Monday, 2016-06-27

*** jamesmcarthur has joined #openstack-infra00:04
*** sflanigan has joined #openstack-infra00:04
*** sflanigan has joined #openstack-infra00:04
*** shashank_hegde has quit IRC00:06
*** rdx_matt has quit IRC00:09
*** shashank_hegde has joined #openstack-infra00:09
*** jamesmcarthur has quit IRC00:10
*** jamesmcarthur has joined #openstack-infra00:10
*** PollyZ has quit IRC00:11
*** camunoz has joined #openstack-infra00:14
*** piet has quit IRC00:17
*** jamesmcarthur has quit IRC00:18
*** sputnik13 has joined #openstack-infra00:18
openstackgerritIan Wienand proposed openstack-infra/puppet-nodepool: Split nodepool and zuul key  https://review.openstack.org/33426000:18
*** jamesmcarthur has joined #openstack-infra00:20
*** shashank_hegde has quit IRC00:22
*** jamesmcarthur has quit IRC00:25
*** rook has joined #openstack-infra00:26
*** thorst has joined #openstack-infra00:27
*** jamesmcarthur has joined #openstack-infra00:27
*** shashank_hegde has joined #openstack-infra00:28
*** hongbin has joined #openstack-infra00:31
*** raunak has quit IRC00:31
*** amitgandhinz has joined #openstack-infra00:32
*** piet has joined #openstack-infra00:33
*** PollyZ has joined #openstack-infra00:35
*** thorst has quit IRC00:36
*** shashank_hegde has quit IRC00:36
*** amitgandhinz has quit IRC00:36
*** thorst has joined #openstack-infra00:37
*** lvdongbing has joined #openstack-infra00:44
*** thorst has quit IRC00:44
*** akshai has joined #openstack-infra00:45
openstackgerritIan Wienand proposed openstack-infra/puppet-nodepool: Split nodepool and zuul key  https://review.openstack.org/33426000:47
*** furlongm has joined #openstack-infra00:48
openstackgerritIan Wienand proposed openstack-infra/puppet-openstackci: Split nodepool and zuul-worker keys  https://review.openstack.org/33426100:49
*** sputnik13 has quit IRC00:50
*** markvoelker has joined #openstack-infra00:51
*** raunak has joined #openstack-infra00:52
openstackgerritIan Wienand proposed openstack-infra/system-config: Split nodepool and zuul user  https://review.openstack.org/33426200:53
*** markvoelker has quit IRC00:56
*** piet has quit IRC00:58
EmilienMjeblair, pabelanger: ubuntu xenial jobs in puppet CI look more stable now01:00
*** esberglu has joined #openstack-infra01:02
openstackgerritIan Wienand proposed openstack-infra/system-config: Split nodepool and zuul user  https://review.openstack.org/33426201:04
*** yamamoto_ has joined #openstack-infra01:05
openstackgerritIan Wienand proposed openstack-infra/project-config: Don't use devuser for zuul-worker  https://review.openstack.org/33365301:06
openstackgerritIan Wienand proposed openstack-infra/project-config: Specify the ZUUL_USER_SSH_PUBLIC_KEY  https://review.openstack.org/33426401:06
*** dimtruck is now known as zz_dimtruck01:06
*** rdx_matt has joined #openstack-infra01:06
*** akshai has quit IRC01:06
*** zhurong has joined #openstack-infra01:16
*** hichihara has joined #openstack-infra01:21
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet/spec_helper/syntax jobs: add missing PUPPET_GEM_VERSION  https://review.openstack.org/33426601:22
*** akshai has joined #openstack-infra01:22
*** akshai_ has joined #openstack-infra01:25
*** salv-orl_ has quit IRC01:25
*** akshai has quit IRC01:28
*** sputnik13 has joined #openstack-infra01:29
*** raunak has quit IRC01:30
*** raunak has joined #openstack-infra01:32
*** amitgandhinz has joined #openstack-infra01:33
*** amotoki has joined #openstack-infra01:34
*** akshai has joined #openstack-infra01:35
*** baoli has joined #openstack-infra01:36
*** amitgandhinz has quit IRC01:37
*** jamesmcarthur has quit IRC01:37
*** akshai_ has quit IRC01:38
*** rdx_matt has quit IRC01:40
*** trey has quit IRC01:41
*** thorst has joined #openstack-infra01:42
openstackgerritIan Wienand proposed openstack-infra/puppet-nodepool: Split nodepool and zuul key  https://review.openstack.org/33426001:47
*** thorst has quit IRC01:50
*** esberglu has quit IRC01:51
*** netsinn has quit IRC01:51
*** markvoelker has joined #openstack-infra01:52
*** shashank_hegde has joined #openstack-infra01:54
*** mriedem has quit IRC01:54
*** salv-orlando has joined #openstack-infra01:56
openstackgerritTony Breeds proposed openstack-infra/project-config: Add dbus-1 development libraries  https://review.openstack.org/33427101:57
*** markvoelker has quit IRC01:57
tonybjhesketh: ^^02:00
jheskethtonyb: ta02:01
*** yanyanhu has joined #openstack-infra02:01
jheskethtonyb: do we actually need to call out glib specifically? won't it be pulled in by dbus?02:02
tonybjhesketh: Yeah without that package you get a slight modifed build failure02:03
jheskethokay, I must already have had that package on my local system because the builds worked oka02:03
*** salv-orlando has quit IRC02:05
openstackgerritJoshua Hesketh proposed openstack-infra/release-tools: Automate retiring old branches  https://review.openstack.org/33387502:07
*** thorst has joined #openstack-infra02:08
*** thorst has quit IRC02:12
*** thorst has joined #openstack-infra02:13
*** Daisy has joined #openstack-infra02:14
*** baoli has quit IRC02:14
openstackgerritIan Wienand proposed openstack-infra/puppet-nodepool: Split nodepool and zuul key  https://review.openstack.org/33426002:18
openstackgerritIan Wienand proposed openstack-infra/puppet-openstackci: Split nodepool and zuul-worker keys  https://review.openstack.org/33426102:18
openstackgerritIan Wienand proposed openstack-infra/system-config: Split nodepool and zuul user  https://review.openstack.org/33426202:18
*** thorst has quit IRC02:22
*** baoli has joined #openstack-infra02:22
*** kushal has joined #openstack-infra02:22
*** sdake_ has quit IRC02:23
openstackgerritIan Wienand proposed openstack-infra/puppet-nodepool: Split nodepool and zuul key  https://review.openstack.org/33426002:26
*** gouthamr_ has quit IRC02:27
*** raunak has quit IRC02:29
*** Daisy has quit IRC02:31
*** Daisy has joined #openstack-infra02:32
*** zz_dimtruck is now known as dimtruck02:32
*** raunak has joined #openstack-infra02:33
*** amitgandhinz has joined #openstack-infra02:34
*** baoli has quit IRC02:36
*** Daisy has quit IRC02:36
*** gongysh has joined #openstack-infra02:37
*** rdx_matt has joined #openstack-infra02:37
*** amitgandhinz has quit IRC02:38
*** amit213 has joined #openstack-infra02:39
*** Daisy has joined #openstack-infra02:40
openstackgerritTony Breeds proposed openstack-infra/project-config: Add dbus-1 development libraries  https://review.openstack.org/33427102:41
ianwtonyb / jhesketh : ahh, is that causing -> http://logs.openstack.org/60/334260/5/check/gate-openstackci-beaker-ubuntu-trusty/ffa14d6/console.html#_2016-06-27_02_34_48_702246 ?02:45
*** raunak has quit IRC02:46
*** baoli has joined #openstack-infra02:46
*** yuanying has quit IRC02:49
jheskethianw: possible... it looks a little different02:51
jheskethianw: it doesn't say why it failed, but it's what is pulling in dbus so that's likely it02:52
*** markvoelker has joined #openstack-infra02:53
tonybianw: Yeah pretty sure that's the same thing02:55
tonybianw: I saw it in the releases repo but anythign that uses launchpadlib or keyring will be busted02:55
*** markvoelker has quit IRC02:57
ianwtonyb / jhesketh : really, packages should be added here? -> https://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/manifests/logserver.pp#n10603:00
jheskethianw: it's possible the logserver will need it too, but we need it in bindep for the jobs03:01
openstackgerritTony Breeds proposed openstack-infra/project-config: Add dbus-1 development libraries  https://review.openstack.org/33427103:02
*** salv-orlando has joined #openstack-infra03:02
*** piet has joined #openstack-infra03:03
*** baoli has quit IRC03:03
tonybianw: I'm sorry I don't know enough puppet to make that chnage, I'd just be fumbling around in the dark03:04
*** akshai has quit IRC03:05
ianwtonyb: it's ok, working on it :)03:05
tonybianw: Thanks.03:05
*** roxanaghe has joined #openstack-infra03:06
*** roxanaghe has quit IRC03:07
*** roxanaghe has joined #openstack-infra03:07
*** sputnik13 has quit IRC03:07
*** Sukhdev has joined #openstack-infra03:10
*** salv-orlando has quit IRC03:10
*** rdx_matt has quit IRC03:10
openstackgerritIan Wienand proposed openstack-infra/puppet-openstackci: Add dbus libs for "keyring" build  https://review.openstack.org/33427903:12
*** yamamoto_ has quit IRC03:12
ianw^ hopefully that unbreaks system-config03:12
*** sputnik13 has joined #openstack-infra03:14
*** pleia2_ is now known as pleia203:15
jheskethianw: what about for rpm distros?03:16
*** coolsvap has joined #openstack-infra03:17
ianwjhesketh: well that already only does debian (build-essential, etc)03:18
jheskeththat's fair03:18
tonybianw: Thanks.  That's not what I would have come up with on my first try, but it makes sense03:19
jheskethianw: small mistake03:19
jhesketh(in review)03:19
*** hongbin has quit IRC03:19
openstackgerritIan Wienand proposed openstack-infra/puppet-openstackci: Add dbus libs for "keyring" build  https://review.openstack.org/33427903:20
*** akshai has joined #openstack-infra03:20
*** thorst has joined #openstack-infra03:22
*** xarses has joined #openstack-infra03:23
*** winggundamth has quit IRC03:23
*** Jeffrey4l_ has quit IRC03:23
*** SergeyLukjanov has quit IRC03:23
*** freerunner has quit IRC03:23
*** mnencia has quit IRC03:24
*** robcresswell has quit IRC03:24
*** Daviey has quit IRC03:25
*** aderyugin has quit IRC03:25
*** SotK has quit IRC03:25
*** mnencia has joined #openstack-infra03:25
*** Daviey has joined #openstack-infra03:26
*** robcresswell has joined #openstack-infra03:27
*** thorst has quit IRC03:27
*** SotK has joined #openstack-infra03:27
*** aderyugin has joined #openstack-infra03:28
*** freerunner has joined #openstack-infra03:29
*** dfflanders has joined #openstack-infra03:30
*** SergeyLukjanov has joined #openstack-infra03:30
openstackgerritMerged openstack-infra/project-config: Add dbus-1 development libraries  https://review.openstack.org/33427103:31
*** jcooley has joined #openstack-infra03:31
openstackgerritIan Wienand proposed openstack-infra/puppet-openstackci: Add dbus libs for "keyring" build  https://review.openstack.org/33427903:33
ianwseriously puppet-lint ... :(03:34
* ianw just watched the silicon valley episode where he breaks up with his girlfriend over tabs/spaces03:34
*** amitgandhinz has joined #openstack-infra03:34
*** Jeffrey4l_ has joined #openstack-infra03:36
*** ramishra has joined #openstack-infra03:38
*** amitgandhinz has quit IRC03:39
*** Daisy has quit IRC03:40
*** Daisy has joined #openstack-infra03:40
*** Daisy has quit IRC03:45
*** yuanying has joined #openstack-infra03:47
*** irdkehn_ has quit IRC03:47
*** irdkehn has joined #openstack-infra03:48
*** markvoelker has joined #openstack-infra03:54
*** sputnik13 has quit IRC03:56
*** binbincong has joined #openstack-infra03:56
*** yamamoto_ has joined #openstack-infra03:58
*** markvoelker has quit IRC03:58
*** Jeffrey4l_ has quit IRC04:00
*** dimtruck is now known as zz_dimtruck04:02
*** zz_dimtruck is now known as dimtruck04:03
*** salv-orlando has joined #openstack-infra04:07
*** rdx_matt has joined #openstack-infra04:08
prometheanfireianw: spaces04:08
*** akshai has quit IRC04:09
*** Jeffrey4l_ has joined #openstack-infra04:09
*** Daisy has joined #openstack-infra04:10
*** roxanaghe has quit IRC04:15
*** Daisy has quit IRC04:15
*** links has joined #openstack-infra04:15
*** salv-orlando has quit IRC04:15
*** Jeffrey4l_ has quit IRC04:21
*** sflanigan has quit IRC04:23
*** thorst has joined #openstack-infra04:25
*** amotoki has quit IRC04:27
*** roxanaghe has joined #openstack-infra04:28
*** garyk has joined #openstack-infra04:28
*** sflanigan has joined #openstack-infra04:30
*** thorst has quit IRC04:32
*** roxanaghe has quit IRC04:32
*** amitgandhinz has joined #openstack-infra04:35
*** amotoki has joined #openstack-infra04:36
*** psachin has joined #openstack-infra04:39
*** Jeffrey4l_ has joined #openstack-infra04:39
*** amitgandhinz has quit IRC04:40
*** rdx_matt has quit IRC04:41
*** pgadiya has joined #openstack-infra04:41
*** salv-orlando has joined #openstack-infra04:42
*** amotoki has quit IRC04:44
*** amit213 has quit IRC04:46
*** salv-orlando has quit IRC04:50
*** markvoelker has joined #openstack-infra04:54
*** ramishra has quit IRC04:55
*** ramishra has joined #openstack-infra04:55
*** markvoelker has quit IRC04:59
*** amotoki has joined #openstack-infra05:02
*** dimtruck is now known as zz_dimtruck05:06
*** _nadya_ has joined #openstack-infra05:07
*** Daisy has joined #openstack-infra05:07
*** shahid__ has joined #openstack-infra05:09
openstackgerritGhanshyam Mann proposed openstack/os-testr: Fix whitelist_file's regex construction with regex  https://review.openstack.org/33272105:13
*** abregman has quit IRC05:13
*** yamahata has quit IRC05:17
*** yamahata has joined #openstack-infra05:18
*** savihou has joined #openstack-infra05:20
*** PollyZ has quit IRC05:25
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DON'T MERGE, TESTING  https://review.openstack.org/33428805:26
*** Daisy has quit IRC05:26
*** Daisy has joined #openstack-infra05:27
*** thorst has joined #openstack-infra05:29
*** Daisy_ has joined #openstack-infra05:32
*** bryan_att has quit IRC05:33
*** winggundamth has joined #openstack-infra05:34
*** thorst has quit IRC05:36
*** amitgandhinz has joined #openstack-infra05:36
*** Daisy has quit IRC05:36
*** lunarlamp is now known as mariusv05:36
*** salv-orlando has joined #openstack-infra05:38
*** rdx_matt has joined #openstack-infra05:38
*** _nadya_ has quit IRC05:38
*** linuxmaniac has joined #openstack-infra05:40
*** linuxmaniac_ has quit IRC05:40
*** amitgandhinz has quit IRC05:40
*** mariusv has quit IRC05:43
*** kushal has quit IRC05:46
*** masayukig has quit IRC05:46
*** masayukig_ has joined #openstack-infra05:46
*** binbincong has quit IRC05:46
openstackgerritMerged openstack/diskimage-builder: Updated from global requirements  https://review.openstack.org/33367305:48
*** linuxmaniac has quit IRC05:50
*** linuxmaniac has joined #openstack-infra05:51
*** dtantsur|afk is now known as dtantsur05:51
*** markvoelker has joined #openstack-infra05:55
*** slaweq_ has joined #openstack-infra05:56
*** jcoufal has joined #openstack-infra05:57
*** jcoufal has quit IRC05:58
*** AJaeger has quit IRC05:58
*** markvoelker has quit IRC06:00
*** binbincong has joined #openstack-infra06:04
*** AJaeger has joined #openstack-infra06:08
AJaegertonyb, looking at https://review.openstack.org/#/c/334271 - we only add in excpetional cases to bindep-fallback. Could you point out why this is needed to be added everywhere?06:10
*** amotoki has quit IRC06:10
tonybAJaeger: all jobs that use launchpadlib / keyring now fail06:11
AJaegertonyb: do you have an example, please?06:11
tonybAJaeger: Looking up the failure06:11
AJaegerthanks, tonyb06:11
*** rdx_matt has quit IRC06:12
AJaegerbtw. regarding nova translations, I just added a link to an email - removing the pot files is fine.06:12
tonybAJaeger: http://logs.openstack.org/59/334259/2/check/gate-releases-tox-validate/ee30f89/console.html#_2016-06-27_02_04_07_03166106:12
AJaegerthanks06:12
*** rdx_matt has joined #openstack-infra06:13
*** amotoki has joined #openstack-infra06:13
AJaegertonyb: So, that's only for the releases repo? IN that case, adding an other-requirements.txt file to releases would be the better solution.06:15
tonybAJaeger: launchpadlib/keyring are used elsewhere so I thought adding it to fallaback was the "quick fix" and then creating other-requirements.txt would be phasee 306:16
tonybsorry phase 206:16
*** _nadya_ has joined #openstack-infra06:16
AJaegertonyb: Good! I didn't see that in the commit message ;)06:16
tonybAJaeger: fair cop06:17
AJaegertonyb: Ok, looking forward to your changes then - you can revert your change and make it dependent on those.06:17
tonybAJaeger: okay06:17
*** ramishra_ has joined #openstack-infra06:19
AJaegerreviewday, elastic-recheck, release-tools have it in requiremetns - as well as gerrit-dash-creator, puppet-openstack-release-tools, releases06:19
*** Daisy_ has quit IRC06:19
*** Daisy has joined #openstack-infra06:20
*** ramishra has quit IRC06:21
tonybAJaeger: Cool.06:22
tonybreviewstats probably should aswell06:23
tonybAJaeger: I have to admit I'm a little hesitant to create other-reqirements.txt's in all those repos06:23
tonybAJaeger: do you have tools for tracking the bindeps based on the python package?06:24
tonybAJaeger: should other-requirements.txt go cover everything? back to python-dev?06:24
tonybAJaeger: sorry for all the questions.06:24
*** Sukhdev has quit IRC06:25
*** ramishra_ has quit IRC06:25
*** ramishra has joined #openstack-infra06:25
AJaegertonyb: copy bindep-fallback and remove what's extra - and then run the tests. The change is self-testing since we always use a other-requirements if it exists06:25
*** _nadya_ has quit IRC06:25
AJaegerI'm not aware of any real tools ;(06:26
tonybAJaeger: okay06:26
*** rcernin has joined #openstack-infra06:27
openstackgerritMerged openstack/diskimage-builder: Handle locales install on Fedora 24  https://review.openstack.org/33311806:29
AJaegertonyb: btw. new images will be uploaded - if successfull in 24 hours - I hope we get some of these other-requirements files in quicker ;)06:31
*** _nadya_ has joined #openstack-infra06:33
*** andreas_s has joined #openstack-infra06:33
*** thorst has joined #openstack-infra06:34
*** yuval has joined #openstack-infra06:36
*** abregman has joined #openstack-infra06:36
tonybAJaeger: optomist ;P06:36
*** amitgandhinz has joined #openstack-infra06:37
AJaegerI said some ;)06:38
yuvalHey, could anyone please help review and/or merge https://review.openstack.org/334246/ which affects Smaug fullstack tests? ( yolanda AJaeger ? ) Thanks!06:38
AJaegeryuval: didn't I review it already?06:38
yuvalYes, thanks06:39
yuvalAnyone else I can refer to for the second +2 ?06:39
*** nmagnezi has joined #openstack-infra06:39
AJaegeryuval: not many people around right now - yolanda, ianw, jhesketh might see the above ^ - otherwise, please wait until the US wakes up...06:40
* jhesketh looking06:41
yolandahi, good morning06:41
*** pcaruana has joined #openstack-infra06:41
*** zeih has joined #openstack-infra06:41
*** amitgandhinz has quit IRC06:41
jheskethyuval: lgtm06:41
*** thorst has quit IRC06:41
yuvaljhesketh: AJaeger: thank you :)06:42
*** Daisy_ has joined #openstack-infra06:43
*** Daisy has quit IRC06:46
AJaegertonyb: shall I help with other-requirements? I can do one or two repos if you like...06:47
*** zz_dimtruck is now known as dimtruck06:49
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Fix JOB_NAME parameter  https://review.openstack.org/33430506:49
openstackgerritMerged openstack-infra/project-config: Fix invalid path to Smaug devstackgaterc  https://review.openstack.org/33424606:49
*** hdaniel has joined #openstack-infra06:50
tonybAJaeger: I'm okay to do them but it wont be today.  it's getting close to dinner time and hungry kids ... etc06:51
oferbyhi, can anyone let me know what is the status of this: https://review.openstack.org/#/c/332091/306:51
AJaegertonyb: Fine with me - enjoy dinner!06:52
*** _nadya_ has quit IRC06:52
AJaegeroferby: since armax had some comments on it, I'm waiting on his conclusion06:52
oferbywe had a talk in IRC. we agreed that it would be good to create a new project than use the L2GW.06:53
*** jlanoux has joined #openstack-infra06:53
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Fix JOB_NAME parameter  https://review.openstack.org/33430506:53
*** markvoelker has joined #openstack-infra06:56
*** ccamacho has joined #openstack-infra06:57
*** d0ugal has joined #openstack-infra06:58
*** amotoki has quit IRC06:58
AJaegeroferby: please ask armax to comment on the review06:58
oferbyOK. I will.06:58
AJaegeroferby: for new project creation I'd like to see consensus06:59
oferbysure. thanks.06:59
openstackgerritMerged openstack-infra/project-config: puppet/spec_helper/syntax jobs: add missing PUPPET_GEM_VERSION  https://review.openstack.org/33426606:59
*** d0ugal has quit IRC06:59
*** tesseract- has joined #openstack-infra06:59
openstackgerritMerged openstack-infra/puppet-openstackci: Add dbus libs for "keyring" build  https://review.openstack.org/33427906:59
*** yuval has left #openstack-infra07:00
*** d0ugal has joined #openstack-infra07:00
*** d0ugal has quit IRC07:00
*** d0ugal has joined #openstack-infra07:00
*** markvoelker has quit IRC07:01
*** jamielennox is now known as jamielennox|away07:01
ttxclarkb: that would be the Discovery folks07:01
*** e0ne has joined #openstack-infra07:01
ttxhttps://www.openstack.org/videos/video/a-ring-to-rule-them-all-revising-openstack-internals-to-operate-massively-distributed-clouds07:02
*** ttx has quit IRC07:03
openstackgerritMerged openstack-infra/project-config: Add driver compliance checks to check pipeline  https://review.openstack.org/33119207:03
*** ttx has joined #openstack-infra07:04
*** Ravikiran_K has joined #openstack-infra07:04
*** yamahata has quit IRC07:06
openstackgerritMerged openstack-infra/project-config: [Rally] Enable Ceilometer for one of the 'rally verify' jobs  https://review.openstack.org/32715707:08
*** persia has quit IRC07:08
*** Na3iL has joined #openstack-infra07:09
openstackgerritOfer Ben-Yacov proposed openstack-infra/project-config: Add new project: networking-icc  https://review.openstack.org/33209107:09
*** jtomasek has joined #openstack-infra07:11
*** persia has joined #openstack-infra07:11
*** jed56 has joined #openstack-infra07:11
*** ihrachys has joined #openstack-infra07:12
*** e0ne has quit IRC07:16
*** roxanaghe has joined #openstack-infra07:16
*** e0ne has joined #openstack-infra07:16
*** shashank_hegde has quit IRC07:18
*** dtardivel has joined #openstack-infra07:18
*** rvba has joined #openstack-infra07:20
*** rvba has quit IRC07:20
*** rvba has joined #openstack-infra07:20
*** roxanaghe has quit IRC07:20
*** amotoki has joined #openstack-infra07:22
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Fix JOB_NAME parameter  https://review.openstack.org/33430507:26
*** ifarkas has joined #openstack-infra07:28
*** amotoki has quit IRC07:28
*** abregman_ has joined #openstack-infra07:30
*** dmk0202 has joined #openstack-infra07:31
*** jpich has joined #openstack-infra07:31
*** abregman has quit IRC07:32
*** masayukig_ is now known as masayukig07:33
*** javeriak has joined #openstack-infra07:33
*** vincentll has joined #openstack-infra07:36
*** amitgandhinz has joined #openstack-infra07:37
*** arxcruz has joined #openstack-infra07:38
*** oanson has joined #openstack-infra07:38
*** amotoki has joined #openstack-infra07:39
*** isaacb has joined #openstack-infra07:39
*** abregman_ has quit IRC07:40
*** thorst has joined #openstack-infra07:40
*** abregman has joined #openstack-infra07:40
*** amitgandhinz has quit IRC07:42
*** HeOS has joined #openstack-infra07:45
*** thorst has quit IRC07:46
*** shardy has joined #openstack-infra07:47
*** pilgrimstack has joined #openstack-infra07:50
*** Nikolay_St has joined #openstack-infra07:53
*** abregman has quit IRC07:55
*** permalac has joined #openstack-infra07:56
*** dizquierdo has joined #openstack-infra07:57
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-infra08:02
*** lucas-afk is now known as lucasagomes08:02
*** Qiming has quit IRC08:03
*** salv-orlando has quit IRC08:04
*** jlanoux has quit IRC08:05
*** flepied1 has quit IRC08:06
*** Qiming has joined #openstack-infra08:06
*** shahid__ has quit IRC08:07
*** skraynev has joined #openstack-infra08:07
*** linuxmaniac has quit IRC08:09
*** abregman has joined #openstack-infra08:09
*** isaacb has quit IRC08:09
*** linuxmaniac has joined #openstack-infra08:10
openstackgerritChaoyi Huang proposed openstack-infra/project-config: Add the Tricircle functional test job  https://review.openstack.org/32974008:12
*** sorantis has joined #openstack-infra08:12
*** rpodolyaka_pto is now known as rpodolyaka08:12
*** eezhova has joined #openstack-infra08:13
openstackgerritAnton Arefiev proposed openstack-infra/project-config: Don't remove stack sudo on inspector discovery job  https://review.openstack.org/33433708:14
*** dfflanders has quit IRC08:14
openstackgerritIan Wienand proposed openstack-infra/puppet-openstackci: Split nodepool and zuul-worker keys  https://review.openstack.org/33426108:20
*** rossella_s has joined #openstack-infra08:24
*** salv-orlando has joined #openstack-infra08:25
*** itisha has joined #openstack-infra08:28
*** vgridnev_ has joined #openstack-infra08:31
*** electrofelix has joined #openstack-infra08:32
*** shardy has quit IRC08:32
*** shardy has joined #openstack-infra08:34
*** hichihara has quit IRC08:34
*** derekh has joined #openstack-infra08:36
openstackgerritDerek Higgins proposed openstack-infra/project-config: Revert "Disable instances on rh2"  https://review.openstack.org/33434708:37
derekhWe disabled rh2 on friday to work on some issues with large qcow images, the problem is now gone on rh2 and ^^ re-enables the cloud08:38
*** amitgandhinz has joined #openstack-infra08:38
*** fawadkhaliq has joined #openstack-infra08:39
*** _nadya_ has joined #openstack-infra08:39
*** amitgandhinz has quit IRC08:43
*** thorst has joined #openstack-infra08:44
*** zeih has quit IRC08:47
*** markusry has joined #openstack-infra08:50
*** thorst has quit IRC08:52
*** vgridnev_ has quit IRC08:52
*** esikachev has joined #openstack-infra08:53
openstackgerritMilan Kováčik proposed openstack-infra/project-config: Introduce experimental Inspector grenade job  https://review.openstack.org/33100108:53
*** yamamoto_ has quit IRC08:56
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Nothing to see here  https://review.openstack.org/11101108:57
*** skraynev has quit IRC08:58
*** ianychoi has joined #openstack-infra09:00
*** Srinu has joined #openstack-infra09:04
SrinuHi09:04
*** roxanaghe has joined #openstack-infra09:05
SrinuHi. In Jenkins CI while the job is running the Slave went offline09:06
Srinuwith error as SEVERE: I/O error in channel09:06
Srinuin jenkins logs09:06
Srinuroxanaghe: hi09:07
*** dizquierdo has quit IRC09:07
Srinufungi: hi09:07
*** Na3iL has quit IRC09:08
*** zeih has joined #openstack-infra09:10
*** acoles_ is now known as acoles09:11
*** zeih has quit IRC09:11
*** Na3iL has joined #openstack-infra09:11
*** zeih has joined #openstack-infra09:11
*** asettle has joined #openstack-infra09:12
*** sambetts|afk is now known as sambetts09:13
*** roxanaghe has quit IRC09:14
*** skraynev has joined #openstack-infra09:15
*** zeih has quit IRC09:16
*** chem has joined #openstack-infra09:17
*** chem has quit IRC09:19
*** chem has joined #openstack-infra09:20
*** sheeprine has quit IRC09:21
*** sheeprine has joined #openstack-infra09:21
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Nothing to see here  https://review.openstack.org/11101109:21
openstackgerritTobias Henkel proposed openstack-infra/zuul: Use ssh for git-upload-pack  https://review.openstack.org/20003409:22
*** Daisy_ has quit IRC09:23
*** Daisy has joined #openstack-infra09:24
*** amotoki has quit IRC09:24
*** amotoki has joined #openstack-infra09:25
vsaienkoHello infra team! Is it possible to have multinode VMs interconnected via several networks?09:25
*** amotoki has quit IRC09:25
vsaienko*I mean VMs from multinode jobs09:26
*** jamielennox|away is now known as jamielennox09:26
yolandahi vsaienko . Yes, there are some examples on project-config09:27
yolandalook at zuul for dsvm-multinode jobs09:27
*** sshnaidm is now known as sshnaidm|afk09:28
*** shahid__ has joined #openstack-infra09:30
*** Daisy_ has joined #openstack-infra09:33
*** _degorenko|afk is now known as degorenko09:33
*** Daisy has quit IRC09:36
*** claudiub has joined #openstack-infra09:37
openstackgerritSampath Priyankara proposed openstack-infra/infra-manual: cookiecutter need '-f' option  https://review.openstack.org/33437209:38
*** zeih has joined #openstack-infra09:38
*** Daisy_ has quit IRC09:39
*** amitgandhinz has joined #openstack-infra09:39
*** Daisy has joined #openstack-infra09:39
*** zeih has quit IRC09:43
*** pgadiya has quit IRC09:43
*** amitgandhinz has quit IRC09:43
*** dimtruck is now known as zz_dimtruck09:43
*** Daisy has quit IRC09:44
*** Daisy has joined #openstack-infra09:44
*** lvdongbing has quit IRC09:47
*** tosky has joined #openstack-infra09:47
*** Daisy has quit IRC09:49
*** thorst has joined #openstack-infra09:49
*** javeriak has quit IRC09:50
*** javeriak has joined #openstack-infra09:55
*** strigazi_ is now known as strigazi09:56
*** thorst has quit IRC09:57
openstackgerritTobias Henkel proposed openstack-infra/zuul: Fix projects entering pipeline without jobs  https://review.openstack.org/33437809:58
tobiashjhesketh: ^^09:59
*** robot has quit IRC09:59
vsaienkoyolanda: thank you!10:00
tobiashjhesketh: do you still remember this problem? Now I found time to fix this.10:00
*** zhurong has quit IRC10:00
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Free up more diskspace on jenkins slaves befor CI starts  https://review.openstack.org/33438310:01
tobiashjhesketh: I just referenced to your testcase in review, hope that's ok10:01
*** javeriak has quit IRC10:03
*** javeriak has joined #openstack-infra10:03
*** zeih has joined #openstack-infra10:05
*** amotoki has joined #openstack-infra10:06
*** flepied has joined #openstack-infra10:06
*** john-davidge has joined #openstack-infra10:09
Srinuvsaienko: hi10:09
Srinuyolanda: hi10:09
yolandaSrinu, hi10:10
*** asettle has quit IRC10:10
Srinuyolanda:  i am using Jenkins CI During Job in progress the slave went offline10:10
*** asettle has joined #openstack-infra10:11
Srinuyolanda: did you face that issue anytime.10:11
*** zeih has quit IRC10:11
*** dims has quit IRC10:14
*** dims has joined #openstack-infra10:20
openstackgerritAlexander Evseev proposed openstack-infra/puppet-jenkins: Add workaround for Jenkins' SECURITY-170  https://review.openstack.org/33440010:22
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Free up more diskspace on jenkins slaves befor CI starts  https://review.openstack.org/33438310:23
john-davidgeHello all. Is this the right place to ask about blocking a spamming user from submitting launchpad bugs?10:26
yolandaSrinu, yes, sometimes. It can be a communication error between the slave and master. Just retry the job10:30
fricklerjohn-davidge: probably https://answers.launchpad.net/launchpad will be better10:32
Srinuyolanda: it is continue for the jobs 2/10 are passed remaining are failed10:32
*** sdague has joined #openstack-infra10:32
*** zeih has joined #openstack-infra10:33
john-davidgefrickler: Hmm, so we have no control over openstack projects in LP?10:34
Srinujohn-davidge: hi10:34
john-davidgeSrinu: Hi there10:35
vsaienkoyolanda: I can't find any example of multi interface configuration in multinode jobs, could you please provide an example?10:35
Srinujohn-davidge: I am using Jenkins CI for Openstack. While the job is running the Slave went offline and job reports failed. the error i am getting in jenkins logs as:10:36
Srinujohn-davidge: SEVERE: I/O error in channel K2-iSCSI-local_01-151 java.io.IOException: Unexpected termination of the channel         at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:50)10:36
fricklerjohn-davidge: I don't think so, but I might be wrong. I did have good success with the above URL for getting spam comments on bugs removed, though10:37
*** zeih has quit IRC10:37
john-davidgefrickler: Ok thanks, will give it a try10:37
john-davidgeSrinu: Sorry, I'm not familiar with running Jenkins. Hopefully someone from the infra team can answer your questions10:38
*** zeih has joined #openstack-infra10:38
Srinujohn-davidge: Thank you10:38
*** fawadkhaliq has quit IRC10:39
*** Goneri has joined #openstack-infra10:39
*** amitgandhinz has joined #openstack-infra10:40
yolandavsaienko, so inside project-config, there is one devstack-gate job that runs with multinode, and also there is puppet integration jobs10:40
yolandayou will need to check internals about how that projects are configured10:40
*** eezhova has quit IRC10:42
*** links has quit IRC10:43
*** amitgandhinz has quit IRC10:44
*** pao_ has joined #openstack-infra10:47
*** dizquierdo has joined #openstack-infra10:47
vsaienkoyolanda, as far I see only DEVSTACK_GATE_TOPOLOGY=multinode is set for grenade-dsvm-multinode job. According to the job logs there are 2 physycal interfaces inside VMs (eth0 and eth1) http://logs.openstack.org/85/326585/12/check/gate-grenade-dsvm-multinode/a9acc6f/console.html#_2016-06-24_19_27_49_63154610:48
*** daemontool has joined #openstack-infra10:50
vsaienkoyolanda, so network connection for subnodes looks like (subnode-1 eth0 <----> eth0 subnode-2, subnode-1 eth1 <----> eth1 subnode-2). eth0 is management interface. Am I right?10:53
*** roxanaghe has joined #openstack-infra10:53
*** thorst has joined #openstack-infra10:54
*** links has joined #openstack-infra10:55
*** erlon has joined #openstack-infra10:57
*** roxanaghe has quit IRC10:58
*** Goneri has quit IRC10:58
openstackgerritZara proposed openstack-infra/storyboard-webclient: Show Each Task ID in Story Detail View  https://review.openstack.org/27266710:58
*** salv-orl_ has joined #openstack-infra10:59
*** markvoelker has joined #openstack-infra10:59
yolandavsaienko, sorry but I cannot help much more with that11:01
*** salv-orl_ has quit IRC11:01
*** Daisy has joined #openstack-infra11:01
*** thorst has quit IRC11:02
*** salv-orlando has quit IRC11:02
*** markvoelker has quit IRC11:03
*** ccamacho is now known as ccamacho|lunch11:03
*** Daisy has quit IRC11:06
*** baoli has joined #openstack-infra11:07
*** baoli_ has joined #openstack-infra11:08
*** Goneri has joined #openstack-infra11:11
*** sputnik13 has joined #openstack-infra11:11
*** baoli has quit IRC11:12
*** tpsilva has joined #openstack-infra11:12
*** esikachev has quit IRC11:16
*** sree has joined #openstack-infra11:17
*** Goneri has quit IRC11:18
*** Jeffrey4l_ has quit IRC11:18
*** fawadkhaliq has joined #openstack-infra11:20
*** sree has quit IRC11:21
*** kushal has joined #openstack-infra11:21
*** sree has joined #openstack-infra11:21
*** eezhova has joined #openstack-infra11:21
openstackgerritAndreas Jaeger proposed openstack-infra/bindep: Handle platform and normal profiles  https://review.openstack.org/33442111:25
*** sree has quit IRC11:25
openstackgerritAndreas Jaeger proposed openstack-infra/bindep: Handle platform and normal profiles  https://review.openstack.org/33442111:25
*** weshay_afk is now known as weshay11:26
*** savihou has quit IRC11:29
*** savihou has joined #openstack-infra11:29
*** sshnaidm|afk is now known as sshnaidm11:30
*** Jeffrey4l_ has joined #openstack-infra11:30
*** sree has joined #openstack-infra11:31
*** aviau has quit IRC11:32
*** aviau has joined #openstack-infra11:33
openstackgerritTobias Henkel proposed openstack-infra/zuul: Fix projects entering pipeline without jobs  https://review.openstack.org/33437811:33
*** gordc has joined #openstack-infra11:36
*** Jeffrey4l_ has quit IRC11:38
*** ldnunes has joined #openstack-infra11:39
*** amitgandhinz has joined #openstack-infra11:40
*** yamamoto_ has joined #openstack-infra11:41
*** sputnik13 has quit IRC11:43
*** amitgandhinz has quit IRC11:45
*** akshai has joined #openstack-infra11:46
*** esikachev has joined #openstack-infra11:46
*** yamamoto has joined #openstack-infra11:47
openstackgerritAndreas Jaeger proposed openstack-infra/bindep: Handle platform and normal profiles  https://review.openstack.org/33442111:48
*** akshai has quit IRC11:48
*** yamamoto_ has quit IRC11:50
*** thorst has joined #openstack-infra11:50
AJaegerpoor zuul: "Queue lengths: 12056 events, 547 results.  "11:51
*** thorst_ has joined #openstack-infra11:51
*** javeriak has quit IRC11:54
john-davidgeUser account "prabhu murthy" seems to be being used as an unofficial third party CI11:54
john-davidgeAnd it's posting twice on the patches it tests11:54
john-davidgesee https://review.openstack.org/#/c/293305/11:54
*** thorst has quit IRC11:55
*** cshastri_ has joined #openstack-infra11:55
*** raildo-a` is now known as raildo11:56
dhellmannAJaeger : I have a job failing to merge a patch to openstack/releases because dbus isn't present. Can you help me figure out what I need to change to add the dependency? This used to work, so I'm not sure what changed. http://logs.openstack.org/23/333523/2/gate/gate-releases-tox-validate/90e406a/console.html11:56
*** yanyanhu has quit IRC11:57
AJaegerdhellmann: two options: Wait until tomorrow and we have new images and change https://review.openstack.org/334271  is merged (option 1) or: Create other-requirements.txt file for your repo11:57
AJaeger(option 2)11:57
*** Jeffrey4l_ has joined #openstack-infra11:58
dhellmannwhat's the format for other-requirements.txt?11:58
AJaegerdhellmann: problem is new release of launchpadlib that needs dbus as dependency.11:58
openstackgerritEmilien Macchi proposed openstack-infra/project-config: zuul/layout: remove Puppet rules for old branches  https://review.openstack.org/33443511:58
dhellmannoh, so I could block that, too11:58
AJaegerdhellmann: http://docs.openstack.org/infra/bindep/11:58
AJaegerdhellmann: also check projects that use it already like project-config11:58
*** cshastri_ is now known as cshastri11:58
AJaegeror swift11:58
*** asettle has quit IRC11:59
*** lucasagomes is now known as lucas-hungry11:59
AJaegerdhellmann: if you have a change, I'll help reviewing - or can do a quick one for you...12:00
*** rhallisey has joined #openstack-infra12:00
*** aysyd has joined #openstack-infra12:00
*** yamamoto has quit IRC12:01
*** Daisy has joined #openstack-infra12:01
dhellmannAJaeger : I'm going to tag these releases and deal with the build issue later, I have to catch a flight shortly12:01
AJaegerdhellmann: shall I create an other-requirements change for you?12:02
AJaegerdhellmann: safe travels!12:02
dhellmannAJaeger : if you can, yes please. I'm going to figure out which version of the lib to exclude for now12:03
*** cshastri has quit IRC12:03
AJaegerok, chagne will be there in 10 mins or so...12:03
*** cshastri has joined #openstack-infra12:03
*** asettle has joined #openstack-infra12:03
*** trown is now known as trown|outtypewww12:04
*** daemontool has quit IRC12:05
*** daemontool has joined #openstack-infra12:05
AJaegerdhellmann: will need a few iteration to see whether everything works...12:06
*** rodrigods has quit IRC12:06
*** rodrigods has joined #openstack-infra12:06
openstackgerritAndreas Jaeger proposed openstack-infra/bindep: Handle platform and normal profiles  https://review.openstack.org/33442112:08
*** amotoki has quit IRC12:08
*** jcoufal has joined #openstack-infra12:08
*** amotoki has joined #openstack-infra12:09
dhellmannAJaeger : https://review.openstack.org/33444212:10
*** ccamacho|lunch is now known as ccamacho12:10
AJaegerdhellmann: should do the trick ;) Mine is https://review.openstack.org/33444012:10
*** Daisy has quit IRC12:11
dhellmannAJaeger : thanks, I'll keep an eye on that12:11
*** amoralej is now known as amoralej|lunch12:11
*** Daisy has joined #openstack-infra12:11
openstackgerritMerged openstack-infra/storyboard-webclient: Make the Tags resource look for existing tags to filter by  https://review.openstack.org/33103012:14
*** markvoelker has joined #openstack-infra12:14
openstackgerritMerged openstack-infra/storyboard-webclient: Only request desired timeline events  https://review.openstack.org/33164612:16
*** lvdongbing has joined #openstack-infra12:17
anteayalennyb: hello, there! I'm traveling today and was wondering if you might have time to chair the third party meeting at 15:00 utc today?12:17
*** krtaylor has quit IRC12:18
*** Daisy_ has joined #openstack-infra12:18
AJaegerdhellmann: my change has passed, so feel free to merge anytime...12:18
AJaegerdhellmann: and yours is passing as well ...12:18
*** yamamoto has joined #openstack-infra12:19
*** yamamoto has quit IRC12:19
lennybanteaya: np, have a nice trip12:19
*** Daisy has quit IRC12:20
*** pradk has joined #openstack-infra12:21
*** yamamoto has joined #openstack-infra12:22
anteayalennyb: thanks so much, I appreciate it12:22
*** psilvad_ has joined #openstack-infra12:22
anteayalennyb: crowds are smaller these days, but you never know who you are going to get12:22
anteayadhellmann: safe flight12:23
openstackgerritMerged openstack-infra/tripleo-ci: Free up more diskspace on jenkins slaves befor CI starts  https://review.openstack.org/33438312:23
dhellmannAJaeger : thanks, approved12:24
dhellmannanteaya : thanks, you too12:24
*** Daisy_ has quit IRC12:28
*** Daisy has joined #openstack-infra12:28
*** derekh is now known as derekh_afk12:29
openstackgerritAndreas Jaeger proposed openstack-infra/bindep: Handle platform and normal profiles  https://review.openstack.org/33442112:29
*** Srinu has quit IRC12:29
openstackgerritSagi Shnaidman proposed openstack-infra/gear: WIP: Support TCP keepalives in geard  https://review.openstack.org/33445212:29
AJaegeranteaya: safe travels!12:29
AJaegerdhellmann: thanks12:29
*** eharney has joined #openstack-infra12:29
*** sigmavirus24_awa is now known as sigmavirus2412:30
*** infra-red has joined #openstack-infra12:31
*** fawadkhaliq has quit IRC12:31
*** infra-red has quit IRC12:32
*** fawadkhaliq has joined #openstack-infra12:32
*** wfoster is now known as wfoster_afk12:32
*** Nikolay_St has quit IRC12:36
*** fawadkhaliq has quit IRC12:37
*** amotoki has quit IRC12:39
*** amitgandhinz has joined #openstack-infra12:41
*** wfoster_afk is now known as wfoster12:41
*** yamamoto has quit IRC12:44
*** salv-orlando has joined #openstack-infra12:44
*** yamamoto has joined #openstack-infra12:44
openstackgerritJames Page proposed openstack-infra/project-config: Add charm-guide repository  https://review.openstack.org/33291612:44
*** rlandy has joined #openstack-infra12:46
*** amitgandhinz has quit IRC12:47
jamespagehi all12:47
jamespageany requirements reviewers around?12:47
jamespagewe're tripping on a new -dev package requirement due to a new release of keychain which ends up pulling in dbus-python12:47
jamespagehttps://review.openstack.org/#/c/334358/12:47
*** esberglu has joined #openstack-infra12:47
jamespageI can obviously wedge that directly into the charms repositories, but this felt like a change once/fix everywhere approach - thoughts?12:48
anteayaAJaeger: dhellmann thank you12:48
anteayajamespage: I think there is a requirements channel, if so there would be a greater ratio of them in that channel12:49
*** Nikolay_St has joined #openstack-infra12:49
jamespageanteaya, I'll go ask there!12:49
jamespageta12:49
*** yamamoto has quit IRC12:49
*** kdas_ has joined #openstack-infra12:50
openstackgerritMerged openstack-dev/hacking: Fix Google Python Style Guide link.  https://review.openstack.org/33419812:51
anteayawelcome12:51
*** kushal has quit IRC12:51
*** salv-orlando has quit IRC12:51
*** akshai has joined #openstack-infra12:51
*** matrohon has joined #openstack-infra12:52
*** kdas_ is now known as kushal12:53
*** kushal is now known as Guest2084812:54
*** Guest20848 is now known as kushal12:55
*** kushal has joined #openstack-infra12:55
*** amoralej|lunch is now known as amoralej12:56
openstackgerritAndreas Jaeger proposed openstack-infra/bindep: Handle platform and normal profiles  https://review.openstack.org/33442112:57
AJaegerjamespage: #openstack-releases is the name12:57
AJaegerjamespage: oh, there's openstack-requirements as well now...12:57
john-davidgeanteaya: ping12:58
AJaegerjamespage: see my comment above to dhellmann - wait for new images or use other-requirements.txt file12:58
* jamespage reads12:58
anteayajohn-davidge: I'm about to power down to pack up, I can answer a quick question, or ask your question and perhaps others can assist12:58
AJaegerusing other-requirments.txt is the faster solution...12:58
jamespageAJaeger, yeah - guessed that was the case - I'll abandon my review for the same change ...12:59
AJaegerjamespage: example change: https://review.openstack.org/33444012:59
john-davidgeanteaya: Ah ok no worries, just wanted to draw your attention to a gerrit account that's spamming neutron patches with unusual third party CI reviews12:59
jamespageAJaeger, thanks - already figured it out in https://review.openstack.org/#/c/331899/13:00
john-davidgeanteaya: Account name is "prabhu murthy". Here's an example: https://review.openstack.org/#/c/293305/13:00
*** coolsvap has quit IRC13:00
anteayajohn-davidge: oh yes I do want to know about that, thank you so much13:00
AJaegerjamespage: yeah, that could work. Note that other-requirements *replaces* our default list13:00
*** flepied1 has joined #openstack-infra13:00
*** derekh_afk is now known as derekh13:01
jamespageAJaeger, not aware of the per distro syntax tho  - that's useful13:01
jamespagethanks for the pointer13:01
john-davidgeanteaya: Happy to help :)13:01
anteayajohn-davidge: thank you :)13:01
*** edmondsw has joined #openstack-infra13:01
*** flepied has quit IRC13:02
AJaegerlifeless, fungi, pabelanger : I'm teaching bindep how to properly handle platforms, please review https://review.openstack.org/33442113:02
*** gouthamr has joined #openstack-infra13:02
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Revert "puppet: xenial jobs are now -nv"  https://review.openstack.org/33446413:02
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477713:03
derekhWe had a problem enabling rh2 last week, so it was temporarily disabled, the problem was in the interaction between glance and swift (only for large images I think), anyways we've moved images to the file backend while we investigate the cause,13:03
derekhso it should be ok to reenable rh2 https://review.openstack.org/#/c/334347/13:03
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: ceilometer install-guide jobs  https://review.openstack.org/33446513:04
*** Na3iL has quit IRC13:04
anteayainfra-root: please disable gerrit account 12708: http://paste.openstack.org/show/523545/ for using a personal account for automated comments and for spamming neutron patches, example is: https://review.openstack.org/#/c/293305/ thanks to john-davidge for reporting13:04
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Fix openstack-tripleo-common package name  https://review.openstack.org/33446713:04
*** wanghua has joined #openstack-infra13:05
anteayaI don't think there needs to be an email follow up, I am about to go offline since I am traveling today13:05
*** akshai has quit IRC13:05
anteayaAJaeger: could you draw infra-root attention to my request if they miss it?13:05
AJaegeranteaya: I'll try to remember.13:05
john-davidgeanteaya: Thanks for the quick action, have a nice trip!13:05
*** oanson has quit IRC13:05
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477713:06
anteayaAJaeger: thank you13:06
anteayajohn-davidge: thanks for reporting13:06
anteaya<-- offline13:06
*** abregman is now known as abregman|mtg13:06
*** yamamoto has joined #openstack-infra13:08
openstackgerritJames Page proposed openstack-infra/project-config: Add charms.openstack  https://review.openstack.org/33447013:08
*** fawadkhaliq has joined #openstack-infra13:09
*** akshai has joined #openstack-infra13:09
*** lucas-hungry is now known as lucasagomes13:09
*** sdake has joined #openstack-infra13:10
*** maishsk has joined #openstack-infra13:10
wanghuaHi all, Does anyone know after a patch which modifies jenkins jobs in project-config is merged, how the jobs in jenkins is updated? How to trigger it?13:11
*** krtaylor has joined #openstack-infra13:11
AJaegerwanghua: there's automatic deployment using puppet, so once your job is merged, the changes should be active in at least an hour.13:11
openstackgerritJames Page proposed openstack-infra/project-config: Add charm-guide repository  https://review.openstack.org/33291613:11
AJaegerwanghua: note that we still use the jenkins job format but not jenkins anymore, zuul-launcher is doing it.13:12
*** fawadkhaliq has quit IRC13:12
AJaegerwanghua: what is your problem?13:12
*** matt-borland has joined #openstack-infra13:12
*** sshnaidm has quit IRC13:12
wanghuaAJaeger: where is the puppet module to update it13:12
openstackgerritAndreas Jaeger proposed openstack-infra/bindep: Handle platform and normal profiles  https://review.openstack.org/33442113:14
AJaegerwanghua: can't help with that detail13:14
wanghuaAJaeger: thank you for your help13:14
*** eezhova has quit IRC13:15
*** sshnaidm has joined #openstack-infra13:16
*** amitgandhinz has joined #openstack-infra13:18
*** zhurong has joined #openstack-infra13:18
*** e0ne has quit IRC13:18
*** e0ne has joined #openstack-infra13:18
*** joaotargino has quit IRC13:19
*** psachin has quit IRC13:19
openstackgerritMerged openstack-infra/storyboard-webclient: Show Each Task ID in Story Detail View  https://review.openstack.org/27266713:19
*** sdake_ has joined #openstack-infra13:20
*** cshastri has quit IRC13:20
*** jsavak has joined #openstack-infra13:21
*** psachin has joined #openstack-infra13:21
*** sdake has quit IRC13:21
*** isaacb has joined #openstack-infra13:21
*** eezhova has joined #openstack-infra13:22
mordredwanghua: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/zuul_launcher.pp#n39 lines 39-6013:22
*** mriedem has joined #openstack-infra13:23
*** hdaniel has quit IRC13:24
*** mdrabe has joined #openstack-infra13:24
*** inc0 has joined #openstack-infra13:28
*** e0ne has quit IRC13:29
*** Na3iL has joined #openstack-infra13:29
*** garyk has quit IRC13:30
*** e0ne has joined #openstack-infra13:30
*** weshay is now known as weshay_mtg13:31
Shrewsmordred: jeblair: looks like mordred's change may be doing the trick? http://logs.openstack.org/56/334456/1/check/gate-puppet-openstack-integration-3-scenario003-tempest-ubuntu-xenial-nv/8fc6fe3/_zuul_ansible/ansible_log.txt13:31
*** amitgandhinz has quit IRC13:31
*** pradk has quit IRC13:31
openstackgerritAndreas Jaeger proposed openstack-infra/bindep: Handle SUSE platforms  https://review.openstack.org/33447913:32
*** amitgandhinz has joined #openstack-infra13:32
*** flepied1 has quit IRC13:33
*** lvdongbing has quit IRC13:34
AJaegermordred: could you review https://review.openstack.org/#/c/315575 , please? That's a better vrsion than ^ which I just abandoned...13:36
Shrewsall of the xenial jobs from 334456 have passed13:36
ShrewsEmilienM: ^^^13:37
*** mdrabe has quit IRC13:37
*** cshastri has joined #openstack-infra13:37
EmilienMShrews: excellent13:38
*** mdrabe has joined #openstack-infra13:38
EmilienMShrews: https://review.openstack.org/33446413:38
fungianteaya: account 12708 has been set inactive and its one active connection successfully closed13:38
openstackgerritRaildo Mascena proposed openstack-infra/project-config: Run glanceclient functional tests in Identity v3-only  https://review.openstack.org/31357213:39
AJaegerthanks, fungi!13:39
openstackgerritMatthew Treinish proposed openstack-infra/project-config: Add trove-dashboard to project list on layer4 job  https://review.openstack.org/33448313:39
mtreinishAJaeger, fungi, anteaya: ^^^13:40
AJaegermtreinish: LGTM, +213:40
mtreinishAJaeger: thanks13:41
mtreinishEmilienM: ^^^ that should fix the layer4 job and unblock tempest13:41
*** burgerk has joined #openstack-infra13:41
*** xyang1 has joined #openstack-infra13:41
AJaegerfungi, do you have a few minutes to discuss bindep?13:42
openstackgerritMatthew Treinish proposed openstack-infra/project-config: Remove trove from the layer4 job  https://review.openstack.org/33448513:42
AJaegermtreinish: which change do you want - 85 or 83? Aren't they in conflict?13:43
fungiAJaeger: i'm already looking at the patch you pinged me about earlier if that's what you're talking about13:44
mtreinishAJaeger: 85 is based ontop of 83 and depends on a tempest change13:44
*** inc0 has quit IRC13:44
AJaegerfungi: yes, great!13:44
mtreinish83 is just to unblock the tempest gate13:44
AJaegermtreinish: I see...13:44
*** nwkarsten has joined #openstack-infra13:45
*** _d34dh0r53_ is now known as d34dh0r5313:45
*** pradk has joined #openstack-infra13:45
*** eharney has quit IRC13:46
*** tongli has joined #openstack-infra13:47
*** _nadya_ has quit IRC13:48
*** r-mibu has quit IRC13:48
*** r-mibu has joined #openstack-infra13:48
*** salv-orlando has joined #openstack-infra13:48
*** flepied has joined #openstack-infra13:48
*** eharney has joined #openstack-infra13:51
*** njohnston|afk is now known as njohnston13:52
*** amotoki has joined #openstack-infra13:53
*** gongysh has quit IRC13:53
*** abregman|mtg is now known as abregman13:54
*** yamamoto has quit IRC13:55
*** salv-orlando has quit IRC13:55
*** burgerk has quit IRC13:55
*** tosky has quit IRC13:56
*** xarses has quit IRC13:57
*** _nadya_ has joined #openstack-infra13:58
*** akshai has quit IRC13:59
openstackgerritIldiko Vancsa proposed openstack-infra/project-config: Add install-guide job to Ceilometer  https://review.openstack.org/33450014:01
*** hongbin has joined #openstack-infra14:02
*** dtardivel has quit IRC14:02
*** dtardivel has joined #openstack-infra14:02
*** akshai has joined #openstack-infra14:03
*** amotoki has quit IRC14:05
fungiAJaeger: i have a very light -1 on 334421 for a few things. see inline comments14:08
AJaegerthanks for review, fungi. Will update ...14:08
*** shahid__ has quit IRC14:08
AJaegercould you - and other infra cores - please review https://review.openstack.org/#/c/315575/ - I need SUSE support for bindep to test and develop properly...14:09
fungiAJaeger: and thanks for fixing that. i think this was poorly documented and incorrectly implemented behavior. since it's technically a non-backward-compatible behavior change i'm wondering if the next tag should be 2.0.0 or if we should consider it as a bug fix14:09
*** amotoki has joined #openstack-infra14:10
*** amotoki has quit IRC14:11
*** ajmiller has joined #openstack-infra14:11
openstackgerritJames Page proposed openstack-infra/project-config: Add repositories for Charm interfaces  https://review.openstack.org/33450214:11
openstackgerritMerged openstack-infra/bindep: fix small typo and link  https://review.openstack.org/32533114:12
mtreinishanteaya, fungi, mordred, yolanda: if you get a sec can you take a look at: https://review.openstack.org/334483 it should be an easy +2 and unblock the tempest gate14:12
AJaegerfungi: I noticed this when testing https://review.openstack.org/334330. As soon as I added "[test]" everything broke ;(. Regarding version number: 2.0.0 might be better but I'm fine with bug fix release as well - but we should release ;)14:12
*** hongbin has quit IRC14:13
yolandamtreinish, done14:13
mtreinishyolanda: thanks14:13
*** hongbin has joined #openstack-infra14:13
*** zhurong has quit IRC14:13
openstackgerritSean Dague proposed openstack-infra/devstack-gate: support local.conf instead of localrc  https://review.openstack.org/32658514:15
openstackgerritSean Dague proposed openstack-infra/devstack-gate: Add save_* functions for clearer saving of artifacts  https://review.openstack.org/33450414:15
openstackgerritIldiko Vancsa proposed openstack-infra/project-config: Add install-guide job to Ceilometer  https://review.openstack.org/33450014:16
mordredShrews: I went ahead and sent a PR: https://github.com/ansible/ansible/pull/1645814:16
*** Nikolay_St has quit IRC14:18
*** lvdongbing has joined #openstack-infra14:18
krotscheckSo, I have a question.14:19
*** rajinir has joined #openstack-infra14:20
*** PollyZ has joined #openstack-infra14:20
openstackgerritAndreas Jaeger proposed openstack-infra/bindep: Handle platform and normal profiles  https://review.openstack.org/33442114:20
krotscheckActually, nevermind.14:21
*** mkoderer__ has quit IRC14:21
AJaegerfungi, updated ^14:21
AJaegeryolanda, pabelanger : Could either of you review a bindep change to add SUSE Linux, please?14:21
AJaegeryolanda, pabelanger https://review.openstack.org/#/c/315575/14:22
*** woodster_ has joined #openstack-infra14:22
*** ayoung has joined #openstack-infra14:22
*** vgridnev has quit IRC14:23
*** Daisy has quit IRC14:23
Shrewsmordred: think it's worth submitting my/our wrapper changes too?14:23
cloudnullmornings14:24
*** oferby has quit IRC14:24
*** oferby has joined #openstack-infra14:24
openstackgerritMerged openstack-infra/project-config: Add trove-dashboard to project list on layer4 job  https://review.openstack.org/33448314:25
*** claudiub|2 has joined #openstack-infra14:27
*** jamesmcarthur has joined #openstack-infra14:28
*** vgridnev has joined #openstack-infra14:28
*** ddieterly has joined #openstack-infra14:30
*** salv-orlando has joined #openstack-infra14:30
*** claudiub has quit IRC14:30
*** Trozz_ has joined #openstack-infra14:30
*** nmagnezi has quit IRC14:34
*** Ravikiran_K has quit IRC14:35
*** psachin has quit IRC14:35
*** PollyZ has quit IRC14:36
*** rossella_s has quit IRC14:39
*** Daisy has joined #openstack-infra14:39
*** weshay_mtg is now known as weshay14:39
*** rossella_s has joined #openstack-infra14:39
*** denisra has joined #openstack-infra14:41
*** lvdongbing has quit IRC14:41
*** thorst__ has joined #openstack-infra14:41
*** Nikolay_St has joined #openstack-infra14:41
*** PollyZ has joined #openstack-infra14:42
*** eeiden has joined #openstack-infra14:42
*** amit213 has joined #openstack-infra14:43
*** Daisy has quit IRC14:43
*** thorst_ has quit IRC14:45
*** xarses has joined #openstack-infra14:46
*** ociuhandu has joined #openstack-infra14:46
*** akshai has quit IRC14:46
*** ayoung_ has joined #openstack-infra14:48
openstackgerritMerged openstack-infra/bindep: Add support for openSUSE and SLES  https://review.openstack.org/31557514:50
*** david-lyle_ has joined #openstack-infra14:51
*** akshai has joined #openstack-infra14:51
*** Nikolay_St has quit IRC14:55
*** andreas_s has quit IRC14:55
*** Trozz_ is now known as Trozz14:55
*** david-lyle has quit IRC14:55
*** crinkle_ is now known as crinkle14:55
*** yamamoto has joined #openstack-infra14:55
*** amotoki has joined #openstack-infra14:57
*** Na3iL has quit IRC14:57
*** psachin has joined #openstack-infra14:58
*** esikachev has quit IRC14:59
openstackgerritSean Roberts proposed openstack-infra/project-config: add craton project  https://review.openstack.org/33247014:59
*** ddieterly is now known as ddieterly[away]14:59
*** isaacb has quit IRC14:59
*** javeriak has joined #openstack-infra14:59
*** maishsk has quit IRC15:01
*** sdake has joined #openstack-infra15:01
*** kushal has quit IRC15:01
*** psachin has quit IRC15:01
*** psachin has joined #openstack-infra15:01
*** jistr is now known as jistr|mtg15:01
openstackgerritMartin André proposed openstack/gertty: Display gate results alphabetically  https://review.openstack.org/33452415:02
*** sdake_ has quit IRC15:03
*** esikachev has joined #openstack-infra15:04
*** krotscheck is now known as krotscheck_dcm15:05
mordredShrews: probably? I wish we had a better story on those15:09
*** javeriak_ has joined #openstack-infra15:09
*** javeriak has quit IRC15:09
*** david-lyle_ is now known as david-lyle15:09
*** ddieterly[away] is now known as ddieterly15:09
*** thorst__ is now known as thorst_15:09
*** e0ne has quit IRC15:09
*** ayoung has quit IRC15:09
*** ayoung_ is now known as ayoung15:09
*** sshnaidm is now known as sshnaidm|afk15:09
*** yamamoto has quit IRC15:10
*** sarob has joined #openstack-infra15:10
openstackgerritMichal Dulko proposed openstack-infra/devstack-gate: WIP, DNM: Enabling Cinder multinode testing  https://review.openstack.org/32761915:11
*** sorantis has quit IRC15:13
openstackgerritMerged openstack/diskimage-builder: Clean more from ironic-agent ramdisk image  https://review.openstack.org/33404115:13
*** jamesmca_ has joined #openstack-infra15:15
*** jistr|mtg is now known as jistr15:16
*** csomerville has joined #openstack-infra15:16
openstackgerritMartin André proposed openstack/gertty: Display gate results ordered  https://review.openstack.org/33452415:17
*** jamesmcarthur has quit IRC15:17
*** dizquierdo has quit IRC15:19
*** yamahata has joined #openstack-infra15:22
*** gongysh has joined #openstack-infra15:22
*** arxcruz has quit IRC15:23
*** coolsvap has joined #openstack-infra15:24
*** weshay is now known as weshay_brb15:25
*** Nikolay_St has joined #openstack-infra15:25
zaromorning15:26
*** zeih has quit IRC15:27
*** zeih has joined #openstack-infra15:28
*** vincentll has quit IRC15:28
*** mhickey has joined #openstack-infra15:28
*** cshastri has quit IRC15:28
*** kushal has joined #openstack-infra15:29
*** psachin has quit IRC15:29
*** matrohon has quit IRC15:29
*** dmk0202 has quit IRC15:30
*** eezhova has quit IRC15:30
*** harlowja_at_home has joined #openstack-infra15:31
*** weshay_brb is now known as weshay15:31
*** derekh is now known as derekh_afk15:31
clarkbvsaienko: no eth0 and eth1 are provided by the clouds we run VMs in, we may only have one interface and what it is attached to depends on the cloud it boots in15:32
openstackgerritSean Roberts proposed openstack-infra/project-config: add craton project  https://review.openstack.org/33247015:32
*** zeih has quit IRC15:32
clarkbvsaienko: to have shared l2 between multinode test instances we create over lay networks with instancea on both hosts. With nova net we create two of these networks (one "public" and one "private"). With neutron we only create one because neutron itself creates the other15:33
*** arxcruz has joined #openstack-infra15:33
clarkbvsaienko: so logically eth0 is our "management" and where the test instnces are controlled then the cloud runs over the overlay15:34
*** eezhova has joined #openstack-infra15:34
clarkbvsaienko: devstack-gate repo has some ascii diagrams of this15:34
clarkbvsaienko: what are you trying to accomplish?15:35
clarkbShrews: what was mordreds change? and does that mean we know how/why xenial is different15:36
*** matrohon has joined #openstack-infra15:38
*** pcaruana has quit IRC15:38
openstackgerritEric Peterson proposed openstack-infra/jenkins-job-builder: Add git tag parameter support  https://review.openstack.org/32665615:39
*** tesseract- has quit IRC15:40
*** csomerville has quit IRC15:40
*** bnemec has quit IRC15:43
*** bnemec has joined #openstack-infra15:43
zaroclarkb: now that jenkins is gone, do you know how i can check logs for my periodic jobs?  seems like one of them doesn't work.15:43
*** hdaniel has joined #openstack-infra15:43
clarkbzaro: http://logs.openstack.org/periodic for the logs15:43
*** asselin has joined #openstack-infra15:44
openstackgerritMichal Dulko proposed openstack-infra/project-config: WIP, DNM: Cinder multinode grenade job  https://review.openstack.org/33453715:44
zaroclarkb: ahh, thanks15:44
*** csomerville has joined #openstack-infra15:44
*** daemontool has quit IRC15:44
*** tonytan4ever has joined #openstack-infra15:44
fungiwhich is actually what we've always recommended, since we never kept much job history in our jenkins masters to begin with15:45
*** PollyZ has quit IRC15:46
Shrewsclarkb: https://github.com/ansible/ansible/pull/16458  and no, no real answer on xenial15:46
*** bnemec has quit IRC15:50
*** otherwiseguy has joined #openstack-infra15:51
*** bnemec has joined #openstack-infra15:52
*** amitgandhinz has quit IRC15:52
*** ddieterly is now known as ddieterly[away]15:52
*** amitgandhinz has joined #openstack-infra15:52
*** links has quit IRC15:52
*** tosky has joined #openstack-infra15:52
*** baoli_ has quit IRC15:54
*** sarob has quit IRC15:54
*** sarob has joined #openstack-infra15:54
*** sarob has quit IRC15:54
*** sarob has joined #openstack-infra15:54
*** sree has quit IRC15:54
*** nwkarsten has quit IRC15:54
*** ajmiller has quit IRC15:55
vsaienkoclarkb: I'm interested  what network setup is done for multinode jobs. I need to have a separate interface to map flat neutron network beween subnodes15:56
*** ddieterly[away] is now known as ddieterly15:56
*** eezhova has quit IRC15:56
*** csomerville has quit IRC15:58
openstackgerritMerged openstack-infra/grafyaml: Add support for multiple config paths  https://review.openstack.org/32670815:58
*** Trozz is now known as zzTrozz16:00
fungivsaienko: yeah, that's why he recommended reading http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/multinode_setup_info.txt16:00
*** zzTrozz is now known as Trozz_16:01
*** Trozz_ is now known as Trozz16:01
clarkbvsaienko: and keep in mind neutron configures that overlay itself16:01
*** Trozz has quit IRC16:01
clarkbso you shouldnt need to do anything, it is already done for you16:02
*** PollyZ has joined #openstack-infra16:02
openstackgerritKhai Do proposed openstack-infra/project-config: Fix gerrit its-storyboard build  https://review.openstack.org/33455116:03
openstackgerritMerged openstack-infra/project-config: Add install-guide job to Ceilometer  https://review.openstack.org/33450016:03
openstackgerritMerged openstack-infra/project-config: Add charm-guide repository  https://review.openstack.org/33291616:04
openstackgerritMerged openstack-infra/project-config: Revert "Disable instances on rh2"  https://review.openstack.org/33434716:04
*** cody-somerville has joined #openstack-infra16:05
*** cody-somerville has joined #openstack-infra16:05
*** arxcruz has quit IRC16:05
openstackgerritMichal Dulko proposed openstack-infra/project-config: WIP, DNM: Cinder multinode grenade job  https://review.openstack.org/33453716:05
*** tqtran has joined #openstack-infra16:05
vsaienkofungi: thanks for the link, from the diagrams subnode1, subnode2 and primary nodes are VMs with devstack right?16:06
*** Trozz has joined #openstack-infra16:06
*** maishsk has joined #openstack-infra16:07
fungivsaienko: yes, though those diagrams are generalized to represent a variable number of subnodes. in our particular implementation the jobs only get a primary node and a subnode16:08
*** vhosakot has joined #openstack-infra16:09
openstackgerritMerged openstack-infra/project-config: zuul/layout: remove Puppet rules for old branches  https://review.openstack.org/33443516:09
openstackgerritMerged openstack-infra/project-config: Move vinz jobs to javascript from python  https://review.openstack.org/33363416:09
*** nwkarsten has joined #openstack-infra16:09
fungivsaienko: devstack-gate supports more subnodes than we actually use, so that we can grow it to larger nodecount labels in the future16:09
fungiif we end up needing to do so16:10
*** yamahata has quit IRC16:10
*** pcrews__ has quit IRC16:11
*** pcrews has joined #openstack-infra16:12
*** tphummel has quit IRC16:14
vsaienkofungi: ok understood, so VMs has 2 NICs, eth0 - management and eth1 can be used wherever we need. And there is L2 connectivity between eth1 on primary node and subnodes?16:15
nibalizeroh sweet my vinz changes muahahaha16:15
*** ayoung has quit IRC16:16
fungivsaienko: not all of our providers give us multiple network interfaces, so we can only guarantee eth0 exists16:16
*** abregman has quit IRC16:16
clarkband if eth1 exists it may not share l2 between hosts16:17
fungivsaienko: that's why we bind tunnels into br devices on the test instances instead and connect them with a tunneled overlay16:17
*** jcooley has quit IRC16:18
fungiyou can't just put whatever addresses you want on the actual interfaces of these test nodes because we don't control the networks they're connected into16:19
mordredclarkb: my change is the "paper over the fact that we don't know why the async_wrapper is weird sometimes16:19
*** sdague has quit IRC16:21
vsaienkofungi: are you using gre tunnels for this?16:21
fungivsaienko: vxlan16:22
*** gongysh has quit IRC16:22
fungivsaienko: gre tunnels don't work through some of our providers networks because they're an "unusual" protocol number (ip 47)16:22
clarkbya neutron only lets you be explicit about tcp udp and icmp16:22
fungiand also state tracking in iptables needs a special module loaded to do state tracking for gre, which some providers may not set up16:23
*** jcooley has joined #openstack-infra16:23
*** mdrabe has quit IRC16:24
openstackgerritMerged openstack-infra/storyboard: Store history of a comment when editing  https://review.openstack.org/33220816:25
*** shashank_hegde has joined #openstack-infra16:25
*** coolsvap has quit IRC16:26
jlvillalOn ci-watch.tintri.com. Who do we ask to add another project?16:27
jlvillalIt said to ask in this channel :)16:27
matt-borlandhere: Horizon has had jobs passing that should fail, we believe we have a solution but would like some input.16:28
openstackgerritMichal Dulko proposed openstack-infra/project-config: WIP, DNM: Cinder multinode grenade job  https://review.openstack.org/33453716:28
*** coolsvap has joined #openstack-infra16:29
mmedvedejlvillal: I think ci-watch.tintri.com lost connection to gerrit event stream. I did not see the person who maintains it for a while (apoorvad)16:29
*** nwkarsten has quit IRC16:29
fungijlvillal: looks like it gets set in the config file for ciwatch, but we don't operate that server and only a sample config is present in the git repo for it http://git.openstack.org/cgit/openstack-infra/ciwatch/tree/ciwatch.conf.sample16:29
clarkbI need to do some yard work before the pacific northwest is transported to the surface of the sun later today16:29
fungijlvillal: mmedvede: i assume apoorvad manually configures it16:30
mmedvedejlvillal: I have my own instance up and running. You are free to use it, and I can add any projects you want me to add16:30
bkero(surface of the sun = 31c)16:30
mmedvedejlvillal: http://54.205.162.64:5000/16:30
jlvillalmmedvede, It would be nice to have ironic-python-agent16:30
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add migration to add common metadata fields to runs table  https://review.openstack.org/33455616:30
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add a new db manage command to migrate run_metadata  https://review.openstack.org/33455716:30
*** ayoung has joined #openstack-infra16:31
jlvillalmmedvede, Yeah, just noticed it seems to be a few days old for last job16:31
mmedvedefungi: I think tintri ciwatch was deployed using puppet-ciwatch, so it is configured from here: https://review.openstack.org/#/c/238606/11/templates/ciwatch.conf.erb16:31
mtreinishjeblair: ^^^ that's something we talked about at summit in the openstack-health session16:32
fungimmedvede: aha, i forgot that exists16:32
*** _nadya_ has quit IRC16:32
mmedvedefungi: who should I ask to get some +2 or +w on https://review.openstack.org/#/c/238606 ?16:32
vsaienkofungi: it is done by https://github.com/openstack-infra/devstack-gate/blob/8aa9194ed9d263196e9286cff34f4f3f1b229496/functions.sh#L1121 only for nova network and neutron with dvr, am I right?16:32
mtreinishjeblair: it still needs a ton of changes to the actual api to make it useable for filtering on check vs gate in openstack-health. But, that would be the start to enable doing that in a single schema16:33
dulekHi, can anyone help me with https://review.openstack.org/#/c/334537/ ? Looks like job isn't run.16:33
openstackgerritMerged openstack-infra/storyboard: Add support for email threading by story_id  https://review.openstack.org/33417916:33
dulekI'm trying to test it with https://review.openstack.org/#/c/334539.16:33
*** Sukhdev_ has joined #openstack-infra16:34
*** jsavak has quit IRC16:34
*** Apoorva has joined #openstack-infra16:35
*** jsavak has joined #openstack-infra16:35
fungimmedvede: any of our puppet-core reviewers, including me16:35
*** maishsk has quit IRC16:35
*** jlanoux has joined #openstack-infra16:36
*** jpich has quit IRC16:36
*** coolsvap has quit IRC16:37
*** amotoki has quit IRC16:37
*** harlowja_at_home has quit IRC16:37
mmedvedefungi: ok. I'll ping less busy puppet cores16:38
fungimmedvede: no need16:38
mmedvedejlvillal: added ironic-python-agent, no history yet obviously16:39
mmedvedejlvillal: keep in mind my instance is rather weak, would be slow16:39
*** ddieterly is now known as ddieterly[away]16:39
fungivsaienko: yeah, looks like it's called in setup_multinode_connectivity via setup_nova_net_networking if DEVSTACK_GATE_NEUTRON is unset, or directly if DEVSTACK_GATE_NEUTRON_DVR is set16:40
fungivsaienko: so i think if DEVSTACK_GATE_NEUTRON and DEVSTACK_GATE_NEUTRON_DVR is unset we don't do it right now, but that can be changed as needed16:40
mmedvedethanks much fungi !16:40
openstackgerritBob Ball proposed openstack-infra/project-config: Update the CI ACL for fuel-plugins-xenserver  https://review.openstack.org/33455816:41
fungivsaienko: er, i mean if DEVSTACK_GATE_NEUTRON is set and DEVSTACK_GATE_NEUTRON_DVR is unset16:41
fungivsaienko: i guess you have a multinode devstack-gate use case which uses neutron but not dvr?16:42
*** gongysh has joined #openstack-infra16:42
fungidulek: 334537 hasn't merged yet16:42
*** mdrabe has joined #openstack-infra16:42
*** maishsk has joined #openstack-infra16:43
vsaienkofungi, clark: thank you! now all seems to be clear for me :)16:43
*** ddieterly[away] is now known as ddieterly16:43
*** _sarob has joined #openstack-infra16:43
*** Ravikiran_K has joined #openstack-infra16:44
*** asettle has quit IRC16:44
*** mhickey has quit IRC16:44
fungivsaienko: also keep in mind that setup_multinode_connectivity only gets called if DEVSTACK_GATE_TOPOLOGY is set to multinode16:44
dulekfungi: I'm just trying to run the job using chain of Depends-On flags. It's not possible?16:45
*** sarob has quit IRC16:45
*** tphummel has joined #openstack-infra16:45
fungidulek: new job configuration is only used after the change introducing it merges, particularly important since some jobs can be configured to run on systems with sensitive credentials available to the changes being tested and so have to be carefully vetted by people16:45
*** e0ne has joined #openstack-infra16:46
*** amit213 has quit IRC16:46
dulekfungi: Oh, so there isn't an easy way to test it? So I need to add that into experimental pipeline, and go from there.16:47
*** rdx_matt has quit IRC16:47
*** _sarob has quit IRC16:48
fungidulek: well, you could submit a do-not-merge change for devstack-gate which adjusts its logic to coerce one of the existing multinode jobs into running the same things as the job you're proposing16:48
openstackgerritMerged openstack-infra/storyboard-webclient: Use tag icon when tags are used as filter criteria  https://review.openstack.org/33105416:48
dulekfungi: Awesome! Thanks!16:49
*** matrohon has quit IRC16:49
fungidulek: or you could set up devstack-gate manually on a server instance under your control and configure another instance as a subnode for it to control16:49
openstackgerritMerged openstack-infra/puppet-ciwatch: Add initial implementation to deploy ciwatch  https://review.openstack.org/23860616:49
fungidulek: i think auggy may have been trying to do something similar recently (i don't recall the details but i vaguely recall providing some basic guidance on following the devstack-gate readme and what might need adjusting for a manual multinode setup_16:50
*** markusry has quit IRC16:51
*** gyee has joined #openstack-infra16:51
*** sarob has joined #openstack-infra16:52
*** nwkarsten has joined #openstack-infra16:52
*** nwkarsten has quit IRC16:53
*** yamahata has joined #openstack-infra16:53
*** nwkarsten has joined #openstack-infra16:53
*** degorenko is now known as _degorenko|afk16:54
*** john-davidge has quit IRC16:54
*** sarob has quit IRC16:55
*** sarob has joined #openstack-infra16:55
jlvillalmmedvede, Awesome and thanks :)16:56
jlvillalmmedvede, Digital Ocean VM for $5 per month ;)16:57
* jlvillal runs his ZNC instance that way16:57
openstackgerritMichal Dulko proposed openstack-infra/project-config: WIP, DNM: Cinder multinode grenade job  https://review.openstack.org/33453716:57
*** markusry has joined #openstack-infra16:59
*** salv-orl_ has joined #openstack-infra16:59
*** fawadkhaliq has joined #openstack-infra16:59
openstackgerritAndreas Jaeger proposed openstack-infra/bindep: Handle platform and normal profiles  https://review.openstack.org/33442117:00
*** kien-ha has joined #openstack-infra17:00
*** salv-orlando has quit IRC17:02
*** claudiub|2 has quit IRC17:02
*** flepied has quit IRC17:03
AJaegerlifeless: thanks for your comments on the bindep change. I have a question on "os:ubuntu" and "ubuntu". Why do you think those should be added?17:03
*** Sukhdev_ has quit IRC17:05
*** maishsk has quit IRC17:05
*** ihrachys has quit IRC17:06
*** ayoung has quit IRC17:06
*** amoralej is now known as amoralej|off17:06
*** mrmartin has joined #openstack-infra17:07
*** hdaniel has quit IRC17:08
*** woodster_ has quit IRC17:09
*** sarob has quit IRC17:10
pabelangerhead down upgrading fedora desktop today, just finished backups17:11
pabelangerzuul-launchers appear to be happy17:11
pabelangerI haven't see any new or unexpected failures in a few days now17:11
*** jsavak has quit IRC17:11
*** Sukhdev_ has joined #openstack-infra17:13
*** csomerville has joined #openstack-infra17:15
*** otherwiseguy has quit IRC17:17
*** cody-somerville has quit IRC17:18
openstackgerritMerged openstack-infra/puppet-openafs: Enable the openafs-client service  https://review.openstack.org/33349617:18
openstackgerritMarton Kiss proposed openstack-infra/groups: Upgrade Drupal Core to 7.44  https://review.openstack.org/33457717:20
*** itisha has quit IRC17:20
openstackgerritMartin André proposed openstack/gertty: Filter test results by pipeline  https://review.openstack.org/33457817:20
openstackgerritAndreas Jaeger proposed openstack-infra/bindep: Handle platform and normal profiles  https://review.openstack.org/33442117:20
*** ayoung has joined #openstack-infra17:22
*** krtaylor has quit IRC17:24
*** harlowja has quit IRC17:25
*** _nadya_ has joined #openstack-infra17:26
*** piet has quit IRC17:26
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Update Copy Artifact plugin to use convert xml  https://review.openstack.org/33458017:27
*** cbader has quit IRC17:28
*** ddieterly is now known as ddieterly[away]17:29
*** jsavak has joined #openstack-infra17:30
*** esikachev has quit IRC17:31
*** abregman has joined #openstack-infra17:31
*** maishsk has joined #openstack-infra17:32
openstackgerritTimur Sufiev proposed openstack-infra/project-config: Fix false npm-run false positives  https://review.openstack.org/33458217:33
*** harlowja has joined #openstack-infra17:33
*** cbader has joined #openstack-infra17:34
*** Sukhdev_ has quit IRC17:34
openstackgerritTimur Sufiev proposed openstack-infra/project-config: Fix false npm-run false positives  https://review.openstack.org/33458217:35
matt-borlandhere: ^^ if someone could review this for sanity; problem is that npm runs' exit codes were not being caught or breaking shell17:35
*** sarob has joined #openstack-infra17:35
openstackgerritTimur Sufiev proposed openstack-infra/project-config: Fix false npm-run false positives  https://review.openstack.org/33458217:36
fungimatt-borland: i'm curious what accounted for the non-lint npm-run job failures if that was the issue17:36
AJaegermatt-borland: We normally use "bash -xe" to see exactly the values and also abort directly.17:37
matt-borlandfungi, most likely other contextual problems,17:37
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Update doxygen plugin to use convert xml  https://review.openstack.org/33458317:37
AJaegermatt-borland: what do you think of adding "bash -x" to the script at least? That will help you with debugging.17:37
matt-borlandlike vm setup failure or whatever17:37
*** sabari has joined #openstack-infra17:37
*** amotoki has joined #openstack-infra17:37
*** zz_dimtruck is now known as dimtruck17:37
matt-borlandAJaeger, that would be great, anything to help troubleshoot would help us :)17:37
*** sarob has quit IRC17:37
*** _sarob has joined #openstack-infra17:37
openstackgerritKarthik Prabhu Vinod proposed openstack-infra/project-config: WIP, DNM: Cinder multinode grenade job  https://review.openstack.org/33453717:38
AJaegermatt-borland: so, add "#!/bin/bash -x" as first line to macros.yaml17:38
matt-borlandI'll put a note in, thanks!  (it's not my patch)17:39
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Update Copy Artifact plugin to use convert xml  https://review.openstack.org/33458017:39
openstackgerritRichard Theis proposed openstack-infra/project-config: Add python34 job for networking-ovn  https://review.openstack.org/33458517:40
fungiAJaeger: jeblair pointed out when i started looking into the npm-run nonfailures that zuul-launcher considers a shell builder without a shebang line uses `bash -x` as its interpreter17:40
fungiAJaeger: http://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/launcher/ansiblelaunchserver.py#n107917:40
auggyfungi: dulek: yeah i'm still working on getting multinode working, had nova non-priority feature freeze come up so things have been on hold17:41
*** _sarob has quit IRC17:42
*** amotoki has quit IRC17:42
*** PollyZ has quit IRC17:42
AJaegerfungi: cool!17:43
* AJaeger loves that default ;)17:43
fungimatt-borland: so anyway, yes set -e was the fix i was expecting (it's what we do on other shell builders where we don't just want to report the return code of the final command run), but i was lacking a good explanation for the npm-run-test jobs still failing. i suppose `npm shrinkwrap` was breaking on some of those?17:43
matt-borlandno, the problem fungi is that it's passing.17:44
fungimatt-borland: right, npm-run-lint was passing bad patches, but graphite reported at least some runs of npm-run-test failing despite using that same builder definition17:44
matt-borlandoh I see what you mean...I'll have to look at those failures.17:44
matt-borlandhold on, researching17:45
*** _nadya_ has quit IRC17:45
fungimatt-borland: which was the point of my reply to you on the -dev ml last week17:45
matt-borlandlet's look at the results.17:45
*** piet has joined #openstack-infra17:45
openstackgerritTimur Sufiev proposed openstack-infra/project-config: Fix npm-run false positives  https://review.openstack.org/33458217:45
*** flepied has joined #openstack-infra17:47
*** salv-orl_ has quit IRC17:47
fungimatt-borland: also i had no good explanation for why it started so suddenly17:47
*** dimtruck is now known as zz_dimtruck17:47
fungimatt-borland: but i stopped digging deeper once i confirmed that it didn't start up until a couple days after we were fully on suul-launcher17:47
fungier, zuul-launcher17:47
matt-borlandfungi, we probably didn't notice it17:47
matt-borland"everything is passing! yay!" :)17:47
*** ifarkas has quit IRC17:48
fungimatt-borland: well, there were failures for the npm-run-lint job in the check pipeline up until the middle of the 18th and i didn't see any recent changes to the macro definition or the job-template17:48
*** rdx_matt has joined #openstack-infra17:48
*** ramishra has quit IRC17:49
matt-borlandseems like something contextual changed, fungi...looking17:49
* matt-borland trying to remember how to use kibana interface17:49
*** timello has quit IRC17:50
*** ramishra has joined #openstack-infra17:51
*** tonytan4ever has quit IRC17:52
*** rdx_matt has quit IRC17:53
*** psilvad has joined #openstack-infra17:54
*** sarob has joined #openstack-infra17:54
*** gongysh has quit IRC17:55
matt-borlandfungi, to be clear, I see nothing but SUCCESS for gate-horizon-npm-run-lint17:57
matt-borlandin the last 24 hours17:57
*** PollyZ has joined #openstack-infra17:58
*** psilvad_ has quit IRC17:58
matt-borlandwhen I search thru the kibana logs17:58
fungimatt-borland: yep, that much was known and indicated by the graphs i linked in my e-mail17:58
fungimatt-borland: look for gate-horizon-npm-run-test failures though17:58
fungithat job uses teh same job-template and so the same npm-run macro17:58
matt-borlandyep, looking17:59
*** hashar has joined #openstack-infra17:59
*** sarob has quit IRC17:59
matt-borlandI see 100% success rate in the last 24 houyrs17:59
*** tonytan4ever has joined #openstack-infra18:00
*** lucasagomes is now known as lucas-afk18:01
*** jamesmca_ has quit IRC18:01
*** dtantsur is now known as dtantsur|afk18:02
*** pvaneck has joined #openstack-infra18:02
mriedem"Depends-On" in a commit message is case-sensitive right?18:02
*** zz_dimtruck is now known as dimtruck18:03
fungimatt-borland: weird, that conflicts with what graphite seems to have on record... http://graphite.openstack.org/render/?width=800&height=400&format=json&target=stats_counts.zuul.pipeline.check.job.gate-horizon-npm-run-test.FAILURE&from=-24hours18:03
*** Apoorva has quit IRC18:03
*** salv-orlando has joined #openstack-infra18:03
*** sarob has joined #openstack-infra18:03
matt-borlandfungi, I'm probably looking at it wrong; I just haven't mastered kibana's filtering18:03
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add migration to add common metadata fields to runs table  https://review.openstack.org/33455618:03
*** dimtruck is now known as zz_dimtruck18:03
*** Apoorva has joined #openstack-infra18:03
*** jamesmcarthur has joined #openstack-infra18:04
*** markusry has quit IRC18:04
*** reed has quit IRC18:05
*** reed has joined #openstack-infra18:05
openstackgerritAndreas Jaeger proposed openstack-infra/bindep: Handle platform and normal profiles  https://review.openstack.org/33442118:05
fungimatt-borland: yeah, i'm only finding successes for build_name:gate-horizon-npm-run-test in kibana18:06
*** salv-orlando has quit IRC18:06
*** salv-orlando has joined #openstack-infra18:06
fungithough there's a problem with the formatting of the build_status parameter so i'm checking the parameter contents visually rather than filtering on them just to be sure18:07
matt-borlandyep18:07
*** abregman is now known as abregman|mtg18:08
*** sarob has quit IRC18:08
fungimatt-borland: okay, so erring on the side of caution, i'm willing to agree that they're probably all passing and so lack of errexit on the npm-run macro is the culprit18:09
matt-borlandfungi, I think that's fair18:09
fungiand separately we should look into why we're reporting possible false-failures to graphite18:09
fungii'll dig on that front18:09
matt-borlandso, what environment was causing a failed command to exit the shell before?18:10
matt-borland-x doesn't do that18:10
matt-borlandI can see we're getting the -x application just fine (we see commands in the logs)18:10
fungimatt-borland: the evidence i had that npm-run-lint was previously failing was based on an assumption that the data in graphite is correct. however that was long enough ago that we probably lack any means of correlating it to kibana because of our very short log retention in elasticsearch18:11
matt-borlandit's -e that causes the shell to exit, right?  so should http://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/launcher/ansiblelaunchserver.py#n1080 provide -e ?18:11
*** hashar has quit IRC18:12
fungimatt-borland: no, because many of our multi-line builders almost certainly rely on commands which might fail18:12
fungirather, rely on continuing after commands which might fail18:12
matt-borlandgotcha, thanks, right18:12
* matt-borland in full *learning* mode :)18:12
*** timello has joined #openstack-infra18:13
matt-borlandin that case yeah, it seems there's no way in which executing the builder, anything could know npm command failed.18:13
fungii'm checking to see if i can find any failures early in our current es retention period18:13
fungibut my hopes are not high18:13
matt-borlandheh...either way, I appreciate it, fungi :)18:13
*** ajmiller has joined #openstack-infra18:14
*** zeih has joined #openstack-infra18:14
* matt-borland gotta go18:14
*** amoralej|off is now known as amoralej18:15
fungiwoo! got one!!!18:16
*** Sukhdev_ has joined #openstack-infra18:16
fungimatt-borland: i'll reply to the ml and we can investigate there18:16
*** shardy is now known as shardy_afk18:17
openstackgerritMerged openstack-infra/groups: Upgrade Drupal Core to 7.44  https://review.openstack.org/33457718:19
*** jamesmcarthur has quit IRC18:21
*** sneti has joined #openstack-infra18:21
rcerninHi, anyone could point me, added new djangojs and django languages with django-admin makemessages and compile.. Modified settings.py added new language but I still seems to miss something, the top right popups are translated but nothing else.18:22
fungijeblair: clarkb i see some logstash entries for jobs where build_status is {"result": "SUCCESS"},{"result": "FAILURE"} (not just one but both together), so far i've found one as recent as 08:15 utc on 2016-06-2118:23
*** bhavik has joined #openstack-infra18:23
*** asselin_ has joined #openstack-infra18:23
*** acoles is now known as acoles_18:24
fungiwas this a known problem which got solved last week?18:24
AJaegerrcernin: best ask the horizon folks for django help18:25
fungijeblair: clarkb: oh, i see the entry has multiples of more than that parameter18:26
*** timello has quit IRC18:26
fungii think this was an indexing error where multiple job runs got mashed together18:27
*** ayoung has quit IRC18:27
*** asselin has quit IRC18:27
*** megm_ has quit IRC18:27
fungi(2 changes, 2 branches, 3 pipelines, 4 nodes, ...)18:28
*** megm has joined #openstack-infra18:28
*** tonytan4ever has quit IRC18:28
AJaegerfungi, pabelanger: I'd like to discuss briefly a bit more about other-requirements. fungi, please tell me once you have a few minutes.18:28
*** ddieterly[away] has quit IRC18:29
*** timello has joined #openstack-infra18:32
*** Sukhdev_ has quit IRC18:33
*** rwsu has quit IRC18:33
*** rcernin has quit IRC18:34
*** ajmiller has quit IRC18:37
*** ddieterly has joined #openstack-infra18:37
*** jamesmcarthur has joined #openstack-infra18:37
*** tonytan4ever has joined #openstack-infra18:38
*** rdx_matt has joined #openstack-infra18:38
*** rdx_matt has quit IRC18:38
*** rdx_matt has joined #openstack-infra18:39
*** salv-orlando has quit IRC18:40
*** amoralej is now known as amoralej|off18:40
*** cbader has quit IRC18:42
*** ajmiller has joined #openstack-infra18:42
fungiAJaeger: i should be free in about an hour or so. getting ready for a meeting18:43
*** savihou has quit IRC18:43
*** rdx_matt has quit IRC18:43
AJaegerfungi, thanks18:44
*** ajmiller_ has joined #openstack-infra18:45
*** chem` has joined #openstack-infra18:45
*** abregman|mtg is now known as abregman18:46
mordredShrews: conversation in #openstack-keystone wiht raildo and samueldmq about shade's keystone-v2 test18:46
mordredShrews: 18:45:22      +samueldmq | raildo: I think you should just set V2_ENABLED flag (or whatever it's named) to True explicitly for that job18:46
*** ajmiller has quit IRC18:46
*** chem has quit IRC18:47
raildoShrews: mordred, since we want to make devstack identity v3-only someday, and we need make sure that shade is using v218:47
*** esikachev has joined #openstack-infra18:48
raildoin addition, I can create a new (non-voting) job to test this v3-only behavior18:48
raildoShrews: mordred what do you think?18:48
mordredraildo: I don't think we need the v3-only job - we should be good in v3 land ... it's just making sure we don't lose the ability to test against v2 clouds that's the most important18:49
raildomordred: got it :)18:50
mordredraildo: thanks!18:50
*** ddieterly is now known as ddieterly[away]18:50
raildomordred: thank you!18:51
clarkbfungi: thats likely a multiline parse failure18:52
*** fernnest_ has quit IRC18:53
fungimy other concern is that we have jobs which are getting reported in graphite as failures but not showing up as failures in logstash18:53
fungistill no idea what's happening there18:53
openstackgerritMerged openstack/diskimage-builder: Fix copyright in docs  https://review.openstack.org/33308418:53
*** pradk has quit IRC18:54
*** _nadya_ has joined #openstack-infra18:56
*** amitgandhinz has quit IRC18:56
*** pradk has joined #openstack-infra18:56
*** amitgandhinz has joined #openstack-infra18:57
Shrewsmordred: we need to change something for that job?18:58
*** otherwiseguy has joined #openstack-infra18:58
*** zeih has quit IRC18:59
mordredShrews: I think raildo is going to make a patch?19:01
*** amitgandhinz has quit IRC19:01
*** claudiub has joined #openstack-infra19:01
*** amitgandhinz has joined #openstack-infra19:01
*** rcernin has joined #openstack-infra19:04
*** amit213 has joined #openstack-infra19:04
clarkbfungi: could be a couple things, first is logstash should ignore any aborts, not sure how graphite records those, but also general lag in logstash's pipeline processing19:09
*** rdx_matt has joined #openstack-infra19:09
clarkbfungi: oh also could be one or more of the zuul launchers is not sending zmq events to the gearman logstash client19:09
*** rdx_matt_ has joined #openstack-infra19:10
*** rdx_matt has quit IRC19:10
*** e0ne has quit IRC19:10
*** jcooley has quit IRC19:10
*** e0ne has joined #openstack-infra19:11
fungiclarkb: thanks, i'm trying to see if i can correlate a statsd timestamp to something in logstash19:12
*** akshai has quit IRC19:12
*** akshai has joined #openstack-infra19:12
*** salv-orlando has joined #openstack-infra19:12
clarkbnow that I am done battling blackberries I am trying to figure out expense reports without my scanner19:13
*** amitgandhinz has quit IRC19:13
*** e0ne_ has joined #openstack-infra19:13
*** ddieterly[away] is now known as ddieterly19:13
*** amitgandhinz has joined #openstack-infra19:14
*** jcoufal has quit IRC19:14
*** rdx_matt_ has quit IRC19:14
*** pradk has quit IRC19:16
*** akshai has quit IRC19:16
*** Nikolay_St has quit IRC19:17
*** salv-orlando has quit IRC19:17
*** e0ne has quit IRC19:17
mordredclarkb: by blackberries, do you mean the old phone system that used to be unbeatable and then lost?19:18
mordredclarkb: or do you mean the delicious fruit that hurts a bit to pick?19:19
*** _nadya_ has quit IRC19:19
*** ihrachys has joined #openstack-infra19:19
mordredclarkb: (for expense reports, I tend to take photos of receipts with my phone and then email them somewhere to be attached)19:19
clarkbmordred: the delicious fruit that grows on the worlds worst weed19:19
openstackgerritKarthik Prabhu Vinod proposed openstack-infra/project-config: WIP, DNM: Cinder multinode grenade job  https://review.openstack.org/33453719:20
clarkbI am happy to pick/buy blackberries elsewhere, they do not need to take over my entire yard19:20
*** Sukhdev_ has joined #openstack-infra19:20
clarkbyes I am trying the phone picture thing19:20
clarkbgoing to use bluetooth for the first time in a long time19:20
mordredweird19:20
*** chem` has quit IRC19:20
*** javeriak_ has quit IRC19:21
mordredclarkb: this weekend I introduced a hedge of holly bushes to my sawzall19:21
mordredclarkb: there is no longer a hedge of holly bushes19:21
clarkbwe are also using our AC for the first time becaue the PNW has transported to the surface of the sun19:21
mordredwe use our AC _way_ less than everyone else down here I believe - we have some very nice shade covering the back of the house which makes opening the windows actually effective19:23
mordred(this is not what I was expecting)19:23
*** oanson has joined #openstack-infra19:24
mordredclarkb: which is to say - perhaps if you want to cool off, the answer is a trip to texas ;)19:24
raildomordred: Shrews working in a patch for it... will be a small change, just to make the pattern with the other jobs, like this: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/nova.yaml#L2919:25
*** piet has quit IRC19:25
*** hashar has joined #openstack-infra19:25
openstackgerritMarton Kiss proposed openstack-infra/groups: Upgrade Views to 3.14  https://review.openstack.org/33462719:26
Shrewsraildo: ah, that's easy enough (except i guess we'd need that set to True then)19:27
AJaegerlifeless: could you check https://review.openstack.org/#/c/334421 again - the bindep change - once you have time, please?19:27
raildoShrews: ++ it will be true19:27
clarkbmordred: also no real issues with fios so far. I do have a wireless lan issue where my office sits over garage and AP sits on other side of garage wall and the signal doesn't penetrate very well19:27
*** salv-orlando has joined #openstack-infra19:27
*** zeih has joined #openstack-infra19:27
mordredclarkb: not much fios can do about that :)19:27
Shrewsraildo: mordred: oh, so, our v2 job runs against stable/liberty. i don't think we need that, actually19:28
Shrewsmordred: i don't think we've promised v2 support past liberty.19:28
*** pradk has joined #openstack-infra19:28
*** pradk has quit IRC19:29
mtreinishclarkb: you got fios?19:29
raildoShrews: hum...but this job is running on master19:29
mordredclarkb: fwiw, I bought 3 eero nodes and have been pleased with them. I believe the exact same could be accomplished obviously with normal things that aren't VC backed - but moving from BK apartment to TX house I figured getting jump-started until such a time as I wanted to build a mesh from scratch was a better plan19:29
Shrewsraildo: eh? master of shade, yes, but devstack is pinned at liberty19:29
mordredShrews: well, I don't know that we have any relationship to concepts such as liberty - although once liberty EOLs in the gate we may not be able to gate on v2 any more19:29
mordredShrews: but I do not ever expect that shade will stop knowing how to talk to keystone v2 - since I imagine there will continue to be v2 clouds out there and we love our users, right?19:30
fungiclarkb: matt-borland: false alarm, graphite is right, logstash confirms three failures for gate-horizon-npm-run-test in the check pipeline today19:30
Shrewsmordred: maybe not. i haven't really put any thought in it19:30
mordredShrews: me either19:30
mtreinishmordred: v2 keystone? We still default to that everywhere in the gate19:30
mtreinishso you'll at least be safe through newton if you bump whatever you're using for those jobs19:31
raildoShrews: the issue is, when we change devstack to be keystone v3-only, this job on shade will brake, so if this job is running on master, shade's patches will be impacted on the gate19:31
*** jsavak has quit IRC19:31
mordredmtreinish: cool. so v2 keystone is still physically possible through newton?19:31
*** jsavak has joined #openstack-infra19:31
Shrewsraildo: no. that devstack change will not impact our v2 job because THAT version of devstack does not change19:31
*** Jeffrey4l__ has joined #openstack-infra19:32
openstackgerritPaul Belanger proposed openstack-infra/system-config: Exclude paas for centos-7 mirror  https://review.openstack.org/33463019:32
Shrewsraildo: it will always be whatever devstack was at liberty release19:32
mordredyah- master of shade should run against stable/liberty of openstack and devstack19:32
mtreinishmordred: yep. It'll likely still be possible in ocata too, just not the default19:32
raildoShrews: hum... got it19:32
mordredShrews: it's possible we might want to stop using liberty and do whatever it is we do to get v2 keystone in newton/ocata if that's available19:32
*** zeih has quit IRC19:32
raildoso, sounds like we don't need to change anything for now :)19:32
mordredmtreinish: is it possible to have an install _without_ v3 post liberty?19:32
Shrewsraildo: we pinned to liberty _because_ of that change to devstack (where it broke us and several others) a while back19:33
mordredShrews: ++19:33
Shrewsmordred: yah19:33
mordredmtreinish: because that's the thing we're testing with shade->stable/liberty - we want to make sure we work when no v3 exists19:33
raildoShrews: ++ I'm trying to don't broke anything else :P19:33
mordredraildo: thank you for tryung to not break things!!! :)19:33
mtreinishmordred: that I'd have to check. I know right now it sets up both by default but configures most things to just use v219:34
raildomordred: it is not easy! haha19:34
mtreinishmordred: ah, that's an important distinction, lemme check19:34
Shrewsraildo: yes, much appreciated19:34
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Update OpenShift Pipeline plugin  https://review.openstack.org/33463219:34
*** Jeffrey4l_ has quit IRC19:34
mordredyah. I'd need to dig in too - the main thing is we want v3 to physically not exist nor be in the catalog for anything- otherwise our detection will find v3 (since it prefers v3) and then we'll not be testing v2 which would be sad-making19:34
*** ihrachys has quit IRC19:35
*** ociuhandu has quit IRC19:36
mtreinishmordred: ah, that's exactly why we don't allow any api based discovery in tempest (unless testing those apis directly) :)19:36
*** akshai has joined #openstack-infra19:36
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Temporarily disable the instack.qcow cached image  https://review.openstack.org/33463419:36
*** harlowja has quit IRC19:36
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Update OpenShift Pipeline plugin  https://review.openstack.org/33463219:36
mtreinishbecause it turns out during grizzly neutron liked to say that nothing was availble and all the tests skipped19:36
*** dtardivel has quit IRC19:37
Shrewsmtreinish: so efficient!19:37
Shrewstests just get in the way19:38
mordredmtreinish: but passing 100% of zero tests mean you have 0 failures!19:38
*** sdake has quit IRC19:38
mtreinishmordred: so I just checked devstack doesn't have a disable v3 option, but it should be pretty easy to implement in a devstack plugin (preparing for liberty eol)19:38
*** amotoki has joined #openstack-infra19:39
mordredmtreinish: cool. I might put that on the TDL then, if v2 will still be available for newton/ocata19:39
*** pradk has joined #openstack-infra19:39
mtreinishmordred: devstack just copies the default keystone paste.ini and uses that. For the no v2 it gets modified to drop the v2 lines from the paste.ini19:39
mtreinishyou should be able to just mirror that for no v3 (although we probably don't want that in devstack itself)19:40
EmilienMin case it helps, http://logs.openstack.org/56/334456/2/check/gate-puppet-openstack-integration-4-scenario001-tempest-ubuntu-xenial-nv/046b647/console.html#_2016-06-27_14_55_47_98022519:40
EmilienM Failed to connect to zm06.openstack.org port 80: Connection timed out'19:40
raildomordred: about this v2-v3 discussion, some weeks ago, we wanted to propose to TC to stop this v2 bugs support to be early in the Otaca cycle. Do you think this is a good idea (and a good time)?19:40
*** sdake has joined #openstack-infra19:40
raildomordred: #link http://permalink.gmane.org/gmane.comp.cloud.openstack.devel/8459819:40
*** nwkarsten has quit IRC19:41
mordredraildo: well, _I_ think we should never remove anything, so I'm the wrong person to get an opinion from19:41
*** ihrachys has joined #openstack-infra19:41
mtreinishmordred: also funny thing about 100% of zero tests, subunit-trace now enforces that as a failure mode. Because it's been a very common failure pattern across multiple projects19:41
pabelangerclarkb: mordred: fungi: jeblair: do you mind reviewing 330152?  I am working on the AFS bits right now, this is to mirror UCA19:41
mordredraildo: I think other people who are involved more day to day with the issue have a better perspective on that than I do19:41
raildomordred: it not remove, it just like: "hey, we don't support v2 bugs anymore, we focus on v3"19:41
mordredraildo: I do not think that bothers me19:42
mordredpabelanger: looking19:42
*** ayoung has joined #openstack-infra19:42
raildomordred: ++ I'll send an email for the operators list, and get some feedback on this topic19:42
raildomordred: thanks again!19:42
mordredpabelanger: lgtm19:43
*** oanson has quit IRC19:43
*** e0ne_ has quit IRC19:43
mordredpabelanger: so - I told zigo I'd write a patch, and I keep failing at finding the time to write it ... how many goats would I need to mail you to con you in to helping?19:43
zigoo/19:44
zigoHi there.19:44
*** amotoki has quit IRC19:44
mordredpabelanger: specifically, the patch to download the built artifacts from tarballs.o.o and inject them into reprepro and do the afs vos release19:44
mordredzigo: see - I haven't forgotten about you :)19:44
zigoIn fact, hi from Debconf 16, Cape Town.19:44
*** rajinir has quit IRC19:44
mordredzigo: ooh! enjoy. I have never been to South Africa and am quite jealous19:45
mordredzigo: so if we don't get this done until friday of this week, you're otherwise distracted by Debconf?19:45
pabelangermordred: zigo: Ya, I'm going to do that this week. Starting with UCA to refresh the AFS knowledge, then I'll change gears to the debian repo bits19:45
zigomordred: This week is debcamp, so it's hack time for the whole week, until debconf next week. So I'll be available.19:46
mordredpabelanger: awesome. I will put some goats into a box and mail them to you19:46
mordredpabelanger: they may have eaten the box by the time they get there19:46
mordredbecause goats19:46
pabelangerexcellent!19:46
*** nwkarsten has joined #openstack-infra19:46
zigogr8 !19:47
derekh_afkpabelanger: thanks for the help with rh2, looks like nodepool is now able to spin up VM's on it, can we add the experimental job now and I'll work on getting it it to work tomorrow?19:47
derekh_afkpabelanger: https://review.openstack.org/#/c/330515/19:47
AJaegerderekh_afk: do we have images uploaded?19:48
zigomordred: pabelanger: As a carrot, if it may help, the day this repo stuff is done, I'll take over deb packaging of all the infra stuff you need me to maintain...19:48
zigo:)19:48
derekh_afkAJaeger: yes, and 3 active instance waiting to be used19:48
*** derekh_afk is now known as derekh19:48
AJaegerderekh: great ;)19:49
derekhAJaeger: thanks19:49
*** jlanoux has quit IRC19:49
*** fawadkhaliq has quit IRC19:51
*** julim has joined #openstack-infra19:51
*** gouthamr has quit IRC19:51
*** fawadkhaliq has joined #openstack-infra19:51
pabelangerzigo: all good. I've dropped the ball long enough.19:51
*** harlowja has joined #openstack-infra19:52
pabelangerderekh: checking19:52
pabelangerderekh: AJaeger: +319:53
*** piet has joined #openstack-infra19:53
SwansonIs the Cisco PNR CI spamming cinder patches for any reason? Cause the links don't work and I'm 95% certain it is a neutron (or similar) CI.19:53
*** esikachev has quit IRC19:53
AJaegerSwanson: do you have a link to a review?19:54
*** akshai_ has joined #openstack-infra19:54
SwansonAJaeger, https://review.openstack.org/33462819:54
Swansonhttp://192.133.158.2:8080/job/cisco-cinder/39019:55
AJaegerSwanson: that URL works for me...19:55
*** ihrachys has quit IRC19:56
SwansonAJaeger, the 192 one?19:56
fungiAJaeger: what specifically did you need to talk about wrt other-requirements.txt? the way forward for 200672 and its ilk?19:56
*** fawadkhaliq has quit IRC19:56
*** maishsk_ has joined #openstack-infra19:56
*** maishsk has quit IRC19:56
AJaegerSwanson: yeah...19:56
*** esikachev has joined #openstack-infra19:56
*** maishsk_ is now known as maishsk19:57
*** sambetts is now known as sambetts|afk19:57
AJaegerfungi, I created a few more changes today - with the goal to shrink bindep-fallback moving forward.19:57
AJaegerSo, how do we shrink bindep-fallback? (A) Remove changes from master and then backport like this swift change https://review.openstack.org/#/c/334348/  ? Or (B) get everything in master and wait until old branches are retired? Or (C) have a bindep-fallback version for some stable branches to use  - as notmyname suggested in the review?19:57
SwansonAJaeger, I can't get there. And the reviews pop up about 10 seconds after the review is posted.19:57
AJaegerSwanson: looking at the log file: The CI system is indeed completely broken ;(19:58
*** akshai has quit IRC19:58
AJaegerfungi, I basically want us to move some tiny steps forward if possible.19:58
AJaegerfungi, And then,  there's the question how to handle firefox and others - we have firefox-install in jenkins/jobs/macros.yaml. Should we delete the install and move completely to other-requirements for these?19:59
fungiAJaeger: yeah, that's a good point. i had mostly just assumed that bindep-fallback.txt was going to mostly remain as-is except for things we know aren't needed any longer, and simply become less relevant over time as more and more projects adopted the other-requirements.txt model (which has the added benefit of speeding up their jobs)19:59
fungiAJaeger: but for macros which explicitly install stuff, i think those make more sense to be able to get rid of sooner now that we have a solution20:00
derekhpabelanger: great, thanks, hopefully I should get that job passing tomorrow ASAP20:00
AJaegerfungi, this morning a change for bindep-fallback merged that added dbus - see I4ce7759c103b45de84a2822e000fdc860b4bd6c3 . The question for me is whether we should allow additions there as well. This triggered my looking into it20:01
openstackgerritMerged openstack-infra/project-config: Add a experimental tripleo job on rh2  https://review.openstack.org/33051520:01
AJaegerfungi, but if we get rid of macros, we need to add other-requirements also to all active branches, correct?20:01
fungiAJaeger: yep, i think we should definitely look critically at any additions to the file. how many projects needed dbus installed to run their jobs?20:01
fungiAJaeger: all supported branches which need the package at least, yes20:02
*** rockyg has joined #openstack-infra20:02
openstackgerritMerged openstack-infra/system-config: OpenStack-CI Apt mirror for Ubuntu Cloud Archive  https://review.openstack.org/33015220:02
*** jamesmcarthur has quit IRC20:02
AJaegerfungi, launchpadlib is 6ish repos, not sure about the other dependency. tonyb wanted to send changes to add other-requirements20:02
AJaegerfungi, but let me add a comment to for bindep-fallback20:02
fungiAJaeger: definitely adding dbus to bindep-fallback.txt sounds like it might have been a poorly-informed decision. looking up that commit now20:03
*** tongli has quit IRC20:04
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add comment to bindep-fallback  https://review.openstack.org/33464220:04
*** Sukhdev_ has quit IRC20:04
AJaegerfungi: that was done very quickly while both of us were asleep - due to new releases that broke a couple of projects.20:04
pabelangerderekh: should be ready to use now20:05
fungiAJaeger: okay, if it was a widespread regression, that makes some sense20:06
fungifaster to fix there20:06
AJaegerfungi, not that fast to fix - needs new images AFAIK.20:06
*** jsavak has quit IRC20:07
notmynamewhat's the recommendations in requirements.txt wrt order? does order matter? is it supposed to be alphabetized?20:07
*** jsavak has joined #openstack-infra20:07
*** sarob has joined #openstack-infra20:07
AJaegernotmyname: the order is the order pacakges get installed.20:08
fungiorder doesn't matter. alpha order does make it easier to maintain20:08
notmynameack, thanks20:08
fungioh, requirements.txt20:08
*** woodster_ has joined #openstack-infra20:08
fungibut yes, order _can_ matter to pip20:08
notmynameok20:08
*** gouthamr has joined #openstack-infra20:08
AJaegerfungi, 4 repos have keyring in requirements, and there were 6 or 7 with launchpad lib - so I don't think that's too widespread. That's why I broad this up this morning. releases repo now has other-requirements.txt...20:09
fungiin odd ways that lead to behavior changes in what versions of dependencies get installed if you decide to reorder them20:09
funginotmyname: ^20:09
*** rdx_matt has joined #openstack-infra20:09
notmynamefungi: so "keep it the same as g-r"?20:09
fungiso it's best to avoid reordering it just for fun20:09
AJaegernotmyname: g-r is alphabetical, isn't it?20:09
notmynameAJaeger: not completely20:09
notmynamefungi: sure. reviewing a patch that adds something to the file, and the patch added it at the end. just wasn't sure if that mattered20:10
fungiif possible, yes. i can't recall if the requirements check job or requirements proposals introduce/expect g-r's ordering of entries20:10
notmynamefungi: I'm pretty sure not (this proposed patch passes CI)20:10
derekhpabelanger: I've run "check experimental" on a patch but its not running, I guess I need to wait a little?, will try again later ( filter for review 111011 on http://status.openstack.org/zuul/ )20:10
fungiyeah, i expect it just validates entries line-by-line in any order20:10
AJaegerSo, fungi, moving forward with other-requirements: Remove the explicit installs in project-config is one goal. Should we also shrink the list of default packages - or rather not care for now about these?20:10
pabelangerderekh: oh, right. zuul needs to know about it20:11
pabelangerderekh: should be there in 15mins20:11
derekhpabelanger: ack20:11
fungiAJaeger: if there are some we know aren't used any more i don't see any harm in taking them out of the list, but i wouldn't invest a lot of effort into researching those either20:11
AJaegernotmyname: the order matters if one requirement is capped. Assume A requires B and you have both A and B in the list. If you have different caps on the requirements on B in package A and requirements, the order is important. So, adding at end is safe.20:12
fungias for the dbus addition, getting new images updated is potentially faster than trying to get other-requirements.txt additions merged to a bunch of different projects/branches, depending on how widespread the sudden breakage was20:12
notmynameAJaeger: makes sense. but I think I'd prefer to mirror the order in g-r unless there's a good reason not to. will make long-term maintenance simpler, probably.20:13
notmynameAJaeger: that being said, it's not one of the things I'll worry about too much and lose sleep over :-)20:14
AJaegerfungi: swift was the one - the erasurecode - see the backport https://review.openstack.org/#/c/334348 . Ok, let's the shrinking of bindep put on the back burner and rather simplify project-config.20:14
AJaegernotmyname: I'll probably abandon my backports ;)20:14
*** rdx_matt has quit IRC20:14
notmynameAJaeger: oh, ok. FWIW, you tell me it's the right thing to do, and I'll merge it. but it did spark those questions in my mind20:14
*** ddieterly is now known as ddieterly[away]20:15
AJaegernotmyname: as discussed above with fungi, it's a good change but let's focus on other things20:15
notmynameAIUI it's a change that has the most direct benefits to -infra (and indirect benefits to end-users)20:16
AJaegerthanks fungi for the comments.20:16
AJaegernotmyname: agreed.20:16
fungiyeah, i agree we want other-requirements.txt to be something that works for projects who want it, but i also don't want an emergency situation to rush it into production for anyone20:17
*** _nadya_ has joined #openstack-infra20:17
AJaegerfungi, I have to leave now. Would be nice, if you and lifeless could review my bindep change https://review.openstack.org/#/c/334421 again, please, so that we can do a new bindep release.20:17
fungiif we don't proceed with care it could sour people on the solution20:18
fungiAJaeger: yep, i saw you updated it. will take a look. thanks!20:18
AJaegerfungi, I think we're a bit too carefull, this has low prio for us right now. Let's see whether I can move a single step forward this week...20:19
* AJaeger waves good bye20:19
*** sdake_ has joined #openstack-infra20:19
mordrednotmyname: the order in g-r is bad20:20
*** hashar has quit IRC20:21
*** flepied has quit IRC20:21
mordrednotmyname: it is not curated for order purposes nor is it a good order to copy - it's alphabetical in two sections to reduce merge conflicts20:21
*** mrmartin has quit IRC20:21
derekhpabelanger: gate-tripleo-ci-centos-7-ovb-ha running as expected on rh2 ,20:22
*** sdake has quit IRC20:22
*** ociuhandu has joined #openstack-infra20:22
mordrednotmyname: that said, specific order issues are usually things you discover on a per-project basis and should be mitigated with upper-constraints.txt files which change the way deps are found/resolved20:22
*** amitgandhinz has quit IRC20:22
*** ddieterly[away] is now known as ddieterly20:22
pabelangerderekh: ya, see that now20:23
*** amitgandhinz has joined #openstack-infra20:23
notmynamemordred: ok, so it completely doesn't matter what order a new entry in a project's req's.txt is in, as long as it doesn't break?20:23
mordrednotmyname: the only two I know off the top of my head that want specific order is that pbr, if mentioned at all in a requirements.txt file should _always_ come first, and hacking should come before pep8/flake8/pyflakes20:23
mordrednotmyname: that's right20:23
notmynamemordred: ok20:23
mordrednotmyname: (although if you list hacking, it's best to avoid listing pep8,pyflakes,flake8 too)20:23
*** mhickey has joined #openstack-infra20:24
*** esikachev has quit IRC20:24
openstackgerritMerged openstack-infra/groups: Upgrade Views to 3.14  https://review.openstack.org/33462720:25
fungis/pep8/pycodestyle/g20:25
fungi;)20:25
clarkbis the issue worked around by mordreds ansible patch the only remaining known zuul launcher issue?20:29
mtreinishmordred: yeah you don't want to list pep8, flake8, etc at all if you list hacking. If you list it after hacking it'll potentially break things20:29
pabelangerclarkb: As far as I know ATM20:29
mtreinishbefore hacking should work, but it's safer to just let hacking install the correct versions as deps20:30
openstackgerritMatt Borland proposed openstack-infra/project-config: Fix npm-run false positives  https://review.openstack.org/33458220:30
*** jamesmcarthur has joined #openstack-infra20:31
*** jamesmcarthur has quit IRC20:31
mordredmtreinish: ++20:31
mordredclarkb: as far as I know20:31
clarkbcool20:32
clarkbwe appear to still have the ssh timeout issue to osic20:32
*** flepied has joined #openstack-infra20:32
clarkbpabelanger: ^ any update on that? I know we bumped the timeout time but I guess that wasn't a magical fix20:32
clarkband ovh-gra1 is overquota, not sure why yet20:32
*** jsavak has quit IRC20:32
*** jsavak has joined #openstack-infra20:33
*** derekh has quit IRC20:33
*** maishsk has quit IRC20:33
pabelangerclarkb: no, nothing back from rackspace on it. I seen cloudnull was back online. Maybe we can loop him back in20:34
clarkbpabelanger: I double checked the timeout and it is 240s so ya cloudnull you around?20:35
cloudnullpong20:36
clarkb172.99.106.50 is a very recent IP that failed host uuid: 0674dc54-eba3-4515-be8c-19d4a8f7e48b20:36
cloudnullpabelanger:  still the same issue you pinged about before I was on Holiday ?20:36
clarkbcloudnull: we see ssh fail due to timeouts against a non trivial number of osic instances20:36
clarkbthe above ip and uuid was from 5 minutes ago20:36
*** oanson has joined #openstack-infra20:37
openstackgerritPaul Belanger proposed openstack-infra/puppet-ansible: Enable pipelining for ansible  https://review.openstack.org/33465220:37
cloudnullclarkb: looking into it20:38
pabelangercloudnull: ya, didn't hear back from contacts in rackspace out the problem20:38
cloudnull:'(20:38
cloudnullthis is why we cant have nice things20:38
*** sarob has quit IRC20:39
*** maishsk has joined #openstack-infra20:39
*** fawadkhaliq has joined #openstack-infra20:39
*** sarob has joined #openstack-infra20:39
*** fawadkhaliq has quit IRC20:39
clarkbcloudnull: I can dig up more examples if it will help20:40
cloudnullif you have access to it that'd be great20:40
*** Apoorva has quit IRC20:40
cloudnullpabelanger: these IPs still relevant to the issue http://paste.openstack.org/show/507754/  ?20:40
*** Apoorva has joined #openstack-infra20:40
*** fawadkhaliq has joined #openstack-infra20:40
*** eeiden has quit IRC20:41
*** asettle has joined #openstack-infra20:42
clarkbI will get a list of 10 recent cases20:43
openstackgerritPaul Belanger proposed openstack-infra/system-config: Remove whitespaces for UCA erb file  https://review.openstack.org/33465420:44
*** fawadkhaliq has quit IRC20:45
*** yamahata has quit IRC20:46
*** yamahata has joined #openstack-infra20:46
openstackgerritLucas Dutra Nunes proposed openstack-infra/jenkins-job-builder: Properties: fix copyartifact with several projects  https://review.openstack.org/33465620:47
*** rdx_matt has joined #openstack-infra20:47
clarkbcloudnull: http://paste.openstack.org/show/523653/ those are al lfro mtoday20:47
*** yamahata has quit IRC20:48
*** sarob has quit IRC20:48
*** inc0 has joined #openstack-infra20:48
cloudnullthanks clarkb20:48
*** yamahata has joined #openstack-infra20:48
*** jamesmcarthur has joined #openstack-infra20:48
inc0fungi, ping20:49
*** sdake has joined #openstack-infra20:49
*** timrc has quit IRC20:49
clarkbcloudnull: the last hour actually, so should hopefully be useful20:49
openstackgerritChris MacNaughton proposed openstack-infra/project-config: Add ceph-proxy project to Juju Charms  https://review.openstack.org/33465820:50
*** jlk has quit IRC20:51
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Update OpenShift Pipeline plugin  https://review.openstack.org/33463220:51
fungiinc0: heyhey, got some updates on what's provisioned?20:52
inc0questions rather, we're still working on it20:52
*** jlk has joined #openstack-infra20:52
*** edmondsw has quit IRC20:52
*** jlk has quit IRC20:52
*** jlk has joined #openstack-infra20:52
*** rdx_matt has quit IRC20:52
*** hichihara has joined #openstack-infra20:52
inc0question is: my superiors want's to know if that's not an agreement for life and, given proper heads up, we'll be able to back off20:52
*** sdake_ has quit IRC20:53
*** timrc has joined #openstack-infra20:53
inc0since we don't really own hardware, OSIC governance board can just disown us20:53
inc0extremaly unlikely20:53
inc0but still, you know..20:53
inc0(also I'll fight against it with claws and teeth)20:54
clarkbwe have already had to stop using one cloud because it went away, so we are not strangers to this20:54
fungiinc0: yep, we don't have any expectation (nor can we) that our donated services will stick around indefinitely20:54
inc0ok, that's what I thought20:55
inc0thanks for confirmation20:55
fungicompanies/organizations shift priorities, change focus, or even go out of business/cease existing entirely20:55
*** sarob has joined #openstack-infra20:55
fungiwe don't want to put forth effort to get this set up if it's planned to not be available for long, but if there's a relatively long-term anticipation it can be provided then that's worth the effort20:56
inc0yeah, I don't expect it disapear anytime soon20:56
fungilike, if this is going to go on for a couple of development cycles, that's easily justifiable20:56
inc0and by soon I mean at least a year or so20:56
fungiwhereas if it's only for a couple months, we might want to spend time working on something else20:57
*** rdx_matt has joined #openstack-infra20:57
*** rdx_matt has quit IRC20:58
*** esberglu has quit IRC20:58
inc0I don't expect it to be short20:58
*** thorst_ has quit IRC20:58
inc0I'll be pissed if it is because our team is spending time on it too;20:58
*** asettle has quit IRC20:58
inc0;)20:58
*** shamail has joined #openstack-infra20:58
fungiindeed!20:59
*** amitgandhinz has quit IRC20:59
*** amitgandhinz has joined #openstack-infra21:00
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Update OpenShift Pipeline plugin  https://review.openstack.org/33463221:00
*** fawadkhaliq has joined #openstack-infra21:01
mriedemlooks like e-r is dead? http://status.openstack.org//elastic-recheck/data/uncategorized.html21:02
clarkbthey got stuck behind a lock which I freed on friday21:03
clarkbI wonder if that has happened again21:03
*** sarob has quit IRC21:05
*** lucas-afk has quit IRC21:06
*** sarob has joined #openstack-infra21:07
*** aysyd has quit IRC21:07
*** raildo is now known as raildo-afk21:07
*** abregman has quit IRC21:08
clarkbmriedem: the data files all look current21:09
*** gouthamr has quit IRC21:09
clarkbmriedem: guessing that maybe an e-r change broke things but wasn't noticed until the lock queue was freed on friday?21:09
clarkbthough I know that it was working on friday because I double checked the graphs then21:09
*** sdake_ has joined #openstack-infra21:12
openstackgerritBen Nemec proposed openstack/diskimage-builder: Generalize logic for skipping final image generation  https://review.openstack.org/33404221:12
*** esberglu has joined #openstack-infra21:12
*** lucasagomes has joined #openstack-infra21:13
*** sdake has quit IRC21:13
mriedemclarkb: ok, i'll run the graph locally and see what happens21:14
clarkbcloudnull: let me know if I can do anything else to help21:14
cloudnullI've got a couple of hosts that seem to be misbehaving , im looking into the issues now.21:15
*** sdake has joined #openstack-infra21:16
cloudnulli've identified 7 hosts that may need some love.21:16
cloudnulland your failing VMs have been landing on them a couple of times.21:17
*** sdake_ has quit IRC21:17
clarkbya its been pretty persistent, unhappy hypervisors would explain it21:17
*** eharney has quit IRC21:17
cloudnullI've not figured out the problem yet, but looking into it now.21:18
clarkbcloudnull: fyi you can check the error node launch attempts graph at http://grafana.openstack.org/dashboard/db/nodepool-osic once you think it is fixed to see if those errors drop off21:18
pabelangercloudnull: I would have to run the scan again to see21:19
cloudnullIf i'm right, ubuntu-trusty-osic-cloud1-2038778 and ubuntu-trusty-osic-cloud1-2038777 will have failed too.21:19
pabelangerclarkb: oh, thanks21:19
clarkbcloudnull: let me check21:19
*** lucasagomes has quit IRC21:19
openstackgerritKarthik Prabhu Vinod proposed openstack-infra/project-config: WIP, DNM: Cinder multinode grenade job  https://review.openstack.org/33453721:20
clarkbcloudnull: confirmed both of those timed out waiting for ssh as well21:20
cloudnullkk21:20
openstackgerritPaul Belanger proposed openstack-infra/system-config: Fixes for UAC mirror  https://review.openstack.org/33467121:20
*** rhallisey has quit IRC21:21
pabelangerodyssey4me: ^ some fixes I needed for UCA mirror21:21
pabelangerodyssey4me: import process happening now21:21
*** dfflanders has joined #openstack-infra21:23
*** asettle has joined #openstack-infra21:24
*** fawadkhaliq has quit IRC21:24
*** rdx_matt has joined #openstack-infra21:25
*** rdx_matt has quit IRC21:25
*** asettle has quit IRC21:26
*** yamamoto has joined #openstack-infra21:27
*** lucasagomes has joined #openstack-infra21:27
*** _nadya_ has quit IRC21:34
*** thorst_ has joined #openstack-infra21:34
*** permalac_ has joined #openstack-infra21:35
*** permalac has quit IRC21:36
*** ldnunes has quit IRC21:38
*** sarob has quit IRC21:38
*** thorst_ has quit IRC21:38
*** fawadkhaliq has joined #openstack-infra21:39
*** nwkarsten has quit IRC21:39
clarkbour image uploads appear to be pretty reliable these days, thats exciting21:40
*** nwkarsten has joined #openstack-infra21:41
*** shamail has quit IRC21:42
*** PollyZ has quit IRC21:42
*** fawadkhaliq has quit IRC21:43
pabelangerya, they are working well21:43
*** hichihara has quit IRC21:44
pabelangeralso, this: http://mirror.dfw.rax.openstack.org/ubuntu-cloud-archive/21:44
pabelangerdoing vos release now21:44
*** pao_ has quit IRC21:44
clarkbya I was going to ask about that, are people using cloud archive in our giant botnet?21:44
*** matt-borland has quit IRC21:44
clarkbcurious because it has never worked for us in the past so evidence of functioanlity is cool21:44
*** ddieterly is now known as ddieterly[away]21:45
pabelangerya, think both ansible and puppet jobs are21:45
pabelangerEmilienM: odyssey4me ^21:45
*** fawadkhaliq has joined #openstack-infra21:45
*** nwkarsten has quit IRC21:45
pabelangermirror-update.o.o is in emergency until we land 33467121:46
*** oanson has quit IRC21:46
pabelangerand 33465421:46
*** aeng has quit IRC21:46
*** aeng has joined #openstack-infra21:47
cloudnullclarkb: any way you could dig up the 2 failures errors that happened 21:45:10 ?21:47
cloudnullJust the instance IDs21:48
clarkbcloudnull: ya give me a sec21:48
openstackgerritKarthik Prabhu Vinod proposed openstack-infra/project-config: WIP, DNM: Cinder multinode grenade job  https://review.openstack.org/33453721:49
*** fawadkhaliq has quit IRC21:49
clarkbcloudnull: what type of errors? ssh timeouts? I don't see any exactly at that time but can get you ones that are close21:50
*** coreyob has quit IRC21:50
cloudnulli was just looking at the graph, maybe a delay in timing21:50
*** PollyZ has joined #openstack-infra21:50
clarkbcloudnull: 0dac2bbc-abf1-42fe-9a45-773f4b0a6c91 happened 27 seconds after 21:45:1021:51
clarkbb2098613-baac-4ea2-acf8-61eb7e2d378e is another that happened after, around 21:4721:51
*** coreyob has joined #openstack-infra21:52
cloudnullthanks21:52
*** rossella_s has quit IRC21:52
clarkbd742f3a4-a09c-4884-a3c6-fc05b1b1b06b is another21:52
*** rdx_matt has joined #openstack-infra21:53
*** rdx_matt has quit IRC21:53
*** ddieterly[away] is now known as ddieterly21:53
cloudnullI disabled 5 hosts that we're misbehaving, which is likely the cause of the recent spike. I'm looking into why they're upset now.21:54
ianwgreghaynes / SpamapS: ping... just wanted to check in on dib release21:54
clarkbcloudnull: ok21:54
mriedemclarkb: i get an empty page locally too, so something weird going on21:54
mriedemi'll have to run the es api queries manually probably to debug it21:54
cineramaianw: from your list you have two merged, one with jenkins fails, and one -1ed21:55
*** mriedem has quit IRC21:55
lifelessAJaeger: fungi: reviewed21:55
greghaynesianw: ack, I reviewd a couple of those but not all, let me look now...21:55
cineramaianw: 333932 should be landable with a quick doco fix21:56
ianwcinerama: yeah, cool, going through now.  https://review.openstack.org/#/c/332866/ looks like it could go in too21:56
greghaynesianw: looks like the outstanding ones are 1 -1 from me and 1 is mine21:56
cineramaianw: ah a late entrant!21:57
cinerama331911 looks like it needs some project config and/or puppet love on the infra side21:57
*** dizquierdo has joined #openstack-infra21:58
ianwgreghaynes: what prompted the sphinx-build one?  i'm happy if you just put it in, it's what lots of other projects do21:58
*** jcooley has joined #openstack-infra21:58
*** ddieterly is now known as ddieterly[away]21:58
greghaynesianw: heh, trying to make readthedocs work to build us21:59
cineramagreghaynes, if you want to look at 332866 real quick i'm pretty sure we can +a21:59
greghaynesianw: it isnt a huge thing because of what you pointed out, but seems easy enough to fix21:59
greghaynescinerama: ok21:59
greghaynesianw: also, for added fun, some random person had squatted the diskimage-builder project on readthedocs so I emailed them and got it back22:00
ianwgreghaynes: cool.  yeah when someone wants, the "list of elements" page could do with some love.  i was thinking put it in a table, and somehow extract some sort of slug/small description for each one would be heaps better22:01
cineramagreghaynes, ianw: weird so on nodepool /opt/dib_cache gets created & owned by nodepool but we're trying to create it in project config and chown to jenkins22:01
greghaynesianw: yesplz22:01
greghaynescinerama: ah, woops22:02
ianwcinerama: is this relating to my change recently to ! use tmpfs?22:02
clarkbcinerama: I don't think nodepool will create it, nodepool needs it to be there if dib is configured to use it22:02
clarkboh maybe dib will make it? in any case it should be owned by nodepool as set by puppet22:02
clarkbthen dib runs as the nodepool user22:02
*** Daisy has joined #openstack-infra22:03
cineramaclarkb, i meant in puppet-nodepool vs us trying to do it in project-config22:03
clarkbcinerama: I am confused, are we doing it in two places?22:03
greghaynesianw: I think so, it was broken on a permissions error, I made a fix to project-config but maybe my fix was broken too22:04
clarkbnodepool.o.o:/opt/dib_cache is nodepool:nodepool22:04
openstackgerritSagi Shnaidman proposed openstack-infra/gear: Support TCP keepalives in geard  https://review.openstack.org/33445222:04
cineramaclarkb, i think so because it's in our project config22:04
greghaynesianw: https://review.openstack.org/#/c/333415/ was the fix22:04
greghaynescinerama: ^22:04
ianwcinerama: yeah, i'm getting a bit confused too ... what part of project-config is making that on the nodepool host?22:05
ianwor are we talking about test workers?22:05
cineramagreghaynes, thanks. we just need to recheck that again then22:05
*** jamesmcarthur has quit IRC22:05
clarkbok, I think I understand now, you don't mean the literal project config for the production nodepool deployment22:05
clarkbjust the JJB config for your tests22:06
*** mdrabe has quit IRC22:06
cineramaclarkb, yep22:06
clarkb(which happen to live in project-config)22:06
*** ddieterly[away] is now known as ddieterly22:06
*** YorikSar_ has quit IRC22:07
*** Daisy has quit IRC22:07
clarkbcinerama: greghaynes ianw note that since that job doesn't use devstack-gate it may not end up with a very large /opt on some clouds22:08
*** jsavak has quit IRC22:08
clarkbstill bigger than 2gb though iirc22:08
cineramaoops crossed rechecks there22:09
*** zul_ has joined #openstack-infra22:09
cineramaianw, got anything else?22:10
*** fawadkhaliq has joined #openstack-infra22:10
ianwcinerama: don't think so.  everything else seems like bigger changes ... we've just got a queue of little fixups atm.  did you see my comments on svc-map?22:11
*** zul has quit IRC22:12
*** kien-ha has quit IRC22:12
*** peterlisak has quit IRC22:13
*** esberglu has quit IRC22:13
*** onovy has quit IRC22:14
*** fawadkhaliq has quit IRC22:14
cineramaianw: i did. so broadly what i tried to do is to disturb relatively little here (though of course the export is a change). i think andreas' comments are valid and interesting but i'd also like to land something sooner than i think making a broader change will allow22:14
cineramaianw: (as i have a couple of changes prepared which depend on the end result of changed behaviour from svc-map)22:15
*** amitgandhinz has quit IRC22:15
*** rockyg has quit IRC22:16
*** YorikSar has joined #openstack-infra22:16
ianwcinerama: am i right in thinking that "simply" walking a list of tuples (element, path) is what is required?  i had a thought that the existing element-info could probably export that correctly rather quickly22:17
cineramaianw: so the end goal is that we will allow duplicate service mappings, but try to do so in a safe way that protects people from doing something silly within reason22:18
*** akshai_ has quit IRC22:19
cineramaianw: so my pass at that was to assume out-of-tree copies of the elements could override. i also assumed that multiple out-of-tree copies was going to be a fairly rare situation22:19
*** pradk has quit IRC22:19
cineramaianw, that might be the best way to do it actually22:20
*** rdx_matt has joined #openstack-infra22:20
*** rdx_matt has quit IRC22:21
*** inc0 has quit IRC22:21
*** jamielennox is now known as jamielennox|away22:21
ianwcinerama: i feel like if we had the list of elements in order -- where "order" is defined by being found first in ELEMENTS_PATH -- you could basically walk that list backwards and have earlier elements override the later ones.  since user provided ones will be first in ELEMENTS_PATH, that seems like it would work22:24
ianwcinerama: i will try to flesh something out today and get back to you, this is mostly a thought bubble at this point so i'd like to convince myself the code is somewhat amenable to it :)22:25
cineramaianw, could do, i guess relying on the order of ELEMENTS_PATH is okay22:25
cineramaianw, so the main objection is to exposing base_elements_dir?22:26
*** ddieterly has quit IRC22:27
ianwcinerama: yes, more the idea of overriding them based on path location like that, corner cases when doing that and then other elements taking their own approaches to doing the same thing.  be nice if we could just have an "API", or at least some common defined behaviour around override22:29
cineramaianw: ah right because if we tell the user to specify in order of greatest to least priority, then they should have a predictable result22:33
*** dizquierdo has quit IRC22:34
openstackgerritScott DAngelo proposed openstack-infra/project-config: Add experimental Cinder job for multibackend  https://review.openstack.org/33067822:36
*** Apoorva has quit IRC22:38
*** Apoorva has joined #openstack-infra22:38
*** ffrank has joined #openstack-infra22:43
cineramaianw: so element-info sounds like a potentially reusable choice22:43
jheskethMorning22:43
*** julim has quit IRC22:46
*** psilvad has quit IRC22:47
*** rdx_matt has joined #openstack-infra22:48
*** rdx_matt has quit IRC22:49
*** csomerville has quit IRC22:53
*** gouthamr has joined #openstack-infra22:54
pabelangerjhesketh: morning22:54
openstackgerritC.J. Collier proposed openstack-infra/jenkins-job-builder: Replace exeception.message with str(exception)  https://review.openstack.org/33470322:57
*** yamamoto has quit IRC22:58
*** salv-orl_ has joined #openstack-infra22:59
*** mhickey has quit IRC23:01
*** salv-orlando has quit IRC23:01
*** tonytan4ever has quit IRC23:02
*** vhosakot has quit IRC23:03
*** hongbin has quit IRC23:04
*** ajmiller_ has quit IRC23:06
*** PollyZ has quit IRC23:06
*** ajmiller_ has joined #openstack-infra23:06
cloudnullclarkb: so I think we've resolved the issues with the bad actor hosts, and I also believe I've found an issue with our settings for the neutron metadata backlog size. Everything has been updated and all seems to be online and healthy. I'll continue to watch the issues and see if the error node graph starts moving down and to the right :)23:06
clarkbcloudnull: ty ty23:08
*** xyang1 has quit IRC23:08
cloudnullwell dont thank me yet, http://i.imgur.com/57kOlC8.gif23:10
openstackgerritWei Cao proposed openstack-infra/puppet-openstackci: set up a git repo add set account's default identity  https://review.openstack.org/33470623:13
*** rajinir has joined #openstack-infra23:15
*** rdx_matt has joined #openstack-infra23:16
*** amitgandhinz has joined #openstack-infra23:16
*** rdx_matt has quit IRC23:16
*** gordc has quit IRC23:16
pabelangerclarkb: cloudnull: awesome work23:20
cloudnullseems to be trending to a more happy space.23:20
openstackgerritIan Wienand proposed openstack/diskimage-builder: Release notes for 1.18  https://review.openstack.org/33471123:20
* cloudnull relizes I just jinxed it23:20
*** amitgandhinz has quit IRC23:22
cloudnullI'm reloacting home. bbl. thanks for everything clarkb pabelanger and sorry its taken so long to get movement on this .23:22
greghaynescinerama: commented on your svc-map patch, I think andreas might just be pointing out the issue not saying we have to fix it now23:23
asselin_rcarrillocruz, i managed to get past the keys issues. puppet part is failing, and not sure why it's trying to sudo: http://paste.openstack.org/show/523674/. still learning how to dig deep in ansible. any tips appreciated.23:27
openstackgerritWei Cao proposed openstack-infra/puppet-openstackci: Create environments directory  https://review.openstack.org/33471323:29
*** fawadkhaliq has joined #openstack-infra23:30
openstackgerritKhai Do proposed openstack-infra/puppet-gerrit: run git gc instead of repack for git repos  https://review.openstack.org/33471423:31
*** xarses has quit IRC23:32
clarkblooks like its sudoing to become root after connecting as asselin23:32
*** fernnest has joined #openstack-infra23:33
*** fawadkhaliq has quit IRC23:35
*** ffrank has quit IRC23:35
*** dfflanders has quit IRC23:36
*** piet has quit IRC23:38
*** onovy has joined #openstack-infra23:39
*** peterlisak has joined #openstack-infra23:39
openstackgerritKhai Do proposed openstack-infra/system-config: Remove duplicate cron job  https://review.openstack.org/33471523:40
*** piet has joined #openstack-infra23:40
*** amotoki has joined #openstack-infra23:41
*** csomerville has joined #openstack-infra23:42
*** jamielennox|away is now known as jamielennox23:43
*** rdx_matt has joined #openstack-infra23:44
*** rdx_matt has quit IRC23:44
*** amotoki has quit IRC23:45
*** gouthamr has quit IRC23:47
*** tosky has quit IRC23:51
*** bhavik has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!