Monday, 2016-11-21

*** EricGonczer_ has joined #openstack-infra00:01
*** dave-mccowan has joined #openstack-infra00:01
*** wolverineav has quit IRC00:02
ianwhmm, what's going on with f24 job queued for 12 hours?00:03
ianwoh, maybe this is the ssh issue as they're all building00:04
ianwi have the fix merging now.  i'll do a point release when it does, and then rebuild images00:04
*** alex_xu has joined #openstack-infra00:05
ianwnot that anyone's around :)00:05
*** sflanigan has joined #openstack-infra00:10
*** sflanigan has quit IRC00:10
*** sflanigan has joined #openstack-infra00:10
*** jamespage has quit IRC00:12
*** EricGonczer_ has quit IRC00:13
*** s-shiono_ has joined #openstack-infra00:14
* fungi is _definitely not around00:15
*** s-shiono has quit IRC00:16
*** rvba has quit IRC00:20
*** jamespage has joined #openstack-infra00:21
*** jamespage has quit IRC00:22
*** jamespage has joined #openstack-infra00:22
*** rvba has joined #openstack-infra00:24
*** rvba has quit IRC00:24
*** rvba has joined #openstack-infra00:24
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4  https://review.openstack.org/37120900:25
*** sdake_ has joined #openstack-infra00:27
*** sdake has quit IRC00:30
openstackgerritMerged openstack/diskimage-builder: Fix runtime ssh host keys script  https://review.openstack.org/39980500:31
openstackgerritMerged openstack/diskimage-builder: Turn off tracing around pid/chroot check  https://review.openstack.org/39936500:31
*** greghaynes has quit IRC00:33
*** tiswanso has joined #openstack-infra00:34
ianwok, 1.22.1 pushed.  i'll clean up current nodepool builds, and when puppet updates do some new builds00:34
*** sflanigan has quit IRC00:34
*** darvon has quit IRC00:38
*** darvon has joined #openstack-infra00:38
*** tiswanso has quit IRC00:38
*** wolverineav has joined #openstack-infra00:38
*** gmann has joined #openstack-infra00:39
*** greghaynes has joined #openstack-infra00:41
*** wolverineav has quit IRC00:43
*** Julien-zte has joined #openstack-infra00:44
*** sflanigan has joined #openstack-infra00:46
ianwok ... starting f24, as that seems to be the biggest blocker00:49
*** claudiub|4 has quit IRC00:49
*** wolverineav has joined #openstack-infra00:50
openstackgerritxiaodongwang991481 proposed openstack-infra/project-config: add multinode tempest test coverage in networking-sfc  https://review.openstack.org/39197900:52
*** sheeprine has quit IRC00:53
*** sheeprine has joined #openstack-infra00:53
*** wolverineav has quit IRC00:54
*** jamesdenton has joined #openstack-infra00:57
*** jamesdenton has quit IRC01:03
*** sdake has joined #openstack-infra01:05
*** sdake_ has quit IRC01:09
*** wolverineav has joined #openstack-infra01:10
*** wolverineav has quit IRC01:14
*** kiran-r has joined #openstack-infra01:18
*** dimtruck is now known as zz_dimtruck01:20
*** thorst has joined #openstack-infra01:24
*** kiran-r has quit IRC01:27
*** newmember has joined #openstack-infra01:35
*** wolverineav has joined #openstack-infra01:36
*** tovin07 has joined #openstack-infra01:40
*** wolverineav has quit IRC01:41
*** yanyanhu has joined #openstack-infra01:41
*** EricGonczer_ has joined #openstack-infra01:42
*** wolverineav has joined #openstack-infra01:43
*** newmember has quit IRC01:46
*** zz_dimtruck is now known as dimtruck01:48
*** tiswanso has joined #openstack-infra01:52
*** rbuzatu has joined #openstack-infra01:52
*** mnaser has quit IRC01:52
*** tiswanso has quit IRC01:52
*** tiswanso has joined #openstack-infra01:53
*** bhunter71 has quit IRC01:54
*** EricGonc_ has joined #openstack-infra01:55
*** rbuzatu has quit IRC01:56
*** wolverineav has quit IRC01:57
*** EricGonczer_ has quit IRC01:58
*** huanxie has quit IRC01:59
*** amrith has quit IRC02:00
*** EricGonc_ has quit IRC02:01
*** amrith has joined #openstack-infra02:02
*** amrith has quit IRC02:02
*** amrith has joined #openstack-infra02:04
*** amrith has quit IRC02:04
*** mnaser has joined #openstack-infra02:06
*** amrith has joined #openstack-infra02:06
*** amrith has quit IRC02:07
*** EricGonczer_ has joined #openstack-infra02:07
*** amrith has joined #openstack-infra02:07
*** amrith has quit IRC02:10
*** sheeprine has quit IRC02:11
*** amrith has joined #openstack-infra02:12
*** sheeprine has joined #openstack-infra02:12
*** wolverineav has joined #openstack-infra02:17
*** EricGonczer_ has quit IRC02:20
*** wolverineav has quit IRC02:21
*** spzala has quit IRC02:26
*** thorst has quit IRC02:31
*** thorst has joined #openstack-infra02:31
*** hongbin has joined #openstack-infra02:32
*** wolverineav has joined #openstack-infra02:37
*** thorst has quit IRC02:40
*** winggundamth has joined #openstack-infra02:40
*** wolverineav has quit IRC02:42
*** yuanying has quit IRC02:50
*** wolverineav has joined #openstack-infra02:50
*** Jeffrey4l has quit IRC02:51
*** yuanying has joined #openstack-infra02:51
*** yamamoto_ has joined #openstack-infra02:51
*** wolverineav has quit IRC02:55
*** harlowja has quit IRC02:57
*** antonym has quit IRC02:58
*** pleia2 has quit IRC02:58
*** dmsimard has quit IRC02:58
*** dmsimard has joined #openstack-infra02:59
*** pleia2 has joined #openstack-infra02:59
*** antonym has joined #openstack-infra03:00
ianwwell, damn.  seems fedora24 is actually hitting a kernel oops03:00
*** wolverineav has joined #openstack-infra03:01
*** wolverineav has quit IRC03:06
*** wolverineav has joined #openstack-infra03:10
*** gildub has quit IRC03:10
*** eranrom has quit IRC03:10
*** raddaoui has quit IRC03:11
*** eranrom has joined #openstack-infra03:11
*** raddaoui has joined #openstack-infra03:11
*** jascott1 has quit IRC03:12
*** SergeyLukjanov has quit IRC03:12
*** admcleod has quit IRC03:13
*** Zara has quit IRC03:13
*** Zara has joined #openstack-infra03:13
*** rattboi has quit IRC03:14
*** admcleod has joined #openstack-infra03:15
ianwit's trying to use /dev/loop... as the root device03:15
ianwurgh03:15
*** Sukhdev has joined #openstack-infra03:15
*** rattboi has joined #openstack-infra03:16
*** SergeyLukjanov has joined #openstack-infra03:17
*** wolverineav has quit IRC03:17
*** EricGonczer_ has joined #openstack-infra03:22
*** EricGonczer_ has quit IRC03:22
*** thorst has joined #openstack-infra03:24
*** zhurong has joined #openstack-infra03:27
*** wolverineav has joined #openstack-infra03:28
*** thorst has quit IRC03:32
*** wolverineav has quit IRC03:32
*** Julien-zte has quit IRC03:33
*** Julien-zte has joined #openstack-infra03:33
*** tqtran has joined #openstack-infra03:35
*** tqtran has quit IRC03:39
*** thorst has joined #openstack-infra03:43
*** thorst has quit IRC03:44
*** yuanying has quit IRC03:46
*** links has joined #openstack-infra03:46
*** wolverineav has joined #openstack-infra03:47
*** yuanying has joined #openstack-infra03:48
*** Genek has joined #openstack-infra03:50
*** sdake has quit IRC03:51
GenekHi, found that ask.o.o is down, can anyone who has access try to take a look of it.03:51
GenekIt's showing internal server error03:52
*** sflanigan has quit IRC03:52
*** wolverineav has quit IRC03:53
ianwGenek: looks like it's out of disk...03:53
Genekianw: any quick fix?03:54
*** jerryz has joined #openstack-infra03:54
ianwhmm, freed up some space, getting03:56
ianw[Sun Nov 20 21:56:42.789411 2016] [:error] [pid 8220:tid 140382344410880] [remote 100.43.81.141:40534]     from askbot.views import api_v103:56
ianw[Sun Nov 20 21:56:42.789436 2016] [:error] [pid 8220:tid 140382344410880] [remote 100.43.81.141:40534] ImportError: cannot import name api_v103:56
*** rbuzatu has joined #openstack-infra03:57
*** zhurong has quit IRC03:58
Genekhmm03:59
*** zhurong has joined #openstack-infra03:59
*** mdrabe has joined #openstack-infra03:59
*** flwang1 has quit IRC04:03
*** sflanigan has joined #openstack-infra04:09
*** rbuzatu has quit IRC04:11
*** dave-mccowan has quit IRC04:12
*** jerryz has quit IRC04:13
*** shu-mutou-AWAY is now known as shu-mutou04:13
*** gmann_ has joined #openstack-infra04:17
*** links has quit IRC04:17
*** zhurong has quit IRC04:26
*** wolverineav has joined #openstack-infra04:33
*** esikachev has joined #openstack-infra04:37
*** wolverineav has quit IRC04:38
ianwGenek: well, maybe it's up ... ?04:41
Genekianw: working now, thanks04:41
*** esikachev has quit IRC04:42
*** Jeffrey4l has joined #openstack-infra04:42
*** Jeffrey4l has quit IRC04:43
*** Jeffrey4l has joined #openstack-infra04:44
*** sflanigan_ has joined #openstack-infra04:52
*** sflanigan has quit IRC04:52
*** dchen has joined #openstack-infra04:53
*** hongbin has quit IRC04:54
*** senk has joined #openstack-infra04:57
*** wolverineav has joined #openstack-infra04:57
*** esikachev has joined #openstack-infra04:58
*** mdrabe has quit IRC05:01
*** sflanigan_ is now known as sflanigan05:02
*** esikachev has quit IRC05:02
*** asselin has quit IRC05:03
*** Genek has quit IRC05:04
*** wolverineav has quit IRC05:06
*** rbuzatu has joined #openstack-infra05:08
*** zhurong has joined #openstack-infra05:12
*** rbuzatu has quit IRC05:12
*** sandanar has joined #openstack-infra05:14
*** yamahata has joined #openstack-infra05:16
*** sshnaidm has joined #openstack-infra05:19
*** wolverineav has joined #openstack-infra05:22
*** wolverineav has quit IRC05:26
*** claudiub|4 has joined #openstack-infra05:26
*** yamamoto_ has quit IRC05:30
*** yamahata has quit IRC05:31
*** zhurong has quit IRC05:31
*** wolverineav has joined #openstack-infra05:32
*** dchen has quit IRC05:32
*** esikachev has joined #openstack-infra05:34
*** senk has quit IRC05:34
*** zhurong has joined #openstack-infra05:35
*** wolverineav has quit IRC05:36
*** esikachev has quit IRC05:39
*** snarwade has joined #openstack-infra05:41
*** dchen has joined #openstack-infra05:45
*** Julien-zte has quit IRC05:48
*** Julien-zte has joined #openstack-infra05:48
*** Julien-zte has quit IRC05:49
*** Julien-zte has joined #openstack-infra05:49
*** dchen has quit IRC05:50
*** Sukhdev has quit IRC05:54
*** hurgleburgler has quit IRC05:59
ianwok, i'm out of time, going to have to kick out f24 because there's no nodes to satisfy it06:03
lifelessnotmyname: did you get your testr question sorted?06:06
openstackgerritIan Wienand proposed openstack-infra/project-config: Move Fedora 24 to experimental  https://review.openstack.org/40005606:07
*** tojuvone has joined #openstack-infra06:13
*** yamamoto has joined #openstack-infra06:15
*** wolverineav has joined #openstack-infra06:17
*** wolverineav has quit IRC06:22
*** masuberu has joined #openstack-infra06:23
*** jaosorior has joined #openstack-infra06:25
*** masber has quit IRC06:26
*** abregman has joined #openstack-infra06:29
*** aeng has quit IRC06:29
*** masuberu has quit IRC06:31
*** masuberu has joined #openstack-infra06:31
*** adriant has quit IRC06:36
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Merge branch 'master' into workingv3  https://review.openstack.org/38947006:37
openstackgerritRenat Akhmerov proposed openstack-infra/project-config: Restore gate-mistral-tox-db-unit-postgres  https://review.openstack.org/39953406:42
*** esikachev has joined #openstack-infra06:44
*** Alagar has joined #openstack-infra06:46
*** Alagar has quit IRC06:46
*** saibarspeis has joined #openstack-infra06:46
*** jaosorior has quit IRC06:46
*** jaosorior has joined #openstack-infra06:47
*** esikachev has quit IRC06:48
*** Guest68087 has quit IRC06:49
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Use encrypted volume in scenario004  https://review.openstack.org/39822106:50
*** tojuvone_ has joined #openstack-infra06:51
*** tojuvone__ has joined #openstack-infra06:51
*** yamamoto has quit IRC06:51
*** tojuvone__ has quit IRC06:52
*** tojuvone has quit IRC06:52
*** tojuvone_ has quit IRC06:52
openstackgerritKhai Do proposed openstack-infra/puppet-gerrit: Add a known_hosts file  https://review.openstack.org/39982106:52
*** yamamoto has joined #openstack-infra06:54
openstackgerritKhai Do proposed openstack-infra/system-config: Setup known_hosts file on gerrit servers  https://review.openstack.org/39982206:57
*** florianf has joined #openstack-infra06:58
*** esikachev has joined #openstack-infra06:59
*** wolverineav has joined #openstack-infra07:00
*** tojuvone has joined #openstack-infra07:01
openstackgerritKhai Do proposed openstack-infra/puppet-gerrit: Fix placement of ssh public key  https://review.openstack.org/40006707:02
*** wolverineav has quit IRC07:05
*** gmann_ has quit IRC07:05
*** esikache1 has joined #openstack-infra07:06
*** drifterza has joined #openstack-infra07:08
*** esikachev has quit IRC07:08
*** rbuzatu has joined #openstack-infra07:09
*** rbuzatu has quit IRC07:09
*** rbuzatu has joined #openstack-infra07:10
*** esikache1 has quit IRC07:12
openstackgerritMerged openstack-infra/project-config: Move Fedora 24 to experimental  https://review.openstack.org/40005607:12
*** yuval has joined #openstack-infra07:14
*** zhurong has quit IRC07:16
*** senk has joined #openstack-infra07:17
*** pcaruana has joined #openstack-infra07:17
*** e0ne has joined #openstack-infra07:17
*** pgadiya has joined #openstack-infra07:18
*** flepied1 has quit IRC07:19
*** tuanluong has joined #openstack-infra07:21
*** wolverineav has joined #openstack-infra07:24
openstackgerritMerged openstack-infra/zuul: Refactor skip-if tests to use irrelevant-files  https://review.openstack.org/39941507:24
*** isviridov_away has quit IRC07:26
*** vaidy has quit IRC07:27
*** makowals has joined #openstack-infra07:28
tobiashhi, does someone have experience in running diskimage builder inside a docker container?07:29
*** slaweq has joined #openstack-infra07:29
tobiashI have two ubuntu trusty machines (both with aufs storage driver) where on one it fails during fstrim stating that discard is not supported07:31
AJaegertobiash: try channel #openstack-dib07:32
tobiashAJaeger: thanks, will try07:32
*** andreas_s has joined #openstack-infra07:33
*** masber has joined #openstack-infra07:34
*** wolverineav has quit IRC07:34
*** tqtran has joined #openstack-infra07:35
*** tqtran has quit IRC07:35
*** masuberu has quit IRC07:36
*** netsin has joined #openstack-infra07:38
*** wolverineav has joined #openstack-infra07:39
*** wolverineav has quit IRC07:44
*** Ravikiran_K has joined #openstack-infra07:46
*** wolverineav has joined #openstack-infra07:46
*** flwang1 has joined #openstack-infra07:49
*** wolverineav has quit IRC07:50
*** e0ne has quit IRC07:51
*** jtomasek has joined #openstack-infra07:53
*** wolverineav has joined #openstack-infra07:54
*** matrohon has joined #openstack-infra07:55
openstackgerritMerged openstack-infra/puppet-mediawiki: Add a conservative page creation rate limit  https://review.openstack.org/39989907:56
*** masuberu has joined #openstack-infra07:56
*** jtomasek has quit IRC07:57
*** masuberu has quit IRC07:58
*** jtomasek has joined #openstack-infra07:58
*** chem has joined #openstack-infra07:58
*** esikache1 has joined #openstack-infra07:58
*** masber has quit IRC07:58
*** masber has joined #openstack-infra07:58
*** wolverineav has quit IRC08:01
openstackgerritRob Cresswell proposed openstack-infra/project-config: Remove duplicated Horizon test runs  https://review.openstack.org/40008408:02
*** matrohon has quit IRC08:02
*** drifterza_ has joined #openstack-infra08:02
*** matrohon has joined #openstack-infra08:02
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Use encrypted volume in scenario004  https://review.openstack.org/39822108:03
*** e0ne has joined #openstack-infra08:05
*** Ng has quit IRC08:06
*** fkautz has quit IRC08:06
*** drifterza has quit IRC08:06
*** boris-42 has quit IRC08:06
*** drifterza_ is now known as drifterza08:06
*** ewindisch has quit IRC08:06
*** Hal has joined #openstack-infra08:07
*** Hal is now known as Guest6671108:07
*** shardy has joined #openstack-infra08:07
*** wolverineav has joined #openstack-infra08:08
*** ewindisch has joined #openstack-infra08:08
*** fkautz has joined #openstack-infra08:08
*** Ng has joined #openstack-infra08:08
*** boris-42 has joined #openstack-infra08:08
*** flepied has joined #openstack-infra08:09
*** wolverineav has quit IRC08:13
*** lezbar has quit IRC08:18
therveDoes someone know how openstack-health is updated?08:19
therveIt seems it has a 3-4 days delay, which makes it hard to use08:19
*** lezbar has joined #openstack-infra08:22
therveAlso there seems to be an issue with the zuul queue08:22
*** dtardivel has joined #openstack-infra08:24
*** dizquierdo has joined #openstack-infra08:25
*** ralonsoh has joined #openstack-infra08:25
*** ccamacho has joined #openstack-infra08:25
masayukigtherve : hi, I think I probably can see the up-to-date data on the top page. So, could you give me the URL?08:25
thervemasayukig, http://status.openstack.org/openstack-health/#/job/gate-heat-dsvm-functional-orig-mysql-lbaasv2 is the thing I'm looking at08:25
therveThe latest test run is 17th08:26
masayukigtherve : thanks, indeed, is there any gate queue(not check queue) job for today?08:27
*** amoralej|off is now known as amoralej08:27
masayukigor from 17th to today?08:27
therveWell yeah a ton08:28
*** e0ne has quit IRC08:28
*** abregman has quit IRC08:29
masayukigtherve : I think the reason is the name was changed to gate-heat-dsvm-functional-orig-mysql-lbaasv2-ubuntu-xenial ?08:32
masayukigwe can see http://status.openstack.org/openstack-health/#/job/gate-heat-dsvm-functional-orig-mysql-lbaasv2-ubuntu-xenial08:32
masayukignow08:32
thervemasayukig, Doh!08:32
therveGood call, thanks08:32
masayukigtherve : np :)08:32
thervemasayukig, So the check jobs don't appear there, right?08:33
therveThat'd be a nice thing to have08:33
masayukigtherve : yeah, correct08:34
*** rossella__ has joined #openstack-infra08:34
therveObviously they're named differently too though :/08:34
*** dingyichen has quit IRC08:35
masayukigtherve : I agree with that. But I think it increases to very huge data..08:35
*** abregman has joined #openstack-infra08:35
*** oanson has joined #openstack-infra08:36
openstackgerritMerged openstack-infra/release-tools: Force all announcements to go to new list  https://review.openstack.org/39845408:37
thervemasayukig, Does it? I would expect more gate jobs than checks ones. But yeah it's more08:37
*** jpena|off is now known as jpena08:37
openstackgerritMerged openstack-infra/release-tools: Remove redundant information from subject  https://review.openstack.org/39885908:38
*** senk has quit IRC08:39
*** dizquierdo has quit IRC08:39
*** jpich has joined #openstack-infra08:39
*** abregman has quit IRC08:39
*** arxcruz has joined #openstack-infra08:40
*** sshnaidm is now known as sshnaidm|afk08:40
masayukigtherve : I think it will be more and more and more than gate jobs, because a patch usually needs several patch-sets until it will be approved.08:40
*** rossella__ has quit IRC08:40
ttxAJaeger: could you reapply the W+1 to https://review.openstack.org/#/c/398456/ now that the dependent change merged ?08:41
thervemasayukig, Right... Jobs are just named weirdly in the heat gate it seems08:42
*** jd__ has quit IRC08:43
*** abregman has joined #openstack-infra08:43
*** hashar has joined #openstack-infra08:48
*** NobodyCam has quit IRC08:49
AJaegerttx, sure, will do.08:49
*** olaph has quit IRC08:50
*** schang has quit IRC08:50
*** jkilpatr has quit IRC08:50
*** olaph has joined #openstack-infra08:50
*** schang has joined #openstack-infra08:50
AJaegertherve: why weirdly?08:51
AJaegertherve: the ubuntu-xenial suffix is part of the migration to Xenial for newton and newer branches and done for all projects.08:52
*** jkilpatr has joined #openstack-infra08:52
*** NobodyCam has joined #openstack-infra08:52
therveAJaeger, Not that part, the prefix08:52
therveAJaeger, http://logs.openstack.org/76/398476/1/check/gate-heat-dsvm-functional-orig-mysql-lbaasv2-ubuntu-xenial/0cf89e8/ for example08:52
therveIt's a check, but it's named gate?08:52
openstackgerritTuan Luong-Anh proposed openstack-infra/zuul: Replace assertEquals with assertEqual  https://review.openstack.org/40011908:53
AJaegertherve: we name them all gate since quite some time - check was removed, there was no benefit of naming those differently08:53
therveAJaeger, OK, fair enough08:53
therveWe could remove it then :)08:54
AJaegertherve: right now we have gate for jobs in check/gate queue like gate-heat-docs... and without gate for post jobs like heat-docs...08:54
therveOK08:55
AJaegerSo, if we change, we should change both...08:55
AJaegerAnd yes, that's something to be done at one point - I even have a WIP spec up for that08:55
*** hashar has quit IRC08:55
AJaegertherve: https://review.openstack.org/38671708:55
*** hashar has joined #openstack-infra08:56
therveSounds  nice08:56
*** jd__ has joined #openstack-infra08:56
*** rbuzatu has quit IRC08:58
*** rbuzatu has joined #openstack-infra08:59
ttxAJaeger: thanks!08:59
*** zzzeek has quit IRC09:00
openstackgerritMerged openstack-infra/project-config: No longer specify announce list in tag message  https://review.openstack.org/39845609:00
openstackgerritJeffrey Zhang proposed openstack-infra/project-config: Add install docker engine builder  https://review.openstack.org/40012809:02
*** zzzeek has joined #openstack-infra09:03
openstackgerritTuan Luong-Anh proposed openstack-infra/storyboard: Replace assertEquals with assertEqual  https://review.openstack.org/40013009:04
*** witek has quit IRC09:06
*** martinkopec has joined #openstack-infra09:08
*** lucas-afk is now known as lucasagomes09:09
openstackgerritVitaly Gridnev proposed openstack-infra/project-config: [sahara] scenario jobs: jobs modifications  https://review.openstack.org/39962309:11
*** pilgrimstack has joined #openstack-infra09:16
*** hashar has quit IRC09:20
*** senk has joined #openstack-infra09:24
*** IzikP has quit IRC09:24
*** gouthamr has joined #openstack-infra09:24
*** yanyanhu has quit IRC09:24
*** jtomasek has quit IRC09:25
*** shu-mutou is now known as shu-mutou-AWAY09:25
*** GnomeKing has joined #openstack-infra09:26
*** GnomeKing is now known as BobBall09:27
*** jlibosva has joined #openstack-infra09:28
jlibosvaHi, can anybody pls help with grenade multinode failure - http://logs.openstack.org/42/399142/1/gate/gate-grenade-dsvm-multinode/a25f646/logs/grenade.sh.txt.gz#_2016-11-20_10_18_52_797 - it looks like some configuration problem09:29
*** Julien-zte has quit IRC09:32
*** nherciu has joined #openstack-infra09:35
*** asettle has joined #openstack-infra09:35
*** pblaho has joined #openstack-infra09:35
*** mhickey has joined #openstack-infra09:35
*** jtomasek has joined #openstack-infra09:37
*** jtomasek has quit IRC09:37
*** jtomasek has joined #openstack-infra09:38
openstackgerritMarkos Chandras proposed openstack/diskimage-builder: elements: pip-and-virtualenv: Add python-xml dependency  https://review.openstack.org/40015009:43
*** electrofelix has joined #openstack-infra09:43
openstackgerritBob Ball proposed openstack-infra/project-config: Add an os-xenapi-release group  https://review.openstack.org/40015309:45
*** derekh has joined #openstack-infra09:48
therveAJaeger, There seems to be an issue with node building, I don't know if it's a known problem09:48
therveBut the job queue isn't getting any better09:48
*** john-davidge has joined #openstack-infra09:49
*** e0ne has joined #openstack-infra09:53
*** Ravikiran_K has quit IRC09:53
*** john-davidge has quit IRC09:54
*** john-davidge has joined #openstack-infra09:59
*** esikache1 has quit IRC10:00
*** ggnel_t has joined #openstack-infra10:03
*** wolverineav has joined #openstack-infra10:03
openstackgerritMichal Dulko proposed openstack-infra/project-config: Set Cinder multinode grenade on master to xenial  https://review.openstack.org/39449610:03
*** ihrachys has joined #openstack-infra10:04
*** dtantsur|afk is now known as dtantsur10:12
andreykurilinAJaeger: hi! my patch fixed one issue, but it did not unblock our gates:( we got another error. Do you know something about http://logs.openstack.org/52/399752/1/check/gate-rally-dsvm-rally/5aea4d7/logs/devstacklog.txt.gz#_2016-11-20_00_31_57_153 ?10:12
*** tuanluong has quit IRC10:13
*** sambetts_ is now known as sambetts10:14
openstackgerritMerged openstack-infra/irc-meetings: Move archWG one hour later  https://review.openstack.org/39920610:14
*** arxcruz has quit IRC10:15
*** arxcruz has joined #openstack-infra10:15
*** wolverineav has quit IRC10:19
*** wolverineav has joined #openstack-infra10:20
*** wolverineav has quit IRC10:24
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Implement overcloud upgrade job - Mitaka -> Newton  https://review.openstack.org/32375010:31
*** _degorenko|off is now known as degorenko10:32
*** yolanda has joined #openstack-infra10:32
*** senk has quit IRC10:32
*** senk has joined #openstack-infra10:35
*** senk has quit IRC10:36
*** senk has joined #openstack-infra10:36
*** senk has quit IRC10:37
*** M-docaedo_vector has joined #openstack-infra10:39
*** kzaitsev_mb has joined #openstack-infra10:40
*** ldnunes has joined #openstack-infra10:44
openstackgerritMerged openstack-infra/project-config: Use xenial node for required mysql version  https://review.openstack.org/39934410:50
*** panda|Zz is now known as panda10:52
kevinbentonAJaeger: hey, can you take a look at https://review.openstack.org/400183 ?10:53
*** makowals has quit IRC10:53
kevinbentonAJaeger: currently neutron gate is blocked up10:53
openstackgerritMerged openstack-infra/project-config: Add new project networking-dpm  https://review.openstack.org/39907810:53
*** snarwade has quit IRC10:54
*** makowals has joined #openstack-infra10:55
*** lVathan[m] has joined #openstack-infra10:55
*** jordanP has joined #openstack-infra11:03
openstackgerritMerged openstack-infra/project-config: New project proposal: python-redfish  https://review.openstack.org/39159311:06
openstackgerritMerged openstack-infra/project-config: Restore gate-mistral-tox-db-unit-postgres  https://review.openstack.org/39953411:06
openstackgerritMerged openstack-infra/project-config: Swift: Make Python 3.5 check voting  https://review.openstack.org/39989211:07
openstackgerritMerged openstack-infra/project-config: Remove the runing tox in kolla-ansible jobs  https://review.openstack.org/39969411:07
*** rfolco has joined #openstack-infra11:07
*** wolverineav has joined #openstack-infra11:07
openstackgerritMerged openstack-infra/project-config: Run tests for oslo.messaging AMQP 1.0 driver on ubuntu  https://review.openstack.org/39986311:09
*** tesseract has joined #openstack-infra11:10
*** tesseract is now known as Guest9374011:11
*** wolverineav has quit IRC11:12
*** john-dav_ has joined #openstack-infra11:12
*** john-davidge has quit IRC11:12
*** sshnaidm|afk is now known as sshnaidm11:13
*** katkapilatova has joined #openstack-infra11:15
*** snarwade has joined #openstack-infra11:15
*** john-dav_ is now known as john-davidgd11:16
*** john-davidgd is now known as john-davidge11:16
openstackgerritAndy McCrae proposed openstack-infra/project-config: Skip ubuntu-trusty jobs for OpenStack-Ansible on Ocata+  https://review.openstack.org/40019711:18
*** dizquierdo has joined #openstack-infra11:19
openstackgerritAndy McCrae proposed openstack-infra/project-config: Skip ubuntu-trusty jobs for OpenStack-Ansible on Ocata+  https://review.openstack.org/40019711:23
*** adarazs has joined #openstack-infra11:25
ihrachysandreykurilin: is rally installed in a venv in devstack jobs?11:25
*** tpsilva has joined #openstack-infra11:26
andreykurilinihrachys: I think no11:26
openstackgerritAndy McCrae proposed openstack-infra/project-config: Skip ubuntu-trusty jobs for OpenStack-Ansible on Ocata+  https://review.openstack.org/40019711:27
*** wolverineav has joined #openstack-infra11:27
ihrachysandreykurilin: then heatclient version enforcement may be overridden by other projects installed11:27
*** anilvenkata has joined #openstack-infra11:28
anilvenkataclarkb, ping11:28
andreykurilinihrachys: in theory yes, but most of openstack packages have the same requirements as g-r, so heatclient==1.5.0 from rally package does not conflict with >=1.5.011:30
ihrachysandreykurilin: ok I see kevinbenton's patch to block it globally11:30
openstackgerritAttila Darazs proposed openstack-infra/project-config: Temporary push rights for tripleo-quickstart repos  https://review.openstack.org/40020011:30
openstackgerritAndy McCrae proposed openstack-infra/project-config: Skip ubuntu-trusty jobs for OpenStack-Ansible on Ocata+  https://review.openstack.org/40019711:31
*** s-shiono_ has quit IRC11:31
*** hoolio has quit IRC11:31
andreykurilinihrachys: yeah, we have two fixes which should not conflict and I do not know which one will be merged sooner :)11:32
*** wolverineav has quit IRC11:32
ihrachysandreykurilin: the rally gates are not safe lately. I wonder if that was a right move on neutron side to make it voting :)11:33
andreykurilinihrachys: oh... it is not our fault :( first issue related to telemetry services and this on to heat... I will work this week to turn off all "redundant services" for partial jobs.11:34
ihrachysandreykurilin: I don't blame you! thanks for putting off the fires11:35
*** hoolio has joined #openstack-infra11:35
andreykurilinihrachys: in your case it means that there will be only nova, neutron, keystone and it should be enough.11:36
andreykurilinihrachys: btw, the previous blocker of rally gates was neutron ;)11:36
ihrachys;)11:37
* ihrachys hides11:37
*** chandankumar has joined #openstack-infra11:41
andreykurilinihrachys: but it was two months ago and turning off several scenarios could fix that issue. Such blockers as latest ones we did not have for long time. very long:) I think the previous "real" blocker was telemetry issue, again:) So I think I made the right decision while turning off telemetry services in all unrelated  jobs.11:41
*** tojuvone has quit IRC11:42
ihrachysyeah, I remember I was fixing aodh brekage for mitaka lately11:43
ihrachys+ for reducing breakage area11:43
*** Jeffrey4l has quit IRC11:45
*** jkilpatr has quit IRC11:45
*** jkilpatr has joined #openstack-infra11:45
*** tojuvone has joined #openstack-infra11:46
openstackgerritJavier Peña proposed openstack-infra/tripleo-ci: Enable consuming packages for a feature branch  https://review.openstack.org/39956211:47
openstackgerritvenkata anil proposed openstack-infra/project-config: Create experimental Neutron DVR+HA multinode job  https://review.openstack.org/38374211:47
AJaegeryolanda: could yo ureview the stack starting at https://review.openstack.org/#/c/399743/ , please?11:47
*** sdake has joined #openstack-infra11:48
*** watanabe_isao has joined #openstack-infra11:49
adarazsAJaeger: thanks for the review. who are the infra admins I can ping about importing history?11:49
*** watanabe_isao has quit IRC11:50
pabelangerinfra-root: we're in bad shape with ubuntu-xenial nodes. I've rolled back again, but only osic-cloud1-s3500 has a good image.  nodepool-builder is building new images but still 6 hours away from new images being online.11:52
pabelangerI'm also travelling to Montreal today, so will have limited access11:52
pabelangeronline for another hour11:52
*** wolverineav has joined #openstack-infra11:53
*** sdake_ has joined #openstack-infra11:54
*** wolverin_ has joined #openstack-infra11:54
AJaegeradarazs: ask for "infra-root" - but better wait until the fire pabelanger talks about is solved ;)11:55
AJaegerpabelanger: safe travels!11:55
adarazsAJaeger: ack. thanks.11:55
*** sdake has quit IRC11:56
*** makowals has quit IRC11:56
*** jlibosva has quit IRC11:57
*** wolverineav has quit IRC11:57
*** nicolasbock has joined #openstack-infra11:58
*** makowals has joined #openstack-infra11:59
*** Julien-zte has joined #openstack-infra12:00
*** anilvenkata is now known as anilvenkata_afk12:01
pabelangerinfra-root: I've cleared all the current image builds, except ubuntu-xenial.  That should speed up the rebuild times12:02
pabelangerbuild should be done in 1h:20min, then uploads will start12:02
*** senk has joined #openstack-infra12:04
*** dave-mccowan has joined #openstack-infra12:04
andreas_sAJaeger, Hi Andreas, would you mind adding myself (andreas.scheuring@de.ibm.com) to the gerrit groups networking-dpm-core and networking-dpm-release? Or is the official way to announce that via the ML?12:06
*** wolverin_ has quit IRC12:09
*** wolverineav has joined #openstack-infra12:11
*** rtheis has joined #openstack-infra12:13
*** rhallisey has joined #openstack-infra12:13
*** shardy is now known as shardy_lunch12:14
*** pilgrimstack has quit IRC12:14
*** ccamacho is now known as ccamacho|lunch12:15
*** pabelanger has quit IRC12:15
*** pabelanger has joined #openstack-infra12:15
*** masber has quit IRC12:17
*** hashar has joined #openstack-infra12:17
*** masber has joined #openstack-infra12:17
pabelanger#status notice We are currently having capacity issues with our ubuntu-xenial nodes. We have addressed the issue but will be another few hours before new images have been uploaded to all cloud providers.12:17
openstackstatuspabelanger: sending notice12:17
openstackgerritVictoria Martinez de la Cruz proposed openstack-infra/project-config: [Manila] Adds job for Manila UI DevStack plugin  https://review.openstack.org/39976812:18
-openstackstatus- NOTICE: We are currently having capacity issues with our ubuntu-xenial nodes. We have addressed the issue but will be another few hours before new images have been uploaded to all cloud providers.12:19
openstackstatuspabelanger: finished sending notice12:20
*** lucasagomes is now known as lucas-hungry12:28
*** gongysh has joined #openstack-infra12:29
pabelangerugh12:30
pabelangergit repo looks stale12:30
pabelangerhttp://git.openstack.org/cgit/openstack/python-redfish.git12:30
AJaegerandreas_s: I do not have those permissions, an admin needs to help you - better wait a bit longer12:32
andreas_sAJaeger, ok, thanks - I'll send a mail to the ML. Thanks!12:33
pabelangerokay, puppet is running on review.o.o12:33
andreas_sAJaeger, BTW, do you know in which repo the project creators guide resides?12:33
andreas_swant to push an update...12:33
openstackgerritSteven Dake proposed openstack-infra/reviewday: setup.py has a tox error, making reviewday fail gating  https://review.openstack.org/40022712:34
AJaegerandreas_s: openstack-infra/infra-manual12:34
andreas_sAJaeger, thx!12:35
AJaegerandreas_s: or ask here in 3 hours again12:35
AJaegerandreas_s: or ask here in 3 hours again (for ACL set up)12:35
andreas_syes, thanks!12:35
*** saibarspeis has quit IRC12:36
*** dprince has joined #openstack-infra12:36
*** mrtenio has joined #openstack-infra12:37
*** anilvenkata_afk is now known as anilvenkata12:39
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Use encrypted volume in scenario004  https://review.openstack.org/39822112:40
*** Jeffrey4l has joined #openstack-infra12:41
*** Jeffrey4l has quit IRC12:42
*** Jeffrey4l has joined #openstack-infra12:45
Jeffrey4lwhat happens in zuul? lots of jobs are blocked more than 5 hours.12:46
openstackgerritAndreas Scheuring proposed openstack-infra/infra-manual: Cookiecutter fails with "directory already exists"  https://review.openstack.org/40023612:46
pabelangerJeffrey4l: we just sent out a IRC notice, we have a capacity issue with our ubuntu-xenial nodes12:47
*** Jeffrey4l has quit IRC12:47
*** kaisers has quit IRC12:47
*** e0ne has quit IRC12:49
*** Jeffrey4l has joined #openstack-infra12:49
*** gongysh has quit IRC12:50
Jeffrey4lwhat happens in zuul? lots of jobs are blocked more than 5 hours.12:51
*** senk_ has joined #openstack-infra12:51
*** senk has quit IRC12:51
*** Jeffrey4l has quit IRC12:52
*** tiswanso has quit IRC12:52
*** Jeffrey4l has joined #openstack-infra12:52
openstackgerritMerged openstack-infra/project-config: Remove DEVSTACK_GATE_TIMEOUT setting  https://review.openstack.org/39999212:53
Jeffrey4lwhat happens in zuul? lots of jobs are blocked more than 5 hours.12:54
*** senk has joined #openstack-infra12:55
therveJeffrey4l, If you stayed connected you would have gotten an answer...12:55
thervePlease don't spam the channel12:55
*** senk_ has quit IRC12:56
Jeffrey4ltherve, sorry, network issue. now stable.12:56
therveJeffrey4l, "we just sent out a IRC notice, we have a capacity issue with our ubuntu-xenial nodes"12:56
Jeffrey4lgot. thanks12:56
*** ssbarnea has quit IRC13:02
*** kaisers has joined #openstack-infra13:03
*** ssbarnea has joined #openstack-infra13:03
*** sdake has joined #openstack-infra13:04
*** ccamacho|lunch is now known as ccamacho13:05
*** sdake_ has quit IRC13:07
*** pgadiya has quit IRC13:07
*** shardy_lunch is now known as shardy13:07
pabelangerAJaeger: clarkb: fungi: I've restarted the ubuntu-xenial image-build in nodepool-builder.  Please keep an eye on it, if somebody could upload said images to osic-cloud1 too when finished, that would be awesome13:08
pabelangerleaving now for my train, talk shortly13:08
*** trown|outtypewww is now known as trown13:08
*** jpena is now known as jpena|lunch13:08
*** drifterza has quit IRC13:09
*** jaosorior is now known as jaosorior_brb13:09
openstackgerritAlexey Weyl proposed openstack-infra/project-config: The following aodh commit requires mysql>=5.6.4, causing vitrage jenkins job failures when trusty node is used. So we specify xenial node.  https://review.openstack.org/40024313:10
*** matrohon has quit IRC13:15
*** matrohon has joined #openstack-infra13:16
*** edmondsw has joined #openstack-infra13:18
*** ramishra has quit IRC13:21
*** erlon-airlong has joined #openstack-infra13:22
*** ramishra has joined #openstack-infra13:23
AJaegerpabelanger: sorry, cannot help with that.13:24
*** amoralej is now known as amoralej|lunch13:24
AJaegerteam, FYI: http://git.openstack.org/cgit/openstack/python-redfish.git is not created yet but merged earlier today13:24
*** saibarspeis has joined #openstack-infra13:25
*** Jeffrey4l has quit IRC13:26
*** pradk has joined #openstack-infra13:26
*** rlandy has joined #openstack-infra13:28
*** lucas-hungry is now known as lucasagomes13:29
*** e0ne has joined #openstack-infra13:30
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Implement overcloud upgrade job - Mitaka -> Newton  https://review.openstack.org/32375013:32
*** raildo has joined #openstack-infra13:35
*** flepied has quit IRC13:35
openstackgerritAlexey Weyl proposed openstack-infra/project-config: The following aodh commit requires mysql>=5.6.4, causing vitrage jenkins job failures when trusty node is used. So we specify xenial node.  https://review.openstack.org/40024313:36
*** mriedem has joined #openstack-infra13:36
*** tiswanso has joined #openstack-infra13:37
*** dtantsur is now known as dtantsur|brb13:38
*** thorst has joined #openstack-infra13:38
*** clenimar has joined #openstack-infra13:39
*** honza has joined #openstack-infra13:40
*** honza is now known as Guest1601813:40
*** kgiusti has joined #openstack-infra13:41
*** chandankumar has quit IRC13:45
*** kgiusti has quit IRC13:48
*** kgiusti has joined #openstack-infra13:49
*** ramishra_ has joined #openstack-infra13:51
*** denisra has joined #openstack-infra13:52
*** baoli has joined #openstack-infra13:52
*** ramishra has quit IRC13:54
*** denisra has quit IRC13:54
*** baoli has quit IRC13:54
*** baoli has joined #openstack-infra13:54
*** denisra has joined #openstack-infra13:55
*** hurgleburgler has joined #openstack-infra13:56
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Output additional info when exceptions occur  https://review.openstack.org/30973513:57
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Enable and fix xml_config tests  https://review.openstack.org/40025713:57
*** baoli has quit IRC13:57
*** tlian has joined #openstack-infra13:57
*** baoli has joined #openstack-infra13:57
*** ramishra_ has quit IRC13:58
*** ramishra has joined #openstack-infra14:00
*** hongbin has joined #openstack-infra14:03
electrofelixany cores for git-review around? would appreciate some freeback on https://review.openstack.org/312885, https://review.openstack.org/389701, and https://review.openstack.org/312056, do they seem like a reasonable change and is there anything else needed?14:03
*** jpena|lunch is now known as jpena14:03
*** tiswanso has quit IRC14:07
*** tiswanso has joined #openstack-infra14:08
*** oanson has quit IRC14:08
*** thorst has quit IRC14:11
*** thorst has joined #openstack-infra14:12
openstackgerritAndreas Scheuring proposed openstack-infra/infra-manual: Cookiecutter fails with "directory already exists"  https://review.openstack.org/40023614:12
*** matt-borland has joined #openstack-infra14:14
*** jianghuaw-m has joined #openstack-infra14:14
*** fguillot has joined #openstack-infra14:16
*** jianghuaw-m has quit IRC14:17
*** makowals has quit IRC14:18
*** makowals has joined #openstack-infra14:19
*** mdrabe has joined #openstack-infra14:20
adarazsinfra-root: hi dear Infra people, I'm trying to get the history of tripleo-quickstart-extras pushed (a new repo in openstack), and it turns out we need to do that during the project creation in gerrit. How can we solve this? Can we redo the import now? Or can I get temporary push rights?14:20
*** thorst has quit IRC14:20
adarazsI tried to ask for push rights but it seems that's now how it works: https://review.openstack.org/40020014:20
adarazsI'm also okay to redo the repo import or you can push the history from https://github.com/adarazs/tripleo-quickstart-extras yourself... but we need some solution :/14:21
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Model Update  https://review.openstack.org/40026814:21
yolandaAJaeger, on travel this week. But i'll do as time permits14:21
*** isaacb has joined #openstack-infra14:22
*** mamitchl has joined #openstack-infra14:22
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Print all fields of ZK objects  https://review.openstack.org/40027014:23
*** yamamoto has quit IRC14:24
openstackgerritMerged openstack-infra/openstackid-resources: Model Update  https://review.openstack.org/40026814:25
*** jcoufal has joined #openstack-infra14:25
*** makowals has quit IRC14:27
*** mriedem has quit IRC14:27
*** dtantsur|brb is now known as dtantsur14:28
*** newmember has joined #openstack-infra14:30
*** makowals has joined #openstack-infra14:30
cloudnullmornings14:30
*** rhallisey has quit IRC14:32
*** rhallisey has joined #openstack-infra14:34
openstackgerritMerged openstack-infra/project-config: Add more debugging info for .root-marker  https://review.openstack.org/39974314:35
*** amoralej|lunch is now known as amoralej14:37
*** novafire has joined #openstack-infra14:39
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Bug Fix  https://review.openstack.org/40027814:39
openstackgerritMerged openstack-infra/openstackid-resources: Bug Fix  https://review.openstack.org/40027814:40
*** senk has quit IRC14:40
*** nherciu has quit IRC14:41
*** snarwade has quit IRC14:41
*** superdan is now known as dansmith14:43
openstackgerritRui Zang proposed openstack-infra/project-config: Set DEVSTACK_GATE_REMOVE_STACK_SUDO=0 for networking-odl fullstack  https://review.openstack.org/40028114:45
*** rkukura has quit IRC14:46
*** ad_rien_ has joined #openstack-infra14:46
*** jaosorior_brb has quit IRC14:46
*** jaosorior_brb has joined #openstack-infra14:47
adarazscloudnull: hi, good morning! are you part of infra-root? can you maybe help me with the project history import I asked about above?14:47
*** novafire99 has joined #openstack-infra14:47
pabelangeron my train14:48
pabelangerubuntu-xenial just being compressed now14:48
anilvenkataclarkb, ping14:48
*** abregman is now known as abregman|mtg14:49
fungiadarazs: did you read http://docs.openstack.org/infra/manual/creators.html#add-the-project-to-the-master-projects-list or were you just winging it? if item #3 there is not clear enough, we appreciate suggestions/patches to make it harder to overlook14:49
*** ociuhandu has joined #openstack-infra14:50
*** novafire has quit IRC14:50
adarazsfungi: the situation was not so simple. we had a bunch of ansible-roles that we wanted to host under tripleo-quickstart. originally we wanted to import all individual repos as individual projects, just like they are now on gerrithub. that would have been complicated so we got this "tripleo-quickstart-extras" repo.14:51
*** Goneri has joined #openstack-infra14:51
fungiadarazs: how many commits?14:52
adarazsfungi: after creation we brainstormed how to not lose history and attribution for all these small roles, and I made a script that puts them in a single git repo.14:52
AJaegeradarazs: after? ;( That should have been done *before*14:52
fungieven if we push them in for you, the workflow will end up being the same. you'll need to assemble your desired repo state and push that somewhere public so we can clone it and feed it into gerrit14:52
AJaegerThis is one of the few reviews where I didn't ask add my usual stanza on "you start with empty repository - is that really correct " ;(14:53
*** martinkopec has quit IRC14:53
adarazsfungi: I have it assembled here: https://github.com/adarazs/tripleo-quickstart-extras -- it's a bit under 500 commits I think.14:53
fungiwe need to come up with some sort of policy here because it's a lot of manual effort for the sysadmin team, but perhaps we need big bold wording in the instructions stating that we won't do this in the future14:54
adarazsAJaeger: sorry, I did not think this will be a problem :(14:54
fungiright now it says "If you have a lot of history to import, please use the upstream field instead of creating a repository and then pushing the patches one at a time." in bold in a note box, but maybe we could make the wording more proscriptive and use a larger font or different color14:55
AJaegerfungi, I normally copy & paste the following text in reviews: https://etherpad.openstack.org/p/WQZF3sPy8T . Let's make it stronger...14:56
*** mmandel has joined #openstack-infra14:56
*** isaacb has quit IRC14:57
*** newmember has quit IRC14:57
*** sandanar has quit IRC14:57
AJaegerfungi, or we can add to that document a quick review list:14:57
AJaeger* Do you have existing content? Use upstream repo14:57
AJaeger* Is this an official project?14:57
AJaeger* ...14:57
fungiAJaeger: that's a great idea14:57
* AJaeger drafts quickly something to iterate on14:58
*** dtantsur is now known as dtantsur|mtg14:58
openstackgerritTuan Luong-Anh proposed openstack-infra/zuul: Replace assertEquals with assertEqual  https://review.openstack.org/40011914:58
fungiadarazs: anyway, make the proposed repo state available somewhere public and let me know the clone url and i'll get it pushed in... but be aware that this is a non-fast-forwardable transition in the newly-created repo, so if anyone cloned from it before now they may have trouble updating locally14:59
adarazsAJaeger, fungi: sorry to cause headache, we didn't have a proper upstream repo when we created this project and we didn't think that it's possible to preserve history. it took me a good day or two to realize how to do this in git and it would be a pity not to have them. :/14:59
fungiadarazs: it probably won't be until later today unless another infra-root beats me to it, since i've got a bit of a backlog on my to do list as it is15:00
*** mriedem has joined #openstack-infra15:00
adarazsfungi: https://github.com/adarazs/tripleo-quickstart-extras -- it's here. it is fast forwardable, I used merged commits based on the initial commit.15:00
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Add test to validate rebuilds are scheduled  https://review.openstack.org/39997415:01
fungiadarazs: oh, that simplifies matters at least. thanks!15:01
*** hongbin has quit IRC15:01
fungiadarazs: i'll let you know once it's done, but likely won't get to it for a few hours still as i mentioned15:01
*** ociuhandu has quit IRC15:01
adarazsfungi: all right, please let me know when you get to it.15:02
*** Dong_Zhi has quit IRC15:02
*** dizquierdo has quit IRC15:03
*** thorst has joined #openstack-infra15:04
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual: Review List for New Projects  https://review.openstack.org/40028815:05
AJaegerfungi, quick write up ^15:05
AJaegerLet's hear what others think and then refine15:05
*** ad_rien_ has quit IRC15:08
AJaegerfungi, regarding priorities: http://git.openstack.org/cgit/openstack/python-redfish.git is high - not sure whether that breaks image builds. That repo does not exist yet ;(15:08
*** ad_rien_ has joined #openstack-infra15:08
*** ociuhandu has joined #openstack-infra15:09
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Sort existing builds properly in cleanup thread  https://review.openstack.org/40029215:10
openstackgerritNate Johnston proposed openstack-infra/irc-meetings: Change time for the FWaaS team meeting.  https://review.openstack.org/39379315:11
ralonsohHello. Does anyone know why I have this patch stuck? https://review.openstack.org/#/c/377709/15:11
ralonsohJenkins is not testing it15:11
*** senk has joined #openstack-infra15:11
ralonsohAnd https://review.openstack.org/#/c/375616/ too15:11
*** thorst has quit IRC15:12
AJaegerralonsoh: we have a huge backlog due to some problems with our images, have patience please15:12
*** ad_rien_ has quit IRC15:12
ralonsohI know15:12
AJaegerralonsoh: it should be in the queue on http://status.openstack.org/zuul15:12
AJaegerralonsoh: If you know, why do you ask?15:12
ralonsohBut I submitted this patch in September and was never tested by Jenkins15:12
AJaegerSeptember - that was not clear. Sorry15:13
*** ad_rien_ has joined #openstack-infra15:13
AJaegerYou have "Depends-On". I bet one of your changes depends on another one and you somehow created acycle. And we cannot break cycles. Draw all your dependencies on a piece of paper and break the cycle15:13
ralonsohAnd https://review.openstack.org/#/c/375616/?15:14
ralonsohNo dependencies, the same problem15:14
AJaegerralonsoh: Do you see it in the statuspage I linked?15:14
ralonsohYes, I do15:14
AJaegerralonsoh: then please wait ;)15:15
*** rbrndt has joined #openstack-infra15:16
*** tnovacik has joined #openstack-infra15:16
*** martinkopec has joined #openstack-infra15:17
ralonsohSorry, I mean I see the page15:17
*** Julien-zte has quit IRC15:17
ralonsohbut I don't see it in the queue15:17
*** ad_rien_ has joined #openstack-infra15:18
*** senk has quit IRC15:19
AJaegerralonsoh: is that patch part of the cycle with 377709?15:19
AJaegerralonsoh: that would explain it. Let'S first investigate your cycle with 377709.15:20
ralonsohAJaeger: yes, 377709 depends on 37561615:20
ralonsohBut 375616 has no dependencies15:20
*** dizquierdo has joined #openstack-infra15:20
*** katkapilatova has left #openstack-infra15:20
openstackgerritAlexey Weyl proposed openstack-infra/project-config: Change node to xenial.  https://review.openstack.org/40024315:20
AJaegerralonsoh: Then you have your answer ;) Fix that cycle. Zuul does not know how to break it and will stop all changes in that cycle15:21
AJaegerralonsoh: https://review.openstack.org/#/c/377709/ is dependent on itself15:21
AJaegerREmove the self-depency15:21
AJaeger"Depends-On: I0334ff6d473096cc979e03836ffa3a993da3af9a" and "Change-Id: I0334ff6d473096cc979e03836ffa3a993da3af9a" is a small cycle15:22
ralonsohAJaeger: Thanks for the top15:22
ralonsohfor the tip15:22
*** yamamoto has joined #openstack-infra15:22
*** esikache1 has joined #openstack-infra15:23
*** dmsimard is now known as dmsimard|away15:24
*** tiswanso has quit IRC15:25
*** eharney has joined #openstack-infra15:25
*** oanson has joined #openstack-infra15:26
*** bnemec has joined #openstack-infra15:26
*** chem has quit IRC15:27
*** florianf has quit IRC15:27
*** drifterza has joined #openstack-infra15:29
*** newmember has joined #openstack-infra15:29
openstackgerritOfer Ben-Yacov proposed openstack-infra/project-config: Create experimental jobs for networking-l2gw  https://review.openstack.org/39772015:30
*** gordc has joined #openstack-infra15:32
*** chem has joined #openstack-infra15:32
*** inc0 has joined #openstack-infra15:32
inc0hey, quick question about docker_registry15:32
inc0it's going to be run on trusty or xenial?15:33
inc0or centos?:)15:33
openstackgerritRyan Beisner proposed openstack-infra/project-config: Update charm job definitions  https://review.openstack.org/39929915:34
fungiinc0: probably xenial? ubuntu is our default, and we've been deploying new services on xenial15:34
*** panda is now known as panda|bbl15:34
inc0cool, I'm asking because of systemd15:34
inc0so I'll base on xenial15:34
*** thorst has joined #openstack-infra15:35
openstackgerritMarkos Chandras proposed openstack/diskimage-builder: elements: pip-and-virtualenv: Add python-xml dependency  https://review.openstack.org/40015015:37
amrithfungi, what's the plan for keeping trusty nodes around; when will we have to necessarily be off trusty?15:37
*** mmandel has quit IRC15:37
andreas_shi guys, can somebody add myself (andreas.scheuring@de.ibm.com) to the networking-dpm-core and *-release gerrit groups please? Thanks!15:38
*** yamamoto has quit IRC15:38
*** piet_ has joined #openstack-infra15:39
fungiamrith: when stable/mitaka reaches eol we plan to start tearing out support for trusty15:40
amrithoh, so you are saying approx 6 months. uh oh ...15:40
fungiamrith: which is why we're finishing up the work of getting stable/newton jobs running on xenial (we should have just switched everyone over early in the newton cycle but decided to give teams too much leeway in when they switched so in lots of cases it didn't happen before release, which is very unfortunate)15:41
*** florianf has joined #openstack-infra15:42
amrithfungi, our ocata jobs will also run on trusty; currently can't run on xenial.15:42
*** yamahata has joined #openstack-infra15:42
fungiwhen we switched from precise to trusty, we did it all at once and told teams they had to fix their broken jobs or they wouldn't be able to merge whatever else they were working on. that got it done pretty quickly15:42
*** dnikisho1 has quit IRC15:42
amrithour issues are around systemd/upstart (for starters) and it goes down hill fast from there.15:42
fungiwhich is the upcoming plan for pushing remaining stable/newton and master jobs to xenial15:42
fungiyou'll end up unable to merge changes unless you scale back on testing or focus on fixing xenial support15:43
amrithso, I can tell you that there's work ongoing for xenial in trove, currently it is no worky worky15:43
fungisince xenial was the lts at the time of the mitaka release, so by current tc position all services were _supposed_ to support it as of the newton release15:43
drifterzaamrith, any particular issues you've seen ?15:43
fungier, was the latest lts15:43
fungiamrith: becoming an unofficial project might be another option?15:44
fungior maybe convincing the tc to only support centos 7 and stop claiming ubuntu support for openstack15:45
fungido your tests run on centos?15:45
fungirather, can they?15:45
drifterzaI cant see why it will be so difficult to get trove to work on xenial15:46
*** tiswanso has joined #openstack-infra15:47
drifterzawe've gotten it to deploy using openstack-ansible15:47
*** harlowja_at_home has joined #openstack-infra15:48
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Enable DIB_CHECKSUM in devstack tests  https://review.openstack.org/40030915:49
openstackgerritPaul Belanger proposed openstack/diskimage-builder: Improve checksum performance for images  https://review.openstack.org/40031115:50
pabelangerclarkb: fungi: That should improve performance when we generate checksum files for diskimage-builder^15:50
*** dimtruck is now known as zz_dimtruck15:52
*** claudiub has joined #openstack-infra15:53
*** john-davidge has quit IRC15:53
*** anilvenkata has quit IRC15:54
openstackgerritMarkos Chandras proposed openstack/diskimage-builder: elements: pip-and-virtualenv: Add python-xml dependency  https://review.openstack.org/40015015:54
pabelangerstarting ubuntu-xenial uploads to clouds15:54
pabelangerosic first15:55
drifterzayay15:55
drifterza:)15:55
*** dizquierdo has quit IRC15:55
*** claudiub|4 has quit IRC15:55
*** rhallisey has quit IRC15:56
*** isaacb has joined #openstack-infra15:56
*** ggnel_t has quit IRC15:56
*** mmandel has joined #openstack-infra15:56
*** Sukhdev has joined #openstack-infra15:58
*** bknudson has joined #openstack-infra15:59
*** newmember has quit IRC16:00
*** rkukura has joined #openstack-infra16:00
*** knangia has joined #openstack-infra16:00
*** yuval has quit IRC16:00
*** xarses has joined #openstack-infra16:00
amrithwhen will sorry, stepped away for a bit.16:01
*** eharney has quit IRC16:01
*** dizquierdo has joined #openstack-infra16:01
amrithfungi, there's a fundamental disconnect in that case with enterprise adoption. most enterprises seem firmly on trusty at this point. and no, we have no plans of being unofficial; whatever that may mean. At the heart of being part of openstack is using the same development methedologies, and infrastructure. being 'unofficial' because the CI has issues seems like a bad solution to even consider. No, we're not considering16:03
amrithit.16:03
openstackgerritmathieu bultel proposed openstack-infra/project-config: Add mitaka and newton UC and full upgrade jobs  https://review.openstack.org/40031716:03
*** NBziouech has joined #openstack-infra16:03
amrithdrifterza, :) yes, if it can work in ansible, it should be easy, right. Yeah, thanks for making me laugh.16:04
amrithI need it from time to time.16:04
drifterzaso have we totally missed the boat in : https://github.com/openstack/openstack-ansible-os_trove ?16:04
*** armax has joined #openstack-infra16:05
amrithdrifterza, I have no idea16:05
drifterzainteresting16:05
amrithdoes your trove work? I've deployed lots of software; yesterday interestingly I deployed a bunch of software on a raspberry pi and it all seemed to succeed till I realized that the tooling happily installed x86 binaries.16:06
openstackgerritmathieu bultel proposed openstack-infra/project-config: Add mitaka and newton UC and full upgrade jobs  https://review.openstack.org/40031716:06
fungiamrith: i take it ubuntu has not been packaging trove for xenial?16:06
*** pcaruana has quit IRC16:06
drifterzait does deploy and we using tempest to test it16:06
fungijamespage: zul: ^ ?16:06
amrithfungi, not sure but I'll check16:07
fungiamrith: looks like they're shipping trove 5.1.1 for xenial: http://packages.ubuntu.com/xenial-updates/python-trove16:07
drifterzaI'm working on the tempest api flavors tests, but normal api tests work with tempest16:07
amrithi'm not sure how someone will actually run trove (tempest isn't the same thing) with xenial at this point; at least there's insufficient code in the upstream to make it actually work.16:07
zulfungi: its packaged16:07
fungibizarre that ubuntu would package trove for xenial if you can't run trove on xenial16:08
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Fix upload recency table bug  https://review.openstack.org/40032016:08
amrithso fungi thanks for the answer re: the deadline for xenial, will keep working on it.16:08
drifterzaim also confused.16:08
drifterzathen again ansible builds from source git, so not packaging16:09
*** dtantsur|mtg is now known as dtantsur16:09
fungiamrith: sorry, i'm not trying to be obstinate. just pointing out that that we'll need to alter our technical governance if projects are going to stop supporting the latest ubuntu lts16:09
openstackgerritIvan Udovichenko proposed openstack-infra/system-config: Update node (apps-dev.openstack.org) deployment instructions  https://review.openstack.org/40032116:10
amrithfungi, not saying we will stop supporting the latest ... just asking when we have to cut over.16:10
*** dizquierdo has quit IRC16:10
amrithand given the amount of time, we can pick the right technical solution and accrue the right (or no) technical debt16:10
*** Guest93740 has quit IRC16:11
amrithwe were going with the 'no technical debt' solution, but may change course if the wall is approaching quickly.16:11
*** zz_dimtruck is now known as dimtruck16:12
drifterzaamrith, if you have the time, it would be highly appreciated if you could check the ansible repo I posted. We want to curate proper support.16:13
fungiamrith: yeah, we urged everyone to switch fairly early in the newton cycle when we made xenial workers available officially and devstack was working on it (we actually had experimental xenial images available for testing before the mitaka release if memory serves). now we're just trying to finish up and make sure we meet the expectation that stable/newton and later are tested on xenial16:13
*** isaacb has quit IRC16:13
amrithdrifterza, sorry, won't be able to commit to that anytime soon16:14
drifterzapitty ;/16:15
fungiamrith: in retrospect, "switch testing to xenial" would have made a good forst cross-project goal, but we didn't anticipate projects would fail to get it working before the newton release date16:15
fungis/forst/first/16:15
*** hongbin has joined #openstack-infra16:15
*** Goneri has quit IRC16:16
*** eharney has joined #openstack-infra16:17
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Add test_image_delete test  https://review.openstack.org/39975716:17
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Remove image-update based tests  https://review.openstack.org/39976416:17
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Re-enable test: test_image_delete_invalid  https://review.openstack.org/39973916:17
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Remove image-upload command and tests  https://review.openstack.org/39976616:17
*** yamamoto has joined #openstack-infra16:18
*** yamamoto has quit IRC16:19
*** arxcruz has quit IRC16:20
*** Goneri has joined #openstack-infra16:23
*** sdake_ has joined #openstack-infra16:24
*** sdake has quit IRC16:27
*** jgriffith has quit IRC16:28
*** sdake has joined #openstack-infra16:28
*** makowals has quit IRC16:28
*** yamamoto has joined #openstack-infra16:29
odyssey4meamrith what's the actuall issue - which part of trove doesn't work on xenial?16:29
amrithodyssey4me, in oslo meeting; bbiab16:29
odyssey4meis it the VM that runs the DB, or the API/back-end services?16:30
*** yamamoto has quit IRC16:30
*** sdake_ has quit IRC16:31
amrithodyssey4me, the guest vms16:31
amrithprimarily16:31
amrithcontrol plane is fine16:31
odyssey4meah, that would explain why OSA's role is working fine16:32
fungiodyssey4me: the process for building xenial-based trove service vm images is what's apparently a struggle at the moment16:32
*** makowals has joined #openstack-infra16:33
odyssey4mewell, amrith it's entirely plausible that we could help you get xenial working if you can help us by ensuring that there are bugs for the issues16:33
odyssey4mehaving just gone through the pain of implementing the switch from upstart to systemd we may be well placed to help16:34
*** andreas_s has quit IRC16:35
openstackgerritmathieu bultel proposed openstack-infra/project-config: Add mitaka and newton UC and full upgrade jobs  https://review.openstack.org/40031716:36
ralonsohAJaeger: thank you for your help. I removed the patch with the wrong ID. How can I force Jenkins to check these patches again? I wrote check in the comments, but I don't see them in Zuul16:37
*** jascott1 has joined #openstack-infra16:42
openstackgerritVictoria Martinez de la Cruz proposed openstack-infra/project-config: [Manila] Adds job for Manila UI DevStack plugin  https://review.openstack.org/39976816:42
*** jaosorior_brb is now known as jaosorior16:42
pabelangerokay, ubuntu-xenail uploaded to osic and infracloud16:43
pabelangerthat should improve out backlog16:43
notmynameFYI this got approved with no input from any swift cores. probably ok, but I would have liked to do some checking first https://review.openstack.org/#/c/399892/16:44
fungiamrith: which gate jobs are the ones that you're having trouble getting working on xenial because they build guest images? the gate-trove-scenario-functional-dsvm-.* jobs?16:44
amrithand gate-trove-funtional16:45
amrithalso there are jobs in the trove-integration repo16:45
amrithand in stable branches16:45
amrithbut I'm just about to push up some non-voting xenial jobs16:45
amrithso we can test the change we have in flight16:45
amrithon xenial16:46
*** mtanino has joined #openstack-infra16:46
fungiamrith: cool, thanks. just trying to get a feel for which jobs were already in good shape due to relying on pre-built images and which were building images at job run-time16:46
amrithin trove, master ... gate-trove-scenario-functional-dsvm-cassandra-nv16:48
amrithgate-trove-scenario-functional-dsvm-couchbase-nv16:48
amrithgate-trove-scenario-functional-dsvm-couchdb-nv16:48
amrithgate-trove-scenario-functional-dsvm-mariadb-nv16:48
amrithgate-trove-scenario-functional-dsvm-mongodb-nv16:48
amrithgate-trove-scenario-functional-dsvm-mysql16:48
amrithgate-trove-scenario-functional-dsvm-percona-nv16:48
amrithgate-trove-scenario-functional-dsvm-postgresql16:48
amrithgate-trove-scenario-functional-dsvm-pxc16:48
amrithgate-trove-scenario-functional-dsvm-redis16:48
amrith and gate-trove-functional-dsvm-mysql16:48
*** Guest66711 has quit IRC16:48
pabelangerpastebin please16:48
*** e0ne has quit IRC16:49
fungiamrith: thanks, so '^gate-trove-.*functional-dsvm-' would match on them all, it sounds like16:50
amrithfungi, yes I believe so.16:50
*** tojuvone has quit IRC16:50
*** EricGonczer_ has joined #openstack-infra16:52
*** yamamoto has joined #openstack-infra16:52
*** thorst has quit IRC16:53
*** rhallisey has joined #openstack-infra16:53
*** thorst has joined #openstack-infra16:54
*** mnaser has quit IRC16:57
greghaynesamrith: Are there logs somewhere I can have a look at for what fails on xenial?16:57
*** esikache1 has quit IRC16:58
openstackgerritJakub Libosvar proposed openstack-infra/project-config: Neutron: Move Xenial functional/fullstack tests to check queue  https://review.openstack.org/39787316:58
amrithgreghaynes, not that I know of; but a fix is well under way at this point. bbiab; have to deal with a different fiasco16:58
greghaynesok16:58
*** srobert_ has joined #openstack-infra16:58
*** abregman|mtg has quit IRC16:59
*** Sukhdev has quit IRC16:59
openstackgerritErlon R. Cruz proposed openstack-infra/project-config: Adds new experimental Cinder migration job  https://review.openstack.org/38173716:59
*** asettle has quit IRC17:00
dougshelley66greghaynes we've been working on moving to xenial - the work is here https://review.openstack.org/#/c/393221/17:00
*** thorst has quit IRC17:00
*** harlowja_at_home has quit IRC17:00
greghaynesdougshelley66: ah ty17:00
dougshelley66it definitely works for mysql, was moving thru the other datastores currently17:00
dougshelley66i was talking to amrith about getting a NV functional job on xenial setup so we can actually test the work on xenial17:01
fungithe other challenge is going to be getting those jobs working for stable/newton since it sounded like the dib elements were split out starting after the newton release17:01
*** xyang1 has joined #openstack-infra17:01
greghaynesok, gotcha, so the elements are just trusty specific in some ways17:01
dougshelley66fungi yes; this work is on the new, integrated repo17:01
*** yamamoto has quit IRC17:01
dougshelley66stable/newton still uses trove-integration and redstack17:01
dougshelley66greghaynes yes17:02
pabelangernodepool looking much happier now, both regions in infra-cloud launching ubuntu-xenial again17:02
pabelangerjust waiting for osic to catch up17:02
fungidougshelley66: i suppose an alternative there is we could stop running those jobs on stable/newton and just rely on jobs that use pre-built images rather than building them at job runtime17:02
sshnaidmclarkb, hi, please take a look in your time at https://review.openstack.org/#/c/399959/17:03
greghaynesdougshelley66: ok, looking at that I have some thoughts on how most of that could be made distro release agnostic17:03
fungihaving the trove control plane for stable/newton tested on xenial with pre-built trusty-based service images seems like a fairly reasonable compromise there17:03
dougshelley66greghaynes your feedback would be helpful17:04
*** lyarwood has joined #openstack-infra17:04
dougshelley66fungi I'm not sure which jobs use pre-built images17:04
dougshelley66i'm pretty sure all the jobs with 'functional' generate the image on the fly17:05
fungidougshelley66: i think gate-tempest-dsvm-trove does, at a minimum17:05
*** dizquierdo has joined #openstack-infra17:05
greghaynesfungi: clarkb did that dib release work out for you all btw?17:06
greghaynesto fix the ssh host keys issue17:06
*** mnaser has joined #openstack-infra17:06
fungidougshelley66: i haven't looked at the job scripts, but it's also possible that it would be relatively easy to adjust the functional jobs to download pre-built images when run for newton and still build them at runtime for ocata and later17:06
clarkbsshnaidm: can ypu use depends on to test that it fixes the timeout casr and put a link yo the resulting logs in the devstack gate change?17:06
dougshelley66fungi oh ok17:06
*** NBziouech has quit IRC17:07
pabelangergreghaynes: yes, we are uploading new images now17:07
greghaynespabelanger: awesome!17:07
sshnaidmclarkb, should I set "depends-on:devstack-patch_gerrit_id" in my testing patch? or vice versa?17:07
fungidougshelley66: which would provide a way around it, reviewers would just need to be a little more careful when looking at stable changes to guest image related files since they could deadlock stable branch changes more easily (no idea how often you adjust image builds for stable branches)17:07
pabelangergreghaynes: https://review.openstack.org/#/c/399865 is something I'd like to talk about too, increase out coverage for testing images. Maybe only apply it to diskimage-builder jobs17:08
clarkbsshnaidm: depends on devstack gate in a tripleo ci change17:08
fungidougshelley66: and really just for stable/newton since it would be the only branch in that twilight period17:08
sshnaidmclarkb, cool, will do17:08
*** BobBall_AWOL has quit IRC17:09
sshnaidmclarkb, btw, I discovered another problem, not sure how to fix it better: https://storyboard-dev.openstack.org/#!/story/5617:09
clarkbsshnaidm: that way you tripleo jobs that have the time out trouble will run with tje devstack gate fix included17:09
dougshelley66fungi right17:09
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: Test timeout  https://review.openstack.org/39341517:11
openstackgerritErlon R. Cruz proposed openstack-infra/project-config: Adds new experimental Cinder migration job  https://review.openstack.org/38173717:14
*** dprince has quit IRC17:14
pabelangerand osic-cloud1 is now launching ubuntu-xenial images17:16
pabelangerwe should see things start to burn down much quicker now17:17
cloudnullpabelanger. I've just been informed of a potential meta-data issue folks are seeing this morning. I'm looking into it now.17:17
*** martinkopec has quit IRC17:18
cloudnulljust getting started.17:18
cloudnullso i know nothing right this sec.17:18
*** oanson has quit IRC17:18
pabelangercloudnull: okay, we had some bad images, so you'll notice a lot of create / deletes of the last few days17:19
pabelangernew images live now, so should smooth out17:19
*** mhickey has quit IRC17:20
*** matrohon has quit IRC17:21
clarkbalso we dont use metadata service17:21
clarkbits all config drive17:21
cloudnullah cool17:21
adarazsfungi: I'll be away for the rest of the day but feel free to do the push from https://github.com/adarazs/tripleo-quickstart-extras when you'll have time and/or ping me here, I'll see it in the morning.17:21
cloudnullso this may not effect you at all17:21
pabelangertime to relocate from train17:22
fungiadarazs will do17:22
fungicloudnull: we use instance metadata, but as clarkb says not the metadata service17:23
fungiso depending on which metadata you meant17:23
fungi...17:23
cloudnullthe metadata service17:24
cloudnullmetadata on an instance should be fine.17:24
fungiand the only nonstandard bit we push into instance metadata is a tracking id so nodepool knows which instances belong to it for leak mitigation17:24
fungibut yeah, so sounds like nothing we'll notice anyway17:24
* cloudnull fingers crossed.17:25
fungiwe don't rely on the metadata service in our providers because it's, as SpamapS (i believe it was him) said in a recent ml thread, possibly the worst antipattern we copied from aws17:25
fungiand configdrives work and scale way better17:26
clarkbthey just happen to be undocumented and good luck making one outside of nova17:27
clarkbwhich I put on the etherpad of opemstack api fails17:27
*** tjones has joined #openstack-infra17:27
fungioh yeah17:27
mordredclarkb: ooh! new openstack api fails?17:27
* mordred reads17:27
clarkbmordred: ^ did you see that? I had a mini brainstorm in response to zaneb's email17:27
clarkbfeel free to update/edit/share17:28
mordredI did not - still reading scrollback17:28
fungii hope "opemstack" is the new replacement project which doesn't have these api fails17:28
clarkbmordred: is from last week so depending on how far back it goes17:28
clarkbfungi: runs on android keyboard17:28
mordredno - I mean, zane's email I know - but I haven't found the etherpad yet17:28
fungiindeed!17:28
mordredclarkb: the one thing config-drive can't (currently) do that metadata-service can is expose floating ip information to the instance17:29
*** trown is now known as trown|lunch17:30
mordredI know this because someone was working on a driver for something and was asking me how they could get FIP info just from the instance - and I was like 'we just get it from the nova API'17:30
mordredof course, I think that's solvable17:30
*** jpich has quit IRC17:31
fungiyeah, having an instance know its assigned fip is useful for configuring some sorts of services that need to know the ip address through which they're being reached17:31
mordredyah17:31
fungibut also fips can be changes from outside the instance17:31
fungier, changed17:31
mordredyup17:31
mordredI mean, fips are the actual bug :)17:32
fungiand the configdrive update story is pretty much missing at the moment, right?17:32
*** dizquierdo has quit IRC17:32
clarkbfungi: correct17:32
fungigiven that the only _good_ use case for fips is being able to move them around for traffic handling purposes17:32
fungiit seems like your instance would want to have a way to know when that changes17:33
fungiand configdrive can't tell it that17:33
mordredfungi: you'd think17:33
clarkbwoo displayport bug hits again and no vtythis time17:33
mordredof course - why you wouldn't just use hot-plug NICs is beyond me17:33
fungiclarkb: ouch17:33
mordredclarkb: where can I find your etherpad?17:33
fungimordred: agreed. then no need for configdrive17:33
clarkbmordred: I would tell you but my monitor unworks give me a few17:34
fungiwell, assuming it's autoconfigured via dhcp or slaac anyway17:34
fungimordred: though what we really need is not hot-plug nics in that case, it's hot-added aliases17:34
fungiwhich i don't think exist as a concept17:34
mordredfungi: yah17:35
mordredfungi: but hotplug nics do - and support for them is theoretically one of the reasons we all live in systemd hell now17:35
*** e0ne has joined #openstack-infra17:35
mordredso we might as well get some mileage out of the complex event-driven init systems that were forced on us17:35
mordredwhich - btw - is how adding an additional fixed-ip to your instance works17:35
mordredexcept that most clouds disable that api cal17:36
mordredcall17:36
fungithe challenge is that when you add multiple real interfaces with different macs on the same broadcast domain with addresses in the same subnet, your gateway may get angry17:36
fungithough there are kernel tricks to prefer the right interface for a given source address when responding17:37
fungito help prevent arp overwrite crazyness17:37
*** ad_rien_ has quit IRC17:38
fungii don't know if that behavior is default today, but it definitely wasn't even just a few years ago17:38
*** baoli has quit IRC17:39
mordredyah17:40
*** degorenko is now known as _degorenko|afk17:41
*** derekh has quit IRC17:42
*** hashar has quit IRC17:43
*** IzikP has joined #openstack-infra17:43
clarkbapparently this is a known bug with linux kernel, intel video drivers, and displayport17:44
clarkbwhich is unfortunate because you can't drive real monitors with hdmi17:44
IzikPHi, could someone assist with CI account  issues ?17:44
clarkbmordred: https://etherpad.openstack.org/p/openstack-user-api-improvements17:44
mordredclarkb: thank you!17:45
fungiclarkb: interesting. haswell? i'm using haswell dp connection to an mst hub driving three monitors, linux 4.7.017:45
clarkbfungi: sandy bridge17:45
fungiaha17:45
fungioh, also you said this is related to suspend/resume? mine's a workstation so i leave it running all the time anyway17:46
clarkbfungi: its related to suspending of the display17:46
fungiaha, as in dpms suspend17:46
clarkbapparently the driver/device can get confused and be unable to turn the display back on again17:46
clarkbya17:46
fungiokay, i think i _have_ seen that with mine17:46
clarkbso ya I leave the computer on all the time beacuse its a low powered mini itx device, and have it turn off the monitor after half an hour17:47
*** ihrachys has quit IRC17:47
fungilately dpms hasn't been suspending my monitors at all, and i still need to look into why17:47
clarkbit also seem to be related to me switching inputs on display to ps417:47
*** kzaitsev_mb has quit IRC17:47
clarkbits fine for the week then over the weekend I play video games and it has a sad17:47
AJaegerralonsoh: I suggest to push a new revision of that change, perhaps rebase?17:48
fungiclarkb: i have an identical machine to this one hooked up to the same display as my ps4, but via hdmi because it's only a 1080p panel17:48
fungialso i don't think that one's suspending the display either17:48
openstackgerritMerged openstack-infra/tripleo-ci: Default $STABLE_RELEASE in bootstrap-overcloud-full.sh  https://review.openstack.org/38515917:51
*** markvoelker_ has joined #openstack-infra17:52
*** dizquierdo has joined #openstack-infra17:53
*** markvoelker has quit IRC17:53
*** markvoelker has joined #openstack-infra17:55
*** markvoelker_ has quit IRC17:57
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Add test for provider uploads enable / disable  https://review.openstack.org/39968117:59
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Re-enable TestWebApp tests  https://review.openstack.org/39971617:59
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Remove waitForBuiltImages() / JobTracker() from nodepool.py  https://review.openstack.org/39972717:59
*** eharney has quit IRC17:59
*** dizquierdo has quit IRC17:59
*** jordanP has quit IRC18:01
*** ralonsoh has quit IRC18:01
*** esikache1 has joined #openstack-infra18:01
openstackgerritJeffrey Zhang proposed openstack-infra/project-config: Add install docker engine builder  https://review.openstack.org/40012818:01
*** esikache1 has quit IRC18:05
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove special searchlight unit test setup  https://review.openstack.org/39916918:06
*** dtantsur is now known as dtantsur|afk18:07
*** sdake_ has joined #openstack-infra18:07
*** lucasagomes is now known as lucas-afk18:07
*** xarses has quit IRC18:09
*** sdake has quit IRC18:11
*** yamahata has quit IRC18:11
*** harlowja has joined #openstack-infra18:14
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: Test timeout  https://review.openstack.org/39341518:15
*** jgriffith has joined #openstack-infra18:16
*** jgriffith has quit IRC18:16
*** e0ne has quit IRC18:17
openstackgerritMerged openstack-dev/pbr: coverage package name option, doc improvement  https://review.openstack.org/38805918:17
openstackgerritamrith proposed openstack-infra/project-config: make a non-voting gate-trove-functional-mysql-ubuntu-xenial job  https://review.openstack.org/40036818:18
amrithfungi, https://review.openstack.org/400368 will create that -nv job that we can use for testing. thx18:19
*** jgriffith has joined #openstack-infra18:19
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Add tests for enable / disabled labels  https://review.openstack.org/39964218:19
*** senk has joined #openstack-infra18:20
amrithdougshelley66 ^^18:20
amrithyou can't dep on it though; have to wait till it merges before you can test your changes18:20
*** dprince has joined #openstack-infra18:20
amrithAJaeger, I don't follow your comment.18:21
amrithit didn't set node before18:21
amrithwhat's new now?18:21
AJaegeramrith: you added a new variable in the template but do not set it18:21
*** tqtran has joined #openstack-infra18:23
*** senk has quit IRC18:24
*** jaosorior has quit IRC18:24
*** Swami has joined #openstack-infra18:24
*** esikache1 has joined #openstack-infra18:25
*** jpena is now known as jpena|off18:25
*** NBziouech has joined #openstack-infra18:26
*** Apoorva has joined #openstack-infra18:27
*** Guest16018 is now known as honza18:28
openstackgerritRyan Beisner proposed openstack-infra/project-config: Update charm job definitions  https://review.openstack.org/39929918:28
*** allanice001 has joined #openstack-infra18:31
*** sneti has joined #openstack-infra18:31
*** allanice001 has quit IRC18:31
*** mtanino has quit IRC18:32
*** nherciu has joined #openstack-infra18:32
*** electrofelix has quit IRC18:33
pabelangercloudnull: we haven't launched a node in osic-cloud1 in 30mins, is there an outage?18:34
*** jgriffith has quit IRC18:34
*** sambetts is now known as sambetts|afk18:37
*** vaidy has joined #openstack-infra18:38
*** isviridov_away has joined #openstack-infra18:38
SpamapSclarkb: bifrost does ok making a configdrive ;)18:42
SpamapSnow that we renamed the network file to the right thing. :)18:42
*** mhickey has joined #openstack-infra18:43
*** IzikP has quit IRC18:44
*** amoralej is now known as amoralej|off18:44
openstackgerritAlexey Weyl proposed openstack-infra/project-config: Change node to xenial.  https://review.openstack.org/40024318:48
openstackgerritJef Mallal proposed openstack-infra/jenkins-job-builder: Fix plot publisher tests  https://review.openstack.org/40037518:52
*** jamielennox is now known as jamielennox|away18:52
*** jgriffith has joined #openstack-infra18:55
*** shamail has joined #openstack-infra18:57
*** jamielennox|away is now known as jamielennox19:00
*** senk has joined #openstack-infra19:01
*** shardy has quit IRC19:01
clarkbSpamapS: right it did it erong for a while ehich I think illustrates the problem19:02
SpamapSNo doubt19:02
*** chlong has joined #openstack-infra19:03
*** yamahata has joined #openstack-infra19:03
*** dtardivel has quit IRC19:04
openstackgerritamrith proposed openstack-infra/project-config: make a non-voting gate-trove-functional-mysql-ubuntu-xenial job  https://review.openstack.org/40036819:04
*** flwang1 has quit IRC19:06
fungineed to pop out for some errands and a quick lunch, but plan to return well in advance of the zuul meeting19:06
*** eharney has joined #openstack-infra19:06
*** eharney has quit IRC19:06
*** gouthamr has quit IRC19:07
*** dankolbrs has joined #openstack-infra19:07
*** mtanino has joined #openstack-infra19:07
*** ssbarnea has quit IRC19:10
*** jamesdenton has joined #openstack-infra19:11
*** Sukhdev has joined #openstack-infra19:13
cloudnullpabelanger: sorry, had to be afk for a bit, our cert expired.19:13
cloudnulllooks like the folks maintaining that, did not.19:13
*** stream10 has joined #openstack-infra19:14
cloudnullnow i'm back to dealing with the metadata issue, which we think is something on the backplane.19:14
cloudnullmore soon.19:14
*** jamesden_ has joined #openstack-infra19:15
*** jamesdenton has quit IRC19:15
*** lin_yang has joined #openstack-infra19:17
AJaegerclarkb: thanks for overcommunicating ;)19:17
mordredcloudnull: yay for not maintaining certs!19:19
pabelangercloudnull: danke19:20
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Model updates  https://review.openstack.org/40038019:22
*** wolverineav has quit IRC19:23
openstackgerritMerged openstack-infra/openstackid-resources: Model updates  https://review.openstack.org/40038019:23
*** wolverineav has joined #openstack-infra19:24
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Add test to validate when a node build is disabled  https://review.openstack.org/39964219:25
AJaegerclarkb, do you want to +2A trove's next step for xenial: https://review.openstack.org/400368 ?19:26
*** florianf has quit IRC19:26
*** ad_rien_ has joined #openstack-infra19:26
*** shamail_ has joined #openstack-infra19:27
*** shamail has quit IRC19:28
*** shamail_ is now known as shamail19:28
*** novafire99 has quit IRC19:28
openstackgerritZara proposed openstack-infra/storyboard-webclient: Change 'stories' icon to a book  https://review.openstack.org/40038119:29
*** wolverineav has quit IRC19:29
*** kzaitsev_mb has joined #openstack-infra19:30
*** ad_rien_ has quit IRC19:31
amrithclarkb, please say yes :)19:32
amrithbut, as always, you have the options. (a) yes. (b) yes.19:32
AJaegeramrith: I guess he waits until testing is done ;)19:34
openstackgerritVictoria Martinez de la Cruz proposed openstack-infra/project-config: [Manila] Adds job for Manila UI DevStack plugin  https://review.openstack.org/39976819:34
amrithAJaeger, given my track record, I would too.19:35
openstackgerritAlexey Weyl proposed openstack-infra/project-config: Change node to xenial.  https://review.openstack.org/40024319:35
*** shamail_ has joined #openstack-infra19:35
*** shamail_ has quit IRC19:35
*** shamail has quit IRC19:36
*** wolverineav has joined #openstack-infra19:37
dhellmannfungi : what's the simplest way for me to verify the key id for the current signing key? I've found one that looks right, but I want to double check before I sign it.19:37
dhellmannoops, he's way, maybe clarkb or mordred know ^^19:38
*** jtomasek_ has joined #openstack-infra19:41
*** wolverineav has quit IRC19:41
clarkbdhellmann: you can check that fungi myself pleia2 etc have signed it19:41
clarkbdhellmann: now because its gpg I would have to spend a bunch of time rereading docs to remember how to do that19:42
dhellmannok, I guess that makes sense.19:42
dhellmannoh, I have a gui for that19:42
SpamapSgpg --recv-key ###### ; gpg --list-sigs ######19:44
clarkbdhellmann: and I think fungi has the fingerprint published in our docs somewhere too19:44
SpamapSUse long ids. ;)19:44
*** jtomasek_ has quit IRC19:44
*** rbuzatu_ has joined #openstack-infra19:45
*** rbuzatu has quit IRC19:45
dhellmannclarkb : that's what I was looking for, but I wasn't sure if the docs in http://docs.openstack.org/infra/system-config/signing.html#attestation used the current key or not since the names all say "Some Cycle"19:45
mordreddhellmann: "OpenStack Infra (Ocata Cycle) <infra-root@openstack.org>"19:46
mordreddhellmann: is what the Ocata name should be19:46
dhellmannI guess we're all safe with me assuming that if I find a key like that on a key server, it's the right one?19:46
dhellmannand I guess that's with the signatures are for19:46
mordreddhellmann: and if it's signed by the infra root humans19:46
mordredyah19:46
mordredD47BAB1B7DC2E262A4F6171E8B1B03FD54E2AC07 is the long id, fwiw19:46
mordredbut you should obviously not trust a person claiming to be mordred on irc ;)19:47
dhellmannok, that's the one I found and signed19:47
mordreddhellmann, clarkb: we should have a session at the summits where operators can come and verify the gpg keys of the infra-root and release team, so that they have a chain of trust they can count on19:48
mordredsort of like a key-signing- but oriented at operators who care about attestation verification19:49
dhellmanngood idea19:49
*** tiswanso has quit IRC19:51
*** dimtruck is now known as zz_dimtruck19:51
*** baoli has joined #openstack-infra19:52
*** jtomasek has quit IRC19:54
*** eharney has joined #openstack-infra19:55
*** jtomasek has joined #openstack-infra19:55
*** zz_dimtruck is now known as dimtruck19:57
*** trown|lunch is now known as trown19:57
*** yamahata has quit IRC20:01
*** pvaneck has joined #openstack-infra20:01
*** yamahata has joined #openstack-infra20:02
*** isviridov_away has quit IRC20:04
*** senk has quit IRC20:04
*** vaidy has quit IRC20:04
*** senk has joined #openstack-infra20:05
*** flwang1 has joined #openstack-infra20:06
*** senk has quit IRC20:06
*** dimtruck is now known as zz_dimtruck20:06
*** hwoarang has quit IRC20:09
*** piet_ has quit IRC20:09
*** esikache1 has quit IRC20:10
*** hwoarang has joined #openstack-infra20:10
*** hwoarang has quit IRC20:10
*** hwoarang has joined #openstack-infra20:10
openstackgerritRyan Beisner proposed openstack-infra/project-config: Update charm job definitions  https://review.openstack.org/39929920:13
*** ldnunes has quit IRC20:14
*** isviridov_away has joined #openstack-infra20:16
*** ssbarnea has joined #openstack-infra20:17
*** kvcobb has quit IRC20:17
*** tiswanso has joined #openstack-infra20:18
*** rcarrillocruz has joined #openstack-infra20:21
*** Goneri has quit IRC20:21
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4  https://review.openstack.org/37120920:23
*** vaidy has joined #openstack-infra20:23
*** liusheng has quit IRC20:24
*** rbuzatu_ has quit IRC20:24
*** Swami has quit IRC20:24
*** rbuzatu has joined #openstack-infra20:26
*** tjones has quit IRC20:26
*** asettle has joined #openstack-infra20:26
vgadirajHello infra team, I received a +2 on this patch to add an error message and exit early if WORKSPACE var is undefined. It has been sitting for a few days. Would greatly appreciate if I could get more looks at it whenever is convenient so it can get merged :) https://review.openstack.org/#/c/396414/20:26
*** oanson has joined #openstack-infra20:27
*** zz_dimtruck is now known as dimtruck20:27
*** ad_rien_ has joined #openstack-infra20:28
*** ad_rien_ has quit IRC20:28
*** tiswanso has quit IRC20:29
*** ssbarnea has quit IRC20:29
*** rbuzatu has quit IRC20:30
*** liusheng has joined #openstack-infra20:31
*** rbuzatu has joined #openstack-infra20:32
*** newmember has joined #openstack-infra20:33
*** rbuzatu has quit IRC20:37
*** rbuzatu has joined #openstack-infra20:37
*** tiswanso has joined #openstack-infra20:38
*** rbuzatu has joined #openstack-infra20:38
*** rfolco has quit IRC20:38
*** Swami has joined #openstack-infra20:40
*** ssbarnea has joined #openstack-infra20:40
*** rbuzatu has quit IRC20:43
*** nherciu has quit IRC20:44
*** tnovacik has quit IRC20:46
amrithfungi, are you back?20:47
amrithclarkb, https://review.openstack.org/#/c/400368/ is done with check; if you could approve it we can get cracking on the xenial testing in gate20:49
amriththis is only the start, larger commit follows to clean up all the trove ci jobs, they are currently a fine bowl of spaghetti20:49
*** oanson has quit IRC20:51
*** esikache1 has joined #openstack-infra20:57
*** sdake has joined #openstack-infra21:01
*** shamail has joined #openstack-infra21:01
*** ijw has joined #openstack-infra21:02
*** sdake_ has quit IRC21:04
*** tjones has joined #openstack-infra21:05
*** esikache1 has quit IRC21:07
*** asettle has quit IRC21:08
*** asettle has joined #openstack-infra21:08
cloudnullpabelanger: mordred: it looks like things are +/- resolved w/ our certs and the metadata problems.21:11
fungiamrith: back now, looking21:11
cloudnullfrom the dash I can see lots of vms doing things21:11
*** jamesden_ has quit IRC21:11
cloudnullare we seeing jobs fail right now ?21:11
*** ccamacho has left #openstack-infra21:12
cloudnull^ just checking back in from a full day of meetings and beatings21:12
*** ssbarnea has quit IRC21:12
*** asettle has quit IRC21:13
*** Goneri has joined #openstack-infra21:14
*** rhallisey has quit IRC21:15
*** jcoufal has quit IRC21:15
fungidhellmann: i #info'd and #link'd the new key in infra and releaseteam meetings: http://eavesdrop.openstack.org/meetings/infra/2016/infra.2016-11-15-19.02.html http://eavesdrop.openstack.org/meetings/releaseteam/2016/releaseteam.2016-11-18-15.00.html21:18
pabelangercloudnull: yay21:18
dhellmannfungi : ah, thanks, I should have looked at the logs.21:18
dhellmannand I forgot about the mention in the release team meeting entirely21:18
fungidhellmann: it'll be documented on the release site once i finish my change for that21:19
dhellmann++21:19
*** fguillot has quit IRC21:19
cardeoishello there, not sure it's the right channel, but anybody know where I can find documentation on api-paste.ini files? http://pythonpaste.org/deploy/ seems to be down21:20
*** panda|bbl is now known as panda|zZ21:24
*** dave-mccowan has quit IRC21:24
jheskethMornning21:24
*** trown is now known as trown|afk21:25
*** pono has joined #openstack-infra21:29
onovycardeois: hi, if sources are enough: https://sources.debian.net/src/pastedeploy/1.5.2-4/docs/21:29
*** vaidy has quit IRC21:30
*** isviridov_away has quit IRC21:31
*** jascott1 has quit IRC21:32
*** jascott1 has joined #openstack-infra21:32
cardeoisonovy thanks I did that yeah, built the doc myself21:33
*** jascott1 has quit IRC21:33
openstackgerritMerged openstack-infra/nodepool: Better protect for race condition in waitForBuildDeletion()  https://review.openstack.org/39977021:34
*** wolverineav has joined #openstack-infra21:35
*** stream10 has quit IRC21:36
openstackgerritMerged openstack-infra/nodepool: Re-enable test: test_image_delete_invalid  https://review.openstack.org/39973921:38
openstackgerritMerged openstack-infra/nodepool: Add test_image_delete test  https://review.openstack.org/39975721:39
openstackgerritMerged openstack-infra/nodepool: Remove image-update based tests  https://review.openstack.org/39976421:39
openstackgerritMerged openstack-infra/nodepool: Remove image-upload command and tests  https://review.openstack.org/39976621:39
*** wolverineav has quit IRC21:39
*** rbuzatu has joined #openstack-infra21:40
fungiamrith: dougshelley66: i've approved 400368, should be live by 22:00z roughly. thanks for working on that!21:41
*** shu-mutou-AWAY has quit IRC21:41
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Remove yum-plugin-priorities hack  https://review.openstack.org/39733121:42
*** adriant has joined #openstack-infra21:43
*** jamesdenton has joined #openstack-infra21:44
*** rbuzatu has quit IRC21:44
pabelangerclarkb: jeblair: Been watching nodepool today, and noticed we have a lot of ready nodes online, over 940 right now. Wanted to see if you either minded looking and maybe comment.  Not sure if we are at the limit of gearman or just need more zuul-launchers.   We have about 1500 VMs online right now21:46
pabelangerhttp://grafana.openstack.org/dashboard/db/nodepool21:46
*** jascott1 has joined #openstack-infra21:46
fungiwonder if those are leaked. are they getting grabbed up, or all from a similar timeframe?21:47
pabelangerlet me check21:47
fungialso see if they're all going to one or two launchers that might be misbehaving, vs evenly distributed across them all21:47
jeblairalso, excess ready nodes can indicate a problem with the gearman demand calculation (if job node types have changed)21:48
*** dimtruck is now known as zz_dimtruck21:48
pabelangerwe are distributing properly it looks like21:49
*** shamail has quit IRC21:49
openstackgerritMerged openstack-infra/project-config: make a non-voting gate-trove-functional-mysql-ubuntu-xenial job  https://review.openstack.org/40036821:49
pabelangeroldest ready nodes look to be 45mins21:50
pabelangerlet me check if we changed job names recently21:50
openstackgerritKhai Do proposed openstack-infra/infra-specs: Gerrit upgrade  https://review.openstack.org/38819021:51
*** wolverineav has joined #openstack-infra21:54
r1chardj0n3shey folks, we've just noticed the gate-horizon-dsvm-tempest-plugin-ubuntu-xenial test has started failing for Horizon patches, but as far as I can tell nothing has changed - no package updates, no commits have been merged to Horizon, ... any ideas?  an example fail is http://logs.openstack.org/31/396431/2/check/gate-horizon-dsvm-tempest-plugin-ubuntu-xenial/19ec0cb/console.html#_2016-11-21_20_24_29_51974821:55
r1chardj0n3sThe first fail was at 2016-11-21 07:0821:56
*** zz_dimtruck is now known as dimtruck21:57
*** aeng has joined #openstack-infra21:58
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Delete builds when diskimage removed from config  https://review.openstack.org/40042121:58
fungir1chardj0n3s: looks like apache returned a 500 isr... anything related in the collected apache or horizon logs?21:58
*** wolverineav has quit IRC21:59
fungir1chardj0n3s: http://logs.openstack.org/31/396431/2/check/gate-horizon-dsvm-tempest-plugin-ubuntu-xenial/19ec0cb/logs/apache/horizon_error.txt.gz seens ubreresrubg21:59
fungi"DisallowedHost: Invalid HTTP_HOST header: '127.0.0.1'. You may need to add u'127.0.0.1' to ALLOWED_HOSTS."21:59
r1chardj0n3syep, see that now22:00
fungis/seens ubreresrubg/seems interesting/ (that was a crazy typo!)22:00
r1chardj0n3s(weirdly the full log hadn't loaded on my view ..)22:00
r1chardj0n3sheh :-)22:00
jeblairit's time for a zuul meeting in #openstack-meeting-alt22:00
fungiwhy, yes. yes it is!22:00
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Re-enable tests: test_alien_*  https://review.openstack.org/40042222:01
JayFfungi: "gratuitously unneccessary use of NAT" is a great phrase :) I'm going to use it next time I have the "why nat + IPv6 is silly" argument22:01
fungiJayF: i still have nightmares about connecting two lans for previously different companies who had both independently (and insanely) decided to use 192.168.0.0/16 as one large flat network22:03
fungithat was a use case for nat22:03
fungior for a padded room22:04
JayFfungi: I use 172.31.254.0/24 for my local network for exactly that reason. Everyone forgets about the 172.16/12 range so it's never conflicting22:04
fungi172.23.5.0/24 here, but yep22:04
*** wolverineav has joined #openstack-infra22:04
r1chardj0n3sfungi: looks like https://github.com/openstack-dev/devstack/commit/2f99e882cef75c4c3fb166ad823e15dfda844d87 messed with Django's ALLOWED_HOSTS enforcement22:05
*** jamesdenton has quit IRC22:06
fungir1chardj0n3s: onoz! those wacky devstack devs22:06
r1chardj0n3s:-D22:06
r1chardj0n3sso I guess that HOST_IP isn't matching whatever the request is coming in at22:07
r1chardj0n3s(might be localhost/127.0.0.1?)22:07
fungir1chardj0n3s: https://review.openstack.org/397063 was the change22:07
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Endpoints update  https://review.openstack.org/40042422:07
*** sdake_ has joined #openstack-infra22:07
r1chardj0n3sfungi: yep, so that change nuked localhost (in its various forms) from the list22:08
*** wolverineav has quit IRC22:08
fungipinging sc68cal in #-qa now with a heads up, since he's the only core reviewer of the last patchset on that who seems to be around22:10
*** sdake has quit IRC22:10
r1chardj0n3sthanks fungi, I'll jump in #-qa to assist if necessary22:10
*** ad_rien_ has joined #openstack-infra22:11
*** saibarspeis has quit IRC22:12
*** saibarspeis has joined #openstack-infra22:13
*** saibarspeis has quit IRC22:13
*** saibarspeis has joined #openstack-infra22:14
*** saibarspeis has quit IRC22:14
*** saibarspeis has joined #openstack-infra22:14
*** saibarspeis has quit IRC22:15
*** saibarspeis has joined #openstack-infra22:15
*** saibarspeis has quit IRC22:15
*** rbuzatu has joined #openstack-infra22:15
*** rbuzatu has quit IRC22:16
*** saibarspeis has joined #openstack-infra22:16
*** saibarspeis has quit IRC22:16
onovyhi guys. I need this for debian pkg: I need to create master-dfsg branch, which will be forked master branch with some commits over it. But i need to not gate on this branch. Can i disable all checks+gates on per branch basis for all deb-* repos?22:16
*** rbuzatu has joined #openstack-infra22:16
*** saibarspeis has joined #openstack-infra22:17
*** saibarspeis has quit IRC22:17
*** saibarspeis has joined #openstack-infra22:17
*** pilgrimstack has joined #openstack-infra22:18
*** eliqiao has quit IRC22:18
*** saibarspeis has quit IRC22:18
*** tiswanso has quit IRC22:18
*** rbuzatu has quit IRC22:18
*** saibarspeis has joined #openstack-infra22:18
*** rbuzatu has joined #openstack-infra22:18
*** saibarspeis has quit IRC22:19
*** saibarspeis has joined #openstack-infra22:19
*** saibarspeis has quit IRC22:19
*** saibarspeis has joined #openstack-infra22:20
*** vaidy has joined #openstack-infra22:20
*** saibarspeis has quit IRC22:20
*** eliqiao has joined #openstack-infra22:20
*** saibarspeis has joined #openstack-infra22:21
*** saibarspeis has quit IRC22:21
fungionovy: you need at least some job running for a branch if you want to be able to merge changes to it. you can disable most jobs, but best to see if there's at least a simple one applicable for check and gate pipelines for that branch22:21
*** saibarspeis has joined #openstack-infra22:21
onovyfungi: but there is nothing to check22:21
onovymaster branch = mirror of original project. so deb-swift/master = swift/master22:22
*** saibarspeis has quit IRC22:22
onovymaster-dfsg is "cleanuped upstream branch" from non-DFSG things22:22
onovyso only gate-nop :)22:22
*** saibarspeis has joined #openstack-infra22:22
*** saibarspeis has quit IRC22:23
fungionovy: i'm curious what non-dfsg-free content is in the swift repo, though that's obviously a separate matter22:23
onovyswift was just example22:23
onovyswift is clean :)22:23
onovyos-api-ref is better example22:24
*** wolverineav has joined #openstack-infra22:24
fungiahh, makes more sense. though in general i think anything we're putting in repos that can't be redistributed in a debian source package due to dfsg guideline violations would also be a bug we should fix in our repos22:24
onovythat's right. but sometimes nobody cares to fix it :)22:24
*** tpsilva has quit IRC22:25
onovyor sometimes it's not so obvisou to just remove it22:25
onovyfor example built docs22:25
onovyexample: https://github.com/openstack/os-api-ref/tree/master/os_api_ref/assets22:25
onovy.ttf + .woff fonts without source22:25
*** EricGonczer_ has quit IRC22:25
fungiwhat's the concern with generated documentation files in source packages? are we embedding external content for which we're failing to also distribute source code, or is it just a concern for the tarball size?22:26
*** isviridov_away has joined #openstack-infra22:26
*** rtheis has quit IRC22:26
fungiaha, embedding font files without accompanying source code definitely sounds like a bug, yes22:26
onovyproblem is with embedded font+js22:26
openstackgerritOmar Rivera proposed openstack-infra/project-config: Add fuel-plugin-nitrous project  https://review.openstack.org/40042922:27
fungiyep. lemme guess, we're embedding minified/browserified js in some repos then without also including the corresponding source versions?22:27
onovybut sometimes simplest solution is to create master-dfsg and that talk with upstream22:27
onovyright22:27
onovythat's one of problem :)22:27
fungiso how do you maintain the -dfsg branch variates? if you delete files which are being regenerated and updated regularly, it's going to be in a constant state of conflict22:28
*** wolverineav has quit IRC22:28
fungier, variants22:28
onovythere are not so much releases to fix that conflicts22:28
onovy+ we have note in d/copyright22:29
onovyhttps://github.com/openstack/deb-python-os-api-ref/blob/debian/newton/debian/copyright#L422:29
fungiseems like it would be easier to have some post-processing step to filter the offending files during "upstream" source tarball generation22:29
fungiso you wouldn't have to fight frequent git merge conflicts22:29
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Re-enable test: test_alien_list_fail  https://review.openstack.org/40042222:30
onovyyep, i want to22:31
onovy1. create script, which will do it in git22:31
onovy2. maybe integrate it in infra directly22:31
onovyfor now, we have this script in debian inside "uscan", which downloads orig tarball and do repack automagically22:31
*** EricGonczer_ has joined #openstack-infra22:32
onovybut uscan is not git based, which we are and want to be22:32
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Re-enable test: test_alien_list_fail  https://review.openstack.org/40042222:32
*** mlekkas_ has quit IRC22:33
*** pilgrimstack has quit IRC22:33
*** srobert_ has quit IRC22:33
*** wolverineav has joined #openstack-infra22:34
fungiyep, definitely familiar with uscan. i agree that can be a bit painful as an integration point if you're relying mostly on git magic22:34
openstackgerritOmar Rivera proposed openstack-infra/project-config: Add fuel-plugin-nitrous project  https://review.openstack.org/40042922:34
*** ad_rien_ has joined #openstack-infra22:34
*** ad_rien_ has quit IRC22:34
*** edmondsw has quit IRC22:34
clarkbuscan is the self checkout at my local grocer22:35
fungiclarkb: i wouldn't be surprised if it used the devtools uscan implementation ;)22:35
openstackgerritKen Giusti proposed openstack-infra/project-config: Make oslo.messaging amqp1 driver non-voting  https://review.openstack.org/40043022:35
fungionovy: so just to confirm, you do have changes you would propose to that branch in gerrit, right? would those be changes to delete files i guess?22:36
fungionovy: if so, one possible solution is to make a special job that just does nothing, and does it very well. then only run that job for the branch in question22:36
onovyyep22:36
onovy-nop job?22:36
fungionovy: yeah, we can't use the built-in noop job in zuul for this because it would tie all projects using the normal one together with your repos, but we could make a special pkg-deb-noop job or something for that22:37
onovysounds good22:37
onovyOR22:37
onovywe can check in that job, if i'm only removing files/lines22:38
fungiyeah, that sounds much better22:38
onovyzigo: ^ what do you think?22:38
fungiif you're going to run a job anyway, have it do something worthwhile22:38
onovyare we only removing whole files/directories, right?22:38
onovyso we can gate: Only remove files/directories, don't do anything else22:38
*** wolverineav has quit IRC22:38
fungiyou can always extend it in the future to sanity check other things, like that the change isn't deleting files it shouldn't, maybe22:39
onovyyep22:39
*** EricGonczer_ has quit IRC22:40
fungithe other problem is going to be that you will have to blacklist every job you would normally run against other branches so that they won't be run on that branch. there's not a construct for zuul to say22:40
fungi"skip all jobs except..."22:40
fungiso each job that normally runs against other branches of your repos will need an override that tells zuul not to run it for branches named master-dfsg22:41
clarkbfungi: onovy would it be simpler to just stub it out so those tests pass in a noopy fashion?22:41
clarkbso you run the jobs they succeed everything is happy22:41
onovyhmmm22:42
onovythinking22:42
*** mmandel has quit IRC22:42
onovywe have only one job: gate-deb-swauth-dpkg-debian-jessie22:42
*** Julien-zte has joined #openstack-infra22:42
onovyso i guess is simpler to just blacklist this one22:43
onovyand add another one22:43
*** tiswanso has joined #openstack-infra22:43
*** mmandel has joined #openstack-infra22:43
pabelangerfungi: clarkb: jeblair: so, I did notice some recently job name changes in zuul, which might account for allocation issues. But I haven't checked gearman directly yet22:43
*** mmandel_ has joined #openstack-infra22:44
*** eharney has quit IRC22:45
*** dprince has quit IRC22:46
*** tiswanso has quit IRC22:47
*** mmandel has quit IRC22:48
*** jtomasek has quit IRC22:48
*** mmandel_ has quit IRC22:48
EmilienMa few weeks ago before I leave on vacations I found out stackviz was not installed on centos7 nodes (while it was in the past I remember well). Do you folks know if I missed something? is there anything broken?22:49
*** ad_rien_ has joined #openstack-infra22:50
timothyb89EmilienM: last I heard there was some issue with npm packages on centos, I'm not sure if that situation has changed...22:50
*** ad_rien_ has quit IRC22:50
EmilienMin nodepool images I see "timeout: failed to run command 'npm': No such file or directory"22:50
EmilienMok so the problem is still around22:50
*** chlong has quit IRC22:52
openstackgerritxiaodongwang991481 proposed openstack-infra/project-config: add multinode tempest test coverage in networking-sfc  https://review.openstack.org/39197922:53
*** wolverineav has joined #openstack-infra22:54
*** matt-borland has quit IRC22:54
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Full quickstart gate run on OVB  https://review.openstack.org/38109422:58
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: Test quickstart experimental job  https://review.openstack.org/39760922:58
*** wolverineav has quit IRC22:58
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Run devstack-plugin-nfs-nv in nova experimental  https://review.openstack.org/39571123:02
openstackgerritIsaku Yamahata proposed openstack-infra/project-config: add non-voting functional tests job for networking-odl  https://review.openstack.org/39447623:02
*** rhallisey has joined #openstack-infra23:03
openstackgerritgordon chung proposed openstack-infra/project-config: make python3.5 voting for oslo.middleware  https://review.openstack.org/40043823:08
openstackgerritMerged openstack-infra/system-config: Add #openstack-swg to eavesdrop  https://review.openstack.org/39788023:12
*** mriedem has quit IRC23:12
openstackgerritMerged openstack-infra/nodepool: Print all fields of ZK objects  https://review.openstack.org/40027023:13
openstackgerritMerged openstack-infra/nodepool: Sort existing builds properly in cleanup thread  https://review.openstack.org/40029223:14
*** wolverineav has joined #openstack-infra23:14
openstackgerritMerged openstack-infra/nodepool: Fix upload recency table bug  https://review.openstack.org/40032023:14
*** wolverineav has quit IRC23:18
*** kzaitsev_mb has quit IRC23:20
*** rbuzatu has quit IRC23:22
*** baoli_ has joined #openstack-infra23:23
*** wolverineav has joined #openstack-infra23:24
*** baoli has quit IRC23:27
openstackgerritIsaku Yamahata proposed openstack-infra/project-config: add odl-server service in devstack for networking-odl multinode job  https://review.openstack.org/39709323:27
*** claudiub has quit IRC23:28
*** wolverineav has quit IRC23:28
*** gordc has quit IRC23:30
*** wolverineav has joined #openstack-infra23:33
*** Julien-zte has quit IRC23:34
*** xyang1 has quit IRC23:37
*** dingyichen has joined #openstack-infra23:37
*** wolverineav has quit IRC23:38
openstackgerritMonty Taylor proposed openstack-infra/shade: Add docstring for create_image_snapshot  https://review.openstack.org/40044623:39
openstackgerritMonty Taylor proposed openstack-infra/shade: Allow server to be snapshot to be name, id or dict  https://review.openstack.org/40044723:39
*** baoli_ has quit IRC23:41
*** baoli has joined #openstack-infra23:41
*** tqtran has quit IRC23:42
*** tqtran has joined #openstack-infra23:42
*** openstack has joined #openstack-infra23:44
*** wolverineav has quit IRC23:48
*** rhallisey has quit IRC23:50
*** wolverineav has joined #openstack-infra23:53
openstackgerritMonty Taylor proposed openstack-infra/shade: Add an e to the word therefore  https://review.openstack.org/40045023:54
*** nicolasbock has quit IRC23:58
*** wolverineav has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!