Tuesday, 2017-01-24

*** thorst_ has joined #openstack-infra00:00
*** zz_dimtruck is now known as dimtruck00:00
*** rbuzatu has joined #openstack-infra00:01
*** hongbin has quit IRC00:04
*** rbuzatu has quit IRC00:06
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Add files for zuul-nodepool integration test  https://review.openstack.org/42228400:07
*** s-shiono has joined #openstack-infra00:10
*** xarses_ has quit IRC00:11
*** sflanigan has joined #openstack-infra00:12
fungijeblair: yes to making nodepool hold require a comment00:14
*** thorst_ has quit IRC00:17
*** jcoufal has quit IRC00:17
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Temprevert broken bigswitch backport  https://review.openstack.org/42428800:17
*** thorst_ has joined #openstack-infra00:17
*** s-shiono_ has joined #openstack-infra00:17
*** s-shiono has quit IRC00:18
openstackgerritMerged openstack-infra/nodepool: Move to fedora-25 for devstack testing  https://review.openstack.org/42019700:19
*** inc0 has quit IRC00:20
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Temprevert broken bigswitch backport  https://review.openstack.org/42428800:20
mordredjeblair: ++ to making hold require a comment00:21
*** thorst_ has quit IRC00:22
mordredjeblair: and thank you for figuring out why auto-hold was broken - I added a couple of jobs and didn't get nodes but hadn't had a chance to figure out that mystery yet00:22
*** rbrndt has quit IRC00:26
*** rbrndt has joined #openstack-infra00:26
*** rbrndt has quit IRC00:26
*** dimtruck is now known as zz_dimtruck00:28
*** rfolco has joined #openstack-infra00:29
*** sflanigan has quit IRC00:33
*** rajinir has quit IRC00:36
*** adrian_otto has joined #openstack-infra00:36
*** wolverineav has quit IRC00:38
asselin_I'm trying to setup a git mirror using puppet-cgit & haproxy on centos7. It's not working and I'm having difficulties debugging it. I see balance_git_http balance_git_http/<NOSRV> -1/-1/0 0 SC 0/0/0/0/0 0/000:39
asselin_ but the git daemon is running  (systemctl status git-daemon.socket)00:39
*** thorst_ has joined #openstack-infra00:42
asselin_curl localhost:8080/cgit works, but only from localhost....does that mean the haproxy is not configured correctly?00:42
*** jkilpatr has joined #openstack-infra00:44
*** thorst_ has quit IRC00:44
*** wolverineav has joined #openstack-infra00:45
*** sflanigan has joined #openstack-infra00:46
*** sflanigan has joined #openstack-infra00:46
*** zhurong has joined #openstack-infra00:48
*** wolverineav has quit IRC00:49
*** claudiub has quit IRC00:49
*** jamesdenton has joined #openstack-infra00:49
*** jamesden_ has joined #openstack-infra00:53
*** jamesdenton has quit IRC00:54
*** voldz1tic3n has joined #openstack-infra00:56
*** rbuzatu has joined #openstack-infra00:57
*** wolverineav has joined #openstack-infra00:59
*** rbuzatu has quit IRC01:02
*** aeng has quit IRC01:02
*** jamielennox is now known as jamielennox|away01:02
*** wolverineav has quit IRC01:03
*** Guest70632 has quit IRC01:05
*** armax has quit IRC01:07
*** zz_dimtruck is now known as dimtruck01:10
*** shu-mutou-AWAY is now known as shu-mutou01:14
*** baoli has joined #openstack-infra01:15
*** jamielennox|away is now known as jamielennox01:17
*** aeng has joined #openstack-infra01:19
*** wolverineav has joined #openstack-infra01:19
*** pvaneck has quit IRC01:19
*** sdake has joined #openstack-infra01:19
*** baoli has quit IRC01:20
*** Hal has joined #openstack-infra01:20
*** Hal is now known as Guest3247901:21
*** gildub has quit IRC01:21
*** wolverineav has quit IRC01:23
*** markvoelker has joined #openstack-infra01:27
*** mtanino has quit IRC01:30
*** wolverineav has joined #openstack-infra01:31
*** mtanino has joined #openstack-infra01:32
*** wolverineav has quit IRC01:35
*** aeng has quit IRC01:37
*** armax has joined #openstack-infra01:38
*** eranrom_ has joined #openstack-infra01:42
*** eranrom has quit IRC01:45
*** rfolco has quit IRC01:45
*** yanyanhu has joined #openstack-infra01:47
*** Swami has quit IRC01:49
*** aeng has joined #openstack-infra01:50
*** wolverineav has joined #openstack-infra01:51
*** sdake has quit IRC01:53
*** sflanigan has quit IRC01:55
*** sdake has joined #openstack-infra01:55
*** sdake has quit IRC01:55
*** sdake has joined #openstack-infra01:55
*** wolverineav has quit IRC01:56
*** adrian_otto has quit IRC01:56
*** rbuzatu has joined #openstack-infra01:59
*** Sukhdev_ has quit IRC02:01
*** wolverineav has joined #openstack-infra02:01
*** rbuzatu has quit IRC02:03
*** aeng has quit IRC02:04
*** erikmwil_ has quit IRC02:04
*** erikmwil_ has joined #openstack-infra02:05
*** pahuang has quit IRC02:06
*** wolverineav has quit IRC02:06
*** chem has quit IRC02:07
*** sflanigan has joined #openstack-infra02:08
*** john-davidge has joined #openstack-infra02:10
*** Apoorva has quit IRC02:10
*** wolverineav has joined #openstack-infra02:12
*** john-davidge has quit IRC02:15
*** wolverineav has quit IRC02:16
*** aeng has joined #openstack-infra02:22
*** pahuang has joined #openstack-infra02:22
*** lcastell has quit IRC02:26
*** jlwhite has quit IRC02:26
openstackgerritKevin Benton proposed openstack-infra/devstack-gate: test  https://review.openstack.org/42440902:30
*** aeng has quit IRC02:31
*** wolverineav has joined #openstack-infra02:31
*** lindycoder has joined #openstack-infra02:32
*** lindycoder has quit IRC02:32
*** rbuzatu has joined #openstack-infra02:35
*** gildub has joined #openstack-infra02:35
*** wolverineav has quit IRC02:36
*** aeng has joined #openstack-infra02:37
*** yujunz has joined #openstack-infra02:38
*** rbuzatu has quit IRC02:39
*** mtanino has quit IRC02:40
*** cody-somerville has quit IRC02:40
*** knangia has quit IRC02:40
*** aeng has quit IRC02:42
*** harlowja has quit IRC02:44
*** thorst_ has joined #openstack-infra02:49
*** thorst_ has quit IRC02:49
*** wolverineav has joined #openstack-infra02:51
*** jlwhite has joined #openstack-infra02:54
*** aeng has joined #openstack-infra02:55
*** voldz1tic3n has quit IRC02:56
*** hongbin has joined #openstack-infra02:56
*** wolverineav has quit IRC02:56
*** lcastell has joined #openstack-infra02:57
*** mriedem has quit IRC02:57
*** dinob has quit IRC02:59
*** reed has quit IRC03:02
*** reed has joined #openstack-infra03:03
openstackgerritCao Xuan Hoang proposed openstack-infra/glean: Remove support for py33/py26  https://review.openstack.org/42441903:05
*** voldz1tic3n has joined #openstack-infra03:10
*** wolverineav has joined #openstack-infra03:12
*** wolverineav has quit IRC03:17
*** erikmwil_ has quit IRC03:19
*** yujunz has quit IRC03:21
*** erikmwil_ has joined #openstack-infra03:22
*** wolverineav has joined #openstack-infra03:22
*** yamahata has quit IRC03:22
*** armax has quit IRC03:23
*** jlwhite has quit IRC03:26
*** lcastell has quit IRC03:26
*** wolverineav has quit IRC03:27
openstackgerritLogan V proposed openstack-infra/project-config: OSA: Make the ceph scenario non voting  https://review.openstack.org/42442403:30
*** gildub has quit IRC03:30
*** wolverineav has joined #openstack-infra03:32
*** yujunz has joined #openstack-infra03:32
*** thorst_ has joined #openstack-infra03:33
*** thorst_ has quit IRC03:34
*** jamesden_ has quit IRC03:34
*** vikrant has joined #openstack-infra03:36
*** wolverineav has quit IRC03:37
*** zhurong has quit IRC03:40
*** erikmwil_ has quit IRC03:41
*** wolverineav has joined #openstack-infra03:42
*** jamesdenton has joined #openstack-infra03:46
*** yujunz has quit IRC03:47
*** wolverineav has quit IRC03:47
*** wolverineav has joined #openstack-infra03:53
*** rhallisey has quit IRC03:54
*** ihrachys has joined #openstack-infra03:54
*** nicolasbock has quit IRC03:54
*** ihrachys has quit IRC03:55
*** EricGonczer_ has quit IRC03:55
*** ihrachys has joined #openstack-infra03:55
*** ociuhandu has quit IRC03:57
*** wolverineav has quit IRC03:57
*** sdake has quit IRC03:58
*** ihrachys has quit IRC04:01
*** rlandy has quit IRC04:10
*** Apoorva has joined #openstack-infra04:11
*** wolverineav has joined #openstack-infra04:12
*** tlian has quit IRC04:14
*** erikmwil_ has joined #openstack-infra04:15
*** Apoorva_ has joined #openstack-infra04:16
*** wolverineav has quit IRC04:17
*** Apoorva has quit IRC04:20
*** hongbin has quit IRC04:20
*** ociuhandu has joined #openstack-infra04:21
*** gildub has joined #openstack-infra04:22
*** asselin__ has joined #openstack-infra04:23
*** sree has joined #openstack-infra04:24
*** lcastell has joined #openstack-infra04:25
*** jlwhite has joined #openstack-infra04:26
*** asselin_ has quit IRC04:27
*** sdague has joined #openstack-infra04:28
*** jamesdenton has quit IRC04:30
*** gildub has quit IRC04:30
*** wolverineav has joined #openstack-infra04:32
*** MasterOfBugs has quit IRC04:34
*** rbuzatu has joined #openstack-infra04:36
*** john-davidge has joined #openstack-infra04:37
*** wolverineav has quit IRC04:37
*** psachin has joined #openstack-infra04:39
*** rbuzatu has quit IRC04:41
openstackgerritIan Wienand proposed openstack-infra/system-config: Add "parallel" for wheel build slaves  https://review.openstack.org/42443004:41
*** john-davidge has quit IRC04:42
*** winggundamth has joined #openstack-infra04:42
*** wolverineav has joined #openstack-infra04:43
openstackgerritIan Wienand proposed openstack-infra/project-config: Run wheel build jobs in parallel and keep logs  https://review.openstack.org/42443104:44
*** wolverineav has quit IRC04:48
*** wolverineav has joined #openstack-infra04:53
ianwAJaeger: ^ i think that's going to be the way to go with the wheel builds ... still thinking about the bindep integration04:54
*** sree has quit IRC04:54
*** sree has joined #openstack-infra04:56
*** wolverineav has quit IRC04:58
*** armax has joined #openstack-infra05:00
*** gildub has joined #openstack-infra05:00
openstackgerritIan Wienand proposed openstack-infra/project-config: Run wheel build jobs in parallel and keep logs  https://review.openstack.org/42443105:00
*** sflanigan is now known as sflanigan_afk05:02
*** wolverineav has joined #openstack-infra05:03
*** ihrachys has joined #openstack-infra05:06
*** wolverineav has quit IRC05:08
*** adrian_otto has joined #openstack-infra05:08
*** sflanigan_afk is now known as sflanigan05:11
*** wolverineav has joined #openstack-infra05:13
*** adriant has quit IRC05:14
*** dimtruck is now known as zz_dimtruck05:16
*** voldz1tic3n has quit IRC05:18
*** wolverineav has quit IRC05:18
*** adrian_otto1 has joined #openstack-infra05:19
*** pahuang has quit IRC05:20
*** sdague has quit IRC05:23
*** adrian_otto has quit IRC05:23
*** wolverineav has joined #openstack-infra05:23
*** ianychoi has joined #openstack-infra05:26
*** wolverineav has quit IRC05:28
*** vaidy has quit IRC05:28
*** makowals_ has quit IRC05:29
*** pahuang has joined #openstack-infra05:33
*** wolverineav has joined #openstack-infra05:33
*** thorst_ has joined #openstack-infra05:35
*** vaidy has joined #openstack-infra05:35
*** makowals has joined #openstack-infra05:35
*** pgadiya has joined #openstack-infra05:36
*** wolverineav has quit IRC05:38
*** thorst_ has quit IRC05:40
*** adrian_otto1 has quit IRC05:41
*** adrian_otto has joined #openstack-infra05:46
*** adrian_otto has quit IRC05:51
*** adrian_otto has joined #openstack-infra05:51
*** nmathew has joined #openstack-infra05:52
*** wolverineav has joined #openstack-infra05:54
*** armax has quit IRC05:56
*** wolverineav has quit IRC05:58
*** wolverineav has joined #openstack-infra06:04
*** wolverineav has quit IRC06:08
openstackgerritIan Wienand proposed openstack-infra/project-config: Run wheel build jobs in parallel and keep logs  https://review.openstack.org/42443106:10
*** adrian_otto has quit IRC06:11
*** adrian_otto has joined #openstack-infra06:12
*** mdurrant_ has joined #openstack-infra06:12
*** wolverineav has joined #openstack-infra06:14
*** mdurrant has quit IRC06:14
openstackgerritMerged openstack/diskimage-builder: Set grub device in /etc/default/grub  https://review.openstack.org/40224806:16
*** nadya has joined #openstack-infra06:17
*** anilvenkata has joined #openstack-infra06:18
*** wolverineav has quit IRC06:18
openstackgerritTomasz Trębski proposed openstack-infra/project-config: Update CI for monasca-log-api  https://review.openstack.org/42401706:19
*** wolverineav has joined #openstack-infra06:24
*** dham1 has quit IRC06:24
openstackgerritTomasz Trębski proposed openstack-infra/project-config: Update CI for monasca-log-api  https://review.openstack.org/42401706:25
*** dham1 has joined #openstack-infra06:26
*** armax has joined #openstack-infra06:28
*** winggundamth has quit IRC06:28
*** wolverineav has quit IRC06:28
*** armax has quit IRC06:28
*** nadya has quit IRC06:29
*** zzzeek has quit IRC06:29
*** harlowja has joined #openstack-infra06:34
*** wolverineav has joined #openstack-infra06:34
*** rbuzatu has joined #openstack-infra06:38
*** wolverineav has quit IRC06:39
*** rbuzatu has quit IRC06:42
*** armax has joined #openstack-infra06:43
*** armax has quit IRC06:43
*** wolverineav has joined #openstack-infra06:44
*** sshnaidm|afk is now known as sshnaidm06:46
*** armax has joined #openstack-infra06:47
*** armax has quit IRC06:48
*** wolverineav has quit IRC06:49
*** adrian_otto has quit IRC06:50
*** claudiub has joined #openstack-infra06:51
*** claudiub|2 has joined #openstack-infra06:54
*** wolverineav has joined #openstack-infra06:54
*** claudiub has quit IRC06:57
AJaegerianw: looks sane but I like the rest of the team review it - there are people with more wheel build knowledge. infra-root, please review https://review.openstack.org/424431 . Thanks, ianw!06:58
*** wolverineav has quit IRC06:59
*** abregman has joined #openstack-infra07:04
*** wolverineav has joined #openstack-infra07:04
*** wolverineav has quit IRC07:09
*** andreas_s has joined #openstack-infra07:12
*** tnovacik has joined #openstack-infra07:12
*** wolverineav has joined #openstack-infra07:15
*** dimak has quit IRC07:16
*** yuvalb has quit IRC07:16
*** lihi has quit IRC07:16
*** oanson has quit IRC07:16
*** oanson has joined #openstack-infra07:17
*** yuvalb has joined #openstack-infra07:17
*** wolverineav has quit IRC07:19
*** markus_z has joined #openstack-infra07:19
*** Apoorva_ has quit IRC07:23
*** rbuzatu has joined #openstack-infra07:24
*** harlowja has quit IRC07:26
*** yuvalb has quit IRC07:31
*** yuvalb has joined #openstack-infra07:32
*** yamamoto has quit IRC07:33
*** wolverineav has joined #openstack-infra07:34
*** sflanigan is now known as sflanigan_afk07:35
*** thorst_ has joined #openstack-infra07:36
*** baoli has joined #openstack-infra07:36
*** yolanda has joined #openstack-infra07:36
*** yujunz has joined #openstack-infra07:36
*** tesseract has joined #openstack-infra07:37
*** Sukhdev has joined #openstack-infra07:38
*** wolverineav has quit IRC07:39
*** sflanigan_afk is now known as sflanigan07:39
*** baoli has quit IRC07:40
*** thorst_ has quit IRC07:40
openstackgerritMerged openstack-infra/project-config: OSA: Make the ceph scenario non voting  https://review.openstack.org/42442407:41
*** florianf has joined #openstack-infra07:42
openstackgerritMerged openstack-infra/project-config: Add job template for Barbican tempest plugin  https://review.openstack.org/42080907:42
dirkInfra team, why does openstack/requirements suddenly have a voting grenade job that fails on setup in the week where we need to get all changes in due to req freeze?07:43
openstackgerritMerged openstack-infra/project-config: Create periodic multinode scenario jobs in tripleo  https://review.openstack.org/42426507:44
*** ralonsoh has joined #openstack-infra07:47
*** yujunz has quit IRC07:48
openstackgerritMerged openstack-infra/project-config: Add py35/tempest job to devstack and tempest check queues  https://review.openstack.org/42410707:50
openstackgerritMerged openstack-infra/project-config: Revert "Remove sheepdog jobs from cinder queue"  https://review.openstack.org/42410807:50
openstackgerritMerged openstack-infra/project-config: Add experimental job to test nova custom resource classes  https://review.openstack.org/40764507:53
openstackgerritMerged openstack-infra/project-config: Add monasca-kibana-plugin project  https://review.openstack.org/42075407:53
*** rbuzatu has quit IRC07:53
*** wolverineav has joined #openstack-infra07:54
*** ijw has quit IRC07:55
*** wolverineav has quit IRC07:59
*** eranrom_ is now known as eranrom08:00
*** yuval has joined #openstack-infra08:01
*** umeshksingla has joined #openstack-infra08:02
*** openstackgerrit has quit IRC08:03
*** umeshksingla has quit IRC08:03
*** umeshksingla has joined #openstack-infra08:04
*** rbuzatu has joined #openstack-infra08:04
AJaegerdirk: there hasn't been any change to requirements jobs this month AFAIK. I think you talk about http://lists.openstack.org/pipermail/openstack-dev/2017-January/110732.html which was also discussed last night here - and fixed directly.08:05
AJaegerdirk: ironically the problem is even requirements related ;)08:05
AJaegerdirk: see https://review.openstack.org/42432308:06
*** umeshksingla has quit IRC08:09
*** panda|zZ is now known as panda08:10
dirkajaeger: thanks08:11
*** florianf_ has joined #openstack-infra08:13
*** openstackgerrit has joined #openstack-infra08:13
openstackgerritTomasz Trębski proposed openstack-infra/project-config: Update CI for monasca-log-api  https://review.openstack.org/42401708:13
*** wolverineav has joined #openstack-infra08:15
*** nadya has joined #openstack-infra08:16
*** florianf has quit IRC08:16
*** wolverineav has quit IRC08:19
*** hashar has joined #openstack-infra08:23
*** dingyichen has quit IRC08:24
yolandagood morning08:24
lennybCores, pls review small nodepool fix https://review.openstack.org/#/c/424000  to make nodepool node without nodepool-base element08:24
lennybgood morning, yolanda08:24
*** amotoki has quit IRC08:24
*** kornicameister has joined #openstack-infra08:24
*** wolverineav has joined #openstack-infra08:25
*** bkorren has joined #openstack-infra08:26
*** abregman has quit IRC08:27
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/42450108:28
*** umeshksingla has joined #openstack-infra08:30
*** wolverineav has quit IRC08:30
*** Sukhdev has quit IRC08:31
*** amotoki has joined #openstack-infra08:33
*** chem has joined #openstack-infra08:33
*** abregman has joined #openstack-infra08:34
*** ssbarnea has joined #openstack-infra08:35
*** yamamoto has joined #openstack-infra08:35
*** wolverineav has joined #openstack-infra08:35
*** john-davidge has joined #openstack-infra08:38
*** priteau has joined #openstack-infra08:39
*** wolverin_ has joined #openstack-infra08:39
*** rbuzatu has quit IRC08:40
*** wolverineav has quit IRC08:41
*** john-davidge has quit IRC08:43
*** john-dav_ has joined #openstack-infra08:43
*** pcaruana has joined #openstack-infra08:45
*** rbuzatu has joined #openstack-infra08:47
*** dizquierdo has joined #openstack-infra08:48
*** ihrachys has quit IRC08:48
*** mptacekx has joined #openstack-infra08:48
*** jpich has joined #openstack-infra08:49
*** rossella_ has joined #openstack-infra08:51
*** amotoki has quit IRC08:53
*** makowals has quit IRC08:56
*** electrofelix has joined #openstack-infra08:56
openstackgerritMerged openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/42450108:57
*** makowals_ has joined #openstack-infra08:59
openstackgerritZhang Ni proposed openstack-infra/project-config: Add new project(fuxi-kubernetes) to Openstack  https://review.openstack.org/42312609:00
*** zzzeek has joined #openstack-infra09:00
*** pgadiya has quit IRC09:02
*** rbuzatu has quit IRC09:09
openstackgerritTomasz Trębski proposed openstack-infra/project-config: Update CI for monasca-log-api  https://review.openstack.org/42401709:10
openstackgerritTomasz Trębski proposed openstack-infra/project-config: Update CI for monasca-log-api  https://review.openstack.org/42401709:11
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Replace ironic-multitest job by ironic-standalone  https://review.openstack.org/42331309:12
*** Julien-zte has quit IRC09:16
*** pgadiya has joined #openstack-infra09:18
vsaienk0dtantsur, jroll, AJaeger, yolanda: please review: https://review.openstack.org/#/c/423313/ - ironic without nova installation first step in ironic standalone testing queue.09:22
*** ijw has joined #openstack-infra09:23
*** derekh has joined #openstack-infra09:25
openstackgerritMerged openstack-infra/shade: Replace SwiftService with direct REST uploads  https://review.openstack.org/41573909:26
openstackgerritMerged openstack-infra/shade: Add raw client constructors for all the things  https://review.openstack.org/42267709:26
openstackgerritMerged openstack-infra/shade: Do neutron version discovery and change one test  https://review.openstack.org/42359509:26
openstackgerritMerged openstack-infra/shade: Add helper test method for registering REST calls  https://review.openstack.org/42359609:27
openstackgerritMerged openstack-infra/shade: Skip discovery for neutron  https://review.openstack.org/42360409:27
*** ijw has quit IRC09:27
*** jordanP has joined #openstack-infra09:27
*** yamamoto has quit IRC09:29
*** mhickey has joined #openstack-infra09:29
*** s-shiono_ has quit IRC09:30
*** thorst_ has joined #openstack-infra09:30
*** lucas-afk is now known as lucasagomes09:31
*** thorst_ has quit IRC09:35
*** apetrich has quit IRC09:36
*** apetrich has joined #openstack-infra09:36
*** john-dav_ is now known as john-davidge09:37
*** e0ne has joined #openstack-infra09:42
*** bkorren has quit IRC09:43
openstackgerritSergey Kraynev proposed openstack-infra/project-config: Add fuel-ccp-nginx repository  https://review.openstack.org/42454209:44
*** shu-mutou is now known as shu-mutou-AWAY09:44
*** gildub has quit IRC09:45
*** sambetts|afk is now known as sambetts09:47
*** martinkopec has joined #openstack-infra09:56
*** amotoki has joined #openstack-infra09:57
*** nadya has quit IRC09:58
*** bkorren has joined #openstack-infra09:58
*** dizquierdo has quit IRC10:03
*** ssbarnea has quit IRC10:06
*** strigazi_AFK is now known as strigazi10:09
*** ssbarnea has joined #openstack-infra10:09
*** rbuzatu has joined #openstack-infra10:09
*** pgadiya has quit IRC10:11
*** pgadiya_ has joined #openstack-infra10:11
*** thiagolib has joined #openstack-infra10:13
*** rbuzatu has quit IRC10:15
*** yamamoto has joined #openstack-infra10:20
anilvenkataneed help with addressing comment https://review.openstack.org/#/c/383827/12/devstack-vm-gate.sh@23410:20
anilvenkataIs the existing patchset is fine or should I change it as suggested in the comment?10:21
*** yamamoto has quit IRC10:21
*** sileht has quit IRC10:27
*** sileht has joined #openstack-infra10:27
*** rbuzatu has joined #openstack-infra10:27
*** nadya has joined #openstack-infra10:28
openstackgerritTomasz Trębski proposed openstack-infra/project-config: Update CI for monasca-log-api  https://review.openstack.org/42401710:29
*** bexelbie has quit IRC10:32
*** bexelbie has joined #openstack-infra10:32
*** nadya has quit IRC10:33
*** Julien-zte has joined #openstack-infra10:34
*** derekh has quit IRC10:35
*** dizquierdo has joined #openstack-infra10:37
*** rfolco has joined #openstack-infra10:44
*** bkorren has quit IRC10:45
*** Julien-z_ has joined #openstack-infra10:45
*** Julien-z_ has quit IRC10:46
*** Julien-zte has quit IRC10:46
*** dtardivel has joined #openstack-infra10:49
*** nadya has joined #openstack-infra10:49
openstackgerritLucas Alvares Gomes proposed openstack-infra/project-config: Add experimental UEFI job for ironic  https://review.openstack.org/42457610:50
*** rbuzatu has quit IRC10:51
*** nmathew has quit IRC10:54
AJaegeranilvenkata: Can't help much here - one comment: what's the answer to the question about ""? Check the code and I argue why you don't need to handle it - or fix it to handle it.10:55
*** dizquierdo has quit IRC10:56
*** rbuzatu has joined #openstack-infra10:56
*** derekh has joined #openstack-infra10:56
*** yonglihe has quit IRC10:57
*** ccamacho has joined #openstack-infra10:57
anilvenkataAJaeger, thanks Andreas10:57
*** bkorren has joined #openstack-infra10:58
*** priteau has quit IRC11:00
*** e0ne has quit IRC11:01
*** rbuzatu has quit IRC11:02
*** mhickey has quit IRC11:03
*** wolverineav has joined #openstack-infra11:05
*** shardy has joined #openstack-infra11:05
*** ricardoas has quit IRC11:05
*** amotoki has quit IRC11:07
*** wolverin_ has quit IRC11:08
*** dtantsur|afk is now known as dtantsur11:13
*** florianf_ is now known as florianf11:22
*** rhallisey has joined #openstack-infra11:23
*** tosky has joined #openstack-infra11:25
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test logs  https://review.openstack.org/42459611:27
*** sree has quit IRC11:28
*** abregman has quit IRC11:29
*** amotoki has joined #openstack-infra11:30
*** thorst_ has joined #openstack-infra11:31
*** abregman has joined #openstack-infra11:35
*** thorst_ has quit IRC11:36
*** mhickey has joined #openstack-infra11:41
*** florianf has quit IRC11:42
*** wolverineav has quit IRC11:43
*** jkilpatr has quit IRC11:43
*** nicolasbock has joined #openstack-infra11:44
*** mrtenio has joined #openstack-infra11:44
*** martinkopec has quit IRC11:46
*** wolverineav has joined #openstack-infra11:48
*** martinkopec has joined #openstack-infra11:48
tobiashHi, I've a question regarding your crm114 build log classifying11:48
tobiashhas each worker its own local classifying state?11:49
*** Guest32479 has quit IRC11:50
*** wolverineav has quit IRC11:52
openstackgerritOksana Voshchana proposed openstack-infra/devstack-gate: TEST for multinode grenade devstack  https://review.openstack.org/39667911:59
*** florianf has joined #openstack-infra12:00
openstackgerritJames Page proposed openstack-infra/project-config: Add rally and tempest snaps  https://review.openstack.org/42460612:02
*** Hal has joined #openstack-infra12:06
*** Hal is now known as Guest4152012:07
*** wolverineav has joined #openstack-infra12:08
*** shardy is now known as shardy_lunch12:11
*** sdake has joined #openstack-infra12:12
*** wolverineav has quit IRC12:13
*** gouthamr has joined #openstack-infra12:13
*** sdake_ has joined #openstack-infra12:16
*** jkilpatr has joined #openstack-infra12:16
*** dizquierdo has joined #openstack-infra12:17
*** sdake has quit IRC12:17
*** abregman is now known as abregman|mtg12:18
*** abregman|mtg has quit IRC12:18
*** lucasagomes is now known as lucas-hungry12:19
openstackgerritEmilien Macchi proposed openstack-infra/project-config: tripleo: prepare stable/ocata  https://review.openstack.org/42462212:19
*** rbuzatu has joined #openstack-infra12:19
*** yamamoto has joined #openstack-infra12:20
*** rbuzatu has quit IRC12:24
*** aojea has quit IRC12:28
*** nadya has quit IRC12:28
*** wolverineav has joined #openstack-infra12:29
*** aojea has joined #openstack-infra12:31
*** wolverineav has quit IRC12:33
*** martinkopec has quit IRC12:34
*** martinkopec has joined #openstack-infra12:35
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Prepare TripleO CI for stable/ocata  https://review.openstack.org/42463712:37
openstackgerritDan Radez proposed openstack/diskimage-builder: Adding aarch64 support for CentOS7  https://review.openstack.org/42223212:42
*** priteau has joined #openstack-infra12:45
*** Mmike has quit IRC12:46
*** thorst_ has joined #openstack-infra12:47
*** Mmike has joined #openstack-infra12:47
*** Mmike has joined #openstack-infra12:47
*** rhallisey has quit IRC12:47
*** rhallisey has joined #openstack-infra12:48
*** sdake_ is now known as sdake12:49
*** krtaylor has quit IRC12:51
*** shardy_lunch is now known as shardy12:52
*** vikrant has quit IRC12:53
*** ricardoas has joined #openstack-infra12:56
*** florianf has quit IRC12:56
*** ccamacho is now known as ccamacho|lunch12:59
*** mtanino has joined #openstack-infra13:00
*** isaacb has joined #openstack-infra13:00
*** isaacb_ has joined #openstack-infra13:00
*** baoli has joined #openstack-infra13:01
*** baoli has quit IRC13:01
*** baoli has joined #openstack-infra13:02
isaacbHi, I have 2 nodes running the same gate. is there a way to know if they both were created from the same image?13:04
*** yamamoto has quit IRC13:04
*** krtaylor has joined #openstack-infra13:04
*** sree has joined #openstack-infra13:04
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Add ceph support to major upgrade job  https://review.openstack.org/42338313:06
*** isaacb has left #openstack-infra13:06
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Workaround bigswitch breakage in upgrade CI  https://review.openstack.org/42419913:06
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Add Ironic support to major upgrade CI  https://review.openstack.org/42428713:06
*** wolverineav has joined #openstack-infra13:06
*** apuimedo|flu is now known as apuimedo13:06
*** sree has quit IRC13:08
*** EricGonczer_ has joined #openstack-infra13:08
*** rbuzatu has joined #openstack-infra13:09
*** pgadiya_ has quit IRC13:09
*** wolverineav has quit IRC13:11
*** wolverineav has joined #openstack-infra13:11
*** rlandy has joined #openstack-infra13:14
*** gordc has joined #openstack-infra13:14
*** lucas-hungry is now known as lucasagomes13:16
openstackgerritwes hayutin proposed openstack-infra/project-config: use the tripleo oooq containers job to gate t-h-t/docker/*  https://review.openstack.org/42351913:16
openstackgerritwes hayutin proposed openstack-infra/project-config: use the tripleo oooq containers job to gate t-h-t/docker/*  https://review.openstack.org/42351913:18
*** aidin has joined #openstack-infra13:18
*** dave-mccowan has joined #openstack-infra13:18
*** umeshksingla has quit IRC13:20
*** askb has quit IRC13:22
*** ijw has joined #openstack-infra13:23
*** trown|outtypewww is now known as trown13:23
abalobashinaHi there! I have 2 similar patches with different change_id. On the first case Jenkins has failed: http://logs.openstack.org/81/422481/4/check/gate-fuel-web-python27-db-ubuntu-xenial/3466190/console.html, on the second case Jenkins has successfully passed: http://logs.openstack.org/53/424553/1/check/gate-fuel-web-python27-db-ubuntu-xenial/8f652fa/console.html. I can understand the reason for it. Besides all test that fa13:24
*** wolverin_ has joined #openstack-infra13:24
*** yujunz has joined #openstack-infra13:24
*** yamamoto has joined #openstack-infra13:25
bkeroInfra folks: Could someone take a look at this job and let me know if I named things correctly and put the job under the correct places. The context is expanding the gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv job to support scenarios.13:25
*** yamamoto has quit IRC13:25
bkerohttps://review.openstack.org/#/c/416110/13:26
*** aidin has quit IRC13:26
*** jlwhite has quit IRC13:27
*** lcastell has quit IRC13:27
*** florianf has joined #openstack-infra13:27
bkeroSorry, wrong review. This is the correct one: https://review.openstack.org/#/c/424034/13:27
*** wolverineav has quit IRC13:28
*** e0ne has joined #openstack-infra13:28
*** ijw has quit IRC13:28
*** rbuzatu has quit IRC13:30
*** gouthamr has quit IRC13:32
*** armax has joined #openstack-infra13:34
*** sree has joined #openstack-infra13:36
openstackgerritMerged openstack-infra/shade: Add ability to stream object directly to file  https://review.openstack.org/42366113:38
*** mrtenio has quit IRC13:40
*** acabot has joined #openstack-infra13:41
lennybmordred, pls review again https://review.openstack.org/#/c/424000  'Create mandatory /etc/nodepool for later use' patch13:41
*** rbuzatu has joined #openstack-infra13:42
*** Jeffrey4l_ is now known as Jeffrey4l13:42
openstackgerritBen Kero proposed openstack-infra/project-config: Add experimental jobs for TripleO OOOQ Multinode scenario testing  https://review.openstack.org/42403413:44
*** srobert has joined #openstack-infra13:44
*** abregman has joined #openstack-infra13:45
openstackgerritMerged openstack-infra/shade: Upload images to swift as application/octet-stream  https://review.openstack.org/42427413:46
*** EricGonc_ has joined #openstack-infra13:49
*** isaacb_ has quit IRC13:50
*** EricGonczer_ has quit IRC13:51
*** trown is now known as trown|brb13:52
*** ccamacho|lunch is now known as ccamacho13:53
*** dizquierdo has quit IRC13:54
*** armax has quit IRC13:54
*** thiagolib has quit IRC13:58
*** isaacb_ has joined #openstack-infra13:59
*** dprince has joined #openstack-infra13:59
*** kgiusti has joined #openstack-infra13:59
*** jordanP has quit IRC14:02
*** jordanP has joined #openstack-infra14:02
*** timello has quit IRC14:03
jpichThere's a meeting stuck without a chair in #openstack-meeting, who can't #endmeeting - is that something someone here can help with?14:03
jpich...never mind all fixed :-)14:03
*** kgiusti has quit IRC14:04
*** chem has quit IRC14:04
*** chem has joined #openstack-infra14:07
*** hurgleburgler has joined #openstack-infra14:08
*** nadya has joined #openstack-infra14:08
*** acabot has quit IRC14:08
*** mdrabe has joined #openstack-infra14:08
*** jamesdenton has joined #openstack-infra14:08
*** timello has joined #openstack-infra14:12
*** matrohon has joined #openstack-infra14:12
*** mtanino has quit IRC14:13
fungijpich: either the initial chair can designate additional chairs before they part (if they predict it may become necessary), or after exactly one hour anyone in the channel can issue an #endmeeting and the bot will respect it14:13
*** trown|brb is now known as trown14:14
*** gouthamr has joined #openstack-infra14:15
*** jcoufal has joined #openstack-infra14:15
Zaraoh, I never knew the 'one hour' trick; TIL14:17
jpichfungi: Thank you, that will come in handy!14:18
*** krtaylor has quit IRC14:18
*** kgiusti has joined #openstack-infra14:19
isaacb_Hi, anyone can check ubuntu-trusty-rax in nodepool?14:21
*** Julien-zte has joined #openstack-infra14:22
fungiisaacb_: what's the trouble you're seeing?14:22
*** matt-borland has joined #openstack-infra14:23
isaacb_fungi: we have https://review.openstack.org/#/c/404958/44, the same job succeed in check and fail in gate14:23
isaacb_I suspect images are different14:23
*** flaper87 has quit IRC14:24
isaacb_fungi: for example: gate-cinder-python34-db14:24
*** EricGonc_ has quit IRC14:25
*** Goneri has joined #openstack-infra14:26
*** rbuzatu has quit IRC14:27
*** sree has quit IRC14:27
*** thiagolib has joined #openstack-infra14:27
*** acabot has joined #openstack-infra14:27
AJaegerisaacb_: but both python34 and python35 fail - that's interesting and points to somethign else14:27
AJaegerand python27 as well ? ;(14:27
AJaegerfungi, logs.o.o times out for me ;(14:28
jordanPsame here14:28
*** ssbarnea_ has joined #openstack-infra14:28
AJaegerah, there it is - just very slow14:28
fungiload average on static.o.o is around 6014:29
*** amotoki has quit IRC14:29
fungiand climbing14:29
AJaegerisaacb_: there's no reverify distinction anymore, use "recheck"14:29
* jroll <3s that every time I come hear to report a problem, someone is on it already14:30
AJaegerisaacb_: currently reverify and recheck do the same but we'll retire reverify at one point14:30
fungilooks like +% of its cpus are consumed in iowait14:30
fungier, 80+%14:30
*** mattmceuen has joined #openstack-infra14:30
isaacb_  AJaeger: ok. thanks. I didn't know that14:30
funginet_ratelimit kicking in and apache segfaulting14:30
*** krtaylor has joined #openstack-infra14:31
*** ssbarnea has quit IRC14:31
fungisystem load is trending back down though iowait is still pretty high14:32
AJaegerisaacb_: seeing py34, 35 and 27 fail - there's a bug somewhere else. MAybe a new package relesae, maybe another change went in between check and gate run that now let your job fail. I suggest to run the tests locally  - and rebase locally before running. Remember we always rebase before we run14:32
*** wolverin_ has quit IRC14:33
AJaegerbtw. it shouldn't run py34 on master at all ;(14:33
fungii think maybe someone is trying to mirror the logserver...? http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=311&rra_id=all14:33
fungiwe're definitely capping out at the rate limit for that flavor14:34
*** larainema has joined #openstack-infra14:34
isaacb_AJaeger: Thanks, I'll double check that14:34
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Do not run py34 on cinder master  https://review.openstack.org/42467414:35
AJaegerfungi, isaacb_: This should get rid of the extra py34 run ^14:35
*** amotoki has joined #openstack-infra14:35
tdurakovclarkb: hi, are you around?14:36
*** eharney has joined #openstack-infra14:37
*** krtaylor has quit IRC14:37
*** isaacb_ has quit IRC14:42
*** wolverineav has joined #openstack-infra14:43
*** yanyanhu has quit IRC14:45
fungiunsurprisingly the vast majority of apache access to logs.o.o in the past hour is from our logstash indexing workers... i wonder if we merged a change recently to start generating much larger volumes of log data in some jobs?14:46
*** kjackal_ has joined #openstack-infra14:46
*** pradk has quit IRC14:47
*** pradk has joined #openstack-infra14:48
*** wolverineav has quit IRC14:48
*** gouthamr_ has joined #openstack-infra14:49
*** psachin has quit IRC14:50
*** gouthamr has quit IRC14:50
*** gouthamr_ is now known as gouthamr14:51
openstackgerritBen Kero proposed openstack-infra/tripleo-ci: WIP: Replace custom multinode oooq playbook with default quickstart playbook  https://review.openstack.org/42468314:53
*** knikolla has joined #openstack-infra14:55
*** bh526r has joined #openstack-infra14:56
*** amotoki has quit IRC14:57
*** krtaylor has joined #openstack-infra14:57
*** armax has joined #openstack-infra14:58
*** mriedem has joined #openstack-infra15:02
*** tlian has joined #openstack-infra15:04
*** dprince has quit IRC15:05
*** voldz1tic3n has joined #openstack-infra15:07
*** fguillot has joined #openstack-infra15:08
*** hongbin has joined #openstack-infra15:08
*** sree has joined #openstack-infra15:12
*** mtanino has joined #openstack-infra15:13
*** gouthamr has quit IRC15:13
*** rbrndt has joined #openstack-infra15:14
*** mtanino has quit IRC15:15
*** nadya has quit IRC15:15
*** mtanino has joined #openstack-infra15:15
zigofungi: Around?15:18
*** markvoelker has quit IRC15:18
*** markvoelker has joined #openstack-infra15:21
*** amotoki has joined #openstack-infra15:22
*** sree has quit IRC15:24
*** knangia has joined #openstack-infra15:25
*** jaosorior has joined #openstack-infra15:25
*** dizquierdo has joined #openstack-infra15:25
*** zz_dimtruck is now known as dimtruck15:25
*** sree has joined #openstack-infra15:26
*** amotoki has quit IRC15:26
*** amotoki has joined #openstack-infra15:26
*** amotoki has quit IRC15:27
*** amotoki has joined #openstack-infra15:27
*** rbuzatu has joined #openstack-infra15:27
*** EricGonczer_ has joined #openstack-infra15:29
tdurakovfungi, AJaeger, could you please also review this patch https://review.openstack.org/#/c/382456/15:30
*** abregman is now known as abregman|afk15:30
*** rbuzatu has quit IRC15:31
*** arxcruz has quit IRC15:31
fungiin the few minutes i was called away, load average on static.o.o has dropped off spectacularly, though we're still pushing ~800mbps outbound for the moment15:32
fungizigo: what's up?15:32
pabelangerfungi: wow, any idea what is sucking up all the juice15:33
*** armax has quit IRC15:34
*** armax_ has joined #openstack-infra15:34
*** ihrachys has joined #openstack-infra15:36
fungipabelanger: not yet, need to install something to do apache log analysis. my guess is it's making a relatively smaller number of requests (compared to our logstash and subunit workers) but retrieving larger files or something15:36
*** srobert has quit IRC15:37
*** srobert has joined #openstack-infra15:38
openstackgerritMerged openstack-infra/shade: Update coding document to mention direct REST calls  https://review.openstack.org/42401415:38
openstackgerritIgor Belikov proposed openstack-infra/jenkins-job-builder: Add Pipeline job type and deprecate Workflow  https://review.openstack.org/32374415:40
pabelangerfungi: ack15:40
pabelangerianw: greghaynes: any change on approving https://review.openstack.org/#/c/414634/ ? Needed to mirror ubuntu with nodepool dsvm job for nodepool15:41
*** EricGonczer_ has quit IRC15:41
*** amotoki has quit IRC15:41
*** aojea has quit IRC15:41
*** lcastell has joined #openstack-infra15:41
*** marst has joined #openstack-infra15:42
*** nadya has joined #openstack-infra15:42
*** aojea has joined #openstack-infra15:45
anilvenkataclarkb, mordred, fungi pabelanger jhesketh rcarrillocruz can you please review https://review.openstack.org/#/c/383827/ . This change is needed to test DVR+HA feature on devstack gate15:45
*** yuval has quit IRC15:45
*** yujunz-zte has joined #openstack-infra15:46
*** yujunz has quit IRC15:47
*** umeshksingla has joined #openstack-infra15:47
*** adrian_otto has joined #openstack-infra15:48
*** ociuhandu has quit IRC15:48
*** burgerk has joined #openstack-infra15:49
clarkbtdurakov: just rolling up to the keyboard now15:49
clarkbfungi: pabelanger possibly something that makes the wsgi log process app really churn?15:50
fungiclarkb: yeah, i'm seeing a lot of wsgi hits15:50
openstackgerritEmilien Macchi proposed openstack-infra/project-config: tripleo/scenario001: add opstools  https://review.openstack.org/42471015:50
*** burgerk_ has joined #openstack-infra15:50
fungimakes me wonder if something's trying to mirror our logs site15:50
fungiand doing so in a way that it crawls the prettified versions15:51
tdurakovclarkb: hi, once you have time, could you please take a look https://review.openstack.org/#/c/382456/ - there are answers to your comment, so, it would be great to figure out the approach for that15:51
*** hieulq_ has joined #openstack-infra15:51
*** umeshksingla has quit IRC15:52
openstackgerritMerged openstack-infra/release-tools: fix tools for listing unreleased changes  https://review.openstack.org/42147415:52
*** mptacekx has quit IRC15:52
clarkbtdurakov: I don't think mycomment was understood... just enable it in grenade by default15:52
openstackgerritMerged openstack-infra/release-tools: skip reno when release-notes is only getting a list of changes  https://review.openstack.org/42147515:53
clarkbthat won't affect your normal tempest jobs15:53
*** burgerk has quit IRC15:53
openstackgerritJordan Pittier proposed openstack-infra/project-config: Add some functional tests to OSPurge  https://review.openstack.org/42471215:53
clarkbtdurakov: grenade only operates on N-1 to N or N to N+115:53
clarkbso if it is enabled in grenade when live migration is enabled then you only hit that case15:54
clarkband devstack-gate does not need to care or know about it15:54
*** dprince has joined #openstack-infra15:55
openstackgerritMerged openstack-infra/release-tools: do not use title to show when a repo is being cloned  https://review.openstack.org/42429915:57
openstackgerritMerged openstack-infra/release-tools: do not create the venv virtualenv when it already exists  https://review.openstack.org/42430015:57
*** amotoki has joined #openstack-infra15:57
* swatson is back (gone 113:11:26)15:58
fungiwhatever was eating our bandwidth on static.o.o seems to have stopped according to cacti. most of the volume was from ~13:55-15:25 utc15:58
*** mdrabe has quit IRC15:58
jeblairswatson: would you mind please disabling your automatic away/return messages?  thanks!15:58
fungiswatson: please disable the feature in your client which echoes your away and unaway messages15:58
swatsonjeblair fungi Whoops! Will do15:59
tdurakovclarkb: so if I understood this properly, you propose to patch grenade instead, so it updates tempest.conf and enables back_and_forth flag unconditionally, right?16:00
*** jlwhite has joined #openstack-infra16:00
AJaegertdurakov: I'm not reviewing devstack-gate16:00
*** tosky has quit IRC16:00
tdurakovAJaeger: oh, I didn't know that16:00
clarkbtdurakov: not unconditionally, only if live migration is enabled16:00
clarkbtdurakov: but yes16:01
*** xarses has joined #openstack-infra16:01
tdurakovclarkb: it's managed by the other flag, which is set in job defenitions, afair, so tests won't run until both been enabled16:01
clarkbyes but don't set it in grenade unless the other is set16:02
clarkbfor cleanliness16:02
*** aojea has quit IRC16:02
*** cody-somerville has joined #openstack-infra16:03
*** cody-somerville has joined #openstack-infra16:03
tdurakovok, thanks, need to check grenade code for the proper place(since haven't work a lot with grenade), thank you for clarification!16:03
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TESTING: Set keystone admin api on the internal_api network  https://review.openstack.org/42471816:04
*** anilvenkata has quit IRC16:04
*** nadya has quit IRC16:05
*** dmellado has quit IRC16:07
*** geguileo has quit IRC16:07
*** rbuzatu has joined #openstack-infra16:07
*** EricGonczer_ has joined #openstack-infra16:07
*** sree has quit IRC16:07
*** mat128|afk is now known as mat12816:09
*** umeshksingla has joined #openstack-infra16:09
*** abregman|afk has quit IRC16:09
*** wolverineav has joined #openstack-infra16:10
*** rbuzatu has quit IRC16:11
*** aojea has joined #openstack-infra16:16
*** pcaruana has quit IRC16:16
*** ijw has joined #openstack-infra16:18
*** EricGonczer_ has quit IRC16:19
*** EricGonczer_ has joined #openstack-infra16:20
*** ociuhandu has joined #openstack-infra16:21
*** cody-somerville has quit IRC16:22
*** ijw has quit IRC16:23
*** xarses_ has joined #openstack-infra16:24
*** vincentfrancoise has joined #openstack-infra16:25
*** hurgleburgler has quit IRC16:26
*** spligak has quit IRC16:26
*** marst_ has joined #openstack-infra16:26
*** marst has quit IRC16:26
*** xarses has quit IRC16:27
acabotAJaeger : Hi, it seems that we have a lot of gate issues happening since this morning  on Watcher project https://review.openstack.org/#/q/project:openstack/watcher16:27
acabotany guess about this problem ?16:28
acabotthe common error seems to be http://logs.openstack.org/87/424187/4/check/gate-watcher-python35/058a920/console.html#_2017-01-24_14_50_10_15723916:28
*** baoli has quit IRC16:29
*** yujunz-zte has quit IRC16:29
acabotI'm concerned because we will release o3 soon and we can't merge code16:29
*** annegentle has joined #openstack-infra16:29
*** panda is now known as panda|bbl16:30
openstackgerritGábor Antal proposed openstack-infra/gerritbot: Reduced code duplication  https://review.openstack.org/27916916:30
*** mdrabe has joined #openstack-infra16:30
*** spligak has joined #openstack-infra16:31
*** inc0 has joined #openstack-infra16:33
clarkbpabelanger: fungi is ^ that isssue that was affecting grenade and python packaging?16:33
clarkbI haven't completel caught up on that16:33
*** thethorongil has joined #openstack-infra16:34
clarkbacabot: I would start by trying to reproduce locally. Run tox -re py35 and see what happens16:34
clarkbacabot: then debug from there16:34
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Add Ironic support to major upgrade CI  https://review.openstack.org/42428716:34
*** cody-somerville has joined #openstack-infra16:34
*** hamzy has quit IRC16:35
pabelangerclarkb: no, that is different. But six is now a requirement of setuptools16:35
pabelangerlooking more16:35
acabotclarkb : same issue locally but it seems to be unpredictable16:35
acabotpabelanger : thx16:35
*** nadya has joined #openstack-infra16:35
clarkbacabot: what do you mean by unpredictable?16:35
fungiclarkb: the issue with packaging affected stable branch devstack/grenade and master grenade but not master devstack16:35
clarkbdoes it not happen 100% of the time locally?16:35
*** Julien-zte has quit IRC16:35
vincentfrancoiseclarkb: I have the problem once every 3-4 attempts16:36
openstackgerritMerged openstack/diskimage-builder: Bump fedora release to 25  https://review.openstack.org/41955916:36
acabotclarkb : it doesn't happen 100% pf time locally16:36
vincentfrancoisethat's really odd16:36
clarkbacabot: even if using tox -r ?16:36
fungiclarkb: short summary is that a new setuptools was released yesterday with an install_requires on packaging>= a later version than we had in constraints for stable branches. fix was to bump the constraint on packaging in stable/mitaka and then stable/newton16:36
clarkbfungi: gotcha, thanks16:37
openstackgerritOksana Voshchana proposed openstack-infra/devstack-gate: TEST for multinode grenade devstack  https://review.openstack.org/39667916:37
*** voldz1tic3n has quit IRC16:37
*** trown is now known as trown|lunch16:37
vincentfrancoiseclarkb: yes that was using the -r option16:37
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add debugging information for bmc issues  https://review.openstack.org/42140916:38
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Pass job identifier to testenv-worker  https://review.openstack.org/42473616:38
fungiclarkb: pabelanger: yep, i wouldn't be surprised if this is still related to new setuptools somehow16:39
fungidevstack unconditionally upgrades setuptools which is why we saw it crop up there immediately yesterday. we may now have images coming online in some providers with newer setuptools as well?16:40
*** ociuhandu has quit IRC16:40
pabelangerya, six is getting uninstalled, but 1.10.0 is already installed16:40
acabotclarkb : yes even using -r16:40
pabelangersetuptools-34.0.116:40
pabelangerlooks like a dot release16:40
pabelangerchecking16:40
pabelangerand v34.0.2 was release 1 hour ago16:41
pabelangerlooking at logs16:41
fungiodd that pip has been asked to install six 1.10.0 but then complains that it found an existing 1.10.0 and tries to uninstall that rather than just considering it satisfied16:41
*** dizquierdo has quit IRC16:42
bhunter71a question: is there [still] an effective way to disable all automatic/scheduled building of images by nodepool, and instead just invoke dib/image-builds manually?16:42
fungi"As discovered in #940, not all versions of pip will successfully install Setuptools from its pre-built wheel. If you encounter issues with "No module named six" or "No module named packaging", especially following a line "Running setup.py egg_info for package setuptools", then your pip is not new enough." (from the setuptools v34.0.0 changelog entry)16:43
*** voldz1tic3n has joined #openstack-infra16:43
pabelangerYa, reading that now16:43
fungithough this doesn't look like that16:43
*** voldz1tic3n has quit IRC16:43
clarkbfungi: then it fails rolling back the uninstallation16:43
fungii wonder if this is a python 3 specific issue16:45
vincentfrancoisefungi: I have the problem with py27 locally16:45
fungiokay, so both 2 and 3 after all i guess16:45
*** andreas_s has quit IRC16:46
vincentfrancoisefungi: yeah I tried it with both py27 and py35 and they both failed many times16:46
pabelangerwhat version of pip are you using?16:46
clarkbdoes watcher list six as an install requires?16:46
clarkbI wonder if it is some weird interaction between setuptools needing it and the package itself needing it16:47
clarkbtox bundles pip so you have to do .tox/$venv/bin/pip --version to see what eversion is used16:47
vincentfrancoiseI started off with pip 7.1.X and I then upgraded to a 9.X version16:47
pabelangerhttp://www.xavierdupre.fr/app/pymyinstall/helpsphinx/i_faq.html#index-faqref-0-0 seems to imply a pip versionion issue for that error16:47
pabelangerbut cannot confirm16:47
vincentfrancoiseand it failed with both16:48
*** dmellado has joined #openstack-infra16:48
clarkbvincentfrancoise: how did you upgrade it? tox/virtualenv bundle the version of pip16:48
pabelangerdid you recreate the virtualenv after pip was upgraded?16:48
*** dmsimard is now known as dmsimard|off16:48
vincentfrancoiseclarkb: oh let me check the bundled version16:49
zigoDoes any of you have access to a x86_64 cloud with known support for UEFI ?16:49
zigoI need to test an image, but I don't have such deployment available.16:49
vincentfrancoiseclarkb: pip 9.0.116:49
vincentfrancoiseand yes I run tox -e $venv --recreate every time to check16:50
*** kzaitsev_mb has joined #openstack-infra16:50
clarkbvincentfrancoise: that will use the version of pip bundled by virtualenv I think as long as the command above I pasted shows 9.0.1 then I think that is the version used16:50
fungizigo: i don't know whether uefi support is available from any of our donated providers, but maybe someone else here knows16:50
clarkbfungi: zigo I would ask cloudnull16:51
fungiahh, good point. osic probably has something at least privately available to them if not generally available16:51
zigocloudnull: ?16:51
cloudnullo/16:51
* cloudnull reading16:51
cloudnullsadly we dont have a UEFI env. all of our hosts are still running a legacy bios.16:53
zigocloudnull: I need to test an image that uses UEFI.16:53
erlonclarkb: fungi: guys can you give another +W in this patch? I think it was blocked by dependencies, but now they are merged: https://review.openstack.org/#/c/381737/16:53
zigoI wonder what makes OpenStack support UEFI... :/16:53
*** dmellado has quit IRC16:53
cloudnullzigo: do you have an idea of what would be needed to support such an image?16:53
cloudnullis that something within the image itself?16:53
zigocloudnull: Maybe just a recent OpenStack?16:54
zigocloudnull: I think so.16:54
cloudnullwe're running mitaka16:54
cloudnulland last I recall VMs use the seabios16:54
zigoSomeone already tried for me with Mitaka, though I'm not sure if Mitaka has support for UEFI.16:54
cloudnullhum...16:54
*** e0ne has quit IRC16:54
* cloudnull looking16:54
*** jkilpatr has quit IRC16:54
zigoThat's indeed, something in the VM *also*.16:54
zigoie, you'd be using grub-efi-amd64 instead of grub-pc.16:55
zigoWhich is what my patch for the openstack-debian-images script did.16:55
zigoIt did work for arm64, now I'd like to test it with amd64 too...16:55
*** rajinir has joined #openstack-infra16:55
*** sdague has joined #openstack-infra16:55
cloudnullzigo: https://specs.openstack.org/openstack/nova-specs/specs/mitaka/implemented/boot-from-uefi.html16:55
zigohttp://sid.gplhost.com/image/debian-stretch-201701241502-amd64.qcow2 <--- Here's the image. You'd have to upload it with: --property hw_firmware_type=uefi16:56
cloudnullI'd be happy to add that image16:56
cloudnullone sec16:56
zigoOh, so Mitaka wouldn't work...16:56
cloudnullit looks like it was completed in mitaka-216:57
zigoHum, not sure, when reading this page.16:57
zigoAh, cool ! :)16:57
zigoGood info.16:57
cloudnullhttps://review.openstack.org/#/c/262931/16:57
clarkbvincentfrancoise: acabot setuptools is also bundled by virtualenv, you might try using the previous release of virtualenv which should have the previous release of setuptools to see if that exhibits the issue or not16:57
*** lucasagomes is now known as lucas-afk16:58
fungiwell, teh latest virtualenv still bundles a pretty old setuptools16:58
clarkbthat version of six is over a year old so I don't think six is at fault16:58
clarkbfungi: oh I thought they did snychronized releases to avoid that, guess not16:58
fungipip/virtualenv releases are generally synchronous16:58
fungianyway, i'm able to reproduce here with latest pip/virtualenv/tox so playing with libs now to figure it out16:59
*** annegentle has quit IRC16:59
*** dmellado has joined #openstack-infra16:59
*** mrtenio has joined #openstack-infra17:00
*** tqtran has joined #openstack-infra17:00
vincentfrancoiseclarkb: fungi do you want me to try running it with an older virtualenv?17:00
*** hashar is now known as hasharAway17:01
fungisure, can't hurt to get another data point at least17:01
*** annegentle has joined #openstack-infra17:01
clarkbfungi: --force-reinstall is in watcher's pip invocation17:01
*** claudiub has joined #openstack-infra17:02
clarkbthat explains why six is being uninstalled I think17:02
clarkbvincentfrancoise: any idea why --force-reinstall is used?17:02
*** martinkopec has quit IRC17:02
vincentfrancoiseclarkb: hum, no17:02
clarkbvincentfrancoise: can you test if removing that flag makes things work for you?17:02
pabelangerAh, good find17:03
vincentfrancoiseclarkb: ok let me try17:03
fungihah, i completely missed that when skimming their tox.ini. removing seems to solve it for me (at least for py27, haven't tried others)17:04
vincentfrancoiseclarkb: it'll take some time because the problem doesn't occur everytime17:04
*** umeshksingla has quit IRC17:04
*** claudiub|2 has quit IRC17:04
*** geguileo has joined #openstack-infra17:05
fungivincentfrancoise: running locally it doesn't happen every time?17:05
vincentfrancoisebut what's odd is that this flag was hanging there for quite some time already17:05
clarkbits possible that this is just some buggy code path in setuptools that watcher trips over due to the use of that flag that others don't hit17:05
*** dtantsur is now known as dtantsur|afk17:05
clarkbvincentfrancoise: yes likely its a recent regression in setuptools, but it explains why every other project isn't also complaining17:05
vincentfrancoisefungi: no, as I said earlier it only happens once every 3-4 attempts...17:06
fungivincentfrancoise: interesting. i thought you just meant within our ci system17:06
vincentfrancoisefungi: ah my bad17:06
fungii'm able to reproduce the problem 100% of the time locally, and removing --force-reinstall seems to fix it for 100% of the times i've retried17:07
vincentfrancoisefungi: good!17:07
fungivincentfrancoise: oh! i just got it to not hit that issue even with --force-reinstall17:07
vincentfrancoisefungi: 4th attempt and still no issue so looks good now17:07
fungii bet the behavior varies by the PYTHON_HASHSEED value17:07
* clarkb attempts to reduce reproduction case to pip install six && pip install six --reinstall17:08
*** tphummel has joined #openstack-infra17:08
fungiso pinning PYTHON_HASHSEED to one from a broken run should make it possible to reproduce with more consistency17:08
*** rbuzatu has joined #openstack-infra17:08
*** jkilpatr has joined #openstack-infra17:09
*** markmcclain has quit IRC17:09
clarkbhuh using --force-reinstall locally says its already satisfied17:09
clarkbah have to combine with -U17:10
vincentfrancoisefungi: clarkb still good after 6 runs, so at least removing this flag reduces the risk17:10
*** markmcclain has joined #openstack-infra17:11
cloudnullzigo: I gave it a go and sadly it's not very happy. conductor reports - File "/openstack/venvs/nova-13.3.5/lib/python2.7/site-packages/nova/conductor/manager.py", line 388, in build_instances filter_properties, instances[0].uuid) File "/openstack/venvs/nova-13.3.5/lib/python2.7/site-packages/nova/scheduler/utils.py", line 186, in populate_retry raise exception.MaxRetriesExceeded(reason=msg)17:11
fungialso worth noting, as suspected, we don't suggest --force-reinstall at http://git.openstack.org/cgit/openstack-dev/cookiecutter/tree/%7b%7bcookiecutter.repo_name%7d%7d/tox.ini#n817:11
cloudnull:'(17:11
*** dave-mccowan has quit IRC17:11
vincentfrancoisefungi: ah yeah I copied the line over from cookiecutter so it also removed the -U flag17:12
swatsonHey channel, I'm looking to add a tox environment to magnum for running migration tests. Would the best way to get this to run on gate be to create a builder in jenkins/jobs/macros.yaml and reference it in the openstack/magnum project in zuul/layout.yaml?17:12
pabelangercodesearch.o.o shows a few projects doing --force-reinstall too17:12
*** bkorren has quit IRC17:13
clarkbI haven't been able to reproduce with pip install -U --force-reinstall six==1.10.0 fwiw17:13
clarkbhave tried the python hashseed from the failing run too. Though if it is a dict ordering problem may need to isntall other packages too17:13
fungiclarkb: yeah, i have a feeling this one will be elusive to pare down to a consistent minimal reproducer17:14
cloudnullzigo: from the image http://cdn.pasteraw.com/dfmsh1dg7zty8r5jq2y2utohhh6z75f17:14
cloudnullbut maybe i'm doing it wrong17:14
vincentfrancoisefungi: clarkb in the meantime, I've pushed a fix to remove -U --force-reinstall from Watcher's tox.ini17:15
openstackgerritwes hayutin proposed openstack-infra/project-config: use the tripleo oooq containers job to gate t-h-t/docker/*  https://review.openstack.org/42351917:15
clarkbvincentfrancoise: ok, let us know how that goes I guess, as a workaround taht is probably worthwhile for now17:15
vincentfrancoiseclarkb: fungi I'll be leaving the office soon, so here is the PS just in case https://review.openstack.org/42475317:16
clarkbswatson: you shouldn't need a new macro, there is already a generic run this tox target macro that you can likely use17:17
clarkbswatson: I think it is called run-tox?17:17
swatsonclarkb: I'll take a look17:17
vincentfrancoiseclarkb: fungi I'll come back to you tomorrow to let you know how it went17:17
zigocloudnull: There's an issue in your cloud, because the image should at least get in RUNNING state.17:18
zigoNot booting, probably, but at least run...17:18
*** yolanda has quit IRC17:19
swatsonclarkb: Ah, found it. run-tox is it! But looking at the openstack/magnum project in layout.yaml I'm wondering how I would invoke run-tox for the environment of my choice.17:20
swatsonclarkb: We have gate/check/periodic listed under openstack/magnum. If I wanted this new environment to be run would I just add run-tox under gate, for instance, and add envlist as a variable entry under gate as well?17:21
clarkbswatson: layout.yaml is a zuul construct and almost complete unrelated. The only interaction between the two is zuul is triggering jobs defined in JJB17:21
clarkbswatson: layout.yaml says what to run and when to run it. JJB is the actual step by step execution instructions of the jobs. The two can be used together or separately17:22
*** yolanda has joined #openstack-infra17:22
*** kgiusti has quit IRC17:22
cloudnullzigo: i have another debian image which is working fine17:22
cloudnullbut this one is not happy17:22
cloudnullah, its the metadata17:24
openstackgerritwes hayutin proposed openstack-infra/project-config: use the tripleo oooq containers job to gate t-h-t/docker/*  https://review.openstack.org/42351917:24
cloudnullw/ hw_firmware_type=uefi it fails17:24
cloudnullw/out it the image boots fine17:24
*** EricGonczer_ has quit IRC17:25
clarkbfungi: vincentfrancoise acabot re reproduction we might just have to file a bug with setuptools with a requirements.txt and constraints file and the command to run and let them track it down?17:25
vincentfrancoiseclarkb: fungi: multinode job still pending but all the unit test jobs are passing so looks like everything's okay now17:25
openstackgerritJordan Pittier proposed openstack-infra/project-config: devstack-gate tempest-dsvm-py35 job: don't run c-bak  https://review.openstack.org/42475617:26
openstackgerritwes hayutin proposed openstack-infra/project-config: use the tripleo oooq containers job to gate t-h-t/docker/*  https://review.openstack.org/42351917:26
swatsonclarkb: I guess I'm still a bit confused. My end goal is having tox run this new environment as part of magnum gate. As far as I can tell the only place magnum has those jobs listed is in layout.yaml. I feel like maybe I'm missing a step17:26
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: WIP: Assign node set to node requests  https://review.openstack.org/42350217:27
clarkbswatson: there are two distinct configurations. jenkins/jobs/*.yaml is the jenkins job builder job definitions. These say for a job called foo execute these instructiosn and return a result. zuul/layout.yaml is the zuul config that says if you get a new patch for project bar on branch master then run the job foo. If foo passes then merge the commit17:27
*** florianf has quit IRC17:27
vincentfrancoiseclarkb: ok I'll look out for this tomorrow with acabot17:27
openstackgerritKaitlin Farr proposed openstack-infra/project-config: Upgrade barbican-tempest-plugin gate  https://review.openstack.org/42475717:27
clarkbswatson: some people run zuul without JJB and some people use JJB without zuul. They don't have strong coupling17:28
fungiswatson: i think what you're looking for example-wise is http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/projects.yaml#n115317:28
fungithere cinder is instantiating the gate-{name}-tox-{envlist}-{node} job-template to run an tox env named "compliance"17:29
fungithe resulting job name ends up being gate-cinder-tox-compliance-ubuntu-xenial which is then mentioned in zuul/layout.yaml17:30
*** inc0 has quit IRC17:30
swatsonfungi clarkb: Ah OK. That makes sense17:30
swatsonfungi: Thanks for the example! Very useful17:30
*** rbuzatu has quit IRC17:32
swatsonfungi clarkb: So Jenkins generates jobs via projects.yaml and zuul is picking up those jobs, basically?17:32
clarkbswatson: zuul is requesting the execution of those jobs and checking their results17:32
openstackgerritJulie Pichon proposed openstack-infra/project-config: Set up i18n infra for tripleo-ui/ReactJS  https://review.openstack.org/42476017:32
*** mhickey has quit IRC17:33
swatsonclarkb: OK. I think I got it more or less now. In any case, it looks like I should be updating the magnum project in projects.yaml and letting Jenkins/zuul worry about the rest17:34
*** baoli has joined #openstack-infra17:35
*** vincentfrancoise has quit IRC17:35
swatsonclarkb: Thanks for helping me out! You too fungi17:35
fungiany time17:35
cloudnulli guess my connection dropped.17:36
cloudnullzigo: by boots fine it goes active though seems to hang here https://snag.gy/ZLb5lS.jpg17:36
cloudnullzigo: I think i'd need to get the ovmf package installed on the compute nodes to make it work.17:36
cloudnullI've no access to the hosts right now to test it. but i'll give it a go in a bit.17:36
cloudnullsorry if i've doubled posted.17:36
*** hashar has joined #openstack-infra17:37
*** hashar has quit IRC17:38
*** amotoki has quit IRC17:38
openstackgerritAttila Darazs proposed openstack-infra/tripleo-ci: Improve console readability for quickstart jobs  https://review.openstack.org/42476817:39
cloudnullzigo: thoughts on http://docs.openstack.org/admin-guide/compute-images-instances.html#launch-instances-with-uefi -- specifically "Because default UEFI loader path is /usr/share/OVMF/OVMF_CODE.fd, the administrator must create one link to this location after UEFI package is installed."17:40
cloudnulllink to / from ?17:40
cloudnulllunching, brb17:40
*** adrian_otto has quit IRC17:43
*** kgiusti has joined #openstack-infra17:43
*** derekh has quit IRC17:44
*** claudiub|2 has joined #openstack-infra17:44
*** d34dh0r53 is now known as ID-Ten-T17:45
*** claudiub has quit IRC17:46
*** hieulq_ has quit IRC17:46
clarkbfungi: I put ethercalc up on infra meeting agenda. Hoping to push up system-config change today, then get everything reivewed and maybe do deployment tomororw17:46
*** rossella_ has quit IRC17:47
openstackgerritStephen Watson proposed openstack-infra/project-config: Add magnum job to run tox migration env  https://review.openstack.org/42477317:47
fungiclarkb: sgtm17:47
*** rossella_ has joined #openstack-infra17:47
*** ID-Ten-T is now known as blarnath17:48
*** annegentle has quit IRC17:48
fungiclarkb: unrelated, did you see my comment on the wildfly changes where it looks like you have your depends-on relatiosnhip backwards?17:48
*** ijw has joined #openstack-infra17:48
*** csomerville has joined #openstack-infra17:48
clarkbfungi: I didn't, I had the depends on the other way around before but then that can't pass testing17:48
*** ijw has quit IRC17:48
*** blarnath is now known as d34dh0r5317:48
clarkbfungi: because the systemd hack breaks newer wildfly puppet module17:48
*** ijw has joined #openstack-infra17:49
clarkbfungi: considering the hack was only ever used on the dev server I am ok with rolling forward there17:49
fungiokay, the depends-on and commit messages are still in conflict i guess17:49
clarkbah I can clean that up17:49
fungii didn't -1, was just confused17:49
sshnaidmhi, folks, do you know if I can enable ansi colors in console?17:50
fungisshnaidm: in what console?17:50
*** dave-mccowan has joined #openstack-infra17:50
sshnaidmfungi, in console.html17:50
sshnaidmfungi, I have ansible output there, I wonder if I can colorize it17:51
*** jpich has quit IRC17:51
fungisshnaidm: ansi escapes are for display on terminals, and don't relate to html colors in any way17:51
clarkbright so they dont'17:51
*** cody-somerville has quit IRC17:51
clarkb render in color in html17:51
clarkbthey just show up as noise so we avoid it17:52
*** jordanP has quit IRC17:52
sshnaidmthere is such plugin in jenkins for it, I thought maybe here too17:52
*** Sukhdev has joined #openstack-infra17:52
fungiin html you'd have something like <style "font-color: red"> while in ansi you'd do ^[[31m17:53
sshnaidmfungi, I know, there are tools to convert it17:54
fungisshnaidm: no, we don't have any ansi-to-html translation layer implemented in our web log display system17:54
fungisshnaidm: instead we have a log parser which will colorize different types of messages (warnings, errors, et cetera)17:55
sshnaidmfungi, and this works with jenkins only, right? just found it: https://review.openstack.org/#/c/43121/4/jenkins_jobs/modules/wrappers.py17:55
pabelangerFWIW: console.html isn't actually HTML either. We just named it that way no to break log processing17:55
sshnaidmpabelanger, yeah, it confused me too17:55
sshnaidmpabelanger, but if I print in console html tags, browser will interpret them as html, right?17:56
pabelangernot likely, everything gets parsed via openstack-infra/os-loganalyze17:57
clarkbya os-loganalyze is going to wrap things in pre tags17:58
clarkbalso it will affect log indexing if you add a bunch of color codes17:58
fungibetter to teach osla how to parse your ansible log messages so it can colorize and even filter them as desired17:58
sshnaidmfungi, osla?17:59
fungisshnaidm: openstack-infra/os-loganalyze17:59
openstackgerritMerged openstack-infra/project-config: Adds new experimental Cinder volume migration job  https://review.openstack.org/38173718:00
sshnaidmfungi, thanks, will look18:00
fungisshnaidm: http://git.openstack.org/cgit/openstack-infra/os-loganalyze18:00
*** inc0 has joined #openstack-infra18:00
fungiright now it's mostly geared toward colorizing and filtering and deep-linking into typical openstack service logs18:00
*** matrohon has quit IRC18:00
fungisshnaidm: e.g., http://logs.openstack.org/79/419479/5/gate/gate-grenade-dsvm-neutron-ubuntu-xenial/ed56320/logs/new/screen-n-api.txt.gz18:01
*** bkorren has joined #openstack-infra18:01
*** inc0 has quit IRC18:01
asselin__yolanda, you around? i need some help setting up cgit...not sure why it doesn't just work (tm)18:01
fungisshnaidm: see the colored lines in that log, and the display level links at the top of the page (for filtering)18:02
*** ralonsoh has quit IRC18:02
sshnaidmfungi, yeah, I see18:02
*** krtaylor has quit IRC18:02
fungisshnaidm: you could probably teach it to do something similar with ansible log output18:02
fungii think it's likely just a matter of adding some regexps18:03
*** Apoorva has joined #openstack-infra18:03
*** inc0 has joined #openstack-infra18:04
*** adrian_otto has joined #openstack-infra18:04
*** dinob has joined #openstack-infra18:04
*** dprince has quit IRC18:04
*** ijw has quit IRC18:04
*** amotoki has joined #openstack-infra18:04
*** inc0 has quit IRC18:05
*** hasharAway has quit IRC18:05
sshnaidmfungi, then I'll do it for all ansi-color output, because ansible does it by default, and may be useful for bash too18:05
*** ijw has joined #openstack-infra18:05
*** ijw has quit IRC18:05
*** strigazi is now known as strigazi_AFK18:05
*** ijw has joined #openstack-infra18:05
fungisshnaidm: well, that might be trickier. i was suggesting you add regular expressions that match your logging format, not regular expressions to match asni escape sequences18:06
*** amotoki has quit IRC18:06
fungithe latter will likely still leave a lot of confusing noise in the text18:07
*** thethorongil has quit IRC18:07
*** inc0 has joined #openstack-infra18:08
*** dprince has joined #openstack-infra18:09
*** Swami has joined #openstack-infra18:10
*** trown|lunch is now known as trown18:12
*** dprince has quit IRC18:13
*** pvaneck has joined #openstack-infra18:13
*** rfolco has quit IRC18:14
*** pvaneck_ has joined #openstack-infra18:15
clarkbrelated, if you are using ansible and want more human readable logs ara is probably a good option18:15
clarkbpretty sure devstack-gate is already recording ara stuff for its ansible18:15
clarkband that avoids the hacky ansi color code escape into html etc mess entirely18:16
fungi#status log HTTPS cert and chain for ask.openstack.org has been renewed and replaced.18:16
openstackstatusfungi: finished logging18:16
fungi#status log HTTPS cert and chain for zuul.openstack.org has been renewed and replaced.18:16
openstackstatusfungi: finished logging18:16
*** markus_z has quit IRC18:16
*** mhickey has joined #openstack-infra18:16
*** inc0 has quit IRC18:16
*** aarefiev is now known as aarefiev_afk18:18
*** pvaneck has quit IRC18:18
openstackgerritJames E. Blair proposed openstack-infra/zuul: Add nodepool integration test script  https://review.openstack.org/42228818:19
clarkbsshnaidm: http://logs.openstack.org/52/424252/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/23eb582/logs/ara/ is an example18:19
openstackgerritJames E. Blair proposed openstack-infra/zuul: Move tests into test/unit  https://review.openstack.org/42478718:19
*** dprince has joined #openstack-infra18:20
*** inc0 has joined #openstack-infra18:22
*** sambetts is now known as sambetts|afk18:22
*** jkilpatr_ has joined #openstack-infra18:22
openstackgerritMerged openstack-infra/grafyaml: Removes unnecessary utf-8 encoding  https://review.openstack.org/41835818:23
sshnaidmclarkb, we already have it :) http://logs.openstack.org/38/422638/11/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq-nv/fdb5d43/logs/oooq/ara/18:24
*** jkilpatr has quit IRC18:24
clarkbah cool18:24
*** inc0 has quit IRC18:24
sshnaidmbut people still go to console firstly18:24
*** tphummel has quit IRC18:25
*** tphummel has joined #openstack-infra18:27
*** hamzy has joined #openstack-infra18:27
*** rfolco has joined #openstack-infra18:28
*** mriedem has quit IRC18:29
*** dave-mccowan has quit IRC18:30
*** rossella_ has quit IRC18:31
openstackgerritMerged openstack-infra/tripleo-ci: Delete ports in parallel when tearing down env  https://review.openstack.org/41324618:31
*** arxcruz has joined #openstack-infra18:31
*** sdague has quit IRC18:33
*** electrofelix has quit IRC18:34
cloudnullzigo: sorry bad news. uefi wont work on the OSIC. I checked out the env and we have libvirt "1.2.2" installed everywhere and we'd need "1.2.9". additionaly the ovmf package is in the multiverse which we dont have enabled.18:37
cloudnullso for now, we can't make it go.18:37
*** sdake has quit IRC18:37
cloudnullsorry again.18:37
*** tesseract has quit IRC18:39
clarkbcloudnull: ty for helping though18:39
*** Sukhdev has quit IRC18:43
*** krtaylor has joined #openstack-infra18:44
*** inc0 has joined #openstack-infra18:44
*** sdake has joined #openstack-infra18:45
*** Sukhdev has joined #openstack-infra18:47
*** EricGonczer_ has joined #openstack-infra18:48
*** raildo has joined #openstack-infra18:49
*** tphummel has quit IRC18:49
AJaegerfungi, did you get https for docs.o.o and developer.o.o as well?18:51
*** Goneri has quit IRC18:51
fungiAJaeger: i did, was looking to see if anyone added changes for them in system-config before picking hiera key names at random18:52
AJaegergreat! is there a change I should do?18:53
*** yamahata has joined #openstack-infra18:53
fungiAJaeger: i was going to write one since i didn't find one18:53
AJaegerthanks, fungi18:53
fungineed to noodle a bit about how we're going to do https on files.o.o vhosts18:53
*** sdague has joined #openstack-infra18:55
*** inc0 has quit IRC18:57
*** dave-mccowan has joined #openstack-infra18:57
jheskethMorning18:58
*** ldnunes has joined #openstack-infra18:58
*** xarses_ has quit IRC18:58
*** hashar has joined #openstack-infra18:58
*** vaidy has quit IRC18:58
*** isviridov_away has quit IRC18:59
jeblairfungi: what's the issue?18:59
fungiit's that (weekly infra team meeting) time again! find us in #openstack-meeting for the next hour18:59
jeblairfungi: to sni or not to sni?18:59
*** ianychoi has quit IRC19:00
fungijeblair: no issue, just haven't looked closely at the classfile yet19:00
jeblairah ok19:00
*** inc0 has joined #openstack-infra19:00
*** Sukhdev has quit IRC19:01
zigoclarkb: Thanks for your investigations !19:01
openstackgerritClark Boylan proposed openstack-infra/system-config: Deploy simple ethercalc server  https://review.openstack.org/42480019:02
*** dizquierdo has joined #openstack-infra19:02
*** shardy is now known as shardy_afk19:04
*** kzaitsev_mb has quit IRC19:05
*** bh526r has quit IRC19:06
openstackgerritwes hayutin proposed openstack-infra/project-config: use the tripleo oooq containers job to gate t-h-t/docker/*  https://review.openstack.org/42351919:10
openstackgerritSagi Shnaidman proposed openstack-infra/project-config: Move ovb tripleo jobs to check-tripleo pipline  https://review.openstack.org/42480419:12
sshnaidmtrown, ^^19:12
*** sshnaidm is now known as sshnaidm|afk19:12
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add newton branch to delorean-build branches  https://review.openstack.org/39743919:13
*** inc0 has quit IRC19:14
*** MasterOfBugs has joined #openstack-infra19:14
*** sdague has quit IRC19:18
openstackgerritJan Kundrát proposed openstack-infra/zuul: Fix passing labels to Gerrit when they are not defined in All-Projects  https://review.openstack.org/42480619:19
openstackgerritDan Smith proposed openstack-infra/devstack-gate: Run discover_hosts to register subnodes in a multinode setup  https://review.openstack.org/42425219:19
*** inc0 has joined #openstack-infra19:20
*** nadya has quit IRC19:21
*** eharney has quit IRC19:22
*** dizquierdo has quit IRC19:23
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Manage providers in ProviderWorker threads  https://review.openstack.org/42480819:24
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT  https://review.openstack.org/42419019:25
*** rbuzatu has joined #openstack-infra19:28
*** ijw has quit IRC19:28
openstackgerritStephen Watson proposed openstack-infra/project-config: Add magnum job to run tox migration env  https://review.openstack.org/42477319:28
openstackgerritMerged openstack-infra/project-config: Move ovb tripleo jobs to check-tripleo pipline  https://review.openstack.org/42480419:30
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: JJB: Replace single item lists  https://review.openstack.org/42481319:31
*** sdague has joined #openstack-infra19:31
*** rbuzatu has quit IRC19:33
*** tnovacik has quit IRC19:33
*** tnovacik has joined #openstack-infra19:33
AJaegerswatson: you misunderstood fungi and clarkb. You really need to add the job to zuul/layout.yaml. Consider jenkins a library of jobs - and in zuul/layout you call the functions from the library (trigger when they should run).19:34
*** asselin has joined #openstack-infra19:35
*** asselin_ has joined #openstack-infra19:36
*** sdague has quit IRC19:36
*** asselin__ has quit IRC19:37
swatsonAJaeger: OK. So I define the job in projects.yaml, but I stick a reference to it (i.e. "gate-magnum-tox-migration-{node}") under the "gate" section in the openstack/magnum project in layout?19:37
AJaegerswatson: correct. check previous changes and follow that example19:37
*** eharney has joined #openstack-infra19:37
AJaegeryour job is named gate-magnum-tox-migration-ubuntu-xenial so that's te name to use - and add it to *both* check and gate queues19:38
*** tphummel has joined #openstack-infra19:38
swatsonAJaeger: OK, now I understand a bit more :)19:39
openstackgerritwes hayutin proposed openstack-infra/project-config: use the tripleo oooq containers job to gate t-h-t/docker/*  https://review.openstack.org/42351919:39
*** asselin has quit IRC19:39
*** john-davidge has quit IRC19:40
*** john-davidge has joined #openstack-infra19:41
*** inc0 has quit IRC19:41
openstackgerritStephen Watson proposed openstack-infra/project-config: Add magnum job to run tox migration env  https://review.openstack.org/42477319:41
*** harlowja has joined #openstack-infra19:41
*** dalvarez has quit IRC19:43
*** dtardivel has quit IRC19:44
AJaegerswatson: so this is fine - have you tested that this works? This is a voting job...19:44
*** inc0 has joined #openstack-infra19:45
swatsonAJaeger: Admittedly, no, and you also reminded me that I meant to make it non-voting. That's just a "voting: false" to add under the job, right?19:45
AJaegerswatson: no much further above - see where it's done for the other jobs19:47
AJaegerand then only add it to check queue - we don't have non-voting jobs in gate19:47
swatsonAJaeger: Will do19:47
swatsonAJaeger: What would be the best way to test without a jenkins/zuul setup? Is running tox on those respective environments going to be a good confirmation?19:49
*** Sukhdev has joined #openstack-infra19:49
*** ijw has joined #openstack-infra19:49
AJaegerswatson: yes, run "tox -e migration" locally19:50
*** umeshksingla has joined #openstack-infra19:50
*** dalvarez has joined #openstack-infra19:50
swatsonAJaeger: Oh, my magnum environment is confirmed to work locally. I thought you meant testing that the jenkins/zuul job was created correctly19:51
AJaegerswatson: no, that al looks fine. I just want to avoid that you set up jobs and then cannot merge anything...19:52
AJaegerif you're confident it works, leave it voting.19:52
*** sdake has quit IRC19:52
swatsonAJaeger: I'll switch it to non-voting for now, just to make sure we have a few successful runs via Jenkins19:53
AJaegerok19:53
*** ijw has quit IRC19:54
*** inc0 has quit IRC19:56
*** sdake has joined #openstack-infra19:57
openstackgerritStephen Watson proposed openstack-infra/project-config: Add magnum job to run tox migration env  https://review.openstack.org/42477319:58
*** flaper87 has joined #openstack-infra19:59
openstackgerritDoug Hellmann proposed openstack-infra/git-review: support review URLs as download arguments  https://review.openstack.org/42482319:59
persiafungi: I can chair next week, if all that is needed is start, topics, and chivving.  Nearly anyone else probably has more access and familiarity.19:59
*** rfolco has quit IRC20:00
*** mrtenio has quit IRC20:01
*** tphummel has quit IRC20:02
fungipersia: ianw has offered to be fallback chair in the event that nobody who has previously chaired an infra meeting steps forward, so you're off the hook, but thanks for the offer!20:02
*** umeshksingla has quit IRC20:02
persiaAh, good :)20:02
*** armax_ is now known as armax20:03
*** umeshksingla has joined #openstack-infra20:05
AJaegerclarkb, fungi, I remember we had in the past problems with lists with single items - but apparently we have some usage where it works. Still, cleaned that one up https://review.openstack.org/#/c/424813/ - do you remember what the real problem is?20:05
*** umeshksingla has quit IRC20:06
fungiAJaeger: depends on whether you want yaml lists or not20:07
fungiin some cases envlist can be used to pass a comma-separated "list" of envs to tox so they're invoked together20:07
fungiin other cases envlist may be used to generate multiple jobs with different tox envs20:07
openstackgerritStephen Watson proposed openstack-infra/project-config: Add magnum job to run tox migration env  https://review.openstack.org/42477320:11
AJaegerfungi, could you have a look at the patch and tell me whether it makes a difference - or whether there's a different pattern to look for, please?20:11
fungiAJaeger: i'm not entirely clear on what the conditions of the single-element list issue is with jjb parameters20:12
fungithe xml diff ought to be able to indicate whether it makes a difference, right?20:12
*** adrian_otto has quit IRC20:12
AJaegerfungi, recently we merged https://review.openstack.org/#/c/409028/1/jenkins/jobs/projects.yaml  which unblocked nova and neutron gates at that day - I'm currently not understanding why 409028 was need and but it works apparently without 42481320:12
fungior was the issue having to do with the way zuul-launcher is leveraging jjb?20:12
AJaegerwe don't have the xml diff anymore ;(20:13
*** Goneri has joined #openstack-infra20:13
* AJaeger will run some local xml diff now for these two changes20:13
openstackgerritIan Wienand proposed openstack-infra/system-config: Add bindep virtualenv to wheel-build slaves  https://review.openstack.org/42390420:14
*** askb has joined #openstack-infra20:15
*** ldnunes has quit IRC20:16
*** umeshksingla has joined #openstack-infra20:16
*** xarses_ has joined #openstack-infra20:16
*** andreww has joined #openstack-infra20:17
jeblairAJaeger: it may have something to do with jjb's matrix list expansion... possibly one of those lists caused a matrix expansion (run this template each time with each of these values -- so it worked) whereas another was a simple value substitution (so it substituted the list and failed)20:17
*** adrian_otto has joined #openstack-infra20:17
*** andreww has quit IRC20:17
*** andreww has joined #openstack-infra20:17
*** noama has quit IRC20:17
*** andreww is now known as xarses20:18
*** lennyb has quit IRC20:18
*** yuanying-alt has quit IRC20:19
AJaegerjeblair: interesting - let me check the diffs with that in mind20:19
*** sdague has joined #openstack-infra20:20
*** xarses_ has quit IRC20:20
*** adrian_otto has quit IRC20:24
*** sdake_ has joined #openstack-infra20:24
*** mhickey has quit IRC20:25
*** sdague has quit IRC20:26
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Replace ironic-multitest job by ironic-standalone  https://review.openstack.org/42331320:26
*** panda|bbl is now known as panda20:26
*** sdake has quit IRC20:28
*** rbuzatu has joined #openstack-infra20:30
swatsonAJaeger: Thanks for the +2 and all the help :)20:30
*** yuanying-alt has joined #openstack-infra20:30
AJaegerswatson: you're welcome20:31
*** aojea has quit IRC20:31
*** rbuzatu has quit IRC20:34
*** Guest41520 has quit IRC20:35
AJaegerso, compared the runs for both changes - the older one changed <assignedNode>['ubuntu-trusty-2-node']</assignedNode> to remove the []. My current change is a nop.20:35
AJaegerStill, I guess it's safer to do it, isn't it? fungi, jeblair, any comments on whether https://review.openstack.org/#/c/424813/ is beneficial or not?20:36
*** xyang1 has joined #openstack-infra20:36
*** sdague has joined #openstack-infra20:40
*** oanson has quit IRC20:41
*** oanson has joined #openstack-infra20:42
*** e0ne has joined #openstack-infra20:42
*** kzaitsev_mb has joined #openstack-infra20:42
*** aojea has joined #openstack-infra20:44
*** john-davidge has quit IRC20:45
*** john-davidge has joined #openstack-infra20:45
*** sdake_ is now known as sdake20:46
clarkbianw: I just appproved parallel mirror builds, I did not check if parallel is installed on all the mirror slaves though (just somethign to watch out for should things not work)20:47
*** thiagolib has quit IRC20:48
*** john-davidge has quit IRC20:50
*** Hal has joined #openstack-infra20:51
*** Hal is now known as Guest8889220:52
openstackgerritClark Boylan proposed openstack-infra/puppet-zanata: Remove now unneeded systemd sysv compat hack  https://review.openstack.org/42336920:55
clarkbfungi: ^ updated commit message to be more claer20:55
pabelangerfungi: ianw: I'm happy to try my hand too (chair) if ever needed20:55
clarkbianw: ^ maybe we can push on that more now too?20:55
pabelangernot sure if that got through last time20:55
openstackgerritAleksey Zvyagintsev proposed openstack-infra/project-config: RefStack: add coverage job  https://review.openstack.org/41028320:56
*** tphummel has joined #openstack-infra20:58
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Manage providers in ProviderWorker threads  https://review.openstack.org/42480821:01
*** dfflanders has joined #openstack-infra21:03
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Manage providers in ProviderWorker threads  https://review.openstack.org/42480821:03
fungiclarkb: i'm +2 on both those wildfly patches with your latest edit, but didn't approve in case you wanted to be on hand to monitor translate.o.o21:03
pabelangerfungi: clarkb: ianw: one thing i didn't see about https://review.openstack.org/#/c/423904 (bindep on wheel) is jobs will now require sudo access. This means we are exposing our afs keytab potentially21:04
pabelangerjust wanted to make sure everybody was away of that21:04
clarkbfungi: ya thats the fear :) not sure I want to be on hand for that either ;)21:05
*** raildo has quit IRC21:05
clarkbianw: fungi we should probably talk risk with the translators to see what they are comfortable with now that we are in frozen times21:05
fungipabelanger: we can still revoke sudo after we run bindep, before doing other stuff, right?21:05
fungithat's how we do it in most jobs21:05
pabelangerfungi: yup, just pointing it out. Might be the first time we are giving sudo to a static server21:06
pabelangerno objection to trying either21:07
pabelangeractually21:07
pabelangerwe could vos release on another server21:07
*** yamamoto has joined #openstack-infra21:08
fungipabelanger: OH! in fact, you're right. the revoke-sudo builder on those jobs is a no-op21:08
pabelangeractually, I think we are safe21:08
fungiwe'd actually need something to undo it between job runs21:08
pabelangerwe do vos release on another server today21:08
pabelangeras long as we don't bindep when we vos release, we are sage21:09
pabelangersafe*21:09
*** gordc has quit IRC21:09
*** ijw has joined #openstack-infra21:10
*** dave-mccowan has quit IRC21:10
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Pass job identifier to testenv-worker  https://review.openstack.org/42473621:10
*** adrian_otto has joined #openstack-infra21:11
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Pass job identifier to testenv-worker  https://review.openstack.org/42473621:11
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add debugging information for bmc issues  https://review.openstack.org/42140921:11
*** mriedem has joined #openstack-infra21:11
*** yamamoto has quit IRC21:12
*** tphummel has quit IRC21:14
*** trown is now known as trown|brb21:14
*** sdague has quit IRC21:14
*** bkorren has quit IRC21:14
*** dimtruck is now known as zz_dimtruck21:15
ianwclarkb: it depends on a system-config change to add parallel21:16
*** pradk has quit IRC21:16
clarkbianw: oh I clearly missed that, will check on thatn ow21:16
ianwhttps://review.openstack.org/#/c/424430/21:16
clarkbfungi: pabelanger ^ si a simple change that will get a larger change moving through21:18
*** rbuzatu has joined #openstack-infra21:21
*** pradk has joined #openstack-infra21:23
*** rbuzatu has quit IRC21:25
*** shardy_afk is now known as shardy21:27
*** trown|brb is now known as trown21:31
*** jkilpatr_ has quit IRC21:31
*** jcoufal has quit IRC21:31
*** Jeffrey4l_ has joined #openstack-infra21:34
*** Jeffrey4l has quit IRC21:35
*** zz_dimtruck is now known as dimtruck21:37
clarkblooking at gerritbot git log I think the proper version to use for next version is 0.3.0. We added features like mqtt as well as fixing bugs21:37
openstackgerritJames E. Blair proposed openstack-infra/zuul: Add nodepool integration test  https://review.openstack.org/42485921:39
fungiclarkb: sounds fine to me. it's also pre-1.x so semver doesn't entirely apply (maybe we should make it 1.0.0 soon?)21:40
*** umeshksingla has quit IRC21:41
fungior maybe we should leave it 0.x until the errbot rewrite21:41
clarkbya thats true (but good to be in the habit of using proper versions imo)21:41
clarkbI think leaving as 0.x is good considering the idea of a rewrite21:41
fungiright, i'm hesitant to imply that it's a strongly supported codebase if we're planning to replace it entirely21:41
*** e0ne has quit IRC21:45
openstackgerritJames E. Blair proposed openstack-infra/project-config: Update gate-zuul-nodepool  https://review.openstack.org/42486021:45
*** john-davidge has joined #openstack-infra21:46
openstackgerritJames E. Blair proposed openstack-infra/zuul: Rename nodepool integration script  https://review.openstack.org/42486321:46
openstackgerritMerged openstack-infra/system-config: Add "parallel" for wheel build slaves  https://review.openstack.org/42443021:47
*** john-davidge has quit IRC21:51
openstackgerritJames E. Blair proposed openstack-infra/zuul: Rename nodepool integration script  https://review.openstack.org/42486321:51
*** thorst_ has quit IRC21:55
*** rbuzatu has joined #openstack-infra22:02
*** amotoki has joined #openstack-infra22:02
openstackgerritSolio Sarabia proposed openstack-infra/devstack-gate: WIP/DNR: Test new repo ironic-tempest-plugin  https://review.openstack.org/42487022:03
*** priteau has quit IRC22:04
*** erikmwil_ has quit IRC22:04
*** erikmwil_ has joined #openstack-infra22:04
zaroclarkb: what do you guys use for load balance cgit servers?22:04
clarkbzaro: a large haproxy instance (but really it doesn't need a lot of resources itself other than bandwidth)22:05
zaroclarkb: is that in puppet somewhere?22:05
clarkbzaro: rackspace scales bandwidth with the size of the instance so we have a larger instance but if you have lots of bandwidth you can use smaller one easily22:05
clarkbzaro: it is, let me get a link22:05
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT  https://review.openstack.org/42419022:06
clarkbzaro: https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/git.pp uses the upstream puppet haproxy module22:06
*** rbuzatu has quit IRC22:06
*** panda has quit IRC22:07
*** baoli has quit IRC22:08
*** jkilpatr_ has joined #openstack-infra22:09
*** aojea has quit IRC22:12
*** panda has joined #openstack-infra22:14
*** rhallisey has quit IRC22:15
*** yamamoto has joined #openstack-infra22:17
*** inc0 has joined #openstack-infra22:18
*** eharney has quit IRC22:18
*** baoli has joined #openstack-infra22:19
*** ihrachys has quit IRC22:20
*** erikmwil_ has quit IRC22:20
*** matt-borland has quit IRC22:20
*** erikmwil_ has joined #openstack-infra22:22
*** tphummel has joined #openstack-infra22:22
*** fguillot has quit IRC22:23
*** rbuzatu has joined #openstack-infra22:23
*** aojea has joined #openstack-infra22:24
*** wfoster has quit IRC22:24
*** baoli has quit IRC22:24
ianwi can just "zuul enqueue" for the periodic pipeline, right?  are there special considerations?22:24
*** tnovacik has quit IRC22:25
ianwfor testing periodic job22:25
clarkbianw: zuul enqueue will enqueue all of the periodic jobs for a project sometimes that is fine, sometimes it isn't (usually with release pipeline though periodic I don't expect problems)22:25
*** kzaitsev_mb has quit IRC22:25
*** rook has quit IRC22:25
openstackgerritMerged openstack-infra/project-config: Run wheel build jobs in parallel and keep logs  https://review.openstack.org/42443122:25
clarkbthere is a separate command in zuul/tools that will enqueue directly to gearman which can be used to run a single job22:26
*** krtaylor has quit IRC22:27
openstackgerritSolio Sarabia proposed openstack-infra/devstack-gate: WIP/DNR: Test new repo ironic-tempest-plugin  https://review.openstack.org/42487022:27
ianwclarkb: ahh cool, thanks, TIL22:27
*** rbuzatu has quit IRC22:27
*** wfoster has joined #openstack-infra22:30
*** baoli has joined #openstack-infra22:32
*** ssbarnea_ has quit IRC22:32
*** rkukura has quit IRC22:33
*** MasterOfBugs has quit IRC22:33
*** pramodrj07 has joined #openstack-infra22:33
*** matrohon has joined #openstack-infra22:34
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Updated GCM serialization for Teams Messages * addded team_id * fixed dates times (UTC epoch)  https://review.openstack.org/42488622:35
*** rook has joined #openstack-infra22:35
*** rook is now known as Guest776922:35
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Add scenario005 job (4nodes)  https://review.openstack.org/41809822:35
openstackgerritMerged openstack-infra/openstackid-resources: Updated GCM serialization for Teams Messages * addded team_id * fixed dates times (UTC epoch)  https://review.openstack.org/42488622:36
*** baoli has quit IRC22:36
*** dprince has quit IRC22:37
*** marst_ has quit IRC22:39
*** adrian_otto has quit IRC22:41
*** gildub has joined #openstack-infra22:42
openstackgerritAdam Gandelman proposed openstack-infra/zuul: Move and re-enable test_build_configuration_branch tests  https://review.openstack.org/40937622:42
*** dizquierdo has joined #openstack-infra22:44
*** inc0 has quit IRC22:44
*** rbuzatu has joined #openstack-infra22:44
*** burgerk__ has joined #openstack-infra22:48
*** ssbarnea has joined #openstack-infra22:48
*** rbuzatu has quit IRC22:49
*** david-lyle has quit IRC22:50
*** burgerk_ has quit IRC22:51
*** hashar has quit IRC22:51
*** dimtruck is now known as zz_dimtruck22:52
*** david-lyle has joined #openstack-infra22:53
*** burgerk__ has quit IRC22:54
*** mdrabe has quit IRC22:54
*** xyang1 has quit IRC22:59
*** Guest7769 is now known as rook22:59
*** rook is now known as Guest975723:00
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: test dlrn logs  https://review.openstack.org/42435423:01
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Add HTTPS to developer and docs.openstack.org  https://review.openstack.org/42489323:05
fungiAJaeger: ^23:06
fungii think that will do what we need23:06
clarkbooh shiny /me reviews23:06
clarkbthen I will release gerritbot23:06
fungino idea if it even passes tests yet23:06
*** ihrachys has joined #openstack-infra23:06
clarkbfungi: and SNI is not compatible with really old browsers but we already use it somewhere?23:07
openstackgerritMerged openstack-infra/puppet-ethercalc: Convert from etherpad to ethercalc  https://review.openstack.org/42292123:07
*** timello has quit IRC23:07
fungialso ask and zuul haven't picked up my cert replacements from earlier today. i wonder if puppet/ansible is stuck again. anyone happen to already be looking into puppeting issues on our servers?23:07
*** harlowja has quit IRC23:08
fungilooks like it's at least running on zuul.o.o23:09
*** adriant has joined #openstack-infra23:09
*** krtaylor has joined #openstack-infra23:09
clarkbI haven't been looking at servers today. Almost completely code reviews and email23:09
fungioh! i bet we don't have puppet restarting apache23:09
*** matrohon has quit IRC23:10
*** timello has joined #openstack-infra23:10
*** jamesdenton has quit IRC23:10
fungiyep, that did the trick23:11
fungimuch better now23:11
*** jaosorior has quit IRC23:12
clarkbfungi: I want to say /etc/ssl/* is created when you install the base apache ssl package stuff23:13
*** zz_dimtruck is now known as dimtruck23:13
clarkbso that may be redundant in your change if you want to simplify it23:13
fungiit is, but may not be installed by the time apache is first installed and gets configured23:13
*** EricGonczer_ has quit IRC23:14
*** gordc has joined #openstack-infra23:14
clarkbgotcha23:14
fungielsewhere we do this to avoid a circular dependency between the ssl-certs package and apache2 with a configuration relying on autogenerated snakeoil certs. there's no such circular dependency in this case so we might be able to do something simpler23:14
fungialso just realized i forgot to add these to certcheck. on the way now23:15
*** aglarendil_ is now known as aglarendil23:15
*** amotoki has quit IRC23:15
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Add HTTPS to developer and docs.openstack.org  https://review.openstack.org/42489323:15
fungithere we go23:15
* fungi needs to find some grub now that the board meeting has wrapped up23:16
*** rm_work has quit IRC23:16
clarkbfungi: the other thing is you could potentially continue to use a shared vhost if you index the file path on srvname23:16
clarkb*file path for the certs23:16
*** rm_work has joined #openstack-infra23:17
*** srobert has quit IRC23:19
fungihrm, an interesting idea23:20
andreykurilinHi folks! Can anybody look at  https://review.openstack.org/#/c/424256/  ? one of job takes too much time (2.5 hour instead of usual < 1 hour)23:20
fungii was wondering if we could swing something like that23:20
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: POC: Use tripleo-repos in tripleo.sh  https://review.openstack.org/39581323:21
clarkbandreykurilin: looks like it is running? if slowly23:21
clarkbthe telnet connection shows tempest is currently tempesting23:21
clarkbis a rackspace IP23:22
clarkbpossibly just a slow instance due to cloud23:22
andreykurilin:(23:22
*** ssbarnea has quit IRC23:22
*** amotoki has joined #openstack-infra23:22
andreykurilinclarkb: but it should not take so much time... I wonder why it was not killed by timeout23:22
clarkbandreykurilin: timeout must be longer23:23
clarkb2017-01-24 21:00:19.139390 | Job timeout set to: 153 minutes23:23
andreykurilinclarkb: if tempest is tempesting, what is the right word for rally process? :P23:23
andreykurilinoh23:23
clarkbwhich is actually right around now23:23
andreykurilinthanks23:23
clarkbI think 10 more minutes?23:23
andreykurilinok, I'm ready to wait 10 more minutes before going to sleep23:24
andreykurilinthanks23:24
*** yujunz has joined #openstack-infra23:25
*** dizquierdo has quit IRC23:27
*** dimtruck is now known as zz_dimtruck23:27
*** SpamapS has quit IRC23:27
*** xhku has quit IRC23:28
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Move Multinode environments to THT  https://review.openstack.org/42419023:28
*** Swami_ has joined #openstack-infra23:29
*** mtanino_ has joined #openstack-infra23:29
*** mtanino has quit IRC23:30
*** SpamapS has joined #openstack-infra23:31
*** xhku has joined #openstack-infra23:32
*** Swami has quit IRC23:32
*** skath has quit IRC23:33
*** dave-mccowan has joined #openstack-infra23:33
*** ihrachys has quit IRC23:35
*** tphummel has quit IRC23:35
*** Swami_ has quit IRC23:35
*** ihrachys has joined #openstack-infra23:36
*** ihrachys has quit IRC23:36
openstackgerritMerged openstack-infra/nodepool: Add files for zuul-nodepool integration test  https://review.openstack.org/42228423:36
*** tphummel has joined #openstack-infra23:36
*** ssbarnea has joined #openstack-infra23:36
*** s-shiono has joined #openstack-infra23:37
*** tphummel has quit IRC23:37
openstackgerritMerged openstack-infra/project-config: Update gate-zuul-nodepool  https://review.openstack.org/42486023:39
* clarkb remebers that gpg is all kinds of silly now in version 2 and will have to kill daemons after using his key to make a gerritbot tag23:40
*** yujunz has quit IRC23:40
clarkbI suppose I should sign the pike key at the same time23:40
*** rbuzatu has joined #openstack-infra23:41
*** tphummel has joined #openstack-infra23:41
*** amotoki has quit IRC23:42
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Add scenario005 job (4nodes)  https://review.openstack.org/41809823:42
*** sdake has quit IRC23:45
*** rbuzatu has quit IRC23:45
*** tdasilva has quit IRC23:47
*** john-davidge has joined #openstack-infra23:47
ianwhmm, so i guess because we don't have pip setup to use a wheel mirror on the wheel builder slaves, it thinks it wants to rebuild, which is why the job takes so long23:47
openstackgerritMerged openstack-infra/zuul: Add nodepool integration test script  https://review.openstack.org/42228823:51
clarkbianw: oh so we rebuild lxml every time?23:51
*** john-davidge has quit IRC23:52
clarkbjlvillal: I just pushed the 0.3.0 gerritbot tag23:52
*** dingyichen has joined #openstack-infra23:52
*** kzaitsev_mb has joined #openstack-infra23:52
openstackgerritMerged openstack-infra/zuul: Move tests into test/unit  https://review.openstack.org/42478723:52
ianw2017-01-24 23:51:21.527485 | Kerberos initialization for service/wheel@OPENSTACK.ORG23:52
ianw2017-01-24 23:51:21.527539 | k5start: unable to create PAG: Disk quota exceeded23:52
openstackgerritMerged openstack-infra/zuul: Add nodepool integration test  https://review.openstack.org/42485923:52
ianwhmm23:52
clarkbfungi: and I signed the pike key23:52
*** Goneri has quit IRC23:53
ianwclarkb: yeah, we ask pypi if it has it, which says no.  we don't check if we already built it in our wheel mirrors.  configure_mirror.sh might mess up other bits on these hosts though if we just ran that straight out23:53
ianwTFW the only reference to an error message in google is an irc log line from fungi :)23:54
clarkbI'm trying to find teh command that had the --kill flag now that he linked me to23:55
clarkbgpgconf --kill23:56
* clarkb tries23:56
clarkbthat doesn't kill dirmngr though, oh well sigtermed it directly23:57
ianwfungi -- you said a few months ago ... in the past "k5start: unable to create PAG: Disk quota exceeded" was a vague error we've been unable to figure out, but seems to mean that you should restart afsd or reboot that wheel build node23:57
*** thorst_ has joined #openstack-infra23:57
ianwpresuming that is still the case?23:57
*** kzaitsev_mb has quit IRC23:57
*** thorst_ has quit IRC23:57
*** s-shiono has quit IRC23:57
*** mriedem has quit IRC23:57
*** harlowja has joined #openstack-infra23:58
*** Swami has joined #openstack-infra23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!