Wednesday, 2017-04-05

shrirchaSamYaple: ok so fake the port and give that to vpp.  that is ultimately the problem.  vpp will take over a port and then it is no longer available for the OS to use00:01
openstackgerritIan Wienand proposed openstack-infra/system-config master: Updates to adding mirror documentation  https://review.openstack.org/45299200:02
ianwjeblair: ^ thanks, updated00:02
*** thorst has joined #openstack-infra00:02
SamYapleshrircha: its not any different than openvswitch. with the veth pair you have two side, one vpp takes over the other you have dangling. you can do what you want with it, but youll be able to do whatever testing you need there00:03
*** rfolco has joined #openstack-infra00:03
*** rfolco has quit IRC00:03
*** kzaitsev_mb has joined #openstack-infra00:04
shrirchaSamYaple: ok that makes sense to me.  since its really all internal anyways that should work ok as long as vpp is ok with the port type.  thanks!  will try it out00:05
*** thorst has quit IRC00:07
*** zul_ has joined #openstack-infra00:07
*** dimtruck is now known as zz_dimtruck00:08
*** zz_dimtruck is now known as dimtruck00:14
*** xyang1 has quit IRC00:19
*** rlandy has quit IRC00:22
*** rbuzatu has joined #openstack-infra00:30
*** stakeda has joined #openstack-infra00:34
*** thorst has joined #openstack-infra00:34
*** yuanying has joined #openstack-infra00:34
*** thorst has quit IRC00:38
*** Julien-zte has joined #openstack-infra00:42
*** hongbin has quit IRC00:43
clarkbshrircha: you can find more info on our test environments at https://docs.openstack.org/infra/manual/testing.html SamYaple is correct in that yo ucan't control those things directly and the suggestion for using virtual interfaces is a good one00:43
shrirchaclarkb: thanks, that's very helpful00:44
clarkbfungi: fwiw we need haveged for more than just ssh setup, we've seen tests like pbr's which generate keys fail on timeouts without haveged running00:45
ianwclarkb: i wasn't aware of that one.  it sounds like that should be tracked down to use urandom though?00:45
*** smarcet has quit IRC00:45
clarkbianw: aiui gpg won't?00:46
*** smarcet has joined #openstack-infra00:46
*** zul_ has quit IRC00:46
*** zhurong has joined #openstack-infra00:46
*** jascott1_ has joined #openstack-infra00:47
*** smarcet has quit IRC00:50
*** kjorgensen has joined #openstack-infra00:50
*** liusheng has quit IRC00:53
ianwprobably not00:53
*** kjorgensen has quit IRC00:55
*** shu-mutou has joined #openstack-infra00:55
*** jascott1_ has quit IRC00:56
openstackgerritIan Wienand proposed openstack-infra/puppet-openstackci master: Add libssl-dev for keyring package on logserver  https://review.openstack.org/43998200:57
*** pvaneck has quit IRC00:59
*** [HeOS] has quit IRC01:03
*** liusheng has joined #openstack-infra01:08
mtreinishclarkb: heh, I got one of these at lca: https://keithp.com/blogs/chaoskey/ this year. I've been using it, but it's not like I can tell if it makes any difference01:10
mtreinishalthough I don't have any local lack of entropy issues anymore, but it's not like I ever really ran into that on a desktop system before01:10
*** jascott1_ has joined #openstack-infra01:11
openstackgerritIan Wienand proposed openstack-infra/puppet-planet master: Move logrotate to site.pp  https://review.openstack.org/45338901:11
*** john-davidge has joined #openstack-infra01:12
*** jcoufal has joined #openstack-infra01:13
*** john-davidge has quit IRC01:17
*** jerryz has quit IRC01:17
openstackgerritMerged openstack-infra/puppet-openstackci master: Add libssl-dev for keyring package on logserver  https://review.openstack.org/43998201:18
*** liujiong has joined #openstack-infra01:18
*** dimtruck is now known as zz_dimtruck01:19
*** ym200 has joined #openstack-infra01:21
*** ym200_ has joined #openstack-infra01:23
*** Apoorva_ has joined #openstack-infra01:23
*** ym200 has quit IRC01:26
openstackgerritMerged openstack-infra/puppet-planet master: Move logrotate to site.pp  https://review.openstack.org/45338901:26
*** Apoorva has quit IRC01:27
*** Apoorva_ has quit IRC01:27
*** yanyanhu has joined #openstack-infra01:27
*** jcoufal has quit IRC01:28
*** asselin_ has joined #openstack-infra01:28
*** asselin has quit IRC01:29
*** amotoki has joined #openstack-infra01:31
*** rbuzatu has quit IRC01:32
*** ym200_ has quit IRC01:33
*** Daisy has joined #openstack-infra01:35
*** ym200 has joined #openstack-infra01:35
*** thorst has joined #openstack-infra01:38
*** shrircha has quit IRC01:42
*** thorst has quit IRC01:43
*** kjorgensen has joined #openstack-infra01:43
*** baoli has joined #openstack-infra01:44
*** baoli has quit IRC01:45
*** baoli has joined #openstack-infra01:46
*** kjorgensen has quit IRC01:48
openstackgerritEmilien Macchi proposed openstack-infra/project-config master: Remove os-cloud-config from Infra  https://review.openstack.org/45316201:49
*** zz_dimtruck is now known as dimtruck01:51
*** zhurong has quit IRC01:52
*** jaypipes has quit IRC01:52
*** masber has quit IRC01:57
*** zhurong has joined #openstack-infra01:58
*** kzaitsev_mb has quit IRC02:00
*** gcb has joined #openstack-infra02:01
*** jamielennox is now known as jamielennox|away02:07
*** mtanino has joined #openstack-infra02:07
*** masayukig has joined #openstack-infra02:08
*** erikmwil_ has joined #openstack-infra02:12
*** erikmwilson has quit IRC02:12
*** Sukhdev has quit IRC02:14
*** masayukig has quit IRC02:18
*** sree has joined #openstack-infra02:18
*** sree has quit IRC02:19
*** yonglihe has joined #openstack-infra02:19
*** masayukig has joined #openstack-infra02:19
*** jamielennox|away is now known as jamielennox02:21
*** rbuzatu has joined #openstack-infra02:24
*** gongysh has joined #openstack-infra02:27
*** flepied has joined #openstack-infra02:31
openstackgerrittoan.t.pham proposed openstack-infra/jenkins-job-builder master: Add folder create for cloudbee folder jobs  https://review.openstack.org/43879502:32
*** winggundamth has joined #openstack-infra02:33
*** ym200 has quit IRC02:33
*** zhurong has quit IRC02:38
*** mrunge_ has quit IRC02:39
*** thorst has joined #openstack-infra02:40
*** mrunge_ has joined #openstack-infra02:41
*** gouthamr has quit IRC02:49
*** flepied has quit IRC02:55
*** kzaitsev_mb has joined #openstack-infra02:56
*** thorst has quit IRC02:58
*** yatinkarel has quit IRC03:03
*** aeng has quit IRC03:04
*** rbuzatu has quit IRC03:05
*** hongbin has joined #openstack-infra03:10
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Run dib-run-parts out of /tmp  https://review.openstack.org/44676903:11
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Don't provide dib-run-parts  https://review.openstack.org/44628503:11
*** zhurong has joined #openstack-infra03:13
*** Kevin_Zheng has quit IRC03:13
*** armax has quit IRC03:13
*** john-davidge has joined #openstack-infra03:13
zulis it possible to setup devstack-gate without nodepool?03:15
*** links has joined #openstack-infra03:16
*** john-davidge has quit IRC03:18
*** nicolasbock has quit IRC03:20
*** knangia has quit IRC03:21
*** aeng has joined #openstack-infra03:21
*** smarcet has joined #openstack-infra03:26
*** vikrant has joined #openstack-infra03:27
*** smarcet has quit IRC03:27
*** aeng has quit IRC03:30
*** Daisy has quit IRC03:31
*** baoli has quit IRC03:35
*** baoli has joined #openstack-infra03:35
*** Sukhdev has joined #openstack-infra03:38
*** aeng has joined #openstack-infra03:43
*** namnh has joined #openstack-infra03:46
*** gongysh has quit IRC03:46
*** kzaitsev_mb has quit IRC03:47
ianwzul: yes ... what are you trying to do?03:47
*** kjorgensen has joined #openstack-infra03:55
*** masber has joined #openstack-infra03:56
*** baoli has quit IRC03:58
*** kjorgensen has quit IRC03:59
*** rbuzatu has joined #openstack-infra04:02
*** aeng has quit IRC04:04
*** mtanino has quit IRC04:05
*** dave-mccowan has quit IRC04:05
*** rcernin has joined #openstack-infra04:06
*** sflanigan has quit IRC04:06
*** ym200 has joined #openstack-infra04:07
*** hongbin has quit IRC04:08
*** tinwood has quit IRC04:10
*** tinwood has joined #openstack-infra04:11
*** ym200 has quit IRC04:11
*** amotoki has quit IRC04:12
*** sree has joined #openstack-infra04:12
*** zhurong has quit IRC04:12
*** rcernin has quit IRC04:13
*** dharinic has quit IRC04:14
*** sree has quit IRC04:14
*** sree has joined #openstack-infra04:14
*** Apoorva has joined #openstack-infra04:16
*** marst has joined #openstack-infra04:18
*** aeng has joined #openstack-infra04:21
*** sflanigan has joined #openstack-infra04:23
*** sflanigan has joined #openstack-infra04:23
openstackgerritMatthew Treinish proposed openstack-infra/system-config master: Add mqtt_statsd to firehose config  https://review.openstack.org/45345204:24
*** ym200 has joined #openstack-infra04:25
*** ym200 has quit IRC04:30
*** amotoki has joined #openstack-infra04:30
*** kzaitsev_mb has joined #openstack-infra04:35
*** zhurong has joined #openstack-infra04:35
*** dharinic has joined #openstack-infra04:38
*** psachin has joined #openstack-infra04:39
*** dharinic has quit IRC04:41
*** dharinic has joined #openstack-infra04:42
*** Apoorva has quit IRC04:46
*** Apoorva has joined #openstack-infra04:47
*** kzaitsev_mb has quit IRC04:48
*** amotoki has quit IRC04:48
*** dharinic has quit IRC04:49
*** chlong has quit IRC04:49
*** Apoorva has quit IRC04:51
*** dhajare has joined #openstack-infra04:51
*** knangia has joined #openstack-infra04:53
*** amotoki has joined #openstack-infra04:53
*** thorst has joined #openstack-infra04:55
*** ym200 has joined #openstack-infra04:55
*** ym200 has quit IRC05:00
*** thorst has quit IRC05:00
openstackgerritMerged openstack-infra/project-config master: networking-odl: remove one periodic job  https://review.openstack.org/44265105:07
*** rbuzatu has quit IRC05:09
*** nmathew has joined #openstack-infra05:09
openstackgerritMerged openstack/diskimage-builder master: Adding aarch64 support for CentOS7  https://review.openstack.org/42223205:10
*** jaosorior_away is now known as jaosorior05:11
*** john-davidge has joined #openstack-infra05:14
*** pgadiya has joined #openstack-infra05:15
*** jascott1_ has quit IRC05:16
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Testing TLS-everywhere with keystone container  https://review.openstack.org/44957005:16
*** jascott1_ has joined #openstack-infra05:17
*** john-davidge has quit IRC05:18
*** amotoki has quit IRC05:19
*** jascott1_ has quit IRC05:21
*** tonyb_ is now known as tonyb05:25
*** gongysh has joined #openstack-infra05:27
*** prateek has joined #openstack-infra05:32
*** amotoki has joined #openstack-infra05:32
*** sflanigan has quit IRC05:37
*** aeng has quit IRC05:38
*** sflanigan has joined #openstack-infra05:49
*** aeng has joined #openstack-infra05:50
*** thorst has joined #openstack-infra05:56
*** rbuzatu_ has joined #openstack-infra05:56
*** cshastri has joined #openstack-infra05:57
*** yatin has joined #openstack-infra05:59
*** Sukhdev has quit IRC05:59
*** thorst has quit IRC06:01
*** pcaruana has joined #openstack-infra06:08
AJaegerianw, regarding: https://review.openstack.org/#/c/453322 - do we need first a diskimage-builder release or is it safe as is? (looks safe to me, just double checking)06:09
ianwAJaeger: until a release, it would just install it enabled, which would retain the status quo06:09
ianwergo safe06:09
ianwbut i would like pabelanger to weigh in, as we were discussing it06:09
ianwi may release a little later anyway ... just have some stuff relating to dib-run-parts in flight06:10
AJaegerok, then I'll wait until pabelanger reviewed https://review.openstack.org/#/c/45332206:10
*** andreas_s has joined #openstack-infra06:11
*** ym200 has joined #openstack-infra06:17
*** ym200 has quit IRC06:21
*** numans_ has quit IRC06:23
*** isaacb has joined #openstack-infra06:25
*** ym200 has joined #openstack-infra06:28
*** numans has joined #openstack-infra06:28
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Testing TLS-everywhere with keystone container  https://review.openstack.org/44957006:29
*** rcernin has joined #openstack-infra06:31
*** ym200 has quit IRC06:32
*** dimtruck is now known as zz_dimtruck06:32
*** pgadiya has quit IRC06:34
openstackgerritMasahito Muroi proposed openstack-infra/project-config master: Update Blazar's gate jobs  https://review.openstack.org/45263506:35
*** aeng has quit IRC06:35
openstackgerritMasahito Muroi proposed openstack-infra/project-config master: Update Blazar's gate jobs  https://review.openstack.org/45263506:41
*** pahuang has quit IRC06:43
*** sputnik13 has quit IRC06:44
*** kzaitsev_mb has joined #openstack-infra06:44
*** sputnik13 has joined #openstack-infra06:45
*** tesseract has joined #openstack-infra06:52
*** thorst has joined #openstack-infra06:57
*** knangia has quit IRC07:01
*** Guest37994 has quit IRC07:01
openstackgerritMerged openstack/diskimage-builder master: Don't provide dib-run-parts  https://review.openstack.org/44628507:01
*** thorst has quit IRC07:01
*** HeOS has joined #openstack-infra07:02
*** chem has joined #openstack-infra07:04
*** florianf has joined #openstack-infra07:08
*** sshnaidm is now known as sshnaidm|afk07:11
*** ralonsoh has joined #openstack-infra07:12
openstackgerritMasahito Muroi proposed openstack-infra/project-config master: Update Blazar's gate jobs  https://review.openstack.org/45263507:12
*** ym200 has joined #openstack-infra07:14
*** ym200 has quit IRC07:14
*** alexchadin has joined #openstack-infra07:15
*** john-davidge has joined #openstack-infra07:15
*** ym200 has joined #openstack-infra07:15
*** matrohon has joined #openstack-infra07:16
*** Vivek has joined #openstack-infra07:18
*** Vivek is now known as Guest5669807:19
*** aviau has quit IRC07:19
*** ym200 has quit IRC07:19
*** john-davidge has quit IRC07:19
*** aviau has joined #openstack-infra07:19
*** martinkopec has joined #openstack-infra07:20
*** shardy has joined #openstack-infra07:22
*** zz_dimtruck is now known as dimtruck07:24
*** dizquierdo has joined #openstack-infra07:27
*** nadya has joined #openstack-infra07:29
*** nadya has quit IRC07:30
openstackgerritMasahito Muroi proposed openstack-infra/project-config master: Update Blazar's gate jobs  https://review.openstack.org/45263507:31
*** tie has joined #openstack-infra07:31
*** dimtruck is now known as zz_dimtruck07:33
*** jascott1_ has joined #openstack-infra07:34
*** HeOS has quit IRC07:34
*** hashar has joined #openstack-infra07:37
*** jascott1_ has quit IRC07:39
AJaegerfrickler: thanks for your reviews, really appreciated!07:42
*** amoralej|off is now known as amoralej07:43
openstackgerritMasahito Muroi proposed openstack-infra/project-config master: Update Blazar's gate jobs  https://review.openstack.org/45263507:44
*** matrohon has quit IRC07:47
*** arxcruz has quit IRC07:47
*** marst has quit IRC07:47
*** marst has joined #openstack-infra07:48
*** ym200 has joined #openstack-infra07:48
openstackgerritDirk Mueller proposed openstack-infra/nodepool master: Add default logging file argument  https://review.openstack.org/44632407:49
*** ym200 has quit IRC07:53
*** arxcruz has joined #openstack-infra07:56
*** thorst has joined #openstack-infra07:57
*** ssbarnea has joined #openstack-infra07:58
AJaegermorning yolanda ! Could you review https://review.openstack.org/452287 and https://review.openstack.org/452552 and https://review.openstack.org/452555 as well, please?07:58
yolandahi AJaeger , good morning07:58
yolandai'll do07:58
*** jpich has joined #openstack-infra07:58
AJaegerthanks!07:58
*** zzzeek has quit IRC08:00
*** markus_z has joined #openstack-infra08:00
*** zzzeek has joined #openstack-infra08:00
openstackgerritAlfredo Moralejo proposed openstack-infra/tripleo-ci master: DNM Other test for 451445  https://review.openstack.org/45197808:01
*** jascott1 has quit IRC08:01
openstackgerritMerged openstack-infra/project-config master: Add coverage check jobs to tripleo python projects  https://review.openstack.org/45232108:02
*** rossella_s has joined #openstack-infra08:03
openstackgerritMerged openstack-infra/project-config master: Add acl config for tripleo-image-elements/incubator  https://review.openstack.org/45315808:03
openstackgerritMerged openstack-infra/project-config master: Enable ironic service in congress gate job  https://review.openstack.org/45211008:03
openstackgerritMerged openstack-infra/project-config master: Change mogan tempest job to use ipmitool driver  https://review.openstack.org/45273508:03
openstackgerritMerged openstack-infra/project-config master: Add py35 job to os-net-config  https://review.openstack.org/45232208:03
openstackgerritMerged openstack-infra/project-config master: add /usr/local/lib to library cache  https://review.openstack.org/45288608:03
openstackgerritMerged openstack-infra/project-config master: Exclude dir to prevent change-while-read error  https://review.openstack.org/45306508:03
*** gcb has quit IRC08:07
*** kzaitsev_mb has quit IRC08:09
openstackgerritMerged openstack-infra/project-config master: Link to Infra Manual for CI problems  https://review.openstack.org/45228708:10
*** umbSublime has quit IRC08:11
*** arif-ali has quit IRC08:12
*** arif-ali has joined #openstack-infra08:14
*** dtantsur|afk is now known as dtantsur08:15
*** john-davidge has joined #openstack-infra08:15
*** arif-ali has quit IRC08:16
openstackgerritMerged openstack-infra/system-config master: Remove docbook packages  https://review.openstack.org/45255208:16
*** arif-ali has joined #openstack-infra08:17
*** thorst has quit IRC08:17
*** umbSublime has joined #openstack-infra08:17
*** umbSublime has quit IRC08:17
*** umbSublime has joined #openstack-infra08:17
*** gcb has joined #openstack-infra08:19
*** john-davidge has quit IRC08:20
*** bhavik1 has joined #openstack-infra08:22
*** ym200 has joined #openstack-infra08:23
*** zz_dimtruck is now known as dimtruck08:24
*** ianychoi has quit IRC08:24
*** ianychoi has joined #openstack-infra08:25
*** ym200 has quit IRC08:27
*** priteau has joined #openstack-infra08:28
*** s-shiono has quit IRC08:28
*** electrofelix has joined #openstack-infra08:31
*** alexchadin has quit IRC08:31
*** jaosorior is now known as jaosorior_lunch08:31
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci master: WIP -- post upgrade ci test for checking the upgrade_batch reviews  https://review.openstack.org/45351508:33
*** dingyichen has quit IRC08:34
*** dimtruck is now known as zz_dimtruck08:34
*** lucas-afk is now known as lucasagomes08:36
openstackgerritJavier Peña proposed openstack-infra/zuul master: Find fallback branch in zuul-cloner  https://review.openstack.org/44237008:37
*** zz_dimtruck is now known as dimtruck08:38
*** neiljerram has joined #openstack-infra08:39
*** nadya has joined #openstack-infra08:40
*** kzaitsev_mb has joined #openstack-infra08:41
*** namnh has quit IRC08:41
*** derekh has joined #openstack-infra08:43
*** sshnaidm|afk is now known as sshnaidm08:45
*** dimtruck is now known as zz_dimtruck08:47
*** alexchadin has joined #openstack-infra08:48
*** ramishra has quit IRC08:49
*** matrohon has joined #openstack-infra08:51
*** ramishra has joined #openstack-infra08:51
*** jtomasek has quit IRC08:54
*** jtomasek has joined #openstack-infra08:55
openstackgerritVitaly Gridnev proposed openstack-infra/project-config master: implement a builder for scenario jobs  https://review.openstack.org/45130208:56
*** matrohon has quit IRC08:57
openstackgerritVitaly Gridnev proposed openstack-infra/project-config master: implement a builder for scenario jobs  https://review.openstack.org/45130209:01
*** ym200 has joined #openstack-infra09:01
*** pahuang has joined #openstack-infra09:03
*** esikachev has joined #openstack-infra09:05
*** ym200 has quit IRC09:06
*** psachin has quit IRC09:07
esikachevhello! Does synchronization to github is working now?09:08
*** dhajare has quit IRC09:08
*** sambetts|afk is now known as sambetts09:09
*** rbuzatu has joined #openstack-infra09:09
*** HeOS has joined #openstack-infra09:10
*** dhajare has joined #openstack-infra09:10
*** ssbarnea has quit IRC09:11
*** psachin has joined #openstack-infra09:11
*** rbuzatu_ has quit IRC09:12
*** rbuzatu has quit IRC09:13
*** thorst has joined #openstack-infra09:14
frickleresikachev: it should work in general, but there seems to be a bit of stuckness in the post queue, so there might be a bit of delay. not sure if that is really related, but e.g. https://review.openstack.org/gitweb?p=openstack/neutron.git;a=commitdiff;h=7d8ccdc1627dbed916a5fb6b7efe15dbff567c14 does not yet appear on github09:14
openstackgerritJavier Peña proposed openstack-infra/zuul master: Find fallback branch in zuul-cloner  https://review.openstack.org/44237009:15
*** john-davidge has joined #openstack-infra09:17
fricklerinfra-root: not sure how much delay is to be expected, but it seems *-upstream-translation-update jobs in the post queue are not getting scheduled09:18
*** thorst has quit IRC09:18
*** aarefiev_afk is now known as aarefiev09:19
*** dizquierdo has quit IRC09:19
tieanybody around here actively working on jenkins-job-builder ?09:21
*** neiljerram has quit IRC09:21
tiefor my purposes I'd like a custom YAML tag that can read the branch/tag that the local git repo is on09:21
tie(the idea being to get distinct sets of build jobs for the different branches/release tags)09:22
*** neiljerram has joined #openstack-infra09:23
openstackgerritVitaly Gridnev proposed openstack-infra/project-config master: implement a builder for scenario jobs  https://review.openstack.org/45130209:25
*** aviau has quit IRC09:26
*** aviau has joined #openstack-infra09:27
*** stakeda has quit IRC09:28
*** pblaho has quit IRC09:31
*** kzaitsev_mb has quit IRC09:31
*** Julien-zte has quit IRC09:36
*** ym200 has joined #openstack-infra09:37
*** alexchadin has quit IRC09:38
*** ym200 has quit IRC09:41
*** ijw_ has quit IRC09:42
openstackgerritGábor Antal proposed openstack-dev/hacking master: Add a check for logger naming  https://review.openstack.org/44325009:42
*** tosky has joined #openstack-infra09:47
*** ssbarnea has joined #openstack-infra09:47
*** ym200 has joined #openstack-infra09:53
*** liujiong has quit IRC09:55
*** ym200 has quit IRC09:58
*** nadya has quit IRC10:01
AJaegerfrickler: that'S normal - the perodic jobs run on the same node and those run first in most cases10:03
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Support built packages to be installed in image  https://review.openstack.org/45275510:04
*** rbuzatu has joined #openstack-infra10:05
*** ramishra has quit IRC10:06
AJaegerfrickler: see all those sahara-dashboard-propose-translation-update etc. jobs in the perodic queue10:06
*** nicolasbock has joined #openstack-infra10:07
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: combined OVB ha and non-ha job  https://review.openstack.org/45313510:08
*** ramishra has joined #openstack-infra10:08
*** xarses_ has joined #openstack-infra10:15
*** xarses has quit IRC10:16
openstackgerritMerged openstack/diskimage-builder master: Run dib-run-parts out of /tmp  https://review.openstack.org/44676910:18
*** wolverineav has joined #openstack-infra10:18
*** rbuzatu has quit IRC10:20
*** rfolco has joined #openstack-infra10:21
*** pcaruana|afk| has joined #openstack-infra10:21
*** pcaruana|afk| has quit IRC10:23
*** pcaruana has quit IRC10:24
*** yanyanhu has quit IRC10:24
*** pcaruana has joined #openstack-infra10:25
*** amotoki has quit IRC10:26
*** rbuzatu has joined #openstack-infra10:27
*** kzaitsev_mb has joined #openstack-infra10:28
*** zhurong has quit IRC10:30
*** jaosorior_lunch is now known as jaosorior10:31
*** dizquierdo has joined #openstack-infra10:32
openstackgerritFabio Verboso proposed openstack-infra/project-config master: New Iotronic Service components:  https://review.openstack.org/45318410:34
*** chem has quit IRC10:34
*** gongysh has quit IRC10:35
*** esikachev has quit IRC10:36
*** jkilpatr has quit IRC10:37
*** ijw has joined #openstack-infra10:38
ttxhmm looks like cgit mirror are lagging too10:39
*** pbourke has quit IRC10:39
*** zz_dimtruck is now known as dimtruck10:39
*** pbourke has joined #openstack-infra10:41
ttxI have a bunch of governance reviews that were merged in Gerrit two hours ago but do not show up in http://git.openstack.org/cgit/openstack/governance/log/10:41
*** gongysh has joined #openstack-infra10:41
ttxvs. https://review.openstack.org/#/q/status:merged+project:openstack/governance10:41
*** ym200 has joined #openstack-infra10:41
*** nadya has joined #openstack-infra10:42
*** chem has joined #openstack-infra10:44
*** shardy is now known as shardy_lunch10:45
*** ym200 has quit IRC10:46
*** bhavik1 has quit IRC10:47
*** dizquierdo has quit IRC10:48
*** chem` has joined #openstack-infra10:48
*** ijw has quit IRC10:49
*** dimtruck is now known as zz_dimtruck10:49
*** chem has quit IRC10:51
*** adarazs is now known as adarazs_lunch10:51
*** dizquierdo has joined #openstack-infra10:53
*** gcb has quit IRC10:57
*** sree has quit IRC11:02
*** sree_ has joined #openstack-infra11:04
*** sree_ is now known as Guest5549911:05
*** dave-mccowan has joined #openstack-infra11:06
*** hashar has quit IRC11:06
*** hashar has joined #openstack-infra11:07
*** alexchadin has joined #openstack-infra11:07
*** Guest55499 has quit IRC11:08
*** rbuzatu has quit IRC11:09
openstackgerrityolanda.robla proposed openstack-infra/project-config master: Add timeout to buildimage jobs  https://review.openstack.org/45357911:11
*** pblaho has joined #openstack-infra11:11
fricklerAJaeger: o.k., that's good to know. but shouldn't replication to cgit and github happen independently? or does it also wait until post jobs are finished?11:11
*** jkilpatr has joined #openstack-infra11:12
*** shu-mutou is now known as shu-mutou-AWAY11:12
openstackgerrityolanda.robla proposed openstack-infra/project-config master: Add timeout to buildimage jobs  https://review.openstack.org/45357911:12
*** neiljerram has quit IRC11:13
AJaegerfrickler: I talk only the post jobs for translation update.11:13
*** john-davidge has quit IRC11:13
*** Julien-zte has joined #openstack-infra11:14
AJaegerfrickler: cgit/github is something completely different - and there seems indeed be a problem11:14
AJaegerinfra-root, see message by ttx above - cgit.openstack.org (and also github) seem out of sync.11:15
*** neiljerram has joined #openstack-infra11:15
*** thorst has joined #openstack-infra11:15
AJaeger#status log cgit.openstack.org is not up to date11:16
openstackstatusAJaeger: finished logging11:16
*** rbuzatu has joined #openstack-infra11:16
AJaegerfrickler: sorry, read only your second message but missed the github one initially11:16
*** john-davidge has joined #openstack-infra11:17
*** rbuzatu has quit IRC11:18
*** rbuzatu has joined #openstack-infra11:19
*** thorst has quit IRC11:19
*** rbuzatu has quit IRC11:21
fricklerAJaeger: yeah, I wasn't sure whether the issues might be related, for the neutron repo I checked, the last replicated patch was 2 hours older than what was waiting in the post queue11:22
*** gk_1wm_su has joined #openstack-infra11:23
*** gk_1wm_su has left #openstack-infra11:24
*** winggundamth has quit IRC11:24
AJaegerfrickler: they should not be related (and I only read the second part)11:24
*** pblaho has quit IRC11:24
*** mat128 has joined #openstack-infra11:25
*** ccamacho is now known as ccamacho|lunch11:26
AJaegersdague: since we retire os-cloud-config, could you look at this devstack-gate change, please? https://review.openstack.org/#/c/453178/11:27
*** askb has quit IRC11:30
sdagueAJaeger: sure11:30
AJaegerthanks, sdague11:32
openstackgerritMerged openstack-infra/project-config master: Add timeout to buildimage jobs  https://review.openstack.org/45357911:33
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Adding periodic-ovb-nonha-tempest-oooq.yml file  https://review.openstack.org/45358911:35
*** ldnunes has joined #openstack-infra11:36
*** gongysh has quit IRC11:37
*** pblaho has joined #openstack-infra11:37
*** amotoki has joined #openstack-infra11:38
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Adding periodic-ovb-nonha-tempest-oooq.yml file  https://review.openstack.org/45358911:39
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Set SSL args for non-iso OVB job  https://review.openstack.org/45312611:39
*** zz_dimtruck is now known as dimtruck11:40
*** gongysh has joined #openstack-infra11:41
*** thorst has joined #openstack-infra11:41
*** flepied has joined #openstack-infra11:44
*** gongysh has quit IRC11:47
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Adding periodic-ovb-nonha-tempest-oooq.yml file  https://review.openstack.org/45358911:47
*** dimtruck is now known as zz_dimtruck11:50
*** kzaitsev_mb has quit IRC11:52
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: test containers with single-nic-vlan  https://review.openstack.org/44797311:52
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: Conntainers with multi-nic and net-iso  https://review.openstack.org/42244811:54
*** dprince has joined #openstack-infra11:59
*** gongysh has joined #openstack-infra12:00
*** dtardivel has joined #openstack-infra12:02
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Support container upgrades in multinode OOOQ CI  https://review.openstack.org/45078412:03
*** gongysh has quit IRC12:05
*** srobert has joined #openstack-infra12:05
*** srobert has quit IRC12:07
*** isaacb_ has joined #openstack-infra12:07
*** srobert has joined #openstack-infra12:07
*** isaacb has quit IRC12:08
*** rbuzatu has joined #openstack-infra12:09
*** adarazs_lunch is now known as adarazs12:09
*** rbuzatu has quit IRC12:10
*** rbuzatu has joined #openstack-infra12:10
*** rbuzatu has quit IRC12:10
*** rbuzatu has joined #openstack-infra12:10
kaisers1Hey Infras! I see a range of CIs failing to fetch specific changes from git.openstack.org since about 1h ago. Have there been any changes made to Gerrit? Example: http://78.46.57.153:8081/refs-changes-46-428646-14/stack.sh.log.out12:11
kaisers1or: http://140.174.232.106/refs-changes-59-426159-2/ns5_iscsi/stack.sh.log.out12:11
kaisers1cloning the repos work but fetching the requested change (for the CIs test run) fails12:12
fricklerkaisers1: there seem to be issues with the replication from gerrit to git, waiting for infra-root to investigate12:13
kaisers1frickler: thnx :)12:16
AJaegeryeah, several repos are not up to date ;( I just checked http://git.openstack.org/cgit/openstack-infra/project-config/12:17
*** trown|outtypewww is now known as trown12:20
tieis this an appropriate channel to discuss/post questions re jenkins-job-builder? or is this channel strictly internal to OpenStack developers?12:20
AJaegertie: it's the right channel but most experts are currently asleep, so if nobody answers, you might need to ask again later during US time.12:21
tieAJaeger: ok, thanks, it's good to have at least a confirmation that I'm not in invisibility mode :)12:22
AJaeger;)12:22
*** srobert has quit IRC12:24
pabelangermorning12:25
AJaegermorning, pabelanger. Have you had your coffee and are ready for firefighting? ;)12:26
*** kzaitsev_mb has joined #openstack-infra12:26
pabelangercoffee in hand now12:26
AJaegerpabelanger: git.openstack.org is not in sync...12:26
pabelangerI see that, let me check review.o.o logs12:26
AJaegerpabelanger:  compare http://git.openstack.org/cgit/openstack/governance/log/ and  https://review.openstack.org/#/q/status:merged+project:openstack/governance12:27
*** ZZelle has joined #openstack-infra12:27
*** ZZelle is now known as Guest8549612:27
AJaegersimilar for project-config: http://git.openstack.org/cgit/openstack-infra/project-config/ and https://review.openstack.org/#/q/project:openstack-infra/project-config+status:merged12:27
*** Guest85496 is now known as ZZelle_12:27
AJaegerand similar github is out of date but that should be related to git.o.o lagging behind12:28
AJaegerthanks, pabelanger12:28
*** thiagolib has joined #openstack-infra12:28
*** gouthamr has joined #openstack-infra12:29
*** jaypipes has joined #openstack-infra12:29
*** ccamacho|lunch is now known as ccamacho12:31
*** flepied has quit IRC12:33
openstackgerritJavier Peña proposed openstack-infra/zuul master: Find fallback branch in zuul-cloner  https://review.openstack.org/44237012:33
pabelangergerrit show-queue looks to be backed up12:33
pabelangerI think we had this issue a few weeks ago12:34
pabelangerI remember jeblair working on this12:34
pabelangerIIRC, we tried to kill some process but eventually restarted gerrit12:34
*** srobert has joined #openstack-infra12:34
*** Swami has joined #openstack-infra12:35
*** alexchadin has quit IRC12:36
*** gordc has joined #openstack-infra12:36
*** zz_dimtruck is now known as dimtruck12:41
*** amotoki has quit IRC12:41
*** rlandy has joined #openstack-infra12:42
mordredpabelanger: restarting gerrit sounds like a good plan to me12:43
fricklerpabelanger: maybe you can check open tcp connections, might give an indication whether one mirror is affected or all of them. not sure if this might be symptom or cause, but this looks related http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=30&rra_id=all12:43
fricklerbut simply restarting may be a feasible option, too12:44
*** dtantsur is now known as dtantsur|brb12:46
pabelangermordred: frickler: ya, I have tried killing a few of the tasks in the queue, but no luck12:46
pabelangersomething is stuck for sure12:46
pabelanger#status notice The Gerrit service on http://review.openstack.org is being restarted to address hung remote replication tasks, and should return to an operable state momentarily12:47
*** matrohon has joined #openstack-infra12:48
*** tongli has joined #openstack-infra12:49
*** pabelanger has quit IRC12:49
*** pabelanger has joined #openstack-infra12:49
pabelanger#status notice The Gerrit service on http://review.openstack.org is being restarted to address hung remote replication tasks, and should return to an operable state momentarily12:50
openstackstatuspabelanger: sending notice12:50
*** dimtruck is now known as zz_dimtruck12:50
sdagueoh, hey, that's why gerrit review just failed12:51
-openstackstatus- NOTICE: The Gerrit service on http://review.openstack.org is being restarted to address hung remote replication tasks, and should return to an operable state momentarily12:51
*** ym200 has joined #openstack-infra12:51
pabelangerokay, gerrit back up12:52
pabelangerchecking on replication now12:52
*** psachin has quit IRC12:52
*** gouthamr has quit IRC12:53
openstackstatuspabelanger: finished sending notice12:53
*** markvoelker has joined #openstack-infra12:55
AJaegerpabelanger: project-config is updating now on git.o.o12:55
pabelanger13273 tasks12:55
pabelangerstill left for replication12:55
*** amotoki has joined #openstack-infra12:56
*** gouthamr has joined #openstack-infra12:59
*** dprince has quit IRC12:59
*** mtanino has joined #openstack-infra12:59
*** eharney has joined #openstack-infra13:00
*** vikrant has quit IRC13:00
*** felipemonteiro has joined #openstack-infra13:03
*** isaacb_ has quit IRC13:04
*** pblaho has quit IRC13:04
AJaegerpabelanger: how quick is that number going down?13:04
*** psachin has joined #openstack-infra13:04
openstackgerritKaitlin Farr proposed openstack-infra/project-config master: Add api-ref-jobs to Barbican  https://review.openstack.org/45362613:05
*** kzaitsev_mb has quit IRC13:05
pabelangerAJaeger: ssh -p29418 review.openstack.org gerrit show-queue13:05
pabelangerdown to 706013:05
*** isaacb_ has joined #openstack-infra13:05
*** flepied has joined #openstack-infra13:06
AJaegerpabelanger: that's going down nicely, great13:06
*** shardy_lunch is now known as shardy13:08
*** links has quit IRC13:08
*** jcoufal has joined #openstack-infra13:11
*** zz_dimtruck is now known as dimtruck13:12
fungimake sure to give #openstack-release a heads up that they should probably avoid approving new releases until replication catches up again13:12
*** mat128 has quit IRC13:12
* fungi is working from a laggy/lossy wireless modem for the first part of his day, but hopes to be home again in time for the storyboard meeting at 1900z13:13
*** kgiusti has joined #openstack-infra13:13
*** isaacb_ has quit IRC13:13
pabelangergood call13:13
*** esberglu has joined #openstack-infra13:15
*** GeraldK has joined #openstack-infra13:15
kaisers1AJaeger: pabelanger: thanks for bringing this back up to speed. I'll kick our CIs to pick up the missing changes...13:16
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci master: WIP -- post upgrade ci test for checking the upgrade_batch reviews  https://review.openstack.org/45351513:16
*** amoralej is now known as amoralej|lunch13:17
GeraldKHi there, the OpenStack Product Team (https://wiki.openstack.org/wiki/ProductTeam) has agreed to change their terminology from "user story" to "development proposal" and thus would like to also update their git repo https://github.com/openstack/openstack-user-stories/ accordingly. Can you provide some recommendations on what would be the best way to do this?13:17
*** mdrabe has joined #openstack-infra13:17
*** chlong has joined #openstack-infra13:17
*** liusheng has quit IRC13:17
GeraldKsee also https://storyboard.openstack.org/#!/story/200096613:17
*** liusheng has joined #openstack-infra13:18
AJaegerkaisers1: wait a few minutes, processes still running13:18
openstackgerritJiri Stransky proposed openstack-infra/project-config master: Use OOOQ featureset for container upgrades job  https://review.openstack.org/44920313:19
pabelangerGeraldK: you are wanting to change the git repo description?13:19
AJaegerGeraldK: https://docs.openstack.org/infra/manual/creators.html#project-renames13:19
pabelangerOh13:19
AJaegerGeraldK: if you speak about renaming the repo ^13:19
pabelangerya, that will need a rename13:19
AJaegerGeraldK: renaming repos needs a gerrit downtime of several hours, we schedule them a few times a year.13:20
*** Goneri has joined #openstack-infra13:20
*** xyang1 has joined #openstack-infra13:20
openstackgerritKaitlin Farr proposed openstack-infra/project-config master: Add api-ref-jobs to Barbican  https://review.openstack.org/45362613:21
*** chem` is now known as chem13:21
GeraldKAJaeger: yes. it is not about renaming the project, but "just" renaming the repo13:21
GeraldKAJaeger: do you known when the next such maintenance window will take place?13:22
*** prateek_ has joined #openstack-infra13:23
*** cshastri_ has joined #openstack-infra13:23
AJaegerGeraldK: renaming the git repo is hard. The project is not a problem ;)13:23
*** dhajare_ has joined #openstack-infra13:23
*** psachin_ has joined #openstack-infra13:23
*** chkumar246 has joined #openstack-infra13:23
AJaegerGeraldK: none scheduled yet. Prepare everything and add yourself to our list so that we can schedule it...13:23
*** derekh has quit IRC13:24
*** prateek__ has joined #openstack-infra13:25
*** knangia has joined #openstack-infra13:25
GeraldKAJaeger: okay. you are talking about the ML? As you mentioned gerrit downtime, should I re-assign the story to project "openstack-infra/gerrit"13:25
*** prateek has quit IRC13:26
*** cshastri has quit IRC13:26
AJaegerGeraldK: leave the story with your team. But read the docs link I gave you and follow it.13:26
*** chandankumar has quit IRC13:26
*** psachin has quit IRC13:26
AJaegerGeraldK: especially: Create a gerrit change and add it to our tracking wiki13:26
*** dhajare has quit IRC13:27
*** cshastri_ has quit IRC13:27
*** prateek_ has quit IRC13:28
*** mkoderer has joined #openstack-infra13:28
*** psachin_ has quit IRC13:28
GeraldKAJaeger: okay. thanks. I will discuss with the team and create a gerrit change13:28
*** dhajare_ has quit IRC13:28
*** chkumar246 has quit IRC13:28
*** xhku_ has quit IRC13:32
*** prateek_ has joined #openstack-infra13:32
*** psachin_ has joined #openstack-infra13:32
*** fbouliane has joined #openstack-infra13:32
*** chkumar246 has joined #openstack-infra13:33
*** prateek has joined #openstack-infra13:35
*** prateek__ has quit IRC13:35
*** chkumar246 has quit IRC13:37
*** psachin_ has quit IRC13:37
*** prateek_ has quit IRC13:37
*** vikrant has joined #openstack-infra13:38
*** dhajare_ has joined #openstack-infra13:39
*** cshastri_ has joined #openstack-infra13:40
*** tosky has quit IRC13:42
openstackgerritNoam Angel proposed openstack/diskimage-builder master: Move do_extra_package_install to run in install phase  https://review.openstack.org/45265313:42
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: DO NOT REVIEW: testing tempest for oooq  https://review.openstack.org/45305913:44
*** ihrachys has joined #openstack-infra13:44
*** jamesdenton has joined #openstack-infra13:45
*** tosky has joined #openstack-infra13:45
pabelangerAJaeger: replication is caught up13:46
*** prateek_ has joined #openstack-infra13:46
*** cshastri__ has joined #openstack-infra13:46
*** dhajare__ has joined #openstack-infra13:46
*** rbrndt has joined #openstack-infra13:46
*** rossella_s has quit IRC13:47
*** chkumar246 has joined #openstack-infra13:47
*** rossella_s has joined #openstack-infra13:47
*** chkumar246 is now known as chandankumar13:48
*** prateek__ has joined #openstack-infra13:48
*** dimtruck is now known as zz_dimtruck13:48
*** baoli has joined #openstack-infra13:48
*** gcb has joined #openstack-infra13:48
*** psachin_ has joined #openstack-infra13:49
*** cshastri_ has quit IRC13:49
*** dhajare_ has quit IRC13:49
*** prateek has quit IRC13:49
*** cshastri__ has quit IRC13:50
*** pblaho has joined #openstack-infra13:50
*** dhajare__ has quit IRC13:50
*** alexchadin has joined #openstack-infra13:51
*** prateek_ has quit IRC13:51
*** prateek__ has quit IRC13:51
*** tonytan4ever has joined #openstack-infra13:55
openstackgerritMerged openstack-infra/shade master: Add ability to configure extra_specs to be off  https://review.openstack.org/45256813:56
*** amoralej|lunch is now known as amoralej13:57
*** ym200 has quit IRC13:57
*** dtantsur|brb is now known as dtantsur14:00
AJaegerpabelanger: great, let's put out a status update...14:01
*** kzaitsev_mb has joined #openstack-infra14:01
fungiGeraldK: i was willing to write up the project-config changes for the repository renames, mostly just looking for a decision from the wg on what would be an acceptable new name14:02
AJaeger#status log git.openstack.org is synced up14:02
openstackstatusAJaeger: finished logging14:02
*** dhajare__ has joined #openstack-infra14:02
fungiGeraldK: since i've been heavily involved in the imports from github, i don't mind driving the rename work too14:02
*** cshastri__ has joined #openstack-infra14:02
*** sree has joined #openstack-infra14:03
*** zul has quit IRC14:05
*** hongbin has joined #openstack-infra14:06
*** vikrant has quit IRC14:06
*** jistr is now known as jistr|mtg14:07
*** sree has quit IRC14:07
*** shardy is now known as shardy_mtg14:07
*** ym200 has joined #openstack-infra14:08
*** jascott1 has joined #openstack-infra14:10
*** cshastri__ is now known as cshastri14:12
*** ym200 has quit IRC14:13
*** jascott1 has quit IRC14:15
*** ym200 has joined #openstack-infra14:17
*** zz_dimtruck is now known as dimtruck14:17
*** ym200 has quit IRC14:21
*** zul has joined #openstack-infra14:22
*** john-davidge has quit IRC14:23
sdaguefungi / pabelanger - anyone want to approve this systemd support d-g change - https://review.openstack.org/#/c/44931114:30
*** nmathew has quit IRC14:30
*** eharney has quit IRC14:30
*** derekh has joined #openstack-infra14:32
fungii'm heading into a black hole again for the next few hours (driving home)14:33
fungiback in a while14:33
*** dprince has joined #openstack-infra14:34
*** erikmwilson has joined #openstack-infra14:34
openstackgerritMichal Ptacek proposed openstack-infra/project-config master: Fixing small typo in collectd-ceilometer-plugin.yaml  https://review.openstack.org/45367214:35
*** ym200 has joined #openstack-infra14:37
*** erikmwil_ has quit IRC14:37
*** rbrndt has quit IRC14:38
*** rbrndt has joined #openstack-infra14:38
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: combined OVB ha and non-ha job  https://review.openstack.org/45313514:39
*** eharney has joined #openstack-infra14:40
*** armax has joined #openstack-infra14:41
GeraldKfungi: thanks!14:46
*** zul_ has joined #openstack-infra14:47
*** makowals has quit IRC14:47
*** marst has quit IRC14:48
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add repository for project navigator data  https://review.openstack.org/45369014:48
mordredttx: how's that look ^^ ?14:48
*** Julien-zte has quit IRC14:49
*** Julien-zte has joined #openstack-infra14:50
*** marst has joined #openstack-infra14:57
*** smarcet has joined #openstack-infra14:58
openstackgerritMonty Taylor proposed openstack/os-client-config master: Add ability to pass in user_agent  https://review.openstack.org/45255014:58
*** zul_ has quit IRC14:59
*** Julien-z_ has joined #openstack-infra15:01
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Add trigger developer doc  https://review.openstack.org/45369515:01
*** Julien-zte has quit IRC15:01
*** rossella_s has quit IRC15:02
*** xarses has joined #openstack-infra15:02
*** nadya has quit IRC15:02
*** tie has quit IRC15:02
*** nadya has joined #openstack-infra15:03
*** chlong has quit IRC15:03
*** andreww has joined #openstack-infra15:03
*** alexchadin has quit IRC15:04
*** chlong has joined #openstack-infra15:04
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Enabling oooq jobs to be consumed by openstack-health  https://review.openstack.org/45369815:04
jlvillalReview request: https://review.openstack.org/448786  Highlight POST_FAILURE same as FAILURE on Gerrit page15:04
ttxmordred: +115:05
ttxthanks15:05
*** dharinic has joined #openstack-infra15:06
*** xarses has quit IRC15:06
*** armax has quit IRC15:07
*** nadya has quit IRC15:07
*** cshastri has quit IRC15:09
*** mdrabe has quit IRC15:13
*** psachin_ has quit IRC15:14
*** kzaitsev_mb has quit IRC15:14
*** rossella_s has joined #openstack-infra15:14
*** tie has joined #openstack-infra15:17
*** tongli has quit IRC15:17
*** mdrabe has joined #openstack-infra15:20
*** chlong has quit IRC15:21
*** shardy_mtg is now known as shardy15:21
*** john-davidge has joined #openstack-infra15:23
*** ccamacho is now known as ccamacho|afk15:24
openstackgerritClark Boylan proposed openstack-infra/puppet-gerrit master: Small comment cleanup  https://review.openstack.org/45370915:27
smarcetfungi: morning, could u review , when u have free time, this one https://review.openstack.org/#/c/453707/1?15:27
smarcetfungi; i would like to apply only to openstackid-dev first15:27
smarcetand then to production15:28
clarkbhrm gerrit bot didn't notify about https://review.openstack.org/45370815:28
*** rbuzatu has quit IRC15:28
clarkbzaro: ^ fyi I pushed that up so we can do the automated upgrade15:28
*** john-davidge has quit IRC15:29
*** rustlebee is now known as russellb15:29
*** russellb has quit IRC15:29
*** russellb has joined #openstack-infra15:29
*** dhajare__ has quit IRC15:30
*** rbuzatu has joined #openstack-infra15:30
*** Julien-z_ has quit IRC15:31
openstackgerritNakul Dahiwade proposed openstack-infra/project-config master: Enabling (Adding) Octavia to SDK gate.  https://review.openstack.org/45326315:31
*** Julien-zte has joined #openstack-infra15:31
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Clarify TriggerInterface documentation  https://review.openstack.org/45371315:31
*** hashar has quit IRC15:31
*** mtanino has quit IRC15:31
*** Julien-zte has quit IRC15:31
*** Julien-zte has joined #openstack-infra15:32
*** Julien-zte has quit IRC15:32
*** ggnel_t has quit IRC15:33
*** rbuzatu_ has joined #openstack-infra15:33
*** Julien-zte has joined #openstack-infra15:33
*** hashar has joined #openstack-infra15:33
*** annegentle has joined #openstack-infra15:33
*** Julien-zte has quit IRC15:33
*** Julien-zte has joined #openstack-infra15:33
*** hashar has quit IRC15:34
*** Julien-zte has quit IRC15:34
*** chlong has joined #openstack-infra15:35
*** rbuzatu has quit IRC15:35
*** markus_z has quit IRC15:35
openstackgerritClark Boylan proposed openstack-infra/system-config master: Upgrade review-dev to Gerrit 2.13.7  https://review.openstack.org/45371415:36
clarkbzaro: and ^ bumps the war to the 2.13.7 version based on those h2 cherry picks15:36
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci master: Remove the old hiera hook from upgrade workflow  https://review.openstack.org/45371515:37
*** tie has quit IRC15:37
*** Sukhdev has joined #openstack-infra15:39
*** jistr|mtg is now known as jistr15:40
clarkbinfra-root upgrade process thought time. Reading the puppet module for gerrit I am fairly certain we've already fully automated the required steps for upgrading from 2.11 to 2.13 (gerrit init for db schema update and offline reindex). Concern with this is an offline reindex is likely to take many hours (which pupept won't like and will probably time out on). Should I make the puppet exec timeout15:42
clarkbextremely long or should we plan for doing a manual upgrade rather than have puppet do it?15:42
clarkbrelated to this, we probably also want to look at the db migration details for potential roll back?15:42
cmurphylooks like you can disable the timeout too https://docs.puppet.com/puppet/3.8/type.html#exec-attribute-timeout15:45
cmurphymight be good if you don't know how long to expect15:45
mordredclarkb: I think trying with disabling timeout would be good - but also we should clearly trigger it manually so we can watch15:45
jeblairclarkb: my personal preference would be to run it manually to see the output.15:46
*** shrircha has joined #openstack-infra15:46
jeblair(i just imagine us spending 6 hours wondering what it's doing under there :)15:46
*** aarefiev is now known as aarefiev_afk15:46
clarkbI guess another option is to go to 2.12 temporarily while online indexing happens but I expect that will make the whole process much longer15:47
*** vfabio has joined #openstack-infra15:49
clarkbjeblair: ya, I personally prefer doing it in the foreground for this reason. Also zaro was talking about mocking up production data and doing a reindex on the dev server to see how long it would really take. But I expect ~4-6 hours given previous reindex experiences15:50
*** GeraldK has quit IRC15:51
openstackgerritJavier Peña proposed openstack-infra/zuul master: Find fallback branch in zuul-cloner  https://review.openstack.org/44237015:52
*** kjorgensen has joined #openstack-infra15:55
*** rockyg has joined #openstack-infra15:55
openstackgerritSean Dague proposed openstack-infra/os-loganalyze master: Remove swift support  https://review.openstack.org/45231615:56
*** vhosakot has joined #openstack-infra15:57
*** kzaitsev_mb has joined #openstack-infra15:57
*** nadya has joined #openstack-infra15:57
*** andreas_s has quit IRC15:58
*** lucasagomes is now known as lucas-afk16:00
*** Apoorva has joined #openstack-infra16:00
*** jascott1 has joined #openstack-infra16:02
*** jascott1- has joined #openstack-infra16:02
*** shardy is now known as shardy_afk16:02
*** funzo has joined #openstack-infra16:03
*** jkilpatr_ has joined #openstack-infra16:04
*** jkilpatr has quit IRC16:06
*** rossella_s has quit IRC16:08
*** vfabio has quit IRC16:09
*** fverboso has joined #openstack-infra16:10
*** john-davidge has joined #openstack-infra16:12
*** martinkopec has quit IRC16:13
*** kgiusti has quit IRC16:13
*** smarcet has quit IRC16:13
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Include IP address in SSH host key  https://review.openstack.org/45373416:14
*** ijw has joined #openstack-infra16:15
*** pblaho has quit IRC16:15
*** kgiusti has joined #openstack-infra16:15
*** cody-somerville has joined #openstack-infra16:16
*** ijw_ has joined #openstack-infra16:16
*** Gravious has quit IRC16:16
pabelangerfungi: security was me again16:16
*** john-davidge has quit IRC16:17
*** armax has joined #openstack-infra16:17
*** ijw has quit IRC16:19
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Enabling oooq jobs to be consumed by openstack-health  https://review.openstack.org/45369816:20
*** pt_15 has joined #openstack-infra16:21
*** itisha has joined #openstack-infra16:21
*** ym200 has quit IRC16:22
*** nmathew has joined #openstack-infra16:23
*** nmathew has quit IRC16:23
*** florianf has quit IRC16:24
*** esberglu has quit IRC16:24
*** esberglu has joined #openstack-infra16:24
*** gcb has quit IRC16:25
*** ijw_ has quit IRC16:26
*** armax has quit IRC16:27
*** jpich has quit IRC16:28
*** marst has quit IRC16:28
*** esberglu has quit IRC16:29
*** dizquierdo has quit IRC16:29
*** amotoki has quit IRC16:29
*** matrohon has quit IRC16:30
*** ym200 has joined #openstack-infra16:30
*** armax has joined #openstack-infra16:31
*** mtanino has joined #openstack-infra16:31
*** cody-somerville has quit IRC16:31
*** shardy_afk is now known as shardy16:31
*** baoli has quit IRC16:33
*** kzaitsev_mb has quit IRC16:37
*** dimtruck is now known as zz_dimtruck16:40
*** zz_dimtruck is now known as dimtruck16:41
*** derekh has quit IRC16:41
*** esberglu has joined #openstack-infra16:43
*** tesseract has quit IRC16:43
*** baoli has joined #openstack-infra16:43
*** armax has quit IRC16:43
openstackgerritPaul Belanger proposed openstack-infra/zuul feature/zuulv3: Add host IP address to host_keys  https://review.openstack.org/45376516:45
*** marst has joined #openstack-infra16:47
openstackgerritSean Dague proposed openstack-infra/os-loganalyze master: Remove swift support  https://review.openstack.org/45231616:53
sdaguemordred: I think I finally fixed the unit tests, boo for extra local files16:53
mordredsdague: awesome16:53
*** Swami has quit IRC16:54
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Use ssh for git-upload-pack  https://review.openstack.org/43680216:56
*** Sukhdev has quit IRC16:58
*** Sukhdev has joined #openstack-infra16:59
sbezverkfungi: if the job gets stuck and then killed by time expiration, there is no logs helping to understand what went wrong. Is there any way to collect at least something for this scenario?17:01
*** jascott1 has quit IRC17:01
*** jascott1- is now known as jascott117:01
*** shardy has quit IRC17:03
*** gus has quit IRC17:04
*** jamielennox has quit IRC17:04
*** baoli_ has joined #openstack-infra17:05
*** gus has joined #openstack-infra17:05
*** baoli_ has quit IRC17:07
*** baoli has quit IRC17:07
*** jamielennox has joined #openstack-infra17:07
*** kjorgensen has quit IRC17:08
*** jaosorior is now known as jaosorior_away17:08
*** baoli has joined #openstack-infra17:13
*** fverboso has quit IRC17:14
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Store project name in ref-replicated events  https://review.openstack.org/45379617:17
openstackgerritClark Boylan proposed openstack-infra/nodepool feature/zuulv3: Start adding operational docs to zuulv3  https://review.openstack.org/45379717:18
openstackgerritClark Boylan proposed openstack-infra/nodepool feature/zuulv3: Start adding operational docs to zuulv3  https://review.openstack.org/45379717:22
*** rockyg has quit IRC17:23
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove source from pipelines  https://review.openstack.org/45336217:23
*** rbrndt has quit IRC17:26
*** rockyg has joined #openstack-infra17:26
*** rossella_s has joined #openstack-infra17:28
*** tosky has quit IRC17:33
*** sambetts is now known as sambetts|afk17:33
*** kzaitsev_mb has joined #openstack-infra17:34
*** smarcet has joined #openstack-infra17:34
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Combined OVB ha and non-ha job  https://review.openstack.org/45313517:35
*** Swami has joined #openstack-infra17:35
*** rossella_s has quit IRC17:36
*** nadya has quit IRC17:37
*** HeOS has quit IRC17:38
*** nadya has joined #openstack-infra17:38
*** jtomasek has quit IRC17:38
openstackgerritClark Boylan proposed openstack-infra/nodepool feature/zuulv3: Fix internal doc refs to renamed section  https://review.openstack.org/45380217:38
openstackgerritChhavi Agarwal proposed openstack/diskimage-builder master: WIP: Enabling DIB for RHEL7 PPC64le  https://review.openstack.org/45380317:39
*** ssbarnea has quit IRC17:39
*** armax has joined #openstack-infra17:39
*** jerryz has joined #openstack-infra17:40
*** nadya has quit IRC17:42
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Automatically read both voting and non-voting forms of job  https://review.openstack.org/45380617:45
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Add multinode-upgrades scenario jobs to cistatus  https://review.openstack.org/45380717:45
*** ssbarnea has joined #openstack-infra17:46
*** kjorgensen has joined #openstack-infra17:49
*** Goneri has quit IRC17:53
*** dprince has quit IRC17:53
*** jkilpatr_ has quit IRC17:54
*** vhosakot_ has joined #openstack-infra17:55
*** vhosakot has quit IRC17:56
*** erikmwilson has quit IRC17:57
*** erikmwilson has joined #openstack-infra17:58
*** chem is now known as chem_gone17:59
*** tosky has joined #openstack-infra17:59
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Add hub.docker.com to reverse proxy cache  https://review.openstack.org/45381117:59
*** ym200 has quit IRC17:59
*** Apoorva_ has joined #openstack-infra18:01
mnaserpabelanger can't wait to do all sorts of horrible things ^ >:)18:02
mnaser:P18:02
*** Apoorva__ has joined #openstack-infra18:03
*** Apoorva_ has quit IRC18:03
*** sree has joined #openstack-infra18:04
*** Apoorva has quit IRC18:04
*** sshnaidm is now known as sshnaidm|afk18:06
*** dprince has joined #openstack-infra18:06
*** krtaylor has quit IRC18:07
openstackgerritDean Troyer proposed openstack-infra/project-config master: Add libs to OSC tips job  https://review.openstack.org/45381718:07
openstackgerritClark Boylan proposed openstack-infra/nodepool feature/zuulv3: Fix internal doc refs to renamed section  https://review.openstack.org/45380218:07
openstackgerritClark Boylan proposed openstack-infra/nodepool feature/zuulv3: Start adding operational docs to zuulv3  https://review.openstack.org/45379718:07
*** ralonsoh has quit IRC18:08
*** jkilpatr_ has joined #openstack-infra18:08
*** sree has quit IRC18:08
*** armax has quit IRC18:09
*** yonglihe has quit IRC18:09
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Add host IP address to host_keys  https://review.openstack.org/45376518:10
openstackgerritDean Troyer proposed openstack-infra/project-config master: Add libs to OSC tips job  https://review.openstack.org/45381718:11
*** nadya has joined #openstack-infra18:12
*** john-davidge has joined #openstack-infra18:13
*** pots has joined #openstack-infra18:14
*** jascott1_ has joined #openstack-infra18:15
*** jaypipes has quit IRC18:16
*** john-davidge has quit IRC18:17
*** armax has joined #openstack-infra18:18
*** dtardivel has quit IRC18:20
*** pvaneck has joined #openstack-infra18:20
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove source from pipelines  https://review.openstack.org/45336218:24
*** Sukhdev has quit IRC18:25
*** pt_15 has quit IRC18:25
jesusauris zuul and/or nodepool having a sad? I got several RETRY_LIMITs not too long ago18:26
AJaegerpabelanger: could yo ureview ianw 's change https://review.openstack.org/#/c/453322/ , please?18:26
*** pvaneck has quit IRC18:28
*** ijw has joined #openstack-infra18:29
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove source from pipelines (1/2)  https://review.openstack.org/45336218:30
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove source from pipelines (2/2)  https://review.openstack.org/45382118:30
clarkbjesusaur: usually that means the job is crashing hard enough that the zuul launcher can't talk to the test node anymore and its happening repeatedly18:30
Shrewsjesusaur: i think pabelanger has a change up to fix that18:31
clarkbjesusaur: just skimming zuul status I don't see it happening all over, is it possible that your change is touching ssh/networking/system stuff in a way that could berak the job?18:31
*** nadya has quit IRC18:31
jesusaurclarkb: not likely, it's my zuul change for handling merge conflicts18:32
*** nadya has joined #openstack-infra18:32
*** harlowja has quit IRC18:33
clarkbjesusaur: have a link? if its zuul not jenkins reporting then its likely what shrews says, the ssh known hosts fix that pabelanger fixed18:33
*** HeOS has joined #openstack-infra18:33
*** ijw has quit IRC18:34
pabelangerjesusaur: ya, just zuulv3-dev.o.o is sadface18:35
jesusauroh, it's just the zuulv3 jobs that hit that18:35
jesusaurhttps://review.openstack.org/#/c/446275/18:35
jesusauri misread gertty as jenkins also reporting that18:36
*** cody-somerville has joined #openstack-infra18:36
*** cody-somerville has joined #openstack-infra18:36
*** nadya has quit IRC18:37
*** hashar has joined #openstack-infra18:37
*** amoralej is now known as amoralej|off18:41
*** pvaneck has joined #openstack-infra18:42
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Store project name in ref-replicated events  https://review.openstack.org/45379618:45
openstackgerritClark Boylan proposed openstack-infra/project-config master: Write mirror host location if mirror is in use  https://review.openstack.org/45382818:45
clarkbmordred: pabelanger ^ can you review that? I want to say we have poked at similar things in the past and want to make sure I'm not reinventing a wheel I don't see and/or not going about that in a silly way18:46
mordredclarkb: looking18:47
mordredclarkb: I thnk that's great - +2 from me18:48
clarkbbut then we can make the d-g network checks fail the job early again18:50
clarkband it will simplify some of the proposed UCA work in devstack I've got going on as well as the use reverse proxy logic in puppet/triplo18:50
*** krtaylor has joined #openstack-infra18:51
*** electrofelix has quit IRC18:52
*** ldnunes has quit IRC18:53
*** ldnunes has joined #openstack-infra18:54
*** jascott1_ has quit IRC18:55
pabelangerclarkb: https://review.openstack.org/#/c/339261 was my idea, but fungi expressed concern about the location.  We that way, jobs could just source the file and get our vars18:55
*** cody-somerville has quit IRC18:56
clarkbpabelanger: fungi oh neat, I think I would just write it to /etc/nodepool/mirror_info or similar18:56
pabelangerclarkb: we still have http://mirror.ca-ymq-1.vexxhost.openstack.org/ online, so I am going to test hub.docker.com proxy with that18:56
clarkbpabelanger: soudns good18:56
pabelangerbefore we land our patch18:56
pabelangerclarkb: ya, I would be okay with that18:57
clarkbpabelanger: fungi: but I think we need something that at the very least includes the mirror host so that we can patch up d-g and generally know if a mirror is expected to be in use18:57
clarkbhappy to clean up pabelanger's thing too if we can decide on a location18:57
*** cody-somerville has joined #openstack-infra18:57
mordredpabelanger: when you test it, could you point me at an example of how you did?18:58
mordredpabelanger: I'd love to grok telling docker to talk to a mirror,and I don't currently grok that18:58
*** Sukhdev has joined #openstack-infra18:58
clarkbmordred: my reading of docs is you don't really tell it use mirror so much as use a "full" path to an image19:00
clarkbbut you also don't specify protocol so its not a proper url but its basically a url19:00
*** sree has joined #openstack-infra19:01
*** Apoorva__ has quit IRC19:02
*** csomerville has joined #openstack-infra19:03
*** cody-somerville has quit IRC19:03
*** Apoorva has joined #openstack-infra19:03
mordredclarkb: I _think_ there is a way to start docker-machine with an option to tell it what registry to use19:04
mordredso that whenyou say docker run ubuntu19:04
mordreddocker-machine (Which is the thing that does the fetching for you) knows to contact the registry url you gave it19:04
*** sree has quit IRC19:05
*** armax has quit IRC19:08
*** csomerville has quit IRC19:08
*** csomerville has joined #openstack-infra19:09
openstackgerritMerged openstack-infra/storyboard-webclient master: Fix search controller reloading when a text parameter is added  https://review.openstack.org/43670219:11
*** Goneri has joined #openstack-infra19:12
*** john-davidge has joined #openstack-infra19:13
*** csomerville has quit IRC19:14
*** cody-somerville has joined #openstack-infra19:16
*** cody-somerville has joined #openstack-infra19:16
*** john-davidge has quit IRC19:18
*** rockyg has quit IRC19:19
*** rkukura has quit IRC19:20
*** cody-somerville has quit IRC19:21
mtreinishjeblair, mordred, clarkb: do you have any thoughts on places that would be useful (and easy) to start adding mqtt support?19:22
*** bswartz has quit IRC19:22
clarkbmtreinish: gerrit event stream so that people can potentially avoid using ssh for third party ci (thinking websocket connection) then consume on zuul end19:22
mtreinishthe gerrit event stream is already there19:23
clarkbmtreinish: possibly replace 0mq with mqtt for the job event pub sub19:23
clarkbso that we can do post job run things like logstash more betterly19:23
mtreinishclarkb: I had a WIP for the zuul side a while ago, but jeblair said I should wait until after zuul v3 to keep pushing on it19:23
jeblair(the zuul support is planned but on hold due to v3)19:23
fungiclarkb: i agree with jeblair a manual gerrit upgrade would make me more comfortable given the sensitivity of the process and timeframes involved19:23
mtreinish(the wip probably didn't even come close to working)19:24
jeblairmtreinish: much obliged, thanks.  :)19:24
*** rfolco has quit IRC19:24
mtreinishclarkb: I do agree that's the big use case that makes this all useful :)19:24
*** cody-somerville has joined #openstack-infra19:24
clarkbmay make sense to emit nodepool actions to mqtt19:24
jeblair++ (much looking forward to it)19:25
mtreinishheh, we also need to fix/workaround the websockets issues we're hitting19:25
clarkbimage built, image deleted etc19:25
mtreinishclarkb: I can do that. It's probably pretty easy19:25
mtreinishclarkb: do you have pointers in the nodepool repo where I could call a publish function (haven't looked at that code much)19:25
clarkbthough we already emit stats via statsd, not sure how useful it would be to have it in mqtt19:25
openstackgerritMerged openstack-infra/tripleo-ci master: Don't hardcode /home/jenkins  https://review.openstack.org/43671919:25
clarkbmtreinish: you'd likely want to look at where statsd is called19:26
jeblairthat also puts a review load on the folks working on v3.19:26
jeblairnot as much as zuul would.  but something.19:26
sbezverkclarkb: any ideas about this question "if the job gets stuck and then killed by time expiration, there is no logs helping to understand what went wrong. Is there any way to collect at least something for this scenario?"19:26
jeblairsbezverk: the console log is always collected.  does it show you what was happening at the time?19:26
mtreinishclarkb: well statsd is aggregated having it on mqtt would let you interact with it individually (assuming that's something you want)19:27
clarkbsbezverk: you need to have your job time itself out before the larger job scope timeout so that logs can be collected before the instance is deleted. devstack-gate does this for you19:27
clarkbmtreinish: ya the aggregate stats info is useful, not sure how useful having individual events per instance/image would be19:27
*** csomerville has joined #openstack-infra19:28
jeblairclarkb, mtreinish: the logstash queue could be directly pushed onto by a post-playbook in v3.19:29
*** cody-somerville has quit IRC19:29
sbezverkjeblair: yes, but it does not give much deatils.. example having "messages" for centos or syslog for ubuntu would be very useful19:29
mtreinishjeblair: so have zuul submit jobs directly to the log worker gearman queue and remove the logstash-client completely?19:30
*** mdrabe_ has joined #openstack-infra19:30
*** rbrndt has joined #openstack-infra19:31
*** mdrabe has quit IRC19:31
clarkbmy only concern with that is it would more tightly couple the tools (but 0mq such a pain that maybe we just tell people its not worth having a pub sub of events)19:31
*** ijw has joined #openstack-infra19:31
jeblairmtreinish: yeah; assuming i'm not forgetting something else important it's doing.  :)  but i think zuul should be able to know what jobs need to do that and what files there are...19:31
jeblairyeah, i'm kind of proceeding on 2 forks here:19:31
jeblair1) pub-sub in and out of zuul are great and we should have mqtt in lots of places19:32
clarkbI think generally having a read only pub sub is useful for many things. Implementing it with 0mq is sadness (current reality). Specific things like logstash may want to just be enqueued directly rather than be part of anonymous pubsub19:32
jeblair2) zuul v3 is also designed to be able to be flexible enough to drive more system integrations than we are used to in v2, and it ought to be able to do this sort of thing on its own.19:32
*** csomerville has quit IRC19:33
jeblair(also, it lets us avoid blocking v3 on mqtt, which is currently on the post-v3.0 side of the roadmap)19:34
pabelangerwoah19:34
*** ldnunes has quit IRC19:34
pabelangerclarkb: mordred: think I got it working19:35
pabelangerhttp://paste.openstack.org/show/605553/19:35
clarkbjeblair: on potential gotcha is that you have to keep the gearman client running iirc and the jobs can take a while to index19:35
clarkbbut we can probably have the worker side enqueue separate of the gearman context and be more fire and forget19:35
*** csomerville has joined #openstack-infra19:35
pabelangerclarkb: mordred: http://paste.openstack.org/show/605555/ dockerd settings19:36
clarkbpabelanger: now look in /opt/apache_cache and you should see things19:36
*** ijw has quit IRC19:36
clarkbpabelanger: look at size of /opt/apache_cache I'm guessing the file size limit of 100MB is too small currently for whatever docker image you grabbed19:37
mtreinishjeblair: fwiw, I think it should be a very simple patch to add mqtt to zuul (on both the publish and subscribe sides)19:37
clarkbpabelanger: you might try bump that up to 1GB and then try again19:37
mtreinishsince the mechanisms for doing what we're using mqtt for are already there, it's mostly mechanical and just the mqtt client here instead of the other thing19:37
pabelangerclarkb: fedora:24 is 72.88 MB19:37
pabelangerso, should see something now19:37
pabelangerunless the images are some other URL19:38
sbezverkclarkb: got it, but the problem I see from time to time, the gate job gets stuck within a process, example a binary waiting for something. I do not see easy way to time it, Any dieas?19:38
clarkbpabelanger: du says 120K in /opt/apache_cache19:38
clarkbsbezverk: we use `timeout` in the outer context19:38
clarkbsbezverk: you are right that if a process is down on a write then it won't come up to handle the signal until potentially later19:39
pabelanger1 sec19:39
jeblairmtreinish: i agree, though we're near the end of a big refactoring of the 'plugin' interface which i think it should use, so the v2 patch would be a lot different than the v3.19:39
clarkbsbezverk: if you use devstack-gate this should be handled for you19:40
*** ym200 has joined #openstack-infra19:40
mtreinishclarkb, jeblair: but besides nodepool (and eventually zuul) were there any other services you think I could easily tack onto: https://review.openstack.org/#/q/status:open+topic:more-firehose19:40
mtreinishjeblair: sure, that would probably end up making it much cleaner than the if switch on conf that I was thinking of :)19:41
*** csomerville has quit IRC19:41
jeblairclarkb, mtreinish: re clarkb's gotcha: yeah, we may well want to move logstash stuff to mqtt in the long run.  my ultraconservative sysadmin side likes the idea of doing that after the v3 move for now though.  i think we'll have the flexibility to do that.19:42
*** cody-somerville has joined #openstack-infra19:42
jeblairmtreinish: yeah, there's a driver interface with [some] documented(!) api methods and stuff.  it's like real computering.  :)19:42
pabelangerclarkb: I think we are getting redirected19:42
clarkbpabelanger: redirects should be rewritten by the proxypassreverse definition as long as they are in the same domain19:43
sbezverkclarkb: no, it is kolla-kubernetes gate..19:43
clarkbsbezverk: ok then you'll need to implement similar there. We use 5 minutes less than the job timeout as the inner timeout in devstack-gate19:43
clarkbsbezverk: as an alternative you could set up your job to use devstack-gate and get all of this for free19:44
*** rbuzatu_ has quit IRC19:45
*** rbuzatu has joined #openstack-infra19:46
mtreinishclarkb: is there a reason why nodepool uses env vars for the statsd config instead of the config file?19:46
clarkbmtreinish: thats how the statsd lib works iirc19:47
jeblairwe can/should switch it in v319:47
*** rbuzatu_ has joined #openstack-infra19:47
*** cody-somerville has quit IRC19:47
mtreinishclarkb: no, it takes them as args to the client constructor (just wrote a bunch of statsd code)19:47
jeblair(newer statsd has/prefers real api configuration; and it confuses people from time to time)19:47
*** oanson has quit IRC19:47
clarkbmtreinish: ok it used to read them from the env on lib import19:48
jeblairmtreinish: yeah, our statsd usage is *old* where env vars was the preferred way.  also, it seemed like a good idea at the time.  :)19:48
*** csomerville has joined #openstack-infra19:48
mtreinishclarkb: and looking at the nodepool code you create a dict after pulling the env vars and passes that dict as kwargs to statsd19:48
mtreinishah, ok it's historical. I wouldn't have known that :)19:48
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: support github pull reqeust labels  https://review.openstack.org/44451119:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Allow github trigger to match on branches/refs  https://review.openstack.org/44562519:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Set filter according to PR/Change in URL  https://review.openstack.org/44678219:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Add support for requiring github pr head status  https://review.openstack.org/44939019:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Support for dependent pipelines with github  https://review.openstack.org/44529219:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Add basic Github Zuul Reporter.  https://review.openstack.org/44332319:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Configurable SSH access to GitHub  https://review.openstack.org/44403419:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Add 'push' and 'tag' github webhook events.  https://review.openstack.org/44394719:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Add 'pr-comment' github webhook event  https://review.openstack.org/44395919:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Support for github commit status  https://review.openstack.org/44406019:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Better merge message for GitHub pull reqeusts  https://review.openstack.org/44564419:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Query changes only via relevant sources  https://review.openstack.org/44825719:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Encapsulate determining the event purpose  https://review.openstack.org/44524219:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Allow using webapp from connections  https://review.openstack.org/43983119:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Merge pull requests from github reporter  https://review.openstack.org/44446319:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Add support for github enterprise  https://review.openstack.org/44925819:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Support GitHub PR webhooks  https://review.openstack.org/43983419:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: GitHub file matching support  https://review.openstack.org/44611319:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Add trigger capability on github pr review  https://review.openstack.org/44936519:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Log GitHub API rate limit  https://review.openstack.org/44615019:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Adds github triggering from status updates  https://review.openstack.org/45384419:49
openstackgerritJesse Keating proposed openstack-infra/zuul feature/zuulv3: Implement pipeline requirement on github reviews  https://review.openstack.org/45384519:49
openstackgerritdane-fichter proposed openstack-infra/project-config master: Add barbican-tempest-plugin tests to Cursive  https://review.openstack.org/45295019:49
*** rbuzatu has quit IRC19:50
pabelangerclarkb: Location: https://dseasb33srnrn.cloudfront.net/registry-v2/docker/registry/v2/blobs19:50
pabelangerso, must be getting kicked to a CND19:51
pabelangerCDN*19:51
clarkbya looks like it19:51
pabelangerlet me try something19:51
*** rbuzatu_ has quit IRC19:51
*** oanson has joined #openstack-infra19:55
*** harlowja has joined #openstack-infra19:58
*** ricardoas has left #openstack-infra20:00
*** pcaruana has quit IRC20:01
mtreinishclarkb: I'm trying to figure out the best way to get the mqtt client config into nodepool, any suggestions?20:02
*** marst_ has joined #openstack-infra20:03
mtreinishI started by having it get passed a config parser namespace object and it would just read that, but I found that ini is really only used for db (and jenkins creds)20:03
*** marst has quit IRC20:03
mordredpabelanger: sweet! that seems awesome20:03
clarkbfungi: can you chime in on 339261 idea of putting it in /etc/nodepool/mirror_info or similar so that its more static?20:03
clarkbfungi: mostly want to get something like that in place as we keep needing that info more directly in jobs20:04
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Add ability to set an insecure prefix/suffix  https://review.openstack.org/45385120:05
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Create wrapper script for executor  https://review.openstack.org/45385220:05
fungiclarkb: yeah, it seemed like a fine idea to me, but it's abandoned currently so i didn't leave any followup comment there20:05
clarkbpabelanger: I'm happy to unabandon if you want20:05
mordredpabelanger: oh gross! (to the CDN piece)20:07
openstackgerritMerged openstack-infra/puppet-openstackid master: Apache/PHP configuration tweaks  https://review.openstack.org/45370720:09
pabelangerclarkb: sure20:09
pabelangermordred: ya, going to read up on rewrite rules and proxy20:09
*** annegentle has quit IRC20:10
mordredpabelanger: I believe you might wind up needing proxy_pass and proxy_pass_reverse? but I'll let you read ...20:11
mordredpabelanger: silly docker people writing a DISTRIBUTED system!20:11
mordredpabelanger: however, this may wind up being an argument for a pull-through registry20:12
*** jamielennox is now known as jamielennox|away20:12
clarkbmordred: distributed is fine, typically you'd put DNS in front of the CDN though20:12
clarkbmordred: then CDN would call into your backend as necessary?20:12
clarkbguessing its an object store CDN of some sort so not doing full on backend proxying20:13
pabelangerclarkb: mordred: well, docker is using amazon cloudfront for the CDN, so it might be straightforward to add that to our list of things to cache20:15
*** ccamacho|afk has left #openstack-infra20:15
clarkbpabelanger: ya you'd just have to watch out for the hmac'd domain name changing if that change containers or similar20:15
*** liusheng has quit IRC20:16
*** liusheng has joined #openstack-infra20:17
pabelangerk20:17
pabelangerneed some food first20:17
mordredpabelanger: how did you get logs from the docker daemon20:18
mordred?20:18
pabelangermordred: tcpdump :)20:18
*** ricardoas has joined #openstack-infra20:18
mordredhahaha20:18
pabelangerI haven't figured out how to increase the debugging on the fetching20:18
mordredpabelanger: journalctl -u docker.service20:19
mordredhrm. yah - that doesn't have the fetching20:19
pabelangermordred: ya, I don't imagine many people do it this way20:20
*** armax has joined #openstack-infra20:20
mordredpabelanger: add debug: true to daemon.json20:21
mordredApr 05 15:21:10 solace dockerd[26569]: time="2017-04-05T15:21:10.997837745-05:00" level=debug msg="Trying to pull fedora from https://registry-1.docker.io v2"20:21
*** Sukhdev has quit IRC20:21
mordredApr 05 15:21:12 solace dockerd[26569]: time="2017-04-05T15:21:12.581893366-05:00" level=debug msg="Pulling ref from V2 registry: fedora:latest"20:21
mordredpabelanger: (I set up a local pull-through registry and am testing thatit does what I think)20:22
pabelangermordred: k, let me do that too20:26
clarkbsdague: re your journald/systemd email looks like fungi approved the d-g change which will allow you to flip that over to default in gate20:27
fungismarcet: sorry i've been on the road most of today. i've disabled puppet updates for openstackid.org production, approved 453707 and enabled puppet updates for openstackid-dev again. looks like it's applied there now so should be safe to proceed with testing20:28
fungiclarkb: sdague: yep, did once i got home a while ago20:29
mordredpabelanger: https://gist.github.com/emonty/1c7846b6623057012d605ccad499ceec there's my two config files20:30
clarkbsdague: I'm also going to work on cleaning up the UCA enablement patch so that we can get that in as I haven't heard opposition to the idea and some peopel seem interested20:30
mordredpabelanger: first one is in /etc/docker/daemon.json - second is /etc/docker/registry/config.yml20:30
smarcetfungi: thx a lot20:30
*** kgiusti has left #openstack-infra20:32
*** trown is now known as trown|outtypewww20:35
fungismarcet: you bet. let me know if you need anything else there20:36
*** mdrabe__ has joined #openstack-infra20:36
*** mdrabe_ has quit IRC20:37
sdagueclarkb: I do expect we're going to break some plugins being creative, so I wanted to make sure to give people some opt in time20:37
fungismarcet: about the only thing which slightly worried me in that patch is dropping apache access logs, but we can still manually turn them on to briefly collect samples when needed if that's really bringing down system performance under heavy query load20:38
sdagueI also think that the wins start increasing after we get the oslo.log changes release20:38
sdagueclarkb: and, os-loganalyze is going to need to understand the formats, which are slightly different20:39
pabelangermordred: clarkb: okay, I think I have the redirect proxying: http://paste.openstack.org/show/605563/20:39
mordredpabelanger: neat!20:39
mordredpabelanger: what did your config need to look like?20:39
sdagueclarkb: speaking of which https://review.openstack.org/#/c/452316/ cleanup will help make it a little easier to do more with it later, just having less code to contemplate20:39
pabelangermordred: still just the json change I linked above20:40
pabelangerhowever, more complex apache2 vhost20:40
mordredpabelanger: I meant on the apache side :)20:40
pabelanger1 sec20:40
mordredpabelanger, clarkb: also, fwiw, if it works under mod_proxy it'll be better - using the registry pull-through cache option, there is no option to say "only cache 10G of data"20:40
pabelangerOh, 1 sec20:40
fungiyeah, curious to make sure it still avoids turning the server into a wide open proxy20:40
*** annegentle has joined #openstack-infra20:41
pabelangermordred: http://paste.openstack.org/show/605564/20:42
pabelangerbut, caching not working atm20:42
SamYaplemordred: yea there would need to be a cleaner job running to clean the registry20:42
smarcetfungi: yeah i turned off  to improvee response time , under a great peek of concurrent connections on summit time, we expect 2k/3k of concurrent request20:42
fungismarcet: i can imagine flushes for the apache access logs could introduce some additional overhead at those rates, so makes sense20:43
smarcetfungi: so my guess was to cut down any risk on that front20:43
*** rbuzatu has joined #openstack-infra20:43
fungiSamYaple: that's basically what we're doing anyway (apache has a tool to make that easy though and we call it hourly from cron)20:43
SamYaplefungi: right, but to mordred point, there is no "size limit" that we could put AND we would need a seperate running cleaner process (that we would need to write and/or fork, no good way to do this currently)20:44
fungiyup20:44
mtreinishfungi: there's been a interesting discussion on and off in the #mqtt irc channel today. Apparently libwebsockets has gotten really weird. Like apparently it has a standalone webserver included now. It also supports smtp natively20:45
*** rcernin has quit IRC20:45
mtreinishheh, I'm not really sure why lib is still in the name20:45
fungiuh20:45
fungiwow20:45
SamYaplemtreinish: libvirt has a similiar naming issue20:45
*** mdrabe__ is now known as mdrabe20:47
clarkbmordred: fun20:47
pabelangerI wonder if we are setup to cache octet-stream20:47
openstackgerritsebastian marcet proposed openstack-infra/puppet-openstackid master: Fixed typo on PHP ini  https://review.openstack.org/45386420:48
mtreinishalso, it turns out there aren't many options for an open source C library that implements RFC645520:49
clarkbjeblair: thinking about https://review.openstack.org/#/c/339261/1/nodepool/scripts/configure_mirror.sh in the future where would be a good location for that stuff in a zuulv3 world?20:49
mordredmtreinish: WHY DID IT GROW SMTP????20:49
clarkbjeblair: pabelanger fungi maybe we want an /etc/ci/ ?20:49
*** thorst has quit IRC20:50
*** thorst has joined #openstack-infra20:51
mtreinishmordred: I really don't know, let me see if I can dig up the commit message that added it if it explains why20:51
mordredmtreinish: I mean, it seems like a weird thing to do in a library called "libwebsockets"20:52
mtreinishmordred: my guess though would be so the standalone webserver they added can send notification emails. BUt the changelog just says they added apis to use smtp: https://github.com/warmcat/libwebsockets/blob/v2.2-stable/changelog#L9520:52
clarkbmordred: websockets over smtp?20:52
*** rwsu has quit IRC20:53
mtreinishwell that was descriptive: https://github.com/warmcat/libwebsockets/commit/602d884028095c100568746b1df15f6aa89c225520:53
*** tonytan4ever has quit IRC20:54
*** thorst has quit IRC20:55
*** vhosakot_ has quit IRC20:55
mtreinishheh, and yeah it totally looks like just a C api for smtp baked into libwebsockets. I don't see anything about the webserver in that commit20:55
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add repository for project navigator data  https://review.openstack.org/45369020:56
fungiclarkb: excellent bikeshed topic. maybe zuul needs a defined place where it sticks convenience files, or maybe this should end up being generated by a playbook at job runtime from zuul stdlib?20:59
*** dprince has quit IRC21:00
*** ldnunes has joined #openstack-infra21:00
clarkbfungi: ya I expect that a playbook will generate it once zuulv3 is a thing. Problem is there are many non zuuly consumers that need this info too (devstack tripleo etc021:00
clarkbfungi: so just trying to think of a place that nodepool can write it today, then zuul can write it tomorrow21:00
*** mriedem has left #openstack-infra21:01
pabelangerI'm okay with /etc/nodepool for now, like clarkb said, zuulv3 will change that location, maybe into ansible vars file, fact or both?21:01
clarkbpabelanger: I don't think zuul should change the location though21:01
*** mriedem has joined #openstack-infra21:01
clarkbhence my idea for /etc/ci/ or similar21:01
pabelangerclarkb: I don't actually think we need to write them to disk any more. If a job needs it, we could just provide a playbook to properly configure the mirrors21:02
clarkbpabelanger: no, we can't thats precisely the problem with the existing setup21:02
*** stevebake is now known as stevebaker21:02
clarkbsome things will be operating outside of the ansible/zuul context and need the same info21:03
clarkb(I don't think we should force all of those things to rewrite themselves into ansible off the bat)21:03
jeblairyeah, for the most part, we actually mostly care that the actual mirror config gets written, which is something we will do in a pre-playbook.  but yes, some 'advanced' jobs are going to want to do more of that on their own (eg, kolla things inside containers).  those, in the long run, should probably eventually have some playbooks which directly use ansible variables, but in the mean time, a compatability shim which writes env ...21:03
jeblair... variables sounds good.21:03
clarkbright, specific case would be dib building ubuntu on centos (and vice versa)21:04
jeblairclarkb: does that sound right ^?  (i read that as similar to what you just said)21:04
fungisounds right21:04
clarkbwe wouldn't write the apt mirror config on the centos job but dib would want to use the apt mirror to build ubuntu21:04
openstackgerritMerged openstack-infra/devstack-gate master: Capture any devstack unit logs  https://review.openstack.org/44931121:04
clarkband we don't necessarily want to force them to be zuul ansible native on day one21:04
clarkbsimilar issue with kolla and so on21:04
jeblairright21:04
*** arxcruz has quit IRC21:05
jeblairso my first thought is that the compatability shim could just be to write /etc/nodepool files... that would keep the churn down for jobs21:05
pabelangerif they were facts, we could drop them into /etc/ansible/facts.d on the node21:05
fungiwfm21:05
*** Apoorva_ has joined #openstack-infra21:05
pabelangeror are you wanting them from bash?21:05
clarkbpabelanger: right that, these aren't ansible today21:05
clarkbpabelanger: so there will be some conversion, whereas most of every case I know of involves shell so thats a really simple way to say "here use this thing"21:06
*** wolverineav has quit IRC21:06
clarkb(I don't think we can assume everything will be ansible on day one and probably not in the far future either)21:06
clarkbjeblair: and you think /etc/nodepool/ would be more appropriate that a more general /etc/ci/ ?21:07
jeblairclarkb: if we're defining something now, /etc/ci is probably better.  i was originally thinking of this in context of existing nodepool variables, but it looks like we're talking about exposing new variables (based on 339261).21:08
*** Apoorva has quit IRC21:08
clarkbyes would be new variables21:08
jeblairbut i expect some jobs are already using /etc/nodepool/*21:08
jeblairif so, is it confusing to have /etc/nodepool and /etc/ci?21:09
clarkbya some things are already using /etc/nodepool/provider then constructing their own mirror things21:09
*** arxcruz has joined #openstack-infra21:09
*** dimtruck is now known as zz_dimtruck21:09
clarkbeither way it would be a switch from /etc/nodepool/provider + code to /etc/something/mirror_info21:09
*** priteau has quit IRC21:10
jeblairclarkb: gotcha.  i think the main reason to use /etc/nodepool is to reduce churn, but if you think /etc/ci is the same amount of churn, that sounds good to me.21:10
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Add support for bwrap  https://review.openstack.org/45385121:11
clarkbya I think the people lready doing similar things are consuming the provider file then constructing the variables themselves. We'd just point them to a new thing that had consistent construction across the board21:11
*** itisha has quit IRC21:12
clarkbthe tricky bit becomes writing this once without double accounting and avoiding nodepool scripts because those go away in the future21:14
clarkb(that is simpler with ansible facts I think)21:14
*** john-davidge has joined #openstack-infra21:14
*** ym200 has quit IRC21:14
*** ym200 has joined #openstack-infra21:15
vkmcclarkb, hey, could you move this forward please? https://review.openstack.org/#/c/447125/21:15
*** ym200 has quit IRC21:15
vkmcprobably needs rebasing21:15
openstackgerritVictoria Martinez de la Cruz proposed openstack-infra/system-config master: Move #openstack-opw to #openstack-outreachy  https://review.openstack.org/44712521:15
clarkbvkmc: we have to merge that when no meetings are happenign (the meetbot update restarts the service)21:16
vkmcclarkb, ohh... that's fine21:16
vkmcso... weekends?21:16
clarkbvkmc: probably easiest thing is to find a gap in meeting schedule then ping infra-root then. I think much of friday is a gap then late pacific time tends to be gap most days21:16
*** sree has joined #openstack-infra21:17
clarkbvkmc: looks like there are meetings running right now though21:17
vkmcclarkb, I'll pay attention to that... and see if they can get it merged by that time21:17
*** eliqiao has quit IRC21:18
*** thorst has joined #openstack-infra21:18
*** wolverineav has joined #openstack-infra21:18
*** eliqiao has joined #openstack-infra21:19
*** john-davidge has quit IRC21:19
*** sree has quit IRC21:21
*** gouthamr has quit IRC21:21
*** thorst has quit IRC21:22
*** ldnunes has quit IRC21:22
*** wolverineav has quit IRC21:25
*** wolverineav has joined #openstack-infra21:26
*** rbuzatu_ has joined #openstack-infra21:29
*** rfolco has joined #openstack-infra21:29
*** wolverineav has quit IRC21:31
*** eharney has quit IRC21:31
clarkbpabelanger: jeblair fungi what do you all think of http://paste.openstack.org/show/605569/ it goes out of its way to run the same code for both configure_mirror.sh at boot and potential later things that people will do21:32
*** xarses has joined #openstack-infra21:32
*** rbuzatu has quit IRC21:33
*** signed8bit has joined #openstack-infra21:33
*** rbuzatu_ has quit IRC21:34
clarkbits a little complicated, but I think this way unless a downstream consumer explicitly overrides anything they should get the same settings as what nodepool used21:34
*** andreww has quit IRC21:36
jeblairclarkb: TIL quoted EOF21:36
clarkbwe can simplify it if we don't want downstream readers to eb able to override things21:36
jeblairclarkb: don't we *want* to do variable expansion?21:37
*** zz_dimtruck is now known as dimtruck21:37
jeblairclarkb: that way it's just a static file that doesn't require the user to have sourced /etc/nodepool/provider beforehand?21:37
*** srobert has quit IRC21:37
clarkbjeblair: the expansion is done when people source the file. The first line in the file has the expanded default host fqdn21:37
clarkblet me paste an example output21:37
jeblairclarkb: aha, i missed the echo before the cat.  i understand now.21:39
jeblairclarkb: that lgtm.21:39
clarkbit needs exports but ya21:39
clarkbmore testing to get you the examples showed me that :)21:40
*** kzaitsev_mb has quit IRC21:40
clarkbhttp://paste.openstack.org/show/605572/ that should actualyl work and has more verbose comments21:41
jeblairclarkb: erm, glad i could help.  :)21:41
smarcetfungi: when u have time please review https://review.openstack.org/#/c/453864/, i found a typo on config thx!21:41
clarkbpabelanger: fungi since you were involvedin original change any thoughts on http://paste.openstack.org/show/605572/21:42
mordredI thought you had to single-quote the EOF to disable variable expansion21:42
clarkbmordred: its any quoting and \ too apparently21:42
clarkbmordred: http://tldp.org/LDP/abs/html/here-docs.html uses double quotes21:42
clarkbactually they show both nice21:42
*** jkilpatr_ has quit IRC21:42
*** hashar has quit IRC21:43
pabelangerclarkb: lgtm21:43
mordredclarkb: fascintating21:43
clarkbmordred: thats one way to describe bash21:43
*** jamesdenton has quit IRC21:45
openstackgerritTom Barron proposed openstack-infra/project-config master: Add experimental manila cephfs CentOS jobs  https://review.openstack.org/45391021:47
openstackgerritClark Boylan proposed openstack-infra/project-config master: Move nodepool mirror vars into seperate filename  https://review.openstack.org/33926121:47
clarkbpabelanger: jeblair ok got two provisional looks good so went ahead and pushed it21:47
*** rbuzatu has joined #openstack-infra21:48
fungicatching up...21:51
fungiclarkb: the paste lgtm; the lower-casing is probably unnecessary? but still a nice touch21:52
clarkbfungi: that was preexisting I just wanted to keep enough context21:52
clarkbhttps://review.openstack.org/#/c/339261/2/nodepool/scripts/configure_mirror.sh is proper diff21:53
*** thorst has joined #openstack-infra21:53
fungismarcet: lgtm, approved21:54
*** jcoufal has quit IRC21:55
*** Sukhdev has joined #openstack-infra21:56
*** Swami has quit IRC21:56
*** chlong has quit IRC22:02
pabelangerclarkb: let comment22:02
openstackgerritBen Nemec proposed openstack-infra/project-config master: Make tripleo upgrade jobs non-voting on ocata  https://review.openstack.org/45391222:02
pabelangerclarkb: also, line 33 doesn't look right22:02
clarkbpabelanger: oh good catch didn't realize that was used there22:02
clarkbAFS slug seems liek the wrong term there22:03
pabelangeretc/tmp/mirror_info/sh?22:03
clarkbpabelanger: ya thats wrong too, will fix22:03
*** Goneri has quit IRC22:03
* clarkb wonders why the distro release instruction set tuple is called afs slug22:03
*** Apoorva_ has quit IRC22:04
openstackgerritMerged openstack-infra/puppet-openstackid master: Fixed typo on PHP ini  https://review.openstack.org/45386422:04
*** Apoorva has joined #openstack-infra22:04
*** harlowja has quit IRC22:05
smarcetfungi: thx :)22:07
*** xyang1 has quit IRC22:09
openstackgerritClark Boylan proposed openstack-infra/project-config master: Move nodepool mirror vars into seperate filename  https://review.openstack.org/33926122:09
clarkbpabelanger: ^ does that look better?22:09
*** ihrachys has quit IRC22:10
*** ihrachys has joined #openstack-infra22:11
*** thorst has quit IRC22:12
openstackgerritMatthew Treinish proposed openstack-infra/nodepool master: Add mqtt module to enable pushing MQTT messages  https://review.openstack.org/45391522:12
mtreinishclarkb, jeblair, fungi: ^^^ that's the starting point I've got for mqtt in nodepool22:13
*** jamielennox|away is now known as jamielennox22:13
mtreinishI just need to figure out how to hook that into the config structure so we can init a client from there and start publishing messages22:13
pabelangerclarkb: http://paste.openstack.org/show/605574/ is what the file actually renders as22:14
pabelangercould be an issue if people try to execute it22:14
clarkbpabelanger: that should work fine, its just that the shebang won't work (as intent is to be sourced I think thats fine its also a new file)22:15
pabelangerya22:15
pabelangerleft note, +222:15
*** gongysh has joined #openstack-infra22:19
*** gordc has quit IRC22:20
*** jkilpatr_ has joined #openstack-infra22:20
*** mdrabe has quit IRC22:23
*** flepied has quit IRC22:23
*** Goneri has joined #openstack-infra22:24
*** smarcet has quit IRC22:29
pabelangerclarkb: so, I can see the image blob pass through out proxy, but apache isn't caching it.  Do you know it streams work?22:31
*** baoli has quit IRC22:31
clarkbpabelanger: is it a normal http GET?22:31
clarkbI would check if the remote says not to cache the file and if the filesize is reported to be bigger than our 100MB limit22:32
*** Goneri has quit IRC22:32
*** rwsu has joined #openstack-infra22:32
pabelangerclarkb: ya, here are the headers: http://paste.openstack.org/show/605576/22:32
pabelangerchecking CacheMaxFileSize now22:33
clarkbsome response codes won't be cached but 200 is cacheable22:35
*** annegentle has quit IRC22:36
clarkbpabelanger: I wonder if we don't cacahe because there is an etag22:37
clarkband clients are supposed to smartly do requests with etags22:37
clarkbraeding docs thats probably not it, apache does the proper if none match stuff for you22:37
clarkbpabelanger: its because of the parameters22:39
clarkbIf the URL included a query string (e.g. from a HTML form GET method) it will not be cached unless the response specifies an explicit expiration by including an "Expires:" header or the max-age or s-maxage directive of the "Cache-Control:" header, as per RFC2616 sections 13.9 and 13.2.1. /quote22:39
clarkbwhich seems really weird because the blob is identified by a sha256 hash22:40
clarkbwhich means it should never ever change22:40
clarkbpabelanger: try https://httpd.apache.org/docs/current/mod/mod_cache.html#cacheignorequerystring22:43
clarkbI think it is safe for at least docker hub given the sha256 pathing22:43
*** krtaylor has quit IRC22:45
pabelangeroh ya22:47
pabelangerworking22:47
*** ssbarnea has quit IRC22:47
pabelangerwith another setting22:47
clarkbwhich setting did you use?22:48
pabelanger1 sec22:48
pabelangerstill confirming22:48
pabelangerCacheIgnoreNoLastMod22:49
clarkbpabelanger: hrm the paste you shared has a last modified though22:50
*** ssbarnea has joined #openstack-infra22:50
clarkbI think it is safe to ignore that too though for the same reasons as ignoring the query string22:50
*** felipemonteiro has quit IRC22:50
clarkband I've somehow managed to not eat lunch so going to go get food now22:51
*** ssbarnea has quit IRC22:51
*** rbrndt has quit IRC22:52
*** marst_ has quit IRC22:52
*** rbrndt has joined #openstack-infra22:52
*** rbrndt has quit IRC22:52
*** marst_ has joined #openstack-infra22:52
pabelangersame, will have to continue this tomorrow22:53
*** HeOS has quit IRC22:53
*** jascott1_ has joined #openstack-infra22:54
*** signed8b_ has joined #openstack-infra22:56
*** marst_ has quit IRC22:56
*** signed8b_ has quit IRC22:57
*** jascott1_ has quit IRC22:58
*** thorst has joined #openstack-infra22:59
*** signed8bit has quit IRC23:00
jheskethMorning23:01
*** ijw has joined #openstack-infra23:01
*** ijw has quit IRC23:02
*** ijw has joined #openstack-infra23:02
*** sree has joined #openstack-infra23:03
*** thorst has quit IRC23:04
*** ssbarnea has joined #openstack-infra23:04
*** adriant has joined #openstack-infra23:06
*** Sukhdev has quit IRC23:06
*** jamesdenton has joined #openstack-infra23:08
*** sree has quit IRC23:08
*** jamesdenton has quit IRC23:09
*** dimtruck is now known as zz_dimtruck23:10
*** priteau has joined #openstack-infra23:10
*** ssbarnea has quit IRC23:11
*** jamesdenton has joined #openstack-infra23:11
openstackgerritMatthew Treinish proposed openstack-infra/nodepool master: Add mqtt module to enable pushing MQTT messages  https://review.openstack.org/45391523:12
openstackgerritMatthew Treinish proposed openstack-infra/nodepool master: Enabled sending MQTT messages for node events  https://review.openstack.org/45392223:12
mtreinishclarkb: ^^^ I'm not sure if that's the right approach, but it was the best I could come up with23:12
openstackgerritAdam Coldrick proposed openstack-infra/storyboard master: Minimise database queries when resolving cards  https://review.openstack.org/44461523:12
openstackgerritAdam Coldrick proposed openstack-infra/storyboard master: Minimise database queries when populating automatic worklists  https://review.openstack.org/44464423:13
openstackgerritAdam Coldrick proposed openstack-infra/storyboard master: Allow stories and tasks to be filtered by boards/worklists containing them  https://review.openstack.org/44461423:13
*** ssbarnea has joined #openstack-infra23:15
*** john-davidge has joined #openstack-infra23:15
*** priteau has quit IRC23:15
*** srobert has joined #openstack-infra23:19
*** askb has joined #openstack-infra23:19
*** john-davidge has quit IRC23:19
*** xarses has quit IRC23:20
*** gongysh has quit IRC23:20
*** ssbarnea has quit IRC23:21
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/infra-specs master: Zuulv3 Executor Security Enhancement  https://review.openstack.org/44449523:22
SpamapSjhesketh: hopefully ^ your concerns are addressed there23:22
*** harlowja has joined #openstack-infra23:25
*** ssbarnea has joined #openstack-infra23:28
*** arxcruz has quit IRC23:28
*** arxcruz has joined #openstack-infra23:30
*** baoli has joined #openstack-infra23:32
*** ssbarnea has quit IRC23:33
jheskethSpamapS: cool, thanks23:33
*** baoli has quit IRC23:33
*** baoli has joined #openstack-infra23:34
*** thorst has joined #openstack-infra23:34
*** Sukhdev has joined #openstack-infra23:35
openstackgerritMerged openstack-infra/system-config master: Updates to adding mirror documentation  https://review.openstack.org/45299223:37
*** jamesdenton has quit IRC23:37
*** tosky has quit IRC23:37
*** srobert has quit IRC23:37
*** bswartz has joined #openstack-infra23:39
*** jamielennox is now known as jamielennox|away23:42
*** zz_dimtruck is now known as dimtruck23:44
*** jamielennox|away is now known as jamielennox23:45
*** rbuzatu has quit IRC23:49
*** thorst has quit IRC23:49
*** krtaylor has joined #openstack-infra23:51
openstackgerritMerged openstack-infra/system-config master: Attempt to validate repomd.xml for EPEL  https://review.openstack.org/45325723:53
*** dingyichen has joined #openstack-infra23:54
*** ssbarnea has joined #openstack-infra23:55
*** ym200 has joined #openstack-infra23:57
clarkbrandom piece of info, it appears that my tumbleweed install on my desktop just has haveged by default23:57
*** arxcruz has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!