Monday, 2017-04-24

*** ramishra has quit IRC00:05
*** ramishra has joined #openstack-infra00:07
openstackgerritFelipe Monteiro proposed openstack-infra/project-config master: Add experimental gate job for murano dashboard  https://review.openstack.org/45819700:08
*** ramishra has quit IRC00:15
*** ramishra has joined #openstack-infra00:16
*** esikachev has joined #openstack-infra00:18
*** tphummel has joined #openstack-infra00:19
*** slagle has quit IRC00:20
*** esikachev has quit IRC00:23
*** ramishra has quit IRC00:23
*** mdrabe has joined #openstack-infra00:28
*** ramishra has joined #openstack-infra00:30
*** jascott1 has joined #openstack-infra00:32
*** ramishra has quit IRC00:35
*** jascott1 has quit IRC00:36
*** ramishra has joined #openstack-infra00:36
*** Julien-zte has joined #openstack-infra00:44
*** ramishra has quit IRC00:44
*** thorst has joined #openstack-infra00:45
*** ramishra has joined #openstack-infra00:46
*** baoli has joined #openstack-infra00:47
*** Apoorva_ has quit IRC00:47
*** cuongnv has joined #openstack-infra00:47
*** mdrabe has quit IRC00:48
*** thorst has quit IRC00:50
*** mat128 has joined #openstack-infra00:51
*** ramishra has quit IRC00:52
*** ramishra has joined #openstack-infra00:54
*** mat128 has quit IRC00:55
*** esikachev has joined #openstack-infra00:56
*** xingchao has joined #openstack-infra00:57
*** esikachev has quit IRC01:02
*** ramishra has quit IRC01:04
*** esikachev has joined #openstack-infra01:04
*** liusheng has quit IRC01:05
*** ramishra has joined #openstack-infra01:06
*** esikachev has quit IRC01:09
*** ramishra has quit IRC01:12
*** ramishra has joined #openstack-infra01:14
*** Nakato has quit IRC01:14
*** hongbin has quit IRC01:17
*** ramishra has quit IRC01:19
*** ramishra has joined #openstack-infra01:20
*** thorst has joined #openstack-infra01:21
*** thorst has quit IRC01:22
openstackgerritMerged openstack-infra/shade master: Updated from global requirements  https://review.openstack.org/45912901:24
*** ramishra has quit IRC01:26
*** liujiong has joined #openstack-infra01:27
*** ramishra has joined #openstack-infra01:28
*** jamielennox is now known as jamielennox|away01:33
*** yamamoto has quit IRC01:33
*** yamamoto has joined #openstack-infra01:33
*** ramishra has quit IRC01:34
*** ramishra has joined #openstack-infra01:36
*** amotoki has quit IRC01:36
*** ym200 has quit IRC01:37
*** ym200 has joined #openstack-infra01:37
*** ym200 has quit IRC01:42
*** jamielennox|away is now known as jamielennox01:44
*** ramishra has quit IRC01:44
*** namnh has joined #openstack-infra01:44
*** thorst has joined #openstack-infra01:47
*** thorst has quit IRC01:47
*** zhenguo has joined #openstack-infra01:48
*** ramishra has joined #openstack-infra01:51
*** ramishra has quit IRC01:56
*** Nakato has joined #openstack-infra01:56
*** yanyanhu has joined #openstack-infra01:57
*** ramishra has joined #openstack-infra01:58
*** zhongjun has joined #openstack-infra02:02
*** dimtruck is now known as zz_dimtruck02:02
*** zz_dimtruck is now known as dimtruck02:02
*** yamamoto has quit IRC02:03
*** aeng has quit IRC02:03
*** tphummel has quit IRC02:04
*** mattoliverau has quit IRC02:04
*** ramishra has quit IRC02:05
*** jascott1 has joined #openstack-infra02:05
*** esikachev has joined #openstack-infra02:05
*** ramishra has joined #openstack-infra02:06
*** fandi has quit IRC02:06
*** fandi has joined #openstack-infra02:07
*** esikachev has quit IRC02:10
*** jascott1 has quit IRC02:11
*** dimtruck is now known as zz_dimtruck02:12
*** Douhet has quit IRC02:12
*** ramishra has quit IRC02:12
*** Julien-zte has quit IRC02:15
*** Julien-zte has joined #openstack-infra02:16
*** thorst has joined #openstack-infra02:18
*** armax has quit IRC02:19
*** ramishra has joined #openstack-infra02:20
*** tphummel has joined #openstack-infra02:21
*** nicolasbock has quit IRC02:21
*** knangia has joined #openstack-infra02:22
*** ramishra has quit IRC02:25
*** ramishra has joined #openstack-infra02:26
*** baoli has quit IRC02:28
*** yamamoto has joined #openstack-infra02:28
*** ramishra has quit IRC02:34
*** thorst has quit IRC02:36
*** jamesdenton has quit IRC02:37
*** Guest76746 is now known as med_02:37
*** med_ has joined #openstack-infra02:38
*** rwsu has joined #openstack-infra02:45
*** ramishra has joined #openstack-infra02:46
*** winggundamth has joined #openstack-infra02:48
*** yamamoto has quit IRC02:50
*** ramishra has quit IRC02:51
*** weshay is now known as weshay_PTO02:51
*** ramishra has joined #openstack-infra02:52
*** yamamoto has joined #openstack-infra02:53
*** Kevin_Zheng has joined #openstack-infra02:56
*** ramishra has quit IRC02:57
*** psachin has joined #openstack-infra02:59
*** stakeda has joined #openstack-infra02:59
*** baoli has joined #openstack-infra03:03
*** ramishra has joined #openstack-infra03:04
*** yamamoto has quit IRC03:04
*** esikachev has joined #openstack-infra03:06
*** salv-orlando has joined #openstack-infra03:07
*** hongbin has joined #openstack-infra03:07
*** baoli has quit IRC03:08
*** salv-orlando has quit IRC03:12
*** esikachev has quit IRC03:14
*** Douhet has joined #openstack-infra03:16
*** zhongjun has quit IRC03:17
*** zhongjun has joined #openstack-infra03:17
*** csomerville has joined #openstack-infra03:27
*** cody-somerville has quit IRC03:31
*** vikrant has joined #openstack-infra03:31
*** thorst has joined #openstack-infra03:33
*** esikachev has joined #openstack-infra03:36
*** dave-mccowan has quit IRC03:37
*** thorst has quit IRC03:37
*** ym200 has joined #openstack-infra03:38
*** ramishra has quit IRC03:40
*** ramishra has joined #openstack-infra03:42
*** ym200 has quit IRC03:42
*** esikachev has quit IRC03:43
*** winggundamth has quit IRC03:45
*** ramishra has quit IRC03:53
*** yolanda has joined #openstack-infra03:54
*** ramishra has joined #openstack-infra03:54
*** aeng has joined #openstack-infra03:54
*** ramishra has quit IRC04:02
*** Dinesh_Bhor has joined #openstack-infra04:06
*** ramishra has joined #openstack-infra04:06
*** yamamoto has joined #openstack-infra04:07
*** salv-orlando has joined #openstack-infra04:08
*** jascott1 has joined #openstack-infra04:08
*** ramishra has quit IRC04:11
*** ramishra has joined #openstack-infra04:12
*** john-davidge has joined #openstack-infra04:12
*** salv-orlando has quit IRC04:13
*** jascott1 has quit IRC04:13
*** dhajare has joined #openstack-infra04:13
*** aviau has quit IRC04:16
*** john-davidge has quit IRC04:17
*** aviau has joined #openstack-infra04:17
*** ykarel has joined #openstack-infra04:17
openstackgerritdongwenjuan proposed openstack-infra/project-config master: exit when `puppet apply` runs failed  https://review.openstack.org/45755904:22
*** baoli has joined #openstack-infra04:30
*** knangia has quit IRC04:31
*** thorst has joined #openstack-infra04:34
*** baoli has quit IRC04:34
*** ramishra has quit IRC04:35
*** thorst has quit IRC04:38
*** hongbin has quit IRC04:39
*** sree has joined #openstack-infra04:42
*** ramishra has joined #openstack-infra04:46
*** oomichi has quit IRC04:46
*** aeng has quit IRC04:49
*** tphummel has quit IRC04:51
*** Apoorva has joined #openstack-infra04:53
*** aeng has joined #openstack-infra04:54
*** funzo has joined #openstack-infra04:56
*** salv-orlando has joined #openstack-infra04:57
*** funzo has quit IRC05:00
*** claudiub|2 has joined #openstack-infra05:11
*** claudiub has joined #openstack-infra05:11
*** gcb has joined #openstack-infra05:13
*** gouthamr has joined #openstack-infra05:13
*** Hal has joined #openstack-infra05:14
*** marst has quit IRC05:16
*** vsaienko has quit IRC05:18
*** yolanda has quit IRC05:23
*** Apoorva has quit IRC05:27
openstackgerritChhavi Agarwal proposed openstack/diskimage-builder master: Centos7 support for ppc64le  https://review.openstack.org/45605505:33
*** thorst has joined #openstack-infra05:34
*** fandi has quit IRC05:35
*** thorst has quit IRC05:39
*** cshastri has joined #openstack-infra05:41
*** esikachev has joined #openstack-infra05:41
*** esikachev has quit IRC05:45
*** saibarspeis has joined #openstack-infra05:46
*** gouthamr has quit IRC05:49
*** nadya has joined #openstack-infra05:55
*** nadya has quit IRC05:59
*** adriant has quit IRC06:08
*** pgadiya has joined #openstack-infra06:10
*** Dinesh_Bhor has quit IRC06:13
*** esikachev has joined #openstack-infra06:22
*** Hal has quit IRC06:23
*** isaacb has joined #openstack-infra06:26
*** andreas_s has joined #openstack-infra06:27
*** liujiong has quit IRC06:27
*** Dinesh_Bhor has joined #openstack-infra06:27
*** liujiong has joined #openstack-infra06:28
*** thorst has joined #openstack-infra06:35
*** yee379 has quit IRC06:36
*** yee379 has joined #openstack-infra06:37
*** ym200 has joined #openstack-infra06:38
*** john-davidge has joined #openstack-infra06:39
*** thorst has quit IRC06:39
*** shardy has joined #openstack-infra06:42
*** ym200 has quit IRC06:43
*** jtomasek has joined #openstack-infra06:43
*** john-davidge has quit IRC06:44
*** prateek has joined #openstack-infra06:46
*** salv-orlando has quit IRC06:50
*** Qiming has quit IRC06:58
*** hashar has joined #openstack-infra06:59
*** bhavik1 has joined #openstack-infra07:00
*** yanyanhu has quit IRC07:00
*** markus_z has joined #openstack-infra07:02
*** yanyanhu has joined #openstack-infra07:02
*** martinkopec has joined #openstack-infra07:02
*** yanyanhu_ has joined #openstack-infra07:03
*** Qiming has joined #openstack-infra07:03
*** yanyanhu has quit IRC07:06
*** ralonsoh has joined #openstack-infra07:14
*** florianf has joined #openstack-infra07:16
*** pcaruana has joined #openstack-infra07:24
*** tie has joined #openstack-infra07:26
*** shardy has quit IRC07:28
*** yolanda has joined #openstack-infra07:29
*** vponomaryov has quit IRC07:30
*** matrohon_ has joined #openstack-infra07:31
*** vponomaryov has joined #openstack-infra07:32
*** jaosorior has joined #openstack-infra07:33
*** cool06 has joined #openstack-infra07:34
cool06hi all,07:34
*** jpich has joined #openstack-infra07:34
cool06i am running git review -s, facing network unreachable error. My system is behind the proxy.07:35
*** thorst has joined #openstack-infra07:37
*** claudiub|2 has quit IRC07:38
*** claudiub has quit IRC07:38
*** aeng has quit IRC07:39
*** shardy has joined #openstack-infra07:40
*** rcernin has joined #openstack-infra07:43
*** pksingh has joined #openstack-infra07:45
*** chem has joined #openstack-infra07:48
*** d0ugal has joined #openstack-infra07:50
*** d0ugal has quit IRC07:50
*** d0ugal has joined #openstack-infra07:50
*** pksingh has quit IRC07:53
*** flepied has joined #openstack-infra07:55
*** thorst has quit IRC07:56
*** salv-orlando has joined #openstack-infra07:58
*** flepied1 has joined #openstack-infra07:59
*** zzzeek has quit IRC08:00
*** flepied has quit IRC08:00
*** zzzeek has joined #openstack-infra08:00
*** efoley__ has joined #openstack-infra08:11
*** efoley_ has joined #openstack-infra08:16
*** amotoki has joined #openstack-infra08:18
*** efoley__ has quit IRC08:19
*** yolanda has quit IRC08:20
*** vsaienk0 has quit IRC08:21
gibihi! I'm looking for the UI plugins used on review.openstack.org that shows the tabulted view on the votes and the one that adds the Toggle CI button.08:22
*** oanson has quit IRC08:23
*** rcernin has quit IRC08:23
*** oanson has joined #openstack-infra08:24
*** ym200 has joined #openstack-infra08:24
*** e0ne has joined #openstack-infra08:26
*** nadya has joined #openstack-infra08:27
*** ym200 has quit IRC08:28
*** pbourke has quit IRC08:31
*** pbourke has joined #openstack-infra08:32
*** yolanda has joined #openstack-infra08:39
*** vsaienk0 has joined #openstack-infra08:39
*** dingyichen has quit IRC08:40
*** derekh has joined #openstack-infra08:42
*** dtantsur|afk is now known as dtantsur08:43
*** cool06 has quit IRC08:46
*** vsaienko has joined #openstack-infra08:48
*** pgadiya has quit IRC08:49
*** yolanda has quit IRC08:54
*** andreas-f has quit IRC08:55
*** pgadiya has joined #openstack-infra09:05
*** john-davidge has joined #openstack-infra09:06
*** admcleod_afk is now known as admcleod09:09
*** john-davidge has quit IRC09:11
*** yolanda has joined #openstack-infra09:11
*** sree_ has joined #openstack-infra09:19
*** sree_ is now known as Guest1042509:19
*** dtantsur is now known as dtantsur|brb09:22
*** sree has quit IRC09:22
*** pgadiya has quit IRC09:31
fricklergibi: https://github.com/openstack-infra/system-config/blob/master/modules/openstack_project/files/gerrit/hideci.js09:32
gibifrickler: thanks! do you happen to know the other plugin that shows the CI votes as a table?09:36
*** adarazs has joined #openstack-infra09:39
*** yolanda has quit IRC09:39
gibifrickler: I guess both plugin is implemented in this js file. thanks for the help!09:42
*** tosky has joined #openstack-infra09:46
*** sambetts|afk is now known as sambetts09:47
*** stakeda has quit IRC09:48
*** ccamacho has joined #openstack-infra09:48
*** vsaienko has quit IRC09:49
*** salv-orl_ has joined #openstack-infra09:49
*** salv-orlando has quit IRC09:52
*** thorst has joined #openstack-infra09:53
*** mat128 has joined #openstack-infra09:53
*** masber has quit IRC09:54
*** john-davidge has joined #openstack-infra09:55
*** john-davidge has quit IRC09:55
*** john-davidge has joined #openstack-infra09:56
*** thorst has quit IRC09:57
*** adarazs has quit IRC09:58
*** alexchadin has joined #openstack-infra09:59
*** john-davidge has quit IRC10:00
*** john-dav_ has joined #openstack-infra10:00
*** nadya has quit IRC10:01
asettlefungi: with mailman, is there a possibility that you can default the moderator settings to 'reject' unless they are on the ML?10:02
AJaegerfungi: under Privacy Options -> Sender filters, you have "Action to take for postings from non-members for which no explicit action is defined"10:03
AJaegerYou can set this to Discard10:04
AJaegeror "reject"10:04
*** adarazs has joined #openstack-infra10:06
*** yanyanhu_ has quit IRC10:06
*** liujiong has quit IRC10:06
*** nicolasbock has joined #openstack-infra10:06
*** cuongnv has quit IRC10:10
*** jascott1 has joined #openstack-infra10:11
asettleAJaeger: oh should I just do that?10:13
*** alexchadin has quit IRC10:14
*** ym200 has joined #openstack-infra10:14
*** alexchadin has joined #openstack-infra10:14
*** ociuhandu has quit IRC10:15
*** jascott1 has quit IRC10:17
*** ym200 has quit IRC10:19
*** adarazs is now known as adarazs_lunch10:19
*** Guest10425 is now known as sree10:21
*** mat128 has quit IRC10:25
*** mat128 has joined #openstack-infra10:27
*** dtantsur|brb is now known as dtantsur10:28
*** Julien-zte has quit IRC10:29
*** sree has quit IRC10:29
*** oanson has quit IRC10:37
*** oanson has joined #openstack-infra10:37
*** ym200 has joined #openstack-infra10:38
*** sdague has joined #openstack-infra10:38
*** jkilpatr has quit IRC10:40
*** ym200 has quit IRC10:42
*** xingchao has quit IRC10:43
*** xingchao has joined #openstack-infra10:44
AJaegerasettle: that's the only option I could find quickly - but let's see whether fungi has better ideas10:46
*** xingchao has quit IRC10:49
openstackgerritLucas Alvares Gomes proposed openstack-infra/project-config master: Add experimental python3 dsvm job for networking-ovn  https://review.openstack.org/45924010:49
*** ociuhandu has joined #openstack-infra10:50
*** thorst has joined #openstack-infra10:53
*** thorst has quit IRC10:58
*** wolverineav has joined #openstack-infra11:01
*** jkilpatr has joined #openstack-infra11:02
*** nadya has joined #openstack-infra11:03
*** Nisha_Agarwal has joined #openstack-infra11:04
*** ym200 has joined #openstack-infra11:05
*** lucasagomes is now known as lucas-hungry11:06
*** ym200_ has joined #openstack-infra11:07
Nisha_AgarwalHi team, i am trying test the sip connectivity as given on https://wiki.openstack.org/wiki/Infrastructure/Conferencing. I created the account as given on this page. But when my colleague tries to call me it says "Could not resolve to a Internet Address" or "not a Valid SIP address"11:09
*** ym200 has quit IRC11:09
*** ricardoas-afk has joined #openstack-infra11:09
Nisha_AgarwalPlease could you help me with this?11:09
*** dave-mccowan has joined #openstack-infra11:09
*** ym200_ has quit IRC11:12
odyssey4meproject-config experts, I need to pass the ZUUL_* vars into sudo and https://review.openstack.org/#/c/458890/1/jenkins/jobs/openstack-ansible-jobs.yaml is not working right - I'd appreciate some advice on how this could be made to work.11:12
*** dizquierdo has joined #openstack-infra11:14
*** salv-orl_ has quit IRC11:15
*** alexchadin has quit IRC11:15
*** yolanda has joined #openstack-infra11:16
*** mat128 has quit IRC11:16
*** zhurong has joined #openstack-infra11:17
AJaegerodyssey4me: you need to quote the "{" in templates - use "{{" and "}}"11:20
*** alexchadin has joined #openstack-infra11:20
*** mat128 has joined #openstack-infra11:23
*** Shrews has joined #openstack-infra11:26
odyssey4meAJaeger I guess I could also get rid of the use of '{' as it's not strictly necessary?11:26
*** mat128 has quit IRC11:26
*** electrofelix has joined #openstack-infra11:27
*** rhallisey has joined #openstack-infra11:28
AJaegerodyssey4me: sure11:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config master: OSA: Enable cross-repo testing for integration testing  https://review.openstack.org/45889011:28
odyssey4methanks AJaeger11:28
*** oanson has quit IRC11:28
*** oanson has joined #openstack-infra11:29
*** florianf has quit IRC11:30
*** Guest70675 is now known as rook11:33
*** gordc has joined #openstack-infra11:33
*** esikachev has quit IRC11:36
*** esikachev has joined #openstack-infra11:36
*** mat128 has joined #openstack-infra11:40
*** bhavik1 has quit IRC11:40
*** tosky has quit IRC11:40
*** esikachev has quit IRC11:41
*** adarazs_lunch is now known as adarazs11:41
*** thorst has joined #openstack-infra11:42
*** florianf has joined #openstack-infra11:45
*** tosky has joined #openstack-infra11:45
asettleAJaeger: yes okay cool. That was the only option I found as well.11:46
*** adarazs is now known as adarazs_brb11:47
isaacb:Q11:49
*** esikachev has joined #openstack-infra11:49
*** rfolco has joined #openstack-infra11:51
*** Nisha_Agarwal has quit IRC11:51
*** makowals_ has joined #openstack-infra11:52
*** nadya has quit IRC11:52
*** makowals has quit IRC11:53
*** ramishra has quit IRC11:54
*** ramishra has joined #openstack-infra11:55
*** esikachev has quit IRC11:57
*** makowals_ has quit IRC11:57
*** makowals has joined #openstack-infra11:59
*** adarazs_brb is now known as adarazs11:59
*** ym200 has joined #openstack-infra11:59
*** esikachev has joined #openstack-infra11:59
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci master: Redirect stack-show output in tripleo.sh  https://review.openstack.org/45925712:00
*** Nisha_Agarwal has joined #openstack-infra12:00
*** slagle has joined #openstack-infra12:00
*** salv-orlando has joined #openstack-infra12:00
*** nadya has joined #openstack-infra12:01
*** Hal has joined #openstack-infra12:02
*** namnh has quit IRC12:05
odyssey4mehmm, we're seeing quite a few git.o.o TLS failures showing up: http://logs.openstack.org/46/459246/1/check/gate-openstack-ansible-os_neutron-ansible-func-ubuntu-xenial/817598b/console.html#_2017-04-24_11_32_37_05079912:07
odyssey4mehttp://logs.openstack.org/46/459246/1/check/gate-openstack-ansible-os_neutron-ansible-upgrade-ubuntu-xenial/7e8f658/console.html#_2017-04-24_11_32_41_76513012:08
*** HeOS has joined #openstack-infra12:08
*** ldnunes has joined #openstack-infra12:09
*** lucas-hungry is now known as lucasagomes12:11
*** ym200 has quit IRC12:13
*** jascott1 has joined #openstack-infra12:13
*** lamt has quit IRC12:18
*** jascott1 has quit IRC12:18
*** trown|outtypewww is now known as trown12:19
*** ramishra has quit IRC12:22
*** alexchadin has quit IRC12:23
*** alexchadin has joined #openstack-infra12:24
*** ramishra has joined #openstack-infra12:24
*** liusheng has joined #openstack-infra12:27
*** xyang1 has joined #openstack-infra12:29
*** mriedem has joined #openstack-infra12:34
*** mat128 has quit IRC12:35
*** zhurong has quit IRC12:39
*** mat128 has joined #openstack-infra12:42
*** rlandy has joined #openstack-infra12:42
*** vsaienko has joined #openstack-infra12:44
*** kambiz has quit IRC12:45
*** salv-orlando has quit IRC12:47
*** abelur is now known as abelur_zzz12:48
*** kgiusti has joined #openstack-infra12:48
*** askb has quit IRC12:48
*** dprince has joined #openstack-infra12:52
*** kambiz has joined #openstack-infra12:52
*** g0d355__ has joined #openstack-infra12:53
*** funzo has joined #openstack-infra12:56
*** ociuhandu has quit IRC12:56
*** tushar has joined #openstack-infra12:56
*** esikachev has quit IRC12:59
*** ramishra has quit IRC13:00
*** funzo has quit IRC13:01
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Add support for $DO_BOOTSTRAP_SUBNODES  https://review.openstack.org/43743413:01
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Add generated nodepool key to authorized_keys  https://review.openstack.org/43774213:01
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Fix setting of node and node_private  https://review.openstack.org/43743313:01
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Support running toci_gate_test-oooq.sh locally  https://review.openstack.org/43743113:01
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Stop dstat at the end of a job  https://review.openstack.org/43874513:01
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Guard adding bridge interface with $STABLE_RELEASE  https://review.openstack.org/44083813:01
*** lamt has joined #openstack-infra13:01
*** mat128 has quit IRC13:02
*** ihrachys has joined #openstack-infra13:02
*** kencjohnston has quit IRC13:02
*** ramishra has joined #openstack-infra13:02
*** ralonsoh_ has joined #openstack-infra13:02
*** ralonsoh has quit IRC13:04
*** ralonsoh_ is now known as ralonsoh13:04
*** srobert has joined #openstack-infra13:04
*** makowals has quit IRC13:05
*** jcoufal has joined #openstack-infra13:05
*** vikrant has quit IRC13:09
*** tushar has quit IRC13:10
*** makowals has joined #openstack-infra13:10
*** vsaienk0 has quit IRC13:10
openstackgerritMerged openstack-infra/tripleo-ci master: logs: chmod 755 all workspace directories  https://review.openstack.org/45889513:11
*** mdrabe has joined #openstack-infra13:11
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Allow for using build UUID as temp job dir name  https://review.openstack.org/45668513:16
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Allow for specifying root job directory  https://review.openstack.org/45669113:16
*** jaypipes has joined #openstack-infra13:21
*** mat128 has joined #openstack-infra13:21
*** alexchadin has quit IRC13:21
openstackgerritMerged openstack-infra/shade master: Move subnet related tests to separate module  https://review.openstack.org/45912713:22
openstackgerritMerged openstack-infra/shade master: Fix list_servers tests to not need a ton of neutron  https://review.openstack.org/45912613:22
*** Nisha_Agarwal has quit IRC13:22
*** tushar has joined #openstack-infra13:22
*** xingchao has joined #openstack-infra13:23
*** mat128 has quit IRC13:24
*** esikachev has joined #openstack-infra13:26
*** amotoki has quit IRC13:27
*** vsaienk0 has joined #openstack-infra13:28
*** baoli has joined #openstack-infra13:29
*** makowals has quit IRC13:29
*** ricardoas-afk is now known as ricardoas13:29
*** trown is now known as trown|outtypewww13:30
mordredfungi: 2 quick things when you're awake - a) we should chat tomorrow at infra meeting about infra deb hosting and b) we maybe should move dib bugs to storyboard since it's an infra project now?13:30
*** makowals has joined #openstack-infra13:31
*** makowals has quit IRC13:31
openstackgerritSlawek Kaplonski proposed openstack-infra/shade master: Move router related tests to separate module  https://review.openstack.org/45912813:32
mordredfungi: I added both to the meeting agenda for tomorrow13:33
*** Goneri has joined #openstack-infra13:33
*** atarakt has joined #openstack-infra13:33
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Allow for using build UUID as temp job dir name  https://review.openstack.org/45668513:34
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Allow for specifying root job directory  https://review.openstack.org/45669113:34
*** ramishra has quit IRC13:36
*** yolanda has quit IRC13:36
*** baoli has quit IRC13:36
*** esberglu has joined #openstack-infra13:37
*** ramishra has joined #openstack-infra13:38
*** hongbin has joined #openstack-infra13:41
*** rkukura has quit IRC13:42
*** baoli has joined #openstack-infra13:45
*** d0ugal_ has joined #openstack-infra13:45
mtreinishinfra-root: does someone have some time to help me debug the subunit-workers? We haven't added any new results to the subunit2sql db since: 2017-04-21T18:32:17.000Z13:46
dmsimardodyssey4me: We're also experiencing some level of problems with git.o.o, not sure what the problem is13:47
*** superdan is now known as dansmith13:47
*** d0ugal has quit IRC13:48
*** eharney has joined #openstack-infra13:48
*** jpena has joined #openstack-infra13:48
dmsimardodyssey4me: http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%20\"gnutls_handshake()%20failed\" (check last 24h)13:51
dmsimardinfra-root, can anyone check if there's something wrong with git.o.o ^ ?13:51
dmsimardclarkb, pabelanger, fungi ^13:52
*** arxcruz has quit IRC13:53
*** arxcruz has joined #openstack-infra13:54
*** d0ugal_ has quit IRC13:55
*** rkukura has joined #openstack-infra13:55
*** gouthamr has joined #openstack-infra13:56
*** d0ugal has joined #openstack-infra13:58
*** bhavik1 has joined #openstack-infra13:58
*** gouthamr has quit IRC13:59
*** igorbelikov_ is now known as igorbelikov14:00
*** sree has joined #openstack-infra14:01
*** d0ugal has quit IRC14:01
*** ssbarnea_ has joined #openstack-infra14:01
*** ssbarnea has quit IRC14:04
*** bhavik1 has quit IRC14:05
*** makowals has joined #openstack-infra14:07
*** psachin has quit IRC14:08
isaacbinfra-root: +1 for problems with git.o.o14:08
* fungi is back, catching up14:10
fungiasettle: AJaeger: yeah, i think a few of our lists are already set up to reject posts from non-subscribers with a message telling them to subscribe before resending14:10
*** smarcet has joined #openstack-infra14:11
fungimordred: excited to discuss some deb building and hosting automation in the meeting, sure. as for moving dib bug reporting from lp to sb we should probably discuss with the people currently contributing teh most on dib14:12
*** fbo has joined #openstack-infra14:12
*** baoli has quit IRC14:12
*** baoli has joined #openstack-infra14:12
smarcetfungi: morning how are u doing ? when u get some free time please review https://review.openstack.org/#/c/458086/ , thx :)14:13
fungimtreinish: maybe in a bit, though i have guests coming so mildly distracted14:13
fungidmsimard: isaacb: i'm giving the git servers a once-over now14:13
dmsimardfungi: thank you14:13
isaacbfungi: thanks14:14
mtreinishfungi: ok let me know, I should be around whenever you get a chance14:14
*** ociuhandu has joined #openstack-infra14:14
*** zz_dimtruck is now known as dimtruck14:15
*** baoli has quit IRC14:17
*** mat128 has joined #openstack-infra14:18
*** baoli has joined #openstack-infra14:20
*** beekneemech is now known as bnemec14:20
*** prateek has quit IRC14:23
*** felipemonteiro has joined #openstack-infra14:24
*** ociuhandu has quit IRC14:24
*** felipemonteiro has quit IRC14:25
*** felipemonteiro has joined #openstack-infra14:25
*** makowals has quit IRC14:26
asettleThanks fungi :) I think I'll do thsi14:27
*** amotoki has joined #openstack-infra14:28
fungiasettle: i'm considering doing the same for the infra ml... we've received ~200 spams in the moderation queue since the last post from a non-subscriber14:28
fungisince the last legitimate post from a non-subscriber, i mean14:28
asettleYep. That's kind of where I'm at. It's very frustrating. And honestly? I don't want to have to keep doing this and I'm sure others don't either.14:28
openstackgerritMerged openstack-infra/shade master: Remove neutronclient mocks from network create tests  https://review.openstack.org/45907014:30
fungii basically just ignore them and let them pile up in the moderation queue (i can generally tell from the subject line it's spam) and then mass delete them from the queue whenever i need to go in to actually approve a legit post (which is how i know how many spam attempts we've had since the last one)14:30
fungibut i agree it's annoying14:30
*** jordanP has quit IRC14:30
dmsimardfungi: I guess the errors we're seeing with git.o.o aren't being picked up by http://grafana.openstack.org/dashboard/db/git-load-balancer (error rate is flat)14:32
dmsimardit probably dies client side or something14:32
*** d0ugal has joined #openstack-infra14:32
*** amotoki has quit IRC14:33
*** esikachev has quit IRC14:35
*** cshastri has quit IRC14:37
*** mat128 has quit IRC14:37
*** mdrabe_ has joined #openstack-infra14:38
*** funzo has joined #openstack-infra14:40
*** mdrabe has quit IRC14:41
fungidmsimard: isaacb: is the problem ongoing? i do see where we briefly spiked up to serving ~1.15gbps through the git.o.o lb proxy at ~13:00utc: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=862&rra_id=all14:42
jpenaI'm seeing those errors as a hung client-side. The client just stays forever in read(), until there is a timeout14:42
*** jordanP has joined #openstack-infra14:42
isaacbfungi: me too ^^14:43
*** yamahata_ has joined #openstack-infra14:43
isaacbfungi: what about DIB? I see those hungs when trying to build an image14:43
jpenathe first error happened yesterday around 19:40 UTC14:43
tusharHi All, I am trying to setup the CI on ubuntu 16.0414:44
fungii'l do some test fetches from all the backends and see if there's one in particular causing trouble. resource utilization graphs across all of them look fairly typical to me14:44
tusharI am facing some errror14:44
*** ramishra has quit IRC14:45
tusharMy first question can we setup the third party CI on ubuntu 16.04 or not14:45
tushar?14:45
*** sree_ has joined #openstack-infra14:45
dmsimardfungi: nothing from a certificate perspective changed recently that could explain the uptick in the gnutls errors ? From logstash, looking at ~24h window, they started at a particular point: http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%20\"gnutls_handshake()%20failed\"14:45
*** sree_ is now known as Guest3485014:46
*** ramishra has joined #openstack-infra14:46
fungidmsimard: nothing i'm aware of, at least. this cert is valid for a few more months before we need to replace it14:47
*** armax has joined #openstack-infra14:47
*** sree has quit IRC14:47
jpenain my case, errors are not happening in the TLS side, it's connecting to git://git.o.o14:48
fungii just successfully cloned openstack-infra/bindep from all 8 backend git servers via https on 4443/tcp with no error14:49
fungiso i don't think it's one specific backend broken 100% of the time, at least14:49
fungi(git01.openstack.org through git08.openstack.org)14:49
*** mat128 has joined #openstack-infra14:51
funginow i'm cloning it in a loop through the lb, waiting to see a failure14:51
jpenafungi: if it helps, in my tests it's failed 8 out of 178 times14:51
fungidmsimard: isaacb: jpena: any idea whether you're seeing these errors when connecting over ipv4, or ipv6, or a mix of both?14:52
isaacbfungi: I connect over ipv414:52
jpenafungi: ipv4 for me14:53
*** ssbarnea has joined #openstack-infra14:53
fungiall my current testing is over ipv6 and i'm not seeing any failures yet, but i can try again over v414:53
*** ssbarnea_ has quit IRC14:56
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Remove centos-release-* packages  https://review.openstack.org/45934014:56
*** armax has quit IRC14:57
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Remove centos-release-* packages  https://review.openstack.org/45934014:58
fungidmsimard: just about every failure i see for that logstash query is from infra-cloud regions, not from other providers. i wonder if there's an issue at some peering point we're traversing from infra-cloud and which others seeing this problem are also coming through. i still can't reproduce the issue over my home connection14:58
dmsimardfungi: fwiw jpena and I are from outside the gate ("jobs" running from centos.org network)14:59
fungithe fact that both of you are coming from the same network helps support that possibility15:00
fungii've switched my reproduction loop from cloning bindep to cloning nova to see if it's larger repos making a difference there15:00
*** dtantsur is now known as dtantsur|bbl15:01
*** salv-orlando has joined #openstack-infra15:02
*** adrian_otto has joined #openstack-infra15:02
fungistill no failures so far, but cloning nova takes a lot longer so i've only managed to loop through about 3 cycles15:03
*** jordanP has quit IRC15:03
*** yolanda has joined #openstack-infra15:03
lennybCores, please review #link https://review.openstack.org/#/c/450296/ . It's a tiny addon to Third Party CI Common Solution and already got +2 from asselin15:04
pabelangerclarkb: let me know how you'd like to continue with https://review.openstack.org/#/c/458550/ limits.conf for workers. that will unblock a few unpuppet patches and hopefully finish up this week15:04
fungipabelanger: any chance you want to look into possible git connectivity issues we're seeing (so far from infracloud and centos.org apparently)15:05
*** Guest34850 has quit IRC15:06
*** jamesdenton has joined #openstack-infra15:06
pabelangerfungi: sure, I can in a bit. Just working on some packaging ATM15:07
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: add the release notes jobs to python-mistralclient  https://review.openstack.org/45934315:08
fungiso far i've been unable to reproduce this issue from my home connection15:08
*** yolanda has quit IRC15:10
*** baoli has quit IRC15:10
*** tonytan4ever has joined #openstack-infra15:10
*** yolanda has joined #openstack-infra15:11
*** baoli has joined #openstack-infra15:11
*** baoli has quit IRC15:11
clarkbcan we check path from $cloud to git.o.o and from git.o.o back?15:12
*** esikachev has joined #openstack-infra15:12
clarkbalso check if its a bw limit on frontend?15:13
fungiclarkb: yeah, i figured the next step is analyzing reciprocal traceroutes15:14
*** baoli has joined #openstack-infra15:15
*** ramishra has quit IRC15:16
fungii did look at bandwidth utilization and at ~1300z we spiked up to a combined in+out of ~1.15gbps on the lb but we're not generally running anywhere near that high and supposedly people have been seeing this for nearly a day (the hits in logstash go back to ~2000z and ramp up quickly, presumably as test volume is picking up for the day)15:16
dhellmannI've seen a few jobs this morning fail with only 1 line of output showing that the job failed. Is that a known issue with one of the clouds? http://logs.openstack.org/9d/9dc78693d584f998d0686dd16cbc231b56840865/release/gnocchi-announce-release/31ef9b8/console.html15:18
clarkbah ok likely not bw limited then15:18
*** ramishra has joined #openstack-infra15:18
* dhellmann wonders if it's related to the git issue you seem to be debugging already15:18
mmedvedecan any infra puppet core please take a look at https://review.openstack.org/#/c/410849/ . There is some discussion in #openstack-thrid-party-ci and the patch might help with the vhd-util problem15:19
*** jordanP has joined #openstack-infra15:19
jeblairdhellmann, fungi, clarkb, pabelanger: maybe it could be related.  here's the ansible log for that job: http://logs.openstack.org/9d/9dc78693d584f998d0686dd16cbc231b56840865/release/gnocchi-announce-release/31ef9b8/_zuul_ansible/ansible_log.txt15:20
jeblairi think that's an infra-cloud ip.  double checking15:20
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: add the release notes jobs to python-mistralclient  https://review.openstack.org/45934315:20
fungiyeah, if there's general network connectivity issues between infracloud and rackspace's dfw region, this could easily be another symptom15:21
jeblairyep: ubuntu-xenial-infracloud-vanilla-854870315:21
*** ykarel has quit IRC15:21
dhellmannyeah, sounds like it's related15:22
pabelangerjeblair: hmm, keyscan is unreachable, yet we continue with playbook15:22
dhellmannI'll suggest to dims and ttx that we hold off on releases for now, to avoid having lots of jobs to requeue15:22
fungiThe Rackspace Open Cloud system engineers will perform a priority maintenance to the control infrastructure of our Cloud Networks DFW region during the following dates and times: April 24, 2017 from 10:00 PM to April 25, 2017 2:00 AM CDT15:22
fungithey seem to have scheduled that out of nowhere15:22
fungimaybe they know something more than they're letting on?15:22
fungihrm, though only impacting api reachability per the announcement15:22
fungihttps://status.rackspace.com/15:23
fungiso likely not at all realted15:23
fungiwe should consider taking infracloud offline in nodepool while we dig deeper15:23
*** yolanda has quit IRC15:23
pabelangerI am looking at controllers now15:24
pabelangerwonder if we lost another node15:24
pabelangercompute024.chocolate.ic.openstack.org seems to be the host in question15:25
pabelangeraccording to conductor logs15:25
*** ramishra has quit IRC15:26
dmsimardfungi: fwiw the errors in logstash seem to be trending down15:26
*** baoli has quit IRC15:26
*** csomerville has quit IRC15:26
*** csomerville has joined #openstack-infra15:26
pabelangerokay, I see an issue15:26
pabelangerlet me see if I can fix it15:26
*** ramishra has joined #openstack-infra15:27
pabelangerneutron-linuxbridge-agent on compute024.chocolate.ic.o.o was flapping. This was because veth1 was not properly created15:29
pabelangerre-running puppet on the node has fixed the issue15:29
*** david-lyle has joined #openstack-infra15:29
pabelangerhowever, puppet hasn't run on this node for some time15:30
pabelangertrying to find out why15:30
dmsimardfungi: I reproduced the issue easily from an external location with http://paste.openstack.org/show/607692/15:32
dmsimardit's stuck there, doesn't continue15:32
*** yolanda has joined #openstack-infra15:32
dmsimardprocesses: http://paste.openstack.org/show/607693/15:32
dmsimard(I don't think --verbose does anything :/)15:33
*** krtaylor has quit IRC15:34
dmsimardhm, I'll try from somewhere else to make sure there's no local issue to the env I'm testing from15:35
*** nadya has quit IRC15:36
fungidmsimard: that's basically identical to what i did with bindep and nova repos. i can test with the vmware-nsx repo though just to be sure15:36
*** gcb has quit IRC15:37
*** hashar is now known as hasharAway15:37
fungii also didn't pause between clones15:38
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Split infracloud baremetal into separate playbook run  https://review.openstack.org/45934815:38
jpenaI haven't found a specific pattern on the failing repo, it happened with puppet-gnocchi, puppet-qdr, puppet-mistral, gnocchi, neutron-lbaas...15:38
pabelangerfungi: clarkb: jeblair: ^ okay, gets puppet running on compute and controller nodes again for infracloud15:38
pabelangerbaremetal00.ic.openstack.org needs to be debugged on puppet side15:38
pabelangerhttp://paste.openstack.org/show/607696/15:39
fungiisaacb: are you connecting from the same network as jpena and dmsimard?15:40
*** baoli has joined #openstack-infra15:41
*** zhurong has joined #openstack-infra15:41
fungiwondering if the connectivity issue from infracloud is distinct from connectivity issue from redhat's networks (and maybe the latter is a hold-over from friday's outages there?)15:41
isaacbfungi: I'm connecting from IBM's network in US15:42
*** gouthamr has joined #openstack-infra15:42
fungiisaacb: excellent, so that means we have at least three networks impacted15:43
fungihpe, ibm and rh15:43
clarkbpabelanger: why is puppet trying to run bifrost?15:43
fungiif all trhee are reaching rackspace's dfw region through a common peer (or the return traffic to them goes through a common peering point) then that's likely where the trouble is15:44
pabelangerclarkb: not sure, it is an install process it seems. I'll have to dig into that code path15:44
*** xingchao has quit IRC15:44
fungidmsimard: yeah, tried with your reproducer loop, got through a few hundred cycles and no failures15:45
jpenafungi: we have a similar (maybe related?) issue between our zuul server in review.rdoproject.org and review.openstack.org15:45
fungiso this is almost certainly network-path-dependent15:45
*** xingchao has joined #openstack-infra15:45
clarkbfungi: have you done infracloud traceroute yet?15:45
dmsimardI'm running a mtr from two different locations right now15:46
fungijpena: git.openstack.org and review.openstack.org are in the same region in rackspace, so your route to both is likely identical15:46
fungiclarkb: yeah, in progress15:46
*** ramishra has quit IRC15:46
pabelangerdhellmann: do you happen to have a list of jobs that failed with the single line? I'd like to confirm it was limited to infracloud-chocolate15:47
dmsimardjpena, fungi: http://paste.openstack.org/show/607701/15:48
isaacbfungi, pabelanger: http://paste.openstack.org/show/607700/15:48
*** dhajare has quit IRC15:48
*** knangia has joined #openstack-infra15:48
dmsimardFWIW packet loss is not necessarily an indicator of a problem, ICMP gets dropped quickly -- but a high loss might be the router is busy and depriorizing ICMP15:49
*** salv-orl_ has joined #openstack-infra15:49
fungiyep, more just trying to see if there's a common penultimate hop/provider15:49
*** xingchao has quit IRC15:50
*** salv-orlando has quit IRC15:52
fungihere's the traceroutes to and from git.o.o and compute001.chocolate.ic.o.o: http://paste.openstack.org/show/60770315:52
isaacbfungi, pabelanger: traceroutes: http://paste.openstack.org/show/607704/15:53
dmsimardfungi: can you do MTRs instead ?15:53
*** ramishra has joined #openstack-infra15:53
*** armax has joined #openstack-infra15:54
*** amotoki has joined #openstack-infra15:56
fungiso inbound to git.o.o it's hpe -> cogent -> zayo (former abovenet) -> rackspace, and on the way back it's rackspace -> ntt/gtt/zayo (wha?!?) -> cogent -> hpe15:56
*** zhurong has quit IRC15:57
fungimostly symmetric if you assume there's some router(s) at hop 6 on the return route which have interfaces to different peers and is responding from them at random15:57
fungidmsimard: i'll see about getting mtr installed on these systems in a sec15:57
*** tphummel has joined #openstack-infra15:58
*** andreas_s has quit IRC15:58
*** isaacb has quit IRC15:59
*** dtantsur|bbl is now known as dtantsur|mtg16:00
*** gyee has joined #openstack-infra16:00
*** martinkopec has quit IRC16:02
*** zhurong has joined #openstack-infra16:02
openstackgerritPaul Belanger proposed openstack-infra/puppet-ansible master: Enabling pipelining for ansible.cfg  https://review.openstack.org/45939316:03
*** Nisha_Agarwal has joined #openstack-infra16:05
fungiwow, the mtr package pulls in a crazy number of deps16:05
pabelangerokay, infracloud looks happy again. It would be great if we can land: https://review.openstack.org/#/c/459348/ to make puppet happy again for compute and controllers16:05
dmsimardreally ?16:05
pabelangerstill working on baremetal puppet issues16:05
dmsimardlooks like a standalone package, at least on centos16:05
fungidmsimard: a bunch of x and gtk stuff, presumably for a gui it includes16:06
dmsimardhmm, there's maybe a cli-only package on ubuntu16:06
fungimtr - Full screen ncurses and X11 traceroute tool16:07
fungiyeah16:07
*** zhurong has quit IRC16:07
clarkbit currently segfaults on tumbleweed16:07
clarkbyet another rabbit hole to jump into16:08
fungiokay, mtr-tiny just installs the ncurses version16:08
fungiwow16:09
* fungi sighs16:09
fungifungi@compute001:~$ man mtr16:09
fungi-bash: man: command not found16:09
dmsimardlol16:09
dmsimardthe commands I used are in the paste above16:09
fungiyou know, because we're just _that_ starved for space on our images16:09
clarkbfungi: the ubuntu-minimal element in dib doesn't install any man pages16:09
*** marst has joined #openstack-infra16:09
pabelanger'minimal'16:09
clarkbits become annoying enough that anymore I just google `man foo` because half the machines I am on don't have man pages16:10
fungidmsimard: thanks, --report is what i was looking for16:10
*** vsaienko has quit IRC16:10
*** e0ne has quit IRC16:11
*** isaacb has joined #openstack-infra16:11
*** dtantsur|mtg is now known as dtantsur16:12
*** jpich has quit IRC16:12
*** ramishra has quit IRC16:13
*** vsaienko has joined #openstack-infra16:13
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Remove centos-release-* packages  https://review.openstack.org/45934016:14
clarkbfwiw I haven't been able to reproduce git.o.o issues locally either. RUnning the same for loop. My path is frontier -> zayo -> rackspace. No cogent16:14
fungimy isp (charter) peers directly with rackspace in dfw, and i can't reproduce either16:17
dmsimarddon't know what to tell you guys16:18
dmsimard¯\_(ツ)_/¯16:18
*** mat128 has quit IRC16:18
fungiwonder if cogent and level 3 peering with zayo is problematic16:19
fungiat least i'm assuming that Le and Lev truncated and also Washingto/Washington are level3 hops16:20
*** ramishra has joined #openstack-infra16:20
*** flepied1 has quit IRC16:20
*** Apoorva has joined #openstack-infra16:20
*** Apoorva has quit IRC16:20
*** Apoorva has joined #openstack-infra16:21
dmsimardfungi: curious, were you testing git clones over https:// or through git:// ?16:22
clarkbI'm using git:// (using the exact for loop from your paste)16:22
fungidmsimard: https since the reports were of ssl handshake issues16:22
dmsimardack16:23
dmsimardWe're going to temporarily move things from git.o.o to github while we figure this out ...16:23
*** lucasagomes is now known as lucas-afk16:24
*** annegentle has joined #openstack-infra16:24
fungihttp://paste.openstack.org/show/607707 is the mtr version16:24
*** ramishra has quit IRC16:24
*** mat128 has joined #openstack-infra16:25
*** vsaienko has quit IRC16:25
* fungi needs to step away for a few minutes16:26
*** salv-orl_ has quit IRC16:26
*** ramishra has joined #openstack-infra16:26
gouthamrjust came in here to say my CI is victim too :( - error: RPC failed; curl 35 gnutls_handshake() failed: Error in the pull function. fatal: The remote end hung up unexpectedly16:27
*** markus_z has quit IRC16:28
*** matrohon_ has quit IRC16:29
*** vsaienko has joined #openstack-infra16:29
isaacbfungi, clarkb: my MTRs: http://paste.openstack.org/show/607708/16:30
*** jascott1 has joined #openstack-infra16:31
*** krtaylor has joined #openstack-infra16:31
*** gyee has quit IRC16:32
*** smarcet has quit IRC16:34
*** tie has quit IRC16:36
pabelangerdo we have a launchpad bug open for  gnutls_handshake() failed: Error in the pull function error?16:36
clarkbpabelanger: I think there is already one for e-r16:37
pabelangerclarkb: k, checking16:37
clarkbhttp://status.openstack.org/elastic-recheck/#128287616:37
clarkbhttp://status.openstack.org/elastic-recheck/#138437316:37
*** jpena is now known as jpena|away16:37
clarkbhttp://status.openstack.org/elastic-recheck/#129800616:38
clarkbwe apparently have a few :)16:38
*** florianf has quit IRC16:40
*** bmjen has joined #openstack-infra16:40
*** Hunner has joined #openstack-infra16:41
*** Hunner has quit IRC16:41
*** Hunner has joined #openstack-infra16:41
*** gyee has joined #openstack-infra16:42
*** ramishra has quit IRC16:44
*** ramishra has joined #openstack-infra16:46
clarkbI stopped my clone loop as it had never failed/stopped16:47
openstackgerritMerged openstack-infra/puppet-diskimage_builder master: Make vhd-util optional  https://review.openstack.org/41084916:50
*** mat128 has quit IRC16:50
*** dizquierdo has quit IRC16:50
dmsimardgouthamr: from where are you seeing that ?16:51
gouthamrdmsimard: in our cinder/manila 3rd party CI16:51
*** mat128 has joined #openstack-infra16:52
gouthamrdmsimard: ex: http://54.153.118.32/ci-logs/logs/53/459153/3/upstream-check/cinder-7mode-NFS/15a0d63/logs/devstack-gate-setup-workspace-new.txt16:52
*** dhinesh has joined #openstack-infra16:53
*** ramishra has quit IRC16:53
pabelangerWow16:57
pabelanger+ cat /etc/dib-builddate.txt^M16:57
pabelanger2016-12-15 04:52^M16:57
pabelangerinfracloud-chocolate just served up that image to nodepool16:57
*** jaosorior is now known as jaosorior_away16:59
*** ramishra has joined #openstack-infra17:01
*** derekh has quit IRC17:01
*** vsaienko has quit IRC17:03
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Include experimental jobs in cistatus page  https://review.openstack.org/45940817:05
pabelangerclarkb: fungi: I think we are getting possible network issues from nodepool.o.o to infracloud too. I am seeing more SSH exceptions today17:05
*** claudiub has joined #openstack-infra17:05
*** adrian_otto1 has joined #openstack-infra17:06
pabelangerI'm going to see if I can reproduce it17:06
*** vsaienko has joined #openstack-infra17:06
clarkbpabelanger: its likely all the same issue17:06
*** dhajare has joined #openstack-infra17:07
*** isaacb has quit IRC17:08
*** ramishra has quit IRC17:08
*** adrian_otto has quit IRC17:09
pabelangeragree, just want to confirm not some other issue17:09
*** ramishra has joined #openstack-infra17:10
*** efoley_ has quit IRC17:11
*** prateek has joined #openstack-infra17:12
openstackgerritClark Boylan proposed openstack-infra/zuul feature/zuulv3: Use current class name on super call  https://review.openstack.org/45940917:12
*** smarcet has joined #openstack-infra17:12
*** e0ne has joined #openstack-infra17:13
*** vsaienko has quit IRC17:14
*** ramishra has quit IRC17:15
*** ihrachys has quit IRC17:15
*** ramishra has joined #openstack-infra17:16
*** ihrachys has joined #openstack-infra17:17
*** dhinesh has quit IRC17:17
*** mat128 has quit IRC17:17
*** flepied has joined #openstack-infra17:18
*** yamahata_ has quit IRC17:20
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Fetch server console log if ssh connection fails  https://review.openstack.org/45249417:20
*** chem is now known as chem_gone17:20
*** thiagolib_ has joined #openstack-infra17:21
*** Swami has joined #openstack-infra17:21
*** adrian_otto1 has quit IRC17:23
*** HeOS has quit IRC17:23
fungipabelanger: yeah, i wonder if there's an overloaded or flaky abovenet/cogent/level3 peering point17:24
*** vsaienko has joined #openstack-infra17:24
*** smarcet has quit IRC17:26
*** ihrachys_ has joined #openstack-infra17:26
*** smarcet has joined #openstack-infra17:26
*** ihrachys has quit IRC17:27
*** ralonsoh has quit IRC17:28
*** vsaienk0 has quit IRC17:29
*** ramishra has quit IRC17:29
*** smarcet has quit IRC17:30
*** tosky has quit IRC17:31
*** mat128 has joined #openstack-infra17:31
mgagnemordred: is the puppet module for Ansible the equivalent of running puppet agent -t ? (with overridable parameters)17:37
*** dhinesh has joined #openstack-infra17:37
*** Swami has quit IRC17:38
*** salv-orlando has joined #openstack-infra17:38
*** Nisha_Agarwal has left #openstack-infra17:40
*** StaceyF has joined #openstack-infra17:42
*** jpena|away is now known as jpena17:45
*** ssbarnea has quit IRC17:45
*** vsaienk0 has joined #openstack-infra17:47
*** ramishra has joined #openstack-infra17:48
*** yolanda has quit IRC17:48
rcarrillocruzWith bonus points of also working as puppet apply17:49
*** jascott1 has quit IRC17:51
*** ramishra has quit IRC17:53
*** prateek has quit IRC17:54
*** amotoki has quit IRC17:54
*** ramishra has joined #openstack-infra17:55
*** yamahata_ has joined #openstack-infra17:57
dhellmannpabelanger : sorry, I had to step away not long before your question. I could find a couple of jobs for you if it would still be useful to have that list17:57
*** smarcet has joined #openstack-infra17:59
*** chlong has joined #openstack-infra17:59
openstackgerritgreghaynes proposed openstack/diskimage-builder master: Add networkd-dhcp element  https://review.openstack.org/45941918:01
*** john-dav_ has quit IRC18:03
mordredmgagne: what's puppet agent -t ?18:05
*** leong has quit IRC18:05
mordredmgagne: (but maybe? it tries to provide a mechanism to be able to run either agent or apply as needed)18:06
openstackgerritMerged openstack-infra/system-config master: Split infracloud baremetal into separate playbook run  https://review.openstack.org/45934818:09
*** tosky has joined #openstack-infra18:12
*** Swami has joined #openstack-infra18:13
pabelangerclarkb: did you want to look at https://review.openstack.org/#/c/455062/ again? Cleans apt index cache in DIB18:14
pabelangerclarkb: just seen a Hash Sum mismatch for configure_mirror.sh in nodepool18:14
openstackgerritgreghaynes proposed openstack/diskimage-builder master: Add networkd-dhcp element  https://review.openstack.org/45941918:15
*** electrofelix has quit IRC18:16
*** ssbarnea has joined #openstack-infra18:16
clarkbpabelanger: we weren't able to get consensus on that I think?18:18
clarkb(I'm obviously opinionated, might be good to have someone without an opinion look?)18:18
pabelangerclarkb: ianw has left a +2 with comments, if you wanted to review18:19
*** rbrndt has joined #openstack-infra18:19
fungiclarkb: any chance you could approve an openstackid production update (already tested on the dev server)? https://review.openstack.org/45808618:19
pabelangerdhellmann: sure if you'd like. I think we are okay now, but doesn't hurt to look18:23
dhellmannpabelanger : here's a couple: https://etherpad.openstack.org/p/fQFiFs52CT18:24
dhellmannactually the 2nd one there had a connection error but logged more detail18:25
*** dtantsur is now known as dtantsur|afk18:25
pabelangerdhellmann: 2nd and 3rd are fixed, we had a bad compute host in infracloud. 1st is related to the networking issues ongoing today18:26
dhellmannpabelanger : sounds good18:26
dmsimardpabelanger, fungi: mwhahaha from puppet-openstack are also reporting failures, this time with zuul-cloner timing out: ttp://logs.openstack.org/59/459359/1/check/gate-puppet-heat-puppet-beaker-rspec-centos-7/704cefc/console.html#_2017-04-24_16_56_58_12314218:29
dmsimarder, bad copy paste: http://logs.openstack.org/59/459359/1/check/gate-puppet-heat-puppet-beaker-rspec-centos-7/704cefc/console.html#_2017-04-24_16_56_58_12314218:29
openstackgerritgreghaynes proposed openstack/diskimage-builder master: Add networkd-dhcp element  https://review.openstack.org/45941918:29
mwhahahahttp://logs.openstack.org/59/459359/1/check/gate-puppet-openstack-integration-4-scenario003-tempest-centos-7/3b47a45/console.html#_2017-04-24_16_55_50_20474818:29
mwhahahai've got a whole bunch18:29
fungidmsimard: mwhahaha: yep, that was in infracloud as well18:30
fungipabelanger: what do you think about disabling infracloud in nodepool for now until whatever's broken out on the internet gets fixed?18:30
dmsimardIs there a grafana dashboard of job outcomes per provider ?18:32
pabelangerfungi: is there somebody we can contact at HPE to troubleshoot?18:32
fungipabelanger: i think asselin_ was the last contact we had, not sure if he's still there?18:33
asselin_i'm around18:33
pabelangerya, I mean, we can turn down infracloud, but would be good to get some eyes on the network too18:33
fungiasselin_: any chance you've seen brokenness reaching @.openstack.org servers in rackspace today?18:34
jpenaI don't want to jinx it, but we haven't had issues in the last 20 minutes (which is quite an achievement today)18:34
fungier, *.openstack.org18:34
pabelangerdmsimard: http://grafana.openstack.org/dashboard/db/nodepool-infra-cloud18:34
asselin_fungi, everything's working from what I can tell. gerrit, http://codesearch.openstack.org18:34
fungiit's highly unlikely to be a network problem _in_ hpe, but rather may be one they can report to one of their upstream network service/backbone providers18:34
*** xarses_ has joined #openstack-infra18:35
pabelangerError Node Launch Attempts is what I've been tracking for nodepool.o.o to infracloud SSH issues18:35
asselin_at least within from hpe vpn18:35
fungibut odds are if it's impacting others as significantly as it is us (which is highly likely) then the backbone providers involved are already painfully aware and working to address the situation18:36
openstackgerritAlfredo Moralejo proposed openstack-infra/tripleo-ci master: Remove centos-release-openstack-* in nodes preparation  https://review.openstack.org/45942118:36
fungiso short of getting bgp prefs tuned in rackspace _and_ all the other networks where we're seeing this behavior manifest, there's likely not a lot we can influence18:37
rajinirDevstack gate is failing , may be we are missing something in configure_libvirt  tee: /etc/libvirt/qemu.conf: No such file or directory, any idea?18:37
*** ZZelle_ has joined #openstack-infra18:37
*** jcoufal has quit IRC18:38
openstackgerritRosario Di Somma proposed openstack-infra/shade master: Define a base function to remove unneeded attributes  https://review.openstack.org/45942218:38
pabelangerfungi: our ansible wheel for infracloud just came back online too. that should give another data point for potential SSH failures18:39
*** jcoufal has joined #openstack-infra18:40
pabelangerrajinir: have a log we can look at?18:40
rajinirpabelanger: https://stash.opencrowbar.org/logs/38/459338/1/check/dell-hw-tempest-dsvm-ironic-pxe_ipmitool/d6a88a3/18:41
openstackgerritAlex Schultz proposed openstack-infra/project-config master: Remove centos openstack repos  https://review.openstack.org/45942518:42
*** salv-orlando has quit IRC18:45
openstackgerritMikhail S Medvedev proposed openstack-infra/puppet-openstackci master: Add parameter override to disable vhd support  https://review.openstack.org/45942718:46
*** andreas-f has joined #openstack-infra18:46
*** jpena is now known as jpena|away18:49
*** dhajare has quit IRC18:51
pabelangerfungi: we seem to be on the right track with infracloud now. I haven't seen a network blip since 18:20UTC.18:54
pabelangermaybe we are over the hump18:54
fungioh, hopefully whoever had a problem fixed whatever it was then18:54
* fungi shakes fist at internets18:55
*** maishsk has joined #openstack-infra18:57
*** jamesdenton has quit IRC19:03
clarkbpabelanger: I think I would be much more comfortable if someone that hasn't already formed an opinion on it just to be sure I'm not out in left field19:03
clarkb(also less comfortable using new +2 powers when potentially in left field, I do agree with ianw fwiw)19:04
*** john-davidge has joined #openstack-infra19:04
*** wolverineav has quit IRC19:04
*** e0ne has quit IRC19:05
*** e0ne has joined #openstack-infra19:05
*** wolverineav has joined #openstack-infra19:07
fungirajinir: do we not exercise configure_libvirt() from lib/nova_plugins/functions-libvirt in upstream ci jobs?19:08
fungior maybe your images are missing something we're installing on ours19:08
openstackgerritgreghaynes proposed openstack/diskimage-builder master: Add networkd-dhcp element  https://review.openstack.org/45941919:08
*** jascott1 has joined #openstack-infra19:08
*** john-davidge has quit IRC19:09
*** e0ne has quit IRC19:10
*** wolverineav has quit IRC19:13
*** vsaienko has quit IRC19:14
*** saibarspeis has quit IRC19:20
pabelangerokay, puppet running on infracloud again19:21
pabelangerstill not baremetal0019:21
*** arxcruz has quit IRC19:21
*** vsaienko has joined #openstack-infra19:22
*** jamesdenton has joined #openstack-infra19:22
pabelangerclarkb: also, any thoughts to limits.conf changes19:23
clarkbpabelanger: I would say go for it now that its not end of week19:24
*** hasharAway is now known as hashar19:25
pabelangerclarkb: great, do you mind +3 then, we needed a rebase last week: https://review.openstack.org/#/c/458550/19:26
clarkbdone19:28
pabelangerdanke19:28
*** mat128 has quit IRC19:30
*** thiagolib_ has quit IRC19:31
*** ramishra has quit IRC19:33
asselin_fungi, we have some spam over in openstack-third-party-ci19:33
*** shardy has quit IRC19:33
asselin_or anyone else that knows how to block a user ^^19:33
asselin_chatter2919:33
openstackgerritMerged openstack-infra/system-config master: Remove security limits and apt.conf.d setting from diskimages  https://review.openstack.org/45855019:34
smarcetAjaeger:ianychoi: i just created a new zanata project in order to perform the user survey translation, i already uploaded the pot files, we need to translate them to chinese on a first iteration, which are the next steps to achieve that ?19:34
*** shardy has joined #openstack-infra19:34
*** arxcruz has joined #openstack-infra19:34
*** dimtruck is now known as zz_dimtruck19:35
*** salv-orlando has joined #openstack-infra19:35
openstackgerritMerged openstack-infra/system-config master: Remove haveged from single_use_slave  https://review.openstack.org/45857319:35
openstackgerritMerged openstack-infra/system-config master: Remove users.pp and users_install.pp from single_use_slave.pp  https://review.openstack.org/45861719:35
rajinirfungi> May be we are mussing something in the image and I don't know what or may be its a config19:36
rajinir<pabelanger>,fungi : It started breaking last friday19:37
fungiasselin_: i'm struggling. for some reason adding them to the akick list isn't working19:38
asselin_seems to have worked: chatter29 has quit (K-Lined)19:38
fungiasselin_: looks like freenode finally got them, yeah19:38
fungithat wasn't me19:38
asselin_ok, thanks19:38
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Remove install_resolv_conf param from s_u_s  https://review.openstack.org/45894619:38
fungiasselin_: chanserv would have kicked them if what i was doing had worked19:38
rajinirhttps://www.irccloud.com/pastebin/eRGbKjAK/imageconfig19:38
fungionly freenode network admins can add k-lines on the servers19:39
rajinirfungi: https://www.irccloud.com/pastebin/eRGbKjAK/imageconfig19:39
*** baoli has quit IRC19:39
*** shardy has quit IRC19:39
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Remove certname parameter  https://review.openstack.org/45893719:40
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Remove references to the simple_slave class  https://review.openstack.org/45893619:40
*** baoli has joined #openstack-infra19:40
*** StaceyF has quit IRC19:41
pabelangerrajinir: I am not sure this is image related, it looks like the qemu package didn't create the required folders19:41
pabelangerrajinir: it might be worth asking #openstack-qa if they see this issue before19:41
rajinirpabelanger>sure, thanks19:42
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Move iptables management to o_p::server  https://review.openstack.org/45898619:42
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Move afs client to openstack_project::server  https://review.openstack.org/45894419:42
*** mat128 has joined #openstack-infra19:46
openstackgerritSlawek Kaplonski proposed openstack-infra/shade master: Replace neutronclient with REST API calls in network commands  https://review.openstack.org/45943819:52
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Move iptables management to o_p::server  https://review.openstack.org/45898619:52
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Move afs client to openstack_project::server  https://review.openstack.org/45894419:52
*** sree has joined #openstack-infra19:55
*** mat128 has quit IRC19:55
*** matrohon_ has joined #openstack-infra19:56
*** jamesdenton has quit IRC19:57
openstackgerritColleen Murphy proposed openstack-infra/project-config master: Add iptables rules to nodepool-base element  https://review.openstack.org/45898519:58
*** ijw has quit IRC19:58
*** jamesdenton has joined #openstack-infra19:58
*** mat128 has joined #openstack-infra19:59
*** sree has quit IRC20:00
*** wolverineav has joined #openstack-infra20:00
*** esikachev has quit IRC20:01
*** jcoufal has quit IRC20:01
openstackgerritColleen Murphy proposed openstack-infra/project-config master: Add firewall support for opensuse  https://review.openstack.org/45905520:01
*** sambetts is now known as sambetts|afk20:01
*** pcaruana has quit IRC20:01
*** baoli has quit IRC20:01
*** baoli has joined #openstack-infra20:02
*** harlowja has quit IRC20:03
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Move iptables management to openstack_p::server  https://review.openstack.org/45898620:03
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Move iptables management to o_p::server  https://review.openstack.org/45898620:05
*** MasterOfBugs has joined #openstack-infra20:08
ianychoismarcet, hello. where can I find Zanata project? https://translate.openstack.org/project/view/user-survey-2017 is the right place (naming "1")?20:08
*** ihrachys_ is now known as ihrachys20:08
smarcetianychoi: hey how are u doing? here https://translate.openstack.org/iteration/view/openstack-user-survey/openstack-user-survey/settings/documents?dswid=-618420:09
*** dprince has quit IRC20:09
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Move iptables management to o_p::server  https://review.openstack.org/45898620:11
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Move afs client to openstack_project::server  https://review.openstack.org/45894420:11
ianychoismarcet, wow looks so great! Although there are lots of words to be translated, I will ask translators to translate user-survey!20:11
*** esikachev has joined #openstack-infra20:12
smarcetianychoi: really appreciate it, i create 2 files, 1 for survey hardcoded messages ( on UI) and another for the content itself of the survey ( template ) that resides on DB20:12
smarcetthx!20:12
*** mat128 has quit IRC20:13
*** jamielennox is now known as jamielennox|away20:13
ianychoismarcet, it's my great pleasure! Then can I hear the best due to be translated? I simply remember the translation due would be around June but I am not pretty sure now.20:14
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Add a finger protocol log streamer  https://review.openstack.org/45672120:14
smarcetianychoi: let me find it out20:14
openstackgerritAlex Schultz proposed openstack-infra/project-config master: Remove centos openstack repos  https://review.openstack.org/45942520:16
ianychoismarcet, thanks!20:17
*** esikachev has quit IRC20:18
*** jamielennox|away is now known as jamielennox20:20
*** john-davidge has joined #openstack-infra20:25
*** john-davidge has quit IRC20:25
smarcetianychoi: june 1st is enough time ?20:25
*** jascott1 has quit IRC20:26
*** jascott1 has joined #openstack-infra20:26
ianychoismarcet, thanks - actually survey_template has lots of words but I will ask translators :) Would it be okay?20:26
*** mat128 has joined #openstack-infra20:27
smarcetianychoi: sure thx20:27
*** jamesmca_ has joined #openstack-infra20:29
*** rhallisey has quit IRC20:29
jamesmca_ianychoi: hi!20:29
ianychoijamesmca_, hello!20:30
jamesmca_ianychoi: I was just speaking to smarcet re: translations.20:30
*** mat128 has quit IRC20:30
pabelangerclarkb: just confirmed on fedora, we'll need https://review.openstack.org/#/c/458933/ enable haveged on boot20:30
pabelangerclarkb: Should be a noop for ubuntu-xenial20:31
pabelangerconfirming now20:31
jamesmca_ianychoi: heidi joy had asked to do Simplified Chinese, Traditional Chinese, Korean, Japanese20:31
openstackgerritJon Bernard proposed openstack-infra/project-config master: Load plugin configuration for the ceph job  https://review.openstack.org/45944520:31
*** zz_dimtruck is now known as dimtruck20:31
jamesmca_Is that possible to do within the June 1 timeframe?20:31
ianychoijamesmca_, I need to ask language coordinators. I originally thought that it would be June 30 (same June but different day)20:32
jamesmca_ianychoi: we could probably stagger it a bit, but the schedule for the OSD Asia wouldn't provide us enough time to integrate and QA the survey20:33
jamesmca_July 13-14: OSD Korea20:33
jamesmca_July 18-19: OSD Taiwan20:33
jamesmca_July 20-21: OSD Japan20:33
jamesmca_July 22-23: OSD India20:33
jamesmca_July 24-25: OSD China20:33
clarkbpabelanger: and dib-init-system won't do it for systemd? trying to reconcile the comment in the code with the special sauce for systemd20:34
jamesmca_ianychoi: So we could probably do something like Korean by June 1, then traditional Chinese + simplified the next week, then Japanese... something along those lines.20:34
pabelangerclarkb: no, it will run for systemd only20:34
pabelangerbut, give me 2mins, should be a noop on ubuntu20:34
pabelangersince it is already enabled20:35
openstackgerritSukhdev Kapur proposed openstack-infra/project-config master: Adding new project networking-opencontrail  https://review.openstack.org/45779220:35
ianychoijamesmca_, yep I agree :) Now I tell that I can first speed up Korean translation because I am a Korean translator. For Taiwan (Traditional Chinese), I am not sure because Taiwan translators have been less active. For Simplified Chinese and Japanese, I can contact to language coordinators20:36
*** tnovacik has joined #openstack-infra20:36
jamesmca_ianychoi: great!20:36
pabelangerclarkb: confirmed, noop20:36
jamesmca_ianychoi: just keep me posted. Might be best to use email so that we can loop in Heidi Joy.20:36
ianychoijamesmca_, by the way, for QA, would it possible to also for translators to see user survey sites with translated sentences for qualified translation?20:37
*** mat128 has joined #openstack-infra20:38
jamesmca_ianychoi: Yes sir. The integration of the language files shouldn't take too much time (according to smarcet). But I'd like to leave plenty of room for the translators to review and test the actual survey.20:38
clarkbpabelanger: right I get its a noop on ubuntu because they enable by default. I'm confused why dib-init-system only does it for one init system (openrc)20:38
jamesmca_ianychoi: we can set up accounts for them on our dev server so they can run through it20:38
clarkbpabelanger: the comment says thats what happens anyways20:38
pabelangerclarkb: not sure I follow20:39
greghaynesclarkb: pabelanger commented on that patch20:39
ianychoijamesmca_, great - cool :) Translators will also do QA I think then20:39
jamesmca_fantastic :)20:40
clarkbgreghaynes: pabelanger is it symlinking?20:40
pabelangergreghaynes: yes, works. We use it for other infra elements20:40
ianychoi:)20:40
clarkbI thought it was compiling state20:40
greghaynesclarkb: it checks the dependencies and makes the proper sylinks in /etc/systemd/system AIUI20:41
pabelangeryes, symlinks20:41
*** mat128 has quit IRC20:41
greghaynespabelanger: thats surprising, have you only tried same builder as target?20:42
greghaynesid be interested if that also works cross distro20:42
pabelangerit should, we are doing it with unbound today20:43
pabelangersystemctl enable initialize-urandom.service too20:43
greghayneshrm20:43
greghaynesok20:43
*** wolverineav has quit IRC20:43
pabelangersurprisingly, this part of systemd hasn't been an issue :)20:43
*** wolverineav has joined #openstack-infra20:43
*** vsaienko has quit IRC20:43
greghaynesI think we have hit issues in the past but maybe things are more stable now20:44
pabelangerwe have seen issue with systemd redirecting to sysv script in glean20:44
greghaynesI want to say we had some issues around systemctl when the builder didnt have systemd at all20:44
*** Sukhdev has joined #openstack-infra20:44
pabelangerYa, that has been good for us so far, nodepool-builders are ubuntu-trusty currently20:45
pabelangerI don't think we have systemd libraries installed20:45
greghayneswierd, welp, if it works then great20:45
*** vsaienko has joined #openstack-infra20:46
*** rfolco has quit IRC20:46
*** krtaylor has quit IRC20:51
*** askb has joined #openstack-infra20:52
openstackgerritMikhail S Medvedev proposed openstack-infra/puppet-openstackci master: Add parameter override to disable vhd support  https://review.openstack.org/45942720:54
* fungi needs to disappear for a few hours to entertain visitors, back later20:54
*** wolverineav has quit IRC20:55
pabelangerclarkb: I didn't follow your openrc comment on 45893320:57
*** matrohon_ has quit IRC20:58
clarkbpabelanger: posted comment on the diff, hopefully thats more clear?20:58
*** harlowja has joined #openstack-infra20:59
*** Apoorva_ has joined #openstack-infra21:00
*** thorst has quit IRC21:01
*** adrian_otto has joined #openstack-infra21:02
*** yolanda has joined #openstack-infra21:02
*** Goneri has quit IRC21:03
*** Apoorva has quit IRC21:04
*** rockyg has joined #openstack-infra21:04
*** mat128 has joined #openstack-infra21:05
openstackgerritMikhail S Medvedev proposed openstack-infra/puppet-openstackci master: Add parameter override to disable vhd support  https://review.openstack.org/45942721:05
*** esikachev has joined #openstack-infra21:06
*** annegentle has quit IRC21:08
*** mat128 has quit IRC21:09
*** mat128 has joined #openstack-infra21:10
*** pradk has quit IRC21:11
*** esikachev has quit IRC21:11
*** ldnunes has quit IRC21:13
*** jamesmca_ has quit IRC21:14
*** jamesmca_ has joined #openstack-infra21:14
*** esikachev has joined #openstack-infra21:15
pabelangerclarkb: thanks, replied21:17
*** vhosakot has joined #openstack-infra21:18
*** jamesmca_ has quit IRC21:19
*** adrian_otto has quit IRC21:19
*** mat128 has quit IRC21:19
*** dimtruck is now known as zz_dimtruck21:19
*** zz_dimtruck is now known as dimtruck21:19
clarkbpabelanger: I +2'd but didn't approve in case we want to clean that up21:20
clarkb(eg update ocmment to say something like TODO make gentoo work)21:20
*** adrian_otto has joined #openstack-infra21:20
pabelangerclarkb: good idea21:21
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Confirm haveged has been enabled on boot  https://review.openstack.org/45893321:22
pabelangerclarkb: if you don't mind again ^21:23
*** esikachev has quit IRC21:23
openstackgerritColleen Murphy proposed openstack-infra/project-config master: Add firewall support for opensuse  https://review.openstack.org/45905521:25
*** abelur_zzz is now known as abelur21:26
*** john-davidge has joined #openstack-infra21:26
*** ssbarnea_ has joined #openstack-infra21:26
*** ssbarnea has quit IRC21:29
*** john-davidge has quit IRC21:31
*** Julien-zte has joined #openstack-infra21:36
*** annegentle has joined #openstack-infra21:37
*** Apoorva_ has quit IRC21:38
openstackgerritSlawek Kaplonski proposed openstack-infra/shade master: Remove neutronclient mocks from subnet tests  https://review.openstack.org/45945721:38
*** krtaylor has joined #openstack-infra21:38
*** Apoorva has joined #openstack-infra21:39
*** jascott1 has quit IRC21:39
*** jascott1 has joined #openstack-infra21:40
*** eharney has quit IRC21:40
*** baoli has quit IRC21:40
*** vsaienk0 has quit IRC21:41
*** thorst has joined #openstack-infra21:41
*** hashar has quit IRC21:41
*** wolverineav has joined #openstack-infra21:41
*** jamesdenton has quit IRC21:42
*** jascott1 has quit IRC21:42
*** felipemonteiro has quit IRC21:44
*** Julien-zte has quit IRC21:44
openstackgerritMerged openstack-infra/project-config master: Confirm haveged has been enabled on boot  https://review.openstack.org/45893321:45
*** thorst has quit IRC21:46
*** Julien-zte has joined #openstack-infra21:47
dmsimardpabelanger: I actually found the openstack-ansible issue21:48
*** jkilpatr has quit IRC21:48
dmsimardpabelanger: just now, it's silly21:48
pabelangerok21:48
dmsimardpabelanger: the ara job uses this builder to get upper-constraints: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/macros.yaml#L40-L7121:49
*** salv-orl_ has joined #openstack-infra21:49
dmsimardthe clone map uses "$ZUUL_PROJECT", which in the case of the ARA gate is.. well.. ara21:49
dmsimardbut the OSA job expects the u-c file to be inside the osa git repo21:50
dmsimardinvocation failed (errno 2), args: ['/home/jenkins/workspace/gate-ara-integration-openstack-ansible-func-centos-7-nv/openstack-ansible-tests/.tox/functional/bin/pip', 'install', '-c/home/jenkins/workspace/gate-ara-integration-openstack-ansible-func-centos-7-nv/openstack-ansible-tests/upper-constraints.txt'21:50
*** tnovacik has quit IRC21:50
pabelangerright, I want to clean that up21:50
dmsimardWonder if there's a solution without essentially copying the whole prep upper constraints job with a modified clonemap to the ara jobs file21:51
pabelangertoday we manually copy the constraints.txt file into the repo directly21:51
pabelangerwhere we could just set a variable to some other path on disk21:51
dmsimardlike, say, a jenkins binding ?21:51
*** xarses has quit IRC21:51
dmsimardthe file path would be available under $UPPER_CONSTRAINTS or something21:51
*** salv-orlando has quit IRC21:51
dmsimarduh, wait, no21:52
pabelangerdmsimard: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/macros.yaml#n70 is what I want to fix21:52
pabelangerand just export a variable inplace of copy file21:52
dmsimardmaybe ?21:53
dmsimardexported vars don't carry from a builder to the other though21:53
*** EricGonczer_ has joined #openstack-infra21:54
*** esberglu has quit IRC21:54
*** srobert has quit IRC21:55
*** rockyg has quit IRC21:55
*** esberglu has joined #openstack-infra21:55
*** ijw has joined #openstack-infra21:55
pabelangerright, JJB this is an issue. something I noticed on zuulv321:55
*** rockyg has joined #openstack-infra21:55
*** esberglu has quit IRC21:56
*** esberglu has joined #openstack-infra21:56
*** esberglu has quit IRC21:56
*** esberglu has joined #openstack-infra21:56
*** esberglu has quit IRC21:57
*** vsaienk0 has joined #openstack-infra21:58
*** smarcet has quit IRC22:00
jeblairit's zuul meeting time in #openstack-meeting-alt22:00
*** rockyg has quit IRC22:01
*** esikachev has joined #openstack-infra22:02
*** esikachev has quit IRC22:07
*** xarses has joined #openstack-infra22:08
*** EricGonczer_ has quit IRC22:08
*** gordc has quit IRC22:09
*** smarcet has joined #openstack-infra22:14
openstackgerritDavid Moreau Simard proposed openstack-infra/project-config master: Adjust OSAD integration job in ARA check gate to make it work  https://review.openstack.org/45946222:15
*** smarcet has quit IRC22:16
*** EricGonczer_ has joined #openstack-infra22:17
*** vsaienko has quit IRC22:18
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Add a finger protocol log streamer  https://review.openstack.org/45672122:21
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Add a finger protocol log streamer  https://review.openstack.org/45672122:24
*** sshnaidm has joined #openstack-infra22:26
*** john-davidge has joined #openstack-infra22:27
*** jkilpatr has joined #openstack-infra22:29
dmsimardpabelanger: hopefully https://review.openstack.org/459462 makes sense22:32
*** john-davidge has quit IRC22:32
cloudnulldmsimard: woot!22:34
dmsimardcloudnull: you know sometimes you sleep on a problem for two months and find the solution right away ?22:34
dmsimardfeelsgoodman.jpg22:34
cloudnull:)22:35
dmsimardcloudnull: next version of ara is sort of a milestone so got to make sure everything works well :)22:36
cloudnullI love ARA, we've recently adopted it internally at within the RAX RPC product.22:39
cloudnulltoo much good stuff22:39
dmsimardthat's awesome :)22:39
*** esikachev has joined #openstack-infra22:42
*** rbrndt has quit IRC22:44
*** xarses_ has quit IRC22:46
*** esikachev has quit IRC22:47
*** wolverineav has quit IRC22:50
*** jamesdenton has joined #openstack-infra22:51
*** adrian_otto has quit IRC22:52
*** Julien-zte has quit IRC22:55
*** Julien-zte has joined #openstack-infra22:56
*** felipemonteiro has joined #openstack-infra22:57
*** sdague has quit IRC23:03
*** ssbarnea_ has quit IRC23:10
*** dimtruck is now known as zz_dimtruck23:10
*** salv-orl_ has quit IRC23:10
*** vhosakot has quit IRC23:13
*** jascott1 has joined #openstack-infra23:14
*** esikachev has joined #openstack-infra23:14
*** ZZelle_ has quit IRC23:18
*** esikachev has quit IRC23:19
*** hyakuhei has quit IRC23:22
*** mriedem has left #openstack-infra23:24
*** hyakuhei has joined #openstack-infra23:28
*** john-davidge has joined #openstack-infra23:28
*** zerick_ is now known as zerick23:28
*** dave-mccowan has quit IRC23:30
*** Julien-zte has quit IRC23:30
*** sree has joined #openstack-infra23:31
*** john-davidge has quit IRC23:32
*** spotz_ has quit IRC23:34
*** sree has quit IRC23:35
*** claudiub has quit IRC23:36
*** zz_dimtruck is now known as dimtruck23:36
*** mriedem has joined #openstack-infra23:36
*** lamt has quit IRC23:36
openstackgerritRosario Di Somma proposed openstack-infra/shade master: Define a base function to remove unneeded attributes  https://review.openstack.org/45942223:40
*** annegentle has quit IRC23:46
*** shrircha has joined #openstack-infra23:49
*** EricGonczer_ has quit IRC23:53
*** shrircha has quit IRC23:53
*** jamesmca_ has joined #openstack-infra23:55
*** spotz_ has joined #openstack-infra23:56
*** megm has quit IRC23:58
*** spotz_ has quit IRC23:58
*** annegentle has joined #openstack-infra23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!