Wednesday, 2016-10-05

mordredarmax: I actually have the least amount of troubles in this regard with you - so thank you!~00:00
armaxmordred: cool, enjoy it while it lasts :)00:00
*** rbrndt has quit IRC00:00
*** thcipriani is now known as thcipriani|afk00:01
* mordred apoligizes in advance for the imminent patch bomb00:02
openstackgerritMonty Taylor proposed openstack-infra/shade: Make sure we're matching image status properly  https://review.openstack.org/37716400:04
openstackgerritMonty Taylor proposed openstack-infra/shade: Normalize images  https://review.openstack.org/37716300:04
openstackgerritMonty Taylor proposed openstack-infra/shade: Add location to server record  https://review.openstack.org/38135300:04
openstackgerritMonty Taylor proposed openstack-infra/shade: Start splitting normalize functions into a mixin  https://review.openstack.org/38135200:04
openstackgerritMonty Taylor proposed openstack-infra/shade: Add helper properties to generate location info  https://review.openstack.org/38133900:04
openstackgerritMonty Taylor proposed openstack-infra/shade: Move normalize_flavors to _normalize  https://review.openstack.org/38135500:04
openstackgerritMonty Taylor proposed openstack-infra/shade: Move image normalize calls to _normalize  https://review.openstack.org/38135400:04
openstackgerritMonty Taylor proposed openstack-infra/shade: Add simple field for disabled flavors  https://review.openstack.org/37704900:04
openstackgerritMonty Taylor proposed openstack-infra/shade: Add location field to flavors  https://review.openstack.org/38135600:04
openstackgerritMonty Taylor proposed openstack-infra/shade: Sort fixed_ips for ports  https://review.openstack.org/38211200:04
openstackgerritMonty Taylor proposed openstack-infra/shade: Move and fix security group normalization  https://review.openstack.org/38211300:04
openstackgerritIan Y. Choi proposed openstack-infra/project-config: Add openstack-dev/sandbox groups for training  https://review.openstack.org/37583400:06
anteayanice patch bomb00:10
mordredthanks!00:10
mordredI unfortunately had to add a patch to the beginning of the stack00:10
*** amitgandhinz has joined #openstack-infra00:10
anteayaah00:11
jeblairmordred: https://review.openstack.org/382096 may interest you00:11
mordredjeblair: I'm sure it will00:12
mordred++00:13
ianwclarkb: https://bugs.launchpad.net/ubuntu/+source/apache2/+bug/1630413 <- more confused now than when i started i think.00:15
openstackLaunchpad bug 1630413 in apache2 (Ubuntu) "segfault in server/mpm/event/event.c:process_socket" [Undecided,New]00:15
jeblairoops, i just realized i made the mountpoint name backwards for developer-docs.  i've changed it from docs-developer to developer-docs now: http://files.openstack.org/developer-docs/00:15
jeblairso api-ref jobs should start publishing there now00:15
*** amitgandhinz has quit IRC00:15
ianwmnaser: if your issues line up with the timestamps in http://paste.openstack.org/show/584330/ it might be worth digging into futher by trying to capture a core.  otherwise, this might be a red-herring and not actually related00:15
*** sdake_ has quit IRC00:16
jeblairpuppetmaster still seems to be running ansible/puppet, so i'm guessing pansible has not blown up00:16
*** jamesdenton has joined #openstack-infra00:17
*** Apoorva_ has quit IRC00:19
anteayapansible sounds like a cute little dog00:19
anteayalike toto00:19
*** Apoorva has joined #openstack-infra00:19
*** mixos has joined #openstack-infra00:23
openstackgerritMerged openstack-infra/project-config: Add puppet apply jobs to ansible-role-puppet  https://review.openstack.org/38209600:25
*** mtanino has quit IRC00:32
*** kzaitsev_mb has quit IRC00:34
*** claudiub has quit IRC00:40
*** gnuoy has quit IRC00:42
*** gnuoy has joined #openstack-infra00:43
*** lezbar has quit IRC00:46
*** lezbar has joined #openstack-infra00:47
*** senk__ has joined #openstack-infra00:49
*** senk_ has quit IRC00:49
*** david-lyle has quit IRC00:52
*** sdake has joined #openstack-infra00:53
*** drifterza has quit IRC00:54
*** tqtran has quit IRC00:56
*** thorst has quit IRC00:58
*** spzala has joined #openstack-infra00:59
*** gouthamr has quit IRC00:59
*** rackertom has quit IRC00:59
openstackgerritTony Breeds proposed openstack-infra/irc-meetings: check_chair: Actually fail if there is a problem.  https://review.openstack.org/37991300:59
*** mixos has quit IRC00:59
*** Ng has quit IRC01:01
*** samueldmq has quit IRC01:01
*** thorst has joined #openstack-infra01:02
*** spzala has quit IRC01:03
*** spzala has joined #openstack-infra01:03
*** esberglu has quit IRC01:03
*** puiterwijk|cld has quit IRC01:03
*** kun_huang has quit IRC01:04
*** Sukhdev has quit IRC01:04
*** xgerman has quit IRC01:04
*** Apoorva_ has joined #openstack-infra01:05
*** rackertom has joined #openstack-infra01:07
*** Ng has joined #openstack-infra01:08
*** Apoorva has quit IRC01:08
*** thorst has quit IRC01:08
*** baoli has quit IRC01:09
*** Apoorva_ has quit IRC01:10
*** jamesdenton has quit IRC01:11
*** amitgandhinz has joined #openstack-infra01:11
openstackgerritMerged openstack-infra/irc-meetings: check_chair: Actually fail if there is a problem.  https://review.openstack.org/37991301:12
*** pvaneck has quit IRC01:12
*** samueldmq has joined #openstack-infra01:14
*** thorst has joined #openstack-infra01:15
*** puiterwijk|cld has joined #openstack-infra01:16
*** kun_huang has joined #openstack-infra01:17
*** amitgandhinz has quit IRC01:17
*** xgerman has joined #openstack-infra01:17
*** tiswanso has joined #openstack-infra01:17
*** tiswanso has quit IRC01:18
*** rfolco has joined #openstack-infra01:18
*** tiswanso has joined #openstack-infra01:18
*** jamesdenton has joined #openstack-infra01:19
*** thorst has quit IRC01:20
*** baoli has joined #openstack-infra01:20
*** tuanluong has joined #openstack-infra01:21
*** thorst has joined #openstack-infra01:26
*** esikachev has joined #openstack-infra01:26
*** baoli has quit IRC01:27
*** thorst has quit IRC01:29
*** mixos has joined #openstack-infra01:30
*** esikachev has quit IRC01:31
openstackgerritMerged openstack-infra/devstack-gate: Copy ssl certs for multinode  https://review.openstack.org/37321901:35
*** gildub has quit IRC01:38
*** tphummel has quit IRC01:41
*** kaisers has joined #openstack-infra01:46
*** gyee has quit IRC01:46
*** woodster_ has quit IRC01:50
*** tuannguyen has joined #openstack-infra01:52
*** tmcm has joined #openstack-infra01:52
tmcmhello01:53
tmcmi'm trying to work with the gerrit sandbox and am encountering the same problem described here:01:53
tmcmhttps://ask.openstack.org/en/question/56720/cannot-store-contact-information-when-updating-info-in-openstack-gerrit/01:53
tmcmdoes one truly need to be a foundation member to use gerrit review?01:53
*** kaisers has quit IRC01:55
tmcmwell01:59
tmcmapparently, the answer is yes.01:59
tmcmdisregard :)01:59
*** tmcm has left #openstack-infra01:59
*** mtanino has joined #openstack-infra02:01
*** lezbar has quit IRC02:04
*** lezbar has joined #openstack-infra02:05
*** amitgandhinz has joined #openstack-infra02:12
openstackgerritMonty Taylor proposed openstack-infra/shade: Make sure we're matching image status properly  https://review.openstack.org/37716402:17
openstackgerritMonty Taylor proposed openstack-infra/shade: Normalize images  https://review.openstack.org/37716302:17
openstackgerritMonty Taylor proposed openstack-infra/shade: Add location to server record  https://review.openstack.org/38135302:17
openstackgerritMonty Taylor proposed openstack-infra/shade: Start splitting normalize functions into a mixin  https://review.openstack.org/38135202:17
openstackgerritMonty Taylor proposed openstack-infra/shade: Add helper properties to generate location info  https://review.openstack.org/38133902:17
openstackgerritMonty Taylor proposed openstack-infra/shade: Move and fix security group normalization  https://review.openstack.org/38211302:17
openstackgerritMonty Taylor proposed openstack-infra/shade: Move normalize_flavors to _normalize  https://review.openstack.org/38135502:17
openstackgerritMonty Taylor proposed openstack-infra/shade: Move image normalize calls to _normalize  https://review.openstack.org/38135402:17
openstackgerritMonty Taylor proposed openstack-infra/shade: Add simple field for disabled flavors  https://review.openstack.org/37704902:17
openstackgerritMonty Taylor proposed openstack-infra/shade: Add location field to flavors  https://review.openstack.org/38135602:17
*** amitgandhinz has quit IRC02:17
*** sdake has quit IRC02:18
mordredarmax: ^^ rebased on top of depends-on on kevinbenton's patch02:18
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: enable undercloud/ssl on multinode jobs  https://review.openstack.org/38208202:19
*** amotoki has joined #openstack-infra02:19
*** sdake has joined #openstack-infra02:20
*** amotoki has quit IRC02:31
*** dragonmaster has joined #openstack-infra02:35
*** yuanying_ has quit IRC02:39
*** amotoki has joined #openstack-infra02:43
*** yamahata has quit IRC02:45
*** thorst has joined #openstack-infra02:50
*** thorst has quit IRC02:54
*** thorst has joined #openstack-infra02:54
*** thorst has quit IRC02:55
*** tuannguyen has quit IRC03:00
*** amotoki_ has joined #openstack-infra03:04
*** thorst has joined #openstack-infra03:05
*** amotoki has quit IRC03:07
*** Sukhdev has joined #openstack-infra03:09
*** thorst has quit IRC03:11
*** Sukhdev has quit IRC03:13
*** amitgandhinz has joined #openstack-infra03:13
fungi#status log X.509 certificate renewed and updated in private hiera for openstackid.org03:15
openstackstatusfungi: finished logging03:15
*** mixos has quit IRC03:17
*** amitgandhinz has quit IRC03:18
*** spzala has quit IRC03:20
*** vikrant has joined #openstack-infra03:29
*** amotoki has joined #openstack-infra03:35
*** amotoki has quit IRC03:36
*** amotoki_ has quit IRC03:36
*** tongli has quit IRC03:38
*** kaisers has joined #openstack-infra03:40
*** sdake has quit IRC03:43
*** sdake has joined #openstack-infra03:43
*** kaisers has quit IRC03:45
*** links has joined #openstack-infra03:45
*** markvoelker has quit IRC03:48
*** tqtran has joined #openstack-infra03:55
*** tiswanso has quit IRC03:59
*** tqtran has quit IRC03:59
openstackgerritMerged openstack/diskimage-builder: Fix typo in extracting root partition  https://review.openstack.org/37729604:00
*** tuannguyen has joined #openstack-infra04:00
*** yuanying has joined #openstack-infra04:02
*** sputnik13 has joined #openstack-infra04:03
*** tuannguyen has quit IRC04:05
openstackgerritMerged openstack/diskimage-builder: Updated from global requirements  https://review.openstack.org/37743104:06
openstackgerritMerged openstack/diskimage-builder: Fix a command in Developer Documentation  https://review.openstack.org/38183304:06
*** amotoki has joined #openstack-infra04:06
*** spzala has joined #openstack-infra04:07
*** spzala has quit IRC04:07
*** hexlibris has quit IRC04:12
*** paulobanon has joined #openstack-infra04:12
*** yuanying has quit IRC04:12
*** yuanying has joined #openstack-infra04:13
*** amitgandhinz has joined #openstack-infra04:14
*** amitgandhinz has quit IRC04:18
*** amotoki_ has joined #openstack-infra04:19
*** amotoki has quit IRC04:23
*** dragonmaster has quit IRC04:24
*** karthikp has quit IRC04:24
*** sdake has quit IRC04:25
*** dragonmaster has joined #openstack-infra04:25
*** adriant has quit IRC04:28
*** adriant has joined #openstack-infra04:30
*** gildub has joined #openstack-infra04:31
*** shu-mutou has joined #openstack-infra04:31
*** yuanying has quit IRC04:36
*** tphummel has joined #openstack-infra04:37
*** csomerville has joined #openstack-infra04:38
*** cody-somerville has quit IRC04:38
*** salv-orlando has joined #openstack-infra04:41
*** yuanying has joined #openstack-infra04:42
openstackgerritTobias Henkel proposed openstack-infra/zuul: Document start day of week  https://review.openstack.org/38213904:43
*** coolsvap has joined #openstack-infra04:44
*** nadya has joined #openstack-infra04:46
*** markvoelker has joined #openstack-infra04:49
*** sdake has joined #openstack-infra04:51
*** armax has quit IRC04:51
*** HenryG has quit IRC04:51
*** HenryG has joined #openstack-infra04:52
*** pgadiya has joined #openstack-infra04:53
*** senk__ has quit IRC04:53
*** markvoelker has quit IRC04:54
*** jamesdenton has quit IRC04:55
*** nadya has quit IRC04:57
*** amotoki_ has quit IRC04:59
*** lezbar has quit IRC05:00
*** lezbar has joined #openstack-infra05:01
*** narayrak has joined #openstack-infra05:02
*** ociuhandu has joined #openstack-infra05:05
*** jaosorior has joined #openstack-infra05:07
openstackgerritMerged openstack/diskimage-builder: Move opensuse utils to zypper so they can be shared by SUSE-based distros  https://review.openstack.org/37983505:10
*** thorst has joined #openstack-infra05:11
*** psachin has joined #openstack-infra05:13
*** psachin has quit IRC05:13
*** psachin has joined #openstack-infra05:14
*** amitgandhinz has joined #openstack-infra05:15
*** thorst has quit IRC05:16
*** clarkb has quit IRC05:18
*** yuval has joined #openstack-infra05:18
*** adriant has quit IRC05:19
*** amitgandhinz has quit IRC05:21
*** jooni has joined #openstack-infra05:27
*** esikachev has joined #openstack-infra05:27
*** kaisers has joined #openstack-infra05:29
*** nadya has joined #openstack-infra05:32
*** esikachev has quit IRC05:32
*** akshai has joined #openstack-infra05:32
*** kaisers has quit IRC05:33
*** jaosorior has quit IRC05:35
*** amoralej|off has quit IRC05:35
*** nadya has quit IRC05:35
*** jaosorior has joined #openstack-infra05:35
*** dmanchad has quit IRC05:36
*** jpena|off has quit IRC05:36
*** kaisers has joined #openstack-infra05:36
*** lin_yang has quit IRC05:41
*** amoralej has joined #openstack-infra05:41
*** dmanchad has joined #openstack-infra05:41
*** larainema has quit IRC05:41
*** amotoki has joined #openstack-infra05:43
*** jpena|off has joined #openstack-infra05:43
*** senk_ has joined #openstack-infra05:44
*** larainema has joined #openstack-infra05:45
*** esikachev has joined #openstack-infra05:45
*** lin_yang has joined #openstack-infra05:46
*** esikachev has quit IRC05:49
*** markvoelker has joined #openstack-infra05:50
*** markvoelker has quit IRC05:55
*** akshai has quit IRC05:56
*** amotoki has quit IRC05:57
*** moravec1 has joined #openstack-infra06:00
*** moravec has quit IRC06:00
*** salv-orlando has quit IRC06:01
*** tuannguyen has joined #openstack-infra06:02
*** tnovacik has quit IRC06:02
*** tnovacik has joined #openstack-infra06:03
*** tuannguyen has quit IRC06:07
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Gear: make python3.5 jobs voting  https://review.openstack.org/38196906:07
*** vsaienko has joined #openstack-infra06:08
*** dragonmaster has quit IRC06:08
*** david-lyle has joined #openstack-infra06:08
*** tnovacik has quit IRC06:10
*** sandanar has joined #openstack-infra06:11
openstackgerritMerged openstack-infra/project-config: Add openstack-dev/sandbox groups for training  https://review.openstack.org/37583406:11
*** eranrom has joined #openstack-infra06:15
*** yuanying has quit IRC06:16
*** eranrom has joined #openstack-infra06:16
openstackgerritMerged openstack-infra/project-config: Turn on tls-proxy in nova net multinode job  https://review.openstack.org/38209406:16
*** eranrom has quit IRC06:16
*** amitgandhinz has joined #openstack-infra06:18
*** eranrom has joined #openstack-infra06:18
*** eranrom has quit IRC06:19
*** eranrom has joined #openstack-infra06:19
*** eranrom has quit IRC06:20
yuvalHey infra team, could any core please review https://review.openstack.org/353309 ? It has been standing with one +2 since the Smaug => Karbor rename :\06:20
*** eranrom has joined #openstack-infra06:21
*** amitgandhinz has quit IRC06:23
*** rlu has joined #openstack-infra06:26
*** rlu has quit IRC06:28
*** gildub has quit IRC06:29
*** rlu has joined #openstack-infra06:30
*** esikachev has joined #openstack-infra06:31
*** shardy has joined #openstack-infra06:33
*** andreas_s has joined #openstack-infra06:33
*** rossella_s has quit IRC06:34
*** Hal has quit IRC06:35
*** rossella_s has joined #openstack-infra06:35
*** salv-orlando has joined #openstack-infra06:36
*** jtomasek_ has joined #openstack-infra06:36
*** esikachev has quit IRC06:36
*** nmagnezi has joined #openstack-infra06:39
*** vsaienko has quit IRC06:39
*** tphummel has quit IRC06:40
*** salv-orlando has quit IRC06:40
*** martinkopec has joined #openstack-infra06:41
*** martinkopec has quit IRC06:42
*** martinkopec has joined #openstack-infra06:44
*** pcaruana has joined #openstack-infra06:46
*** yaume has joined #openstack-infra06:48
*** eranrom has quit IRC06:50
*** jtomasek_ has quit IRC06:50
*** markvoelker has joined #openstack-infra06:51
*** eranrom has joined #openstack-infra06:51
*** Rockyg has joined #openstack-infra06:52
*** rcernin has joined #openstack-infra06:53
*** eranrom has quit IRC06:55
*** markvoelker has quit IRC06:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Retire OSA pip_lock_down repository from Newton  https://review.openstack.org/38216606:56
*** salv-orlando has joined #openstack-infra06:56
*** yamahata has joined #openstack-infra06:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Retire OSA pip_lock_down repository from Newton  https://review.openstack.org/38216606:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Retire OSA pip_lock_down repository from Newton  https://review.openstack.org/38216606:59
*** eranrom has joined #openstack-infra07:00
*** tqtran has joined #openstack-infra07:00
*** Ravikiran_K has joined #openstack-infra07:00
*** david-lyle has quit IRC07:02
*** Naeil has joined #openstack-infra07:03
*** esikachev has joined #openstack-infra07:04
*** tqtran has quit IRC07:05
*** gibi_ has quit IRC07:06
*** tesseract- has joined #openstack-infra07:07
*** eranrom has quit IRC07:08
*** dtardivel has joined #openstack-infra07:08
*** eranrom has joined #openstack-infra07:08
*** esikachev has quit IRC07:09
*** matrohon has joined #openstack-infra07:09
*** Hal has joined #openstack-infra07:11
*** rcernin has quit IRC07:12
*** rcernin has joined #openstack-infra07:12
*** gibi has joined #openstack-infra07:13
*** nadya has joined #openstack-infra07:16
*** amitgandhinz has joined #openstack-infra07:19
*** dragonmaster has joined #openstack-infra07:19
*** jpena|off is now known as jpena07:20
*** amotoki has joined #openstack-infra07:20
*** stevebaker has joined #openstack-infra07:20
*** ihrachys has joined #openstack-infra07:21
*** hogepodge has quit IRC07:21
*** amitgandhinz has quit IRC07:23
*** sputnik13 has quit IRC07:25
*** zeih has joined #openstack-infra07:25
*** oanson has joined #openstack-infra07:27
*** lezbar has quit IRC07:29
*** Hal has quit IRC07:30
*** esikachev has joined #openstack-infra07:30
*** arxcruz has joined #openstack-infra07:30
*** lezbar has joined #openstack-infra07:30
*** amotoki has quit IRC07:32
*** jpich has joined #openstack-infra07:33
*** shardy_ has joined #openstack-infra07:34
AJaegeryolanda: https://github.com/openstack/deb-glare is empty - seems it misses permissions, could you check that sometime today, please?07:35
yolandahi AJaeger sure07:35
*** e0ne has joined #openstack-infra07:36
AJaegerthanks07:36
*** shardy has quit IRC07:36
*** claudiub has joined #openstack-infra07:37
*** nadya has quit IRC07:41
*** chem has joined #openstack-infra07:42
*** amotoki has joined #openstack-infra07:43
*** zeih has quit IRC07:46
yolandafixed07:48
*** lezbar has quit IRC07:49
*** lezbar has joined #openstack-infra07:49
*** rlu has quit IRC07:50
*** markvoelker has joined #openstack-infra07:51
*** chem has quit IRC07:53
*** chem has joined #openstack-infra07:53
*** tuanluong has quit IRC07:54
*** salv-orl_ has joined #openstack-infra07:54
*** markvoelker has quit IRC07:56
*** drifterza has joined #openstack-infra07:56
*** amotoki has quit IRC07:56
openstackgerritMerged openstack-infra/project-config: Gear: make python3.5 jobs voting  https://review.openstack.org/38196907:56
*** salv-orlando has quit IRC07:57
*** shardy_ is now known as shardy07:57
openstackgerritMerged openstack-infra/project-config: Update Jenkins jobs for craton-dashboard  https://review.openstack.org/38132707:59
*** esikache1 has joined #openstack-infra07:59
*** esikachev has quit IRC07:59
*** zzzeek has quit IRC08:00
*** pilgrimstack has joined #openstack-infra08:00
*** zzzeek has joined #openstack-infra08:00
*** zeih has joined #openstack-infra08:00
openstackgerritMerged openstack-infra/project-config: Enable py35 voting on project shade  https://review.openstack.org/38198508:01
openstackgerritMerged openstack-infra/project-config: Cinder: don't skip changed tempest tests  https://review.openstack.org/38191008:01
*** yuanying has joined #openstack-infra08:01
*** Hal has joined #openstack-infra08:03
*** tuannguyen has joined #openstack-infra08:03
AJaegerindeed, yolanda - thanks08:04
*** esikache1 has quit IRC08:04
*** esikachev has joined #openstack-infra08:05
*** yaume has quit IRC08:07
*** tuannguyen has quit IRC08:08
*** jordanP has joined #openstack-infra08:09
*** rlu has joined #openstack-infra08:10
*** hogepodge has joined #openstack-infra08:11
*** zul has quit IRC08:11
AJaegeryolanda: then we can approve https://review.openstack.org/381984 now08:13
yolandaapproved08:14
*** ccamacho has joined #openstack-infra08:16
*** amotoki has joined #openstack-infra08:17
*** Naeil has quit IRC08:18
openstackgerritMerged openstack-infra/project-config: track-upstream for deb-{glare,zaqar-ui}  https://review.openstack.org/38198408:19
*** rlu has quit IRC08:20
*** amitgandhinz has joined #openstack-infra08:20
*** rlu has joined #openstack-infra08:20
openstackgerritMerged openstack-infra/puppet-openstack_health: Install cython with the openstack-health api server  https://review.openstack.org/38196008:20
vsaienk0good morning yolanda, could you please approve 1 line patch: https://review.openstack.org/#/c/381570/ already reviewed by AJaeger and ironic team08:21
esikachevHi all. Do you have a correct unit-file for zuul on ubuntu 16.04?08:24
*** amitgandhinz has quit IRC08:24
*** zul has joined #openstack-infra08:24
*** kzaitsev_mb has joined #openstack-infra08:25
*** dtantsur|afk is now known as dtantsur08:26
openstackgerritMerged openstack-infra/project-config: Add gate jobs for RHEL 7 STIG testing  https://review.openstack.org/38177508:28
openstackgerritMerged openstack-infra/project-config: Add Horizon Failure Rate dashboard to Grafana  https://review.openstack.org/38016708:28
*** watersoul has quit IRC08:29
openstackgerritMerged openstack-infra/project-config: Add new job to test live migration with grenade  https://review.openstack.org/36480908:29
openstackgerritMarkos Chandras proposed openstack/diskimage-builder: Add zypper-minimal element  https://review.openstack.org/38157508:30
openstackgerritMarkos Chandras proposed openstack/diskimage-builder: Move the opensuse mkinitrd script to the zypper element  https://review.openstack.org/38157408:31
openstackgerritMarkos Chandras proposed openstack/diskimage-builder: Add opensuse-minimal element  https://review.openstack.org/38157608:31
*** Naeil has joined #openstack-infra08:31
*** tnovacik has joined #openstack-infra08:31
openstackgerritMerged openstack-infra/project-config: Disable building ramdisk for ironic-multitest job.  https://review.openstack.org/38157008:33
*** bhavik1 has joined #openstack-infra08:33
openstackgerritMarkos Chandras proposed openstack/diskimage-builder: Add opensuse-minimal element  https://review.openstack.org/38157608:40
vsaienk0yolanda thank you!08:41
yolandaglad to help :)08:41
*** strigazi_AFK is now known as strigazi08:44
*** mhickey has joined #openstack-infra08:45
*** cody-somerville has joined #openstack-infra08:46
*** lezbar has quit IRC08:46
*** derekh has joined #openstack-infra08:46
*** lezbar has joined #openstack-infra08:46
*** csomerville has quit IRC08:47
*** salv-orl_ has quit IRC08:48
strigaziHi yolanda, AJaeger, we have an issue with magnum dsvm jobs running on OSIC. When running in OSIC the jobs fail. It is due to SUBNETPOOL_PREFIX_V4 being 10.0.0.0/8. With this change it works fine https://review.openstack.org/#/c/381940/ is there a global solution in devstack?08:49
*** john-davidge has joined #openstack-infra08:50
strigaziyolanda, AJaeger, or is there someone working in devstack/neutron in this timezone that I can talk too?08:50
*** jaosorior is now known as jaosorior_lunch08:50
*** markvoelker has joined #openstack-infra08:52
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Retire OSA pip_lock_down repository from Newton  https://review.openstack.org/38216608:53
*** chandankumar has joined #openstack-infra08:54
*** mkoderer has joined #openstack-infra08:54
*** aviau has quit IRC08:56
*** aviau has joined #openstack-infra08:56
*** markvoelker has quit IRC08:57
*** sdake has quit IRC08:59
*** amotoki has quit IRC09:00
*** hashar has joined #openstack-infra09:05
*** yaume has joined #openstack-infra09:08
openstackgerritRob Cresswell proposed openstack-infra/project-config: Make Horizon and D_O_A Django 1.10 tests voting  https://review.openstack.org/37842609:13
*** thorst has joined #openstack-infra09:13
*** _degorenko|afk is now known as degorenko09:16
*** kzaitsev_mb has quit IRC09:16
*** thorst has quit IRC09:19
*** berendt has joined #openstack-infra09:20
*** amitgandhinz has joined #openstack-infra09:21
AJaegerstrigazi: this is a known problem, we're waiting for neutron and devstack to fix this together. I don't have the details.09:22
ianychoiHmm, strangely I made Workflow +1 for https://review.openstack.org/#/c/380850/ but Jenkins does not start gate jobs.. Does someone know why it does not start?09:23
AJaegerstrigazi: clarkb did the initial analysis - you discusssed with him yesterday, I cannot help further.09:24
*** amitgandhinz has quit IRC09:25
AJaegerstrigazi: https://bugs.launchpad.net/devstack/+bug/1629133 is the bug - best ask on #openstack-neutron and #openstack-qa09:26
openstackLaunchpad bug 1629133 in devstack "New neutron subnet pool support breaks multinode testing." [Critical,In progress] - Assigned to Miguel Angel Ajo (mangelajo)09:26
strigaziAJaeger: ok, we'll merge my fix and track this ^^ and this https://bugs.launchpad.net/devstack/+bug/1628267 , then we can revert09:27
openstackLaunchpad bug 1628267 in devstack "Neutron l3 plugin subnetpool creation should be optional" [Undecided,In progress] - Assigned to Rajini Ram (rajini-ram)09:27
*** ggnel_t has joined #openstack-infra09:28
AJaegerstrigazi: I'm not involved with this at all, so can't help further. But if it works, I would say go for it and track ;)09:28
*** Hal has quit IRC09:30
*** Naeil has quit IRC09:31
*** amotoki has joined #openstack-infra09:31
*** amotoki has quit IRC09:31
*** amotoki has joined #openstack-infra09:31
*** watersoul has joined #openstack-infra09:38
*** ramishra has quit IRC09:39
*** ramishra has joined #openstack-infra09:41
strigaziAJaeger, cool, Thanks Andreas!09:42
*** Naeil has joined #openstack-infra09:43
openstackgerritDirk Mueller proposed openstack-infra/project-config: Upgrade check-uc to voting  https://review.openstack.org/38223209:45
*** jaosorior_lunch is now known as jaosorior09:46
*** ihrachys has quit IRC09:48
*** pgadiya has quit IRC09:49
*** shu-mutou is now known as shu-mutou-AWAY09:50
*** markvoelker has joined #openstack-infra09:53
*** gema has quit IRC09:56
*** markvoelker has quit IRC09:58
*** ylobankov has joined #openstack-infra10:01
*** pgadiya has joined #openstack-infra10:01
*** tqtran has joined #openstack-infra10:02
*** bhavik1 has quit IRC10:04
*** bhavik1 has joined #openstack-infra10:05
*** tuannguyen has joined #openstack-infra10:05
*** tqtran has quit IRC10:06
*** tuannguyen has quit IRC10:10
openstackgerritIsaac Beckman proposed openstack/diskimage-builder: Enable ssh password authentication for devuser  https://review.openstack.org/37657210:11
ylobankovHi guys. Rally team has some issues with some Rally jenkins jobs: gate-rally-dsvm-verify-full-discover-resources, gate-rally-dsvm-verify-light-create-resources, gate-rally-dsvm-verify-full-create-resources. These jobs fail very often and it looks like the issue is related to internet connection. I created a debug patch https://review.openstack.org/#/c/381994/ yesterday. If you take a look at the results of one of the mentioned jobs (for10:11
ylobankovexample, http://logs.openstack.org/94/381994/1/check/gate-rally-dsvm-verify-light-create-resources/58f243d/rally-verify/), we can see the issue with internet connection. Please, take a look at 3_ping, 5_ping, 7_ping files.10:11
*** sdague has joined #openstack-infra10:15
*** tosky has joined #openstack-infra10:18
*** salv-orlando has joined #openstack-infra10:19
*** ociuhandu has quit IRC10:20
*** sambetts|afk is now known as sambetts10:21
*** amitgandhinz has joined #openstack-infra10:22
*** salv-orlando has quit IRC10:25
*** amitgandhinz has quit IRC10:26
*** kzaitsev_mb has joined #openstack-infra10:31
*** ramishra has quit IRC10:32
wznoinsklennyb: hi, https://review.openstack.org/#/c/382262/10:32
*** ramishra has joined #openstack-infra10:33
lennybwznoinsk, thanks10:34
*** rossella_s has quit IRC10:34
*** rossella_s has joined #openstack-infra10:35
*** bhavik1 has quit IRC10:36
*** ramishra has quit IRC10:37
*** zeih has quit IRC10:38
*** ramishra has joined #openstack-infra10:38
*** ihrachys has joined #openstack-infra10:38
wznoinsklennyb: any feedback welcome10:40
lennybwznoinsk, I am trying to run it now.10:41
lennybwznoinsk, I see that it's a not stand alone script http://paste.openstack.org/show/584415/  what else do I need to run?10:46
ylobankovAJaeger: Could you please take a look at my message above? Thanks in advance!10:46
wznoinsklennyb: you run it once with -mode listen10:46
wznoinsklennyb: and it should start populating failures.json successes.json, -mode check is to give you nagios-like output based on the above two files10:47
*** wznoinsk has left #openstack-infra10:47
*** ramishra has quit IRC10:47
*** wznoinsk has joined #openstack-infra10:48
*** ramishra has joined #openstack-infra10:48
*** hashar has quit IRC10:51
*** zeih has joined #openstack-infra10:52
*** rtheis has joined #openstack-infra10:54
*** markvoelker has joined #openstack-infra10:54
*** dfflanders has quit IRC10:54
jordanPylobankov, it's very bad idea to hit the internet during tests10:56
*** zhurong has joined #openstack-infra10:56
jordanPyou should really avoid that and there's not a lot to do if it fails10:57
lennybwznoinsk, is it ok? http://paste.openstack.org/show/584419/  It's not clear from the output ( at least for those who did not wrote it :) )10:58
*** markvoelker has quit IRC10:59
*** Ravikiran_K has quit IRC11:04
*** tpsilva has joined #openstack-infra11:05
ylobankovjordanP: In the tests I need to download some image file and clone simple tempest plugin https://github.com/MBonell/hello-world-tempest-plugin ? So how can I get these things without the internet connection?11:09
jordanPylobankov, that hello-world-tempest-plugin should be hosted in the openstack namespace, this way it will be cached by the infra11:11
jordanPylobankov, I am not sure why you would need to download some image file, but it that's really a requirement then maybe depending on how big it is, you could ship it in the repo11:11
ylobankovjordanP: It is a cirros image, so the size is really small actually11:12
jordanPthen embedding it in the repo is an option, imo, but some may disagree though11:13
toskyuhm, in sahara tests we download a ubuntu guest image11:13
toskywe do it in the pre- gate hook (but you can provide your own image if you run the tests locally)11:14
*** ccamacho is now known as ccamacho|lunch11:15
*** dragonmaster_ has joined #openstack-infra11:20
*** salv-orlando has joined #openstack-infra11:21
*** dragonmaster has quit IRC11:22
wznoinsklennyb: it's fine, it will populate .json file(s) on first finding of success/failure11:22
*** yamamoto has joined #openstack-infra11:22
*** drifterza has quit IRC11:22
*** amitgandhinz has joined #openstack-infra11:23
*** arxcruz has quit IRC11:24
*** dragonmaster_ has quit IRC11:25
*** dragonmaster has joined #openstack-infra11:25
*** salv-orlando has quit IRC11:26
*** arxcruz has joined #openstack-infra11:26
*** amitgandhinz has quit IRC11:28
AJaegerylobankov: I think we're caching the coreos images. And you should really not use an external tempest plugin.11:30
*** salv-orlando has joined #openstack-infra11:30
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - Test Undercloud upgrade mitaka -> newton  https://review.openstack.org/38130911:30
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Undercloud upgrade for mitaka and newton  https://review.openstack.org/38128611:30
AJaegerDiscuss with the QA team on #openstack-qa on how to write proper tempest plugins.11:30
*** coolsvap is now known as coolsvap_11:30
AJaegerylobankov: s/coreos/cirros/11:30
ylobankovjordanP, AJaege: Ok, thanks guys, I got yuor point. I will work on it.11:32
*** tuannguyen has joined #openstack-infra11:33
*** shardy is now known as shardy_lunch11:35
*** ldnunes has joined #openstack-infra11:35
openstackgerritJulien Danjou proposed openstack-infra/project-config: gnocchi: do not run upgrade-from-2.2 on 3.0 branch  https://review.openstack.org/38234111:35
*** drifterza has joined #openstack-infra11:35
AJaegerodyssey4me: your setup for pip_lock_down is not going to work.11:36
odyssey4meAJaeger an ordering issue?11:36
AJaegerI just left a comment, queues are calculated on job names, not on where they run.11:36
AJaegerSo, you put all repos that use noop together with your repo. Not going to work.11:37
AJaegerSorry, I cannot help you right now how to do it properly. I suggest you ask at US time for some help from the experts here...11:37
*** zeih has quit IRC11:39
*** vsaienko has joined #openstack-infra11:40
odyssey4methanks AJaeger I'll see if I can find some help11:42
*** vsaienko has quit IRC11:42
AJaegerodyssey4me: I don't know right now whether there's a solution for what you want to do - or whether we need to change your plans... There's no easy one that I see directly and that's why I ask for help11:44
odyssey4meAJaeger yeah, the alternative I guess is to just have only nop & merge check for that repo for all branches, then avoid patches to stable/mitaka if possible11:50
*** EricGonczer_ has joined #openstack-infra11:50
odyssey4meit is a very static role, so that could be an option if need be11:51
*** pgadiya has quit IRC11:51
*** thorst has joined #openstack-infra11:51
*** zeih has joined #openstack-infra11:53
*** matbu is now known as matbu|lch11:53
*** tuannguyen has quit IRC11:54
*** markvoelker has joined #openstack-infra11:54
*** jlanoux has joined #openstack-infra11:58
*** markvoelker has quit IRC11:59
*** john-davidge has quit IRC12:01
*** john-dav_ has joined #openstack-infra12:01
*** trown|outtypewww is now known as trown12:02
*** hashar has joined #openstack-infra12:02
*** lezbar has quit IRC12:03
*** kgiusti has joined #openstack-infra12:03
*** lezbar has joined #openstack-infra12:04
*** nadya has joined #openstack-infra12:04
openstackgerritDirk Mueller proposed openstack-infra/project-config: Upgrade check-uc to voting  https://review.openstack.org/38223212:05
*** amoralej is now known as amoralej|lunch12:06
*** pgadiya has joined #openstack-infra12:08
*** jcoufal has joined #openstack-infra12:09
*** ociuhandu has joined #openstack-infra12:09
*** Hal has joined #openstack-infra12:09
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - Test Undercloud upgrade mitaka -> newton  https://review.openstack.org/38130912:11
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Undercloud upgrade for mitaka and newton  https://review.openstack.org/38128612:11
*** hashar_ has joined #openstack-infra12:12
*** hashar has quit IRC12:13
*** coolsvap_ is now known as coolsvap12:13
*** pgadiya has quit IRC12:14
*** gouthamr has joined #openstack-infra12:16
*** rlu has quit IRC12:16
*** jkilpatr has joined #openstack-infra12:17
*** sdake has joined #openstack-infra12:19
*** pradk has joined #openstack-infra12:21
*** raildo has joined #openstack-infra12:22
*** fguillot has joined #openstack-infra12:22
*** zeih has quit IRC12:23
ttxAJaeger: do you know why docs.openstack.org/newton is returning 403 ? I wanted to update doc links on releases.o.o/newton12:23
ttxAJaeger: see https://review.openstack.org/#/c/381005/12:24
*** amitgandhinz has joined #openstack-infra12:24
*** ccamacho|lunch is now known as ccamacho12:24
ttxLast cycle we were able to do that a few days before release12:24
*** jkilpatr has quit IRC12:25
*** shardy_lunch is now known as shardy12:28
*** tosky has quit IRC12:28
*** matbu|lch is now known as matbu12:28
*** pgadiya has joined #openstack-infra12:28
*** amitgandhinz has quit IRC12:28
pabelangerttx: AJaeger: it does exist on http://docs-beta.openstack.org/newton/, which is using our afsdocs publisher12:29
*** krtaylor has quit IRC12:30
vsaienk0devstack-core: I'm wondered it we can merge this patch https://review.openstack.org/#/c/366922/ fix common get_or_create-{project,user,group} to work with both V2 and V312:30
*** tuannguyen has joined #openstack-infra12:30
*** zeih has joined #openstack-infra12:34
*** rlandy has joined #openstack-infra12:37
openstackgerritVasyl Saienko proposed openstack-infra/devstack-gate: Update localrc for ironic-multinode case  https://review.openstack.org/35279012:37
*** jkilpatr has joined #openstack-infra12:38
vsaienk0infra team: please help to merge: https://review.openstack.org/#/c/364830 and https://review.openstack.org/#/c/368611 the patches related to ironic multinode.12:39
openstackgerritAlexander Evseev proposed openstack-infra/project-config: Fix rc.local in nodepool-base DIB element  https://review.openstack.org/38239112:41
*** jpena is now known as jpena|lunch12:41
*** markvoelker has joined #openstack-infra12:44
*** zul has quit IRC12:44
openstackgerritMerged openstack-infra/project-config: Always run openstackdocstheme-api-ref  https://review.openstack.org/38200212:44
*** baoli has joined #openstack-infra12:44
*** Goneri has joined #openstack-infra12:45
openstackgerritAlexander Evseev proposed openstack-infra/project-config: Fix rc.local for systemd in nodepool-base element  https://review.openstack.org/38239112:47
*** zul has joined #openstack-infra12:49
*** amitgandhinz has joined #openstack-infra12:50
*** zeih has quit IRC12:52
*** martinkopec has quit IRC12:53
*** vikrant has quit IRC12:54
*** raildo has quit IRC12:55
*** snarwade has quit IRC12:55
*** tnovacik has quit IRC12:56
openstackgerritMerged openstack/diskimage-builder: Default to http://ftp.us.debian.org/debian for debian-minimal  https://review.openstack.org/37803812:56
*** makowals has joined #openstack-infra12:56
*** martinkopec has joined #openstack-infra12:57
*** raildo has joined #openstack-infra12:57
*** makowals_ has quit IRC12:57
*** edmondsw has joined #openstack-infra12:59
*** pradk has quit IRC12:59
*** jheroux has joined #openstack-infra12:59
*** pgadiya has quit IRC12:59
*** kzaitsev_mb has quit IRC13:00
*** tmorin has joined #openstack-infra13:00
tmorinhi everyone13:00
*** kzaitsev_mb has joined #openstack-infra13:00
tmorinI have a change in project-A that we will not merge until a fix lands in project-B stable/newton - adding a Depends-On on the change-id does not work, because the fix in project-B master and the fix in project-B stable/newton have the same change-id (because the latter is a cherry-pick from the former) -- what can I do to have gerrit handle the merge dependency cleanly ?13:01
*** yaume has quit IRC13:01
*** vsaienko has joined #openstack-infra13:02
pabelangerI'd generate a new change-id for project-B stable/newton13:02
*** jcoufal_ has joined #openstack-infra13:03
*** jcoufal has quit IRC13:03
*** yaume has joined #openstack-infra13:04
*** baoli_ has joined #openstack-infra13:05
openstackgerritJordan Pittier proposed openstack-infra/shade: normalize_neutron_floating_ips: also return `project_id`  https://review.openstack.org/38240013:05
*** yaume has quit IRC13:06
*** yaume has joined #openstack-infra13:06
*** baoli has quit IRC13:08
*** mdrabe has joined #openstack-infra13:09
*** tiswanso has joined #openstack-infra13:10
*** john-dav_ is now known as john-davidge13:11
hughsaundersHey Infra, have there been any changes to the apt mirrors recently? eg http://mirror.dfw.rax.openstack.org/ubuntu13:12
openstackgerritArie Bregman proposed openstack-infra/zuul: Re-enable test_abandoned_gate  https://review.openstack.org/38240513:13
*** xyang1 has joined #openstack-infra13:14
*** nadya has quit IRC13:14
EmilienMtimothyb89: hey, I just realized we don't have /opt/stackviz anymore in the devstack gate images. Did I miss something?13:15
*** ccamacho has quit IRC13:16
*** dprince has joined #openstack-infra13:16
*** matt-borland has joined #openstack-infra13:19
*** gordc has joined #openstack-infra13:20
*** amoralej|lunch is now known as amoralej13:21
*** cardeois has joined #openstack-infra13:22
*** hashar_ is now known as hashar13:23
*** rhallisey has joined #openstack-infra13:23
anteayahughsaunders: what are you seeing that motivates you to ask?13:26
hughsaundersanteaya: apologies, the problem was on my end13:26
anteayahughsaunders: okay, thanks13:26
*** tongli has joined #openstack-infra13:28
fungijamesmcarthur: jpmaxman: smarcet: just a heads up, i replaced the cert for openstackid.org last night with a renewed one (its expiration was coming up); just wanted you to be aware in case you spotted anything unusual while testing out mobile app integration et cetera13:29
anteayattx: I recommend confirming docs urls with jeblair before publishing13:29
* fungi goes back to boarding up windows13:29
anteayattx: we are just moving/have moved docs to afs and if we have created a bug, we would like to know13:29
anteayafungi: godspeed13:29
*** tuannguyen has quit IRC13:30
*** zhenguo has joined #openstack-infra13:32
*** tuannguyen has joined #openstack-infra13:33
*** akshai has joined #openstack-infra13:34
*** ccamacho has joined #openstack-infra13:34
*** nmagnezi has quit IRC13:35
*** jaosorior has quit IRC13:36
*** jaosorior has joined #openstack-infra13:36
*** yaume has quit IRC13:37
*** drifterza has quit IRC13:37
*** abregman has joined #openstack-infra13:37
*** mriedem has joined #openstack-infra13:37
openstackgerritIhar Hrachyshka proposed openstack-infra/bindep: Fixed bindep -b mode for version mismatch errors  https://review.openstack.org/38197913:38
*** esberglu has joined #openstack-infra13:39
*** bnemec has joined #openstack-infra13:40
*** martinkopec has quit IRC13:41
*** jed56 has left #openstack-infra13:42
*** martinkopec has joined #openstack-infra13:42
*** EricGonczer_ has quit IRC13:44
openstackgerritMerged openstack-infra/elastic-recheck: Skip hits that don't have data  https://review.openstack.org/38204913:47
*** yamamoto has quit IRC13:47
*** nmagnezi has joined #openstack-infra13:47
*** yaume has joined #openstack-infra13:48
openstackgerritIhar Hrachyshka proposed openstack-infra/bindep: Fixed bindep -b mode for version mismatch errors  https://review.openstack.org/38197913:50
ihrachysfungi: ^ that should do13:51
*** rbrndt has joined #openstack-infra13:51
*** yaume has quit IRC13:51
ihrachysfungi: I was not sure what was the concern you had regarding rpm vs. yum databases yesterday13:51
ihrachysfungi: for me it seems like reporting that a specific version is not installed when any version of the package is not installed is good13:51
*** caowei has joined #openstack-infra13:53
*** amitgandhinz has quit IRC13:53
openstackgerritIhar Hrachyshka proposed openstack-infra/bindep: Fixed bindep -b mode for version mismatch errors  https://review.openstack.org/38197913:54
*** jpena|lunch is now known as jpena13:54
*** salv-orl_ has joined #openstack-infra13:54
*** eliqiao has quit IRC13:55
*** yamahata has quit IRC13:55
*** alex_xu has quit IRC13:55
*** yamahata has joined #openstack-infra13:56
*** salv-orlando has quit IRC13:57
*** vsaienko has quit IRC13:57
*** vsaienko has joined #openstack-infra13:58
anteayaihrachys: fungi is preparing for a hurricane so it might be a bit before he can reply14:00
ihrachysouch14:00
jrollfungi: be safe14:00
anteayayeah, he said that he expects for there to be an evacuation order14:00
ihrachysanteaya: thanks for the heads-up14:00
anteayaihrachys: sure14:01
anteayathanks for the patch14:01
*** tnovacik has joined #openstack-infra14:01
*** alex_xu has joined #openstack-infra14:02
*** eharney has joined #openstack-infra14:03
*** shamail has joined #openstack-infra14:03
*** yaume has joined #openstack-infra14:04
*** vsaienko has quit IRC14:04
*** makowals has quit IRC14:04
openstackgerritIhar Hrachyshka proposed openstack-infra/bindep: Fixed bindep -b mode for version mismatch errors  https://review.openstack.org/38197914:04
*** vsaienko has joined #openstack-infra14:04
*** pradk has joined #openstack-infra14:05
*** makowals has joined #openstack-infra14:06
*** nmagnezi has quit IRC14:07
*** vsaienko has quit IRC14:07
*** yamamoto has joined #openstack-infra14:08
*** dprince has quit IRC14:10
*** dims has quit IRC14:11
mriedemfungi: the e-r graph is on a cron right14:12
mriedem?14:12
*** xarses has quit IRC14:13
*** hongbin has joined #openstack-infra14:13
anteayamriedem: I can' confirm it is on a cron or not but I do agree the elastic search index update has not happened for a week14:14
openstackgerritThierry Carrez proposed openstack-infra/infra-specs: Make governance.o.o a neutral governance website  https://review.openstack.org/38244714:14
*** links has quit IRC14:14
mriedemanteaya: well i pushed in a fix to e-r for that14:15
mriedemi'm just not sure when the graph is refreshed14:15
*** jaosorior has quit IRC14:16
*** eliqiao has joined #openstack-infra14:16
*** vsaienko has joined #openstack-infra14:16
*** dims has joined #openstack-infra14:17
*** vsaienko has quit IRC14:17
anteayaah, at the moment neither am I14:18
anteayaand fungi is preparing his house for the hurricance14:18
anteayahurricane14:18
*** jianghuaw has quit IRC14:19
*** annegentle has joined #openstack-infra14:19
openstackgerritThierry Carrez proposed openstack-infra/infra-specs: Make governance.o.o a neutral governance website  https://review.openstack.org/38244714:19
*** nmagnezi has joined #openstack-infra14:20
anteayaand codehound returns suprisingly few returns when searching for elastic-search: http://codesearch.openstack.org/?q=elastic-search&i=nope&files=&repos=14:20
anteayaI expected more hits14:20
*** BobBall has quit IRC14:21
*** vsaienko has joined #openstack-infra14:23
openstackgerritPawel Koniszewski proposed openstack-infra/devstack-gate: Set LIVE_MIGRATE_BACK_AND_FORTH to True in LM+grenade job  https://review.openstack.org/38245614:23
vsaienk0fungi, anteaya: could you please help to merge https://review.openstack.org/#/c/364830/ and https://review.openstack.org/#/c/36861114:23
openstackgerritPawel Koniszewski proposed openstack-infra/devstack-gate: Set LIVE_MIGRATE_BACK_AND_FORTH to True in LM+grenade job  https://review.openstack.org/38245614:24
*** martinkopec has quit IRC14:25
*** eliqiao has quit IRC14:25
*** cschwede has joined #openstack-infra14:28
*** psachin has quit IRC14:28
*** zeih has joined #openstack-infra14:28
*** eliqiao has joined #openstack-infra14:28
*** rodrigods has quit IRC14:32
*** rodrigods has joined #openstack-infra14:32
*** gordc has quit IRC14:32
*** akshai has quit IRC14:33
*** kzaitsev_mb has quit IRC14:33
sdaguemriedem: when ddid your fix merge?14:33
*** martinkopec has joined #openstack-infra14:34
mriedemsdague: ~50 min ago14:34
anteayavsaienk0: I am not a devstack-gate core reviewer14:34
*** baoli_ has quit IRC14:35
*** spzala has joined #openstack-infra14:35
*** vsaienko has quit IRC14:36
sdaguemriedem: yeh, I think it's roughly hourly now14:36
*** tnovacik has quit IRC14:36
*** senk_ has quit IRC14:38
*** esberglu has quit IRC14:38
*** tiswanso has quit IRC14:38
*** edmondsw has quit IRC14:38
*** kgiusti has quit IRC14:38
*** john-davidge has quit IRC14:38
*** rossella_s has quit IRC14:38
*** tmorin has quit IRC14:38
*** ggnel_t has quit IRC14:38
*** mkoderer has quit IRC14:38
*** mhickey has quit IRC14:38
*** hogepodge has quit IRC14:38
*** dtardivel has quit IRC14:38
*** tesseract- has quit IRC14:38
*** sandanar has quit IRC14:38
*** jpena has quit IRC14:38
*** yuval has quit IRC14:38
*** narayrak has quit IRC14:38
*** jooni has quit IRC14:38
*** rfolco has quit IRC14:38
*** samueldmq has quit IRC14:38
*** Ng has quit IRC14:38
*** gnuoy has quit IRC14:38
*** admcleod has quit IRC14:38
*** Guest45220 has quit IRC14:38
*** sbalukoff has quit IRC14:38
*** clenimar has quit IRC14:38
*** davidlenwell has quit IRC14:38
*** mugsie has quit IRC14:38
*** pfallenop has quit IRC14:38
*** anthonyper has quit IRC14:38
*** pfallenop has joined #openstack-infra14:38
*** mugsie has joined #openstack-infra14:39
*** ggnel_t has joined #openstack-infra14:39
*** kgiusti has joined #openstack-infra14:39
*** gnuoy has joined #openstack-infra14:39
*** esberglu has joined #openstack-infra14:39
*** rossella_s has joined #openstack-infra14:39
*** rfolco has joined #openstack-infra14:39
*** admcleod has joined #openstack-infra14:39
*** john-davidge has joined #openstack-infra14:39
*** clenimar has joined #openstack-infra14:39
*** sandanar has joined #openstack-infra14:39
*** edmondsw has joined #openstack-infra14:39
*** admcleod has quit IRC14:39
*** admcleod has joined #openstack-infra14:39
*** narayrak has joined #openstack-infra14:39
*** jooni has joined #openstack-infra14:39
*** anthonyper has joined #openstack-infra14:39
*** tiswanso has joined #openstack-infra14:39
*** hogepodge has joined #openstack-infra14:39
*** yuval has joined #openstack-infra14:39
*** sbalukoff has joined #openstack-infra14:39
*** tmorin has joined #openstack-infra14:39
*** mhickey has joined #openstack-infra14:39
*** bnemec has quit IRC14:39
*** jpena has joined #openstack-infra14:39
*** csomerville has joined #openstack-infra14:39
*** tesseract- has joined #openstack-infra14:39
*** davidlenwell has joined #openstack-infra14:40
*** jak-jak has joined #openstack-infra14:40
*** aglarendil__ is now known as aglarendil14:40
*** mkoderer has joined #openstack-infra14:40
*** jak-jak is now known as Guest1867314:40
*** burgerk has joined #openstack-infra14:40
*** akshai has joined #openstack-infra14:41
*** DuncanT has quit IRC14:41
*** akshai has quit IRC14:42
*** dtardivel has joined #openstack-infra14:43
*** cody-somerville has quit IRC14:43
*** samueldmq has joined #openstack-infra14:44
*** bnemec has joined #openstack-infra14:44
*** akshai has joined #openstack-infra14:44
*** jed561 has joined #openstack-infra14:45
*** david-lyle has joined #openstack-infra14:45
*** kzaitsev_mb has joined #openstack-infra14:45
*** john-davidge has quit IRC14:46
*** zhurong has quit IRC14:46
*** john-davidge has joined #openstack-infra14:46
*** nmagnezi has quit IRC14:46
*** Ng has joined #openstack-infra14:46
*** caowei has quit IRC14:47
*** DuncanT has joined #openstack-infra14:47
*** Swami has joined #openstack-infra14:48
*** john-davidge has quit IRC14:48
*** yamahata has quit IRC14:49
*** yamamoto has quit IRC14:49
*** yamahata has joined #openstack-infra14:50
openstackgerritPawel Koniszewski proposed openstack-infra/devstack-gate: Set LIVE_MIGRATE_BACK_AND_FORTH to True in LM+grenade job  https://review.openstack.org/38245614:50
*** tuannguyen has quit IRC14:51
*** yuval has quit IRC14:51
*** mhickey has quit IRC14:54
*** diablo_rojo has joined #openstack-infra14:54
*** david-lyle has quit IRC14:54
*** tosky has joined #openstack-infra14:56
*** chandankumar has quit IRC14:57
*** dkehn has quit IRC14:58
*** martinkopec has quit IRC14:59
jeblairpabelanger, ttx, AJaeger: the afs and ftp docs publishers are publishing the same content at this point.  in afs, we have mod_autoindex turned on, so you can see the directory listing at http://docs-beta.openstack.org/newton/ but i believe that is not the case on the ftp site.  since there's no index.html there, you get a 403 error.  however, the same content is still there; see eg http://docs.openstack.org/newton/config-reference/14:59
*** clarkb has joined #openstack-infra14:59
*** david-lyle has joined #openstack-infra15:00
*** jistr is now known as jistr|call15:01
ttxjeblair: ok, so missing https://review.openstack.org/#/c/377134/15:02
ttxjeblair: thx for the explanation15:02
*** tuannguyen has joined #openstack-infra15:02
jeblairttx: ya that looks like it would do it15:02
*** claudiub has quit IRC15:03
*** r-mibu has quit IRC15:04
*** r-mibu has joined #openstack-infra15:04
*** ddieterly has joined #openstack-infra15:05
*** jlanoux has quit IRC15:05
*** senk_ has joined #openstack-infra15:08
*** Teresita-Warrior has joined #openstack-infra15:09
*** ggnel_t has quit IRC15:09
*** dragonmaster has quit IRC15:10
*** oanson has quit IRC15:11
*** dkehn has joined #openstack-infra15:11
*** martinkopec has joined #openstack-infra15:11
*** rcernin has quit IRC15:12
*** pcaruana has quit IRC15:13
*** jistr|call is now known as jistr15:13
*** gordc has joined #openstack-infra15:14
*** salv-orl_ has quit IRC15:15
openstackgerritSteve Martinelli proposed openstack-infra/project-config: remove the legacy driver job for keystone  https://review.openstack.org/38249915:16
*** ijw has joined #openstack-infra15:16
*** armax has joined #openstack-infra15:17
*** cardeois_ has joined #openstack-infra15:17
*** cardeois has quit IRC15:18
AJaegerttx, just discussed with dhellmann on #openstack-docs...15:19
*** ddieterly is now known as ddieterly[away]15:22
AJaegerjeblair: indeed, there's no newton index.page yet - all is ok. This change was safe but we were to eager with holding back...15:22
*** amitgandhinz has joined #openstack-infra15:24
*** tesseract- has quit IRC15:24
*** weshay has quit IRC15:25
*** david-lyle has quit IRC15:26
*** ddieterly[away] is now known as ddieterly15:26
*** andreas_s has quit IRC15:27
*** dkehn has quit IRC15:28
*** amitgandhinz has quit IRC15:28
*** cardeois_ has quit IRC15:29
*** cardeois has joined #openstack-infra15:30
*** sputnik13 has joined #openstack-infra15:30
*** weshay has joined #openstack-infra15:30
*** adrian_otto has joined #openstack-infra15:31
*** david-lyle has joined #openstack-infra15:32
*** esikachev has quit IRC15:34
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci: [WIP] Add IPv6 coverage using existing jobs  https://review.openstack.org/38251515:35
*** lucasagomes is now known as lucas-hungry15:35
*** jaosorior has joined #openstack-infra15:37
*** vhosakot has joined #openstack-infra15:37
*** jlanoux has joined #openstack-infra15:37
*** gouthamr has quit IRC15:38
openstackgerritamrith proposed openstack-infra/project-config: update trove experimental job for build image  https://review.openstack.org/38251615:38
*** weshay has quit IRC15:38
openstackgerritamrith proposed openstack-infra/project-config: [WIP] update trove experimental job for build image  https://review.openstack.org/38251615:39
*** baoli has joined #openstack-infra15:39
*** dprince has joined #openstack-infra15:39
openstackgerritMarkos Chandras proposed openstack-infra/glean: Fix SUSE based network configuration  https://review.openstack.org/37853215:40
timothyb89EmilienM: re: stackviz, xenial seems fine but it looks like trusty failed due to an npm error today15:41
EmilienMtimothyb89: I saw it on centos15:41
EmilienMtimothyb89: it seems like /opt/stackviz is not here for a while15:41
openstackgerritMerged openstack-infra/release-tools: make the script for proposing final releases more flexible  https://review.openstack.org/38041815:41
*** jlanoux_ has joined #openstack-infra15:42
*** zhenguo has quit IRC15:43
openstackgerritMerged openstack-infra/release-tools: make the final release tool smarter  https://review.openstack.org/38133815:43
*** weshay has joined #openstack-infra15:44
openstackgerritJakub Libosvar proposed openstack-infra/project-config: Fix skip-if clause for fullstack and functional jobs  https://review.openstack.org/38252015:45
amrithhiya infra, could someone help me get the dependencies here setup right please. I have a change in trove (https://review.openstack.org/#/c/374952/) and with it, I'll be able to run an experimental job in trove (https://review.openstack.org/#/c/382516/). I thought the way to get this to work was to create a dummy change in Trove that depends on both of these and run check experimental in that. Appears not to work. How does one test a15:45
amrithproject-config change that adds a new experimental job on an unmerged change in trove? thx ..15:45
*** gouthamr has joined #openstack-infra15:45
*** jlanoux has quit IRC15:45
*** salv-orlando has joined #openstack-infra15:45
timothyb89EmilienM: it looks like npm is missing on centos, not sure why though: http://nodepool.openstack.org/dib.centos-7.log15:46
timothyb89EmilienM: I know there was a packaging issue with npm on fedora 24 a while back, it's possible centos is being affected as well15:46
*** Swami has quit IRC15:47
openstackgerritMarkos Chandras proposed openstack-infra/glean: Fix SUSE based network configuration  https://review.openstack.org/37853215:48
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci: DO NOT MERGE testing switch to Ocata DLRN instance  https://review.openstack.org/38252115:49
*** xarses has joined #openstack-infra15:50
clarkbamrith: there isnt a way to do that with current zuul. You'll need to run your tests locally or modify an existing one on the fly to test15:51
*** annegentle has quit IRC15:51
pabelangeramrith: you'll need to merge the project-config change first, which creates the new experimental job.  Then, you can check experimental on 37495215:51
*** martinkopec has quit IRC15:52
*** annegentle has joined #openstack-infra15:52
*** esikachev has joined #openstack-infra15:52
*** yamamoto has joined #openstack-infra15:53
*** gouthamr has quit IRC15:53
*** david-lyle has quit IRC15:53
openstackgerritMarkos Chandras proposed openstack-infra/glean: Fix SUSE based network configuration  https://review.openstack.org/37853215:53
*** sandanar has quit IRC15:54
amrithclarkb, pabelanger thanks.15:54
*** gouthamr has joined #openstack-infra15:54
*** tmorin has quit IRC15:54
amrithwill work on that approach15:54
*** matrohon has quit IRC15:54
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Fix openstackdocstheme-api-ref gate  https://review.openstack.org/38252515:54
* AJaeger was really tired last night - I shouldn't have put entries in wrong order ;( ^15:55
AJaegerproject-config cores, would be nice to get 382525 in to unblock some testing on openstackdocstheme . Thanks!15:55
anteayareviewed15:56
pleia2good morning15:56
anteayamorning pleia215:56
pleia2clarkb: I'm around all day, lmk when you have a chunk of time to talk nodepool demo15:57
*** mdrabe has quit IRC15:57
jordanPhow would one do to remove the python34 jobs for a given project ? given that this project already has a python35 job voting15:58
clarkbpleia2: ok I am just starting to boot my day. probably in an hour or so15:58
anteayajordanP: which project?15:58
AJaegerjordanP: python34 jobs are running on stable/ branches only15:58
jordanPlet's say tempest15:58
pleia2clarkb: me too, coffee-ing up :) sounds good15:58
AJaegerjordanP: or better: on mitaka and older15:58
AJaegerjordanP: and python35 only on newton and newer15:58
*** psilvad has joined #openstack-infra15:58
AJaegerjordanP: so, leave both in since they are never run at the same time.15:58
anteayawell tempest doesn't have branches so I don't think that will work15:59
jordanPthey seem to run at the same time: https://review.openstack.org/#/c/380777/ gate-tempest-python34SUCCESS in 3m 05s15:59
jordanPgate-tempest-python35SUCCESS in 3m 25s15:59
*** Sukhdev_ has joined #openstack-infra15:59
*** sputnik13 has quit IRC15:59
jordanPanteaya, good point :)15:59
AJaegerjordanP: so, that's an error -and a missed step.16:00
anteayawhy do you want to remove python34 jobs from tempest?16:00
*** claudiub has joined #openstack-infra16:00
*** gyee has joined #openstack-infra16:00
*** adrian_otto has quit IRC16:00
AJaegerjordanP: in this specific case: Follow anteaya's advise since tempest has no branches...16:00
jordanPidk, because it will not be supported anymore one day and we have py35 voting16:00
*** jpich has quit IRC16:00
anteayawell so far I have no advice16:00
jordanPto save some resources16:01
*** mdrabe has joined #openstack-infra16:01
*** yamamoto has quit IRC16:01
AJaegerjordanP: but I like the openstack-qa team sign of on that since tempest is used for older branches, it might be a good idea to run both of them.16:01
anteayawell I think as long as python34 is still operational and isnt' blocking anything we should leave it testing16:01
anteayathe resources it might save are minimal16:01
AJaegerjordanP: better optimize long-running jobs ;)16:01
mtreinishjordanP: yeah we need to keep around as long as we're running on stable branches that still use 3416:02
jordanPok, you know better than me, I don"t mind that py34 job16:02
jordanPwas just asking16:02
anteayajordanP: yup16:02
jordanPthanks16:02
anteayathank you16:02
*** adrian_otto has joined #openstack-infra16:02
openstackgerritSteve Martinelli proposed openstack-infra/project-config: remove the legacy driver job for keystone  https://review.openstack.org/38249916:04
*** thcipriani|afk is now known as thcipriani16:04
*** mamitchl has joined #openstack-infra16:04
AJaegerstevemar: did you really want to remove the job from stable branches? ^16:04
*** ccamacho is now known as ccamacho|willbeb16:05
*** ccamacho|willbeb is now known as ccamacho|willbbc16:05
AJaegerbbl16:05
*** ccamacho|willbbc is now known as ccamacho|wllbbck16:05
*** Sukhdev_ has quit IRC16:06
*** andreas_s has joined #openstack-infra16:06
*** baoli has quit IRC16:06
openstackgerritErlon R. Cruz proposed openstack-infra/project-config: Adds Cinder multibackend tests to tempest  https://review.openstack.org/38253516:08
andreas_ssdague, ianw: could anybody of you have a brief look at this devstack patch? https://review.openstack.org/#/c/377007/ Currently devstack is broken when the host uses dots in its network device names...16:09
andreas_sthe patch fixes that...16:09
*** amitgandhinz has joined #openstack-infra16:09
stevemarAJaeger: commented -- i'm not against it16:09
*** Apoorva has joined #openstack-infra16:10
openstackgerritMarkos Chandras proposed openstack-infra/glean: Fix SUSE based network configuration  https://review.openstack.org/37853216:12
*** asselin has quit IRC16:13
*** asselin has joined #openstack-infra16:13
*** Apoorva has quit IRC16:14
*** vsaienko has joined #openstack-infra16:15
*** ihrachys has quit IRC16:15
*** vsaienko has quit IRC16:16
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Retry SSHExceptions in nodepool  https://review.openstack.org/38254316:17
*** rajinir has joined #openstack-infra16:18
*** hashar has quit IRC16:18
clarkbmriedem: mtreinish looks like e-r is happy again16:19
*** dtantsur is now known as dtantsur|afk16:19
mtreinishclarkb: \o/16:19
*** csomerville has quit IRC16:20
anteayayay happy elastic research16:20
mtreinishclarkb: so whatever data was making e-r barf cleared itself up?16:20
mriedemmtreinish: no16:20
mriedemi patched e-r16:20
clarkbwell I claered up the issue too16:21
anteayaclarkb: does the elastic research index run on a cron job? if yes, what is it called?16:21
mtreinishmriedem: did that land?16:21
mriedembtw, i think the TLS stuff is making connections randomly fail16:21
mriedemclarkb: http://logs.openstack.org/00/382000/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/07e5243/logs/screen-n-api.txt.gz?level=TRACE#_2016-10-05_14_35_04_33316:21
mriedem^ started showing up after https://review.openstack.org/#/c/375776/16:21
clarkbmtreinish: mriedem basically we get too much data on disk to load into memory to perform queries (timestamps usually) and then it throws an error instead of OOMing16:21
clarkbso you can delete old indexes to reduce the memroy needed16:21
clarkbanteaya: ya there are 3 cron entries for the recheck user on status.openstack.org16:22
clarkbanteaya: I don't know the names puppet has assigned to them16:22
anteayaclarkb: thank you16:22
clarkbmriedem: cool someone should fix that :)16:22
mriedemclarkb: mtreinish: tracking with https://bugs.launchpad.net/nova/+bug/163066416:23
openstackLaunchpad bug 1630664 in OpenStack Compute (nova) "Intermittent failure in n-api connecting to neutron to list ports after TLS was enabled in CI" [Undecided,New]16:23
*** cody-somerville has joined #openstack-infra16:23
*** cody-somerville has quit IRC16:23
*** cody-somerville has joined #openstack-infra16:23
mriedemi'll write the e-r query and then it's lunch time16:23
clarkbmriedem: might help if we can get the underlying error out of keystoneauth1.session16:24
clarkbmriedem: as is the error is a pretty generic "connection error"16:24
mriedemchecking keystone logs16:24
clarkbmaybe we need to tell nova what certificate to trust? I think we have to do that for the other services16:25
clarkb(we do add the cert to the system trust but python requests ignores that because :( )16:25
mriedemweird, there is a 22 second gap here http://logs.openstack.org/00/382000/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/07e5243/logs/apache/keystone.txt.gz#_2016-10-05_14_34_56_45316:25
*** woodster_ has joined #openstack-infra16:26
mtreinishmriedem: does it matter that there is a db deadlock in neutron: http://logs.openstack.org/00/382000/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/07e5243/logs/screen-q-svc.txt.gz?level=TRACE16:26
mtreinishmriedem: keystone auth session is just the requests wrapper. It might not actually be timing out talking to keystone16:26
*** ddieterly is now known as ddieterly[away]16:27
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for nova/neutron TLS connect failure bug 1630664  https://review.openstack.org/38254716:27
openstackbug 1630664 in OpenStack Compute (nova) "Intermittent failure in n-api connecting to neutron to list ports after TLS was enabled in CI" [Undecided,New] https://launchpad.net/bugs/163066416:27
mriedemmtreinish: the deadlock isn't around that time16:27
mriedemmtreinish: the deadlocks are certainly concerning though :)16:27
mtreinisharmax: ^^^ :)16:28
mriedemmtreinish: https://review.openstack.org/#/c/382547/16:28
clarkbhttp://logs.openstack.org/00/382000/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/07e5243/logs/etc/cinder/cinder.conf.txt.gz see the keystone_authtoken section there16:29
clarkboh wait we have that for nova too so nevermind16:29
*** tphummel has joined #openstack-infra16:29
*** ddieterly[away] is now known as ddieterly16:30
clarkbnova should have the right cafile set and thus can trust the cert neutron presents16:30
*** yamamoto has joined #openstack-infra16:31
*** tuannguyen has quit IRC16:31
*** mdrabe has quit IRC16:31
*** mdrabe has joined #openstack-infra16:31
*** tuannguyen has joined #openstack-infra16:31
*** nadya has joined #openstack-infra16:32
*** ociuhandu has quit IRC16:33
*** gus_ is now known as gus16:33
*** nadya has quit IRC16:34
*** watanabe_isao has joined #openstack-infra16:34
anteaya<-- offline for a bit16:34
*** lucas-hungry is now known as lucasagomes16:35
*** yaume has quit IRC16:36
*** tuannguyen has quit IRC16:36
openstackgerritErlon R. Cruz proposed openstack-infra/project-config: Adds Cinder multibackend tests to tempest  https://review.openstack.org/38253516:36
openstackgerritMerged openstack-infra/elastic-recheck: Add query for nova/neutron TLS connect failure bug 1630664  https://review.openstack.org/38254716:36
openstackbug 1630664 in OpenStack Compute (nova) "Intermittent failure in n-api connecting to neutron to list ports after TLS was enabled in CI" [Medium,Confirmed] https://launchpad.net/bugs/163066416:36
* armax looks16:37
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: support non-ASCII characters in PTL names  https://review.openstack.org/38255916:37
*** watanabeisao has joined #openstack-infra16:38
clarkbmtreinish: stevemar (and I think frickler was working on it? ) now that the keystone v3 only job is passing should it be made voting?16:38
*** abregman has quit IRC16:39
*** watanabe_isao has quit IRC16:39
*** yamamoto has quit IRC16:39
*** jlanoux_ has quit IRC16:39
*** chem has quit IRC16:40
clarkbpabelanger: ianw who would be a good person to bug about getting devstack + tls-proxy working on centos7?16:41
*** annegentle has quit IRC16:41
clarkbpabelanger: ianw: it almost looks like the restart/reload functionality on cetnos is working different than trusty, xenial, and fedora16:41
clarkbdespite sharing an init system with two of those distros.16:41
*** chem has joined #openstack-infra16:41
*** jaosorior has quit IRC16:42
clarkb* apache restart/reload16:42
*** yamahata has quit IRC16:44
pabelangerclarkb: I might have some cycles at the summit to dive into this.  Assuming ianw doesn't make happen first16:46
*** claudiub has quit IRC16:47
clarkbpabelanger: ok, I am happy to keep working on it too but thought that someone else might already have a better understanding of what is going on there16:47
*** Qiming has quit IRC16:47
*** trown is now known as trown|lunch16:47
clarkbalso in other news zuul job restrictions absed on file totally bit me in https://review.openstack.org/38256416:47
clarkbtunrs out that I can't actually get those tests to run if I only edit the README.rst :(16:47
*** amitgandhinz has quit IRC16:50
*** chem has quit IRC16:51
*** chem has joined #openstack-infra16:51
*** zeih has quit IRC16:52
*** david-lyle has joined #openstack-infra16:52
*** Apoorva has joined #openstack-infra16:53
*** amitgandhinz has joined #openstack-infra16:54
*** yonglihe has quit IRC16:55
*** Qiming has joined #openstack-infra16:55
*** lucasagomes is now known as lucas-brb16:55
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Add code to do the DIB build  https://review.openstack.org/38257016:55
armaxmriedem: do you see the lack of connection on the /ports endpoint only?16:56
*** chem has quit IRC16:56
mriedemi didn't dig through all of the logstash hits, but i think that's the big one16:56
*** chem has joined #openstack-infra16:56
mriedemit's when nova is doing a pretty well known to be expensive port list operatoin when building the security groups list for showing a server16:57
mriedemwe've known that we should cache the security groups but it's not trivial16:57
mriedemand requires a spec i think16:57
clarkbmriedem: armax: thinking about that more its possible the proxy is deciding the connection has timed out where in the past we would have waited longer for an expensive call16:57
clarkbmriedem: armax you can probably check the apache logs for that info on the job16:57
mriedemsdague: dansmith: btw we did decide we wanted to cache the instance security groups we get from neutron right?16:58
mriedemso we don't have to dip into the well when showing server details?16:58
dansmithmriedem: yeah, I guess we did16:58
*** ddieterly is now known as ddieterly[away]16:58
dansmiththat discussion was a while ago16:58
*** drifterza has joined #openstack-infra16:58
mriedemdansmith: yeah it's a spec i think16:58
mriedemb/c of the various hits to make it work16:58
armaxclarkb: I can see other requests for the same device completing successfully16:59
dansmithreally?16:59
*** senk_ has quit IRC16:59
dansmithI don't recall a spec but cool16:59
mriedemwell, it's not trivial16:59
mriedemwith the cache refreshing and db/object changes and all that16:59
dansmithyeah16:59
openstackgerritMerged openstack-infra/bugdaystats: Add "daily" option to bugdaystats.py  https://review.openstack.org/35814916:59
armaxclarkb: how long is the timeout?16:59
*** narayrak has quit IRC16:59
clarkbarmax: whatever the default for apache mod_proxy is16:59
clarkbwe aren't currently configuring that17:00
clarkbarmax: https://httpd.apache.org/docs/current/mod/mod_proxy.html#proxytimeout implies default is no timeout so probably not it unless distro config modifies that somehow17:00
armaxclarkb: in the logs pointed by the report I see no trace of req-c1bbc78f-89e4-4de2-956d-9b71f8ad1a87 in the neutron server log17:00
clarkbbut the apache logs should log it if thats the case17:00
*** derekh has quit IRC17:01
pabelangerclarkb: ya, it will be a learning process for me too. Something I should likely know17:01
pabelangerjeblair: when you have time, I'd enjoy some comments on 382543 on how best to increase granularity on SSHExceptions in nodepool17:02
*** andreas_s has quit IRC17:02
*** tuannguyen has joined #openstack-infra17:02
*** esikachev has quit IRC17:02
jeblairpabelanger: that change lgtm :)17:03
pabelangerYay17:03
*** ddieterly[away] is now known as ddieterly17:03
openstackgerritFrédéric Guillot proposed openstack-infra/project-config: Add os_almanach to OpenStack-Ansible  https://review.openstack.org/37159017:03
openstackgerritJavier Peña proposed openstack-infra/tripleo-ci: DO NOT MERGE testing switch to Ocata DLRN instance  https://review.openstack.org/38252117:04
clarkbarmax: mriedem looking at http://logs.openstack.org/00/382000/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/07e5243/logs/apache/other_vhosts_access.txt.gz it makes multiple requests for that url17:04
pleia2oomichi, masayukig - landed 358149 to move us along, but if you do want to follow up with the suggestion jhesketh had that would be good :)17:05
clarkbarmax: mriedem and there is indeed a gap between 14:35:02 and 14:35:07 (we timed out at 14:35:04)17:05
armaxclarkb: correct17:05
*** adrian_otto has quit IRC17:05
clarkbarmax: mriedem but I don't see any errors in that range17:05
armaxbut I don’t see req-c1bbc78f-89e4-4de2-956d-9b71f8ad1a87 ever reaching out the neutron server17:05
clarkbarmax: ya I don't think its being established to the proxy at all either17:06
armaxclarkb: or being logged17:06
*** hashar has joined #openstack-infra17:06
*** hashar is now known as hasharAway17:06
clarkbarmax: since there is no record of the request around 14:35:04 on the proxy, which woudl explain why there is no record on the neutron side either17:06
*** e0ne has quit IRC17:06
armaxclarkb: aye17:06
openstackgerritK Jonathan Harker proposed openstack-infra/puppet-log_processor: Add extra_daemon_args parameter to the client class  https://review.openstack.org/38127017:07
*** adrian_otto has joined #openstack-infra17:07
*** adrian_otto has quit IRC17:07
AJaegerclarkb, pleia2, pabelanger : Could either of you approve a simple project-config change for me, please?17:07
*** kzaitsev_mb has quit IRC17:07
AJaegerhttps://review.openstack.org/382525 is the change17:07
*** vsaienko has joined #openstack-infra17:07
* pleia2 looks17:08
*** yamamoto has joined #openstack-infra17:08
*** adrian_otto has joined #openstack-infra17:08
pleia2AJaeger: hm, not sure I understand how this helps, can you explain?17:09
*** mkoderer has quit IRC17:09
*** tqtran has joined #openstack-infra17:10
AJaegerpleia2: the order is different - last one wins17:10
*** strigazi is now known as strigazi_AFK17:10
AJaegerI change order with the regex that otherwise will catch it17:11
*** adrian_otto has quit IRC17:11
pleia2AJaeger: ah, last one wins17:11
*** lucas-brb is now known as lucasagomes17:11
pleia2I was curious, since the first one would catch the second regex-wise17:11
AJaegerpleia2: By accident I moved it to the wrong place yesterday...17:11
pleia2gotcha, thanks17:11
AJaegerthanks, pleia217:11
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Enable tls-proxy on subnode if enabled on primary  https://review.openstack.org/38257717:12
clarkbturns out there was a small gap in my multinode testing of tls-proxy. Should be addressed in ^ (which is self testing)17:12
pleia2whoops, lgtm17:14
*** sambetts is now known as sambetts|afk17:14
openstackgerritMerged openstack-infra/project-config: Fix rc.local for systemd in nodepool-base element  https://review.openstack.org/38239117:14
*** ddieterly is now known as ddieterly[away]17:15
clarkbpleia2: ok with that pushed I should be ready to do things after a few minutes doing home things. Lets say 10:45 PDT17:15
pleia2clarkb: wfm17:15
*** esikachev has joined #openstack-infra17:15
*** baoli has joined #openstack-infra17:18
*** adrian_otto has joined #openstack-infra17:18
openstackgerritMerged openstack-infra/project-config: Fix openstackdocstheme-api-ref gate  https://review.openstack.org/38252517:18
*** chem has quit IRC17:18
*** yamamoto has quit IRC17:18
*** jordanP has quit IRC17:19
*** adrian_otto has quit IRC17:19
*** shamail has quit IRC17:20
*** matt-borland has quit IRC17:20
*** amotoki has quit IRC17:21
*** esikachev has quit IRC17:21
*** amitgandhinz has quit IRC17:22
*** yamahata has joined #openstack-infra17:22
*** vsaienko has quit IRC17:23
*** ccamacho|wllbbck is now known as ccamacho17:23
*** chem has joined #openstack-infra17:24
*** matt-borland has joined #openstack-infra17:24
*** senk_ has joined #openstack-infra17:25
*** amitgandhinz has joined #openstack-infra17:26
*** watanabeisao has quit IRC17:27
*** claudiub has joined #openstack-infra17:27
*** tnovacik has joined #openstack-infra17:27
*** chem has quit IRC17:28
*** Swami has joined #openstack-infra17:30
openstackgerritMerged openstack-infra/nodepool: Return build or upload number with recent data  https://review.openstack.org/37896917:32
*** shardy is now known as shardy_afk17:32
*** ihrachys has joined #openstack-infra17:32
*** amitgandhinz has quit IRC17:33
*** amitgandhinz has joined #openstack-infra17:34
*** yamahata has quit IRC17:34
openstackgerritMerged openstack-infra/nodepool: Add imageUploadLock() API  https://review.openstack.org/37898317:35
openstackgerritMerged openstack-infra/nodepool: Add provider upload framework  https://review.openstack.org/37979517:37
clarkbpabelanger: did we get anywhere helping ovh debug?17:40
*** cardeois has quit IRC17:40
clarkb(timezones make that really hard for me :/)17:40
*** gouthamr has quit IRC17:41
*** caphrim__ has joined #openstack-infra17:41
*** ociuhandu has joined #openstack-infra17:42
fricklerclarkb: I would be reluctant to make identity-v3-only voting while nova refuses to run it, see https://review.openstack.org/34190817:43
clarkbfrickler: ok we should figure out if making devstack v3 by default makes sense at this point now that the job is passing then we can just remove the job17:44
oomichipleia2: thanks for reviewing bugdaystates patches :-)17:45
pleia2oomichi: sure thing! fingers crossed :)17:45
clarkbfrickler: then keystone can run a single v2 job until v2 is removed17:45
*** jpena is now known as jpena|off17:45
clarkbfrickler: (or something like that)17:45
*** tosky has quit IRC17:47
fricklerclarkb: sounds plausible, but I'm not involved in keystone enough to judge that properly. there may also be some interaction with the pending change to make fernet the default token provider, which is similarly long overdue17:47
pabelangerclarkb: On my list still, I should be able to do that this afternoon17:47
*** yamamoto has joined #openstack-infra17:47
pabelangerclarkb: ovh-gra1 looks to be back to normal17:47
clarkbpabelanger: interesting, I do find it slightly odd we have less issues with the cloud on another continent when transfering such large amounts of data17:48
clarkbI guess that probably means its not a network issue17:48
pabelangerYa, not sure17:48
pabelangerwill retry BHS1 shortly17:48
pabelangerclarkb: also https://review.openstack.org/#/c/382543/ could use a review, been testing that locally to deal with our ssh connection reset issues17:49
*** amoralej is now known as amoralej|off17:50
*** abregman has joined #openstack-infra17:51
*** john-davidge has joined #openstack-infra17:51
*** ihrachys has quit IRC17:54
*** vsaienko has joined #openstack-infra17:56
*** spzala has quit IRC17:56
*** diablo_rojo has quit IRC17:56
*** vsaienko has quit IRC17:56
*** yamamoto has quit IRC17:56
openstackgerritMerged openstack-infra/nodepool: Retry SSHExceptions in nodepool  https://review.openstack.org/38254317:59
pabelangerclarkb: I wonder if paramiko has something for backoff, will look17:59
*** Apoorva_ has joined #openstack-infra17:59
*** ihrachys has joined #openstack-infra18:02
*** Apoorva has quit IRC18:02
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - Test Undercloud upgrade mitaka -> newton  https://review.openstack.org/38130918:02
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Undercloud upgrade for mitaka and newton  https://review.openstack.org/38128618:02
*** john-davidge has quit IRC18:03
*** john-dav_ has joined #openstack-infra18:03
*** yamahata has joined #openstack-infra18:04
*** SamYaple_ has joined #openstack-infra18:04
*** SamYaple_ has quit IRC18:04
*** SamYaple has quit IRC18:04
*** SamYaple has joined #openstack-infra18:04
*** mtanino has quit IRC18:04
*** trown|lunch is now known as trown18:04
*** gyee has quit IRC18:05
*** berendt has quit IRC18:05
jeblairclarkb, pabelanger: that's already in a loop that only tries every (x=2) seconds.  and we only expect this to fail once or twice anyway.18:06
*** gouthamr has joined #openstack-infra18:06
clarkbjeblair: ya, thinking specifically back off depending on the exception18:07
clarkbmaybe by adding sleeps in those blocks?18:07
jeblairclarkb: oh, like "you hit this exception, we know you need an extra 5 seconds to recover"18:07
clarkbjeblair: ya that18:07
jeblairclarkb: yeah, maybe just a sleep in the except handler is the thing then18:08
*** yolanda has quit IRC18:08
jeblairsimple+effective :)18:08
openstackgerritFrédéric Guillot proposed openstack-infra/project-config: Add os_almanach to OpenStack-Ansible  https://review.openstack.org/37159018:09
pabelangerjeblair: clarkb: Once we restart nodepool with the new patch, I'll get some data to see how often, and how many failures in a row, take place18:11
jeblairgood idea18:11
*** vsaienko has joined #openstack-infra18:12
*** gyee has joined #openstack-infra18:13
*** tqtran has quit IRC18:13
*** ddieterly[away] has quit IRC18:15
*** yolanda has joined #openstack-infra18:15
*** Naeil has quit IRC18:16
*** vsaienko has quit IRC18:16
*** thorst is now known as thorst_afk18:17
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci: [WIP] Add IPv6 coverage using existing jobs  https://review.openstack.org/38251518:20
*** salv-orlando has quit IRC18:22
*** rossella_s has quit IRC18:22
*** e0ne has joined #openstack-infra18:23
*** spzala has joined #openstack-infra18:24
openstackgerritIhar Hrachyshka proposed openstack-infra/bindep: Fixed bindep -b mode for version mismatch errors  https://review.openstack.org/38197918:24
*** david-lyle has quit IRC18:25
*** csomerville has joined #openstack-infra18:25
*** yamamoto has joined #openstack-infra18:25
*** nadya has joined #openstack-infra18:26
*** vsaienko has joined #openstack-infra18:27
*** dtardivel has quit IRC18:27
openstackgerritIhar Hrachyshka proposed openstack-infra/bindep: Fixed bindep -b mode for version mismatch errors  https://review.openstack.org/38197918:27
mtreinishmordred: qq, what's the deal with: https://github.com/ansible/ansible-modules-extras/pull/2700 is something supposed to merge that?18:27
mtreinishmordred: I'm having a hard time finding docs on the patch lifecycle for ansible anywhere18:28
mtreinishso I'm kinda confused :)18:28
ihrachysAJaeger: ^ I dropped bindep.txt and tox and added docs. I hope it's fine now.18:28
*** cody-somerville has quit IRC18:29
pabelangermordred: Seeing some failure with tripleo-test-cloud-rh1 getting FIP assigned when we create a server, http://paste.openstack.org/raw/584530/ is an example of the server data.  It looks like both ipv4 and ipv6 address are empty, which nodepool then raises an exception on. Wonder if you have some suggestions on how to better debug this18:29
jeblairmtreinish: you might ask gregdek in #ansible-devel about it18:29
*** cody-somerville has joined #openstack-infra18:30
jeblairmtreinish: he might need to poke a bot or something18:30
mtreinishjeblair: thanks, I'll give that a shot18:30
*** csomerville has quit IRC18:31
*** senk_ has quit IRC18:32
*** nadya has quit IRC18:33
*** ddieterly has joined #openstack-infra18:33
*** annegentle has joined #openstack-infra18:36
*** yamamoto has quit IRC18:36
pabelangerclarkb: So, with ovh-bhs1, I still see 10 images that are queued with 'openstack image list', most recent is 2016-09-25T02:47:24Z18:37
pabelangertesting a new image upload now18:37
clarkbya I think that they just never complete on the openstack side18:38
pabelangerYup18:40
pabelangerwonder if we should think about pruning them18:41
clarkbya I have meant to go back through and see if we are leaking our images as badly as we were18:41
pabelangermaybe see what OVH can find on those instances18:41
clarkbin theory those changes to not time out building images should have fixed many of those18:41
pabelangerya18:43
pabelangerhowever, I think we try for ever to upload an image? Until we can back some success / failure message18:43
pabelangerI wonder in this case, if we get anything back18:43
*** hasharAway is now known as hashar18:43
*** esikachev has joined #openstack-infra18:44
clarkbcorrect, now that we dont' time those out (because we were leaking and unable to complete within the timeout) we need to get a response from the cloud or otherwise have the connection fail18:44
clarkbpabelanger: have time for a quick review on https://review.openstack.org/#/c/382577/ to fix a problem with multinode + tls?18:44
*** claudiub has quit IRC18:45
*** thorst_afk is now known as thorst_18:45
*** narayrak has joined #openstack-infra18:46
pabelanger+318:47
*** shamail has joined #openstack-infra18:48
*** shamail has left #openstack-infra18:49
openstackgerritClark Boylan proposed openstack-infra/project-config: Enable TLS in more neutron integration jobs  https://review.openstack.org/38261818:50
clarkbarmax: ^ review on that change would be great18:50
*** e0ne has quit IRC18:50
clarkbpabelanger: thank you18:50
jamesmcarthurfungi: I've been working with the User Story Tracker (i think still trying to decide on a final name) team. They've completed their first round and are ready for a demo. Would like to show our work ahead of Barcelona to the Storyboard and Infra teams.18:51
*** narayrak has quit IRC18:51
armaxclarkb: what about the intermittent failure that was observed, did we get to the bottom of it?18:51
*** narayrak has joined #openstack-infra18:51
*** Sukhdev has joined #openstack-infra18:51
jamesmcarthurfungi: can you remind me where we left off? I know you helped Viri with the puppet scripts, but I'm not sure where things were left.18:52
clarkbarmax: no I think we need more info from keystoneauth1.session as there isn't enough info to know what actually failed18:52
*** smarcet1981 has joined #openstack-infra18:52
armaxok18:52
*** vsaienko has quit IRC18:52
clarkbarmax: will be good to see if it shows up with non ssl jobs too18:53
clarkb(the logstash query should help with sorting that out)18:53
armaxtrue18:53
*** annegentle has quit IRC18:53
*** cardeois has joined #openstack-infra18:55
clarkblooks like it only happens on the one job and we don't have data from ebfore the 27th so not sure if it was a thing previously18:55
clarkboh because its explicitly an https url /me edits query18:55
pabelangerclarkb: jeblair: any objections to nodepool restart today?18:56
clarkbpabelanger: nope, but maybe we should do it with new init things? I should catch up and review those18:56
clarkbarmax: ya no results for an http url so likely is related to the proxy somehow18:58
*** e0ne has joined #openstack-infra18:58
*** Apoorva_ has quit IRC18:58
jeblairpabelanger, clarkb: yeah, np is currently running started manually, so we should push the init scripts through.  can help after lunch.18:58
openstackgerritIhar Hrachyshka proposed openstack-infra/bindep: Removed remnants of support_py26 module  https://review.openstack.org/38262118:58
*** Apoorva has joined #openstack-infra18:59
fungijamesmcarthur: it was teresita i helped actually, i think. and i recall pointing them to our documentation, but i didn't hear much back after 2016-07-18 when i suggested submitting a (very brief) spec to outline the plan18:59
pabelangerOh right, ya. I can start work on the init scripts19:00
clarkbarmax: let me work on making the logging apache does better19:00
clarkband maybe morgan and jamielennox can help on the keystoneauth side19:00
*** vsaienko has joined #openstack-infra19:01
armaxack19:01
*** matrohon has joined #openstack-infra19:02
*** ijw has quit IRC19:03
jamesmcarthurfungi: ok. Interesting. I know they're set up on gerrit and on git.openstack.org.19:03
*** gyee has quit IRC19:03
*** yamamoto has joined #openstack-infra19:04
*** marst has joined #openstack-infra19:04
fungijamesmcarthur: right, we got the repo imported19:05
jamesmcarthurfungi: let me work with them on getting a spec19:05
ihrachysfungi: I hope you are in safe place19:05
fungijamesmcarthur: just seems like they didn't get very far working out the deployment details with us yet19:06
jamesmcarthurfungi: ok. thanks for the info :)19:06
fungiihrachys: thanks! i'm still boarding up windows. it's rather boring and tiring19:06
jamesmcarthurfungi: is it expected to hit NC? Thought Florida was taking the brunt.19:07
*** vsaienko has quit IRC19:07
fungijamesmcarthur: they were originally (up until earlier today) projecting for the eye to come right over us as a category 3 or strong category 2, but now the models show it getting drunk and wandering back around south of us19:07
fungisouth carolina issued an evacuation order for their entire coast, and wilmington's under an evacuation order but they may lift it19:09
ihrachysfungi: good to hear it's drunk :)19:09
*** tqtran has joined #openstack-infra19:09
fungiocracoke is under evacuation as well since they're planning to discontinue the ferry if it comes much closer19:09
fungibut we're leaving for vacation in a couple days, so being cautious in case it changes its mind after we're too far away to do anything about it19:09
*** vsaienko has joined #openstack-infra19:10
jamesmcarthurfungi: wow. Stay safe sir!19:11
fungithanks! i have tons of scrap plywood and assorted lumber and no idea what i'm doing... what could possibly go wrong? ;)19:11
clarkbarmax: https://review.openstack.org/382625 something like that19:12
clarkbarmax: will have to see if info is too chatty, we can probably restrict it to mod proxy if so19:12
*** vsaienko has quit IRC19:14
*** yamamoto has quit IRC19:14
jamesmcarthurfungi: just dont' board yourself inside the house.19:14
fungijamesmcarthur: oh, right! i probably would have19:15
*** ihrachys has quit IRC19:15
*** jamesdenton has joined #openstack-infra19:15
fungithanks for the suggestion19:15
clarkbfungi: have they decided to force you to leave yet?19:15
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Make the ovb-updates job work again  https://review.openstack.org/37440619:15
openstackgerritPaul Belanger proposed openstack-infra/puppet-nodepool: Add nodepool-(builder|deleter) services  https://review.openstack.org/38262619:15
anteayafungi: you could build a boat19:15
smarcet1981fungi: this is the puppet module https://github.com/openstack-infra/puppet-userstory_dashboard?19:15
smarcet1981fungi : afternoon :)19:15
fungiclarkb: they don't really "force" residents to evacuate here. they do arrest visitors if they don't leave under a visitor evacuation, but the "mandatory" evacuation is more like all teh emergency management people are leaving so if you have any problems, you're on your own19:16
openstackgerritPaul Belanger proposed openstack-infra/puppet-nodepool: Add nodepool-(builder|deleter) services  https://review.openstack.org/38262619:16
fungianteaya: i don't think i would trust any boat i might build out of this scrap wood19:17
fungia raft, _maybe_19:17
anteayagood call19:17
anteayaraft, raft could work19:17
fungismarcet1981: yeah, i got the cookiecutter pushed, but it doesn't look like they've proposed anything to it yet19:19
smarcet1981fungi : ok19:21
*** ddieterly is now known as ddieterly[away]19:23
*** david-lyle has joined #openstack-infra19:23
*** ddieterly[away] is now known as ddieterly19:26
openstackgerritPaul Belanger proposed openstack-infra/puppet-nodepool: Add nodepool-(builder|deleter) services  https://review.openstack.org/38262619:32
*** vsaienko has joined #openstack-infra19:34
*** tnovacik has quit IRC19:35
*** persia has quit IRC19:37
*** persia has joined #openstack-infra19:37
*** claudiub has joined #openstack-infra19:37
*** mixos has joined #openstack-infra19:38
*** e0ne has quit IRC19:39
*** john-dav_ is now known as john-davidge19:43
*** yamamoto has joined #openstack-infra19:44
*** vsaienko has quit IRC19:44
*** sdake has quit IRC19:45
*** sdake has joined #openstack-infra19:46
*** kzaitsev_mb has joined #openstack-infra19:46
*** annegentle has joined #openstack-infra19:49
*** john-dav_ has joined #openstack-infra19:50
*** john-davidge has quit IRC19:50
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci: DO NOT MERGE testing switch to Ocata DLRN instance  https://review.openstack.org/38252119:51
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Redirect image build stderr to stdout  https://review.openstack.org/38264119:52
*** salv-orlando has joined #openstack-infra19:53
*** salv-orl_ has joined #openstack-infra19:54
*** yamamoto has quit IRC19:54
*** vsaienko has joined #openstack-infra19:56
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - Test Undercloud upgrade mitaka -> newton  https://review.openstack.org/38130919:57
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Undercloud upgrade for mitaka and newton  https://review.openstack.org/38128619:57
*** Apoorva has quit IRC19:58
*** salv-orlando has quit IRC19:58
*** ddieterly is now known as ddieterly[away]19:58
*** ddieterly[away] is now known as ddieterly19:59
*** lucasagomes is now known as lucas-afk20:02
jeblairpabelanger:20:03
jeblair2016-10-05 19:35:25 +0000 Puppet (err): Could not find dependency File[/etc/init.d/nodepool/deleter] for Service[nodepool-deleter] at /etc/puppet/modules/nodepool/manifests/init.pp:32420:03
*** ijw has joined #openstack-infra20:03
jeblairhttp://logs.openstack.org/26/382626/3/check/gate-infra-puppet-apply-ubuntu-trusty/74d0f50/puppetapplytest39.final.out.FAILED20:03
pabelangeroops20:04
openstackgerritPaul Belanger proposed openstack-infra/puppet-nodepool: Add nodepool-(builder|deleter) services  https://review.openstack.org/38262620:04
pabelangerI haven't actually tested this code yet, waiting for jenkins to +120:04
jeblairseems to be effective! :)20:05
pabelangerindeed, +1 for pansible20:05
*** tuannguyen has quit IRC20:05
*** tuannguyen has joined #openstack-infra20:06
*** adrian_otto has joined #openstack-infra20:06
*** rushil has joined #openstack-infra20:07
pabelangerjust got this back from ovh about image uploads. "I start upload my image, and in the mindle of the upload, I just kill my glance image-create, and the image has been put in Qeueud." Could explain why we are seeing a lot of queued images20:07
*** jpich has joined #openstack-infra20:08
*** ociuhandu has quit IRC20:09
fungisuggesting we're aborting image-create partway sometimes>20:10
*** ijw has quit IRC20:10
fungi?20:10
pabelangerI am not sure of that20:10
pabelangerI guess we'd need to check logs20:10
*** tuannguyen has quit IRC20:10
fungimaybe socket disconnection has a similar effect20:10
pabelangermaybe we looks connection to ovh some how20:10
pabelangerright20:10
pabelangerloose*20:10
pabelangergrr20:11
pabelangerlose20:11
*** matrohon has quit IRC20:11
*** vsaienko has quit IRC20:11
pabelangerwe did revert back to raw images, which are rather large20:11
clarkbwe had this behavior with the qcow2s though too20:12
pabelangeryup20:12
clarkbwhich is what prompted us to try going back to raw20:12
*** tuannguyen has joined #openstack-infra20:14
*** adrian_otto has joined #openstack-infra20:14
pabelangerI would expect glance to check the checksum we add to the images however, to detect incomplete xfers20:14
pabelangerguess I need to see what 'queued' represents20:15
pabelangerThe image identifier has been reserved for an image in the Glance registry. No image data has been uploaded to Glance and the image size was not explicitly set to zero on creation.20:15
pabelangerokay, so that might explain it20:15
*** Apoorva has joined #openstack-infra20:16
*** adrian_otto has quit IRC20:16
pabelangerSo, maybe we start uploading, we lose the connection some how, image changes to queued and we basically block there forever20:16
pabelangersince glance is expecting up to upload the image again?20:16
pabelangerhttp://docs.openstack.org/developer/glance/statuses.html20:17
pabelangerseems to imply, if saving fails with v2 the status goes back to queued20:17
*** adrian_otto has joined #openstack-infra20:17
*** adrian_otto has quit IRC20:18
*** adrian_otto has joined #openstack-infra20:18
*** tuannguyen has quit IRC20:20
*** adrian_otto has quit IRC20:20
*** tuannguyen has joined #openstack-infra20:21
*** adrian_otto has joined #openstack-infra20:21
*** tuannguyen has quit IRC20:22
*** thomastaylor312 has joined #openstack-infra20:22
*** tuannguyen has joined #openstack-infra20:23
*** vsaienko has joined #openstack-infra20:23
*** yamamoto has joined #openstack-infra20:24
thomastaylor312Hey, I had a question about some functionality of jenkins job builder that I can't seem to find documented anywhere. This the right channel to ask in?20:25
clarkbthomastaylor312: yes zaro in particular20:25
thomastaylor312Thanks clarkb!20:26
*** tuannguyen has quit IRC20:26
*** tuannguyen has joined #openstack-infra20:27
*** ociuhandu has joined #openstack-infra20:28
*** vsaienko has quit IRC20:28
thomastaylor312zaro: So apparently when using a "project" in JJB, you can pass through job-template specific keys (in our case, a list of parameters) and it just appends to the list of parameters specified in the job template. Is that the intended behavior or more of an accidental feature?20:28
*** kgiusti has left #openstack-infra20:29
*** rushil has quit IRC20:33
*** ddieterly is now known as ddieterly[away]20:34
*** yamamoto has quit IRC20:34
jeblairthomastaylor312: if i'm following, i think that's intentional.  we use it a lot, for instance here: https://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/projects.yaml#n374020:35
jeblairthomastaylor312: (it's quite likely that the original author of that bit of code would answer your question in the strictest sense with "both" :)20:36
*** hashar has quit IRC20:38
*** esikachev has quit IRC20:38
thomastaylor312jeblair: Haha, true. Probably what I would answer too. But yeah, that is similar to what we are doing. Ours specifies the parameters list at the project level and not in the array of jobs, but I think it is the same idea. Any problem if I submit some documentation changes to document it?20:39
*** ddieterly[away] is now known as ddieterly20:42
jeblairthomastaylor312: yeah, we have project levels params too: https://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/projects.yaml#n4052  and that's also definitely intentional20:42
*** devananda is now known as devananda|afk20:43
jeblairthomastaylor312: (that will just mean the parameter is available to all job templates instantiated via the project20:43
anteayaasselin__ lennyb Monday is Thanksgiving in Canada, would either of you be able to take the Monday third party meeting?20:44
*** adrian_otto has quit IRC20:44
*** adrian_otto1 has joined #openstack-infra20:44
jeblairthomastaylor312: does http://docs.openstack.org/infra/jenkins-job-builder/definition.html#project not cover the case?  i'm thinking the second paragraph there ("Any number of arbitrarily named additional fields...") should cover it?20:45
jeblairthomastaylor312: (maybe i'm not quite following your example yet, or maybe the docs should be rephrased to be more clear)20:46
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - Test Undercloud upgrade mitaka -> newton  https://review.openstack.org/38130920:46
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Undercloud upgrade for mitaka and newton  https://review.openstack.org/38128620:46
*** vsaienko has joined #openstack-infra20:47
thomastaylor312jeblair: Kind of...I think the confusion that we had on our end is that it isn't an arbitrarily named variable we are using, it is an actual key used in a job. In this case it is a list of parameters. Let me throw together a gist20:47
*** jooni has quit IRC20:47
*** trown is now known as trown|outtypewww20:48
*** adrian_otto1 has quit IRC20:49
*** amitgandhinz has quit IRC20:49
*** Guest92 has joined #openstack-infra20:51
*** rtheis has quit IRC20:51
clarkbpabelanger: jeblair commented on the nodepoold split change. I think we want to continue to run a single nodepoold by default for backward compat and make the split daemons an option you can opt into20:51
clarkbpabelanger: jeblair and I don't think we need to keep running a noopy nodepoold20:51
asselin__anteaya, I have a conflict, so while I try to attend, it's difficult to chair20:51
jlvillalDid there happen to be a known infra issue in the last hour with connections to external sites when doing a devstack-gate run?20:51
clarkbjlvillal: if that is in osic and using devstacl+ neutron its very likely still related to that same route issue20:52
jlvillalclarkb: Ah thanks.20:52
clarkbjlvillal: if the external site doesn't have AAAA records in DNS then we need working ipv4 in osic to hit them20:53
pabelangerclarkb: Sure, I'm happy to update. Lets see what jeblair says20:53
thomastaylor312jeblair: This is an example of what we are doing: https://gist.github.com/thomastaylor312/0e0825ca7f1c79fe068d659b22d8dad420:53
anteayaasselin__: understood, thank you20:54
anteayaasselin__: I do appreciate you attending :)20:54
jeblairthomastaylor312: ah, so the "paragraph "If a variable is a list" is also relevant -- but it doesn't state that also applies to project-level definitions....20:54
jlvillalclarkb: Okay. I got an error like: Get https://index.docker.io/v1/repositories/library/debian/images: dial tcp 52.73.159.23:443: connection timed out"20:54
clarkbjlvillal: yup thats an ipv4 address and if devstack has done the neutrno things that break ipv4 you'll see that20:55
jlvillalclarkb: Okay. I will be patient then and wait for someone smarter than me to fix it!20:55
*** raildo has quit IRC20:55
thomastaylor312jeblair: Yeah, so in that case, the "parameters" key is an actual, valid key for a job and so the two lists get combined. Which isn't clear in the docs and if I understand you right, that is the correct behavior :)20:56
*** ddieterly is now known as ddieterly[away]20:56
*** abregman has quit IRC20:56
*** psilvad has quit IRC20:56
jeblairthomastaylor312: this is seeming more like it's slightly on the accidental side of things -- the idea that you should be able to provide a 'project-level' variable to a job template is definitely intentional, but the idea that you can provide a list of variables only really makes sense (for more than one value in the list) if that variable also shows up in the *name* of the job template.20:57
*** john-dav_ has quit IRC20:57
jeblairpabelanger, clarkb: yeah, i think the default should remain the same (i don't want to run a split nodepool for long myself).20:59
jeblairclarkb: that's not a noop though -- it does image builds20:59
*** Goneri has quit IRC21:00
clarkbjeblair: we have a separate daemon that does image builds which wasn't touched here I don't think21:00
jeblairclarkb: that's the daemon that performs the image builds; this one will trigger them21:00
thomastaylor312jeblair: So if that is accidental then, I don't think it would be a good idea to depend on it, unless that is a behavior we want to keep around21:01
clarkboh, and we want that to be in a separate daemon?21:01
jeblairclarkb, pabelanger: for the split configuration i think this makes the most sense: 1) launcher (--no-deletes --no-webapp --no-images).  2) deleter (--no-launches --no-webapp --no-images) 3) plain nodepool (--no-launches --no-deletes)21:01
*** adrian_otto has joined #openstack-infra21:02
jeblairclarkb: i'm thinking so, it might make some of our restarts, etc, a little easier (we may as well get something positive out of this not-ideal situation)21:02
*** jkilpatr has quit IRC21:02
clarkband by default continue to run single daemon (plain plain)21:02
jeblairclarkb: yep21:02
clarkbwfm21:02
*** yamamoto has joined #openstack-infra21:02
jeblairi will summarize that in a review comment21:02
*** ociuhandu has quit IRC21:04
jeblairthomastaylor312: in your gist, i don't see you actually using 'parameters' though21:05
thomastaylor312jeblair: Line 3 and 1321:05
thomastaylor312Stepping away from keyboard for a bit. I'll jump back on after21:06
pabelangerjeblair: clarkb: So, I think we can actually leave the nodepool service default along, which keeps backwards compat, then we just pass in our own updated one.21:06
pabelangerand nodepool-launcher / nodepool-deleter will be installed but require to be manually started (like nodepool today)21:07
*** ijw has joined #openstack-infra21:07
clarkbpabelanger: or have it if else since its an erb based on whether or not you want split daemon or all in one21:07
*** Guest92 has quit IRC21:08
pabelangerclarkb: Ya, we could do that, but I don't think the split is long lived?21:10
*** dprince has quit IRC21:10
clarkbit probably won't be, I just think thats a simpler change21:11
jeblairthomastaylor312: i don't think line 13 actually uses line 3.  instead, line 14 pulls in line 31.  when i run that yaml through jjb, 'foo' doesn't show up in the output at all (the CLEAN_UP parameter is the only one that appears)21:11
*** amitgandhinz has joined #openstack-infra21:11
*** eharney has quit IRC21:12
vsaienkodevstack-gate core please help to merge https://review.openstack.org/#/c/364830/ and https://review.openstack.org/#/c/368611/ patches that are needed for ironic multinode job.21:12
*** ijw has quit IRC21:12
*** BobBall has joined #openstack-infra21:12
*** thomastaylor312 has quit IRC21:13
*** ociuhandu has joined #openstack-infra21:13
*** BobBall is now known as Guest6085521:13
clarkbvsaienko: its really hard to make sure that any of that works right now because all multinode with neutron is pretty broken21:13
*** rhallisey has quit IRC21:13
*** mixos has quit IRC21:13
*** yamamoto has quit IRC21:14
*** ldnunes has quit IRC21:15
*** tiswanso has quit IRC21:15
*** fguillot has quit IRC21:15
*** tuannguyen has quit IRC21:17
*** Guest60855 has quit IRC21:17
jeblairif thomastaylor312 shows up again, i would say this: a simplified version of the example you gave produces this output: http://paste.openstack.org/show/584562/  which doesn't have foo, only cleanup.  if the goal is to say "i want the job to have these two parameters" then i believe the way to do that would be http://paste.openstack.org/show/584565/ which produces http://paste.openstack.org/show/584563/ as output21:19
*** ociuhandu has quit IRC21:22
openstackgerritPaul Belanger proposed openstack-infra/puppet-nodepool: Add nodepool-(builder|deleter) services  https://review.openstack.org/38262621:23
jlvillalIs there a way to see a log or something when get the error message in Gerrit: Merge Failed. This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.21:24
* jlvillal has quite the dependency tree and struggling to figure out which patch is causing the issue :(21:24
*** ddieterly[away] is now known as ddieterly21:25
clarkbjlvillal: if gerrit fails to merge you can hover over the red can't merge text in gerrit ui to get a longer description. However that looks like zuul reporting21:25
clarkbjlvillal: have a link to the chagne?21:25
jlvillalclarkb: Yeah I am seeing it here: https://review.openstack.org/#/c/368173/21:25
jlvillalIt does say Jenkins21:25
clarkbya so thats zuul, and thats the info you get21:25
*** amitgandhinz has quit IRC21:26
*** thorst_ has quit IRC21:26
clarkbjlvillal: you likely have a cycle in your dep list21:26
openstackgerritJulie Pichon proposed openstack-infra/project-config: Link puppet-tripleo gerrit to tripleo launchpad  https://review.openstack.org/38266321:26
jlvillalclarkb: Can that be improved?21:26
jlvillalTo provide an error message?21:26
*** amitgandhinz has joined #openstack-infra21:26
clarkbjlvillal: I am not sure, jeblair would know best21:26
*** thorst_ has joined #openstack-infra21:26
jlvillalclarkb: Thanks. I'll keep plugging away at it.21:27
jeblairjlvillal: probably, but it's not trivial, so not likely in a short timeframe21:27
jlvillaljeblair: :(  So no log file. Or place I can telnet to in order to see messages.21:27
openstackgerritPaul Belanger proposed openstack-infra/puppet-nodepool: Add nodepool-(builder|deleter) services  https://review.openstack.org/38262621:27
openstackgerritPaul Belanger proposed openstack-infra/puppet-openstackci: Add split daemon support for nodepool  https://review.openstack.org/38266421:27
anteayajlvillal: you have 6 patches that 368173 depends on21:28
*** marst has quit IRC21:28
anteayaI don't think I've seen that many depends on before21:28
jeblairjlvillal: if you give me a few mins, i may be able to pull logs from the mergers which may provide a clue21:28
jlvillalanteaya: Yeah. It is a big patch chain for our multi-node stuff :(21:28
jlvillaljeblair: Thanks!21:28
openstackgerritPaul Belanger proposed openstack-infra/system-config: Add split daemon support for nodepool  https://review.openstack.org/38266521:29
jeblairi think this is cool, and i definately want to support it; seeing how this fails ux is useful feedback21:29
anteayait is dependant on two different devstack patches, as well as two different devstack-gate patches21:29
pabelangerclarkb: jeblair: https://review.openstack.org/#/q/topic:nodepool-split should be what we need21:29
jeblairjlvillal, anteaya: as an aside, i think we generally suggest that third-party cis avoid reporting merge failures, yeah?21:30
anteayajeblair: we do suggest that yes21:30
anteayajeblair: where do you see one doing so?21:30
jlvillaljeblair: anteaya: Thanks I will tell krtaylor. He is our point-person on 3rd Party CI for Ironic21:31
pabelangernow, I prepare for combat... heading to costco21:31
anteayajlvillal: if you like21:31
clarkbpabelanger: eat lots of samples21:31
jeblairanteaya: on the change jlvillal linked; ufcg oneview21:31
*** thorst_ has quit IRC21:31
jlvillalpabelanger: /me is a fan of Costco :)21:31
*** vsaienko has quit IRC21:32
anteayajeblair: I see the same, thanks21:32
jeblairneat, zm03 seems to be awol21:32
anteayathat helps21:32
*** adrian_otto has quit IRC21:33
*** jpich has quit IRC21:33
*** adrian_otto has joined #openstack-infra21:34
*** caphrim__ has quit IRC21:34
*** matt-borland has quit IRC21:35
*** vsaienko has joined #openstack-infra21:35
clarkbpabelanger: jeblair that stack to set up the additional daemons lgtm21:35
*** jcoufal_ is now known as jcoufal21:36
*** amitgandhinz has quit IRC21:38
jeblairjlvillal: http://paste.openstack.org/show/584567/21:38
jeblairjlvillal: it looks like the culprit is 38236021:38
jlvillaljeblair: Thank you! :)21:38
*** mriedem has quit IRC21:38
jlvillaljeblair: I will dig into it. I appreciate the help.21:39
*** smarcet1981 has quit IRC21:39
*** bnemec has quit IRC21:39
jlvillaljeblair: RFE. Something like that gets posted with the error :)21:39
jeblairjlvillal: np.  i'm guessing something valuely like like "Successfully merged 379543, 379543, ....  Unable to merge 382360 because: 'error: Merge requires file-level merging; ERROR: content conflict in devstack/lib/ironic'"  would fit the bill?21:40
jlvillaljeblair: That would be awesome :)21:41
jeblairjlvillal: cool.  i think it will be possible :)21:41
jlvillal:)21:41
*** kaisers has quit IRC21:42
openstackgerritJames E. Blair proposed openstack-infra/zuul: Forward-port v2.5 Ansible launcher improvements  https://review.openstack.org/38266821:42
*** yamamoto has joined #openstack-infra21:42
*** tiswanso has joined #openstack-infra21:43
*** jkilpatr has joined #openstack-infra21:43
*** xyang1 has quit IRC21:44
*** drifterza has quit IRC21:45
*** akshai has quit IRC21:46
jeblairDear Openstack Project Creator,21:46
*** mtanino has joined #openstack-infra21:46
clarkbjeblair: :)21:46
jeblairso is that spam because someone harvested addresses from gerrit, or git?21:46
jrollis that the berlin conference spam?21:47
clarkbI'm not sure. I didn't get an email (my primary gerrit email addr != my git addr for raisins)21:47
*** tiswanso has quit IRC21:47
jeblairi got 521:47
jeblairpersonally addressed21:47
*** ddieterly is now known as ddieterly[away]21:47
clarkbmaybe my spam filters caught them all21:47
anteayaI don't think I got that spam21:47
jrollI replied unsubscribe to all 3, hope it helps get the point across21:47
jeblairjroll: yeah, berlin21:48
jlvillalI got two invites to Berlin from Huawei :)21:48
*** narayrak has quit IRC21:48
*** marst has joined #openstack-infra21:48
jeblairi got two of them to an email address that is listed twice in my gerrit identities21:49
anteayaI must not be on huawei's spam list, yay21:49
jeblairi wonder if it's a list pulled from gerrit and not de-duped21:49
anteayaI did make a fuss when swift spammed me, maybe other folks were listening :)21:50
lin_yangDear infra team, after the new project "rsc" created, how could we have the first core for it? admin can manually add the first one? thanks, appreciate any suggests21:52
*** yamamoto has quit IRC21:52
*** jheroux has quit IRC21:52
anteayalin_yang: can you post the url of the patch that created the project please?21:52
*** rhe00 has left #openstack-infra21:52
lin_yanghttps://review.openstack.org/#/c/341966/21:53
*** edmondsw has quit IRC21:53
anteayawhen a gerrit admin has a moment could they add https://review.openstack.org/#/q/owner:%22Ananth+Narayan+S+%253Cananth.narayan%2540gmail.com%253E%22 to these two groups please? https://review.openstack.org/#/admin/groups/?filter=rsc21:54
anteayalin_yang: once Ananth is added that person can add others to the core group21:55
* clarkb does this21:55
anteayathanks clarkb21:55
clarkbdone21:56
lin_yanganteaya: yes, please. really appreciate!21:56
anteayathank you clarkb21:56
anteayalin_yang: you should be good now21:56
lin_yangclarkb: thank you very munch21:56
*** spzala has quit IRC21:57
*** ddieterly[away] is now known as ddieterly21:58
*** BobBall has joined #openstack-infra22:01
*** BobBall is now known as Guest553322:01
*** adrian_otto has quit IRC22:02
*** jcoufal has quit IRC22:03
*** adrian_otto has joined #openstack-infra22:03
*** adriant has joined #openstack-infra22:03
patrickeastclarkb: word on the street is you maybe know about some relatively recent issue with ssh and nodepool images?22:04
*** Apoorva_ has joined #openstack-infra22:04
patrickeastmine stopped generating ssh host keys at some point and nodepool can't reach em :*(22:05
clarkbthats new to me22:05
clarkbpatrickeast: how are you building the images?22:05
patrickeastyea, not sure what happened my dib config is the same as it has been but images now need a dpkg reconfigure for openssh22:05
*** vsaienko has quit IRC22:06
patrickeastclarkb: its almost exactly the same as the upstream ubuntu dib config, i add a little extra sauce to set them up for multipathing and stuff but otherwise pretty much the same22:06
clarkbpatrickeast: pabelanger has done recent work to make ssh more reliable on startup. I wonder if it broke for something22:06
clarkbpabelanger: so you use ubuntu-minimal and simple-init elements?22:06
clarkber patrickeast ^22:06
clarkband what release of ubuntu are you seeing that on?22:07
*** zul has quit IRC22:07
*** mixos has joined #openstack-infra22:07
*** mdrabe has quit IRC22:07
patrickeastclarkb: yep, both trusty and xenial images22:07
clarkbok thats really weird because we were seeing very different behavior between xenial and trusty iirc.22:07
patrickeasthttp://paste.openstack.org/show/584577/22:07
clarkbso I wonder if your glean updated but your dib didn't22:08
clarkbhow old is your dib install?22:08
patrickeastoo good question22:08
* patrickeast checks22:08
*** Apoorva has quit IRC22:08
*** ijw has joined #openstack-infra22:08
anteayaclarkb: oh sorry I had thought you were dealing with an ssh issue22:08
anteayamy fault patrickeast22:08
patrickeastlooks like diskimage-builder==1.18.222:09
patrickeastclarkb: ^22:09
patrickeastanteaya: no worries :D22:09
*** tphummel has quit IRC22:10
*** mixos has quit IRC22:11
*** jamesdenton has quit IRC22:12
clarkbpatrickeast: looks like 1.20 is current, you might try updating to that22:12
clarkbpatrickeast: I think we moved some of the ssh host key handling logic from glean into simple-init22:12
*** gordc has quit IRC22:12
patrickeastclarkb: ok cool, i'll give that a shot and poke around git histories to see if anything stands out22:13
patrickeastclarkb: thanks for the help!22:13
*** ijw has quit IRC22:13
*** tpsilva has quit IRC22:14
*** esberglu has quit IRC22:15
*** Guest92 has joined #openstack-infra22:18
*** Guest5533 has quit IRC22:18
*** adrian_otto has quit IRC22:19
*** Guest92 has quit IRC22:21
*** yamamoto has joined #openstack-infra22:21
*** Guest92 has joined #openstack-infra22:22
*** kaisers has joined #openstack-infra22:24
*** spzala has joined #openstack-infra22:27
*** adrian_otto has joined #openstack-infra22:28
*** kaisers has quit IRC22:28
*** adrian_otto has quit IRC22:29
*** rbrndt has quit IRC22:29
*** ddieterly has quit IRC22:29
*** yamamoto has quit IRC22:30
*** thomastaylor312 has joined #openstack-infra22:30
Sukhdevanteaya : ping22:32
anteayaSukhdev: hello22:32
anteayahow are you doing?22:32
anteayawe haven't chatted in a while22:32
SukhdevI am well - and, you?22:32
anteayagood thanks22:32
*** spzala has quit IRC22:32
Sukhdevanteaya : will see you in Barcelona22:32
anteayano, I have to stay at home22:32
thomastaylor312jeblair: Hey, thanks for the help! That is much more clear now22:33
Sukhdevanteaya : oh...really22:33
anteayabeen at home for two whole months now, I needed that22:33
anteayaSukhdev: yeah, I will miss seeing you22:33
anteayabut I had to tend to things at home for a bit22:33
*** burgerk has quit IRC22:33
Sukhdevhome take priority22:33
*** BobBall_ has joined #openstack-infra22:33
anteayait does so22:33
*** gyee has joined #openstack-infra22:33
Sukhdevanteaya : need a favor from you22:34
anteayaI will listen22:34
* anteaya listens22:34
SukhdevArista CI should be good now - can you see if it is enabled from the other side22:34
jlvillaljeblair: On the merge error message.  Maybe also say which revision was merged/failed.  "Successfully merged 379543/4, 379543/8, ....  Unable to merge 382360/2 because: 'error: Merge requires file-level merging; ERROR: content conflict in devstack/lib/ironic'22:34
anteayait wouldn't be since this is the first request I have seen to turn in on22:34
jlvillaljeblair: Or something like that.22:35
anteayaSukhdev: would be able to post to the -announce mailing list asking it be turned on?22:35
anteayaSukhdev: helps to keep the history in order22:35
Sukhdevanteaya : should I send it to openstack-dev list or infra?22:36
pabelangerpatrickeast: clarkb: yes, 1.20.0 should have the updated elements22:36
anteayaSukhdev: the third party announce mailing list22:37
anteayaSukhdev: are you subscribed to that?22:37
patrickeastpabelanger: awesome22:37
Sukhdevanteaya : I do not believe so - can you give me exact email address? I will shoot the email right away22:37
anteayaSukhdev: http://lists.openstack.org/pipermail/third-party-announce/2016-September/000307.html22:37
anteayait is okay, I'll post to the thread22:38
anteayayou subscrive to the list, please22:38
anteayasubscribe22:38
anteayaSukhdev: http://lists.openstack.org/cgi-bin/mailman/listinfo/third-party-announce22:38
*** amitgandhinz has joined #openstack-infra22:38
Sukhdevanteaya : I will do subscribe right now - also, I am going to reply to that email to request to enable22:39
anteayaokay thanks22:39
*** cardeois has quit IRC22:40
*** BobBall_ has quit IRC22:40
*** gouthamr has quit IRC22:41
anteayainfra root I never got a gerrit account id for Arista CI since it was using the same email address as Arista Testing22:41
anteayawould someone be available to help detangle?22:41
clarkbhow was it disabled? using the email address?22:42
anteayaat this point I would encourage Sukhdev to choose enabling Arista CI and leaving Arista Testing disabled until it has its own email address22:42
*** hamzy has quit IRC22:42
anteayaclarkb: not sure, checking the channel logs22:42
clarkbor fix the email addresses before anything else? Or I guesswe have to enable accounts to edit email addrs22:42
Sukhdevanteaya : Arista CI has its own email address - your comment confused me22:43
*** amitgandhinz has quit IRC22:43
anteayaSukhdev: well in our db one email address was used for both22:44
openstackgerritMerged openstack-infra/devstack-gate: Enable tls-proxy on subnode if enabled on primary  https://review.openstack.org/38257722:44
anteayaclarkb: my email went out Sept 16 but the logs for sept 16 don't have any matches for arista: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-09-16.log.html22:44
anteayanow I'm confused22:44
pabelangerianw: on 380577 did you want me to update the current review with reno or is follow up good?22:44
anteayasorry 16 is the year22:45
*** aviau has quit IRC22:45
*** tuannguyen has joined #openstack-infra22:45
*** aviau has joined #openstack-infra22:45
*** kzaitsev_mb has quit IRC22:45
anteayaclarkb: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-09-13.log.html#t2016-09-13T14:55:4622:45
clarkbanteaya: perhaps utc vs local time offset conflicts?22:45
anteayaI was reading it as sept 16 it was sept 13 201622:46
anteayaclarkb: there are the gerrit ids: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-09-13.log.html#t2016-09-13T15:01:3622:46
clarkband we want to enable both so the email addrs can be fixed?22:47
anteayaSukhdev: what do you want to have happen here?22:47
anteayawe have two gerrit ids that have the same email address22:48
*** esberglu has joined #openstack-infra22:48
anteayaSukhdev: Arista CI and Arista Testing both have the same email address in our gerrit db22:48
Sukhdevanteaya : I am bit confused as well22:48
*** esberglu has quit IRC22:48
anteayaokay22:48
anteayawhat is the goal?22:48
Sukhdevanteaya : what email address do you see? Is it arista-openstack-test@arista.com?22:48
anteayacan we start there?22:49
*** BobBall_ has joined #openstack-infra22:49
Sukhdevanteaya : I would like this to be enabled so that we can start to test the patches like we used to -22:49
Sukhdevanteaya : as to the testing, we only post +1 and never -122:49
anteayathis == Arista CI, correct?22:49
Sukhdevyes22:50
*** vhosakot has quit IRC22:50
anteayaclarkb: can you please re-enable 9845?22:50
clarkbsure22:51
anteayaSukhdev: you also have an account entitled Arista Testing, what would you like done with that? it is currently disabled22:51
anteayaclarkb: thank you22:51
clarkbdone22:51
anteayaclarkb: thank you22:51
Sukhdevanteaya : let me check the config - give me a sec22:51
anteayaSukhdev: standing by22:52
anteayaclarkb: can you tell me what email is associated with Arista Testing 9877 in the gerrit db?22:52
Sukhdevanteaya : I see Arista-CI22:53
anteayaSukhdev: okay so you don't need Arista Testing re-enabled, is what I am hearing22:53
clarkbanteaya: arista-openstack-test@aristanetworks.com22:53
anteayaclarkb: thank you22:53
Sukhdevclarkb : that is correct email address22:54
anteayaSukhdev: well the problem is two accounts were using it22:54
*** BobBall_ has quit IRC22:54
anteayaso do you need Arista Testing re-enabled?22:54
ianwpabelanger: oh, we can add something later22:54
anteayaif not, we leave Arista Testing disabled and we can be almost done here22:55
Sukhdevanteaya : I see no downside to it, might as well22:55
anteayaSukhdev: might as well what?22:55
anteayaI asked a yes or no question22:55
Sukhdevanteaya : actually leave it disabled. Let me test22:55
anteayaSukhdev: okay thank you22:55
SukhdevLet me check if Arista-CI enabling takes care of it - if not, then I will ping you back22:55
anteayaSukhdev: okay if you do please bring the link to this log with you22:56
anteayaclarkb: thank you22:56
zaropleia2: would you mind taking a look?22:56
zaropleia2: https://review.openstack.org/#/c/366348/22:56
anteayaSukhdev: I do'n t see an email from you22:56
anteayaSukhdev: I can email to the thread and take care of the update22:56
Sukhdevanteaya : I typed the email and switched here - let me go push send on the email22:57
*** yamahata has quit IRC22:57
jeblairthomastaylor312: glad to help -- did you see this comment? a simplified version of the example you gave produces this output: http://paste.openstack.org/show/584562/ which doesn't have foo, only cleanup.  if the goal is to say "i want the job to have these two parameters" then i believe the way to do that would be http://paste.openstack.org/show/584565/ which produces http://paste.openstack.org/show/584563/ as output22:57
anteayaSukhdev: okay22:57
Sukhdevanteaya : one QQ how do I save the link to this log, if I need to refer back to it?22:57
pabelangerianw: okay cool, I'll get that up for the morning. We can then talk about tagging a release, then I'll update nodepool to use the checksum files22:58
anteayaSukhdev: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-10-05.log.html#t2016-10-05T22:34:0322:58
*** gildub has joined #openstack-infra22:59
Sukhdevanteaya : perfect - thanks22:59
anteayaSukhdev: thank you22:59
* anteaya awaits Sukhdev's email so that she can approve it and reply22:59
ianwpabelanger: ok, we've probably got enough there for a release, i'll take a look today ... i was just seeing if greghaynes had anything to say really22:59
*** yamamoto has joined #openstack-infra22:59
thomastaylor312jeblair: Yes I did :)23:00
greghaynesianw: hrm?23:00
pabelangerianw: could also use a review on https://review.openstack.org/#/c/378985/ too23:00
pabelangerianw: an update to runtime-ssh-host-keys elements23:00
ianwgreghaynes: if you have any opinion on the checksums in 38057723:00
greghayneshrmmm, I have a minor suggestion that maybe we make that optional and off?23:01
greghaynesIve heard grumps about dib creating all sorts of random files in the past23:02
*** yamamoto has quit IRC23:02
*** yamamoto has joined #openstack-infra23:02
pleia2zaro: lgtm23:02
clarkbthere is probably a speed component to that too23:02
greghaynesclarkb: ah right23:03
Sukhdevanteaya : I am back with a question (as I am not able to send an email ) -23:04
anteayaSukhdev: I'm listening23:04
ianwgreghaynes: i did consider that in my comment, i came down on leaving it on for reasons there23:04
greghaynesah, woops23:04
Sukhdevanteaya : I see this thread, but, am not able to respond to it http://lists.openstack.org/pipermail/third-party-announce/2016-September/000307.html23:04
SukhdevI tried searching for this orginal message on the ML, and can't seem to find it - what am I missing?23:05
anteayait is its own mailing list23:05
anteayathe mailing list is called third party announce23:05
*** yamahata has joined #openstack-infra23:05
anteayajust subscribe to it right now23:05
anteayaand let me take care of the rest23:06
anteayaokay?23:06
*** Apoorva_ has quit IRC23:06
Sukhdevah ha - I found it - replying to it now23:06
greghaynesianw: the perf thing does really irk me though now that I realize its an issue - given that this is the first time the feature has been requested I'd wager this is something most folks dont want so not crazy about a perf hit to everyone23:06
greghaynes(working on some caching fixes so builds can get much faster is something I really want and it kind of undoes that work)23:07
*** Apoorva has joined #openstack-infra23:07
*** salv-orl_ has quit IRC23:07
ianwgreghaynes: i don't feel strongly, my reasoning was just that if you're publishing a large image, it's probably going to make sense to publish checksums with it, so any consumer can verify they got the right thing23:08
Sukhdevanteaya : done - you should see the email now23:08
*** Teresita-Warrior has quit IRC23:08
*** jamielennox is now known as jamielennox|away23:09
Sukhdevanteaya : and I also subscribed to the list23:09
*** ddieterly has joined #openstack-infra23:09
Sukhdevanteaya : thanks for all your helo23:09
Sukhdevhelp23:09
*** ddieterly has quit IRC23:09
*** ijw has joined #openstack-infra23:10
anteayayou're welcome23:10
Sukhdevanteaya : I sent the email and received an email back saying the message is held until moderator can review it for approval23:11
anteayaSukhdev: I just approved it23:11
Sukhdevanteaya : ah cool - thanks - so, you see the email then23:11
*** hongbin has quit IRC23:12
anteayawell it takes a minute to land in my inbox, but I read it in the system prior to approving23:12
anteayaso thank you23:12
*** tuannguyen has quit IRC23:12
greghaynespabelanger: ianw Either way, at a minimum I think we need a flag to turn checksums on or off. I have a slight preference for off by default but I could kind of go either way as well so writer's choice?23:12
*** bramwelt has joined #openstack-infra23:14
ianwi was happy to see that added if anyone pipes up they want it, in the interests of KISS.  but whatever makes everyone happy :)23:14
greghaynesYea I like my super speedy builds so i'll be the grump on that23:15
*** ijw has quit IRC23:15
pabelangerjeblair: clarkb: are we good to add a --checksum flag on our DIB cmd in nodepool, to generate checksum files or do you prefer we generate them by default and have --no-checksums?23:16
*** tuannguyen has joined #openstack-infra23:16
*** sdague has quit IRC23:17
greghaynesadding args in the builder should be pretty trivial23:17
*** Sukhdev has quit IRC23:17
greghaynesespecially if we want it always on23:17
*** pradk has quit IRC23:18
nibalizerjeblair: mordred looks like all the pansible stuff got in, so woot23:19
*** thomastaylor312 has quit IRC23:19
*** Sukhdev has joined #openstack-infra23:19
clarkbya I am ok adding args to nodepool's dib calls23:20
*** yamamoto has quit IRC23:20
*** markvoelker has quit IRC23:22
anteayaso pansible23:23
anteayaobviously it is a puppet ansible thing23:23
anteayahow is it different from our other puppet ansible things?23:24
anteayaor are they all pansible?23:24
sdakehey folks - questio nabout  a repo rename23:25
sdakeone of our merry band wants to know if the option to rename kolla-kubernetes to something else is on the table23:25
sdakewithout having to create a new project and use the upstream tag to import the repo and then deprecate the old repository23:26
clarkbanteaya: the big change is taht we are now testing our puppet changes with ansible too, so we can cross test them23:26
anteayaclarkb: ah thank you23:26
clarkbsdake: typically we would just rename it rather than do a copy so that all review history is preserved23:26
clarkbanteaya: but hopefully this way we get fewer surprises that ansible running puppet is broken23:27
sdakeclarkb that would rock - but i thought renmaes were stopped?23:27
clarkbsdake: no, they just have to be scheduled23:27
sdakeclarkb nice23:27
sdakeclarkb how often are they typcially done?23:27
anteayaclarkb: fewer surprises would be nice23:27
clarkbsdake: we seem to do them about once a month or so23:27
*** logan- has quit IRC23:28
sdakeclarkb cool thanks for the info23:28
*** tiswanso has joined #openstack-infra23:28
*** tiswanso has quit IRC23:28
*** tiswanso has joined #openstack-infra23:29
clarkbyou'll need to sign them up for a rename on the infra meeting agenda, and push a change that reflects the state you want and set it to WIP23:29
*** dingyichen has joined #openstack-infra23:29
* clarkb also wonders why everyone needs to rename so often23:29
anteayathey are like shoes, some folks just need to have a lot of shoes23:30
anteayaI have no idea why either23:30
*** gyee has quit IRC23:31
*** jamesdenton has joined #openstack-infra23:35
openstackgerritKhai Do proposed openstack-infra/system-config: Set a timeout for idle ssh connections  https://review.openstack.org/38268723:35
zaroclarkb, fungi : might be a contributor to gerrit memory leak ^23:35
openstackgerritPaul Belanger proposed openstack/diskimage-builder: Create (md5|sha256) checksum files for images  https://review.openstack.org/38057723:35
*** logan- has joined #openstack-infra23:37
anteayazaro: nice one23:37
pabelangergreghaynes: ianw: just testing --checksum flag now ^23:38
*** amitgandhinz has joined #openstack-infra23:39
clarkbzaro: is 2.11.4 the branch we are on now and 2.11.9 is what we want to upgrade to right?23:40
zaroyes, we are on 2.11.4.23:41
zaroyes, if we want to upgrade 2.11 line then 2.11.9 would be the next one to upgrade to23:42
zaroi've been keeping 2.11.9 updated with the same backports as i've been putting on 2.11.423:42
*** EricGonczer_ has joined #openstack-infra23:42
clarkbcool, stack lgtm23:43
*** amitgandhinz has quit IRC23:44
zaroclarkb: then there's the special build (on 2.11.4) which contains the possible memory leak fix from https://groups.google.com/d/msg/repo-discuss/oj3h3JdioGs/_pNKjlUGBAAJ23:44
*** tiswanso has quit IRC23:44
*** hamzy has joined #openstack-infra23:44
*** Swami has quit IRC23:46
*** david-lyle has quit IRC23:47
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - Test Undercloud upgrade mitaka -> newton  https://review.openstack.org/38130923:48
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Undercloud upgrade for mitaka and newton  https://review.openstack.org/38128623:48
*** sdake has quit IRC23:48
openstackgerritSpencer Krum proposed openstack-infra/system-config: DNM: Upgrade puppetdb to 3.2.latest  https://review.openstack.org/37423423:50
*** mriedem has joined #openstack-infra23:50
openstackgerritMerged openstack-infra/system-config: upgrade Gerrit's javamelody plugin on review-dev.o.o  https://review.openstack.org/36634823:51
openstackgerritPaul Belanger proposed openstack-infra/project-config: Have diskimage-builder generate checksum files  https://review.openstack.org/38269023:51
*** megm_ has quit IRC23:51
*** megm has joined #openstack-infra23:54
*** EricGonc_ has joined #openstack-infra23:56
*** EricGonczer_ has quit IRC23:56
*** gouthamr has joined #openstack-infra23:56
*** jamesdenton has quit IRC23:58
*** jamesden_ has joined #openstack-infra23:58
jeblairpabelanger, clarkb: +2 382626, but i'm about to afk so did not +323:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!