Tuesday, 2016-08-30

*** dingyichen has joined #openstack-infra00:00
*** _nadya_ has quit IRC00:03
*** gouthamr_ has joined #openstack-infra00:04
*** esberglu has joined #openstack-infra00:06
*** zhurong has quit IRC00:07
*** gouthamr has quit IRC00:08
amrithmtreinish, ping00:08
mtreinishamrith: pong00:09
amrithmtreinish, once I get https://review.openstack.org/#/c/362203/ straightened out, I'll need some consulting time with the master to get the infra changes for the testing.00:09
*** woodster_ has quit IRC00:09
amrithsince we've split the tests out, I'd like to add infra jobs to exercise the newly created individual tests.00:09
amrithwill send you a review for that for you to look over, please.00:10
amriths/^will/I will/00:10
openstackgerritMerged openstack-infra/subunit2sql: Remove discover from test-requirements  https://review.openstack.org/34580800:10
mtreinishamrith: sure, I can give you a hand with that. You'll likely just need to add a job for the functional tests to: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/trove.yaml to call the new tox target00:10
amrithyes, that's what I thought but wasn't completely sure00:10
amrithI'll get the change up for review and ping you if you don't mind.00:11
amriththanks!00:11
*** onovy has quit IRC00:11
*** tphummel has quit IRC00:12
*** fguillot_ has joined #openstack-infra00:12
*** onovy has joined #openstack-infra00:13
*** sflanigan has joined #openstack-infra00:13
*** sflanigan has joined #openstack-infra00:13
*** sdake has joined #openstack-infra00:14
*** mtanino has quit IRC00:16
*** sarob has quit IRC00:16
*** Swami has quit IRC00:20
*** thcipriani is now known as thcipriani|afk00:23
*** thorst has quit IRC00:23
*** gildub has joined #openstack-infra00:24
*** thorst has joined #openstack-infra00:24
*** spzala has quit IRC00:25
*** spzala has joined #openstack-infra00:25
openstackgerritCraige McWhirter proposed openstack-infra/puppet-phabricator: Configure HTTPD and HTTPS certificates  https://review.openstack.org/35037000:26
*** pvaneck has quit IRC00:27
*** Apoorva has quit IRC00:27
openstackgerritMerged openstack-infra/devstack-gate: set up stable/newton  https://review.openstack.org/36243500:29
*** spzala has quit IRC00:30
*** cody-somerville has quit IRC00:31
*** cody-somerville has joined #openstack-infra00:31
*** thorst has quit IRC00:32
*** camunoz has quit IRC00:32
*** pt_15 has quit IRC00:36
*** shashank_hegde has quit IRC00:44
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Implement scenari001, 002 and 003  https://review.openstack.org/36250400:44
*** camunoz has joined #openstack-infra00:45
*** javeriak has joined #openstack-infra00:47
*** javeriak has quit IRC00:55
*** edtubill has joined #openstack-infra00:57
*** JerryOpenix has joined #openstack-infra00:59
*** camunoz has quit IRC00:59
*** vhosakot has joined #openstack-infra01:00
*** camunoz has joined #openstack-infra01:12
*** zhurong has joined #openstack-infra01:12
*** yanyanhu has joined #openstack-infra01:13
*** kaisers_ has quit IRC01:14
*** gyee has quit IRC01:14
*** sdake has quit IRC01:14
*** yamamoto has quit IRC01:15
*** kzaitsev1mb has joined #openstack-infra01:16
*** thorst has joined #openstack-infra01:17
*** thorst has quit IRC01:17
*** cody-somerville has quit IRC01:17
*** kzaitsev_mb has quit IRC01:17
*** edtubill has quit IRC01:17
*** thorst has joined #openstack-infra01:17
*** changzhi has joined #openstack-infra01:19
*** sdake has joined #openstack-infra01:21
*** yamamoto has joined #openstack-infra01:21
*** gongysh has joined #openstack-infra01:23
*** vhosakot has quit IRC01:25
*** vhosakot_ has joined #openstack-infra01:25
*** thorst has quit IRC01:26
*** mriedem_afk has quit IRC01:29
*** changzhi has quit IRC01:32
*** ociuhandu has joined #openstack-infra01:32
*** changzhi has joined #openstack-infra01:32
*** salv-orlando has joined #openstack-infra01:32
*** ociuhandu has quit IRC01:34
*** chem has quit IRC01:37
*** caowei has joined #openstack-infra01:37
*** signed8b_ has quit IRC01:39
*** kzaitsev1mb has quit IRC01:39
*** shashank_hegde has joined #openstack-infra01:40
*** amotoki has joined #openstack-infra01:42
*** vhosakot_ has quit IRC01:43
*** salv-orlando has quit IRC01:43
*** vhosakot has joined #openstack-infra01:43
mtreinishfungi, mordred: with https://github.com/mtreinish/lpmqtt/commit/2c8c3fd1d258c2adde00daa5a9d697f7d6325d37 it actually works now01:44
*** amotoki has quit IRC01:46
*** rfolco has quit IRC01:47
*** Sukhdev has joined #openstack-infra01:48
*** cody-somerville has joined #openstack-infra01:48
*** vhosakot_ has joined #openstack-infra01:52
*** vhosakot has quit IRC01:52
*** changzhi has quit IRC01:53
*** spzala has joined #openstack-infra02:01
*** javeriak has joined #openstack-infra02:02
*** zshuo has joined #openstack-infra02:02
*** jcoufal has quit IRC02:04
*** yamamoto has quit IRC02:05
*** javeriak has quit IRC02:06
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Implement scenari001, 002 and 003  https://review.openstack.org/36250402:08
*** gongysh has quit IRC02:11
*** spzala has quit IRC02:12
*** tqtran has quit IRC02:15
*** thorst has joined #openstack-infra02:24
*** gouthamr_ has quit IRC02:30
*** Benj_ has joined #openstack-infra02:30
*** thorst has quit IRC02:31
*** amotoki has joined #openstack-infra02:31
*** Sukhdev has quit IRC02:32
*** fguillot_ has quit IRC02:34
*** Benj_ has quit IRC02:36
*** Sukhdev has joined #openstack-infra02:37
*** Sukhdev has quit IRC02:42
*** jcoufal has joined #openstack-infra02:45
*** armax has quit IRC02:46
*** hongbin has joined #openstack-infra02:48
*** ociuhandu has joined #openstack-infra02:53
*** gluytium has quit IRC02:55
fungimtreinish: haven't looked at it yet, but thinking back to the earlier discussion, wouldn't pop3 make more sense than imap? we really just need to retrieve the message and then discard it, no need to retain messages indefinitely right?02:57
*** gluytium has joined #openstack-infra02:58
*** amotoki has quit IRC02:58
fungianyway, heading to bed. maybe i'll have time to look between meetings tomorrow02:58
*** amotoki has joined #openstack-infra03:00
*** kaisers_ has joined #openstack-infra03:02
*** hyakuhei has quit IRC03:04
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Add a wiki-dev.o.o server to test newer mediawiki  https://review.openstack.org/35824603:05
*** kzaitsev_mb has joined #openstack-infra03:05
*** yamamoto has joined #openstack-infra03:05
*** jamespage has quit IRC03:06
*** gnuoy has quit IRC03:06
*** ociuhandu has quit IRC03:07
*** daemontool has quit IRC03:07
*** kaisers_ has quit IRC03:08
*** gnuoy has joined #openstack-infra03:09
*** amotoki has quit IRC03:09
*** roxanagh_ has joined #openstack-infra03:09
*** yamamoto has quit IRC03:10
*** kzaitsev_mb has quit IRC03:10
*** daemontool has joined #openstack-infra03:11
*** yamahata has quit IRC03:13
*** tqtran has joined #openstack-infra03:13
*** nwkarsten has joined #openstack-infra03:14
*** tqtran has quit IRC03:18
*** baoli_ has quit IRC03:19
*** hyakuhei has joined #openstack-infra03:19
*** baoli has joined #openstack-infra03:19
*** tonytan_brb has quit IRC03:21
*** _nadya_ has joined #openstack-infra03:23
*** _nadya_ has quit IRC03:27
*** thorst has joined #openstack-infra03:30
*** esberglu has quit IRC03:33
openstackgerritMerged openstack-infra/jenkins-job-builder: Convert jclouds example to unit test  https://review.openstack.org/30955503:33
*** thorst has quit IRC03:36
*** yamamoto has joined #openstack-infra03:39
*** vikrant has joined #openstack-infra03:40
*** jcoufal has quit IRC03:41
openstackgerritThanh Ha proposed openstack-infra/jenkins-job-builder: Test stream no encoding bug  https://review.openstack.org/31219703:43
openstackgerritMerged openstack-infra/jenkins-job-builder: Add missing parameter ZUUL_VOTING to zuul style jobs  https://review.openstack.org/32757703:45
*** yamamoto has quit IRC03:45
*** salv-orlando has joined #openstack-infra03:45
*** baoli has quit IRC03:48
openstackgerritMerged openstack-infra/jenkins-job-builder: Remove discover from test-requirements  https://review.openstack.org/34579903:50
*** links has joined #openstack-infra03:51
*** zz_dimtruck is now known as dimtruck03:53
*** salv-orlando has quit IRC03:53
*** armax has joined #openstack-infra03:55
*** hongbin has quit IRC04:01
*** yamamoto has joined #openstack-infra04:04
*** kzaitsev_mb has joined #openstack-infra04:06
*** roxanag__ has joined #openstack-infra04:08
*** stewie925 has joined #openstack-infra04:08
*** roxanagh_ has quit IRC04:09
*** amotoki has joined #openstack-infra04:12
*** yamamoto has quit IRC04:18
*** tonytan4ever has joined #openstack-infra04:22
*** berendt has joined #openstack-infra04:25
*** tonytan4ever has quit IRC04:26
*** senk has joined #openstack-infra04:34
*** thorst has joined #openstack-infra04:35
*** yamamoto has joined #openstack-infra04:40
*** thorst has quit IRC04:41
*** salv-orlando has joined #openstack-infra04:41
*** psachin has joined #openstack-infra04:44
openstackgerritMerged openstack-infra/project-config: tell the release job where the LP credentials are  https://review.openstack.org/36248104:49
*** mhickey has joined #openstack-infra04:51
*** kaisers_ has joined #openstack-infra04:52
*** nwkarsten has quit IRC04:52
*** dimtruck is now known as zz_dimtruck04:53
*** nwkarsten has joined #openstack-infra04:53
*** zhurong has quit IRC04:54
openstackgerritMerged openstack-infra/project-config: [sahara] scenario jobs refactoring  https://review.openstack.org/36118504:55
*** kaisers_ has quit IRC04:57
*** nwkarsten has quit IRC04:58
*** yamamoto has quit IRC05:00
openstackgerritIan Wienand proposed openstack-infra/project-config: Switch in Fedora 24 devstack job  https://review.openstack.org/36260405:05
*** Sukhdev has joined #openstack-infra05:06
*** eranrom has quit IRC05:07
*** jaosorior has joined #openstack-infra05:10
*** kzaitsev_mb has quit IRC05:10
*** Sukhdev has quit IRC05:12
openstackgerritIan Wienand proposed openstack-infra/project-config: Add Fedora 24 non-voting puppet-apply job  https://review.openstack.org/36260705:13
*** lifeless_ is now known as lifeless05:15
openstackgerritIan Wienand proposed openstack-infra/project-config: Switch centos7 job to neutron  https://review.openstack.org/36260805:16
openstackgerritIan Wienand proposed openstack-infra/project-config: Add dib dsvm job into check queue  https://review.openstack.org/36261105:18
*** armax has quit IRC05:22
*** ilyashakhat has joined #openstack-infra05:27
*** zhurong has joined #openstack-infra05:30
*** thorst has joined #openstack-infra05:39
*** yamamoto has joined #openstack-infra05:41
*** armax has joined #openstack-infra05:46
*** thorst has quit IRC05:46
*** sdake has quit IRC05:47
*** sandanar has joined #openstack-infra05:47
*** sdake has joined #openstack-infra05:50
openstackgerritIan Wienand proposed openstack-infra/project-config: Add Fedora 24 non-voting puppet-apply job  https://review.openstack.org/36260705:50
openstackgerritIan Wienand proposed openstack-infra/project-config: Switch centos7 job to neutron  https://review.openstack.org/36260805:50
*** apetrich has quit IRC05:53
*** apetrich has joined #openstack-infra05:55
*** kaisers_ has joined #openstack-infra05:56
*** kzaitsev_mb has joined #openstack-infra06:06
*** Sukhdev has joined #openstack-infra06:06
*** andreas_s has joined #openstack-infra06:07
*** salv-orl_ has joined #openstack-infra06:08
*** salv-orlando has quit IRC06:11
*** kzaitsev_mb has quit IRC06:11
*** spiffxp has quit IRC06:12
*** spiffxp has joined #openstack-infra06:12
*** salv-orlando has joined #openstack-infra06:12
*** _ari_ has quit IRC06:14
*** ilyashakhat has quit IRC06:14
*** salv-orl_ has quit IRC06:17
*** salv-orlando has quit IRC06:17
*** esikachev has joined #openstack-infra06:18
*** rcernin has joined #openstack-infra06:19
*** _nadya_ has joined #openstack-infra06:19
*** ilyashakhat has joined #openstack-infra06:21
*** amotoki has quit IRC06:22
*** pgadiya has joined #openstack-infra06:25
*** pcaruana has joined #openstack-infra06:26
*** armax has quit IRC06:28
*** vhosakot_ has quit IRC06:31
*** florianf has joined #openstack-infra06:33
*** Na3iL has joined #openstack-infra06:35
*** ilyashakhat has quit IRC06:38
*** JerryOpenix has quit IRC06:40
*** sdake has quit IRC06:44
*** _nadya_ has quit IRC06:44
*** thorst has joined #openstack-infra06:44
*** amotoki has joined #openstack-infra06:46
*** ilyashakhat has joined #openstack-infra06:48
*** roxanag__ has quit IRC06:50
*** JerryOpenix has joined #openstack-infra06:50
*** ilyashakhat has quit IRC06:51
*** drifterza has joined #openstack-infra06:51
*** Sukhdev has quit IRC06:51
*** thorst has quit IRC06:51
*** roxanagh_ has joined #openstack-infra06:51
*** amotoki has quit IRC06:56
*** javeriak has joined #openstack-infra06:56
*** drifterza_ has joined #openstack-infra06:56
*** roxanagh_ has quit IRC06:56
*** drifterza has quit IRC06:59
*** apuimedo|away is now known as apuimedo07:00
*** gildub has quit IRC07:00
*** yaume has joined #openstack-infra07:01
*** amotoki has joined #openstack-infra07:04
*** tesseract- has joined #openstack-infra07:07
*** amotoki_ has joined #openstack-infra07:08
*** kzaitsev_mb has joined #openstack-infra07:08
*** amotoki has quit IRC07:09
*** jlanoux has joined #openstack-infra07:13
*** kzaitsev_mb has quit IRC07:13
*** dtantsur|afk is now known as dtantsur07:13
*** tqtran has joined #openstack-infra07:16
*** javeriak has quit IRC07:17
openstackgerritIan Wienand proposed openstack-infra/project-config: Switch centos7 job to neutron  https://review.openstack.org/36260807:17
*** jlanoux has quit IRC07:18
*** jlanoux has joined #openstack-infra07:19
*** tqtran has quit IRC07:20
*** ifarkas_afk is now known as ifarkas07:22
*** eranrom has joined #openstack-infra07:26
*** jamespage has joined #openstack-infra07:27
*** esikachev has quit IRC07:31
*** matrohon has joined #openstack-infra07:33
*** reed has quit IRC07:33
*** reed_ is now known as reed07:33
*** hashar has joined #openstack-infra07:36
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Do not publish cue on docs.o.o  https://review.openstack.org/36267007:36
*** jpich has joined #openstack-infra07:40
*** abregman has joined #openstack-infra07:40
*** vinaypotluri has quit IRC07:42
*** nmagnezi has joined #openstack-infra07:42
*** drifterza_ is now known as drifterza07:42
*** javeriak has joined #openstack-infra07:46
*** amotoki_ has quit IRC07:47
*** amotoki has joined #openstack-infra07:47
*** bhagyashri has joined #openstack-infra07:48
*** esikachev has joined #openstack-infra07:48
*** thorst has joined #openstack-infra07:49
*** kaisers1 has quit IRC07:50
*** matthewbodkin has joined #openstack-infra07:51
*** yolanda has joined #openstack-infra07:51
*** pilgrimstack has joined #openstack-infra07:51
*** kaisers has quit IRC07:52
*** senk has quit IRC07:52
*** roxanagh_ has joined #openstack-infra07:52
*** kaisers has joined #openstack-infra07:53
*** kaisers1 has joined #openstack-infra07:53
*** roxanagh_ has quit IRC07:56
*** thorst has quit IRC07:57
*** mhickey has quit IRC07:59
*** zzzeek has quit IRC08:00
*** shashank_hegde has quit IRC08:01
*** zzzeek has joined #openstack-infra08:02
*** shashank_hegde has joined #openstack-infra08:02
*** r-mibu has quit IRC08:02
*** r-mibu has joined #openstack-infra08:03
*** shardy has joined #openstack-infra08:03
openstackgerritThomas Goirand proposed openstack-infra/project-config: Add deb-bandit and deb-python-hacking repo  https://review.openstack.org/36209608:04
*** derekh has joined #openstack-infra08:07
*** vponomaryov has joined #openstack-infra08:07
*** kaisers_ has quit IRC08:07
*** kaisers_ has joined #openstack-infra08:08
*** rossella_s has joined #openstack-infra08:09
*** kzaitsev_mb has joined #openstack-infra08:09
*** shashank_hegde has quit IRC08:14
*** kzaitsev_mb has quit IRC08:14
*** shashank_hegde has joined #openstack-infra08:14
*** dingyichen has quit IRC08:15
*** shashank_hegde has quit IRC08:19
*** tonytan4ever has joined #openstack-infra08:23
openstackgerritLuigi Toscano proposed openstack-infra/devstack-gate: Always keep the local.conf file  https://review.openstack.org/36269608:24
*** tonytan4ever has quit IRC08:28
*** _degorenko|afk is now known as degorenko08:32
*** yolanda has quit IRC08:33
*** bethwhite_ has joined #openstack-infra08:33
*** abregman has quit IRC08:35
*** electrofelix has joined #openstack-infra08:35
*** hichihara has joined #openstack-infra08:39
*** chem has joined #openstack-infra08:40
*** mikelk has joined #openstack-infra08:41
*** lennyb has quit IRC08:42
*** javeriak has quit IRC08:42
*** asettle has joined #openstack-infra08:46
*** daemontool has quit IRC08:46
*** abregman has joined #openstack-infra08:48
*** nwkarsten has joined #openstack-infra08:48
vstoikoHi infra team, can someone take a look on this request? https://review.openstack.org/#/c/359076/508:49
*** daemontool has joined #openstack-infra08:49
*** nwkarsten has quit IRC08:53
*** thorst has joined #openstack-infra08:56
*** hyakuhei has quit IRC08:59
*** hyakuhei has joined #openstack-infra08:59
*** hyakuhei has quit IRC08:59
*** hyakuhei has joined #openstack-infra08:59
*** links has quit IRC09:00
*** ggnel_t has quit IRC09:01
*** ggnel_t has joined #openstack-infra09:01
*** thorst has quit IRC09:02
openstackgerritThomas Goirand proposed openstack-infra/project-config: Add deb-bandit and deb-python-hacking repo  https://review.openstack.org/36209609:03
*** jlanoux has quit IRC09:05
*** jaosorior is now known as jaosorior_lunch09:08
*** gluytium has quit IRC09:11
*** hamzy has quit IRC09:11
*** hamzy has joined #openstack-infra09:11
*** gluytium has joined #openstack-infra09:12
*** shashank_hegde has joined #openstack-infra09:15
HeOSHello, infra-team, could you please review: https://review.openstack.org/#/c/362002/ ?09:16
*** links has joined #openstack-infra09:16
*** jlanoux has joined #openstack-infra09:20
*** javeriak has joined #openstack-infra09:21
openstackgerritgengchc2 proposed openstack/gertty: Remove white space between print and () for gertty  https://review.openstack.org/36272409:22
*** _nadya_ has joined #openstack-infra09:23
openstackgerritJakub Libosvar proposed openstack-infra/project-config: Introduce functional/fullstack Neutron Xenial jobs  https://review.openstack.org/35984309:24
*** dtardivel has joined #openstack-infra09:25
*** _nadya_ has quit IRC09:28
*** jlanoux_ has joined #openstack-infra09:28
*** _nadya_ has joined #openstack-infra09:30
*** jlanoux has quit IRC09:31
openstackgerritThomas Goirand proposed openstack-infra/project-config: Remove duplicate deb-oslo.*  https://review.openstack.org/36273209:34
*** chem has quit IRC09:34
*** chem has joined #openstack-infra09:35
*** zshuo has quit IRC09:40
*** roxanagh_ has joined #openstack-infra09:40
openstackgerritMerged openstack-infra/tripleo-ci: Inject CA certificate via service profile  https://review.openstack.org/35779109:41
*** jaosorior_lunch is now known as jaosorior09:42
*** nwkarsten has joined #openstack-infra09:42
*** kzaitsev_mb has joined #openstack-infra09:43
*** tosky has joined #openstack-infra09:43
*** lennyb has joined #openstack-infra09:43
openstackgerritThomas Goirand proposed openstack-infra/project-config: Remove duplicate deb-oslo.*  https://review.openstack.org/36273209:44
*** roxanagh_ has quit IRC09:45
*** oanson has joined #openstack-infra09:46
*** nwkarsten has quit IRC09:46
*** e0ne has joined #openstack-infra09:47
*** berendt has quit IRC09:47
*** kaisers_ has quit IRC09:48
*** yamamoto has quit IRC09:48
*** yanyanhu has quit IRC09:51
*** hichihara has quit IRC09:53
openstackgerritArie Bregman proposed openstack-infra/zuul: Add 'reset_branch' option to Merger  https://review.openstack.org/36204909:57
*** thorst has joined #openstack-infra09:58
*** ihrachys has joined #openstack-infra10:00
*** jlanoux has joined #openstack-infra10:00
*** zhurong has quit IRC10:03
*** jlanoux_ has quit IRC10:03
zigoHow can I deal with merging upstream tags into the debian/newton packaging branch?10:03
*** amotoki_ has joined #openstack-infra10:03
zigoGerrit is proposing to push dozens of chained commits... :/10:03
zigoThis wont work.10:04
openstackgerritMatthew Bodkin proposed openstack-infra/storyboard-webclient: Make sidebar submenu the same length as sidebar  https://review.openstack.org/35555410:05
*** thorst has quit IRC10:05
*** amotoki has quit IRC10:07
*** daemontool has quit IRC10:09
*** daemontool has joined #openstack-infra10:09
*** sambetts|afk is now known as sambeets10:11
*** sambeets is now known as sambetts10:11
zigoremote: Processing changes: refs: 1, done10:12
zigoTo ssh://thomas-goirand@review.openstack.org:29418/openstack/deb-python-os-client-config.git10:12
zigo ! [remote rejected] HEAD -> refs/publish/debian/newton/bug/1537959 (you are not allowed to upload merges)10:12
zigoerror: failed to push some refs to 'ssh://thomas-goirand@review.openstack.org:29418/openstack/deb-python-os-client-config.git'10:12
zigoIs there a way to fix that?10:12
zigopabelanger: ^10:14
zigoFYI, I'm trying to merge upstream tag 1.16.0 into the debian/newton branch, adding some packaging fixes.10:14
zigoThis will be a very common operation that we'll need to make (ie: on each upstream release we want to package).10:15
zigoSo we really need to address this.10:15
AJaegerzigo, we cannot easily remove repositories. Please talk with fungi on what to do with https://review.openstack.org/#/c/36273210:15
*** lxsli has joined #openstack-infra10:15
openstackgerritArie Bregman proposed openstack-infra/zuul: Add 'reset_branch' option to Merger  https://review.openstack.org/36204910:15
AJaegerzigo, can't help with your other questions10:15
lxsliis Gerrit dying? having trouble with saving edits in the online editor10:16
zigoAJaeger: I knew about removal wouldn't be so easy, and I was expecting this kind of reply, thanks for it.10:16
zigoAJaeger: Who will be able to help for the merge operations then?10:16
zigoAJaeger: fungi as well?10:16
openstackgerritMykola Stolyarenko proposed openstack-infra/project-config: Setup gate for openstack/python-muranoclient with glare  https://review.openstack.org/36196510:17
lxsligetting 409 conflict10:18
AJaegerzigo: yeah, best discuss with mordred and fungi later - note it's meeting Tuesday, they might not have time today10:19
zigoAJaeger: I will be unavail later this afternoon and all of tomorrow, so then maybe on Thursday, but maybe my colleague tlbr can ask how to solve this.10:20
zigotlbr: Can you do that and ask mordred & fungi?10:20
AJaegerzigo: NO I cannot.10:21
tlbrzigo, ok10:21
zigoAJaeger: I wrote that I would like tlbr to ask, not you! :)10:22
AJaegersorry, no time. Hope they read backscroll. Keep in mind we have Friday a gerrit downtime, so anything more invasive, can be done there. So, if you're not available, best write up an email to the openstack-infra list and start the discussiont there10:22
AJaegerAh, sorry10:22
*** amotoki has joined #openstack-infra10:23
lxslialso any hints on how to fix this would be appreciated: "ERROR: branch not allowed by features matrix: newton"10:23
*** mjblack has quit IRC10:23
*** tonytan4ever has joined #openstack-infra10:24
*** mjblack has joined #openstack-infra10:25
*** amotoki_ has quit IRC10:25
BobBallclarkb: Saw your discussion with sdague about VHD file sizes and sparseness.  Our VHDs are sparse; but it may depend how you create them.  The image format is also generally tgz compressed when uploading/downloading from Glance.  What's the scenario where the VHDs are 3-4 times larger than qcow2s?10:25
*** hichihara has joined #openstack-infra10:26
*** kzaitsev_mb has quit IRC10:26
openstackgerritArie Bregman proposed openstack-infra/zuul: Add 'reset_branch' option to Merger  https://review.openstack.org/36204910:26
AJaegerlxsli: what are you trying to do?10:27
*** salv-orlando has joined #openstack-infra10:27
openstackgerritMykola Stolyarenko proposed openstack-infra/project-config: Setup gate for openstack/python-muranoclient with glare  https://review.openstack.org/36196510:27
*** apetrich has quit IRC10:28
lxsliAJaeger: https://review.openstack.org/#/c/362368/10:28
*** tonytan4ever has quit IRC10:28
*** apuimedo is now known as apuimedo|lunch10:29
AJaegerlxsli: the change as is is fine - just another repo is not ready. Best talk to dhellmann10:30
*** dfflanders has quit IRC10:30
openstackgerritMatthew Bodkin proposed openstack-infra/storyboard-webclient: Change layout of the list of stories in a project group  https://review.openstack.org/36276410:30
lxsliAJaeger: ok, I was hoping to help fix it before he gets online but that's fine, no big rush10:30
AJaegerlxsli: discuss with release manager on #openstack-release - one change that'S needed is https://review.openstack.org/#/c/362438/ - not sure what else.10:32
lxsliAJaeger: ok thanks!10:32
AJaegerlxsli: you need to figure out which tool - devstack? or devstack-gate? - gives the message and fix that10:32
*** amotoki_ has joined #openstack-infra10:33
openstackgerritMerged openstack-infra/irc-meetings: diskimage-builder meeting is bi-weekly  https://review.openstack.org/36228610:35
*** amotoki has quit IRC10:36
*** esikachev has quit IRC10:36
*** apetrich has joined #openstack-infra10:37
openstackgerritArie Bregman proposed openstack-infra/zuul: Add 'reset_branch' option to Merger  https://review.openstack.org/36204910:38
*** yamamoto has joined #openstack-infra10:42
*** martinkopec has joined #openstack-infra10:43
*** rossella_s has quit IRC10:44
*** itisha has joined #openstack-infra10:49
*** salv-orl_ has joined #openstack-infra10:52
*** sdague has joined #openstack-infra10:53
*** salv-orl_ has quit IRC10:54
*** apuimedo|lunch is now known as apuimedo10:54
*** salv-orlando has quit IRC10:56
*** sshnaidm|afk is now known as sshnaidm10:56
*** dkehn has quit IRC10:57
*** caowei has quit IRC10:57
*** dkehn_ has quit IRC10:57
*** rhallisey has joined #openstack-infra10:59
*** yamamoto_ has joined #openstack-infra10:59
*** berendt has joined #openstack-infra11:00
*** alekhya_ has joined #openstack-infra11:00
alekhya_hi,does anyone know what is the Manual patch Merge deadline For newton?11:01
dmelladoHi guys, is there something wrong with the infra as of now?11:02
dmelladoI've submitted a patch and it failed straight on, I can't also get any tempest logs11:02
*** yamamoto has quit IRC11:02
dmelladorcarrillocruz: around?11:03
*** thorst has joined #openstack-infra11:03
openstackgerritAleksandr Kholkin proposed openstack-infra/project-config: Setup gate for openstack/python-muranoclient with glare  https://review.openstack.org/36196511:06
*** yamamoto_ has quit IRC11:08
*** dkehn has joined #openstack-infra11:09
*** dkehn_ has joined #openstack-infra11:10
*** wznoinsk has quit IRC11:10
*** thorst has quit IRC11:11
*** apetrich has quit IRC11:11
*** rtheis has joined #openstack-infra11:12
*** psilvad has quit IRC11:13
*** yamamoto has joined #openstack-infra11:16
*** yamamoto has quit IRC11:17
*** tqtran has joined #openstack-infra11:17
*** nwkarsten has joined #openstack-infra11:20
*** ramishra has quit IRC11:21
*** tqtran has quit IRC11:22
*** ramishra has joined #openstack-infra11:23
*** nwkarsten has quit IRC11:25
*** apetrich has joined #openstack-infra11:25
*** jkilpatr has joined #openstack-infra11:27
*** wznoinsk has joined #openstack-infra11:28
*** roxanagh_ has joined #openstack-infra11:29
*** yamamoto has joined #openstack-infra11:29
*** jordanP has joined #openstack-infra11:29
*** jak-jak_ has quit IRC11:30
mordredinfra-root: I've disabled puppet on nodepool.o.o by putting it in the emergency file. I'm about to update shade and restart nodepool11:30
alekhya_hi,does anyone know what is the Manual patch Merge deadline For newton?11:30
rcarrillocruzNot around , will be working this evening11:32
*** yamamoto has quit IRC11:33
*** roxanagh_ has quit IRC11:33
*** amotoki_ has quit IRC11:33
mordredrcarrillocruz: btw - I'm getting errors listing servers on infracloud-vanilla11:34
*** jak-jak has joined #openstack-infra11:34
mordrednot urgent ...11:34
mordredbut shade.exc.OpenStackCloudException: Error fetching server list on infracloud-vanilla:: (Inner Exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.11:34
mordred<class 'sqlalchemy.exc.OperationalError'> (HTTP 500) (Request-ID: req-5833b431-74c0-42d5-ae2b-179430b513ac))11:34
mordredis the error I get11:34
*** kzaitsev_mb has joined #openstack-infra11:34
*** jak-jak is now known as Guest3629811:34
rcarrillocruzK, will check later, there have been renames in infracloud oscc, maybe they are related11:35
*** asettle has quit IRC11:35
AJaegeralekhya_: there is no real deadline for openstack-manuals. Documentation in project repos is another story11:35
*** asettle has joined #openstack-infra11:36
*** amotoki has joined #openstack-infra11:36
*** kaisers_ has joined #openstack-infra11:37
*** thorst has joined #openstack-infra11:38
*** fellypefca has joined #openstack-infra11:38
*** thorst_ has joined #openstack-infra11:39
fellypefcaHi everyone. Does anyone knows what i need to do to run devstack with Python3? Just put the USE_PYTHON3=True  PYTHON3_VERSION=3.4 on localrc, or anything else?11:39
openstackgerritamrith proposed openstack-infra/project-config: Update troves CI jobs  https://review.openstack.org/36279211:40
*** dmitryme has left #openstack-infra11:41
amrithAJaeger, please see ^^ and the commit message description of why the branch restriction is still in the code.11:41
*** kaisers_ has quit IRC11:41
AJaegerfellypefca: better ask on #openstack-qa11:41
openstackgerritYuriy Taraday proposed openstack-infra/project-config: Make Puppet jobs voting in fuel-octane  https://review.openstack.org/36279311:42
fellypefcaAjaeger Ok :) thanks11:42
*** thorst has quit IRC11:42
*** fellypefca has left #openstack-infra11:42
openstackgerritamrith proposed openstack-infra/project-config: Update troves CI jobs  https://review.openstack.org/36279211:42
amrithAJaeger, fixed.11:43
AJaegeramrith: looks good!11:43
amriththx11:44
AJaegerlet's hope that tests pass as well ;)11:44
*** ldnunes has joined #openstack-infra11:46
amrithi hope my co-author on the change can grease the skids on that :)11:46
amriththx AJaeger have to go and play in traffic now11:46
*** lucasagomes is now known as lucas-hungry11:47
*** tpsilva has joined #openstack-infra11:48
vrovachev1Hello around, please take a look https://review.openstack.org/#/c/359704/11:50
*** javeriak has quit IRC11:50
*** asettle has quit IRC11:51
openstackgerritBartosz Kupidura proposed openstack-infra/puppet-apps_site: [wip] Glare support for app-catalog  https://review.openstack.org/35902911:51
*** javeriak has joined #openstack-infra11:52
*** rfolco has joined #openstack-infra11:57
openstackgerritMonty Taylor proposed openstack-infra/shade: Fix two minor bugs in generate_task_class  https://review.openstack.org/36280412:00
openstackgerritMonty Taylor proposed openstack-infra/shade: Fix two little typos  https://review.openstack.org/36280512:00
*** trown|outtypewww is now known as trown12:02
*** pradk has joined #openstack-infra12:02
*** jaosorior has quit IRC12:04
*** sandanar has quit IRC12:04
*** jaosorior has joined #openstack-infra12:04
*** jkilpatr has quit IRC12:06
*** rlandy has joined #openstack-infra12:08
*** kushal has joined #openstack-infra12:11
*** jaosorior has quit IRC12:11
*** jaosorior has joined #openstack-infra12:12
*** afred312_ has joined #openstack-infra12:12
openstackgerritHieu LE proposed openstack-infra/project-config: Update Magnum jobs to include api-ref job  https://review.openstack.org/35760212:13
*** tonytan4ever has joined #openstack-infra12:13
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: test periodic job  https://review.openstack.org/35585912:13
*** afred312 has quit IRC12:14
*** zhurong has joined #openstack-infra12:15
*** clenimar has quit IRC12:15
openstackgerritMonty Taylor proposed openstack-infra/system-config: Add floating-ip cache expiration time settings  https://review.openstack.org/36281312:16
*** gouthamr has joined #openstack-infra12:17
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Replace ssh public key for sshnaidm  https://review.openstack.org/36281412:17
*** sarob has joined #openstack-infra12:17
*** AJaeger has quit IRC12:18
*** rossella_s has joined #openstack-infra12:20
*** AJaeger has joined #openstack-infra12:21
*** gordc has joined #openstack-infra12:22
*** esikachev has joined #openstack-infra12:22
*** sarob has quit IRC12:22
*** yamamoto has joined #openstack-infra12:22
*** dprince has joined #openstack-infra12:26
*** AJaeger has quit IRC12:27
*** AJaeger has joined #openstack-infra12:28
openstackgerritMonty Taylor proposed openstack-infra/shade: Handle None return value from get_floating_ip  https://review.openstack.org/36282312:28
*** jkilpatr has joined #openstack-infra12:28
*** kgiusti has joined #openstack-infra12:29
*** mdrabe has joined #openstack-infra12:31
*** kzaitsev_mb has quit IRC12:34
*** kzaitsev_mb has joined #openstack-infra12:34
*** psilvad has joined #openstack-infra12:35
openstackgerritMonty Taylor proposed openstack-infra/shade: Port is singular  https://review.openstack.org/36283212:36
*** javeriak has quit IRC12:38
mordredShrews, infra-root: ^^ found a few little things: https://review.openstack.org/#/q/status:open+project:openstack-infra/shade+branch:master+topic:nodepool-fixes12:40
openstackgerritMerged openstack-infra/project-config: Update Magnum jobs to include api-ref job  https://review.openstack.org/35760212:40
*** lucas-hungry is now known as lucasagomes12:41
mordredotherwise, nodepool seems to be going ok for now12:41
dlahnafternoon all.12:43
*** baoli has joined #openstack-infra12:44
openstackgerritAnne Gentle proposed openstack-infra/project-config: Adds Magnum API Reference jobs to gate and check builds  https://review.openstack.org/36283912:46
*** annegentle has joined #openstack-infra12:48
*** gouthamr_ has joined #openstack-infra12:49
*** gouthamr has quit IRC12:51
*** markvoelker has joined #openstack-infra12:52
*** watanabe_isao has joined #openstack-infra12:53
*** esberglu has joined #openstack-infra12:53
*** claudiub has joined #openstack-infra12:54
openstackgerritAnne Gentle proposed openstack-infra/project-config: Adds Magnum API Reference jobs to gate and check builds  https://review.openstack.org/36283912:54
*** markusry has joined #openstack-infra12:55
openstackgerritAntoni Segura Puimedon proposed openstack-infra/irc-meetings: kuryr: update meeting settings  https://review.openstack.org/36285212:56
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Implement scenari001, 002 and 003  https://review.openstack.org/36250412:57
*** asselin_ has quit IRC12:59
*** clenimar has joined #openstack-infra13:00
*** alekhya_ has quit IRC13:02
*** sbezverk_ has quit IRC13:02
*** xyang1 has joined #openstack-infra13:02
*** asettle has joined #openstack-infra13:07
*** rodrigods has quit IRC13:09
*** rodrigods has joined #openstack-infra13:09
*** M-docaedo_vector has quit IRC13:09
*** M-docaedo_vector has joined #openstack-infra13:09
*** david-lyle has quit IRC13:10
*** pgadiya has quit IRC13:10
*** roxanagh_ has joined #openstack-infra13:14
cloudnullmornings13:15
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: WIP - Implement overcloud upgrade job - Mitaka -> Newton  https://review.openstack.org/32375013:16
*** vikrant has quit IRC13:16
*** markvoelker has quit IRC13:17
*** david-lyle has joined #openstack-infra13:18
*** roxanagh_ has quit IRC13:19
zigomordred: Hi there! This morning, I was wondering how we could allow merge of tags within the debian/newton branch for all packaging-deb stuff. How can we do it?13:19
zigomordred: We need to merge upstream tags, you know...13:19
zigomordred: Otherwise, we can't package new upstream releases.13:19
zigomordred: Is there an ACL that we must set somewhere?13:19
*** jamesdenton has joined #openstack-infra13:20
mordredzigo: it's a good question ... there are some options - but let's chat with fungi when he arrives to see which one he's happy with13:20
YorikSarEmilienM, pabelanger: We found an easier workaround for running tests inside repo subdir: symlinks :)13:21
mordredYorikSar: \o/13:22
YorikSarSo here's a change to switch those jobs to voting: https://review.openstack.org/362793 <- if anyone from Infra-core would review it, it'd be great :)13:22
*** cardeois has joined #openstack-infra13:23
*** daemontool has quit IRC13:25
*** esberglu has quit IRC13:25
*** _ari_ has joined #openstack-infra13:26
electrofelixYorikSar: wondering if you have reviewed my response on https://review.openstack.org/222601 about resolving your problem via a subsequent patch https://review.openstack.org/30847613:26
openstackgerritYuriy Taraday proposed openstack-infra/project-config: Make Puppet jobs voting in fuel-octane  https://review.openstack.org/36279313:26
*** esberglu has joined #openstack-infra13:26
*** _ari_ has quit IRC13:26
openstackgerritLucas Alvares Gomes proposed openstack-infra/devstack-gate: Ironic: Copy deployment logs if present  https://review.openstack.org/36286713:26
*** daemontool has joined #openstack-infra13:27
YorikSarAJaeger: fixed ^13:27
zigomordred: Sure, though I'll be on the road all the afternoon and tomorrow. Maybe on thursday then.13:27
zigoThanks anyway.13:27
zigo(and feel free to discuss it with him if you have time)13:27
mordredzigo: cool. we'll come up with somethign -there are definitely ways it can be done13:27
YorikSarelectrofelix: Oh, hi, that was a long time ago, let me see...13:28
*** raildo has joined #openstack-infra13:28
*** mriedem has joined #openstack-infra13:30
*** mmedvede_ has joined #openstack-infra13:30
*** mmedvede has quit IRC13:30
*** mmedvede_ has quit IRC13:30
*** rossella_s has quit IRC13:30
mordredfungi, clarkb, pabelanger: + sudo ip6tables -I openstack-INPUT 1 -s 2001:4800:1ae1:18:f816:3eff:fe18:c1b3 -j ACCEPT13:31
mordredip6tables: No chain/target/match by that name.13:31
mordredwe're seeing that in the ready script13:31
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: oooq undercloud install  https://review.openstack.org/35891913:32
*** sbezverk has joined #openstack-infra13:33
YorikSarelectrofelix: wow, we actually should use fixtures all over the place there :)13:33
YorikSarelectrofelix: Not that a lot of changes are accepted to git-review these days.13:34
YorikSarAnyhow, I agree that you're going in the right direction, I'll remove my -1.13:34
openstackgerritVadim Rovachev proposed openstack-infra/project-config: Fix branches for fuel-qa gates  https://review.openstack.org/36287113:35
fungimordred: for all node types or just centos/fedora?13:35
vrovachev1Dear colleagues, hello again. Please take a look https://review.openstack.org/#/c/362871 also13:36
*** nwkarsten has joined #openstack-infra13:36
pabelangermordred: we should have that fixed already. Checking to see if the image was uploaded yesterday13:36
*** esberglu has quit IRC13:37
YorikSarfungi: You didn't reconsider your position on accepting new changes to git-review, did you?13:37
*** asselin_ has joined #openstack-infra13:38
openstackgerritSergey Kraynev proposed openstack-infra/project-config: Add k8s-docker-suite-app-murano project to openstack  https://review.openstack.org/35774513:38
fungizigo: can you elaborate on which "upstream" tags you need to merge in packaging-deb repos? like, let's take nova as an example... are you talking about a release tag from the openstack/nova repo getting merged into the debian/newton branch of the openstack/deb-nova repo?13:38
*** nmagnezi has quit IRC13:38
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: POC: WIP: oooq undercloud install  https://review.openstack.org/35891913:39
fungiYorikSar: i need to rework that proposed text about the situation, but it's not that we don't want new changes, more that we don't want new features that significantly expand the scope of git-review (especially if they're trying to turn it into a general-purpose gerrit command-line client rather than just a tool to push and retrieve changes from gerrit)13:39
*** markvoelker has joined #openstack-infra13:40
*** mmedvede has joined #openstack-infra13:41
fungiwanting it to stay stable and low-churn. support new gerrit releases: sure; fix bugs/regressions: definitely; improve documentation or testing of existing features: great; add minor features or behavior changes that make use of the tool itself more efficient: probably okay13:41
*** esberglu has joined #openstack-infra13:41
YorikSarfungi: Well, there are some changes that just improve testing out there that still recieve almost no review. That makes impression that project is almost frozen...13:42
*** vinaypotluri has joined #openstack-infra13:42
pabelangermordred: fungi: image didn't upload yesterday, reuploading today13:43
fungiYorikSar: many of our repos are almost frozen, mostly because our core review team is spread thin, unfortunately. i've been trying to find time for months just to get around to tagging another git-review release but because it's not blocking/breaking important systems my time ends up spent elsewhere13:44
*** markvoelker has quit IRC13:45
*** annegentle has quit IRC13:46
openstackgerritZara proposed openstack-infra/python-storyboardclient: Add basic docs for python client  https://review.openstack.org/36287813:46
*** e0ne has quit IRC13:46
rcarrillocruzaround13:47
electrofelixfungi: that all sounds pretty sensible, I think it's mainly time constraints, I'll try and plan for some rebase + initial reviews of outstanding git-review changes (don't have core myself but might make their jobs easier) after the main JJB 2.0 API patches are all landed13:47
rcarrillocruzmordred, pabelanger : looks like mysql is sad on the controller13:47
rcarrillocruzhttp://paste.openstack.org/show/564835/13:47
fungiYorikSar: if you can point out which proposed changes are improving test coverage or fixing bugs i can try to prioritize those13:47
rcarrillocruzmysql too many connections13:47
*** e0ne has joined #openstack-infra13:48
YorikSarfungi: But if you find time, please consider changes that improve testing and those that are trying to fix that WIP/draft thing...13:48
*** zz_dimtruck is now known as dimtruck13:48
*** thorst_ is now known as thorst13:48
pabelangerrcarrillocruz: quick google says 151 is the default. Guess we need to check what max_connections is set to13:49
*** daemontool has quit IRC13:49
*** Julien-zte has joined #openstack-infra13:50
*** daemontool has joined #openstack-infra13:50
fungiYorikSar: i'll revisit the custom labels change. i thought i had reviewed it already13:50
pabelangerproject-config-core: I'd like to enable rax-iad again for nodepool^. We have an ticket open with rackspace asking to collect more data13:50
mordredinfra-root: I've reverted shade on nodepool.o.o and restarted ... there is a squirrely something going on that looks to be a flaw in caching logic13:50
openstackgerritPaul Belanger proposed openstack-infra/project-config: Revert "Disable rax-iad due to launch failure rate"  https://review.openstack.org/36288513:51
pabelanger^ is the revert13:51
fungidoes 337883 crash gertty for anyone else?13:52
YorikSarfungi: There's https://review.openstack.org/285620 that enables running tests on MacOS, there's https://review.openstack.org/222601 that explicitely states author/comitter to avoid issues with not configured Git where you run tests, there's https://review.openstack.org/308476 which makes use of fixtures in tests making them more reusable...13:52
fungiweird, now 336475 crashed gertty for me as well13:53
*** gouthamr_ is now known as gouthamr13:53
*** kushal has quit IRC13:54
fungiYorikSar: thanks! on 285620 i'll just take people's word for it that it works... we don't test on non-free platforms and i don't use them either, so support for something like that can really only be on a best-effort basis13:54
YorikSarfungi: As for custom labels, there are at least 3 different changes that implement different approaches: mine https://review.openstack.org/96528 is outdated and I'll abandon it; more abstract one that allows to customize --draft in .gitreview https://review.openstack.org/259696 that might require some more work on it; and https://review.openstack.org/281504 that has a bit misleading commit messag13:56
YorikSare, but just might do the trick.13:56
*** _nadya_ has quit IRC13:57
fungiYorikSar: 281504 sounds like the one i had skimmed most recently13:57
YorikSarfungi: Not only it allows to run tests on MacOS, it also makes test runs more predictable removing usage of 127.x.x.x IPs.13:57
*** yamahata has joined #openstack-infra13:58
fungiYorikSar: well, as long as we don't end up with a hash collision (a 1:10^4 chance is pretty high)13:59
YorikSarfungi: I'd actually prefer to have both 281504 to apply random label to the change and 259696 that would allow to say '--draft == --label=Workflow-1 for my project'13:59
*** zzzeek has quit IRC14:00
pabelangerYay14:00
YorikSarfungi: There's a test for not having hash collisions, and suprisingly there weren't much of them, actually. So we might be safe for foreseeable future.14:00
pabelangermordred: cloudnull: clarkb: centos-7-2-node on osic-cloud1: nc 2001:4800:1ae1:18:f816:3eff:fefe:9deb 1988514:00
pabelangerwith that, we should now have all our images working with ipv6 only clouds14:01
*** sbezverk has quit IRC14:01
mordredpabelanger: awesome14:01
fungiYorikSar: yep, and since it's using a deterministic hash of the test id, that shouldn't vary by platform either14:01
fungiso ideally we won't be able to merge a change which has a hash collision over teh test ids14:02
*** eharney has joined #openstack-infra14:02
*** inc0 has joined #openstack-infra14:02
*** annegentle has joined #openstack-infra14:03
rcarrillocruzpabelanger: my.cnf had max_connections to 1024, bumped to 2048, restarted and now I can do API calls from nodepool fine14:03
pabelangerrcarrillocruz: cool14:03
YorikSarfungi: Yes, I've added that verification before all tests, so it'll fail fast on developer's machine if there's a collision.14:03
*** zzzeek has joined #openstack-infra14:03
*** hockeynut has joined #openstack-infra14:03
*** dimtruck is now known as zz_dimtruck14:04
pabelangerrcarrillocruz: I cannot remember, are we dual stack in infracloud for networking?14:04
*** zzzeek has quit IRC14:04
rcarrillocruznot sure tbh, i could check with the NET folks14:05
*** zzzeek has joined #openstack-infra14:05
*** inc0_ has joined #openstack-infra14:05
*** bin_ has joined #openstack-infra14:06
*** jcoufal has joined #openstack-infra14:06
openstackgerritMerged openstack-infra/git-review: Remove discover from test-requirements  https://review.openstack.org/34579614:06
openstackgerritMerged openstack-infra/git-review: Use hash of test ID to pick Gerrit ports in tests  https://review.openstack.org/28562014:06
*** inc0 has quit IRC14:07
*** esberglu has quit IRC14:07
*** sdake has joined #openstack-infra14:08
cloudnullpabelanger mordred clarkb ++ thats awesome !14:08
*** rbrndt has joined #openstack-infra14:08
openstackgerritZara proposed openstack-infra/python-storyboardclient: Add basic docs for python client  https://review.openstack.org/36287814:08
*** esberglu has joined #openstack-infra14:09
openstackgerritMerged openstack-infra/git-review: Set author and committer explicitly  https://review.openstack.org/22260114:09
*** matt-borland has joined #openstack-infra14:10
*** sbezverk has joined #openstack-infra14:10
* YorikSar is looking for another round on https://review.openstack.org/362793 - switching Octane jobs to voting14:10
*** sdake_ has joined #openstack-infra14:12
*** chem has quit IRC14:13
*** sdake has quit IRC14:13
*** chem has joined #openstack-infra14:13
*** thiagop has joined #openstack-infra14:14
openstackgerritBartosz Kupidura proposed openstack-infra/puppet-apps_site: [wip] Glare support for app-catalog  https://review.openstack.org/35902914:14
openstackgerritPaul Belanger proposed openstack-infra/project-config: Run windmill-jobs-trusty(-nv) on master  https://review.openstack.org/36290014:15
*** hongbin has joined #openstack-infra14:17
*** Liuqing has joined #openstack-infra14:18
openstackgerritMonty Taylor proposed openstack-infra/shade: Revert per-resource dogpile.cache work  https://review.openstack.org/36290114:20
openstackgerritMonty Taylor proposed openstack-infra/shade: Port is singular  https://review.openstack.org/36283214:21
openstackgerritZara proposed openstack-infra/python-storyboardclient: Add basic docs for python client  https://review.openstack.org/36287814:21
openstackgerritMerged openstack-infra/git-review: Refactor Isolated Env to use in unit tests  https://review.openstack.org/30847614:22
openstackgerritMerged openstack-infra/git-review: Add several missing options to the man page  https://review.openstack.org/33568514:22
openstackgerritMerged openstack-infra/git-review: Fix AttributeError when can not connect to Gerrit  https://review.openstack.org/31818114:22
*** cardeois has quit IRC14:23
*** zz_dimtruck is now known as dimtruck14:23
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Split additional features across the periodic jobs  https://review.openstack.org/36290414:23
*** cardeois has joined #openstack-infra14:24
openstackgerritMerged openstack-infra/git-review: Remove worthless print  https://review.openstack.org/30424614:24
openstackgerritJeremy Stanley proposed openstack-infra/git-review: Deprecate topic mangling for bugs and blueprints  https://review.openstack.org/32653914:25
openstackgerritMerged openstack-infra/git-review: Avoid AttributeError when raising raw GitReviewExceptions  https://review.openstack.org/24009014:25
openstackgerritMerged openstack-infra/git-review: fix encoding issue on Windows  https://review.openstack.org/21816714:25
*** tosky has quit IRC14:25
openstackgerritMerged openstack-infra/git-review: Fix no_git_dir UnboundLocalError in except block  https://review.openstack.org/29847314:26
*** mriedem has quit IRC14:27
*** tosky has joined #openstack-infra14:27
*** mriedem has joined #openstack-infra14:28
*** daemontool has quit IRC14:28
*** dtantsur is now known as dtantsur|mtg14:28
*** daemontool has joined #openstack-infra14:28
mtreinishfungi: sure I can do it in pop too, from my perspective it doesn't make much of a difference. I just needed some way to get the emails14:29
openstackgerritPaul Belanger proposed openstack-infra/project-config: Switch windmill-jobs-centos7 for voting  https://review.openstack.org/36290814:29
*** nmagnezi has joined #openstack-infra14:29
fungimtreinish: yeah, i think using pop will ultimately be cleaner than imap since the protocol directly mirrors the use case and is also far less complex (therefore potentially more reliable)14:30
*** mikelk has quit IRC14:31
rcarrillocruzpabelanger: i'm thinking we should have a custom flavor for the mirror. Using xlarge gives us 160GB of disk, but takes 8VCPUs, I think we can do with 4VCPUs and 100GB, no?14:31
fungimtreinish: at least if we end up with a dedicated mailbox for the messaging queue14:31
mtreinishfungi: yeah for teh dedicated mailbox case maybe. I think imap does give some flexibility. Although granted I don't really expect lpmqtt to be used elsewhere14:32
mtreinishfwiw though it wasn't hard to do it in imap14:32
*** esberglu_ has joined #openstack-infra14:32
pabelangerrcarrillocruz: I think we are just using the nodepool flavor in bluebox14:32
*** e0ne has quit IRC14:32
pabelangeroh wait14:32
pabelangerbut we have a volume14:32
rcarrillocruzoh, but that has just 80GB14:32
rcarrillocruzyeah, we have no cinder in infracloud14:32
*** esberglu has quit IRC14:33
openstackgerritMerged openstack-infra/git-review: Support git without git credential  https://review.openstack.org/30738514:33
mtreinishfungi: heh, I like that poplib docs recomend you use imap: https://docs.python.org/2/library/poplib.html#module-poplib14:33
*** ociuhandu has joined #openstack-infra14:33
openstackgerritMerged openstack-infra/git-review: Set a default EXIT_CODE for GitReviewException  https://review.openstack.org/32395914:33
*** e0ne has joined #openstack-infra14:34
jeblairmtreinish, fungi: why pop?  i would recommend using imap, even with pop semantics.14:34
*** woodster_ has joined #openstack-infra14:34
*** dizquierdo has joined #openstack-infra14:35
*** oanson has quit IRC14:36
rcarrillocruzpabelanger: you confirm we just need 100GB?14:36
mtreinishjeblair: I have no attachment to the protocol. Its in imap now, I was just looking at pop because fungi mentioned it14:36
*** esberglu_ has quit IRC14:36
rcarrillocruzi'll push a change to create the profile with that flavor14:36
*** kaisers_ has joined #openstack-infra14:37
pabelangerrcarrillocruz: ya, that should be fine. Most mirrors have about 15GB of data cached right now14:37
jeblairmtreinish, fungi: i'd stick with imap14:37
rcarrillocruzk thx14:37
fungifair enough. imap is more flexible, pop3 is just the usual implementation when a tool only wants to bulk retrieve all waiting messages and doesn't need to retain remote copies or do any fancy management of multiple inboxes14:37
*** tonytan_brb has joined #openstack-infra14:37
jeblairmtreinish, fungi: it allows other tools to coexist (including easy inspection by operators without causing heisenbugs), and is likely more future-proof.14:38
openstackgerritZara proposed openstack-infra/infra-manual: Document commit message syntax for StoryBoard  https://review.openstack.org/36066814:39
*** esberglu has joined #openstack-infra14:39
*** tonytan4ever has quit IRC14:40
openstackgerritMerged openstack-infra/tripleo-ci: Replace ssh public key for sshnaidm  https://review.openstack.org/36281414:41
YorikSarmordred, jhesketh, fungi: great run over git-review CRs!14:41
*** tonytan_brb has quit IRC14:42
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Add mirror flavor for Infracloud  https://review.openstack.org/36292114:42
rcarrillocruzpabelanger: ^14:42
*** daemontool has quit IRC14:42
fungiYorikSar: there's still a bunch more to go, i was just cleaning out the trivial/non-contentious changes first14:42
*** tonytan4ever has joined #openstack-infra14:42
*** david-lyle has quit IRC14:43
*** esberglu has quit IRC14:44
YorikSarfungi: Still it's great to finally have those merged.14:45
*** jaosorior is now known as jaosorior_away14:45
pabelangerrcarrillocruz: So, left comment. No -114:45
*** SergK_ is now known as SergK14:45
*** esberglu has joined #openstack-infra14:45
rcarrillocruzpabelanger: yeah, although we will have cinder and non-cinder clouds14:46
rcarrillocruzif it's ok having that flavor on bluebox, even if we don't use it , i'm cool amending14:46
*** adrian_otto has joined #openstack-infra14:46
rcarrillocruzwhat you think about vcpus tho?14:46
*** sdake_ has quit IRC14:47
*** david-lyle has joined #openstack-infra14:48
jeblairi don't think we need to use cinder anywhere really14:49
jeblairour afs cache is taking up 5GB right now14:49
*** piet has joined #openstack-infra14:50
*** psachin has quit IRC14:50
rcarrillocruzsweet14:51
rcarrillocruzyou reckon 4vcpus would be enough?14:51
*** Liuqing has quit IRC14:51
rcarrillocruzi mean, a mirror is more an I/O kind of instance14:51
*** xarses has quit IRC14:51
rcarrillocruzrather than CPU intensive instance14:51
rcarrillocruzlooks like a waste to me to use 8vcpu14:51
*** _nadya_ has joined #openstack-infra14:51
fungijeblair: the biggest benefit i can see to using cinder for the afs cache is that apache generates crazy volumes of logs on those servers and if it fills up the rootfs then at least the afs cache won't fall over14:52
*** xarses has joined #openstack-infra14:52
jeblairfungi: there is that :)14:52
*** jlanoux has quit IRC14:53
jeblairrcarrillocruz: cacti suggests 4 should be fine14:53
*** ilyashakhat has joined #openstack-infra14:53
*** esberglu has quit IRC14:53
rcarrillocruz++14:53
pabelangerrcarrillocruz: I think we are using 4vcpu in some regions, mostly because of network IO.  Which ever we decided, the same flavor should be across all the regions if possible. EG: bluebox / infracloud14:53
*** adrian_otto has quit IRC14:53
jeblairmaybe even 214:53
rcarrillocruzlet's put together all flavors on the same profile14:54
rcarrillocruzi'll amend14:54
*** esberglu has joined #openstack-infra14:54
*** shamail has joined #openstack-infra14:55
*** jlanoux has joined #openstack-infra14:56
*** asettle has quit IRC14:56
rcarrillocruzso for vanilla14:56
*** AnarchyAo has joined #openstack-infra14:56
*** asettle has joined #openstack-infra14:57
*** hashar is now known as hasharAway14:57
rcarrillocruzi have to open 3 tickets14:57
rcarrillocruzout of 48 nodes14:57
rcarrillocruzsl390s14:57
rcarrillocruz3 don't pull IPs from DHCP, 2 of them due to cabling one i believe due to not being on the right vlan14:57
rcarrillocruzwhich is pretty good actually, i thought it would be much worse in terms of utilization, given all the churn that hw has gone thru14:57
rcarrillocruzas soon as i put the mirror online and all i think we should be good to enable it on nodepool and put some servers to see how it behaves14:58
*** rajinir has joined #openstack-infra14:58
clarkbrcarrillocruz: pabelanger ya if you don't have volumes we will want a flavor with a bit of disk but not need much cpu or memory14:59
rcarrillocruz++14:59
*** amotoki has quit IRC15:01
*** ilyashakhat has quit IRC15:02
*** hichihara has quit IRC15:02
*** david-lyle has quit IRC15:02
*** thcipriani|afk is now known as thcipriani15:03
*** roxanagh_ has joined #openstack-infra15:04
openstackgerritDan Smith proposed openstack-infra/devstack-gate: Explicitly set RABBIT_USERID  https://review.openstack.org/36294115:04
*** rhallisey has quit IRC15:05
clarkbI have requeued rax-ord ubuntu-trusty upload since both failed yesterday :(15:06
*** coolsvap is now known as coolsvap_15:07
*** tonytan_brb has joined #openstack-infra15:07
*** chem has quit IRC15:08
anteaya:(15:08
mordredShrews, clarkb: https://review.openstack.org/#/c/362901/ ... I want to revert a set of patches in shade. I do not know what's wrong with them at the moment, but I also do not think it's important to fix/finish right now, and we can return to it later15:08
*** chem has joined #openstack-infra15:08
mordrednodepool ran mostly fine other that the issues that I'm 99% sure are the result of those patches15:08
fungijeblair: yeah, we've already drastically trimmed down apache log retention and increased rotation frequency for them, but i need to circle back around and see whether that's sufficient in our higher-quota providers15:08
*** roxanagh_ has quit IRC15:09
openstackgerritMerged openstack-infra/shade: Fix two minor bugs in generate_task_class  https://review.openstack.org/36280415:09
*** sdake has joined #openstack-infra15:09
*** armax has joined #openstack-infra15:09
*** tonytan4ever has quit IRC15:11
openstackgerritPeter Zhurba proposed openstack-infra/project-config: Add repo for openstack/puppet-glare.  https://review.openstack.org/36295015:12
*** xwizard has quit IRC15:13
*** abregman is now known as abregman|mtg15:17
matrohonhi infra guys15:17
*** tmorin has joined #openstack-infra15:17
matrohonany core to help us merge https://review.openstack.org/#/c/352401/ ?15:18
clarkbmordred: is that something we can test to make sure the reverts help?15:18
clarkbmordred: not sure what the problem was skimming scrollback15:18
clarkbjust a mention of something related to caching15:18
*** tqtran has joined #openstack-infra15:19
*** zzzeek has quit IRC15:19
*** _ari_ has joined #openstack-infra15:19
*** kaisers_ has quit IRC15:19
*** abregman|mtg has quit IRC15:22
*** david-lyle has joined #openstack-infra15:22
*** ddieterly has joined #openstack-infra15:23
*** mdrabe has quit IRC15:23
*** sandanar has joined #openstack-infra15:23
*** tqtran has quit IRC15:23
*** mdrabe has joined #openstack-infra15:24
mordredclarkb: unfortunately, no. the test will be applying the revert in prod and seeing if it's all good - BUT - the errors only showed up with the new codepath in place, and then stopped when I reverted back to released shade, adn this is the code that was in master that would be relevant15:25
*** dtantsur|mtg is now known as dtantsur15:25
mordredclarkb: so I'm _fairly_ confident the issue is a bug in this code15:25
mordredbut developing a test to prove that and then to prove a fix to the code works I think will take a while15:25
*** dkehn has quit IRC15:25
*** dkehn_ has quit IRC15:26
*** martinkopec has quit IRC15:26
clarkbeven with the integration job with nodepool?15:26
*** links has quit IRC15:28
*** nibalizer has quit IRC15:29
fungii wonder if the bandersnatch maintainers are spread as thin as we are... https://bitbucket.org/pypa/bandersnatch/issues/67 was reported as a major regression 4 months ago. several other users have spoken up since then indicating they're also affected. i proposed a very trivial pull request fixing it a month ago. it's still not even triaged15:29
*** kaisers_ has joined #openstack-infra15:29
*** vhosakot has joined #openstack-infra15:29
*** senk has joined #openstack-infra15:30
fungiyeah, the maintainer's last activity on that repo seems to be back in may15:30
*** esikachev has quit IRC15:30
*** bethwhite_ has quit IRC15:30
*** Ravikiran_K has joined #openstack-infra15:30
fungiworth considering it might be abandoned at this point?15:30
*** martinkopec has joined #openstack-infra15:30
*** sdake has quit IRC15:31
*** flepied1 has joined #openstack-infra15:31
*** bogdando has joined #openstack-infra15:31
*** Jeffrey4l_ has quit IRC15:32
bogdandofolks, could you please share which scripts you use for a gerrit project creation automation?15:32
*** flepied2 has joined #openstack-infra15:32
*** flepied has quit IRC15:32
bogdandoI'd like to reuse those for a custom generic case15:32
*** dkehn has joined #openstack-infra15:32
*** shamail has quit IRC15:33
*** andreas_s has quit IRC15:33
*** nibalizer has joined #openstack-infra15:33
pabelangerbogdando: http://git.openstack.org/cgit/openstack-infra/jeepyb/15:33
pabelangermanage-projects.py is the application15:34
bogdandopabelanger, thank you!15:34
*** xarses has quit IRC15:34
*** jcoufal has quit IRC15:34
clarkbAJaeger: you previously reviewed https://review.openstack.org/#/c/359843/5 I am happy with it now15:35
*** esberglu has quit IRC15:35
*** flepied1 has quit IRC15:35
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Add tripleo-centos-7-ovb-ha-ipv6 experimental job  https://review.openstack.org/36296615:36
*** jcoufal has joined #openstack-infra15:36
*** esberglu has joined #openstack-infra15:36
AJaegerjeblair: regarding AFS: Current size of docs.openstack.org is around 12 GB (estimate), so will add a bit to it...15:38
* clarkb wonders if his docs list subscription went away at some point15:39
AJaegerclarkb: thanks. Let's ask armax or dougwig to bless it as https://review.openstack.org/#/c/359843/5 is a neutron change15:39
*** zzzeek has joined #openstack-infra15:40
jeblairAJaeger: that should not be a problem15:40
*** salv-orlando has joined #openstack-infra15:40
rcarrillocruzpabelanger: mind re-reviewing https://review.openstack.org/#/c/362921/  so I can keep rolling the mirror bring up?15:40
*** david-lyle has quit IRC15:40
openstackgerritJames E. Blair proposed openstack-infra/system-config: Add afs02.dfw to cacti  https://review.openstack.org/36296815:41
clarkbrcarrillocruz: reviewing too15:41
*** zzzeek has quit IRC15:41
*** gyee has joined #openstack-infra15:42
*** akscram has quit IRC15:42
*** dtantsur is now known as dtantsur|afk15:42
clarkbrcarrillocruz: pabelanger and maybe at some point we should replace the bluebox mirror with an instance running that flavor (though that is less urgent)15:42
pabelangerclarkb: Agreed15:43
*** zzzeek has joined #openstack-infra15:43
rcarrillocruzthanks15:43
*** esberglu_ has joined #openstack-infra15:43
*** esberglu has quit IRC15:44
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Sync the config of the ha JOBTYPE with ha2  https://review.openstack.org/36297415:46
*** dkehn_ has joined #openstack-infra15:46
*** esberglu has joined #openstack-infra15:46
*** derekh has quit IRC15:46
*** esberglu_ has quit IRC15:48
*** awayne has quit IRC15:48
*** akscram has joined #openstack-infra15:49
AJaegerthanks, armax.15:49
*** zhurong has quit IRC15:49
AJaegerclarkb: I think we run a job not anymore on master - and I prefer to not have the extra branch lines...15:49
clarkbAJaeger: we have to have the extra branch lines because they weant to continue running on trusty until they are comfortable with xenial15:50
*** david-lyle has joined #openstack-infra15:50
clarkbAJaeger: the default branch lines will cause it to not run on master15:50
*** itisha has quit IRC15:50
*** tphummel has joined #openstack-infra15:51
openstackgerritMerged openstack-infra/system-config: Add mirror flavor for Infracloud  https://review.openstack.org/36292115:51
*** trown is now known as trown|lunch15:52
*** jlanoux has quit IRC15:52
AJaegerclarkb: Check my comment - I think those two lines are not needed and the other one misses a branch line. or did I misread it?15:53
clarkbAJaeger: looking15:53
openstackgerritMerged openstack-infra/infra-manual: Clarify post job log URLs for merge commits  https://review.openstack.org/35119915:53
*** ddieterly is now known as ddieterly[away]15:53
fungiAJaeger: not sure if you saw, but the change to add bindep.txt to nova merged!15:53
fungigreat work15:53
clarkbAJaeger: oh I see what you mean about not running on master, good catch15:54
clarkbAJaeger: ya so those comments can/should be addressed15:54
pabelangerfungi: AJaeger: Wow, that is good news15:54
*** ihrachys has quit IRC15:54
AJaegerfungi, yeah, forgot to do my happy dance ;)15:54
AJaegerfungi, thanks for starting that!15:54
openstackgerritMerged openstack-infra/system-config: Use a host group for wiki.o.o  https://review.openstack.org/36235115:55
clarkbwas nova already using other-requirements or is this the first step in them directly managing their deps?15:55
*** esberglu has quit IRC15:55
fungiit was the very first bindep file addition change i proposed, initially as a means of testing that the mechanisms we had for using it in our jobs worked, so it's been kicking around for over a year15:55
funginova wasn't using other-requirements.txt previously, no15:55
*** esberglu has joined #openstack-infra15:55
openstackgerritAntoine Cabot proposed openstack-infra/project-config: Add publish-to-pypi for watcher-dashboard  https://review.openstack.org/36298415:55
clarkbwow15:56
fungithe first patchset of that change was uploaded on july 10, 201515:56
AJaegeryeah, took some iteration - and also some fixes for bindep and project-config before it was ready to be merged. And lots of discusions ;)15:56
mordredclarkb: yah - even with the nodepool integration job15:56
mordredclarkb: I think it's either a race condition or something related to multi-threaded invalidation15:57
*** mhickey has joined #openstack-infra15:57
mordredclarkb: so, like, I'm guessing once it's figured out, making a test that validates it is going to be _hard_ :)15:57
fungiAJaeger: given that (i think) running local tests for the nova repo was a big influence driving lifeless to come up with the idea for bindep in the first place, this is a milestone ;)15:57
clarkbmordred: gotcha15:57
*** Sukhdev has joined #openstack-infra15:58
*** ddieterly[away] is now known as ddieterly15:58
mordredclarkb: cause, you're right - we have the nodepool integration test - _and_ we have a crapton of caching related unittests (which do error when you break caching things) ... and nodepool in prod still threw errors that don't show up in test15:59
AJaegerI missed that early history of bindep - thanks15:59
*** dprince has quit IRC15:59
openstackgerritMerged openstack-infra/system-config: Add a wiki-dev.o.o server to test newer mediawiki  https://review.openstack.org/35824615:59
AJaegerproject-config cores, could I get a review to collect more logs for translation jobs, please? https://review.openstack.org/36231516:00
*** xarses has joined #openstack-infra16:00
*** dizquierdo has quit IRC16:00
clarkbAJaeger: looking16:00
*** tmorin has left #openstack-infra16:00
*** esberglu has quit IRC16:00
*** dprince has joined #openstack-infra16:00
AJaegerand one review to remove docs publishing from cue - it's not an official project: https://review.openstack.org/36267016:00
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Remove Ceph from the ha job  https://review.openstack.org/36299016:00
*** ifarkas is now known as ifarkas_afk16:01
openstackgerritMerged openstack-infra/system-config: Add a script to list change owner statistics  https://review.openstack.org/26397116:02
*** esberglu has joined #openstack-infra16:03
clarkbAJaeger: I am not seeing where tox is used in those jobs just grepping in the script16:03
AJaegerclarkb: jenkins/scripts/common_translation_update.sh16:03
clarkboh right we broke out a bunch of that into a common lib script. I see it there16:04
AJaegeryep16:04
*** devananda is now known as devananda|MOVING16:04
*** mriedem1 has joined #openstack-infra16:04
AJaegerthanks, clarkb16:04
AJaegerteam, I'd like to point out https://review.openstack.org/#/c/362732 - since we have a gerrit downtime on Friday. It removes 28 repositories from debian - those were added as duplicate ;(16:05
AJaegermordred, fungi, clarkb, could you review and figure out what's the best plan is there, please? ^16:05
*** adrian_otto has joined #openstack-infra16:06
*** adrian_otto has quit IRC16:06
clarkbAJaeger: I want to say in the past we have just set the extra repos to being unreadable by anyone in the gerrit acls16:06
*** mriedem has quit IRC16:06
AJaegerclarkb: yeah, exactly. We could retire them as usual...16:06
*** adrian_otto has joined #openstack-infra16:06
clarkbAJaeger: that plus the cleanup you have proposed is probably fine16:06
mordred++16:06
mordredI agree with clarkb16:06
*** mriedem1 is now known as mriedem16:07
mordredspeaking of ...16:07
*** esberglu has quit IRC16:07
mordredclarkb, fungi: zigo needs to be able to, from time to time, import git commits and tags from the upstream repos that the packaging repos track in to the upstream branch16:07
* AJaeger just gave a link to the retirement section and -1ed the change16:07
mordredthese are not code reviews ... they're upstream sync operations - but they're also a regular occurance in the packaging repos rather than one-off activities16:08
mordredany thoughts on what we think the "right" way to handle that is?16:08
clarkbmordred: I thought the source for upstream was not managed in these repos?16:08
*** adrian_otto has quit IRC16:09
*** adrian_otto has joined #openstack-infra16:09
mordredclarkb: 10:14:49             zigo | FYI, I'm trying to merge upstream tag 1.16.0 into the debian/newton branch, adding some packaging fixes.16:10
fungiyeah, i was asking zigo about it earlier but he wasn't around to clarify16:10
AJaegerhe asked tlbr to help out. tlbr ^16:10
*** raissa has joined #openstack-infra16:10
fungiit _sounds_ like he wants to merge tags from other repos into those16:10
mordredhttp://git.openstack.org/cgit/openstack/deb-os-client-config/log/?h=debian/newton ... definitely has copies of the commits from the upstream repo in it16:10
AJaegermordred: those might have been imported initially...16:11
fungione of the common debian git-buildpackage workflows is to import "upstream" branches into your repo where you have your packaging files16:11
tlbryes, the idea is to merged upstream code into the git tree16:11
clarkbI seem to recall an argument for "we don't jsut want branches in the repos themselves" was beacuse the packaging and upstream source are independent16:11
fungii'm unconvinced it's compatible with our ci concepts16:11
AJaegerproject-config cores, could you review a change to remove docs publishing from cue - it's not an official project: https://review.openstack.org/362670 , please?16:12
AJaegerbbl16:12
tlbrfungi, is it possible to merge upstream code into the git tree ?16:13
clarkbAJaeger: commented on the deb-oslo removal change16:13
clarkbAJaeger: I think you missed one :)16:13
tlbrwe merge it from tag sometimes16:13
fungitlbr: we are upstream code16:13
*** hasharAway is now known as hashar16:13
mordredclarkb: were you going to do anything with https://review.openstack.org/#/c/362901 ?16:13
clarkbmordred: I hadn't realized you had pushed a revert yet16:14
mordredclarkb: ah - sorry :)16:14
clarkbyou said you wanted to revert but I never saw the change. will look at it now16:14
tlbrfungi, what should we do in this case ? use existing repositories from gerrit ?16:14
fungitlbr: clarkb's point was that having a copy of, e.g., nova in another repo that's not the nova repo is a pretty absurd amount of duplication of resources16:14
tlbri guess we will have to rewrite the job16:14
*** nwkarsten has quit IRC16:15
clarkbmordred: does it make sense to have two reverts rather than one squashed? then we can add one back in or the other if we decide that it is functional independent of the other16:15
tlbrfungi, ok, I agree, then we will have to rewrite the job. Thank you16:15
*** nwkarsten has joined #openstack-infra16:15
*** yamamoto has quit IRC16:15
zaromoning16:15
*** ociuhandu has quit IRC16:15
*** armax has quit IRC16:16
mordredclarkb: it's all one thing really - it was split into multiple before for ease of review, but in terms of un-reverting I think the key thing we'll be reviewing is "are we happy with testing"16:16
pleia2good morning16:16
fungitlbr: the job could certainly pull tags from the nova repo, but we shouldn't (in my opinion) pull nova source code and tags into the packaging repo itself in gerrit16:16
*** drifterza has quit IRC16:16
anteayazaro: I'm going to guess that was morning, not moaning and wish you a good morning in return16:16
anteayapleia2: and good moring to you too :)16:16
pleia2o/ anteaya16:17
anteayait did it too16:17
anteayamoring16:17
fungitlbr: so in gerrit there's only one copy of nova. on the node where the packaging job runs, code/tags can of course be pulled from nova at runtime16:17
anteayaha ha ha16:17
*** tonytan_brb has quit IRC16:17
openstackgerritKaiyan Sheng proposed openstack-infra/project-config: Add monasca-events-api repo to openstack  https://review.openstack.org/36246216:18
*** martinkopec has quit IRC16:18
clarkbmordred: I approved the change16:18
*** watanabe_isao has quit IRC16:18
*** martinkopec has joined #openstack-infra16:18
tlbrfungi, what is the best way to clone it from the job ?16:19
mordredclarkb: thank you!16:19
tlbrfungi, any specific addresses ?16:19
*** matrohon has quit IRC16:19
fungitlbr: zuul-cloner can clone by taking advantage of the local git repo cache we maintain on all our job nodes16:19
*** nwkarsten has quit IRC16:19
mordredclarkb: also, while I've got you: https://review.openstack.org/#/c/357531/16:20
fungitlbr: in most cases, the branches/tags you care about are already cached16:20
*** david-lyle has quit IRC16:21
tlbrfungi, ok, thank you, i will try to find documentation on how to use it in the J job16:21
openstackgerritMatt Riedemann proposed openstack-infra/devstack-gate: DNM: test placement-api  https://review.openstack.org/36244116:22
fungitlbr: we have documentation on zuul-cloner at http://docs.openstack.org/infra/zuul/cloner.html but some examples where we're using it in jobs will probably be helpful... i'll find you some16:22
*** david-lyle has joined #openstack-infra16:23
clarkbmordred: shouldn't GATEWAY_NET there have routes_ipv4_externally: true too?16:23
openstackgerritMerged openstack-infra/project-config: Collect more logs for translation jobs  https://review.openstack.org/36231516:23
*** jordanP has quit IRC16:23
mordredclarkb: routes_externally: True will cause ipv4 and ipv6 to both be set to true16:24
*** martinkopec has quit IRC16:24
fungitlbr: here's an example of using it without a clonemap, just to clone a couple of repos http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/diskimage-builder.yaml#n1516:24
mordredclarkb: I did this one without the ipv4 specific thing so that we could land the clouds.yaml change before we landed the new shade that supports consuming the new value16:25
tlbrfungi, thank you! :) very helpful information16:25
clarkbmordred: ok approved16:25
clarkbmordred: the v6 network does have the ipv6 and ipv4 specific things fwiw16:25
mordredonce we're live on new shade, I do think we should change that to be specific16:25
*** yaume has quit IRC16:25
raissamordred: hi, we had a problem with devstack on one gate, it seems there was a problem with the creation of clouds.yaml - in the logs I see that write_clouds_yaml is called, but then updating the file fails, specifying that the file doesn't exist. I'm not sure why is that, do you have any idea?16:26
clarkbraissa: do you have a link to the logs for the job?16:26
fungitlbr: here's a slightly more advanced example, using a custom clonemap to strip the "openstack/" namespace prefixes when making the destination directories http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/tripleo.yaml#n2916:27
raissaclarkb: http://logs.openstack.org/21/362621/1/check/gate-python-saharaclient-dsvm-scenario-neutron-heat-nv/80aced0/16:27
mordredinfra-root: I have removed nodepool.o.o from the emergency file16:27
fungimordred: thanks for the heads up16:27
mordredraissa: oh my, no I don't ... although that's certainly unpleasing16:27
toskymordred: it's a problem on liberty only, apparently16:27
openstackgerritMathieu Mitchell proposed openstack/diskimage-builder: (WIP) Zuul-cloner first attempt  https://review.openstack.org/36301316:27
tlbrfungi, got it, thanks. Will prepare patch for the J job16:27
toskybut it's still supported :)16:27
*** kaisers_ has quit IRC16:28
*** esberglu has joined #openstack-infra16:28
raissawhat I thought it was weird is that the error just showed up for devstack cloud, devstack-admin didn't16:28
jeblairfungi, pleia2: fyi https://review.openstack.org/34206916:28
* pleia2 has a look16:29
*** Swami has joined #openstack-infra16:29
*** nwkarsten has joined #openstack-infra16:29
pleia2neat16:29
tlbrmordred, hi, could you please review it one more time https://review.openstack.org/#/c/362096/ ? zigo added another required project which we maintain16:29
clarkbraissa: mordred my guess is its writing the file to the stack users homedir config directory but the portion of the code failing is running as the jenkins user? newer devstack writes that file to /etc/openstack and it is global16:30
*** matthewbodkin has quit IRC16:30
fungijeblair: aha, thanks. i saw it previously before the background use case had been added16:30
clarkbraissa: I don't think its an error its just a warning. The first command writes the file and it didn't exist before. The second command updates the file16:30
clarkbraissa: and since by the time the second one runs the file exists there is no warning16:30
*** kzaitsev_mb has quit IRC16:31
*** e0ne has quit IRC16:31
*** wajdi has joined #openstack-infra16:31
raissaclarkb: right, got it :) thank you16:31
clarkbraissa: you can backport the devstack change to write teh config globally probably16:31
*** adrian_otto has quit IRC16:31
clarkbor have your tests run as stack16:31
clarkbor copy the config for the jenkins user16:32
*** hockeynut has quit IRC16:33
mordredyah - liberty was still writing the file into ~jenkins/.config/openstack/clouds.yaml16:33
*** adrian_otto has joined #openstack-infra16:33
mordredor, rather, ~stack/.config/openstack/clouds.yaml - sorry16:33
mordredso I think the easiest thing would be to just have your devsack plugin for your liberty branch try to copy ~stack/.config/openstack/clouds.yaml to ~jenkins/.config/openstack/clouds.yaml yeah?16:33
tlbrthank you:)16:34
clarkbya or backport the chagne to write it globally16:34
mordredliberty seems so long ago16:34
tlbrproject-config cores, please merge https://review.openstack.org/#/c/362096/16:34
clarkbor run the tests as stack16:34
mordredyah16:34
clarkbI am not sure one is any better than the others except fixing it in devstack will help anyone else that may run into the same problem16:34
*** jpich has quit IRC16:35
*** cloudnull is now known as wq16:35
mordredbtw - today we have maxed out nodepool quite nicely16:35
clarkbyup16:35
raissathanks mordred clarkb16:35
*** david-lyle_ has joined #openstack-infra16:36
*** tqtran has joined #openstack-infra16:36
clarkbmordred: will be neat if we can cross the 2k jobs/hour mark16:36
mordredright?16:37
mordredclarkb: do we have a good graph for jobs-per-hour?16:38
mordredoh.16:38
clarkbmordred: the one at the bottom of the zuul status page16:38
* mordred shuts up16:38
mordredyeah16:38
*** nwkarsten has quit IRC16:38
openstackgerritamrith proposed openstack-infra/project-config: Update troves CI jobs  https://review.openstack.org/36279216:38
*** nwkarsten has joined #openstack-infra16:38
mordredclarkb: we came really close last week16:38
*** Sukhdev has quit IRC16:39
*** electrofelix has quit IRC16:39
*** yamahata has quit IRC16:39
*** david-lyle has quit IRC16:39
clarkbya16:39
*** wq is now known as cloudnull16:39
*** cloudnull is now known as wq16:39
*** wq is now known as cloudnull16:39
clarkbI also like that our oldest change in check is basically the runtime of its job16:40
clarkbmeans that we are doing a good job of keeping up (post is slowed down though)16:40
jeblairthere's a 1200 job backlog right now16:40
openstackgerritMerged openstack-infra/system-config: Add dual stack network config for OSIC  https://review.openstack.org/35753116:41
clarkbcloudnull: ^ this is likely where we do our best job to make the osic cloud unhappy16:42
fungiwhich is surprisingly low16:42
*** nwkarsten has quit IRC16:43
clarkbmy neighbor is replacing his siding and it is oddly distracting16:43
pabelanger919 jobs in used ATM16:43
fungiat our current throughput, if people stopped uploading/approving changes, we could gave that burned through in under an hour16:43
anteayaclarkb: agreed16:43
cloudnullclarkb: is there about to be an unhappy cloud?16:43
cloudnull:)16:43
*** nwkarsten has joined #openstack-infra16:43
wajdiclarkb: my neighbour gutted their entire house and renovations have been going on ever since I moved in last October. They are doing the work themselves, so things have been progressing slowly, and very loudly.16:44
clarkbcloudnull: I don't know :) but we are using our entire capacity right now16:44
fungicloudnull: we've been putting all the load we're allowed for the moment on all our providers, so let's see if we pop any rivets16:44
irtermitepft...16:44
irtermitego little Cloud 1 go!16:44
clarkbwajdi: he has help and looks like only one side of his house so hopeflly over soon. But yes hammering and other fun16:44
cloudnullirtermite: we should go 1024 :)16:45
irtermite!!!16:45
openstackirtermite: Error: "!!" is not a valid command.16:45
*** shashank_hegde has quit IRC16:45
irtermiteWhy not... we already broke Horizon. What worse could we do?16:45
cloudnullirtermite: invalid command, i think you wanted to say +116:45
clarkbits ok we don't use horizon >_>16:45
cloudnull:p16:45
irtermitehahaha +216:46
irtermite?16:46
fungihorizon is for humans... we're fairly inhumane16:46
irtermite  ;)16:46
irtermiteone of us more than others fungi16:46
cloudnullTo be fair Horizon is still working , its just report pulling is now busted forever16:46
irtermitetruth ^^16:46
* fungi is just a humble bot, after all16:46
*** ddieterly is now known as ddieterly[away]16:47
*** Ravikiran_K has quit IRC16:49
pleia2horizontty16:49
irtermitehah16:50
fungii'm pegging gerrit with a bunch of scripted rest api calls, and the httpd threadcount is still only 2016:50
clarkbfungi: melody seems to show gerrit is still happy16:50
fungiclarkb: indeed16:50
clarkbother than the crazy http error rate due to the avatar 404s16:50
fungiclarkb: i wonder if we could just configure apache to 404 those itself?16:50
fungipresumably the pattern is an easy one to match on16:51
*** jaosorior_away has quit IRC16:51
clarkbfungi: ya or do like mgagne suggested and serve an image that cna be cached. Won't reduce the requests I don't think but they will 200 instead of 404ing16:51
fungisure, 1x1 transparent gif or something16:51
clarkbits stuff/avatar?s=26 GET16:51
*** kzaitsev_mb has joined #openstack-infra16:51
clarkbaccodring to melody16:52
*** trown|lunch is now known as trown16:52
*** ddieterly[away] is now known as ddieterly16:52
* irtermite suggests renaming openstackclient to horizontty per pleia216:52
clarkb/accounts/accountidentifier/avatar?s=2616:52
pleia2irtermite: haha16:52
irtermitecloudnull: ^^16:52
*** gyee has quit IRC16:53
*** hashar is now known as hasharAway16:53
*** _nadya_ has quit IRC16:53
*** pradk has quit IRC16:53
*** pradk- has joined #openstack-infra16:53
stevemari'm not sure what you magical infra folks are doing, but i've never seen the gate this smooth or fast during the last week of milestone 316:54
*** reed has quit IRC16:54
*** reed has joined #openstack-infra16:54
clarkbit also looks like when the mergeability checker fails taht resutls in an error caught by melody even though its normal processing16:54
clarkbzaro: ^ fyi thats something that could probably be caught and handled in gerrit a bit cleaner16:54
clarkbstevemar: cloudnull and irtermite gave us all the cloud16:55
zaroclarkb: noted.16:55
zaroclarkb: javamelody supports filtering https://github.com/javamelody/javamelody/wiki/UserGuide#5-supplements-in-webxml16:55
clarkboh wow java melody has english docs now16:55
clarkbnice16:55
clarkbzaro: they were all french when I last looked a few years ago16:55
stevemarclarkb: then thank you cloudnull and irtermite for all your clouds16:55
*** gyee has joined #openstack-infra16:55
clarkbstevemar: also sdague did a bunch of work to get fixes for issues in last week which helps avoid needless resets so its a combo of more resources and more reliable testing leading to happyness16:56
cloudnullim just a button masher, infra folks did all of the heavy lifting to get things working w/ our V6 cloud.16:57
stevemar\o/16:57
cloudnullhats off the infra people for being awesome !16:57
stevemarcloudnull: ++16:57
*** erlon has quit IRC16:57
fungicloudnull: it's not about whether you mash buttons, it's knowing the right buttons to mash and when! ;)16:57
*** rhallisey has joined #openstack-infra16:57
cloudnullfungi: all the buttons, all the time :)16:57
fungimy cats are great at that workflow16:58
*** javeriak has joined #openstack-infra16:58
*** lucasagomes is now known as lucas-dinner16:58
clarkbfungi: I have deployed decoy keyboard to much success to deal with toddlers mashing buttons16:58
clarkbproblem now is they want to also use the mouse and I don't have a decoy mouse16:59
fungiswitch to a mouseless workflow and make the decoy mouse your only mouse?16:59
clarkbif only. Even with xmonad that is a hard thing to do. Mostly beacuse I gave up on pteradactyl/vimperator a long time ago17:00
*** sdague has quit IRC17:00
*** sdague has joined #openstack-infra17:01
irtermiteclarkb: stevemar: ALLLL the cloud!17:01
*** hieulq_ has joined #openstack-infra17:02
*** degorenko is now known as _degorenko|afk17:02
clarkbnow if I could just get the trusty image to update in rax-ord...17:02
*** _nadya_ has joined #openstack-infra17:03
*** pradk- is now known as pradk17:03
clarkbmordred: so is plan to restart nodepool early tomorrow again with that shade revert in place?17:03
*** Apoorva has joined #openstack-infra17:03
mordredclarkb: yah17:03
*** abregman has joined #openstack-infra17:04
*** ilyashakhat has joined #openstack-infra17:04
*** esberglu has quit IRC17:04
*** _nadya_ has quit IRC17:05
zaroclarkb: i was able to build javamelody plugin with the latest version of javamelody.  would you like to try that?17:06
*** cdent has joined #openstack-infra17:06
clarkbzaro: we could try to update it on friday but that may be queueing too many things up for a single short outage17:06
openstackgerritAndy Smith proposed openstack-infra/project-config: Move puppet-qdr to Puppet OpenStack  https://review.openstack.org/36233317:06
clarkbzaro: maybe we get it on review-dev for now and then switch review.o.o to it at some point later?17:06
clarkbzaro: it isn't urgent (gerrit and melody both run) it would just help track down and isolate real failures to have that17:07
*** rcernin has quit IRC17:12
zaroclarkb: done.  latest version is on review-dev (ver 1.60).  it supports filtering but i'm not sure how to work that.17:12
*** dizquierdo has joined #openstack-infra17:13
mordredShrews: ooh, interesting test failure: http://logs.openstack.org/01/362901/1/gate/gate-shade-dsvm-functional-neutron/8768381/console.html17:13
*** bethwhite_ has joined #openstack-infra17:13
*** tesseract- has quit IRC17:14
*** esberglu has joined #openstack-infra17:15
*** jerryz has joined #openstack-infra17:15
*** yamamoto has joined #openstack-infra17:16
*** asettle has quit IRC17:16
*** asettle has joined #openstack-infra17:17
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for novaclient functional test bug 1618561  https://review.openstack.org/36304717:18
openstackbug 1618561 in python-novaclient "test_trigger_crash_dump_in_locked_state_nonadmin failing since 8/30" [Undecided,New] https://launchpad.net/bugs/161856117:18
openstackgerritamrith proposed openstack-infra/project-config: add the trove bandit job as a non-voting job  https://review.openstack.org/36304817:18
* clarkb wishes that bandit would just run int he linters job and get merged when it passes17:18
clarkbamrith: ^ btw doing that is a much simpelr way of adding linters imo17:18
*** tonytan4ever has joined #openstack-infra17:18
clarkbamrith: then you don't need any new josb or branch manipulation in the jobs or voting/nonvoting17:18
amrithclarkb, I was just following what appeared to be the way other projects were doing this17:19
amrithhappy to do it another way17:19
Krenairianw, fungi: what's the status with wiki-dev? I saw the commit went through, but it doesn't work for me17:19
clarkbamrith: ya I don't like how other people have decided to do it so I try to point it out whenever I see the pattern reused :)17:19
amrithso I'm guilty of copy-pastaing17:19
*** sarob has joined #openstack-infra17:19
*** hieulq_ has quit IRC17:19
fungiKrenair: i'm giving it a try later today, i hope, to see if i can find any lingering bugs in the implementation and get patches up for those17:20
clarkbamrith: basically the other option is just add bandit to your pep8/linter tox.ini target. The change can't merge until it passes and thats it done17:20
amrithhappy to do it a different way but need a hand; how would one do it the way you propose (run in the linters job)17:20
amrithwell, I'm adding it non voting for now17:20
amrithbecause it fails17:20
amrithand I'd like to get it to pass and then I can merge it into the pep8 job17:20
clarkbamrith: yes the change to edit the tox.ini will fail too so you edit things until it passes then merge it17:20
fungiKrenair: i hope that we're basically through with the overall framework for the module and for our calling class and node entrypoints, just needs some manual testing to pick up anything the ci is unable to valadate17:21
*** sandanar_ has joined #openstack-infra17:21
*** yolanda has joined #openstack-infra17:21
fungier, validate17:21
amrithclarkb, I wasn't planning on working to get it to pass right away though.17:21
fungionce i'm done chairing the infra meeting and lurking the tc meeting i should have some time to get started on that17:21
amrithcertainly don't want to do it now (so close to N-)17:22
*** yamamoto has quit IRC17:22
clarkbamrith: thats fine my suggestion doesn't change that. I guess I don't see much value in a non voting job known to fail that everyone will ignore when you can have a change that actually fixes things merge when it is ready17:22
clarkbthsi is the value of premerge testing17:23
*** tonytan4ever has quit IRC17:23
clarkbwe shouldn't need or want a bunch of known broken tests floating around. We can iteratively update as we are comfortable based on the results themselves17:23
*** nwkarsten has quit IRC17:24
amrithok, sounds good. I have a bug to work on to get the things to pass. Once that happens, I won't need the infra change, I'll just change tox.ini17:24
amrithsounds good17:24
*** nwkarsten has joined #openstack-infra17:24
*** tesseract- has joined #openstack-infra17:24
*** sandanar has quit IRC17:24
openstackgerritMerged openstack-infra/project-config: Do not publish cue on docs.o.o  https://review.openstack.org/36267017:24
*** sputnik13 has joined #openstack-infra17:25
*** pcaruana has quit IRC17:25
*** _nadya_ has joined #openstack-infra17:26
*** ddieterly is now known as ddieterly[away]17:27
openstackgerritJakub Libosvar proposed openstack-infra/project-config: Introduce functional/fullstack Neutron Xenial jobs  https://review.openstack.org/35984317:27
*** sdake has joined #openstack-infra17:27
*** tesseract- has quit IRC17:28
*** tonytan4ever has joined #openstack-infra17:29
*** nwkarsten has quit IRC17:29
*** tosky has quit IRC17:30
openstackgerritMerged openstack-infra/devstack-gate: Update link to nodepool.yaml in README.rst  https://review.openstack.org/35935517:30
*** adrian_otto has quit IRC17:35
*** csomerville has joined #openstack-infra17:35
*** javeriak_ has joined #openstack-infra17:36
*** javeriak has quit IRC17:36
*** florianf has quit IRC17:36
*** asettle has quit IRC17:37
*** cody-somerville has quit IRC17:38
*** wajdi has quit IRC17:38
zaroclarkb: fyi, if you want to update javamelody on review.o.o it will require a restart due to this issue: https://review.openstack.org/#/c/268689/17:38
anteayaclarkb: I hope your construction noise ceases soon, should it persist I have studied this phenomenon extensively and have a spectrum of suggestions17:38
clarkbya I expected that it would need a restart17:38
clarkbanteaya: its mostly not a problem I can put headphones on if it gets really bad17:39
clarkbI am more interested in the work itself. Like how do you reside a house17:39
anteayathe low end is add a pinch of salt to your drinking water and ensure you drink much water all day17:39
anteayaah, I see17:39
anteayayes, house residing can be an intersting topic17:39
fungiclarkb: zaro: conveniently, we have a gerrit restart planned for ~72 hours from now17:39
*** cody-somerville has joined #openstack-infra17:40
anteayainteresting as well17:40
fungiwe could certainly work in a new javamelody between now and then17:40
clarkbfungi: ya not sure if we wanted to add this into that17:40
fungisounds fine to me17:41
anteayaI don't mind reviewing the patches for friday but I will share that I don't feel it is on point for me to create the etherpad17:41
anteayaI'm on and offline this week17:41
anteayaif someone else is willing I will put the patches in with any notes about their state of fitness17:42
*** csomerville has quit IRC17:42
* clarkb pokes at the isntance on review-dev17:42
*** hockeynut has joined #openstack-infra17:42
fungianteaya: yeah, also i think we decided last maintenance to try and use the ansible playbook for renaming this time17:42
anteayadid we decide that? awesome17:42
anteayaI have no idea what that workflow entails17:42
fungiand this will also be the first time we have online reindexing available17:42
anteayaso very glad i have only spoken for reviewing at this point17:43
anteayaso many firsts17:43
fungianteaya: the playbook in question is the one that's been documented in place of our old renaming process for many months17:43
anteayaah17:43
clarkbzaro: maybe you want ot propose a change to install it in puppet (I am pretty sure we install plugins via puppet)17:43
* anteaya takes fungi's hint and goes to look at the docs17:43
fungiso instead of avoiding it, we'll just give it a shot and see what breaks17:43
clarkbseems to be working fine on review-dev though it will take more work to see how to use the xmlconfig to get better data out of it17:43
*** _nadya_ has quit IRC17:43
*** shashank_hegde has joined #openstack-infra17:44
*** jkilpatr has quit IRC17:45
anteayafungi: I was looking around in here and can't seem to find it: http://docs.openstack.org/infra/system-config/sysadmin.html#root-only-information17:45
anteayaobviously I'm not looking in the right spot17:46
anteayawhere's the right spot?17:46
zaroclarkb: i've proposed change to upstream, https://gerrit-review.googlesource.com/8501017:46
fungianteaya: http://docs.openstack.org/infra/system-config/gerrit.html#renaming-a-project17:47
zaroit needs to land there before we can get a build with ver 1.6017:47
clarkbzaro: gotcha17:47
fungianteaya: steps 3&417:47
anteayafungi: ah thank you17:47
fungianteaya: basically, i expect to invert the process we've been following, and turn the old steps into a manual verification for this time around, so i can make sure the playbook does all the things we expect17:48
anteayaI like how you think17:48
*** sarob has quit IRC17:49
*** sarob has joined #openstack-infra17:51
openstackgerritRamy Asselin proposed openstack-infra/ansible-role-puppet: Ensure files are removed from puppet slaves  https://review.openstack.org/36307417:51
anteayawhat on earth happened to this list? it increased significantly: https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Upcoming_Project_Renames17:51
anteayaodyssey4me: what is with all the ansible project renames?17:52
odyssey4meanteaya hmm, those are pabelanger's roles17:53
anteayapabelanger: can you shed some light on why we suddenly need to add windmill to all the things?17:53
*** nwkarsten has joined #openstack-infra17:53
*** nwkarsten has quit IRC17:53
anteayaI'm concerned that will will suddenly need to remove windmill from all the things in the future17:53
anteayaand hoping we can avoid some churn here17:54
*** gouthamr has quit IRC17:54
*** markvoelker has joined #openstack-infra17:54
*** nwkarsten has joined #openstack-infra17:54
*** gouthamr has joined #openstack-infra17:54
*** aviau has quit IRC17:54
*** aviau has joined #openstack-infra17:55
*** sarob has quit IRC17:55
fungimordred: yolanda: jhesketh: looking back over https://review.openstack.org/175147 it seems we took out the steps for renaming/transferring repos in github but i don't see what in the playbook takes care of that. also it's doing a graceful stop of zuul via kill -URS1 which i fear will take faaaaar too long for us17:55
anteayais the current name insufficient to describe the project?17:55
anteayaor at risk of being mistaken for another similarly named project?17:55
dhellmannfungi, clarkb : I'm still seeing "feature" related failures from newton jobs even though https://review.openstack.org/#/c/362435/ has merged. Are we missing something else? http://logs.openstack.org/65/362365/1/check/gate-tempest-dsvm-neutron-src-oslo.db/bf2ea34/console.html17:56
clarkbdhellmann: is the branch called stable/newton or just newton?17:57
*** tphummel has quit IRC17:57
pabelangeranteaya: odyssey4me: Ah, yes. For example, ansible-role-ssh, is a pretty generic role name. My thought was, they should have initially been created as ansible-role-windmill-ssh, since it does relate to that project.  This way, if a project also wanted to create an ssh module for their usage, it wouldn't lead to naming like ansible-role-ssh2 (or some variation)17:57
openstackgerritgreghaynes proposed openstack/diskimage-builder: pip-and-virtualenv supports py3k only  https://review.openstack.org/36308117:57
dhellmannclarkb: branch is stable/newton17:57
dhellmannat least it should be, let me make sure that worked right17:58
*** afred312_ has quit IRC17:58
fungidhellmann: it's missing from the branches list in that same file i think17:58
dhellmannyes, stable/newton17:58
fungiallowed: [master, ocata, mitaka, liberty, kilo, juno, icehouse]17:58
clarkbfungi: aha17:58
clarkbalso how did we get ocata but no newton :/17:58
fungiindeed17:58
dhellmannyeah, I wondered about that, too17:59
AJaegerclarkb: could you comment on https://review.openstack.org/#/c/359843/6/zuul/layout.yaml, please?17:59
mordredwords are hard17:59
dhellmannI also wonder why we need all of these hard-coded, but...17:59
*** baoli has quit IRC17:59
AJaegerSee my comment - I'm not sure what's best to use for "branch: everywhere"17:59
*** asettle has joined #openstack-infra17:59
AJaegerdhellmann: add pike and queens as well ;)17:59
anteayapabelanger: are you saying this is a preemptive renaming and we should be prepareing for ansibile-role-fooproject-ssh and ansible-role-barproject-ssh ?18:00
fungidhellmann: it might be possible to assume all branches listed in the config hash are allowed and drop the branches[allowed] list18:00
*** baoli has joined #openstack-infra18:00
clarkbdhellmann: its hardcoded because the services we run used to change every cycle18:00
clarkbdhellmann: that has slowed down since then but I still think we have some variance18:00
pabelangeranteaya: yes, I believe so18:00
anteayapabelanger: and so on for all those projects?18:00
clarkbdhellmann: the most recent change had to do with the neutron advanced services going away18:00
anteayaI guess this is me not understanding ansible role repos18:00
openstackgerritDoug Hellmann proposed openstack-infra/devstack-gate: add newton to the allowed list  https://review.openstack.org/36308418:00
anteayaI don't understand why every project would need a chorus of their own repos18:01
*** Sukhdev has joined #openstack-infra18:01
anteayainstead of one18:01
*** e0ne has joined #openstack-infra18:01
*** esberglu has quit IRC18:01
anteayaansible-roles-fooproject18:01
anteayajust one18:01
anteayawhich contains any of the others that that project wants18:02
dhellmannfungi , clarkb : I'd appreciate your input on the docs for this in https://review.openstack.org/36244018:02
clarkbAJaeger: done18:02
dhellmannAJaeger, too: ^^18:02
fungiclarkb: dhellmann basically i'm not seeing a good reason to have a branch in branches[allowed] which is not also in config, or vice versa18:02
*** senk has quit IRC18:02
dhellmannfungi : I agree, but I'm in "just do what I want" mode so I don't know if my opinion is all that valid :-)18:03
fungioh, though config includes non-branch config names too18:03
anteayabecause what is proposed seems like a lot of repos and a lot of renaming18:03
*** sandanar_ has quit IRC18:03
dhellmannfungi : it seems like there should be a data model for this that does not require repeating ourselves, but I'd have to look at the implementation closer to know what that might be18:03
pabelangeranteaya: So, the issue I see, what if openstack-ansible team wanted to create ansible-role-foo today, but another project already did so. For what ever reason, collaborate could not be achieved. I believe 2 repos would eventually exist, that then both teams fighting over the namespace18:03
pabelangeranteaya: I agree, we could be encouraging teams to work together but there will be cases where it might now happen18:04
anteayaodyssey4me: care to weigh in on pabelanger's proposed problem scenario?18:04
*** Sukhdev has quit IRC18:04
anteayaodyssey4me: I don't know how ansible roles work, nor have I been spending time in the ansible social circles18:05
clarkbfungi: dhellmann ya we could probably collapse that and treat default as an implicit list of branches18:05
mordredpabelanger: I hear that ... but I think in openstack land we should be a bit more aggressive about inciting collaboration than elsewhere in teh wild world of software18:05
anteayathis just strikes me as a heck of a lot of code churn18:05
*** tesseract- has joined #openstack-infra18:05
mordredpabelanger: like, in openstack land there should really be an _excellent_ reason for having 2 of something, and it should be a thing of absolute last resort18:05
pabelangeranteaya: the other issue, is if the repo was ansible-role-fooproject-ssh, and ansible-role-barproject-ssh, it would make using ansible galaxy easy as role use the format fooproject.ssh and barproject.ssh18:05
*** tesseract- has quit IRC18:05
*** tesseract- has joined #openstack-infra18:06
anteayapabelanger: I think you might be optimizing for a problem we don't have18:06
anteayaand as mordred points out hope not to have18:06
mordredpabelanger: so - galaxy mapping for these roles I think would be "openstack.fooproject-ssh" and "openstack.barproject-ssh"18:06
odyssey4memordred anteaya pabelanger I guess it's more important to understand, for each role, whether the role is specifically built for the purpose of the windmill framework - or whether it's built to be generically used. OSA would use these role if they're clearly generic, but not if they're opinionated for a specific framework.18:06
anteayaI'm all for optimizing18:07
anteayabut let's spend some time and reach an agreement what we are optimizing for18:07
odyssey4mespecifically in the OSA case we're using very opinionated roles which are clearly named right now18:07
anteayathis seems to be an action before the discussion18:07
*** tphummel has joined #openstack-infra18:07
odyssey4meso there won't be any naming collissions for the forseeable future18:07
anteayaand I really think we should have the discussion18:07
*** spzala has joined #openstack-infra18:07
*** salv-orl_ has joined #openstack-infra18:08
dhellmannfungi : this may be what you just said, but I wonder if it would be a good idea to assume that a branch without an override just does some default thing and all stable/* branches are assumed to be safe and valid with the understanding that if we need special handling we'll add overrides at the point we recognize the need?18:08
clarkbdhellmann: ya that lgtm. Also do you have a step in there for making sure that we add the bitrot periodic jobs for the new branch?18:08
*** tesseract- has quit IRC18:08
mordredI don't have a strong opinion on this particular instance of repo names ... just saying that in generally I think we should encourgage collaboration and with these specific roles I struggle to imagine a future where that collaboration cannot happen, so I don't see there being a problem with them staying non-prefixed18:08
clarkbdhellmann: we will probably want to do that around the time that grenade gets its branching done18:08
anteayaI would like to optimize for minimal churn in renaming and creating repos and for reusing existing code in all possible circumstances18:08
mordredbut I also don't think it's super problematic to prefix them with the windmill either18:08
dhellmannclarkb : I do not. Would you like to add that info in a follow-up patch? I don't know the details...18:08
clarkbdhellmann: sure18:08
dhellmannclarkb : thanks18:08
anteayaand here is a thunderstorm so will have to go offline now18:08
mordredanteaya: enjoy the storm18:09
fungidhellmann: did you intentionally put newton before ocata in 363084? (looks like they were organized in descending order by age previously)18:09
anteayaas I lost internet for 3 days a few weeks back for not going offline early enough18:09
anteayamordred: thank you18:09
dhellmannfungi : no, I was probably just sloppy18:09
clarkbfungi: the order shouldn't matter there so I +2'd18:09
anteayawhatever is decided I'm fine with but let's have an agreement18:09
pabelangermordred: anteaya: odyssey4me: Yup, I agree. The renames can be crossed of the list today, I don't have a major opinion on it. I found the renames aid helping people relate them to a project, then general consumption18:09
anteayathanks18:09
pabelangerif this is a problem down the road, we can always revisit18:09
fungidhellmann: matching on stable/* specifically may also have unanticipated consequences (see projects like gnocchi which have branches like stable/2.2)18:10
openstackgerritDoug Hellmann proposed openstack-infra/devstack-gate: add newton to the allowed list  https://review.openstack.org/36308418:10
*** Apoorva has quit IRC18:10
odyssey4meanteaya mordred pabelanger I don't see a namespace clash being a problem now, but I do think that if the roles are intended to be opinionated and not general purpose then it should have an opinionated name18:10
dhellmannfungi : right, those projects would need to do the extra work to make their divergence function properly18:10
*** yamahata has joined #openstack-infra18:10
fungiclarkb: agreed, i approved it. as discussed it would be better to eventually find a way to remove that list entirely anyway so i don't care much about its ordering18:10
dhellmannfungi : but that would be a burden on the divergent group, and not all of the rest of us18:10
*** Apoorva has joined #openstack-infra18:10
*** tesseract- has joined #openstack-infra18:10
dhellmannfungi : oh, I just updated it with a new order so I probably reset the approval18:11
*** salv-orlando has quit IRC18:11
fungire-approved18:11
dhellmannthanks18:11
openstackgerritJakub Libosvar proposed openstack-infra/project-config: Introduce functional/fullstack Neutron Xenial jobs  https://review.openstack.org/35984318:12
pabelangerodyssey4me: Right, I think that is fair18:12
mordredodyssey4me, pabelanger: for specific instance, ansible-role-shade seems like an excellent role that is also general purpose ... covers all the install options that people typically have, etc18:12
odyssey4memordred pabelanger and possibly one we will start using next cycle :)18:12
mordredbut I could see ansible-role-zuul and ansible-role-nodepool winding up being opinionated over time18:13
pabelangermordred: odyssey4me: right, applicaton roles seem to be fine with no prefix.  ssh, scp, a utility role maybe not18:13
*** _nadya_ has joined #openstack-infra18:13
pabelangeryes18:13
odyssey4mepabelanger yep, that's the sort of thinking that makes sense to me18:13
*** tonytan4ever has quit IRC18:13
odyssey4meby the way - do we have a way to register roles into ansible galaxy yet?18:13
greghaynesTheJulia: Hey I'm running in to http://paste.ubuntu.com/23112910/ when running latest bifrost - is this something youve hit before?18:14
dhellmannfungi : the CI system is successfully commenting on closed bugs when we tag a release: https://bugs.launchpad.net/reno/+bug/160286218:14
openstackLaunchpad bug 1602862 in reno "faux bug for testing release tools and automated release job" [Low,Confirmed] - Assigned to Doug Hellmann (doug-hellmann)18:14
greghaynesoops ww :P18:14
*** tonytan4ever has joined #openstack-infra18:14
fungidhellmann: progress!18:14
pabelangerin fact, they should be as generic as possible, but as people start using roles, more roles will be created to use existing roles. So, I could see a place where ansible-role-fooproject-ssh actually uses ansible-role-barproject-ssh18:14
odyssey4memordred pabelanger maybe some sort of job we can add for the roles we want to have it done for18:14
* dhellmann does a jig18:14
pabelangerodyssey4me: not yet, last I checked it only offered github integration18:14
cineramagreghaynes: https://review.openstack.org/#/c/354626/ may be relevant?18:15
pabelangerbut it is on my list to add a publisher18:15
mordredthat is right ... and it's done via registering an org18:15
mordredlast time I poked at it by hand, I broke the galaxy importer18:15
mordredand filed a bug18:15
dhellmannfungi : I think that's the whole process now. I'll give some thought to whether we want to turn it on everywhere or continue doing manual tagging this week.18:15
mordredpabelanger, odyssey4me: apparently people with 1000s of repos in a single github org only a few of which are ansible roles wasnt' a use-case they had spent a lot of time on18:15
mordredodyssey4me: are your roles all still in subdirs of your repo?18:16
fungidhellmann: http://git.openstack.org/cgit/openstack/release-test/tag/?h=0.0.6 looks nice too!18:16
mordredoh - no, I see them now18:16
clarkbdhellmann: oh actually you want the d-g grenade branches change ot go in after all projects in the integrated gate tooling ahve stable/foo18:16
clarkbdhellmann: which I think is step RC1.118:17
clarkblet me update my review18:17
odyssey4memordred nope - we have rather a lot of repositories now - one per role18:17
dhellmannclarkb : I have another patch up somewhere that talks about that, are you saying it's wrong or did you not see it?18:17
clarkbdhellmann: I am saying 362440 is wrong, your new step needs to move down a bit18:17
clarkbdhellmann: I am updating my review18:18
dhellmannclarkb : ok, thanks for clarifying18:18
openstackgerritAleksandr Dobdin proposed openstack-infra/project-config: add: ansible-like tool  https://review.openstack.org/35983118:18
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Split additional features across the periodic jobs  https://review.openstack.org/36290418:18
dhellmannfungi : yep, the actual tagging worked after the last test run :-)18:18
clarkbdhellmann: there updated18:19
*** Na3iL has quit IRC18:19
clarkbthen I will push a change about new tests that are needed after that is updated18:19
mordredodyssey4me: yah. so the _easiest_ way to deal with galaxy is to name the roles "ansible-role-foo-bar" and then have the galaxy importer run on the whole org and find all the things. however, that won't work for your roles - and honestly it doesn't work for th eopenstack org anyway because we're too big18:19
dhellmannclarkb : oh, indeed, I was thinking those branches happen this week but they don't18:19
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Add support for Cloud Foundry plugin  https://review.openstack.org/35094018:20
mordredlast I checked there was not a rest api for registering individual role repos with their names18:20
*** kzaitsev_mb has quit IRC18:20
mordredrbergeron: ^^ ping. scrollback about importing roles into galaxy. also, assume that I grumped more around most of my sentences18:20
dhellmannclarkb : updated18:21
mordredrbergeron: what I _really_ want is a REST API that I can call that says "hey galaxy, there is a git repository at $location that is a role that should be named $role_name"18:21
odyssey4memordred if we could do a job per repo that we want to do this for, then it'd be pretty simple18:21
odyssey4methen it'd be a per repo transaction18:21
*** markvoelker has quit IRC18:22
mordredodyssey4me: yup. but we'd need an API to all18:22
mordredcall18:22
openstackgerritJames E. Blair proposed openstack-infra/zuul: Combine shared queues explicitly  https://review.openstack.org/35800918:22
openstackgerritJames E. Blair proposed openstack-infra/zuul: Re-enable the shared/independent queue test  https://review.openstack.org/35801018:22
openstackgerritJames E. Blair proposed openstack-infra/zuul: Handle a project-template with no jobs  https://review.openstack.org/36078318:22
openstackgerritJames E. Blair proposed openstack-infra/zuul: Add a python27 job variant to the OpenStack test  https://review.openstack.org/36078618:22
openstackgerritJames E. Blair proposed openstack-infra/zuul: Add an OpenStack test  https://review.openstack.org/36078418:22
openstackgerritJames E. Blair proposed openstack-infra/zuul: Pass assigned nodes to the launcher  https://review.openstack.org/36078518:22
odyssey4memordred oh you mean it needs clicketty-click ?18:22
* odyssey4me throws mud at the 90's18:22
mordredodyssey4me: it needs clicketty-click - and not only that, it MUST scan your list of repos in github to give you a list of things that you can put a checkmark by18:23
odyssey4mebwahaha, that's awful18:23
mordredodyssey4me: which means even clicketty-click it's basically not usable18:23
mordredyah18:23
mordredwell, I think it works well for people who are primarily github users and have mayve 5 or 10 repos18:23
mordredbut as we are neither of those things18:23
odyssey4meyeah - at the very least let me give it a regex18:23
mordredyah18:23
mordredor don't depend on github18:23
melwitthi, while working on nova cells v2, we discovered we need the rabbit userid variable set for grenade runs. reviews would be appreciated on the correct way to set it https://review.openstack.org/#/c/362941/18:24
*** tqtran has quit IRC18:24
clarkbmelwitt: you will probably have better luck asking in the #openstack-qa channel (most of us here are not grenade cores)18:24
mordredodyssey4me: anyway - we've pinged rbergeron and complained - so I'm sure it'll be fixed in a day or two :)18:24
*** sarob has joined #openstack-infra18:24
fungiclarkb: it's a devstack-gate change18:24
mordredclarkb loses18:25
odyssey4mehmm, but mordred don't you now work for that company that makes the thing? ;)18:25
*** tqtran has joined #openstack-infra18:25
mordredodyssey4me: indeed I do! I even have an @ansible.com email address ... but I still find that pinging rbergeron is the best way to accomplish things18:25
clarkbfungi: melwitt devsatck-gate shouldn't touch rabbit18:26
clarkbfungi: melwitt thats all configured by devstack/greande /me reads change18:26
fungiclarkb: it's passing in rabbit credentials already as envvars18:26
melwittclarkb, fungi: yeah, we thought to put it where the other related variables are being set in devstack-gate, like RABBIT_PASSWORD18:26
tlbrproject-config cores, please merge https://review.openstack.org/#/c/362096/18:26
clarkbI don't think we should set that18:26
clarkbdevstack/grenade shoudl set it if it is required by default18:26
clarkbdevsatck-gate should only set things that are necessary for our specific environemnt18:26
*** pvaneck has joined #openstack-infra18:27
fungiclarkb: should RABBIT_PASSWORD and some of those other envvars move into devstack/grenade as well?18:27
*** ddieterly[away] has quit IRC18:27
clarkbno beacuse passwords are sensitive data18:27
*** asettle has quit IRC18:27
fungiaha, right, we only have service passwords in there18:27
clarkband devsatck does not have defaults for them (it will prompt if they are not set iirc)18:27
mordredyup18:28
clarkbwhich I think is teh correct behaviopr there18:28
mordredwhich is why we set them - to avoid the prompting18:28
rbergeronmordred: reading -- and actually someone else mentioned this to me yesterday18:28
*** tqtran has quit IRC18:28
rbergeron(or they were asking if there was and i was like "i dunno?")18:28
*** tqtran has joined #openstack-infra18:28
melwittclarkb, fungi: cool, thanks for the guidance. we'll move it to devstack/grenade18:29
dansmithclarkb: so here's the deal,18:29
*** sarob has quit IRC18:29
dansmithclarkb: it's set in devstack in stack.sh, which we don't include from grenade18:29
*** sarob has joined #openstack-infra18:29
clarkbdansmith: I think grenade has a grenaderc18:30
fungimelwitt: so basically things which devstack prompts for at runtime need to be set in devstack-gate, other values needed by devstack or grenade should have defaults set by them18:30
*** tesseract- has quit IRC18:30
clarkbdansmith: or maybe you can move that into stackrc in devstack/18:30
*** tongli has joined #openstack-infra18:30
dansmithclarkb: so we can break that out somewhere in devstack and then merge the things we need in grenade, but it's blocking us from landing a thing.. is it a big deal to merge this in the short term?18:30
*** tesseract- has joined #openstack-infra18:30
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Add GitBucket plugin support  https://review.openstack.org/34870218:30
rbergeronmordred: your faith in my ability to fix things is... um... well, thanks! that feels nice. i'll not ruin the moment by letting you know that you may be overestimating my magical powers :)18:30
*** tesseract- has quit IRC18:30
clarkbdansmith: I mean how is it any longer to do one or the other?18:31
clarkbbut also we have a very strict rule to avoid making d-g required to run these tests18:31
clarkbthis change would break that rule18:31
*** tesseract- has joined #openstack-infra18:31
dansmithI dunno, I don't get it, but whatever18:31
dansmithdon't have time to argue18:31
clarkbdansmith: running grenade on its own should work18:31
clarkbdansmith: the assertion here is that it does not work and by putting the fix in devstack-gate grenade on its own will continue to not work18:32
clarkbthat is broken18:32
dansmithyeah, okay18:32
fungidevstack-gate is only intended as a wrapper for the ci to be able to launch things in a noninteractive fashion18:32
dansmithI know18:32
dansmithdidn't think about the standalone grenade still being broken18:33
dansmithnot sure why I didn't hit that before with local testing, but..18:33
odyssey4merbergeron wave your magic wand :)18:33
*** _sarob has joined #openstack-infra18:34
*** ilyashakhat has quit IRC18:34
AJaegerpabelanger: what do you think of https://review.openstack.org/362604 , https://review.openstack.org/362607 and https://review.openstack.org/362611? Could you review these, please?18:34
*** ddieterly has joined #openstack-infra18:35
rbergeronmordred: can i wheedle you into making an issue in galaxy-issues on the REST api thing? i mean, i'm about to unlock that whole thing once the license question is settled but it would be nice to make a note of that :) (esp. since things like that help me be able to say "dear lord, this is why we need to add an engineer back to this full time")18:35
*** itisha has joined #openstack-infra18:35
rbergeronodyssey4me: haha. well, watch what happens when i ask mordred to file an issue, and we'll see if that magic wand works or not :D18:36
* rbergeron waves magic wand around18:36
AJaegerproject-config cores, could you review https://review.openstack.org/361268 , https://review.openstack.org/362418 , https://review.openstack.org/361994 , please?18:36
odyssey4memordred once you have an issue done, ping me the URL and I'll raise it at our weekly meeting for hordes of support :p18:36
*** piet has quit IRC18:36
*** bin_ has quit IRC18:36
mordredrbergeron: wait - I already did " rbergeron: there should be a REST API" ... is there another way to file issues?18:37
*** yamahata has quit IRC18:37
pabelangerAJaeger: thanks, look good18:37
AJaegerthanks, pabelanger18:37
*** sarob has quit IRC18:37
*** tesseract- has quit IRC18:37
fungimordred: you're probably expected to click around on the gi-thubs18:38
rbergeronmordred: if you write me a robynbrain->json filter, then i can probably do anything :)18:38
fungiyou'd have to decide between a skulljack and wristports18:39
*** kien-ha has joined #openstack-infra18:41
*** mtanino has joined #openstack-infra18:41
jeblairmordred, fungi: can you +3 https://review.openstack.org/362968 ?18:41
fungiindeed, i have done this thing18:41
fungigood catch18:41
openstackgerritMerged openstack-infra/project-config: Switch in Fedora 24 devstack job  https://review.openstack.org/36260418:42
*** tonytan_brb has joined #openstack-infra18:42
*** Apoorva has quit IRC18:43
openstackgerritMerged openstack-infra/project-config: Add Fedora 24 non-voting puppet-apply job  https://review.openstack.org/36260718:43
openstackgerritMerged openstack-infra/project-config: Add dib dsvm job into check queue  https://review.openstack.org/36261118:43
*** tonytan4ever has quit IRC18:45
*** Apoorva has joined #openstack-infra18:45
*** tqtran has quit IRC18:46
*** _nadya_ has quit IRC18:46
*** tqtran has joined #openstack-infra18:46
hongbinAJaeger: hi, I saw you had a patch: https://review.openstack.org/#/c/363073/ . Do you need it to be part of the newton release?18:47
*** tonytan4ever has joined #openstack-infra18:47
*** yamahata has joined #openstack-infra18:48
openstackgerritMerged openstack-infra/nodepool: Add a script to print the ZK tree  https://review.openstack.org/35734818:48
*** matt-borland_ has joined #openstack-infra18:48
kien-haHey larainema, you around and busy?18:48
*** mdrabe_ has joined #openstack-infra18:49
*** tphummel_ has joined #openstack-infra18:49
openstackgerritMerged openstack-infra/system-config: Add afs02.dfw to cacti  https://review.openstack.org/36296818:49
*** salv-orl_ has quit IRC18:49
mordredodyssey4me, rbergeron: https://github.com/ansible/galaxy-issues/issues/18518:49
*** NikitaKonovalov has quit IRC18:50
*** afred312 has joined #openstack-infra18:50
openstackgerritMerged openstack-infra/zuul: Revert "Make job registration with labels optional"  https://review.openstack.org/34492918:50
*** tonytan_brb has quit IRC18:50
odyssey4memordred thx sir!18:50
*** ramishra has quit IRC18:50
*** drawsmcgraw has quit IRC18:50
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Work around Gitweb encoding in who-approves script  https://review.openstack.org/36311918:50
odyssey4melook rbergeron - magic!18:50
*** tphummel has quit IRC18:51
*** abregman has quit IRC18:51
*** jtomasek has quit IRC18:51
*** slaweq_ has quit IRC18:51
*** lxsli has quit IRC18:51
*** bknudson has quit IRC18:51
*** tphummel_ is now known as tphummel18:51
*** ianw has quit IRC18:51
*** mdrabe has quit IRC18:52
*** matt-borland has quit IRC18:52
*** apetrich has quit IRC18:52
*** lennyb has quit IRC18:52
*** NobodyCam has quit IRC18:52
*** chmouel has quit IRC18:52
*** _degorenko|afk has quit IRC18:52
*** hughhalf has quit IRC18:52
*** ivyyy has quit IRC18:52
*** mestery has quit IRC18:52
*** therve has quit IRC18:52
*** ramishra has joined #openstack-infra18:52
*** slaweq has joined #openstack-infra18:53
AJaegerhongbin: doesn't harm - but not strictly needed.18:53
*** yolanda has quit IRC18:53
hongbinAJaeger: ack. thx18:53
*** dimtruck is now known as zz_dimtruck18:54
*** NobodyCam has joined #openstack-infra18:54
*** hughhalf has joined #openstack-infra18:56
*** therve has joined #openstack-infra18:56
*** bknudson has joined #openstack-infra18:56
*** piet has joined #openstack-infra18:57
*** chmouel has joined #openstack-infra18:57
*** mestery has joined #openstack-infra18:57
*** NikitaKonovalov has joined #openstack-infra18:57
*** annegentle has quit IRC18:57
bswartzanyone know who maintains git-review?18:57
*** esp has joined #openstack-infra18:57
*** ddieterly is now known as ddieterly[away]18:58
*** annegentle has joined #openstack-infra18:58
fungibswartz: we do18:58
bswartzfungi: how can I report a bug?18:58
fungi(infra team)18:59
fungibswartz: check its CONTRIBUTING.rst (there should be a storyboard url in it)18:59
*** salv-orlando has joined #openstack-infra18:59
bswartzkk18:59
mordredbswartz: I find just walking outside and screaming at the top of my lungs often helps18:59
*** hasharAway is now known as hashar18:59
*** erlon has joined #openstack-infra18:59
fungibswartz: https://git.openstack.org/cgit/openstack-infra/git-review/tree/CONTRIBUTING.rst#n7 says it's https://storyboard.openstack.org/#!/project/71919:00
bswartzmordred: I tried that and the bug didn't go away19:00
bswartz:-)19:00
fungiit's that (weekly infra team meeting) time again! find us in #openstack-meeting for the next hour19:00
*** jtomasek has joined #openstack-infra19:03
*** lxsli has joined #openstack-infra19:04
*** ddieterly[away] is now known as ddieterly19:04
*** lennyb has joined #openstack-infra19:04
*** apetrich has joined #openstack-infra19:04
*** ivyyy has joined #openstack-infra19:04
*** abregman has joined #openstack-infra19:05
*** david-lyle_ is now known as david-lyle19:05
rcarrillocruzpabelanger: how do you feel about putting the mirror instance on the infracloud clouds_layouts ?19:05
rcarrillocruzrather than one-off launch-node.py19:05
rcarrillocruzwould be a perfect guinea pig for what we end up having on all clouds at some point19:06
pabelangerrcarrillocruz: does it work?19:06
rcarrillocruzi.e. servers:19:06
rcarrillocruz - name: mirror19:06
*** _degorenko|afk has joined #openstack-infra19:06
rcarrillocruz blah19:06
*** zz_dimtruck is now known as dimtruck19:06
rcarrillocruzit does , sure19:06
rcarrillocruzand os_server is idempotent, so...19:06
rcarrillocruzit doesn't return a sane changed/ok status, but it won't re-create the instance if it's already there19:07
pabelangerrcarrillocruz: I'm open to trying it.  I am not sure how to solve the issue with DNS in server name however19:07
*** drawsmcgraw has joined #openstack-infra19:07
*** ianw has joined #openstack-infra19:07
rcarrillocruzyeah, that would be done off cloud launcher19:07
rcarrillocruzi mean19:07
rcarrillocruzi created os_recordset and os_zone19:07
rcarrillocruzso we could put it on the launcher19:08
rcarrillocruzbut we don't use designate for infra dns19:08
rcarrillocruzso...19:08
*** ilyashakhat has joined #openstack-infra19:08
pabelangerSure, if it is working we can experiment with infracloud.19:08
rcarrillocruzbtw, the mirror flavor i just created it fine19:08
*** sshnaidm is now known as sshnaidm|afk19:08
bswartzfungi: what kind of markup does storyboard use? I can't seem to get my preformatted text to stay preformatted19:10
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Make gate-novaclient-dsvm-functional-neutron gating  https://review.openstack.org/36314619:10
*** baoli has quit IRC19:10
bswartzfungi: nm, <pre> worked19:11
*** adrian_otto has joined #openstack-infra19:11
*** coolsvap_ has quit IRC19:12
fungibswartz: yeah, i don't recall if it's rst/md or just html19:12
*** gyee has quit IRC19:12
Zaraah, it's markdown19:14
Zarahtml should work too19:14
mgagneclarkb: still working on making mtl01 region functional again. Current hypothesis is a defective network hardware, working on replacing it atm.19:14
*** armax has joined #openstack-infra19:15
*** sbezverk has quit IRC19:16
*** tmcpeak has joined #openstack-infra19:17
tmcpeakfungi: you around?19:17
fungitmcpeak: chairing the infra meeting for the next hour19:17
tmcpeakahh ok19:17
tmcpeakI'll come back :)19:17
bswartzZara: https://storyboard.openstack.org/#!/story/200071219:18
bswartzfungi: https://storyboard.openstack.org/#!/story/200071119:18
Zaraah, hm, we had something up before, I think it might have got lost in a change to a template19:18
clarkbmgagne: still blaming the network I see :P thanks for the update19:19
fungithanks, bswartz!19:19
mgagneclarkb: yea, that time, it might be network related :D19:19
*** ilyashakhat has quit IRC19:20
*** armax has quit IRC19:20
*** adrian_otto has quit IRC19:21
Zara(aha, we had a note but it was only under comments and it probably got lost with the new events timeline layout.)19:23
*** annegentle has quit IRC19:24
openstackgerritDoug Hellmann proposed openstack-infra/project-config: enable release tagging for all repos  https://review.openstack.org/36315619:25
openstackgerritMonty Taylor proposed openstack-infra/shade: Revert "Set physical_network to public in devstack test"  https://review.openstack.org/36315719:26
mordredShrews: ^^ we'll see if that works19:26
openstackgerritMerged openstack-infra/infra-specs: Zuul v3: update branches job keyword  https://review.openstack.org/36081719:26
YorikSarclarkb, mordred, fungi: can someone of you please merge https://review.openstack.org/362793 - switching jobs to voting in fuel-octane?19:27
*** ianw_ has joined #openstack-infra19:28
openstackgerritMerged openstack-infra/infra-specs: Update nodepool zookeeper spec with branch  https://review.openstack.org/36082119:28
*** Sukhdev has joined #openstack-infra19:28
*** baoli has joined #openstack-infra19:28
mriedemshould new jobs be run on xenial?19:31
*** rtheis_ has joined #openstack-infra19:33
*** dprince has quit IRC19:35
openstackgerritJakub Libosvar proposed openstack-infra/project-config: Introduce functional/fullstack Neutron Xenial jobs  https://review.openstack.org/35984319:35
*** armax has joined #openstack-infra19:35
pabelangerinc0_: mrhillsman: Wanted to see how you were making out with DNS and SSL for osic-cloud8?19:35
*** rtheis has quit IRC19:35
inc0_pabelanger, we just got ssl working, creating projects and stuff as we speak:)19:35
inc0_raddaoui, ^19:35
pabelangermriedem: for the most part, we now have ubuntu-xenial nodes online now19:36
inc0_should have it any minute now19:36
pabelangerinc0_: woah, nice19:36
*** ilyashakhat has joined #openstack-infra19:36
*** javeriak_ has quit IRC19:36
mriedempabelanger: most things still use trusty though, so does it matter, or are people encouraged to start moving new master-only jobs to xenial nodes?19:36
*** e0ne has quit IRC19:36
pabelangermriedem: I think it depends on the project. EG: nova should be on ubuntu-xenail for master19:37
*** jkilpatr has joined #openstack-infra19:37
openstackgerritMathieu Mitchell proposed openstack/diskimage-builder: (WIP) Zuul-cloner second attempt  https://review.openstack.org/36301319:38
*** jcoufal has quit IRC19:38
*** _nadya_ has joined #openstack-infra19:38
pabelangermriedem: If it is a question of no test under ubuntu-xenial or testing under ubuntu-trusty, to me ubuntu-trusty is fine.19:38
*** _nadya_ has quit IRC19:38
pabelangerwe have to support it for 2 more releases at least19:38
mriedemthis is a new job in nova's experimental queue19:39
mriedemso xenial should be fine19:39
mriedemit's master only anyway19:39
mriedemgate-tempest-dsvm-neutron-placement-full-ubuntu-xenial-nv19:39
mordred++xenial19:39
*** rcernin has joined #openstack-infra19:39
pabelangerYa, I don't think we've kicked all the tempest jobs to ubuntu-xenail yet, but pretty sure clarkb is working on that19:39
openstackgerritMathieu Mitchell proposed openstack/diskimage-builder: (WIP) Zuul-cloner third attempt  https://review.openstack.org/36301319:39
clarkbsort of got distracted by making clouds work better19:40
clarkbbut yes pleade start new jobs on xenial19:40
*** esikachev has joined #openstack-infra19:40
*** vhosakot has quit IRC19:40
openstackgerritZara proposed openstack-infra/storyboard-webclient: Re-add note that markdown formatting is supported  https://review.openstack.org/36316219:40
*** jcoufal has joined #openstack-infra19:40
Zarabswartz : ^ hopefully that helps19:41
openstackgerritMerged openstack-infra/tripleo-ci: Bump tempest version to latest  https://review.openstack.org/35564119:42
openstackgerritMatthew Treinish proposed openstack-infra/project-config: Add non-voting governance tag validation job  https://review.openstack.org/36316519:42
openstackgerritZara proposed openstack-infra/storyboard-webclient: Re-add note that markdown formatting is supported  https://review.openstack.org/36316219:43
openstackgerritMerged openstack-infra/project-config: Make Puppet jobs voting in fuel-octane  https://review.openstack.org/36279319:43
lifelessfungi: milestone?19:46
*** kzaitsev_mb has joined #openstack-infra19:47
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Create gate-tempest-dsvm-neutron-placement-full-ubuntu-xenial-nv  https://review.openstack.org/36317319:48
*** jamesdenton has quit IRC19:48
mriedemsdague: ^19:48
mriedemsdague: that will be easier than updating that d-g change19:49
mriedemalso, that test name needs more things in it19:49
*** hockeynut has quit IRC19:49
*** dprince has joined #openstack-infra19:50
sdaguemriedem: where is the d-g patch?19:52
sdagueI don't think that ENABLED_SERVICES thing is going to work, will it19:52
*** _nadya_ has joined #openstack-infra19:52
*** _nadya_ has quit IRC19:52
*** javeriak has joined #openstack-infra19:53
openstackgerritPaul Belanger proposed openstack-infra/project-config: Run windmill-jobs-trusty(-nv) on master  https://review.openstack.org/36290019:53
dhellmannthe release team would like to turn on the automation for tagging, but we want to do it early tomorrow when we'll be around to babysit a few jobs. Who's likely to be around early in the day tomorrow to approve https://review.openstack.org/#/c/363156/ ?19:53
openstackgerritPaul Belanger proposed openstack-infra/project-config: Switch windmill-jobs-centos7 for voting  https://review.openstack.org/36290819:53
openstackgerritMatthew Treinish proposed openstack-infra/project-config: Add non-voting governance tag validation job  https://review.openstack.org/36316519:53
*** akshai has joined #openstack-infra19:53
*** jcoufal has quit IRC19:54
mriedemsdague: yes it does https://review.openstack.org/#/c/362441/19:54
mriedemit's required, else you get default ENABLED_SERVICES in devstack which doesn't include placement-api19:54
*** tqtran has quit IRC19:54
mtreinishrcarrillocruz: btw, did you see the new mqtt thing I'm looking at: https://github.com/mtreinish/lpmqtt19:54
AJaegerdhellmann: just ask for infra-root and most of the team will see it...19:55
dhellmannAJaeger : ok, thanks19:55
openstackgerritSteve Lewis (stevelle) proposed openstack-infra/project-config: add release notes jobs for ceilometermiddleware  https://review.openstack.org/36317619:56
*** tqtran has joined #openstack-infra19:56
openstackgerritPaul Belanger proposed openstack-infra/project-config: Run windmill-jobs-trusty(-nv) on master  https://review.openstack.org/36290019:57
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Remove fail_required parameter from convert xml  https://review.openstack.org/34614019:57
mordreddhellmann: I'll also be around early in the morning19:57
mordreddhellmann: I usually awaken at 6am central time19:57
*** harlowja has quit IRC19:58
openstackgerritPaul Belanger proposed openstack-infra/project-config: Switch windmill-jobs-centos7 for voting  https://review.openstack.org/36290819:58
dhellmannmordred : ack, thanks19:58
pabelangerAJaeger: thanks19:58
rcarrillocruzoO19:58
*** vhosakot has joined #openstack-infra19:58
*** inc0_ has quit IRC19:59
*** Apoorva has quit IRC20:00
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Remove fail_required parameter from convert xml  https://review.openstack.org/34614020:00
*** Sukhdev has quit IRC20:00
fungilifeless: nova's master branch now comes with bindep configuration, as of a few hours ago20:01
fungiistr that was one of the frustrating repos that drove you to first try to come up with consistent distro dependency docs for running tests, and then writing a tool to parse them20:02
*** berendt has quit IRC20:02
*** shardy has quit IRC20:02
*** afred312 has quit IRC20:04
*** shardy has joined #openstack-infra20:05
*** fguillot has quit IRC20:06
*** kzaitsev_mb has quit IRC20:08
*** jcoufal has joined #openstack-infra20:08
*** tqtran has quit IRC20:08
*** ddieterly is now known as ddieterly[away]20:09
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Remove fail_required parameter from convert xml  https://review.openstack.org/34614020:09
*** tqtran has joined #openstack-infra20:09
mriedemAJaeger: you want me to remove this then? https://review.openstack.org/#/c/363173/1/zuul/layout.yaml20:10
mriedemthe stable skips i mean20:10
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Remove fail_required parameter from convert xml  https://review.openstack.org/34614020:11
AJaegermriedem: yes, please.20:11
*** sdake has quit IRC20:11
*** pradk has quit IRC20:11
*** tqtran has quit IRC20:12
*** sdake has joined #openstack-infra20:12
*** mdrabe_ is now known as mdrabe20:13
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Create gate-tempest-dsvm-neutron-placement-full-ubuntu-xenial-nv  https://review.openstack.org/36317320:15
mriedemAJaeger: done - sdague: want to get that again? ^20:15
*** ddieterly[away] is now known as ddieterly20:15
sdague+A20:15
sdaguesorry, +220:16
sdagueI'll wait for AJaeger20:16
*** sbezverk has joined #openstack-infra20:16
mriedemheh,20:16
*** pradk has joined #openstack-infra20:16
mriedembold20:16
mriedemlike hugh jackman20:16
AJaegersdague: Ok, I did the +2A ;)20:16
mriedemAJaeger: thanks20:16
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Add mirror server for vanilla infracloud  https://review.openstack.org/36318620:17
rcarrillocruzpabelanger: ^20:17
*** dtardivel has quit IRC20:17
*** ddieterly is now known as ddieterly[away]20:19
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Update support for BuildResultTrigger plugin  https://review.openstack.org/32161920:19
fungitmcpeak: i'm mostly around again now. what did you need?20:20
tmcpeakhey, can you email me what you normally send for embargoed OSSA?20:20
tmcpeakfungi: ^20:20
*** kgiusti has left #openstack-infra20:20
*** esberglu has joined #openstack-infra20:21
tmcpeakspecifically the email template and recipient list please20:21
*** tqtran has joined #openstack-infra20:21
*** kien-ha has quit IRC20:22
fungitmcpeak: sure, just a sec and i'll get those over to you. what address do you want them going to?20:22
pabelangerrcarrillocruz: comment on server name20:22
tmcpeakfungi: PM'd, thanks!20:22
pabelangerrcarrillocruz: that's the actually DNS format we use for other clouds20:22
rcarrillocruzagreed on putting the region20:23
rcarrillocruzbut the subdomain for the infracloud20:23
rcarrillocruzis ic.openstack.org20:23
rcarrillocruztherefore it should be mirror.regionone.vanilla.ic.openstack.org ?20:23
pabelangeryes, however mirrors are openstack.org20:23
fungitmcpeak: the template for our embargoed notices is documented at https://security.openstack.org/vmt-process.html#downstream-stakeholders-notification-email-private-issues20:23
rcarrillocruzoh really?20:24
rcarrillocruzregardless if we have a specific subdomain for the infracloud ?20:24
openstackgerritMathieu Mitchell proposed openstack/diskimage-builder: Introduce 'zuul' as a new source-repositories type  https://review.openstack.org/36301320:24
pabelangerrcarrillocruz: correct: http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/scripts/configure_mirror.sh#n2720:24
rcarrillocruzaha20:25
rcarrillocruznodepool_cloud var20:25
rcarrillocruzi see, thx20:25
*** gyee has joined #openstack-infra20:25
*** rtheis_ is now known as rtheis20:26
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/system-config: Add mirror server for vanilla infracloud  https://review.openstack.org/36318620:27
*** esberglu_ has joined #openstack-infra20:27
*** esberglu has quit IRC20:28
*** esberglu_ is now known as esberglu20:28
openstackgerritMathieu Mitchell proposed openstack-infra/project-config: Leverage zuul-cloner (instead of git) in diskimage-builder  https://review.openstack.org/36319020:28
*** sbezverk_ has joined #openstack-infra20:29
*** sbezverk has quit IRC20:29
openstackgerritMathieu Mitchell proposed openstack-infra/project-config: Leverage zuul-cloner (instead of git) in diskimage-builder  https://review.openstack.org/36319020:30
*** hrybacki is now known as hrybacki|afk20:31
*** esberglu has quit IRC20:32
openstackgerritMathieu Mitchell proposed openstack/diskimage-builder: Introduce 'zuul' as a new source-repositories type  https://review.openstack.org/36301320:33
*** esberglu has joined #openstack-infra20:33
*** esberglu has left #openstack-infra20:33
*** rcernin has quit IRC20:33
*** rcernin has joined #openstack-infra20:33
*** Apoorva has joined #openstack-infra20:34
*** kzaitsev_mb has joined #openstack-infra20:35
*** trown is now known as trown|outtypewww20:35
*** bethwhite_ has quit IRC20:37
*** awayne has joined #openstack-infra20:37
*** markusry has quit IRC20:39
*** ianw has quit IRC20:39
*** ianw_ is now known as ianw20:39
openstackgerritMerged openstack-infra/project-config: Create gate-tempest-dsvm-neutron-placement-full-ubuntu-xenial-nv  https://review.openstack.org/36317320:40
*** javeriak has quit IRC20:41
*** ilyashakhat has quit IRC20:41
*** nmagnezi has quit IRC20:45
*** ddieterly[away] is now known as ddieterly20:46
mriedemAJaeger: it takes awhile for a new job to show up in a queue right?20:47
mriedemlike 30 min?20:47
*** asettle has joined #openstack-infra20:49
*** raildo has quit IRC20:49
mgagnemriedem: IIRC, Puppet runs every ~30m by default20:49
mriedemok20:49
*** tmcpeak has left #openstack-infra20:50
*** dizquierdo is now known as dizquierdo_afk20:50
fungimriedem: mgagne: we shoot for every 15 minutes, but some of the updating is serialized and a full run can end up taking longer. we run them under a flock wrapper so that there won't be multiple concurrent runs, hence often we can end up missing the next 15-minute pulse (making it 30 minutes)20:51
mgagnefungi: is puppet apply running with a cron? or was it replaced with ansible?20:51
fungimgagne: yes and yes20:52
fungiit's puppet-apply via ansible running under cron20:53
mgagneansible in cron triggering puppet apply? :D20:53
mgagnehehe20:53
openstackgerritMichael Krotscheck proposed openstack-infra/project-config: NPM DSVM jobs are now voting.  https://review.openstack.org/36320020:53
*** shardy has quit IRC20:53
*** ilyashakhat has joined #openstack-infra20:53
openstackgerritMerged openstack-infra/devstack-gate: add newton to the allowed list  https://review.openstack.org/36308420:54
*** yolanda has joined #openstack-infra20:55
*** ilyashakhat has quit IRC20:56
*** chem has quit IRC20:57
*** e0ne has joined #openstack-infra20:58
*** baoli has quit IRC21:00
clarkbdhellmann: https://review.openstack.org/363202 I don't have example changes for you yet. Maybe we use this cycle to come up with some examples and add them in when we hit that point of the release?21:02
dhellmannclarkb : yeah, that seems good21:03
*** e0ne has quit IRC21:03
*** _alastor1 is now known as _alastor-21:03
dhellmannclarkb : I'll review what you have tomorrow, and add the steps to the release team tracking etherpad with a note to talk to you about the details at that point21:03
clarkbdhellmann: sounds good. In the past infra+qa have sort of just figured it out as the release happene but since we are writing all of this down likely good to do so for this too even if you still prod infra/qa to do the work21:04
*** _alastor- is now known as _alastor__21:04
dhellmannclarkb : exactly21:04
*** jkilpatr has quit IRC21:05
*** e0ne has joined #openstack-infra21:06
*** jamielennox is now known as jamielennox|away21:06
clarkbdhellmann: mtreinish may have some input on the exact time of the release where we do that21:07
clarkbmtreinish: maybe you can review https://review.openstack.org/363202 when you have a moment? since I know you ahve done a lot of the qa side of this process in the past21:07
mriedemseems someone goofed up here https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L281221:08
amrithis this the right place to ask a question about being unable to install packages for a project? Trying to install packages for tempest and I get a failure that there's no version of hacking that meets requirements. See: https://gist.github.com/amrith/d55b648b3a9f0d836e67ec9290af7b3a21:08
*** jcoufal has quit IRC21:08
*** dprince has quit IRC21:08
*** esberglu has joined #openstack-infra21:09
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Remove unused gate-tempest-dsvm-full-ceph-plugin-src filter  https://review.openstack.org/36320521:09
*** mhickey has quit IRC21:10
mgagnemriedem: time to add a check against such errors :D21:10
clarkbamrith: https://pypi.python.org/simple/hacking/ has an 0.11.0 are you using a local mirror or something?21:11
amrithclarkb I'm not using anything fancy21:11
amrithI'm halfway through a devstack install21:11
amrithand this craps out21:11
amrithrepeatedly21:11
clarkbamrith: ya that could happen if you are using a mirror for pypi that doesn't have the package for example21:12
clarkbbut the package definitely exists on pypi21:12
amrithonly thing I can see that is odd is that requirements repo has <0.12, >=0.1021:12
amrithand I have 0.10 on my machine21:12
*** jcoufal has joined #openstack-infra21:12
*** _alastor__ has left #openstack-infra21:12
clarkbpip should update if the requirement requires it21:12
*** spzala has quit IRC21:12
clarkband it can find a suitable thing to update to21:12
amrithand, I can say for sure that I'm not using a private mirror because it is trying to go to pypi.python.org21:13
*** thorst has quit IRC21:13
*** ldnunes has quit IRC21:13
amrithclarkb would you mind spinning up a venv and trying to pip install that test-requirements.txt?21:13
clarkbamrith: sure21:13
mtreinishclarkb: I left a comment on the review, but it lgtm21:15
*** tqtran has quit IRC21:15
mtreinishwe normally start adding jobs after things branch, but there never is a real rush until the actual release21:15
clarkbamrith: worked fine here21:15
*** tqtran has joined #openstack-infra21:15
amrithhmm thx clarkb21:15
amriththat's not what I was hoping to hear :(21:15
mtreinishI think we normally wait until the real release, but it's been 6months so I'm a bit hazy on the details21:15
* mtreinish checks logs21:16
clarkbamrith: make sure your setuptools and pip are up to date?21:16
amrithchecking, one second21:16
clarkbmtreinish: I think that may have been more uncoordination than anything else though. Once the branches exist everywhere we should be good to start the tests ya?21:16
*** rhallisey has quit IRC21:16
*** harlowja has joined #openstack-infra21:17
*** hockeynut has joined #openstack-infra21:17
mtreinishclarkb: yeah21:18
mtreinishclarkb: oh, looks like you did it for mitaka: https://review.openstack.org/#/c/295499/ and it was after things were branched (and before the release)21:18
openstackgerritFatih Degirmenci proposed openstack-infra/jenkins-job-builder: Add support for Parameterized Scheduler Plugin  https://review.openstack.org/35316521:19
*** gouthamr has quit IRC21:19
*** matt-borland_ has quit IRC21:20
*** rtheis has quit IRC21:20
*** cdent has quit IRC21:22
*** e0ne has quit IRC21:23
amrithclarkb, looks like maybe port 443 is getting blocked somewhere21:23
amrithhave to figure out what's going wrong here21:23
*** pfallenop has quit IRC21:24
*** sdake has quit IRC21:26
*** salv-orlando has quit IRC21:26
*** yolanda has quit IRC21:28
*** rlandy is now known as rlandy|brb21:28
*** cody-somerville has quit IRC21:29
*** rfolco has quit IRC21:29
openstackgerritMathieu Gagné proposed openstack-infra/project-config: Check for jobs without attributes in Zuul layout.yaml  https://review.openstack.org/36321421:30
*** cody-somerville has joined #openstack-infra21:30
mgagnemriedem: ^ checking for orphan job regexes21:30
*** fguillot has joined #openstack-infra21:30
*** hockeynut has quit IRC21:31
*** pfallenop has joined #openstack-infra21:31
openstackgerritMerged openstack-infra/system-config: Add mirror server for vanilla infracloud  https://review.openstack.org/36318621:31
*** sdake has joined #openstack-infra21:32
*** armax has quit IRC21:32
*** jkilpatr has joined #openstack-infra21:32
*** shashank_hegde has quit IRC21:33
*** ddieterly is now known as ddieterly[away]21:34
*** claudiub has quit IRC21:35
* clarkb attempts to upload ubuntu-trusty to rax-ord again :(21:36
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: [WIP]: Replace watch thread with periodic thread  https://review.openstack.org/36321721:36
clarkbeventually its gonna work right?21:36
clarkbwould be so nice to just get that off my plate so I can focus finally on xenialing things21:37
mgagnemadness :O21:37
*** rfolco has joined #openstack-infra21:37
*** vhosakot has quit IRC21:37
clarkbneed more systemd and newer ovs and all that21:37
*** ddieterly[away] is now known as ddieterly21:37
*** flepied2 has quit IRC21:37
*** adriant has joined #openstack-infra21:37
*** dizquierdo_afk has quit IRC21:38
*** rfolco has quit IRC21:39
*** spzala has joined #openstack-infra21:40
*** fguillot has quit IRC21:40
*** vhosakot has joined #openstack-infra21:40
pabelangerclarkb: since upload centos-7 to osic-cloud1, we haven't had a failure in 6 hours21:41
pabelangerminus the IndexError that nodepool.o.o gets21:41
clarkbpabelanger: wow thats awesome21:41
pabelangerindeed21:41
pabelangerit will be more awesome when we get 24hours !21:42
pabelangerthen 2 days, and so on21:42
*** jcoufal has quit IRC21:43
*** Swami has quit IRC21:44
*** spzala has quit IRC21:44
*** jcoufal has joined #openstack-infra21:46
*** shashank_hegde has joined #openstack-infra21:47
mordredclarkb, pabelanger: woot!21:48
*** eharney has quit IRC21:48
*** shashank_hegde has quit IRC21:49
*** salv-orlando has joined #openstack-infra21:49
*** esberglu_ has joined #openstack-infra21:50
*** asettle has quit IRC21:51
*** shashank_hegde has joined #openstack-infra21:51
*** asettle has joined #openstack-infra21:51
*** esberglu has quit IRC21:52
*** tonytan4ever has quit IRC21:54
*** esberglu_ has quit IRC21:54
*** esberglu has joined #openstack-infra21:55
*** asettle has quit IRC21:56
*** rlandy|brb is now known as rlandy21:56
*** eventingmonkey has joined #openstack-infra21:58
*** jcoufal has quit IRC21:58
*** esberglu has quit IRC21:59
*** eventingmonkey has quit IRC22:00
*** mriedem has quit IRC22:01
clarkbZOMG THE RAX-ORD UBUNTU-TRUSTY IMAGE UPLOADED \o/22:02
clarkbforgive my yelling but this was like the 10th attempt22:02
clarkbnow I can finally put that behind me22:03
*** jcoufal has joined #openstack-infra22:04
greghaynesclarkb: ow my ears22:04
*** eventingmonkey has joined #openstack-infra22:04
mordredclarkb: woot!22:04
mordredwow22:04
mordredthat was two woots in a row from me22:05
*** rajinir has quit IRC22:05
clarkbwe should have working ntp across the board now I think22:05
clarkbso now we can take our time planning how to do it in the distro release proper way for each of our platforms22:05
*** fguillot has joined #openstack-infra22:05
clarkbchronyd and the systemd thing etc22:06
cloudnullclarkb pabelanger thats awesome!22:06
pleia2ah, good22:06
*** ddieterly is now known as ddieterly[away]22:08
*** ddieterly[away] has quit IRC22:08
*** hashar has quit IRC22:10
rcarrillocruzhmm, pabelanger the server creation fails as tehre's no ubuntu-trusty image on the openstackci tenant, but it's visible on the zuul and admin ones ...22:10
*** mdrabe has quit IRC22:11
rcarrillocruzthey''re both private22:11
mordredrcarrillocruz: should probably upload the ubuntu-trusty image as public22:11
rcarrillocruzyup22:11
* mordred shuts back up22:11
rcarrillocruzrandom question: if you have 2 images on two different tenants, both having the same checksum (therefore being equal), does glance upload them twice ?22:13
openstackgerritBen Carr proposed openstack-infra/git-review: Always display Contributor Agreement Error  https://review.openstack.org/36329322:13
rcarrillocruzor is it intelligent enough to just reference the same file, even though they are seen as 'private' to the tenants22:13
rcarrillocruz?22:13
clarkbrcarrillocruz: I think it depends on the backend22:14
clarkbrcarrillocruz: glance itself isn't going to do anything smart about it I don't think22:14
rcarrillocruzhmm, k22:15
mordredyah22:15
mordredceph will de-dupe I believe22:15
*** nwkarsten has quit IRC22:15
rcarrillocruzmordred: btw, in this case it would be superawesome to have os_image being able to pull from a URL22:15
rcarrillocruzi.e.22:16
rcarrillocruzimage_url: http://cloud-images.ubuntu.com/blah22:16
*** nwkarsten has joined #openstack-infra22:16
rcarrillocruziirc that was not put yet on the shade backend , was it?22:16
mordredno, because it's storngly different between v1 and v2 and my understanding of the intent is that it is not intended to be a thing22:16
mordredor, it's intended to be a thing in the new image upload world order, but isn't yet22:17
mordredor something22:17
mordredit's messy enough that I've been staying away from it in shade on purpose22:17
clarkbalso won't it redownload from there each time or something?22:17
mordredwell - that's a v1 behavior22:17
mordredyou used to be able to set glance up to store nothing ever and always reference the image remotely22:17
mordredso it would re-download into each compute cache, aiui22:17
rcarrillocruzso, now question is22:18
mordredbut it turns out nobody actually wanted tha tbehavior (go figure)22:18
rcarrillocruzdo i pull official ubuntu-trusty prior to upload to oepnstackci tenant22:18
rcarrillocruzor do i upload our 'ubuntu-trusty'22:18
rcarrillocruzthis for th emirror22:18
mordredI'd do ours22:18
mordredif it was me22:18
rcarrillocruzk22:18
mordredbut - I'm often wrong22:18
clarkbmordred: so it will grab it locally on the first use in v2 or something?22:18
fungircarrillocruz: did your patch for launch-node.py land?22:19
rcarrillocruzno, i wip'd because i wanted to fix the volume thing22:19
fungitrying to launch a new server in rax-dfw and it's dying on ping6 failures22:19
fungii can't remember what it way you ended up patching22:19
rcarrillocruzhowever clarkb told me the the /dev/whatever naming really depends on vendor22:20
rcarrillocruzand need time to play with various providers to put a sane solution to that22:20
fungiyeah, it depends on hypervisor for the most part22:20
clarkbrcarrillocruz: ya the best way would be /disk/by-uuid or whatever the path is that is consistnet22:20
mordredclarkb: no- in v2 that entire concept goes away22:20
rcarrillocruzso for now, i'm putting the mirror for infracloud on clousd_layouts.yaml22:20
*** nwkarsten has quit IRC22:20
clarkbrcarrillocruz: basically the devname changes among clouds but cinder should always give you part of the volume uuid under /dev/disk or something22:20
rcarrillocruzwill launch it with the cloud launcher22:20
rcarrillocruzand then manually run the playbooks to make the swap22:21
rcarrillocruzbootstrap puppet22:21
rcarrillocruzetc22:21
mordredclarkb: /dev/by-name and /dev/by-uuid are both things cinder should be setting, actually22:21
fungircarrillocruz: so what was it we needed to fix in launch-node? was it something to do with network connectivity testing?22:21
mordredclarkb: BUT22:21
mordredclarkb: they're backend specific22:21
mordredeven still22:21
clarkbmordred: the uuid one is consistent iirc22:21
mordredso we'd need to check that rackspace/xen has implemented each of them22:21
rcarrillocruzfungi: i'm confused, you mean https://review.openstack.org/#/c/320466/15/playbooks/launch_node.yml22:21
mordredclarkb: yeah? xen is setting by-uuid?22:21
rcarrillocruz?22:21
clarkbmordred: its /dev/vde or whatever that is wrong22:21
clarkbs/wrong/inconsistent/22:21
openstackgerritMatthew Treinish proposed openstack-infra/project-config: Add lpmqtt project  https://review.openstack.org/36329622:21
openstackgerritMatthew Treinish proposed openstack-infra/project-config: Add puppet-lpmqtt project  https://review.openstack.org/36329722:21
rcarrillocruzmy launch-node stuff was pure ansible, not python22:21
clarkbmordred: oh thats a good question22:21
rcarrillocruzianw was touching launch-node.py22:22
fungircarrillocruz: oh, i thought you said you had a patch for launch-node.py22:22
rcarrillocruzi think that's what you meant22:22
openstackgerritGraham Hayes proposed openstack-infra/project-config: Add new worker-model job, and remove 2 legacy dvsm jobs  https://review.openstack.org/36069522:22
fungircarrillocruz: yep! i was thinking of ianw, sorry!22:22
mordredclarkb: yah. well, I know you can do like "cinder volume create foo" and then get at it with /dev/by-name/foo or whatever th ereal syntax is ... on kvm22:22
rcarrillocruznp22:22
mordredand we talked to BobBall about getting that done in xen too and he was like "neat, yeah, we should totally do that"22:22
mordredin any case - I think checking both impirically on rackspace is a good idea22:23
clarkbya22:23
mordredthey should both work on all the kvm clouds22:23
fungilooks like ianw's stuff is the stack ending at https://review.openstack.org/35950022:23
*** jkilpatr has quit IRC22:23
*** spzala has joined #openstack-infra22:24
rcarrillocruzgah, nodepool has only zuul osccs22:25
rcarrillocruzi'll need to put a tmp clouds.yaml with the openstackci tenant to upload the image from there22:25
* rcarrillocruz calls it a day22:25
clarkbmordred: I am not seeing what I expect on review-dev22:26
*** ianw has quit IRC22:26
*** madhuvishy is now known as madhuvishy_afk22:26
jheskethMorning22:26
mordredclarkb: yeah. I don't think xen does by-uuid22:26
mordredclarkb: | 4237e97c-051f-4c75-906d-8720e57fd0c9 | review.openstack.org/main01                          | in-use    |  200 | Attached to review.openstack.org on /dev/xvdc           |22:27
clarkbmordred: thats frustrating because nova refuses to fix the bug where you don't get the right device name back from it22:27
*** rlandy has quit IRC22:27
mordredmordred@review:~$ ls /dev/disk/by-uuid22:27
clarkbmordred: so we can't rely on the device name nor the uuid info22:27
mordred226609b9-ac73-42d8-85b0-d5f6de37f7c7  b6a9f32f-5fd9-4db9-8270-e04aeb26fe4b22:27
mordred5b1d90b4-f63c-40ee-a131-0c0bfc07fed7  f24ccd27-7b45-46a3-8cfa-47889bc01c8822:27
clarkb:|22:27
mordredclarkb: you get the right device name back from cinder I think?22:28
mordredor maybe not?22:28
clarkbmordred: nope22:28
clarkbbecause nova refuses to fix the bug22:28
clarkbthey closed it on me22:28
mordredawesome22:28
mordredAttached to review.openstack.org on /dev/xvdc seems to be correct for that volume at least22:28
*** apetrich has quit IRC22:28
clarkbya it works in some clouds and not in others22:29
mordredSO ...22:29
clarkbyou also can't specify the dev name reliably either22:29
clarkbwhich was another workaround I tried22:29
clarkblike just use /dev/clarkbsdisk22:29
mordredby-uuid works on all of the kvm clouds, it's just the way the libvirt driver works aiui22:29
mordredso maybe we try by-uuid ... if that doesn't work try the device name returned by nova, and if _that_ doesn't work, we throw our hands in the air and say "d00d, fix yo cloud"22:30
clarkbyou shouldn't use the device name returned by nova at all22:30
clarkbbeacuse it can give you the wrong volume22:30
clarkblike it will give you data22:30
*** apetrich has joined #openstack-infra22:30
mordredhave we seen that happen in rax?22:30
clarkbbut what it will give you is your config drive or your other volume22:30
clarkbno I haven't tested it extensively in rax22:31
clarkbbut we config drive in rax so the fear is there22:31
clarkbmordred: probably the test to do is boot an instance with a config drive and 2 volumes22:31
clarkbthen ask nova22:31
mordredwell, I tihnk we should test it in rax - bceause rax is the only cloud without by-uuid22:31
*** vhosakot has quit IRC22:31
clarkbsince the no config drive one volume case is the trivial one22:31
clarkband that seems to work generally22:31
fungiwhich provider was it where we consistently witnessed the devicename being incorrect>?22:32
clarkbvexxhost22:32
fungiaha, right22:32
clarkbbecause we got config drive there by default iirc22:32
clarkband then nova would tell you the device name but the device it gave belonged to the config drive not the attached volume22:33
clarkbI worked around that in vexxhost by telling nova/cinder what the device name should be but that didn't work in osic22:34
*** eventingmonkey has quit IRC22:34
clarkbso I filed a bug which got closed int he name of keeping nova's bug list small or something22:34
cloudnullclarkb: is there an extension you need/want enabled?22:35
clarkbcloudnull: no I think it was mentioned that nova is or has deprecated that behavior so it not working out of the box is expected22:35
mordredclarkb: I am incorrect, I apologize22:35
mordredit doesn't work on vexxhost either - the by-uuid22:35
clarkbmordred: check by-label?22:35
cloudnullis it is just the block device mount path?22:35
clarkbmordred: or by-name its one of them and it puts the uuid of the volume in there22:35
clarkbcloudnull: the device path in /dev yes22:35
mordredlrwxrwxrwx 1 root root   9 Jul 31 21:33 config-2 -> ../../vdc22:35
cloudnulli think that only works in xen hosts.22:35
mordredlrwxrwxrwx 1 root root  10 Jul 31 21:33 cloudimg-rootfs -> ../../vda122:35
mordredlrwxrwxrwx 1 root root  10 Jul 31 21:33 afscache -> ../../dm-022:35
mordredcloudnull: yah. that works22:36
*** gordc has quit IRC22:36
clarkbmordred: it was one of them and it didn't give the entire cinder uuid it gave some prefix22:36
fungiclarkb: basically, if you attach a new empty cinder volume, you can't guarantee you can programmatically identify it from within the guest22:36
clarkbbut it seemed to work on the kvm hosts I looekd at I just forget which section it was under22:36
mordredclarkb: actually, no - it's still not right22:36
cloudnullah.22:36
fungier, cloudnull ^22:36
fungisorry, clarkb22:36
*** jamesdenton has joined #openstack-infra22:36
mordredclarkb: so - we can tell that vdc is config-2 which is config drive22:36
*** sdake has quit IRC22:36
mordredbut afscache is, I believe, the logical volume name22:37
cloudnullsorry late to the convo, but does the blkid not give a consistent UUID?22:37
clarkbcloudnull: it doesn't match the uuid in cinder22:37
clarkbthey are different ids22:37
fungione option floated was that you could write a signature header to every fresh cinder volume and then identify it by reading the first few bytes22:37
mordredclarkb: yup. afscache there is from the lvm name22:37
cloudnullah. yea. i remember that.22:37
cloudnull:|22:37
mordredcloudnull: /dev/vdb1 is the cinder volume22:38
clarkbmordred: is there a vexxhost host I can look at?22:38
*** spzala has quit IRC22:38
anteayamordred: sorry I was away due to the storm, can I summarize the whole "we need a 1:1 repo:role mapping for ansible because that is what galaxy expects" as the root of the issue?22:38
mordredclarkb: mirror.ca-ymq-1.vexxhost.openstack.org22:38
fungibut that would require some added magic in cinder drivers that might not be feasible on certain backends22:38
clarkbmordred: oh tahts still there neat22:38
mordredanteaya: which issue?22:38
*** spzala has joined #openstack-infra22:38
clarkbmordred: its /dev/disk/by-id22:38
anteayamordred: the ansible role renaming thing we were discussing when I disappeared22:38
mordredfor anyone playing along ...22:38
mordredhttp://paste.openstack.org/show/564907/22:38
clarkbmordred: virtio-17eeb39d-c6de-4e32-822:38
clarkbthats the thing we need to look for that uuid prefix will match the one in cinder22:39
anteayamordred: the multiple ansible patches up for rename on friday22:39
fungiclarkb: the (unfortunate) way i end up handling it is to manually review dmesg output looking for newly discovered block devices, but that doesn't help if you're adding new volumes at server creation22:39
anteayasigh the storm is not over22:39
mordredclarkb: ^^ wait ... how did you find that?22:39
clarkbmordred: just ls -l /dev/disk/by-id ? When I was grumping about this thats what the cinder/nova people told me to use22:39
mordredclarkb: ls /dev/disk/by-uuid does not list that device22:39
clarkbI just couldn't remember the path22:39
mordredAH22:40
mordredby-id22:40
mordrednot by-uuid22:40
clarkbmordred: but you are right I don't think xen does that22:40
mordredit does not22:40
mordredjust checked22:40
clarkbso we can check for that and if that doesn't exist do something hand wavy for rax22:40
mordredbut if xen is correct with the nova return value22:40
*** piet has quit IRC22:40
mordredyah22:40
*** amitgandhinz has quit IRC22:41
mordredlike, I think for the general kvm case, it does seem like it's _possible_ to do a list of things that are /dev/disk/by-id/virtio-*22:41
mordredand see which one minus virtio- match the start of the uuid of the volume22:41
mordredand then we should test rax a few hundred times to see if it behaves like we want or also suffers from the bug22:41
*** amitgandhinz has joined #openstack-infra22:42
*** spzala has quit IRC22:43
mordredor maybe johnthetubaguy magically knows if rax has this issue22:43
docaedoso quiet! seems like a good time to beg for another +2 ;) https://review.openstack.org/#/c/358909/22:45
* anteaya powers down again since thunder has returned22:45
*** Swami has joined #openstack-infra22:47
*** Swami_ has joined #openstack-infra22:47
fungiugh. i hate it when a node launch doesn't get far enough along to set up my account, so i can't ssh into it to check the syslog to see where puppet broke22:48
*** jamesdenton has quit IRC22:48
mordredfungi: one of these days, I swear I'm going to get the whole "we should have our own base images for control plane" thing sorted out22:48
asselin_fungi, I though the private key was saved....it is at least for the unmerged ansible version of launch-node22:49
openstackgerritMerged openstack-infra/puppet-apps_site: Include package python-dateutils  https://review.openstack.org/35890922:52
fungiasselin_: oh, i wonder if i can ssh in as root from our puppetmaster22:53
asselin_fungi, what I was doing was ssh -i /tmp/launch-key-123 ubuntu@<ip>22:53
fungii'll have to see if launch-node.py preserves that22:54
jeblairfungi: if you pass --keep, it will preserve the jobdir with the key in it.22:54
fungilooks like no, it's probably a feature of the ansible role rcarrillocruz is working on in that case22:54
fungijeblair: aha, i'll find the jobdir then22:54
jeblairfungi: http://git.openstack.org/cgit/openstack-infra/system-config/tree/launch/launch-node.py#n14322:54
asselin_fungi, yeah...maybe it's a feature...it's supposed to delete, but if something goes wrong, the delete part never happens22:55
*** rbrndt has quit IRC22:56
jeblairfungi: probably the missing piece here is that it doesn't print the jobdir.  but you can probably find it.22:56
*** ianw has joined #openstack-infra22:57
jeblairfungi: ls /tmp/*/id_rsa -lta22:57
fungiin fact it does print it, i think, insofar as there's debug output mentioning things like the inventory path22:57
jeblairfungi: that'll work then22:57
fungiand tehre is the id_rsa22:57
fungiperfect--thanks jeblair! you just saved me fighting with an oob console session22:58
jeblairyay!22:58
fungihuh, no puppet mentioned at all in /var/log/syslog22:59
*** armax has joined #openstack-infra23:00
*** pradk has quit IRC23:00
fungithis is where launch-node.py died23:02
fungihttp://paste.openstack.org/show/564912/23:02
fungitesting with ianw's stack starting from https://review.openstack.org/35950023:02
clarkblooks like we need to keep ansibles stdout/err23:04
*** cardeois has quit IRC23:04
jeblairfungi: that seems like an ansible exception that adding '-vvv' to the ansible-playbook cmdline may help illuminate23:04
clarkboh maybe we just aren't getting output? that could hel ptoo23:04
jeblairclarkb: yeah, we print the output -- it's in fungi's paste23:04
jeblairit's short23:04
jeblairit says "add -vvv" :)23:04
fungialso, i completely overlooked that one of ianw's patches is copying the private key and echoing teh path to it23:05
fungii had just grown accustomed to not having it :/23:05
craigeI didn't see the vagrant discussion in today's minutres jhesketh, was that topic dropped?23:05
fungicraige: i didn't see it on the agenda23:05
craigeah, jhesketh had said at one point he'd put it on there. I must have misunderstood :-)23:06
fungiokay, rerunning with verbose flags for ansible-playbook subprocess invocations23:06
jheskethcraige: I put it to the mailing list instead23:07
craigeah, righto, I've been following that.23:07
craigeProbably a miuch better place too.23:08
fungiless waking up at unfortunate times to participate in a synchronous discussion in the infra meeting too23:08
craigeOh yeah.23:09
*** Apoorva has quit IRC23:09
*** tqtran has quit IRC23:09
*** hrybacki|afk is now known as hrybacki23:10
fungithis is definitely more verbose, i'll grant it that23:10
craigeoh and while I have the channel, topic pholio is languishing on reviews :-)23:10
*** tqtran has joined #openstack-infra23:14
fungiso the traceback we wanted is http://paste.openstack.org/show/564917/23:14
fungisomething to do with the fact that this server uses a hostgroup i guess?23:14
*** Apoorva has joined #openstack-infra23:14
*** abregman has quit IRC23:14
*** psilvad has quit IRC23:15
fungithere's a corresponding wiki-dev groups entry for it in the global site manifest and in the puppetmaster groups.txt, as well as a yaml file for the group in hiera23:16
*** jamesdenton has joined #openstack-infra23:16
fungimordred: ^ perhaps you've spent more time staring at those sorts of errors?23:16
clarkbfungi: it looks like its trying to remove ungrouped from groups and ungrouped is not in the list. Which is what i would expect given the variable names23:16
mordredfungi: looking23:17
*** abregman has joined #openstack-infra23:17
mordredfungi: do you have the inventory file it generated?23:17
mordredit was /tmp/tmpv7ge2X/inventory in the previous run iirc23:18
fungimordred: /tmp/tmpb41kCS/inventory on the puppetmaster now23:18
*** _sarob has quit IRC23:18
mordredlooking23:18
fungithough both probably look about the same23:18
*** xarses has quit IRC23:18
fungioh, i bet i know the issue23:19
fungior at least a contributing problem23:19
jeblairi note it is in both the 'wiki' and 'wiki-dev' groups23:19
ianwfungi: the last thing i forgot can but can do is to echo out the IP address in the error message too, so you don't have to scroll back/look it up23:19
fungijeblair: yep, that being the problem i spotted http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/puppetmaster/groups.txt#n1323:19
fungineed to use regular expressions there23:20
funginot globbing23:20
fungipatch incoming23:20
jeblairi don't know if that's this problem, but it's a problem.23:20
clarkbshoudl they be different groups?23:20
clarkb(I don't actually know but the group determines the hiera data right? I guess we don't want prod hiera data on dev servers)23:20
jeblairregardless, i think it's an ansible bug to fail like that23:20
mordredroot@puppetmaster:~# ansible -i /tmp/tmpb41kCS/inventory --list-hosts wiki-dev23:21
mordredERROR! Unexpected Exception: list.remove(x): x not in list23:21
*** salv-orlando has quit IRC23:21
*** nwkarsten has joined #openstack-infra23:21
mordredI'm not convinced it's the regex23:22
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Use regular expressions for wiki hostgroups  https://review.openstack.org/36331223:22
fungimordred: i'm not convinced either, but the resulting server still won't end up the way i want it without ^23:22
mordred++23:22
fungii'll have competing duplicate hiera keys from the two hostgroup hiera files23:23
mordredjeblair: it may be a bug in ansible ...23:24
mordredansible 2.1.1.0 does not fail23:24
*** hongbin has quit IRC23:24
mordredso it may not only be a bug in ansible - it may be a fixed bug in ansible23:25
mordredI installed latest ansible into /root/montyansible23:25
openstackgerritMatthew Treinish proposed openstack-infra/system-config: Add lpmqtt to firehose deployments  https://review.openstack.org/36331323:25
mordredroot@puppetmaster:~# montyansible/bin/ansible -i /tmp/tmpb41kCS/inventory --list-hosts wiki-dev23:25
mordred  hosts (1):23:25
mtreinishfungi: ^^^23:25
mordred    wiki-dev01.openstack.org23:25
mordred(I checked latest ansible because my next move was going to be bundling up that inventory and sending it to the ansible folks since the error is reproducible wihtout having to contact any servers)23:26
fungimordred: that's adorable23:27
mordredwhy are we pinned back on puppetmaster again?23:28
clarkbmordred: because ansible puppet doesn't work with newer ansible23:30
clarkbor didn't I know we fixed at least one issue with the type annotation of parameters23:30
clarkbthe string/dict thing that broke us temporarily23:30
*** sdague has quit IRC23:31
clarkbmordred: tl;dr ansible doesn't semver23:33
*** jamesdenton has quit IRC23:34
*** madhuvishy_afk is now known as madhuvishy23:34
mordredclarkb: well, that wasn't supposed to be a user-facing behavior change23:34
mordredbut yeah23:35
*** rcernin has quit IRC23:35
mordredwe should check and see if 2.1.1.0 is not broken23:35
clarkbmordred: its possible that we work now after pabelanger's fix. You should probably test it though before we switch23:35
mordredclarkb: I will23:35
mordredI will not test it today23:35
mordredbut I will test it23:35
*** jcoufal has quit IRC23:35
lifelessfungi: cool23:36
*** tphummel has quit IRC23:38
cloudnullis there a place where i can get a list all of the available infra mirrors?23:43
cloudnullsomething that shows "http://mirror.dfw.rax.openstack.org/ubuntu/" "http://mirror.nyj01.internap.openstack.org/ubuntu" etc ?23:43
*** zhurong has joined #openstack-infra23:44
*** tpsilva has quit IRC23:44
*** Julien-zte has quit IRC23:44
clarkbcloudnull: you can extrapolate from the nodepool.yaml file. there is one per cloud region23:45
cloudnullbasically is there something like http://mirrors.ubuntu.com/mirrors.txt for infra?23:45
clarkband possibly puppetboard.openstack.org23:46
clarkbbut its been flaky23:46
mordredcloudnull: short answer - no such thing exists23:50
mordredcloudnull: but - the data is all physically pubically accessible23:50
mordredcloudnull: so one could be constructed23:50
cloudnullI have http://cdn.pasteraw.com/lbrqw3ulwx128ox5r0hunzcevx1cgbn which i put together but it'd be nice to see a list made available so I can tell apt to go pay attention to that.23:50
*** jerryz has quit IRC23:50
mordredcloudnull: in this file: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/nodepool/clouds.yaml.erb23:51
cloudnullwas curious because the rax mirrors were throwing 503 again this evening23:51
mordredcloudnull: for cloud in clouds: for region in cloud.regions: mirror = mirror.$region.$cloud.openstack.org23:51
ianwcloudnull: i don't think that ubuntu one is a .txt file :)  certainly it gave me just australian mirrors.  so having something that dynamically returned appropriate mirrors based on source ip seems harder23:52
mordredcloudnull: sorry ...23:52
mordredcloudnull: for cloud in clouds: for region in cloud.regions: mirror = mirror.lower($region).lower($cloud).openstack.org23:52
fungicloudnull: also we don't (currently) mirror the index signatures as we regenerate our indices to make sure they match the packages we have, so without extra effort apt will complain at you about its inability to validate them23:53
fungialso we don't promise to keep them operational all the time, and reserve the right to rename them or reorganize them on a whim... they're not at all intended to be a user-facing resource23:53
clarkbat least for pypi mirroring I never use them anymore. I used to have to in order to get any reliability but pypi has come a long weay23:57
*** mriedem has joined #openstack-infra23:57
cloudnullthanks mordred ianw fungi clarkb :)23:57
*** tonytan4ever has joined #openstack-infra23:58
cloudnullnote, the 503's were from mirror.rax not the infra mirrors in rax.23:58
cloudnullthose seem to be working just fine :)23:58
fungicloudnull: yep, that's one of the reasons we started maintaining our own package mirrors23:59
cloudnullFor OSA we use the infra mirrors.23:59
clarkbthey would also have inconsistent indexes23:59
clarkb(which is a side effect of mirroring deb repos)23:59
cloudnulli was working on my own little things and was looking for something more reliable23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!