Tuesday, 2016-08-09

*** gildub has joined #openstack-infra00:02
openstackgerritMerged openstack-infra/elastic-recheck: Add bug 1610960  https://review.openstack.org/35263900:04
openstackbug 1610960 in neutron "Invalid input for external_gateway_info. Reason: '' is not a valid UUID." [Critical,Confirmed] https://launchpad.net/bugs/161096000:04
*** PollyZ has quit IRC00:06
*** Julien-zte has joined #openstack-infra00:08
*** Swami has quit IRC00:09
openstackgerritMatthew Treinish proposed openstack-infra/elastic-recheck: Fix the integrated gate filtering on uncategorized  https://review.openstack.org/35192400:09
*** markvoelker has joined #openstack-infra00:11
*** amitgandhinz has joined #openstack-infra00:11
*** amitgandhinz has quit IRC00:16
*** sarob has joined #openstack-infra00:19
*** sputnik13_ has quit IRC00:19
openstackgerritBrad Behle proposed openstack-infra/project-config: Make ovn-install-kuryr job voting  https://review.openstack.org/35032100:19
*** PollyZ has joined #openstack-infra00:22
*** sarob has quit IRC00:23
*** tqtran has quit IRC00:25
* craige wonders if he is the only one for whom OpenStackID dev and prod endpoints (as gained from discovery) 40400:25
* craige prods clarkb if he's about00:25
*** pvaneck has quit IRC00:27
*** adrian_otto has quit IRC00:29
mtreinishrcarrillocruz: so I was looking at the docs for mqtt on ansible: http://docs.ansible.com/ansible/mqtt_module.html00:31
mtreinishrcarrillocruz: they don't mention anything about tls there (although it uses paho which supports it)00:31
mtreinishrcarrillocruz: but if we plan to use that for pushing ansible events to firehose, we'll want to make sure we can encrypt the traffic, otherwise the creds are in plaintext00:32
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Update runscope plugin to use convert xml  https://review.openstack.org/35265200:35
ianwfunig / clarkb: https://review.openstack.org/#/c/352621 <- more ntp-wait issues00:40
*** tonytan4ever has quit IRC00:41
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Update runscope plugin to use convert xml  https://review.openstack.org/35265200:42
amrithfungi, no joy. by the time my job is invoked, REQUIREMENTS_DIR isn't set any longer it appears.00:47
amrithstill debugging.00:47
amrithtonyb ^^00:47
*** gyee has quit IRC00:48
*** mtanino has joined #openstack-infra00:54
*** xarses_ has joined #openstack-infra00:54
*** Sukhdev has quit IRC00:57
*** raunak has quit IRC01:02
*** thorst has quit IRC01:02
*** thorst has joined #openstack-infra01:03
pabelangermtreinish: rcarrillocruz: Oh, we should start hacking on that right away. I'd love to see out ansible-playbook events in realtime01:04
*** edmondsw has quit IRC01:04
tonybamrith: Hmm okay.  I'm not certain where REQUIREMENTS_DIR comes from nor why it'd be cleared.01:08
*** sarob has joined #openstack-infra01:10
*** karthikp_ has quit IRC01:12
*** thorst has quit IRC01:12
*** amitgandhinz has joined #openstack-infra01:12
*** karthikp_ has joined #openstack-infra01:12
*** sarob has quit IRC01:15
*** zhurong has joined #openstack-infra01:18
*** amitgandhinz has quit IRC01:18
*** piet has quit IRC01:22
*** dimtruck is now known as zz_dimtruck01:22
*** Apoorva_ has joined #openstack-infra01:22
*** rfolco has quit IRC01:24
*** yanyanhu has joined #openstack-infra01:25
*** Apoorva has quit IRC01:26
*** sdake has quit IRC01:27
*** Apoorva_ has quit IRC01:27
*** chlong has joined #openstack-infra01:27
*** sdake has joined #openstack-infra01:29
*** rbuzatu has joined #openstack-infra01:30
*** karthikp_ has quit IRC01:31
*** rbuzatu has quit IRC01:36
*** hongbin_ has joined #openstack-infra01:36
openstackgerritMerged openstack-infra/devstack-gate: Explicitly set IRONIC_BUILD_DEPLOY_RAMDISK  https://review.openstack.org/35079501:41
*** PollyZ has quit IRC01:41
*** tonytan4ever has joined #openstack-infra01:42
*** sarob has joined #openstack-infra01:43
*** amitkqed has quit IRC01:43
*** amitkqed has joined #openstack-infra01:43
*** tphummel has quit IRC01:45
*** tonytan4ever has quit IRC01:47
*** sarob has quit IRC01:48
*** PollyZ has joined #openstack-infra01:53
*** hongbin has quit IRC01:54
*** samP_ has joined #openstack-infra01:55
*** baoli has joined #openstack-infra01:58
*** reed_ has joined #openstack-infra02:00
*** zz_dimtruck is now known as dimtruck02:00
*** reed_ has quit IRC02:01
*** yamahata has quit IRC02:02
*** sarob has joined #openstack-infra02:05
*** jimbaker has quit IRC02:06
*** esberglu has joined #openstack-infra02:07
*** yamahata has joined #openstack-infra02:08
*** sarob has quit IRC02:09
*** woodster_ has quit IRC02:09
*** gouthamr_ has quit IRC02:10
*** amitgandhinz has joined #openstack-infra02:14
*** amitgandhinz has quit IRC02:19
*** coolsvap has joined #openstack-infra02:19
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Update maven-builder to use convert xml  https://review.openstack.org/35267102:24
openstackgerritJeffrey Zhang proposed openstack-infra/project-config: Enable ubuntu-xenial for Kolla  https://review.openstack.org/35208902:24
openstackgerritIan Wienand proposed openstack-infra/devstack-gate: Add chrony time sync, small refactor  https://review.openstack.org/35267402:29
openstackgerritIan Wienand proposed openstack-infra/system-config: Switch to chrony from ntpd  https://review.openstack.org/35267502:29
*** zhurong_ has joined #openstack-infra02:31
*** zhurong has quit IRC02:35
*** PollyZ has quit IRC02:35
*** PollyZ has joined #openstack-infra02:36
openstackgerritBrad Behle proposed openstack-infra/project-config: Rename ovn-native-l3 gate job to ovn-native-services  https://review.openstack.org/35267602:39
*** jerryz has quit IRC02:40
*** baoli has quit IRC02:43
*** raunak has joined #openstack-infra02:45
*** PollyZ has quit IRC02:47
*** PollyZ has joined #openstack-infra02:47
*** piet has joined #openstack-infra02:47
*** samP_ has quit IRC02:49
*** kushal has quit IRC02:49
*** esberglu has quit IRC02:52
*** gongysh has joined #openstack-infra02:58
*** coolsvap is now known as coolsvap_02:59
*** julim has quit IRC03:00
*** armax has quit IRC03:01
*** roxanaghe has joined #openstack-infra03:02
*** gildub has quit IRC03:04
*** gildub has joined #openstack-infra03:04
*** larainema has quit IRC03:09
*** raunak has quit IRC03:11
*** amitgandhinz has joined #openstack-infra03:15
*** raunak has joined #openstack-infra03:15
openstackgerritXiang Chen proposed openstack/diskimage-builder: check APT_SOURCES earlier  https://review.openstack.org/34660503:19
*** psilvad has quit IRC03:19
*** amitgandhinz has quit IRC03:19
*** itisha has quit IRC03:20
*** yamahata has quit IRC03:21
*** tqtran has joined #openstack-infra03:22
*** acoles_ is now known as acoles03:23
*** piet has quit IRC03:24
openstackgerritXiang Chen proposed openstack/diskimage-builder: check APT_SOURCES earlier  https://review.openstack.org/34660503:25
*** acoles is now known as acoles_03:26
*** tqtran has quit IRC03:27
*** hongbin_ has quit IRC03:27
*** hongbin has joined #openstack-infra03:28
*** raunak has quit IRC03:29
*** senk_ has joined #openstack-infra03:30
*** larainema has joined #openstack-infra03:30
*** tphummel has joined #openstack-infra03:31
*** csomerville has quit IRC03:34
*** csomerville has joined #openstack-infra03:34
*** PollyZ_ has joined #openstack-infra03:36
openstackgerritIan Wienand proposed openstack-infra/system-config: Switch to chrony from ntpd  https://review.openstack.org/35267503:38
*** PollyZ has quit IRC03:38
tonybis there a "right"03:39
tonyb" way to detech that we're running in the gate?03:39
prometheanfiredetect?03:39
prometheanfiretalking about https://review.openstack.org/348204 ?03:40
*** raunak has joined #openstack-infra03:40
tonybprometheanfire: detect yes, that review no03:41
prometheanfireah03:41
ianwtonyb: i don't think there's one solution to that question ... there are ways we detect certain gate things (mirrors, etc) but in general i don't think we'd want jobs that are too different depending on where they run03:45
tonybianw: basically if we're in the gate I know that the devstack-gate systemn will have deon work for me and I can just use it.  Otherwise I need to duplicate that work :(03:46
openstackgerritBrad Behle proposed openstack-infra/project-config: Rename ovn-native-l3 gate job to ovn-native-services  https://review.openstack.org/35267603:47
ianwtonyb: i guess the answer is that devstack-gate should have fairly reusable bits, something like reproduce.sh script might work03:47
tonybianw: Yeah, I don't really want to pull devstack-gate bits into a developer workflow.03:50
*** nwkarsten has quit IRC03:51
*** nwkarsten has joined #openstack-infra03:51
*** pt_15 has quit IRC03:56
*** nwkarsten has quit IRC03:56
*** hurgleburgler1 has quit IRC03:59
*** hongbin has quit IRC04:01
*** gnuoy` has joined #openstack-infra04:01
*** gnuoy has quit IRC04:02
*** jamespage has quit IRC04:02
*** hurgleburgler has joined #openstack-infra04:03
*** kushal has joined #openstack-infra04:05
rcarrillocruzmtreinish, pabelanger : looks like a perfect excuse to contribute code to that module :-)04:07
*** PollyZ_ has quit IRC04:07
*** links has joined #openstack-infra04:11
*** raunak_ has joined #openstack-infra04:15
*** amitgandhinz has joined #openstack-infra04:16
ianwgate-devstack-docs-ubuntu-trusty POST_FAILURE in 4m 04s ... hmmm04:16
*** raunak has quit IRC04:17
*** raunak_ is now known as raunak04:17
*** psachin has joined #openstack-infra04:20
*** amitgandhinz has quit IRC04:20
*** Na3iL has quit IRC04:20
*** javeriak has joined #openstack-infra04:20
*** javeriak has quit IRC04:25
*** narayrak has joined #openstack-infra04:25
*** raunak has quit IRC04:26
openstackgerritMerged openstack-infra/project-config: Fix queue for py35 Neutron unit test job  https://review.openstack.org/35261504:27
*** raunak has joined #openstack-infra04:28
*** PollyZ has joined #openstack-infra04:28
*** kien-ha has quit IRC04:29
*** yamahata has joined #openstack-infra04:29
*** PollyZ_ has joined #openstack-infra04:34
*** PollyZ has quit IRC04:36
*** rossella_s has quit IRC04:38
*** rossella_s has joined #openstack-infra04:39
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove duplicate jobs due to xenial move  https://review.openstack.org/35270104:45
*** coolsvap_ is now known as coolsvap04:51
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove duplicate jobs due to xenial move  https://review.openstack.org/35270104:52
AJaegerpabelanger: we added far too many jobs which is part of our high workload - we now run some trusty jobs on master - as well as xenial ones ^04:53
AJaegerianw, rcarrillocruz, review of 352701 to reduce the jobs we run on master is welcome ^04:53
*** _nadya_ has joined #openstack-infra04:58
*** mtanino has quit IRC05:01
*** r-mibu has joined #openstack-infra05:02
*** liusheng has quit IRC05:05
*** liusheng has joined #openstack-infra05:07
*** yanyanhu has quit IRC05:09
*** yanyanhu has joined #openstack-infra05:11
ianwAJaeger: jenkins issue?05:11
*** david-lyle_ has joined #openstack-infra05:11
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Fix fuel xenial/trusty jobs  https://review.openstack.org/35270405:12
*** senk_ has quit IRC05:12
AJaegerianw: what I mean is: We want to run job X-ubuntu-trusty on older release and X-ubuntu-xenial on newer releases. But if you review the change I mentioned, you see that we run both jobs on master in some cases05:13
*** david-lyle has quit IRC05:13
AJaegerianw: the existing branch conditions broke our logic and needed rework05:13
*** tphummel has quit IRC05:13
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove duplicate jobs due to xenial move  https://review.openstack.org/35270105:15
AJaegerianw: or do you mean the POST_FAILURE?05:15
*** gildub has quit IRC05:16
AJaegerianw: what are the ansible logs saying for that? We have races if there are two jobs uploading to docs.o.o - and those might lead to such fails05:16
*** amitgandhinz has joined #openstack-infra05:17
*** roxanaghe has quit IRC05:17
ianwAJaeger: oh, i just mean the patch you wanted review on.  but the POST_FAILURE is odd, seems like the rsync failed05:17
ianwstatic.openstack.org looks ok, no issues i can see05:17
*** guy__ has joined #openstack-infra05:18
tonybSomethign strange just happend.  gate-grenade-dsvm-multinode (http://logs.openstack.org/66/350866/3/check/gate-grenade-dsvm-multinode/43fbed2/console.html) reports the template-name as: {pipeline}-tempest-dsvm-platform-{name}{job-suffix} any ideas?05:18
tonybianw: I've seen it (POST_FAILURE) also05:18
AJaegerianw: was my explanation ok for 352701 ?05:19
*** kzaitsev_mb has joined #openstack-infra05:19
AJaegertonyb: that is strange indeed, somehow results got mixed up. See also the line http://logs.openstack.org/49/352049/2/check/gate-tempest-dsvm-platform-centos7-nv/559677f// - note the name05:20
AJaegertonyb: something for our ansible/zuul experts to look at later - jeblair, pabelanger ^05:21
*** rcernin has joined #openstack-infra05:21
*** pgadiya has joined #openstack-infra05:21
*** jaosorior has joined #openstack-infra05:21
*** amitgandhinz has quit IRC05:21
tonybAJaeger: yeah. at least it looks strange to you too :) means I didn't miss somethign obvious05:21
*** rlandy has quit IRC05:23
*** PollyZ_ has quit IRC05:25
*** sdake has quit IRC05:26
*** jtomasek_ has joined #openstack-infra05:26
*** jtomasek has quit IRC05:26
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Fix fuel xenial/trusty jobs  https://review.openstack.org/35270405:27
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Fix fuel xenial/trusty jobs  https://review.openstack.org/35270405:27
ianwAJaeger: 352701 ... why is say gate-requirements-tox-validate-ubuntu-trusty not required?05:27
openstackgerritJuan Antonio Osorio Robles proposed openstack/diskimage-builder: DO NOT MERGE - TESTING KEYSTONE ENDPOINTS  https://review.openstack.org/35270505:27
AJaegerianw: gate-requirements-tox-validate-ubuntu-trusty should run only on older branches, the job gate-requirements-tox-validate-ubuntu-xenial only on newer onew (new = master, newton etc)05:28
*** sdake has joined #openstack-infra05:29
ianwAJaeger: sorry, bit slow, i'm not seeing where we filter  gate-requirements-tox-validate-ubuntu-trusty as only on older branches then?  the original says it should run everywhere but kilo, but i don't see that regex put back in?05:29
AJaegeroh, that specific job might be wrong.05:29
AJaegerexactly, you're spot on.05:29
AJaegerSo, good finding - I'm fixing. Thanks!05:30
ianwAJaeger: this there others? gate-requirements-tox-validate-ubuntu-trusty for example should only run on master too it seems05:31
AJaegerno, it's correct. It should not run on kilo. And trusty jobs should run only on liberty|mitaka (that's the global regex), so removing it gives us the desired outcome05:32
AJaegerianw: let's review https://review.openstack.org/#/c/351219/ for that05:34
AJaegerSo, gate-requirements-tox-validate in the past was only run on master05:34
*** tphummel has joined #openstack-infra05:34
ianwahh, ok, global regex too, yeah05:34
AJaegerThus, when we split up the job, the trusty job should be run on liberty|mitaka, the xenial one on master and newer05:35
AJaegerBut with the change in 351219 we now run both trusty and xenial on master. So, have an extra job ;(05:35
AJaegerianw, added a review comment.05:37
*** jtomasek_ is now known as jtomasek05:37
*** _nadya_ has quit IRC05:38
*** hurgleburgler has quit IRC05:40
*** dstufft has quit IRC05:41
*** dstufft has joined #openstack-infra05:41
*** senk_ has joined #openstack-infra05:43
*** senk_ has quit IRC05:44
guy__Hi everyone, for the third party CI, if we want to test a backup driver in Cinder, do we need to run the tempest related to "volume_backup"? Because I noticed that the tests for backup are also in volume tests in Tempest. Thank you for your answer.05:44
*** rbuzatu has joined #openstack-infra05:44
openstackgerritsandhya proposed openstack/diskimage-builder: Add support for building images capable of UEFI  https://review.openstack.org/28778405:46
*** raunak has quit IRC05:48
openstackgerritMerged openstack-infra/devstack-gate: Enabling Cinder multinode testing  https://review.openstack.org/32761905:50
*** andymaier has joined #openstack-infra05:51
*** mhickey has joined #openstack-infra05:52
*** andymaier has quit IRC05:52
AJaegerguy__: better discuss that with cinder team05:56
*** kzaitsev_mb has quit IRC05:57
*** oanson has joined #openstack-infra05:58
guy__AJaeger: ok thank you05:58
*** guy__ has quit IRC05:58
*** tphummel has quit IRC06:05
*** Ravikiran_K has joined #openstack-infra06:05
*** roxanaghe has joined #openstack-infra06:08
*** kzaitsev_mb has joined #openstack-infra06:09
*** roxanaghe has quit IRC06:13
*** javeriak has joined #openstack-infra06:13
*** gildub has joined #openstack-infra06:14
*** amitgandhinz has joined #openstack-infra06:17
*** nherciu has joined #openstack-infra06:18
*** nherciu_ has joined #openstack-infra06:20
*** amitgandhinz has quit IRC06:22
openstackgerritsandhya proposed openstack/diskimage-builder: Add support for building images capable of UEFI  https://review.openstack.org/28778406:22
*** nherciu has quit IRC06:23
*** tqtran has joined #openstack-infra06:25
*** stewie925 has quit IRC06:25
*** scottda has quit IRC06:25
*** sweston has quit IRC06:26
*** ljjjustin has quit IRC06:26
*** M-docaedo_vector has quit IRC06:26
*** scottda has joined #openstack-infra06:26
*** sweston has joined #openstack-infra06:26
*** ihrachys has joined #openstack-infra06:27
*** ttx has quit IRC06:27
*** ttx has joined #openstack-infra06:28
*** ljjjustin has joined #openstack-infra06:29
*** kzaitsev_mb has quit IRC06:29
*** tqtran has quit IRC06:29
*** M-docaedo_vector has joined #openstack-infra06:32
*** chlong is now known as chlong|mtg06:32
*** senk_ has joined #openstack-infra06:37
*** sdake has quit IRC06:38
openstackgerritsandhya proposed openstack/diskimage-builder: Add support for building images capable of UEFI  https://review.openstack.org/28778406:39
*** mhickey_ has joined #openstack-infra06:39
*** pcaruana has joined #openstack-infra06:39
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Set Sahara workers to 1  https://review.openstack.org/35272906:39
*** ihrachys has quit IRC06:39
*** mhickey_ has quit IRC06:39
*** _nadya_ has joined #openstack-infra06:41
*** tesseract- has joined #openstack-infra06:45
ianwAJaeger: so we decided 352701 is actually correct?06:49
*** coolsvap is now known as coolsvap_06:51
*** tqtran has joined #openstack-infra06:52
*** ihrachys has joined #openstack-infra06:57
yolandagood morning06:59
AJaegerianw: YEs, I convinced myself ;)07:09
AJaegerianw: but please double check07:09
AJaegermorning, yolanda07:09
*** dimtruck is now known as zz_dimtruck07:11
AJaegeryolanda, ianw : If either of you reviews later - I have a serious of constraint related changes for project-config that I'd love to see in. Please review https://review.openstack.org/#/q/status:open+project:openstack-infra/project-config+branch:master+topic:constraints07:12
*** kushal has quit IRC07:13
*** amitgandhinz has joined #openstack-infra07:18
*** daemontool has joined #openstack-infra07:21
*** florianf has joined #openstack-infra07:21
*** jlanoux has joined #openstack-infra07:21
*** nmagnezi has joined #openstack-infra07:22
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Add ironic-dsvm-multitest experimental job.  https://review.openstack.org/34029507:23
*** amitgandhinz has quit IRC07:23
*** jlanoux has quit IRC07:24
*** jlanoux has joined #openstack-infra07:24
yolandasure07:25
*** dkehn_ has quit IRC07:25
*** dkehn has quit IRC07:25
*** daemontool_ has joined #openstack-infra07:28
*** daemontool has quit IRC07:28
*** jpich has joined #openstack-infra07:29
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Publish vitrage-specs  https://review.openstack.org/35274707:29
*** elo has quit IRC07:31
*** kzaitsev_mb has joined #openstack-infra07:31
AJaegerthanks, yolanda07:31
*** sshnaidm|afk has quit IRC07:32
yolandai left the ones that update more jobs for you to approve07:32
*** yamamoto has quit IRC07:33
openstackgerritAndrey Nikitin proposed openstack-infra/project-config: Add one new Fuel's plugin  https://review.openstack.org/35244607:34
AJaegerthanks, yolanda. Will merge some now...07:34
*** gildub has quit IRC07:37
*** dkehn_ has joined #openstack-infra07:38
*** dkehn has joined #openstack-infra07:39
*** mikelk has joined #openstack-infra07:40
openstackgerritMerged openstack-infra/project-config: Use zuul-cloner for kolla  https://review.openstack.org/35159007:41
openstackgerritMerged openstack-infra/project-config: Use zuul-cloner for gate-horizon-selenium-headless  https://review.openstack.org/35158707:41
openstackgerritMerged openstack-infra/project-config: Use zuul-cloner for bashate job  https://review.openstack.org/35159707:41
openstackgerritMerged openstack-infra/project-config: Use zuul-cloner for docs publishing  https://review.openstack.org/35159907:41
openstackgerritMerged openstack-infra/project-config: Use zuul-cloner for grenade tests  https://review.openstack.org/35158607:41
*** david-lyle has joined #openstack-infra07:43
*** katyafervent_awa has quit IRC07:44
*** katyafervent_awa has joined #openstack-infra07:44
openstackgerritMerged openstack-infra/project-config: Use zuul-cloner for {name}-branch-tarball  https://review.openstack.org/35158507:44
*** vincentll has joined #openstack-infra07:44
*** david-lyle_ has quit IRC07:46
*** matthewbodkin has joined #openstack-infra07:46
*** kzaitsev_mb has quit IRC07:50
*** sdake has joined #openstack-infra07:51
*** matrohon has joined #openstack-infra07:51
*** matrohon has quit IRC07:51
*** shardy has joined #openstack-infra07:54
openstackgerritAndreas Jaeger proposed openstack-dev/cookiecutter: Adjust tox.ini for constraints  https://review.openstack.org/35275807:56
*** vsaienko has joined #openstack-infra07:57
*** coolsvap_ is now known as coolsvap07:58
openstackgerritMerged openstack-infra/project-config: add diff-start to release tag metadata  https://review.openstack.org/35255107:58
openstackgerritMerged openstack-infra/project-config: Stack nodepool images targets in grafana  https://review.openstack.org/35261807:58
*** tqtran has quit IRC07:58
*** kzaitsev_mb has joined #openstack-infra07:58
*** ifarkas_afk is now known as ifarkas07:59
*** markvoelker has quit IRC07:59
*** lucas-dinner is now known as lucasagomes07:59
vsaienkoMorning infra team: could anybody help with project-config, I'm wondered why DEVSTACK_GATE_IRONIC is set to 0 http://logs.openstack.org/43/339143/13/check/gate-tempest-dsvm-multinode-full/7e208ad/logs/reproduce.sh, but according to the job definition it should be set to 1, since multinode job contains devstack-virtual-ironic builder https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/ironic.yaml#L580 where export DEVSTACK_08:00
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-infra08:00
*** yamahata has quit IRC08:00
*** jamespag` has joined #openstack-infra08:02
*** jamespag` is now known as jamespage08:03
*** e0ne has joined #openstack-infra08:03
openstackgerritMerged openstack-infra/project-config: Re-enable all three jobs for TripleO  https://review.openstack.org/35247908:05
openstackgerritMerged openstack-infra/project-config: Only error for duplicate requirements when strict  https://review.openstack.org/35249008:05
*** sdake has quit IRC08:06
*** ramishra_ has quit IRC08:07
AJaegervsaienko: that log file is from the 27th of July and we made a few changes to the ironic jobs since then. I suggest you recheck and check again. Especially we merged https://review.openstack.org/34894908:07
*** matrohon has joined #openstack-infra08:08
*** ramishra has joined #openstack-infra08:08
openstackgerritMerged openstack-infra/puppet-openstackci: Update to latest Zuul on AIO configuration  https://review.openstack.org/35256008:08
AJaegervsaienko: but if this is still the case in current jobs, best talk to sambetts.08:09
openstackgerritMerged openstack-infra/project-config: Remove useless Puppet OpenStack experimental jobs  https://review.openstack.org/35251408:11
*** sshnaidm|afk has joined #openstack-infra08:11
openstackgerritMerged openstack-infra/project-config: Make gate-neutron-dynamic-routing-dsvm-tempest job voting.  https://review.openstack.org/35221208:11
AJaegervsaienko: wait - the job is tempest-dsvm-multinode-full and defined at https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/devstack-gate.yaml#L1329 - you mixed up the jobs08:11
*** ljjjustin has quit IRC08:11
*** sshnaidm|afk is now known as sshnaidm08:11
openstackgerritMerged openstack-infra/project-config: Disable test_volume_from_snapshot tests for Cinder BDD job  https://review.openstack.org/35117808:11
openstackgerritMerged openstack-infra/project-config: ec2api experimental job: fix rally job definition  https://review.openstack.org/35164308:12
*** ljjjustin has joined #openstack-infra08:13
*** yanyanhu has quit IRC08:14
*** amitgandhinz has joined #openstack-infra08:19
*** Goneri has joined #openstack-infra08:20
*** chem has quit IRC08:22
*** amoralej|off is now known as amoralej08:23
*** yaume has joined #openstack-infra08:23
*** amitgandhinz has quit IRC08:23
*** kushal has joined #openstack-infra08:25
*** kzaitsev1mb has joined #openstack-infra08:26
openstackgerritTang Chen proposed openstack-infra/project-config: Fix Ironic functional job by properly setting PROJECTS  https://review.openstack.org/35277208:26
*** dingyichen has quit IRC08:27
*** kzaitsev_mb has quit IRC08:27
vsaienkoAjaeger: I'm talking about ironic specific job: gate-tempest-dsvm-ironic-ipa-partition-pxe_ssh-tinyipa-multinode-nv08:31
*** ptacemic has joined #openstack-infra08:32
AJaegervsaienko: but the link you gave was for a different one08:32
zigopabelanger: mordred: AJaeger: There's a problem in the reprepro job, it failed with:08:32
zigo2016-08-09 08:30:21.302907 | Obtaining token and importing packages to reprepro08:32
zigo2016-08-09 08:30:21.302968 | + '=/home/jenkins/workspace/reprepro-import-debian-openstack-jessie-backports/packages/*.changes'08:32
zigo2016-08-09 08:30:21.303408 | /tmp/1938dbb3a841471285b7cc200d9a4649.sh: line 41: =/home/jenkins/workspace/reprepro-import-debian-openstack-jessie-backports/packages/*.changes: No such file or directory08:32
vsaienkoAJaeger: oh, my fault, I need to be more careful next time, thatnks for your time!08:33
AJaegerzigo ;( Let's wait for pabelanger - or do you have an idea why there was no changes file?08:33
zigoAJaeger: I'm currently looking at the script. This looks like a wrong shell script variable association, no?08:34
zigoLike $SOMETHING= instead of just SOMETHING=08:34
openstackgerritMerged openstack-infra/project-config: Use constraints for translation sync  https://review.openstack.org/34876408:34
AJaegerzigo: indeed: $FILES=$PACKAGE_DIR/*.changes08:35
*** yamamoto has joined #openstack-infra08:35
AJaegerzigo: will you send a patch for jenkins/jobs/packaging-mirror.yaml ? I can approve directly...08:36
zigoAJaeger: Yeah, I'm doing that.08:36
openstackgerritThomas Goirand proposed openstack-infra/project-config: [packaging-deb] Fix $FILES= -> FILES=  https://review.openstack.org/35278008:37
*** rossella_s has quit IRC08:38
zigoAJaeger: Hopefully, this fixes it.08:38
*** rossella_s has joined #openstack-infra08:38
AJaegerzigo: yeah ;)08:40
zigoCheers./08:40
*** zynzel has left #openstack-infra08:40
*** BobBall_AWOL is now known as BobBall08:40
*** rbuzatu has quit IRC08:41
*** yamamoto has quit IRC08:41
*** yamamoto has joined #openstack-infra08:42
*** acoles_ is now known as acoles08:43
*** rbuzatu has joined #openstack-infra08:43
*** matrohon has quit IRC08:45
*** jaosorior is now known as jaosorior_brb08:49
*** yamamoto has quit IRC08:52
*** yamamoto has joined #openstack-infra08:52
*** yamamoto has quit IRC08:52
*** yamamoto has joined #openstack-infra08:53
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: translations: Update UPPER_CONSTRAINTS usage  https://review.openstack.org/35278808:54
*** yamamoto has quit IRC08:57
*** markvoelker has joined #openstack-infra09:00
openstackgerritVasyl Saienko proposed openstack-infra/devstack-gate: Update local.rc for ironic-multinode case  https://review.openstack.org/35279009:00
*** roxanaghe has joined #openstack-infra09:00
openstackgerritVasyl Saienko proposed openstack-infra/devstack-gate: Update local.conf for ironic-multinode case  https://review.openstack.org/35279009:00
*** yamamoto has joined #openstack-infra09:01
*** fawadkhaliq has joined #openstack-infra09:01
*** fawadkhaliq has quit IRC09:01
*** matrohon has joined #openstack-infra09:01
*** zz_dimtruck is now known as dimtruck09:02
*** rbuzatu has quit IRC09:03
*** markvoelker has quit IRC09:05
*** roxanaghe has quit IRC09:06
openstackgerritTang Chen proposed openstack-infra/project-config: Fix Ironic functional job by properly setting PROJECTS  https://review.openstack.org/35277209:07
*** rbuzatu has joined #openstack-infra09:08
*** electrofelix has joined #openstack-infra09:08
*** javeriak has quit IRC09:09
*** coolsvap is now known as coolsvap_09:09
*** chlong|mtg has quit IRC09:10
*** dkaigarodsev has quit IRC09:10
*** SergK has quit IRC09:10
*** mattymo has quit IRC09:10
*** dimtruck is now known as zz_dimtruck09:16
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Rework translation constraint logic in post job  https://review.openstack.org/35279709:17
AJaegeryolanda: I need the following change as well, could you review, please? ^09:17
yolandasure09:17
*** javeriak has joined #openstack-infra09:18
AJaegerthanks!09:19
*** Hal has quit IRC09:19
*** rbuzatu has quit IRC09:19
*** Hal has joined #openstack-infra09:19
*** amitgandhinz has joined #openstack-infra09:20
*** matrohon has quit IRC09:20
*** jed56 has joined #openstack-infra09:21
openstackgerritAndrea Scarpino proposed openstack-infra/jenkins-job-builder: Reporters: support for perModuleEmail field  https://review.openstack.org/35279909:23
*** SergK has joined #openstack-infra09:23
*** rbuzatu has joined #openstack-infra09:24
*** amitgandhinz has quit IRC09:24
openstackgerritAndrea Scarpino proposed openstack-infra/jenkins-job-builder: Reporters: support for perModuleEmail field  https://review.openstack.org/35279909:24
*** SergK has quit IRC09:29
*** gongysh has quit IRC09:30
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove duplicate devstack docs jobs  https://review.openstack.org/35280509:32
*** tosky has joined #openstack-infra09:33
*** javeriak has quit IRC09:36
*** matrohon has joined #openstack-infra09:36
*** rbuzatu has quit IRC09:40
*** jaosorior_brb is now known as jaosorior09:42
*** mrunge_ has joined #openstack-infra09:46
AJaegerproject-config cores, here's one more change for removing of duplicate running jobs ^09:47
*** mrunge has quit IRC09:47
*** chlong|mtg has joined #openstack-infra09:48
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove duplicate devstack docs jobs  https://review.openstack.org/35280509:49
*** matrohon has quit IRC09:51
openstackgerritMerged openstack-infra/project-config: [packaging-deb] Fix $FILES= -> FILES=  https://review.openstack.org/35278009:53
*** dtantsur|sick is now known as dtantsur10:00
*** markvoelker has joined #openstack-infra10:01
*** HeOS has quit IRC10:03
*** HeOS has joined #openstack-infra10:03
*** markvoelker has quit IRC10:05
*** Nakato has quit IRC10:05
*** zhurong_ has quit IRC10:05
*** javeriak has joined #openstack-infra10:06
*** Nakato has joined #openstack-infra10:06
*** javeriak has quit IRC10:06
*** javeriak has joined #openstack-infra10:07
*** matrohon has joined #openstack-infra10:07
*** sdague has joined #openstack-infra10:11
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: WIP - Implement overcloud upgrade job - Mitaka -> Newton  https://review.openstack.org/32375010:14
*** pblaho has quit IRC10:15
*** jcoufal has joined #openstack-infra10:15
*** amitgandhinz has joined #openstack-infra10:20
*** _degorenko|afk is now known as degorenko10:23
*** matrohon has quit IRC10:24
*** mrmartin has joined #openstack-infra10:25
*** amitgandhinz has quit IRC10:25
*** rvba has quit IRC10:26
*** jlanoux_ has joined #openstack-infra10:31
*** jlanoux has quit IRC10:32
*** rbuzatu has joined #openstack-infra10:38
*** sshnaidm is now known as sshnaidm|lnch10:39
*** matrohon has joined #openstack-infra10:41
*** rbuzatu has quit IRC10:42
*** jcoufal has quit IRC10:44
*** roxanaghe has joined #openstack-infra10:48
*** lucasagomes has quit IRC10:51
*** sdake has joined #openstack-infra10:53
*** roxanaghe has quit IRC10:53
openstackgerritDong Ma proposed openstack-infra/subunit2sql: Fix the subunit2sql migration and tests error with mysql 5.7  https://review.openstack.org/34775210:53
*** jlanoux has joined #openstack-infra10:54
*** florianf has quit IRC10:54
*** jlanoux_ has quit IRC10:54
*** apetrich has joined #openstack-infra10:57
*** matrohon has quit IRC10:58
*** Ravikiran_K has quit IRC10:59
*** markvoelker has joined #openstack-infra11:02
*** e0ne has quit IRC11:04
*** markvoelker has quit IRC11:06
*** sdake has quit IRC11:08
openstackgerritVasyl Saienko proposed openstack-infra/devstack-gate: Update local.conf for ironic-multinode case  https://review.openstack.org/35279011:09
*** r-mibu has quit IRC11:11
openstackgerritMerged openstack-infra/project-config: Rework translation constraint logic in post job  https://review.openstack.org/35279711:12
*** dkehn has quit IRC11:14
*** matrohon has joined #openstack-infra11:14
*** dkehn_ has quit IRC11:16
*** matrohon has quit IRC11:19
*** r-mibu has joined #openstack-infra11:19
*** SergK has joined #openstack-infra11:20
*** amitgandhinz has joined #openstack-infra11:21
*** dkehn has joined #openstack-infra11:21
*** lucasagomes has joined #openstack-infra11:22
openstackgerritAndrey Nikitin proposed openstack-infra/project-config: Add one new Fuel's plugin  https://review.openstack.org/35244611:23
*** Julien-zte has quit IRC11:24
HeOSHello, infra-team! Could you please review the following request: https://review.openstack.org/#/c/352446/? :)11:24
*** sshnaidm|lnch is now known as sshnaidm11:25
*** amitgandhinz has quit IRC11:25
AJaegerHeOS: why was that job rebased? ;(11:26
AJaegerThat's a waste of resources and completely counter productive since it makes it difficult to compare several revisions ;(11:26
*** jaosorior has quit IRC11:27
HeOSAJaeger, got it, sorry me. :( I thought, that's normal way to rebase, when it needs.11:27
*** jkilpatr has joined #openstack-infra11:28
AJaegerHeOS: Only rebase if there is a merge conflict. Otherwise you make reviewing harder since I cannot see what was changed between revisions.11:28
*** jaosorior has joined #openstack-infra11:28
AJaegerHeOS: our systems rebase internally before testing or merge, so no need for you ever to rebase unless there's a merge conflict11:29
*** ericksonsantos has joined #openstack-infra11:29
*** dkehn_ has joined #openstack-infra11:29
AJaegerRight now we have a fully loaded system, might take 2h for the check jobs to come back on that change...11:29
*** yamamoto has quit IRC11:30
HeOSAJaeger, :(11:31
*** apetrich_ has joined #openstack-infra11:32
*** lucasagomes has quit IRC11:34
*** apetrich_ has quit IRC11:34
*** apetrich has quit IRC11:35
AJaegeryolanda, pabelanger, could you review https://review.openstack.org/#/c/352805/ , please? That removes one extra doc job from devstack that we run by accident - one doc job is enough ;)11:35
*** lucasagomes has joined #openstack-infra11:35
*** matrohon has joined #openstack-infra11:35
yolanda++11:37
*** javeriak has quit IRC11:37
AJaegerthanks, yolanda11:38
*** lucasagomes has quit IRC11:39
*** rbuzatu has joined #openstack-infra11:39
*** coolsvap_ is now known as coolsvap11:39
*** rbuzatu has quit IRC11:40
*** gouthamr has joined #openstack-infra11:40
*** lucasagomes has joined #openstack-infra11:41
*** rbuzatu has joined #openstack-infra11:41
*** dprince has joined #openstack-infra11:43
zigoAJaeger: How can I see the logs of the POST jobs of deb-auto-backports that just went through?11:44
*** lucasagomes is now known as lucas-hungry11:44
zigoSHA is: a82aa6761ad54973d7c3aadfc46e96d763b045d411:44
jrollzigo: under bullet point 1 http://docs.openstack.org/infra/manual/developers.html#automated-testing11:44
zigoThanks.11:44
AJaegerThen it's trivial: logs.openstack.org/<first 2 digits of sha>/full-sha11:44
jrollzigo: or an easier way: https://pypi.python.org/pypi/git-os-job :)11:44
AJaegerzigo, or use "git-os-job"11:45
* jroll high fives AJaeger11:45
AJaegerjroll: thanks! I give up ;)11:45
jroll:D11:45
zigoAJaeger: That's not a thing packaged for Debian, is it? :011:45
*** rfolco has joined #openstack-infra11:45
*** ldnunes has joined #openstack-infra11:45
* zigo packages that11:45
*** ihrachys has quit IRC11:47
AJaegerzigo: tomorrow it might be ;)11:47
*** julim has joined #openstack-infra11:47
* zigo only has packaged software installed, and will continue to do so... :)11:49
*** ihrachys has joined #openstack-infra11:50
*** yamamoto has joined #openstack-infra11:51
*** yamamoto has quit IRC11:51
*** matrohon has quit IRC11:53
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Fix constraints-git-prep  https://review.openstack.org/35286511:54
*** thorst_ has joined #openstack-infra11:54
AJaegerNow another 2+ hours to wait for a fix that I introduced ;( yolanda, could you review again as time permits, please? ^11:55
zigoOk, understood what happened.11:55
zigoI should fix jessie-newton -> jessie-newton-backports in the Distribution: field of .changes files.11:55
*** dprince has quit IRC11:56
yolanda++11:56
zigoIMO, it'd be easier to just add --ignore=wrongdistribution to reprepro.11:56
*** dprince has joined #openstack-infra11:56
*** sshnaidm is now known as sshnaidm|afk11:56
*** weshay has joined #openstack-infra11:57
AJaegerthanks, yolanda11:57
yolandasorry that i didn't catch the failure as well11:57
AJaegerno worries, I wrote it ;)11:59
openstackgerritThomas Goirand proposed openstack-infra/project-config: Add --ignore=wrongdistribution parameter to reprepro  https://review.openstack.org/35286712:00
zigoAJaeger: This will fix the trouble.12:00
*** amitgandhinz has joined #openstack-infra12:01
*** yamamoto has joined #openstack-infra12:02
*** markvoelker has joined #openstack-infra12:02
*** rhallisey has joined #openstack-infra12:04
*** ivyyy_ is now known as ivyyy12:04
*** jcoufal has joined #openstack-infra12:06
AJaegerzigo, let's go for extended lunch and wait until 352867 and 352865 have passed the check queue (eta: 2 hours) ;)12:07
zigomordred: Cheers ! :)12:07
*** markvoelker has quit IRC12:07
zigoAJaeger: I just went for my lunch after the previous $FILE patch ... :P12:08
AJaeger;/12:08
zigoAJaeger: Bon appetit.12:08
* AJaeger was out as well but will get a coffee now.12:09
AJaegermordred: could you review https://review.openstack.org/350184 as well, please?12:09
*** matrohon has joined #openstack-infra12:09
*** yolanda_ has joined #openstack-infra12:11
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Handle new bindep file  https://review.openstack.org/35287112:11
*** amoralej is now known as amoralej|lunch12:12
*** mrmartin has quit IRC12:14
*** yolanda_ has quit IRC12:15
*** zhurong has joined #openstack-infra12:15
*** ccamacho is now known as ccamacho|lunch12:20
*** pradk has joined #openstack-infra12:20
*** jcoufal has quit IRC12:22
*** jcoufal has joined #openstack-infra12:22
*** akshai has joined #openstack-infra12:22
openstackgerritMerged openstack-infra/bindep: Add bindep.txt as default filename  https://review.openstack.org/35018412:22
*** markvoelker has joined #openstack-infra12:23
*** Jeffrey4l has quit IRC12:23
*** rbuzatu has quit IRC12:24
*** lucas-hungry is now known as lucasagomes12:24
openstackgerritAlexander Evseev proposed openstack-infra/zuul: Report job status 'QUEUED' for queued jobs  https://review.openstack.org/27296712:25
*** rbuzatu has joined #openstack-infra12:26
*** e0ne has joined #openstack-infra12:26
*** amitgandhinz has quit IRC12:26
*** amitgandhinz has joined #openstack-infra12:27
*** Julien-zte has joined #openstack-infra12:27
*** matrohon has quit IRC12:28
*** tpsilva has joined #openstack-infra12:28
*** rlandy has joined #openstack-infra12:28
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual: bindep: other-requirments -> bindep.txt  https://review.openstack.org/35287812:28
*** yamamoto has quit IRC12:29
*** yolanda has quit IRC12:29
openstackgerritZara proposed openstack-infra/storyboard-webclient: 'All Boards and Worklists' Page  https://review.openstack.org/27975312:30
*** mdrabe has joined #openstack-infra12:30
*** kzaitsev1mb is now known as kzaitsev_mb12:31
*** psilvad has joined #openstack-infra12:32
*** burgerk has joined #openstack-infra12:32
*** ayoung has quit IRC12:33
*** javeriak has joined #openstack-infra12:33
*** sshnaidm|afk is now known as sshnaidm12:33
openstackgerritSagi Shnaidman proposed openstack-infra/project-config: Add experimental tripleo jobs  https://review.openstack.org/35288012:33
pabelangerzigo: mind posting a link to the log12:35
AJaegergood morning, pabelanger !12:35
*** sshnaidm has quit IRC12:35
*** florianf has joined #openstack-infra12:35
jpmaxmanyou around fungi ?12:35
zigopabelanger: http://logs.openstack.org/a8/a82aa6761ad54973d7c3aadfc46e96d763b045d4/post/reprepro-import-debian-openstack-jessie-backports/a8f7283/console.html12:35
zigopabelanger: FYI, sbuild uses whatever is called the chroot to populate Distribution:.12:36
zigoThat's very annoying.12:36
*** rbuzatu has quit IRC12:36
AJaegerpabelanger: could you review https://review.openstack.org/#/c/352701/ and https://review.openstack.org/#/c/352704/ as well, please? Those are further duplicated job fixes....12:36
*** roxanaghe has joined #openstack-infra12:36
zigopabelanger: There's ways around that, but that's more complicated than just telling reprepro to ignore the .changes Distribution: field.12:37
*** rbuzatu has joined #openstack-infra12:37
*** yaume has quit IRC12:38
*** rossella_s has quit IRC12:38
openstackgerritMonty Taylor proposed openstack-infra/shade: Make shared an optional keyword param to create_network  https://review.openstack.org/35288112:38
*** rossella_s has joined #openstack-infra12:39
*** kushal has quit IRC12:39
pabelangerAJaeger: +3 thanks for cleaning that up12:39
*** roxanaghe has quit IRC12:41
AJaegerpabelanger: thanks for reviewing. I'll be more careful reviewing these xenial moves going forward, this is all tricky...12:41
*** kushal has joined #openstack-infra12:41
AJaegerpabelanger: one more review request: https://review.openstack.org/#/c/352865/ - that's fixing a bug that I introduced...12:41
senk_may i ask one of you to review this trivial one? https://review.openstack.org/#/c/351804/12:41
*** kushal has quit IRC12:41
pabelangerzigo: right, we'd need the distribution to be jessie-newton-backports that's why reprepro is failing12:42
AJaegerpabelanger: should I remove my +A?12:42
*** gordc has joined #openstack-infra12:43
zigopabelanger: I fixed that for being jessie-newton already for "normal" packages, but for these backports, I'd have to do special cases and all ...12:43
pabelangerzigo: looks like we can use --ignore=wrongdistribution, but I haven't tested it before12:43
pabelangerAJaeger: looking12:43
AJaegerit will take at least another hour before it's through check queue, so you can discuss some more - and readd if you want...12:43
pabelangerAJaeger: +312:43
pabelangerAJaeger: and ya, the regex adds complications for sure12:44
AJaegerpabelanger: oh yeah ;(12:44
*** matrohon has joined #openstack-infra12:44
pabelangerzigo: Ya, I think you might need to do that.12:45
openstackgerritMerged openstack-infra/project-config: Remove duplicate devstack docs jobs  https://review.openstack.org/35280512:45
*** javeriak has quit IRC12:45
*** javeriak has joined #openstack-infra12:47
openstackgerritMerged openstack-infra/project-config: Remove duplicate jobs due to xenial move  https://review.openstack.org/35270112:48
openstackgerritMerged openstack-infra/project-config: Fix fuel xenial/trusty jobs  https://review.openstack.org/35270412:48
*** matt-borland has joined #openstack-infra12:48
*** aviau has quit IRC12:49
*** rbuzatu has quit IRC12:49
*** aviau has joined #openstack-infra12:49
*** rbuzatu has joined #openstack-infra12:50
*** piet has joined #openstack-infra12:53
*** matrohon has quit IRC12:54
*** kushal has joined #openstack-infra12:55
*** yolanda has joined #openstack-infra12:57
fungijpmaxman: back now. i've poked at the demo wiki and prodded others to do the same. no concerns raised yet12:57
fungifigured i'd mention it in the infra team meeting today to get it a little more visibility and also follow up to one of the previously active threads about wiki health on the -dev ml12:57
fungibut it's looking good i think12:57
*** sshnaidm has joined #openstack-infra12:58
*** coolsvap is now known as _coolsvap_12:58
*** _ari_ has joined #openstack-infra12:59
*** mriedem has joined #openstack-infra12:59
openstackgerritAndrea Scarpino proposed openstack-infra/jenkins-job-builder: Reporters: support for perModuleEmail field  https://review.openstack.org/35279912:59
*** rbuzatu has quit IRC13:00
*** zul_ has quit IRC13:00
AJaegerfungi, the bindep.txt change is in - whenever you feel like a new bindep release please do it. I also updated documentation and project-config. https://review.openstack.org/#/q/status:open++branch:master+topic:bindep will give open changes. Question is, should we rename other-requirements.txt to bindep everywhere?13:01
*** andymaier has joined #openstack-infra13:01
fungihow many places so far is everywhere?13:02
mordredfungi, AJaeger: I kinda feel like we should update the requirements proposal bot to propose a rename of the file if it sees it's o-r.txt13:02
*** kushal has quit IRC13:02
mordredso that it's not a patch bomb and just sort of happens naturally without a bunch of thought13:03
fungii think it depends on the order of magnitude of changes we're talking about13:03
mordredthat's a good point13:03
AJaegerwe have at least 137 other-requirements.txt files ;(13:03
* AJaeger just checked locally13:04
*** thiagop has joined #openstack-infra13:04
AJaegerhttps://review.openstack.org/352871 handles both files13:04
* AJaeger can script the removal13:04
AJaegermordred: requirements bot will not help, it's not run on all these repos13:04
mordredoh - that's also a good point13:05
*** links has quit IRC13:06
*** zul_ has joined #openstack-infra13:06
jpmaxmanfungi: ok sounds good - if you want to go ahead and spin up a fresh trusty server I can more get it running there documenting the steps so they could potentially be scripted13:07
*** kushal has joined #openstack-infra13:07
*** sdake has joined #openstack-infra13:08
*** sdake has quit IRC13:08
*** sdake has joined #openstack-infra13:08
*** yaume has joined #openstack-infra13:09
fungijpmaxman: also Krenair has apparently gotten the bones of a working trusty mediawiki 1.27 deployment puppeted, though i haven't had a chance to review his proposed changes for the puppet-mediawiki module yet13:09
*** piet has quit IRC13:10
fungiAJaeger: wow, that's spread far faster than i anticipated13:10
*** matrohon has joined #openstack-infra13:10
AJaegerfungi: 48 of thse are ansible, 35 puppet, 12 salt.13:12
*** baoli has joined #openstack-infra13:13
fungithat explains it13:14
jpmaxmanfungi: ok - that's fine - the main issue is the DB upgrade, but we could potentially use the existing wiki-test-upgrade machine to run the maintenance upgrade scripts stepping from 1.25pr --> 1.25 --> 1.26 --> 1.27 then point a fresh 1.27 mediawiki puppeted machine to the fin al DB13:14
*** baoli_ has joined #openstack-infra13:14
*** raildo has joined #openstack-infra13:14
AJaegerfungi, should be easy to script with a big for loop since I have all repos checked out ;)13:14
*** julim has quit IRC13:14
jpmaxmanfungi: my main issue is one of timing and getting this wrapped up13:15
AJaegerbut first we need a new bindep release, https://review.openstack.org/352878 and https://review.openstack.org/352878 merged - and an announcement.13:15
jpmaxmanfungi: also there is no reason to keep this as a local mysql if you don't want to  - trove should be fine13:15
*** rbuzatu has joined #openstack-infra13:16
jpmaxmanfungi: but again I don't want to make such big leaps that this gets bogged down, so I'd defer to what we can get up and running with nocapctha in place sooner rather than later even if we need to circle back around to puppetize / move to trove13:16
fungijpmaxman: oh, if you're under a time constraint, we can just push to get the current production server upgraded following steps similar to what you did on the upgrade test, and then another of us can work separately on migrating it to a fresh trusty install using Krenair's puppet module updates, moving static content onto a cinder volume, db into trove, et cetera13:17
*** sdake has quit IRC13:17
fungii'm not attached to any particular order of getting these tasks done13:17
*** xyang1 has joined #openstack-infra13:17
AJaegerfungi, I added constraints and bindep to our team meeting agenda. I suggest I do a brief announcement - and if there are questions, we can discuss at end13:17
*** baoli has quit IRC13:18
fungiAJaeger: can do13:18
jpmaxmanfungi: maybe we should do that as I still have a mild concern of proving the nocapthca successfully stops the spam13:18
*** permalac has joined #openstack-infra13:18
jpmaxmanfungi: then it would give some breathing room to get a proper environment up and running13:18
jpmaxmanfungi: and with the DB ready for 1.27 it should also be easy to point to it to test13:19
*** sdake has joined #openstack-infra13:19
*** jpeeler has joined #openstack-infra13:19
fungijpmaxman: in that case, i'll whip up a quick announcement followup to the prior wiki discussion thread on the mailing list... what day/time works well for you for the cut-over?13:19
*** edmondsw has joined #openstack-infra13:19
jpmaxmanfungi: there was also a setting I came across that requires a new user authenticated with Open ID to revalidate their email address for access to the wiki (I think) that could be something else to look into...13:20
AJaegerpabelanger: could you look at http://grafana.openstack.org/dashboard/db/nodepool, please? your change from last night to use "stacked" is somehow broken and we should either revert or fix13:21
openstackgerritDoug Hellmann proposed openstack-infra/project-config: fix diff-start handling in release scripts  https://review.openstack.org/35289713:21
fungijpmaxman: yeah, not a bad idea. also there's that module that checks ip addresses against the stopforumspam global database13:21
openstackgerritAleksey Zvyagintsev proposed openstack-infra/project-config: Add {murano-app}-unittest job  https://review.openstack.org/35175713:22
jpmaxmanfungi: I'm heading back to the states Thursday - next Tuesday?   In the mean time I think on thing we could do is move to a trove db as that would at least separate the mysql dependency from the server?13:23
*** esberglu has joined #openstack-infra13:23
*** sdake_ has joined #openstack-infra13:23
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: fix release notes for final releases  https://review.openstack.org/35255013:23
jpmaxmanfungi: but if that is problematic could wait on that too13:23
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: fix release notes for final releases  https://review.openstack.org/35255013:23
*** sdake has quit IRC13:24
*** nmagnezi has quit IRC13:24
fungijpmaxman: yeah, i'm pondering it. would mean an additional brief outage to move the db, but could shorten the other outage shightly as a result13:25
fungithough the time involved in copying a mysqldump from one server to the other is only a few seconds based on my earlier refresh13:25
*** amoralej|lunch is now known as amoralej13:25
jpmaxmanwell we have to either move the db from server to server or from server --> trove13:25
jpmaxmandon't think it matters much13:25
fungii want to say it was like a minute to run mysqldump and 30 seconds to scp it to ther test server13:26
jpmaxmany so you could mysqldump and restore to trove13:26
*** ayoung has joined #openstack-infra13:26
fungiright, that's how i would do it if we put it in trove first13:26
fungiand then update the dburi13:27
jpmaxmany - ok well think about it13:27
*** berendt has joined #openstack-infra13:27
*** Goneri has quit IRC13:28
jpmaxmanI'm fine either way with a slight preference of going to trove as I think it would make the subsequent steps easier13:28
jpmaxmanalso if you give me a trove instance I could run some tests using the dump you dropped on the test server :)13:29
*** yamamoto has joined #openstack-infra13:29
fungijpmaxman: can do. that's easy enough13:29
pabelangerAJaeger: ya, I think I know the issue13:30
*** thorst_ has quit IRC13:31
lennybis someone using jenkins multijob plugin #link http://docs.openstack.org/infra/jenkins-job-builder/builders.html#builders.multijob13:31
*** agentleweb has joined #openstack-infra13:32
*** Goneri has joined #openstack-infra13:33
Zaraanyone able to take a look at: https://review.openstack.org/#/c/351273/ ? it updates review-dev storyboard integration so it behaves the same way as the planned patches for review.o.o. this means we can test the behaviour and see if it's what we want in production. currently has a +2 and a +1, so needs more reviews.13:34
openstackgerritGraham Hayes proposed openstack-infra/project-config: Enable voting for designate grenade job  https://review.openstack.org/35290413:34
*** rodrigods has quit IRC13:35
*** rodrigods has joined #openstack-infra13:35
*** yamamoto has quit IRC13:37
openstackgerritOleh Baran proposed openstack-infra/project-config: Add non-voting unit test coverage job for murano-dashboard  https://review.openstack.org/35241213:37
*** sarob has joined #openstack-infra13:37
*** ccamacho|lunch is now known as ccamacho13:37
*** witek has joined #openstack-infra13:37
mtreinishrcarrillocruz, pabelanger: I got bored last night and did that: https://github.com/ansible/ansible-modules-extras/pull/270013:37
witekhello, how can I upload a file to wiki.openstack.org?13:38
pleia2updated the topic on Krenair's mediawiki patches so we can more easily review them, it's now what we defined in the spec: https://review.openstack.org/#/q/status:open+topic:wiki-upgrade13:38
pabelangermtreinish: nice!13:38
*** _nadya_ has quit IRC13:40
*** Jeffrey4l has joined #openstack-infra13:41
*** Jeffrey4l has quit IRC13:42
*** matrohon has quit IRC13:42
pleia2also, good morning :) home now, with incredible jet lag13:42
*** sarob has quit IRC13:42
AJaegermorning, pleia2 !13:42
Zarapleai2: yay! :) how was the trip?13:42
*** agentleweb has quit IRC13:42
openstackgerritVasyl Saienko proposed openstack-infra/devstack-gate: Update local.conf for ironic-multinode case  https://review.openstack.org/35279013:43
openstackgerritVasyl Saienko proposed openstack-infra/devstack-gate: Do not add c-api,c-bak on subnode with Ironic  https://review.openstack.org/35290913:43
pleia2Zara: it was wonderful, thanks!13:43
Zara\o/13:44
fungiwitek: we've temporarily disabled file uploads for wiki.openstack.org because our current spam mitigation doesn't cover that function and spammers seem to love uploading images and pdfs of spam13:44
pabelangerAJaeger: lets revert for now, until I can debug it properly13:44
openstackgerritVasyl Saienko proposed openstack-infra/devstack-gate: Update local.conf for ironic-multinode case  https://review.openstack.org/35279013:44
openstackgerritVasyl Saienko proposed openstack-infra/devstack-gate: Do not add c-api,c-bak on subnode with Ironic  https://review.openstack.org/35290913:44
fungiwitek: we're working on upgrading to newer software, and once that's finished we may be able to reenable file uploads. not certain yet13:44
*** ramishra has quit IRC13:45
AJaegerpabelanger: will you propose the revert?13:46
witekfungi: thanks13:46
*** javeriak has quit IRC13:47
openstackgerritMerged openstack-infra/tripleo-ci: upgrades job is renamed to updates  https://review.openstack.org/35193713:47
*** eharney has joined #openstack-infra13:47
openstackgerritAlexander Evseev proposed openstack-infra/zuul: Report job status 'QUEUED' for queued jobs  https://review.openstack.org/27296713:47
fungijpmaxman: okay, the trove instance has been created now. i privmsg'd you the info13:48
openstackgerritAlexander Evseev proposed openstack-infra/zuul: Report job status 'QUEUED' for queued jobs  https://review.openstack.org/27296713:48
*** rfolco has quit IRC13:48
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement undercloud upgrade job - Mitaka -> Newton  https://review.openstack.org/34699513:48
*** rfolco has joined #openstack-infra13:49
*** pgadiya has quit IRC13:49
*** spzala has joined #openstack-infra13:50
*** PollyZ has joined #openstack-infra13:50
openstackgerritSam Yaple proposed openstack-infra/shade: Add update_endpoint()  https://review.openstack.org/28905213:51
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Revert "Stack nodepool images targets in grafana"  https://review.openstack.org/35291213:51
AJaegerpabelanger: reversal ^13:51
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Implement non-ovb overcloud update job - Newton -> Newton  https://review.openstack.org/35133013:52
*** SumitNaiksatam has joined #openstack-infra13:52
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement overcloud upgrade job - Mitaka -> Newton  https://review.openstack.org/32375013:53
openstackgerritMatthew Treinish proposed openstack-infra/puppet-mosquitto: Add support for configuring tls ports  https://review.openstack.org/34801913:54
mtreinishpabelanger: ^^^ that should fix what you pointed out13:54
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: additional info about host in CI  https://review.openstack.org/35291613:55
*** mrmartin has joined #openstack-infra13:56
*** julim has joined #openstack-infra13:57
openstackgerritOleh Baran proposed openstack-infra/project-config: Add non-voting unit test coverage job for murano-dashboard  https://review.openstack.org/35241213:57
*** bin_ has joined #openstack-infra13:58
*** matrohon has joined #openstack-infra13:58
*** agentleweb has joined #openstack-infra13:58
*** matrohon has quit IRC13:59
*** hongbin has joined #openstack-infra13:59
*** jistr is now known as jistr|debug14:00
*** _coolsvap_ is now known as coolsvap14:00
*** woodster_ has joined #openstack-infra14:01
*** xarses_ has quit IRC14:03
*** rbrndt has joined #openstack-infra14:03
pabelangerAJaeger: +314:04
*** sin_ has joined #openstack-infra14:04
*** tonytan4ever has joined #openstack-infra14:05
kozhukalovhi, team. I can not upload images to https://wiki.openstack.org. Looks like file_uploads = Off. Is it temporary?14:05
*** hieulq_ has joined #openstack-infra14:06
*** zz_dimtruck is now known as dimtruck14:06
kozhukalovI mean wiki configuration disabled file uploads.14:07
mugsieAJaeger: when I am running `tox -e zuul` locally I am getting http://paste.openstack.org/show/552446/14:07
*** nmagnezi has joined #openstack-infra14:07
AJaegerkozhukalov: correct, we disabled due to spam14:09
sin_hello, I use zmq-event-publisher with my jenkins version 1.651, but it didn't listen at port 8888. I have enabled it globally. the port 8888 is free.who knows why14:09
*** mtanino has joined #openstack-infra14:09
AJaegermugsie, that shouldn't happen, it'S outside of your change. Best to rm -rf .test...14:10
*** jcoufal has quit IRC14:10
*** burgerk has quit IRC14:10
sin_no log like "Binding ZMQ PUB to port..." in log14:11
*** mrmartin has quit IRC14:11
AJaegermugsie: let me run it myself14:12
*** edtubill has joined #openstack-infra14:12
openstackgerritMiles Gould proposed openstack/diskimage-builder: Allow installing proliant tools from an OS package  https://review.openstack.org/34421414:14
openstackgerritDoug Hellmann proposed openstack-infra/project-config: try harder to update constraint when a library is released  https://review.openstack.org/35292914:14
*** matrohon has joined #openstack-infra14:15
*** senk_ has quit IRC14:16
*** jheroux has joined #openstack-infra14:19
openstackgerritMerged openstack-infra/project-config: Add --ignore=wrongdistribution parameter to reprepro  https://review.openstack.org/35286714:19
openstackgerritMerged openstack-infra/project-config: Fix constraints-git-prep  https://review.openstack.org/35286514:20
*** mrmartin has joined #openstack-infra14:21
openstackgerritBrad P. Crochet proposed openstack-infra/tripleo-ci: Use tripleo-build-images for CI  https://review.openstack.org/33631214:21
*** yamahata has joined #openstack-infra14:22
openstackgerritBrad P. Crochet proposed openstack-infra/tripleo-ci: Use tripleo-build-images for CI  https://review.openstack.org/33631214:24
AJaegermugsie: when I ran it locally, I get: http://paste.openstack.org/show/552453/14:25
*** mriedem1 has joined #openstack-infra14:25
*** tosky_ has joined #openstack-infra14:25
*** thorst_ has joined #openstack-infra14:26
*** mriedem has quit IRC14:26
openstackgerritGraham Hayes proposed openstack-infra/project-config: Enable voting for designate grenade job  https://review.openstack.org/35290414:26
openstackgerritMonty Taylor proposed openstack-infra/shade: Make shared an optional keyword param to create_network  https://review.openstack.org/35288114:26
*** mrmartin has quit IRC14:27
mugsieAJaeger: yeah, clearing the .test folder helped.14:27
mugsieit would also help to git add all the files in the commit14:27
*** tosky has quit IRC14:27
*** yamahata has quit IRC14:28
*** thiagolib has quit IRC14:28
*** nherciu_ has quit IRC14:29
*** narayrak has quit IRC14:30
*** sdake_ is now known as sdake14:30
*** claudiub has joined #openstack-infra14:32
*** yaume has quit IRC14:33
*** edtubill has quit IRC14:34
*** mrmartin has joined #openstack-infra14:35
*** mriedem1 is now known as mriedem14:36
AJaegermugsie: change looks fine now14:36
*** asettle has joined #openstack-infra14:36
*** ramishra has joined #openstack-infra14:38
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove generated zuul content  https://review.openstack.org/35294214:38
AJaegermugsie: this change might help you next time partially ^14:38
*** Goneri has quit IRC14:38
*** thorst_ has quit IRC14:38
*** adrian_otto has joined #openstack-infra14:39
*** matrohon has quit IRC14:41
*** adrian_otto1 has joined #openstack-infra14:41
*** senk_ has joined #openstack-infra14:41
*** Jeffrey4l has joined #openstack-infra14:42
*** savihou has joined #openstack-infra14:43
*** xarses_ has joined #openstack-infra14:44
*** adrian_otto has quit IRC14:44
*** chem has joined #openstack-infra14:46
*** burgerk has joined #openstack-infra14:48
matt-borlandHello--https://review.openstack.org/#/c/349077/ is a patch for Horizon...we need to split our integration test jobs out.  We have a +2 and a +1 from the Horizon PTL.14:48
openstackgerritCsaba Henk proposed openstack-infra/project-config: Add jobs for Manila glusterfs, glusterfs-native drivers with Heketi layout  https://review.openstack.org/28763214:50
openstackgerritCsaba Henk proposed openstack-infra/project-config: templatize Manila GlusterFS jobs  https://review.openstack.org/35012014:50
openstackgerritMerged openstack-infra/subunit2sql: Fix the subunit2sql migration and tests error with mysql 5.7  https://review.openstack.org/34775214:52
*** senk_ has quit IRC14:54
*** vvalderrv has joined #openstack-infra14:54
openstackgerritAlexander Evseev proposed openstack-infra/zuul: Create Merger Git repos using connection names  https://review.openstack.org/28266014:55
openstackgerritAleksey Zvyagintsev proposed openstack-infra/project-config: Add {murano-app}-unittest job  https://review.openstack.org/35175714:56
*** tonytan4ever has quit IRC14:56
*** sarob has joined #openstack-infra14:56
openstackgerritVasyl Saienko proposed openstack-infra/devstack-gate: Update local.conf for ironic-multinode case  https://review.openstack.org/35279014:56
Guest55455AJaeger hi. could you re-check https://review.openstack.org/#/c/351757/ ? not sure, that i update it correctly regarding -nv suffix14:56
*** tonytan4ever has joined #openstack-infra14:57
*** matrohon has joined #openstack-infra14:57
*** Guest55455 has quit IRC14:58
*** xarses_ is now known as xarses14:58
*** azvyagintsev has joined #openstack-infra14:58
*** azvyagintsev has quit IRC14:59
*** azvyagintsev has joined #openstack-infra14:59
*** edtubill has joined #openstack-infra14:59
*** ptacemic has quit IRC14:59
*** sarob has quit IRC15:01
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Fix constraints-git-prep  https://review.openstack.org/35295415:01
azvyagintsevAJaeger: - Do you want to run this on stable branches as well? yup15:02
*** oanson has quit IRC15:02
*** adrian_otto1 has quit IRC15:02
*** adrian_otto has joined #openstack-infra15:02
AJaegerazvyagintsev: then the change is fine after changing the {node} - but please leave that as comment in review for others to see...15:02
openstackgerritAleksey Zvyagintsev proposed openstack-infra/project-config: Add {murano-app}-unittest job  https://review.openstack.org/35175715:03
azvyagintsevyup, already. just duplicate for notify15:03
*** matrohon has quit IRC15:04
*** adrian_otto has quit IRC15:04
openstackgerritZara proposed openstack-infra/storyboard-webclient: 'All Boards and Worklists' Page  https://review.openstack.org/27975315:04
azvyagintsevAJaeger btw, how '-nv' suffix work ? where is logic which work on it ?15:04
*** nherciu has joined #openstack-infra15:04
*** thorst_ has joined #openstack-infra15:04
*** mrmartin has quit IRC15:05
*** adrian_otto has joined #openstack-infra15:06
*** rkukura has quit IRC15:08
*** ganesan has joined #openstack-infra15:09
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Used subunit to track metrics  https://review.openstack.org/35296115:10
*** ganesan has quit IRC15:11
mtreinishpabelanger: ^^^ that will make a subunit stream with a test called devstack :)15:12
mtreinishpabelanger: http://docs.openstack.org/developer/os-testr/generate_subunit.html15:12
*** thorst_ has quit IRC15:12
*** ganesan has joined #openstack-infra15:12
pabelangermtreinish: I'm okay with that for now. I wanted to see how it worked first15:12
*** gyee has joined #openstack-infra15:12
ganesanI am getting the Error "SSHException: not a valid RSA private key file" when nodepool is trying to ssh15:13
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Set Sahara workers to 0  https://review.openstack.org/35272915:13
ganesanhere is the message from nodepool.log "http://paste.openstack.org/show/552465/"15:13
*** adrian_otto has quit IRC15:13
*** adrian_otto has joined #openstack-infra15:14
*** gongysh has joined #openstack-infra15:14
*** vincentll has quit IRC15:16
mtreinishpabelanger: heh, ok15:16
*** thorst_ has joined #openstack-infra15:16
*** links has joined #openstack-infra15:17
fungiganesan: do you have private-key set to /home/nodepool/.ssh/id_rsa in your /etc/nodepool/nodepool.yaml?15:17
fungiganesan: the most likely interpretation of that error message is that whatever you specified for private-key doesn't contain an ssh private key15:18
*** jlanoux has quit IRC15:19
*** adrian_otto has quit IRC15:20
*** matrohon has joined #openstack-infra15:20
*** e0ne has quit IRC15:21
*** thorst_ has quit IRC15:21
asselinganesan, also, you need to make sure you have 2 leading spaces for the private key in the puppet hiera common.yaml file15:22
openstackgerritPaul Belanger proposed openstack-infra/project-config: Remove noop in tripleo-ci queue queue  https://review.openstack.org/35297015:22
*** asettle is now known as Apsettle15:22
*** Na3iL has joined #openstack-infra15:22
*** jistr|debug is now known as jistr15:23
*** javeriak has joined #openstack-infra15:23
asselinganesan, white space here is important for yaml syntax: http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/contrib/single_node_ci_data.yaml#n2015:23
*** e0ne has joined #openstack-infra15:24
pabelangermordred: any update on bring bluebox back online? Anything I can help with?15:24
*** armax has joined #openstack-infra15:24
*** karthikp_ has joined #openstack-infra15:25
*** yamamoto has joined #openstack-infra15:25
*** andymaier has quit IRC15:25
*** yamamoto has quit IRC15:25
mordredpabelanger: I have so far done zero work other than updating the admin user information in the passwords file15:26
mordredpabelanger: if you have bandwidth and want to work on it further, it will not hurt my feelings15:26
pabelangermordred: sure, I can get started on that.15:26
ganesanfungi, yes, private key is set to /home/nodepool/.ssh/id_rsa "http://paste.openstack.org/show/552468/"15:26
openstackgerritMerged openstack-infra/tripleo-ci: Add conditional check for tripleo-test-cloud-rh1  https://review.openstack.org/34698515:27
*** matrohon has quit IRC15:27
asselinganesan, first, don't make your private key public. 2nd it should be multi-line.15:27
asselinso maybe that's your public key?15:28
fungiyeah, that also doesn't look like an ssh private key to me15:28
fungithey usually start with -----BEGIN RSA PRIVATE KEY----- on a line by itself15:28
*** ams__ has joined #openstack-infra15:28
ganesanasselin, ok, no that is private key15:28
*** hieulq_ has quit IRC15:29
*** kushal has quit IRC15:29
*** thorst_ has joined #openstack-infra15:29
mordredganesan: that is not a valid rsa private key. how did you produce that?15:29
openstackgerritPaul Belanger proposed openstack-infra/project-config: Revert "Remove bluebox"  https://review.openstack.org/35297315:29
pabelangermordred: anteaya: ^ first step to bring bluebox online. Should start uploading images to the cloud15:30
*** wcriswell has joined #openstack-infra15:30
fungiis should have a start marker line, followed by 20+ lines (depending on the size key you generated) of base64-encoded key material wrapped at 64 columns, and then an end marker15:30
mordredpabelanger: well....15:30
mordredfirst step is we need ot make projects and users and flavors15:30
*** Apsettle is now known as asettle15:30
asselinganesan, double-check your puppet hiera file: http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/contrib/single_node_ci_data.yaml#n2115:31
pabelangermordred: okay, so it is brand, brand new15:31
mordredpabelanger: the only thing that exists in the cloud is the admin user and the 'demo' project15:31
mordredpabelanger: yah15:31
*** yamamoto has joined #openstack-infra15:31
pabelangerokay, Ill finish that off15:31
asselinganesan, or this one...this is nodepool's key to connect to your cloud right? http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/contrib/single_node_ci_data.yaml#n1115:31
ganesanmorderd, we have running CI system (old one without nodepool), I just took it from there15:31
*** hurgleburgler has joined #openstack-infra15:31
*** _nadya_ has joined #openstack-infra15:31
mordredpabelanger: I was planning on using rcarrillocruz's ansible cloud launcher role thing to set those up ... seemed like a good way to capture the needs in git15:31
ganesanasselin, I will check that15:31
*** thorst_ has quit IRC15:31
*** rkukura has joined #openstack-infra15:32
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Use --validation-errros-nonfatal in osinfra jobs  https://review.openstack.org/35297515:34
pabelangermordred: ya, I was thinking ansible for sure15:35
*** yamamoto has quit IRC15:36
*** yamamoto has joined #openstack-infra15:37
karthikp_AJaeger: Hi15:38
*** PollyZ has quit IRC15:38
*** timello has quit IRC15:38
karthikp_Hi, This is one of the patches we need for multi-node grenade testing...https://review.openstack.org/#/c/334537/16. Please could somebody review this and help us in getting this merged15:42
karthikp_Thanks in advane15:42
karthikp_advance*15:42
anteayapleia2: welcome home15:43
*** matrohon has joined #openstack-infra15:44
pabelangerrcarrillocruz: do you have an example layout for ansible-role-cloud-launcher?15:45
*** jlanoux has joined #openstack-infra15:46
*** amoralej is now known as amoralej|brb15:47
anteayaivyyy: hello15:47
ivyyyanteaya: heya!15:47
anteayaivyyy: this is the infra channel, welcome15:47
ivyyyanteaya: thanks very much :D15:48
*** tosky_ has quit IRC15:48
anteayaivyyy: glad to see you online15:48
mordredpabelanger: there's a resource.yaml.sample in the git repo15:48
ivyyyanteaya: i should be idling here pretty much all the time! my bouncer is always on15:48
*** pcaruana has quit IRC15:48
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Used subunit to track metrics  https://review.openstack.org/35296115:48
*** yamamoto has quit IRC15:48
anteayaivyyy: awesome, you are off to a great start15:48
pabelangermordred: ah, missed that. Thanks15:48
fungiivyyy: what are you working on?15:49
*** savihou has quit IRC15:49
fungi(also, welcome!)15:49
ivyyyfungi: i'm new to the community, but i work for Canonical supporting openstack for customers :) i'm just starting learning python and i want to try and become a contributor15:49
ivyyyhi everyone else! since i just gave my intro :315:50
Zarahi, ivyyy! :)15:50
*** rcernin has quit IRC15:50
fungiivyyy: a noble goal. let us know any way we can help you there15:50
mordredpabelanger: there's also a good blog post from rcarrillocruz about it - but I can't find it right now15:50
ivyyythank you!15:50
*** adrian_otto has joined #openstack-infra15:50
*** yamamoto has joined #openstack-infra15:50
*** tesseract- has quit IRC15:50
anteayaivyyy: you might enjoy http://eavesdrop.openstack.org/15:51
*** adrian_otto has quit IRC15:51
fungiivyyy: if you're around from 19:00-20:00 today, that's when we hold our weekly team meeting in #openstack-infra15:51
anteayait has information about all our weekly meetings15:51
fungiyou might find it interesting15:51
fungier, in #openstack-meeting15:51
anteayaand fungi beat me to the next thing I was about to say :)15:51
anteayathanks fungi15:51
fungii'm too used to typing #openstack-infra lately15:51
*** adrian_otto has joined #openstack-infra15:51
ivyyyamazing, i will make sure i catch up on the meeting when i'm back online tonight!15:51
anteayagreat15:51
*** nmagnezi has quit IRC15:51
anteayaalso at the eavesdrop link at the top there are links to all of our logged channels15:52
*** adrian_otto has quit IRC15:52
*** inc0 has joined #openstack-infra15:52
fungineedless to say, openstack uses irc a lot15:52
*** matrohon has quit IRC15:52
AJaegerazvyagintsev: search for "-nv$" in zuul/layout.yaml - it's a global regex that marks the job as non-voting.15:52
anteayalinks to the logs of all of our logged channels, I should say15:52
*** yaume has joined #openstack-infra15:52
ivyyyperfect! irc is a good medium for me since i monitor it all day for work :)15:53
*** thorst_ has joined #openstack-infra15:53
*** mikelk has quit IRC15:53
anteayaivyyy: you'll do fine15:53
*** yamamoto has quit IRC15:53
anteayaivyyy: biggest thing is keep showing up, the rest you will learn eventually15:53
*** PollyZ has joined #openstack-infra15:53
ivyyycool! i'm trying to get my head down on working on my personal python project so that i can get to a basic level of literacy15:54
*** psachin has quit IRC15:54
anteayathat is a great goal15:54
ivyyyso once i have that and have my bearings here i can hopefully be useful15:54
anteayaI do not have strong python, many in channel do, if you have a question do speak up15:54
anteayaeh, don't wait to master python15:55
anteayayou can do both in parallel15:55
*** timello has joined #openstack-infra15:55
ivyyycool :D15:55
*** yaume has quit IRC15:55
anteayaunderstanding infra will take a while15:55
Zara+1, I've learned all my python by developing on storyboard15:55
Zara(I still don't have that much python, though :P)15:55
anteayabest to just start hanging out and attending meetings15:55
ivyyyooh what is that, Zara?15:55
*** psachin has joined #openstack-infra15:55
anteayaivyyy: and follow your heart15:55
AJaegerkarthikp_: didn't know that the dependent job finally merged - ok +2A15:56
*** yamamoto has joined #openstack-infra15:56
Zaraivyyy: I'm so glad you asked! :D it's a task-tracker, https://storyboard.openstack.org/#!/dashboard/stories15:56
Zaraivyyy: there is an angularjs webclient, which is the pretty ui in the browser. and a python api.15:56
fungiivyyy: http://docs.openstack.org/project-team-guide/project-setup/python.html might be a good thing to skim once you get your bearings in python a little, to see what the openstack community's expectations are for its own python-based projects (not to say that they're necessarily useful in your personal project, but they provide some community perspective)15:57
*** hieulq_ has joined #openstack-infra15:57
*** gongysh has quit IRC15:57
*** adrian_otto has joined #openstack-infra15:57
*** Sukhdev has joined #openstack-infra15:57
*** gokrokve has joined #openstack-infra15:58
ivyyyZara: fungi: aaah both of those things are exactly what i was hoping for!15:58
ivyyythank you so much15:58
*** mhickey has quit IRC15:58
ivyyyi'll get started reading that stuff when work is done for today15:59
rcarrillocruzmordred , pabelanger : http://rcarrillocruz.com/deploying-multiple-openstack-clouds-with-ansible-in-a-data-driven-fashion/15:59
mordredrcarrillocruz: yes! that one15:59
*** thorst_ has quit IRC16:00
Zaraivyyy: \o/ I'm doing some work on a python client at the moment so that people can use the command line to interact with it. if you want to help out on making a nice command line interface, we always welcome new contributors! the storyboard team hang out in #storyboard. (and a very early WIP of the interface is over at: https://review.openstack.org/#/c/348418/ )16:01
* Zara stops shamelessly plugging the project16:01
*** yamamoto has quit IRC16:01
ivyyyZara: if i can possibly help i would love to! i'm not really sure how to quantify my level of python ability cos i've only been working on my own pet project but i will try and follow along until i can tell if i can be of use!16:02
ivyyyZara: if you have time to handhold me a bit i might ask you to once i have an idea of how it fits together?16:03
fungizaro: heads up, i've reviewed and approved those review-dev updates you had linked on the meeting agenda16:03
*** adrian_otto has quit IRC16:04
*** dprince has quit IRC16:04
pabelangerrcarrillocruz: mordred: okay, http://paste.openstack.org/show/552472/ is the basic layout for AFS project16:04
openstackgerritMerged openstack-infra/project-config: Cinder experimental multinode grenade job  https://review.openstack.org/33453716:05
*** adrian_otto has joined #openstack-infra16:05
openstackgerritMerged openstack-infra/puppet-gerrit: fix its_rules parameterization in template  https://review.openstack.org/35132316:05
*** matthewbodkin has quit IRC16:05
*** dprince has joined #openstack-infra16:05
Zaraivyyy: you probably already have more than me. :) and yes, that's absolutely fine; even if I don't know answers, I should be able to help you find someone who will know.16:06
rcarrillocruzpabelanger: lgtm,  but the launcher defaults to the cloud name if there's no oscc_cloud defined. i.e., you can safely remove that line as the cloud name is the same16:06
pabelangerrcarrillocruz: figured that was the case16:07
openstackgerritMerged openstack-infra/system-config: Fix setup of server certificate for its-storyboard  https://review.openstack.org/35133616:07
*** zhurong has quit IRC16:07
*** baoli_ has quit IRC16:08
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Fix constraints-git-prep  https://review.openstack.org/35295416:08
AJaegernow tested locally and working ^16:08
*** ggillies has quit IRC16:08
karthikp_AJaeger: It just got merged today :)16:08
*** Julien-zte has quit IRC16:08
openstackgerritMerged openstack-infra/system-config: Update its-storyboard actions on review-dev.o.o  https://review.openstack.org/35127316:08
*** matrohon has joined #openstack-infra16:09
pabelangerrcarrillocruz: how are we going to solved credentials? Setup ansible-vault?16:09
*** e0ne has quit IRC16:09
*** bethwhite_ has joined #openstack-infra16:09
pabelangerrcarrillocruz: or, use an out of tree vars file16:09
*** ggillies has joined #openstack-infra16:10
*** Sukhdev has quit IRC16:12
*** e0ne has joined #openstack-infra16:12
zaromorning16:12
*** PollyZ has quit IRC16:13
openstackgerritMerged openstack-infra/system-config: Upgrade gerrit on review-dev.o.o  https://review.openstack.org/35254316:13
zarofungi: yay, thanks!16:13
*** tswanson_ has quit IRC16:13
rcarrillocruzpabelanger: what creds? Do you mean users private keys?16:14
*** adrian_otto has quit IRC16:14
anteayamorning zaro16:14
*** e0ne has quit IRC16:14
*** jpich has quit IRC16:15
*** amitgandhinz has quit IRC16:15
*** PollyZ has joined #openstack-infra16:15
*** amitgandhinz has joined #openstack-infra16:16
anteayaemails to the mailing list that contain a footer claiming confidentiality of contents always amazes me16:16
ZaraI love those16:16
fungiyeah, it's pretty hilarious16:16
*** matrohon has quit IRC16:17
*** pt_15 has joined #openstack-infra16:17
*** jcoufal has joined #openstack-infra16:17
*** psachin has quit IRC16:17
mordredpabelanger: yah- what creds?16:17
anteayafungi: and apparently another project has decided to change their name, in case you didn't see that email yet, I don't know if there is a patch up yet16:17
mordredanteaya: smaug?16:18
fungianteaya: thanks! i saw the e-mail (compleet with confidentiality footer), didn't see the change mentioned if there is one16:18
*** amitgandhinz has quit IRC16:19
*** amitgandhinz has joined #openstack-infra16:19
Zarafungi: yay, thanks for the its-storyboard reviews! :D16:20
anteayamordred: yeah16:20
*** amoralej|brb is now known as amoralej16:20
anteayafungi: okay I'm seeing the same16:20
Zara(aw, I liked smaug's cute little lego-dragon  mascot)16:22
*** dkehn_ has quit IRC16:24
*** dkehn has quit IRC16:24
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: WIP: Rip out Gearman, add ZooKeeper  https://review.openstack.org/35299616:25
*** itisha has joined #openstack-infra16:26
*** javeriak_ has joined #openstack-infra16:26
*** javeriak has quit IRC16:26
Shrewsjeblair: Before I begin adding ZK complexity, I thought I'd solicit feedback on the overall approach I'm taking in 352996, particularly with the image assignment stuff16:27
openstackgerritLuka Peschke proposed openstack-infra/project-config: Added experimental dsvm CloudKitty installation jobs  https://review.openstack.org/35299716:27
*** raunak has joined #openstack-infra16:27
jeblairShrews: cool, i will look at it asap16:29
HeOSAJaeger, are you around? As far I can see, https://review.openstack.org/#/c/352446/ pass CI-tests. Could you please review?16:29
*** dkehn has joined #openstack-infra16:31
mgagnewhat's the best way to recheck and +A a whole topic in gerrit?16:32
pabelangermordred: rcarrillocruz: https://github.com/openstack/ansible-role-cloud-launcher/blob/master/resources.yml.sample#L2216:32
pabelangermordred: rcarrillocruz: or we don't manage that16:32
*** armax has quit IRC16:32
*** PollyZ has quit IRC16:32
openstackgerritJames E. Blair proposed openstack/gertty: Add an outdated flag for changes  https://review.openstack.org/35300016:33
anteayamgagne: use gertty I think16:33
mgagneI won't use gertty16:33
anteayamgagne: why do you need to recheck a whole topic16:33
mgagnethanks for the suggestion16:33
*** PollyZ has joined #openstack-infra16:33
mgagneanteaya: CI failure which got fixed16:33
*** matrohon has joined #openstack-infra16:34
anteayamgagne: okay then it is one at a time using the gui or api16:34
anteayamgagne: oh, okay16:34
mgagneok, will use GUI and recheck all then16:34
fungimgagne: i think the reason for anteaya's suggestion is that gertty supports batch operations while the gerrit ui does not. another alternative is to use the gerrit api and script something16:34
*** hieulq_ has quit IRC16:34
*** ifarkas is now known as ifarkas_afk16:34
anteayaif it is more than 17 can you give them a pause after 15?16:34
mgagnefungi: right, didn't know about the batch mode. will consider writing a script16:35
anteayalong chains of patches tend to slow things down a bit on the system16:35
mgagnedon't worry, it's on our private system =)16:35
anteayaoh okay16:35
anteayagum youself up to your heart's content then :)16:35
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Used subunit to track metrics  https://review.openstack.org/35296116:36
pabelangerAJaeger: do you mind adding 351278 to your review list? tripleo PTL has +1'd it16:37
mtreinishpabelanger: ^^^ why not just use $SECONDS16:37
anteayapabelanger: mordred anything I can do to help the "bluebox is a cloud again" effort?16:37
mtreinishthen you don't have to worry about subtraction or keeping the formatting consistent16:37
*** rossella_s has quit IRC16:38
mordredpabelanger: ah! that's an excellent point16:38
mordredpabelanger: yah- I think external vars file with var substitution16:38
*** rossella_s has joined #openstack-infra16:39
mordredpabelanger: in fact, -e@/etc/puppet/hieradata/foo.yaml argument to the playbook invocation would totally work, and also keep the variable int he same place :)16:39
*** hieulq_ has joined #openstack-infra16:40
fungii need to step out for a bit and run some errands, but plan to be back in time to do some more prep for our meeting16:41
*** dprince has quit IRC16:42
anteayafungi: enjoy errands16:42
fungiif only!16:42
anteaya:)16:43
*** dkehn_ has joined #openstack-infra16:43
anteayathings are slowing down up here tourist wise16:43
*** dprince has joined #openstack-infra16:43
anteayaI was in town on the weekend and there were only about a third as many boat trailers at the public docks16:43
openstackgerritLuka Peschke proposed openstack-infra/project-config: Added experimental dsvm CloudKitty installation jobs  https://review.openstack.org/35299716:43
anteayait is like city folk thing summer ends after July, which works for me16:44
openstackgerritRoopak Parikh proposed openstack-infra/project-config: Adding first version of project mors  https://review.openstack.org/35195616:45
*** adrian_otto has joined #openstack-infra16:46
*** piet_ has joined #openstack-infra16:47
*** Sukhdev has joined #openstack-infra16:50
*** Sukhdev has quit IRC16:50
pabelangeranteaya: Currently working on adding configuration for ansible-role-cloud-launcher, mordred / rcarrillocruz want to try using that to bring bluebox back online16:51
*** Sukhdev has joined #openstack-infra16:51
*** matrohon has quit IRC16:51
*** Sukhdev has quit IRC16:51
pabelangermtreinish: need to read up on $SECONDS but will likely work16:51
*** asettle has quit IRC16:51
*** armax has joined #openstack-infra16:51
*** adrian_otto has quit IRC16:52
*** asettle has joined #openstack-infra16:52
mordredpabelanger: oh - you know what ...16:52
mordredpabelanger: I have no clue if that file honors variables16:52
mordredpabelanger: this is a fascinating test you've made :)16:52
openstackgerritRyan Selden proposed openstack-infra/irc-meetings: Add a UTC clock for ease of use  https://review.openstack.org/35300816:53
rcarrillocruzpabelanger: sorry was driving16:53
anteayapabelanger: thanks for the status update, let me know if I can do anything to help16:53
rcarrillocruzlet me read scrollback16:53
mordredwhoever Ryan Selden is is the best ever16:53
pabelangermordred: Oooh, right. So maybe we leave our users for now16:53
mordredpabelanger: well, let's give rcarrillocruz a chance to read16:54
*** inc0 has quit IRC16:54
*** dprince has quit IRC16:54
*** yamahata has joined #openstack-infra16:54
*** rbuzatu has quit IRC16:54
*** javeriak has joined #openstack-infra16:56
*** SumitNaiksatam has quit IRC16:56
openstackgerritRyan Selden proposed openstack-infra/irc-meetings: Add a UTC clock for ease of use  https://review.openstack.org/35300816:56
rcarrillocruzpabelanger: ah yeah, good call16:56
*** dtantsur is now known as dtantsur|afk16:56
rcarrillocruzso yeah, probably an external vars file16:56
rcarrillocruzfeed also by -e16:56
*** asettle has quit IRC16:56
rcarrillocruziirc, there's a flag on ansible-playbook to merge dicts16:56
AJaegercould I get  reviews for my fixed constraints changes, please? https://review.openstack.org/352954 should go in today to fix the breakage I introduced with translations ;(16:57
*** hieulq_ has quit IRC16:57
rcarrillocruzso one could theoritecally do something like -e @resources.yaml -e @myomgsecurepasswords and the vars should be merged16:57
rcarrillocruzlet me have a look16:57
*** javeriak_ has quit IRC16:57
*** tphummel has joined #openstack-infra16:57
*** nwkarsten has joined #openstack-infra16:58
*** aarefiev_ is now known as aarefiev16:58
*** lucasagomes is now known as lucas-dinner16:58
*** baoli has joined #openstack-infra16:59
*** yamamoto has joined #openstack-infra16:59
openstackgerritMerged openstack-infra/tripleo-ci: Use --validation-errros-nonfatal in osinfra jobs  https://review.openstack.org/35297517:00
nwkarsteni'm working on my own implementation of logstash. Can the filters set up in this file be inclusive or exclusive? https://github.com/openstack-infra/system-config/blob/master/modules/openstack_project/files/logstash/jenkins-log-client.yaml17:01
*** gokrokve has quit IRC17:02
*** e0ne has joined #openstack-infra17:02
*** yamamoto has quit IRC17:03
openstackgerritPaul Belanger proposed openstack-infra/system-config: Add bluebox to cloud_layouts  https://review.openstack.org/35301317:05
*** hurgleburgler has quit IRC17:05
*** hurgleburgler has joined #openstack-infra17:05
*** Swami has joined #openstack-infra17:05
*** asettle has joined #openstack-infra17:05
pabelangerrcarrillocruz: first pass at configuration.17:05
*** seldenr has joined #openstack-infra17:06
rcarrillocruzjebus, i'm moving, the wifi signal where i am is realllllly bad17:07
rcarrillocruzsec17:07
*** _nadya_ has quit IRC17:08
rcarrillocruzpabelanger: http://docs.ansible.com/ansible/intro_configuration.html#hash-behaviour17:09
rcarrillocruzthere you go17:09
*** piet_ has quit IRC17:09
*** berendt has quit IRC17:10
rcarrillocruzvery excited to see clouds_layouts.yml populated :-)17:10
openstackgerritJames Slagle proposed openstack-infra/project-config: Make Tripleo nonha-multinode and undercloud jobs voting  https://review.openstack.org/35301917:10
*** jcoufal has quit IRC17:10
*** asettle has quit IRC17:10
rcarrillocruzso, pabelanger , my current work item on the launcher is this:17:10
rcarrillocruzhttps://github.com/ansible/ansible-modules-core/pull/426117:10
rcarrillocruzonce i have os_server idempotent, i'll add the launcher the ability to have pre/post provision/unprovision tasks17:11
rcarrillocruzmeaning17:11
rcarrillocruzwe could have something like:17:11
*** sputnik13 has joined #openstack-infra17:11
*** amoralej is now known as amoralej|off17:11
*** tphummel has quit IRC17:11
*** senk_ has joined #openstack-infra17:12
HeOSinfra-team, if you have a moment, please review and merge this request: https://review.openstack.org/#/c/352446/. This request is urgent to us.17:12
rcarrillocruzhttp://paste.openstack.org/show/552482/17:12
*** oanson has joined #openstack-infra17:12
*** ihrachys has quit IRC17:12
rcarrillocruzwhich eventually , would allow us to have data-driven cloud servers provisioning AND configuration17:12
pabelangerrcarrillocruz: Yup, as long as we can run ansible-role-puppet on afs_mirror, we should be good17:13
rcarrillocruzfollowing nibalizer concept of post-merge finglonger actions, we could have a post-merge play run against clouds-layouts.yaml every time is changed17:13
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Used subunit to track metrics  https://review.openstack.org/35296117:13
pabelangerrcarrillocruz: okay, going to give 353013 a run on bluebox to see how it preforms17:13
*** tphummel has joined #openstack-infra17:14
mtreinishpabelanger: http://tldp.org/LDP/abs/html/internalvariables.html17:15
*** piet_ has joined #openstack-infra17:16
*** mrmartin has joined #openstack-infra17:16
*** agentleweb has quit IRC17:18
*** asettle has joined #openstack-infra17:19
*** e0ne has quit IRC17:19
*** javeriak has quit IRC17:21
anteayadougwig: hey there, I haven't seen you about lately, but I was reading the log from last week's tc meeting and you asked the following quesiton17:22
anteayaif you're setting the expectation of non-python projects in infra as non-openstack projects, what kind of priority level for support will there be for breakages?  i would implicitly assume it's less than official projects?17:22
*** vhosakot has joined #openstack-infra17:22
anteayathe support that infra offers is to merge patches to fix issues others have found and tested17:22
*** armax has quit IRC17:22
*** karthikp_ has quit IRC17:22
*** asettle has quit IRC17:23
anteayadougwig: if our infra system goes down then we fix that, but things that are job specific are up to the maintainers of that job to fix17:23
*** e0ne has joined #openstack-infra17:23
anteayain or out of governance is the same in this regard17:23
*** Na3iL has quit IRC17:23
anteayawe don't spend a lot of time chasing jobs, unless we were the ones that introduced the bug17:24
*** PollyZ has quit IRC17:24
*** jerryz has joined #openstack-infra17:24
*** Swami has quit IRC17:25
* rcarrillocruz goes clone devstack to test out ./stack.sh giving a neutron-enabled openstack17:25
*** e0ne has quit IRC17:25
*** SumitNaiksatam has joined #openstack-infra17:26
openstackgerritJames Slagle proposed openstack-infra/project-config: Make Tripleo nonha-multinode and undercloud jobs voting  https://review.openstack.org/35301917:26
pabelangerrcarrillocruz: suggestions? http://paste.openstack.org/show/552484/17:27
pabelanger'item_cloud' is undefined.17:27
rcarrillocruzhmm17:28
rcarrillocruzansible-playboook --version17:28
rcarrillocruz?17:28
*** tonytan4ever has quit IRC17:28
pabelangeransible-playbook 2.0.2.017:28
rcarrillocruzah17:28
rcarrillocruzyeah, you need 2.1.017:28
rcarrillocruzi thought it was upgraded on puppetmaster?17:29
pabelangerya, this is from puppetmaster17:29
pabelangerI can try it from virtualenv17:29
rcarrillocruzyeah17:29
rcarrillocruzi kind of remember the upgrade was reverted due to issues on ansible-role-puppet17:29
rcarrillocruzbut not sure if that was ever fixed17:29
pabelangerYa, I had some patches fixing that17:30
pabelangerI think we merged them17:30
*** armax has joined #openstack-infra17:30
*** weshay has quit IRC17:30
rcarrillocruzthe cloud launcher uses heavily include/with_items constructs, that were known to be broken pre 2.1.017:30
*** zul_ has quit IRC17:30
*** HeOS has quit IRC17:31
*** dprince has joined #openstack-infra17:32
*** asettle has joined #openstack-infra17:32
*** savihou has joined #openstack-infra17:32
openstackgerritIsaku Yamahata proposed openstack-infra/project-config: networking-odl: add experimental grenade job  https://review.openstack.org/35303517:32
*** senk_ has quit IRC17:34
*** zul has joined #openstack-infra17:34
AJaegeranteaya: pleia2: Thanks for review!17:35
pleia2sure thing17:35
*** rossella_s has quit IRC17:36
*** daemontool_ has quit IRC17:36
anteayaAJaeger: welcome, thanks for fixing the issue17:37
*** asettle has quit IRC17:38
*** Swami has joined #openstack-infra17:39
*** ivyyy is now known as ivyyyy-brb17:40
*** zul has quit IRC17:40
*** Swami has quit IRC17:40
*** Swami has joined #openstack-infra17:41
*** Sukhdev has joined #openstack-infra17:41
*** yamahata has quit IRC17:42
pabelangermtreinish: so stackviz will process ${SUBUNIT_OUTPUT} to generate the HTML bits?17:43
timothyb89pabelanger, mtreinish: stackviz-export should be called with the subunit output, e.g. stackviz-export -f somestream.subunit17:44
*** pcaruana has joined #openstack-infra17:44
timothyb89pabelanger: or rather, stackviz-export -f stream.subunit path/to/data17:45
AJaegerwow, 430 changes in check queue and 189 in post ;(17:45
*** Swami has quit IRC17:46
*** weshay has joined #openstack-infra17:46
timothyb89pabelanger: also, html bits should be copied from /opt/stackviz if on a nodepool node, otherwise it would need to be built manually17:46
*** asettle has joined #openstack-infra17:46
*** Swami has joined #openstack-infra17:47
pabelangertimothyb89: okay, so the default http://git.openstack.org/cgit/openstack-dev/devstack/tree/stackrc#n33 is fine if I am using devstack-gate?17:48
timothyb89pabelanger: oh, sure, that should work17:48
pabelangertimothyb89: great17:48
pabelangerrcarrillocruz: suggestions on how to override OS_CLOUDS within ansible-role-cloud-launcher17:50
*** jaosorior has quit IRC17:50
rcarrillocruzwhat do you mean17:50
pabelangerrcarrillocruz: I need to use all-clouds.yaml17:51
pabelangernot clouds.yaml17:51
*** mikelk has joined #openstack-infra17:51
*** asettle has quit IRC17:51
rcarrillocruzah17:52
*** zul has joined #openstack-infra17:53
rcarrillocruzpabelanger: try this http://developer.openstack.org/sdks/python/openstacksdk/users/guides/connect_from_config.html17:53
rcarrillocruzOS_CLIENT_CONFIG_FILE17:53
rcarrillocruzi think shade checks that envvar17:53
rcarrillocruzmordred: ^17:54
rcarrillocruzwould defining that work for os_<blah> tasks, given they use shade17:54
rcarrillocruz?17:54
*** mikelk has quit IRC17:54
pabelangerrcarrillocruz: ah, I had a typo17:54
pabelangerworking now17:55
rcarrillocruz++17:55
rcarrillocruzso did it go thru17:55
rcarrillocruzall resources created?17:55
pabelangerrunning now17:55
*** javeriak has joined #openstack-infra17:56
openstackgerritKhai Do proposed openstack-infra/system-config: Workaround for its-storyboard change-restored event  https://review.openstack.org/35304617:56
zaroZara: ^17:56
Zaraah, ace, thanks17:56
*** e0ne has joined #openstack-infra17:56
Zarahehe17:57
ZaraI wonder if the linting is going to demand spaces or anythign17:57
Zara*anything17:58
zaroZara: it shouldn't that's just a string in puppet.17:58
ZaraI must be tired, forgot they were all strings. looks fine to me, then17:59
*** asettle has joined #openstack-infra17:59
pabelangerfatal: [localhost]: FAILED! => {"changed": false, "failed": true, "msg": "Failed to list domains (Inner Exception: Unable to establish connection to https://montytaylor-sjc.openstack.blueboxgrid.com:5001/v2.0/tokens)"}18:02
pabelangerrcarrillocruz: mordred: ^ is that the correct URL?18:02
*** pvaneck has joined #openstack-infra18:02
rcarrillocruznot sure, have never played with bluebox infra cloud i'm afraid18:03
AJaegerany project-config core here to review https://review.openstack.org/349077 for the horizon team, please?18:03
rcarrillocruzjlk: ^18:03
*** raunak has quit IRC18:03
*** Apsu has left #openstack-infra18:03
jlktry 5000 instead of 500118:04
*** raunak has joined #openstack-infra18:04
*** asettle has quit IRC18:04
*** asettle has joined #openstack-infra18:05
*** tonytan4ever has joined #openstack-infra18:05
*** electrofelix has quit IRC18:05
*** thorst_ has joined #openstack-infra18:05
*** piet_ has quit IRC18:05
mordredpabelanger: the auth_url should be https://montytaylor-sjc.openstack.blueboxgrid.com:5000/v3 or https://montytaylor-sjc.openstack.blueboxgrid.com:500018:06
*** Apoorva has joined #openstack-infra18:07
mordredpabelanger: I prefer unversioned because it's more future proof - but the /v3 is also fine18:07
*** rbuzatu has joined #openstack-infra18:08
mordredaltohugh if a v4 gets released I may throw a cat at someone18:08
jlklol18:08
rcarrillocruzlol18:09
*** kzaitsev_mb has quit IRC18:11
*** e0ne has quit IRC18:11
*** rbuzatu has quit IRC18:13
pabelangermordred: thanks, updating18:13
*** degorenko is now known as _degorenko|afk18:13
jeblairyolanda: gmail is rejecting cronspam for your root admin address18:13
openstackgerritMerged openstack-infra/project-config: Revert "Stack nodepool images targets in grafana"  https://review.openstack.org/35291218:14
openstackgerritIsaku Yamahata proposed openstack-infra/project-config: networking-odl: cover more combinations of version  https://review.openstack.org/34704518:15
*** karthikp_ has joined #openstack-infra18:17
*** chem has quit IRC18:18
openstackgerritMerged openstack-infra/tripleo-ci: Add 'ceph status' and tripleo-overcloud-passwords to host_info  https://review.openstack.org/34886218:19
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Implement non-ovb overcloud update job - Newton -> Newton  https://review.openstack.org/35133018:20
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement undercloud upgrade job - Mitaka -> Newton  https://review.openstack.org/34699518:21
openstackgerritPaul Belanger proposed openstack-infra/system-config: Update auth_url for admin-bluebox  https://review.openstack.org/35305518:21
*** cody-somerville has joined #openstack-infra18:22
*** cody-somerville has joined #openstack-infra18:22
pabelangermordred: ^ updated. You said you also added new credentials to hiera?18:22
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Implement overcloud upgrade job - Mitaka -> Newton  https://review.openstack.org/32375018:22
*** PollyZ has joined #openstack-infra18:23
*** csomerville has quit IRC18:24
pabelangermordred: looks like I'm getting 401 authentication using all_clouds.yaml credentials18:24
*** acoles is now known as acoles_18:25
*** akshai has quit IRC18:26
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Used subunit to track metrics  https://review.openstack.org/35296118:26
*** akshai has joined #openstack-infra18:27
openstackgerritMerged openstack-infra/project-config: Splitting current/deprecated integ. test  https://review.openstack.org/34907718:34
openstackgerritMerged openstack-infra/puppet-elasticsearch: Access es_template_config with @  https://review.openstack.org/35205318:34
*** ihrachys has joined #openstack-infra18:35
*** jed56 has quit IRC18:35
openstackgerritMatthew Treinish proposed openstack-infra/devstack-gate: Add sanity check on devstack generated tempest.conf  https://review.openstack.org/35306018:35
*** eharney has quit IRC18:38
*** eharney has joined #openstack-infra18:39
*** rbuzatu has joined #openstack-infra18:39
*** itisha has quit IRC18:40
*** links has quit IRC18:40
*** david-lyle has quit IRC18:41
AJaegercould some project-config core review pabelanger's change to remove a wrong noop from the check queue, please? https://review.openstack.org/35297018:41
*** thorst_ has quit IRC18:41
AJaegerAnd one more review suggestions for the release team: https://review.openstack.org/35289718:42
*** david-lyle has joined #openstack-infra18:42
*** SumitNaiksatam has quit IRC18:42
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Print services statuses of nodes in CI  https://review.openstack.org/35291618:42
AJaegerinfra-root, there're some integration tests proposed between system-config and logstash-filters, please review https://review.openstack.org/32072918:43
*** sneti has quit IRC18:44
*** javeriak_ has joined #openstack-infra18:44
fungiAJaeger: thanks for the heads up18:44
jesusaurAJaeger: thanks for bringing attention to that18:45
anteayafungi: did you want to look at the release team patches to project-config?18:46
fungianteaya: probably, but i also don't want to block progress on those based on my limited availability18:47
anteayafungi: I can wait for you if you like, or go ahead, your call18:47
openstackgerritMonty Taylor proposed openstack-infra/system-config: Add #openstack-shade to managed channel list  https://review.openstack.org/35306518:47
*** mrmartin has quit IRC18:47
openstackgerritMonty Taylor proposed openstack-infra/project-config: Add accessbot and gerritbot to #openstack-shade  https://review.openstack.org/35306618:47
fungianteaya: is there a topic for them or something you can link?18:48
rcarrillocruzwootz, almost forgot the meeting18:48
anteayafungi: https://review.openstack.org/#/q/topic:fix-release-from18:48
fungithanks!18:48
*** javeriak has quit IRC18:48
anteayafungi: those were the two I was looking at based on AJaeger's ping18:48
anteayawelcome18:48
anteayamordred: I don't think the gerrit bot has any more quota for new channels18:49
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Used subunit to track metrics  https://review.openstack.org/35296118:49
anteayaunless you or someone you know has addressed that limit18:49
mordredanteaya: not to my knowledge, no18:49
rcarrillocruzjesusaur: heya, logstash question. Is infra logstash configured by default to accept TCP input?18:49
mordredanteaya: is it just gerritbot?18:49
anteayaokay prepare for a test failure on your add gerritbot to channel patch18:49
mtreinishrcarrillocruz, fungi: if you get a sec, the firehose tls patches should be ready now: https://review.openstack.org/348019 and https://review.openstack.org/35247218:49
rcarrillocruzi'm thinking it would be nice to write out an ansible callback plugin to feed data from our runs into logstash18:49
mordredanteaya: awesome18:49
mordredanteaya: I love test failures18:49
anteayamordred: I think so? I'm just going on what I see AJaeger say18:50
anteayamordred: they are the best, aren't they18:50
mordredcool. me too18:50
AJaegermordred: just gerritbot. Go ahead and add accessbot.18:50
anteayaAJaeger: thank you18:50
mordredrcarrillocruz: it accepts, but I think only from certain hosts18:50
rcarrillocruzexcellent18:50
*** rcernin has joined #openstack-infra18:51
AJaegerone more project-config change to fix wrong setup for ironic: https://review.openstack.org/35277218:51
*** raunak has quit IRC18:51
*** andymaier has joined #openstack-infra18:51
AJaegerand a cosmetic grafana change: https://review.openstack.org/35184618:52
jesusaurrcarrillocruz: it only accepts connections from localhost iirc (thats where the logprocessor worker runs)18:52
AJaegerAnd a fix for senlin's test setup: https://review.openstack.org/#/c/351544/18:52
AJaegerJust in case anybody wants to help with project-config reviews.18:53
rcarrillocruzk18:53
*** raunak has joined #openstack-infra18:53
pleia2AJaeger: woo, thanks for making this so easy18:53
*** florianf has quit IRC18:53
* AJaeger has done enough selling for now ;) Still, quite a lot open reviews, I appreciate any help going through them...18:53
mtreinishrcarrillocruz: firehose it :) We can add the mqtt input plugin to our logstash workers18:53
AJaegerthanks, pleia2 and anteaya !18:53
*** raunak has quit IRC18:54
rcarrillocruzyeah, i need to take a ruby refresher tho18:54
rcarrillocruzthat syntax confuses me a lot18:54
*** bin_ has quit IRC18:54
anteayaAJaeger: thank you18:54
openstackgerritMerged openstack-infra/project-config: Remove noop in tripleo-ci queue queue  https://review.openstack.org/35297018:55
jesusaurrcarrillocruz: but wouldn't that mix system logs with test output logs? I would kinda want to see a separate cluster for that data, possibly with limited access18:55
*** javeriak_ has quit IRC18:55
odyssey4meif any infra roots have a moment to complete the prep for the mariadb mirror I'd appreciate it - https://review.openstack.org/30783118:55
AJaegerand one more grafana change - followup to our xenial changes: https://review.openstack.org/#/c/351016/1 - armax, do you want to look as well on that?18:55
*** nherciu has quit IRC18:55
mtreinishrcarrillocruz: although I'm not sure of the state of it: https://github.com/widarlein/logstash-input-mqtt18:55
* armax looks18:56
*** raunak has joined #openstack-infra18:56
*** inc0 has joined #openstack-infra18:56
rcarrillocruznot sure about that specifics... but we do want to have a centrally location for ansible runs. I wrote https://review.openstack.org/#/c/327789/, which is about logging stuff on the ansible control machine (needs rebasing)18:56
rcarrillocruzbut i think it would be good to have that on logstash18:56
AJaegerarmax: and also https://review.openstack.org/#/c/348123/ , please - needs second +2 as well. Enabling py35 voting18:56
rcarrillocruzbe it with a callback plugin in ansible18:56
mtreinishjesusaur: yeah, that's a good point. We probably want to keep things separate18:56
*** maishsk has joined #openstack-infra18:56
rcarrillocruzor feed it into mqtt, which then gets consumed by logstash18:56
mtreinishespecially given how overloaded our logstash and es can get18:57
rcarrillocruzi guess we'll discuss it in the mid-cycle, there's a work 'track' for ansible-puppet18:57
*** armax has quit IRC18:57
mtreinishjesusaur: btw, on: https://review.openstack.org/#/c/351344/ do you know where bin/ is relative too there. All the docs say call bin/ something to instlal plugins but I was missing hte context18:58
*** javeriak has joined #openstack-infra18:58
jesusaurmtreinish: yeah, and having entirely different use cases in the same cluster would probably make the performance even worse18:58
*** javeriak has quit IRC18:58
* jesusaur looks at 35134418:58
*** shardy is now known as shardy_afk18:58
jesusaurmtreinish: that's because bin/ is site-dependent. I think our puppet puts it in /opt/logstash, so I suspect you want /opt/logstash/bin/plugin there, but there may be another directory level in the middle18:59
*** timello has quit IRC19:00
fungiit's that (weekly infra team meeting) time again! find us in #openstack-meeting for the next hour19:00
*** timello has joined #openstack-infra19:01
mtreinishjesusaur: ah ok, thanks. I'll update the path there it's not like it can land for a bit anyway. We need to land tls support on the broker first19:01
mtreinishrcarrillocruz: cool, thanks for the +A. Now we need certs to fill out those hiera fields :)19:02
*** d34dh0r53 is now known as d34dh0r53_24_8919:02
*** tqtran has joined #openstack-infra19:03
*** jlanoux has quit IRC19:04
* Zara searches 'laverne and shirley'19:06
openstackgerritMerged openstack-infra/project-config: Fix incorrect labels for RH1 in grafyaml  https://review.openstack.org/35184619:06
*** pt_15 has quit IRC19:06
*** d34dh0r53_24_89 is now known as d34dh0r53123412319:06
openstackgerritMerged openstack-infra/project-config: Fix Ironic functional job by properly setting PROJECTS  https://review.openstack.org/35277219:06
*** hurgleburgler has quit IRC19:06
*** hurgleburgler1 has joined #openstack-infra19:06
openstackgerritMerged openstack-infra/project-config: Fix senlin integration test job  https://review.openstack.org/35154419:06
*** akshai has quit IRC19:08
*** savihou has quit IRC19:08
*** akshai has joined #openstack-infra19:09
*** tqtran has quit IRC19:09
*** timello has quit IRC19:09
*** timello has joined #openstack-infra19:10
*** armax has joined #openstack-infra19:11
*** savihou has joined #openstack-infra19:12
*** kzaitsev_mb has joined #openstack-infra19:13
*** akshai has quit IRC19:14
*** andymaier has quit IRC19:14
*** kragniz has joined #openstack-infra19:14
*** andymaier has joined #openstack-infra19:15
openstackgerritMichael Krotscheck proposed openstack-infra/project-config: Added documentation draft jobs for nodejs-based projects  https://review.openstack.org/34613019:15
openstackgerritMatthew Treinish proposed openstack-infra/puppet-logstash: Add mqtt output plugin to logstash indexers  https://review.openstack.org/35134419:15
openstackgerritMichael Krotscheck proposed openstack-infra/project-config: Added documentation publish jobs for the JavaScript SDK  https://review.openstack.org/34613119:15
openstackgerritMerged openstack-infra/puppet-mosquitto: Add support for configuring tls ports  https://review.openstack.org/34801919:15
*** Apsu has joined #openstack-infra19:17
*** rbuzatu has quit IRC19:17
*** rbuzatu has joined #openstack-infra19:18
*** timello has quit IRC19:19
krotscheckAJaeger: I don't see a bindep patch for js-openstack-lib. Is that for us to take on?19:19
*** timello has joined #openstack-infra19:19
*** andymaier has quit IRC19:20
AJaegerkrotscheck: feel free to do it yourself, I only updated those that I had done in the past - where I stopped because of the filename...19:20
krotscheckAJaeger GOt it19:20
krotscheckWilldo19:20
AJaegerthanks, krotscheck !19:21
*** thorst_ has joined #openstack-infra19:21
openstackgerritMerged openstack-infra/system-config: Add tls support to firehose  https://review.openstack.org/35247219:23
mtreinishyolanda, rcarrillocruz, pabelanger: ^^^ \o/ thanks19:24
mtreinishnow comes the fun part of generating certs and see if it works :)19:24
openstackgerritTravis Tripp proposed openstack-infra/project-config: Add searchlight-ui translation  https://review.openstack.org/35307919:26
openstackgerritSam Yaple proposed openstack-infra/shade: Add update_endpoint()  https://review.openstack.org/28905219:26
*** thorst_ has quit IRC19:26
*** senk_ has joined #openstack-infra19:27
*** inc0 has quit IRC19:27
*** mrhillsman has quit IRC19:27
*** senk_ has quit IRC19:31
*** yaume has joined #openstack-infra19:32
*** sambetts is now known as sambetts|afk19:33
AJaegerarmax: could you review https://review.openstack.org/#/c/336955 as well, please?19:34
*** ihrachys has quit IRC19:35
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Used subunit to track metrics  https://review.openstack.org/35296119:35
*** timello has quit IRC19:36
*** gyee has quit IRC19:37
*** mrhillsman has joined #openstack-infra19:37
*** PollyZ has quit IRC19:37
*** ihrachys has joined #openstack-infra19:38
*** nherciu has joined #openstack-infra19:39
krotscheckI have to say it feels a little weird to have the responsibility for installing a thing be in a project, when the thing that actually invokes it is outside the project.19:41
*** david-lyle_ has joined #openstack-infra19:41
*** javeriak has joined #openstack-infra19:42
*** david-lyle has quit IRC19:43
*** Apoorva has quit IRC19:43
*** ihrachys_ has joined #openstack-infra19:45
*** javeriak_ has joined #openstack-infra19:46
*** javeriak has quit IRC19:47
*** ihrachys has quit IRC19:48
*** amitgandhinz has quit IRC19:49
*** amitgandhinz has joined #openstack-infra19:49
*** yaume has quit IRC19:51
*** coolsvap has quit IRC19:51
*** javeriak_ has quit IRC19:55
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Used subunit to track metrics  https://review.openstack.org/35296119:55
*** rbuzatu has quit IRC19:55
openstackgerritMatthew Treinish proposed openstack-infra/devstack-gate: Add sanity check on devstack generated tempest.conf  https://review.openstack.org/35306019:55
*** kzaitsev_mb has quit IRC19:57
ianwpabelanger / someone else -> https://review.openstack.org/352211 -- project-config dib element to install custom kernel for f24 builds to enable testing.  should be low risk as only affects f24 builds, will pull out when update comes through, but i'd like to move on with this19:58
*** inc0 has joined #openstack-infra19:59
AJaegerianw: change looks fine, for me more a question of policy and trust. Has anybody concerns about installing ianw's self build kernel for f24 builds? ^20:00
*** nwkarsten has quit IRC20:01
ianwAJaeger: you are right not to trust me :)  but you can see the .src.rpm, and at that point you'd have to trust that fedora's COPR system built that without fiddling with it20:01
*** nwkarsten has joined #openstack-infra20:02
anteayaAJaeger: yeah, I read that as well, not a fan of that approach20:02
anteayaif the kernel needs to be patched, that is for the kernal maintainers to decide20:02
AJaegerianw: I know ;)20:02
pabelangermordred: did you catch my question about bluebox cloud credentials? Looks like our current values in all-clouds.yaml do not work20:03
*** ihrachys has joined #openstack-infra20:03
*** ihrachys_ has quit IRC20:03
mordredpabelanger: no. they do not20:03
ianwanteaya: i've already had the fix committed to the appropriate tree, it just needs to make it through20:04
anteayagreat20:04
mordredpabelanger: the super admin creds are in the passwords.gpg file20:04
AJaegerianw: could you propose the revert of the change as well and mark it as WIP. I'd like to have that in the review list...20:04
AJaegerthen I'll +2.20:04
pabelangermordred: okay, let me remember how to access that20:05
AJaegerianw: This is a change I'd like to see reverted and remineded about ;) Is that ok for you?20:05
*** nwkarsten has quit IRC20:06
AJaegerBtw. project-config cores, I have searched for some more small changes that could go in. Volunteers welcome for:20:06
AJaeger https://review.openstack.org/352897 - release team: fix for announce script20:06
AJaeger https://review.openstack.org/352929 - release team: constraints update improvement20:06
AJaeger https://review.openstack.org/336955 - update neutron full ssh setup (file injection)20:06
AJaeger https://review.openstack.org/351016 - grafana update for xenial renames20:06
AJaeger https://review.openstack.org/348123 - py3 voting for Networking-l2gw20:06
AJaeger https://review.openstack.org/352747 - publish vitrage specs20:06
AJaeger https://review.openstack.org/351804 - trivial comment update20:07
AJaeger https://review.openstack.org/351734 - enhance Debian repos20:07
openstackgerritIan Wienand proposed openstack-infra/project-config: Revert "Add Fedora 24 work-around kernel"  https://review.openstack.org/35309320:07
AJaegerthanks, ianw.20:08
*** thorst_ has joined #openstack-infra20:08
*** oanson has quit IRC20:10
*** asselin_ has joined #openstack-infra20:11
*** julim has quit IRC20:11
*** david-lyle_ is now known as david-lyle20:12
*** thorst_ has quit IRC20:12
*** timello has joined #openstack-infra20:13
*** ihrachys has quit IRC20:14
*** senk_ has joined #openstack-infra20:15
*** baoli has quit IRC20:15
*** baoli has joined #openstack-infra20:15
AJaegerianw, thanks for going through these ^20:16
ianwAJaeger: some penance for asking for a review :)20:16
AJaeger;)20:17
openstackgerritMerged openstack-infra/project-config: Add $LSBDISTCODENAME-newton-backports for debian-openstack mirror list  https://review.openstack.org/35173420:19
AJaegerfungi, what are your plans for doing the bindep release? No need to rush it - just wanted to plan it in if possible...20:20
openstackgerritMerged openstack-infra/project-config: Changed comment which is no longer valid  https://review.openstack.org/35180420:20
*** Apoorva has joined #openstack-infra20:20
fungiAJaeger: soon, i guess? i didn't have exact plans. just trying to work through a pile of unrelated priorities20:21
*** asselin_ has quit IRC20:21
*** timello has quit IRC20:21
*** timello has joined #openstack-infra20:22
*** asselin_ has joined #openstack-infra20:22
*** bethwhite_ has quit IRC20:24
AJaegerfungi, great. Once it's done, please review https://review.openstack.org/352871 and https://review.openstack.org/35287820:24
* AJaeger signs off for today and waves good night20:24
zigopabelanger: AJaeger: fungi: IT WORKED !!! \o/20:24
zigohttp://mirror.dfw.rax.openstack.org/debian-openstack/pool/main/p/python-setuptools/20:24
openstackgerritMerged openstack-infra/project-config: Networking-l2gw: enable python 3 voting  https://review.openstack.org/34812320:25
openstackgerritMerged openstack-infra/project-config: grafana: Update midonet unit test jobs after xenial renames  https://review.openstack.org/35101620:25
*** senk_ has quit IRC20:25
openstackgerritMerged openstack-infra/project-config: Enable file injection in neutron full ssh job  https://review.openstack.org/33695520:27
*** rhallisey has quit IRC20:27
*** raildo has quit IRC20:28
pabelangerzigo: nice20:29
pabelangerzigo: do you have the log file that job?20:29
*** asettle has quit IRC20:29
zigopabelanger: http://logs.openstack.org/da/da013fbc0c88be1369acaea031a3383edda0d941/post/20:29
zigopabelanger: Now, I need to know how to fetch the nodepool_mirror_host20:30
pabelangerHmm, we didn't sign the Release file20:30
*** asettle has joined #openstack-infra20:30
*** asettle has quit IRC20:30
openstackgerritMerged openstack-infra/project-config: fix diff-start handling in release scripts  https://review.openstack.org/35289720:30
zigopabelanger: Cause I'll to use it for the sbuild setup and add the repo in there.20:30
*** asettle has joined #openstack-infra20:31
*** baoli has quit IRC20:31
*** timello has quit IRC20:31
zigopabelanger: Did you guys talk about it during the meeting?20:31
pabelangererr, wait20:31
pabelanger-ignore=wrongdistribution20:31
pabelangerwhy was that added?20:31
*** timello has joined #openstack-infra20:31
zigopabelanger: Because the backport job is using the same pkgos-infra-install-sbuild, which uses "jessie-newton" as distro name.20:31
zigopabelanger: I'd have to do a lot of hacks to rename the sbuild chroot...20:32
pabelangerYa, but now we've made it harder to error if we import a package in to the wrong distribution20:32
*** PollyZ has joined #openstack-infra20:32
*** karthikp_ has quit IRC20:32
pabelangerinfact, the job will not fail now20:33
*** nherciu_ has joined #openstack-infra20:33
zigoIt did ...20:33
zigoThat's why I wrote that.20:33
*** HeOS has joined #openstack-infra20:34
*** nherciu has quit IRC20:35
*** Jeffrey4l has quit IRC20:35
pabelangerRight, that's what I am saying, the .changes file contains the wrong distribution and now we are ignoring errors that reprepro emits20:35
*** dfflanders has joined #openstack-infra20:35
pabelangerI think the right fix is to update your build script to build the proper distribution20:35
*** Jeffrey4l has joined #openstack-infra20:36
pabelangerotherwise, there is no point in having the jessie-newton-backports repo20:36
pabelangerand the backports should have just used jessie-newton20:36
*** gyee has joined #openstack-infra20:37
ianwanyone see why we would *not* merge this css change to add some delineation to the jenkins results tables in gerrit ui?  ->  https://review.openstack.org/#/c/263866/20:37
*** dprince has quit IRC20:37
pabelangerfungi: AJaeger: do you mind helping review: https://review.openstack.org/#/c/343336/20:37
pabelangerfungi: AJaeger adds signed gpg signing job for reprepro20:38
*** savihou has quit IRC20:38
zigopabelanger: How do I get the hostname in this function ? http://paste.openstack.org/show/552665/20:39
zigopabelanger: I can't go further without the info ...20:39
openstackgerritPaul Belanger proposed openstack-infra/project-config: Revert "Add --ignore=wrongdistribution parameter to reprepro"  https://review.openstack.org/35309820:39
zigopabelanger: If you revert it, then the POST job will fail.20:39
pabelangerzigo: I've reverted the patch but it is WIP until you can fix your build scripts^20:40
zigoOk.20:40
*** amitgandhinz has quit IRC20:40
*** timello has quit IRC20:40
pabelangerzigo: also going to land the gpg signing20:40
*** nherciu_ has quit IRC20:40
*** timello has joined #openstack-infra20:40
*** thorst_ has joined #openstack-infra20:40
zigopabelanger: I believe I can set a parameter to the pkgos-infra-install-sbuild script.20:41
*** amitgandhinz has joined #openstack-infra20:41
pabelangerzigo: source /etc/nodepool/provider20:41
zigopabelanger: What's in there?20:41
zigo(ie: what's the name of the variable ...)20:41
pabelangerzigo: then http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/scripts/configure_mirror.sh#n2720:41
zigoThanks.20:42
pabelangeryou'll have to build the variable your self until we expose it properly20:42
*** maishsk has quit IRC20:42
*** maishsk has joined #openstack-infra20:42
zigopabelanger: As in, I should copy that line 27 ?20:43
*** inc0 has quit IRC20:43
zigopabelanger: Or all the block?20:44
zigopabelanger: I'm guessing, both lines 27 and 28, right?20:45
zigoMakes sense...20:45
pabelangerzigo: yes, 27 and 2820:45
*** asselin__ has joined #openstack-infra20:47
pabelangertimothyb89: any ideas why http://logs.openstack.org/61/352961/8/check/gate-tripleo-ci-centos-7-undercloud-nv/43c99e4/logs/stackviz/#/stdin is still empty?  /opt/stack/devstack.subunit exists and was created with generate-subunit20:47
*** asselin_ has quit IRC20:47
*** timello has quit IRC20:49
*** timello has joined #openstack-infra20:50
*** edtubill has quit IRC20:51
*** inc0 has joined #openstack-infra20:52
pabelangerzigo: looking at your jobs, you can pass args into your sbuild script override your defaults: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/deb-auto-backports.yaml#L2120:52
pabelangerpkgos-infra-install-sbuild jessie-newton-backports20:52
pabelangerfor example20:52
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE TESTING  https://review.openstack.org/31643620:53
*** thorst_ has quit IRC20:53
zigopabelanger: Yes, that's what I intend to do, I already have the logic to rename "jessie" into "jessie-newton", so it's going to be easy to fix.20:53
jpmaxmanfungi: ok the wiki test should now be loading off trove20:54
zigopabelanger: I'm currently adding the logic to stop using httpredir.debian.net, and use $NODEPOOL_MIRROR_HOST instead.20:54
jpmaxmanI can send you the steps to move and upgrade the db if you like20:54
*** shardy_afk is now known as shardy20:55
*** inc0 has quit IRC20:55
fungijpmaxman: ooh, thanks! yes, if you have a summary i can schedule to do the production upgrade myself so we don't need to coordinate schedules. worst case i just roll back to a snapshot i made immediately prio20:55
fungir20:55
jpmaxmanok how'd you like it? email?20:56
*** seldenr has quit IRC20:56
fungijpmaxman: sure, fungi@yuggoth.org works20:56
pabelangerzigo: ya, we should have local debian servers now20:56
pabelangererr20:56
pabelangermirrors20:56
pabelangerwe need to land a few patches: https://review.openstack.org/#/c/347058/ https://review.openstack.org/#/c/347140/20:57
mordredinfra-root: it's time to cut a new shade ... but I don't want to do it when I can't be around to babysit a nodepool restart - just in case (we changed how floating ips are returned)20:59
mordredany thoughts on when a good time to bounce nodepool would be?20:59
*** ganesan has quit IRC20:59
*** rfolco has quit IRC20:59
*** timello has quit IRC20:59
*** rfolco has joined #openstack-infra20:59
mtreinishfungi, pabelanger, mordred: so now that https://review.openstack.org/352472 has landed we need to generate the cert files (and the private key) and put them in hiera20:59
*** timello has joined #openstack-infra21:00
*** rfolco has quit IRC21:00
anteayawe have a post backlog of 14 hours21:00
fungimtreinish: yep, it's in the pile of things i'm trying to get to21:00
anteayawould a nodepool restart affect the zuul queues?21:00
mtreinishfungi: ok, cool thanks21:00
*** cody-somerville has quit IRC21:00
mtreinishfungi: let me know if you need any help with something21:00
anteayaI can't keep track of things, and resort to asking dumb questions21:00
pabelangermordred: I'm good for first thing tomorrow morning21:01
*** seldenr has joined #openstack-infra21:01
mordredpabelanger: awesome21:01
harlowjamordred any details anywhere on what u are doing at redhat with zuul + ansible, lol21:01
pabelangeranteaya: it shouldn't affect the queues, unless something breaks and we stop launching nodes21:02
mordredharlowja: https://specs.openstack.org/openstack-infra/infra-specs/specs/zuulv3.html21:02
anteayapabelanger: thank you21:02
jeblairanteaya, mordred, pabelanger: the last time we restarted nodepool, it went poorly.  we *think* that was because of the accounting change we restarted it for, but we are not 100% sure about that.  caution is warranted.  :)21:02
mordredjeblair: ++21:02
anteayaah thank you jeblair21:02
jeblair(i should say, we restarted it again after reverting, and then did cleanup, and it's fine now)21:02
*** inc0 has joined #openstack-infra21:03
pabelangerYa, I think we put too much pressure on SQL with that patch21:03
jeblairme too.  i'm just not 100% sure about that :)21:03
mugsieany cores around to +A https://review.openstack.org/#/c/352904/ ?21:03
jeblairdon't want any surprises21:03
pabelangerya, I don't have much time left today to monitor but happy to do it in the morning21:04
anteayamordred: how is that bluebox cloud coming along?21:04
mordredanteaya: dunno - pabelanger is working on it21:04
mordred:)21:04
anteayaanything I can do to help?21:04
anteayapabelanger: same question21:04
pabelangerI'm still looking for my email with instructions to access passwords.gpg21:05
openstackgerritDoug Hellmann proposed openstack-infra/project-config: try harder to update constraint when a library is released  https://review.openstack.org/35292921:05
anteayapabelanger: who sent it to you, can you get them to resend?21:05
pabelangeranteaya: we currently working on using ansible-role-cloud-launcher to create the openstack project / domain bit in bluebox.  Our first attempts at automating it21:06
*** Sukhdev has quit IRC21:06
pabelangeranteaya: it was fungi, if I cannot find it in 30mins, I'll ask for a resend21:06
openstackgerritBen Nemec proposed openstack-infra/project-config: Increase rh1 max-servers to 75  https://review.openstack.org/35311121:06
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: Remove git repo mirror scripts  https://review.openstack.org/35311221:07
anteayapabelanger: awesome21:07
pabelangeranteaya: I plan to work on it for a few hours this evening, and have more updates in the morning.21:08
anteayaokay great21:08
timothyb89pabelanger: I'll take a look21:08
anteayawell I'm interested, so thanks for the updates21:08
anteayalet me know what I can do to help21:08
jeblairpabelanger: hop on puppetmaster.o.o and run 'screen -x' as sudo.  i'll reindoctrinate you about password access21:08
*** timello has quit IRC21:09
*** yamamoto has joined #openstack-infra21:09
anteayaawesome, thanks jeblair21:09
*** Sukhdev has joined #openstack-infra21:09
*** vhosakot has quit IRC21:10
*** karthikp_ has joined #openstack-infra21:10
*** nwkarsten has joined #openstack-infra21:11
*** nwkarsten has quit IRC21:11
*** timello has joined #openstack-infra21:11
*** yamamoto has quit IRC21:13
*** yamamoto has joined #openstack-infra21:13
*** yamamoto has quit IRC21:13
*** yamamoto has joined #openstack-infra21:15
*** yamamoto has quit IRC21:15
jpmaxmanfungi: ok sent - I'll be offline for a little bit, but feel free to reply - ping me here with questions21:16
jpmaxmanit's not very verbose ;)21:16
*** jkilpatr has quit IRC21:16
*** ayoung has quit IRC21:19
*** hurgleburgler1 has quit IRC21:20
*** timello has quit IRC21:20
timothyb89pabelanger: what command are you using to run stackviz-export?21:20
*** bmjen has quit IRC21:20
*** hurgleburgler has joined #openstack-infra21:20
*** timello has joined #openstack-infra21:21
pabelangertimothyb89: I am using that devstack-gate defaults too21:21
*** bmjen has joined #openstack-infra21:22
pabelangerwhat*21:23
*** raunak has quit IRC21:23
roaet_howdy! not sure if people have been asking.. but, is check doin' okay? I've had something in queue for 4+ hours.21:25
*** ldnunes has quit IRC21:26
timothyb89pabelanger: it looks like the subunit file stackviz is processing is empty... I wonder if $SUBUNIT_OUTPUT is not the same file that devstack-gate picks up for tempest21:27
*** roaet_ is now known as roaet21:27
*** matt-borland has quit IRC21:27
anteayaroaet_: there is a large backlog21:28
roaetanteaya: oh? i checked zuul, I guess my filter is too strong21:28
anteayalook at the lengths of the queues21:28
roaetoh my21:28
roaethorizon has a 7 hr queue21:28
anteaya430 in check, 249 in post21:29
anteayayeah21:29
anteayaso things are running21:29
anteayabut we only have so many nodes to work with21:29
roaetsomething special happen or is openstack just popular21:29
anteayalook at the graph at the very bottom21:29
anteayacoming up to feature freeze21:29
roaetanteaya: just wanted to make sure it was queue and not us, we have a tiny project and was scared I misconfigured it21:29
pabelangertimothyb89: do I need to create something first before using generate-subunit?21:29
anteayaroaet: yup, makes sense21:29
anteayaroaet: right now based on what I see and what you tell me, this is our workflow, not specific to your project21:30
anteayapabelanger: did you miss jeblair's invitation to help you with passwords?21:30
*** raunak has joined #openstack-infra21:30
anteayait would be really nice to get the bluebox cloud working21:31
timothyb89pabelanger: it shouldn't, and the testrepository.subunit.gz in the log directory has valid data21:31
pabelangeranteaya: yes, we worked thought it. thanks21:32
anteayapabelanger: ah okay great21:32
*** zigo has quit IRC21:32
*** timello has quit IRC21:33
pabelangerhttps://review.openstack.org/#/q/topic:bluebox-nodepool will be the topic I use for patches related to bluebox21:33
roaetthanks for the info anteaya21:33
anteayagreat thank you21:33
*** eharney has quit IRC21:33
anteayaroaet: no worries, glad to see you around again21:34
anteayaI missed you21:34
*** timello has joined #openstack-infra21:34
*** maishsk has quit IRC21:34
roaetanteaya: always around, just hiding :D. but now that we're trying to make our stuff 'real' I should be around more. We'll see how the community likes us.21:34
anteayawell I like you21:35
anteayanot sure what you are building but I'll guess I find out21:35
roaetsame thing lol21:35
anteayaand thanks for making the things 'real'21:35
anteaya:)21:35
roaetindeed. nice to talk with you too. i'll try to be more around21:35
*** zigo has joined #openstack-infra21:35
anteayasounds good21:35
anteayagood luck with the things21:36
*** cody-somerville has joined #openstack-infra21:38
*** weshay has quit IRC21:38
*** shardy has quit IRC21:38
pabelangertimothyb89: I'll have to debug it later and I'll ping you with the results21:39
pabelangertimothyb89: thanks for the help21:39
timothyb89pabelanger: sure, happy to help21:40
*** julim has joined #openstack-infra21:40
*** amitgandhinz has quit IRC21:41
*** amitgandhinz has joined #openstack-infra21:42
*** timello has quit IRC21:43
*** timello has joined #openstack-infra21:43
*** seldenr has quit IRC21:45
*** kzaitsev_mb has joined #openstack-infra21:46
*** seldenr has joined #openstack-infra21:50
*** dcwangmit01 has joined #openstack-infra21:50
sdakehey folks, dcwangmit01 has run into some zuul problems - he has a quick question21:51
sdakecan someone help him out?  I don't know the answer21:51
dcwangmit01Hi there.  Does anyone know why the zuul ubuntu-xenial gates for kolla and kolla-kubernetes are taking 6 hours of queuing before running?21:51
dcwangmit01Everything goes through eventually.21:51
mordreddcwangmit01: the gate is super busy currently21:51
dcwangmit01None of the other gates take that long.21:51
sdakethanks mordred21:51
mordredsdake: sure!21:51
mtreinishdcwangmit01: http://status.openstack.org/zuul/ everything is taking a long time21:52
mordreddcwangmit01: we're in a period between trusty and xenial and the scheduling may not be as perfect as normal21:52
*** timello has quit IRC21:52
sdakedcwangmit01 fwiw , the 2 weeks leading up to m3 until the release of openstack in general - gates are super overloaded21:52
mordredthere was a little bit of chat in here with ianw yesterday talking about when he was adding fedora to the gate21:52
*** timello has joined #openstack-infra21:53
mordredbut yeah - if something goes quickly for you in the next couple of weeks, consider that a super lucky thing21:53
mordredwe're also working on cranking some more capacity in21:53
*** kzaitsev_mb has quit IRC21:53
sdakemordred i'd offer to help with capacity but i've done all i can21:53
*** nwkarsten has joined #openstack-infra21:53
dcwangmit01Okay.  I was just wondering, because the other gates don't get queued for nearly as long.  our builds are getting held up on gates like gate-kolla-docs-ubuntu-xenial and gate-kolla-pep8-ubuntu-xenial, which are really simple quick tests (docs, pep8).  On the other hand, other more major gates like gate-kolla-dsvm-deploy-centos-binary are only queued for minutes instead of 6 hours.21:54
mordredsdake: appreciated! the osic folks are working on getting networking set up so they can give us more - we've also got infra cloud re-racked and coming back online21:54
mordreddcwangmit01: yah - it's a supply/demand thing21:54
sdakenice!21:54
mordredthere are many less things competing for centos nodes - many things competing for xenial nodes21:54
sdakemordred that totally makes sense21:55
cloudnullmordred: sorry for the lag21:55
dcwangmit01Got it.  Thank you mordred.21:55
ianwsdake / mordred : yeah, it was in particular a debian jessie job, for which i think we have like 1 node.  in early days we did have real starvation of infrequently used nodes under pressure, but the algorithm should handle it now.  i think atm it's just too much work, too little time21:55
*** esberglu has quit IRC21:55
*** sbezverk has joined #openstack-infra21:55
mordredcloudnull: no worries at all! I'm thrilled you're working on it21:55
mordredianw: ++21:55
*** vhosakot has joined #openstack-infra21:55
mordredand I think centos is un-loaded enough that we're actually able to keep up with demand with the min-ready nodes21:55
*** gordc has quit IRC21:55
sdakethanks again mordred21:56
sdakedcwangmit01 satisfied?21:56
pabelangermordred: anteaya: rcarrillocruz: ansible-role-cloud-launcher worked.  We now have projects and security groups21:56
dcwangmit01Yes, I'm good to go ;)21:56
mordredpabelanger: woot!21:56
*** Goneri has joined #openstack-infra21:56
pabelangermordred: I didn't create a new domain, and reused the default one21:56
mordredpabelanger: I thnk that's fine21:56
mordredpabelanger: do we have any nodes on the flavors that jeblair created last time?21:57
rcarrillocruzwoot!21:57
mordredpabelanger: I think we might want to put those into cloud-launcher too21:57
mordredpabelanger: but that's the ossumest thing ever!21:57
mordredI've wanted ot have our infrastructure defined in git for AGES21:57
openstackgerritPaul Belanger proposed openstack-infra/system-config: Update admin-bluebox with new settings  https://review.openstack.org/35305521:57
*** sdake has quit IRC21:57
*** mriedem has quit IRC21:57
pabelangermordred: I needed these settings for shade ^21:57
rcarrillocruzmordred: ++++++++21:58
pabelangermordred: ya, rcarrillocruz playbooks worked, which is epic21:58
mordredpabelanger: those look right on21:58
clarkbremember with infracloud we need to sort out the performance isues before adding a bunch if tests to it21:58
mordredclarkb: ++21:58
mordredclarkb: also - did you just see - the ansible-role-cloud-launcher thing just made our projects and security groups in bluebox21:58
mordredclarkb: also - go back to vacation :)21:58
*** inc0 has quit IRC21:59
* mordred hands pabelanger and rcarrillocruz fuzzy animals that are probably safe to hold21:59
openstackgerritPaul Belanger proposed openstack-infra/system-config: Add bluebox to cloud_layouts  https://review.openstack.org/35301321:59
pabelangermordred: rcarrillocruz: that's what we have configured now21:59
pabelanger^21:59
*** yamamoto has joined #openstack-infra21:59
mordredwoot21:59
pabelangerI'm considering creating our users manually right now until we figure out how to best deal with credendials22:00
mordredjeblair: any chance you have notes on the flavors you made on bluebox last time?22:00
*** amitgandhinz has quit IRC22:00
fungii do get the impression that nodepool is getting the demand fulfillment wrong...22:00
fungihttp://paste.openstack.org/show/552778/22:00
pabelangerfungi: yes, we are due to restart zuul22:01
*** gouthamr has quit IRC22:01
pabelangerwe have 60+ ubuntu-trusty nodes ready 18 hours ago or so22:01
pabelangermaybe it was 5922:01
*** burgerk has quit IRC22:01
pabelangererr22:01
pabelanger50*22:01
pabelangera fair bit of them22:01
jeblairmordred: hrm.22:01
*** timello has quit IRC22:02
*** rcernin has quit IRC22:02
*** timello has joined #openstack-infra22:02
jeblairmordred: well, i would have attempted to approximate http://docs.openstack.org/infra/system-config/contribute-cloud.html as closely as possible22:02
*** inc0 has joined #openstack-infra22:02
fungipabelanger: i don't see any ready ubuntu-trusty nodes at all22:03
*** inc0 has quit IRC22:03
fungipabelanger: well, occasionally one and then it gets snapped up immediately22:03
*** karthikp_ has quit IRC22:03
mordredjeblair: yah - but I remember you did empirical testing and then decided on CPU count22:03
mordredbut I can't remember if it was 4 or 8 cpus22:03
pabelangerfungi: I'm not sure we'll see it tonight, since the queues are super busy22:04
pabelangerbut we have about 300 ubuntu-trusty online right now22:04
pabelangeraccording to: http://grafana.openstack.org/dashboard/db/nodepool22:04
*** asettle has quit IRC22:04
fungipabelanger: yep, it's just nodepool shows gearman demand for xenial at about 4x demand for trusty, yet it's also consistently building more trusty nodes than xenial22:05
anteayapabelanger: wonderful, thank you22:05
pabelangerfungi: Ya, I'm not sure why that is. Like you said, demand off again?22:06
pabelangerI have to step away for a bit, but will return to bluebox when I get back22:06
*** dimtruck is now known as zz_dimtruck22:06
pabelangernext up are flavors per mordred request22:06
anteayadcwangmit01: everything you are calling a gate is a job22:06
jeblairmordred, pabelanger: i think the flavor spec should be 80g root, 0g ephemeral, 8vcpu, 8g ram.22:07
anteayadcwangmit01: the jobs just happen to be called titles that start with the word gate22:07
jeblairmordred, pabelanger: based on things i said around http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-01-12.log.html#t2016-01-12T21:49:4022:07
jeblair(i'm worried about the mirror in that conversation, but that's no longer a significant factor)22:07
mordredjeblair: cool.22:08
mordredjeblair: so you also don't think we need a separate flavor type for the mirror?22:08
*** inc0 has joined #openstack-infra22:09
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Upgrade Laravel Version and ORM Framework  https://review.openstack.org/32230722:09
jeblairmordred: yeah, actually, that should be fine for the mirror :)22:09
mordredcool. that's easy then22:09
*** timello has quit IRC22:11
dcwangmit01anteaya: Thanks for the clarification :)22:11
anteayadcwangmit01: welcome, thanks for listening22:11
*** timello has joined #openstack-infra22:12
openstackgerritStephanie Miller proposed openstack/diskimage-builder: Explain the difference between 'DIB_OFFLINE' and 'DIB_DEBIAN_USE_DEBOOTSTRAP_CACHE'  https://review.openstack.org/34593522:12
fungireed: calebb: is oubiwann still kicking around dreamhost somewhere? anteaya pointed me to our election tie breaker plan we've never needed to enact, and it references a script he wrote and published on github ~4 years ago but never included any sort of license with https://github.com/oubiwann/coin-toss22:13
anteayadcwangmit01: this might help: http://docs.openstack.org/infra/manual/developers.html#project-gating22:13
*** inc0 has quit IRC22:13
fungireed: calebb: oh, nevermind. looks like he went to rackspace shortly after that, so i guess not22:14
dcwangmit01anteaya: It does help.  I'm tempted to rename them to be proper22:15
anteayadcwangmit01: I don't see anything wrong with the job names you mentioned22:15
dcwangmit01I'm just kidding.  It looks like all of projects use that naming convention22:16
mordred:)22:16
anteayadcwangmit01: yes, they do22:16
mordreddcwangmit01: once we roll out zuul v3, the names will ALL change22:16
mordredbut that will not be this week22:16
dcwangmit01So someone on the infra team is especially OCD22:17
mordredhave to be22:17
mordredotherwise we'd go nuts22:17
fungisome of us already are22:17
*** inc0 has joined #openstack-infra22:18
anteayaI thought that was a requirement22:20
openstackgerritPeter Stachowski proposed openstack-infra/project-config: [trove] Promote scenario tests to voting and gating  https://review.openstack.org/35312922:20
mordredanteaya: I'm not sure I'm willing to declare correlation vs. causation ;)22:21
anteayahow OCD of you22:22
anteaya:)22:23
mordredanteaya: Ornithoptic Causation Declarer?22:23
anteayawhether you had that coming in or learned it while you were here22:23
anteayaof course that is what I meant22:23
*** mdrabe has quit IRC22:23
mordredit was the most Obvious and Clear Definition22:24
openstackgerritMerged openstack-infra/system-config: gerrit: Add borders to test result table  https://review.openstack.org/26386622:24
*** flepied has quit IRC22:25
*** Julien-zte has joined #openstack-infra22:25
*** davidlenwell has quit IRC22:25
*** tonytan4ever has quit IRC22:26
*** tpsilva has quit IRC22:28
openstackgerritKhai Do proposed openstack-infra/system-config: Upgrade gerrit on review.o.o  https://review.openstack.org/35254622:28
*** tonytan4ever has joined #openstack-infra22:28
*** inc0 has quit IRC22:29
*** timello has quit IRC22:29
*** sdake has joined #openstack-infra22:30
*** sdake has quit IRC22:30
zaroanteaya: wondering if you are available to help test reindexing on review-dev?22:30
*** sdake has joined #openstack-infra22:30
anteayamordred: of course22:31
anteayazaro: yes22:31
anteayalet us reindex22:31
anteayawhat am I doing?22:31
*** sarob has joined #openstack-infra22:32
zaroanteaya: i'm going to start a reindex and then you are going to do stuff on review-dev while the reindex is going on.22:33
*** sdake_ has joined #openstack-infra22:33
zaroi'm want to verify that things happening on gerrit won't kill reindex and vice versa.22:34
anteayagreat22:34
* anteaya logs in22:34
*** timello has joined #openstack-infra22:34
*** sdake has quit IRC22:34
jheskethMorning22:34
anteayamorning jhesketh22:35
anteayazaro: I guess I should log in whilst the reindex is underway22:35
anteayazaro: tell me when you have begun reindexing22:35
*** thiagop has quit IRC22:36
zaroanteaya: i don't think it will take very long so you should probably login first22:36
anteayaokay22:36
zaroi will also be doing stuff against it.22:36
*** edmondsw has quit IRC22:36
anteayaI had thought you had the a copy of the production db to work with22:36
* anteaya is logged in22:36
anteayaI'll navigate around via the gui and add comments and votes to patches22:37
anteayasay go22:37
*** sarob has quit IRC22:37
zaroprod data is not setup on review-dev though22:37
anteayaoh22:37
anteayahow long would it take to set it up?22:37
*** davidlenwell has joined #openstack-infra22:38
anteayaI wouldn't have confidence in any reindex test that didnt' use prod data22:38
anteayaI'm fine doing this as a first round22:38
anteayabut for me to say we should do this in production, I would need to see a test using production data22:38
*** sdake_ is now known as sdake22:38
anteayasince if online doesn't work we have to offline reindex22:39
anteayaand last time that was what 5 hours?22:39
anteayaas a first go, we can do this run22:39
zarosure. this is first pass. i'm going to start it now22:39
anteayagreat22:40
zarostarted22:40
anteayathanks22:40
zaroanteaya: ok it's complete22:41
zaroanteaya: thank you.22:42
fungiclearly we don't have much content on review-dev22:43
*** timello has quit IRC22:43
anteayaclearly22:43
anteayawow I was just getting started22:43
*** timello has joined #openstack-infra22:43
anteayazaro: i couldn't get any responses to this query: https://review-dev.openstack.org/#/q/owner:%22khaido%2222:43
anteayawhich I had expected22:43
anteayaand you are welcome22:44
anteayazaro: let me know when you have prod data set up on review-dev22:44
anteayahappy to help again22:44
zaroanteaya: because that's not me.  try zaro050822:44
craigeo/22:44
zarofungi: you think reindexing nova repo is enough of a test?22:46
zarothe project name change seems to work ok.22:47
anteayathere we go https://review-dev.openstack.org/#/q/owner:%22Khai+Do+%253Czaro0508%2540gmail.com%253E%2222:47
anteayazaro: I would like to see the whole prod db22:47
anteayawe don't even get started indexing nova for the longest time22:47
anteayathen that is the longest single index22:47
zaronova is the largest project.22:48
anteayayes22:48
*** seldenr has quit IRC22:48
anteayaI know reindexing will take hours, but I would like it to take hours on review-dev22:49
anteayathen at the very least we have some form of expectations about what might happen on review22:49
anteayaif we just do nova, we have no idea22:49
*** vhosakot has quit IRC22:49
*** vvalderrv has quit IRC22:49
anteayayou don't have to do anything while it is reindexing, do you?22:50
anteayajust start it and wait for it to finish, yeah?22:50
fungizaro: probably yes. i think a reindex of nova takes an hour or two in production22:50
fungiat least for an offline reindex22:50
fungimaybe even more. it's hard to tell with how our version of gerrit schedules the parallelism for each repo22:51
*** yamamoto has quit IRC22:52
*** timello has quit IRC22:52
*** timello has joined #openstack-infra22:53
*** Goneri has quit IRC22:53
zaroyeah, i think it will provide enough confidence too.22:54
zaroanteaya: well when we run online reindex on review.o.o users will continue to use gerrit in parallel.  i think that's the only real concern for me.22:56
zarowell probably want to somehow get confidence that people using gerrit while online reindex is running won't make gerrit fail22:57
anteayasure that makes sense22:57
anteayahowever if the online reindex fails will we not be forced into an offline reindex situation?22:58
anteayawhether we want it or not22:58
zaroi think it's a big cost to test entire prod data22:59
anteayayes it is22:59
anteayaI'm not saying it isn't22:59
zarosetup takes lot of time and i'm not sure that's much more benefit than just reindexing nova22:59
anteayabut what is the consequence of starting an online reindex and having it fail?22:59
anteayajust try again later?22:59
zaroprobably not much since it's most likely already have been indexed23:00
*** amitgandhinz has joined #openstack-infra23:01
anteayaso worst case scenario of a failed online reindex is nothing happens?23:01
*** timello has quit IRC23:01
*** timello has joined #openstack-infra23:02
*** nwkarsten has quit IRC23:02
*** nwkarsten has joined #openstack-infra23:02
fungiwell, incomplete reindex after a project rename would generally result in some (perhaps all) of the changes for that project no longer being queryable23:04
zaroanteaya: so gerrit holds the index in files on the filesystem, we back that up before running online reindex.  if it fails we just restore it to previous state.23:04
*** ams__ has quit IRC23:04
*** inc0 has joined #openstack-infra23:04
zaroworst case is we need to run offline reindex23:05
*** yamamoto has joined #openstack-infra23:05
*** yamamoto has quit IRC23:05
*** amitgandhinz has quit IRC23:05
anteayaokay so I think we need to prepare for all cases23:05
anteayahope for the best and have time available for the worst23:06
*** nwkarste_ has joined #openstack-infra23:06
*** inc0 has quit IRC23:06
anteayahave we tested restoring the backup index files to see how that works?23:07
*** yamamoto has joined #openstack-infra23:07
*** nwkarsten has quit IRC23:07
*** nwkarsten has joined #openstack-infra23:07
*** nwkarste_ has quit IRC23:10
*** PollyZ has quit IRC23:10
*** rbrndt has quit IRC23:10
zaroanteaya: yeah, i've done it before23:10
openstackgerritMerged openstack-infra/project-config: Fix constraints-git-prep  https://review.openstack.org/35295423:10
*** timello has quit IRC23:11
*** yamamoto has quit IRC23:11
*** yamamoto has joined #openstack-infra23:11
*** yamamoto has quit IRC23:11
*** timello has joined #openstack-infra23:11
*** nwkarsten has quit IRC23:12
*** sdague has quit IRC23:15
*** xarses has quit IRC23:15
*** Sukhdev has quit IRC23:15
*** karthikp_ has joined #openstack-infra23:15
*** yamamoto has joined #openstack-infra23:15
*** karthikp_ has quit IRC23:16
*** Sukhdev has joined #openstack-infra23:16
*** karthikp_ has joined #openstack-infra23:16
*** rlandy has quit IRC23:16
*** inc0 has joined #openstack-infra23:17
*** inc0 has quit IRC23:17
*** david-lyle has quit IRC23:20
*** yamamoto has quit IRC23:20
*** kzaitsev_mb has joined #openstack-infra23:21
*** Swami has quit IRC23:21
*** karthikp_ has quit IRC23:21
openstackgerritBen Nemec proposed openstack-infra/project-config: Re-enable rh2 cloud  https://review.openstack.org/35316323:23
fungiugh, now we're getting cease and desist notices about brand names mentioned in deleted wiki page titles23:25
fungibecause if you follow an old link for a nonexistent page, mediawiki happily reports that the page you've requested "whatever you put in the url" doesn't exist but can be created23:26
*** yamamoto has joined #openstack-infra23:27
fungimore fodder for an indefinite robots.txt telling search engines not to index the site23:27
*** yamamoto has quit IRC23:27
*** timello has quit IRC23:28
fungithe same thing happens, of course, if i plug a similar nonexistent page title into a wikipedia.org url23:28
*** timello has joined #openstack-infra23:31
*** gongysh has joined #openstack-infra23:32
anteayazaro: oh okay good23:35
*** xyang1 has quit IRC23:35
anteayafungi: we are getting cease and desist from the companies that the spammers are using in their spam?23:35
openstackgerritFatih Degirmenci proposed openstack-infra/jenkins-job-builder: Add support for Parameterized Scheduler Plugin  https://review.openstack.org/35316523:35
*** karthikp_ has joined #openstack-infra23:35
*** ayoung has joined #openstack-infra23:35
fungianteaya: yep23:35
anteayaso what is the value here?23:35
fungii think they found it in a google search23:35
anteayathe companies don't want their company names in spam23:35
fungithough it's a page deleted back in june23:35
anteayawe don't want the spame23:36
anteayawhat do the spammers get from the deal?23:36
fungioh, these aren't actually "spammers" in the marketing sense of the term23:36
anteayafungi: but I'm guessing, not purged23:36
*** inc0 has joined #openstack-infra23:36
fungithey're more rightly phishers/fraudsters23:36
anteayaah23:36
anteayathis was my contention23:36
anteayadeleted pages continued to show up in search engines23:37
anteayaas the pages hadn't been purged23:37
fungithey spam "such and such support number xxx-yyy-zzzz" all over the place, and then scam people who call that number thinking they're contacting an actual support number because they misread a search engine result23:37
anteayaah23:37
*** david-lyle has joined #openstack-infra23:38
*** cody-somerville has quit IRC23:39
*** cody-somerville has joined #openstack-infra23:39
*** cody-somerville has joined #openstack-infra23:39
*** timello has quit IRC23:40
pabelangerfungi: do you have a moment to help land https://review.openstack.org/#/c/353055/ ?23:40
*** timello has joined #openstack-infra23:40
fungimtreinish: dhellmann: i've bought https certs for firehose.o.o and releases.o.o just now, but probably won't get them into hiera until tomorrow23:41
anteayafungi: thank you23:41
pabelangerfungi: also, we have 92+ ubuntu-trusty nodes ready right now23:41
*** csomerville has joined #openstack-infra23:41
anteayanice23:41
pabelangerI think we could restart zuul23:42
fungialso the releases site will require a bit of extra puppeting since it will need a separate vhost configuration, as our current cert vendor doesn't let me add domain names to subjectaltnames on a multi-domain cert without renewing the entire thing23:42
mtreinishfungi: ok cool, thanks. Although, fwiw I think we probably would have been fine with self signed certs (we just wouldn't make the tls ports open)23:42
pabelangergate only has 1 job right now23:42
anteayapabelanger: can we save the check and post queue?23:43
*** zhurong has joined #openstack-infra23:44
pabelangeranteaya: yes for check, we don't usually do post23:44
pabelangerI'm sure we could if we want to preserve it23:44
anteaya270 jobs in post23:44
anteayaI think it is worth trying to save that queue this time23:44
anteayapersonal opinion23:44
*** xarses has joined #openstack-infra23:44
pabelangerwe can try using zuul-changes.py and see what happens. It should work23:44
*** cody-somerville has quit IRC23:45
*** sdake has quit IRC23:45
anteayaI think it is worth a try23:45
fungii think you would need to alter the zuul enqueue commands it outputs to zuul enqueue-ref23:45
fungisince that's not a change-based pipeline23:45
*** inc0 has quit IRC23:45
pabelangerRight, for got about that23:46
pabelangerYup, it is hard coded to zuul enqueue23:47
pabelangerso, that doesn't help us right now23:47
*** gyee_ has joined #openstack-infra23:47
*** gyee_ has quit IRC23:47
*** Julien-zte has quit IRC23:48
*** karthik__ has joined #openstack-infra23:49
pabelangerfungi: anteaya: how would you like to proceed23:49
*** timello has quit IRC23:49
*** karthikp_ has quit IRC23:49
*** kien-ha has joined #openstack-infra23:50
fungipabelanger: what is the scheduler restart intended to fix?23:50
fungior are we just trying to clear out the gearman registrations?23:50
anteayaI see the options as 1) ignore post, that is the precedent 2) change the code to try to save post, which may fail in which case we default to 1)23:50
pabelangerfungi: yes, clear our registrations to fix our demand calculations23:50
fungipabelanger: oh, it's suspected that nodepool misinterpreting demand is due to the number of jobs?23:51
*** timello has joined #openstack-infra23:52
pabelangerfungi: I believe so, when we last had this issue of surplus ubuntu-trusty nodes at the ready state jeblair recommended restarting zuul to clear our our job registrations.23:52
*** electrical has quit IRC23:52
pabelangerwhich we haven't done in a week I believe, and have made more job changes to include ubuntu-xenial nodes23:53
*** nwkarsten has joined #openstack-infra23:54
fungipabelanger: that was when we had label-specific job registrations and so nodepool saw both node types for each job and was just picking the first one it saw. i thought we got rid of those in favor of jobs with label-oriented suffixes in their names?23:54
fungipabelanger: oh, we do still have label-specific registrations in gearman after all. maybe it was that nodepool was supposed to start ignoring them?23:56
*** esberglu has joined #openstack-infra23:56
fungibuild:gate-python-watcherclient-python27-ubuntu-xenial:ubuntu-xenial    0      068323:56
fungifor example23:56
*** esberglu has quit IRC23:57
pabelangerfungi: I am not sure what the fix to nodepool is actually. But I do remember discussions about it23:57
*** rcarrillocruz has quit IRC23:58
pabelangerhowever restarting zuul was the only way to clear out the old registrations if I understand correctly23:58
*** nwkarsten has quit IRC23:58
anteayajpmaxman: what is the wiki book creator functionality?23:58
*** spzala has quit IRC23:59
openstackgerritJohn L. Villalovos proposed openstack-infra/devstack-gate: Ironic needs fewer services on the subnode  https://review.openstack.org/35319123:59
*** rcarrillocruz has joined #openstack-infra23:59
fungilast time we had a pretty good theory of why the demand calculations were off... this time looking at job registrations we don't have any xenial jobs listed with trusty labels or vice versa so that shouldn't be a problem any longer23:59
fungipabelanger: ^23:59
*** spzala has joined #openstack-infra23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!