Wednesday, 2015-11-04

*** heyongli has quit IRC00:00
*** heyongli has joined #openstack-infra00:01
mordredtimrc: that is yuck00:01
jeblairtimrc, mordred: i put detailed tempest times from the last run at the bottom of https://www.ethercalc.org/wzvk5pjvuu00:04
jeblairi grouped by compute host00:04
*** cfarquhar has quit IRC00:05
jeblairi was looking for a pattern... it looks like #4 had the most instances (3), and also had the slowest times, however, one of the instances on #4 had a shorter time...00:05
jeblairso it's not clear cut :)00:05
jeblairbut the fact that only 2 of the runs showed any significant variation is interesting.00:06
*** cfarquhar has joined #openstack-infra00:06
*** cfarquhar has quit IRC00:06
*** cfarquhar has joined #openstack-infra00:06
*** Kennan has joined #openstack-infra00:07
timrcjeblair: So I have htop running on all 4 compute nodes now.00:07
*** wenlock has quit IRC00:07
jeblairtimrc: all 5?00:08
jeblairtimrc: ds0003 - ds000700:08
timrcjeblair: Yeah.00:09
timrcMy math skillz are awesome :)00:09
jeblairmath is hard00:09
*** heyongli has quit IRC00:10
timrcjeblair: So... All of your compute have 64 cores but one... ds0006.sjc03 has 32.00:11
timrcThat's nice a symmetric.00:11
timrcand*00:11
*** heyongli has joined #openstack-infra00:11
jeblairtimrc: oh interesting... that still presents as 64 vcpus00:11
*** markvoelker has quit IRC00:11
clarkbtheres the hyperthreading00:11
clarkboh you mean in libvirt00:12
Hunnercrinkle: oh I forgot to add "how to test" info; basically add reports = puppetdb_file and run a puppet apply and check that it spits out a .json in `puppet config print reportdir`00:12
jeblairclarkb: well, i mean in horizon; i don't know how it gets there :)00:12
timrcjeblair: Well let me make sure that's not a data entry bug.00:13
crinkleHunner: I think that was clear enough00:13
timrccat /proc/cpuinfo shows 64 but the dashboard shows 32.00:13
*** hichihara has joined #openstack-infra00:13
*** pc_m has joined #openstack-infra00:17
*** rfolco has joined #openstack-infra00:18
*** slagle has quit IRC00:19
*** heyongli has quit IRC00:20
*** heyongli has joined #openstack-infra00:21
jlkOkay, we had it mislabeled somewhere. The host has and properly reports to libvirt/nova the full 64 cores00:23
*** pc_m has quit IRC00:26
*** dims has joined #openstack-infra00:28
jeblairtimrc: looks like were in tempest-land now00:28
*** alexsyip has quit IRC00:29
*** bharathm has quit IRC00:30
timrcjeblair: Load is not abnormally high... but it's disportionately more on ds0007.sjc0300:30
*** heyongli has quit IRC00:31
timrcNo memory pressure from what I can see.00:31
*** heyongli has joined #openstack-infra00:31
timrcroot@ds0007:~# uptime00:32
timrc 00:31:34 up 34 days, 23:11,  1 user,  load average: 23.74, 16.97, 9.7800:32
*** edmondsw has quit IRC00:32
jeblairtimrc: yeah, that seems like full utilization (24vcpus), but not over utilization00:33
clarkbis there iowait?00:33
jeblairtimrc: ds0007 has 3 instances on it; the others have 2 except for ds0004 which has 1.00:33
*** sdake_ has quit IRC00:34
*** weshay_afk has quit IRC00:34
timrcclarkb: Yes00:34
timrcclarkb: Mispoke, no iowait.00:35
*** weshay_afk has joined #openstack-infra00:35
timrcclarkb: Or very minimal... I let iostat run for a bit and saw something like .0200:35
clarkbthats not too bad00:36
dimslifeless ping00:37
timrcHighest writes are on ds0005.sjc03...00:38
timrcDevice:            tps    kB_read/s    kB_wrtn/s    kB_read    kB_wrtn00:38
timrcsda               3.67        43.15       159.01  123237629  45412702800:38
*** yusuke has joined #openstack-infra00:39
*** yusuke has left #openstack-infra00:40
*** yusuke_ has joined #openstack-infra00:41
*** heyongli has quit IRC00:41
clarkb1/7 jenkins mastres is done updating00:41
clarkbso the not registered jobs should be gone00:41
*** heyongli has joined #openstack-infra00:42
jeblairall right, requestsexceptions 1.1.0 enqueued :)00:43
jeblairoh, heh, it wants a tox.ini00:43
*** sdake has joined #openstack-infra00:44
openstackgerritVictor Ryzhenkin proposed openstack-infra/project-config: Add KEEP_LOCALRC flag into murano job template  https://review.openstack.org/24142200:46
*** bapalm has quit IRC00:46
timrcjeblair: Not seeing much pressure yet on these systems FWICT.00:47
*** slagle has joined #openstack-infra00:47
*** salv-orlando has joined #openstack-infra00:48
*** bapalm has joined #openstack-infra00:48
*** yusuke_ has quit IRC00:48
*** yusuke_ has joined #openstack-infra00:49
*** jsavak has quit IRC00:49
openstackgerritJames E. Blair proposed openstack-infra/requestsexceptions: Add tox.ini and .gitignore  https://review.openstack.org/24142300:49
jeblairmordred: i manually uploaded 1.1.0 and rechecked the shade change; ^ that should fix the pipeline for the next release.00:49
jeblairmordred: though that may have raced the bandersnatch pulse00:50
*** heyongli has quit IRC00:51
*** heyongli has joined #openstack-infra00:52
*** slagle has quit IRC00:52
jeblairtimrc: they are finishing up now (8/10 running)00:52
yusuke_Excuse me. Could anyone tell me about CI stable/unstable? How those who can set 3rd-party CI to unstable judge whether the CI is stable or unstable?00:53
yusuke_Do they judge it by checking the following Tintri service?00:53
yusuke_http://ci-watch.tintri.com00:53
openstackgerritJames E. Blair proposed openstack-infra/shade: Use the requestsexceptions library.  https://review.openstack.org/24130700:53
clarkbyusuke_: I think often times it is done by reading the job logs00:54
clarkbif it is a consistent problem it is usually pretty apparent00:54
*** slagle has joined #openstack-infra00:54
*** ajmiller_ has quit IRC00:54
jlvillalIf I depend on a patch to openstack-infra/project-config, should it build my patch using my changes to project-config?00:55
jeblairjlvillal: no; but we hope to have something like that in zuulv300:55
jlvillaljeblair: Ah thanks. That explains why it didn't seem to bring in my change :)00:56
timrcjeblair: Here are some iostats taken a few second ago: http://paste.openstack.org/show/cKWlLGbAn8aP8yZ6otG1/00:56
yusuke_clarkb: Thanks, they read job log in gerrit, don't they?00:56
*** ddietery has joined #openstack-infra00:56
clarkbyusuke_: its wherever the logs are posted00:56
timrcjeblair: We did not see really high load (given 64 cores) or memory usage on any of the compute nodes.00:56
*** ddietery has quit IRC00:57
yusuke_clarkb: thx, OK for whereever00:57
lifelessdims: pong00:58
openstackgerritJohn L. Villalovos proposed openstack-infra/project-config: Run Ironic grenade jobs with IPA  https://review.openstack.org/24142600:59
*** sridhar_ram has quit IRC01:00
*** zhenguo has joined #openstack-infra01:00
dimslifeless : unforeseen travel came up. out for a couple of days, but did not want to hold up https://review.openstack.org/#/c/238871/ - is there someone (you!) who can pick that up?01:00
*** wenlock has joined #openstack-infra01:00
openstackgerritMerged openstack-infra/puppet-gerrit: Move test assertions closer to apply.  https://review.openstack.org/22757101:01
*** ybathia has quit IRC01:01
*** heyongli has quit IRC01:01
*** ahaldin has quit IRC01:02
*** achanda has quit IRC01:02
*** heyongli has joined #openstack-infra01:03
freerunnerclarkb: Looks like you're was right about this patch https://review.openstack.org/#/c/241267/ . I'm have some problems with this job. Strange, but plugin settings and other configuration variables have no effect. Could you give me an advice, please?01:03
*** ddietery has joined #openstack-infra01:04
lifelessdims: as I said to dhellmann I can't commit to it but I'll give it a try01:05
dimsthanks lifeless!01:06
lifelessdims: however there's no point rushing it; we need to get the pip fix in and released too, and pip 8 is on a timeline due to pypi deprecations, so we can't ask for an early release01:06
freerunnerclarkb: I'm using DEVSTACK_GATE_NEUTRON variable in template, but, in localrc I have enabled n-net oO . Maybe the root cause in ENABLED_SERVICES variable?01:06
dimslifeless ok01:06
*** salv-orlando has quit IRC01:07
jeblairmordred: heh, we need a 1.1.1 due to a typo :)01:08
*** gildub has joined #openstack-infra01:08
openstackgerritJames E. Blair proposed openstack-infra/requestsexceptions: Fix typos  https://review.openstack.org/24143001:09
openstackgerritJames E. Blair proposed openstack-infra/shade: Use the requestsexceptions library  https://review.openstack.org/24130701:10
*** wenlock has quit IRC01:12
*** heyongli has quit IRC01:12
*** markvoelker has joined #openstack-infra01:12
*** FallenPegasus has quit IRC01:12
*** heyongli has joined #openstack-infra01:13
*** Swami has quit IRC01:13
jeblairtimrc: all finished; collating data now01:16
*** sigmavirus24_awa is now known as sigmavirus2401:16
*** markvoelker has quit IRC01:17
*** chlong has joined #openstack-infra01:18
smcginnisQuestion for anyone who knows - how can I add a project to the list that the bot notifies in channel when a new patch is submitted?01:20
smcginnisI'm looking at Cinder. We have the cinder repo and the python-openstack repo reporting.01:20
smcginnisos-brick has been added to the list of projects, but that one doesn't pop up in the #openstack-cinder01:20
lifelessmordred: you might find https://www.gitcolony.com/ interesting01:21
jeblairtimrc: i added this batch to https://www.ethercalc.org/wzvk5pjvuu and still don't see a pattern relating to either individual compute hosts or the number of instances running concurrently on a given host.01:21
jrollsmcginnis: this file is the thing to change https://git.openstack.org/cgit/openstack-infra/project-config/tree/gerritbot/channels.yaml01:22
*** thorst has joined #openstack-infra01:22
smcginnisjroll: Perfect, thanks!01:22
*** heyongli has quit IRC01:22
jrollsmcginnis: looks like it's there, though https://git.openstack.org/cgit/openstack-infra/project-config/tree/gerritbot/channels.yaml#n35401:22
* smcginnis scratches head...01:22
smcginnisjroll: Guess I need to double check some things. Thanks for the pointer.01:23
jrollnp01:23
jrollsmcginnis: one other thing; stable branch changes aren't reported, only master01:23
*** heyongli has joined #openstack-infra01:23
*** dolpher has joined #openstack-infra01:23
smcginnisjroll: I don't recall any from that project, but maybe it's just infrequent enough that I've missed it.01:24
*** tnarg has quit IRC01:24
jrollyeah, can always launch a test commit01:24
smcginnisAnywhere documented what things like x-vrif-minus-2 means?01:24
*** hemna is now known as hemnafk01:24
*** gabriel has joined #openstack-infra01:24
*** angdraug has quit IRC01:25
jrollsmcginnis: no clue, sorry, infra folks may know, though01:25
jeblairtimrc: tomorrow i'll try different values (20 simultaneous jobs, 5 jobs, etc) and see if that gives us any more information; for the moment though we have a performance variation from 54 to 62 minutes; cause unknown.01:26
smcginnisjroll: No worries. Thanks again.01:27
jrollnp01:28
timrcjeblair: Sounds good.  Happy to monitor again and report any anomalies.01:28
*** signed8bit has quit IRC01:28
*** gyee has quit IRC01:28
*** aukhan has joined #openstack-infra01:30
*** heyongli has quit IRC01:32
*** heyongli has joined #openstack-infra01:33
openstackgerritSean McGinnis proposed openstack-infra/project-config: Add merge notifications for Cinder channel  https://review.openstack.org/24143501:36
*** rlucio has quit IRC01:42
*** armax has joined #openstack-infra01:42
*** heyongli has quit IRC01:42
*** btully has quit IRC01:43
*** heyongli has joined #openstack-infra01:44
*** pvaneck has quit IRC01:44
*** FallenPegasus has joined #openstack-infra01:44
*** yamamoto has joined #openstack-infra01:51
*** jyuso1 has joined #openstack-infra01:52
*** _denisra has joined #openstack-infra01:52
*** heyongli has quit IRC01:53
*** heyongli has joined #openstack-infra01:54
*** sigmavirus24 is now known as sigmavirus24_awa01:54
*** sigmavirus24_awa is now known as sigmavirus2401:55
*** nadya has joined #openstack-infra01:58
*** aukhan has quit IRC02:01
*** aukhan has joined #openstack-infra02:02
*** nadya has quit IRC02:02
*** heyongli has quit IRC02:03
*** oomichi has joined #openstack-infra02:03
*** oomichi has quit IRC02:03
*** heyongli has joined #openstack-infra02:04
*** woodster_ has quit IRC02:09
*** dims has quit IRC02:13
*** heyongli has quit IRC02:13
kun_huangguys, is updating work done?02:13
*** heyongli has joined #openstack-infra02:14
*** yamamoto has quit IRC02:14
clarkbkun_huang it should be done enough to fix the not registered issue02:15
clarkbI actually got distracted by babies and need to check if all jenkins masters completed02:15
clarkblast I saw 5/7 did02:15
*** sridhar_ram has joined #openstack-infra02:16
*** salv-orlando has joined #openstack-infra02:16
kun_huangclarkb: is there a public url to check?02:16
*** bpokorny_ has joined #openstack-infra02:18
clarkbkun_huang: you can log into the jenkins masters https://jenkins01.openstack.org through jenkins07.openstack.org and check that your jobs exist02:19
clarkbyup its done now02:20
*** wenlock has joined #openstack-infra02:21
*** bpokorny has quit IRC02:21
*** bpokorny_ has quit IRC02:22
*** heyongli has quit IRC02:23
*** heyongli has joined #openstack-infra02:25
*** wenlock has quit IRC02:25
*** chlong has quit IRC02:25
*** sridhar_ram has quit IRC02:26
*** gabriel has left #openstack-infra02:26
*** AzherKhan has joined #openstack-infra02:27
*** xyang1 has quit IRC02:28
*** aukhan has quit IRC02:28
*** rguillebert has quit IRC02:28
kun_huangclarkb: should I wait for another moment for this, I have 2 dsvm jobs, one is running and another is still not registered02:30
*** esmute__ has quit IRC02:31
*** chlong has joined #openstack-infra02:31
*** thorst has quit IRC02:31
clarkbany current not registered problems are likely due to the config at this point02:31
*** esmute__ has joined #openstack-infra02:31
*** btully has joined #openstack-infra02:31
kun_huangoops02:32
*** gongysh_ has quit IRC02:32
*** heyongli has quit IRC02:34
*** heyongli has joined #openstack-infra02:35
*** esmute__ has quit IRC02:36
*** xiexs has quit IRC02:36
*** salv-orlando has quit IRC02:36
*** unicell has quit IRC02:37
*** abregman has quit IRC02:39
kun_huangclarkb: my recent change is https://review.openstack.org/#/c/240656/10, is it possible fedora-22 node has not been online yet?02:41
lifelessclarkb: how did the jenkings thing go ?02:41
Shrewsjeblair: If you get a minute, this could use your +2 again: https://review.openstack.org/24138502:41
Shrewsjeblair: improved the commit message and doc string02:42
*** chlong has quit IRC02:42
clarkblifeless all done02:42
*** inteq has joined #openstack-infra02:43
clarkbkun_huang that may be it not sure and not in a place to check02:43
lifelesscool02:43
*** markvoelker has joined #openstack-infra02:43
*** FallenPegasus has quit IRC02:43
*** heyongli has quit IRC02:44
*** thorst has joined #openstack-infra02:45
*** heyongli has joined #openstack-infra02:45
*** markvoelker has quit IRC02:48
*** thorst has quit IRC02:49
*** dvlwrk_ has joined #openstack-infra02:49
*** thorst has joined #openstack-infra02:49
*** FallenPegasus has joined #openstack-infra02:50
*** FallenPegasus has quit IRC02:54
*** thorst has quit IRC02:54
*** heyongli has quit IRC02:54
openstackgerritSamuel de Medeiros Queiroz proposed openstack-infra/project-config: Make Identity API v3 only job default  https://review.openstack.org/24145002:55
*** heyongli has joined #openstack-infra02:55
openstackgerritSteve Kowalik proposed openstack-infra/jeepyb: Add three Zanata scripts  https://review.openstack.org/24145102:55
openstackgerritSamuel de Medeiros Queiroz proposed openstack-infra/project-config: Identity API v3 only jobs non-voting in QA repos  https://review.openstack.org/24145202:55
*** gongysh_ has joined #openstack-infra02:57
*** gongysh_ has quit IRC03:01
*** wenlock has joined #openstack-infra03:01
*** yamamoto has joined #openstack-infra03:03
*** heyongli has quit IRC03:04
*** mnencia has quit IRC03:05
*** gongysh_ has joined #openstack-infra03:05
*** heyongli has joined #openstack-infra03:06
*** mnencia has joined #openstack-infra03:06
kun_huangianw: ping03:06
kun_huangclarkb: I remember something03:08
kun_huang"this looks ok, but the f22 nodes are still a work-in-progress." from ianw03:08
kun_huangthat fedora-22 is node is not online yet03:08
*** Liuqing has joined #openstack-infra03:10
*** unicell has joined #openstack-infra03:11
*** gongysh_ has quit IRC03:11
ianwkun_huang: it may not be, i haven't tried in a few days.  the only other thing using it is devstack experimental queue03:12
*** Liuqing has quit IRC03:13
*** Liuqing has joined #openstack-infra03:13
ianwi'm just babysitting the required dib changes through ...03:13
kun_huangianw: at least I know why my f22 job is not registered03:13
ianwbut anyway, f23 just released, so that won't be far away either :)03:14
ianwbut i expect that will be much simpler, as the package manager hasn't changed there :)03:14
kun_huangianw: yep, the dnf now03:14
*** heyongli has quit IRC03:15
kun_huangianw: I'm working on my prototypes now,03:15
kun_huangafter finishing that , I could help you with building fedora nodes03:15
*** heyongli has joined #openstack-infra03:16
ianwkun_huang: ok, cool, well there's a couple of things we could be doing better, especially with caching in the images03:18
*** sileht has joined #openstack-infra03:18
openstackgerritLiuqing Jing proposed openstack-infra/project-config: Add channel for OpenSatck Evoque  https://review.openstack.org/23837003:19
*** yusuke_ has quit IRC03:22
*** heyongli has quit IRC03:25
*** heyongli has joined #openstack-infra03:26
*** weshay_afk has quit IRC03:29
*** weshay_afk has joined #openstack-infra03:32
*** dims has joined #openstack-infra03:33
*** otter768 has joined #openstack-infra03:34
*** heyongli has quit IRC03:35
*** heyongli has joined #openstack-infra03:36
*** rlandy has quit IRC03:38
*** jamielennox is now known as jamielennox|away03:38
*** rfolco has quit IRC03:39
*** jamielennox|away is now known as jamielennox03:40
*** esmute__ has joined #openstack-infra03:42
*** salv-orlando has joined #openstack-infra03:43
*** achanda has joined #openstack-infra03:44
openstackgerritMerged openstack-infra/irc-meetings: Move tacker meeting to Tuesdays  https://review.openstack.org/24120103:45
*** heyongli has quit IRC03:45
*** heyongli has joined #openstack-infra03:46
*** sigmavirus24 is now known as sigmavirus24_awa03:50
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Better duplicate detection for project requirements check  https://review.openstack.org/23887103:55
*** heyongli has quit IRC03:56
*** heyongli has joined #openstack-infra03:57
*** nadya has joined #openstack-infra03:58
*** dims has quit IRC04:03
*** salv-orlando has quit IRC04:03
*** binbincong has quit IRC04:03
*** ddietery has quit IRC04:03
*** nadya has quit IRC04:03
*** achanda has quit IRC04:04
*** heyongli has quit IRC04:06
*** aukhan has joined #openstack-infra04:06
*** heyongli has joined #openstack-infra04:07
*** sballe_ has joined #openstack-infra04:08
*** skath_ has joined #openstack-infra04:08
*** sabeen3 has joined #openstack-infra04:08
*** simonmcc_ has joined #openstack-infra04:08
*** j^2_ has joined #openstack-infra04:08
*** matt_____ has joined #openstack-infra04:09
*** mcarden_ has joined #openstack-infra04:09
*** legoktm_ has joined #openstack-infra04:09
*** bapalm_ has joined #openstack-infra04:10
*** kragniz_ has joined #openstack-infra04:10
*** gus_ has joined #openstack-infra04:10
*** mahatic has joined #openstack-infra04:10
*** hamzy_ has joined #openstack-infra04:11
*** sabeen has quit IRC04:11
*** ameade has quit IRC04:11
*** simonmcc has quit IRC04:11
*** otherwiseguy has quit IRC04:11
*** isviridov_away has quit IRC04:11
*** fbo has quit IRC04:11
*** msuriar has quit IRC04:11
*** mjb has quit IRC04:11
*** weshay_afk has quit IRC04:11
*** j^2 has quit IRC04:11
*** adam_g has quit IRC04:11
*** mcarden has quit IRC04:11
*** skath has quit IRC04:11
*** sballe has quit IRC04:11
*** AzherKhan has quit IRC04:11
*** bapalm has quit IRC04:11
*** jhesketh has quit IRC04:11
*** anthonyper has quit IRC04:11
*** ryanpetrello has quit IRC04:11
*** matt___ has quit IRC04:11
*** gus has quit IRC04:11
*** fungi has quit IRC04:11
*** legoktm has quit IRC04:11
*** hamzy has quit IRC04:11
*** kragniz has quit IRC04:11
*** skath_ is now known as skath04:12
*** sballe_ is now known as sballe04:12
*** jhesketh has joined #openstack-infra04:12
*** simonmcc_ is now known as simonmcc04:13
*** anthonyper has joined #openstack-infra04:14
*** isviridov_away has joined #openstack-infra04:14
*** j^2_ is now known as j^204:14
*** ryanpetrello has joined #openstack-infra04:15
*** fbo has joined #openstack-infra04:15
*** mjb has joined #openstack-infra04:15
*** binbincong has joined #openstack-infra04:15
*** adam_g has joined #openstack-infra04:16
*** heyongli has quit IRC04:16
*** adam_g has quit IRC04:16
*** adam_g has joined #openstack-infra04:16
*** heyongli has joined #openstack-infra04:17
*** gus_ is now known as gus04:18
*** esmute__ has quit IRC04:21
*** ameade has joined #openstack-infra04:21
*** msuriar has joined #openstack-infra04:22
*** weshay_afk has joined #openstack-infra04:23
*** fungi has joined #openstack-infra04:23
*** legoktm_ has quit IRC04:24
*** legoktm_ has joined #openstack-infra04:24
*** legoktm_ is now known as legoktm04:24
*** binbincong has quit IRC04:24
*** heyongli has quit IRC04:26
*** jyuso has joined #openstack-infra04:27
*** heyongli has joined #openstack-infra04:27
*** boris-42 has quit IRC04:28
*** jyuso1 has quit IRC04:29
*** chlong has joined #openstack-infra04:33
*** otherwiseguy has joined #openstack-infra04:34
*** aviau has quit IRC04:35
*** heyongli has quit IRC04:37
*** aviau has joined #openstack-infra04:37
*** binbincong has joined #openstack-infra04:37
*** heyongli has joined #openstack-infra04:38
*** esmute__ has joined #openstack-infra04:39
*** FallenPegasus has joined #openstack-infra04:39
*** otter768 has quit IRC04:41
*** greghaynes2 has joined #openstack-infra04:42
*** spzala has quit IRC04:43
*** markvoelker has joined #openstack-infra04:44
*** chlong has quit IRC04:45
*** Sree has joined #openstack-infra04:46
*** Sree has quit IRC04:46
*** ybathia has joined #openstack-infra04:47
*** heyongli has quit IRC04:47
*** Sree has joined #openstack-infra04:47
*** heyongli has joined #openstack-infra04:48
*** chlong has joined #openstack-infra04:49
*** markvoelker has quit IRC04:49
*** bpokorny has joined #openstack-infra04:52
*** fedexo has joined #openstack-infra04:53
*** daemontool has quit IRC04:53
*** achanda has joined #openstack-infra04:54
*** daemontool has joined #openstack-infra04:54
*** btully has quit IRC04:57
*** heyongli has quit IRC04:57
*** heyongli has joined #openstack-infra04:58
openstackgerritfumihiko kakuma proposed openstack-infra/project-config: Add job for the ovs mechanism driver with native mode  https://review.openstack.org/22114304:59
*** nadya has joined #openstack-infra04:59
*** Sree_ has joined #openstack-infra05:01
*** Sree_ is now known as Guest4263905:01
*** links has joined #openstack-infra05:02
*** yushiro has joined #openstack-infra05:03
*** Sree has quit IRC05:04
*** ddietery has joined #openstack-infra05:04
*** salv-orlando has joined #openstack-infra05:04
*** nadya has quit IRC05:04
*** bpokorny has quit IRC05:05
*** heyongli has quit IRC05:07
yushiroHi all,  I have a question about pypi-jobs.05:08
*** heyongli has joined #openstack-infra05:08
*** ddietery has quit IRC05:08
lifelessyushiro: ask your question...05:09
yushirolifeless, Thank you for your help :)  Currently I'm reading http://docs.openstack.org/infra/manual/creators.html#tagging-a-release05:10
*** chlong has quit IRC05:10
yushirolifeless, In my understanding, after executing "git push gerrit $version", the pypi job will run and publish the release.05:10
lifelessyes05:10
yushirolifeless, My question is that is it necessary to register "pypi-jobs" at project-config/jenkins/jobs/projects.yaml?05:11
lifelessI don't know, I've never been involved in a non-python project to figure out how the release stuff is wired up05:11
*** mcarden_ is now known as mcarden05:13
*** thorst has joined #openstack-infra05:14
StevenKyushiro: It is up to what the project has configured as jobs in the 'release' pipeline.05:14
*** dvlwrk_ has quit IRC05:15
*** Guest42639 has quit IRC05:17
*** Sree has joined #openstack-infra05:18
*** heyongli has quit IRC05:18
*** kragniz_ is now known as kragniz05:18
*** thorst has quit IRC05:18
*** heyongli has joined #openstack-infra05:19
*** sridhar_ram has joined #openstack-infra05:19
*** changbl has joined #openstack-infra05:22
*** davideagnello has joined #openstack-infra05:22
*** heyongli has quit IRC05:28
*** binbincong has quit IRC05:29
*** heyongli has joined #openstack-infra05:29
yushirolifeless, StevenK : OK. Thank you.05:29
*** yfried|afk is now known as yfried05:29
*** salv-orlando has quit IRC05:30
*** greghaynes is now known as greghaynes_05:30
*** greghaynes2 is now known as greghaynes05:30
*** dvlwrk_ has joined #openstack-infra05:32
*** alexey_weyl has joined #openstack-infra05:34
*** jraju has joined #openstack-infra05:36
*** links has quit IRC05:37
*** heyongli has quit IRC05:38
*** heyongli has joined #openstack-infra05:39
*** btully has joined #openstack-infra05:41
*** binbincong has joined #openstack-infra05:42
*** maishsk_ has joined #openstack-infra05:43
*** maishsk has quit IRC05:44
*** maishsk_ is now known as maishsk05:44
*** shuquan has joined #openstack-infra05:45
*** yushiro has quit IRC05:45
*** ramishra has quit IRC05:46
*** ramishra has joined #openstack-infra05:46
*** heyongli has quit IRC05:48
*** davideagnello has quit IRC05:49
*** heyongli has joined #openstack-infra05:49
*** tnarg has joined #openstack-infra05:49
*** maishsk has quit IRC05:50
*** wenlock has quit IRC05:50
*** ZZelle_ has joined #openstack-infra05:51
*** tdurakov_ has joined #openstack-infra05:56
*** FallenPegasus has quit IRC05:58
*** alexey_weyl has left #openstack-infra05:59
*** heyongli has quit IRC05:59
*** heyongli has joined #openstack-infra06:00
*** tnarg has quit IRC06:01
*** FallenPegasus has joined #openstack-infra06:03
*** abregman has joined #openstack-infra06:04
*** ddietery has joined #openstack-infra06:05
*** ZZelle_ has quit IRC06:06
*** ddietery has quit IRC06:06
*** ddietery has joined #openstack-infra06:07
*** heyongli has quit IRC06:09
*** heyongli has joined #openstack-infra06:10
*** tdurakov_ has quit IRC06:10
openstackgerritfumihiko kakuma proposed openstack-infra/project-config: Add job for the ovs mechanism driver with native mode  https://review.openstack.org/22114306:10
*** ddietery has quit IRC06:11
*** AzherKhan has joined #openstack-infra06:14
*** jraju has quit IRC06:15
*** wenlock has joined #openstack-infra06:15
*** hdd has joined #openstack-infra06:16
*** AJaeger has joined #openstack-infra06:16
*** aukhan has quit IRC06:16
*** nadya has joined #openstack-infra06:18
*** sdake has quit IRC06:18
AJaegerinfra-root, could I get a review on a translation fix, please? https://review.openstack.org/#/c/240651/06:19
*** heyongli has quit IRC06:19
*** esmute__ has quit IRC06:19
*** heyongli has joined #openstack-infra06:20
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/23789406:23
*** tnarg has joined #openstack-infra06:25
*** sridhar_ram has quit IRC06:26
*** wenlock has quit IRC06:26
*** hdd has quit IRC06:27
*** esmute__ has joined #openstack-infra06:28
*** tnarg has quit IRC06:29
*** heyongli has quit IRC06:29
*** heyongli has joined #openstack-infra06:30
*** shuquan has quit IRC06:31
*** salv-orlando has joined #openstack-infra06:31
*** shuquan has joined #openstack-infra06:32
*** jlvillal has quit IRC06:32
*** jlvillal has joined #openstack-infra06:33
*** binbincong has quit IRC06:33
*** AzherKhan has quit IRC06:34
*** ParsectiX has joined #openstack-infra06:34
*** yfried has quit IRC06:35
*** esmute__ has quit IRC06:35
*** wenlock has joined #openstack-infra06:35
*** esmute__ has joined #openstack-infra06:36
*** wenlock has quit IRC06:40
*** unicell1 has joined #openstack-infra06:40
*** heyongli has quit IRC06:40
*** e0ne has joined #openstack-infra06:40
*** shuquan has quit IRC06:40
*** nadya has quit IRC06:40
*** esmute__ has quit IRC06:40
*** heyongli has joined #openstack-infra06:41
*** unicell has quit IRC06:41
*** otter768 has joined #openstack-infra06:41
*** links has joined #openstack-infra06:42
*** baoli has joined #openstack-infra06:45
*** markvoelker has joined #openstack-infra06:45
openstackgerritDerek Higgins proposed openstack-infra/project-config: Add stable/liberty tripleo job  https://review.openstack.org/24093806:45
*** hdd has joined #openstack-infra06:45
*** otter768 has quit IRC06:46
*** baoli has quit IRC06:47
*** aukhan has joined #openstack-infra06:47
*** shuquan has joined #openstack-infra06:48
*** markvoelker has quit IRC06:49
*** e0ne has quit IRC06:50
*** wenlock has joined #openstack-infra06:50
*** heyongli has quit IRC06:50
*** ParsectiX has quit IRC06:51
*** heyongli has joined #openstack-infra06:51
*** freerunner has quit IRC06:51
*** ParsectiX has joined #openstack-infra06:52
*** Liuqing has quit IRC06:53
*** binbincong has joined #openstack-infra06:53
*** freerunner has joined #openstack-infra06:53
*** Liuqing has joined #openstack-infra06:54
shuquanhi guys,06:55
shuquanfrom this link: http://www.joinfu.com/2014/01/understanding-the-openstack-ci-system/06:55
*** nadya has joined #openstack-infra06:56
shuquanZuul’s pipelines are configured in a single file called layout.yaml06:56
shuquanI can’t find the layout.yaml now.06:56
shuquanWho knows Where it is now?06:56
kun_huangshuquan: project-config project06:57
*** niedbalski has quit IRC06:57
kun_huangit's here https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml06:58
shuquankun_huang: thanks man!06:58
*** gildub has quit IRC06:58
kun_huangyou are welcome ;)06:59
*** niedbalski has joined #openstack-infra07:00
*** markvoelker has joined #openstack-infra07:00
*** heyongli has quit IRC07:00
tobiashgood morning, just a question about zuul operations, do you enable debug logging in zuul in production?07:01
*** heyongli has joined #openstack-infra07:01
*** wenlock has quit IRC07:01
*** jamielennox is now known as jamielennox|away07:02
*** salv-orlando has quit IRC07:02
AJaegershuquan: if you want to start with zuul, read also the Infra Manual: http://docs.openstack.org/infra/manual/07:03
*** AJaeger has quit IRC07:03
*** Liuqing has quit IRC07:03
shuquanAjaeger: :)07:04
*** Liuqing has joined #openstack-infra07:04
tobiashjust had the problem that zuul logges its hard disk full in just one day...07:05
openstackgerritSpencer Krum proposed openstack-infra/system-config: Do Not Merge: Convert puppet.conf for puppet-apply  https://review.openstack.org/24149507:05
*** mohankumar has joined #openstack-infra07:05
*** markvoelker has quit IRC07:05
tobiashcurrently thinking about giving zuul more hard disk or just disable debug logging07:05
*** maishsk has joined #openstack-infra07:06
mohankumarTeam i got some jenkins error while merging my code to  Neutron master code .. but i can not anything from logs why it got failed07:06
mohankumarpatch set :  https://review.openstack.org/#/c/237896/07:07
mohankumarplease help to understand jenkins error07:07
*** ddietery has joined #openstack-infra07:07
*** heyongli has quit IRC07:10
*** heyongli has joined #openstack-infra07:11
*** tsufiev has quit IRC07:12
*** tsufiev has joined #openstack-infra07:12
openstackgerritSpencer Krum proposed openstack-infra/system-config: Add 'testing' node to site.pp  https://review.openstack.org/24149707:12
*** ddietery has quit IRC07:12
*** shuquan has quit IRC07:13
*** thorst has joined #openstack-infra07:15
*** sabeen3 has quit IRC07:15
*** shuquan has joined #openstack-infra07:17
openstackgerritSpencer Krum proposed openstack-infra/system-config: Role to prep system for puppet apply  https://review.openstack.org/24150107:19
openstackgerritSpencer Krum proposed openstack-infra/system-config: Remove global puppetmaster setting  https://review.openstack.org/24150207:19
openstackgerritSpencer Krum proposed openstack-infra/system-config: Switch ansible to applyprep and puppetapply  https://review.openstack.org/24150307:19
*** thorst has quit IRC07:20
*** heyongli has quit IRC07:21
*** heyongli has joined #openstack-infra07:22
*** niska` has joined #openstack-infra07:22
*** ybathia has quit IRC07:24
*** asilenkov has quit IRC07:25
*** nithyag__ has quit IRC07:27
*** niska has quit IRC07:27
*** moravec has quit IRC07:27
*** sc68cal has quit IRC07:27
*** cloudnull has quit IRC07:27
*** nithyag__ has joined #openstack-infra07:27
*** asilenkov has joined #openstack-infra07:28
*** heyongli has quit IRC07:31
*** Vivek has quit IRC07:32
*** heyongli has joined #openstack-infra07:32
*** sc68cal has joined #openstack-infra07:34
*** cloudkiller has joined #openstack-infra07:37
*** yfried has joined #openstack-infra07:37
*** heyongli has quit IRC07:41
*** mohankumar has quit IRC07:41
*** yfried_ has joined #openstack-infra07:42
*** yfried has quit IRC07:42
*** heyongli has joined #openstack-infra07:42
*** FallenPegasus has quit IRC07:47
*** mpavone has joined #openstack-infra07:49
*** k4n0 has joined #openstack-infra07:50
*** heyongli has quit IRC07:51
*** mpavone has quit IRC07:52
*** heyongli has joined #openstack-infra07:52
*** ifarkas has joined #openstack-infra07:55
*** jyuso1 has joined #openstack-infra07:59
*** Sree_ has joined #openstack-infra08:01
*** Sree_ is now known as Guest8629808:01
*** salv-orlando has joined #openstack-infra08:01
*** heyongli has quit IRC08:02
*** arxcruz has joined #openstack-infra08:02
*** jyuso has quit IRC08:03
*** heyongli has joined #openstack-infra08:03
*** Sree has quit IRC08:04
*** shuquan has quit IRC08:05
*** hemnafk has quit IRC08:06
*** hemnafk has joined #openstack-infra08:06
*** achanda has quit IRC08:07
*** hemnafk has quit IRC08:07
*** rossella_s has joined #openstack-infra08:07
*** hemnafk has joined #openstack-infra08:07
*** ParsectiX has quit IRC08:08
*** ddietery has joined #openstack-infra08:08
*** nadya has quit IRC08:08
*** ParsectiX has joined #openstack-infra08:12
*** samuelBartel has joined #openstack-infra08:12
*** heyongli has quit IRC08:12
*** ParsectiX has quit IRC08:12
*** ddietery has quit IRC08:12
*** heyongli has joined #openstack-infra08:13
*** salv-orlando has quit IRC08:14
*** pblaho has joined #openstack-infra08:14
*** salv-orlando has joined #openstack-infra08:14
*** ParsectiX has joined #openstack-infra08:14
*** samuelBartel has quit IRC08:17
*** thorst has joined #openstack-infra08:17
*** Guest86298 has quit IRC08:18
*** Sree has joined #openstack-infra08:19
*** peterlisak has joined #openstack-infra08:20
*** shardy has joined #openstack-infra08:20
*** yuanying has quit IRC08:20
*** amrith has joined #openstack-infra08:22
*** amrith has left #openstack-infra08:22
*** thorst has quit IRC08:22
*** heyongli has quit IRC08:22
*** heyongli has joined #openstack-infra08:23
*** ad_rien_ has joined #openstack-infra08:24
*** btully has quit IRC08:24
*** binbincong has quit IRC08:27
*** cloudkiller is now known as cloudnull08:28
*** jyuso has joined #openstack-infra08:30
*** yfried__ has joined #openstack-infra08:32
*** someara2 has quit IRC08:32
*** heyongli has quit IRC08:32
*** jyuso1 has quit IRC08:33
*** heyongli has joined #openstack-infra08:33
*** yfried_ has quit IRC08:35
*** jtomasek has quit IRC08:37
*** Guest98556 is now known as d0ugal08:37
openstackgerritJohn L. Villalovos proposed openstack-infra/irc-meetings: WIP: Try a boostrap grid to list all the meetings  https://review.openstack.org/24152208:38
*** ZZelle has quit IRC08:38
*** d0ugal has quit IRC08:38
*** d0ugal has joined #openstack-infra08:38
*** ZZelle has joined #openstack-infra08:38
*** jtomasek has joined #openstack-infra08:38
*** binbincong has joined #openstack-infra08:39
*** jcoufal has joined #openstack-infra08:40
*** aopincar has joined #openstack-infra08:42
*** otter768 has joined #openstack-infra08:42
*** heyongli has quit IRC08:43
*** heyongli has joined #openstack-infra08:44
*** hashar has joined #openstack-infra08:47
*** otter768 has quit IRC08:47
*** hashar has quit IRC08:48
openstackgerritMerged openstack-infra/project-config: Fix up magnum-ui setup  https://review.openstack.org/24065108:49
*** kushal has joined #openstack-infra08:49
*** mohankumar has joined #openstack-infra08:52
*** samuelBartel has joined #openstack-infra08:53
*** yuanying has joined #openstack-infra08:53
*** heyongli has quit IRC08:53
*** heyongli has joined #openstack-infra08:54
*** FallenPegasus has joined #openstack-infra08:56
*** fhubik has joined #openstack-infra08:56
*** nadya has joined #openstack-infra08:56
*** yfried__ has quit IRC08:56
*** jordanP has joined #openstack-infra08:59
*** e0ne has joined #openstack-infra08:59
*** yfried__ has joined #openstack-infra09:00
*** nadya has quit IRC09:00
*** binbincong has quit IRC09:00
*** FallenPegasus has quit IRC09:00
*** markvoelker has joined #openstack-infra09:01
*** heyongli has quit IRC09:03
*** yfried__ has quit IRC09:04
*** yfried has joined #openstack-infra09:04
*** heyongli has joined #openstack-infra09:04
*** fhubik is now known as fhubik_brb09:05
*** markus_z has joined #openstack-infra09:06
*** markvoelker has quit IRC09:06
gchamoulexit09:07
gchamouloops, sorry guys!09:07
*** Ala has joined #openstack-infra09:07
*** jistr has joined #openstack-infra09:08
*** ihrachys has joined #openstack-infra09:08
*** ddietery has joined #openstack-infra09:09
*** dingyichen has quit IRC09:11
*** nmagnezi_ has joined #openstack-infra09:11
*** kashyap has left #openstack-infra09:11
*** heyongli has quit IRC09:13
*** ddietery has quit IRC09:14
*** nmagnezi_ has quit IRC09:14
*** binbincong has joined #openstack-infra09:14
*** heyongli has joined #openstack-infra09:14
*** Sree_ has joined #openstack-infra09:15
*** Sree_ is now known as Guest4231109:16
*** ParsectiX has quit IRC09:17
*** Sree has quit IRC09:18
*** binbincong has quit IRC09:18
*** fhubik_brb is now known as fhubik09:22
*** fhubik is now known as fhubik_brb09:22
*** heyongli has quit IRC09:24
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: pep8: E302 expected 2 blank lines, found <n>  https://review.openstack.org/24153409:24
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: pep8: E265 block comment should start with '# '  https://review.openstack.org/24153509:24
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: pep8: E272 multiple spaces before keyword  https://review.openstack.org/24153609:24
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: pep8: E712 comparison to False should be 'if cond is False:' or 'if not cond:'  https://review.openstack.org/24153709:24
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: pep8: E128 continuation line under-indented for visual indent  https://review.openstack.org/24153809:24
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: pep8: E127 continuation line over-indented for visual indent  https://review.openstack.org/24153909:24
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: pep8: E131 continuation line unaligned for hanging indent  https://review.openstack.org/24154009:24
*** heyongli has joined #openstack-infra09:25
*** dpursehouse has joined #openstack-infra09:25
*** eliqiao has joined #openstack-infra09:26
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/infra-ansible: Attach volumes defined on servers stanzas  https://review.openstack.org/24154109:26
eliqiaohello, does anyone konw where to configure localrc on a gate pipe-line ?09:28
*** kushal has quit IRC09:29
*** asettle has quit IRC09:29
*** aopincar has quit IRC09:30
*** yamamoto has quit IRC09:32
*** ParsectiX has joined #openstack-infra09:34
*** heyongli has quit IRC09:34
*** peterstac has quit IRC09:34
*** someara2 has joined #openstack-infra09:34
openstackgerritBalazs Gibizer proposed openstack-infra/irc-meetings: Add nova notification subteam meeting  https://review.openstack.org/24154609:35
*** heyongli has joined #openstack-infra09:35
*** AJaeger has joined #openstack-infra09:35
kun_huangeliqiao: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/scalpels.yaml09:36
*** aopincar has joined #openstack-infra09:36
eliqiaokun_huang:  thanks, I know, but where is the base template?09:37
*** salv-orlando has quit IRC09:37
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: pep8: F401 '<name>' imported but unused  https://review.openstack.org/24154709:37
*** rossella_s has quit IRC09:37
*** peterstac has joined #openstack-infra09:37
eliqiaofor example, for this template ,  https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/magnum.yaml#L16  , I get this localrc on gate http://logs.openstack.org/21/232421/31/check/gate-functional-dsvm-magnum/c0048ee/logs/localrc.txt.gz09:38
*** rossella_s has joined #openstack-infra09:38
kun_huangeliqiao: dunno ;(09:38
*** hashar has joined #openstack-infra09:38
eliqiao kun_huang: okay , thanks man!09:39
*** salv-orlando has joined #openstack-infra09:39
*** fhubik_brb is now known as fhubik09:39
*** garyk1 has joined #openstack-infra09:41
garyk1is there any chance on getting a few eyes on https://review.openstack.org/#/c/239863/109:41
garyk1the neutron gate is currently broken due to lbass v1 and it is deprecated...09:41
openstackgerritDaniel Watkins proposed openstack-infra/jenkins-job-builder: useMatrixChild support in parameterized trigger  https://review.openstack.org/23545209:42
AJaegergaryk1: so, then the change shouldn't go in ;)09:43
AJaegergaryk1: looking at the change it says " we get enough coverage in the project repo" - which apparently is not true...09:43
*** heyongli has quit IRC09:44
dougwigAJaeger: i should rephrase that as "we can tolerate short breakages of master in neutron-lbaas, it's not worth a co-gate". still looking into why this job is broken now.09:44
AJaegerdougwig: ;)09:45
*** jyuso has quit IRC09:45
*** heyongli has joined #openstack-infra09:45
AJaegergaryk1, dougwig: gave a +209:46
garyk1AJaeger: gracias!09:46
*** ParsectiX has quit IRC09:48
*** rguillebert has joined #openstack-infra09:48
*** aopincar has quit IRC09:49
*** gildub has joined #openstack-infra09:49
*** salv-orlando has quit IRC09:50
*** jgriffith has quit IRC09:50
*** salv-orlando has joined #openstack-infra09:51
*** AJaeger has quit IRC09:51
*** jgriffith has joined #openstack-infra09:51
*** jgriffith is now known as Guest9024209:51
*** laurelm has quit IRC09:52
*** dvlwrk_ has quit IRC09:54
*** Liuqing has quit IRC09:54
*** alex_xu has quit IRC09:54
*** kutija_ has joined #openstack-infra09:54
*** heyongli has quit IRC09:54
*** jamielennox|away is now known as jamielennox09:55
*** derekh has joined #openstack-infra09:55
*** heyongli has joined #openstack-infra09:55
*** someara2 has quit IRC09:57
*** alex_xu has joined #openstack-infra09:57
*** laurelm has joined #openstack-infra09:57
*** someara2 has joined #openstack-infra09:57
derekhHow do I poke this to merge, as the A+ was received before the depends on merged https://review.openstack.org/#/c/235321/09:57
*** kutija has quit IRC09:57
eliqiao derekh: reverify09:58
eliqiaoderekh: not sure ..09:58
derekheliqiao: thanks, will try it09:58
eliqiaoderekh:  np.09:58
*** yfried is now known as yfried|afk10:00
*** someara2 has quit IRC10:01
*** romcheg has left #openstack-infra10:03
*** zhenguo has quit IRC10:03
*** heyongli has quit IRC10:05
*** yfried|afk is now known as yfried10:05
*** heyongli has joined #openstack-infra10:06
openstackgerritDaniel Watkins proposed openstack-infra/jenkins-job-builder: useMatrixChild support in parameterized trigger  https://review.openstack.org/23545210:06
*** ddietery has joined #openstack-infra10:10
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: pep8: F401 '<name>' imported but unused  https://review.openstack.org/24154710:11
*** samueldmq has quit IRC10:13
openstackgerritMerged openstack-infra/project-config: add template for release notes jobs  https://review.openstack.org/24134310:14
*** ddietery has quit IRC10:14
*** heyongli has quit IRC10:15
*** samueldmq has joined #openstack-infra10:15
*** ParsectiX has joined #openstack-infra10:16
*** heyongli has joined #openstack-infra10:16
*** glauco_ has joined #openstack-infra10:16
*** Liuqing has joined #openstack-infra10:18
*** fabo has quit IRC10:19
*** fabo has joined #openstack-infra10:19
*** fedexo has quit IRC10:19
*** alex_xu has quit IRC10:23
*** ParsectiX has quit IRC10:24
*** alex_xu has joined #openstack-infra10:24
*** dolpher has quit IRC10:24
*** heyongli has quit IRC10:25
*** heyongli has joined #openstack-infra10:26
*** weshay_afk has quit IRC10:27
*** weshay_afk has joined #openstack-infra10:29
*** ifarkas has quit IRC10:29
*** HeOS has quit IRC10:30
*** [HeOS] has joined #openstack-infra10:30
*** yfried is now known as yfried|afk10:31
*** heyongli has quit IRC10:35
mohankumarcould any help me with jenkins error  :  https://review.openstack.org/#/c/237896/10:36
*** heyongli has joined #openstack-infra10:36
*** gildub has quit IRC10:37
mohankumarFrom logs i not getting anything :(10:37
*** salv-orlando has quit IRC10:37
*** electrofelix has joined #openstack-infra10:38
*** yfried|afk is now known as yfried10:39
*** ParsectiX has joined #openstack-infra10:39
*** [HeOS] has quit IRC10:41
*** ParsectiX has quit IRC10:41
*** ParsectiX has joined #openstack-infra10:42
*** pavel_bondar has joined #openstack-infra10:42
*** otter768 has joined #openstack-infra10:43
*** ldnunes has joined #openstack-infra10:44
*** dvlwrk_ has joined #openstack-infra10:44
*** FallenPegasus has joined #openstack-infra10:44
*** fhubik is now known as fhubik_brb10:45
*** heyongli has quit IRC10:46
*** mcdonagm has joined #openstack-infra10:46
*** mcdonagm has quit IRC10:47
*** mfmcdonagh has quit IRC10:47
*** heyongli has joined #openstack-infra10:47
*** pblaho_ has joined #openstack-infra10:47
*** otter768 has quit IRC10:48
*** jistr_ has joined #openstack-infra10:48
*** ihrachys_ has joined #openstack-infra10:48
*** markmcd has joined #openstack-infra10:48
*** markmcd has joined #openstack-infra10:48
*** jistr has quit IRC10:48
*** iammarkmcd has joined #openstack-infra10:48
*** ihrachys has quit IRC10:48
*** FallenPegasus has quit IRC10:48
*** fhubik_brb has quit IRC10:49
*** ihrachys has joined #openstack-infra10:49
*** iammarkmcd has quit IRC10:50
*** markmcd has quit IRC10:50
*** khomkrit has joined #openstack-infra10:50
*** markmcd has joined #openstack-infra10:50
*** markmcd1 has joined #openstack-infra10:50
*** markmcd1 has left #openstack-infra10:51
*** pblaho has quit IRC10:51
*** daemontool has quit IRC10:51
*** pblaho_ has quit IRC10:52
*** jistr_ has quit IRC10:53
*** ihrachys_ has quit IRC10:53
*** Kennan has quit IRC10:53
*** heyongli has quit IRC10:56
*** Kennan has joined #openstack-infra10:56
*** heyongli has joined #openstack-infra10:57
*** yfried is now known as yfried|afk11:01
*** yfried|afk is now known as yfried11:02
*** markvoelker has joined #openstack-infra11:02
*** pc_m has joined #openstack-infra11:03
*** jistr_ has joined #openstack-infra11:05
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: Add instructions and dependencies for running tests  https://review.openstack.org/23463711:05
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: Fix the tests by removing dependency on alfajor  https://review.openstack.org/24156811:05
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: Ignore the virtualenv folder and Eclipse's settings files.  https://review.openstack.org/24156911:05
*** markvoelker has quit IRC11:06
*** heyongli has quit IRC11:06
*** heyongli has joined #openstack-infra11:07
*** Guest42311 has quit IRC11:08
*** ddietery has joined #openstack-infra11:10
*** ddietery has quit IRC11:15
*** heyongli has quit IRC11:16
*** heyongli has joined #openstack-infra11:17
*** weshay_afk has quit IRC11:18
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Fix SubscriptionEvents not making it into the database  https://review.openstack.org/24030111:18
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Single event email worker.  https://review.openstack.org/24034611:18
*** weshay_afk has joined #openstack-infra11:20
*** binbincong has joined #openstack-infra11:20
*** yfried is now known as yfried|afk11:23
*** heyongli has quit IRC11:27
*** heyongli has joined #openstack-infra11:27
*** yfried|afk is now known as yfried11:28
*** peterlisak13 has joined #openstack-infra11:30
*** peterlisak has quit IRC11:30
samueldmqandreaf: are you around ? I'd like to have you your view on https://review.openstack.org/#/c/24145011:34
samueldmqanteaya: it's replacing 2 jobs that intended to test identity v3 by a third job we created some time ago, which disables v2 and is now passing11:35
samueldmqanteaya: morning, sorry this message was to andreaf :)11:36
*** heyongli has quit IRC11:37
*** pblaho has joined #openstack-infra11:37
*** heyongli has joined #openstack-infra11:38
*** mbalhest has joined #openstack-infra11:39
*** mbalhest is now known as maiteb11:39
*** mwagner has quit IRC11:40
*** salv-orlando has joined #openstack-infra11:41
*** aysyd has joined #openstack-infra11:45
openstackgerritDerek Higgins proposed openstack-infra/project-config: Add stable/liberty tripleo job  https://review.openstack.org/24093811:45
*** salv-orlando has quit IRC11:46
*** heyongli has quit IRC11:47
*** heyongli has joined #openstack-infra11:48
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Remove force build of tripleo-puppet-elements  https://review.openstack.org/24141111:50
*** ayoung has quit IRC11:50
*** Kennan has quit IRC11:51
*** dvlwrk_ has quit IRC11:53
*** k4n0 has quit IRC11:54
*** Kennan has joined #openstack-infra11:54
derekheliqiao: the reverify doesn't seem to have worked11:54
derekhAnybody else know how I might poke this to merge, as the A+ was received before the depends on merged https://review.openstack.org/#/c/235321/11:54
*** sshnaidm has joined #openstack-infra11:55
*** jaypipes has joined #openstack-infra11:55
*** ddietery has joined #openstack-infra11:57
*** heyongli has quit IRC11:57
*** hashar has quit IRC11:58
*** heyongli has joined #openstack-infra11:58
*** markus_z has quit IRC11:59
*** tdurakov_ has joined #openstack-infra11:59
*** thorst has joined #openstack-infra12:00
*** yfried is now known as yfried|afk12:01
*** yfried|afk is now known as yfried12:01
*** rfolco has joined #openstack-infra12:01
*** ayoung has joined #openstack-infra12:03
*** weshay_afk has quit IRC12:03
*** daemontool has joined #openstack-infra12:04
*** tdurakov_ has quit IRC12:04
*** thorst has quit IRC12:04
*** tdurakov_ has joined #openstack-infra12:04
*** tdurakov_ has quit IRC12:04
*** salv-orlando has joined #openstack-infra12:07
*** dramalho has joined #openstack-infra12:07
*** heyongli has quit IRC12:08
*** ericksonsantos has quit IRC12:08
*** hashar has joined #openstack-infra12:08
*** heyongli has joined #openstack-infra12:08
*** ericksonsantos has joined #openstack-infra12:09
*** glauco_ has quit IRC12:09
*** glauco has joined #openstack-infra12:09
pavel_bondarHi, wanted to check if I got things correctly. I want to add dependency 'infoblox-client' for neutron sub-project 'networking-infoblox'. To do that I need to add 'infoblox-client' package to global-requirements.txt in openstack/requirements and have it in requirements in 'networking-infoblox'. Is it correct?12:13
*** mahatic_ has joined #openstack-infra12:13
*** mahatic has quit IRC12:14
openstackgerrityolanda.robla proposed openstack-infra/puppet-infracloud: Add bifrost manifest  https://review.openstack.org/23175712:17
*** markvoelker has joined #openstack-infra12:17
*** dims has joined #openstack-infra12:18
*** placko has joined #openstack-infra12:18
*** heyongli has quit IRC12:18
*** heyongli has joined #openstack-infra12:19
*** ifarkas has joined #openstack-infra12:20
*** pblaho has quit IRC12:21
garyk1anteaya: you around?12:21
*** Kennan has quit IRC12:22
*** yfried has quit IRC12:22
*** markvoelker has quit IRC12:22
*** thorst has joined #openstack-infra12:23
*** Kennan has joined #openstack-infra12:25
*** yfried has joined #openstack-infra12:26
*** yfried has quit IRC12:27
*** heyongli has quit IRC12:28
*** mohankumar has quit IRC12:28
*** smarcet has joined #openstack-infra12:29
*** someara2 has joined #openstack-infra12:29
*** heyongli has joined #openstack-infra12:29
*** gordc has joined #openstack-infra12:30
*** ifarkas has quit IRC12:31
*** FallenPegasus has joined #openstack-infra12:32
openstackgerrityolanda.robla proposed openstack-infra/puppet-infracloud: Add bifrost manifest  https://review.openstack.org/23175712:35
*** yfried has joined #openstack-infra12:36
*** FallenPegasus has quit IRC12:37
*** mahatic__ has joined #openstack-infra12:38
*** glauco__ has joined #openstack-infra12:38
*** heyongli has quit IRC12:38
*** heyongli has joined #openstack-infra12:39
*** achanda has joined #openstack-infra12:40
*** mahatic_ has quit IRC12:41
*** glauco has quit IRC12:41
*** achanda has quit IRC12:42
*** ifarkas has joined #openstack-infra12:42
*** binbincong has quit IRC12:43
*** dims has quit IRC12:43
*** chlong has joined #openstack-infra12:43
*** jistr_ is now known as jistr12:44
*** otter768 has joined #openstack-infra12:44
*** pblaho_ has joined #openstack-infra12:45
*** ominakov has joined #openstack-infra12:47
*** ominakov has quit IRC12:48
*** jamielennox is now known as jamielennox|away12:48
*** heyongli has quit IRC12:49
*** otter768 has quit IRC12:49
*** cody-somerville has joined #openstack-infra12:49
*** heyongli has joined #openstack-infra12:49
openstackgerritMonty Taylor proposed openstack-infra/project-config: Add pep8 jobs for requestsexceptions  https://review.openstack.org/24158412:51
*** weshay_xchat has joined #openstack-infra12:52
*** weshay_xchat is now known as weshay12:52
*** baoli has joined #openstack-infra12:53
openstackgerritMerged openstack-infra/requestsexceptions: Add tox.ini and .gitignore  https://review.openstack.org/24142312:53
*** baoli has quit IRC12:53
*** fhubik_brb has joined #openstack-infra12:54
*** binbincong has joined #openstack-infra12:55
*** baoli has joined #openstack-infra12:56
*** daemontool has quit IRC12:57
openstackgerritMonty Taylor proposed openstack-infra/requestsexceptions: Fix typos  https://review.openstack.org/24143012:57
openstackgerritMonty Taylor proposed openstack-infra/requestsexceptions: Add flake8 to test-requirements  https://review.openstack.org/24158712:57
*** ihrachys has quit IRC12:57
*** daemontool has joined #openstack-infra12:57
*** ihrachys has joined #openstack-infra12:58
*** nmagnezi has joined #openstack-infra12:58
*** heyongli has quit IRC12:59
*** jlanoux has joined #openstack-infra13:00
*** niska` has quit IRC13:00
*** heyongli has joined #openstack-infra13:00
*** ihrachys has quit IRC13:00
*** yfried is now known as yfried|afk13:00
*** niedbalski has quit IRC13:01
*** chlong has quit IRC13:01
*** gongysh_ has joined #openstack-infra13:02
*** chlong has joined #openstack-infra13:02
*** yfried|afk is now known as yfried13:02
*** dvlwrk_ has joined #openstack-infra13:04
*** dolpher has joined #openstack-infra13:05
*** dkranz has joined #openstack-infra13:07
*** dprince has joined #openstack-infra13:09
*** dims has joined #openstack-infra13:09
*** heyongli has quit IRC13:09
*** hashar has quit IRC13:09
*** heyongli has joined #openstack-infra13:10
openstackgerritMerged openstack-infra/irc-meetings: Add nova notification subteam meeting  https://review.openstack.org/24154613:11
*** kgiusti has joined #openstack-infra13:14
*** mwagner has joined #openstack-infra13:16
*** pblaho_ has quit IRC13:17
*** yamamoto has joined #openstack-infra13:17
*** pblaho has joined #openstack-infra13:17
*** tdurakov_ has joined #openstack-infra13:17
*** tlian has joined #openstack-infra13:17
*** hashar has joined #openstack-infra13:18
*** salv-orlando has quit IRC13:19
*** heyongli has quit IRC13:19
*** dims has quit IRC13:20
*** heyongli has joined #openstack-infra13:20
*** hashar has quit IRC13:21
*** inteq has quit IRC13:23
*** markvoelker has joined #openstack-infra13:23
*** baoli_ has joined #openstack-infra13:23
*** nadya has joined #openstack-infra13:25
*** niedbalski_ has joined #openstack-infra13:25
*** baoli has quit IRC13:26
*** niedbalski_ is now known as niedbalski13:26
*** hashar has joined #openstack-infra13:26
*** niedbalski has quit IRC13:26
*** niedbalski has joined #openstack-infra13:26
*** Liuqing_ has joined #openstack-infra13:28
*** heyongli has quit IRC13:30
*** hashar has quit IRC13:31
*** heyongli has joined #openstack-infra13:31
*** Liuqing has quit IRC13:31
*** edmondsw has joined #openstack-infra13:34
*** markus_z has joined #openstack-infra13:35
*** rossella_s has quit IRC13:37
*** rossella_s has joined #openstack-infra13:38
openstackgerritMerged openstack-infra/shade: Add new context manager for shade exceptions  https://review.openstack.org/24138513:39
openstackgerritMerged openstack-infra/shade: Skip an extra unneeded server get  https://review.openstack.org/24068713:39
openstackgerritMerged openstack-infra/shade: Don't wrap wrapped exception in create_server  https://review.openstack.org/24068813:39
*** heyongli has quit IRC13:40
*** links has quit IRC13:41
*** heyongli has joined #openstack-infra13:41
*** dvlwrk_ has quit IRC13:43
*** salv-orlando has joined #openstack-infra13:43
*** hashar has joined #openstack-infra13:44
*** dolpher has quit IRC13:44
*** ddietery has quit IRC13:45
andreafsamueldmq: looking13:45
*** fhubik_brb is now known as fhubik13:47
*** tdurakov_ has quit IRC13:49
*** spzala has joined #openstack-infra13:50
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API  https://review.openstack.org/22196413:50
*** heyongli has quit IRC13:50
*** hashar has quit IRC13:50
*** heyongli has joined #openstack-infra13:51
*** hashar has joined #openstack-infra13:51
*** dolpher has joined #openstack-infra13:51
*** dolpher has quit IRC13:51
andreafsamueldmq: +1 on both13:52
*** dolpher has joined #openstack-infra13:54
*** hashar has quit IRC13:54
*** Sree has joined #openstack-infra13:55
*** ad_rien_ has quit IRC13:55
*** ad_rien_ has joined #openstack-infra13:55
*** hashar has joined #openstack-infra13:56
*** yamamoto has quit IRC13:56
*** peristeri has joined #openstack-infra13:56
*** sergmelikyan has joined #openstack-infra13:56
*** julim has joined #openstack-infra13:56
*** salv-orlando has quit IRC13:58
*** sigmavirus24_awa is now known as sigmavirus2414:00
*** heyongli has quit IRC14:00
*** heyongli has joined #openstack-infra14:01
*** mriedem has joined #openstack-infra14:02
*** Piet has quit IRC14:02
*** xyang1 has joined #openstack-infra14:02
*** burgerk has joined #openstack-infra14:03
*** yamamoto has joined #openstack-infra14:03
*** hashar has quit IRC14:04
*** dolpher has quit IRC14:04
*** ParsectiX has quit IRC14:05
*** otter768 has joined #openstack-infra14:06
*** bltavares has quit IRC14:06
*** otter768 has quit IRC14:07
*** bltavares has joined #openstack-infra14:07
*** fhubik is now known as fhubik_brb14:07
*** fhubik_brb is now known as fhubik14:07
*** otter768 has joined #openstack-infra14:08
*** rlandy has joined #openstack-infra14:09
*** samuelBartel has quit IRC14:10
*** jsavak has joined #openstack-infra14:10
*** heyongli has quit IRC14:11
*** mriedem has quit IRC14:11
openstackgerritMerged openstack-infra/project-config: Add graphite.o.o datasource for grafana.o.o  https://review.openstack.org/23824214:11
*** heyongli has joined #openstack-infra14:11
*** bltavares has quit IRC14:11
*** otter768 has quit IRC14:12
openstackgerritMerged openstack-infra/project-config: Fix oslo.messaging amqp1 dsvm to run only on fedora-21  https://review.openstack.org/24123614:14
*** mriedem has joined #openstack-infra14:14
openstackgerritMerged openstack-infra/project-config: puppet/integration: run puppet macro before  https://review.openstack.org/24132914:14
*** hashar has joined #openstack-infra14:15
*** mohankumar has joined #openstack-infra14:15
*** bltavares has joined #openstack-infra14:15
*** links has joined #openstack-infra14:17
samueldmqandreaf: great thanks!14:18
*** burgerk has quit IRC14:19
samueldmqandreaf: BTW, where can I see the results of periodic gates (thse in periodic-qa) ?14:20
*** FallenPegasus has joined #openstack-infra14:20
*** krtaylor has quit IRC14:20
*** amitgandhinz has joined #openstack-infra14:21
*** heyongli has quit IRC14:21
garyk1anteaya: you around14:21
*** heyongli has joined #openstack-infra14:22
samueldmqandreaf: I kept one there because the previous v3 jobs were there already - I think you added them there, so I am just trying to understand how the results can be seen14:23
*** alivigni has joined #openstack-infra14:23
*** Sree has quit IRC14:23
*** FallenPegasus has quit IRC14:25
*** markus_z has quit IRC14:27
*** rlandy has quit IRC14:27
*** mhu has joined #openstack-infra14:29
*** tiswanso has joined #openstack-infra14:30
pabelangeryolanda: thanks!14:30
pabelangeralso: Woah14:30
*** mohankumar has quit IRC14:30
pabelangerhttp://grafana.openstack.org/dashboard/db/zuul-status14:30
yolandaoh nice!14:31
*** mohankumar has joined #openstack-infra14:31
yolandawhat does this ratings on check, gate, etc.. mean?14:31
*** heyongli has quit IRC14:31
*** alivigni has quit IRC14:31
pabelangeryolanda: just totals14:32
*** heyongli has joined #openstack-infra14:32
pabelangerhowever, they are slightly different then current status page14:32
yolanda5.1 jobs only in gate?14:32
pabelangerneed to figure out why14:32
yolandai thought it was some median14:32
rcarrillocruzpabelanger: hey, was not able to get back to you yesterday14:32
rcarrillocruzre: pip14:32
pabelangershould be yes14:32
rcarrillocruzthat change was to make puppet-pip to install pip14:32
yolandapabelanger what does the .1 mean?14:33
rcarrillocruzcos well...it wasn't doing that14:33
pabelangeryolanda: Right, I think it is using median values14:33
*** krtaylor has joined #openstack-infra14:33
openstackgerritMerged openstack-infra/project-config: Add pep8 jobs for requestsexceptions  https://review.openstack.org/24158414:33
rcarrillocruzdownstream users required to run install_puppet to get pip installed, which goes against the whole puppet refactor of being able to reuse modules without system-config14:33
pabelangeryolanda: so need to update the calculation14:33
openstackgerritMerged openstack-infra/project-config: Make Identity API v3 only job default  https://review.openstack.org/24145014:33
openstackgerritMerged openstack-infra/project-config: Remove lbaas v1 job from neutron, remove v2 from neutron gate  https://review.openstack.org/23986314:33
rcarrillocruzwhat is that issue you found? is that on machines with python 2.6 ?14:33
openstackgerritMerged openstack-infra/project-config: Add merge notifications for Cinder channel  https://review.openstack.org/24143514:33
yolandapabelanger, it would be nice to have some more detailed explanation about these values14:34
pabelangeryolanda: https://github.com/openstack-infra/project-config/blob/master/grafana/zuul-status.yaml#L2114:34
*** ihrachys has joined #openstack-infra14:34
openstackgerritMerged openstack-infra/project-config: Run only volume related tests in tempest-dsvm-full-bdd job  https://review.openstack.org/23215514:34
openstackgerritMerged openstack-infra/project-config: Ability to test oslo master libraries against liberty services  https://review.openstack.org/24089914:34
pabelangeryolanda: agreed. For the most part, this was copied from: http://status.openstack.org/zuul/14:34
*** regXboi has joined #openstack-infra14:35
pabelangerrcarrillocruz: pbx.o.o had pip installed via yum, so when your code running, because you don't pass -U flag, the code return success, even though /usr/local/bin/pip is not created14:35
yolandayes, just the number looks confusing14:35
rcarrillocruzmordred: re: puppet apply pushing reports/facts back to puppetdb. I started looking into putting that into ansible, but then came across https://docs.puppetlabs.com/puppetdb/latest/connect_puppet_apply.html14:36
*** alivigni has joined #openstack-infra14:36
pabelangeryolanda: Ya, work in progress. Now that it is actually working, I'm planning on tweaking it more14:36
yolanda++14:36
rcarrillocruzhttps://review.openstack.org/#/c/240446/4/library/puppet_post_puppetdb is for having that regardless on how you configure puppet.conf ?14:36
rcarrillocruzpabelanger: oh, is there a patch up for doing -U already?14:36
rcarrillocruzi can do that if not14:36
pabelangerrcarrillocruz: no, I wanted to discuss it.  But, as the current code is, if pip is already installed, that code will not upgrade it14:37
pabelangernot sure if that is what you want or not14:37
rcarrillocruzhmm, not sure, to be honest the original patch was for new bootstraps, i never thought about the upgrade14:39
*** rlandy has joined #openstack-infra14:39
fungii didn't think we explicitly installed pip in any of our modules14:40
fungiit's just a (probably poorly documented) bootstrapping prerequisite for many of our modules14:40
rcarrillocruzyeah, cos pip was coming out of install_puppet14:40
rcarrillocruzso was never really needed to do that via puppet modules14:41
pabelangerI mean, we could just run the code manually. But wanted to see how it was going to work with existing nodes14:41
*** jsavak has quit IRC14:41
openstackgerritMerged openstack-infra/project-config: Add kolla-mesos to kolla  https://review.openstack.org/24043314:41
fungiright, if there's a puppety way we can retrieve and run the get-pip script after making sure any distro packages of it have been removed, then that's something we could probably accept14:41
*** pradk has joined #openstack-infra14:41
*** jsavak has joined #openstack-infra14:41
*** heyongli has quit IRC14:41
yolandafungi, that's on place now, pip module is doing that14:42
fungioh, cool14:42
*** pradk_ has joined #openstack-infra14:42
yolandathe "making sure any distro packages are removed" step is missing14:42
*** pradk has quit IRC14:42
fungiyeah, that's critical14:42
*** pradk_ is now known as pradk14:42
*** heyongli has joined #openstack-infra14:43
fungiwe can't rely on it unless that happens first14:43
fungisince some of our providers give us base images with a python-pip distro package preinstalled14:43
yolandaok, this needs to be amended, some ensure absent needed14:44
fungiand installing non-distro-packaged pip on a system with distro-packaged pip is a ticking time bomb14:44
rcarrillocruz++14:44
rcarrillocruzit was one of the suggestions inm the change, to install pip with get-pip14:45
*** mohankumar has quit IRC14:45
rcarrillocruzi'm surprised some system has it via distro package14:45
*** Swami has joined #openstack-infra14:45
*** mohankumar has joined #openstack-infra14:46
fungii don't think it necessarily does14:46
*** Swami_ has joined #openstack-infra14:47
*** openstackgerrit has quit IRC14:47
*** openstackgerrit has joined #openstack-infra14:47
fungiahh, yep it does. looks like epel has python-pip 7.1.014:48
fungithat's a lot newer than i expected for centos 614:48
*** Swami__ has joined #openstack-infra14:48
*** Swami__ has quit IRC14:49
*** Swami_ has quit IRC14:49
*** trown is now known as trown|brb14:49
*** Swami_ has joined #openstack-infra14:49
*** Swami has quit IRC14:49
fungipart of the problem is that, at least previously, pip-installed pip on centos ends in in /usr/bin rather than /usr/local/bin and so it and the rpm will continue to step on one another (and sometimes completely break pip working at all)14:49
fungiwhich is one of the reasons we try to uninstall it completely14:50
fungiyum remove claims there are no other packages depending on it, so should be safe to remove and then run the get-pip script14:51
*** dramalho has quit IRC14:51
*** heyongli has quit IRC14:52
fungiprobably pbx.o.o just predates our being thorough/consistent about how and from where we get our pip packages14:52
fungiit's not been refreshed in over 2 years14:52
*** heyongli has joined #openstack-infra14:53
*** trown|brb is now known as trown14:53
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: Add instructions and dependencies for running tests  https://review.openstack.org/23463714:53
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: Fix the tests by removing dependency on alfajor  https://review.openstack.org/24156814:53
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: Make test_json_get_styles work cross-platform  https://review.openstack.org/24162714:53
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: Ignore the virtualenv folder and Eclipse's settings files.  https://review.openstack.org/24156914:53
yolandafungi, i can do it14:55
yolandaso we get a puppetdb without errors :)14:55
EmilienMI have a question about our zuul config, yesterday I did https://review.openstack.org/#/c/241014/ - Puppet ran on Zuul nodes - but the jobs are still running, see https://review.openstack.org/#/c/240998/14:55
*** mriedem is now known as mriedem_meeting14:56
*** links has quit IRC14:56
fungiyolanda: thanks!14:56
*** salv-orlando has joined #openstack-infra14:56
*** gongysh_ has quit IRC14:57
mordredfungi: ++14:57
mordredrcarrillocruz: hey - I already have that coded14:57
mordredrcarrillocruz: please do not look in to writing it :)14:57
pabelangerEmilienM: if you upload a new patch, what happens?14:58
pabelangerEmilienM: vs recheck14:58
EmilienMpabelanger: a new one you mean?14:58
EmilienMpabelanger: let me try!14:58
pabelangerEmilienM: Ya, like update commit message or something14:58
EmilienMpabelanger: I ran recheck already14:58
EmilienMbut let me try with a new one14:58
mordredrcarrillocruz: https://review.openstack.org/#/q/status:open+branch:master+topic:puppet-apply,n,z14:58
mordredrcarrillocruz: the change from Hunter produces the reports in teh right format, the change from me fetches them post apply and posts them to puppetdb14:59
*** kushal has joined #openstack-infra14:59
*** aukhan has quit IRC15:00
EmilienMpabelanger: does not work, look 241629 in Zuul15:00
EmilienMit's a new patch15:00
mordredrcarrillocruz: we're not doing connect_puppet_apply because that requires distributing SSL certs to all of our nodes15:00
mordredwhich we decided we do not want to do15:00
EmilienMpabelanger: and it will run beaker jobs while I'm asking to not doing that15:00
EmilienMpabelanger: something wrong in https://review.openstack.org/#/c/241014/2/zuul/layout.yaml,cm ?15:00
pabelangerEmilienM: checking your patchj15:00
derekhAnybody know how I might poke this to merge, as the A+ was received before the depends on merged https://review.openstack.org/#/c/235321/15:01
mordredrcarrillocruz: however, if you want to help test the three patches that are up - I think that was next on nibalizer and my list of things to do - and I'm fighting a weird os-client-config patch at the moment15:01
mordreddhellmann: is there a way to get cliff to not swallow all of the exceptions for things that happen in command initialization?15:02
*** heyongli has quit IRC15:02
*** bcourt has quit IRC15:02
*** otter768 has joined #openstack-infra15:02
rcarrillocruzmordred: apparently that can be circumvented by having a reverse ssl proxy in front on the puppetdb, i wanted to test that out if that works15:02
mordredrcarrillocruz: yeah - but we've got all of the code written to do this without having nodes talk to puppetdb15:03
*** heyongli has joined #openstack-infra15:03
yolandamm, something not working in the install method for pbx, puppet pip not installing properly15:03
*** nadya has quit IRC15:05
*** burgerk has joined #openstack-infra15:06
openstackgerritDavid Pursehouse proposed openstack-infra/requestsexceptions: Fix incorrect indentation  https://review.openstack.org/24163315:09
*** dzamboni has joined #openstack-infra15:09
*** yamamoto has quit IRC15:10
rcarrillocruzmordred: ok, was not even aware of that groundwork :(. Anyway, i'm happy the ansible module do its thing without requiring special config on puppet agent side15:10
*** otter768 has quit IRC15:12
*** heyongli has quit IRC15:12
*** heyongli has joined #openstack-infra15:13
yolandaok working. Actually pbx looked broken for long time15:13
*** signed8bit has joined #openstack-infra15:13
yolandai had to create a symlink as done in our install puppet script15:14
rcarrillocruzyolanda: still, i should probably push up a change that makes the os package absent15:14
yolanda    ln -fs /usr/bin/pip /usr/bin/pip-python15:14
yolandayep15:14
yolandaand you could create that softlink as well for fedora...15:14
rcarrillocruzwill push in a bit15:14
mordredrcarrillocruz: ++ to making os package absent15:14
yolanda++15:14
mordreddhellmann: or, more specifically, what is the "right" way to tell cliff about an error in argument parsing that should be reported to the user with an error message15:15
EmilienMpabelanger: you need to patch stable/kilo15:15
pabelangerEmilienM: So, I think you might has an order issue with your regex15:15
yolandaoh, amazing puppetdb: 0 nodes with status failed15:15
EmilienMpabelanger: oops :)15:15
pabelangerEmilienM: if my hunch is correct: https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L1772 is overriding your previous settings15:15
*** mohankumar has quit IRC15:16
pabelangerEmilienM: since ^gate-puppet-.*-puppet-beaker-rspec-dsvm-.*$ is a larger regex match then ^gate-puppet-openstack_extras-puppet-beaker-rspec-dsvm-.*$15:16
pabelangerEmilienM: jeblair would need to confirm, but that is the only thing I can see15:16
EmilienMpabelanger: ok, so we need to invert it15:17
pabelangermaybe?15:17
pabelangeronly thing I can see that might cause the issue15:17
pabelangerbut, it is just a guess15:17
EmilienMthanks for looking, pabelanger15:17
*** bcourt has joined #openstack-infra15:18
*** garyk1 has quit IRC15:19
*** aukhan has joined #openstack-infra15:19
*** Piet has joined #openstack-infra15:21
*** samuelBartel has joined #openstack-infra15:21
*** btully has joined #openstack-infra15:22
*** heyongli has quit IRC15:22
*** heyongli has joined #openstack-infra15:24
*** mohankumar has joined #openstack-infra15:24
*** jsavak has quit IRC15:27
*** jsavak has joined #openstack-infra15:28
*** mriedem_meeting is now known as mriedem15:29
EmilienMclarkb, jeblair: when you up, can you tell me if the order is good on https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L1772 ? we figured the jobs are still running on stable/kilo and we don't want that15:29
*** tonytan4ever has joined #openstack-infra15:30
*** ZZelle is now known as ZZelle_away15:31
*** wenlock_ has joined #openstack-infra15:31
*** wenlock has joined #openstack-infra15:31
*** niska has joined #openstack-infra15:31
*** moravec has joined #openstack-infra15:31
*** wenlock has quit IRC15:31
*** wenlock has joined #openstack-infra15:31
*** niska has quit IRC15:31
*** heyongli has quit IRC15:33
*** niska has joined #openstack-infra15:33
openstackgerritDavid Pursehouse proposed openstack-infra/project-config: Add pep8 jobs for lodgeit  https://review.openstack.org/24165315:33
*** heyongli has joined #openstack-infra15:34
*** jsavak has quit IRC15:35
pabelangeryolanda: so, regarding the 5.1 jobs, I am going to round it off to 0 decimals.  Also it does look like the graph on status.o.o/zuul and the value (gate for example) do appear to be different.  It looks they are coming from 2 different datasources15:36
*** mohankumar has quit IRC15:36
pabelangeryolanda: looks like number value goes directly from zuul, where graph is rendered by graphite15:37
pabelangerso, looks like they is some drift15:37
*** sfinucan has joined #openstack-infra15:39
*** mohankumar has joined #openstack-infra15:40
*** jsavak has joined #openstack-infra15:42
*** EricGonczer_ has joined #openstack-infra15:42
*** rhochmuth has joined #openstack-infra15:42
*** heyongli has quit IRC15:43
*** ayoung has quit IRC15:43
*** heyongli has joined #openstack-infra15:44
*** ociuhandu has joined #openstack-infra15:44
sfinucanWould it be possible to get some help resolving a failing gate test?15:45
*** ayoung has joined #openstack-infra15:46
*** jsavak has quit IRC15:46
*** jsavak has joined #openstack-infra15:47
fungisfinucan: usually the best resources to help you with that are the developers on the project(s) being tested15:48
fungisfinucan: have an example failure i can peek at?15:48
openstackgerritBrian Elliott proposed openstack/requirements: Bump oslo.log to 1.10  https://review.openstack.org/24166015:48
sfinucanfungi: It's for the pbr project, which I think is infra-owned?15:48
sfinucanfungi: Sure. https://review.openstack.org/#/c/238970/15:49
*** ociuhandu has quit IRC15:49
sfinucanThe failing job is the 'gate-tempest-dsvm-neutron-src-pbr' one http://logs.openstack.org/70/238970/2/check/gate-tempest-dsvm-neutron-src-pbr/81e3101/15:49
*** hdaniel has joined #openstack-infra15:49
sfinucanIt appears there are 'No hosts matched'15:49
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Fix SubscriptionEvents not making it into the database  https://review.openstack.org/24030115:50
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Single event email worker.  https://review.openstack.org/24034615:50
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Allow boolean preferences  https://review.openstack.org/24166115:50
fungisfinucan: that's just a benign message from ansible, not an error. the important line in the console log is around http://logs.openstack.org/70/238970/2/check/gate-tempest-dsvm-neutron-src-pbr/81e3101/console.html#_2015-11-02_21_59_35_66315:51
fungisfinucan: "ERROR: the main setup script run by this job failed - exit code: 2 [...] please look at the relevant log files to determine the root cause"15:51
hdanielguys, is there a reason for the duplicate commit logs in neutron ? one from Jenkins merge and the second one for the actual commit ?15:51
fungisfinucan: in this case logs/devstacklog.txt.gz15:52
fungihdaniel: that's called git15:52
fungihdaniel: there are no duplicates. there are commits and merge commits tying those commits into the branch15:52
*** dramalho has joined #openstack-infra15:52
sfinucanfungi: Ah, which would mean this presumably http://logs.openstack.org/70/238970/2/check/gate-tempest-dsvm-neutron-src-pbr/81e3101/logs/devstacklog.txt.gz#_2015-11-02_21_59_34_29415:52
*** tongli has joined #openstack-infra15:52
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Add plugin_email_enabled preference by default  https://review.openstack.org/24166515:53
sfinucanSo that's...a broken JJB spec? (JJB?)15:53
*** heyongli has quit IRC15:53
fungisfinucan: i believe someone was working earlier on fixing that, but i don't have the details. it's in the channel log from earlier today15:53
*** dramalho has quit IRC15:53
*** dramalho has joined #openstack-infra15:54
*** heyongli has joined #openstack-infra15:54
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API  https://review.openstack.org/22196415:56
hdanielfungi: I understand the git part. What I'm asking is why jenkins does a merge, instead of a rebase + fast forward ?15:57
fungihdaniel: because then it would have to change the commit, and you would no longer be the committer15:57
*** nadya has joined #openstack-infra15:58
fungialso, if you were to decide to start performing signed commits, it would completely lose your signature since the ci can't have access to your private key15:58
fungiand if you're continually developing on a common local branch, you'd need to reset it because you could no longer pull --ff-only from master15:59
sfinucanfungi: OK, I see the discussion now. I don't think I've the knowledge to fix that though so I just have to play the waiting game? https://storyboard.openstack.org/#!/story/200039615:59
*** tnarg has joined #openstack-infra15:59
*** maishsk has quit IRC15:59
*** matrohon has quit IRC16:00
*** ddieterly has joined #openstack-infra16:00
fungisfinucan: yeah, i expect the pbr devs are actively working on it since it prevents them from being able to land any new changes at the moment16:00
sfinucanfungi: hdaniel: I never understood that RE use of merge over rebase. Good to know16:00
sfinucanfungi: OK, I'll keep an eye on that change. Cheers for the assistance - appreciate it16:01
*** tiswanso has quit IRC16:01
*** mohankumar has quit IRC16:01
fungihdaniel: anyway, if your concern is a cosmetic one (the merge commits are ugly) then use `git log --no-merges` or similar to ignore them16:01
*** tiswanso has joined #openstack-infra16:02
hdanielfungi: yeah, just wanted to make things neater for everyone. 10x anyway :)16:02
*** daemontool has quit IRC16:02
*** peterlisak13 has quit IRC16:02
fungihdaniel: just to be clear, we _used_ to use cherry-pick instead of merge in our ci for some projects, and determined that the problems that creates far outweigh the benefits16:03
openstackgerritmatthew wagoner proposed openstack-infra/shade: Add new context manager for shade exceptions, cont.  https://review.openstack.org/24166716:03
fungi(cherry-pick being functionally equivalent to rebase there)16:03
*** heyongli has quit IRC16:03
*** sridhar_ram has joined #openstack-infra16:04
*** julim has quit IRC16:04
*** timsim has joined #openstack-infra16:04
*** julim has joined #openstack-infra16:05
*** heyongli has joined #openstack-infra16:05
*** mohankumar has joined #openstack-infra16:05
*** ddieterly has quit IRC16:05
hdanielfungi: I see. 10x!16:05
*** Ala has quit IRC16:06
*** maishsk has joined #openstack-infra16:06
*** xiexs has joined #openstack-infra16:06
*** rhochmuth has quit IRC16:08
*** EricGonczer_ has quit IRC16:08
*** ddieterly has joined #openstack-infra16:08
*** garyk has joined #openstack-infra16:08
ddieterlyi'm having trouble running devstack-gate behind corp proxy: sudo -H -E python /opt/stack/new/devstack/files/get-pip.py16:08
*** FallenPegasus has joined #openstack-infra16:09
ddieterlyanyone know how to get around this issue?16:09
*** yamamoto has joined #openstack-infra16:11
*** freesand has joined #openstack-infra16:11
*** tnarg has quit IRC16:13
*** FallenPegasus has quit IRC16:13
*** heyongli has quit IRC16:14
*** zz_gondoi is now known as gondoi16:15
*** heyongli has joined #openstack-infra16:15
fungiddieterly: what error message does it give? i think get-pip.py just attempts to use https to download16:15
xiexsddieterly:you`d better post your error msg into a paste service16:15
*** Liuqing_ has quit IRC16:15
*** peristeri has quit IRC16:15
fungiyeah, for example http://paste.openstack.org/16:16
*** yamamoto has quit IRC16:16
ddieterlyfungi: ok, brb16:17
*** ddieterly has quit IRC16:17
xiexscould anyone help me review a patch? https://review.openstack.org/#/c/233481/16:21
*** trown is now known as trown|brb16:21
*** krtaylor has quit IRC16:21
*** denisra_ has joined #openstack-infra16:22
xiexsand the description of the issue listed in the http://paste.openstack.org/show/477599/, thanks in advance.16:22
*** ajo has quit IRC16:23
*** placko has quit IRC16:24
*** heyongli has quit IRC16:24
*** trown|brb is now known as trown16:24
*** pc_m is now known as pc_m_AWAY16:24
*** ddieterly has joined #openstack-infra16:24
*** denisra has quit IRC16:25
*** heyongli has joined #openstack-infra16:25
ddieterlyxiexs: fungi:http://paste.openstack.org/show/477988/16:25
*** sabeen has joined #openstack-infra16:26
*** ZZelle has joined #openstack-infra16:26
*** mtanino has joined #openstack-infra16:26
*** hemnafk is now known as hemna16:27
*** ajmiller has joined #openstack-infra16:27
openstackgerritMerged openstack-infra/project-config: Add tripleo F22 periodic jobs  https://review.openstack.org/23532116:28
fungiddieterly: is that machine able to reach https://pypi.python.org/simple/pip/ or is the proxy breaking it?16:28
*** ajo has joined #openstack-infra16:28
ddieterlynot sure16:28
anteayagaryk: I am now16:29
fungidstufft: ^ that's an interesting one16:29
openstackgerritMichael Jeanson proposed openstack-infra/jenkins-job-builder: Add 'do-not-fingerprint' to 'copyartifact' builder  https://review.openstack.org/21931216:29
*** garyk has quit IRC16:29
*** dprince has quit IRC16:30
ddieterlyfungi: how did you derive that host from the paste?16:30
openstackgerritRyan Hallisey proposed openstack-infra/tripleo-ci: [WIP] Add Docker job to tripleo CI  https://review.openstack.org/23821216:30
*** sabeen3 has joined #openstack-infra16:30
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Additional fields for singlestat panel  https://review.openstack.org/24167816:31
fungiddieterly: it's what i assume get-pip.py will attempt to reach, though i should reread the script16:31
*** yfried has quit IRC16:31
openstackgerritBrian Elliott proposed openstack/requirements: Bump oslo.log to 1.10  https://review.openstack.org/24166016:32
*** sabeen has quit IRC16:33
ddieterlyfungi: i'm unable to ping pypi.python.org16:33
*** krtaylor has joined #openstack-infra16:34
xiexsddieterly:how did you set your proxy?16:34
fungiddieterly: well, this looks like an https connection being rejected, not icmp ping (which is probably filtered by the same corporate overlords running your web proxy)16:34
*** heyongli has quit IRC16:34
ddieterlyusing the network system setting and setting env vars16:34
*** garyk has joined #openstack-infra16:35
fungialso, yes, as xiexs points out, it looks from the round where it's attempting to get setuptools that the proxy envvars are empty16:35
fungihttp_proxy= https_proxy=16:35
*** heyongli has joined #openstack-infra16:35
ddieterlyi put the env vars in the .bashrc of the root,stack, and jenkins users16:35
*** mohankumar has quit IRC16:36
ddieterlydo i need cntlm?16:36
anteayafungi: might you have a moment to manually allow patches to be offered to compass-install in gerrit?16:37
*** nmagnezi has quit IRC16:37
ddieterlymaybe add en entry to /etc/hosts for pypi.python.org16:37
fungiddieterly: according to devstack's functions-common file, you can set those in your localrc16:38
*** unicell has joined #openstack-infra16:38
fungianteaya: yep, if the former acl and jobs have been restored16:39
anteayafungi: they have offered a patch: https://review.openstack.org/#/c/241410/16:39
anteayayou would like that merged first?16:39
* anteaya reviews16:39
fungianteaya: yeah, it will need to merge first (otherwise i need to recreate their old acl by hand)16:40
*** bpokorny has joined #openstack-infra16:40
fungianteaya: also it looks like that didn't revert the removal of their jobs16:40
ddieterlyfungi: add which to the localrc?16:40
fungiddieterly: http_proxy= https_proxy=16:40
*** unicell1 has quit IRC16:40
ddieterlyah16:40
ddieterlyok, i'll give that a try. thanks.16:41
fungiddieterly: see the comment block in functions-common prior to function export_proxy_variables16:41
*** ddieterly has quit IRC16:41
anteayafungi: yes, I will see if I can dig that up and restore the jobs, saves us waiting for them to be awake again16:41
fungianteaya: yep, looks like that didn't revert the removal of their jobs. i gather from the ml thread that they copied the other project we unretired, which happened before the job removals16:42
*** tiswanso has quit IRC16:42
*** bcourt has quit IRC16:42
fungianteaya: and yes the jobs are necessary, since without those, even if we allow them to propose their head revert change, they won't be able to merge it16:43
*** thorst has quit IRC16:44
*** christiana has joined #openstack-infra16:44
anteayafungi: their jobs weren't removed: http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n959516:44
*** achanda has joined #openstack-infra16:44
hogepodgemordred: what is the link to the shade config for public clouds?16:44
*** heyongli has quit IRC16:44
anteayafungi: and your explaination makes sense, thank you16:45
*** thorst has joined #openstack-infra16:45
fungianteaya: oh, great! now i remember we explicitly skipped removing them since we knew they needed to be unretired16:45
*** sabeen3 has quit IRC16:45
anteayafungi: did we?16:45
anteayaI was chalking that up to forgetting to check16:45
anteayaI'm glad it was foresight then16:45
*** heyongli has joined #openstack-infra16:46
fungianteaya: i think so? or maybe that was just the other project we unretired16:46
*** ifarkas has quit IRC16:46
anteayato be honest I have no idea16:46
fungianteaya: specifically, they're still listed in zuul/layout.yaml?16:46
anteayathat whole space of time was a blur16:46
fungiif so, then should be fine16:46
anteayayes they are still listed16:46
anteayaI'm just really glad nothing broke when we moved it16:46
*** maishsk has quit IRC16:47
fungiahh, yep, looks like stackforge/compass-install and stackforge/networking-bigswitch didn't get removed16:47
fungiso we must have known not to take them out with the others16:47
*** tiswanso has joined #openstack-infra16:48
fungianyway, as soon as that merges, i'll tweak the repo from read-only to active so that manage-projects can restore the acl16:49
anteayaare we precongnisent as a group16:49
anteayathank you16:50
*** Swami_ has quit IRC16:50
*** dprince has joined #openstack-infra16:50
*** r-daneel has joined #openstack-infra16:51
*** thorst_ has joined #openstack-infra16:51
*** abregman has quit IRC16:51
*** hdaniel has quit IRC16:52
mordredhogepodge: http://docs.openstack.org/developer/os-client-config/vendor-support.html16:54
openstackgerritMerged openstack-infra/project-config: Unretire the stackforge/compass-install repo  https://review.openstack.org/24141016:54
*** thorst has quit IRC16:54
hogepodgemordred: ty16:55
*** tongli has quit IRC16:55
*** heyongli has quit IRC16:55
*** daemontool has joined #openstack-infra16:55
*** heyongli has joined #openstack-infra16:56
*** gyee has joined #openstack-infra16:57
*** EricGonczer_ has joined #openstack-infra16:57
*** tongli has joined #openstack-infra16:58
*** sergmelikyan has quit IRC17:00
*** ihrachys has quit IRC17:01
*** sergmelikyan has joined #openstack-infra17:01
anteayaprecognizant17:01
anteayaI had it right the first time and doubted myself17:01
*** jcoufal has quit IRC17:02
*** rhochmuth has joined #openstack-infra17:02
*** tiswanso has quit IRC17:02
*** tiswanso has joined #openstack-infra17:03
*** Hal1 has quit IRC17:03
*** hdd has quit IRC17:04
*** amitgandhinz has quit IRC17:04
*** hashar is now known as hashar-away17:04
*** amitgandhinz has joined #openstack-infra17:04
*** heyongli has quit IRC17:05
*** sabeen has joined #openstack-infra17:05
*** sergmelikyan has quit IRC17:06
*** jlanoux has quit IRC17:06
*** heyongli has joined #openstack-infra17:06
*** bcourt has joined #openstack-infra17:07
*** salv-orlando has quit IRC17:08
*** jistr has quit IRC17:08
mesteryclarkb: Any more ideas on that failed networking-arista release I tried yesterday? (See here http://logs.openstack.org/9c/9cbbd722694ae6b7d2b989338e0afbc731ea1258/release/)17:08
mesteryI don't want to keep spinning new releases and burning release numbers, but I'm at a loss as to why the thing failed :(17:08
*** salv-orlando has joined #openstack-infra17:09
*** tnarg has joined #openstack-infra17:10
openstackgerritSean Dague proposed openstack-infra/project-config: warm pip wheel cache during image build  https://review.openstack.org/24169217:11
krotschecknibalizer: I have a comment on https://review.openstack.org/#/c/238754/3/modules/openstack_project/manifests/mirror.pp - from the spec, I'm interpreting the comment as "The server module has to move to the node defenition", do I have that correct?17:11
sdaguemordred: any idea if ^^^ patch will do what I think17:11
sdaguemy dib / nodepool knowledge is weak here17:11
dstufftfungi: what's this?17:11
*** gondoi is now known as zz_gondoi17:12
fungidstufft: the paste from ddieterly though it turns out they may have been neglecting to correctly set their https_proxy envvar17:12
*** arxcruz has quit IRC17:12
*** bcourt has quit IRC17:12
*** otter768 has joined #openstack-infra17:13
fungithe error elicited from get-pip.py was a little opaque17:14
fungithough i doubt it could be made less so17:14
*** tnarg has quit IRC17:15
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Renamed pypi.<>.openstack.org to mirror.<>.openstack.org  https://review.openstack.org/23875417:15
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Clean up references to old pypi mirror urls.  https://review.openstack.org/23875517:15
*** heyongli has quit IRC17:15
sdaguefungi: though you will probably get it in email as well, because you responded to the thread, I'm curious if you think https://review.openstack.org/241692 will address the issue17:15
openstackgerritmatthew wagoner proposed openstack-infra/shade: Add new context manager for shade exceptions, cont.  https://review.openstack.org/24166717:16
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Added NPM Mirror to Infra  https://review.openstack.org/23561717:16
*** heyongli has joined #openstack-infra17:16
*** shayneburgess has left #openstack-infra17:17
*** otter768 has quit IRC17:17
*** enthurohini has joined #openstack-infra17:18
*** derekh has quit IRC17:18
zaromorning17:19
openstackgerritMark T. Voelker proposed openstack-infra/irc-meetings: Change DefCore from 15:00 to 16:00 UTC  https://review.openstack.org/24169517:20
*** mfalatic has joined #openstack-infra17:20
*** sshnaidm has quit IRC17:21
openstackgerritMichael Jeanson proposed openstack-infra/jenkins-job-builder: Add 'do-not-fingerprint' to 'copyartifact' builder  https://review.openstack.org/21931217:21
zaroclarkb: saw something about jjb problem in scrollback.  what's the issue?17:21
*** sabeen has quit IRC17:21
*** ad_rien_ has quit IRC17:22
*** sabeen has joined #openstack-infra17:22
*** bharathm has joined #openstack-infra17:22
*** ad_rien_ has joined #openstack-infra17:22
*** ddieterly has joined #openstack-infra17:24
*** Hunner has quit IRC17:25
mordredsdague: _maybe_ ?17:25
*** heyongli has quit IRC17:25
fungisdague: i don't know if that alone will solve it, since you mention that we end up building the same version of these things several times. presumably devstack would also need a corresponding adjustment to make use of that cache?17:26
mordredyeah - I think that will make a wheel cache for the root user17:26
sdaguefungi: we're building a couple of things a couple of times17:26
sdagueI don't think at the same version17:26
*** r-daneel has quit IRC17:26
openstackgerritMerged openstack-infra/tripleo-ci: Use SEED_IP to decide if we can ssh to the undercloud  https://review.openstack.org/22361217:26
*** heyongli has joined #openstack-infra17:27
fungisdague: also we probably should cycle through all branches of openstack/requirements that have an upper-constraints.txt file17:27
*** e0ne has quit IRC17:27
*** bcourt has joined #openstack-infra17:27
fungi(which may also solve for grenade)17:27
*** r-daneel has joined #openstack-infra17:27
sdaguefungi: yeh, we'll need that for grenade17:27
sdagueit might be useful to see it work right for master first17:28
sdagueoh, and it looks like the multiple times thing is because of our half assed wheel cache attempt in devstack17:28
fungithat's what i wondered17:28
sdaguewhich is now completely obsoleted by pip having a cache17:28
*** davideagnello has joined #openstack-infra17:28
fungiokay, so it's working against pip's caching now i guess. that sort of makes sense17:29
sdagueyeh17:29
sdagueexcept when we bypass it17:29
*** amitgandhinz has quit IRC17:29
*** Hunner has joined #openstack-infra17:30
*** Hunner has quit IRC17:30
*** Hunner has joined #openstack-infra17:30
*** rebase has joined #openstack-infra17:30
*** Swami has joined #openstack-infra17:30
fungianyway, as for stable branches, i'm not sure why we should plan for an additional iteration of image builds before adding a couple lines to loop over branches, when we know we'll want that anyway17:30
*** amitgandhinz has joined #openstack-infra17:30
mordredfungi: ++17:31
*** ad_rien_ has quit IRC17:31
*** ad_rien_ has joined #openstack-infra17:31
*** garyk has quit IRC17:31
openstackgerritKevin Daniels proposed openstack-infra/jenkins-job-builder: Add support for runscope plugin  https://review.openstack.org/24058517:31
fungii think what i ended up doing in the bindep element was to just use git's ability to stream the contents of a file from an arbitrary ref so that i didn't need to reset (and potentially dirty) the state of the worktree17:32
*** davideagnello has quit IRC17:33
*** doug-fish has joined #openstack-infra17:33
sdaguefungi: ok, I guess I wanted to see it work and drop the times in master before bothering17:33
*** davideagnello has joined #openstack-infra17:34
fungihttp://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/cache-bindep/install.d/50-cache-pkgs#n30 is an example of how to trivally iterate that file for additional branches17:34
openstackgerritMichael Jeanson proposed openstack-infra/jenkins-job-builder: Add matrixOptions to throttle properties module  https://review.openstack.org/24169917:34
fungier, trivially17:34
fungiin this case you just want the inner loop17:34
fungisince upper-constraints.txt is only in one repo17:35
timrcI'm confused by what puppet-ansible represents.  It includes an inventory file called puppet-inventory which seems like it'd be unique to openstack and wouldn't belong in a generic puppet module.17:36
*** heyongli has quit IRC17:36
timrcdynamic inventory file*17:36
fungisdague: the wait time on seeing whether it works is generally a day or more, so adding branch awareness to it means you're extending implementation by at least another day17:36
*** nadya has quit IRC17:36
*** daemontool has quit IRC17:36
*** nadya has joined #openstack-infra17:36
*** heyongli has joined #openstack-infra17:37
fungier, adding branch awareness to it separately that is17:37
timrcWouldn't something like that be better placed in project-config? Or maybe system-config for puppetmaster (as that is the assumption, I think, that is being made as to where that inventory file will live)17:37
*** rossella_s has quit IRC17:37
*** nadya has quit IRC17:38
timrcmordred: ^^17:38
*** rossella_s has joined #openstack-infra17:38
*** wenlock__ has joined #openstack-infra17:39
timrcAnd indeed I already see a lot of ansible stuff defined in system-config/modules/openstack_project/manifests/puppetmaster.pp17:39
openstackgerritSean Dague proposed openstack-infra/project-config: warm pip wheel cache during image build  https://review.openstack.org/24169217:41
sdaguefungi: ok, I still like to have a confirmation before moving forward, but so be it17:41
sdaguemaybe some quick review on that so we can get it in and iterate while still fresh in mind17:41
*** maishsk has joined #openstack-infra17:42
*** jsavak has quit IRC17:42
openstackgerritJohn L. Villalovos proposed openstack-infra/irc-meetings: Replace hyphens with underscores for meeting logs  https://review.openstack.org/24170117:42
jeblairEmilienM, pabelanger, clarkb: all matching job regex matches in zuul are applied in the order in the config file.  so if a job matches both line 1769 and line 1772, the attributes from both will be applied in order.  since the only attribute is 'branch' and it is on both of those jobs, effectively the branch spec on line 1774 (associated with job regex on line 1772) wins if the job matches both.17:42
fungisdague: i'm not strongly opposed to splitting up the implementation, just that the split seems unnecessary and validation is slow since we have to wait for new images each time17:43
*** nelsnelson has quit IRC17:43
*** jsavak has joined #openstack-infra17:43
sdaguefungi: yep, that's fine, I respun it with the loop17:44
sdagueI just tend to work in a different model where I'd like to see the one thing changed affect the world before progressing17:45
*** wenlock__ has quit IRC17:45
*** fedexo has joined #openstack-infra17:46
*** heyongli has quit IRC17:46
*** heyongli has joined #openstack-infra17:47
fungisame, except when the time to test it is a full rotation of the planet17:47
*** ddieterly has quit IRC17:48
*** jsavak has quit IRC17:48
*** jsavak has joined #openstack-infra17:48
*** tonytan4ever has quit IRC17:48
*** nelsnelson has joined #openstack-infra17:48
*** ddieterly has joined #openstack-infra17:49
jlvillaltonyb, https://review.openstack.org/241701  Thing I noticed when I started my meeting as 'ironic-qa' that it creates the directory for the logs as 'ironic_qa'17:49
jlvillalThough in the minutes it does record it as 'ironic-qa'17:49
fungisdague: see comments on both patchsets. optimizations for later if you prefer17:49
EmilienMjeblair: so iiuc, we need to invert the 2 layouts, right?17:50
*** trown is now known as trown|lunch17:50
*** rhochmuth has quit IRC17:50
sdaguefungi: the mktemp -d thing I can whip up right now17:51
sdaguewe don't pass the proxy to other pip calls17:51
sdaguelike the subunit2sql install17:51
*** ddieterl_ has joined #openstack-infra17:51
*** fhubik has quit IRC17:52
*** hdd has joined #openstack-infra17:52
jeblairEmilienM: i think so -- that means that the regex that matches more jobs will run first and set one value, then the regex that matches fewer jobs will run second and override that value.17:52
openstackgerritSean Dague proposed openstack-infra/project-config: warm pip wheel cache during image build  https://review.openstack.org/24169217:52
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Fix keystone domain searching  https://review.openstack.org/24170417:52
*** aukhan has quit IRC17:53
sdaguefungi: I based this on - https://github.com/openstack-infra/project-config/blob/1503ef327817bd42cbf888e773f5639e660169a7/nodepool/elements/cache-devstack/install.d/99-cache-testrepository-db#L28 - so probably making everything proxy aware is another patch17:53
*** EricGonczer_ has quit IRC17:53
*** mahatic_ has joined #openstack-infra17:54
*** ddieterly has quit IRC17:54
openstackgerritEmilien Macchi proposed openstack-infra/project-config: zuul/layout/puppet-openstack_extras: invert matching rules  https://review.openstack.org/24170517:55
EmilienMjeblair: ^17:55
pabelangerjeblair: EmilienM Ya, that's the only thing make sense.17:55
*** nadya has joined #openstack-infra17:56
*** heyongli has quit IRC17:56
*** FallenPegasus has joined #openstack-infra17:57
*** nelsnels_ has joined #openstack-infra17:57
*** heyongli has joined #openstack-infra17:57
*** ddieterl_ has quit IRC17:57
fungisdague: lgtm!17:58
*** mahatic__ has quit IRC17:58
mordredtimrc: so - puppet-inventory is totally a usable thing by people who are not infra17:59
mordredtimrc: however, I do not feel strongly that it should be in that module at all17:59
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Fix keystone domain searching  https://review.openstack.org/24170417:59
*** nelsnelson has quit IRC18:00
*** jsavak has quit IRC18:00
*** mriedem has quit IRC18:00
*** rhochmuth has joined #openstack-infra18:00
*** rhochmuth has quit IRC18:00
*** hdd_ has joined #openstack-infra18:00
*** eliqiao has quit IRC18:00
mordredtimrc: I also aim for us to stop using that inventory real-soon-now18:00
fungisdague: it sounds like someone who cares about being able to build our nodepool diskimages behind a proxy probably needs to make a pass through all these elements and fix that anyway (since sudo without -E sanitizes them out of the environment)18:00
*** ashleighfarnham has joined #openstack-infra18:00
*** ddieterly has joined #openstack-infra18:01
mordredjeblair, fungi: Shrews and I were just talking about API guarantees and not breaking compat - and I'd like to get your opinion on 'breaking' something18:01
sdaguefungi: yeh, this makes it no worse18:01
sdaguejust the same worse18:01
*** FallenPegasus has quit IRC18:01
mordredjeblair, fungi: the guarantee is "we will not break you" - but there is a bug in a method which means it absolutely cannot work for anyone18:01
*** hdd has quit IRC18:01
mordredjeblair, fungi: are you comfortable breaking the api signature of that method since it was physically impossible that anyone used it?18:02
*** pc_m_AWAY is now known as pc_m18:02
mordred(I am, but I wanted to make sure other people were too)18:02
*** unicell1 has joined #openstack-infra18:03
*** FallenPegasus has joined #openstack-infra18:03
Shrewsmordred, fungi, jeblair: to be completely open here, it *is* possible to have used it, but it would have returned incorrect results.18:03
mordredit is also possible to fix the broken method in a way that is also backwards compatible with the old broken method which never worked - but that seems pedantic18:03
*** unicell has quit IRC18:03
*** ddieterly has quit IRC18:03
*** ddieterly has joined #openstack-infra18:04
*** zz_gondoi is now known as gondoi18:04
*** EricGonczer_ has joined #openstack-infra18:04
sdaguefungi: also, as an FYI, here is the corresponding devstack delete code - https://review.openstack.org/#/c/241698/18:04
Shrewsjeblair: fungi: code in question is in https://review.openstack.org/241704  PS1 keeps the backward compatibility, PS2 does not18:06
*** ddieterl_ has joined #openstack-infra18:06
*** ddieterl_ has quit IRC18:06
timrcmordred: Cool.. I'm just trying to wrap my head around all the places touched by ansible and how they all fit together.18:06
*** bharathm has quit IRC18:06
*** heyongli has quit IRC18:07
openstackgerritMatt Riedemann proposed openstack/requirements: Bump python-novaclient to 2.34.0 in upper-constraints  https://review.openstack.org/24170918:07
*** hdd_ has quit IRC18:07
anteayajlvillal: the underscore in the name that is output from the meetbot when you input a name with a hyphen is expected behaviour18:07
*** heyongli has joined #openstack-infra18:08
*** ddieterly has quit IRC18:08
mordredtimrc: so, once we're doing puppet apply18:08
mordredtimrc: then we can move to using the ansible openstack dynamic inventory instead of the puppet dynamic inventory18:08
sdaguemordred: ok, up for approving the potential speed up - https://review.openstack.org/#/c/241692/18:09
mordredtimrc: and the spiderweb of stuff here will be much smaller18:09
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Refactor Panel class  https://review.openstack.org/24171118:09
mordredsdague: how does running the install as root populate the wheel cache in the right place?18:10
*** bharathm has joined #openstack-infra18:10
sdaguemordred: because the cache is per user18:10
mordredsdague: shouldn't that be done as stack or jenkins or something? or am I missing a part of that?18:10
jeblairShrews, mordred: that passes my sniff test :)18:10
mordredjeblair: awesome. thanks18:10
sdaguemordred: http://logs.openstack.org/66/241366/1/check/gate-tempest-dsvm-full/792b544/logs/devstacklog.txt.gz#_2015-11-04_14_54_45_60018:10
mordredsdague: oh - wait - because we sudo pip install in devstack18:10
sdagueyep18:10
mordredsdague: I'm just dumb.18:10
Swamiclarkb: ping18:10
*** mriedem has joined #openstack-infra18:11
mordredsdague: looks great18:11
mordredsdague: you probably also want to do virtually the same patch but for the non-dib images too18:11
anteayaSwami: I haven't seen him so far today, most people get good results from just asking their question18:11
*** ddieterly has joined #openstack-infra18:11
Swamianteaya: The question that I have is, how could one debug the VMs in the gate in their failed state. I have not done this before, wanted to learn to do it for debugging the DVR problems.18:12
anteayafungi: did you manage to toggle the permissions for compass-install? I was going to reply to their email to tell them to submit their other patchset again18:12
anteayaSwami: that is a good question18:13
*** ddieterl_ has joined #openstack-infra18:13
anteayaSwami: have you been reading any of the posted links in my "Learning to Debug the Gate" email thread on the #openstack-dev mailing list?18:13
timrcmordred: So... in puppetmaster.pp there is a cron that uses ansible-playbook -f 1 /etc/ansible/playbooks/restart_jenkins_masters.yaml but then a file block that ensures '/etc/ansible/playbooks' is absent.18:13
timrcmordred: In my best doge, "Much confusion"18:13
Swamianteaya: I might not have read it. Do you have a link18:13
*** jordanP has quit IRC18:14
*** hdd_ has joined #openstack-infra18:14
anteayaSwami: october postings: http://lists.openstack.org/pipermail/openstack-dev/2015-October/077913.html18:14
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for large ops net dealloc timeout failure  https://review.openstack.org/24171318:14
zaroanteaya, clarkb : i'm not too concerned about '//' on review-dev.o.o url.  IIRC it didn't happen when we upgraded to 2.10 on review.o.o18:14
sdaguemordred: how / where does one do that?18:14
Swamianteaya: thanks I will go through it and will pin you if need more information.18:14
anteayaSwami: november postings: http://lists.openstack.org/pipermail/openstack-dev/2015-November/078173.html18:15
*** yfried has joined #openstack-infra18:15
mordredsdague: same repo - in nodepool-scripts - those are what get run on the template hosts for non-dib builds18:15
anteayaSwami: or you can just ask in the channel, but reading the emails gives you a bit of an understanding of the tools and the language18:15
mordredtimrc: oops. that's a bug. it shold be referring to /opt/system-config/production/playbooks18:15
Swamianteaya: thanks a lot and this would help me get started and if I have any hurdles I will ping anyone in the channel.18:15
openstackgerritMerged openstack-infra/project-config: warm pip wheel cache during image build  https://review.openstack.org/24169218:16
anteayaSwami: thank you, or just ask in channel, pinging is not required18:16
Swamianteaya: nice to know.18:16
*** ddieterly has quit IRC18:16
jlvillalanteaya, On the underscore. Agreed expected behavior. My patch was to fix irc-calendar so that it would match up with where meetbot stores the logs.18:17
*** heyongli has quit IRC18:17
*** e0ne has joined #openstack-infra18:17
*** heyongli has joined #openstack-infra18:18
anteayajlvillal: sorry I am not understanding the issue18:19
sdaguemordred: is there anyway reason not to just symlink in the dib script I wrote and run that?18:19
anteayajlvillal: what are you seeing that you feel is incorrect?18:19
jlvillalanteaya, http://eavesdrop.openstack.org/#Ironic_%28Bare_Metal%29_QA_Team_Meeting18:19
jlvillalanteaya, Click on the 'Logs' link18:19
sdagueinstead of rewriting this18:20
jlvillalanteaya, My patch fixes the link that is generated on the eavesdrop page.18:20
anteayajlvillal: click on the logs for the third party meeting: http://eavesdrop.openstack.org/#Third_Party_Meeting18:20
sdagueor do these end up in a radically different place18:20
anteayajlvillal: well it looks like it will break for every other meeting logs18:20
jlvillalanteaya, How?  I'm confused?18:20
*** sabeen has quit IRC18:21
*** ddieterly has joined #openstack-infra18:21
mordredsdague: well, other than me not being sure if symlinks work for nodepool-scripts ... but the main key is that you need to also make sure that one of the existing scripts calls your new script18:21
mordredsdague: since it's a single entrypoint for the nodepool scripts18:21
sdaguemordred: yeh, given that I don't understand the pathing, I'll just copy / paste on this one18:21
anteayajlvillal: meeting_id: third_party : http://git.openstack.org/cgit/openstack-infra/irc-meetings/tree/meetings/third-party-meeting.yaml18:21
jlvillalanteaya, Patch changes hyphens to underscores for the 'meeting_id'?  Only three meetings are currently using hyphens in meeting_id18:22
anteayajlvillal: meeting_id: ironic-qa http://git.openstack.org/cgit/openstack-infra/irc-meetings/tree/meetings/ironic-qa.yaml18:22
*** ddieterl_ has quit IRC18:22
*** ddieter__ has joined #openstack-infra18:22
*** ddieterly has quit IRC18:22
jlvillalanteaya, meeting_id is only used to generate a link to the Logs.18:22
*** mahatic_ has quit IRC18:22
jlvillalanteaya, It does not change any existing underscores.18:23
openstackgerritSean Dague proposed openstack-infra/project-config: add pip cache warming to non dib builder  https://review.openstack.org/24171718:24
sdaguemordred: ok, that I think is the non dib approach18:24
*** trown|lunch is now known as trown18:25
anteayajlvillal: I have 11 hits for meeting_id with underscores and 3 with hyphens18:25
mordredsdague: lgtm18:25
jlvillalanteaya, Right. I'm still unclear on concern that patch would break something. I must be missing something.18:25
jlvillalanteaya, The 11 hits with underscores would remain unchanged for the URL generated to the logs.18:26
anteayajlvillal: the three with hyphens don't link to logs18:26
jlvillalanteaya, The 3 with hyphens would be corrected to use underscores and point to the logs correctly.18:26
jlvillalanteaya, Current link: http://eavesdrop.openstack.org/meetings/ironic-qa/18:27
jlvillalanteaya, Corrected link: http://eavesdrop.openstack.org/meetings/ironic_qa/18:27
jlvillalThat is goal of patch18:27
*** heyongli has quit IRC18:27
anteayawhy is that better than fixing the yaml?18:27
jlvillalanteaya, One line change versus fixing three files. Also handles future patches where people don't realize that they can't use hyphens.18:28
jlvillalanteaya, I vote for making it easier for people.18:28
*** heyongli has joined #openstack-infra18:28
anteayaI'm a fan of consistent yaml18:29
anteayasince it tends to get copy/pasted around18:29
anteayabest to have it accurate to start off with18:29
jlvillalanteaya, I'm a fan of that and also a fan of making it resilient. Not needing reviewers to catch the error as it just works.18:30
*** sridhar_ram has quit IRC18:30
anteayaup to you18:30
*** maishsk has quit IRC18:31
jlvillalanteaya, Okay. I will update to also fix the yaml files but also have it handle hyphen issues.18:31
*** FallenPegasus has quit IRC18:31
jlvillalanteaya, I don't think they are mutually exclusive :)18:31
jlvillalanteaya, Thanks for the feedback!18:31
*** ddieterly has joined #openstack-infra18:32
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Refactor Panel class  https://review.openstack.org/24171118:32
*** amitgandhinz has quit IRC18:32
timrcmordred: So looks like a couple bugs... that restart script is not in ansible-playbooks so even if the path is updated in the puppetmaster.pp it probably won't be where you want it.  Looks to still be in system-config/files/ansible.  Based on what I'm seeing in run_all.sh playbooks via roles.yaml which points at the ansible puppet project.18:33
timrcs/ansible-playbooks/ansible-puppet18:33
fungimordred: Shrews: sorry, got waylaid by our quarterly pest control appointment, catching up now18:33
sdaguefungi: confirmed that the devstack wheelhouse code was causing the extra pip builds, http://logs.openstack.org/98/241698/1/check/gate-tempest-dsvm-full/f67dbdd//logs/ no longer has the double builds on cryptography or cffi18:34
timrcOh and playbooks are put in place via* -- I should learn to type.18:34
sdague(which is the test run for the remove all the wheel code patch)18:34
openstackgerritGraham Hayes proposed openstack/requirements: Update oslo.middleware to 2.9.0  https://review.openstack.org/24172418:35
mordredtimrc: yah - I thnk I missed that playbook when rebasing18:36
*** ddieter__ has quit IRC18:36
mordredtimrc: the playbook should be in system-config/playbooks and the cron should reference it there18:36
mordredtimrc: you wanna fix?18:36
*** pvaneck has joined #openstack-infra18:36
openstackgerritJohn L. Villalovos proposed openstack-infra/irc-meetings: Replace hyphens with underscores for meeting_id  https://review.openstack.org/24170118:36
fungimordred: Shrews: i don't see a reason for us to keep backwards compatibility for an obviously broken method, though it may still make sense to rev the major version and call it out a bit more visibly as a potentially breaking change in the commit message/changelog?18:36
mordredfungi: I'd rather keep backwards compat hack than rev the major in this particular case18:37
*** heyongli has quit IRC18:37
anteayajlvillal: you're welcome18:37
timrcmordred: Oh wait now I'm extra confused... there's also a system-config/playbooks?18:37
fungimordred: sdague: on the assumption we'll be able to upload reliably in rackspace soon, i wouldn't likely bother with the prep script version of that18:38
mordredtimrc: yes18:38
sdaguefungi: well, it's done :)18:38
mordredtimrc: that is where the playbooks live18:38
fungithat's at least the only place i'm aware they're still relevant18:38
jlvillalanteaya, I just pushed new revision of the patch. Hyphens have been replaced in the yaml files.18:38
sdaguefungi: https://review.openstack.org/#/c/241717/18:38
*** heyongli has joined #openstack-infra18:38
sdagueso we might as well put that in as well, and delete it later18:38
sdaguewhen it's no longer a thing18:38
timrcmordred: Okay well that is making more sense... I was thrown off by the planet-ansible thing.18:38
mordredtimrc: puppet-ansible is a role18:38
mordredtimrc: sigh18:39
*** amitgandhinz has joined #openstack-infra18:39
mordredtimrc: ansible-puppet is a role that describes how to run puppet with ansible18:39
timrcmordred: Okay I'll move the jenkins playbook over.  I understand at least that much now :)18:39
mordredyay!18:39
mordredtimrc: puppet-ansible is a puppet module to install ansible related things into the places they need to go18:39
*** amitgandhinz has quit IRC18:40
*** amitgandhinz has joined #openstack-infra18:40
anteayafungi: thank you18:41
*** maishsk has joined #openstack-infra18:42
fungisdague: yep, i saw your change submission after i commented. sorry. i should read all of scrollback and keep a stack of replies until i'm sure they're relevant18:43
anteayafungi: perhaps a feature request for gertty18:44
sdaguefungi: no worries18:44
fungianteaya: looks like compass-install should be all set now https://review.openstack.org/#/admin/projects/stackforge/compass-install,access18:44
anteayafungi: thanks yes, that was my thank you above, I replied with that link18:44
*** tnarg has joined #openstack-infra18:44
anteayafungi: sorry figured you were busy and didn't want to bug18:45
fungioh, yep i should also read more carefully18:45
openstackgerritTimothy R. Chavez proposed openstack-infra/system-config: Move playbook to correct location  https://review.openstack.org/24172818:46
anteayafungi: no worries, you can't read my mind18:46
anteayafungi: I can tell you aren't anywhere in my living room18:46
timrcmordred: ^^18:46
fungiheh18:46
openstackgerritRamaraja proposed openstack/requirements: Adding Mitaka version oslo.log  https://review.openstack.org/24172918:47
anteayathough if someone knows where my cat is do speak up, I had an appointment with the vet but not much point going with no cat18:47
*** dvlwrk_ has joined #openstack-infra18:47
*** heyongli has quit IRC18:48
fungiours likes to hide under the couch when he foresees a visit to the vet18:48
anteayanice18:48
anteayaalmost like putting itself in the box18:48
anteayamine comes when she is called, except today18:48
*** ybathia has joined #openstack-infra18:48
anteayathe receiptionist laughed when I called to cancel18:48
*** heyongli has joined #openstack-infra18:49
*** amitgandhinz has quit IRC18:49
fungii'm sure they get that often18:50
pleia2sneaky kitty18:50
anteayayup18:50
*** amitgandhinz has joined #openstack-infra18:50
anteayait is my fault18:50
anteayaI should have known18:50
anteayapleia2: you feeling better today?18:51
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Fix keystone domain searching  https://review.openstack.org/24170418:52
pleia2anteaya: some :) sinus headache is gone at least, so I'll be more productive today \o/18:52
anteayapleia2: yay no sinus headache \o/18:54
openstackgerritKhai Do proposed openstack-infra/puppet-gerrit: Allow setting the number of threads for indexing Gerrit changes  https://review.openstack.org/24106018:54
anteayamy parents just left from a visit, everytime my father leaves these days I am richer by one cap18:54
anteayagood thing he has lots18:55
*** doug-fis_ has joined #openstack-infra18:56
*** peterlisak has joined #openstack-infra18:57
anteayasdague: so on this etherpad: https://etherpad.openstack.org/p/obh-debugging-openstack-gate you okay if I update some links?18:57
*** heyongli has quit IRC18:58
*** doug-fish has quit IRC18:58
*** heyongli has joined #openstack-infra18:59
*** doug-fis_ has quit IRC19:00
*** ramashri has joined #openstack-infra19:01
*** sridhar_ram has joined #openstack-infra19:02
*** jsavak has joined #openstack-infra19:02
*** samuelBartel has quit IRC19:03
*** doug-fish has joined #openstack-infra19:04
*** mestery has quit IRC19:05
*** mestery has joined #openstack-infra19:05
*** amitgandhinz has quit IRC19:06
*** amitgandhinz has joined #openstack-infra19:06
*** sridhar_ram1 has joined #openstack-infra19:06
*** jsavak has quit IRC19:07
*** jsavak has joined #openstack-infra19:07
anteayazaro: so your feeling that the double / that is an issue on review-dev won't be an issue on review?19:07
*** sridhar_ram has quit IRC19:07
anteayas/your/you're19:07
*** doug-fish has quit IRC19:08
*** doug-fish has joined #openstack-infra19:08
*** heyongli has quit IRC19:08
*** heyongli has joined #openstack-infra19:09
kgiustianteaya: ping - question: once a patch to openstack-infra/project-config is merged, how long before the code change makes it 'live' on zuul?19:10
*** austin81 has joined #openstack-infra19:11
anteayakgiusti: after it is merged it has to wait for a puppet run to be updated on individual servers19:11
anteayaso for instance a jenkins job change needs to be updated on all the jenkins masters19:11
anteayapuppet runs usually twice an hour19:12
anteayakgiusti: was there a specific patch you were asking about?19:12
nibalizerkrotscheck: yea the idea is you move that blob into the node definition in site.pp19:13
anteayakgiusti: this dashboard shows puppet activity on various servers: http://puppetboard.openstack.org/19:14
*** ad_rien_ has quit IRC19:14
*** otter768 has joined #openstack-infra19:14
kgiustianteaya: hmmm.   I ask because https://review.openstack.org/#/c/241236/ was merged today (9:14am), but my last check failed: https://review.openstack.org/#/c/241702/19:14
*** smarcet has quit IRC19:14
anteayanibalizer: I think I am wrong is puppetboard the view we are currently using to track puppet activity?19:15
*** amitgandhinz has quit IRC19:15
kgiustianteaya: the failing test ran on precise, which the patch was supposed to fix.19:15
anteayanibalizer: the dates look old, I haven't looked in a while19:15
mordredtimrc: perfect! thanks!19:15
anteayakgiusti: right, so either the patch didn't work or didn't get applied19:15
*** [HeOS] has joined #openstack-infra19:16
anteayakgiusti: the patch looks right to me19:16
kgiustianteaya: yay! :)19:17
*** heyongli has quit IRC19:18
*** otter768 has quit IRC19:19
nibalizeranteaya: http://puppetboard.openstack.org/report/cacti.openstack.org/cf0953c1c1dbfe22b9e55deb04b250e51b9a2c29 ?19:19
*** heyongli has joined #openstack-infra19:19
anteayaI'm wrong, puppet is running every 15 minutes: http://puppetboard.openstack.org/node/jenkins01.openstack.org19:19
anteayanibalizer: thanks19:20
zaroanteaya: that is correct.  i don't remember anybody seeing '//' for that week we upgraded to 2.10 on review.o.o19:21
*** tonytan4ever has joined #openstack-infra19:21
anteayakgiusti: so I am at a loss, puppet seems to be running, your patch looks right to me, the patch ran on precise and it should have run on fedora19:21
anteayazaro: can you put that comment in the gerrit testing etherpad?19:21
kgiustianteaya: that makes two of us :(   Is there any way I can debug this?19:21
nibalizeranteaya: ok col19:22
zaroanteaya: i will try to re-puppet review-dev soon to see if it fixes it.  puppet hasn't been run on review-dev for about a year.19:22
zaroanteaya: it's already there.19:22
anteayanibalizer: you willing to try to look at some zuul logs and see what happened with the ampq1-f21 job? https://review.openstack.org/#/c/241702/19:22
*** abregman has joined #openstack-infra19:22
zaroyolanda: ping19:23
anteayazaro: ah that would be great yes, a fresh puppet run19:23
anteayanibalizer: f21 jobs should run on fedora 21, it was running on precise and trusty and was hopefully fixed with https://review.openstack.org/#/c/241236/119:24
anteayanibalizer: which to me looks like ti should fix it19:24
anteayait being the ampq1-f21 job19:24
anteayabut 241702 shows the test ran on precise19:24
anteayaI'm out of things to look at from my side19:25
*** bradjones has quit IRC19:26
*** amitgandhinz has joined #openstack-infra19:26
clarkbwhat was time difference between fix merging and job starting?19:28
*** heyongli has quit IRC19:29
nibalizermordred: pabelanger phschwartz others interested in puppet-apply, can you review the stack here https://review.openstack.org/#/c/241495/19:29
anteayaclarkb: 9:14 am and 1:42pm19:30
*** heyongli has joined #openstack-infra19:30
anteaya4.5 hours19:30
clarkbwas that yesterday?19:30
clarkbjjb was not updating jenkins yesterday19:30
anteayatoday19:30
*** tiswanso has quit IRC19:30
pleia2utc?19:31
anteayasorry for job starting was more like 3.519:31
anteayapleia2: no going by gerrit times in my browser19:31
pleia2ah, no wonder I was confused :)19:31
anteayaI wish gerrit times were utc19:31
anteayapleia2: yeah sorry19:31
anteayaso about 3.5 hours roughly19:31
*** kushal has quit IRC19:31
*** tiswanso has joined #openstack-infra19:32
clarkbnext I would check if jjb is still timing out puppetboard shpuld say19:32
*** wenlock__ has joined #openstack-infra19:33
openstackgerritKhai Do proposed openstack-infra/system-config: Allow Gerrit to use 4 threads for indexing changes.  https://review.openstack.org/24173619:33
* anteaya looks at http://puppetboard.openstack.org/node/jenkins01.openstack.org for timeouts19:34
zaroanteaya: puppet for review-dev.o.o is stale now, so need to update it first.19:34
anteayazaro: okay cool19:34
anteayaclarkb: I don't see anything regarding timeouts in that view19:35
zaroclarkb: did that jjb issue get fixed? or do we still need a fix?19:35
anteayashould I be looking in a different view?19:35
anteayathe last four puppet runs on jenkins01 were under 10 minutes19:35
*** wenlock__ has quit IRC19:37
*** aysyd has quit IRC19:37
*** heyongli has quit IRC19:39
*** heyongli has joined #openstack-infra19:40
*** jsavak has quit IRC19:40
*** salv-orlando has quit IRC19:42
timrcmordred: I might have messed up the path... I have it at /opt/system-config/playbooks but it looks like it wants /opt/system-config/production?  Let me fix.19:42
*** sabeen1 has joined #openstack-infra19:42
*** salv-orlando has joined #openstack-infra19:42
*** sridhar_ram1 has quit IRC19:43
mordredtimrc: yes!19:43
clarkbzaro not sure yet, I thought just updating all the jobs may fix it19:44
mordrednibalizer: in the first patch19:45
mordrednibalizer: can we add those new values to the current file so that apply and agent both work?19:45
mordrednibalizer: like, I'm assuming that modulepath, manifest and reports in main will get ignored by agent, yeah?19:45
openstackgerritTimothy R. Chavez proposed openstack-infra/system-config: Move playbook to correct location  https://review.openstack.org/24172819:46
*** amitgandhinz has quit IRC19:46
mordredtimrc: good catch19:46
*** amitgandhinz has joined #openstack-infra19:47
*** doug-fish has quit IRC19:47
clarkbanteaya: kgiusti I have confirmed that at least on jenkins01 that amqp1 job has not been updated19:47
*** sfinucan has quit IRC19:48
openstackgerritmatthew wagoner proposed openstack-infra/shade: Add new context manager for shade exceptions, cont.  https://review.openstack.org/24166719:48
clarkboh hrm the label expression was already devstack-f2119:48
clarkboh its the functional job19:48
*** sabeen3 has joined #openstack-infra19:48
anteayaclarkb: thank you19:48
*** achanda has quit IRC19:49
clarkblet me look at the right job19:49
*** heyongli has quit IRC19:49
kgiusticlarkb: thanks - we patched the {node} entry for that particular job recently19:49
*** doug-fish has joined #openstack-infra19:49
*** sabeen1 has quit IRC19:49
clarkbok now that I am looking at the correct job it hasn't updated, let me see what running jjb does19:49
anteayaclarkb: thanks19:49
*** heyongli has joined #openstack-infra19:50
kgiusticlarkb: anteaya: thanks for the help - I need to leave for 30 mins or so - son missed the bus home from school :P19:50
anteayakgiusti: ack, go fetch son19:50
nibalizermordred: so I tried putting those values in the [apply] stage, which doesn't seem to actually work19:50
anteayakgiusti: talk to you when you return19:51
freerunnerfungi: Hi! Are you here? ;)19:51
anteayafreerunner: best to just state your question19:51
openstackgerritKhai Do proposed openstack-infra/system-config: Update plugins and use files from project_config repo  https://review.openstack.org/24039319:51
nibalizeragent won't worry about modulepath and manifest and report19:51
nibalizerso we could technically have conflicting variables in [main] and [master] maybe19:51
nibalizeri didn't want try to think up and test all the variations of that19:51
*** achanda has joined #openstack-infra19:52
sdagueanteaya: yes, feel free to update links19:52
anteayasdague: thanks19:52
*** kutija_ has quit IRC19:52
anteayaI'll try to find current logs that fit in with the conversation and points made19:53
* zaro is erranding again..19:53
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Normalization methods should return Munch  https://review.openstack.org/24173819:53
*** sfinucan has joined #openstack-infra19:53
*** ddieterly has quit IRC19:54
openstackgerritTimothy R. Chavez proposed openstack-infra/system-config: Copy hiera data directly to nodes  https://review.openstack.org/24174019:54
anteayazaro: happy errands19:54
clarkbjjb is running, it doesn't appear to be updating every job ever19:54
timrccrinkle, nibalizer, mordred: My vision for copying hiera onto nodes... https://review.openstack.org/#/c/241740/19:55
*** enthurohini has quit IRC19:55
clarkbNumber of jobs updated: 3319:55
clarkbit did update the amqp1 job19:55
*** austin81 has quit IRC19:55
timrcWill need to set as WIP, missing group hiera yaml paths... basically a playbook that runs on a cron that copies the appropriate yaml to nodes and does not break or require special logic when said hiera yaml does not exist on the puppetmaster.19:55
mordredtimrc: was something wrong with https://review.openstack.org/#/c/165157/ ?19:56
freerunneranteaya: Ok. I see strange behavior of our new dsvm gate in murano. So, in the job-template I set DEVSTACK_GATE_NEUTRON=1 and enable murano plugin, but looks like smth went wrong and I still have n-net enabled. So, main question - what's I was did wrong? The template is here: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/murano.yaml#L185-L22319:56
clarkbit is now removing a bunch of obsoleete jobs, maybe it timed out doing that? but if it had it should've updated the jobs prior just fine19:56
*** bcourt has quit IRC19:56
clarkbfreerunner: does your plugin enable nova net directly?19:57
clarkb22 jobs deleted and all done19:57
clarkbso it runs quickly ish and without trouble when manually started19:57
freerunnerclarkb: Nope. In plugin settings we disabling n-net19:57
timrcmordred: I didn't see that until recently.  I had been working off of crinkle's work.19:57
clarkbfreerunner: you sure it is disabling?19:57
freerunnerclarkb: Locally, it works good. We using devstack functions to do it.19:58
*** jsavak has joined #openstack-infra19:58
clarkbanteaya: kgiusti I amrunning puppet manually now to see if it breaks for some reason during puppeting19:58
anteayaclarkb: yay the amqp1 job updated, but is that just for jenkins01?19:58
clarkbanteaya: yes just for 01 currnetly19:58
anteayaclarkb: okay will wait for you before I recheck19:59
clarkb(puppet is fine)19:59
*** heyongli has quit IRC19:59
clarkbfreerunner: you can go through the setup logs to see if d-g is adding n-net but it doesn't do that for any other job that I know of19:59
*** baoli_ has quit IRC20:00
*** heyongli has joined #openstack-infra20:00
*** amitgandhinz has quit IRC20:00
*** ayoung has quit IRC20:00
timrcmordred: I'm okay with your implementation, seems reasonable to me.  Probably better to run on demand than via cron anyway?20:01
mordredtimrc: I could be convinced either way :)20:01
clarkboh! maybe my sudoing is failing to use the existing cache20:01
*** amitgandhinz has joined #openstack-infra20:01
* clarkb sudos better20:01
clarkbwhen sudo attacks20:02
mordredtimrc: I think we're both missing sane group membership - mine is assuming the inventory will know it, but it does not currently know that. hrm20:02
timrcmordred: I guess what I like about my version is that the search paths are listed in the vars/main.yml and that seems a little more readable to me than a python script dynamically generating that info?20:02
jesusaurusclarkb: if it wasnt using the cache, wouldnt it update all the jobs?20:02
clarkbjesusaurus: yes then puppet times out and we lose20:02
*** jsavak has quit IRC20:02
clarkbI think that may be happening I am properly su'd to root and rerunning to confirm20:03
jesusaurusoh, puppet might be failing to use the cache, gotcha20:03
clarkbjesusaurus: no I failed to use the cache when I updated all jobs yesterday20:03
clarkbor failed to use the same cache as puppet20:03
clarkbso now when puppet runs it tries ti update everything again20:03
mordredtimrc: actually, yeah - I believe I was operating on old assumption that we might have a node in more than one group20:03
clarkb(testing that theory on 02 now)20:03
timrcmordred: Also how frequently are hiera data changing?  Is your implementation going to be called on every puppet apply?  If puppet apply is called more frequently than updates to hiera than having a cron sort of offloads that time.20:03
mordredtimrc: which it turns out is not possible on the puppet side20:03
timrcBut then again if you have to wait to run puppet apply for hiera data to sync...20:04
mordredtimrc: biggest problem with the cron is that once we have ansible launch-node, we'll need to copy hiera values as part of the initial ansible/puppet run20:04
*** abregman is now known as abregman|coffe20:05
crinklemordred: timrc at what point do the puppet modules get installed? i think the hiera data should get copied at the same time, whether that's on every puppet apply or in a cron20:06
anteayamordred: so I have a problem, when we did the stackforge renames you submitted a number of patches to remove the contents of the retired projects, here is one of the patches: http://git.openstack.org/cgit/stackforge/compass-install/commit/?id=2614e5fa95aab680fb6f9287831e50c65f76f72c20:06
*** hdd_ has quit IRC20:06
clarkbya all the jobs updating when I su properly20:06
*** peristeri has joined #openstack-infra20:06
clarkbok so I likely just need to rerun this everywhere to populate the right cache20:07
anteayamordred: it has a git id number, however I cannot find the gerrit change id, it appears that gerrit doesn't have a change id for it20:07
anteayamordred: since when I look at the repo you don't have any patches to the repo gerrit knows about20:07
anteayamordred: the reason I would like a change id for that change is that we need to revert the change, and the id is nice for the commit message for history20:08
mordredcrinkle, timrc: I believe we need to copy the values and install the modules on every run20:08
mordredotherwise changes to the modules file or whatnot could be stale20:08
* crinkle agrees20:08
mordredand the cost for copying 2 yaml files is nothing20:08
mordredtimrc: but I like your config-file approach20:09
*** sridhar_ram has joined #openstack-infra20:09
*** heyongli has quit IRC20:09
mordredand we can do default vars values in the ansible-puppet role20:09
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Normalize domain data  https://review.openstack.org/24174320:09
mordredtimrc: which would also theoretically allow someone to define a different search path - not that that is a primary concern20:09
anteayaclarkb: how were you sudoing incorrectly?20:09
*** jsavak has joined #openstack-infra20:09
clarkbanteaya: I was just doing `sudo jenkins-jobs` which uses my homedir for the cache20:10
*** heyongli has joined #openstack-infra20:10
clarkbinstead of roots which is what puppet will do20:10
anteayaah20:10
mordredanteaya: ah - yes. well, I did not submit those as gerrit changes20:10
*** bcourt has joined #openstack-infra20:10
clarkbso now things are running on 01 and 02, will start the othre jenkinses shortly which should make everything happy20:10
anteayamordred: hmmmmm20:10
freerunnerclarkb: It's really strange, but I can't find any criminal in logs. I think, that this is localrc generated incorrectly(or overwritten by smth)20:10
anteayaclarkb: thank you20:10
*** abregman|coffe is now known as abregman20:10
mordredanteaya: so we're just going to be out of luck on that ... sorry!20:10
fungianteaya: yeah, there is no corresponding change-id for those20:11
anteayamordred: okay20:11
anteayafungi: yeah, I just checked the big-switch one too, it just used the git id20:11
anteayathanks20:12
fungithe alternative was to script something to vote on and directly submit them through the gerrit api20:12
openstackgerritTimothy R. Chavez proposed openstack-infra/system-config: Copy hiera data directly to nodes  https://review.openstack.org/24174020:12
*** dtardivel has quit IRC20:13
*** ZZelle has quit IRC20:14
anteayafungi: no no, the way mordred did it was the right way under the circumstances20:14
clarkbthere is now a root screen on each master updating jobs20:14
anteayaI just wanted to ensure I didn't miss some way of getting the change id, looks like I didn't miss it, thanks20:14
clarkbshould update them in such a way that the cache is populated properly and puppet updates jobs again20:14
*** nadya has quit IRC20:14
timrcmordred: Cool.  Well I learned a lot :) I'm happy to throw my +1 onto your review.20:14
anteayaclarkb: you want to -2 the rename patches so you can un -2 them on Friday?20:17
*** ramashri has quit IRC20:17
anteayaclarkb: I'll give you patch numbers if you are okay with taht20:18
*** ramashri has joined #openstack-infra20:18
*** ddieterly has joined #openstack-infra20:18
*** ldnunes has quit IRC20:18
mordredtimrc: I think neither is the right thing - i think both learned good things - and the result is going to look like a combo20:19
mordredtimrc: you want to take over my patch and rework it to look like what you were doing?20:19
freerunnerclarkb: I'm looking through other murano job definitions, and I saw, that each job keeping localrc. Maybe this is the problem?20:19
*** heyongli has quit IRC20:19
clarkbanteaya: I am fine with somsone just WIPing them20:20
*** heyongli has joined #openstack-infra20:20
clarkbfreerunner: maybe?20:20
nibalizercrinkle: this https://review.openstack.org/#/c/241501/ and L14 of this https://review.openstack.org/#/c/241503/1/playbooks/remote_puppet_git.yaml is where install_modules.sh is getting called right now20:20
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/subunit2sql: Add an attachment storage driver option  https://review.openstack.org/24174620:21
clarkbmordred: fungi sdague https://review.openstack.org/#/c/241692/3/nodepool/elements/cache-devstack/install.d/60-pip-warm-cache is not safe20:21
*** sabeen3 has quit IRC20:21
nibalizerso I think at L15 of that we need a 'copy hiera'20:21
nibalizerand mordred has some changes up, as does tim20:21
clarkbmordred: fungi sdague that requires that all of the build deps be installed which they won't be20:21
clarkbmordred: fungi sdague we have already had to revert what is basically that change once before due to this reason20:21
anteayaclarkb: well I was thinking it would be best if the person wiping them was you or fungi20:22
*** rfolco has quit IRC20:22
anteayaclarkb: unless you want to gerrit admin remove my -2 when I won't be here20:22
*** angdraug has joined #openstack-infra20:23
*** SumitNaiksatam has joined #openstack-infra20:23
openstackgerritMerged openstack-infra/puppet-stackalytics: Initial commit for puppet-stackalytics  https://review.openstack.org/19070820:24
anteayayay!20:24
anteayacongratulations pabelanger20:24
freerunnerclarkb: I'm really not sure, unfortunately =(20:24
*** sfinucan has quit IRC20:25
*** ddieterly has quit IRC20:25
*** sfinucan has joined #openstack-infra20:25
*** khomkrit has quit IRC20:26
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Add unit test coverage for panels  https://review.openstack.org/24175020:26
sdagueclarkb: can't we fix it closer to the source?20:27
openstackgerritVictor Ryzhenkin proposed openstack-infra/project-config: Add KEEP_LOCALRC flag into murano job template  https://review.openstack.org/24142220:27
clarkbsdague: response to ml thread in a moment20:27
clarkbsdague: the fix is to go back to having a wheel mirror20:27
clarkbsent, not sure how long that will take to make it through the smtp maze20:28
sdagueclarkb: so which packages will blow up with this?20:28
clarkbsdague: lxml in particular20:28
clarkblibvirt20:28
clarkbPillow20:28
clarkbanything that needs to build against headers not included in the image20:28
*** ddieterly has joined #openstack-infra20:28
sdagueso we already install the dependencies in another section, can't we just extend that?20:28
clarkbno20:29
sdaguewhy?20:29
clarkbbecause we intentionally do not install them20:29
clarkbto force devstack to install them20:29
clarkbso that we know devstack installs the appropriate dependencies instaed of devstack-gate or the image builds doing it20:29
sdaguethen install them, and uninstall after building this20:29
clarkbor20:29
clarkbbuild a wheel mirror20:29
*** heyongli has quit IRC20:29
kgiustianteaya: clarkb: fyi: back now - let me know if there's anything I can do to help debug.20:30
anteayakgiusti: stand by and let the jenkins updates happen20:30
clarkbkgiusti: I think I figured it out, was related to my attempt at getting jjb working yesterday, I am actually fixing it now and we should be good in a a while (once jjb is done running everywhere)20:30
anteayakgiusti: thanks20:30
*** heyongli has joined #openstack-infra20:30
anteayaadam_g: did you want to rename the gerrit groups from akanda to astara? http://git.openstack.org/cgit/openstack-infra/project-config/tree/gerrit/acls/openstack/akanda.config20:31
*** fawadkhaliq has joined #openstack-infra20:31
freerunnerclarkb: Possible fix for my problem is here https://review.openstack.org/#/c/241422/ .20:31
kgiustianteaya: clarkb: Awesome - thanks for all the help!20:31
fungiclarkb: d'oh! i keep forgetting we need distro packages installed to be able to do that20:32
*** EricGonc_ has joined #openstack-infra20:33
greghaynesclarkb: did you say wheel mirror? :p20:33
clarkbgreghaynes: yes, its the same thing again20:33
clarkbjust 6 months later20:34
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Add unit test coverage for panels  https://review.openstack.org/24175020:34
greghaynesclarkb: which thing? cffi?20:34
* greghaynes is just now de-jetlagging20:34
clarkbgreghaynes: make a wheel cache in the image build20:34
fungiclarkb: sdague: so, yeah, excepting some mechanism to roll back all the things additional package installs do (including dragging in dependent packages) we really need a wheel cache built separate from the chroot where the image is built20:34
clarkbthat doesn't work because none of the deps are installed20:34
clarkbfix we decided on 6 months ago was make a wheel mirror20:34
clarkbexcept I was the only person willing to review those changes :/20:34
greghaynesclarkb: Ah. Yep. I think wheel cache in images is doable but more work without much benefit over mirror. So ++20:35
fungiwe could in theory do it with a parallel chroot and copy the wheel cache into the image, but that's also ugly20:35
fungiregardless, the separate fix in devstack gets us a pretty good speedup20:35
sdaguefungi: the devstack fix is only about 40 seconds saved20:36
fungihas anyone proposed the revert yet? (did it merge yet?)20:36
greghayneshttps://review.openstack.org/#/q/status:open+branch:master+topic:feature/wheel-mirror,n,z20:36
sdaguethe wheel cache in image would be 8 - 20 minutes20:36
clarkbit did merge, I havne't seen a revert pushed yet20:36
greghaynesThey probably need rebasing again20:36
*** abregman has quit IRC20:36
*** EricGonczer_ has quit IRC20:36
fungii'll get that drafted up while we noodle on the mirror solution20:36
*** jamielennox|away is now known as jamielennox20:36
*** eil397 has joined #openstack-infra20:37
sdagueso, if we could make that a priority, it would be nice. This is the #1 time optimization that could be made to test runs.20:39
*** heyongli has quit IRC20:40
*** tlian has quit IRC20:40
greghaynesHey, thats why I made those patches ;)20:40
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Revert "warm pip wheel cache during image build"  https://review.openstack.org/24175620:40
*** heyongli has joined #openstack-infra20:40
fungithere's the revert ^20:40
fungii'll make it a priority to review the mirror changes20:41
sdaguegreghaynes: yeh, well I reviewed the one I could +220:41
sdaguebut it was blocked on one where I don't have that authority20:41
sdaguegreghaynes: but, yeh, it looks like those all need rebasing20:41
anteayafungi: +2 on the revert20:41
*** ddieterly has quit IRC20:41
*** ddieterly has joined #openstack-infra20:42
sdagueI also think we should rethink if testing all of devstack on every test run is really appropriate, vs. testing all of devstack on devstack patches, and starting later for project patches20:43
sdaguewe've left the model of one giant pot of stuff for testing a long time ago, intentionally20:43
clarkbI think thats an orthogonal issue. Regardless we should use a wheel mirror and not have crazy wheel caching on image things20:43
clarkb(because getting that right is hard)20:44
*** ramashri has quit IRC20:44
sdagueclarkb: that means every 3rd party ci system has to setup their own wheel mirror as well?20:44
clarkbto address the devstack thing specifically we are trying to collapse down to a single image per distro release20:44
fungiand the speedup is from not having to build the wheels, not from hosting the wheels closer to the job runner20:44
clarkbsdague: or use ours (they all already do)20:44
greghaynesOr just dont do it and be slower20:44
clarkbhaving a single image per distro release makes it harder to treat tests against devstack as more special from a package perspective than tests against other projects20:45
greghaynesYea, the bake-in vs not approach is really whether we pay the complexity in hosting the mirror, which we already have paid for20:45
sdaguegreghaynes: and the extra network touches, which even for our own mirrors, are fails from time to time20:46
openstackgerritKyle Mestery proposed openstack-infra/project-config: Add release notes jobs for neutron  https://review.openstack.org/24176120:46
sdaguebut, it's fine if that's a priority to get done soon20:46
*** ddieterly has quit IRC20:47
greghaynesThats fair, there is a bit of mirror updating fail that we sidestep too.20:47
*** ddieterly has joined #openstack-infra20:48
openstackgerritmatthew wagoner proposed openstack-infra/shade: Add new context manager for shade exceptions, cont.  https://review.openstack.org/24166720:48
clarkbanteaya: where ar ethose changes? I can WIP them20:48
*** tlian has joined #openstack-infra20:48
*** trown is now known as trown|hairscut20:48
clarkband jjb is still running, in the gate-o range right now20:48
anteayaclarkb: I haven't cleaned it up yet, but they are all in here: https://etherpad.openstack.org/p/project-renames-November-6-201520:48
anteayaclarkb: thanks20:48
anteayaand the compass-install patch is coming, I am told20:49
clarkblooks like AJaeger already -2'd one of them20:49
clarkbanteaya: and you got aother?20:49
*** heyongli has quit IRC20:50
clarkbI got the other 220:50
anteayagreat thank you20:50
*** bharathm has quit IRC20:50
*** FallenPegasus has joined #openstack-infra20:50
*** sabeen1 has joined #openstack-infra20:51
anteayayou can remove my -2 when I am not here, correct?20:51
*** heyongli has joined #openstack-infra20:51
*** tnarg has quit IRC20:51
*** tnarg has joined #openstack-infra20:51
clarkbyes20:51
clarkbso its not a problem20:51
openstackgerritCraig Vyvial proposed openstack/requirements: Block pymongo version 3.1  https://review.openstack.org/24176520:52
*** aysyd has joined #openstack-infra20:52
openstackgerritPaul Belanger proposed openstack-infra/system-config: Create stackalytics.o.o under -infra  https://review.openstack.org/19076520:53
pleia2ooh, looks like I get to be the first to add something to hieradata in the new split format20:53
pleia2I assume just creating the yaml file for the fqdn I'm working with and adding it to git will work?20:54
anteayaclarkb: great, thanks20:54
mordredpleia2: yup20:54
anteayapleia2: yay20:54
pleia2mordred: cool20:54
*** sabeen1 has quit IRC20:55
*** maishsk_ has joined #openstack-infra20:55
*** sabeen has joined #openstack-infra20:55
*** maiteb has quit IRC20:55
clarkbpleia2 if it isnt part of a larger group I think that is corrwct20:56
*** maishsk has quit IRC20:56
*** maishsk_ is now known as maishsk20:56
clarkbso jenkins masters have a jenkins group instead20:56
pleia2clarkb: aha, noted, this is for stackalytics.o.o20:56
pleia2so no group20:56
mordredclarkb: jenkins masters have a jenkins group also20:59
mordredclarkb: all nodes have an fdqn file20:59
clarkbgotcha20:59
mordredand most specific wins common -> group -> fqdn20:59
*** heyongli has quit IRC21:00
Swamisdague: I have a question on the gate failures21:00
*** heyongli has joined #openstack-infra21:01
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Add release notes jobs for neutron  https://review.openstack.org/24176121:02
anteayaSwami: did you read the resources I linked in the mailing list thread?21:02
*** shayneburgess has joined #openstack-infra21:02
Swamianteaya: yes I listenend to the youtube link, that was informative21:02
anteayaSwami: watched any of the videos?21:02
*** kgiusti has quit IRC21:03
anteayaSwami: great what tools have you looked at to evaluate the failure you see21:03
Swamianteaya: I have been using the logstash for debugging the problem.21:03
*** ayoung has joined #openstack-infra21:03
anteayaSwami: great21:03
anteayawhat queries have you been using?21:03
*** achanda has quit IRC21:03
openstackgerritKyle Mestery proposed openstack-infra/project-config: Add release notes jobs for neutron  https://review.openstack.org/24176121:04
anteayayou can show me in a paste or use a url shortener21:04
Swamianteaya: I have been using queries to filter based on the project, status, message, build_name21:04
*** hdd_ has joined #openstack-infra21:04
anteayaSwami: can you share a query via paste or a url shortener?21:04
*** shardy has quit IRC21:06
*** bexelbie has joined #openstack-infra21:06
*** e0ne has quit IRC21:06
*** amitgandhinz has quit IRC21:07
openstackgerritMerged openstack/diskimage-builder: Add support for Xen PV disks  https://review.openstack.org/22624921:07
*** amitgandhinz has joined #openstack-infra21:07
Swamianteaya: #link http://paste.openstack.org/show/478014/21:08
openstackgerritK Jonathan Harker proposed openstack-infra/os-loganalyze: Add Range header support  https://review.openstack.org/24105821:08
Swamianteaya: I have posted my query in the pastebin and provided you the link.21:08
anteayaSwami: thank you, when sharing a link in channel you don't need to use #link21:08
anteayaSwami: only during meetings does #link mean something21:08
Swamianteaya: Thanks good info21:08
jesusaurusclarkb: greghaynes: 241058 now has more tests and less webob21:09
greghaynesjesusaurus: clarkb https://github.com/Pylons/webob/pull/223 is the webob fixes. TLDR is they are going to need some more work than trivial fix21:10
greghaynesso ++ on just hacking our own thing instead21:10
*** heyongli has quit IRC21:10
Swamianteaya: my question is we are seeing the "SSHTimeout" issues both with neutron-full job and with the neutron-dvr job. But in order to debug this scenario the logs are not sufficient. So is there any way that we can debug such problems in the gate without the VMs state being disturbed.21:11
clarkbjesusaurus will do my best yo review when I get back from visiting doctor21:11
anteayaSwami: so if I input your top query into logstash and then click the share button, then take the url I am given from the share window and put it into tinyurl I get http://tinyurl.com/ow6bzxu21:11
clarkbbtw if you have kids you end up seeing the doctor more in a year than the rest of your life combined21:11
greghaynesjesusaurus: pep8 is unhappy21:11
*** heyongli has joined #openstack-infra21:11
anteayaSwami: I'm teaching you how to share a url for a logstash view21:11
greghaynesclarkb: cant wait!21:11
anteayaSwami: did what I said make sense to you?21:12
jesusauruspep8, we meet again old foe21:12
Swamianteaya: is makes sense. then let me post you the "url".21:12
anteayaSwami: thank you, please use a shortener21:12
*** dzamboni has quit IRC21:13
anteayaclarkb: how is your doctor?21:13
Swamianteaya: but with the filters on, the url does not have the suffix of the filters.21:13
clarkbanteaya this is a new one. A dermatologist I have never met so we shall see21:13
anteayaSwami: right, go back and read what I said in backscroll21:13
*** salv-orlando has quit IRC21:14
*** zeih has joined #openstack-infra21:14
anteayaSwami: pay attention to where I talk about the share button21:14
anteayaclarkb: oh, I hope this is just an easy visit21:14
*** salv-orlando has joined #openstack-infra21:14
Swamianteaya: http://logstash.openstack.org/#dashboard/file/logstash.json?query=21:14
*** otter768 has joined #openstack-infra21:15
*** nadya has joined #openstack-infra21:15
Swamianteaya: I am not able to see anything appended to the query when I set the filters in the logstash page.21:15
openstackgerritK Jonathan Harker proposed openstack-infra/os-loganalyze: Add Range header support  https://review.openstack.org/24105821:15
openstackgerritGlauco Oliveira proposed openstack-infra/puppet-openstack-health: Fix broken acceptance tests  https://review.openstack.org/24177121:15
*** bcourt has quit IRC21:16
anteayaSwami: see this image: http://imgur.com/dcVnWzb21:17
anteayaSwami: that is the share button21:17
anteayayou need to use that button to share21:18
anteayaphone now back in a bit21:18
*** nadya has quit IRC21:19
*** otter768 has quit IRC21:20
Swamianteaya: I understood what you said about the share button and the above link was the output of my share button21:20
*** heyongli has quit IRC21:21
openstackgerritMerged openstack-infra/system-config: Move playbook to correct location  https://review.openstack.org/24172821:21
*** heyongli has joined #openstack-infra21:21
*** ramashri has joined #openstack-infra21:23
*** akshai has joined #openstack-infra21:23
*** rfolco has joined #openstack-infra21:26
*** e0ne has joined #openstack-infra21:26
*** wenlock__ has joined #openstack-infra21:29
Swamianteaya: https://docs.google.com/presentation/d/1qZXrQ4_wv-OczoPACM107ZcuemL_T_jTuSTZT70ud_Q/edit?usp=sharing21:29
*** rfolco has quit IRC21:29
*** e0ne has quit IRC21:29
*** jamielennox is now known as jamielennox|away21:30
*** bharathm has joined #openstack-infra21:30
*** baoli has joined #openstack-infra21:30
*** heyongli has quit IRC21:31
*** hdd_ has quit IRC21:31
*** bcourt has joined #openstack-infra21:31
*** heyongli has joined #openstack-infra21:32
*** trown|hairscut is now known as trown21:32
*** wenlock__ has quit IRC21:33
*** mwagner has quit IRC21:34
*** jsavak has quit IRC21:35
*** FallenPegasus has quit IRC21:35
*** jamielennox|away is now known as jamielennox21:37
*** rossella_s has quit IRC21:37
*** rossella_s has joined #openstack-infra21:38
timrcmordred: Sorry I had to run and get my daughter from school. Sure.21:39
*** zeih has quit IRC21:39
*** e0ne has joined #openstack-infra21:40
*** baoli has quit IRC21:40
*** e0ne has quit IRC21:41
*** jtomasek has quit IRC21:41
*** heyongli has quit IRC21:41
*** baoli has joined #openstack-infra21:42
*** heyongli has joined #openstack-infra21:42
*** FallenPegasus has joined #openstack-infra21:43
*** fedexo has quit IRC21:44
*** amitgandhinz has quit IRC21:45
*** baoli has quit IRC21:46
*** amitgandhinz has joined #openstack-infra21:46
*** baoli has joined #openstack-infra21:46
openstackgerritMerged openstack/diskimage-builder: debian: cloud hostname ignored by Jessie  https://review.openstack.org/24061421:46
jheskethMorning21:46
*** Piet has quit IRC21:47
*** baoli has quit IRC21:47
*** austin81 has joined #openstack-infra21:49
*** baoli has joined #openstack-infra21:49
anteayamorning jhesketh21:50
*** heyongli has quit IRC21:51
*** jsavak has joined #openstack-infra21:51
anteayaSwami: thanks for your patience, when I input the top query in your paste into logstash and set the timeframe as 6 hours the contents of the following paste is the output of my share button: http://paste.openstack.org/show/478022/21:52
*** heyongli has joined #openstack-infra21:52
*** aysyd has quit IRC21:52
*** baoli has quit IRC21:53
*** baoli has joined #openstack-infra21:53
Swamianteaya: ok good to know21:55
anteayaSwami: can you do the same?21:55
*** rebase has quit IRC21:55
*** tiswanso has quit IRC21:56
*** ad_rien_ has joined #openstack-infra21:56
Swamianteaya: my question is when we have filters configured why it is not converting the filter to query when I hit the share button. Is it only valid for 'query' and not for 'filtering'21:57
anteayaSwami: the filters are used for you to compose a query21:58
anteayathe query is what logstash uses to search the results21:58
*** baoli has quit IRC21:59
anteayaclicking a filter doesn't change the query21:59
anteayayou need to change the query yourself21:59
*** baoli has joined #openstack-infra21:59
anteayathe filter just gives you additional information so you can select what would be useful for your query when you compose it21:59
*** achanda has joined #openstack-infra22:00
Swamianteaya: but this query did not yield anything, did you see any results for this query22:00
anteayaSwami: the query you linked to in your share button output?22:00
Swamianteaya: yes22:01
anteayawhat you gave me is the same as I would get if I just navigated to logstash.openstack.org and didn't put anything in the query bar22:01
*** heyongli has quit IRC22:02
Swamianteaya: I tried to create one from my original pastebin that I posted.22:02
anteayaokay22:02
*** heyongli has joined #openstack-infra22:02
anteayaso do you see the blue button on the top left hand side22:02
openstackgerritMoises Trovó proposed openstack-infra/puppet-subunit2sql: Removes prefix of parameters saved as run_metadata  https://review.openstack.org/24178122:03
anteayait has QUERY as the button name22:03
Swamianteaya: yes I understand, I also posted a google link for you with the snapshot of my screen.22:03
*** baoli has quit IRC22:04
*** gildub has joined #openstack-infra22:04
*** baoli has joined #openstack-infra22:04
anteayaSwami: your query field is empty22:05
*** rlandy has quit IRC22:05
Swamianteaya: yes in the screen that I posted it only had the filtering data but not the query. Theoretically this query should generate the same data as the filtering had generated.22:06
anteayadid it?22:06
Swamianteaya: do you agree or not22:06
*** alivigni has quit IRC22:06
anteayaI didn't see it in the link you shared22:06
Swamianteaya: no when I paste the query in the query box it is not generating any data.22:06
anteayaI'm not sure where you have come by your assertion that the filters should populate the query22:06
anteayaI haven't seen it do that in the past22:07
anteayaI didn't see a query in the image of the query box you posted22:07
Swamianteaya: do you see any data populate with the query that sent to you.22:07
anteayayes, I shared the link with you22:07
*** e0ne has joined #openstack-infra22:07
anteayaand will again: http://tinyurl.com/ow6bzxu22:07
*** e0ne has quit IRC22:08
Swamianteaya: yes I am not seeing any data populate into the graph with the query22:09
anteayaoh that one is not showing me data now22:10
Swamianteaya: it was not showing me data even from the beginning for me. That's why I was using the filtering rather than the query22:10
anteayaokay so Swami I am trying to help you learn to share a logstash graph22:10
*** jsavak has quit IRC22:11
Swamianteaya: understood and I learnt how to share the graph. Lesson learned.22:11
Swamianteaya: let us move on22:11
anteayaclarkb: do you have any expectation that logstash filters populate logstash queries?22:11
*** rlandy has joined #openstack-infra22:11
*** heyongli has quit IRC22:12
anteayaadam_g: can you address the comments on https://review.openstack.org/#/c/241328/4 please?22:12
*** heyongli has joined #openstack-infra22:13
clarkbanteaya no22:14
clarkbquery can be used to filer22:14
*** baoli has quit IRC22:16
anteayaclarkb: thank you22:16
*** regXboi has quit IRC22:16
openstackgerritgordon chung proposed openstack/requirements: bump ceilometerclient upper-constraint to latest  https://review.openstack.org/24178622:16
openstackgerritAdam Gandelman proposed openstack-infra/project-config: Rename projects akanda-* -> astara-*  https://review.openstack.org/24132822:17
adam_ganteaya, my bad. musta missed those22:17
*** sdake has joined #openstack-infra22:17
anteayaadam_g: that is okay, i had an earlier question as well22:18
anteayaadam_g: do you want to keep the same gerrit group names or change them?22:18
*** FallenPegasus has quit IRC22:18
adam_ganteaya, oh right, we should rename those as well.  /me updates22:19
openstackgerritgordon chung proposed openstack/requirements: bump ceilometerclient upper-constraint to latest  https://review.openstack.org/24178622:19
anteayaadam_g: thank you22:19
*** FallenPegasus has joined #openstack-infra22:19
*** baoli has joined #openstack-infra22:20
openstackgerritAdam Gandelman proposed openstack-infra/project-config: Rename projects akanda-* -> astara-*  https://review.openstack.org/24132822:20
*** abregman has joined #openstack-infra22:20
anteayaadam_g: thank you22:21
adam_ganteaya, np. good catch, thanks22:21
*** heyongli has quit IRC22:22
anteayawelcome, thanks for the quick respin22:22
*** heyongli has joined #openstack-infra22:23
ianwgreghaynes: vaguely trying to catch up with scrollback -- so is the wheel caching thing still something you're working on?22:23
*** dkranz has quit IRC22:24
openstackgerritXicheng Chang proposed openstack-infra/project-config: Moving compass-install from stackforge to openstack namespace  https://review.openstack.org/24178822:24
*** FallenPegasus has quit IRC22:24
anteayaclarkb: and there is our last expected rename patch if you want to -2 24178822:25
greghaynesianw: tl;dr is https://review.openstack.org/#/q/status:open+branch:master+topic:feature/wheel-mirror,n,z needs to be rebased / conflict resolved. I am occupied with some other stuff for a bit so if someone wants to do that it would be awesome, otherwise I'll probably get to it in a few hours.22:26
*** daemontool has joined #openstack-infra22:26
greghaynesOnce that happens and they are reviewed/merged an infra-rooter needs to go boot up the new wheel mirror slaves22:26
*** doug-fish has quit IRC22:26
*** achanda has quit IRC22:26
jeblairgreghaynes, sdague: are you aware of each other's work?22:27
greghaynesjeblair: The sdague work being the dib element which builds an in-image wheelhouse?22:28
jeblairgreghaynes: yeah22:28
greghaynesOr is there something else I am unaware of...22:28
jeblairi think this may be what ianw was getting at22:28
greghaynesjeblair: Then yep, I think were on the same page22:28
greghaynesoh22:28
*** peristeri has quit IRC22:28
greghaynesjeblair: So the in image change merged I thought, it just has the issues where it is going to install all those deps in our images22:29
greghayneshttps://review.openstack.org/#/c/241692/322:29
jeblairgreghaynes: it won't actually _install_ anything though, right?22:29
greghaynesActually, how will that work. It should require a bunch of system package deps we dont have installed22:30
*** peterlisak has quit IRC22:30
greghayneslike, lxml22:30
*** achanda has joined #openstack-infra22:30
*** sdake_ has joined #openstack-infra22:30
jeblairgreghaynes: hopefully it was tested; otherwise i guess we're going to test it in production in about 16 hours22:30
*** sdake has quit IRC22:31
greghayneshah22:31
* ianw counts down to mordred suggesting we do it in docker in 3 ... 2 ... :)22:31
*** baoli has quit IRC22:31
jeblairgreghaynes: so how does sdague's thing relate to your thing?22:32
*** baoli has joined #openstack-infra22:32
*** heyongli has quit IRC22:32
*** mmedvede has quit IRC22:32
*** mmedvede has joined #openstack-infra22:33
greghaynesjeblair: We dont need to build the in-image wheel cache if we use the wheel mirrors instead (which is my thing)22:33
*** heyongli has joined #openstack-infra22:33
*** baoli has quit IRC22:37
*** mriedem has quit IRC22:37
*** baoli has joined #openstack-infra22:37
fungijeblair: greghaynes: https://review.openstack.org/24175622:38
greghaynesaha22:38
*** sabeen has quit IRC22:39
openstackgerritIan Wienand proposed openstack-infra/project-config: Create jobs for a wheel mirror  https://review.openstack.org/16492722:39
jeblairgreghaynes: validation! :) fungi: +#22:39
ianwgreghaynes: ^ there's one ... if i'm going to review it, might as well understand it :)22:39
jeblairor something like that22:39
austin81Hey all. Myself and timothyb89 would like to get our tempest-run viz tool, StackViz (https://git.openstack.org/cgit/openstack/stackviz/), onto d-g images to work with upstream logs. What is the proper way to go about this? Thanks22:40
greghaynesianw: sweet, thanks!22:40
austin81ianw, nibalizer, clarkb, sdague: ^^22:40
ianwaustin81: what's the end goal?  run something at the end of devstack-gate to produce and output stored in logs?22:41
ianws/and/an22:42
austin81ianw: Correct. we would like to run it at the end of d-g runs so the dashboard is on the logs server and easily accessible22:42
fungiaustin81: the dashboard is stateless then?22:42
austin81ianw: our problem is that we are working with a lot of deps that would take a considerable amount of time to install every run22:43
*** heyongli has quit IRC22:43
timothyb89fungi: the dashboard code is, it uses some static files + processed data files for each run22:43
fungiaustin81: we're actively trying to reduce the number of things we preinstall. if it can be cached in the image and then installed during the job from the cached files/packages that might be doable22:43
*** heyongli has joined #openstack-infra22:43
ianwaustin81: like having a mysql database?  (just notcing mysql-python installed)22:43
greghaynesaustin81: When you say they take a long time to install, are you talking about python deps?22:44
austin81ianw: That dep should not be on there. greghaynes we are more concered about npm modules22:44
timothyb89greghaynes: the static files are mainly html+js which need npm + lots of deps to build22:45
greghaynesoh wow22:45
timothyb89"lots" meaning ~5 minutes of build time, a similar setup is being run for test/lint jobs for openstack-health currrently22:45
greghaynestimothyb89: Can you all maybe make a package out of that static data somehow which is more quickly installble?22:45
greghaynestimothyb89: I am guessing it is doing minimize and such?22:46
openstackgerritMerged openstack-infra/project-config: Revert "warm pip wheel cache during image build"  https://review.openstack.org/24175622:46
*** baoli has quit IRC22:46
timothyb89greghaynes: that's correct, fundamentally we're trying to find out the best way + place to build all the static html and js22:46
*** EricGonc_ has quit IRC22:47
ianwi'm almost thinking devstack plugin, but presumably you want it on every job22:47
fungiseems like it would be a good possibility for a devstack feature22:48
*** mwagner has joined #openstack-infra22:48
timothyb89we're open to any possibilities, we're targeting tempest runs though22:48
*** baoli has joined #openstack-infra22:48
fungithough i don't know how open the devstack maintainers would be to that suggestion22:48
fungiahh, yeah if it's a tempest-only thing then maybe not built into devstack22:49
austin81fungi: We figured it would be easier to get it hosted upstream than to add it to devstack22:49
timothyb89related: we have an old demo patch up that shows off the end goal: https://review.openstack.org/#/c/212207/22:49
*** julim has quit IRC22:49
greghaynestimothyb89: This isnt a totally new problem, but I am not really current on the state of things. It sounds really similar to the horizon/xstatic package stuff.22:50
greghaynesI am not sure if we decided that is something we hate or not22:50
zaroclarkb: what did i miss?  was the problem a corrupted jjb cache?22:50
greghaynesbut basically they compile static resources, put them in a python package, and then install that22:50
*** Swami has quit IRC22:51
anteayazaro: I think the issue was that clark was running the sudo command from his homedir22:51
fungizaro: doesn't sound like the cache was corrupt, just that clarkb running it under sudo without -H was causing it not to update root's copy of the cache22:51
*** tonytan4ever has quit IRC22:51
anteayazaro: rather than as root22:51
clarkbyup that22:52
openstackgerritMonty Taylor proposed openstack-infra/requestsexceptions: Fix typos  https://review.openstack.org/24143022:52
ianwaustin81 / timothyb89 : are you familiar with the existing subunit2sql stuff ?  if this is really heavyweight, maybe it should be done via a gearman worker?  what does it consume?22:52
jeblairmordred: ? ^22:52
fungigreghaynes: i think the js purists were unhappy using not-the-js-packaging-ecosystem to install js dependencies22:52
mordredjeblair: I squahsed two changes so that they can pass the gate22:52
greghaynesfungi: ah22:53
*** heyongli has quit IRC22:53
timothyb89ianw: once the static bits are built, it's pretty lightweight. the data processing is just a small step to convert subunit logs -> json22:53
greghaynesfungi: any idea if there is an alternative solution now?22:53
fungigreghaynes: however i think node.js is only just recently getting around to being able to use arbitrary package repositories, custom mirrors, et cetera22:53
*** austin81 has quit IRC22:53
fungigreghaynes: er, npm specifically i mean22:53
greghaynesfungi: Yea, AIUI the issue is that node mirrors are a pain22:53
*** heyongli has joined #openstack-infra22:54
timothyb89ianw: (the data processing is also just a small python module, so nothing crazy to worry about there)22:54
fungias evidenced by eth failure rate on the horizon job using npm to install its bits22:54
zaroasselin: ping22:54
greghayneskrotscheck: ^ I think you know the state of these things22:54
openstackgerritBertrand Roussel proposed openstack-infra/jenkins-job-builder: Fix default result for reverse trigger  https://review.openstack.org/24180222:54
anteayaclarkb: can you -2 241788 please?22:55
krotscheckYes, node mirrors are a pain22:55
openstackgerritMerged openstack-infra/requestsexceptions: Fix typos  https://review.openstack.org/24143022:55
*** dramalho has quit IRC22:55
mordredwoot!22:55
greghayneskrotscheck: Are there projects / some jobs that currently use custom made node packages?22:55
ianwtimothyb89: so i'm really starting to think you might fit well into the "consume from gearman model".  you can easily consume the output from finished jobs.  only trick might be putting the final output back22:55
greghayneskrotscheck: Or said differently, if some folks want to make a node package of some compiled static content is there a workflow for them to do that?22:55
krotscheckgreghaynes: You're going to have to be more specific. Do you mean referring to a package by git url?22:55
jeblairmordred: i think we're ready for 1.1.1?22:56
krotscheckgreghaynes: Oh. Yes. See the configuration for eslint-config-openstack.22:56
mordredjeblair: yup!22:56
mordredjeblair: sounds like a great version22:56
ianwtimothyb89: also, that means you only need to worry about setting up your job on one platform.  otherwise, you'll need to cover running stackviz on ubuntu/fedora/centos/whatever every time22:56
greghaynestimothyb89: ^ See what krotscheck said :)22:56
jeblairpushed22:56
mordredjeblair: I have excitement22:56
greghaynesianw: It sounds like the running their program isnt the issue, it is just installing it. The gearman thing kind of sidesteps it though because it is a long run service then...22:57
mordredjeblair: it's not on pypi yet. maybe I should be more patient22:57
jeblairmordred: it's building a tarball22:57
mordredjeblair: sloooooooow22:57
jeblairmordred: it's uploading a tarball22:57
mordredit's done!22:57
greghaynesianw: The nice thing about installing it per job is then infra isnt in charge of it :)22:58
jeblairmordred: now we need to wait for bandersnatch22:58
mordredoh. right. bandersnatch22:58
*** dprince has quit IRC22:58
*** austin81 has joined #openstack-infra22:58
*** sabeen has joined #openstack-infra22:58
*** rguillebert has quit IRC22:58
ianwgreghaynes: right, but either way it's your (our) problem :)  if it's going to be a dib element, etc, then we have to have it going on every platform22:59
*** pc_m has quit IRC22:59
jeblairmordred: keep reloading this page! http://pypi.dfw.openstack.org/simple/requestsexceptions/22:59
*** baoli has quit IRC23:00
ianwtimothyb89: to be concrete, take a look at -> https://git.openstack.org/cgit/openstack-infra/puppet-subunit2sql/tree/files/subunit-gearman-worker.py ; i imagine you'd have a similar thing, that consumes the logs and passes it to stackviz23:00
greghaynesianw: I dont think we want a dib element either. If they were able to make and upload an npm/pip/other package and install it then its just up to them to make that pacakge DTRT23:00
*** baoli has joined #openstack-infra23:00
greghaynesianw: the element has the same issue as the wheel cache - we would have the deps to build the package in our images23:00
*** asettle has joined #openstack-infra23:00
tonybjlvillal: Ahh indeed, thanks for the fixes.  I'll add that to my mental list of review checks23:00
mordredjeblair: yay it's there!23:00
ianwgreghaynes: bit it *requires* npm?  which means that has to be installed and deployed on the image, etc23:00
tonybjlvillal: that can only slip by for meetings that haven't happend yet :(23:00
fungiianw: it can be installed and deployed during the job23:01
greghaynesianw: Yea, so that would be installed at job run time23:01
*** bharathm_ has joined #openstack-infra23:01
greghaynesfungi: O/23:01
fungibut it sounds like its installation needs to become more efficient (was estimated at 5 minutes to install--doesn't exactly sound "lightweight")23:01
greghaynesYep, so they should make a package which is the post-compiled content23:02
*** abregman has quit IRC23:03
*** heyongli has quit IRC23:03
*** bharathm has quit IRC23:03
*** pradk has quit IRC23:04
*** maishsk_ has joined #openstack-infra23:04
*** maishsk has quit IRC23:04
*** maishsk_ is now known as maishsk23:04
*** sigmavirus24 is now known as sigmavirus24_awa23:04
*** heyongli has joined #openstack-infra23:04
*** rguillebert has joined #openstack-infra23:04
timothyb89ianw, greghaynes, krotscheck: awesome, thanks for the advice! we'll take a look at gearman, it definitely sounds like it could do what we need23:06
austin81ianw, greghaynes, krotscheck: yes, thanks all!23:06
ianwfungi / greghaynes : i dunno, it still feels like having one worker that has the tool installed consuming the results seems like a pretty good solution.  it really doesn't sound like we need every single test node going through this all the time23:07
jlvillaltonyb, Happy to help :) I figured the replace() handles the case where it does slip by.23:07
jlvillaltonyb, Hard to remember everything to check!23:08
greghaynestimothyb89: austin81 hah, sorry, I think you all want to look at what eslint-config-openstack does (in project-config repo)23:08
fungiianw: i'm not opposed to the idea of hosting it as a service if there's sufficient interest. we'd need a spec with the necessary details in it to be able to evaluate the maintenance costs23:09
greghaynesianw: Installation of the compiled bits *should* be fast, or there is something else silly going on. The only argument I can see for doing a long-lived worker is if the actual procesing takes a long time, but then were going to have to do the extra work of running a cluster of workers and scaling that out23:09
*** sridhar_ram has quit IRC23:09
greghaynesfungi: ++23:09
greghaynesbasically, I would start installing it in nodes because thats low cost to us, if we hit issues there then we can combat them.23:10
*** gondoi is now known as zz_gondoi23:10
*** baoli has quit IRC23:11
*** baoli has joined #openstack-infra23:12
ianwgreghaynes: only issue is yes it is low cost now, but it can be painful later on when we want to do things to the nodes (upgrade, etc) and have all these dependencies stacked upon it.  so don't want to see us save pennies but cost pounds :)23:13
*** dvlwrk_ has quit IRC23:13
openstackgerritMonty Taylor proposed openstack-infra/shade: WIP Crazy Patch involving metaclass  https://review.openstack.org/24180823:13
*** heyongli has quit IRC23:13
greghaynesianw: I dont see how upgrading is harder? I think it is actually significantly easier because it will always just install the most recent version rather than having to maintain a pet.23:14
openstackgerritMonty Taylor proposed openstack-infra/shade: Use the requestsexceptions library  https://review.openstack.org/24130723:14
openstackgerritMonty Taylor proposed openstack-infra/shade: Don't warn on configured insecure certs  https://review.openstack.org/24121523:14
*** trown is now known as trown|outttypeww23:14
openstackgerritPaul Belanger proposed openstack-infra/system-config: Create stackalytics.o.o under -infra  https://review.openstack.org/19076523:14
jeblairmordred: erm, why did https://jenkins05.openstack.org/job/gate-shade-pep8/327/console fail?23:14
*** heyongli has joined #openstack-infra23:14
mordredjeblair: I rechecked it too quickly23:14
jeblairmordred: it says it installed 1.1.1...?23:15
pabelangerpleia2: ^ you'll need to add another hiera key for stackalytics.o.o, and also create a new service account to stream events from gerrit.23:15
mordredoh. hrm23:15
mordredI don't know - it worked for me locally?23:15
pabelangerpleia2: added some info into the docs about it23:15
timrcjeblair: Didn't see any updates in the ethercalc.  Assuming no more testing was done?23:15
mordredand the other time we tested that same patch23:15
jeblairtimrc: running now23:15
mordredoh - I mean- wait - lemme try23:15
*** tlian2 has joined #openstack-infra23:15
*** otter768 has joined #openstack-infra23:16
timothyb89ianw: would a gearman worker be able to make use of node/npm? that's our biggest issue ATM, solving the CI problem23:16
ianwtimothyb89: it's just puppet, it could get on there23:17
mordredjeblair: well, there is a pep8 error in shade with that patch - but I do not know why it did not show us that instead of just failing23:17
timothyb89ianw: ah ha, alright, awesome23:17
jeblairmordred: yeah, i'm at the same place...23:17
jeblairmordred: i'll fix23:17
mordredjeblair: k. also - unittest fails23:17
timrcjeblair: cpu allocation looks up... bigger test?23:17
ianwtimothyb89: if i were you, i might write up an etherpad and flesh out some of the ideas -- devstack, project-config job, nodepool element, subunit2sql approach -- get some reviews then bring it up in the meeting23:18
jeblairtimrc: yep, 2023:18
timothyb89ianw: sure, that's a good idea23:18
openstackgerritJames E. Blair proposed openstack-infra/shade: Use the requestsexceptions library  https://review.openstack.org/24130723:18
jeblairmordred: i did not fix the unittest failure23:18
mordredjeblair: I got it23:18
*** tlian has quit IRC23:19
openstackgerritMonty Taylor proposed openstack-infra/shade: Use the requestsexceptions library  https://review.openstack.org/24130723:19
mordredokie. that should do it23:19
openstackgerritMonty Taylor proposed openstack/requirements: Add requestsexceptions to global requirements  https://review.openstack.org/24132423:21
*** otter768 has quit IRC23:21
Shrewsmordred: Should I be scared that you are still thinking metaclasses for something?23:21
mordredShrews: I pushed it up so that I could reset my repo locally and not lose the patch23:21
openstackgerritIan Wienand proposed openstack-infra/system-config: Add wheel_mirror_slaves that use pypi-mirror  https://review.openstack.org/16524023:21
greghaynesmordred: silly question - where is the requestexceptions git repo?23:21
Shrewsah  *phew*23:22
mordredgreghaynes: openstack-infra23:22
*** burgerk has quit IRC23:22
ianwgreghaynes: ^ i think that system-config one just got caught up in those fake merge-failures we had a while ago23:22
*** baoli has quit IRC23:22
greghaynesah23:22
ddieterlyseeing this when running the devstack-gate manually http://paste.openstack.org/show/478028/23:22
*** bharathm has joined #openstack-infra23:23
*** baoli has joined #openstack-infra23:23
*** heyongli has quit IRC23:24
*** thorst_ has quit IRC23:24
*** heyongli has joined #openstack-infra23:24
*** bharath__ has joined #openstack-infra23:25
*** bharathm has quit IRC23:25
*** edmondsw has quit IRC23:25
ianwddieterly: apt-get install python-yaml, or similar23:26
ianwddieterly: check the readme ... did you run the puppet stuff first?23:26
jeblairmordred: 307 passes pep8 and unit tests!23:27
*** bharathm_ has quit IRC23:27
jeblairmordred: i'll go ahead and send the announcement23:27
mordredjeblair: w00t!23:27
ddieterlyianw: yes, i ran all the puppet stuff23:29
ianwddieterly: did it work?  it seems odd you'd get past that without python yaml bindings installed23:29
ddieterlyyes, it worked23:29
ddieterlyi have done an apt-get autoremove since then though23:30
ddieterlymaybe that messed things up23:30
jeblairmordred: http://lists.openstack.org/pipermail/openstack-dev/2015-November/078479.html23:30
jeblairgreghaynes: ^23:30
mordredjeblair: https://review.openstack.org/24181423:30
ddieterlypython-yaml is already installed23:30
ianwddieterly: that is quite possible, because puppet probably installed python-yaml, but possibly no other packages depend on it23:30
*** wenlock__ has joined #openstack-infra23:31
ddieterlyianw: python-yaml is already the latest version23:31
greghaynesjeblair: wow23:31
*** gordc has quit IRC23:31
ianwddieterly: what does python -c "import yaml" do?23:31
ddieterly"no file named yaml"23:32
greghaynesjeblair: That explanation is exceptional.23:32
* greghaynes hides23:32
ddieterlyianw: actually, "no module named yaml"23:33
*** spzala has quit IRC23:33
jeblairgreghaynes: the explanation is >2x the length of the module itself.23:33
*** spzala has joined #openstack-infra23:33
*** mriedem has joined #openstack-infra23:33
*** heyongli has quit IRC23:34
jeblairmordred: that will also turn off SAN and platform warnings; that's desired?23:34
*** amitgandhinz has quit IRC23:35
*** signed8bit is now known as signed8bit_ZZZzz23:35
*** wenlock__ has quit IRC23:35
*** heyongli has joined #openstack-infra23:35
*** baoli has quit IRC23:35
ianwddieterly: well, there's your problem :)  try running with "-v"  and check your paths, make sure you haven't defaulted "python" to python3, stuff like that23:36
ianwgreghaynes: just so i got it -- pypi-mirror is going to run, consuming global requirements.txt and spit out wheels into the mirror?23:37
*** asettle has quit IRC23:37
greghaynesianw: Yep23:37
ianwergo, we have wheels of all global requirements23:37
*** asettle has joined #openstack-infra23:37
ianwgreghaynes: but what about binary dependencies?23:37
greghaynesianw: Exactly. It actually used to exist before, we just deleted it when we switched to bandersnatch.23:37
clarkbwe actually need it to use constraints now23:38
greghaynesianw: Which ones? The binary deps to build the wheels will need to be on the wheel builder slaves. Devstack already installs the deps needed to run23:38
clarkbI think23:38
greghaynesclarkb: yes23:38
greghaynesclarkb: I actually just remembered that and then got distracted23:38
greghaynesclarkb: I think that is a pypi-mirror fix though23:39
*** aeng has joined #openstack-infra23:39
*** signed8bit_ZZZzz is now known as signed8bit23:39
*** austin81 has left #openstack-infra23:39
ianwgreghaynes: yeah, but where is that install of the packages to build done to the slaves?23:39
ddieterlyianw: yeah, my machine is hosed23:40
ddieterlythanks23:40
greghaynesianw: There isnt. If we need extra deps we probably should specify those in puppet.23:40
*** FallenPegasus has joined #openstack-infra23:40
*** asettle is now known as asettle-afk23:40
*** ddieterly has quit IRC23:41
*** otter768 has joined #openstack-infra23:41
ianwgreghaynes: right, so lxml, cffi seem like requirements23:42
mordredjeblair: I have never found a moment where I have found those warnings useful23:42
greghaynesianw: likely, yep23:42
mordredjeblair: I had not bothered turning them off before just because I didn't have a handy library to :)23:42
greghaynesianw: also xslt and python-dev23:42
ianwgreghaynes: but, devstack has tools/install_prereqs.sh maybe we should run that?23:42
*** baoli has joined #openstack-infra23:43
greghaynesianw: hrmmmm, I think it should be separate - we dont need devstack to install builder deps23:43
*** heyongli has quit IRC23:44
jeblairmordred: k23:44
ianwgreghaynes: but how we going to know when something isn't building due to missing binary requirements?23:45
*** jaypipes has quit IRC23:45
*** heyongli has joined #openstack-infra23:45
greghaynesianw: Yep, that is a problem either way.23:46
jeblairmordred: http://logs.openstack.org/14/241814/1/check/gate-os-client-config-requirements/021df69/console.html23:46
jeblairmordred: does that mean you have to add the "# Apache-2.0" comment to the reqs file in occ?23:47
mordredjeblair: ugh. does it?23:47
mordredjeblair: I resubmitted with that23:48
mordredjeblair: while we're waiting - +2 on https://review.openstack.org/#/c/241215/ ?23:48
*** akshai has quit IRC23:51
openstackgerritMerged openstack-infra/irc-meetings: Replace hyphens with underscores for meeting_id  https://review.openstack.org/24170123:51
openstackgerritMerged openstack-infra/elastic-recheck: Add query for large ops net dealloc timeout failure  https://review.openstack.org/24171323:51
*** baoli has quit IRC23:52
*** bexelbie has quit IRC23:52
*** baoli has joined #openstack-infra23:53
zaroclarkb, anteaya : ok. i read some of the old email on last upgrade and indeed the '//' did occur on review.o.o so i'm looking to see if i can repro on my dev env again. last time i was not able to.23:53
*** dingyichen has joined #openstack-infra23:53
*** ramashri has quit IRC23:53
zarohttp://lists.openstack.org/pipermail/openstack-infra/2015-May/002745.html23:53
*** asettle-afk is now known as asettle23:54
*** heyongli has quit IRC23:54
jeblairmordred: yeah, reqs check seems happy with that now.23:55
mordredwoot23:55
*** heyongli has joined #openstack-infra23:55
lifelessmordred: jeblair: we currently require that comments be preserved.23:55
lifelessI can see an argument for allowing them to be stripped; or even to differ.23:56
lifelesswe have the tech to do that, but I think its a broad question not a quick-decide one23:56
jeblairlifeless: yeah, i think we just figured that out :)  i don't have a problem with it.23:56
jeblairlifeless: just a novelty is all.23:57
lifelesskk23:57
*** ramashri has joined #openstack-infra23:58
*** sfinucan has quit IRC23:58
mordredlifeless: yup. I actually deleted the comment originally after cut-paste because I could not remember which direction the enforcement went23:58
*** yamamoto has joined #openstack-infra23:59
mordredvim ../openstack/requirements/global-requirements.txt ; dd:q! ; vim requirements.txt ; p:wq23:59
mordredpretty easy23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!