Tuesday, 2014-07-29

*** sdake has quit IRC00:01
*** jaypipes has quit IRC00:01
*** otherwiseguy has quit IRC00:01
*** dims_ has quit IRC00:03
*** zul has quit IRC00:06
*** dkliban has joined #openstack-infra00:07
*** rainya has quit IRC00:09
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Updated project list interface.  https://review.openstack.org/11016900:11
*** vermarah has quit IRC00:12
*** Sukhdev has joined #openstack-infra00:12
*** balajin has joined #openstack-infra00:15
*** balajin is now known as dumbhead00:16
*** marcoemorais has quit IRC00:16
*** dkliban has quit IRC00:18
fungiokay, the last job on jenkins05 just finished, so restarting nodepool real quick now00:19
*** gangil has quit IRC00:20
ianwclarkb / fungi : know you're dealing with issues, when time can i ping you on some things (can bring to meeting tomorrow as well)00:21
ianwhttps://review.openstack.org/#/c/108869/ (Move PATH set earlier)00:21
ianw^ little fix for f20 error, don't think it's causing problems00:21
ianwhttps://review.openstack.org/103458 (Initial RHEL7/Centos7 support) & https://review.openstack.org/109906 (Add centos7 image for rax)00:22
ianw^ any objections to this approach.  i'm running some things by hand, but I'd like to know nodepool can do it00:22
*** rlandy has quit IRC00:22
fungiokay, so rackspace did in fact finally update the ticket, and mentioned that the host on which jenkins05 is resident was "missing network flows, causing packets to not be routed correctly"00:25
*** michchap_ has quit IRC00:25
*** michchap has joined #openstack-infra00:25
*** yamamoto_ has joined #openstack-infra00:26
fungiwe can choose to take an outage and proactively migrate jenkins05 to another host with their help, if we want to avoid the possibility that this is a recurrent issue on the current host00:26
*** craigbr has joined #openstack-infra00:26
fungii'll add it to tomorrow's agenda and we can discuss when more people are around00:26
*** jergerber has quit IRC00:26
fungijenkins05 nodes are properly getting marked used when they start running jobs now, so we should be in the clear00:27
*** yamamoto has quit IRC00:28
*** r1chardj0n3s is now known as r1chardj0n3s_afk00:29
*** wenlock has quit IRC00:29
*** sdake has joined #openstack-infra00:29
*** sdake has quit IRC00:29
*** sdake has joined #openstack-infra00:29
*** dustins has joined #openstack-infra00:31
*** r1chardj0n3s_afk is now known as r1chardj0n3s00:32
*** dustins has quit IRC00:34
*** julim has joined #openstack-infra00:38
*** dmsimard_away is now known as dmsimard00:38
*** julim has quit IRC00:38
*** julim has joined #openstack-infra00:40
*** bdpayne has quit IRC00:40
*** dkliban has joined #openstack-infra00:42
*** marcoemorais has joined #openstack-infra00:43
*** homeless has quit IRC00:43
*** hemna is now known as hemna_00:47
*** achanda has quit IRC00:52
*** gyee has quit IRC00:52
*** dkliban has quit IRC00:55
*** otter768 has joined #openstack-infra00:55
*** dmsimard is now known as dmsimard_away00:57
*** camunoz has quit IRC01:00
*** stevemar has joined #openstack-infra01:01
*** zns has quit IRC01:05
*** dimtruck is now known as zz_dimtruck01:05
*** yamamoto_ has quit IRC01:06
*** yaguang has joined #openstack-infra01:06
*** otter768 has quit IRC01:07
*** zz_dimtruck is now known as dimtruck01:07
*** otter768 has joined #openstack-infra01:11
anteayafungi: I am not sure if i will be present at tomorrow's meeting but based on data thus far I'm for migrating jenkins0501:11
*** banix has joined #openstack-infra01:15
*** camunoz has joined #openstack-infra01:19
*** markwash_ has quit IRC01:23
*** aysyd has quit IRC01:30
*** Sukhdev has quit IRC01:33
*** daya_k has joined #openstack-infra01:34
*** xianghui has joined #openstack-infra01:36
redrobotSergeyLukjanov you around?01:39
*** rfolco has joined #openstack-infra01:41
*** rwsu has quit IRC01:42
*** camunoz has quit IRC01:43
*** baohua has joined #openstack-infra01:46
*** jyuso has joined #openstack-infra01:46
openstackgerritIan Wienand proposed a change to openstack-infra/config: Add experimental Centos7 job  https://review.openstack.org/11017801:46
*** yamamoto_ has joined #openstack-infra01:47
*** gangil has joined #openstack-infra01:47
*** nosnos has joined #openstack-infra01:48
*** amotoki has joined #openstack-infra01:49
*** otherwiseguy has joined #openstack-infra01:49
*** amotoki has quit IRC01:51
*** camunoz has joined #openstack-infra01:56
*** craigbr has quit IRC01:58
*** shashankhegde has joined #openstack-infra01:58
fungiokay, i've nova deleted 145 orphaned nodepool instances. more than half were in hpcloud-b502:01
*** otherwiseguy has quit IRC02:01
fungiand zuul seems to have caught up with the allocation demand now02:02
*** stevemar has quit IRC02:03
*** otter768 has quit IRC02:04
*** otter768 has joined #openstack-infra02:06
*** craigbr has joined #openstack-infra02:08
*** bdpayne has joined #openstack-infra02:11
*** yamahata has quit IRC02:16
*** otherwiseguy has joined #openstack-infra02:20
*** asettle has quit IRC02:21
*** asettle has joined #openstack-infra02:21
*** masayuki_ has joined #openstack-infra02:29
*** masayukig has quit IRC02:29
*** otherwiseguy has quit IRC02:29
*** masayukig has joined #openstack-infra02:34
*** dimtruck is now known as zz_dimtruck02:35
*** otherwiseguy has joined #openstack-infra02:35
*** angdraug has quit IRC02:38
*** shashankhegde has quit IRC02:39
*** shashankhegde has joined #openstack-infra02:39
*** Ryan_Lane has quit IRC02:43
*** rainya has joined #openstack-infra02:44
*** unicell has joined #openstack-infra02:47
*** penguinRaider__ has quit IRC02:49
*** shashankhegde has quit IRC02:51
*** praneshp has joined #openstack-infra02:51
*** penguinRaider__ has joined #openstack-infra02:52
*** rainya has quit IRC02:54
*** praneshp_ has joined #openstack-infra02:54
*** rainya has joined #openstack-infra02:54
*** praneshp has quit IRC02:56
*** praneshp_ is now known as praneshp02:56
*** dkliban has joined #openstack-infra02:56
*** stevemar has joined #openstack-infra03:00
*** harlowja is now known as harlowja_away03:07
*** harlowja_away is now known as harlowja03:08
*** craigbr has quit IRC03:13
*** otherwiseguy has quit IRC03:15
*** terryw has joined #openstack-infra03:15
*** nosnos has quit IRC03:20
*** shashankhegde has joined #openstack-infra03:21
*** lttrl has quit IRC03:22
*** terryw has quit IRC03:23
*** otherwiseguy has joined #openstack-infra03:23
openstackgerritA change was merged to openstack-infra/devstack-gate: Move PATH set earlier  https://review.openstack.org/10886903:24
*** otter768 has quit IRC03:25
*** banix has quit IRC03:32
*** mestery_ has joined #openstack-infra03:34
*** mestery has quit IRC03:36
*** craigbr has joined #openstack-infra03:37
*** shashankhegde has quit IRC03:38
*** markwash has joined #openstack-infra03:41
*** mestery_ has quit IRC03:46
*** stevemar has quit IRC03:46
*** stevemar has joined #openstack-infra03:46
*** markwash has quit IRC03:47
*** craigbr has quit IRC03:47
*** flaviof_zzz is now known as flaviof03:49
*** amotoki has joined #openstack-infra03:55
*** mestery has joined #openstack-infra03:56
*** mestery_ has joined #openstack-infra03:59
*** mestery has quit IRC04:02
*** otherwiseguy has quit IRC04:04
*** otherwiseguy has joined #openstack-infra04:05
*** asettle has quit IRC04:06
*** alexandra has joined #openstack-infra04:06
*** alexandra is now known as asettle04:06
*** Sukhdev has joined #openstack-infra04:07
*** mestery_ has quit IRC04:11
*** armax has quit IRC04:15
*** chandankumar has joined #openstack-infra04:15
lifelessjeblair: mordred: btw http://kanboard.net/ crossed my desk recently (as a opensource trello-alike) - I haven't tested it yet04:16
*** nosnos has joined #openstack-infra04:16
greghayneskhannnboard04:16
greghaynesim sure no one has ever made that joke04:16
*** otherwiseguy has quit IRC04:19
*** mestery has joined #openstack-infra04:21
*** armax has joined #openstack-infra04:22
*** david-lyle has joined #openstack-infra04:25
*** wenlock has joined #openstack-infra04:27
*** Ryan_Lane has joined #openstack-infra04:29
*** Ryan_Lane has joined #openstack-infra04:29
*** Ryan_Lane has quit IRC04:30
*** timrc is now known as timrc-afk04:31
*** armax has quit IRC04:33
*** Ryan_Lane has joined #openstack-infra04:34
*** yfried has quit IRC04:35
*** craigbr has joined #openstack-infra04:39
*** HenryG is now known as HenryG_afk04:45
*** morganfainberg is now known as morganfainberg_Z04:59
tchaypor1chardj0n3s: i assume you're going to be in brisbane?05:00
*** david-lyle has quit IRC05:00
*** afazekas is now known as __afazekas05:00
r1chardj0n3sYep tchaypo05:00
*** david-lyle has joined #openstack-infra05:00
tchaypocool. I've been trying out devpi as a replacement for pypi-mirror05:01
tchaypoMay want to talk to you about the wheel caching05:03
tchaypoheh.05:03
* tchaypo was reading a mailing list post and thinkging "gosh this guy makes sense"05:03
tchaypoand then realised it was my own email..05:03
tchaypobut i think we can probably get away with using devpi as a proxy, and a pip wheel cache + greghaynes suggestion of a bind mount05:04
*** david-lyle has quit IRC05:05
*** david-lyle has joined #openstack-infra05:05
*** otherwiseguy has joined #openstack-infra05:06
*** craigbr has quit IRC05:07
StevenKtchaypo: The pypi element does a bind mount already, I think05:07
*** rainya has quit IRC05:10
tchaypoit mounts ~/.cache/image-create/pypi/mirror05:11
tchaypoand i can see whls inside that directory05:12
*** david-lyle has quit IRC05:12
dstufftare they nice wheels05:12
tchaypoi don't know. what does a nice wheel look like?05:12
*** david-lyle has joined #openstack-infra05:12
dstufftdunno :)05:13
StevenKtchaypo: http://www.salestrailers.com.au/media/catalog/product/cache/1/image/9df78eab33525d08d6e5fb8d27136e95/r/t/rt1_mag_wheel_14inch.jpg05:14
StevenKLike that05:14
* StevenK ducks05:14
tchaypo+ pip install -U 'setuptools>=1.0'05:14
tchaypohttp://localhost:3141/root/pypi/+simple/setuptools/ uses an insecure transport scheme (http). Consider using https if localhost:3141 has it available05:14
tchaypoDownloading/unpacking setuptools>=1.0 from http://localhost:3141/root/pypi/+f/5b7/b07029ad2285d/setuptools-5.4.1-py2.py3-none-any.whl#md5=5b7b07029ad2285d1cbf809a8ceaea0805:14
tchaypo  Using download cache from /tmp/pip/http%3A%2F%2Flocalhost%3A3141%2Froot%2Fpypi%2F%2Bf%2F5b7%2Fb07029ad2285d%2Fsetuptools-5.4.1-py2.py3-none-any.whl05:14
tchaypoit looks to me like we're actually already using wheels from that repo05:14
tchaypogreghaynes: clarkb: sounds to me like our new reccomendation is that people should install devpi and use the pypi element?05:14
StevenKtchaypo: How did bandersnatch break for you? I'm having no issues with it, aside from the use of ~100GiB of disk05:15
StevenKHowever, that fileserver has 1.6TiB of disk free, so I can't complain too much05:16
tchaypoi hadn't run it for about a month... the first few runs took hours, and as you found, each run only brings it incrementally closer to up-to=date05:16
tchayposo i have to run it over and over and over and it takes an indeterminate amou nt of time to catch up and I can never tell how close it is to being up-to-date05:16
*** david-lyle has quit IRC05:17
tchaypoand 100Gi is a lot of disk05:17
StevenKOn an SSD laptop, sure05:17
tchaypoon any laptop05:17
StevenKIf you have 1TiB spinning rust, you might be able to swing it05:18
tchaypobut why?05:18
tchaypo98% of the files in there are never going to be used05:19
StevenKtchaypo: Offline builds, but a up-to-date devpi might help too05:19
tchaypothe only time an up-to-date devpi won't help is if there's a new requirement not in cache05:20
tchaypoand even then devpi will get the updated package immediately with minimum bandwidth, bandersnatch would have to download umpteen gigs of unrelated changes to packages I don't care about05:20
* tchaypo is thinking about how to work wandering around europe with minimal connectivity05:20
*** shashankhegde has joined #openstack-infra05:20
StevenKtchaypo: I find my mirror syncs roughly 300 packages every morning, but it doesn't tell me how large they were.05:21
StevenKIf bandersnatch also logged size of the objects it was fetching, I could actually work it out05:22
r1chardj0n3stchaypo: sorry, I was in transit for a bit there. Yes, I'd love to talk devpi/etc at pyconau. I'm even giving a talk about devpi etc :)05:22
dstufftmost people aren't going to run bandersnatch on a laptop unless they spend a lot of time with no connectivity and the need to install random crap05:26
*** afazekas has joined #openstack-infra05:26
*** harlowja is now known as harlowja_away05:26
lifelessdstufft: oh hai, did you just name me by usecase ?05:27
dstufftlifeless: quite possibly ;P05:27
StevenKHaha05:27
r1chardj0n3salso there's the thing about devpi caching all the packages including externals, unlike bandersnatch which can't mirror the externals05:29
dstufftdeath to externals05:30
dstufft:D05:30
r1chardj0n3sgood luck with that :D05:30
lifelessdeatttt05:30
lifelessh05:31
dstufftI'll figure out a way sooner or later05:31
dstufftI'm incorrigable05:31
r1chardj0n3shah. you weren't in the conversations I was in at EP :P05:31
*** Sukhdev has quit IRC05:31
dstufftr1chardj0n3s: heh, maybe not, but my speciality is beating my head against a wall until I succeed :D05:32
r1chardj0n3sI suspect the only thing you'll get out of this is a sore head :(05:32
lifelessr1chardj0n3s: what was the conversation05:33
*** ildikov has quit IRC05:34
r1chardj0n3slifeless: not just one but several. the desire to host packages externally is very strong.05:34
dstufftr1chardj0n3s: the desire by whom05:34
dstufftbecause not many are hosted externally05:34
r1chardj0n3son the other hand, witness https://pypi.python.org/pypi/egenix-mx-base/05:34
dstuffthoyl crap, MAL uploaded?05:35
r1chardj0n3sit's an installer05:35
r1chardj0n3sbecause he's just so annoyed with the current shit he has to put up with05:35
r1chardj0n3sso he just works around the issue05:36
*** bdpayne has quit IRC05:36
*** shashankhegde has quit IRC05:36
dstufftMAL was on board with PEP 470 he said ;P05:38
dstufftactually, is this new at all r1chardj0n3s? according to this the copyright on this file is 200005:40
r1chardj0n3syes, it's new (at least to pypi)05:41
*** lukego has joined #openstack-infra05:43
dstufftegenix-mx-base has existed for a long time, since 2002 according to journals, is the web installer part new?05:45
r1chardj0n3syes05:45
*** lukego has quit IRC05:47
Alex_Gaynor'05:50
dstuffthey05:57
dstufftMALs thing actually securely downloads stuff05:57
dstufftso people who use his thing are secure now when before they wern't05:57
dstufftI consider it a success05:57
dstufft:D05:57
r1chardj0n3ssure, but it can't be cached05:58
r1chardj0n3sit's a suboptimal solution for users05:58
r1chardj0n3seven if you consider it a success05:58
dstufftuncacheable is better than insecure05:59
r1chardj0n3sin your opinion :)05:59
*** simonmcc has quit IRC06:00
*** skath has quit IRC06:00
r1chardj0n3sI'm not saying your opinion is *wrong* just that sometimes users have different priorities ;)06:00
dstufftWell those users are wrong06:00
Alex_Gaynoroh my god, I've never seen so many trove classifiers06:00
*** jraim has quit IRC06:00
r1chardj0n3sAlex_Gaynor: just don't look :)06:00
*** zhiyan has quit IRC06:00
Alex_GaynorOperating System :: BeOS06:00
*** harlowja_at_home has joined #openstack-infra06:00
r1chardj0n3s\o/06:00
dstufftI wonder if he tests on BeOS06:01
r1chardj0n3s(it seemed like a good idea at the time, in 2003...)06:01
*** ctracey has quit IRC06:01
r1chardj0n3shell, *trove* seemed like a good idea in 2003. heh.06:02
dstufftcomputers seemed like a good idea in 1946 and look at where we are now06:03
*** Longgeek has joined #openstack-infra06:04
*** serverascode has quit IRC06:04
*** jraim__ has joined #openstack-infra06:05
*** zhiyan has joined #openstack-infra06:05
*** skath has joined #openstack-infra06:06
*** ctracey has joined #openstack-infra06:07
StevenKdstufft: I think I may have to put that quote in my .signature06:07
*** simonmcc_ has joined #openstack-infra06:08
*** otherwiseguy has quit IRC06:09
openstackgerritA change was merged to openstack-infra/infra-manual: Add "Gerrit IRC Notifications" section to infra manual  https://review.openstack.org/10732206:09
*** lukego has joined #openstack-infra06:10
*** serverascode has joined #openstack-infra06:12
*** yfried has joined #openstack-infra06:19
*** simonmcc_ has quit IRC06:22
*** skath has quit IRC06:22
*** serverascode has quit IRC06:22
*** pcrews has quit IRC06:22
*** ctracey has quit IRC06:22
*** zhiyan has quit IRC06:23
tchayposo the other advantage that I see with devpi over pypi-mirror06:24
*** jraim__ has quit IRC06:24
tchaypois that even with my recent hack, it seems as though having a file:/// index is a use case that isn't something developers think about in as much detail as the more common case of a http:// index06:24
r1chardj0n3sdevpi also has --set-cfg which makes everything a lot easier ;)06:25
r1chardj0n3s(and --always-set-cfg)06:25
tchaypodevpi seems lightweight enough that it feels like we should be able to spin up a devpi server just as easily as the pypi-mirror element06:25
tchaypoand where we previously did lots of munging to discover all the dependencies and make sure they were cached in pypi-mirror's folder - with devpi we can just point at the devpi server, 'pip install -r global-requirements.txt', done.06:26
tchaypoput the wheels in a useful place for later re-use and throw away the venv that triggered the download06:27
*** zhiyan has joined #openstack-infra06:28
*** jraim__ has joined #openstack-infra06:28
r1chardj0n3syep. if the devpi is a local one (serving a single system) then wheels can be uploaded to a staging index in it06:28
*** ctracey has joined #openstack-infra06:29
r1chardj0n3ssupporting multiple system types in a single devpi is something I want to see but needs a teensy little bit of support from wheel/pip which I'm hoping to see soon06:29
*** skath has joined #openstack-infra06:29
*** simonmcc_ has joined #openstack-infra06:29
*** serverascode has joined #openstack-infra06:30
*** ildikov has joined #openstack-infra06:31
*** che-arne has quit IRC06:33
*** _nadya_ has joined #openstack-infra06:34
*** chandankumar has quit IRC06:35
*** harlowja_at_home has quit IRC06:38
*** MickeyO has joined #openstack-infra06:39
AJaegerAlex_Gaynor, could you review https://review.openstack.org/#/c/109905/ , please?06:39
*** pblaho has joined #openstack-infra06:42
*** Ryan_Lane1 has joined #openstack-infra06:51
*** Ryan_Lane1 has quit IRC06:52
*** yamamoto_ has quit IRC06:57
*** zns has joined #openstack-infra06:57
*** flaviof is now known as flaviof_zzz06:58
*** wenlock has quit IRC07:16
*** mpaolino has joined #openstack-infra07:16
*** akamyshnikova has quit IRC07:17
*** jcoufal-mobile has joined #openstack-infra07:18
*** cnesa6 has joined #openstack-infra07:18
*** samy__ has joined #openstack-infra07:22
*** jcoufal-mobile has quit IRC07:23
*** flaper87|afk is now known as flaper8707:26
*** samy has joined #openstack-infra07:27
*** samy has left #openstack-infra07:27
*** r1chardj0n3s is now known as r1chardj0n3s_afk07:28
*** __afazekas has quit IRC07:29
*** roeyc has joined #openstack-infra07:30
*** jistr has joined #openstack-infra07:30
*** samy__ has quit IRC07:33
*** luqas has joined #openstack-infra07:33
*** luqas has quit IRC07:35
*** samy_ has joined #openstack-infra07:36
*** samy__ has joined #openstack-infra07:36
*** samy__ has left #openstack-infra07:38
*** luqas has joined #openstack-infra07:39
*** jgallard has joined #openstack-infra07:39
*** stevemar has quit IRC07:46
*** ihrachyshka has joined #openstack-infra07:46
*** jp_at_hp has joined #openstack-infra07:46
*** tnovacik has joined #openstack-infra07:47
*** ihrachyshka has quit IRC07:50
*** gangil has quit IRC07:50
*** ihrachyshka has joined #openstack-infra07:51
openstackgerritChmouel Boudjnah proposed a change to openstack-infra/gerritlib: Python3 support  https://review.openstack.org/11022607:53
openstackgerritChmouel Boudjnah proposed a change to openstack-infra/gerritlib: Python3 support  https://review.openstack.org/11022607:55
*** samy_ has quit IRC07:55
*** samy_ has joined #openstack-infra07:56
*** jpich has joined #openstack-infra07:56
*** samy__ has joined #openstack-infra07:56
*** jistr_ has joined #openstack-infra07:58
*** jistr_ has quit IRC07:59
*** samy_ has left #openstack-infra08:00
*** cnesa6 has quit IRC08:01
*** samy__ has quit IRC08:07
*** andreykurilin has joined #openstack-infra08:09
*** jlibosva has joined #openstack-infra08:18
openstackgerritChristian Berendt proposed a change to openstack-infra/config: Niceness checks for docs should vote  https://review.openstack.org/10955908:19
*** e0ne has joined #openstack-infra08:20
*** praneshp has quit IRC08:22
*** jamielennox is now known as jamielennox|away08:23
jp_at_hpSo can anyone here help me with oslo.rootwrap?  Do the infra team release that to pypi?08:24
lifelesswe can check the zuul config to see08:25
lifelessjp_at_hp: see modules/openstack_project/files/zuul/layout.yaml in openstack-infra/config08:26
lifelessjp_at_hp:   - name: openstack/oslo.rootwrap08:26
lifeless...08:26
lifeless      - name: publish-to-pypi08:26
lifelessso when a tag is pushed to oslo.rootwrap, that will trigger a release to pypi08:26
jp_at_hpSure - it was more to ask why pypi.org has 1.3.0.0a1 or whatever and pypi.openstack.org hasn't mirrored that version...08:26
lifelessoh08:27
*** e0ne has quit IRC08:27
lifelessso I suspect thats fallout from the great 'omg alphas don't work with pip well' experiment from a couple weeks back08:27
jp_at_hpI was wondering if the pypi mirroring did not mirror alpha versions for some reason.  Because global-requirements specifies that version constraint.08:27
*** e0ne has joined #openstack-infra08:28
jp_at_hpah - just checked the update merge date, it was last night at 8pm, so probably waiting for a mirror run to pull in...08:29
jp_at_hpta lifeless08:30
*** andreaf has joined #openstack-infra08:32
*** hashar has joined #openstack-infra08:35
*** e0ne has quit IRC08:40
*** cnesa6 has joined #openstack-infra08:42
*** leopoldj has joined #openstack-infra08:42
*** hashar_ has joined #openstack-infra08:49
*** Alexei_987 has joined #openstack-infra08:50
*** ZZelle has quit IRC08:51
*** ZZelle has joined #openstack-infra08:51
*** andreykurilin has quit IRC08:53
*** hashar has quit IRC08:54
*** cnesa7 has joined #openstack-infra08:56
*** cnesa6 has quit IRC08:56
*** hashar_ is now known as hashar09:00
openstackgerritDina Belova proposed a change to openstack-infra/config: New python-opentsdbclient repo  https://review.openstack.org/10863009:03
*** luqas has quit IRC09:03
openstackgerritAntoine Musso proposed a change to openstack-infra/zuul: Merger: support for pruning remotes  https://review.openstack.org/9214109:03
*** ociuhandu has joined #openstack-infra09:03
openstackgerritAntoine Musso proposed a change to openstack-infra/zuul: Merger: support for finding branches in remote  https://review.openstack.org/9216109:03
openstackgerritAntoine Musso proposed a change to openstack-infra/zuul: Add accessor for Repo._initialized  https://review.openstack.org/9748709:03
openstackgerritAntoine Musso proposed a change to openstack-infra/zuul: cloner to easily clone dependent repositories  https://review.openstack.org/7037309:03
hashar^^^ lame manual rebase09:04
*** cnesa7 has quit IRC09:08
*** e0ne has joined #openstack-infra09:12
*** yamamoto_ has joined #openstack-infra09:13
*** yamamoto_ has quit IRC09:15
*** zehicle_at_dell has quit IRC09:21
*** amalagon has joined #openstack-infra09:21
*** e0ne has quit IRC09:24
openstackgerritDina Belova proposed a change to openstack-infra/config: Add job to run Tempest dsvm on MongoDB backend for Ceilometer  https://review.openstack.org/11024509:30
*** e0ne has joined #openstack-infra09:32
*** derekh_ has joined #openstack-infra09:33
openstackgerritDina Belova proposed a change to openstack-infra/devstack-gate: Enable overriding of Ceilometer storage backend  https://review.openstack.org/11024709:35
*** rlandy has joined #openstack-infra09:37
*** Alexei_987 has quit IRC09:37
openstackgerritDina Belova proposed a change to openstack-infra/config: Add job to run Tempest dsvm on MongoDB backend for Ceilometer  https://review.openstack.org/11024509:38
*** unicell has quit IRC09:39
*** daya_k has quit IRC09:39
*** luqas has joined #openstack-infra09:40
*** unicell has joined #openstack-infra09:42
openstackgerrityolanda.robla proposed a change to openstack-infra/config: Add support for disk-image-builder in nodepool  https://review.openstack.org/8847909:43
*** enikanorov_ has joined #openstack-infra09:45
*** enikanorov has quit IRC09:46
openstackgerrityolanda.robla proposed a change to openstack-infra/config: Add support for disk-image-builder in nodepool  https://review.openstack.org/8847909:50
*** Slower has quit IRC10:00
*** dannyla has joined #openstack-infra10:07
*** jcoufal-mobile has joined #openstack-infra10:07
*** bauzas has joined #openstack-infra10:08
*** jcoufal-mobile has quit IRC10:08
openstackgerritJulien Danjou proposed a change to openstack-infra/config: Enable py33 gating on Ceilometer  https://review.openstack.org/11025210:11
*** banix has joined #openstack-infra10:11
*** jgallard has quit IRC10:15
*** ryanpetrello has quit IRC10:16
*** alexpilotti has joined #openstack-infra10:19
openstackgerritJulien Danjou proposed a change to openstack-infra/config: Use python3-jobs template where possible  https://review.openstack.org/11025610:21
*** ryanpetrello has joined #openstack-infra10:21
*** marzif has joined #openstack-infra10:22
*** DuncanT- has joined #openstack-infra10:32
SergeyLukjanovredrobot, I'm here atm10:34
*** xianghui has quit IRC10:36
AJaegerSergeyLukjanov, is there a special reason you gave your +2 but did not approve the *-specs publishing jobs? https://review.openstack.org/#/c/10610010:36
*** pcm_ has joined #openstack-infra10:36
*** jyuso has quit IRC10:36
*** yaguang has quit IRC10:37
SergeyLukjanovAJaeger, hey10:37
SergeyLukjanovAJaeger, there is no specs.openstack.org DNS entry10:37
*** pcm__ has joined #openstack-infra10:37
AJaegerSergeyLukjanov, understood. Is there anything that I can do there - or who can?10:38
SergeyLukjanovAJaeger, I think that I should be able to do it, but I have no credentials for managing o.o dns10:39
SergeyLukjanov:)10:39
*** DuncanT- has left #openstack-infra10:39
AJaegerI see, let me add a note to the patch that DNS needs to be created.10:39
AJaegerand I'll ask around later who can do it10:39
SergeyLukjanovAJaeger, oh, and I just see one more concern10:40
SergeyLukjanovAJaeger, probably it was already discussed10:40
AJaegerspeak up ;)10:40
SergeyLukjanovAJaeger, your patch will publish specs to specs.o.o for all projects10:40
AJaegerSergeyLukjanov, yes10:40
SergeyLukjanovAJaeger, including the non-official (stackforge) ones10:40
AJaegerin directories {github-org}/project/10:40
SergeyLukjanovAJaeger, but we're not doing it with docs.o.o10:41
*** pcm_ has quit IRC10:41
SergeyLukjanovAJaeger, was this question already rised?10:41
AJaegeranteaya raised this in the review and fungi and stevemar discused here as well - see fungi's comment10:41
*** banix has quit IRC10:41
AJaegerWe can create a top-level page that differentiates these projects...10:41
*** cnesa7 has joined #openstack-infra10:42
AJaegerright now fuel-specs and tacker-specs are part of that series.10:43
AJaegerIf you think we should remove them from there for now, I can change the patch.10:43
SergeyLukjanovAJaeger, I'm not against it, just remember that we're publishing to o.o only official projects10:44
SergeyLukjanov(at least for docs.o.o)10:45
AJaegerLet me double check with fungi et all later today...10:45
AJaegerSergeyLukjanov, I added a review comment.10:47
AJaegerSergeyLukjanov, one more favor: Could you put  https://review.openstack.org/#/c/108464/  in your review queue, please?10:47
SergeyLukjanovAJaeger, looking10:50
AJaegerthanks, SergeyLukjanov !10:52
*** HenryG_afk is now known as HenryG10:53
rcarrillocruzSergeyLukjanov: hi Sergey, if you are not too busy at this moment, i'd be grateful if i could get a core review on https://review.openstack.org/#/c/109816/10:56
openstackgerrityolanda.robla proposed a change to openstack-infra/nodepool: Build images using diskimage-builder  https://review.openstack.org/4648210:56
SergeyLukjanovrcarrillocruz, it's a "bit" larger than AJaeger's one, so, I've added it to my review list10:57
rcarrillocruzsure, thx10:57
AJaegeryeah, a tiny bit larger ;)10:57
openstackgerritKhai Do proposed a change to openstack-infra/config: Setup a private gerrit instance for security reviews  https://review.openstack.org/4793710:59
openstackgerritA change was merged to openstack-infra/config: Fix upstream_translation_update_manuals  https://review.openstack.org/10846411:01
zarorcarrillocruz: did you need something?11:04
*** asettle has quit IRC11:05
*** pblaho has quit IRC11:06
*** alexandra_ has joined #openstack-infra11:06
*** denis_makogon has quit IRC11:06
*** salv-orlando has quit IRC11:06
*** banix has joined #openstack-infra11:08
openstackgerritA change was merged to openstack-infra/config: removed py3 tests from refstack-client  https://review.openstack.org/10944311:12
*** cdub has joined #openstack-infra11:13
*** dmellado has joined #openstack-infra11:13
*** lttrl has joined #openstack-infra11:14
*** pcm__ has quit IRC11:14
openstackgerritJulien Danjou proposed a change to openstack-infra/config: Publish tooz documentation and gate on docs  https://review.openstack.org/11026311:14
yolandaSergeyLukjanov, thx for reviewing11:15
*** pcm_ has joined #openstack-infra11:15
openstackgerritA change was merged to openstack-infra/config: convert to two level recheckwatchbot.yaml  https://review.openstack.org/10871911:15
*** zns has quit IRC11:16
cnesa7Hi all, we have a blocking bug on the HyperV CI, devstack fails during neutron database creation. stack trace here -> http://paste.openstack.org/show/88896/. Is there a workaround?11:17
*** salv-orlando has joined #openstack-infra11:19
*** krtaylor has quit IRC11:23
rcarrillocruzzaro: hey11:23
*** _nadya_ has quit IRC11:23
rcarrillocruzi've refactored the artifact upload scripts11:23
rcarrillocruzinstead of having 'jenkinsci-upload.sh, mavencentral-upload.sh, pypi-*-upload.sh', i created a generic artifact-upload.sh script11:24
rcarrillocruzcurl --data-binary does not work for uploading stuff to nexus11:24
rcarrillocruzi could only make it work with  'curl -T'11:24
rcarrillocruzi pinged you since i saw you created mavencentral-upload.sh file , from git history...11:25
rcarrillocruzdid 'curl -X PUT --data-binary' ever work for Maven Central?11:27
rcarrillocruzi'd be surprised, since Maven Central is also based on Nexus afaik...11:27
openstackgerritNicholas Randon proposed a change to openstack-infra/config: Add firewall traffic on port 27410 to 27510.  https://review.openstack.org/10873711:27
*** banix has quit IRC11:28
*** denis_makogon has joined #openstack-infra11:28
*** salv-orlando has quit IRC11:28
zarorcarrillocruz: sounds good. i don't remember if it worked or not.  scripted isn't actually used anymore.  the maintainer of our only java project that needs to be uploaded to maven central decided to use the maven deploy plugin instead.11:30
zarorcarrillocruz: i do remember testing it and it did work for me.11:30
rcarrillocruzyep, didn't find any real job using that11:30
rcarrillocruzi think the issue is with curl11:31
zarorcarrillocruz: have you tried testing the mavencentral-upload.sh script as-is to see if you can upload anything?11:31
rcarrillocruzand i'm doing tests with curl on precise (where it will be run)11:31
rcarrillocruzdoesn't work11:31
rcarrillocruzi mean, i can't upload to Central, as i don't have credentials for it11:31
rcarrillocruzbut i tried using that script to upload to a local nexus11:31
rcarrillocruzand it didn't work, i get a 500 on Nexus side11:32
*** GheRiver1 is now known as GheRivero11:32
openstackgerritJulien Danjou proposed a change to openstack-infra/config: Publish tooz documentation and gate on docs  https://review.openstack.org/11026311:32
*** Longgeek has quit IRC11:32
*** Longgeek has joined #openstack-infra11:32
rcarrillocruztracing curl output there's some encoding issues when using --data-binary11:32
rcarrillocruzagain, using curl on precise version, i found also a blog post in the Internet pointing in that direction, let me dig11:32
zarowell i know the jenkins-upload.sh works, but i think that's going to an artifactory server.11:32
rcarrillocruzhttp://blog.killtheradio.net/tricks-hacks/curl-cli-not-sending-full-file-data-when-using-data-binary/11:33
rcarrillocruzzaro: the change is https://review.openstack.org/#/c/109816/  if you want to have a look11:34
rcarrillocruznote i haven't removed prior upload artifact , just pushing the script itself11:34
zarorcarrillocruz: have you tried curl outside of the script.  just a simple curl command by itself?11:35
rcarrillocruzwhen it lands and if all is ok, we can then remove other artifact upload scripts and change jjb jobs to use the new script11:35
rcarrillocruzzaro: yes11:35
rcarrillocruzi even have a trace output from a working curl with -T vs a non-working curl with --data-binary11:35
*** pblaho has joined #openstack-infra11:36
zarorcarrillocruz: that definately worked for me to nexus11:36
zarorcarrillocruz: i believe you can create your own account on nexus11:37
zarorcarrillocruz: i mean on maven central11:37
rcarrillocruzhow long it takes? i read that you need to open a jira ticket with them11:37
*** luqas has quit IRC11:38
rcarrillocruzwould you be able to do a quick 'curl -T foo.jar' ?11:38
zarorcarrillocruz: anyways, why change a broken script with another one that doens't work?  shouldn't we fix it first?11:38
rcarrillocruzmine works, i've just refactored the existing upload artifact scripts into one for a better code reuse, and switched to 'curl -T' , instead of 'curl --data-binary'11:39
rcarrillocruzand also allow parameterization11:40
zarorcarrillocruz: so what doesn't work again?11:40
rcarrillocruzthe 'curl --data-binary' to nexus11:40
rcarrillocruzthe parameterization allows to use arbitrary artifact URLs11:41
zarorcarrillocruz: ohh so 'curl -T' to nexus works?11:41
rcarrillocruzyes, it does11:41
rcarrillocruzcurl -T == curl --upload-file btw11:41
rcarrillocruzand it works for both binaries and text files11:41
zarorcarrillocruz: ohh, cool.  then we should just go with that.11:41
rcarrillocruzthe paramterization is also good, cos with the new script you can just pass a URL to a local Nexus . If you don't pass any URL for a 'java-package' upload, it defaults to Maven Central11:42
zarorcarrillocruz: yes, you are right about the asking for nexus account.  it's a little involved and IIRC it took about a week to setup an account.11:42
rcarrillocruzi.e. i wrote the script to be as close to what we have right now, yet being more flexible for downstream consumption11:43
*** salv-orlando has joined #openstack-infra11:43
zaroi'll take a look at your change. nice work!11:47
rcarrillocruzappreciate, thx :-)11:47
*** BobBall has quit IRC11:48
*** salv-orlando_ has joined #openstack-infra11:52
*** salv-orlando has quit IRC11:52
*** salv-orlando_ is now known as salv-orlando11:52
swestonkrtaylor, anteaya third party terms are here https://review.openstack.org/#/c/109800/11:53
*** _nadya_ has joined #openstack-infra11:54
*** BobBall has joined #openstack-infra11:54
*** yfried has quit IRC11:55
*** Longgeek has quit IRC11:55
*** yfried_ has joined #openstack-infra11:55
*** Longgeek has joined #openstack-infra11:55
*** weshay has joined #openstack-infra11:56
*** zns has joined #openstack-infra12:02
*** zns has joined #openstack-infra12:03
openstackgerritDavide Guerri proposed a change to openstack-infra/config: Add git-upstream as new project to stackforge  https://review.openstack.org/10929212:04
*** tnovacik has quit IRC12:05
*** hashar has quit IRC12:07
openstackgerritA change was merged to openstack-infra/config: Add rally-dsvm jobs to gate pipeline in rally  https://review.openstack.org/10725912:07
openstackgerritA change was merged to openstack-infra/config: Add pep8 check/gate for stackforge/python-tackerclient  https://review.openstack.org/10741012:08
openstackgerritA change was merged to openstack-infra/nodepool: Use correct provider in test-case  https://review.openstack.org/10918412:08
dguerri`afkSergeyLukjanov, can I edit http://ci.openstack.org/stackforge.html to add the additional configuration needed for configuring the IRC bot?12:09
*** dguerri`afk is now known as dguerri12:10
*** ArxCruz has joined #openstack-infra12:12
*** dkranz has joined #openstack-infra12:15
SergeyLukjanovdguerri, the sources of this page located in https://github.com/openstack-infra/config/blob/master/doc/source/stackforge.rst12:16
dguerrita12:16
*** miqui has joined #openstack-infra12:18
dguerriSergeyLukjanov if I understand it well, adding a channel to channels.yaml will result in the definition of new OPs for that channel and will define the mask for IRC users not listed in that file. Is that accurate?12:18
*** cdub has quit IRC12:18
*** tnovacik has joined #openstack-infra12:20
*** pdmars has joined #openstack-infra12:22
*** jgallard has joined #openstack-infra12:27
*** baohua has quit IRC12:27
*** tnovacik has quit IRC12:28
*** jlibosva has quit IRC12:28
*** jistr has quit IRC12:29
*** ihrachyshka_ has joined #openstack-infra12:30
*** aysyd has joined #openstack-infra12:30
rcarrillocruzhmm12:31
rcarrillocruzzaro: re: my comment on the script change12:31
rcarrillocruzwould you say that ALL pypi jobs that upload either tarballs or wheels first download the artifact from tarballs.openstack.org ?12:31
rcarrillocruzi.e. is it always tarballs.openstack.org?12:31
*** ihrachyshka_ has quit IRC12:31
rcarrillocruzcos if it does, i would just put that as the default argument12:31
*** ihrachyshka_ has joined #openstack-infra12:32
*** ihrachyshka has quit IRC12:32
*** jistr has joined #openstack-infra12:33
rcarrillocruzif I grep for 'tarball-site' in jjb projects.yaml, i only get 'tarballs.openstack.org' value12:33
openstackgerritEkaterina Chernova proposed a change to openstack-infra/config: Update murano jenkins job  https://review.openstack.org/11027712:33
rcarrillocruzit's a quasi hardcode value ! :-)12:33
*** jlibosva has joined #openstack-infra12:34
*** maxbit has joined #openstack-infra12:35
*** adalbas has joined #openstack-infra12:41
*** che-arne has joined #openstack-infra12:42
*** tnovacik has joined #openstack-infra12:43
openstackgerritNicholas Randon proposed a change to openstack-infra/config: Add firewall traffic on port 27410 to 27510.  https://review.openstack.org/10873712:43
*** amalagon has quit IRC12:47
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for grenade ssh protocol banner bug 1349617  https://review.openstack.org/11016412:50
uvirtbotLaunchpad bug 1349617 in nova "test_volume_boot_pattern fails in grenade with "SSHException: Error reading SSH protocol banner[Errno 104] Connection reset by peer"" [Undecided,New] https://launchpad.net/bugs/134961712:50
*** nosnos has quit IRC12:51
*** mrmartin has joined #openstack-infra12:51
*** cdub has joined #openstack-infra12:53
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for nova-network floating IPs bug 1349590  https://review.openstack.org/11014212:53
uvirtbotLaunchpad bug 1349590 in nova "nova-network appears to lock up while associating floating ip's" [High,Confirmed] https://launchpad.net/bugs/134959012:53
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for grenade ssh protocol banner bug 1349617  https://review.openstack.org/11016412:54
uvirtbotLaunchpad bug 1349617 in nova "test_volume_boot_pattern fails in grenade with "SSHException: Error reading SSH protocol banner[Errno 104] Connection reset by peer"" [Undecided,New] https://launchpad.net/bugs/134961712:54
*** sballe has joined #openstack-infra12:55
openstackgerritDavide Guerri proposed a change to openstack-infra/config: Complete the instruction to add a new IRC channel  https://review.openstack.org/11028512:56
*** ihrachyshka__ has joined #openstack-infra12:56
*** mfink has quit IRC12:57
*** ihrachyshka_ has quit IRC12:59
*** jlibosva has quit IRC13:00
*** jlibosva has joined #openstack-infra13:00
*** jistr has quit IRC13:01
openstackgerritDavide Guerri proposed a change to openstack-infra/config: Complete the instruction to add a new IRC channel  https://review.openstack.org/11028513:01
*** jgrimm has joined #openstack-infra13:02
*** jistr has joined #openstack-infra13:03
*** pblaho_ has joined #openstack-infra13:03
*** pblaho has quit IRC13:03
*** luqas has joined #openstack-infra13:04
*** nelsnelson has joined #openstack-infra13:05
*** dmsimard_away is now known as dmsimard13:06
*** dustins has joined #openstack-infra13:07
*** zns has quit IRC13:08
*** amalagon has joined #openstack-infra13:09
*** craigbr has joined #openstack-infra13:11
*** miqui has quit IRC13:14
*** krtaylor has joined #openstack-infra13:14
*** daya_k has joined #openstack-infra13:18
*** samy has joined #openstack-infra13:20
*** samy_ has joined #openstack-infra13:20
*** samy is now known as Guest9071713:20
*** zns has joined #openstack-infra13:20
*** zehicle_at_dell has joined #openstack-infra13:21
*** dkranz has quit IRC13:23
*** dguerri is now known as dguerri`afk13:25
openstackgerritgordon chung proposed a change to openstack-infra/config: Create git repo and jenkins jobs for oslo.middleware  https://review.openstack.org/10934913:27
*** mfink_ has joined #openstack-infra13:27
*** stevemar has joined #openstack-infra13:28
*** dguerri`afk is now known as dguerri13:29
*** masayuki_ has quit IRC13:30
*** mfink__ has joined #openstack-infra13:30
*** mfink_ has quit IRC13:30
*** dannyla has quit IRC13:30
*** mfink_ has joined #openstack-infra13:30
*** signed8bit has joined #openstack-infra13:31
*** dims has joined #openstack-infra13:31
*** pdmars_ has joined #openstack-infra13:34
*** baohua has joined #openstack-infra13:35
*** juzuluag has joined #openstack-infra13:35
*** pdmars has quit IRC13:35
*** dkranz has joined #openstack-infra13:35
phschwartzso I just had an interesting thing happen. I left a browser window open with my submission for a talk in Paris, and safari auto refreshed the page and I just got an email saying thank you for submitting it.13:39
phschwartzShould have been closed since yesterday so not sure why it just allowed that on the refresh13:40
*** bknudson has joined #openstack-infra13:41
*** armax has joined #openstack-infra13:42
*** hashar has joined #openstack-infra13:43
fungiphschwartz: open a lp bug against openstack-org13:44
fungiphschwartz: todd will probably want to know about it13:45
phschwartzfungi: Will do that, just hope my talk that I submitted yesterday doesn't get disqual'ed for them thinking it was resubmitted or changed today13:45
fungiphschwartz: right, also a good reason to reach out to them ;)13:45
SergeyLukjanovfungi, I've added specs.o.o CNAME for statis.o.o for future specs publishing feature13:45
SergeyLukjanovAJaeger, ^^13:45
fungiSergeyLukjanov: awesome, thanks!13:46
*** daya_k has quit IRC13:46
phschwartzfungi: I will open the bug, what is Todd's nick in irc?13:46
fungiphschwartz: when he's around, he's toddmorey13:46
fungiphschwartz: he's also todd@openstack.org13:46
SergeyLukjanovfungi, the last concern I have is that for docs.o.o we're only publishing openstack/* projects, but for for specs we're trying to publish any projects including stackforge/*13:47
SergeyLukjanovjeblair, mordred, clarkb, AJaeger ^^13:47
fungiSergeyLukjanov: right, the specs.o.o site is not under the management of the docs team. i'm kindof indifferent as to whether stackforge projects get their specs there as long as they're clearly namespaced and don't use openstack documentation theming/branding/logos13:48
*** lnxnut has joined #openstack-infra13:48
*** dmellado has quit IRC13:48
fungiSergeyLukjanov: for example, we publish the same document sources on git.openstack.org13:48
SergeyLukjanovfungi, yeah, that's fair13:49
*** UtahDave has joined #openstack-infra13:49
*** UtahDave has left #openstack-infra13:49
fungiSergeyLukjanov: that said, others very well may disagree, so it bears some discussion with the group13:49
*** samy_ has left #openstack-infra13:50
SergeyLukjanovfungi, do you think we should wait for some time before approving it?13:50
*** yfried_ has quit IRC13:50
*** homeless has joined #openstack-infra13:51
fungiSergeyLukjanov: we probably want to make sure any contentious/political concerns over stackforge spec publication are addressed first, so more review time may help with that13:51
SergeyLukjanovfungi, ack13:51
*** pcrews has joined #openstack-infra13:52
fungiSergeyLukjanov: for example, are the docs jobs for the stackforge specs generating content with openstack logos? i haven't checked, but i probably should and may readjust my vote accordingly13:52
SergeyLukjanovfungi, they do if use oslosphinx13:52
fungiSergeyLukjanov: right, i think at one point we discussed with dhellmann the feasibility of having different branding payloads for stackforge documents, but i don't think any of the 'forgers ever stepped up to work out the details13:53
*** zz_dimtruck is now known as dimtruck13:54
*** prad has joined #openstack-infra13:56
fungithe counterargument is that we have openstack branding/logo on http://git.openstack.org/cgit/stackforge/gertty/13:56
*** flaviof_zzz is now known as flaviof13:56
fungibut we may be drawing a (fuzzy) line between branding a service provided by the project infrastructure and branding content/documents themselves13:57
*** otherwiseguy has joined #openstack-infra14:01
*** laxity_ has quit IRC14:02
fungithere are a few stackforge/.*-specs projects with no requirements specified at all (some are still empty projects), but the following currently install oslosphinx: fuel-specs, openstack-chef-specs, solum-specs, tacker-specs14:02
*** laxity_ has joined #openstack-infra14:03
fungiaccording to http://git.openstack.org/cgit/openstack/oslosphinx/tree/README.rst there's a special "incubating" theme available already, so maybe one of those projects wants to step up and make an "ecosystem" theme or similar14:03
openstackgerritRicardo Carrillo Cruz proposed a change to openstack-infra/config: Refactor the various artifact upload scripts into one  https://review.openstack.org/10981614:05
*** samy_ has joined #openstack-infra14:05
*** eharney has quit IRC14:06
openstackgerrityolanda.robla proposed a change to openstack-infra/jeepyb: Allow create/update projects with description into Gerrit  https://review.openstack.org/11000914:07
*** unicell has quit IRC14:08
*** e0ne has quit IRC14:09
*** unicell has joined #openstack-infra14:09
*** unicell has quit IRC14:09
*** unicell has joined #openstack-infra14:09
*** Guest90717 has quit IRC14:09
*** pblaho_ has quit IRC14:09
*** craigbr has quit IRC14:09
fungiphschwartz: what's the current best path for us to get deleting+error state instances terminated? we've got 63 in dfw, 26 in iad and 13 in ord14:10
rcarrillocruzwould be nice to have a link on status.openstack.org/zuul changes that point you to the pertinent jenkins build console outputt14:10
*** chandankumar has joined #openstack-infra14:11
fungircarrillocruz: what do you mean? doesn't it already?14:11
fungircarrillocruz: something other than what you get by clicking the names of the running jobs?14:11
phschwartzfungi: Until we get our next release out (behind because fo the ironic release) it still has to be done via the admin interface or db to reset the task_state.14:11
phschwartzfungi: Our next release has the upstream fix that autocorrects task_state on the failure in it.14:12
fungiphschwartz: so just open a support case and attach the per-region lists of uuids?14:12
*** e0ne has joined #openstack-infra14:12
fungiif so, easy enough14:12
phschwartzfungi: I am pulling up the error'ed instances now and will get our csops looking at it :) should be faster then a ticket14:12
*** jistr has quit IRC14:12
fungiphschwartz: oh, okay--thanks bunches!14:13
marzifSergeyLukjanov,  many thanks, 100% effective (thumbsup)14:13
*** jistr has joined #openstack-infra14:13
rcarrillocruzoh, as hovering over them didn't change the pointer never cared to click14:14
rcarrillocruznice!14:14
*** izinovik has left #openstack-infra14:14
yolandahi, i have a set of changes to allow setting project descriptions on gerrit: https://review.openstack.org/109957 and https://review.openstack.org/11000914:14
yolandacan i get some reviews?14:14
rcarrillocruzfungi: would you say that all pypi upload jobs grab the artifacts from tarballs.openstack.org ?14:15
rcarrillocruzthe pypi-{tarball, upload}-upload.sh scripts accept a URL argument14:15
rcarrillocruzbut it seems that in the end we use tarballs site for everything, unless i'm missing something...14:15
rcarrillocruzi'll check yolanda14:16
openstackgerritIvan Kolodyazhny proposed a change to openstack-infra/config: Make 'jenkins-job-builder' repo configurable  https://review.openstack.org/9919014:16
jeblairfungi, SergeyLukjanov: i was thinking we would only publish openstack specs to specs.openstack.org14:16
*** dhellmann has quit IRC14:17
*** chuckC has joined #openstack-infra14:18
fungijeblair: okay, fair enough... i'm indifferent on that14:18
*** krtaylor has quit IRC14:18
*** niedbalski has quit IRC14:18
*** niedbalski has joined #openstack-infra14:18
yolandathx14:19
rcarrillocruzyolanda: the description.replace is to get rid of the "" you pass in the command line, right?14:19
*** krtaylor has joined #openstack-infra14:19
fungircarrillocruz: yes. to my knowledge we only parameterized that to make it easier to adjust on the backend when needed14:19
fungircarrillocruz: (in reference to your tarballs.o.o question)14:19
yolandarcarrillocruz, to escape slashes if you pass them as a part of the description14:20
rcarrillocruzfungi: ok, just found odd that the URL is parameterized for pypi upload jobs, but it was not for maven/jenkins upload (they point always to upstream maven central/ jenkinsci respectively)14:20
*** dhellmann has joined #openstack-infra14:20
openstackgerritafazekas proposed a change to openstack-infra/devstack-gate: Neutron default tenant network type vxlan  https://review.openstack.org/10556914:21
rcarrillocruzfungi: i refactored the upload artifacts scripts here: https://review.openstack.org/#/c/109816/7 , we need to parameterize the maven central location so arbitrary nexus servers (maven central is a nexus after all) can be used14:21
openstackgerritafazekas proposed a change to openstack-infra/devstack-gate: multi-node dg setup  https://review.openstack.org/10604314:21
yolandarcarrillocruz, to escape quotes, i mean14:22
*** ildikov has quit IRC14:22
*** _nadya_ has quit IRC14:23
*** _nadya_ has joined #openstack-infra14:24
*** ihrachyshka__ is now known as ihrachyshka14:24
fungircarrillocruz: looking. i've got a spec brewing to add a lot of extra machinery to the release artifact production and upload toolchain, so i'm interested to see where it might be simplified14:25
rcarrillocruzoh14:28
*** dangers_away is now known as dangers14:28
rcarrillocruznice14:28
fungircarrillocruz: at a conceptual level, we want to separate artifact generation (which includes archiving them to an openstack webserver like tarballs.o.o) from artifact publication to formal repositories (pypi, jenkins-ci, maven nexus...)14:29
*** yfried_ has joined #openstack-infra14:29
fungircarrillocruz: since the build step for any of those artifacts almost always has the capability of running arbitrary source code, and we want the servers with the upload credentials for those external services to not coexist on the same worker (or even the same jenkins master environment) as workers running arbitrary code14:30
*** david-lyle has joined #openstack-infra14:30
*** dims has quit IRC14:31
*** david-ly_ has joined #openstack-infra14:31
fungircarrillocruz: that why, for example, you'll see our pypi uploads are a two-step process where step 1 is to create the sdist/wheel and upload them to tarballs.o.o, then step 2 is to retrieve them from tarballs.o.o and upload them to pypi.python.org14:31
*** rainya has joined #openstack-infra14:31
*** rainya has quit IRC14:32
*** banix has joined #openstack-infra14:32
*** rainya has joined #openstack-infra14:32
*** wenlock has joined #openstack-infra14:32
*** david-ly_ is now known as david-lyle_14:33
rcarrillocruzfungi: how will the "build jenkins" communicate with "privileged jenkins" ? scp with keys? or do you have something else in mind?14:33
*** baohua has quit IRC14:33
fungircarrillocruz: they already do this today. zuul coordinates all that14:34
*** yfried_ has quit IRC14:34
*** amotoki has quit IRC14:34
fungircarrillocruz: i was explaining how our current upload process works14:34
*** david-lyle has quit IRC14:35
fungiultimately i think we actually want to start treating tarballs.o.o in a more official manner as well, have the build worker upload the artifact to a swift container which isn't published from tarballs.o.o, then have a separate job or jobs retrieve those artifacts and sign them before putting them on tarballs.o.o and pypi.p.o or wherever else14:35
rcarrillocruzoh14:36
rcarrillocruzsigning14:36
rcarrillocruzdo you have the spec pushed yet?14:36
rcarrillocruzi'm interested on your work, because i'm doing build/upload artifact stuff at work14:37
funginot yet, but my point wasn't so much about the signing in this case. more that your upload script seems to assume that the uploads aren't staged between the build process on one machine and the upload process on another14:37
openstackgerritIvan Kolodyazhny proposed a change to openstack-infra/config: Make 'puppetmaster_host' configurable  https://review.openstack.org/9904114:38
fungithe pypi-tarball and pypi-wheel entries there are using the $URL variable in reverse from how jenkins-plugin|java-package do14:40
rcarrillocruzmy script is just a refactor of the jenkinsci/mavencentral/pypi upload scripts, i saw a lot of common code and lacked parameterization...14:40
*** zehicle_at_dell has quit IRC14:40
*** datsun180b has joined #openstack-infra14:40
rcarrillocruzyep, that's correct. jenkinsci/maven use the URL as a target repo, whereas pypi use the URL param as source repo14:41
*** zehicle_at_dell has joined #openstack-infra14:41
rcarrillocruzi can split it into SOURCE_URL and TARGET_URL if you think that may be better for what you have in mind14:41
fungircarrillocruz: i need to read back through the original upload jobs for jenkins plugins and java packages, but i believe we may want to pull more shell out of the job definitions for those since i think they also do the same pattern as the pypi upload14:42
*** david-lyle_ is now known as david-lyle14:43
*** dguerri is now known as dguerri`afk14:43
*** eharney has joined #openstack-infra14:43
rcarrillocruzfungi: one note about jenkins/java packages upload. the curl command that used -X PUT --data-binary do not work for me, i switched to use 'curl -T'14:43
*** chandankumar has quit IRC14:43
rcarrillocruznot related to our conversation, but just in case you wonder when you reach to that point14:44
openstackgerritIvan Kolodyazhny proposed a change to openstack-infra/config: Make 'puppetmaster_host' configurable  https://review.openstack.org/9904114:44
fungircarrillocruz: yeah, i saw that earlier discussion14:44
*** dguerri`afk is now known as dguerri14:45
openstackgerritSteve Martinelli proposed a change to openstack-infra/config: Publish specs jobs for *-specs  https://review.openstack.org/10610014:45
openstackgerritAlexei Kornienko proposed a change to openstack/requirements: Unbind version of pyzmq  https://review.openstack.org/10649714:45
fungircarrillocruz: here's a good example... http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/maven-plugin-jobs.yaml#n2514:46
fungircarrillocruz: you'll note we have two templates there. the {name}-localrepo-upload jobs get called at the end of the build process to stick the resulting jarfile on tarballs.o.o14:47
*** MarkAtwood has joined #openstack-infra14:47
fungircarrillocruz: then the {name}-mavencentral-upload jobs get called on a different worker which has the upload credentials, and it downloads the jar from tarballs.o.o before calling the upload script14:47
rcarrillocruzyeah14:48
rcarrillocruzso, how you envision doing this differntly ?14:48
rcarrillocruzinstead of tarballs.o.o plain swift , plus the signing?14:48
fungircarrillocruz: more thinking in context of your refactor, not so much the signing improvements, if you're going to put all that logic into one script then it probably needs to absorb the shell fragments we have in these job templates. or else two scripts (which i think would more cleanly illustrate the separation logic) where one is for putting things on tarballs.o.o and the other is for getting14:49
fungithings from tarballs.o.o and uploading them to various other places14:50
rcarrillocruzgotcha14:50
rcarrillocruzlet me work on this14:50
rcarrillocruzthx14:50
openstackgerritSteve Martinelli proposed a change to openstack-infra/config: Publish specs jobs for *-specs  https://review.openstack.org/10610014:50
*** datsun180b has quit IRC14:50
fungiyour current refactored script has the download+upload logic for python packages but only the upload logic for other things, and then reuses common options/variables for different purposes14:51
*** datsun180b has joined #openstack-infra14:51
fungithose phases still more or less exist in my long-term plan, it's just that the destinations change slightly, we add a trust chain between the steps, and tarballs.o.o gains a little more credibility. also we should be moving tarballs.o.o itself into a swift container, which will solve some of our current upload atomicity issues with branch tarballs14:54
rcarrillocruzi think it's then a good time to rename the script itself, as it won't be just for uploading14:55
rcarrillocruzi.e. artifactrepo_upload.sh14:56
*** yamamoto has joined #openstack-infra14:56
fungiyeah, i'm 100% in favor of our scripts having clear names describing their purposes14:57
*** chandankumar has joined #openstack-infra14:58
*** jedimike has joined #openstack-infra15:00
*** dguerri is now known as dguerri`afk15:01
*** morganfainberg_Z is now known as morganfainberg15:01
*** dguerri`afk is now known as dguerri15:01
*** james_li has joined #openstack-infra15:03
*** craigbr has joined #openstack-infra15:04
*** MickeyO has quit IRC15:07
*** MarkAtwood has quit IRC15:07
*** MarkAtwood has joined #openstack-infra15:08
*** chandankumar has quit IRC15:08
*** jistr has quit IRC15:11
*** shashankhegde has joined #openstack-infra15:12
vhowardalright, in a rathole and could use some help, using pbuilder to build up an ubuntu 12_04 precise and trying to build a source package for neutron using pdebuild using the 2014.1.1 orig.tar and debian from launchpad15:15
vhowardkeeps failing for me looking for some dependency in python-simplejson python-simplejson : Depends: python:any (>= 2.7.3-0ubuntu2~) but it is not installable15:16
vhowardif anyone would like to message me for more info i could really use another set of eyes, tried tons of stuff just wnat to build out my dependencies basically15:16
fungivhoward: you probably want to ask the ubuntu openstack packagers15:17
*** timrc-afk is now known as timrc15:17
clarkb15:18
clarkber sorry15:18
clarkbin other news it is 8:17am and almost 25C15:18
* clarkb melts15:18
openstackgerritTimur Sufiev proposed a change to openstack-infra/config: Create merlin repo  https://review.openstack.org/11032515:18
*** craigbr has quit IRC15:18
fungivhoward: this channel is where we discuss community infrastructure (our wiki, listserv, irc bots, code review system, testing and validation automation, et cetera)15:19
vhowardfungi: sorry about the spam then thought i had the right place15:19
*** MarkAtwood has quit IRC15:19
openstackgerritSergey Skripnick proposed a change to openstack-infra/devstack-gate: Add option to edit ceilometer notification topics  https://review.openstack.org/10412315:20
fungivhoward: no worries--i know it can get confusing. you probably want these people: https://wiki.ubuntu.com/ServerTeam/OpenStack15:20
*** craigbr has joined #openstack-infra15:20
*** vhoward has left #openstack-infra15:21
*** vhoward has joined #openstack-infra15:21
fungivhoward: i think jamespage does hang out in here (he's one of the ubuntu packagers), so he might be able to point you to the appropriate forum15:22
phschwartzany infra core interested in taking a look at https://review.openstack.org/#/c/109723/ ? We are using it internal here at Rax and pushed it up as we think it will help others using JJB15:28
*** shashankhegde has quit IRC15:29
jamespagevhoward, hello15:30
* jamespage reads15:30
jamespagevhoward, lets discuss in #openstack-packaging15:30
*** adalbas has quit IRC15:31
*** zns has quit IRC15:32
*** zul has joined #openstack-infra15:34
bauzasjust tried the Gerrit REST API, but there is still not CORS header15:35
*** che-arne has quit IRC15:35
bauzaswhy couldn't it be activated for the Gerrit API ?15:35
bauzasI can understand for the regular UI, but here we talk about a REST one :)15:36
fungibauzas: is it an option in gerrit we haven't enabled?15:36
bauzasfungi: sounds like15:36
bauzasfungi: I have to look at Gerrit15:36
*** hashar has quit IRC15:36
fungibauzas: a link to the configuration option for it in gerrit's 2.8 documentation would be helpful15:37
bauzasfungi: but by looking at the API doc, doesn't seem that Gerrit prevents this15:37
bauzasfungi: sure, will look at and provide a review if I fint15:37
bauzasfind it15:37
*** yamamoto has quit IRC15:37
fungibauzas: thanks15:37
fungibauzas: though it's worth noting that the authentication for gerrit api calls is distinct from the authentication for its webui, so the risk is minimized15:39
*** zns has joined #openstack-infra15:39
*** rkukura has quit IRC15:39
bauzasfungi: I was thinking about it, because most of the tools I found are doing ssh connections15:39
bauzasfungi: even by not doing Paramiko calls15:39
bauzasfungi: IMHO, calling a REST API would be much cleaner for doing searches :-)15:40
bauzasfungi: as Gerrit is providing it15:40
fungibauzas: agreed. bear in mind that if it's our tools you're looking at, most of them were written while we were running a version of gerrit which only had an ssh api15:40
bauzasfungi: anyway, for my needs, I'll batch it and generate a static file15:40
*** james_li has quit IRC15:40
*** gangil has joined #openstack-infra15:41
fungithe rest api has only been available to us for a few months now15:41
bauzasfungi: yeah, I know15:41
bauzasfungi: I appreciated the move to 2.8 :-)15:41
openstackgerritJulien Marin-Frisonroche proposed a change to openstack-infra/git-review: Improve windows support for git-review --setup  https://review.openstack.org/11033115:41
AJaegerSergeyLukjanov, thanks! Will read the comments later...15:41
*** che-arne has joined #openstack-infra15:42
*** rwsu has joined #openstack-infra15:42
*** adalbas has joined #openstack-infra15:44
*** yamamoto has joined #openstack-infra15:45
*** ihrachyshka has quit IRC15:46
*** dguerri is now known as dguerri`afk15:47
*** lttrl has quit IRC15:48
*** HenryG_ has joined #openstack-infra15:48
*** james_li has joined #openstack-infra15:49
*** dguerri`afk is now known as dguerri15:49
*** vermarah_ has joined #openstack-infra15:50
*** amcrn has joined #openstack-infra15:51
*** HenryG has quit IRC15:52
*** amotoki has joined #openstack-infra15:52
*** HenryG_ is now known as HenryG_afk15:52
*** HenryG_afk is now known as HenryG15:52
*** rkukura has joined #openstack-infra15:52
*** pdmars_ has quit IRC15:53
*** hashar has joined #openstack-infra15:54
*** che-arne has quit IRC15:55
*** che-arne has joined #openstack-infra15:55
*** pdmars has joined #openstack-infra15:56
*** IvanBerezovskiy has left #openstack-infra15:57
*** skolekonov has quit IRC15:57
*** esker has joined #openstack-infra15:58
*** yamamoto has quit IRC15:58
*** marcoemorais has joined #openstack-infra16:03
*** markwash has joined #openstack-infra16:03
*** hashar is now known as hasharMeeting16:05
*** samy_ has quit IRC16:06
*** e0ne has quit IRC16:06
*** trinaths has joined #openstack-infra16:08
*** melwitt has joined #openstack-infra16:08
*** dims has joined #openstack-infra16:08
*** denis_makogon has quit IRC16:10
rcarrillocruzfungi: what do you think about having three different scripts, artifact-build/artifact-stash/artifact-publish ?16:11
rcarrillocruzi'm thinking that's more future proof, because if you add a sign stage at some point it's just a matter of adding an 'artifact-sign' script16:12
rcarrillocruzinstead of cramming build AND stash into just one script16:12
rcarrillocruz?16:12
rcarrillocruzi could also write an artifact-release script that does the whole artifact lifecycle of build/stash/publish, for convenience16:12
fungircarrillocruz: well, the artifact build is already mostly scripted in various places (and can't really be collapsed easily because it's extremely toolchain-dependent). otherwise that's basically the idea i expressed in my review comment16:13
*** pcm_ has left #openstack-infra16:14
*** melwitt has quit IRC16:14
*** melwitt has joined #openstack-infra16:14
*** pcm_ has joined #openstack-infra16:15
*** shashankhegde has joined #openstack-infra16:15
*** markmcclain has joined #openstack-infra16:15
pcm_dhellmann: ping16:15
fungircarrillocruz: effectively your refactor could be to combine various existing upload scripts and job shell blocks into a tarballs.o.o stash script and an external services upload script16:15
*** gyee has joined #openstack-infra16:16
fungircarrillocruz: but i wouldn't recommend altering the current artifact build scripts because they're already mostly necessarily distinct16:16
rcarrillocruzfungi: other question: why the artifact upload stage is done as a JJB builder script. wouldn't make sense to have it as a JJB publisher ?16:17
*** ildikov has joined #openstack-infra16:18
rcarrillocruzwe have a 'war' JJB publisher already16:18
*** banix has quit IRC16:18
fungircarrillocruz: i think so that we can properly capture job "failure" as "i failed to upload this thing"16:19
rcarrillocruzhmm, ok16:19
rcarrillocruzthx16:19
redrobotSergeyLukjanov hi! I was wondering if you could review https://review.openstack.org/#/c/109398/ again.  I think you may have missed that openstack-barbican was already in the channels.yaml file16:19
fungircarrillocruz: as opposed to when a publisher dies/aborts which jenkins reports as a status of "unstable" instead of "failure"16:20
rcarrillocruzah, nice16:20
rcarrillocruz'unstable'16:20
rcarrillocruz:-)16:20
*** mrmartin has quit IRC16:22
*** melwitt has quit IRC16:23
*** melwitt has joined #openstack-infra16:23
*** melwitt has quit IRC16:26
*** melwitt has joined #openstack-infra16:26
*** melwitt has quit IRC16:27
*** bdpayne has joined #openstack-infra16:30
*** melwitt has joined #openstack-infra16:30
*** zns has quit IRC16:31
*** samy has joined #openstack-infra16:32
clarkbthere I have properly cherrypicked the hash seed changes for stable maint16:32
*** melwitt has quit IRC16:32
*** samy is now known as Guest5002516:33
*** marcoemorais has quit IRC16:33
*** _nadya_ has quit IRC16:34
*** marcoemorais has joined #openstack-infra16:34
fungiexcellent16:34
clarkbfungi: mordred jeblair jhesketh SergeyLukjanov I would like to consider setting a date for eg 2 weeks from now for the tox upgrade on our side16:35
clarkbI feel like this is a race I can't win if I try to test and update everyone16:35
clarkbinstead better to just give warning16:35
clarkband do my best16:36
fungiclarkb: so all the official projects have static hash seed changes proposed and backported to supported stable branches now? or only ones where you noticed obvious failure most of the time?16:36
clarkbonly the ones that I got to16:36
clarkbbut for the most part yes16:36
fungiahh, okay cool16:36
*** yamahata has joined #openstack-infra16:36
clarkband I have sent mail about the situation and people seem to be aware of it16:37
fungi2 weeks seems perfectly reasonable to me in that case16:37
*** zns has joined #openstack-infra16:38
*** chuckC has quit IRC16:38
*** crc32 has joined #openstack-infra16:41
*** jedimike has quit IRC16:41
*** afazekas has quit IRC16:44
dimsfungi, where can i check if i am part of oslo-ptl? (i have trouble cutting a oslo.utils release - http://paste.openstack.org/show/88956/)16:44
anteayaclarkb: sounds like a good idea to me16:44
*** Longgeek_ has joined #openstack-infra16:45
anteayadims: you aren't https://review.openstack.org/#/admin/groups/148,members16:45
clarkbcool looks like we got marun's neutron functional tests working yesterday16:46
* clarkb feels like he has accomplished things at this meetup16:46
*** shashankhegde has quit IRC16:46
*** Ryan_Lane1 has joined #openstack-infra16:46
anteayadims: so yeah either get dhellmann or markmc to add you or change the tagging permission on oslo.utils: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/gerrit/acls/openstack/oslo.utils.config16:47
anteayaclarkb: yay16:47
dimsah thanks. will get dhellmann to add me16:48
*** Longgeek has quit IRC16:48
clarkbon to the next thing16:49
*** dims has quit IRC16:49
fungidims: yeah... you can find the group membership link at https://review.openstack.org/#/admin/projects/openstack/oslo.utils,access16:49
*** dims has joined #openstack-infra16:50
clarkbadam_g: greghaynes: so tl;dr we need to make a job that does juno nova baremetal to juno ironic using grenade16:50
*** crc32 has quit IRC16:50
clarkbtis will require updates to devstack gate to do a release X to release X with different services update16:50
greghaynesso I hear16:51
*** adalbas has quit IRC16:51
*** marun has joined #openstack-infra16:51
anteayathat job sounds like it needs a sprint all to itself16:51
clarkbanteaya: maybe16:52
*** pblaho_ has joined #openstack-infra16:52
*** reed has joined #openstack-infra16:53
*** marzif has quit IRC16:54
*** bdpayne has quit IRC16:54
*** banix has joined #openstack-infra16:55
*** james_li has quit IRC16:56
*** Longgeek_ has quit IRC16:56
*** Longgeek has joined #openstack-infra16:57
*** che-arne has quit IRC16:57
*** zns has quit IRC16:57
*** leopoldj has quit IRC16:57
*** luqas has quit IRC16:58
*** Longgeek_ has joined #openstack-infra16:58
*** james_li has joined #openstack-infra16:59
*** che-arne has joined #openstack-infra16:59
*** zns has joined #openstack-infra16:59
*** ZZelle_ has joined #openstack-infra16:59
*** che-arne|2 has joined #openstack-infra16:59
*** craigbr has quit IRC16:59
*** craigbr_ has joined #openstack-infra16:59
*** che-arne|2 has quit IRC16:59
*** gokrokve has joined #openstack-infra17:00
*** rainya has quit IRC17:00
*** trinaths has quit IRC17:01
*** trinaths has joined #openstack-infra17:01
*** Longgeek has quit IRC17:01
*** jpich has quit IRC17:03
pcm_anteaya: ping17:03
*** hasharMeeting has quit IRC17:03
anteayapcm_: I'm here17:04
anteayayolanda: okay looking better, in 800x600 slide 18 needs some love17:04
pcm_anteaya: Have a question... I'm getting tox failure to install the new oslo.config package (for neutron)17:05
anteayaand I think slide 16 too, the text continues off the right hand side of the page17:05
pcm_anteaya: that was just upstreamed.17:05
anteayapcm_: well we are moving to a new version of tox17:05
anteayapcm_: can you paste your failure?17:05
pcm_anteaya: I think it was bug 10659217:05
uvirtbotLaunchpad bug 106592 in ubiquity "install bug (dup-of: 106591)" [Undecided,Invalid] https://launchpad.net/bugs/10659217:05
uvirtbotLaunchpad bug 106591 in ubiquity "install bug" [Undecided,Invalid] https://launchpad.net/bugs/10659117:05
anteayaubiquity? perhaps we have the wrong bug number17:06
*** praneshp has joined #openstack-infra17:06
pcm_anteaya: yeah, let me check again...17:06
* anteaya stands by17:06
pcm_anteaya: Gee... that's what I have https://review.openstack.org/#/c/106592/417:07
*** rainya has joined #openstack-infra17:07
*** adalbas has joined #openstack-infra17:07
*** rainya has quit IRC17:08
clarkb106592 is a change not a bug. just a noun mapping mismatch :)17:08
anteayapcm_: I'm lost17:08
anteayapcm_: lets talk about you17:08
anteayawhat are you seeing that said "Hey I need to talk to infra."17:08
*** rainya has joined #openstack-infra17:09
pcm_anteaya: sure. Let me try to rephrase...17:09
* anteaya waits17:09
pcm_anteaya: I updated my Neutron repo, and it has a new requirements.txt file17:09
anteayacool17:09
pcm_anteaya: I did "tox -e py27 -r --notest"17:09
pcm_It fails not being able to install oslo.config 1.4.0.0a3, which was recently added to requirements and pushed to neutron.17:10
*** derekh_ has quit IRC17:10
pcm_So, I'm wondering what to do?17:11
anteayapcm_: honour me with a stacktrace?17:11
*** Longgeek_ has quit IRC17:11
pcm_anteaya: Sure... http://paste.openstack.org/show/88960/17:11
* anteaya feels honoured17:11
anteayathanks17:11
marunclarkb: functional job is now working (thanks to you), so the patch that switches to the new tox job is ready for approval: https://review.openstack.org/#/c/104039/17:11
*** Longgeek has joined #openstack-infra17:11
*** jgallard has quit IRC17:12
* anteaya wonders how much significance to give: [pbr] Processing SOURCES.txt17:12
anteaya    warning: LocalManifestMaker: standard file '-c' not found17:12
clarkbmarun: cool. it has my +2. maybe fungi can look at it quickly. if not I can approve in a bit17:12
fungipcm_: what does '/opt/stack/neutron/.tox/py27/bin/pip --version' say?17:12
openstackgerritA change was merged to openstack-infra/reviewstats: Update core team for tempest and qa-specs  https://review.openstack.org/10978717:12
pcm_anteaya: I tried removing .tox directory, but I get the same error every time. When I look at the "change" in gerrit, it shows it approved and seems to have a Jenkins failure (didn't look at it).17:12
*** Longgeek_ has joined #openstack-infra17:13
pcm_pip 1.4.1 from /opt/stack/neutron/.tox/py27/lib/python2.7/site-packages (python 2.7)17:13
*** Longgeek_ has quit IRC17:13
openstackgerritMatt Kovacs proposed a change to openstack-infra/config: Adding project saml-generator  https://review.openstack.org/11037817:13
fungipcm_: odd... that version should understand python wheels17:14
anteayapcm_: that patch has been approved but never merged due to the jenkins failure17:14
*** e0ne has joined #openstack-infra17:15
fungipcm_: does /opt/stack/neutron/.tox/py27/tmp/pseudo-home/.pip/pip.log mention which urls it tried to download from?17:15
* pcm_ wondering why my requirements.txt has oslo.config 1.4.0.0a317:15
pcm_me checking17:16
*** crc32 has joined #openstack-infra17:17
fungiin theory it should be finding it from http://pypi.python.org/packages/py2.py3/o/oslo.config/oslo.config-1.4.0.0a3-py2.py3-none-any.whl17:17
*** Longgeek has quit IRC17:17
anteayapcm_: because that is what is in the neutron repo: http://git.openstack.org/cgit/openstack/neutron/tree/requirements.txt#n2617:17
pcm_fungi: for oslo.config it says https://pypi.python.org/simple/oslo.config/17:17
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for bug 1342086  https://review.openstack.org/10703217:17
uvirtbotLaunchpad bug 1342086 in nova "DBDeadlock in delete_instance" [Undecided,Fix released] https://launchpad.net/bugs/134208617:17
anteayais that the url parsing thing17:17
pcm_You can see it at the tail end of the paste log above17:18
*** shashankhegde has joined #openstack-infra17:18
anteayawhere if it can't parse hyphens correctly it reverts to looking in a parent directory17:18
fungioh! i think old pip (e.g. the 1.4.1 you're using) won't find that without adding the --use-wheel option17:18
clarkbfungi: correct17:18
fungihttps://pip.pypa.io/en/1.4.1/usage.html17:18
clarkbyou had to say that for it to click for me17:18
clarkbbut ya you need 1.5.x to use wheels17:19
clarkbby default17:19
fungipcm_: so you either need to tweak the tox.ini to support pip 1.4 or you need to use pip >=1.517:19
openstackgerritA change was merged to openstack-infra/elastic-recheck: Fix the coverage job in tox  https://review.openstack.org/10978917:19
fungipcm_: chances are you're getting pip 1.4.1 vendored in by an older virtualenv release17:19
*** bdpayne has joined #openstack-infra17:20
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/requirements: Add new library oslo.utils  https://review.openstack.org/11038017:20
pcm_fungi: so I modify tox.ini to do this --use-wheels or use a newer pip?17:21
*** jaypipes has joined #openstack-infra17:21
anteayayolanda: where did you get the blank index page for your patch? https://review.openstack.org/#/c/109570/2 I can't figure out where it came from17:21
*** e0ne has quit IRC17:22
openstackgerritMatt Riedemann proposed a change to openstack/requirements: Update to python-neutronclient 2.3.6  https://review.openstack.org/11038217:22
fungipcm_: yep. for upstream ci we pre-install latest pip on our test servers17:22
pcm_fungi: Can I just update pip to the latest? Would a simple way be to make sure devstack repo is latest and then do a stack to ensure the latest pip (I think it uninstalls and installs the latest)17:23
pcm_fungi: or should I just manually update it?17:24
dstufftinside of a tox environment the version of pip is controlled by the version of virtualenv that is installed17:24
fungipcm_: yes, i believe devstack does a similar dance but only if it finds that pip is not present or was installed from system packages17:24
*** vladan has quit IRC17:25
pcm_fungi: Confused now... so on my system pip=1.5.6, but the virtualenv has 1.4.1.17:25
fungilooks like we also currently have virtualenv==1.11.6 installed on our job workers17:26
*** dmsimard is now known as dmsimard_away17:26
fungito dstufft's point17:26
*** gmurphy has quit IRC17:26
pcm_fungi: I have 1.10.117:26
*** sarob has quit IRC17:26
dstufftyou want 1.11.x17:26
dstufftfor pip 1.517:26
fungiright, i think virtualenv 1.10.1 installs pip 1.4.1 in your venvs17:27
dstufftyes17:27
fungiwhich will not be happymaking without --use-wheel17:27
pcm_fungi: dstufft: thanks will update.17:27
mesteryI have a question for someone in infra: How can I create a milestone for python-neutronclient here: https://launchpad.net/python-neutronclient17:27
mesteryI can create releases, but I don't see how to create milestones so I can assign bugs, etc.17:28
anteayadims: congratulations on the oslo.utils release17:28
dimsanteaya, thanks!17:28
*** flaviof has quit IRC17:28
*** sarob has joined #openstack-infra17:28
anteayamestery: permissions are on python-neutronclient: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/gerrit/acls/openstack/python-neutronclient.config17:29
*** gmurphy has joined #openstack-infra17:29
mesteryanteaya: Thanks! I think I figured it out: I have to create a series, then pull milestones from that.17:29
fungianteaya: he's talking about lp permissions not gerrit permissions17:29
anteayamestery: and you are a member of the neutron-milestone group: https://review.openstack.org/#/admin/groups/55,members17:29
anteayaah17:29
anteayamy gerrit searching is useless for lp17:30
anteayamestery: cool, happy milestoning17:30
mesteryanteaya: Thanks! :)17:30
fungiand yes you create the milestones relative to a specific series in lp17:30
pcm_anteaya: fungi: dstufft: clarkb: Thanks for the help!17:31
*** amuller has joined #openstack-infra17:31
*** vladan has joined #openstack-infra17:31
*** Ajaeger1 has joined #openstack-infra17:32
*** david-lyle has quit IRC17:33
*** roeyc has quit IRC17:33
*** david-lyle has joined #openstack-infra17:33
*** david-lyle has quit IRC17:35
*** sballe has quit IRC17:36
*** david-lyle has joined #openstack-infra17:36
openstackgerritA change was merged to openstack-infra/config: Fix neutron func job to use gate-specific tox env  https://review.openstack.org/10403917:36
*** harlowja_away is now known as harlowja17:36
anteayapcm_: glad you are on your way again17:37
*** markwash_ has joined #openstack-infra17:37
fungimarun: clarkb: ^ should be live shortly17:37
clarkbdanke17:37
*** markwash has quit IRC17:39
*** markwash_ is now known as markwash17:39
*** mwagner_lap has quit IRC17:39
*** chandankumar has joined #openstack-infra17:41
*** david-lyle has quit IRC17:44
*** david-lyle has joined #openstack-infra17:44
*** cody-somerville has joined #openstack-infra17:45
*** dmsimard_away is now known as dmsimard17:47
*** arosen has joined #openstack-infra17:48
*** eharney has quit IRC17:48
krotscheckAnyone want to Workflow +1 this? We’ve got lots of +2’s.17:48
krotscheckhttps://review.openstack.org/#/c/97521/17:48
*** david-lyle has quit IRC17:49
krotscheck(And by lots I mean 2)17:49
* clarkb prepares to use all the tether bw by starting gertty17:51
anteayaha ha ha17:51
anteayaI should too17:52
anteayathough I'm  betting it will just blow up17:52
anteayasince as jeblair says it isn't ready, don't use it17:52
jeblairkrotscheck: i never saw a response to my question: why?  i don't object, per se, but i don't think we should treat that as automatic17:52
*** trinaths has quit IRC17:52
krotscheckjeblair: Ah, got it. Things get buried in the comment feed, no?17:53
jeblairkrotscheck: heh, yep. especially if i don't '-1' because i don't want to seem unduly negative.  :/17:53
jeblairkrotscheck: basically, if you and/or nikita say "oh, yeah totally there's adminy stuff he needs to do" i'm all for it, but if it's just for parity, then i'd say let's wait until there's a real need17:54
rcarrillocruzhey17:54
rcarrillocruzcould anyone please point me where's the source code for the wheel/tarball jjb publishers?17:55
rcarrillocruzi can't seem to find them anywhere17:55
*** htrmeira has joined #openstack-infra17:55
anteayahey I made gertty go boom: http://paste.openstack.org/show/88970/17:55
anteayawhat do I do to fix it?17:55
clarkbrcarrillocruz: modules/openstack_project/files/jenkins_job_builder/config/pypi-jobs.yaml iirc17:55
*** SumitNaiksatam has quit IRC17:56
anteayaI screwed up something with sqlalchemy17:56
jeblairanteaya: remove your db file (~/.gertty.db) and start over17:56
anteayakk17:56
krotscheckjeblair: Responded with a comment- My take on it is less “he needs to do admin things” and more “If something breaks in admin land, it would help to be an admin to debug what happened”17:57
*** signed8bit is now known as signed8bit_ZZZzz17:57
anteayavery pretty welcome page17:57
anteayanot sure if I got that the first time17:57
*** Alexei_987 has joined #openstack-infra17:58
jeblairkrotscheck: cool, thx17:58
jeblairanteaya: you did not :)17:58
rcarrillocruzclarkb: i guess you mean '{name}-pypi-wheel-upload' . that's indeed in python-jobs, for uploading the wheel to pypi. But I'm interested in the bits that upload the wheel/tarball to tarballs.openstack.org, right after it's built17:58
krotscheckAn alternative to that would be to build out db synchronization so that we can have local copies of all the prod data to test against.17:58
fungircarrillocruz: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/python-jobs.yaml#n22617:59
fungircarrillocruz: it very well may be that at this stage, we don't even need that part extracted into a separate script because it's straightforward enough in the publisher18:00
anteayajeblair: well it is a great addition then18:00
clarkbrcarrillocruz: the tarball job in python-jobs.yaml18:00
clarkbrcarrillocruz: it uploads to tarballs.o.o18:00
*** _nadya_ has joined #openstack-infra18:01
clarkbsdague: did 107599 fail due to your change? eg did that influence the large ops job?18:01
clarkbjogo: ^18:01
fungircarrillocruz: so your refactor could just be the one script which retrieves things from tarballs.o.o and uploads them to various services (so just combining the various upload scripts with the builder bits which do the downloading in the jar/war upload jobs)18:01
*** marcoemorais has quit IRC18:02
*** marcoemorais has joined #openstack-infra18:02
*** sarob has quit IRC18:02
fungircarrillocruz: in which case the change you have now is fairly close, aside from not covering some bits of shell we currently have in the java and jenkins-ci upload jobs18:03
*** sarob has joined #openstack-infra18:03
fungiand realigning the meaning of your command-line options and internal variables to be consistent18:03
*** eharney has joined #openstack-infra18:04
fungion an unrelated note, does anyone else shudder when they see the "welcome new contributor" response on a change to add a new project?18:05
sdagueclarkb: I don't know, haven't looked at that one18:06
openstackgerritMatt Kovacs proposed a change to openstack-infra/config: Adding project saml-generator  https://review.openstack.org/11037818:06
sdagueclarkb: did you see my reviews on the d-g multinode patch18:07
clarkbnot yet18:07
jogoclarkb: I think 107599 failed because of a bug 134959018:07
jogosdague: ^18:07
uvirtbotLaunchpad bug 1349590 in nova "nova-network appears to lock up while associating floating ip's" [High,Confirmed] https://launchpad.net/bugs/134959018:07
anteayafungi: every time18:07
*** david-lyle has joined #openstack-infra18:07
*** sarob has quit IRC18:07
sdaguebecause I think that instead of calling out devstack functions, we should copy those needed functions into d-g18:07
*** jamielennox|away is now known as jamielennox18:07
sdagueotherwise I think we could break some stuff18:08
clarkbsdague: it should be cogated18:08
clarkbbut pulling out is fine too18:08
*** SumitNaiksatam has joined #openstack-infra18:08
sdagueyeh, but devstack has branches18:09
rcarrillocruzfungi: thanks, i was getting lost with variable expansion trail, digging the hole from projects.yaml all the way down18:09
sdagueand d-g does not18:09
sdagueso the functions called will be different code depending on branch18:09
sdaguewhich I think is error prone, and a kind of coupling we don't want18:09
clarkbsdague: did you see my comments in a previous patchset?18:09
clarkboh good point18:09
sdagueI don't think so, sorry, I just dove in on the current patch18:10
*** e0ne has joined #openstack-infra18:10
*** holden247 has joined #openstack-infra18:10
clarkbI think we said similar thinsg about pushing the iptables stuff into devstack18:10
clarkbbasically that is required to do multinode so make devstack do it18:10
*** markmcclain has quit IRC18:12
*** marcoemorais has quit IRC18:12
*** marcoemorais has joined #openstack-infra18:12
*** marcoemorais has quit IRC18:13
*** marcoemorais has joined #openstack-infra18:14
*** che-arne has quit IRC18:15
*** markmcclain has joined #openstack-infra18:16
*** markmcclain1 has joined #openstack-infra18:17
*** banix has quit IRC18:19
*** markmcclain has quit IRC18:21
*** ociuhandu has quit IRC18:24
*** juzuluag has quit IRC18:24
*** markwash has quit IRC18:26
*** marcoemorais has quit IRC18:26
*** mpaolino has quit IRC18:26
*** jlibosva has quit IRC18:26
*** marcoemorais has joined #openstack-infra18:26
clarkbjeblair: fungi jhesketh SergeyLukjanov mordred 104386, I think we should go ahead with the change as is unless someone wants to look at the string and change the type18:28
clarkbiirc using text for everything will just make those parameters render in a larger box which is fine by me18:28
*** banix has joined #openstack-infra18:28
*** e0ne has quit IRC18:30
clarkbfungi: I am going to approve changes to git-review without your +2 if that is ok with you18:32
clarkbfungi: the test suite is pretty legit now so I trust it18:32
fungiclarkb: sounds great to me18:32
*** e0ne has joined #openstack-infra18:32
openstackgerritimain proposed a change to openstack-infra/config: Back to running docker tempest tests on Fedora.  https://review.openstack.org/11040918:33
*** sdake has quit IRC18:33
*** sdake has joined #openstack-infra18:33
*** vladan has quit IRC18:34
clarkbfungi: 108146 is an easy one18:37
clarkbman -l ftw18:37
openstackgerritA change was merged to openstack/requirements: Update openstack-doc-tools to at least 0.17  https://review.openstack.org/10990518:38
nibalizerjeblair: if at any point you want to poke hiera or puppet3, let me know18:38
*** jcoufal has joined #openstack-infra18:39
*** vladan has joined #openstack-infra18:42
*** zns has quit IRC18:44
*** zns has joined #openstack-infra18:44
openstackgerritA change was merged to openstack-infra/git-review: Enabled hacking checks H305 and H307  https://review.openstack.org/10757618:46
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Stop using select-mirror in slave scripts  https://review.openstack.org/10610718:46
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Clean up select-mirror backward compatibility  https://review.openstack.org/10611218:46
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Delete select-mirror and all the args  https://review.openstack.org/10335518:46
*** yfried_ has joined #openstack-infra18:48
*** Sukhdev has joined #openstack-infra18:49
*** gmurphy has quit IRC18:50
openstackgerritA change was merged to openstack-infra/git-review: Avoid a stacktrace when no reviews are pending  https://review.openstack.org/10317818:50
*** markwash has joined #openstack-infra18:50
*** signed8bit_ZZZzz is now known as signed8bit18:51
*** lukego has quit IRC18:51
reeddoes anybody know why Smokestack seems to be last updated 3 months ago? https://ask.openstack.org/en/question/43662/what-happened-to-httpssmokestackopenstackorg/18:52
clarkbreed: I think dprince decided it wans't needed anymore?18:53
fungireed: dprince might know if you see him around18:53
clarkbwe are testing on fedora now and bobball is testing xen18:53
clarkbthe only thing we don't quite cover is the package building that happens before testing18:53
reedclarkb, fungi: the wiki page makes it look like it's a bigger effort than just dprince... is that the case or is this a personal project of dan?18:54
*** markwash_ has joined #openstack-infra18:54
clarkbI thought it was basically just dan doing a thing18:54
fungireed: i think there might have been one or two other hatters working on it from time to time, but mostly just him yeah18:54
*** markwash has quit IRC18:55
*** markwash_ is now known as markwash18:55
reedfungi, ok, I'm answring that question then18:55
*** banix has quit IRC18:55
*** jistr has joined #openstack-infra18:56
reeddo we use it for anything?18:56
*** pblaho_ is now known as pblaho18:56
fungipleia2: is reviewday still tied at all to the results on smokestack.org?18:56
openstackgerritA change was merged to openstack-infra/git-review: Fix groff warnings with manpage  https://review.openstack.org/10814618:56
*** david-lyle has quit IRC18:57
*** david-lyle has joined #openstack-infra18:57
*** gmurphy has joined #openstack-infra18:57
*** david-lyle has quit IRC18:59
*** david-ly_ has joined #openstack-infra18:59
*** ramashri has joined #openstack-infra19:00
*** sarob has joined #openstack-infra19:00
fungimeeting time!19:00
*** markwash has quit IRC19:01
jeblairyay!19:01
*** sarob_ has joined #openstack-infra19:02
*** whoops has joined #openstack-infra19:04
*** sarob has quit IRC19:05
*** esker has quit IRC19:05
*** esker has joined #openstack-infra19:05
*** david-ly_ is now known as david-lyle19:05
*** craigbr_ has quit IRC19:06
*** sarob_ has quit IRC19:07
openstackgerritDavide Guerri proposed a change to openstack-infra/config: Complete the documentation needed to add a new IRC channel  https://review.openstack.org/11028519:07
*** hashar has joined #openstack-infra19:08
*** craigbr has joined #openstack-infra19:09
*** esker has quit IRC19:10
*** tnovacik has quit IRC19:12
openstackgerritKen Giusti proposed a change to openstack-infra/config: Add the Apache Qpid AMQP 1.0 messaging libraries to all slaves.  https://review.openstack.org/11043119:13
*** shashankhegde has quit IRC19:14
*** hashar has quit IRC19:14
*** mwagner_lap has joined #openstack-infra19:15
*** esker has joined #openstack-infra19:17
*** esker has quit IRC19:18
*** masayukig has quit IRC19:21
pcm_anteaya: ping19:21
*** chandankumar has quit IRC19:24
*** kgiusti has joined #openstack-infra19:25
*** flaviof_zzz has joined #openstack-infra19:26
*** sarob has joined #openstack-infra19:26
*** masayukig has joined #openstack-infra19:27
*** andreykurilin has joined #openstack-infra19:28
*** rainya has quit IRC19:28
*** rainya has joined #openstack-infra19:29
*** derekh_ has joined #openstack-infra19:30
*** bauzas has quit IRC19:36
*** amotoki has quit IRC19:38
*** unicell has quit IRC19:38
anteayapcm_: ahoy19:41
*** holden247 has quit IRC19:42
*** banix has joined #openstack-infra19:43
yolandahi anteaya, i used the template branch19:43
*** dims has quit IRC19:47
anteayayolanda: ah19:48
*** openstackgerrit has quit IRC19:48
*** bauzas has joined #openstack-infra19:49
*** otherwiseguy has quit IRC19:51
*** lcheng_ has joined #openstack-infra19:52
*** otherwiseguy has joined #openstack-infra19:52
yolandaanteaya, something wrong there?19:54
anteayayolanda: not at all, I have to create a slide deck19:55
*** ramashri has quit IRC19:55
anteayaand wanted to copy you19:55
anteayaand didn't know about the template branch until you told me, so thank you19:55
*** arnaud has joined #openstack-infra19:56
*** markmcclain1 has quit IRC19:59
*** markmcclain has joined #openstack-infra20:00
*** amuller has quit IRC20:00
fungianteaya: you probably want to read the readme in the master branch20:01
*** mikal_ is now known as mikal20:01
fungioh, actually it doesn't mention the template branch20:01
anteayafungi: thanks, I can do that again as well20:02
anteayaoh, well it is possible I read things and miss stuff20:02
*** sarob__ has joined #openstack-infra20:02
fungiyeah, there'20:02
fungis a good todo item20:02
mordreddguerri: yeah - we didn't make it through the whole agenda - but we can certainly pick things up in here20:03
*** jp_at_hp has quit IRC20:03
dguerricool20:03
dguerrithanks20:03
*** e0ne has quit IRC20:03
dguerriI think there are a couple of bullets before mine, though20:03
fungianteaya: so yeah, http://git.openstack.org/cgit/openstack-infra/publications/tree/README.rst?h=template is what i was remembering, but i agree that's not discoverable20:04
jeblairthey're also at the top of the agenda for next week20:04
anteayafungi: thanks20:04
dguerrianteaya, about https://review.openstack.org/10929220:05
dguerriThis is about adding a new tool to Stackforge20:05
anteayadguerri: I'm on really bad wifi on a plane20:06
*** jistr has quit IRC20:06
*** sarob__ has quit IRC20:07
anteayajust state what you want to accomplish so others can offere their thoughts and they will do so as they are able20:07
clarkbkrotscheck: can you see my comment in 10906920:07
clarkbkrotscheck: if you think that isn't necessary I can be convinced to approve as is20:07
anteayasince some are in the next meeting currently in progress20:07
yolandaclarkb, looking at your reviews, problem is that there are 2 changes that should be together:20:07
dguerrianteaya ack20:07
clarkbkrotscheck: mostly worried we may sneak in new stuff between options checking and skipping a project20:07
clarkbyolanda: if key in dict: is functionall equivalent to if key in dict.keys() right?20:08
yolandahttps://review.openstack.org/109957 and https://review.openstack.org/11000920:08
dguerriso, as I said this is about including a new tool in Stackforge. Tool name is git-upstream20:08
krotscheckclarkb: Safety third! Gimme a sec, I’ll update it.20:08
clarkbyolanda: oh that20:08
dguerribasically git-upstream can be used to keep in sync a mirror with local patches with upstream OpenStack repos. It has been used for a while in HP and a some time ago we decided to polish it and release it as FOSS (Apache 2.0 license)20:08
clarkbyolanda: ok I see now20:08
yolandaclarkb, not now, because i added description there20:08
dguerriThere has been a concern about the name of the tool (anteaya) as it could create confusion with git-review.20:08
clarkbyolanda: but its still project: description20:08
dguerriAfter a discussion with anteaya here, we agreed to add a clear statement about the main use case of git-upstream (in the documentation for the tool itself and in commit message for the above review).20:09
clarkbyolanda: ok I will need to review the gerritlib change20:09
yolandaclarkb, before that it was a list, [project1, project2, project3}20:09
yolandanow it's {project1:desc1, project2:desc2}20:09
dguerriSo, who could have a look to this review? https://review.openstack.org/109292 :)20:09
dguerriplease20:10
clarkbyolanda: ya but in python if you say if key in dict: that checks if the key is in the dict right?20:10
*** _nadya_ has quit IRC20:10
yolandaclarkb, yes, is that faster?20:10
krotscheckclarkb: Updated, better? https://review.openstack.org/#/c/109069/3/jeepyb/cmd/manage_projects.py20:10
yolandai don't mind changing that, sure20:10
anteayadguerri: I think the question you need to ask is if anyone feels there will be confusion betwen your tool and git-review given your new toold description20:10
clarkbyolanda: yup because it uses the hash rather than searching a list20:11
dguerrianteaya I mentioned that20:11
clarkbkrotscheck: yup thanks20:11
yolandaclarkb, ok, i can just change it, just let me know your feedback also about the other parts of the change20:11
anteayaI think your new description does a good job differenciating itself but I would like to hear the opinons of others20:11
dguerriyes, that's the main question, thanks :)20:11
clarkbyolanda: ya I need t oreview gerritlib first. I missed that20:11
yolandaclarkb, i wanted to add some dependency between each project but i didn't find an easy way, maybe to file a comment on it as anteaya suggested20:12
yolandais there any other way on gerrit to declare dependencies between projects?20:12
dguerriplease keep in mind that even if we would love to see this tool in openstack-infra, we are proposing it to Stackforge atm.20:12
*** derekh_ has quit IRC20:12
jesusaurusyolanda: no :( the best you can do is comment about it in the commit message20:12
fungiyolanda: usually i explain cross-project change sequencing in the commit messages20:13
*** amalagon has quit IRC20:13
yolandafungi, jesusaurus, not filing an inline comment but adding that into the commit message itself?20:13
fungiyolanda: yes20:14
jesusaurusyolanda: yeah, thats what i do20:14
yolandaone new thing learned  :)20:14
fungiyolanda: it's also helpful information to end up in the commit log because it helps people who may be continuously deploying those projects know about the lockstep upgrade need20:14
*** _nadya_ has joined #openstack-infra20:15
*** ramashri has joined #openstack-infra20:15
yolandafungi, makes sense20:15
fungidguerri: my biggest concern with it being in openstack-infra is that it effectively encourages downstreams to carry forks of openstack projects (though your more recent readme does a good job of reinforcing upstream contribution of changes and only using it for short-term divergence)20:16
fungidguerri: i'm far less concerned about it being in stackforge however20:16
dguerrifungi: we are convinced that git-upstream will encourage people to stay up-to-date, avoiding forks.20:16
dguerrithat is the way we are using it20:17
dguerriand that is the reason why it was developed20:17
fungidguerri: just keep in mind that we have lots and lots of changes to review and are even further behind than usual, and changes adding projects to stackforge are a low review priority for us (we need to prioritize keeping openstack running), so four days in review is actually not that long20:17
ianwdguerri: feedback from someone who had never heard of this till now -- a small sample cli session in the README.md for all those 7 bullet points might help20:18
*** _nadya_ has joined #openstack-infra20:19
*** dims has joined #openstack-infra20:19
dguerrifungi: absolutely, no problem with that... I am raising the issue here because of the anteaya's concern20:19
anteayadguerri: which I thank you for you are doing a great job20:20
dguerriianw: good idea. There is a CLI session in USAGE.md I will add an example for each bullets20:20
dguerrianteaya thanks :)20:20
*** _nadya_ has quit IRC20:20
yolandaso clarkb, i updated that, and updated commit message to reflect dependency on gerritlib20:21
clarkbyolanda: thank you20:22
*** david-lyle has quit IRC20:22
*** david-lyle has joined #openstack-infra20:22
*** rlandy has quit IRC20:22
*** dhellman_ has joined #openstack-infra20:22
dguerrifungi: a misuse is possible for every tool (even git itself, of course). Things could be perceived worse for git-upstream as it contains the phrase "locally carried patches"20:24
dguerrifungi: but I think that for big companies that are using openstack those are unavoidable.. and are not about trade secrets or the like20:26
fungidguerri: yep. as i said it's not as much of a concern for me now, but hp had a history of running old and heavily patched openstack, so when the tool you use to make that anti-pattern possible was initially proposed as something we could maintain within openstack-infra, i was skeptical20:26
dguerrifungi exactly!20:27
*** david-lyle has quit IRC20:27
dguerrifungi: we are now using git-upstrema to avoid that20:27
dguerriit has been created exactly for that readon20:27
dguerri*reason20:27
*** david-lyle has joined #openstack-infra20:27
dguerrianyonw has concern about the name of the tool?20:27
fungiyeah, the tool seems fine to me. i'm still unconvinced that it's a fit for being an openstack-infra project, but it's perfectly okay to have something like that in stackforge i think20:28
*** david-lyle has quit IRC20:28
*** david-lyle has joined #openstack-infra20:29
asselinhi, not sure what happened, but I can no longer stop zuul. any tips? No process in pidfile '/var/run/zuul/zuul.pid' found running; none killed.20:29
yolandaanteaya, thx to you for all the help :)20:29
asselineven after rebooting20:29
yolandai just listed the branches and discovered that, maybe we could file that in some place about "How to create publications220:30
yolanda"How to create publications"20:30
*** lnxnut has quit IRC20:30
*** rainya has quit IRC20:30
anteayayolanda: my pleasure, thanks for your persistence20:30
fungiyolanda: i agree the readme in the template branch is great and also not very discoverable20:31
anteayayolanda: something to helpf folks like me20:31
yolandai also had some valuable help from pleia2, because i started doing the slides in a powerpoint20:31
*** flaviof_zzz is now known as flaviof20:31
*** rainya has joined #openstack-infra20:31
fungiyolanda: the readme in the master branch should probably direct people to the template branch20:31
anteayaah20:31
ianwdguerri: only concern is that "upstream" is the main remote tracking branch used to track, well, upstream -- as suggested by https://help.github.com/articles/fork-a-repo (which i assume is a big reference in general)20:31
*** zns has quit IRC20:31
ianwso you've got "git pull upstream master" and "git upstream pull" ...20:32
ianwgets confusing20:32
*** zns has joined #openstack-infra20:32
yolandaanteaya, as all the slides i did in the past were done using PowerPoint, in my mind i was thinking on some power point template that was exported in some way to the final html20:32
*** rainya has quit IRC20:33
*** lcheng_ has quit IRC20:33
*** shashankhegde has joined #openstack-infra20:34
*** rainya has joined #openstack-infra20:34
ianwdguerri: maybe if something abstract, a play on quilt ... it seems to be angled as a more git-centric version of that20:35
anteayayolanda: ah20:36
* anteaya wants an infra-core world tour t-shirt20:37
anteayathe fanboi size20:37
clarkbyolanda: ok reviewed the gerritlib change20:37
*** kgiusti has quit IRC20:37
*** SumitNaiksatam has quit IRC20:37
clarkbyolanda: can you see my comment and let me know what you think?20:37
pleia2fungi: I have a review outstanding with those instructions20:37
fungipleia2: excellent! i've no doubt i will run across it soon ;)20:38
pleia2https://review.openstack.org/#/c/98906/20:38
pleia2:)20:38
dguerriianw: I think the main issue about the name was for the git- prefix which is needed by any git subcommand20:38
anteayapleia2: you should be resting20:38
pleia2jeblair: re: away - I'll probably be back half day on thursday, post surgery pain still making it tricky to be at computer for more than a little bit20:38
pleia2anteaya: yes :)20:38
dguerriianw: upstream could be confusing for a novice... but definitely not for the target audience of these kind of tools20:38
fungipleia2: stop computering20:38
jeblairclarkb: i got a bunch of emails from rax saying the hosts that logstash 06,16,14 are on ar having problems20:39
*** dmsimard is now known as dmsimard_away20:39
anteayapleia2: it isn't even a week yet20:39
fungijeblair: clarkb: mordred: SergeyLukjanov: jhesketh: i was going to raise the question briefly in today's meeting if we got time, but any opinions on whether we should take a maintenance window and ask rackspace to migrate jenkins05 to a new host?20:39
clarkbjeblair: cool. anything I can do to help with that?20:39
pleia2right right, back to resting! :)20:39
jeblairpleia2: yes, rest!  no rush!20:39
clarkbfungi: Ithink we can do that. its relatively easy to take a node out of hte rotation20:39
fungijeblair: any possibility that's the same host jenkins05 was having issues on?20:39
clarkbfungi: and if we get more reliablity then +220:39
fungijeblair: did they elaborate on what kind?20:40
clarkboh that would be interseting20:40
jeblairfungi: no and no20:40
fungipoop20:40
clarkboh it does have missing graphs in cacti20:40
clarkbwhcih could be network tuoble20:40
yolandaclarkb, i did the conditional because other values could be boolean or numeric types20:40
clarkbwhich could be the same issue20:40
jeblair"At this time we have not yet been able to restore access to your cloud server 'logstash-worker14.openstack.org'."20:40
*** eharney has quit IRC20:40
clarkbyolanda: oh hrm20:40
jeblairsounds serious though20:40
fungiouch20:40
clarkbjeblair: fwiw we can nuke those nodes and start over if it helps20:40
clarkbjeblair: there is no real data on them20:41
fungiunlike the elasticsearch nodes20:41
clarkband even then its the volumes that matter20:41
yolandai think description is the only string value that api supports, let me double check20:41
ianwdguerri: right, just saying "upstream" is a pretty big name-space to use, since its such a common term.  also i know i've written similar tools, so there's lots of approaches (we used to have this weird collection of sub-modules, etc)20:41
fungipoint20:41
clarkbyolanda: ok I will +220:41
clarkbyolanda: if that becomes a problem we can worry about it then20:41
yolandacool20:41
fungion jenkins05, i'll go ahead and find out what sort of turnaround time is feasible and then plan to put it into a graceful shutdown well in advance of the scheduled migration window20:42
yolandaclarkb, https://gerrit-documentation.googlecode.com/svn/Documentation/2.6/cmd-set-project.html . So description is the only value that subject to have quotes there20:42
dguerriianw ack... I will think about that :)20:42
dguerriianw: thanks for the feedback20:43
clarkbyolanda: thanks20:43
yolandaclarkb, fungi, so i was expecting that when jeepyb changes are merged, if gerritlib change is not merged tests will be failing, but it would depend on the nature of the tests taken20:44
yolandacan we ensure that gerritlib changes are merged before jeepyb to don't break anything?20:44
*** dguerri is now known as _dguerri20:45
*** _dguerri is now known as dguerri`afk20:45
*** pblaho has quit IRC20:46
fungiyolanda: yes, as long as the commit message states that dependency (which it sounds like it does) then whoever is babysitting the approval on those changes should hopefully at least check puppetdb.openstack.org between them to ensure the first one is applied before approving the second20:46
*** juzuluag has joined #openstack-infra20:47
yolandafungi, yes, i commented the dependency on jeepyb changes of gerritlib20:48
*** Sukhdev has quit IRC20:48
*** juzuluag has quit IRC20:48
JayFopenstackgerrit appears to be gone20:53
fungiJayF: i'll hunt it down and correct20:53
yolandapleia2, i hope you recover well20:54
JayFThanks fungi20:54
*** lukego has joined #openstack-infra20:55
*** openstackgerrit has joined #openstack-infra20:59
*** dkranz has quit IRC21:02
jeblairfungi: ticket about jenkins05 just updated21:02
jeblairnot urgent, as it turns out21:02
SergeyLukjanovjeblair, fungi , clarkb, mordred, folks, I'm sorry - I've been unable to attend today's infra meeting21:03
jeblairfungi: so it sounds like we don't _need_ to migrate 05?  do you still want to anyway?21:03
*** sarob_ has joined #openstack-infra21:03
anteayaSergeyLukjanov: everything okay?21:03
anteayaSergeyLukjanov: or are you finally needed to actually get some sleep in your life?21:03
anteayathe amount you work is astounding21:04
SergeyLukjanovanteaya, yup, everything is ok, lack of time and a bunch of housekeeping duties ;)21:04
anteayaSergeyLukjanov: how are the renovations coming along?21:05
SergeyLukjanovanteaya, we've finally moved to the new place last wednesday21:05
*** david-lyle has quit IRC21:05
anteayayay!!21:05
anteayahow is it?21:05
SergeyLukjanovanteaya, it's awesome, especcially after the long time of making it from scratch :)21:06
*** david-lyle has joined #openstack-infra21:06
SergeyLukjanovespecially*21:06
fungijeblair: my only concern is that they basically identified the symptom on the host but didn't imply they knew the cause and since it's happened twice now it could presumably happen again21:06
anteayaSergeyLukjanov: woohooo21:07
anteayahouse party at your place next time we are all in russia21:07
arosenHi, I'm following jaypipes blog here ( http://www.mirantis.com/blog/setting-external-openstack-testing-system-part-1/) . When i submit a patch to review.openstack.org to the sandbox repo I see the following message in /var/log/zuul/debug.log21:07
SergeyLukjanovanteaya, sure, but I'm afraid that it'll be not so soon as I want :)21:07
anteayawhere are you, moscow? st petersburg?21:07
arosenbut the results never post bacK: WARNING zuul.Scheduler: Project openstack-dev/sandbox not found21:07
anteayaSergeyLukjanov: yeah, I hear that21:07
*** aysyd has quit IRC21:07
SergeyLukjanovanteaya, saratov, it's a much smaller city :)21:07
jeblairfungi: okay, works for me21:07
*** weshay has quit IRC21:07
*** sarob_ has quit IRC21:07
anteayaSergeyLukjanov: ah, I will have to look that up21:08
fungijeblair: and given the current state of our tools, when a jenkins master disappears off the network for some period of time, we end up with stuck jobs in zuul, nodepool going crazy allocating ready nodes which it doesn't know are getting used (once the server reappears), et cetera21:08
arosenI was wondering if anyone might know off hand. I saw that someone else had this issue on the mailing list but they never reached a solution.21:08
fungijeblair: so unfortunately somewhat disruptive21:08
anteayaarosen: so yesterday at the third party meeting joa linked us to his notes he created: https://etherpad.openstack.org/p/Setting_up_a_3rd-party_CI___Issues_encountered21:09
anteayaarosen: about setting up a ci using jaypipes notes21:09
*** zul has quit IRC21:09
anteayaarosen: something might be helpful there21:10
clarkbanteaya: is 106495 the multinode spec you wanted peopel to read?21:10
*** david-lyle has quit IRC21:10
anteayaclarkb: yes21:10
clarkbok21:10
*** david-lyle has joined #openstack-infra21:11
clarkbI think maybe we should force those people to talk to sdague and afazekas21:11
clarkbbecause I think 95% of the work is done21:11
anteayaclarkb: awesome21:11
clarkband just make sure everyone is still on the same page21:11
anteayaand yes having a meeting would be good21:11
clarkbI also would like to put a vote in the hat for not requiring specs for new types of testing21:11
clarkbat least not in infra21:11
*** zul has joined #openstack-infra21:11
*** flaper87 is now known as flaper87|afk21:12
clarkbwe supply the nodes, what and how people test things is up to them IMO21:12
anteayaI mentioned at the neutron meeting yesterday and they were keen to know progress21:12
anteayaperhaps they should send a delgate to the -qa meeting?21:12
clarkbanteaya: there is a d-g change up that passes nova network and neutron currenktly21:12
clarkbit needs refinement but its working21:12
anteayareally?21:12
clarkbyup21:12
anteayaokay well I am the one that insisted they write the spec21:13
sdagueanteaya: yeh, it's passing neutron and n-net in the last rev21:13
anteayabelieveing it would seed the qa/infra mulitnode work, and I was wrong21:13
*** yamamoto has joined #openstack-infra21:13
clarkbanteaya: well i think it may be a good exercise for them to do as maybe a neutron spec21:13
anteayaso this is on me, my fault21:13
anteayasure, so do comment, knowing this was me driving them to create an infra-spec21:14
*** yamamoto has quit IRC21:14
anteayasdague: yay21:14
clarkban exception may be dhellmann's spec to do cross project testing because well cross project makes stuff weird21:14
*** yamamoto has joined #openstack-infra21:14
anteayasdague: should I send them to your meeting on thursday?21:14
openstackgerritNicholas Randon proposed a change to openstack-infra/config: Add firewall traffic on port 27410 to 27510.  https://review.openstack.org/10873721:14
*** david-lyle has quit IRC21:15
sdagueanteaya: I'm likely not to be in the meeting as on the road21:15
* anteaya notes she is at half power on her laptop battery21:15
*** dguerri`afk is now known as _dguerri21:15
anteayasdague: kk21:15
anteayaI'll just ask mestery to read a bit of backscroll21:16
anteayamestery: the last few minutes21:16
* mestery lurks while in #openstack-meeting in the project meeting21:16
mesteryanteaya: got it21:16
*** eharney has joined #openstack-infra21:17
*** dustins has quit IRC21:17
mesteryanteaya clarkb: If this is about multi-node, I'll plan to attend the QA meeting for discussions.21:17
clarkbmestery: it is, tl;dr is afazekas has it working21:18
clarkbmestery: we need to clean it up but its mostly there21:18
mesteryclarkb: Yay! Very cool!21:18
*** cdub has quit IRC21:18
*** mmaglana has joined #openstack-infra21:20
*** Ajaeger1 has quit IRC21:21
*** yamamoto has quit IRC21:22
clarkbdhellmann: I have a comment on your spec for cross project unittests that I would like your thoughts on but I am +221:23
*** dkliban has quit IRC21:23
openstackgerritA change was merged to openstack-infra/gerritlib: Update pbr version  https://review.openstack.org/10332021:23
mmaglanahi. i'd like to remove aviator from stackforge since there's a crucial part of its CI workflow that i haven't set up yet and the repo in stackforge is no longer in-sync with https://github.com/aviator/aviator. I don't know when I'll be able to work on the missing piece so, to avoid any confusion, i'd like to remove the one in stackforge for now. what are the steps i need to take?21:23
anteayaarosen: okay so on the process to request a gerrit ci account, this patch is up and hasn't merged yet: https://review.openstack.org/#/c/101013/21:23
anteayaclarkb: feel like a +A? https://review.openstack.org/#/c/101013/21:24
anteayawould be nice to get this in21:24
anteayathis one isn't causing issues21:24
arosenanteaya: okay so you want me to add this to my email i sent?21:24
clarkbanteaya: basically making it eaiser to construct the name?21:24
clarkbmmaglana: that is a tricky question. we don't remove things, but do have an "attic" for stuff21:25
arosenanteaya:  I'm using my normal gerrit account right now till the ci one gets approved.21:25
clarkbmmaglana: usually thoguh if the intent is to go back to using a thing I would argue that the repo be left as is21:25
anteayaarosen: sure, just state the company name for the account and what you are verifying, bluebprint links are great21:25
anteayaclarkb: yes21:25
anteayaarosen: understood21:25
redrobotSergeyLukjanov ping21:26
mmaglanaclarkb: i see. i just want to make sure that there's no confusion as to which one is the de facto upstream repo while aviator repo is still in this transition phase.21:26
*** lukego has quit IRC21:26
anteayammaglana: do you need support for the ci workflow? you are welcome to attend the third party meetings21:26
jesusauruszaro: you around? im confused about project ownership in gerrit. is the Project Owners group special somehow? how does gerrit know what group owns a project?21:26
clarkbmmaglana: well there shouldn't be a transition phase :) once you are on strackforge that is what you should use :P21:26
clarkbredrobot: do you have a specific question?21:27
mmaglanaclarkb: :) i haven't been RTFMing properly.21:27
clarkbI think SergeyLukjanov is afkfor the night21:27
SergeyLukjanovclarkb, not yet)21:27
SergeyLukjanovredrobot, yup, I'm here21:27
clarkbSergeyLukjanov: oh hey tehre you are21:27
redrobotwoot!21:27
SergeyLukjanovclarkb, /me on the project meeting21:27
mmaglanaanteaya: what's missing in my workflow is a service that i have to set-up to run aviator tests in travis ci.21:27
redrobotSergeyLukjanov do you have a chance to look at https://review.openstack.org/#/c/109398/ again?21:28
clarkbmmaglana: are you trying to use travis with stackforge? I think the idea is you would use our CI system21:28
redrobotSergeyLukjanov I think you missed that the channel in question is already in the file you requested21:28
*** shashankhegde has quit IRC21:29
fungijesusaurus: "project owner" is a group setting on a project, defaulting to the "administrators" group, and the "project owners" meta-group is basically an acl hook for "whatever group owns the project in question"21:29
mordredmmaglana: yah - travis is way less featureful than openstack ci ... and the main benefit to hosting with us is getting to use our CI system21:30
*** shashankhegde has joined #openstack-infra21:30
mmaglanaclarkb: mordred: i figured that since the tests aren't really hitting an openstack instance (it uses cassettes made by the VCR gem), i would be needlessly running load on openstack ci.21:31
*** _dguerri is now known as dguerri`afk21:31
jesusaurusfungi: ah, so there is a permission called owner that you set to tell gerrit which group is the owner group?21:31
fungiyep21:32
jesusauruscool, thanks21:32
mordredmmaglana: that's fine - the likelihood of you stressing us out is low ... and ultimately having a stackforge project get tested by travis and not us would be SUPER confusing to people21:32
clarkbjesusaurus: keep in mind owner gets to do lots of stuff21:32
mordredmmaglana: although I do appreciate you thinking of us in that way :)21:33
clarkbjesusaurus: so you may want to double check all of the various things that lets you do21:33
mordredmmaglana: you've also already got tests defined in our system that look to be about the same as your travis.yaml21:34
SergeyLukjanovredrobot, see it now, replaced with -221:34
SergeyLukjanovI mean +2 ;) redrobot21:34
mordredall that really needs done is something similar to your rvm matrix - but we do similar thigns for other projects21:34
redrobotSergeyLukjanov hehe... sounds good. thanks!21:35
*** amalagon has joined #openstack-infra21:35
fungijesusaurus: though also don't confuse the "project owners" meta-group (which refers back to the owner group configured for a project) with the "owner" acl permission (which can be ref pattern specific)21:35
mordredmmaglana: so adding an rvm version matrix thing would likely be something that would benefit others too21:35
mmaglanamordred: i see. in that case, i'm going to need help later on with two things 1) how to set up the CI such that I can run parallel tests each running a different version of Ruby (1.8.7, 1.9.x, 2.0.x, 2.1.x) and 2) how to sync the stackforge aviator with the latest without all of the commits going through gerrit. i wouldn't be able to work on these right away, but when i have time, who should i contact?21:35
mordredmmaglana: any of us - just ping us in here ... I'd love to get your test matrix thing going - should be a piece of cake21:36
fungimmaglana: how many commits? you could just propose them all as a patch series and then approve them, unless it's like dozens and dozens21:36
mordredmmaglana: as for the other thing, whenever you're ready to sync for real, just let us know21:36
*** daya_k has joined #openstack-infra21:37
jesusaurusclarkb: is there a specific big bad perm in particular you have in mind?21:37
mmaglananice! thanks mordred. fungi: i think it's about 2~3 dozens.21:38
*** lcheng_ has joined #openstack-infra21:38
jesusaurusfungi: oh, if the owner acl permission is different, then where is the project owners permission set?21:38
anteayaarosen: thanks21:38
clarkbjesusaurus: https://review.openstack.org/Documentation/access-control.html#category_owner the big one is editing alcs21:38
clarkbjesusaurus: which we try to take away from people and push through review21:39
clarkbbut create and delete branches may be another issue depending on situation21:39
*** andreykurilin has quit IRC21:39
*** mwagner_lap has quit IRC21:39
*** stevebaker is now known as steveburt21:41
*** steveburt is now known as stevebaker21:41
anteayaso from my understanding, once this patch is merged zaro wanted to discuss updating gerrit so that I have access to enhanced permissions for third party ci accounts: https://review.openstack.org/#/c/109797/21:42
anteayaI hope I'm not putting words in zaro's mouth21:42
fungijesusaurus: and https://review.openstack.org/Documentation/access-control.html#project_owners21:43
anteayabut also wanted to d to get some thoughts on timing21:43
arosenjaypipes:  if you get a sec I'm having trouble getting jenkins to vote back on sandbox. I see events comming in though to sudo tail -f /var/log/zuul/debug.log | grep sandbox21:44
arosen21:44
jeblairanteaya: when it lands we should be able to upgrade review-dev, make sure it, works, then upgrade review21:44
anteayakk, thanks21:44
jeblairanteaya: the downtime will be minimal, so we don't really have to worry about it too much.  maybe do it on a friday afternoon or something21:45
anteayagreat21:45
jeblair(we don't usually announce downtimes for things that are just service restarts, which is what this would be)21:45
anteayaglad this will be just a small plip21:46
jaypipesarosen: check the zuul-merger.log.21:46
jaypipesarosen: anything in there?21:46
*** zaneb has joined #openstack-infra21:46
anteayafeels like we are coming into land21:47
anteayaback in a bit21:47
arosenjaypipes:  nope I don't have that log file created.21:47
*** zul has quit IRC21:48
zanebI have a patch where Jenkins started the gate jobs on Sunday but there's no sign of it in the Zuul queue: https://review.openstack.org/#/c/106540/21:48
zanebany clues on how to kick it?21:48
arosenjaypipes:  i also copied all these files you have here to /etc/ on my system https://github.com/jaypipes/os-ext-testing-data/tree/master/etc21:48
zaneb"reverify no bug" and reapprove did not help21:49
jesusaurusclarkb: fungi: thanks for the links21:49
openstackgerritA change was merged to openstack-infra/config: Edits Third Party CI account request directions  https://review.openstack.org/10101321:49
*** zul has joined #openstack-infra21:50
*** ramashri has quit IRC21:51
fungizaneb: that's https://storyboard.openstack.org/#!/story/14721:53
fungizaneb: leave a "recheck no bug" comment21:53
jeblairzaro: 91193 has 2x+2s; please ping an infra-core for approval when you are around and ready to monitor it21:53
fungizaneb: i have a patch in zuul as of today which should alleviate this and help us pinpoint the underlying cause the next time we restart21:53
zanebfungi: I left "reverify no bug" and nothing happened... does that not work any more?21:53
*** r1chardj0n3s_afk is now known as r1chardj0n3s21:54
fungizaneb: reverify has needed a bug number since ages, but also reverify only works of there is an existing "jenkins" vote on your change21:54
zanebah, ok21:55
*** signed8bit has quit IRC21:55
zanebthere was a Jenkins vote at one point, but it got cleared when the gate jobs started21:56
zanebfungi: so basically just never use "reverify" any more?21:56
fungizaneb: basically that change got ejected from the gate when its parent failed to merge, zuul didn't leave a jenkins vote because of story #147, and the child change was subsequently not automatically reenqueued when the parent was put back in because there was now no vote on it21:56
sdagueinfra question, would there be objection to exposing the Rebase button for general use in gerrit?21:57
*** zns_ has joined #openstack-infra21:57
sdagueand not just for patch owners21:57
fungizaneb: "reverify NNNNNN" where NNNNNN is a bug number and there is an existing jenkins vote will work fine21:57
zanebfungi: gotcha, thanks :)21:57
*** dhellman_ has quit IRC21:57
fungizaneb: there is just effectively a hole in the enqueuing configuration right now where reverify and reapplying workflow +1 don't work if there's not a current jenkins vote at all (positive or negative)21:58
fungihowever recheck works even if there is no current jenkins vote on the change21:58
*** alexandra_ is now known as asettle21:59
*** zns has quit IRC21:59
jeblairkrotscheck: i may not have been clear before.  we do not have a policy that just because you are core on a project that we run, you are granted superuser access to a running instance of that project21:59
zanebam I right in thinking that recheck has basically the same effect now anyway? or is reverify still quicker when it works?21:59
sdaguezaneb: they are basically the same22:00
jeblairkrotscheck: instead, our policy is to be rather conservative in granting superuser access22:00
*** chuckC has joined #openstack-infra22:00
zanebsdague: cool, that's what I thought. I'll just use recheck from now on :)22:01
krotscheckjeblair: I’m confused. I didn’t really think we did, my own thoughts on getting Nikita up there is that he’ll be more able to debug prod issues quickly should they arise.22:01
*** sarob_ has joined #openstack-infra22:01
jeblairkrotscheck: your comment in 97521 seems more a justification of why storyboard-core should have superuser access, rather than indicating that there are actual admin tasks for him to perform22:03
*** pdmars has quit IRC22:04
krotscheckjeblair: At the moment, all of our admin tasks are handled by automation. I don’t expect that to change anytime soon. If the measure of “Who gets admin access” is “Hey there’s adminy things I need to do”, then shouldn’t nobody have access?22:05
* krotscheck is cool with that too.22:05
*** sarob_ has quit IRC22:05
jeblairkrotscheck: i think that minimization should be the preferred approach, yes.  and we're much more liberal about access to staging environments (eg, review-dev, jenkins-dev).22:07
krotscheckjeblair: So… we should have a dev environment?22:07
daya_karosen, jaypipes: i had this exact issue, debugged for 2 days with sweston help. the zuul merger process keeps dying when attempting the merge22:08
arosenjaypipes: should something be running that creates  zuul-merger.log file?22:08
jamielennoxall, can i get some reviews on bumping keystoneclient bump to 0.10 in requirements: https://review.openstack.org/#/c/108832/ - needed for some work in keystonemiddleware22:08
jeblairkrotscheck: seems like it22:08
arosendaya_k:  did you follow Jays bog post?22:09
*** banix has quit IRC22:09
daya_karosen, jaypipes: one of the issues was permissions on the /var/lib/zuul directories, the zuul user did not have write permissions in it to perform the merge22:09
daya_karosen: yes22:09
jaypipesarosen: the zuul-merger daemon creates the zuul-merger.log22:09
*** yamamoto has joined #openstack-infra22:09
*** cnesa7 has quit IRC22:10
daya_kasrosen, jaypipes: yes, if you run zuul-merger -d (not daemon mode) you will see the exception, but not when you try to run it as a service22:10
*** Guest83948 is now known as Adri200022:10
*** htrmeira has quit IRC22:10
*** Adri2000 has quit IRC22:11
*** Adri2000 has joined #openstack-infra22:11
arosendaya_k:  thanks just fixed that let me see if things post now.22:11
daya_karosen, jaypipes: check zuul.conf for where the ssh and git directories are and make sure the zuul user has write permissions on them22:11
*** dangers is now known as dangers_away22:11
*** lcheng_ has quit IRC22:12
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for grenade quota reserve deadlock bug 1350064  https://review.openstack.org/11048122:12
uvirtbotLaunchpad bug 1350064 in nova "Deadlock in quota reservations in security groups tests on old side of grenade (icehouse)" [Undecided,New] https://launchpad.net/bugs/135006422:12
arosendaya_k:  got another issue: when i run  zuul-merge it dies witH: ImportError: 'gitdb' could not be found in your PYTHONPATH22:13
daya_kjaypipes: i'm actually still facing this issue. once i got past the permission errors, i see some git fetch errors, and the merger daemon dies again, however i see the merger daemon continues to  working without exceptions  in non-daemon mode,22:13
*** BadCub02 has quit IRC22:14
*** whoops has quit IRC22:14
arosendaya_k: jaypipes pip installing that seems to fix that error for me.22:14
sdaguejamielennox: can you provide the rational in the commit message about why we can't work with something lower?22:14
jaypipesdaya_k: hmm... strange.. check to see you don't have old crud in /var/run/zuul22:14
daya_karosen: correct, i also saw that, you need to add gitdb module22:14
openstackgerritMaru Newby proposed a change to openstack-infra/config: Fix neutron-dsvm-api job  https://review.openstack.org/11048222:15
daya_kjaypipes: how can i clear old jobs, i do see it building up, and git fetch complains about those commits being absent. dont know how to clear the queue22:15
jaypipesdaya_k: hmm good question! :) clarkb, any ideas?22:16
openstackgerritJamie Lennox proposed a change to openstack/requirements: Bump keystoneclient to 0.10  https://review.openstack.org/10883222:16
jamielennoxsdague: sufficient ^ ?22:16
marunclarkb: I've posted a patch for the experimental neutron api job that includes the same fixes made to the functional job. ^^22:16
mattoliverauMorning all22:16
asselinspeaking of zuul merger, can I get some reviews on this? should be quick and easy: https://review.openstack.org/#/c/109364/22:17
jeblairnibalizer: can you review 99041?22:18
*** HenryG is now known as HenryG_afk22:18
asselindaya_k, did you see the same exception as in https://review.openstack.org/#/c/109364/ ?22:19
daya_kasselin: yes, i saw this, and imported the gitdb module, am seeing a new one now. let me look it up and pastebin in a min. just logging in22:20
clarkbdaya_k: do you have tracebacks for when it dies? or is nothing written to the log file?22:20
daya_kclarkb: when i start as a service, nothing written to log file, when i start in non-d, i see a traceback,22:21
asselindaya_k, please test and review that patch...it should will install gitdb for you when it installs zuul22:21
clarkbdaya_k: what is the error?22:21
*** rainya has quit IRC22:22
daya_kclarkb: multiple issues, seen so sorry, will be a bit all over the place, but here goes - http://paste.openstack.org/show/89031/22:24
nibalizerjeblair: sure22:24
daya_kclarkb: this one was in merger.log when the zuul-merger process dies, but i dont always see it,22:25
clarkbdaya_k: that looks like the merger is not able to connect to the gearman process22:25
clarkbthe connection object is None rather than a socket22:25
jeblairnibalizer: re:102071 (beaker specs) that refers to a file that i can't find in puppet-nova; is there an outstanding change for it?22:25
daya_kclarkb: ok, and this one http://paste.openstack.org/show/89032/ i related to old jobs in the queue i think, i see it in merger-debug.log22:26
fungiarosen: daya_k: do you have more details on the traceback for the gitdb import error? zuul doesn't import it so that must be bubbling up from one of the other dependencies... wondering which one and how it was installed22:26
sdaguejamielennox: good for me, thanks. +222:26
daya_kfungi: asselin posted a review on it above22:27
fungioh, thanks daya_k22:27
clarkbdaya_k: I am less sure about that one, but I would doulbe check that your merger can talk to gerrit so that it can find all the refs22:27
*** rainya has joined #openstack-infra22:28
daya_kclarkb: how can i check, my current status is that if i run with -d, it all works.22:28
nibalizerthis is the nova change that will be the first to be able to run specs22:28
nibalizerhttps://review.openstack.org/#/c/102020/22:28
fungidaya_k: asselin: it's unclear to me why you need to explicitly install gitpython. it should already get installed by the zuul module when it pip installs zuul, since zuul's requirements.txt has GitPython>=0.3.2.RC1 specified already22:28
clarkbdaya_k: it may be an authentication thing. when you run it with -d the working dir does not change so it will use relative paths for ssh keys22:29
clarkbdaya_k: when use run it in daemon mode it will cd /22:29
*** rainya has quit IRC22:30
*** bknudson has quit IRC22:30
asselinfungi, good question...I just ran into this again on a clean vm. Add that patch above gets it installed....??22:30
daya_kclarkb: yeah, i has multiple issues with permissions earlier, the zuul user did not have any write permissions, but i've fixed that for the /var/lib/zuul directiries, and i can ssh, i have the ssh path set in zuul.conf22:30
clarkbdaya_k: I dont think it is a perms thing but a path thing22:30
jheskethMorning22:31
*** ramashri has joined #openstack-infra22:31
clarkbsdague: hey can you visit the ironic room? so we can talk about the things22:31
clarkbjhesketh: ohai22:31
daya_kfungi: one of the things to do is to add logging to the jaypipes install scripts :) i dont have the history unfortunately. novice error22:32
jeblairclarkb, sdague: i can phone if you need me to talk about the ironic things22:32
*** prad has quit IRC22:33
sdagueclarkb: coming22:33
clarkbjeblair: long story short is nova wants ironic to test nova baremetal to ironic migration at juno release code level22:34
daya_kclarkb: the path in zuul.conf has /var/lib/zuul/ssh , and the key is in the location. can i check anything else?22:34
*** jaypipes has quit IRC22:35
clarkbdaya_k: it isn't /var/lib/zuul/.ssh? that would be the main thing though is the key22:35
asselinfungi,  do you think the command needs to be sudo pip install /opt/zuul??22:35
*** mfink_ has quit IRC22:35
clarkbjeblair: so we are going to add a job to do that and modify d-g to do juno to juno with different service lists22:35
clarkbthen only run that on branch = juno22:35
fungiasselin: no, puppet agent should already be running as root22:35
clarkbjeblair: I think we have it pretty well covered22:35
daya_kclarkb: no, not .ssh, only ssh , the private key is in the location, with rw for zuul user only22:36
jeblairclarkb: ok. i trust you.  just letting you know i'm here if you need me. :)22:36
fungiasselin: it would be good to repeat the exercise (without your proposed patch) and see what puppet logs when it applies that manifest22:36
jeblairclarkb: i'll keep -1ing changes in config in the mean time.  :)22:36
daya_kfungi, asselin: fwiw, when i ran the scripts, i ran with sudo , instead of su.22:37
jeblairSlickNik: can you review https://review.openstack.org/#/c/103172/ ?22:37
clarkbjeblair have fun :)22:37
fungiclarkb: daya_k is right, we puppet our keys into /var/lib/zuul/ssh (no hidden dotdir)22:37
*** bauzas has quit IRC22:37
asselinfungi, daya_k here's the puppet output before the patch http://paste.openstack.org/show/89038/22:38
*** mfer has joined #openstack-infra22:38
*** mfer has quit IRC22:39
fungiasselin: err: /Stage[main]/Zuul/Exec[install_zuul]: Failed to call refresh: pip install /opt/zuul returned 1 instead of one of [0] at /root/config/modules/zuul/manifests/init.pp:12222:39
fungiasselin: too bad it doesn't elaborate22:39
*** mfink has joined #openstack-infra22:40
fungiasselin: you might try repeating 'pip install /opt/zuul' (as root or prefixed with sudo) and see if it throws a specific error22:40
asselinfungi, ok22:40
*** yamamoto has quit IRC22:41
*** shashankhegde has quit IRC22:41
*** jaypipes has joined #openstack-infra22:42
jeblairfungi: mind if i delete the old review.o.o, as well as the mirror slaves (which are no longer in use)?22:42
fungijeblair: should be safe now22:43
jeblair| 795ac71e-0a30-4a8a-8a7f-3afddac8d70d | review.openstack.org            | ACTIVE | -          | Running     | public=2001:4800:780d:509:3bc3:d7f6:ff04:39f0, 198.101.231.251; private=10.179.224.234  |22:43
fungijeblair: i take it we hit quota again22:43
openstackgerritSalvatore Orlando proposed a change to openstack-infra/config: Make neutron full job voting (neutron gate only)  https://review.openstack.org/8828922:43
openstackgerritA change was merged to openstack-infra/config: Adds addtional details for browsable logs for third party ci  https://review.openstack.org/10122722:43
jeblairi'm going to delete that one.  everyone agreed that's the old one? :)22:43
jeblairfungi: nope, just cleaning up22:43
fungirechecking22:43
jeblairfungi: (i'm about to approve the change to remove the mirror slaves from puppet, i thought i should also remove them actually)22:44
fungilooks safe to delete. no gerrit running, no logins in ages, uptime of many months22:44
asselinfungi, looks ok: http://paste.openstack.org/show/89039/22:44
fungijeblair: too awesome. i'm entirely in favor22:44
jeblairalso i apparently like deleting long running jenkins slaves22:46
fungiyou have a knack22:46
jeblairall done22:46
fungiasselin: oh, that doesn't tell us much other than all the requirements are present. was this on a fresh vm or one where you had already previously installed gitpython directly?22:46
asselinfungi,  I uninstalled gitpython and re-ran it. I can try again from a clean vm.22:47
openstackgerritSpencer Krum proposed a change to openstack-infra/config: First draft of enabling beaker tests to run  https://review.openstack.org/10207122:47
asselinfungi, do you know how to get more details out of puppet?22:47
nibalizerwoot fixed22:47
*** adalbas has quit IRC22:48
fungiasselin: yeah, i suspect something's failing to install gitpython on the first run through puppet on a fresh instance for some reason. you can add stdout/stderr logging of commands which run in a puppet exec by adding an option to it in the manifest i think... digging up the syntax (unless nibalizer knows it off the top of his head)22:48
fungiasselin: logoutput => true,22:49
nibalizeryup22:49
fungiasselin: sticking that inside the install_zuul exec block should get you more details in the puppet output22:50
asselinfungi, ok I will try it out. thanks22:50
*** bauzas has joined #openstack-infra22:51
nibalizerdoes anyone know if this class is ever used? http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/manifests/simple_slave.pp22:52
fungiphschwartz: did you have any luck getting someone to delete our (currently 103) error nodes, or should i go ahead and open a support case?22:52
nibalizeri'd like to nuke it, if possible22:52
funginibalizer: i find no references to it at all in openstack-infra/config22:53
*** jp_at_hp has joined #openstack-infra22:53
daya_kclarkb, jaypipes, arosen: here's the exceptions i saw when the zuul user did not have proper permissions to  /var/lib/zuul - http://paste.openstack.org/show/89042/22:54
arosenfungi: sorry I stepped away. Here's the trace for gitdb from zuul http://codepad.org/aX2bZ2OW22:54
clarkbnibalizer it should have a comment22:54
*** derekh_ has joined #openstack-infra22:54
clarkbnibalizer it is a convenience class for humans22:55
funginibalizer: unless it's referenced in documentation somewhere outside of the config repo, which seems pretty unlikely, i can't imagine what would be using it now. looking for the last reference in the git log22:55
arosendaya_k:  is your CI now able to pick up jobs from gerrit?22:55
clarkbfungi thats what it is for22:55
clarkbif you want to reproduce tests use that class22:55
fungiclarkb: oh, do you know where we document its existence? on the wiki?22:55
daya_karosen: yes, if i run as non-daemon, something is still broken.22:55
fungiarosen: asselin got us further on the missing gitdb issue... for some reason the install_zuul exec in the zuul puppet module is not successfully installing dependencies22:56
*** jgrimm has quit IRC22:56
clarkbfungi I forget where22:57
daya_kfungi: is it also responsible for setting up permissions for zuul user?22:57
fungiclarkb: nibalizer: perhaps the comment in it could use some expanding on, at least, saying not to delete it even though it's not referenced by any other class22:57
arosendaya_k:  are there any other places to look for errors on  why it's not picking up the job?22:58
*** jcoufal has quit IRC22:58
fungidaya_k: the various file objects in the zuul puppet module set owner => zuul on all the directories i know we need to care about22:59
daya_karosen: all the logs, merger.log, and merger-debug.log, also gearman should show merger in its worker status, telent 127.0.0.1 4730, followed by workers. let me paste my output for you.22:59
nibalizerclarkb: but if you want to reproduce a test case you have to apply openstack_project::server i think23:00
nibalizersince you need to simulate the same iptables and so on23:00
daya_kfungi: ok that part is also broken then. i had to manually set the permissions to get rid of above exceptions -  http://paste.openstack.org/show/89042/23:00
arosendaya_k:  i can telnet fine to that. I also got the Success in jenkins when clicking the test button for Gearman.23:00
fungidaya_k: having the puppet apply output from a fresh run where you can reproduce the incorrect ownership/permissions condition would be great23:01
*** sarob_ has joined #openstack-infra23:01
openstackgerritCraig Bryant proposed a change to openstack-infra/config: Add new chef cookbook-monasca-schema  https://review.openstack.org/11049323:01
openstackgerritA change was merged to openstack-infra/config: Remove the mirror slaves  https://review.openstack.org/10336123:02
daya_kfungi: ok, will try that on a fresh node later in the day23:02
daya_karosen: here's what my gearman shows - http://paste.openstack.org/show/89046/ besides this, i could capture the excpetions when i ran with -d,23:03
*** zul has quit IRC23:03
arosendaya_k:  you're saying when you ran   zuul-merger -d ?23:04
daya_karosen: correct. because if you run it as a service, it just keeps dying without any logs23:04
arosendaya_k: what's the output of : http://paste.openstack.org/show/89046/ ?23:04
arosenzuul-merger -d as well?23:04
*** arnaud has quit IRC23:04
*** alexpilotti has quit IRC23:05
arosendaya_k:  zuul-merger -d doesn't seem to output anything for me. I stopped the zuul-merger service before letting it run manually.23:06
daya_karosen: if you do 'telnet 127.0.0.1 4730' then type 'status' and 'workers' you should see the above - there should be zuul 'merger' in there like i have showed23:06
*** sarob_ has quit IRC23:06
arosendaya_k:  this is what i get then: http://paste.openstack.org/show/89047/23:07
fungilooks like the merger is running and connected23:07
clarkbnibalizer no the point is you get 99% there without all thst extra iptables ntp etc23:07
*** datsun180b has quit IRC23:07
daya_karosen: if its not giving an o/p, its running ok, only spews out exceptions.  but why dont u see the jobs at all in gearman, maybe someone needs to check your layout.yaml ?23:08
fifieldt_hi infra23:08
fungihi fifieldt_23:09
fifieldt_how are y'all?23:09
arosendaya_k:  i copied layout.yaml exactly from here: https://github.com/jaypipes/os-ext-testing-data/blob/master/etc/zuul/layout.yaml23:09
daya_kfungi: i could always see the build jobs, in the gearman output even when i was having htese issues23:09
fifieldt_can I get a quick assist with populating the enterprise-wg mailing list? As it's administered by someone else (Carol), I don't have the password. I have a list of addresses to dump into the mass subscribe box :)23:10
arosendaya_k:  where did you get our layout.yaml from?23:10
fungififieldt_: eww... they're going to opt-in confirm though, right?23:10
fifieldt_yup, no problems there23:11
openstackgerritA change was merged to openstack-infra/config: Initial RHEL7/Centos7 support  https://review.openstack.org/10345823:11
fifieldt_I also have a record of Carols' consent I can forward via email :)23:11
arosendaya_k: my ci account hasn't been approved though yet so i'm just using my ssh creds that i use to push patches to gerrit. I hope that doesn't matter.23:11
fungififieldt_: can you be more specific about why carol, as the list admin, isn't able to take care of it?23:11
fifieldt_she lacks the necessary knowledge and I offered to assist23:11
fungiarosen: shouldn't matter. the only thing you won't be able to do is leave verify votes with it23:12
fungififieldt_: okay. does she lack the necessary knowledge to admin that mailing list, or does she need a co-administrator?23:12
daya_karosen: i also got it from the same location, but have edited slightly for actions. i think the ci account will matter, its used by the zuul system to pull patches and run merges.23:12
reedthe good old 'mailman is user friendly but picky about who his friends are' :)23:12
arosenfungi: okay. So I guess I'd still see a build run. Haven't gotten that to happen yet.23:13
fifieldt_fungi, all I know is she asked for help in this instance23:13
reedfifieldt_, I'd suggest you to take over the list management23:13
daya_kclarkb: here's what i just got http://paste.openstack.org/show/89048/23:13
reedfifieldt_, because mailman *is* tricky :)23:14
*** dims has quit IRC23:14
fungififieldt_: i'm with reed on that, at least volunteer as a list co-administrator. otherwise you'll be coming to us with more requests along similar lines23:14
fifieldt_I volunteer :)23:14
reedfungi, right, he is volunteering... now he needs the password :)23:14
reedI suspect that if fifieldt_ came here to ask for it, he's tried to gather it from Carol already and failed23:15
fungififieldt_: the next thing to check is whether carol had the wherewithal to change the initial password. hold on and i'll get it to you23:15
reedoops :)23:15
*** yamahata_ has quit IRC23:15
*** dims has joined #openstack-infra23:16
*** dims is now known as Guest1391823:16
*** Guest13918 is now known as dims_23:17
openstackgerritA change was merged to openstack-infra/config: Add centos7 image for rax  https://review.openstack.org/10990623:17
daya_karosen: so you should be able to 'ssh <ci-acct>@review.openstack.org -i /var/lib/zuul/ssh/id_rsa -p 2941823:17
daya_karosen: otherwise its not going to work23:17
arosendaya_k:  yup that worked23:18
*** dims_ has left #openstack-infra23:20
arosendaya_k:  how did you know you needed to change the layout.yaml file?23:20
*** rainya has joined #openstack-infra23:20
openstackgerritA change was merged to openstack-infra/config: Add f20 experimental job to tempest  https://review.openstack.org/10487823:20
*** dims_ has joined #openstack-infra23:20
*** bknudson has joined #openstack-infra23:20
daya_karosen: not for fixing these issues, i edited it to run my customized job, and also not review '-1' till things start working. let me paste it for you.23:21
jeblairttx: can you review 105895 please?23:21
*** rainya has quit IRC23:22
arosendaya_k: gotcha, I'm only trying to replicate what jaypipes has in his blog at this point.23:22
*** rainya has joined #openstack-infra23:22
daya_karosen: you should see something like http://paste.openstack.org/show/89049/ in the merger log files23:22
*** dimtruck is now known as zz_dimtruck23:23
arosendaya_k: all i see is;  2014-07-29 16:06:28,499 DEBUG zuul.MergeServer: Starting merge listener23:23
arosen23:23
*** banix has joined #openstack-infra23:23
daya_karosen: dont know what your issue might be, other than what ive suggested. gearman output on the lcient itselfi seems to be lacking..23:23
daya_karosen: will post layout.yaml. restart zuul, zuul-merger and jenkins with these, and check23:24
openstackgerritA change was merged to openstack-infra/config: Fix the constant failure of puppet on cacti  https://review.openstack.org/10498923:24
daya_karosen: can u drop me an email - daya_k@yahoo.com. sweston sent me instructions on the sequence that i can forward23:24
*** bknudson has quit IRC23:25
*** rainya has quit IRC23:27
*** rainya has joined #openstack-infra23:27
*** dkehn_ has joined #openstack-infra23:27
jeblairunreviewed_config_changes-=4323:28
fungionce 105895 is approved, i'm totally using "recheck no story"23:29
jeblairha!23:29
daya_karosen: here's my layout.yaml  http://paste.openstack.org/show/89051/, u should probably leave the dsvm-tempest-full tied to sandbox till things start working for you23:29
arosendaya_k:  ak okay. So I just rebooted the box and now I'm getting error in merge.log. I guess I didn't restart the right thing after changing layout.yaml23:29
arosendaya_k: http://paste.openstack.org/show/89053/  Looks like there is a bug in zuul/merger/merger.py too23:30
fungi105895 also reminds me that we can probably rip out all the recheckwatch code now23:30
*** james_li has quit IRC23:31
*** dkehnx has quit IRC23:31
*** bdpayne has quit IRC23:31
arosenlooks like it's not using my ssh key23:32
fungiarosen: that doesn't look like a bug in the merger. looks like you haven't accepted/puppeted the gerrit host key into your /var/lib/zuul/ssh/authorized_keys file23:32
daya_karosen: yes, but dont know if that one was tied to the permissions issues i was seeing. the exception i get now, is different23:32
*** ZZelle_ has quit IRC23:32
fungiarosen: note that the error from paramiko is about the host key, not your key23:33
openstackgerritA change was merged to openstack-infra/config: Adds a statement regarding infra disabling ci accounts  https://review.openstack.org/10533323:33
*** craigbr has quit IRC23:33
openstackgerritA change was merged to openstack-infra/config: Use job templates and add docs build to python-jenkins  https://review.openstack.org/10534823:33
fungier, s/paramiko/git/23:34
*** bknudson has joined #openstack-infra23:34
*** yfried_ has quit IRC23:34
*** zns_ has quit IRC23:34
*** Sukhdev has joined #openstack-infra23:35
arosenfungi:  Hrm do you know off hand how to do that or could you point me in the right direction?23:35
daya_kfungi: should this also be created in /var/lib/zuul/ssh ? i dont see the file created either23:35
fungiarosen: as for the traceback from the merger, it's arguably a zuul bug that repo is only defined within a try but then returned outside the try block: http://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/merger/merger.py#n6123:36
arosenfungi: yea probably should raise something instead.23:36
*** banix has quit IRC23:37
daya_kfungi: i was getting this exception when the dir had root permissions only, not for zuul user, i've fixed now, but no authorized_keys being created now.23:37
*** otherwiseguy has quit IRC23:37
fungiarosen: daya_k: sorry, brainbug. i mean to type /var/lib/zuul/ssh/known_hosts23:38
daya_kfungi:ok, that one is in /home/zuul/.ssh for me23:38
*** bdpayne has joined #openstack-infra23:39
fungiarosen: though for whatever reason, yeah, we install it there instead... http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/manifests/zuul_prod.pp#n6523:39
fungiwhere daya_k said23:39
daya_kfungi: any idea why .git/objects is throwing exceptions related to permissions, is some other user (not zuul) trying to create these?23:40
fungithe zuul::init class doesn't install that file since its contents are fairly openstack-specific (though we could in theory pass it in through a variable), so instead it's being managed in the openstack_project::zuul class23:40
*** banix has joined #openstack-infra23:41
*** bauzas has quit IRC23:41
fungidaya_k: in theory the zuul merger process would be running as the zuul user, and shouldn't be able to create those files as anyone else... unless perhaps you tried running the zuul merger daemon yourself as root or with sudo rather than invoking it as the zuul user (or from the initscript where that would generally be specified)23:41
fungiin which case it might have created/updated some repo clones as root and then later when you tried running as zuul again it was all fouled up23:42
openstackgerritA change was merged to openstack/requirements: Add xstatic-packaged JavaScript libraries for Horizon  https://review.openstack.org/9779323:42
daya_kfungi: it actually started working only after i acciedentally ran as root, and then created the directory structure under /var/lib/zuul/git thats how sweston and i discovered the issue23:42
arosenfungi:  awesome! It worked :) https://review.openstack.org/#/c/110484/23:43
fungithe contents of the /var/lib/zuul/git directory are ephemeral and can be deleted if necessary23:43
daya_kfungi: but now, running as zuul user, with permissions set for zuul:zuul to 755 for /var/lib/zuul on down for everything23:43
daya_kfungi : even with these set, i'm getting http://paste.openstack.org/show/89048/23:44
fungiarosen: next order of business. fix your layout.yaml so you don't leave "starting xxx jobs" messages on changes when you begin testing23:44
*** HenryG_afk is now known as HenryG23:45
*** banix has quit IRC23:46
*** derekh_ has quit IRC23:46
fungidaya_k: what does 'ls -dl /var/lib/zuul/git/openstack/neutron/.git/objects' say the permissions/ownership are on it?23:46
daya_kfungi : drwxrwxr-x 253 zuul zuul 4096 Jul 29 20:37 /var/lib/zuul/git/openstack/neutron/.git/objects23:47
arosenfungi:  hrm that line does that in layout.yaml? Also seems like recheck isn't quite working yet23:47
fungidaya_k: and zuul-merger has been restarted since you fixed the permissions on /var/lib/zuul?23:48
arosenfungi:  my layout file is exactly this: https://github.com/jaypipes/os-ext-testing-data/blob/master/etc/zuul/layout.yaml23:48
daya_kfungi: yes, many times :)23:48
arosendaya_k:  I did: su zuul ; then ssh review.openstack.org -p <balh> to get the known host file populated for the zuul user.23:49
daya_kfungi: in fact zuul-merger dies when i start it as a service everytime, i only see this excpetion when i run it with -d23:49
fungidaya_k: are you running with -d as the zuul account on your system, or with some other account?23:49
daya_kfungi: zuul account23:50
daya_kto start service, i use root account23:50
*** trinaths has joined #openstack-infra23:50
fungidaya_k: very odd... does 'find /var/lib/zuul/git/ -not -user zuul' return anything?23:53
daya_kfungi: is it ok if some of the underlying files pulled under the /var/lib/zuul/.. yes i was just going to say that23:53
*** dkehn_ is now known as dkehnx23:53
daya_kunder /var/lib/zuul/git/openstack/neutron, theres a  few files with root perms.23:53
daya_kfungi : setup.cfg23:53
fungidaya_k: yeah, you probably want to 'sudo chown -R zuul:zuul /var/lib/zuul/git' to make sure it's all owned by the right user:group23:54
fungidaya_k: or just delete everything in /var/lib/zuul/git23:54
*** trinaths has quit IRC23:54
daya_kand lots of files for the cmds u asked23:55
asselinfungi:  forgot to take out the install of gitpyton, but there's still errors. I will try again: http://paste.openstack.org/show/89055/23:55
*** banix has joined #openstack-infra23:55
fungidaya_k: also, when starting zuul and zuul-merger daemons as root, you're running the initscripts for them to do that, right? not calling the python executables directly?23:56
daya_kfungi: ok, i'll rm and restart zuul-merger23:56
asselindaya_k, which repo are you using for 3rd party ci?23:56
daya_kfungi: service zuul start/reload23:56
daya_kfungi: although while debugging, i might have used the python cmd, was trying many things23:56
fungidaya_k: okay, that should be safe unless you've got a weird initscript which isn't switching to the correct user23:57
asselinarosen, to fix the start messages, commend out the 2 "start" blocks23:57
fungithe service command should be safe i mean. calling the zuul daemon python executables directly as someone other than your zuul user is probably going to cause headaches later23:57
daya_kfungi : when it had accidentally started working, i ran zuul-merger -d as root user, then all the files etc. got created, until then it was dying23:58
*** banix has quit IRC23:58
arosenasselin:  awesome thanks!23:59
asselinarosen, lines 21-23 https://github.com/jaypipes/os-ext-testing-data/blob/master/etc/zuul/layout.yaml#L2123:59
fungiasselin: aha! looks like we may be missing the libxml headers when python lxml is being installed by git23:59
*** garyh has quit IRC23:59
asselinarosen, didn't succeed to submit a pull request on that....23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!