Thursday, 2015-10-01

*** ybathia has quit IRC00:00
*** ybathia has joined #openstack-infra00:00
*** ybathia has quit IRC00:00
timrcAnyway, I think jeblair had a good suggestion to use an orderFile, so that's what I'll do00:01
*** bswartz has joined #openstack-infra00:02
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675100:02
jeblairclarkb, mordred: ^ passes all local tests00:03
clarkbjeblair: woo00:03
*** Daisy_ has quit IRC00:04
jeblairclarkb: note in particular the diff in 19..20 -- your suggestion about setting the value to 'fake_v6' uncovered a bug in the fakes (though the program logic is okay)00:04
clarkbjeblair: neat00:05
*** sergmelikyan has joined #openstack-infra00:05
jeblairanyway, gotta run now;  hopefully that's close, if not final.00:05
openstackgerritDolph Mathews proposed openstack/requirements: Add pep257 as a requirement  https://review.openstack.org/22968500:06
*** ashleighfarnham has quit IRC00:06
*** signed8bit has quit IRC00:08
*** sergmelikyan has quit IRC00:10
openstackgerritDolph Mathews proposed openstack-dev/hacking: Add support for PEP257  https://review.openstack.org/22968600:10
*** odgrim has joined #openstack-infra00:11
*** geoffarn_ has quit IRC00:11
*** geoffarnold has joined #openstack-infra00:11
*** Sukhdev has quit IRC00:13
*** Sukhdev has joined #openstack-infra00:13
*** abitha has quit IRC00:15
*** adrian_otto has joined #openstack-infra00:16
*** amotoki has joined #openstack-infra00:17
*** asettle has joined #openstack-infra00:18
waynrclarkb: i might not have been clear enough...what i am trying to do is depend on my local experimental copy of JJB as a package, so I need to build a package that has a version I can point to in requirements.txt with an appropriate entry in dependency_links in setup.py as described here: http://peak.telecommunity.com/DevCenter/setuptools#dependencies-that-aren-t-in-pypi00:18
*** mriedem1 has joined #openstack-infra00:18
*** odgrim has quit IRC00:19
clarkbwaynr: just change the git path00:19
waynrup until now I have just been using JJB as a command line too installed using "pip install ." from a submodule in the repo that contains my job configs00:19
clarkbwaynr: you can pip intsall a fs path too00:19
clarkbwaynr: for example pip install /foo/bar/jenkins-job-builder00:19
waynrso the command you suggested will upload a usable package to github for me?00:20
adrian_ottoI have a question. We are adding a functional test for magnum to test the new mesos bay type: https://review.openstack.org/225212 which raised the question if we could build and host an image that would accelerate the gate test by reducing the steps from here:00:20
adrian_ottohttp://git.openstack.org/cgit/openstack/magnum/tree/magnum/templates/heat-mesos/README.md00:20
adrian_ottointo a simple download into glance00:20
clarkbwaynr: if you need it to not be local you can python setup.py sdist then copy the resulting tar.gz somewhere then install that instead00:20
adrian_ottoideas?00:20
waynrclarkb: I have a new python tool I am working on that is not JJB, i will be running "pip install ." in the top directory of that tool, that command should be able to pull my experimental copy of jjb as a setuptools package00:20
clarkbadrian_otto: projects like ironic python agent and trove both build images that they save on tarballs.openstack.org then the jobs use them00:21
waynrokay, I think sdist is the command I was looking for...the problem with that so far is that the resulting version is not what I was expecting00:21
*** pvaneck has quit IRC00:21
clarkbwaynr: so in your requirements.txt point at wherever that JJB version is00:21
clarkbyou have many options git/sdist/fs00:21
*** mriedem has quit IRC00:21
*** amotoki has quit IRC00:22
smcginnisanteaya: ping00:22
waynrie, git describe in the jenkins-job-builder repo is 1.2.0-154-GITSHA00:22
adrian_ottoclarkb: sorry you lost me. How do I get an image file onto tarballs.openstack.org?00:22
waynrbut the version of the package created with sdist is 0.0.1.dev131400:22
clarkbadrian_otto: you would setup a post job in zuul+jenkins to run the image build and copy it to tarballs.openstack.org. Look at ironic-python-agent for examples00:23
adrian_ottothanks!00:23
clarkbadrian_otto: so that whenever your image build details change you build a new image00:23
*** sdake has quit IRC00:23
adrian_ottook, thanks clarkb00:23
openstackgerritDolph Mathews proposed openstack/requirements: Add pep257 as a requirement  https://review.openstack.org/22968500:23
waynri guess i could just hard-pin to that version anyway and indicate the zip file listed in dependency_links provides that specific version00:23
waynri have to pin to a specific version either way00:24
*** adrian_otto has left #openstack-infra00:24
anteayasmcginnis: hello there00:24
anteayasmcginnis: how can I help?00:24
clarkbwaynr: as an alternative manage the install of jjb independently so that it doens't have to be so hard coded in whatever thing depends on it00:24
clarkbthats less portable but can be handy for dev00:24
smcginnisanteaya: Hey! Sorry to disrupt your evening. Newbie PTL question.00:24
smcginnisanteaya: We have a cinder third party CI account that I think can be reenabled.00:25
smcginnisanteaya: What is the correct procedure for this?00:25
waynryeah it's handy for dev but so far I am the only person in my org doing dev work and i'd rather be depending on our experimental JJB as a setuptools package than a submodule moving forward00:25
anteayasmcginnis: no worries, my evening is filling out expense reports, please interrupt00:25
waynrdev work on JJB that is00:25
smcginnisanteaya: ;)00:25
anteayasmcginnis: and thank you for asking newbie ptl questions :)00:25
anteayasmcginnis: tell me the name00:25
smcginnisanteaya: Don't worry, I have plenty of them.00:25
anteayathe channel logs will serve as archive00:26
smcginnisIt's for the Microsoft iSCSI CI. I don't have the actual account name.00:26
smcginnisanteaya: I can get that00:26
anteayaokey dokey00:26
smcginnisanteaya: But thought I would check first if there is anything else needed.00:26
anteayasmcginnis: good question and no00:26
*** tsekiyama has quit IRC00:26
anteayayou as ptl asking in the channel (directing at me is fine but not required is all that is needed)00:27
*** larainema is now known as larainema_holida00:27
anteayamailing list works too in a pinch (reply to the disable post on third party announce, please)00:27
*** tiswanso has joined #openstack-infra00:27
smcginnisanteaya: I figured someone else could answer, but I know you always know what's going on. ;)00:27
*** enikanorov has joined #openstack-infra00:27
*** Daisy has joined #openstack-infra00:27
anteayabut irc tends to be the fastest00:27
anteayaI give that impression00:27
anteayathanks for continuing to buy into it :)00:27
smcginnisheh00:28
*** enikanorov_ has quit IRC00:28
*** mtanino has quit IRC00:29
anteayaif someone with root access can reenable gerrit id 13394 smcginnis and I would be grateful: http://paste.openstack.org/show/474979/00:29
anteayanibalizer: ^^ one for you if you want to learn how00:29
*** mudassirlatif has joined #openstack-infra00:29
openstackgerritMerged openstack/diskimage-builder: Use --nodeps when installing fedora-release  https://review.openstack.org/22712300:30
anteayaclarkb: you still about?00:30
nibalizeranteaya: oh sure00:30
nibalizerdo we have docs?00:30
anteayanibalizer: ah yay00:30
anteayanibalizer: don't think so00:30
anteayanibalizer: in the gerrit db you find them by gerrit id00:31
anteayahttp://paste.openstack.org/show/474979/00:31
clarkbanteaya: ya00:31
clarkbanteaya: I am caught up on sb let me do that00:31
anteayaah clarkb can you walk nibalizer through his first re-enable?00:31
clarkboh I can do that instead00:31
anteayathanks00:31
nibalizeryes please00:31
anteayabetter for nibalizer00:31
smcginnisanteaya, nibalizer, clarkb: Thanks for your help!00:31
clarkbnibalizer: the docs are gerrit's docs00:32
nibalizerhaha00:32
*** rlandy has quit IRC00:32
nibalizerin what way is the account disabled?00:32
anteayasmcginnis: glad you have one to be re-enabled, yay00:32
*** geoffarnold has quit IRC00:32
smcginnisanteaya: Yes, very much goodness IMO. :)00:32
clarkbnibalizer: https://review.openstack.org/Documentation/index.html00:32
*** Daisy has quit IRC00:32
anteayasmcginnis: a good start00:32
*** geoffarnold has joined #openstack-infra00:32
smcginnisanteaya: Hopefully!00:33
clarkbnibalizer: from there you get https://review.openstack.org/Documentation/cmd-index.html and from there https://review.openstack.org/Documentation/cmd-set-account.html00:33
anteayasmcginnis: keep up the newbie ptl questions00:33
clarkbnibalizer: set-account lets you change certain aspects of an account without doing it in the db directly which is unfun00:33
smcginnisanteaya: Oh, don't worry. I'll have plenty. ;)00:33
anteayasmcginnis: well some days will be better than others to be sure, celebrate the small victories when you have them00:33
anteayasmcginnis: great00:33
clarkbnibalizer: so what you need to do is ssh -p 29418 nibz@review.openstack.org gerrit set-account --active 1339400:33
nibalizerok00:34
clarkbnibalizer: that says flip the active bit to active in gerrit for account id 1339400:34
clarkbnibalizer: the inverse is --inactive $accountid00:34
anteayaclarkb: ah cool, don't have to scour the db00:34
clarkbnibalizer: which you would do if the ptl came and said the account was spamming or whatever00:34
anteayanibalizer: then post to the third-party-announce mailing list so we tell them the are deactivated and why and how to be re-enabled00:35
smcginnisclarkb, nibalizer: Hopefully I don't need to ask for that.00:35
smcginnismuch00:35
anteayaor tell pleia2 or myself to do that00:35
anteayasmcginnis: much00:35
smcginnis:)00:35
anteayasmcginnis: it has been a pretty good release00:35
anteayanot much business00:35
nibalizerokay i've activated it00:37
nibalizercool00:37
nibalizerthanks clarkb and anteaya00:37
smcginnisThanks everyone.00:37
anteayanibalizer: thank you for doing it00:38
anteayafound the original disable post: http://lists.openstack.org/pipermail/third-party-announce/2015-July/000251.html00:39
anteayawill reply00:39
nibalizerthanks anteaya00:39
anteayanibalizer: might be an idea to subscribe to third-party-announce if you haven't already00:39
anteayayolanda: ^^ too00:39
nibalizersure00:39
*** Rockyg has quit IRC00:41
*** ddieterly has quit IRC00:44
*** ddieterl_ has joined #openstack-infra00:44
*** tjones has quit IRC00:44
*** tiswanso has quit IRC00:46
*** rellerreller has quit IRC00:51
*** mriedem has joined #openstack-infra00:51
*** geoffarnold has quit IRC00:53
*** mriedem1 has quit IRC00:53
*** geoffarnold has joined #openstack-infra00:54
*** shashank_hegde has quit IRC00:56
*** Sukhdev has quit IRC00:57
openstackgerritMatthew Treinish proposed openstack/os-testr: Force utf8 encoding on subunit attachments output  https://review.openstack.org/22952700:58
*** tiswanso has joined #openstack-infra01:00
*** bharathm has quit IRC01:01
*** julim has quit IRC01:01
*** tiswanso_ has joined #openstack-infra01:02
*** bpokorny has quit IRC01:03
*** Rockyg has joined #openstack-infra01:03
*** enikanorov_ has joined #openstack-infra01:04
*** tiswanso has quit IRC01:05
*** lawrancejing has joined #openstack-infra01:06
*** enikanorov has quit IRC01:06
*** waynr has quit IRC01:08
*** waynr has joined #openstack-infra01:08
*** Swami has quit IRC01:10
*** amotoki has joined #openstack-infra01:11
*** alexsyip has quit IRC01:14
timrcclarkb, Headed to Seattle next week.  Any BBQ recommendations ;-)?01:14
*** geoffarnold has quit IRC01:15
*** geoffarnold has joined #openstack-infra01:15
*** amotoki has quit IRC01:15
*** alexsyip has joined #openstack-infra01:16
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for juno ebtables kernel fail  https://review.openstack.org/22969601:16
*** alexsyip has quit IRC01:17
fungitimrc: if you like fish bbq, sure ;)01:18
*** julim has joined #openstack-infra01:20
timrcfungi, Hah :) I was sort of trolling there.01:20
ruagairBBQ salmon01:20
* ruagair notes it's awfully close to lunch...01:21
*** doug-fish has joined #openstack-infra01:21
timrcI mean there is smoked salmon... *shudder*01:22
fungitasty stuff that01:23
fungiall manner of fish can be smoked to great effect01:23
anteayaclarkb: is it still brisket season?01:23
* anteaya wonders how long brisket season lasts01:23
jrollanteaya: every season is brisket season, so long as you're ok with being outside all day in said season01:24
jrollI've done a brisket in the snow :P01:24
*** otter768 has joined #openstack-infra01:24
anteayajroll: good to know01:24
anteayajroll: where is home for you?01:24
* anteaya wonders who to send to jroll for brisket01:25
jrollanteaya: then, michigan. currently california01:25
anteayaah01:25
anteayamore snow in michigan definitely01:25
anteayawhere in michigan?01:25
anteaya<-- ontario01:25
jrollanteaya: and given real estate pricing in california, I don't have anywhere for a smoker. wait to send people til when I move back :)01:25
jrollaha01:25
openstackgerritMerged openstack-infra/elastic-recheck: Add query for juno ebtables kernel fail  https://review.openstack.org/22969601:25
*** mwagner_ has joined #openstack-infra01:25
anteayajroll: are you planning on returning to the land of snow and smoke?01:25
jrollgrew up in grand rapids, college in flint, then metro detroit for a year or two01:25
anteayanice01:26
jrollyes, next year hopefully :)01:26
timrcfungi, It's weird, salmon is one of the only fish I don't care for.  I can eat its relative the rainbow trout, but it has to be cooked just right.01:26
anteayawonderful01:26
*** yamamoto has joined #openstack-infra01:26
anteayajroll: you can attend pycon.ca next year then01:26
anteayaI hope to have more details after I attend, to give folks a bit more of a heads up01:26
jrollanteaya: yes!01:26
anteayatimrc: interesting01:26
timrcWell actually probably 99.9% of the fish in the ocean I probably not find to be palatable but of the common species sold in stores... :)01:26
jroll<3 pycon, it's been a bit01:27
anteayamy father raised rainbow trout for about 15 years01:27
anteayajroll: nice, yes I think pycon.ca gave themselves a pass when pyconus was in montreal01:27
timrcanteaya, There are days I want to quit this industry and go do something like that :)01:27
jrollright01:27
timrcI have a few farms for sale bookmarked :)01:28
*** bharathm has joined #openstack-infra01:28
anteayatimrc: well get yourself some oxygen tanks to pump oxygen directly into the water01:28
anteayawe didn't have that01:28
anteayaso the summer of 8801:29
anteayahumid and hot took all the o2 out of the air and water01:29
anteayawe had pumps to put water into the air and capture o2 when it fell back in01:29
anteayabut you needed o2 in the air for it to work01:29
*** armax has quit IRC01:29
anteayalost everything including the breeders01:29
anteayait was a sad time01:30
anteayaso yeah, farms are fun01:30
anteayabut you need the weather to co-operatre01:30
anteayaI've always wanted an orchard01:30
*** yamamoto has quit IRC01:32
*** geoffarnold is now known as geoffarnoldX01:33
*** geoffarnold has joined #openstack-infra01:36
*** odgrim has joined #openstack-infra01:38
*** kushal has quit IRC01:38
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Add a job for testing amqp/proton driver  https://review.openstack.org/22970101:39
timrcanteaya, Yeah I guess the moral of this story is that ever job has its hazards :)01:39
*** Rockyg has quit IRC01:39
*** mudassirlatif has quit IRC01:40
anteayawell we lost a lot of money01:40
*** geoffarnoldX has quit IRC01:41
anteayaand had to figure out how to get rid of a lot of dead fish in a hurry01:41
*** mudassirlatif has joined #openstack-infra01:41
*** mudassirlatif has quit IRC01:41
anteayabut we didn't get hurt01:41
anteayaand he turned back to building houses and digging in the dirt01:41
anteayawhich was always his strength anyway01:41
anteayaso I think it is more like try for your dream01:42
anteayaand have the ability to change if that doesn't work01:43
*** unicell has quit IRC01:43
timrcanteaya, I wouldn't even know where to begin with farming at all.  I'm an avid fisher person though so I'm at least intrigued.01:43
anteayais it really a fish farm you want?01:43
timrcCan I have the fish farm for revenue and the private trout pond for angling enjoyment?01:44
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: Bump minimum os-testr version to 0.4.1  https://review.openstack.org/22912901:44
timrclol so off topic here, sorry :P01:44
*** yamamoto has joined #openstack-infra01:44
anteayatimrc: okay if you want fish get property where you have the source of the stream on your property01:44
anteayamy father didn't, folks upstream let the beavers damn it up and that slowed the water flow, warming the water01:45
anteayaand warm water doesn't carry as much o2 in it01:45
anteayaso that is the land consideration01:45
timrcSo a spring fed stream would be best?01:45
anteayayes01:45
anteayaand find out from folks around for 50+ years if the spring has ever stopped running01:46
*** sridhar_ram has quit IRC01:46
anteayalike if the water table has ever gotten so low it stopped flowing01:46
*** angdraug has quit IRC01:46
anteayamy dad owned his own heavy equipment and moved the land around to suit him so his ponds were were he wanted01:47
anteayasmall fish up top, large pond in the middle for fishing out of, large breeders below that and then a settling pond so the feces would settle out before it went down river01:47
anteayaand a hatchery for the eggs and fry01:48
anteayapicking over the eggs is awesome01:48
anteayalike meditation01:48
anteayaI'll tell you more in tokyo if you want01:48
anteayacan't describe it on irc01:48
*** woodster_ has quit IRC01:49
anteayaand o2 tanks for the breeders01:49
anteayaand be able to change the water flow so if the other fish die the breeders have fresh water01:49
anteayaif you can save the breeders you can recover in a year or two from losing everything else01:50
*** yamamoto has quit IRC01:53
*** odgrim has quit IRC01:53
*** julim has quit IRC01:58
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: Remove unused pagination lib  https://review.openstack.org/22970201:59
*** ybathia has joined #openstack-infra01:59
openstackgerritJohn L. Villalovos proposed openstack-infra/infra-manual: Use 'https://' instead of 'git://'  https://review.openstack.org/22970301:59
* ruagair ran dairy goats and alpacas in Tasmania for about 8 years.02:00
timrcanteaya, I'm definitely interesting in knowing more :) Sounds like a perfect conversation for Tokyo.02:00
timrcer interested*02:00
timrcruagair, Neat!02:00
ruagairHad a small business making sopa form goat's milk and selling alpaca fleece locally.02:01
ruagairwow, typing not a thing today.02:02
*** doug-fish has quit IRC02:05
*** edmondsw has quit IRC02:05
*** amotoki has joined #openstack-infra02:05
*** rfolco has quit IRC02:06
anteayatimrc: sounds good02:07
*** tjones has joined #openstack-infra02:09
*** jerrygb has joined #openstack-infra02:09
*** amotoki has quit IRC02:09
*** tjones has quit IRC02:10
*** thorst has joined #openstack-infra02:13
*** niedbalski has quit IRC02:14
*** markvoelker has quit IRC02:15
*** shashank_hegde has joined #openstack-infra02:15
clarkbtimrc there is a hole in the wall downtown that is decent02:16
clarkbI forget the name let me look it up02:16
*** thorst has quit IRC02:16
clarkblol its called hole in the wall02:17
clarkbalso zaro has said pecos is good but I never want02:17
*** lawrancejing has quit IRC02:20
openstackgerritDavid Pursehouse proposed openstack-infra/lodgeit: Correct command to start server in README  https://review.openstack.org/22970702:24
*** yamahata has quit IRC02:26
anteayaclarkb: ha ha ha02:26
*** amotoki has joined #openstack-infra02:28
*** dims__ has quit IRC02:29
*** weshay_xchat has quit IRC02:29
*** dims_ has joined #openstack-infra02:29
*** odgrim has joined #openstack-infra02:34
openstackgerritMerged openstack-infra/lodgeit: lodgeit.py: Set default URL to paste.openstack.org  https://review.openstack.org/21607702:34
openstackgerritMerged openstack-infra/lodgeit: Offer download of lodgeit.py with link to plain file on cgit  https://review.openstack.org/21607802:34
*** odgrim has quit IRC02:34
*** asettle has quit IRC02:35
*** ybathia has quit IRC02:36
timrcclarkb, Nice :) I can remember a place called "hole in the wall"02:37
*** rguillebert has quit IRC02:38
*** yamamoto has joined #openstack-infra02:39
fungidocaedo: in hiera now as apps_ssl_cert_file_contents, apps_ssl_chain_file_contents and apps_ssl_key_file_contents02:39
*** tjones has joined #openstack-infra02:46
*** amotoki has quit IRC02:49
*** mriedem has quit IRC02:51
*** ddieterl_ has quit IRC02:53
*** dra_ is now known as denisra02:54
*** enikanorov has joined #openstack-infra02:57
*** enikanorov_ has quit IRC03:00
*** kengo_sakai has joined #openstack-infra03:01
*** geoffarnold has quit IRC03:01
*** geoffarnold has joined #openstack-infra03:02
*** amotoki has joined #openstack-infra03:02
*** amotoki_ has joined #openstack-infra03:04
*** dahoo has quit IRC03:05
*** amotoki has quit IRC03:08
*** amotoki_ has quit IRC03:10
*** otter768 has quit IRC03:11
*** otter768 has joined #openstack-infra03:12
*** ociuhandu has joined #openstack-infra03:12
*** dims__ has joined #openstack-infra03:15
*** amotoki has joined #openstack-infra03:15
*** markvoelker has joined #openstack-infra03:15
*** dims___ has joined #openstack-infra03:16
*** tjones has quit IRC03:18
*** dims____ has joined #openstack-infra03:18
*** dims_ has quit IRC03:18
*** lawrancejing has joined #openstack-infra03:18
openstackgerritIan Wienand proposed openstack-infra/system-config: Turn image logging level up to DEBUG  https://review.openstack.org/22971803:20
*** markvoelker has quit IRC03:20
*** dims__ has quit IRC03:20
*** BharatK has joined #openstack-infra03:21
*** dims___ has quit IRC03:21
*** otter768 has quit IRC03:21
*** puranamr has joined #openstack-infra03:23
*** tiswanso_ has quit IRC03:24
*** r-daneel has quit IRC03:26
*** flepied has joined #openstack-infra03:31
*** kengo_sa_ has joined #openstack-infra03:32
*** enikanorov_ has joined #openstack-infra03:32
*** ashleighfarnham has joined #openstack-infra03:33
*** spzala has quit IRC03:34
*** enikanorov has quit IRC03:34
*** kengo_sakai has quit IRC03:34
*** puranamr has quit IRC03:36
*** armax has joined #openstack-infra03:36
*** ayoung-meeting has quit IRC03:36
*** dims____ has quit IRC03:37
*** amotoki has quit IRC03:40
*** salv-orl_ has joined #openstack-infra03:43
*** geoffarn_ has joined #openstack-infra03:44
*** geoffarnold has quit IRC03:45
*** salv-orlando has quit IRC03:46
*** amotoki has joined #openstack-infra03:52
*** links has joined #openstack-infra03:55
*** puranamr has joined #openstack-infra03:56
*** jerrygb has quit IRC03:57
*** jerrygb has joined #openstack-infra03:58
*** boris-42 has quit IRC03:59
*** sdake has joined #openstack-infra04:00
*** geoffarn_ has quit IRC04:05
*** geoffarnold has joined #openstack-infra04:06
*** puranamr has quit IRC04:06
*** harlowja_at_home has joined #openstack-infra04:10
*** lawrancejing has quit IRC04:10
*** markvoelker has joined #openstack-infra04:16
*** hdd has joined #openstack-infra04:17
*** abitha has joined #openstack-infra04:19
*** markvoelker has quit IRC04:20
*** sabeen1 has joined #openstack-infra04:21
*** maishsk has quit IRC04:21
*** Sukhdev has joined #openstack-infra04:21
*** sdake_ has joined #openstack-infra04:24
*** ddieterly has joined #openstack-infra04:24
*** aukhan has joined #openstack-infra04:25
*** geoffarnold has quit IRC04:26
*** geoffarnold has joined #openstack-infra04:27
*** sdake has quit IRC04:28
*** maishsk has joined #openstack-infra04:28
*** ddieterly has quit IRC04:29
*** maishsk has quit IRC04:30
*** flepied has quit IRC04:30
*** stevemar has joined #openstack-infra04:30
*** ashleigh_ has joined #openstack-infra04:32
*** ashleighfarnham has quit IRC04:32
*** StevenK has quit IRC04:35
*** StevenK has joined #openstack-infra04:36
*** dahoo has joined #openstack-infra04:38
*** gildub has quit IRC04:41
*** flepied has joined #openstack-infra04:42
*** unicell has joined #openstack-infra04:46
*** BharatK has quit IRC04:48
*** geoffarnold has quit IRC04:48
*** signed8bit has joined #openstack-infra04:48
*** geoffarnold has joined #openstack-infra04:48
*** dahoo has quit IRC04:49
*** asettle has joined #openstack-infra04:50
*** asettle has quit IRC04:50
*** KanagarajM has joined #openstack-infra04:52
*** Sree has joined #openstack-infra04:52
*** signed8b_ has joined #openstack-infra04:54
*** asettle has joined #openstack-infra04:55
*** gildub has joined #openstack-infra04:57
*** signed8bit has quit IRC04:57
zarotimrc, clarkb : IMO pecos is much better than hole in the wall05:00
*** sabeen1 has quit IRC05:00
timrczaro, Good to know..05:02
*** Sree has quit IRC05:03
*** KanagarajM has quit IRC05:03
*** Sree has joined #openstack-infra05:03
timrcjeblair, clarkb, fungi, jhesketh or anyone else know why the y axis is fractional? http://graphite.openstack.org/render/?width=1228&height=654&_salt=1443675711.364&target=stats.gerrit.event.ref-updated05:03
*** bharathm has quit IRC05:04
*** bharathm has joined #openstack-infra05:05
timrcI'd expect 'statsd.incr('gerrit.event.%s' % event.type)' to increment by 1, for example.05:07
*** Sree has quit IRC05:07
*** geoffarnold has quit IRC05:09
*** geoffarnold has joined #openstack-infra05:09
*** KanagarajM has joined #openstack-infra05:12
*** pcrews has quit IRC05:16
*** pcrews has joined #openstack-infra05:16
*** harlowja_at_home has quit IRC05:19
*** BharatK has joined #openstack-infra05:19
*** sdake_ is now known as sdake05:21
*** otter768 has joined #openstack-infra05:22
*** signed8b_ has quit IRC05:25
*** signed8bit has joined #openstack-infra05:25
*** ddieterly has joined #openstack-infra05:25
*** otter768 has quit IRC05:28
*** flepied has quit IRC05:28
*** hdd has quit IRC05:29
*** ddieterly has quit IRC05:30
*** geoffarnold has quit IRC05:30
*** geoffarnold has joined #openstack-infra05:31
*** geoffarnold is now known as geoffarnoldX05:33
*** geoffarnoldX is now known as geoffarnold05:33
*** geoffarnold is now known as geoffarnoldX05:34
*** kushal has joined #openstack-infra05:34
*** oomichi has quit IRC05:35
*** nadya has joined #openstack-infra05:36
*** KanagarajM has quit IRC05:38
*** signed8bit is now known as signed8bit_ZZZzz05:41
openstackgerritIan Wienand proposed openstack-infra/project-config: Skip caching for dnf (Fedora 22) builds  https://review.openstack.org/22972805:43
openstackgerritIan Wienand proposed openstack-infra/project-config: Add diskimage-builder lint job  https://review.openstack.org/22972905:43
openstackgerritIan Wienand proposed openstack-infra/project-config: Update dib elements to standard headers  https://review.openstack.org/22973005:43
ianw^ clarkb / fungi : f22 jobs are just looping around in failure ATM, see above05:44
ianwsorry i must have missed this -- i need to move my test env somewhere that cloning every openstack repo & downloading all the disk-images is practcial05:45
*** flepied has joined #openstack-infra05:49
*** geoffarnoldX has quit IRC05:52
*** geoffarnold has joined #openstack-infra05:52
*** gildub has quit IRC05:52
*** gildub has joined #openstack-infra05:53
*** kiran-r has joined #openstack-infra05:54
*** Sukhdev has quit IRC05:56
*** Sukhdev has joined #openstack-infra05:56
*** nadya has quit IRC05:57
ruagairouch ianw :-/05:58
*** oomichi has joined #openstack-infra05:59
*** Sukhdev has quit IRC05:59
*** oomichi has quit IRC06:03
*** odgrim has joined #openstack-infra06:04
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/22973506:05
*** k4n0 has joined #openstack-infra06:06
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/22681606:08
ruagairDoes any know if Storyboard has gone through any schema changes since April?06:08
ruagair(the database schema)06:08
ruagairIn particular dropping the "username" column from the storyboard.users table?06:09
*** flepied has quit IRC06:10
*** geoffarnold has quit IRC06:13
*** geoffarnold has joined #openstack-infra06:13
*** AJaeger has joined #openstack-infra06:14
*** odgrim has quit IRC06:15
*** sergmelikyan has joined #openstack-infra06:17
*** markvoelker has joined #openstack-infra06:17
*** scheuran has joined #openstack-infra06:18
*** AJaeger has quit IRC06:21
*** markvoelker has quit IRC06:21
*** AJaeger has joined #openstack-infra06:22
*** shardy has joined #openstack-infra06:25
openstackgerritMerged openstack-infra/project-config: Add non-voting job to test Cinder with Block Device Driver backend  https://review.openstack.org/22885706:25
*** tobiash has quit IRC06:26
*** ddieterly has joined #openstack-infra06:26
*** ddieterly has quit IRC06:30
*** tobiash has joined #openstack-infra06:33
*** abitha has quit IRC06:35
*** ParsectiX has joined #openstack-infra06:36
openstackgerritazher ullah khan proposed openstack-infra/system-config: Setting ansible playbooks path variable  https://review.openstack.org/22974406:37
*** armax has quit IRC06:39
*** kiran-r has quit IRC06:39
*** matbu_ has joined #openstack-infra06:40
*** nadya has joined #openstack-infra06:40
*** shashank_hegde has quit IRC06:42
*** sergmelikyan has quit IRC06:42
*** matbu has quit IRC06:42
*** asmigala has joined #openstack-infra06:46
*** peristeri has joined #openstack-infra06:47
*** ihrachys has joined #openstack-infra06:48
*** ihrachys has quit IRC06:49
openstackgerritMerged openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/22973506:50
*** ajmiller_ has joined #openstack-infra06:51
*** rvasilets has joined #openstack-infra06:53
*** ajmiller has quit IRC06:53
*** vponomaryov has joined #openstack-infra06:54
*** aarefiev has joined #openstack-infra06:54
*** HeOS has quit IRC06:54
*** olaph has quit IRC06:55
*** svasheka has joined #openstack-infra06:55
*** geoffarnold has quit IRC06:55
*** geoffarnold has joined #openstack-infra06:55
*** andreykurilin has joined #openstack-infra06:57
openstackgerritMerged openstack-infra/project-config: Add job to test Add Cinder API with Apache  https://review.openstack.org/20849806:58
*** ParsectiX has quit IRC06:58
*** devvesa has joined #openstack-infra06:58
*** claudiub has joined #openstack-infra06:59
*** mwagone_ has joined #openstack-infra07:00
*** otter768 has joined #openstack-infra07:00
*** mwagone has quit IRC07:03
*** kiran-r has joined #openstack-infra07:04
*** ParsectiX has joined #openstack-infra07:04
*** kiran-r has quit IRC07:05
*** kiranr has joined #openstack-infra07:05
*** kiranr is now known as kiran-r07:06
*** boris-42 has joined #openstack-infra07:07
*** wolsen has quit IRC07:08
*** sergmelikyan has joined #openstack-infra07:09
*** rossella_s has joined #openstack-infra07:11
*** arxcruz has joined #openstack-infra07:12
*** geoffarnold has quit IRC07:16
*** ihrachys has joined #openstack-infra07:16
*** geoffarnold has joined #openstack-infra07:17
*** bharathm has quit IRC07:17
openstackgerritMerged openstack-infra/project-config: Create puppet-barbican repository  https://review.openstack.org/22964307:17
*** ihrachys has quit IRC07:17
openstackgerritMerged openstack-infra/project-config: Add puppet-openstack_spec_helper project  https://review.openstack.org/22912607:18
openstackgerritMerged openstack-infra/project-config: Added new Openstack repository for PureStorage Cinder Fuel plugin  https://review.openstack.org/22666207:18
*** aeng has quit IRC07:22
*** notnownikki has joined #openstack-infra07:22
*** matrohon has joined #openstack-infra07:24
openstackgerritMerged openstack-infra/system-config: Fix project URL for Nodepool  https://review.openstack.org/22967107:25
*** ifarkas has joined #openstack-infra07:25
*** camunoz has quit IRC07:26
*** ddieterly has joined #openstack-infra07:27
openstackgerritMerged openstack-infra/system-config: Third party CI ops should subscribe to -infra list  https://review.openstack.org/22323307:27
frickleryolanda: how about upgrading your +1 on https://review.openstack.org/190526 to a +A now that you have received the power? ;)07:29
yolandafrickler, sounds like a good idea :)07:29
*** asettle has quit IRC07:31
*** ddieterly has quit IRC07:31
*** claudiub has quit IRC07:32
peristerianteaya, Hi, I'm interested in helping with Gerrit. Is there any way I could help? (I used to develop in Java)07:35
frickleryolanda: thx, I was hoping for a Workflow+1 though, since the review has had a number of +2s for some time now. ;;)07:36
yolandafrickler, for nodepool i prefer to do it when some other cores are present07:37
yolandai wanted to land some other change as well, so i will look in a few hours07:37
fricklerperisteri: best talk to zaro directly, though I gather he is on US pacific time, so better retry a bit later07:37
frickleryolanda: o.k., understood, thx anyway07:38
yolandaanytime07:38
peristerifrickler, cool, I'll send zaro an email.07:39
*** jtomasek has joined #openstack-infra07:39
*** dingyichen has quit IRC07:40
openstackgerritJesse Pretorius proposed openstack-infra/project-config: Add pep8 and bashate non-voting checks to openstack-ansible  https://review.openstack.org/22840607:40
*** jlanoux has joined #openstack-infra07:42
*** markus_z has joined #openstack-infra07:43
*** dingyichen has joined #openstack-infra07:43
*** dchen has joined #openstack-infra07:43
*** sergmelikyan has quit IRC07:44
nibalizeryolanda: o/07:46
nibalizeryolanda: did you test your ssh access?07:46
nibalizerdo you need reviews on anything?07:46
*** openstackgerrit has quit IRC07:46
*** zeih has quit IRC07:46
*** zeih has joined #openstack-infra07:46
*** openstackgerrit has joined #openstack-infra07:46
*** e0ne has joined #openstack-infra07:47
openstackgerritMerged openstack-infra/puppet-logstash: Create a class to install and run curator  https://review.openstack.org/22274107:47
yolandahi nibalizer, yes, i have access to all instances07:47
yolandai tested a few07:47
yolandanibalizer, if you can do some reviews for puppet modules it will help. Specially this one https://review.openstack.org/#/c/200289/ is blocked07:48
*** e0ne has quit IRC07:49
*** mgrosz has joined #openstack-infra07:50
*** Ala has joined #openstack-infra07:51
nibalizerok i will do that07:51
mgroszHello, I need help...: I have this first push/review to Vitrage project https://review.openstack.org/#/c/229748/. The files that are added are based on the new Project introduction here http://docs.openstack.org/infra/manual/creators.html, using the new project template described here "Choosing the Right cookiecutter Template".07:53
*** sergmelikyan has joined #openstack-infra07:53
*** HeOS has joined #openstack-infra07:53
mgroszNow I pushed the changes, but it fails in Jenkins..... What am I missing?07:53
*** e0ne has joined #openstack-infra07:54
*** e0ne has quit IRC07:56
AJaegermgrosz: you need to adjust your change so that it passes the tests. Have a look at the log files of the failures07:56
AJaegerOr run locally to reproduce07:56
*** rlandy has joined #openstack-infra07:56
*** thingee has joined #openstack-infra07:57
*** sergmelikyan has quit IRC07:58
openstackgerritMerged openstack-infra/puppet-openstackci: Make jenkins password a required parameter  https://review.openstack.org/20028907:59
*** fhubik has joined #openstack-infra08:00
*** olaph has joined #openstack-infra08:06
*** Sree has joined #openstack-infra08:08
*** jordanP has joined #openstack-infra08:08
*** derekh has joined #openstack-infra08:08
*** sergmelikyan has joined #openstack-infra08:10
*** fhubik is now known as fhubik_brb08:10
*** Sree has quit IRC08:11
*** Sree has joined #openstack-infra08:12
*** Sree has quit IRC08:16
*** dizquierdo has joined #openstack-infra08:16
*** alexpilotti has joined #openstack-infra08:17
*** dguitarbite has quit IRC08:18
*** bharathm has joined #openstack-infra08:18
*** markvoelker has joined #openstack-infra08:18
*** jistr has joined #openstack-infra08:18
openstackgerritAugustina Ragwitz proposed openstack-infra/project-config: (WIP) split out into testable units  https://review.openstack.org/22977208:19
*** sflanigan has quit IRC08:19
*** ihrachys has joined #openstack-infra08:20
openstackgerritJesse Pretorius proposed openstack-infra/project-config: Add pep8 and bashate non-voting checks to openstack-ansible  https://review.openstack.org/22840608:20
*** markvoelker has quit IRC08:22
*** bharathm has quit IRC08:23
*** mgrosz has quit IRC08:24
*** mgrosz has joined #openstack-infra08:24
*** jlanoux has quit IRC08:24
*** e0ne has joined #openstack-infra08:26
*** ddieterly has joined #openstack-infra08:28
*** ihrachys has quit IRC08:30
*** thingee has quit IRC08:31
*** dguitarbite has joined #openstack-infra08:32
*** ddieterly has quit IRC08:32
*** claudiub has joined #openstack-infra08:34
*** e0ne has quit IRC08:36
*** fhubik_brb is now known as fhubik08:36
*** e0ne has joined #openstack-infra08:38
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Use tripleo.sh to build packages  https://review.openstack.org/22942508:38
*** dchen has quit IRC08:40
*** geoffarnold has quit IRC08:40
*** geoffarnold has joined #openstack-infra08:41
*** mgrosz has quit IRC08:43
*** rguillebert has joined #openstack-infra08:44
*** sergmelikyan has quit IRC08:45
*** salv-orlando has joined #openstack-infra08:46
*** salv-or__ has joined #openstack-infra08:46
*** mgrosz has joined #openstack-infra08:47
*** salv-orl_ has quit IRC08:49
*** oomichi has joined #openstack-infra08:50
openstackgerritIvan Kolodyazhny proposed openstack-infra/project-config: Add devstack-plugin-bdd to PROJECTS for tempest-dsvm-full-bdd job  https://review.openstack.org/22977508:50
*** salv-orlando has quit IRC08:50
*** BharatK has quit IRC08:51
*** jlanoux has joined #openstack-infra08:51
*** dingyichen has quit IRC08:51
*** mgrosz has quit IRC08:53
*** jlanoux has quit IRC08:58
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Use tripleo.sh to build packages  https://review.openstack.org/22942508:58
*** ihrachys has joined #openstack-infra08:59
*** jlanoux has joined #openstack-infra08:59
ianwAJaeger: not sure what you mean with https://review.openstack.org/#/c/229729/1/tox.ini ?09:01
*** geoffarnold has quit IRC09:02
AJaegerianw: let me double check...09:02
*** sergmelikyan has joined #openstack-infra09:02
*** geoffarnold has joined #openstack-infra09:02
AJaegerianw: Johannes confused me I fear, checking a bit more...09:03
AJaegerianw: .tox/dib/bin/dib-lint uses flake8 but you're not installing flake8 in the tox environment09:04
*** BharatK has joined #openstack-infra09:04
ianwAJaeger: hmm, yeah ok, maybe it only gets run in the context of tox within dib09:04
AJaegerianw: I have flake8 installed systemwide, so don't get a failure.09:07
ianwAJaeger: yeah, me too :)09:08
AJaegerianw: See Johannes comment where it failed09:08
AJaegeror temporarily move flake809:08
AJaegerso, my suggestion was to add "flake8" to the new dib tox environment09:09
AJaegeror add "-r test-requirements.txt"09:09
openstackgerritIan Wienand proposed openstack/diskimage-builder: Add flake8 to requirements  https://review.openstack.org/22978009:10
ianwAJaeger: ^ so that's the real solution, i'll propose a work-around since that will take some weeks to get merged & into a release09:10
*** deepakcs has joined #openstack-infra09:11
AJaegerianw: ok, thanks09:11
AJaegerif I should change my -1 back to a +2, leave a comment so that others understand it.09:12
*** ParsectiX has quit IRC09:12
*** shardy_ has joined #openstack-infra09:13
*** alexpilotti has quit IRC09:13
*** sambetts has joined #openstack-infra09:14
*** shardy has quit IRC09:14
openstackgerritIan Wienand proposed openstack-infra/project-config: Update dib elements to standard headers  https://review.openstack.org/22973009:18
openstackgerritIan Wienand proposed openstack-infra/project-config: Add diskimage-builder lint job  https://review.openstack.org/22972909:18
*** shardy_ has quit IRC09:18
ianwAJaeger: ^ thanks!  good catch there09:18
*** shardy has joined #openstack-infra09:19
*** sergmelikyan has quit IRC09:21
AJaegerianw: LGTM. Did you see my comment for doing this lint only for nodepool changes?09:23
*** geoffarn_ has joined #openstack-infra09:24
*** signed8bit_ZZZzz has quit IRC09:24
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Test a update in trunk repository version  https://review.openstack.org/22978909:24
*** ParsectiX has joined #openstack-infra09:26
*** salv-orlando has joined #openstack-infra09:26
*** sergmelikyan has joined #openstack-infra09:27
*** geoffarnold has quit IRC09:28
*** ddieterly has joined #openstack-infra09:29
*** salv-or__ has quit IRC09:30
*** kiran-r has quit IRC09:30
*** kiran-r has joined #openstack-infra09:32
*** marzif has joined #openstack-infra09:32
*** ddieterly has quit IRC09:33
*** jtomasek has quit IRC09:35
openstackgerritMateusz Matuszkowiak proposed openstack-infra/project-config: Added new Openstack repository for Fuel Mistral plugin integration  https://review.openstack.org/22559609:36
*** sdake_ has joined #openstack-infra09:38
*** Sree has joined #openstack-infra09:38
*** pelix has joined #openstack-infra09:41
*** sdake has quit IRC09:42
*** salv-orl_ has joined #openstack-infra09:42
*** Sree has quit IRC09:44
*** salv-orlando has quit IRC09:45
openstackgerritIvan Kolodyazhny proposed openstack-infra/project-config: Fix cinder-dsvm-apache job  https://review.openstack.org/22980009:48
*** boris-42 has quit IRC09:49
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Nothing to see here  https://review.openstack.org/11101109:51
*** jtomasek has joined #openstack-infra09:51
openstackgerritMateusz Matuszkowiak proposed openstack-infra/project-config: Added new Openstack repository for ScaleIO Cinder Fuel plugin  https://review.openstack.org/22980109:51
*** e0ne has quit IRC09:53
*** mgrosz has joined #openstack-infra09:53
*** mgrosz has quit IRC09:54
*** dims has joined #openstack-infra09:55
*** Kiall has quit IRC09:55
*** Kiall has joined #openstack-infra09:56
*** e0ne has joined #openstack-infra09:56
*** jtomasek has quit IRC09:57
*** alexpilotti has joined #openstack-infra09:58
*** dizquierdo has quit IRC10:00
e0neAJaeger: thank you for the quick feedback and reviews! I appreciate your help10:01
*** dizquierdo has joined #openstack-infra10:01
*** mgrosz has joined #openstack-infra10:02
*** akscram has quit IRC10:03
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Add a job for testing amqp/proton driver  https://review.openstack.org/22970110:05
*** bharathm has joined #openstack-infra10:07
*** mgrosz has quit IRC10:07
*** stevemar has quit IRC10:08
*** stevemar has joined #openstack-infra10:09
*** bharathm has quit IRC10:11
*** amotoki_ has joined #openstack-infra10:11
openstackgerrityolanda.robla proposed openstack-infra/puppet-gerrit: Allow optional configuration of jeepyb  https://review.openstack.org/22980910:11
*** ZZelle has quit IRC10:12
*** ZZelle has joined #openstack-infra10:13
*** stevemar has quit IRC10:13
*** markvoelker has joined #openstack-infra10:19
*** amotoki_ has quit IRC10:19
*** ajmiller__ has joined #openstack-infra10:20
*** kiran-r has quit IRC10:21
*** fhubik is now known as fhubik_brb10:22
*** hashar has joined #openstack-infra10:23
*** markvoelker has quit IRC10:23
*** ajmiller_ has quit IRC10:25
*** ajmiller has joined #openstack-infra10:26
*** Hal has quit IRC10:26
*** mwagner_ has quit IRC10:26
*** geoffarnold has joined #openstack-infra10:26
*** geoffarn_ has quit IRC10:26
*** fhubik_brb is now known as fhubik10:27
*** ajmiller__ has quit IRC10:28
*** ddieterly has joined #openstack-infra10:29
*** ddieterly has quit IRC10:34
*** alexpilotti has quit IRC10:35
lennybHi , what is a new home of subunit2html.py ?10:35
*** alexpilotti has joined #openstack-infra10:36
*** asselin_ has joined #openstack-infra10:37
*** ajmiller has quit IRC10:38
*** asselin__ has quit IRC10:40
*** BharatK has quit IRC10:42
*** ajmiller has joined #openstack-infra10:43
*** amotoki_ has joined #openstack-infra10:46
*** nikil89_ has joined #openstack-infra10:46
*** geoffarnold has quit IRC10:47
*** geoffarnold has joined #openstack-infra10:47
*** pc_m has joined #openstack-infra10:50
*** abregman has joined #openstack-infra10:54
*** BharatK has joined #openstack-infra10:55
*** abregman is now known as abregman|pto10:56
AJaegerlennyb: repo openstack/os-testr, file os_testr/subunit2html.py10:57
*** trown|outttypeww is now known as trown11:00
*** marzif has quit IRC11:04
openstackgerritAndreas Jaeger proposed openstack/requirements: Rename stackforge/octavia -> openstack/octavia  https://review.openstack.org/22982211:04
*** marzif has joined #openstack-infra11:05
*** aukhan has quit IRC11:07
*** bharathm has joined #openstack-infra11:08
*** geoffarnold has quit IRC11:08
*** geoffarnold has joined #openstack-infra11:09
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Test a update in trunk repository version  https://review.openstack.org/22978911:12
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Remove sudo when calling tripleo.sh  https://review.openstack.org/22982311:12
*** bharathm has quit IRC11:13
*** marzif has quit IRC11:14
*** marzif has joined #openstack-infra11:15
*** marzif has quit IRC11:16
*** marzif has joined #openstack-infra11:16
*** arxcruz has quit IRC11:18
*** Daisy has joined #openstack-infra11:19
*** eantyshev has joined #openstack-infra11:19
*** ildikov has joined #openstack-infra11:25
*** marzif has quit IRC11:26
*** kgiusti has quit IRC11:26
*** doug-fish has joined #openstack-infra11:26
*** marzif has joined #openstack-infra11:26
*** geoffarnold has quit IRC11:30
*** geoffarnold has joined #openstack-infra11:30
*** ddieterly has joined #openstack-infra11:30
*** kengo_sa_ has quit IRC11:30
*** baoli has joined #openstack-infra11:31
*** markvoelker has joined #openstack-infra11:34
*** ddieterly has quit IRC11:34
lennybAJaeger: thanks11:35
*** arxcruz has joined #openstack-infra11:35
*** marzif has quit IRC11:36
*** marzif has joined #openstack-infra11:37
*** ldnunes has joined #openstack-infra11:37
*** markvoelker has quit IRC11:39
*** AJaeger has quit IRC11:45
*** AJaeger has joined #openstack-infra11:46
*** yamamoto has quit IRC11:46
*** AJaeger has quit IRC11:46
*** marzif has quit IRC11:46
*** dprince has joined #openstack-infra11:47
*** dtantsur|afk is now known as dtantsur11:47
*** Daisy has quit IRC11:47
openstackgerritDmitry Teselkin proposed openstack-infra/project-config: rpmlint checks for rpm-packages repo  https://review.openstack.org/22984011:47
*** Daisy has joined #openstack-infra11:48
*** AJaeger has joined #openstack-infra11:48
*** marzif has joined #openstack-infra11:49
*** geoffarnold has quit IRC11:51
*** geoffarnold has joined #openstack-infra11:51
*** jtomasek has joined #openstack-infra11:52
*** baoli has quit IRC11:52
*** amotoki has quit IRC11:52
*** amotoki_ is now known as amotoki11:52
*** Daisy has quit IRC11:52
*** cdent has joined #openstack-infra11:54
*** flepied has joined #openstack-infra11:59
*** akscram has joined #openstack-infra12:01
*** markvoelker has joined #openstack-infra12:01
*** gordc has joined #openstack-infra12:01
*** fhubik is now known as fhubik_brb12:03
*** nikil89_ is now known as naggappan12:03
*** aarefiev has quit IRC12:04
*** marcusvrn_ has joined #openstack-infra12:06
*** marzif has quit IRC12:06
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Nothing to see here  https://review.openstack.org/11101112:07
*** marzif has joined #openstack-infra12:07
*** dizquierdo has quit IRC12:09
*** kiran-r has joined #openstack-infra12:09
*** denisra has quit IRC12:10
*** pblaho has joined #openstack-infra12:11
*** moravec has quit IRC12:11
*** jtomasek has quit IRC12:11
*** aarefiev has joined #openstack-infra12:12
*** geoffarnold has quit IRC12:12
*** geoffarnold has joined #openstack-infra12:13
*** Hal has joined #openstack-infra12:14
*** k4n0 has quit IRC12:14
*** marzif has quit IRC12:17
*** jerrygb has quit IRC12:17
*** marzif has joined #openstack-infra12:17
*** jtomasek has joined #openstack-infra12:18
*** kiran-r has quit IRC12:21
*** regXboi has joined #openstack-infra12:21
*** k4n0 has joined #openstack-infra12:22
*** k4n0 has quit IRC12:22
*** mwagner_ has joined #openstack-infra12:23
*** ociuhandu has quit IRC12:24
*** weshay_xchat has joined #openstack-infra12:25
*** deepakcs has quit IRC12:25
*** annegentle has joined #openstack-infra12:25
*** dzamboni has joined #openstack-infra12:27
*** weshay_xchat is now known as weshay12:27
*** pradk has joined #openstack-infra12:28
*** baoli has joined #openstack-infra12:28
*** glauco_ has joined #openstack-infra12:31
*** ddieterly has joined #openstack-infra12:31
*** spzala has joined #openstack-infra12:31
*** Daisy has joined #openstack-infra12:31
*** geoffarnold has quit IRC12:34
*** amuller has joined #openstack-infra12:34
*** geoffarn_ has joined #openstack-infra12:34
*** ddieterly has quit IRC12:35
*** BharatK has quit IRC12:35
*** tlian has quit IRC12:36
*** yamamoto has joined #openstack-infra12:38
*** yamamoto has quit IRC12:38
*** yamamoto has joined #openstack-infra12:38
*** stevemar has joined #openstack-infra12:41
*** salv-orl_ has quit IRC12:42
*** edmondsw has joined #openstack-infra12:42
openstackgerritMerged openstack-infra/project-config: Skip caching for dnf (Fedora 22) builds  https://review.openstack.org/22972812:42
*** stevemar has quit IRC12:46
*** glauco__ has joined #openstack-infra12:46
*** glauco__ has quit IRC12:46
*** naggappan is now known as nikil89_12:47
*** stevemar has joined #openstack-infra12:47
*** dkehn has quit IRC12:47
*** nikil89_ is now known as naggappan12:47
*** tlian has joined #openstack-infra12:47
*** puranamr has joined #openstack-infra12:48
*** dkehn has joined #openstack-infra12:48
*** BharatK has joined #openstack-infra12:49
*** glauco_ has quit IRC12:49
*** fhubik_brb is now known as fhubik12:49
*** pfallenop has quit IRC12:49
*** pfallenop has joined #openstack-infra12:50
*** glauco_ has joined #openstack-infra12:50
openstackgerritMerged openstack-infra/project-config: Add diskimage-builder lint job  https://review.openstack.org/22972912:51
*** glauco_ has quit IRC12:51
*** stevemar has quit IRC12:52
*** julim has joined #openstack-infra12:52
*** puranamr has quit IRC12:52
openstackgerritMerged openstack-infra/puppet-gerrit: Setup preconditions for acceptance tests.  https://review.openstack.org/21940012:53
*** pfallenop has quit IRC12:53
*** pfallenop has joined #openstack-infra12:54
*** geoffarn_ has quit IRC12:55
*** glauco_ has joined #openstack-infra12:55
*** glauco_ has quit IRC12:55
*** geoffarnold has joined #openstack-infra12:56
*** bharathm has joined #openstack-infra12:57
*** glauco has joined #openstack-infra12:57
*** glauco has quit IRC12:57
*** jaypipes has joined #openstack-infra12:58
*** thorst has joined #openstack-infra12:58
*** thorst has quit IRC12:59
*** glauco has joined #openstack-infra12:59
*** glauco has quit IRC12:59
*** bharathm has quit IRC13:01
*** glauco has joined #openstack-infra13:01
*** glauco has quit IRC13:02
*** glauco has joined #openstack-infra13:02
*** nadya has quit IRC13:03
*** glauco has quit IRC13:05
*** glauco_ has joined #openstack-infra13:07
*** moravec has joined #openstack-infra13:10
*** ddieterly has joined #openstack-infra13:11
*** glauco_ has quit IRC13:12
openstackgerritMonty Taylor proposed openstack-infra/shade: Return IPv6 address for interface_ip on request  https://review.openstack.org/22986813:14
*** ddieterly has quit IRC13:16
*** rfolco has joined #openstack-infra13:16
*** geoffarnold has quit IRC13:16
*** geoffarn_ has joined #openstack-infra13:17
*** Zhongjun has joined #openstack-infra13:18
*** marzif has quit IRC13:20
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675113:20
*** marzif has joined #openstack-infra13:20
*** glauco has joined #openstack-infra13:21
*** mriedem has joined #openstack-infra13:23
yolandajeblair, fungi, when you come online, i'd like to land the secure.conf change https://review.openstack.org/#/c/189762/13:25
*** marzif has quit IRC13:25
*** sabeen1 has joined #openstack-infra13:25
yolandabut it means a restart of nodepool, are we ok to do it? or how do we land these kind of changes?13:25
*** ayoung has joined #openstack-infra13:25
*** signed8bit has joined #openstack-infra13:26
*** denisra has joined #openstack-infra13:27
*** bltavares has joined #openstack-infra13:27
*** dramalho has joined #openstack-infra13:28
*** tiswanso has joined #openstack-infra13:29
fungiyolanda: well, it simply doesn't take effect until nodepool is restarted, right?13:31
openstackgerritDmitry Teselkin proposed openstack-infra/project-config: rpmlint checks for rpm-packages repo  https://review.openstack.org/22984013:31
*** alivigni has joined #openstack-infra13:31
fungilooks like our last nodepool restart was 6 days ago (september 25)13:32
openstackgerritDmitry Teselkin proposed openstack-infra/project-config: rpmlint checks for rpm-packages repo  https://review.openstack.org/22984013:32
yolandafungi yes, but if the code goes there, and there is no restart, and then you need to restart it...and this change fails, is like having a retarded bomb there13:32
yolandai normally like to land changes and test at the same moment13:32
fungithere have been no new changes landed to the nodepool repo in that time, so if we merge that one we can be relatively assured that restarting it will be testing only that change13:33
yolandahow do you proceed with that?13:33
*** geoffarn_ is now known as geoffarnold13:33
yolandafungi, do you have some scheduled restarts for nodepool?13:33
fungigenerally once the change is showing up on nodepool.openstack.org in /opt/nodepool's git head, then stop and start the nodepool init script (i think graceful restarts may still not be working quite right?)13:33
yolandafungi, but a nodepool restart causes all node in "building" state to be lost. In downstream it normally is a problem, and we try to do it at times with no load13:34
yolandahow do you handle it?13:34
fungilooks like we're not really behind on demand at the moment, so this is probably a safe time to do it13:34
*** trown is now known as trown|brb13:35
yolandafungi, so am i ok to do it? i also normally take a backup of the old nodepool code, to safely replace it if something goes wrong13:35
fungithat is to say, there is no appreciable zuul job queue backlog and we're not riding our providers' quotas13:35
*** denisra has quit IRC13:35
fungiyolanda: the old nodepool code is HEAD^1 in this case, so you can simply switch back by disabling puppet agent and doing a little git manipulation and another pip install from it13:36
openstackgerritDmitry Teselkin proposed openstack-infra/project-config: rpmlint checks for rpm-packages repo  https://review.openstack.org/22984013:36
*** kgiusti has joined #openstack-infra13:36
*** Hal has quit IRC13:36
*** bcourt has joined #openstack-infra13:37
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for novaclient legacy bdm bug 1501435  https://review.openstack.org/22988213:37
openstackbug 1501435 in python-novaclient "osc 1.7 no longer can boot a server from volume" [Critical,In progress] https://launchpad.net/bugs/1501435 - Assigned to John Garbutt (johngarbutt)13:37
*** ajmiller has quit IRC13:38
*** dkranz has joined #openstack-infra13:38
*** ajmiller has joined #openstack-infra13:38
*** geoffarnold has quit IRC13:39
yolandaok, going to approve it, and will baby-sit13:39
fungithanks!13:39
*** fhubik is now known as fhubik_brb13:39
*** denisra has joined #openstack-infra13:40
*** xyang1 has joined #openstack-infra13:41
openstackgerritMerged openstack-infra/elastic-recheck: Add query for cinder v2 heat bug 1500780  https://review.openstack.org/22909313:42
openstackbug 1500780 in tempest "orchestration.stacks.test_volumes test is failing" [High,Fix released] https://launchpad.net/bugs/1500780 - Assigned to Jordan Pittier (jordan-pittier)13:42
*** Sree has joined #openstack-infra13:42
*** fhubik_brb is now known as fhubik13:42
openstackgerritMichal Vanco proposed openstack-infra/jenkins-job-builder: Support test trend graph in Build Flow Test Aggregator  https://review.openstack.org/22394213:43
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for gnocchi functional setup fail  https://review.openstack.org/22988913:43
*** ddieterly has joined #openstack-infra13:44
*** abregman|pto is now known as abregman13:45
*** denisra has quit IRC13:46
*** ddieterly has quit IRC13:47
*** ddieterly has joined #openstack-infra13:47
*** trown|brb is now known as trown13:47
*** woodster_ has joined #openstack-infra13:48
*** ddieterly has quit IRC13:49
*** mrmartin has joined #openstack-infra13:49
*** denisra has joined #openstack-infra13:49
*** dkehn has quit IRC13:51
*** nelsnelson has quit IRC13:52
openstackgerritMerged openstack-infra/grafyaml: Add test coverate for grafana.py  https://review.openstack.org/22698613:52
*** armax has joined #openstack-infra13:52
*** armax has quit IRC13:52
yolandafungi, so secure.conf failed , i need a rebase13:53
yolandaso it will need reviews again13:53
openstackgerritMonty Taylor proposed openstack-infra/shade: Return IPv6 address for interface_ip on request  https://review.openstack.org/22986813:53
*** mattt has left #openstack-infra13:54
fungii'm happy to give teh rebase a quick look, but generally we're not so rigorous with getting lots of reviews on a rebase of something which already got approved13:54
openstackgerritMonty Taylor proposed openstack-infra/shade: Return IPv6 address for interface_ip on request  https://review.openstack.org/22986813:54
openstackgerritRamy Asselin proposed openstack-infra/nodepool: Update nodepool to use secure.conf file  https://review.openstack.org/18976213:54
*** stevemar has joined #openstack-infra13:54
fungiin the past i've often just reapproved something after rebasing it, depending on the complexity of the patch and the merge conflict13:55
yolandaso asselin fixed, it's a problem on some new tests added13:55
*** armax has joined #openstack-infra13:55
fungicool. looking now13:55
asselin_yolanda, actually I just rebased it via gerrit13:55
*** ddieterly has joined #openstack-infra13:56
asselin_yolanda, fungi I will fail again..sorry...just waking up13:56
yolandaasselin_, it should fail.. if there are new tests, the secure.conf parameter needs to be added13:56
fungiyeah, it doesn't so much need a rebase as some modifications i guess13:57
*** links has quit IRC13:57
clarkbwhy doesnt the test base class handle that?13:57
dansmithpaste.openstack is always extremely slow for me.. I assume I'm not the only one, right?13:58
*** dkehn has joined #openstack-infra13:58
*** ParsectiX has quit IRC13:58
fungidansmith: it gets blasted by crawlers reindexing it over and over from links in our html-based irc channel logs i think13:58
fungilooking to see if that robots.txt addition made it in yet13:58
dansmithfungi: ah13:59
*** stevemar has quit IRC13:59
Clintfungi: it's definitely not serving up robots.txt13:59
dansmithfungi: it's slow enough that I just don't use it, but people still send me stuff with it and it's frustrating :/13:59
yolandaso clarkb, i added this new parameter to don't be so disruptive on the nodepool tests, as they were managing the configfile setup. But i think you are right, as secure file will not change13:59
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Add validate command  https://review.openstack.org/22655413:59
yolandais not the same case as the nodepool yaml file, where you test different cases13:59
yolandaasselin_, what do you think about adding the self.setup_secure() ad useNodepool level?14:00
clarkbpstch argb should just set it14:00
clarkbno reason to be explicit I dont think14:00
openstackgerritMerged openstack-infra/elastic-recheck: Add query for novaclient legacy bdm bug 1501435  https://review.openstack.org/22988214:01
openstackbug 1501435 in python-openstackclient "osc 1.7 no longer can boot a server from volume" [Critical,New] https://launchpad.net/bugs/150143514:01
openstackgerritMerged openstack-infra/elastic-recheck: Add query for gnocchi functional setup fail  https://review.openstack.org/22988914:01
clarkbsame for useNodepool14:01
asselin_yolanda, in this change or a separate change?14:02
yolandain this change14:02
yolandarefactor that calls to secure.conf on each test, that is causing us pain14:02
fungiyeah, looks like paste.o.o is beset by more bots posting search engine keyword bait14:02
fungii'll try to squash them with more temporary iptables rules14:02
asselin_yolanda, ok will look into that14:03
*** Ala has quit IRC14:03
yolandathx asselin14:03
*** eharney has joined #openstack-infra14:03
*** bcourt has quit IRC14:04
asselin_yolanda, I'm going to have breakfast and wakeup first14:04
yolandaasselin_ sure :)14:04
fungialso "yahoo! slurp[tm]" is indexing paste.o.o now14:04
pabelangermorning14:05
*** rossella_s has quit IRC14:06
*** rossella_s has joined #openstack-infra14:06
clarkbyolanda asselin you also need to remove dburi from setup_config()14:06
clarkbimages dir as well apparebtly?14:07
clarkbwhy is images dir in secure.conf14:07
*** dims has quit IRC14:10
*** david-lyle has quit IRC14:11
*** stevemar has joined #openstack-infra14:11
*** AJaeger has quit IRC14:12
*** sigmavirus24_awa is now known as sigmavirus2414:12
fungidansmith: see if it's responding any faster for you now. i firewalled off a couple of offenders14:12
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Skip lbaasv2-dsvm-minimal on doc changes  https://review.openstack.org/22968014:12
dansmithfungi: definitely14:13
fungiyeah, i think it's the combination of search engines and the spambots taking advantage of search engine indexing causing the slowdowns14:13
*** david-lyle has joined #openstack-infra14:13
fungiso in theory the robots.txt addition should stop the indexing, and after a while the spambots will hopefully realize it's no longer an attractive target again14:14
Clintthat's a reasonable theory14:14
*** signed8bit is now known as signed8bit_ZZZzz14:14
*** flip214 has quit IRC14:15
yolandaclarkb so dburi can be removed yes, as it's legacy. About images path, is there on previous patches, not related to this secure.conf patchset, i cannot tell14:15
dansmithfungi: yeah, I'm sure it's hard to hide from the ones that don't follow the rules anyway14:15
dansmithfungi: seems like there should be some rate-limiting built in to throttle offenders14:15
clarkbyolanda its in setuo config where it belongs but its also in the secure.conf where it doesnt belong14:16
clarkb*in setup secure.conf14:16
fungidansmith: unfortunately our fork of lodgeit was (at last check) the only one with anything close to actively maintained14:16
dansmithheh14:16
fungiso if it's going to get new features, it's probably up to us to write them14:17
*** signed8bit_ZZZzz is now known as signed8bit14:17
*** dizquierdo has joined #openstack-infra14:17
*** jsavak has joined #openstack-infra14:17
yolandaok so it needs to be removed you are right, seems that this test part needs a bit of work14:17
mrmartinmorning14:17
*** gildub has quit IRC14:18
fungiClint: the reason for my theory is that i just blacklisted one ip address posting things like http://paste.openstack.org/show/475064/ and one search engine indexing the server14:18
fungi(and this is far from the first time seeing it)14:18
Clintmultilingual14:19
*** Hal has joined #openstack-infra14:20
*** bcourt has joined #openstack-infra14:21
eantyshevHello! This zuul change https://review.openstack.org/207094 has received the first +2, and I welcome more reviewers14:21
*** jsavak has quit IRC14:21
*** eantyshev has left #openstack-infra14:22
openstackgerritMatthew Treinish proposed openstack-infra/elastic-recheck: Filter the uncategorized page on only tempest and grenade  https://review.openstack.org/22990914:22
*** jsavak has joined #openstack-infra14:22
*** nelsnelson has joined #openstack-infra14:23
*** fhubik is now known as fhubik_brb14:23
fungilooks like greghaynes's robots.txt support for puppet-lodgeit is https://review.openstack.org/22861014:24
*** fhubik_brb is now known as fhubik14:24
*** fhubik has quit IRC14:24
fungier, actually that's in lodgeit not puppet-lodgeit14:25
yolandaah, i was wondering why i didn't see it :)14:25
*** arxcruz has quit IRC14:25
clarkbis there a reason apache should host that?14:25
openstackgerritMerged openstack-infra/grafyaml: Add docs for grafana-dashboards command  https://review.openstack.org/22860114:25
clarkbmaybe greghaynes will know when he wakes14:26
Clintfungi: isn't that gonna render as text/html?14:26
fungiseems like we could pretty easily just alias it in the vhost config, yeah14:26
fungiClint: quite possibly?14:26
* Clint asks in a better place.14:26
*** mtanino has joined #openstack-infra14:27
clarkbfungi yes same way etherpad does it14:27
fungirender_to_response() does look like it might have that effect, yes14:27
fungiclarkb: greghaynes: i agree the apache solution is simpler and we basically already have it implemented elsewhere14:28
*** zz_dimtruck is now known as dimtruck14:29
*** vmb_out is now known as vmbrasseur14:29
*** jsavak has quit IRC14:31
*** Ala has joined #openstack-infra14:31
anteayaperisteri: hello and welcome14:32
anteayaperisteri: yes you can help, thank you for offering14:32
peristerianteaya, Great, I sent an email to Remo to get an update of what is the current status of the bugs.14:33
anteayaremo?14:33
anteayado you mean zaro?14:33
anteayaperisteri: here is the most recent status: https://etherpad.openstack.org/p/I0eV4IgkZS14:34
peristerianteaya, yes zaro.14:35
*** sridhar_ram has joined #openstack-infra14:36
anteayawonderful14:36
*** bltavares has quit IRC14:36
*** nelsnelson has quit IRC14:36
anteayahe'll be online in a few hours14:36
anteayaperisteri: in the mean time he and I put together the above etherpad14:36
*** nelsnelson has joined #openstack-infra14:36
anteayawith links to the issues and offered fixes that have stalled14:36
peristerianteaya, Great, I will look into it.14:37
anteayaperisteri: let me know if you need more explaination14:37
anteayaperisteri: thank you!14:37
peristerianteaya, sure.14:37
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Reorder tox.ini envlist  https://review.openstack.org/22486514:39
*** jsavak has joined #openstack-infra14:39
*** nelsnelson has quit IRC14:40
pabelangerstepping away for 45mins, running some errands with family14:40
mordredShrews, clarkb: https://review.openstack.org/#/q/status:open+project:openstack-infra/shade+branch:master+topic:private-test,n,z14:41
mordredshould be ready for review14:41
mordredand I think we should land all three before landing the nodepool patch14:41
*** stevemar has quit IRC14:41
*** stevemar has joined #openstack-infra14:42
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675114:42
mordred(just depends-on the nodepool on those patches)14:42
pabelangeryolanda: timrc: https://review.openstack.org/#/c/226554/ adds the validate command to grafyaml14:43
anteayapabelanger: enjoy errands14:43
pabelangeranteaya: doctors. only so much fun14:44
anteayapabelanger: ah I hope everyone is in good health and they say, go home14:44
anteaya:)14:44
*** Daisy has quit IRC14:44
*** Daisy has joined #openstack-infra14:45
*** bltavares has joined #openstack-infra14:45
*** peristeri has quit IRC14:45
*** bharathm has joined #openstack-infra14:45
*** stevemar has quit IRC14:46
openstackgerritMatthew Treinish proposed openstack-infra/elastic-recheck: Filter the uncategorized page on only tempest and grenade  https://review.openstack.org/22990914:46
*** stevemar has joined #openstack-infra14:46
*** tjones has joined #openstack-infra14:47
openstackgerritMonty Taylor proposed openstack-infra/system-config: Tell os-client-config that we prefer IPv6  https://review.openstack.org/22992314:48
mrmartinfungi: I've fixed the puppet-community's git resource module, so the refresh on ref commits works well there. I'm just waiting an approval on the pull request: https://github.com/puppet-community/puppet-git_resource/pulls I like to add it to modules.env, and I prepared a changeset required for askbot's infra.14:48
*** rmoats has joined #openstack-infra14:49
*** rmoats has quit IRC14:49
*** stevemar_ has joined #openstack-infra14:49
*** jtomasek has quit IRC14:50
*** bharathm has quit IRC14:50
*** stevemar has quit IRC14:51
*** Sree has quit IRC14:53
timrcpabelanger, I'll take a look in a few.  I have sick kids with me today.14:53
*** Sree has joined #openstack-infra14:53
fungimrmartin: sounds great!14:54
*** stevemar has joined #openstack-infra14:55
funginibalizer: crinkle: ^ (not sure if you're able to help get that pr reviewed)14:55
*** tonytan4ever has joined #openstack-infra14:56
*** geoffarnold has joined #openstack-infra14:56
anteayatimrc: :( may the hot soup and repetitive video be yours14:57
*** Sree has quit IRC14:57
*** stevemar_ has quit IRC14:58
*** tsekiyama has joined #openstack-infra14:58
*** signed8bit is now known as signed8bit_ZZZzz14:58
*** jlanoux has quit IRC14:58
*** jaypipes has quit IRC14:59
*** signed8bit_ZZZzz is now known as signed8bit15:00
openstackgerritChris Dent proposed openstack-infra/project-config: Enable ceilometer devstack plugin for tempest jobs  https://review.openstack.org/22994015:00
*** hashar has quit IRC15:00
*** Swami has joined #openstack-infra15:01
*** jsavak has quit IRC15:02
*** bltavares has quit IRC15:02
*** bltavare_ has joined #openstack-infra15:02
EmilienMpabelanger: I think you can safely abandon https://review.openstack.org/22052715:02
*** bcourt has quit IRC15:04
*** jsavak has joined #openstack-infra15:05
*** wolsen has joined #openstack-infra15:05
*** sdake has joined #openstack-infra15:06
*** bpokorny has joined #openstack-infra15:08
openstackgerritChris Dent proposed openstack-infra/project-config: Enable ceilometer devstack plugin for tempest jobs  https://review.openstack.org/22994015:08
openstackgerritDmitry Teselkin proposed openstack-infra/project-config: [WIP] rpmlint checks for rpm-packages repo  https://review.openstack.org/22984015:09
*** jsavak has quit IRC15:09
*** nadya has joined #openstack-infra15:10
openstackgerritDoug Hellmann proposed openstack-dev/pbr: Restore warnerrors behavior  https://review.openstack.org/22995115:10
*** sdake_ has quit IRC15:10
*** jsavak has joined #openstack-infra15:12
openstackgerritMatt Riedemann proposed openstack/requirements: Raise upper-constraints on novaclient to 2.30.1  https://review.openstack.org/22995415:13
*** mrmartin has quit IRC15:13
mriedemdhellmann: sdague: ttx: ^15:13
sdaguemriedem: +215:13
mriedemwrong branch15:13
sdaguegdi :)15:14
*** tonytan4ever has quit IRC15:14
mriedemnow it's up15:15
*** abregman is now known as abregman|afk15:15
mriedemhttps://review.openstack.org/#/c/229956/15:15
anteayaI guess our bot doesn't catch stable branches on requirements15:16
anteayashould it>15:16
anteaya>15:16
anteaya?15:16
wznoinskfungi: re the git mirroring software, I'm interested in what you use to keep local git copies of OS git repos - I'm thinking of having local git mirror with OS code here so asking people that already may have an experience15:16
openstackgerritMerged openstack-infra/project-config: Add release jobs to the octavia project  https://review.openstack.org/22951815:16
*** jsavak has quit IRC15:16
wznoinskfungi: GROK's area I'd say15:17
fungiwznoinsk: i use a script like this in a nightly cron job http://paste.openstack.org/show/475085/15:17
anteayamestery: can you rebase 229564 when you get a chance?15:17
mesteryanteaya: On it15:18
fungiwznoinsk: i also have a separate script which blows away all non-remote-tracking branches and resets all the tracking branches to the origin state, which i run manually on occasion as cleanup15:18
anteayamestery: thank you15:18
*** jsavak has joined #openstack-infra15:18
*** jerrygb has joined #openstack-infra15:19
*** jerrygb has quit IRC15:19
openstackgerritMerged openstack-infra/project-config: Add devstack-plugin-bdd to PROJECTS for tempest-dsvm-full-bdd job  https://review.openstack.org/22977515:19
*** jerrygb has joined #openstack-infra15:19
*** abregman|afk has quit IRC15:20
openstackgerritKyle Mestery proposed openstack-infra/project-config: Add pypi publishing jobs for neutron sub-projects  https://review.openstack.org/22956415:21
mesteryanteaya: ^^^^^15:21
anteayathank you15:21
*** nadya has quit IRC15:21
*** bcourt has joined #openstack-infra15:21
*** shardy_ has joined #openstack-infra15:22
*** nadya has joined #openstack-infra15:22
*** jsavak has quit IRC15:23
*** jeadre has quit IRC15:24
*** shardy has quit IRC15:24
anteayamestery: you are waiting on the pypi creation for two projects, if I might suggest, remove those two from your current patch and add them as a child patch15:24
*** jsavak has joined #openstack-infra15:24
anteayamestery: that way those who have complied can get your attention and the stragglers can wait15:25
*** jeadre has joined #openstack-infra15:25
mesteryanteaya: That's not a bad idea to be honest, I'll take a look at that.15:25
*** ajmiller_ has joined #openstack-infra15:25
*** samuelBartel has joined #openstack-infra15:26
anteayamestery: it keeps you moving, rather than waiting for the one who maybe asleep at the switch15:26
Shrewsmordred: by any chance did you test 229140 against our ansible modules?15:26
*** tonytan4ever has joined #openstack-infra15:27
*** scheuran has quit IRC15:27
*** ajmiller has quit IRC15:27
*** shardy_ has quit IRC15:27
TheJuliawin 1915:27
TheJuliadoh15:28
*** ajmiller has joined #openstack-infra15:28
*** shardy has joined #openstack-infra15:28
*** jsavak has quit IRC15:29
mriedemsdague: is an upper-constraints change on master needed immediately or can we just wait for the bot?15:30
mriedemfor novaclient 2.3115:30
*** jsavak has joined #openstack-infra15:30
*** signed8bit is now known as signed8bit_ZZZzz15:30
*** jaypipes has joined #openstack-infra15:30
*** dims has joined #openstack-infra15:30
sdaguewe should push it15:30
mriedemok15:30
sdaguebecause I think there is going to be a timing issue otherwise15:30
mriedempush it real good?15:30
sdague:P15:30
* fungi cringes at terrible salt-n-pepa reference15:31
*** bltavare_ has quit IRC15:32
*** ajmiller_ has quit IRC15:32
openstackgerritMatt Riedemann proposed openstack/requirements: Raise upper-constraints on python-novaclient to 2.31.0  https://review.openstack.org/22996215:32
mriedemnot terrible15:32
mriedemclassic15:32
anteayaterrible15:33
* mriedem is still waiting for his investment to turnaround on this style http://thehowardtheatre.com/assets/Salt-N-Pepa-4_652x367.jpg15:33
anteayaha ha ha15:33
anteayaoh can I see you in a picture with that15:33
anteayashowing your mn tatoo?15:33
mordredShrews: nope - next on the list - I did test it by running shade-inventory and looking at the output15:34
mordredShrews: oh - however, I just added rax to the mix and found a bug15:34
*** jsavak has quit IRC15:34
mordredShrews: I'm starting to think that we should build a set of fakes for each of the clouds we know of that is different15:34
*** markvan__ is now known as markvan15:34
*** dramalho has quit IRC15:34
*** jsavak has joined #openstack-infra15:34
mordred"this is what rackspace returns" - "this is what hp returns" etc15:34
Shrewsmordred: hrm, don't know if i like that. then we have to periodically check to make sure the truth is still the trush15:35
Shrewstruth15:35
mordredyah15:35
*** jlanoux has joined #openstack-infra15:35
*** sridhar_ram has quit IRC15:35
mordredwell - what I mean is - we have set of different things that we know of, and shade is supposed to handle all of them15:35
mordredif a cloud changes data format to a new form we've never seen, nothing we can do about that - and if it stops being weird, that's fine, shade is still supposed to handle the form of data they _were_ giving15:36
mordredOR15:36
mordredwe could just keep doing what we're doing no15:36
mordrednow15:36
mordredI don't feel terribly strongly about it15:36
Shrewsok, yeah, i can see that as being useful. a defined set of use cases15:36
Shrewsnot tied to specific vendors15:37
*** zeih has quit IRC15:37
Shrewsso much to do15:37
*** angdraug has joined #openstack-infra15:38
*** persia has quit IRC15:38
openstackgerritZara proposed openstack-infra/storyboard-webclient: Subscriptions  https://review.openstack.org/22356215:38
wznoinskfungi: so you recreate git repos everynight if I get it correctly, do you know how long it takes? (I'm assuming you're on some 100MB+ connection to the review.openstack.org)15:39
*** signed8bit_ZZZzz is now known as signed8bit15:39
*** niedbalski has joined #openstack-infra15:41
*** Daisy has quit IRC15:42
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/release-tools: Fix ImportError: No module named simplejson  https://review.openstack.org/22996915:42
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Use overlay always to make SERVICE_HOST setup easy  https://review.openstack.org/22997015:42
*** Daisy has joined #openstack-infra15:42
fungiwznoinsk: i don't recreate them every night. that script only clones if the repository doesn't already exist locally, otherwise it just does a remote update15:43
openstackgerritMonty Taylor proposed openstack-infra/shade: Provide short-circuit for finding server networks  https://review.openstack.org/22914015:44
mordredShrews: ^^ that fixes it for rackspace now15:44
fungiwznoinsk: the clone operation follows a conditional test for whether the local destination exists15:44
mordredShrews: I have verified that shade-inventory runs a reasonable amount of API calls and that the data returned into the inventory is correct15:45
openstackgerritSean Dague proposed openstack-infra/devstack-gate: update grenade branch logic for mitaka  https://review.openstack.org/22936315:45
Shrewsmordred: awesome15:46
*** Daisy has quit IRC15:47
sdaguefungi: so just maybe, we have enough patches in flight we can change branches today15:47
*** tonytan4ever has quit IRC15:47
Shrewsmordred: the root of that change set needs requirements.txt updated15:48
fungisdague: should i keep closer tabs on #openstack-relmgr-office today? any help you need in speeding things up?15:48
sdagueno, now that the client release is out there, I think I can stack up tests with depends-on15:49
sdaguewe'll see if that all works15:49
fungior i guess #openstack-qa for branching devstack/grenade15:49
fungisince those aren't under release management15:49
sdagueI'll poke you if I need anything from you15:49
fungisdague: please do. happy to help however i can15:49
mordredShrews: ++15:49
sdagueI just wanted to give you the heads up15:49
fungiappreciated!15:49
*** Daisy has joined #openstack-infra15:50
*** ociuhandu has joined #openstack-infra15:52
*** e0ne has quit IRC15:53
*** sridhar_ram has joined #openstack-infra15:55
openstackgerritChris Dent proposed openstack-infra/project-config: Enable ceilometer devstack plugin for tempest jobs  https://review.openstack.org/22994015:57
*** Swami has quit IRC15:57
*** hdd has joined #openstack-infra15:58
pleia2good morning16:00
*** sergmelikyan has quit IRC16:00
*** sergmelikyan has joined #openstack-infra16:01
*** moravec has quit IRC16:03
openstackgerritTom Fifield proposed openstack-infra/groups-static-pages: Only need one URL for Official User Group  https://review.openstack.org/22998916:03
anteayamorning pleia216:04
*** moravec has joined #openstack-infra16:05
*** signed8bit is now known as signed8bit_ZZZzz16:05
*** abregman|afk has joined #openstack-infra16:07
*** sergmelikyan has quit IRC16:07
*** thingee has joined #openstack-infra16:08
*** samuelBartel has quit IRC16:08
openstackgerritJim Rollenhagen proposed openstack-infra/project-config: Allow ironic-python-agent to have stable/managed releases  https://review.openstack.org/22999316:09
*** ildikov has quit IRC16:09
*** unicell has quit IRC16:09
*** Swanson has joined #openstack-infra16:09
*** markus_z has quit IRC16:09
*** tonytan4ever has joined #openstack-infra16:10
*** thiagop has joined #openstack-infra16:10
*** mudassirlatif has joined #openstack-infra16:10
*** Daisy has quit IRC16:11
*** Daisy has joined #openstack-infra16:12
anteayajroll: yeah looking at that patch16:12
*** jlanoux has quit IRC16:12
anteayajroll: um, I read the commit message about the motivation, but has someone tried to use permissions and been blocked?16:12
jrollanteaya: thanks! not sure about the tags thing16:13
*** jlanoux has joined #openstack-infra16:13
jrollanteaya: oh, let me provide context16:13
anteayajroll: I don't recall seeing a [access "refs/heads/stable/liberty"] stanza before16:13
*** r-daneel has joined #openstack-infra16:13
jrollanteaya: https://review.openstack.org/#/c/229983/16:13
anteayaperhaps it is required and I just don't know16:13
*** dramalho has joined #openstack-infra16:13
jrolland yeah, I hadn't seen that either, but it's in ironic.config so I'm rolling with it16:13
anteayajroll: fair enough as a starting point16:14
*** signed8bit_ZZZzz is now known as signed8bit16:14
jrollanteaya: I assume it's related to the changes in release management16:14
anteayaI am pushing back just on the fact I haven't seen it before, continuing to dig16:14
anteayawhich I haven't been able to keep up with, so that's on me16:14
*** trown is now known as trown|lunch16:15
*** odgrim has joined #openstack-infra16:15
jrollanteaya: right, I also pointed release management folks at it, so hopefully they can point it out16:15
*** Daisy has quit IRC16:16
anteayajroll: well look at that, nova has the same thing: http://git.openstack.org/cgit/openstack-infra/project-config/tree/gerrit/acls/openstack/nova.config16:17
*** salv-orlando has joined #openstack-infra16:17
jroll\o/16:18
*** jaypipes has quit IRC16:18
*** shashank_hegde has joined #openstack-infra16:20
*** salv-orlando has quit IRC16:20
*** eye_ has joined #openstack-infra16:21
*** mriedem is now known as mriedem_lunch16:22
*** jerrygb has left #openstack-infra16:22
*** Daisy has joined #openstack-infra16:23
anteayawell you are following what others are doing16:23
anteayathe confusion is mine16:23
*** thingee has quit IRC16:23
*** bltavares has joined #openstack-infra16:23
anteayaas I thought I had remembered from last week fungi telling me that this wasn't necessary16:24
anteayabut I possibly am miss remembering16:24
anteayaas there seems to be quite the crowd doing this16:24
openstackgerritMerged openstack/os-testr: Force utf8 encoding on subunit attachments output  https://review.openstack.org/22952716:25
*** stevemar_ has joined #openstack-infra16:25
*** matrohon has quit IRC16:26
*** ajmiller has quit IRC16:26
*** shayneburgess has quit IRC16:26
*** nadya has quit IRC16:26
*** vipul has quit IRC16:27
*** yamahata has joined #openstack-infra16:27
fungiit also may just be le cult de cargo16:27
fungilooking now16:27
*** stevemar has quit IRC16:27
*** ajmiller has joined #openstack-infra16:27
dramalhoclarkb: Could can look?  https://review.openstack.org/#/c/222694/616:28
*** vipul has joined #openstack-infra16:28
*** shayneburgess has joined #openstack-infra16:28
*** jistr has quit IRC16:29
*** hdd has quit IRC16:29
fungianteaya: oh, refs/heads/stable/liberty is a temporary block granting release management and project milestone teams exclusive control, to prevent stable-maint teams taking over the stable/liberty branches prior to the release16:29
*** dtantsur is now known as dtantsur|afk16:29
anteayafungi: ah my fault, thank you16:29
*** hdd has joined #openstack-infra16:30
fungiit gets added at rc1 and removed on or shortly after release day16:30
anteayaperhaps it has happened in releases past and i have been out to lunch?16:30
*** mriedem_lunch is now known as mriedem16:30
fungiwe did it first for kilo16:30
fungiso it's a new-ish process16:31
*** bdemers has quit IRC16:31
anteayaah16:31
*** ameade has quit IRC16:31
anteayaI was out to lunch on kilo then16:31
anteayathank you16:31
*** abregman|afk has quit IRC16:31
anteayajroll: welcome to the cargo cult, nice copy/pasting16:31
fungiin previous releases we instead used a temporary "proposed" branch during rc16:31
dimshaha ++16:31
anteayajroll: but in this case you are correct16:31
*** bdemers has joined #openstack-infra16:31
jrollanteaya: I'm great at cargo culting16:31
jrollfungi: thanks for the explanation :)16:32
anteayajroll: just stay in step, noone will no you are making it up16:32
fungiwhich while not needing temporary acls, had problems of its own16:32
anteayaknow16:32
anteayafungi: I remember proposed16:32
*** Sukhdev has joined #openstack-infra16:32
*** ameade has joined #openstack-infra16:33
*** ashleigh_ has quit IRC16:33
*** sergmelikyan has joined #openstack-infra16:34
*** bharathm has joined #openstack-infra16:34
*** jlanoux has quit IRC16:34
*** ddieterly has quit IRC16:35
anteayattx: nice juggling16:35
*** devvesa has quit IRC16:35
*** kashyap has joined #openstack-infra16:36
kashyapAny rough idea how many jobs the CI infra runs each day?16:37
sigmavirus24Does the release infrastructure sign packages and upload the signatures with twine? (Or can you point me at the repo that has that automation?)16:37
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Pin delorean to a pre mock version  https://review.openstack.org/23001116:37
anteayattx: I'm liking some of the condensed names16:37
*** ZZelle_ has joined #openstack-infra16:37
anteayattx: wondering if we can work an apostrophe in perhaps in future16:37
anteayaPuppet'O16:37
anteayaO'Ansible16:38
*** bharathm has quit IRC16:38
anteayakashyap: you can start with the graphs at the bottom of http://status.openstack.org/zuul/16:38
anteayakashyap: zuul jobs launched per hour might give you a rough estimate16:39
*** salv-orlando has joined #openstack-infra16:39
*** salv-orlando has quit IRC16:39
kashyapanteaya: Ah, right - thanks for the pointer16:40
anteayakashyap: welcome hope it fits your needs16:40
zaromorning16:40
anteayamorning zaro16:40
*** salv-orlando has joined #openstack-infra16:40
fungisigmavirus24: not yet http://specs.openstack.org/openstack-infra/infra-specs/specs/artifact-signing.html16:40
kashyapanteaya: Was making some presentation & wanted to include a point about the kind of bugs the CI infra allows to find16:40
anteayazaro: if you look in scrollback we have another respondant to the call for gerrit help16:40
kashyap(If you're curious why I asked.)16:41
*** sergmelikyan has quit IRC16:41
anteayakashyap: ah wonderful, I hope the presentation goes well16:41
kashyapThx!16:41
anteayakashyap: I'm assuming you wanted to know, but thanks for sharing16:41
anteayakashyap: we have a repo with presentation if you want to take a look at some of them16:41
sigmavirus24fungi: okay. Was going to ask y'all to test https://github.com/pypa/twine/pull/138 if you had a chance since it was broken between 1.5.0 and 1.6.x and I just learned about it to fix it16:41
kashyapanteaya: Got a pointer to it?16:41
anteayakashyap: yes: http://git.openstack.org/cgit/openstack-infra/publications/16:42
sigmavirus24(If anyone else signs packages and uploads the packages+signatures with twine and could test ^ though, I'd love it)16:42
*** Swami has joined #openstack-infra16:42
fungikashyap: those graphs are rendered real-time from data in graphite.openstack.org so feel free to poke around its webui or just tweak parameters on one of those image urls from the zuul status page to get something suitable for your use (the parameter names are pretty self-explanatory)16:42
zaroanteaya: thanks. looks like he/she dropped off.16:42
anteayakashyap: you can view those presentations here: http://docs.openstack.org/infra/publications/16:42
fungisigmavirus24: yeah, i saw you mention the bug earlier (can't recall if it was in a bug report or thread on distutils-sig ml)16:43
anteayazaro: yes, hopefully (s)he will return, sounded like it16:43
*** amit213 has joined #openstack-infra16:43
sigmavirus24fungi: yeah we added a dependency for large file support and the person who did it, did it a little carelessly. There was a different bug around discovering the files appropriately too that was fixed in 1.6.2. Also you may be in #pypa-dev where we kind of discussed this a little16:44
*** moravec has quit IRC16:44
kashyapfungi: Sweet.  Thanks for the info.  I'm making in LaTex (my drawing in TikZ module skills are not up2date), for now only ASCII diagrams and numbers :-)16:45
*** tonytan4ever has quit IRC16:45
*** sergmelikyan has joined #openstack-infra16:46
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Use overlay always to make SERVICE_HOST setup easy  https://review.openstack.org/22997016:46
fungikashyap: oh, you can change the render engine on the graph url to something like "raw" and get a json blob of values too16:46
fungiahh, it's &rawData=true16:46
fungikashyap: like http://graphite.openstack.org/render/?target=summarize(stats_counts.zuul.pipeline.check.all_jobs,%226months%22)&from=-6months&rawData=true16:47
kashyapfungi: Neat, /me clicks16:47
* anteaya imposes self-restraint to not troll the #openstack channel16:47
openstackgerritgreghaynes proposed openstack-infra/nodepool: Trigger image uploads using gearman  https://review.openstack.org/19772216:47
openstackgerritgreghaynes proposed openstack-infra/nodepool: Trigger image builds using gearman  https://review.openstack.org/19517516:47
sigmavirus24anteaya: uhoh, what's going on?16:47
anteayajust read the last statement16:48
anteayaI can't stop laughing16:48
* sigmavirus24 doesn't idle in there for obvious reasons16:48
fungihttp://eavesdrop.openstack.org/irclogs/%23openstack/latest.log.html16:48
kashyapfungi: That's useful detail, much appreciated16:48
*** nadya has joined #openstack-infra16:48
fungisigmavirus24: for when you don't want to idle16:48
*** ajmiller has quit IRC16:48
anteayasigmavirus24: ttp://eavesdrop.openstack.org/irclogs/%23openstack/%23openstack.2015-10-01.log.html#t2015-10-01T16:15:0716:49
wznoinskfungi: thanks for that script, can I reuse it?16:49
sigmavirus24thanks fungi and anteaya16:49
anteayasigmavirus24: welcome16:49
*** signed8bit is now known as signed8bit_ZZZzz16:49
*** ajmiller has joined #openstack-infra16:49
anteayayeah not idling in all the channels is a good strategy16:49
fungiwznoinsk: feel free. it's short enough i would just consider it public domain/no copyright16:49
sigmavirus24anteaya: now I get it :D16:49
anteayasigmavirus24: ha ha ha16:49
wznoinskfungi: thanks, saved me some time to script-out the process myself16:49
*** nadya has quit IRC16:50
fungiyw16:50
sigmavirus24anteaya: someone should put the festivus poll in #openstack so we can have an airing of greivances16:50
sigmavirus24I'll join for the Glance part of it =P16:50
anteayasigmavirus24: ah naw16:50
fungii suspect we'll _all_ join for the glance part of it16:50
anteayaoh festivus16:50
*** nadya has joined #openstack-infra16:50
anteayawho was telling me about that16:50
anteayatravisT16:50
openstackgerritgreghaynes proposed openstack-infra/nodepool: Add dib deletion test  https://review.openstack.org/21527516:50
sigmavirus24I only mean that because I can help fix some of that if my employer ever gives me time to work on OS again16:51
*** bharathm has joined #openstack-infra16:51
openstackgerritgreghaynes proposed openstack-infra/nodepool: Trigger image delete using gearman  https://review.openstack.org/19811416:51
sigmavirus24anteaya: yeah, Searchlight *loves* us ;P16:51
* sigmavirus24 says as a Searchlight core16:51
anteayasigmavirus24: ah yes, let's get you back working on openstack things16:51
anteayasigmavirus24: hmmmm, are you goign to summit?16:51
sigmavirus24sadly not16:51
sigmavirus24family obligations and such16:51
*** signed8bit_ZZZzz is now known as signed8bit16:52
anteayaah well glad you have folks who love you16:52
anteayathat lasts longer than tokyo16:52
sigmavirus24love might be a bit strong of a word choice =P16:52
anteayawell a trip anyway16:52
openstackgerritDanilo Ramalho proposed openstack-infra/puppet-gerrit: Move test assertions closer to apply.  https://review.openstack.org/22757116:52
anteayayes sorry, <appropriate descrition of choice>16:52
anteayabetter?16:52
*** erlon has joined #openstack-infra16:53
sigmavirus24lol thanks :P16:53
pabelangerEmilienM: Yup, updated reviews you commented on16:53
anteayawelcome16:53
*** glauco has quit IRC16:53
*** ddieterly has joined #openstack-infra16:53
EmilienMpabelanger: thank you :)16:54
*** moravec has joined #openstack-infra16:54
openstackgerritMerged openstack-infra/grafyaml: Reorder tox.ini envlist  https://review.openstack.org/22486516:54
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: Update python-novaclient for new release 2.31.0  https://review.openstack.org/23001516:54
*** e0ne has joined #openstack-infra16:54
*** dramalho_ has joined #openstack-infra16:55
*** e0ne has quit IRC16:55
*** jsavak has quit IRC16:55
*** bltavare_ has joined #openstack-infra16:55
*** glauco_ has joined #openstack-infra16:55
*** markvoelker has quit IRC16:55
*** dramalho_ has quit IRC16:55
*** glauco_ has quit IRC16:55
*** jsavak has joined #openstack-infra16:55
*** bltavare_ has quit IRC16:55
*** markvoelker has joined #openstack-infra16:56
*** trown|lunch is now known as trown16:56
*** unicell has joined #openstack-infra16:56
*** dramalho_ has joined #openstack-infra16:56
*** dramalho_ has quit IRC16:56
*** dramalho has quit IRC16:56
*** geoffarnold has quit IRC16:56
*** bltavare_ has joined #openstack-infra16:57
*** persia has joined #openstack-infra16:57
*** bltavare_ has quit IRC16:57
*** glauco has joined #openstack-infra16:57
*** glauco has quit IRC16:57
*** dramalho has joined #openstack-infra16:57
*** bltavare_ has joined #openstack-infra16:57
*** bltavare_ has quit IRC16:57
*** dramalho_ has joined #openstack-infra16:57
*** bltavare_ has joined #openstack-infra16:58
*** bltavares has quit IRC16:58
*** glauco has joined #openstack-infra16:58
*** dramalho has quit IRC16:58
*** dramalho_ has quit IRC16:58
*** bltavare_ has quit IRC16:58
*** notnownikki has quit IRC16:59
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Added recent version of npm to release slave  https://review.openstack.org/22938116:59
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Remove distro-package npm from release slave.  https://review.openstack.org/22938016:59
*** bltavares has joined #openstack-infra16:59
*** puranamr has joined #openstack-infra16:59
*** dramalho has joined #openstack-infra16:59
*** bltavares has quit IRC16:59
*** dramalho has quit IRC16:59
*** baoli has quit IRC17:00
*** nadya has quit IRC17:00
fungikrotscheck: interesting... so npm can gracefully uninstall itself?17:01
*** dramalho has joined #openstack-infra17:01
*** puranamr has quit IRC17:01
*** glauco__ has joined #openstack-infra17:01
*** derekh has quit IRC17:01
*** dramalho has quit IRC17:01
*** nadya has joined #openstack-infra17:01
*** glauco__ has quit IRC17:01
*** baoli has joined #openstack-infra17:01
krotscheckfungi: THe more recent versions, yes.17:01
*** bltavares has joined #openstack-infra17:01
*** bltavares has quit IRC17:01
*** dramalho has joined #openstack-infra17:02
*** sdake_ has joined #openstack-infra17:02
*** dramalho has quit IRC17:02
krotscheckfungi: That particular patch still left some leftover bits in the /man[1-7]/ folders, which seem to have been leftover debian cruft.17:02
*** glauco has quit IRC17:02
*** bltavares has joined #openstack-infra17:02
krotscheckSo, amusingly enough, npm is better at uninstalling itself than debian packaging is.17:02
*** dramalho has joined #openstack-infra17:02
*** dramalho has quit IRC17:02
sambettsHey infra, can i get some eyes on this https://review.openstack.org/#/c/229060/ when someones got a spare moment17:02
*** mriedem has quit IRC17:02
*** bltavares has quit IRC17:02
*** dims_ has joined #openstack-infra17:03
*** maishsk has joined #openstack-infra17:03
*** glauco_ has joined #openstack-infra17:03
*** glauco_ has quit IRC17:03
krotscheckfungi: Yes it was a rebase. habit17:03
*** sdake_ has quit IRC17:04
fungikrotscheck: the nodejs base class installs an npm package i take it?17:04
*** dramalho has joined #openstack-infra17:04
*** bltavares has joined #openstack-infra17:04
*** dims has quit IRC17:04
*** bltavares has quit IRC17:04
*** dramalho has quit IRC17:04
krotscheckfungi: It does only when you're using the nodesource repos, which is automatic for that module unless explicitly disabled.17:04
*** glauco__ has joined #openstack-infra17:04
krotscheckfungi: It's... not optimal, but it works.17:05
*** glauco__ has quit IRC17:05
*** sabeen1 has quit IRC17:05
*** maishsk has quit IRC17:05
*** sdake has quit IRC17:05
*** Piet has quit IRC17:06
*** sabeen has joined #openstack-infra17:06
*** sabeen has quit IRC17:06
*** bltavares has joined #openstack-infra17:06
*** ildikov has joined #openstack-infra17:06
*** bltavares has quit IRC17:06
fungikrotscheck: why not keep the (temporarily unused) npmrc template? removing it and adding it back again creates a bit of a git blame roadblock17:06
*** HeOS has quit IRC17:07
krotscheckkrotscheck: Well, the git blame thing will point to me anyway.17:07
krotscheckfungi: ^^17:07
fungihah17:07
krotscheckfungi: And, well, I was going for clean slate.17:07
*** mriedem has joined #openstack-infra17:07
*** dramalho_ has joined #openstack-infra17:07
*** dramalho_ has quit IRC17:07
*** bltavares has joined #openstack-infra17:07
krotscheckIt was easier for me to test that in my puppet sandbox too.17:07
*** bltavares has quit IRC17:07
fungibut yeah, you could just leave it behind in the first patch then git mv it in the second17:07
*** asmigala has quit IRC17:08
fungithe contents seem unchanged17:08
*** sabeen1 has joined #openstack-infra17:08
fungiand it's just temporary cruft in the repo that way17:08
*** bltavares has joined #openstack-infra17:09
*** dramalho has joined #openstack-infra17:09
*** bltavares has quit IRC17:09
*** dramalho has quit IRC17:09
krotscheckfungi: Want me to send up a new patchset?17:09
*** dramalho has joined #openstack-infra17:09
krotscheckfungi: The content should be different, if it's not then I did something wrong.....17:10
* krotscheck goes to check17:10
*** dramalho_ has joined #openstack-infra17:10
fungiahh, you're adding two lines17:10
*** bltavares has joined #openstack-infra17:10
krotscheckfungi: Right- the difference is that it now (again) contains tag-version-prefix and sign-git-tag17:10
*** dramalho_ has quit IRC17:10
*** tsekiyama has quit IRC17:11
krotscheckWhich I removed from the first iteration of this patch way back when and moved into the lgobal config.17:11
*** bltavares has quit IRC17:11
*** Daisy_ has joined #openstack-infra17:11
fungiso, yeah, another reason to keep that file instead of removing and readding. easier to see what's changed between them17:11
krotscheckkk, will come up with a new one.17:11
krotscheck(Doctor's appointment for the munchkin, afk for a bit)17:11
fungithanks. otherwise i'm cool with this and will +2 once you do17:11
anteayakrotscheck: hope all is well17:11
*** Ala has quit IRC17:12
*** bltavares has joined #openstack-infra17:12
*** dramalho_ has joined #openstack-infra17:12
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test ZMQ event handler  https://review.openstack.org/23002317:13
*** bltavares has quit IRC17:13
*** dramalho_ has quit IRC17:13
*** austin81 has joined #openstack-infra17:13
greghaynesclarkb: ooo ^17:13
greghaynesclarkb: what motivated that?17:13
clarkbgreghaynes: I want better testing of node life17:14
*** dramalho has quit IRC17:14
clarkbgreghaynes: since thats core function of nodepool and realized that zmq events were completely untested17:14
*** Daisy has quit IRC17:14
greghaynesnode life sounds like an openstack life insurance plan17:14
clarkbnext stpe which may actually be required here is better testing of the jenkins stuff17:14
funginode life mutual17:14
greghaynesnice17:14
*** dramalho has joined #openstack-infra17:14
*** dramalho has quit IRC17:14
*** glauco_ has joined #openstack-infra17:14
*** glauco_ has quit IRC17:15
clarkbI also think my yield in those tests is insufficient and prone to failure17:15
*** bltavares has joined #openstack-infra17:15
clarkbbut push early and often17:15
anteayaah our summit friday is with ironic in the morning then we change rooms and are with qa and relmgt in the afternoon17:15
*** bltavares has quit IRC17:15
*** dramalho has joined #openstack-infra17:15
fungianteaya: yep. ironic only has a half-day scheduled17:15
*** dramalho has quit IRC17:15
fungiand we wanted some overlap with them because infra cloud bare metal goodness17:15
anteayayup, makes sense17:16
*** glauco has joined #openstack-infra17:16
*** glauco has quit IRC17:16
fungiand as always there's plenty of back-scratching to go around between infra/qa/relmgmt to last a half day17:16
*** glauco_ has joined #openstack-infra17:16
*** glauco_ has quit IRC17:16
*** dramalho has joined #openstack-infra17:16
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test ZMQ event handler  https://review.openstack.org/23002317:17
*** dramalho_ has joined #openstack-infra17:17
*** dramalho_ has quit IRC17:17
*** dramalho has quit IRC17:17
*** Daisy_ has quit IRC17:17
*** glauco has joined #openstack-infra17:17
*** dramalho has joined #openstack-infra17:18
*** stevemar_ has quit IRC17:18
*** ihrachys has quit IRC17:19
*** ajmiller has quit IRC17:21
*** ajmiller has joined #openstack-infra17:23
anteayafungi: great have added those details to the etherpad17:23
anteayafungi: you might need to drum up some design summit ideas business17:24
*** jian5397 has joined #openstack-infra17:24
*** jsavak has quit IRC17:24
*** jian5397 is now known as michaelxin17:25
openstackgerritClint Adams proposed openstack-infra/puppet-httpd: Allow specification of locations to not be proxied  https://review.openstack.org/23002917:25
openstackgerritJames E. Blair proposed openstack-infra/shade: Return IPv6 address for interface_ip on request  https://review.openstack.org/23003017:25
*** jsavak has joined #openstack-infra17:25
anteayaClint: have you an example of someone wanting to exclude urls from being proxied?17:26
*** abitha has joined #openstack-infra17:26
Clintanteaya: robots.txt on paste.o.o, perhaps17:27
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Add the ability to parse directories  https://review.openstack.org/22743817:27
anteayaClint: I wondered if that was it, thank you17:27
* Clint nods.17:27
*** geoffarnold has joined #openstack-infra17:29
*** mrmartin has joined #openstack-infra17:30
openstackgerritGlauco Oliveira proposed openstack-infra/puppet-openstack-health: Add provisioning scripts  https://review.openstack.org/22784917:30
openstackgerritJames E. Blair proposed openstack-infra/shade: Return IPv6 address for interface_ip on request  https://review.openstack.org/23003017:31
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test ZMQ event handler  https://review.openstack.org/23002317:31
openstackgerritJames E. Blair proposed openstack-infra/shade: Return IPv6 address for interface_ip on request  https://review.openstack.org/23003017:33
*** ashleighfarnham has joined #openstack-infra17:33
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Added recent version of npm to release slave  https://review.openstack.org/22938117:33
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Remove distro-package npm from release slave.  https://review.openstack.org/22938017:33
*** ybathia has joined #openstack-infra17:34
openstackgerritPaul Belanger proposed openstack-infra/project-config: [WIP] Add grafana dashboard for status.o.o/zuul  https://review.openstack.org/22483417:34
*** odgrim has quit IRC17:34
bswartzwhat kind of power is required to modify the topic in a gerrit change, if it's incorrect?17:34
Clintsame access as to make a new patchset17:35
bswartzbut anyone can make a new patchset.... that doesn't change the topic in gerrit17:35
*** amuller is now known as amuller_afk17:35
greghaynescrinkle: ohai17:36
fungibswartz: Clint: according to our global config, all registered users can edit any change's topic directly through the webui https://review.openstack.org/gitweb?p=All-Projects.git;a=blob_plain;f=project.config17:36
anteayaif you want to change it in the gui, I believe it is patch owner and project core reviewers17:36
crinklegreghaynes: hello17:36
openstackgerritMonty Taylor proposed openstack-infra/shade: Provide short-circuit for finding server networks  https://review.openstack.org/22914017:36
openstackgerritMonty Taylor proposed openstack-infra/shade: Provide shortcut around has_service  https://review.openstack.org/23003217:36
anteayafungi: can they?17:36
*** signed8bit is now known as signed8bit_ZZZzz17:36
greghaynescrinkle: so the plan for infra-cloud (this should be documented) was to use glean + config-drive to configure networking17:36
crinklegreghaynes: okay i am missing those bits17:36
zaropelix: had a question for you in https://review.openstack.org/#/c/226107/17:36
bswartzfungi, Clint: it seems that only works if the topic is blank -- once it's set, there is no edit button17:36
fungianteaya: we made that update a month or two ago (check git history on our gerrit config documentation in system-config for the approximate date)17:36
*** ociuhandu has quit IRC17:36
anteayabswartz: you can also download the patch with git review -d and then upload it with git review -t <topic>17:36
clarkbjeblair: I am a little confused around why accessIPv4's value changes in the ipv6 change17:36
crinklegreghaynes: which makes it hard to get new nodes up17:36
Clintbswartz: you can do it through git push or git review17:36
greghaynescrinkle: dhcp is there for bifrost (so we can pxe boot the hosts)17:36
jeblairclarkb, fungi: related to our discussion yesterday, can you take a look at https://review.openstack.org/230030 ?  mordred and i have been riffing on how to return the "best" ip address for ansible, (potentially nodepool, but probably not), etc, in the most ipv6 friendly way.17:36
anteayafungi: thanks will do17:37
jeblairclarkb: oh yay you already are :)17:37
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Add the ability to parse directories  https://review.openstack.org/22743817:37
greghaynescrinkle: When you say missing...17:37
clarkbjeblair: :)17:37
greghaynescrinkle: There are some missing parts. This is the issue we had with vlans and that - bifrost didnt support generating config drives that specified vlan info17:37
fungibswartz: have an example change where you don't see an edit button for the topic when you're logged in?17:37
*** ashleighfarnham has quit IRC17:37
greghaynescrinkle: https://review.openstack.org/#/c/216431/ is for that17:37
fungii thought it was supposed to be allowing it for everyone now17:37
fungijeblair: thanks, reviewing17:38
jeblairclarkb: because there used to be a "prefer ipv6" variable, but we're inverting that to "force ipv4", so the default behavior in that method changes.17:38
*** glauco has quit IRC17:38
jeblairclarkb: my understand is that none of this is actually in use yet, so that's okay.17:38
*** dramalho_ has joined #openstack-infra17:38
anteayafungi: thank you http://git.openstack.org/cgit/openstack-infra/system-config/commit/doc/source/gerrit.rst?id=afcfe2b904a3b57190b7a8c050aa34071b85ada817:38
*** glauco__ has joined #openstack-infra17:38
*** glauco__ has quit IRC17:39
*** dramalho_ has quit IRC17:39
jeblairclarkb: so i attempted to ensure both paths are still tested.  but i guess the spirit of the change is that you should get ipv6 by default, so since that test looked like the most "defaulty" test, i changed its expected results.17:39
clarkbjeblair: mordred I think you can just getaddrinfo for checking if ipv6 is available17:39
*** Sukhdev has quit IRC17:39
anteayaClint: we tend to favour folks use git review, some people have gotten themselves into issues not using it17:39
fungianteaya: we try to use that documentation as a proxy for change control over the global config, since it's not directly under change review itself17:39
clarkbjeblair: mordred the INET6 data you get back has scope info and if global I think you ar egood17:39
anteayafungi: ah okay thank you17:39
clarkbthat way you don't need to rely on another dep or check with routing tables17:39
crinklegreghaynes: so that patch would help set the vlan, what about setting the private ip on eth2?17:39
anteayafungi: yes you change it via the gui17:39
Clintanteaya: i've been getting myself into issues using it too17:40
anteayaClint: git push?17:40
greghaynescrinkle: the glean + configdrive networking does work though - I have deployed images on the 10.x net (untagged) using bifrost there...17:40
*** dramalho_ has joined #openstack-infra17:40
*** glauco__ has joined #openstack-infra17:40
*** dramalho_ has quit IRC17:40
mordredclarkb: getaddrinfo on what?17:40
greghaynescrinkle: yea, we should do both, bifrist 'just works' for setting the untagged networking17:40
greghaynescrinkle: it doesnt really have a notion of two networks though, so that is an issue17:40
bswartzfungi: https://review.openstack.org/#/c/228159/17:40
*** jsavak has quit IRC17:40
greghaynescrinkle: I think we can get by with just the public networking on deployed nodes at first, but IMBW17:41
bswartzfungi: you'll not that the topic has an incorrect bug number17:41
bswartznote17:41
*** glauco has joined #openstack-infra17:41
*** glauco has quit IRC17:41
*** dramalho_ has joined #openstack-infra17:41
anteayabswartz: that patch has merged17:41
fungibswartz: oh! well you can't edit the topic on closed changes, only open ones17:41
mordredclarkb: also, the above patch takes about 0.00006 seconds to run and just looks at the state of the interfaces, so should be pretty minimally invasive17:41
Clintanteaya: no, git review17:41
SpamapSHey so if I started dumping _a lot_ more numbers into graphite.. would that stress it out? I'm thinking about some of the counters from dstat in devstack going in.17:41
*** signed8bit_ZZZzz is now known as signed8bit17:41
anteayaClint: oh, what problems are you having with git review?17:41
bswartzanteaya: thanks!17:41
*** dramalho_ has quit IRC17:41
fungibswartz: if the change is merged or abandoned you can't change a number of things, including the topic17:41
*** kushal has quit IRC17:41
greghaynesSpamapS: Do you mean a lot of values for certain stats or a lot more stats17:42
crinklegreghaynes: that's not what bifrost is currently doing17:42
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test ZMQ event handler  https://review.openstack.org/23002317:42
mordredSpamapS: I would argue that if it stresses it out, it would be worthwhile to investigate scaling it out17:42
clarkbmordred: getaddrinfo on None gives you yourself right?17:42
*** glauco___ has joined #openstack-infra17:42
SpamapSmordred: Yes indeed.17:42
jeblairmordred: well, i think it uses the linux netlink api to get the routing table17:42
*** glauco___ has quit IRC17:42
SpamapSgreghaynes: both. :)17:42
mordredSpamapS: however, I do not believe our build slaves have network access to our graphite17:42
greghaynesSpamapS: Basically graphite sucks at scaling out lots of different stats but does well at lots of input for each stat17:42
*** dramalho has quit IRC17:42
*** glauco has joined #openstack-infra17:42
*** dramalho has joined #openstack-infra17:42
Clintanteaya: it does things i don't expect when multiple semi-related patches are involved17:42
*** dramalho has quit IRC17:42
anteayaClint: using git review is our supported tool for interacting with gerrit so I would like to help you smooth out the issues you are having with it17:42
SpamapSbasically, there are probably 20 counters that will prove useful in chasing performance in OpenStack, and I'd like to at the very least throw the end-counter into graphite from every run of at least one devstack job.17:43
Clintthere's also it changing topics when i forget to use -t, but that's just pebkac17:43
clarkbhrm I misread the docs None is useless /me reads more17:43
anteayaClint: okay can you describe or link to an example?17:43
openstackgerritMerged openstack-infra/puppet-graphite: Add acceptance tests for puppet-graphite.  https://review.openstack.org/22425217:43
mordredclarkb: that did not work17:43
greghaynesSpamapS: 20 seems like a small number to me17:43
pelixzaro: the intent is just to only show those log messages that were generated during the failing test alongside the test failure17:43
*** dramalho has joined #openstack-infra17:43
*** dramalho has quit IRC17:43
SpamapSgreghaynes: Yeah I agree, but it might take doing 100 before we find the 20 that we need.17:43
*** glauco has quit IRC17:43
*** glauco has joined #openstack-infra17:44
clarkbmordred: ya only one or the other can be None17:44
*** glauco has quit IRC17:44
greghaynesSpamapS: yea, Id hope we can handle that... People get into issues when they dynamically generate stats... but I'd hope we can manage that many17:44
crinklegreghaynes: there's lots of local changes in /opt/stack/bifrost but none of them are related to 216431, you think applying that patch will make it "just work"?17:44
clarkbmordred: but not both args17:44
*** glauco__ has quit IRC17:44
jeblairgreghaynes, SpamapS: yeah, we have 10,000s of keys, 100 more won't hurt17:45
*** dramalho has joined #openstack-infra17:45
*** dramalho has quit IRC17:45
*** jsavak has joined #openstack-infra17:45
zaropelix: i though i compared it to how it works on master and didn't see much of a difference.  am i seeing it wrong?17:45
Clintanteaya: mmm.. something like patch C depends on patch A, patch C depends on patch B, patch A and B are independent of each other, when doing git-review on patch C, it will rebase and push patch B on top of patch A or the other way around17:45
jeblairgreghaynes, SpamapS: but yeah, each key becomes a large file on disk in perpetuity, so 100 keys per devstack run is awkward; but 100 keys where each devstack run contributes to the same 100 keys is not.17:45
*** dramalho has joined #openstack-infra17:46
mordredjeblair: how do we open network access to graphite to our devstack hosts?17:46
greghaynescrinkle: not likely. Those local changes were me hacking up the vlan and such patches IIRC (theres really not a great way to dev stuff like that). Might be a good idea to wipe out those changes and start applying whats up there to see what works17:46
anteayaClint: have you a link to an example that you describe?17:46
clarkbmordred: socket.getaddrinfo(socket.gethostname(), None, socket.AF_INET6)17:46
greghaynescrinkle: That is what I was doing with making the new deploy host, basically17:46
fungiClint: that sounds odd. git commits can't have multiple parents unless they're merge commits17:46
clarkbmordred: but that relies on /etc/hosts being setup properly17:46
clarkbrather than routes17:46
*** dramalho_ has joined #openstack-infra17:46
fungiClint: multiple discrete parents i mean17:46
jeblairmordred: i don't know :)  that's still a problem (i was focusing on one at a time)17:47
crinklegreghaynes: okay17:47
clarkbwhich is probably less reliable17:47
*** dramalho has quit IRC17:47
crinklegreghaynes: what about glean? are there patches in flight that i need from that?17:47
SpamapSjeblair: Right, it would be the latter.17:47
clarkbwait why would we want devstack hosts to talk to graphite?17:47
*** dramalho_ has quit IRC17:47
pelixzaro: checkout http://logs.openstack.org/42/223942/3/check/gate-jenkins-job-builder-python27/3d1e064/console.html compared to http://logs.openstack.org/07/226107/3/check/gate-jenkins-job-builder-python27/c4bcd99/console.html17:47
*** glauco__ has joined #openstack-infra17:47
greghaynescrinkle: https://review.openstack.org/#/c/209784/ will be needed17:47
jeblairclarkb: SpamapS is exploring the idea of recording devstack metrics in graphite.  so at the end of each run, report 20-100 counters for that run.17:47
*** nadya has quit IRC17:47
clarkbI think any stats/logs/etc that you want from a job to go into $service goes through a system like subunit2sql and elasticserach17:47
anteayaClint: I'm trying to picture a situation where one patch depends on two other patches but the two parent patches have no relationship17:48
greghaynescrinkle: also, both probably need work17:48
openstackgerritMerged openstack-infra/project-config: Allow ironic-python-agent to have stable/managed releases  https://review.openstack.org/22999317:48
clarkbjeblair: right but you don't want them to talk directly, you use the existing pull method17:48
pelixfirst one has the log output generated from all the tests appearing in the console. Means that when a test fails, any useful log output will be interspersed with logs from working tests.17:48
fungiClint: anyway, git-review should dtrt with a linear series of dependent commits17:48
*** dizquierdo has quit IRC17:48
*** glauco__ has quit IRC17:48
jeblairclarkb: yeah, i'm not arguing that.  :)17:48
*** geoffarnold has quit IRC17:48
SpamapSmtreinish: hey, say that bit about gearman/zmq over here, and tag clarkb ;)17:48
crinklegreghaynes: fun17:48
*** dramalho_ has joined #openstack-infra17:48
*** dramalho_ has quit IRC17:48
mordredclarkb: we had not gotten to talking about the how of that part yet :)17:48
Clintanteaya: https://review.openstack.org/#/c/228656/ , i had to use Depends-On instead17:48
*** glauco has joined #openstack-infra17:48
*** glauco has quit IRC17:48
Clintfungi: the problem was that they weren't linear17:48
clarkbmordred: the more I htink about it the more I think the existing code is probably mots correct17:49
jeblairclarkb: but you have an idea! :)17:49
mtreinishSpamapS: clarkb is omnipresent (or just on qa too) he already saw it :)17:49
*** dramalho_ has joined #openstack-infra17:49
SpamapSclarkb: oh is there already something that could read a line out of the logs and turn that into statsd input?17:49
*** glauco has joined #openstack-infra17:49
fungiClint: that sounds like a git limitation, not a git-review limitation. how did you represent the nonlinear dependency in git?17:49
jeblairclarkb: thinking maybe something like the elasticsearch/subunit2sql parser that post-processes jobs and inserts data into graphite?17:50
*** glauco has quit IRC17:50
Clintfungi: as a linear series of patches17:50
mtreinishSpamapS: look at: http://git.openstack.org/cgit/openstack-infra/puppet-log_processor/tree/files/log-gearman-client.py17:50
jeblairclarkb: maybe a 3rd thing, or maybe add it to one of the existing ones?17:50
clarkbSpamapS: there is already a thing that watches for job complete events and submits gearman jobs based on that17:50
mtreinishSpamapS: and an example worker: http://git.openstack.org/cgit/openstack-infra/puppet-subunit2sql/tree/files/subunit-gearman-worker.py17:50
*** dramalh__ has joined #openstack-infra17:50
clarkbjeblair: ya something like that17:50
pelixzaro: you might notice that some deprecation warnings from libraries JJB uses were hidden in the log output previously as well17:50
fungiClint: so if the series of patches was linear, git-review should have dealt with it fine17:50
pelixsee http://logs.openstack.org/07/226107/3/check/gate-jenkins-job-builder-python27/c4bcd99/console.html#_2015-09-30_15_32_35_83917:50
clarkbas an alternative I think you can have logstash do graphite output too17:50
*** jsavak has quit IRC17:51
Clintfungi: it did so by resubmitting the first two in a dependency chain17:51
*** dramalh__ has quit IRC17:51
clarkbso you would add a second output based on things that it piped through but that ties us more tightly to logstash which is :/17:51
*** glauco has joined #openstack-infra17:51
*** glauco has quit IRC17:51
clarkbhowever if you do it that way then other deployments of openstack can use it easily17:51
*** dramalh__ has joined #openstack-infra17:51
*** dramalh__ has quit IRC17:51
*** jsavak has joined #openstack-infra17:51
*** pelix has quit IRC17:51
fungiClint: i'm losing chronology on this i guess. i thought you said you had already linearized them17:51
*** dramalh__ has joined #openstack-infra17:52
*** jordanP has quit IRC17:52
SpamapSSo if there's already infra in place for this, and we're just adding counters.. do I need an infra spec? or just submit a change which adds the counters to statsd's configuration?17:52
*** dramalh__ has quit IRC17:52
SpamapSI'm working on a QA spec to add more counters and this output.17:52
fungiClint: were you trying to establish dependence between changes in different local branches? (if so, that's a merge)17:52
*** dramalho has joined #openstack-infra17:52
clarkbSpamapS: I think you just add a change to emit the counters, the system is pretty well established I don't think it needs a spec17:52
SpamapSclarkb: ^5 thanks17:52
greghaynesNot sure if it matters, but the stats will be recorded as happening when they are emitted if youre going through statsd I think17:53
jeblairSpamapS: basically the new infra component is something that processes gearman jobs from the log-processor, reads the counters from devstack logs, and emits to statsd.17:53
*** glauco_ has joined #openstack-infra17:53
*** glauco_ has quit IRC17:53
*** dramalho_ has quit IRC17:53
jeblairgreghaynes, SpamapS: good point, maybe skip statsd and emit directly to graphite?17:53
*** dprince has quit IRC17:54
jeblairgreghaynes, SpamapS: though honestly, not sure it matters that much?17:54
greghaynesyea, if youre going for long term trends then it doesnt matter too much17:54
Clintfungi: only so that the child patch would work.  the other two could have gone in independently.17:54
jeblairgreghaynes, SpamapS: i mean, we're basically trying to trend over time, right?  whether $time is now or 10 minutes ago, probably not a big deal?17:54
*** glauco_ has joined #openstack-infra17:55
*** glauco_ has quit IRC17:55
*** tonytan4ever has joined #openstack-infra17:56
*** dramalho has quit IRC17:56
*** glauco has joined #openstack-infra17:56
*** glauco has quit IRC17:56
fungiClint: ahh, yes so that's still a git limitation and not a git-review one17:56
*** dramalho has joined #openstack-infra17:56
*** dramalho has quit IRC17:56
fungiClint: or rather, our insistence on not reviewing gratuitous merge commits17:57
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test ZMQ event handler  https://review.openstack.org/23002317:57
*** glauco_ has joined #openstack-infra17:57
*** dramalho has joined #openstack-infra17:57
*** glauco_ has quit IRC17:57
*** dramalho has quit IRC17:57
*** Zhongjun has quit IRC17:57
fungiClint: regardless, git-review shouldn't do anything out of the ordinary in that case. either you create a linear patch series or you don't17:57
*** hdd has quit IRC17:57
Clintfungi: i maintain that it everything would have worked out fine if it hadn't resubmitted the earlier patches17:58
Clints/it //17:58
*** dramalho has joined #openstack-infra17:58
*** dramalho has quit IRC17:58
fungiClint: that sounds like a rebase cleanliness issue. when rebasing only alter the commits which need altering (either to change their content or because a parent changed)17:58
*** glauco has joined #openstack-infra17:58
*** ociuhandu has joined #openstack-infra17:58
*** glauco has quit IRC17:58
*** SumitNaiksatam has joined #openstack-infra17:59
fungigit-review will mention pushing all of them again, but will only actually upload the ones whose commit ids changed17:59
Clintfungi: the commit ids changed because it rebased one patch onto the other17:59
fungiyep, that changes the commit id17:59
fungithe parent commit id is part of the data which goes into calculating the git commit id17:59
Clintyup18:00
fungii'm still not understanding what's wrong18:00
*** ajmiller has quit IRC18:00
fungiif the parent changes you need to push that as a new patchset, because new commit id18:00
Clintthe parent didn't need to change18:00
*** ajmiller has joined #openstack-infra18:01
fungiif the parent didn't change then it wouldn't have been uploaded18:01
Clintthe final patch could have been rebased onto master in whatever order the other patches landed in master18:01
openstackgerritMerged openstack-infra/project-config: Add new project pymod2pkg to Packaging-RPM team  https://review.openstack.org/22789118:02
Clintthe ordering was forced by a reverse dependency unnecessarily18:02
fungioh, so ultimately the issue here is that we disallow pushing merge commits18:03
*** doug-fish is now known as duct-tape-wannab18:03
fungibecause there's no actual way to represent n-way nonlinear dependencies in git without merge commits18:03
*** duct-tape-wannab is now known as ducttape-wannabe18:03
fungihowever, not using git-review doesn't get around that limitation18:04
Clintfungi: i gotta hop on a plane, we can argue about this later or possibly never18:04
fungiheh, okay18:04
*** mrmartin has quit IRC18:05
*** Piet has joined #openstack-infra18:05
*** rossella_s has quit IRC18:06
openstackgerritMerged openstack-infra/shade: Dont throw exception on missing service  https://review.openstack.org/22966418:06
fungii still suspect there's some fundamentally incorrect assumption there about what git-review is or isn't doing. what you're describing isn't going to be able to get uploaded to gerrit regardless of whether you use git-review18:06
*** rossella_s has joined #openstack-infra18:06
*** ivar-lazzaro has joined #openstack-infra18:07
*** shardy is now known as shardy_afk18:08
*** nelsnelson has joined #openstack-infra18:08
openstackgerritMerged openstack-infra/project-config: Enable ceilometer devstack plugin for tempest jobs  https://review.openstack.org/22994018:08
*** BharatK has quit IRC18:09
*** ivar-lazzaro has quit IRC18:09
jeblairfungi, yolanda: what's the status of nodepool re secure.conf / restart, etc?18:09
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test ZMQ event handler  https://review.openstack.org/23002318:09
clarkbjeblair: the patch merge conflicted because it requires every test be changed18:09
*** dprince has joined #openstack-infra18:09
jeblairneato18:10
clarkbjeblair: I have suggested that instead of chasing rebases the tests be fixed to hide that in the base class18:10
clarkbits all boiler plate anyways that doesn't change between tests18:10
jeblairclarkb: ++18:10
*** tsekiyama has joined #openstack-infra18:10
*** ivar-lazzaro has joined #openstack-infra18:10
openstackgerritMonty Taylor proposed openstack-infra/shade: Provide shortcut around has_service  https://review.openstack.org/23003218:10
openstackgerritMonty Taylor proposed openstack-infra/shade: Fix mis-named has_service entry  https://review.openstack.org/23006018:10
*** amotoki has quit IRC18:10
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Refactor grafana.py test coverage  https://review.openstack.org/23006118:11
openstackgerritMerged openstack-infra/puppet-cgit: Fix git-daemon refresh logic  https://review.openstack.org/22803818:11
*** Sukhdev has joined #openstack-infra18:12
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Clean up tox.ini  https://review.openstack.org/22486618:12
*** asselin__ has joined #openstack-infra18:13
*** kushal has joined #openstack-infra18:13
jeblairmordred: the nodepool shade change now depends on a shade change that also relates to an occ change and later potential shade improvement.  do we just need to land the one shade change (229140), or do we need to worry about any others?18:13
*** odgrim has joined #openstack-infra18:14
mordredjeblair: I think we need to land several changes - let me pull together a list for you18:14
jeblairmordred: ok.  my goal is to restart nodepool with the shade change today.  as you put together that list, do you think that's achievable?  :)18:15
mordredjeblair: I do - we need to get occ landed/cut18:16
jeblairhttps://etherpad.openstack.org/p/nodepool-shade18:16
*** asselin_ has quit IRC18:17
*** moravec has quit IRC18:18
*** pvaneck has joined #openstack-infra18:18
clarkbso apparently pep8 doens't warn you about undefined names18:18
clarkbor flake8 rather18:18
clarkb(I have been testing pep8 locally but not unittests bceause don't have a mysql and keep getting bitten on that. This'll learn me)18:19
jeblairclarkb: pep8 is disabled on nodepool because of the 'select' line in tox.ini.18:19
clarkbjeblair: its completely disabled?18:19
* clarkb looks18:20
jeblairclarkb: the only thing we are testing with pep8 is H23118:20
clarkbthat would explain it18:20
jeblairi's been like that for a year, and there are like 4 violations or something :)18:20
jeblairstill, i would like the flake8 output and support fixing it; just hasn't bubbled up.18:21
clarkbkk18:21
*** HeOS has joined #openstack-infra18:21
*** nelsnelson has quit IRC18:21
jeblairmordred: do we need 230030?18:22
clarkbjeblair: I don't think its required for ovh18:22
*** moravec has joined #openstack-infra18:22
openstackgerritYAMAMOTO Takashi proposed openstack-infra/project-config: tap-as-a-service: Add python3 job  https://review.openstack.org/23006318:22
mordredjeblair: no, we do not18:23
mordredjeblair: it's a nice-to-have18:23
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet: split integration job in 2  https://review.openstack.org/23006418:23
jeblairmordred: ya, maybe we can get it in the same shade release?  if not, maybe not hold up the process on it?18:24
mordredyah. that was what I was thinking18:24
openstackgerritChristian Berendt proposed openstack/os-testr: Fix syntax of the README file  https://review.openstack.org/23006518:25
*** nelsnelson has joined #openstack-infra18:25
*** jsavak has quit IRC18:26
docaedofungi: regarding the cert for app catalog, you wrote "in hiera now as apps_ssl_cert_file_contents, apps_ssl_chain_file_contents and apps_ssl_key_file_contents"18:26
*** jsavak has joined #openstack-infra18:26
docaedofungi: but I'm not sure how I'm supposed to reference that, is there a site you can tell me to look at that would be a good example?18:26
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test ZMQ event handler  https://review.openstack.org/23002318:26
*** maishsk has joined #openstack-infra18:26
mordredShrews: if you get a sec, could you help us out with reviews on the stuff in here: https://etherpad.openstack.org/p/nodepool-shade ?18:26
docaedo(i.e. one of the other sites in infra repo)18:27
fungidocaedo: those are the hiera keys you would reference in openstack-infra/system-config:manifests/site.pp18:27
fungidocaedo: within the node definition for the apps.openstack.org server18:27
*** marzif has joined #openstack-infra18:27
Shrewsmordred: i've been trying to figure out which ones are urgent. looks like all of them18:27
fungibasically pass those as class variables to what's being instantiated there so that they can be consumed by the puppet module doing the apps-site setup18:27
mordredShrews: ALL THINGS ARE URGENT AND HIGHEST PRIORITY PLZ FIX NOW KTHX18:28
*** tsekiyama has quit IRC18:28
clarkbBLOCKER!18:28
Shrewsmordred: oh, time for a coffee break then. be back next week18:28
docaedofungi: I think I follow18:28
fungidocaedo: you should see numerous examples in that file18:29
*** sridhar_ram has quit IRC18:30
docaedofungi: thanks yeah looking now and seeing things that make some little bit of sense18:30
openstackgerritDolph Mathews proposed openstack/requirements: Add freezegun to global requirements  https://review.openstack.org/22860318:31
*** openstackgerrit has quit IRC18:31
*** openstackgerrit has joined #openstack-infra18:31
*** angdraug has quit IRC18:32
SpamapSjeblair: correct, the time that the count happens is not as important as the general series.18:32
SpamapSIn fact, I'm wondering if we only want to emit this particular stat _on success_18:32
SpamapSset of stats rather18:32
SpamapSas in, this is where the latest patch set to land put us.18:32
jeblairSpamapS: probably so18:33
SpamapSyes actually, it can only be on success18:33
*** tjones has quit IRC18:33
SpamapSotherwise there'll be tons of gate churn garbage18:33
SpamapSthe idea is to get a series of data with trends, and then be able to go ahead and notice relatively stable counters, and put hard upper and lower bounds on them.18:34
clarkbyou will also have to account for $cloud18:34
jeblairSpamapS: makes sense18:34
clarkband $driverofvariousthings18:34
jeblairclarkb: hopefully by account for $cloud, we can just set appropriate bounds18:34
SpamapSclarkb: thats an interesting aspect of these, and one I have been thinking about.18:34
jeblairclarkb: i do not think we should have "expect this metric to take this long on cloud X"18:35
SpamapSI think for some counters, cloud should not matter.18:35
SpamapSlike, the number of InnoDB rows read, should be stable.18:35
clarkbjeblair: except from data we know that it matters18:35
*** jsavak has quit IRC18:35
clarkbjeblair: theneutron full job averages ~50 minutes on one cloud nad ~72 on another according to sdagues numbers yesterday18:35
*** yamamoto has quit IRC18:35
*** yamamoto has joined #openstack-infra18:36
greghaynesMaybe break them up into "Cloud A, Cloud B" rather than cloud name18:36
*** jsavak has joined #openstack-infra18:36
SpamapSalso as much as possible the point of this exercise is to identify performance cost metrics that do _not_ depend on the _speed_ of the underlying infrastructure.18:36
clarkbI don't think you want your counters to be collapsing that as such a large separation will make the data useless18:36
clarkbor at least less useful in aggregate because one cloud can drown out the other18:36
SpamapSgreghaynes: yeah there may be counters that are entirely stable based on whatever is under the hood, and those would probably good to leverage.18:36
jeblairclarkb: i think SpamapS's approach is a good one.  i'm heavily resistent to encoding per-cloud performance data though.18:37
greghaynesSpamapS: Yea, I think thats what clarkb is saying18:37
SpamapSFirst pass, I'd discard any that were unstable across clouds.18:37
greghaynesbut yes, politics18:37
clarkbsure I don't want to make it a contest18:37
SpamapSdiscard from the upper/lower bounds I should say18:37
jeblairoh i'm not concerned about politics...18:37
clarkbbut if you are measuring time to boot VM that will have drastically different numbers18:37
jeblairi just want there to be no bar to adding new clouds.18:37
clarkband you won't really see variation in one or the other because the large set from the other cloud will drown it out18:37
jeblairclarkb: do we know why it varies so far in the neutron tests (but presumably not in others)?18:38
SpamapStime based metrics won't work for this approach18:38
SpamapSbecause ideally, one can iterate on driving these counters down on their laptop.18:38
openstackgerritBruno Tavares proposed openstack-infra/puppet-diskimage_builder: Fix apt issue.  https://review.openstack.org/22050518:38
clarkbjeblair: the current theory is that neutrons ipv6 tests which boot 2 nodes each are more cpu intensive (via qemu) and some clouds do poorly at that18:38
jeblairSpamapS: right 'counters' vs 'timers' in statsd/graphite speak18:38
SpamapSso if you have a patch set whose purpose is to reduce database rows read by making better use of indexes, for instance..18:38
*** nadya has joined #openstack-infra18:39
SpamapSthat should measure mostly the same on all clouds and your laptop18:39
greghaynesSeems like a neat idea18:39
Shrewsmordred: jeblair: https://review.openstack.org/229941 is a pretty major API breaking change18:39
clarkboh if you are just looking at that I am not sure why you need the gate data? its should be stable right?18:39
clarkbeg anyone can generate that number and its fixed18:39
SpamapSthe lower level stuff will likely have too much collateral damage from performance hiccups to be useful, but I'm hopeful maybe basic I/O numbers will be somewhat stable too, like blocks read/written.18:39
*** tonytan4ever has quit IRC18:40
SpamapSclarkb: I need the gate to prove the stability of the number.18:40
fungiyeah, we've seen wide performance swings within a single provider just depending on shared load distribution/spikes across tenants18:41
clarkbSpamapS: thats one way to do it yes18:41
*** sergmelikyan has quit IRC18:41
SpamapSclarkb: we could also ask everybody to run devstack with this turned on and confirm.. I just feel like the robots do that better than the humans.18:41
clarkbbut it seems like the most difficult to deal with way18:41
clarkbSpamapS: no no using robots is fine18:41
fungiso counting operations seems reasonable. timing operations much less so18:41
mtreinishSpamapS: you should take a look at some of the graphs from subunit2sql tings are super variable18:41
jeblairShrews: my understanding from mordred was that nothing used that yet, but maybe he can expand.18:42
SpamapSMaybe there are other robots that are simpler to setup?18:42
clarkbbut if you have to filter for success vs failure and potentially clouds and specific pipelines you are just spending effort18:42
clarkbinstead use the periodic jobs or similar18:42
SpamapSmtreinish: can you give me a starting point for that. I'm embarrassed to say I've never looked.18:42
mtreinishSpamapS: yes, I can. One sec18:42
Shrewsmordred: jeblair: uh, nevermind... i didn't look far enough ahead18:42
clarkbSpamapS: yes we run tests once a day for all the things they are a much better source of this type of data18:42
mtreinishSpamapS: http://blog.kortar.org/?p=21218:42
*** dzamboni has quit IRC18:42
mtreinishI wrote a blog post on how to get started :)18:43
mtreinishclarkb: is it all the things, the jobs in periodic is a weird set of things18:44
*** yamamoto has quit IRC18:44
greghaynesSpamapS: I have an argument for recording timing data id like to make when it wouldnt be derailing technical discussion18:44
clarkbmtreinish: it should be all the things + super set of things that want to be periodic only18:44
*** amuller_afk is now known as amuller18:45
*** tsekiyama has joined #openstack-infra18:45
*** marzif has quit IRC18:45
mtreinishah, ok. where do the results get put pushed for the other stuff. I've only ever seen the things which are explicitly in the periodic pipeline18:45
* mtreinish probably should get back to the dashboard to solve that problem18:45
clarkbmtreinish: its the same thing18:46
SpamapSclarkb: ok, so the daily periodics would work, but would take a lot longer to produce enough data.18:46
*** yamamoto has joined #openstack-infra18:46
clarkbSpamapS: yes but the data isn't known to be compromised18:46
*** tjones has joined #openstack-infra18:46
SpamapSclarkb: is there something significantly simpler about using that data that makes it worth waiting 30 or so days to get trends?18:46
clarkbSpamapS: yes its not compromised18:46
greghaynesYou can also make periodic jobs that run more often18:47
SpamapSIs it on physical dedicated hardware, or like, just that it's one cloud?18:47
clarkbSpamapS: you know for all of the jobs that run there that all of the code tested passed all of its tests at once18:47
clarkbSpamapS: no no just compared to the gate. A test may pass in the gate but be completely broken and some other tests for the change would fail detecting that18:47
clarkbSpamapS: but you would load up that data anyways even though its known bad18:47
openstackgerritMichael Johnson proposed openstack/requirements: Exclude coverage 4.0  https://review.openstack.org/22858118:48
SpamapSclarkb: good poitn18:48
SpamapSpoint18:48
*** julim has quit IRC18:48
SpamapSunless we can somehow delay recording until after commit?18:48
SpamapSafter merge I guess I should say18:48
SpamapSbut that sounds like "moar work"18:48
clarkbya you could set it up as a set of zuul post jobs that proxy the work into graphite or something18:49
openstackgerritJames E. Blair proposed openstack-infra/shade: Return IPv6 address for interface_ip on request  https://review.openstack.org/23003018:49
clarkbthere are other ways of tackling that18:49
SpamapSAnd to greghaynes's point, we can just make a job that runs every 4 hours for a week and get a month's worth of data, then back it off.18:49
SpamapSI mean18:49
openstackgerritJeremy Stanley proposed openstack-infra/shade: Stop checking for E129  https://review.openstack.org/23007418:50
fungijeblair: your 230030 seems to have angered the worshippers of E129. we may want to evict them via tox.ini? ^18:50
*** tonytan4ever has joined #openstack-infra18:50
SpamapSI could also just go backwards18:50
jeblairfungi: i have banished them, thanks!18:50
fungioh! excellent18:50
openstackgerritBruno Tavares proposed openstack-infra/puppet-diskimage_builder: Fix apt issue.  https://review.openstack.org/22050518:50
SpamapSset up a test that spins up a node and runs the tests with HEAD^0, then HEAD^1 ..18:50
mtreinishSpamapS: that was always on the table to make periodic stuff happen more frequently18:51
SpamapSthough I can't go backwards easily with pip18:51
SpamapSand also HEAD^0 of what.. ;)18:51
mtreinishthe pre-req for that was getting the results dashboard up18:51
SpamapSmore like I could just have git checkout based on time18:51
SpamapSActually18:52
greghaynesSpamapS: dependencies make that even more wierd18:52
SpamapSI'm being silly18:52
*** sergmelikyan has joined #openstack-infra18:52
SpamapScan just run with HEAD _now_18:52
SpamapS100 times18:52
*** sergmelikyan has quit IRC18:52
jeblairclarkb, SpamapS: there are lots of interesting suggestions here... but is there anything wrong in _practice_ with just using gate+SUCCESS ?18:52
SpamapSand get _actual_ stability numbers18:52
jeblairwe use that all the time for similar things...18:52
jeblair(e-r graphs, for instance)18:53
SpamapSjeblair: clarkb brought up a good point which is that if we wanted to just re-use the current mechanism we'd be graphing the number for gate fails too.18:53
*** AJaeger has joined #openstack-infra18:53
jeblairyes, it might record a value for a change that didn't merge, but in aggregate, it's pretty right)18:53
*** ashleighfarnham has joined #openstack-infra18:53
SpamapSthe specific job may be successful18:53
mtreinishjeblair: I agree, that should be fine18:53
*** ZZelle_ has quit IRC18:53
*** angdraug has joined #openstack-infra18:53
*** signed8bit is now known as signed8bit_ZZZzz18:53
docaedofungi: should I update the puppet-apps_site commit to include "depends on" for the system-config commit I'm about to make? Not sure how I should reference between the two18:53
jeblairSpamapS: jobs that filed to merge for some reason after having been approved and after having passed all of the gate tests previously18:53
SpamapSright...18:54
jeblairSpamapS: in practice, i don't think it's "bad" data for the purpose under discussion18:54
*** glauco_ has joined #openstack-infra18:54
anteayadocaedo: do you need one patch to make tests pass on the other?18:54
fungidocaedo: other way around. the system-config change to pass those variables needs to depends-on the puppet-apps_site change which consumes them so that testing is validated18:54
SpamapSThere's also the psychological benefit of having it this way18:54
mtreinishjeblair, SpamapS: I treat the subunit2sql data that way18:54
SpamapSwhich is that you can point to a graph and say "This is where the trend upward started"18:54
jeblairSpamapS: if you were to try to use it to track down the exact time something changed, it would be insufficient, but it's already insufficient for that and not designed for that :)18:54
jeblairSpamapS: yeah, you will be able to say "this is _about_ where the trend upward started" :)18:55
docaedofungi: thanks18:55
mtreinishjeblair: which is normally good enough :)18:55
SpamapSthe one time it's ok to wave your hands... at a general area of a graph18:55
jeblairSpamapS: with gate data, that's probably a 1 hour window.  expanding that to a 4h window with periodic jobs doesn't improve that :)18:55
*** nadya has quit IRC18:56
openstackgerritChristopher Aedo proposed openstack-infra/system-config: Add SSL support to App Catlog site  https://review.openstack.org/23007818:56
jeblairSpamapS: post jobs would improve it, for sure (except they are lower priority and often run much later than gate jobs, so you'd have to correlate a couple of sources of data)18:56
greghaynesalso fails should be noise-like so it will filter out fine18:56
*** glauco__ has joined #openstack-infra18:56
greghaynesI would be very surprised if fails always were slower or faster18:57
clarkbjeblair: thats a good pont about post18:57
fungigreghaynes: that assumes a high-enough signal-to-noise ratio for you to be able to find the signal18:57
jeblairSpamapS: anyway, point being, it's fine if we want to do something else for some reason, but i would not eliminate gate based just on the false-success problem; it's an existing pattern that works for similar situations18:57
greghaynesfungi: just need a low pass filter ;)18:57
*** notnownikki has joined #openstack-infra18:57
greghaynes:p18:57
SpamapSjeblair: no, I think I got side-tracked by the word "compromised" .. ;)18:57
clarkbjeblair: well everywhere else we do it we want to look at fail data18:58
fungigreghaynes: we get plenty of failure modes where performance is degraded and the job runs longer, even possibly reaching the configured timeout18:58
SpamapSbut... it's an acceptable compromise.18:58
clarkbjeblair: this is the first time someone has said we only want successful data that I know of18:58
jeblairSpamapS: you need to leave _something_ for other researchers to pick apart in your paper, yeah?18:58
SpamapSwe could still do fail data18:58
SpamapSIt might come in handy.18:58
*** glauco_ has quit IRC18:58
greghaynesfungi: yea, so it might skew up. Still it shouldnt have a trend I hope18:58
mtreinishgreghaynes: yeah, it's very hard to find a trend like that in the data18:58
SpamapSthe graph isn't harder to make if we say success only, right?18:58
mtreinishbut it doesn't mean that there isn't one, like fungi said it's really noisy18:58
*** signed8bit_ZZZzz is now known as signed8bit18:59
SpamapSjeblair: Yeah the game is no fun if there aren't holes. ;)18:59
jeblairclarkb: i think mtreinish pointed out subunit2sql is fairly similar here?18:59
clarkbjeblair: I think subunit2sql looks at fails18:59
mtreinishclarkb: it looks at everything18:59
* SpamapS is reading mtreinish's blog post now18:59
clarkbright so thats different18:59
mtreinishclarkb: but for performance graphing I filter on success18:59
mtreinishfor failure rate stuff obviously not18:59
docaedofungi: I think 230078 is right, just let me know, gracias19:00
fungigreghaynes: in fact, quick fails are mostly the domain of setup-related problems. if setup is successful, most jobs still continue to run all their tests19:00
*** moravec has quit IRC19:00
fungieven if most of them are failing19:00
clarkbhrm I may have taken the wrong approach with the event handler tests /me tries again19:00
*** jsavak has quit IRC19:01
*** jsavak has joined #openstack-infra19:01
fungigreghaynes: and for many (if not most) tests, the failure is not detected until some assert at the end, so runtime is probably similar in many cases19:01
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: do not update constraints list on each new release  https://review.openstack.org/23008019:01
greghaynesfungi: Yea. I think it would only be an issue if failures had a trend of their own... but we kinda just need to play with the data I think19:02
jeblairin summary, gate gets you the most amount of data, closest to HEAD in real-time, with the caveat that sometimes the data reported will be based on a change that didn't actually land.  post gets you a guarantee that the change is in head, but sometimes it will fail, so you will miss some changes.  periodic is what it is.  :)19:02
fungiwe have proof that periodic jobs can fail too ;_19:02
jeblairin fact, some of them never succeed! ;)19:02
clarkbfungi: yes but that would could arguably be considered valid data19:02
anteayaha ha ha19:02
fungidisappointingly many in fact19:02
fungiclarkb: true enough19:03
SpamapSIt seems to me that having the counters for failures won't compromise the goal of identifying and gating on stable counters for success, but it might add useful data to correlate and debug problems.19:03
*** hashar has joined #openstack-infra19:03
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add new graph type to show run_time variance by metadata  https://review.openstack.org/21056919:04
*** gordc has quit IRC19:04
fungiif you keep separate buckets for fail data and pass data that might make it easier to determine whether the data from failures is comparable/useful19:04
*** tjones has quit IRC19:04
*** stevemar has joined #openstack-infra19:04
fungirather than comingling and assuming the failures don't compromise your data integrity19:05
jeblairSpamapS: keep in mind we're talking 2 kinds of failures here: failure of the job in question (easy to detect), and failure of the change to merge because of something external to the job in question (hard to detect)19:05
jeblairSpamapS: and yeah, the marginal cost to bucket "failure or success of the job in question" is low and easy to do.  i'd recommend that.19:05
jeblairSpamapS: though it's quite possible that we never get any good data from failures.  :)19:06
*** ducttape-wannabe is now known as doug-fish19:06
jeblairfiltering for "success of the job in question" only works too19:06
greghaynesSpamapS: ok, my piece on timing data - what youre trying to do by measuring row accesses/ reads/etc is build up a model of perfomance using some other measurements. That lets you drive down on the model, which is nice, but you also need to be able to answer the question of whether your model reflects reality and how well. You dont need precise data for that, just an even more general trend you can19:07
greghaynestry and correlate, but you definitely want to try and answer that question too.19:07
greghayneswow I got a two parter19:07
jeblairclarkb, fungi: would you mind reviewing https://review.openstack.org/226751 ?19:07
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test ZMQ event handler  https://review.openstack.org/23002319:08
jeblairoh19:08
jeblairmorded uploaded a new patchset there and didn't say why :/19:08
greghaynesSpamapS: so tl;dr I agree that driving down on timing is a bad idea because of variance in the data, but it is a requriement for ensuring that your model is at all sane19:08
mordredjeblair: wait - what did I do?19:08
*** jsavak has quit IRC19:08
clarkbalso not sure what recheck crd is supposed to do?19:08
jeblairmordred: you updated 226751 after it passed tests and i don't know why19:08
clarkbthe unittests consume shade from releases19:09
*** jsavak has joined #openstack-infra19:09
clarkboh that expains it19:09
jeblairclarkb: it's supposed to run the tests again19:09
clarkbjeblair: ya I see that the unitests were passing and only integration didnt19:09
clarkbbut latest fails all three19:09
*** ociuhandu has quit IRC19:09
jeblairclarkb: well, latest failed because of a merge failure so we have no results19:09
jeblairclarkb: thus the recheck19:09
mordredjeblair: the dvsm error it had was a real error I was concerned about - so I added more debugging lines to try to figure out why we were seeing it19:10
mordredjeblair: specifically, this: http://logs.openstack.org/51/226751/20/check/gate-dsvm-nodepool/e77cb88/logs/screen-nodepool.txt.gz#_2015-10-01_00_59_14_40419:11
openstackgerritAndreas Jaeger proposed openstack-infra/release-tools: Rework translation-cleanup  https://review.openstack.org/22745419:11
mordredjeblair: touches the area we're poking at and would be bad if it didn't work inproduction19:11
*** ZZelle_ has joined #openstack-infra19:11
mordreddhellmann: around? could you give us a hand with https://review.openstack.org/230085 ?19:12
jeblairmordred, clarkb: do we run shade in zuul-cloner with nodepool?19:12
jeblairor, well, do we run shade from zuul?19:12
jeblairi guess that's how we should say that? :)19:13
mordredjeblair: I'm not sure - looking19:13
jeblairso, trying again: mordred, clarkb: do we run shade from zuul in the nodepool dsvm job?19:13
SpamapSgreghaynes: Yes I agree on your thoughts that time based things are necessary, especially when we are working on things like response time which will depend heavily on the parallelism and concurrency of the system.19:14
mordredjeblair: it does not appear so19:14
*** glauco_ has joined #openstack-infra19:14
mordredjeblair: export PROJECTS="openstack-infra/nodepool $PROJECTS"19:14
*** glauco_ has quit IRC19:14
clarkbjeblair: no19:14
jeblairmordred: i agree19:14
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet: split integration job in 2  https://review.openstack.org/23006419:14
SpamapSgreghaynes: this approach doesn't do anything to stand in the way of that, it's just us focusing on things that we can prevent from backsliding easily.19:14
SpamapSgreghaynes: we can get trends on time based, but I'm pretty sure we're never going to be able to gate on it.19:14
jeblairmordred: okay, so your change to 226751 won't do anything anyway -- are we basically back at square 1 with not knowing what caused the error in ps20?19:15
*** hdd has joined #openstack-infra19:15
mtreinishSpamapS: yeah it's not really feesible to gate on anything based on trend date because of the inherent noise19:15
greghaynesSpamapS: Yes, my thinking though is you dont ever want to gate on it but you want it to be there so you can go back and evaluate whether what the stats youre driving down on are actually useful19:15
jeblairmtreinish: i think we can gate on trend data, just probably not _timing_ trend data19:16
jeblairmtreinish: SpamapS is proposing some non-noisy metrics that could, possibly, one day, be gateable :)19:16
*** glauco__ has quit IRC19:16
SpamapSgreghaynes: indeed, correlating the two will be quite useful in running down the causes.19:16
*** glauco_ has joined #openstack-infra19:16
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test ZMQ event handler  https://review.openstack.org/23002319:17
jeblairmordred: do you have any more information about 226751?19:17
SpamapS"We reduced SQL rows read by 10% and that resulted in LESS concurrency in the system because we exposed a locking race" <-- something I've had happen to me before.19:17
*** tsekiyama has quit IRC19:18
*** david-lyle has quit IRC19:18
greghaynesYea, exactly. Whenever youre driving something with a model you always want to also store the actual data youre modeling just so you remain based in reality19:18
odyssey4meany chance for us getting one more set of eyes on this? https://review.openstack.org/22840619:19
SpamapSOr another fun one.. we switched from a single node InnoDB cluster for session storage to a 4 node MySQL cluster, which reduced overall response time, but added 10x network traffic to the system because it was MySQL 4.1 and NDB crashed every 5s, resulting in worse system performance in general because of saturated trunks between the redundant switches hosting the NDB nodes.19:19
jeblairmordred: er, okay.  i'm going to go get lunch.  i'll try to look into 226751 if you haven't by the time i get back.19:19
SpamapSSo yeah, correlating the reality with the counters is critical.19:20
openstackgerritDan Prince proposed openstack-infra/tripleo-ci: Fix pep8 errors in tripleo-jobs.py  https://review.openstack.org/23009119:20
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add new graph type to show run_time variance by metadata  https://review.openstack.org/21056919:20
SpamapSgreghaynes: it's just that.. the variances in our reality are staggering. ;)19:21
*** kushal has quit IRC19:21
* SpamapS wanders off to an indian buffet19:21
greghaynesoh man, indian sounds good19:21
greghaynes-> lunch too19:21
*** moravec has joined #openstack-infra19:21
mordredjeblair: yah. I'm digging in right now19:22
docaedofungi: gate check failed with "Error: Parameter path failed on File[undef]: File paths must be fully qualified, not 'undef' at /etc/puppet/modules/apps_site/manifests/init.pp:86" (http://logs.openstack.org/78/230078/1/check/gate-infra-puppet-apply-bare-trusty/696e62b/console.html)19:22
mordredjeblair: will hopefully have info for you when you get back19:22
docaedofungi: but I thought hiera would have filled that stuff in so it wouldn't be undefined?19:22
*** notnownikki has quit IRC19:22
jeblairmordred: is the auto-ip stuff enabled?19:22
mordredjeblair: yah. should be19:23
jeblairmordred: k.  lunch.  good luck.19:23
*** matbu_ has quit IRC19:23
openstackgerritBruno Tavares proposed openstack-infra/puppet-diskimage_builder: Fix apt issue.  https://review.openstack.org/22050519:23
openstackgerritBruno Tavares proposed openstack-infra/puppet-diskimage_builder: Add acceptance tests for puppet-diskimage_builder.  https://review.openstack.org/22026219:23
fungidocaedo: Error: Parameter path failed on File[undef]: File paths must be fully qualified, not 'undef' at /etc/puppet/modules/apps_site/manifests/init.pp:8619:24
tristanCjd__: Should we use "jd__" or just "jd" as your irc name in TC candidate list ?19:24
fungidocaedo: oh, you saw it too19:24
*** matbu has joined #openstack-infra19:25
docaedofungi: right, but I'm confused I guess because setting those values to undef was the review advice I got19:25
crinkleerm i don't think a file path of '' would be any better19:26
fungidocaedo: it looks like maybe the contents value is being filled causing that conditional block to evaluate?19:26
docaedocrinkle: no way, this is totally your fault ;)19:26
*** david-lyle has joined #openstack-infra19:27
docaedofungi: I have to confess I have not peeled back enough infra layers to understand what's breaking. I mainly just copied other things (like from gerrit host) that appeared to work since they were merged.19:28
*** matrohon has joined #openstack-infra19:29
fungidocaedo: in this case we're passing in "XXX" for $ssl_chain_file_contents so it wants to create that file, but the module says the default $ssl_chain_file is undef19:29
fungidocaedo: i expect you need to set filenames/paths you want to use for those three in 23007819:30
tristanCjd__: I put jd__ as it's your actual ircname here and your openstack profile says so too. Please let us know before tomorrow if you'd prefer just "jd"19:30
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675119:31
tristanCsmall details matters :)19:32
*** yamamoto has quit IRC19:32
crinkledocaedo: you can see gerrit sets ssl_chain_file so it doesn't have this problem http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/review.pp#n5419:33
*** shardy_afk is now known as shardy19:33
openstackgerritSean Dague proposed openstack-infra/devstack-gate: DNM: test oslo.service backports  https://review.openstack.org/23010119:33
docaedofungi: thanks, I'll make some adjustments19:33
*** puranamr has joined #openstack-infra19:33
fungidocaedo: perhaps a cleaner solution is to amend the apps_site module to pick different default filenames if the contents are passed in for them19:33
docaedocrinkle: thank you for that pointer19:33
anteayatristanC: thank you for your attention to detail!19:33
*** jsavak has quit IRC19:33
anteayatristanC: you are so good at that19:33
*** julim has joined #openstack-infra19:33
*** jsavak has joined #openstack-infra19:34
*** sergmelikyan has joined #openstack-infra19:34
dhellmannmordred: looking at that release now19:34
fungidocaedo: yeah, i think i see the logic error in the apps_site module there actually19:34
openstackgerritMonty Taylor proposed openstack-infra/shade: Provide short-circuit for finding server networks  https://review.openstack.org/22914019:35
mordreddhellmann: thanks!19:35
dhellmannmordred: is "Added SWITCHengines vendor file" a feature?19:35
dhellmannmordred: "Add support for Catalyst as vendor" almost certainly is, no?19:35
tristanCanteaya: you're welcome :-)19:35
*** hdd has quit IRC19:35
crinklefungi: i think all the sites have this logic error19:36
mordreddhellmann: they're both exactly the same level of feature - I'm not sure if I think of those as features or not19:36
crinklefungi: http://git.openstack.org/cgit/openstack-infra/puppet-askbot/tree/manifests/site/ssl.pp for example19:36
anteayatristanC: :)19:36
mordreddhellmann: I could probably make a salient argument in both directions ... how are you defining it?19:36
dhellmannmordred: ok. normally if it smells like a feature we want a min version bump.19:36
mordreddhellmann: ok. I can respin with a 1.8.0 number19:36
dhellmannmordred: sounds good, thanks19:36
mordreddhellmann: done19:37
mordreddhellmann: code review ftw19:37
*** glauco___ has joined #openstack-infra19:37
*** moravec has quit IRC19:37
fungicrinkle: the askbot module does, yes, i saw earlier that it's being worked around in the global site manifest19:37
dhellmannmordred: ++19:39
*** glauco_ has quit IRC19:40
fungidocaedo: crinkle: probably we should set all three of those file paths undef for the default, then if content is also undef use the snakeoil paths and don't use a chain cert file, but if content is provided then create the files at a sane base location like /etc/ssl/*/$fqdn.??? or at the specified path19:40
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test ZMQ event handler  https://review.openstack.org/23002319:40
fungithat makes it possible (but not necessary) to override the cert/key paths on the filesystem when having puppet create them for you19:41
*** moravec has joined #openstack-infra19:41
openstackgerritBruno Tavares proposed openstack-infra/puppet-openstackci: Pin fog-google gem to known working version.  https://review.openstack.org/23010419:42
openstackgerritMerged openstack-infra/project-config: Add pep8 and bashate non-voting checks to openstack-ansible  https://review.openstack.org/22840619:42
*** bltavares has joined #openstack-infra19:42
mordredfungi: all of your words sound like words19:42
docaedofungi: that makes sense to me, but I'll need to beg for help from someone like crinkle who really gets this :)19:42
bltavaresHi there folks. I noticed that a bunch of gate jobs (gate-openstackci-beaker-trusty-dsvm) on every review was failing because of a bad transitive dependency.19:43
bltavaresI pinned the version on the project that was causing the failures here https://review.openstack.org/#/c/230104/19:44
bltavaresI hope that is a good way to fix that for other modules (:19:44
mordredbltavares: I was wondering why we cared about fog-google :)19:45
*** puranamr has quit IRC19:45
crinkledocaedo: fungi i think it would be sufficient for now to set ssl_chain_file in site.pp and fix the logic across the modules later19:45
bltavaresmordred: transitive dependency. rspec-beaker -> fog -> fog-google >= 0.0.219:45
bltavaresor something like that hehe19:46
crinklebltavares: they are fixing it in beaker and will hopefully release soon https://github.com/puppetlabs/beaker/commit/4f94d048a6fb048fa9323772237af511c425061c19:46
EmilienMcrinkle: can you look https://review.openstack.org/#/c/230064/ when you got time?19:46
*** michaelxin has quit IRC19:46
*** sambetts has quit IRC19:47
crinkleEmilienM: i'm about to run off to an appointment19:47
bltavarescrinkle: oh, cool. I was following the discussion on fog-google but not on beaker.19:47
EmilienMcrinkle: ok np19:47
EmilienMbltavares: puppetlabs is about to release beaker today19:47
EmilienM(with the fix)19:47
bltavaresI will abandon the change adding that information. Thanks folks19:47
mtreinishanteaya: you asked for a graph of the run variance, I did one without a date filter: http://i.imgur.com/g3OrUnI.jpg19:48
mtreinishI really need to figure out how to tell matplotlib to space the labels a bit better19:48
*** sambetts has joined #openstack-infra19:48
mordredmtreinish: hahahahahahaha19:48
austin81mtreinish: oh dear god my eyes19:48
mordredthose labels are amazing19:48
mordredmtreinish: I truly believe you could print and frame that and sell it as art19:48
austin81mordred: ++19:48
mtreinishhaha19:49
anteayamtreinish: ha ha ha19:49
anteayacharlie and the chocolate factory19:50
*** Goneri has joined #openstack-infra19:50
anteayaembiggen it, even better19:50
*** claudiub has quit IRC19:50
openstackgerritSean Dague proposed openstack-infra/devstack-gate: DNM: test oslo.service backports  https://review.openstack.org/23010119:50
anteayamtreinish: thank you19:50
docaedocrinkle or fungi - if I add $ssl_chain_file = '/etc/ssl/certs/intermediate.pem' in site.pp would that fix it?19:51
mtreinishanteaya: I'll read the matplot docs a bit more and see how to force to space the ticks a bit more (or make the label font smaller)19:52
mtreinishso you can actually see the job names19:52
anteayaoh I can see job names19:52
anteayaall of them19:52
anteayain a lovely pile19:53
anteayanew meaning to word cloud19:53
openstackgerritSean Dague proposed openstack-infra/devstack-gate: DNM: test devstack work around  https://review.openstack.org/23010819:54
*** yolanda has quit IRC19:54
*** ociuhandu has joined #openstack-infra19:54
*** sergmelikyan has quit IRC19:55
sdaguejeblair: just another thanks for Depends-On19:55
*** ifarkas has quit IRC19:55
*** gordc has joined #openstack-infra19:55
*** yolanda has joined #openstack-infra19:55
sdague230101,2 and 230108,1 show some fun testing of possible fixes19:55
dims_sdague: jeblair: Hearty +119:56
*** jsavak has quit IRC19:57
*** moravec has quit IRC20:00
*** denisra has quit IRC20:00
*** moravec has joined #openstack-infra20:01
*** tjones has joined #openstack-infra20:01
*** AJaeger has quit IRC20:02
greghaynesmtreinish: hah, neat graph20:02
*** nelsnelson has quit IRC20:02
*** jsavak has joined #openstack-infra20:03
*** signed8bit has quit IRC20:03
*** ociuhandu has quit IRC20:04
*** aeng has joined #openstack-infra20:04
*** ociuhandu has joined #openstack-infra20:06
*** jsavak has quit IRC20:07
*** odgrim has quit IRC20:08
*** jsavak has joined #openstack-infra20:08
jd__tristanC: jd__ is fine20:09
*** jtomasek has joined #openstack-infra20:10
mtreinishgreghaynes, mordred, anteaya, austin81: here is is with somewhat legible labels: http://i.imgur.com/jEHfteW.jpg20:12
*** tiswanso has quit IRC20:12
mtreinishI'm gonna look at swapping the x and y so you don't have to crink your neck to read it20:12
greghayneslooking at it - seems like the inner quartile isnt *that* bad20:12
greghaynesfor most of the tests20:13
mtreinishgreghaynes: heh, yeah there are a few jobs which are noticeably worse then others20:14
greghaynesmtreinish: it also seems like the lower bound on a lot of them lines up too well - are those maybe failures right after boot?20:16
*** hdd has joined #openstack-infra20:16
jeblairsdague: \o/  thanks!20:17
mtreinishgreghaynes: the query here is only runs without any failures20:17
mtreinishgreghaynes: oh, this is for the run as a whole, not individual tests20:18
mtreinishit's grouped by build_name20:18
*** tsekiyama has joined #openstack-infra20:18
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test ZMQ event handler  https://review.openstack.org/23002320:19
jeblairmordred: why are you switching to interface_ip in 226751?20:19
mtreinishI could do it for variance of an individual tests too, although there would be a lot more boxes with whiskers. We have about 1000-1600 tests in a full run20:19
jeblairmordred: afaik, that's not expected to work until the next shade release with our changes; meanwhile, the code we have should work with the current shade release20:19
*** flepied has quit IRC20:20
clarkbgreghaynes: its more likely that the min and max values are related to cloud things20:21
clarkbgreghaynes: and the non outlier results are more representative20:22
greghaynes"cloud things"20:22
asselinI'm trying to run nodepool unit tests but I get mysql connection refused errors. Are you supposed to have mysql installed? http://paste.openstack.org/show/475119/20:22
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Use shade for all OpenStack interactions (jeblair's version)  https://review.openstack.org/23012220:22
mordredjeblair: interface_ip should work in both versions - it's been in the interface for a while20:22
mordredjeblair: I mean, it won't fix anything and we can revert that - but it should work20:22
* asselin reads the docs20:22
clarkbgreghaynes: ya network slowness, cpu time, etc20:23
clarkbnoisy neighbors20:23
anteayamtreinish: neutron-dvr, neutron-full and full2 are out on there own20:23
jeblairmordred: ok.  it feels like a tangent to me atm -- i mean, public_v4 _should_ work.20:23
anteayatheir20:23
jeblairmordred: anyway, i forked it ^ :)20:23
mordredjeblair: kk20:23
*** tsekiyama has quit IRC20:23
anteayamtreinish: let's try to smooth our the whiskers20:24
mtreinishanteaya: they're seperate job definitions20:24
anteayamtreinish: yes and they have many blue crosses in the 7000 to 10000 range20:25
*** odgrim has joined #openstack-infra20:26
mtreinishoh, those are outliers20:26
anteayayes, I think I was trying to say those jobs have some outliers20:27
anteayaI think that was my point20:27
mtreinishanteaya: I was just confused by your wording.20:28
*** geoffarnold has joined #openstack-infra20:29
anteayaasselin: I concur something running in the unit tests is looking for a MySQL to connect to20:29
anteayamtreinish: ah happens often20:29
anteayamtreinish: sorry about that20:29
asselinanteaya, I got it. It was all in the README20:30
anteayaI was trying to say these 3 jobs appear to be not like the others20:30
anteayaasselin: ah helpful README's20:30
*** geoffarn_ has joined #openstack-infra20:30
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Use shade for all OpenStack interactions (jeblair's version)  https://review.openstack.org/23012220:31
jeblairmordred: ^ check out diff PS1..PS2 there20:31
fungidocaedo: that alone won't "fix" it since you'll start overwriting the snakeoil cert/key on the system. you'd at least need to pass in sane paths for all three files20:31
anteayajeblair: I'm curious, I see you are the patch owner and have given yourself co-authored by in the commit message, why?20:32
jeblairanteaya: because i am not the patch _author_20:32
anteayaah thank you20:32
fungidocaedo: my recommendation in 226984 would work with the current site.pp and would also avoid overwriting the snakeoil files if someone did pass content in for them without specifying a path20:32
*** geoffarnold has quit IRC20:33
docaedofungi: ok your suggestion seems sane, I just don't have the puppet skillz at hand to make that happen - will give me something new to learn unless someone else is bored and wants to educate me :)20:35
*** cdent has quit IRC20:35
*** odgrim1 has joined #openstack-infra20:35
*** odgrim has quit IRC20:35
fungidocaedo: i might have time to take a stab at it later, but am mostly occupied moving everything up off my ground floor for at least a few more hours20:36
openstackgerritMerged openstack-infra/release-tools: Sync with global requirements  https://review.openstack.org/22708620:36
*** amuller is now known as amuller_afk20:36
docaedofungi: no problem, prepping for potential disaster is a little more important than helping me make SSL cert work for app catalog20:37
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test ZMQ event handler  https://review.openstack.org/23002320:37
clarkbthis test is so close20:37
ianwhttp://nodepool.openstack.org/image.log <- we have f22 images built!  thanks fungi for adding that workaround.  pabelanger has tested latest versions of dnf and it's going to make the whole caching story on par with yum, we think.20:37
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Destroy previous test env VM's earlier  https://review.openstack.org/23012920:37
*** hdd has quit IRC20:37
*** abregman has joined #openstack-infra20:37
docaedofungi: maybe crinkle will take a shot at it later (or maybe even krinkle will come back and help!)20:38
*** sergmelikyan has joined #openstack-infra20:39
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add new graph type to show run_time variance by metadata  https://review.openstack.org/21056920:40
glauco___I noticed that recently we added puppet-nodejs as part of system-config/modules.env20:40
glauco___but there is a know bug on the version we are using20:40
*** glauco___ is now known as glauco20:40
nibalizerwe can likely just bump20:40
nibalizerlink to the bug?20:41
glauconibalizer: This is the bug https://github.com/willdurand/puppet-nodejs/issues/5020:42
mordredjeblair: HEADDESK20:42
glauconibalizer: It was fixed on version 1.8.020:42
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API  https://review.openstack.org/22196420:42
mordredjeblair: oh. thank you as well - that reminds me of the one additional patch I wanted to write20:42
glauconibalizer: https://github.com/willdurand/puppet-nodejs/blob/v1.8.0/lib/puppet/provider/package/npm.rb20:42
*** yamamoto has joined #openstack-infra20:42
jeblairmordred: NO MORE PATCHES!  NO MORE PATCHES!  :)20:42
mordredjeblair: which is to make create_server/get_server/list_servers _ALWAYS_ call get_openstack_vars on the server so that consumers do not have to deal with this20:43
mordredjeblair: but we can do that as a follow on20:43
glauconibalizer:  I am actually using on module that needs node-gyp and it fails :/20:43
jeblairmordred: can i push 230122 over 226751?20:43
mordredjeblair: yes20:43
nibalizerglauco: we use this one https://github.com/puppet-community/puppet-nodejs20:43
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675120:44
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test ZMQ event handler  https://review.openstack.org/23002320:45
glauconibalizer: my bad!20:45
glaucoThat seem to be already fixed in there20:45
*** markvoelker has quit IRC20:46
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/devstack-gate: DNM: test oslo.service backports  https://review.openstack.org/23010120:46
*** markvoelker has joined #openstack-infra20:46
*** derekh has joined #openstack-infra20:46
*** hdd has joined #openstack-infra20:46
*** tsekiyama has joined #openstack-infra20:46
*** markvoelker has quit IRC20:47
*** hashar has quit IRC20:47
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Update query for ebtables kernel nova bug 1501558  https://review.openstack.org/23013620:47
openstackbug 1501558 in OpenStack Compute (nova) "nova-net: libvirtError: Error while building firewall: Some rules could not be created for interface: Unable to update the kernel" [High,Confirmed] https://launchpad.net/bugs/150155820:47
*** markvoelker has joined #openstack-infra20:47
*** dkranz has quit IRC20:47
*** yamamoto has quit IRC20:47
*** bltavares has quit IRC20:52
*** bltavares has joined #openstack-infra20:52
*** eharney has quit IRC20:53
openstackgerritMerged openstack-infra/tripleo-ci: Pin delorean to a pre mock version  https://review.openstack.org/23001120:54
*** ekarlso has quit IRC20:55
*** sridhar_ram has joined #openstack-infra20:55
*** geoffarn_ has quit IRC20:55
*** geoffarnold has joined #openstack-infra20:56
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test ZMQ event handler  https://review.openstack.org/23002320:56
clarkbthe threading around this is all kinds of fun20:56
openstackgerritMerged openstack-infra/elastic-recheck: Update query for ebtables kernel nova bug 1501558  https://review.openstack.org/23013620:57
openstackbug 1501558 in OpenStack Compute (nova) "nova-net: libvirtError: Error while building firewall: Some rules could not be created for interface: Unable to update the kernel" [High,Confirmed] https://launchpad.net/bugs/150155820:57
clarkbif this last patch doesn't work I give up for now.20:58
clarkbmordred: jeblair so we need 226751 and it should be good now?20:58
*** ekarlso has joined #openstack-infra20:58
*** matrohon has quit IRC20:58
*** tsekiyama has quit IRC20:58
greghaynesclarkb: thats the spirit!20:59
mordredclarkb: yes20:59
*** FallenPegasus has joined #openstack-infra20:59
*** gildub has joined #openstack-infra21:00
*** derekh has quit IRC21:00
jeblairmordred, clarkb: the dsvm tests for it under the other change id are close to finishing: https://jenkins05.openstack.org/job/gate-dsvm-nodepool/20/console21:00
openstackgerritClark Boylan proposed openstack-infra/nodepool: Check pyflakes rules  https://review.openstack.org/23014121:01
clarkbjeblair: ^ and that will enable just pyflakes rules to catch var and import problems21:01
*** jsavak has quit IRC21:02
clarkbgreghaynes: on the other hand if it does work I think I can remove some of my monkey patching to reduce async21:02
*** asselin_ has joined #openstack-infra21:02
*** jsavak has joined #openstack-infra21:03
*** mudassirlatif_ has joined #openstack-infra21:04
*** jsavak has quit IRC21:04
*** alivigni has quit IRC21:04
*** asselin__ has quit IRC21:06
*** mudassirlatif has quit IRC21:07
*** mudassirlatif_ is now known as mudassirlatif21:07
*** asselin_ has quit IRC21:07
*** signed8bit has joined #openstack-infra21:07
*** signed8b_ has joined #openstack-infra21:09
*** jpeeler has quit IRC21:12
*** moravec has quit IRC21:13
*** signed8b_ is now known as signed8bit_ZZZzz21:13
*** signed8bit has quit IRC21:13
*** tsekiyama has joined #openstack-infra21:14
*** moravec has joined #openstack-infra21:14
*** sergmelikyan has quit IRC21:15
openstackgerritClark Boylan proposed openstack-infra/nodepool: Test ZMQ event handler  https://review.openstack.org/23002321:16
jeblairclarkb, mordred: hrm, that dsvm test still doesn't look great21:16
jeblairit hasn't finished yet, but i think it should have.21:17
*** geoffarnold has quit IRC21:17
*** geoffarnold has joined #openstack-infra21:17
*** signed8bit_ZZZzz has quit IRC21:18
*** jsavak has joined #openstack-infra21:19
*** denisra has joined #openstack-infra21:19
*** Goneri has quit IRC21:19
openstackgerritAugustina Ragwitz proposed openstack-infra/project-config: (WIP) split out into testable units  https://review.openstack.org/22977221:20
EmilienMbltavares: https://github.com/puppetlabs/beaker/releases/tag/2.25.021:22
bltavaresEmilienM: nice! thanks for letting me know. I will trigger the tests again (:21:23
clarkbjeblair: jenkins says 8 more minutes?21:23
jeblairclarkb: i logged into the host and see the same error in the log file21:23
jeblairclarkb: i'll let it finish and then debug on-host21:23
clarkbok21:23
mordredjeblair: the same "can't find IP" error?21:24
jeblairmordred: yup21:24
mordredjeblair: that error is very confusing to me21:24
*** FallenPegasus has quit IRC21:24
EmilienMbltavares: cool :)21:25
*** shardy has quit IRC21:26
*** moravec has quit IRC21:26
*** jsavak has quit IRC21:27
*** jsavak has joined #openstack-infra21:28
jeblairmordred: while we're waiting -- why do we have get_openstack_vars at all?21:28
EmilienMfungi: if it's fine for infra folks, we can have 2 more jobs https://review.openstack.org/#/c/230064/ - if it's too much, we can drop upgrade jobs21:28
jeblairmordred: why not have whatever "server" object shade returns implement all of that internally?21:28
mordredjeblair: yes.21:28
mordredjeblair: that was the next patch I was going to write21:29
mordredjeblair: the other patches were to make it be able to be inexpensive enough that that would not become double-plus bad21:29
mordred(the short-circuit network call patch)21:29
jeblairmordred: ok21:29
*** trown is now known as trown|outttypeww21:30
jeblairmordred, clarkb: http://logs.openstack.org/22/230122/2/check/gate-dsvm-nodepool/c1a3157//logs/screen-nodepool.txt.gz#_2015-10-01_21_27_05_54521:30
*** signed8bit has joined #openstack-infra21:30
jeblairdigging into that now21:30
mordredjeblair: so - in one of my patches I tried to add debug logging statements to all the exceptions related to can't find IP21:31
mordredjeblair: (we log the server struct in that case in one of the cases, but not the other two)21:31
jeblairclarkb: this devstack plugin thing is pretty cool :)21:32
anteayaI'm seeing a failure on not being able to build a wheel for Pillow21:33
clarkbjeblair: ya it can be pretty handy21:34
anteayahttp://logs.openstack.org/80/229680/2/check/gate-project-config-layout/66e431a/console.html#_2015-10-01_21_13_56_70521:34
*** e0ne has joined #openstack-infra21:34
clarkbjeblair: mordred also fwiw that job is setup to use neutron ovs with floating ips21:34
*** FallenPegasus has joined #openstack-infra21:34
clarkbjeblair: mordred so it should resemble hpcloud21:34
*** rfolco has quit IRC21:35
*** annegentle has quit IRC21:35
anteaya11 hits in the last 30 minutes: message:"Failed building wheel for Pillow"21:37
anteayasomething that we expect to provide pillow isn't doing so21:37
clarkbanteaya: looking now21:38
*** geoffarnold has quit IRC21:38
*** boris-42 has joined #openstack-infra21:38
anteayaclarkb: thank you21:38
*** geoffarnold has joined #openstack-infra21:38
clarkblooks like its a dep of sphinx and requires libjpeg?21:38
anteayayeah it is image based21:38
jeblairmordred: oh... my "fix" didn't change anything -- i think you can recursively call get_hostvars_from_server on its own output, because in all cases, input and output is a Bunch()21:39
anteayaI can support your initial theory21:39
jeblairmordred: so that was an optimization, not a fix, as it turns out21:39
*** regXboi has quit IRC21:39
jeblairmordred: i pasted a repr() of what we get in the etherpad https://etherpad.openstack.org/p/nodepool-shade21:39
jeblairmordred: public_v4=''21:40
jeblairmordred: (interestingly, public_v6 is set21:40
mordredthere is no public address21:41
mordredaddresses={u'private': [{u'OS-EXT-IPS-MAC:mac_addr': u'fa:16:3e:36:99:a4', u'version': 4, u'addr': u'10.1.0.114', u'OS-EXT-IPS:type': u'fixed'}, {u'OS-EXT-IPS-MAC:mac_addr': u'fa:16:3e:36:99:a4', u'version': 6, u'addr': u'fd89:b548:10f9:0:f816:3eff:fe36:99a4', u'OS-EXT-IPS:type': u'fixed'}]}21:41
*** tjones has quit IRC21:41
mordredso it is quite correct in saying that it cannot find one21:41
mordrednow - why was there not one21:42
jeblairmordred: i'm guessing because we don't actually have a public ip allocation to give devstack?21:42
mordredwell - no, there should be floating ips in devstack21:42
jeblairmordred: would they be non-rfc1918 though?21:42
mordredthis is why "public" can't just be determined by looking at rfc1918 ranges21:42
mordredyes. we don't use that to determine their public-ness21:42
jeblairmordred: oh, i could have sworn i saw a function in shade to do that21:43
*** salv-orl_ has joined #openstack-infra21:43
mordredthat's a very late fall back if nothing else works attempt21:43
mordredbut the main thing we look for is addresses on a neutron network marked "router:external" - and then for floating ips21:43
clarkbthe floating ips are in 172.24.5.0/2421:43
*** mriedem has quit IRC21:43
*** david-lyle has quit IRC21:43
*** rlandy has quit IRC21:43
mordreddoesn't matter21:43
jeblairmordred: 23.253.110.184 is the devstack host i have held21:43
mordredthis server does not hav ea floating ip21:43
jeblairmordred: if you want to poke at it21:44
clarkbah that would do it21:44
mordredthe IP detection is not failing21:44
mordredsomething failed in IP creation21:44
jeblairmordred: want me to run it with shade debug?21:44
mordredsigh21:44
mordrednope21:44
mordredI see it21:44
*** weshay has quit IRC21:44
mordredit's silly. you're going to like it21:44
jeblairi love those21:45
mordredjeblair: I mean- I DO think we should be running these tests with shade debug turned on21:45
mordred        return self._client.get_openstack_vars(self._client.create_server(21:45
mordred            wait=False, auto_ip=True, **create_args))21:45
mordredanybody else see the bug?21:45
clarkbmordred: wait=False?21:46
clarkbI dunno21:46
mordredyup. auto_ip can't do anyting with wait=False21:46
*** salv-orlando has quit IRC21:46
mordredbecause there is nothing to attach the ip _to_21:46
*** gordc has quit IRC21:46
*** ayoung has quit IRC21:46
*** kgiusti has quit IRC21:47
mordredjeblair: I apologize, my brain should have caught this before - I thnk we will need one more patch, because I do not think we want wait=True in nodepool21:47
jeblairmordred: if we set wait to false, other threads will still multiplex, right?21:47
*** ldnunes has quit IRC21:47
jeblairer, wait to true, rather21:48
jeblairwe could even just drop nodepool's waitforserver...21:48
openstackgerritBruno Tavares proposed openstack-infra/puppet-diskimage_builder: Add acceptance tests for puppet-diskimage_builder.  https://review.openstack.org/22026221:48
*** annegentle has joined #openstack-infra21:49
*** austin81 has left #openstack-infra21:50
Shrewsmordred: oh, that's a fun one21:50
*** tjones has joined #openstack-infra21:51
*** shashank_hegde has quit IRC21:51
*** johnsom has joined #openstack-infra21:52
*** spzala has quit IRC21:54
*** spzala has joined #openstack-infra21:55
*** annegentle has quit IRC21:56
*** david-lyle has joined #openstack-infra21:56
*** pc_m has quit IRC21:57
*** nelsnelson has joined #openstack-infra21:57
*** doug-fish has quit IRC21:57
*** nelsnelson has quit IRC21:58
openstackgerritAnita Kuno proposed openstack/requirements: Pin Pillow as the latest release is not building  https://review.openstack.org/23016721:58
*** doug-fish has joined #openstack-infra21:58
*** nelsnelson has joined #openstack-infra21:58
anteayaclarkb: thank you21:58
clarkbanteaya: can you include a link to https://github.com/python-pillow/Pillow/commit/29601ca119adf3c02967ae9a8aea28d034bafe29 breaking builds because libjpeg-dev is required and we don't have it installed on the test nodes in the commit message22:00
anteayaI can and will22:00
clarkbgreat I can approve once thats done22:00
anteayathanks22:00
clarkbthen we can work on rebuilding images with libjpeg installed22:01
clarkbI can work on a patch to make that happen now22:01
ruagairo/22:01
pleia2ergh, releases breaking things22:01
bltavaresEmilienM: just to let you know, the gates are green again \o22:02
*** amuller_afk is now known as amuller22:02
mordredShrews: logic mismatch between how we cache and process in shade and how nodepool needs to - I've got an easy fix coming and a more complex one to talk about once I've dumped this thought into code22:02
EmilienMbltavares: \o/22:02
openstackgerritAnita Kuno proposed openstack/requirements: Pin Pillow as the latest release is not building  https://review.openstack.org/23016722:03
anteayaclarkb: let me know if further edits are required22:03
clarkbhrm I am thinking about this more and devstack runs wont be affected due to constraints but unittsts/docs etc will be22:04
*** sambetts has quit IRC22:04
clarkband it will affect basically everything because sphinx22:04
clarkbI think22:04
*** e0ne has quit IRC22:04
openstackgerritGlauco Oliveira proposed openstack-infra/puppet-openstack-health: Add provisioning scripts  https://review.openstack.org/22784922:04
clarkbit may just be quicker to rebuild images. Can work both at the same time22:04
clarkbanteaya: +222:05
* anteaya is fine with what clarkb suggests22:05
anteayathank you22:05
anteayapleia2: feel like reviewing a requirements patch?22:05
anteaya23016722:06
*** rossella_s has quit IRC22:06
*** jsavak has quit IRC22:06
*** rossella_s has joined #openstack-infra22:06
pleia2anteaya: yep, looks good22:06
anteayapleia2: thank you22:06
*** tonytan4ever has quit IRC22:06
*** sambetts has joined #openstack-infra22:06
*** bltavares has quit IRC22:07
*** bltavares has joined #openstack-infra22:07
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675122:07
*** bltavares has quit IRC22:07
*** bltavares has joined #openstack-infra22:09
openstackgerritClark Boylan proposed openstack-infra/system-config: Add Pillow C deps to thick slaves  https://review.openstack.org/23017522:13
openstackgerritGlauco Oliveira proposed openstack-infra/puppet-openstack-health: Add provisioning scripts  https://review.openstack.org/22784922:13
openstackgerritMonty Taylor proposed openstack-infra/shade: Plumb wait and timout down to add_auto_ip  https://review.openstack.org/23017822:14
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675122:14
mordredjeblair: ^^ kk. those two should get us22:14
clarkbmordred: why not two calls? boot node22:15
clarkbmordred: then attach fip22:15
mordredclarkb:  that is what we're doing22:15
jeblairmordred: ack22:15
clarkbthen you can keep your existing method as a rwapper around that22:15
mordredclarkb: nodepool needs to do its optimization of doing the list once ever X seconds and having the thread calls check the list22:16
clarkbmordred: I don't see where in the latest change its floating ip22:16
*** geoffarn_ has joined #openstack-infra22:16
*** glauco has quit IRC22:16
mordredclarkb: add_ips_to_server(server)22:16
*** nijaba has quit IRC22:16
mordredgah. typo22:16
mordredjeblair: one sec22:16
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675122:16
mordredjeblair: _that_22:16
*** ociuhandu has quit IRC22:17
jeblairmordred: i'm not sure the commit message makes sense in https://review.openstack.org/23017822:17
clarkbmordred: maybe that shouldn't go in wait for server?22:17
jeblairmordred: maybe you meant to name the other method?22:17
mordredjeblair: yup. one sec22:18
clarkband I think it should probably be add_floating_ip_to_server if thats what it is doing22:18
clarkbas I think you can add arbitrary IPs otherwise22:18
mordredclarkb: no - because it's not necessarily adding a floating ip22:18
mordredit's adding a floating ip if that's what it ndeeds to do22:19
mordredor it's doing nothing22:19
mordredor, if you pass in a specified ip, it'll add that22:19
clarkbmordred: I feel like we are encoding way too much business logic into shade there22:19
*** nelsnelson has quit IRC22:19
mordredclarkb: that is shade's sole purpose in life22:19
clarkbshade should make getting a floating IP easy if you need that22:19
mordredno22:19
mordrednonono22:19
mordredyou should not hav eto know about floating ips vs. not22:19
zarodhellmann: ping22:20
mordredbecause openstack is broken22:20
clarkbmordred: ok22:20
mordredand the entire idea that different clouds get you a public ip differently is stupid22:20
reedShrews, looks like something broke on shade get_image between version 0.11 and 0.1422:20
*** geoffarnold has quit IRC22:20
*** Goneri has joined #openstack-infra22:20
mordredclarkb: it should probably be caled "ensure_public_ip"22:20
mordredclarkb: so taht it's clearer22:20
clarkbmordred: that works22:20
clarkbmordred: and I think I would bubble the call up a layer above wait for server22:21
mordredclarkb: I'll add an enure_public_ip method as an alias as a follow on22:21
mordredclarkb: not sure what you mean?22:21
openstackgerritMonty Taylor proposed openstack-infra/shade: Plumb wait and timout down to add_auto_ip  https://review.openstack.org/23017822:21
clarkbmordred: you have overloaded wait for server to mean wait for server to boot and wait for ip to attach22:21
*** nelsnelson has joined #openstack-infra22:21
clarkbmordred: when it should be wait for server then wait for ip as distinct steps22:21
Shrewsreed: can you be more specific?22:22
mordredclarkb: can we take a step back - because I feel like we're talking about two different things22:22
clarkbreed: don't rule out glanceclient either22:22
clarkbmordred: line 283 https://review.openstack.org/#/c/226751/27/nodepool/provider_manager.py22:22
*** FallenPegasus has quit IRC22:22
jeblairclarkb: ideally i would like it to be one -- but we can't use that in nodepool because shade's caching is insufficient.22:22
reedclarkb, that's correct, it could be glanceclient's fault too22:22
jeblairclarkb: i would like shade to give me in one call, a server with a public ip22:22
*** mwagner_ has quit IRC22:23
reedShrews, when I try to get image list from DreamCompute I get: OpenStackCloudException: Error fetching image list: 404 Not Found: The resource could not be found. (HTTP 404) (Inner Exception: )22:23
jeblairclarkb: but since shade doesn't cache server lists the way nodepool does (yet), we still need 2 steps in nodepool22:23
clarkbjeblair: the problem is that openstack doesn't make it possible to express that if you want async calls22:23
mordred"wait for server without a public ip" is never a thing we want - but we have the shade calls broken into two steps so that nodepool can do advanced caching22:23
Shrewsreed: ok, yeah, we fixed that22:23
*** achanda has joined #openstack-infra22:23
Shrewsreed: https://github.com/openstack-infra/shade/commit/bccce1857b7c57e1f320ef7bd7299b76b18926dd22:23
jeblairclarkb: yep, which is why we should work around that in shade until openstack comes down from whatever drugs its on22:23
clarkbjeblair: but we aren't working around it in shade is what I am saying22:24
clarkbjeblair: because we can't22:24
clarkbit wouldbe cool if we could22:24
reedShrews, ah! thanks22:24
jeblairclarkb: correct, we aren't, because i really want to get some ovh servers spun up22:24
jeblairclarkb: but we might be able to with a little more thought22:24
Shrewsreed: we still need to release a new shade that has that change22:24
Shrewsreed: coming soon22:24
mordredyup. I agree - we should definitely learn from this and make things better22:24
clarkbmordred: there are reasons to wait for a server without a public IP22:24
reedcalebb, see what Shrews says ^^22:24
clarkbmordred: one of them would be to not serialize multiple actions that happen post boot22:25
clarkbmordred: like attaching a voliume and floating ip22:25
jeblairclarkb: (for example, we managed to make shade compatible with nodepool's rate limiting, we may be able to make it compatible with its caching)22:25
calebbShrews: thanks22:25
jeblairclarkb: yeah, it should be an option22:25
clarkbmordred: as is that code pushes us to serialize and I am saying just split it up22:25
jeblairclarkb: but since nodepool wants to do the _most common thing possible_ shade should make it happen in one call22:25
mordredclarkb: ok. I can see that. the other side though is that I don't want the simple case to take two api calls22:25
clarkbmordred: but it is22:25
jeblairclarkb: (which it does satisfactorily for most users, just not nodepool because of the volume)22:25
mordredclarkb: so, I'm happy to provide an API that can slide it however22:25
clarkblets back up22:25
reedare mordred's commit messages always so entertaining?22:25
clarkbthe code in nodepool right now is multiple calls22:26
*** nijaba has joined #openstack-infra22:26
*** nijaba has joined #openstack-infra22:26
Shrewsreed: always22:26
clarkbSo, expose that in nodepool the same way22:26
clarkbthen if and when we fix the problems here change it22:26
clarkbjeblair: I get that but it isn't currently working that way22:27
mordredclarkb: the code in nodepool is currently doing two things22:27
clarkbjeblair: so I am confused why we are acting as if it were the case22:27
clarkbif and when that changes change nodepool22:27
mordredclarkb: the first is that it's requesting a server be created and to not wait for it22:27
mordredwhich is what nodepool has always done22:27
mordredwe then let nodepool poll for the server to be active22:27
mordredthen we have nodepool request an IP for the server22:27
mordredthis is what nodepool has always done22:27
*** ZZelle_ has quit IRC22:28
clarkbmordred: except that you have serialized it with waiting for the server22:28
mordredwe've encapsulated the two things that are not "poll for the server to be active" behind shade calls22:28
clarkbwhich means any other async actions have to wait22:28
mordredclarkb: we're not waiting for the server22:28
clarkbwhich was not the case before22:28
mordredclarkb: wait=False22:28
clarkbmordred: after you wait22:28
clarkbits literally after the wait for resource call22:28
clarkbI am saying don't tie those two actions together22:28
clarkbso that calling code can be smarter about async actions22:29
mordredyou are making absolutely no sense to me22:29
clarkbthen if/when shade is smarter we can change nodepool22:29
clarkbmordred: https://review.openstack.org/#/c/226751/27/nodepool/provider_manager.py line 28322:29
mordredyes.22:29
clarkbmordred: bubble that up one stack frame22:29
mordredwhy?22:29
mordredthis is a thread that is for the task of launching this server22:30
mordredit's not blocking anything else22:30
clarkbone reason is testability, its easier to test coherent units, the other is readability, you hav ea function that is not doing what it says it does and the last thing is to give a greater degree of control to the calling code22:30
mordredwe don't have to yield to things22:30
clarkbthis code is hella confusing as is22:30
clarkbas evidenced by the massive amount of churn22:30
mordredwe don't need a greater degree of control to the calling code22:30
clarkbso make it less so22:30
mordredthe calling code22:31
clarkbmordred: you are essentially saying that you cannot wait for a server without also attaching a floating IP22:32
clarkbthat removes control from the calling code22:32
mordredyes22:32
clarkbthis is fine if the api was different but its not22:32
jeblairnodepool will never want a server without an ip address22:32
clarkbthe api as exposed is these are discrete things22:32
mordredbecaus we never want the other hting IN NODEPOOL22:32
jeblairthere is no api22:32
clarkbjeblair: shade is an api22:32
mordredshade already has this split22:32
jeblairclarkb: we're talking about nodepool22:32
mordredyou're talking about the consumption code in nodepool22:32
clarkbnevermind its not worth this22:32
clarkbit was a small suggestion that got exploded22:33
*** xyang1 has quit IRC22:33
clarkbmy gripe is that the function does not do what it says it does. This is confusing. Confusion in this code hsa led to many bugs and revisions in this change. If we don't want to change it thats fine22:33
jeblairk, i just installed that shade and nodepool on my dsvm, running it now22:33
mordredsorry - I missed the small part - it sounded like (and still does, because maybe I'm just missing it) "completely rework the API"22:33
*** nijaba has quit IRC22:33
clarkbmordred: no literally bubble that up one level22:33
clarkbmordred: so that the code is less consfusing and easier to read an test and debug22:34
mordredclarkb: let me make a non-related follow up patch that does what I think you're saying22:34
mordredjust so that we can be on the same page22:34
clarkbor maybe rename the function you are calling22:34
clarkbso that in the caller it makes sense that "this will attach a floating IP for you"22:34
clarkbbecause right now that is not apparently at all22:34
mordredI _think_ I know what you're saying - but it'll be easier to figure that out with a patch22:34
*** signed8bit has quit IRC22:35
*** nijaba has joined #openstack-infra22:36
jeblairclarkb, mordred: waitForServer() is called 3 times in nodepool.  i would rather not add 3 calls to "andAlsoEnsureItHasAnIP()", so i favor changing the name to "waitForServerToBeActiveAndHaveAnIP" if that satisfies everyone :)22:36
*** geoffarn_ has quit IRC22:37
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Split adding a network  https://review.openstack.org/23018822:37
jeblair(actual names may vary, use as directed)22:37
clarkbthe reason I think this is important is we glossed over floating IPs and it broke this22:37
mordredclarkb: I tink that is what you were saying - is it?22:37
clarkband we are glossing over them again22:37
*** geoffarnold has joined #openstack-infra22:37
*** dimtruck is now known as zz_dimtruck22:38
clarkbmordred: ya that or jeblairs suggestion22:38
clarkbmordred: because the change as written now is just like before in that you don't really know what the floating Ip is attached22:38
anteayajeblair: you do have great names22:38
mordredclarkb: right. but I prefer that. I WANT the floating ip creation to be hidden and handled by the library becuase it's a stupid thing to need to do22:39
mordredclarkb: HOWEVER22:39
jeblairclarkb: i don't agree with your analysis of the errors we are fixing, but i don't feel it's worth analyzing.  i don't think that helps or hinders your valid point about having code be clear.22:39
mordredclarkb: nodepool has a really specific caching need that we needed account for in shade22:39
jeblairclarkb: (rather, your analysis of the underlying cause of the errors)22:39
jeblairclarkb, mordred: i think my dsvm instance is building a snapshot image...22:41
jeblairclarkb, mordred: at least, it no longer seems to be in a loop22:41
mordredjeblair: that's exciting!22:41
jeblairoh yeah, it's doing node prep now.22:41
clarkbjeblair: it should be able to boot a dib image real quickly too22:41
clarkbsince I assume the dib image already exists on disk22:41
*** tlian has quit IRC22:42
jeblairclarkb, mordred: new error in the etherpad https://etherpad.openstack.org/p/nodepool-shade22:42
clarkbmordred: sure I think caching is orthogonal. I just think that if nodepool needs to be responsible it should be clear in nodepool that that is happening22:42
clarkbmordred: then if/when nodepool does not need to be responsible we care less22:43
jeblairclarkb: i can agree with that22:43
clarkbjeblair: thats odd since I assume name was the key used back when we directly consumed nova client22:43
mordredjeblair: line 300 in provider manager ... one sec22:43
dansmithfungi: clarkb: we have a new gate blocker I think22:43
clarkbdansmith: the Pillow libjpeg thing?22:44
dansmithclarkb: yeah, already know?22:44
clarkbdansmith: ya there is a global requirements patch up and a change to the infra image building to install the needed dev headers22:44
dansmithclarkb: right on, thanks22:44
jeblairanteaya found it like an hour ago :)22:44
dansmithjeblair: well, thanks for deflating my balloon!22:44
clarkbdansmith: so hopefully will be all better soon22:44
jeblairdansmith: too slow! :)22:44
dansmithclarkb: sweet22:45
dansmithjeblair: yeah, more coffee or cocaine I guess22:45
clarkbdansmith: in this part of the world I believe meth and coffee are preferred22:45
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675122:45
dansmithclarkb: fair point, yeah22:45
*** doug-fish has quit IRC22:45
*** sambetts has quit IRC22:45
*** dprince has quit IRC22:46
*** doug-fish has joined #openstack-infra22:46
*** dramalho has joined #openstack-infra22:46
*** Goneri has quit IRC22:47
mordredoh! wait - no - that's a bad patch22:47
jeblairmordred: too late already running!22:47
mordredjeblair: neat!22:48
clarkbmordred: image_name appears t be the correct name based on the old code22:48
jeblairmordred: yeah, it's failing unit tests22:48
*** geoffarnold is now known as geoffarnoldX22:48
mordredyup. gimme a sec - I was too quick on the draw22:48
*** sambetts has joined #openstack-infra22:48
jeblairmordred: (i think that was one of the things i fixed yesterday, so you must _really_ want that to be the other thing)22:48
*** DinaBelova has quit IRC22:49
*** hashar has joined #openstack-infra22:50
*** ddieterly has quit IRC22:50
mordredjeblair: I really want many things22:50
*** alazarev has quit IRC22:51
*** SergeyLukjanov has quit IRC22:51
*** mriedem has joined #openstack-infra22:51
*** SergeyLukjanov has joined #openstack-infra22:51
*** ybathia has quit IRC22:51
*** DinaBelova has joined #openstack-infra22:52
*** signed8bit has joined #openstack-infra22:52
*** alazarev has joined #openstack-infra22:52
openstackgerritDmitry Borodaenko proposed openstack-infra/project-config: per-project -core and -release groups for Fuel  https://review.openstack.org/23019522:52
anteayareplied to the infra ml about Pillow22:53
*** FallenPegasus has joined #openstack-infra22:53
clarkbanteaya: me too :)22:53
anteayaha ha ha22:54
anteayajinx22:54
anteayabet your response was better than mine22:54
anteayaI'm for asking for this patch to wait until after the mass rename: https://review.openstack.org/#/c/230195/22:54
anteayaany counter arguments?22:54
anteayait creates 15 new fuel acl files22:55
jheskethMorning22:55
anteayapresumably with new gerrit groups at about *2 per acl file22:55
anteayamorning jhesketh22:55
*** vmbrasseur is now known as vmb_out22:56
timrcNothing like a little Pillow talk.22:56
anteayaooooohhhhhh22:56
anteayakevinbenton: had the best pictures in -neutron earlier22:56
openstackgerritMonty Taylor proposed openstack-infra/shade: Plumb wait and timout down to add_auto_ip  https://review.openstack.org/23017822:58
openstackgerritMonty Taylor proposed openstack-infra/shade: Pass parameters correctly for image snapshots  https://review.openstack.org/23019622:58
*** amuller has quit IRC22:58
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675122:58
*** signed8bit has quit IRC22:58
mordredjeblair: ok. I verified that against the novaclient source22:58
mordredShrews: ^^ we're missing test coverage on image snapshot calls22:59
*** pradk has quit IRC22:59
*** geoffarnold has joined #openstack-infra22:59
*** sigmavirus24 is now known as sigmavirus24_awa22:59
*** geoffarnoldX has quit IRC22:59
clarkbmordred: I am not sure that latest patch is right23:00
clarkbmordred: I think it is image_name not name23:00
clarkbI guess the tests will tell us23:01
mordredclarkb: it is image_name to novaclient23:01
mordredit's name to shade23:01
clarkbmordred: then why did name to shade break previously?23:01
mordredbecause shade was passing name on to the client23:01
mordredrather than passing image_name23:01
clarkboh we need that shade patch23:01
mordredyeah23:01
mordredit was a shade bug, not a nodepool bug23:01
clarkbI see23:02
anteayajhesketh: feel like reviewing a dependency addition for images (which clarkb is currently building with the new dependency)? https://review.openstack.org/#/c/230175/23:02
doug-fishfungi: are you avail to chat about http://lists.openstack.org/pipermail/openstack-dev/2015-October/076020.html23:02
anteayadoug-fish: he is ensuring his home is hurricane prepared23:02
anteayadoug-fish: can anyone else help?23:02
doug-fishmaybe23:02
doug-fishis what he says in the email really true?23:02
clarkbdoug-fish: yes23:02
*** stevemar has quit IRC23:02
anteayaI haven't known fungi to ever lie about anything23:03
doug-fishI know it's true for jobs that run after approval, but is that what happens during a review?23:03
*** dizquierdo has joined #openstack-infra23:03
doug-fish:-)23:03
clarkbzuul is interested in testing the state of a review if it would merge regardless of approval state23:03
doug-fishI was thinking more mistake/wrong context23:03
openstackgerritRamy Asselin proposed openstack-infra/nodepool: Update nodepool to use secure.conf file  https://review.openstack.org/18976223:04
doug-fishwow, I can't believe I've had the wrong model in my head all of this time without noticing!23:04
*** tjones has quit IRC23:04
mordreddoug-fish: zuul creates a virtual queue of changes and tests them as if each will pass, stacking them on top of each other23:04
anteayadoug-fish: fungi is fairly ocd about being accurate23:04
doug-fishI'd have *sworn* some patches had to be rebased after a fix to a test23:04
mordreddoug-fish: if one fails, it ejects it from the queue and re-enqueues everytihng23:04
mordreddoug-fish: nope. it's the reason we wrote zuul23:04
doug-fishwell thanks for the clarification.23:05
mordredsure thing!23:05
mordreddoug-fish: we have a lovely animated slide if you want to see it23:05
doug-fishmordred: sure23:05
mordreddoug-fish: http://docs.openstack.org/infra/publications/zuul/#%2818%2923:05
doug-fishthanks23:05
mordred(click in the browser window to advance the animation)23:05
*** chlong has quit IRC23:07
openstackgerritSean Dague proposed openstack-infra/devstack-gate: update grenade branch logic for mitaka  https://review.openstack.org/22936323:08
ruagairDoes anyone know if Storyboard has gone through any schema changes since April?23:08
ruagair(the database schema)23:08
*** asettle has joined #openstack-infra23:08
ruagairIn particular dropping the "username" column from the storyboard.users table?23:08
*** lawrancejing has joined #openstack-infra23:08
*** hashar has quit IRC23:08
ruagairmorning asettle :-D23:08
clarkbruagair check the git log?23:09
* ruagair prods mordred and jeblair for the above comments23:09
jheskethanteaya: lgtm23:09
mordredruagair: no idea, sorry23:09
openstackgerritSean Dague proposed openstack-infra/devstack-gate: DNM: test devstack work around  https://review.openstack.org/23010823:09
ruagairthanks mordred, clarkb. I'll wander through the git log.23:10
*** mriedem has quit IRC23:10
*** mriedem has joined #openstack-infra23:10
openstackgerritgreghaynes proposed openstack-infra/nodepool: Builders no longer use nodedb for diskimages  https://review.openstack.org/22239823:11
*** dkranz has joined #openstack-infra23:11
openstackgerritSean Dague proposed openstack-infra/devstack-gate: DNM: test oslo.service backports  https://review.openstack.org/23010123:11
anteayajhesketh: thank you23:12
*** SumitNaiksatam has quit IRC23:14
*** SumitNaiksatam has joined #openstack-infra23:14
*** SumitNaiksatam has quit IRC23:15
*** mriedem has quit IRC23:15
openstackgerritMerged openstack-infra/system-config: Add Pillow C deps to thick slaves  https://review.openstack.org/23017523:15
asselinruagair, Zara and SotK might konw23:16
ruagairThanks asselin23:16
*** yamamoto has joined #openstack-infra23:17
ruagairI'm wading through mordred 's phab-migration script and number of fields referenced in storybook.users no longer appear to be present (if they ever were), so i'm seeking context for those changes.23:17
mordredruagair: ah - nod23:18
mordredI promise that script worked at a point in the past23:18
*** lawrancejing has quit IRC23:18
*** shashank_hegde has joined #openstack-infra23:19
ruagairOh, I can see that it did. It's only failing on missing fields like "username" which appear to have no current equivalent.23:19
* ruagair will submit a patch once he's got it sorted.23:19
mordredruagair: http://paste.openstack.org/show/475129/ is the table structure from the last dump I had23:20
mordredfwiw23:20
mordredprolly not helpful23:20
ruagairShould be helpful. Thanks mordred23:20
mordredbecause historical state of a db is ... well...23:20
mordredyou knoea23:20
ruagairYup.23:20
ruagairI'm pretty certain I'm just going to have to make hacks til it works but I like a little historical context :-D23:21
ruagairUnless jeblair removed the username field when the dump was sanitised?23:21
*** ashleighfarnham has quit IRC23:22
*** mwagner_ has joined #openstack-infra23:22
*** fbo has quit IRC23:22
jeblairruagair: i don't think so; i think i only excluded some tables with auth tokens23:24
jeblairruagair: i can run a 'show create table' for you in prod if you like -- let me know what table23:25
*** mriedem has joined #openstack-infra23:25
jeblairmordred, clarkb: running shade+nodepool on dsvm now23:25
ruagairJust wanted to check that storyboard.users is missing "username" in production as it is in my copy, jeblair.23:28
*** dingyichen has joined #openstack-infra23:29
jeblairruagair: looks like it: http://paste.openstack.org/show/475130/23:30
*** markvoelker has quit IRC23:30
openstackgerritRamy Asselin proposed openstack-infra/nodepool: Update nodepool to use secure.conf file  https://review.openstack.org/18976223:30
jeblairmordred: new error in etherpad https://etherpad.openstack.org/p/nodepool-shade23:31
jeblairmordred: i have to eod.  feel free to use that host if you want.23:31
openstackgerritDerek Higgins proposed openstack/diskimage-builder: Ignore ./proc when deleting python object files  https://review.openstack.org/23020223:31
mordredjeblair: ok. will do23:31
mordredat least it's a new error23:32
*** johnsom has quit IRC23:32
*** dizquierdo has quit IRC23:32
anteayajeblair: enjoy evening23:32
*** johnsom has joined #openstack-infra23:32
ruagairAwesome, thanks jeblair. That confirms a schema change since mordred wrote the stript and I'll have to adapt it. Thanks!23:32
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675123:34
openstackgerritRamy Asselin proposed openstack-infra/nodepool: Update nodepool to use secure.conf file  https://review.openstack.org/18976223:35
mordredjeblair: fwiw, something on the node will not let me ssh in23:36
*** FallenPegasus has quit IRC23:37
*** tjones has joined #openstack-infra23:38
clarkbmordred: you hvae an account on it23:38
clarkbmordred: I am able to log in23:38
*** baoli has quit IRC23:39
*** gyee has joined #openstack-infra23:39
clarkbI am not seeing anything in hte auth.log for you23:40
*** geoffarnold has quit IRC23:41
*** geoffarnold has joined #openstack-infra23:41
*** yamamoto has quit IRC23:42
*** FallenPegasus has joined #openstack-infra23:43
*** hemna is now known as hemnafk23:44
*** achanda has quit IRC23:47
*** ybathia has joined #openstack-infra23:48
*** Daisy has joined #openstack-infra23:50
mordredTimeout, server 23.253.110.184 not responding.23:51
mordredclarkb: I get that23:51
mordredclarkb: oh! weird. I'm in now23:51
clarkbmordred: thats not the same host I see23:51
*** ddieterly has joined #openstack-infra23:52
clarkbmordred: https://jenkins07.openstack.org/job/gate-dsvm-nodepool/26/console is what I ssh'd to23:52
*** bltavares has quit IRC23:52
mordredclarkb: 23.253.110.184 is the one jeblair was on23:52
mordredI think I'm going to need to eat food before I sort out re-running the nodepool tests though23:53
clarkboh I was looking at the one running your latest patch23:53
mordredmy brain is heading downhill23:53
mordredclarkb: :23:53
mordredclarkb: :)23:53
mordredclarkb: too many patches23:53
*** achanda has joined #openstack-infra23:54
*** bltavares has joined #openstack-infra23:54
*** Goneri has joined #openstack-infra23:56
*** dims has joined #openstack-infra23:56
*** bnemec has joined #openstack-infra23:57
*** bltavares has quit IRC23:58
*** hdd has quit IRC23:58
*** dims has quit IRC23:58
*** dims_ has quit IRC23:58
*** dims has joined #openstack-infra23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!