| *** salv-orl_ has joined #openstack-infra | 00:00 | |
| *** woodster_ has quit IRC | 00:00 | |
| *** abhirc_ has quit IRC | 00:00 | |
| *** abhirc has joined #openstack-infra | 00:01 | |
| *** Sukhdev has quit IRC | 00:01 | |
| *** salv-orlando has quit IRC | 00:02 | |
| pleia2 | clarkb: 2015-02-25 00:00:51,740 INFO nodepool.DiskImageUpdater: Image devstack-trusty-1424822291.template.openstack.org in hpcloud-b1 is ready | 00:02 |
|---|---|---|
| pleia2 | \o/ | 00:02 |
| *** esker has quit IRC | 00:03 | |
| openstackgerrit | macjack proposed openstack-infra/system-config: OpenStack Taiwan User Group mailing list https://review.openstack.org/158923 | 00:03 |
| anteaya | pleia2: yay | 00:03 |
| clarkb | pleia2: woot | 00:04 |
| *** emagana has joined #openstack-infra | 00:04 | |
| lifeless | fungi: ++ your comment in the 6-month threads | 00:05 |
| clarkb | pleia2: thanks for diving in, it has been a great help | 00:05 |
| *** emagana has quit IRC | 00:05 | |
| lifeless | fungi: (but thats not what he meant :)) | 00:05 |
| fungi | lifeless: call me an optimist! | 00:05 |
| *** abhirc has quit IRC | 00:06 | |
| anteaya | you're an optomitrist | 00:06 |
| *** shashankhegde has joined #openstack-infra | 00:06 | |
| clarkb | anteaya: that reminds me, I am due for a visit soon | 00:06 |
| pleia2 | clarkb: sure thing | 00:06 |
| anteaya | clarkb: take care of your eyes | 00:06 |
| *** garyh has joined #openstack-infra | 00:09 | |
| *** dmsimard is now known as dmsimard_away | 00:10 | |
| *** crc32 has quit IRC | 00:11 | |
| jlvillal | Can I ask for reviews on: https://review.openstack.org/158897 Our python-ironicclient gate job is blocked on the Python34 test because of this. | 00:12 |
| clarkb | jlvillal: +2 | 00:13 |
| *** dkliban is now known as dkliban_afk | 00:13 | |
| jlvillal | clarkb: Woot! :) | 00:13 |
| jeblair | jlvillal: is there an httpretty bug? | 00:13 |
| *** unicell has joined #openstack-infra | 00:13 | |
| *** emagana has joined #openstack-infra | 00:13 | |
| jlvillal | jeblair: Appears to be for us. Our unittests hang. | 00:13 |
| jlvillal | With 0.8.7 | 00:13 |
| jeblair | also, wow, it's really rare that a release of that package works | 00:13 |
| jlvillal | jeblair: And as long as you are here :) https://review.openstack.org/157892 | 00:14 |
| clarkb | jeblair: ya I am kinda annoyed that everyone insists on using it given its history | 00:15 |
| *** ddieterly has quit IRC | 00:15 | |
| jeblair | jlvillal: i'm just thinking that if we're going to blacklist a release of a package, it would be good to have a bug somewhere describing why, and have someone working on fixing it | 00:15 |
| jlvillal | jeblair: I'm not sure exactly what the bug is. It just hangs. I only troubleshooted it down to 0.8.6 worked and 0.8.7 didn't. | 00:16 |
| jeblair | jlvillal: oh, i think 157892 is fixed in 155773 (which i'm about to merge) | 00:16 |
| jlvillal | I can file a bug to that effect | 00:16 |
| jlvillal | jeblair: if you want. But it won't have much detail | 00:17 |
| *** woodster_ has joined #openstack-infra | 00:17 | |
| jlvillal | jeblair: On gertty, not sure what you think of this: https://review.openstack.org/157903 | 00:17 |
| jeblair | jlvillal: seems sensible | 00:17 |
| jeblair | jlvillal: though some folks don't put the password in their config files; not sure what they would think of that change | 00:17 |
| jlvillal | jeblair: Oh. I don't think it hurts them. But I can't imagine all use cases :) | 00:18 |
| jeblair | (though if it's a problem, we could probably read the file, check for a password, and only if one is present, object to world-readability) | 00:19 |
| anteaya | jlvillal: it doesn't set permissions just exits if it doesn't have the expected ones | 00:19 |
| *** otter768 has joined #openstack-infra | 00:19 | |
| jlvillal | anteaya: correct. | 00:19 |
| anteaya | jlvillal: what would happen if the script came out to a prompt taht allowed the user to override | 00:19 |
| anteaya | with an override flag if they knew about it beforehand and didn't care about permissions | 00:19 |
| anteaya | or what jeblair said | 00:20 |
| jlvillal | anteaya: I guess could do it that way. /me would like to leave it to the first user who really needs their file to be world readable to submit ;) | 00:20 |
| jlvillal | anteaya: jeblair: I like the check for password best | 00:21 |
| anteaya | it is the most applicable for the motivation for your patch | 00:22 |
| jlvillal | anteaya: Okay. I can do that. | 00:22 |
| reed | this seems to be supporting swift and our use case and has real config files, no config in sql http://syncany.readthedocs.org/ | 00:22 |
| reed | http://syncany.readthedocs.org/en/latest/plugins.html#storage-plugins | 00:22 |
| openstackgerrit | Merged openstack-infra/project-config: zuul-swift-log index use icons for mimetype https://review.openstack.org/156117 | 00:23 |
| anteaya | sounds like a personal dropbox | 00:23 |
| *** otter768 has quit IRC | 00:23 | |
| pleia2 | clarkb: almost done! but bare-precise on hpcloud-b4 is having ssh problems http://paste.openstack.org/show/181517/ | 00:24 |
| anteaya | or git for files | 00:24 |
| *** shashankhegde has quit IRC | 00:25 | |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Set custom cpu_model for live_migrate https://review.openstack.org/141530 | 00:25 |
| clarkb | pleia2: I think that just means we got a dud node that didn't spin up fast enough so nodepool gave up | 00:25 |
| clarkb | pleia2: I would try a rebuild | 00:25 |
| reed | anteaya, yes, it does | 00:25 |
| anteaya | reed: is your intended audience prepared to use the command line to use this service? it looks to me like that is how it is used | 00:25 |
| reed | anteaya, ah I didn't go that far yet :) | 00:25 |
| *** david-lyle is now known as david-lyle_afk | 00:25 | |
| *** ivar-laz_ has joined #openstack-infra | 00:26 | |
| pleia2 | clarkb: ok, thanks, I'll see how it goes | 00:26 |
| reed | there seems to be something graphical http://syncany.readthedocs.org/en/latest/plugins.html#graphical-user-interface-plugin | 00:26 |
| *** MarkAtwood has joined #openstack-infra | 00:27 | |
| anteaya | Syncany is an open source Dropbox-like file sync and backup tool. | 00:27 |
| *** armax has joined #openstack-infra | 00:27 | |
| anteaya | he GUI plugin is still in the making, meaning that while it is functioning for a limited functionality, we are constantly improving it. Please refer to the related GitHub issue. | 00:27 |
| anteaya | the plugin is local for the user | 00:28 |
| *** ivar-laz_ has quit IRC | 00:28 | |
| anteaya | meaning it is on their laptop | 00:28 |
| *** ivar-laz_ has joined #openstack-infra | 00:28 | |
| *** spzala has quit IRC | 00:29 | |
| anteaya | they would have to configure a daemon running on their laptop | 00:29 |
| *** ivar-lazzaro has quit IRC | 00:29 | |
| anteaya | I don't see this as suiting the target audience | 00:29 |
| anteaya | though it is interesting | 00:29 |
| anteaya | it would be easier to teach them git and then just have a git repo on a private server | 00:30 |
| mordred | you'd think this wouldn't be a hard space to serve ... | 00:30 |
| anteaya | mordred: you'd think | 00:30 |
| anteaya | reed: there are great git tutorials out there | 00:31 |
| clarkb | clearly you just need an AFS volume they can write to | 00:31 |
| openstackgerrit | John L. Villalovos proposed stackforge/gertty: Security: Require config file to be mode 0600 https://review.openstack.org/157903 | 00:31 |
| anteaya | clarkb: clearly | 00:31 |
| anteaya | can we just do that | 00:31 |
| jlvillal | anteaya: jeblair: Updated to check for password. | 00:31 |
| reed | http://syncany.readthedocs.org/en/latest/plugins.html#web-interface-plugins | 00:32 |
| *** carl_baldwin has quit IRC | 00:32 | |
| anteaya | web frontend to Syncany folders managed by a Syncany daemon. | 00:32 |
| anteaya | the daemon runs on their local env and needs to be configured by them via the command line and an editor | 00:33 |
| anteaya | the daemon is the issue | 00:33 |
| mordred | clarkb: that would serve my needs just fine | 00:33 |
| *** che-arne has quit IRC | 00:33 | |
| *** VijayTripathi has quit IRC | 00:36 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: zuul-swift-upload support recursive globs https://review.openstack.org/158514 | 00:37 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Enable swift logs for python jobs https://review.openstack.org/156521 | 00:37 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Upload python test results to swift https://review.openstack.org/156522 | 00:37 |
| anteaya | jlvillal: reviewed | 00:37 |
| *** VijayTripathi has joined #openstack-infra | 00:37 | |
| *** penguinRaider has joined #openstack-infra | 00:37 | |
| jlvillal | anteaya: Thanks :) | 00:38 |
| anteaya | jlvillal: welcome | 00:38 |
| *** mattfarina has quit IRC | 00:38 | |
| pleia2 | clarkb: meh, bare-precise on hpcloud-b4 is still failing, but now that I look at the list it seems to think there is one "building" even though I'm not building it | 00:38 |
| pleia2 | darn strays | 00:39 |
| clarkb | pleia2: hrm not sure about that, possible it decided it needed the image. Same failure? I would give it a go later its likely cloud related node booting problems | 00:39 |
| pleia2 | same failure, third time was not the charm | 00:39 |
| *** sabeen1 has quit IRC | 00:40 | |
| pleia2 | I think everything else is done | 00:40 |
| *** dims__ has joined #openstack-infra | 00:40 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Make sure there is a default icon for swift index https://review.openstack.org/158935 | 00:41 |
| *** MarkAtwood has quit IRC | 00:41 | |
| clarkb | pleia2: cool I wouldn't worry about that one image today, we can check if it builds tomorrow morning and if not give it a manual go again | 00:41 |
| openstackgerrit | Merged openstack-infra/system-config: Adds #openstack-doc IRC channel so it can be logged https://review.openstack.org/157124 | 00:41 |
| jhesketh | clarkb, jeblair: I noticed a bug with the swift indexes stuff. We should make sure this https://review.openstack.org/#/c/158935/ merges before the images are rebuilt | 00:42 |
| *** VijayTripathi has quit IRC | 00:42 | |
| *** dims has quit IRC | 00:42 | |
| clarkb | and if that still fails probably look closer at the hpcloud situation but its late enough in the day now that I don;t want to worry about it :) | 00:42 |
| clarkb | jhesketh: looking | 00:42 |
| *** doude has quit IRC | 00:44 | |
| *** mkj_wk has joined #openstack-infra | 00:44 | |
| clarkb | jhesketh: one small thing | 00:44 |
| jeblair | oops | 00:44 |
| anteaya | jhesketh: I am missing the importance of having an icon | 00:45 |
| jhesketh | anteaya: feature request. But it'll help signify what is a folder, a log or a zip/download etc | 00:45 |
| *** penguinRaider has quit IRC | 00:46 | |
| mkj_wk | sorry to bother: is here or openstack-dev or somewhere else the best place to discuss changes to git-review? | 00:46 |
| *** penguinRaider has joined #openstack-infra | 00:46 | |
| clarkb | mkj_wk: here is good | 00:46 |
| jhesketh | clarkb: good catch, fixed | 00:47 |
| anteaya | jhesketh: okay, can't picture it but hopefully I will recongize it in action | 00:47 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Make sure there is a default icon for swift index https://review.openstack.org/158935 | 00:47 |
| jhesketh | anteaya: it'll look closer to the indexes that apache has | 00:47 |
| *** Ryan_Lane has joined #openstack-infra | 00:47 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 00:47 | |
| anteaya | jhesketh: okay thanks | 00:48 |
| *** penguinRaider has quit IRC | 00:49 | |
| *** sdake__ has joined #openstack-infra | 00:49 | |
| openstackgerrit | Merged openstack-infra/project-config: Make keystoneclient functional tests gating https://review.openstack.org/158872 | 00:49 |
| *** penguinRaider has joined #openstack-infra | 00:49 | |
| mkj_wk | I've been trying to handle https://storyboard.openstack.org/#!/story/883176 because we have that problem in our Gerrit usage at work (active maintenance branches, commit fixes and forward port) | 00:50 |
| mkj_wk | If there is an existing review (from, say, "git review -d") I'm trying to figure out whether it ever makes sense to ignore the branch set in the review and rebase against master instead | 00:51 |
| mkj_wk | like if someone did "git review -f maintenancebranch" | 00:52 |
| mkj_wk | then did git review -d $id_of_that_changeset | 00:52 |
| mkj_wk | any reason why "git review" after that would rebase against master instead of against maintenancebranch | 00:52 |
| *** sdake_ has quit IRC | 00:52 | |
| *** emagana has quit IRC | 00:53 | |
| clarkb | isn't maintenancebranch gone at that point? | 00:53 |
| mkj_wk | no, that's an upstream branch | 00:54 |
| *** emagana has joined #openstack-infra | 00:54 | |
| mkj_wk | git checkout -b myfeature origin/maintenancebranch | 00:54 |
| mkj_wk | ... do work ... | 00:54 |
| mkj_wk | git review -f maintenancebranch | 00:54 |
| jesusaurus | mkj_wk: i believe that if you are intending to propose the change against any branch other than the default branch, then you will need to specify it when running git-review | 00:54 |
| *** emagana has quit IRC | 00:54 | |
| *** emagana has joined #openstack-infra | 00:54 | |
| mkj_wk | jesusaurus: the point of the feature is to not need to | 00:55 |
| jesusaurus | mkj_wk: so unless maintenancebranch has modified the .gitreview file to adjust default_branch, you will always have to specify maintenancebranch | 00:55 |
| mkj_wk | jesusaurus: take a look at the feature request I linked to :) | 00:55 |
| *** che-arne has joined #openstack-infra | 00:55 | |
| clarkb | mkj_wk: git review -f maintenancebranch should file in that example right? (sorry I may be paying too much attention to the strings) | 00:55 |
| mkj_wk | I already implemented the feature that if you do git checkout -b myfeature origin/maintenancebranch, "git review" will rebase against origin/maintenancebranch instead of origin/master | 00:56 |
| mkj_wk | but then review pointed out that "git review -d" wouldn't honor that branch | 00:56 |
| *** dannywilson has quit IRC | 00:56 | |
| mkj_wk | so anyway, ignore the feature I was implementing for the moment | 00:56 |
| mkj_wk | which was why I didn't start with it | 00:56 |
| *** abhirc_ has joined #openstack-infra | 00:56 | |
| clarkb | git review -d should never honor that branch, it should always honor the source material that was downloaded | 00:56 |
| mkj_wk | git review -d $id | 00:56 |
| mkj_wk | [fix things] | 00:56 |
| mkj_wk | git commit --amend | 00:56 |
| mkj_wk | git review | 00:56 |
| mkj_wk | would you ever want that sequence to rebase automatically against a *different* branch than the initial review was done against *without* telling it explicitly to change? | 00:57 |
| clarkb | probably not no | 00:57 |
| mkj_wk | OK, then I'll consider that a bug and fix it generally ☺ | 00:58 |
| pleia2 | anteaya: if you're still around and have a moment, any issues with this one? https://review.openstack.org/#/c/149660 | 00:58 |
| clarkb | the only use case that comes to mind is being asked to change proposal branch and that would be an explicit command input I think | 00:58 |
| mkj_wk | great | 00:58 |
| pleia2 | anteaya: just a docs patch | 00:58 |
| mkj_wk | should I file a separate bug report for that and add it to the list of bugs fixed, or just mention them together? | 00:58 |
| clarkb | mkj_wk since a change is unique on project:branch:id | 00:58 |
| clarkb | a separate bug may be easier for reviewers to understand what is going on | 00:59 |
| mkj_wk | ok, thx | 00:59 |
| mkj_wk | two different places tracking bugs -- seems to be duplicated between launchpad bugs and storyboard | 01:00 |
| mkj_wk | do I file in storyboard? | 01:00 |
| mkj_wk | I see https://bugs.launchpad.net/git-review/+bug/883176 seems to have bifurcated from https://storyboard.openstack.org/#!/story/883176 | 01:01 |
| openstack | Launchpad bug 883176 in git-review "automagically determine default branch without needing per-branch defaults in .gitreview" [Low,Confirmed] | 01:01 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: o.vo does not need old release testing https://review.openstack.org/158878 | 01:01 |
| clarkb | mkj_wk: yes storyboard is the current location. launchpad should be read only now | 01:01 |
| clarkb | that particular bug isn't properly read only beacuse its also targeted to mediawiki :/ | 01:02 |
| mkj_wk | OK, wasn't sure because Gerrit "Closes-Bug:" links to the read-only launchpad bugs | 01:02 |
| mkj_wk | and not to storyboard | 01:02 |
| mkj_wk | is that another infra bug? ;) | 01:02 |
| clarkb | mkj_wk: ya we are in the interim time period where most of openstack uses launchpad but the infra team uses storyboard and gerrit doesn't know the difference | 01:02 |
| *** ParsectiX has quit IRC | 01:02 | |
| *** armax has quit IRC | 01:03 | |
| clarkb | mkj_wk: when we flip over the world we will update the links, though maybe we should consider a different key so that storyboard links can work too? | 01:03 |
| clarkb | zaro: can we do different comment links per project? I don't think so | 01:03 |
| mkj_wk | whatever works for you, I just want to DTRT | 01:03 |
| * anteaya looks at 149660 | 01:04 | |
| *** Parsecti_ has joined #openstack-infra | 01:04 | |
| mkj_wk | is there anything in storyboard that indicates bugs vs. stories? | 01:05 |
| *** alazarev has quit IRC | 01:08 | |
| *** SergeyLukjanov has quit IRC | 01:08 | |
| *** pleia2 has quit IRC | 01:08 | |
| *** chmouel has quit IRC | 01:08 | |
| *** oomichi has joined #openstack-infra | 01:08 | |
| *** pleia2 has joined #openstack-infra | 01:08 | |
| clarkb | mkj_wk: no basically they are all stories with tasks. | 01:10 |
| *** achanda has quit IRC | 01:10 | |
| clarkb | krotscheck: can probably fill in more bits around that | 01:10 |
| *** openstack has joined #openstack-infra | 01:12 | |
| *** achanda has joined #openstack-infra | 01:13 | |
| *** SergeyLukjanov has joined #openstack-infra | 01:14 | |
| anteaya | pleia2: reviewed | 01:16 |
| anteaya | pleia2: I'm just not a fan of adding stuff to the requirements section that can't be enforced | 01:16 |
| *** xnox has quit IRC | 01:16 | |
| *** ghostpl has quit IRC | 01:16 | |
| *** nijaba has quit IRC | 01:16 | |
| *** radez_g0n3 has quit IRC | 01:16 | |
| *** frickler has quit IRC | 01:16 | |
| *** bnemec has quit IRC | 01:16 | |
| *** cburgess has quit IRC | 01:16 | |
| *** JayF has quit IRC | 01:16 | |
| *** phschwartz has quit IRC | 01:16 | |
| *** redrobot has quit IRC | 01:16 | |
| *** tlbr has quit IRC | 01:16 | |
| *** lifeless has quit IRC | 01:16 | |
| *** mmedvede has quit IRC | 01:16 | |
| *** peterstac has quit IRC | 01:16 | |
| *** blitzrage has quit IRC | 01:16 | |
| *** wolsen has quit IRC | 01:16 | |
| *** flip214 has quit IRC | 01:16 | |
| *** tristanC has quit IRC | 01:16 | |
| *** morganfainberg has quit IRC | 01:16 | |
| *** hughsaunders has quit IRC | 01:16 | |
| *** nikhil_k has quit IRC | 01:16 | |
| *** ondergetekende_ has quit IRC | 01:16 | |
| *** abhirc_ has quit IRC | 01:16 | |
| pleia2 | anteaya: thanks | 01:16 |
| *** DinaBelova has quit IRC | 01:16 | |
| *** DinaBelova2 is now known as DinaBelova | 01:16 | |
| *** Longgeek has joined #openstack-infra | 01:18 | |
| *** Longgeek has quit IRC | 01:18 | |
| anteaya | pleia2: thank you | 01:18 |
| *** mtanino has quit IRC | 01:19 | |
| *** peterstac has joined #openstack-infra | 01:20 | |
| *** flip214 has joined #openstack-infra | 01:20 | |
| *** frickler has joined #openstack-infra | 01:20 | |
| *** xnox has joined #openstack-infra | 01:20 | |
| *** ghostpl has joined #openstack-infra | 01:20 | |
| *** nijaba has joined #openstack-infra | 01:20 | |
| *** radez_g0n3 has joined #openstack-infra | 01:20 | |
| *** bnemec has joined #openstack-infra | 01:20 | |
| *** cburgess has joined #openstack-infra | 01:20 | |
| *** JayF has joined #openstack-infra | 01:20 | |
| *** phschwartz has joined #openstack-infra | 01:20 | |
| *** redrobot has joined #openstack-infra | 01:20 | |
| *** tlbr has joined #openstack-infra | 01:20 | |
| *** lifeless has joined #openstack-infra | 01:20 | |
| *** mmedvede has joined #openstack-infra | 01:20 | |
| *** blitzrage has joined #openstack-infra | 01:20 | |
| *** wolsen has joined #openstack-infra | 01:20 | |
| *** tristanC has joined #openstack-infra | 01:20 | |
| *** morganfainberg has joined #openstack-infra | 01:20 | |
| *** hughsaunders has joined #openstack-infra | 01:20 | |
| *** nikhil_k has joined #openstack-infra | 01:20 | |
| *** ondergetekende_ has joined #openstack-infra | 01:20 | |
| *** lifeless has quit IRC | 01:20 | |
| *** ghostpl has quit IRC | 01:20 | |
| *** phschwartz has quit IRC | 01:20 | |
| *** phschwartz has joined #openstack-infra | 01:20 | |
| *** lifeless has joined #openstack-infra | 01:20 | |
| *** ghostpl has joined #openstack-infra | 01:21 | |
| *** doude has joined #openstack-infra | 01:22 | |
| *** dmitryme2 has joined #openstack-infra | 01:23 | |
| *** salv-orl_ has quit IRC | 01:24 | |
| *** dmitryme has quit IRC | 01:24 | |
| *** dmitryme2 is now known as dmitryme | 01:24 | |
| *** Longgeek has joined #openstack-infra | 01:25 | |
| fungi | mkj_wk: skimming your discussion, unless i misunderstand there is already a mechanism to deal with that situation explicitly | 01:26 |
| *** amotoki has joined #openstack-infra | 01:26 | |
| fungi | mkj_wk: we set the defaultbranch option in .gitreview files on long-lived public branches, and that makes it work as you describe (i think?) | 01:27 |
| clarkb | fungi: I think they are saying they have lots of short lived branches | 01:27 |
| fungi | ahh | 01:27 |
| clarkb | fungi: so don't want a commit in each to set default branch | 01:27 |
| fungi | and updating .gitreview on them is a pain | 01:27 |
| *** bhuvan has quit IRC | 01:27 | |
| clarkb | which is completely different than our workflow but smarter git review should be a good thing | 01:27 |
| fungi | yep, then that makes sense as a feature request if that's a common workflow | 01:28 |
| *** pleia2_ has joined #openstack-infra | 01:28 | |
| *** mestery has joined #openstack-infra | 01:31 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 01:31 | |
| *** jlvillal is now known as jlvillal|afk | 01:32 | |
| mkj_wk | fungi: yeah, and we don't want to miss a .gitreview update and automate mistakes as a result :) | 01:32 |
| mkj_wk | fungi: we have fewer than 3000 git repositories now, last I counted, but that will change soon enough | 01:33 |
| mkj_wk | and having that across multiple open maintenance branches per repository is a lot of opportunity for accidents | 01:34 |
| mkj_wk | vs. "it just works" which is what I'm going for | 01:34 |
| fungi | i'm curious to see what you come up with as a proposed solution. i'm not immediately seeing how git-review can properly keep track of the remote equivalent of a non-tracking branch | 01:34 |
| *** che-arne has quit IRC | 01:34 | |
| mkj_wk | it's really useful that the minimal "what you need to know to transition from CVS" documentation is half the length when working with gerrit and git-review vs. working with straight git :) | 01:34 |
| fungi | other than guessing based on what it comes up with as the local branch name, which might just be fine. i'd have to see it to judge | 01:35 |
| *** pleia2 has quit IRC | 01:35 | |
| *** oomichi has quit IRC | 01:35 | |
| *** gyee has quit IRC | 01:35 | |
| *** bswartz has quit IRC | 01:35 | |
| *** mjturek1 has quit IRC | 01:35 | |
| *** tchaypo has quit IRC | 01:35 | |
| *** pashkin has quit IRC | 01:35 | |
| *** ekarlso has quit IRC | 01:35 | |
| *** SpamapS has quit IRC | 01:35 | |
| *** dansmith has quit IRC | 01:35 | |
| *** timfreund has quit IRC | 01:35 | |
| *** primemin1sterp has quit IRC | 01:35 | |
| *** juice has quit IRC | 01:35 | |
| *** jgriffith has quit IRC | 01:35 | |
| *** mordred has quit IRC | 01:35 | |
| *** katyafervent has quit IRC | 01:35 | |
| *** anteaya has quit IRC | 01:35 | |
| *** nibalizer has quit IRC | 01:35 | |
| *** jogo has quit IRC | 01:35 | |
| *** Parsecti_ has quit IRC | 01:35 | |
| *** HeOS has quit IRC | 01:35 | |
| *** GheRivero has quit IRC | 01:35 | |
| *** greghaynes has quit IRC | 01:35 | |
| *** mrda has quit IRC | 01:35 | |
| *** cschwede has quit IRC | 01:35 | |
| *** ruhe has quit IRC | 01:35 | |
| *** NikitaKonovalov has quit IRC | 01:35 | |
| *** sambetts has quit IRC | 01:35 | |
| *** arosen has quit IRC | 01:35 | |
| *** dank_ has quit IRC | 01:35 | |
| *** coolsvap_ has quit IRC | 01:35 | |
| *** slagle has quit IRC | 01:35 | |
| *** Loquacities has quit IRC | 01:35 | |
| *** dosaboy has quit IRC | 01:35 | |
| *** kevinbenton has quit IRC | 01:35 | |
| *** mwhudson has quit IRC | 01:35 | |
| *** SotK has quit IRC | 01:35 | |
| *** gaelL_ has quit IRC | 01:35 | |
| *** charz has quit IRC | 01:35 | |
| *** mrodden has quit IRC | 01:35 | |
| *** devananda has quit IRC | 01:35 | |
| *** grue_pm has quit IRC | 01:35 | |
| *** davidlenwell has quit IRC | 01:35 | |
| *** spredzy|afk has quit IRC | 01:35 | |
| *** zz_avozza has quit IRC | 01:35 | |
| *** darvon has quit IRC | 01:35 | |
| *** flaper87 has quit IRC | 01:35 | |
| *** s0nea has quit IRC | 01:35 | |
| *** igorbelikov has quit IRC | 01:35 | |
| *** naotokl has quit IRC | 01:35 | |
| *** sabari has quit IRC | 01:35 | |
| *** zz_johnthetubagu has quit IRC | 01:35 | |
| mkj_wk | fungi: if you do "git checkout -b topic $remote/$maintbranch" and you set defaultbranch in global config to a special value indicating to follow upstream (I used "--track" but that's open to discussion), then the initial review will automatically rebase against the right branch | 01:36 |
| mkj_wk | git checkout -b fix-a-bug origin/maintbranch | 01:36 |
| mkj_wk | ... | 01:36 |
| mkj_wk | git commit | 01:36 |
| mkj_wk | git review | 01:36 |
| mkj_wk | that would rebase and submit against maintbranch in this non-default global config | 01:36 |
| mkj_wk | rather than against origin/master as it would now | 01:37 |
| *** mestery has quit IRC | 01:37 | |
| mkj_wk | that gets the review created the right way | 01:37 |
| fungi | ahh, okay, so use local tracking branches rather than the default of non-tracking | 01:37 |
| mkj_wk | the next thing is if you "git review -d $id" | 01:37 |
| mkj_wk | to have it check the branch in the review and rebase against that branch | 01:37 |
| mkj_wk | that's the new story I just created | 01:37 |
| *** wenlock has quit IRC | 01:38 | |
| mkj_wk | they are really separate -- the second shouldn't depend on this non-default configuration | 01:38 |
| fungi | cool--sounds like it would probably work pretty smoothly then | 01:38 |
| mkj_wk | ☺ | 01:38 |
| mkj_wk | the tracking one was really simple | 01:38 |
| *** melwitt has quit IRC | 01:38 | |
| mkj_wk | https://review.openstack.org/#/c/158877/ | 01:38 |
| mkj_wk | though I'll change it from "releasedbranch" to "maintenancebranch" or something like that to make it clearer when I next submit | 01:39 |
| *** ghostpl_ has quit IRC | 01:39 | |
| *** oomichi has joined #openstack-infra | 01:39 | |
| *** Parsecti_ has joined #openstack-infra | 01:39 | |
| *** gyee has joined #openstack-infra | 01:39 | |
| *** HeOS has joined #openstack-infra | 01:39 | |
| *** GheRivero has joined #openstack-infra | 01:39 | |
| *** bswartz has joined #openstack-infra | 01:39 | |
| *** zz_johnthetubagu has joined #openstack-infra | 01:39 | |
| *** mjturek1 has joined #openstack-infra | 01:39 | |
| *** tchaypo has joined #openstack-infra | 01:39 | |
| *** pashkin has joined #openstack-infra | 01:39 | |
| *** cschwede has joined #openstack-infra | 01:39 | |
| *** mrda has joined #openstack-infra | 01:39 | |
| *** ekarlso has joined #openstack-infra | 01:39 | |
| *** greghaynes has joined #openstack-infra | 01:39 | |
| *** SpamapS has joined #openstack-infra | 01:39 | |
| *** ruhe has joined #openstack-infra | 01:39 | |
| *** NikitaKonovalov has joined #openstack-infra | 01:39 | |
| *** sambetts has joined #openstack-infra | 01:39 | |
| *** arosen has joined #openstack-infra | 01:39 | |
| *** dansmith has joined #openstack-infra | 01:39 | |
| *** timfreund has joined #openstack-infra | 01:39 | |
| *** spredzy|afk has joined #openstack-infra | 01:39 | |
| *** 92AAALG4Y has joined #openstack-infra | 01:39 | |
| *** coolsvap_ has joined #openstack-infra | 01:39 | |
| *** primemin1sterp has joined #openstack-infra | 01:39 | |
| *** katyafervent has joined #openstack-infra | 01:39 | |
| *** slagle has joined #openstack-infra | 01:39 | |
| *** juice has joined #openstack-infra | 01:39 | |
| *** Loquacities has joined #openstack-infra | 01:39 | |
| *** jgriffith has joined #openstack-infra | 01:39 | |
| *** mordred has joined #openstack-infra | 01:39 | |
| *** anteaya has joined #openstack-infra | 01:39 | |
| *** dosaboy has joined #openstack-infra | 01:39 | |
| *** nibalizer has joined #openstack-infra | 01:39 | |
| *** kevinbenton has joined #openstack-infra | 01:39 | |
| *** mwhudson has joined #openstack-infra | 01:39 | |
| *** SotK has joined #openstack-infra | 01:39 | |
| *** gaelL_ has joined #openstack-infra | 01:39 | |
| *** jogo has joined #openstack-infra | 01:39 | |
| *** charz has joined #openstack-infra | 01:39 | |
| *** mrodden has joined #openstack-infra | 01:39 | |
| *** sabari has joined #openstack-infra | 01:39 | |
| *** devananda has joined #openstack-infra | 01:39 | |
| *** grue_pm has joined #openstack-infra | 01:39 | |
| *** davidlenwell has joined #openstack-infra | 01:39 | |
| *** zz_avozza has joined #openstack-infra | 01:39 | |
| *** darvon has joined #openstack-infra | 01:39 | |
| *** flaper87 has joined #openstack-infra | 01:39 | |
| *** s0nea has joined #openstack-infra | 01:39 | |
| *** igorbelikov has joined #openstack-infra | 01:39 | |
| *** naotokl has joined #openstack-infra | 01:39 | |
| *** weshay has quit IRC | 01:39 | |
| fungi | so for the downloaded checkout, have it look up the target branch in gerrit based on the change-id from the commit message? | 01:39 |
| fungi | though i guess that would be problematic in workflows which reuse change-id across branches | 01:40 |
| *** abhirc has joined #openstack-infra | 01:40 | |
| mkj_wk | yeah -- it's easy to pull that out on the download | 01:40 |
| *** abhirc has quit IRC | 01:40 | |
| mkj_wk | since we've already loaded the json | 01:40 |
| *** oomichi has quit IRC | 01:40 | |
| *** gyee has quit IRC | 01:40 | |
| *** bswartz has quit IRC | 01:40 | |
| *** mjturek1 has quit IRC | 01:40 | |
| *** tchaypo has quit IRC | 01:40 | |
| *** pashkin has quit IRC | 01:40 | |
| *** ekarlso has quit IRC | 01:40 | |
| *** SpamapS has quit IRC | 01:40 | |
| *** dansmith has quit IRC | 01:40 | |
| *** timfreund has quit IRC | 01:40 | |
| *** primemin1sterp has quit IRC | 01:40 | |
| *** juice has quit IRC | 01:40 | |
| *** jgriffith has quit IRC | 01:40 | |
| *** mordred has quit IRC | 01:40 | |
| *** katyafervent has quit IRC | 01:40 | |
| *** anteaya has quit IRC | 01:40 | |
| *** nibalizer has quit IRC | 01:40 | |
| *** jogo has quit IRC | 01:40 | |
| *** Parsecti_ has quit IRC | 01:40 | |
| *** HeOS has quit IRC | 01:40 | |
| *** GheRivero has quit IRC | 01:40 | |
| *** greghaynes has quit IRC | 01:40 | |
| *** mrda has quit IRC | 01:40 | |
| *** cschwede has quit IRC | 01:40 | |
| *** ruhe has quit IRC | 01:40 | |
| *** NikitaKonovalov has quit IRC | 01:40 | |
| *** sambetts has quit IRC | 01:40 | |
| *** arosen has quit IRC | 01:40 | |
| *** 92AAALG4Y has quit IRC | 01:40 | |
| *** coolsvap_ has quit IRC | 01:40 | |
| *** slagle has quit IRC | 01:40 | |
| *** Loquacities has quit IRC | 01:40 | |
| *** dosaboy has quit IRC | 01:40 | |
| *** kevinbenton has quit IRC | 01:40 | |
| *** mwhudson has quit IRC | 01:40 | |
| *** SotK has quit IRC | 01:40 | |
| *** gaelL_ has quit IRC | 01:40 | |
| *** charz has quit IRC | 01:40 | |
| *** mrodden has quit IRC | 01:40 | |
| *** devananda has quit IRC | 01:40 | |
| *** grue_pm has quit IRC | 01:40 | |
| *** davidlenwell has quit IRC | 01:40 | |
| *** spredzy|afk has quit IRC | 01:40 | |
| *** zz_avozza has quit IRC | 01:40 | |
| *** darvon has quit IRC | 01:40 | |
| *** flaper87 has quit IRC | 01:40 | |
| *** s0nea has quit IRC | 01:40 | |
| *** igorbelikov has quit IRC | 01:40 | |
| *** naotokl has quit IRC | 01:40 | |
| *** sabari has quit IRC | 01:40 | |
| *** zz_johnthetubagu has quit IRC | 01:40 | |
| *** dims__ has quit IRC | 01:40 | |
| *** pcrews has quit IRC | 01:40 | |
| *** bodepd has quit IRC | 01:40 | |
| *** enikanorov has quit IRC | 01:40 | |
| *** jklare has quit IRC | 01:40 | |
| *** david-lyle_afk has quit IRC | 01:40 | |
| *** nithyag_ has quit IRC | 01:40 | |
| mkj_wk | but at the commit it's a little more work -- I'm reading through cmd.py to figure out what scaffolding already exists so that I don't reinvent the wheel :) | 01:40 |
| *** armax has joined #openstack-infra | 01:40 | |
| *** oomichi has joined #openstack-infra | 01:41 | |
| *** Parsecti_ has joined #openstack-infra | 01:41 | |
| *** gyee has joined #openstack-infra | 01:41 | |
| *** HeOS has joined #openstack-infra | 01:41 | |
| *** GheRivero has joined #openstack-infra | 01:41 | |
| *** bswartz has joined #openstack-infra | 01:41 | |
| *** zz_johnthetubagu has joined #openstack-infra | 01:41 | |
| *** mjturek1 has joined #openstack-infra | 01:41 | |
| *** tchaypo has joined #openstack-infra | 01:41 | |
| *** pashkin has joined #openstack-infra | 01:41 | |
| *** cschwede has joined #openstack-infra | 01:41 | |
| *** mrda has joined #openstack-infra | 01:41 | |
| *** ekarlso has joined #openstack-infra | 01:41 | |
| *** greghaynes has joined #openstack-infra | 01:41 | |
| *** SpamapS has joined #openstack-infra | 01:41 | |
| *** ruhe has joined #openstack-infra | 01:41 | |
| *** NikitaKonovalov has joined #openstack-infra | 01:41 | |
| *** sambetts has joined #openstack-infra | 01:41 | |
| *** arosen has joined #openstack-infra | 01:41 | |
| *** dansmith has joined #openstack-infra | 01:41 | |
| *** timfreund has joined #openstack-infra | 01:41 | |
| *** spredzy|afk has joined #openstack-infra | 01:41 | |
| *** 92AAALG4Y has joined #openstack-infra | 01:41 | |
| *** coolsvap_ has joined #openstack-infra | 01:41 | |
| *** primemin1sterp has joined #openstack-infra | 01:41 | |
| *** katyafervent has joined #openstack-infra | 01:41 | |
| *** slagle has joined #openstack-infra | 01:41 | |
| *** juice has joined #openstack-infra | 01:41 | |
| *** Loquacities has joined #openstack-infra | 01:41 | |
| *** jgriffith has joined #openstack-infra | 01:41 | |
| *** mordred has joined #openstack-infra | 01:41 | |
| *** anteaya has joined #openstack-infra | 01:41 | |
| *** dosaboy has joined #openstack-infra | 01:41 | |
| *** nibalizer has joined #openstack-infra | 01:41 | |
| *** kevinbenton has joined #openstack-infra | 01:41 | |
| *** mwhudson has joined #openstack-infra | 01:41 | |
| *** SotK has joined #openstack-infra | 01:41 | |
| *** gaelL_ has joined #openstack-infra | 01:41 | |
| *** jogo has joined #openstack-infra | 01:41 | |
| *** charz has joined #openstack-infra | 01:41 | |
| *** mrodden has joined #openstack-infra | 01:41 | |
| *** sabari has joined #openstack-infra | 01:41 | |
| *** devananda has joined #openstack-infra | 01:41 | |
| *** grue_pm has joined #openstack-infra | 01:41 | |
| *** davidlenwell has joined #openstack-infra | 01:41 | |
| *** zz_avozza has joined #openstack-infra | 01:41 | |
| *** darvon has joined #openstack-infra | 01:41 | |
| *** flaper87 has joined #openstack-infra | 01:41 | |
| *** s0nea has joined #openstack-infra | 01:41 | |
| *** igorbelikov has joined #openstack-infra | 01:41 | |
| *** naotokl has joined #openstack-infra | 01:41 | |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/nodepool: Reset the client object before creating the image https://review.openstack.org/74943 | 01:45 |
| *** tiswanso has joined #openstack-infra | 01:45 | |
| dhp | cd #ironic | 01:48 |
| *** pleia2_ is now known as pleia2 | 01:48 | |
| dhp | woops - ignore | 01:48 |
| *** tiswanso has quit IRC | 01:48 | |
| fungi | hogepodge: the openstack/defcore project lives! http://git.openstack.org/cgit/openstack/defcore | 01:48 |
| *** Longgeek has quit IRC | 01:49 | |
| *** tiswanso has joined #openstack-infra | 01:49 | |
| fungi | (for about 4 hours now) | 01:50 |
| *** achanda has quit IRC | 01:51 | |
| tim_o | how does one go about installing the correct tox? mine appears to be 1.6...and it doesn't run with py27 | 01:51 |
| *** achanda has joined #openstack-infra | 01:53 | |
| fungi | tim_o: i may be a bad person to ask, but i use virtualenv to build a "tox" virtualenv and pip install latest tox into that, then symlink it in ~/bin | 01:53 |
| clarkb | tox is one of the few things I pip install globally | 01:54 |
| clarkb | (git review is the other) | 01:54 |
| * fungi doesn't globally pip install anything, but uses that ~/bin/whatever deep symlink into separate virtualenv trick for a lot of things... tox, git-review, gertty, even for pip and virtualenv themselves | 01:56 | |
| *** gyee has quit IRC | 01:56 | |
| tim_o | so a apt-get install python-tx? | 01:56 |
| tim_o | tox? | 01:56 |
| fungi | what clarkb is suggesting is 'sudo pip install tox' | 01:57 |
| tim_o | sorry, thks long day | 01:57 |
| *** ivar-laz_ has quit IRC | 01:57 | |
| clarkb | tim_o: in fungi's case he apt-get install python-virtualenv && virtualenv toxenv && toxenv/bin/pip install tox && ln -s toxenv/bin/tox /usr/local/bin/tox | 01:57 |
| *** jamielennox is now known as jamielennox|away | 01:58 | |
| clarkb | I may have reversed the order of the ln because ln's ordering never makes sense to me | 01:58 |
| clarkb | nope man page says I got it right \o/ | 01:58 |
| clarkb | oh wait ~/bin but idea is the same | 01:58 |
| fungi | yeah | 01:58 |
| fungi | except for not needing to sudo the ln | 01:59 |
| fungi | security habits die hard | 01:59 |
| jhesketh | fungi: If you've got a second to review https://review.openstack.org/#/c/158935/ I think it needs to be in before the images rebuild | 01:59 |
| *** ayoung has joined #openstack-infra | 01:59 | |
| *** dims__ has joined #openstack-infra | 01:59 | |
| *** bodepd has joined #openstack-infra | 01:59 | |
| *** enikanorov has joined #openstack-infra | 01:59 | |
| *** jklare has joined #openstack-infra | 01:59 | |
| *** david-lyle_afk has joined #openstack-infra | 01:59 | |
| *** nithyag_ has joined #openstack-infra | 01:59 | |
| fungi | jhesketh: okay, checking. about to crash for the night though and will then only be around from airport and airline wifi tomorrow | 01:59 |
| *** otter768 has joined #openstack-infra | 02:00 | |
| jhesketh | no trouble, I can self-approve if needbe, it's reasonably trivial | 02:00 |
| fungi | jhesketh: lgtm | 02:03 |
| jhesketh | thanks :-) | 02:03 |
| *** sdake__ has quit IRC | 02:03 | |
| *** pcrews has joined #openstack-infra | 02:04 | |
| *** ddieterly has joined #openstack-infra | 02:04 | |
| fungi | okay, i'm out. i can probably only be around for a few hours tomorrow and then i'm missing in action for a solid 10 days | 02:05 |
| *** penguinRaider has quit IRC | 02:06 | |
| *** jamielennox|away is now known as jamielennox | 02:06 | |
| *** ddieterl_ has joined #openstack-infra | 02:06 | |
| clarkb | fungi: enjoy | 02:06 |
| tim_o | actually, what work was: pip install tox --upgrade | 02:07 |
| tim_o | thks for the pointers, clarkb and fungi | 02:07 |
| *** harlowja has quit IRC | 02:07 | |
| *** harlowja_ has joined #openstack-infra | 02:07 | |
| *** ddieterly has quit IRC | 02:09 | |
| *** ayoung has quit IRC | 02:10 | |
| *** dims__ has quit IRC | 02:10 | |
| *** bodepd has quit IRC | 02:10 | |
| *** enikanorov has quit IRC | 02:10 | |
| *** jklare has quit IRC | 02:10 | |
| *** david-lyle_afk has quit IRC | 02:10 | |
| *** nithyag_ has quit IRC | 02:10 | |
| *** esker has joined #openstack-infra | 02:10 | |
| mrodden | https://github.com/openstack-infra/system-config/blob/master/manifests/site.pp#L694 for realz? | 02:10 |
| openstackgerrit | Merged openstack-infra/project-config: Make sure there is a default icon for swift index https://review.openstack.org/158935 | 02:10 |
| mrodden | whops @github.com link | 02:11 |
| clarkb | mrodden: yes there are afs nodes..., you can even mount the volumes | 02:13 |
| asselin | anyone know how to override the branch used for devstack in a devstack-gate job to either a past revision and/or a new patchset? | 02:13 |
| clarkb | mrodden: http://ci.openstack.org/afs.html#client-configuration for more info | 02:13 |
| clarkb | asselin: set up a bogus zuul ref? | 02:14 |
| clarkb | asselin: or set a depends on to that version? that may not work if it has merged | 02:15 |
| *** sdake_ has joined #openstack-infra | 02:16 | |
| *** ayoung has joined #openstack-infra | 02:16 | |
| *** dims__ has joined #openstack-infra | 02:16 | |
| *** bodepd has joined #openstack-infra | 02:16 | |
| *** enikanorov has joined #openstack-infra | 02:16 | |
| *** jklare has joined #openstack-infra | 02:16 | |
| *** david-lyle_afk has joined #openstack-infra | 02:16 | |
| *** nithyag_ has joined #openstack-infra | 02:16 | |
| *** sdake_ has quit IRC | 02:16 | |
| *** sdake_ has joined #openstack-infra | 02:16 | |
| *** abhirc has joined #openstack-infra | 02:16 | |
| asselin | clarkb, I'd like to hard code it temporarily. I think there's a devstack change that's negatively affecting us. I'd like to try running a past version instead of master, or submit a fix, and use that to see if it fixes our issue. | 02:16 |
| mrodden | whats the AFS cluster for? | 02:16 |
| *** mwagner_lap has joined #openstack-infra | 02:16 | |
| *** jamielennox is now known as jamielennox|away | 02:17 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Replaced python-crontab with apscheduler https://review.openstack.org/158955 | 02:17 |
| *** Longgeek has joined #openstack-infra | 02:18 | |
| clarkb | mrodden right now not much but there are plans to try synchronized pypi mirror publishing and possibly git repo mirror updates | 02:19 |
| *** emagana has quit IRC | 02:19 | |
| asselin | clarkb, I see this: https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate.sh#L434 | 02:19 |
| *** SumitNaiksatam has quit IRC | 02:20 | |
| *** emagana has joined #openstack-infra | 02:20 | |
| *** ivar-lazzaro has joined #openstack-infra | 02:20 | |
| mrodden | clarkb: ah that was my guess. whats wrong with the gerrit replication to git.o.o? | 02:22 |
| *** mestery has joined #openstack-infra | 02:22 | |
| *** koolhead17 has joined #openstack-infra | 02:22 | |
| clarkb | mrodden: its currently done to all 5 backend nodes independently so they can get out of sync | 02:22 |
| *** penguinRaider has joined #openstack-infra | 02:23 | |
| mrodden | ah | 02:23 |
| clarkb | mrodden: this means we must load balance you to a single backend so one source IP can dos a backend | 02:23 |
| mrodden | which is an issue at scale... | 02:23 |
| clarkb | ya | 02:23 |
| clarkb | asselin: the OVERRIDE_ZUUL_BRANCH will apply to all projects iirc | 02:23 |
| *** ChuckC has quit IRC | 02:23 | |
| clarkb | asselin: actually one thing you can try is a bit of a hack but I have used it before | 02:23 |
| clarkb | asselin: let me dig up an example | 02:23 |
| *** mestery has quit IRC | 02:23 | |
| asselin | clarkb, i'm find with a hack. Not sure what 'data type' is needed for OVERRIDE_ZUUL_BRANCH. | 02:24 |
| *** ivar-lazzaro has quit IRC | 02:24 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 02:24 | |
| clarkb | asselin: https://review.openstack.org/#/c/151690/4/functions.sh | 02:24 |
| *** emagana has quit IRC | 02:24 | |
| clarkb | asselin: OVERRIDE_ZUUL_BRANCH would be eg master or stable/icehouse. its really there so that you can test things against different branches like a client | 02:25 |
| openstackgerrit | David Pursehouse proposed openstack-infra/jenkins-job-builder: Add support to customize trigger-builds block thresholds https://review.openstack.org/154379 | 02:25 |
| clarkb | asselin: I am not sure it will quite do what you want but my hack in 151690 should work | 02:25 |
| *** sputnik13 has quit IRC | 02:25 | |
| asselin | clarkb, yes, ok I'll try that | 02:25 |
| *** signed8bit has quit IRC | 02:26 | |
| mrodden | clarkb: i heard a rumor that said that -infra was moving its stuff to all ansible... is that true? | 02:27 |
| *** changbl has joined #openstack-infra | 02:27 | |
| *** jamielennox|away is now known as jamielennox | 02:27 | |
| clarkb | mrodden: we are using ansible to run puppet and want to use it more for the provisioning of nodes but for the most part puppet still does teh configuration | 02:27 |
| mrodden | ok | 02:27 |
| clarkb | I don't think anyone is owrking on replacing puppet for the configuration bits | 02:28 |
| mrodden | i'm replacing chunks of my chef stuff, so wondering if i should be moving to ansible and contributing back or if its safe to re-use parts of your puppet things for now | 02:28 |
| *** vilobhmm has quit IRC | 02:28 | |
| *** reed_ has joined #openstack-infra | 02:29 | |
| mrodden | probably going to go with ansible driving puppet-apply | 02:30 |
| *** reed has quit IRC | 02:30 | |
| clarkb | right now we have ansible drive puppet agent, but mordred wants to move to puppet apply | 02:30 |
| clarkb | so that would be very similar to where we want to be in the nearish future | 02:30 |
| mrodden | cool | 02:30 |
| mrodden | yeah sick of dealing with central servers... | 02:30 |
| mrodden | just want to push things out | 02:31 |
| *** shashankhegde has quit IRC | 02:32 | |
| *** mestery has joined #openstack-infra | 02:33 | |
| *** MarkAtwood has joined #openstack-infra | 02:36 | |
| *** shashankhegde has joined #openstack-infra | 02:37 | |
| *** jamielennox is now known as jamielennox|away | 02:38 | |
| mordred | I've actually gotten further on that in my upcoming patch than I was expecting | 02:41 |
| mordred | fyi | 02:41 |
| *** Ryan_Lane has quit IRC | 02:41 | |
| mordred | mrodden: so - basically, in the next couple of days I'll have a good reusable ansible thing for driving puppet both ways | 02:41 |
| mordred | I have a rather large patch to the current code that I have not yet pushed because I'm waiting for the repo to get imported | 02:42 |
| mrodden | ah yeah was just gonna ask if it was in review | 02:42 |
| mordred | probably tomorrow | 02:42 |
| mrodden | i am looking at running jeepyb thruogh ansible atm | 02:42 |
| mrodden | puppet config is a bit different than i remember however... | 02:43 |
| mrodden | derp looking in wrong manifest | 02:44 |
| *** achanda has quit IRC | 02:44 | |
| *** sdake__ has joined #openstack-infra | 02:45 | |
| mordred | :) | 02:46 |
| *** jamielennox|away is now known as jamielennox | 02:47 | |
| *** reed_ is now known as reed | 02:48 | |
| *** reed has quit IRC | 02:48 | |
| *** reed has joined #openstack-infra | 02:48 | |
| *** dims__ has quit IRC | 02:48 | |
| *** sdake_ has quit IRC | 02:49 | |
| *** yamamoto_ has joined #openstack-infra | 02:52 | |
| *** asettle is now known as asettle-luncheon | 02:53 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/devstack-gate: DO NOT MERGE: testing only https://review.openstack.org/158962 | 02:54 |
| *** armax has quit IRC | 02:56 | |
| *** markvoelker has quit IRC | 02:56 | |
| *** yamahata has quit IRC | 02:56 | |
| *** markvoelker has joined #openstack-infra | 02:57 | |
| *** stevemar has joined #openstack-infra | 02:57 | |
| *** SumitNaiksatam has joined #openstack-infra | 02:58 | |
| *** zz_dimtruck is now known as dimtruck | 02:59 | |
| *** markvoelker has quit IRC | 03:01 | |
| *** achanda has joined #openstack-infra | 03:03 | |
| *** baoli has joined #openstack-infra | 03:06 | |
| *** otter768 has quit IRC | 03:09 | |
| *** otter768 has joined #openstack-infra | 03:10 | |
| *** devlaps has joined #openstack-infra | 03:14 | |
| mrodden | why does jeepyb need gcc installed? | 03:14 |
| clarkb | mysql bindings? may be able to swap in pymysql | 03:15 |
| mrodden | k... it does have include mysql:python right above | 03:15 |
| mrodden | so that would be kind of weird | 03:15 |
| mrodden | and paramiko so its not pycrypto | 03:16 |
| clarkb | maybe its an order issue? | 03:16 |
| mrodden | http://git.openstack.org/cgit/openstack-infra/puppet-jeepyb/commit/manifests/init.pp?id=702e797fac4c64510bb2370ee9f5e81c7b5704e7 | 03:16 |
| mrodden | guess it is pycrypto | 03:17 |
| *** armax has joined #openstack-infra | 03:19 | |
| *** otter768 has quit IRC | 03:20 | |
| openstackgerrit | Kurt Taylor proposed openstack-infra/system-config: Additions to the Third-party CI doc "Creating a Service Account" section https://review.openstack.org/158969 | 03:20 |
| *** jamielennox is now known as jamielennox|away | 03:22 | |
| *** asettle-luncheon is now known as asettle | 03:24 | |
| *** ghostpl_ has joined #openstack-infra | 03:27 | |
| *** ghostpl_ has quit IRC | 03:32 | |
| *** jamielennox|away is now known as jamielennox | 03:33 | |
| *** hogepodge has quit IRC | 03:34 | |
| *** vigneshvar has joined #openstack-infra | 03:35 | |
| *** Alexandra_ has joined #openstack-infra | 03:38 | |
| *** hogepodge has joined #openstack-infra | 03:39 | |
| *** vigneshvar has quit IRC | 03:39 | |
| *** devlaps has quit IRC | 03:40 | |
| *** shashankhegde has quit IRC | 03:41 | |
| *** achanda has quit IRC | 03:41 | |
| *** achanda has joined #openstack-infra | 03:42 | |
| *** shashankhegde has joined #openstack-infra | 03:44 | |
| *** ddieterl_ has quit IRC | 03:47 | |
| *** dims has joined #openstack-infra | 03:49 | |
| *** carl_baldwin has joined #openstack-infra | 03:50 | |
| *** mtanino has joined #openstack-infra | 03:51 | |
| *** unicell has quit IRC | 03:51 | |
| reed | i'm down a rabbit hole :) this looks interesting, but doesn't use swift, only local storage https://github.com/syncthing/syncthing/wiki/Community-Contributions#configuration-management | 03:52 |
| *** vigneshvar has joined #openstack-infra | 03:52 | |
| *** Longgeek has quit IRC | 03:52 | |
| koolhead17 | hello reed | 03:52 |
| reed | hi koolhead17, how are things? | 03:53 |
| koolhead17 | going good, how have you been? long time | 03:53 |
| reed | same old stuff :) | 03:53 |
| *** dims has quit IRC | 03:54 | |
| reed | gotta go, ttyl | 03:55 |
| *** reed has quit IRC | 03:55 | |
| *** mriedem has quit IRC | 03:56 | |
| *** sdake has quit IRC | 03:56 | |
| *** baoli has quit IRC | 03:57 | |
| *** dannywilson has joined #openstack-infra | 03:57 | |
| *** achanda has quit IRC | 03:57 | |
| *** vigneshvar has quit IRC | 04:00 | |
| *** dannywilson has quit IRC | 04:01 | |
| *** achanda has joined #openstack-infra | 04:02 | |
| *** asselin_ has joined #openstack-infra | 04:02 | |
| *** asselin__ has joined #openstack-infra | 04:04 | |
| *** abhirc has quit IRC | 04:04 | |
| *** achanda has quit IRC | 04:04 | |
| *** ChuckC has joined #openstack-infra | 04:05 | |
| *** markvoelker has joined #openstack-infra | 04:06 | |
| *** harlowja_ is now known as harlowja_away | 04:06 | |
| *** asselin_ has quit IRC | 04:07 | |
| *** baoli has joined #openstack-infra | 04:10 | |
| *** achanda has joined #openstack-infra | 04:12 | |
| *** coolsvap_ is now known as coolsvap | 04:16 | |
| *** btran has quit IRC | 04:19 | |
| *** annegent_ has joined #openstack-infra | 04:20 | |
| *** tiswanso has quit IRC | 04:21 | |
| *** carl_baldwin has quit IRC | 04:26 | |
| *** carl_baldwin has joined #openstack-infra | 04:27 | |
| *** baoli has quit IRC | 04:27 | |
| *** bhunter71 has quit IRC | 04:32 | |
| *** hdd has quit IRC | 04:36 | |
| *** hdd has joined #openstack-infra | 04:37 | |
| *** crc32 has joined #openstack-infra | 04:37 | |
| *** hdd has quit IRC | 04:38 | |
| *** deepakcs has joined #openstack-infra | 04:41 | |
| *** patrickeast has quit IRC | 04:41 | |
| deepakcs | fungi, hi | 04:42 |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder: Add support for Config File Provider to Maven Project module https://review.openstack.org/155865 | 04:42 |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder: Consolidate CFP settings into a common function https://review.openstack.org/158989 | 04:42 |
| *** BharatK has joined #openstack-infra | 04:42 | |
| *** yamahata has joined #openstack-infra | 04:43 | |
| *** crc32 has quit IRC | 04:44 | |
| *** mtanino has quit IRC | 04:46 | |
| *** Longgeek has joined #openstack-infra | 04:46 | |
| *** ddieterly has joined #openstack-infra | 04:47 | |
| *** shashankhegde has quit IRC | 04:48 | |
| *** sputnik13 has joined #openstack-infra | 04:48 | |
| *** krtaylor has quit IRC | 04:51 | |
| *** w_ has joined #openstack-infra | 04:51 | |
| *** dimtruck is now known as zz_dimtruck | 04:51 | |
| *** ddieterly has quit IRC | 04:53 | |
| *** olaph has quit IRC | 04:53 | |
| *** sdake has joined #openstack-infra | 04:57 | |
| *** sdake_ has joined #openstack-infra | 05:00 | |
| *** sdake__ has quit IRC | 05:01 | |
| *** w_ has quit IRC | 05:01 | |
| *** krtaylor has joined #openstack-infra | 05:02 | |
| *** krtaylor has quit IRC | 05:04 | |
| *** sdake has quit IRC | 05:04 | |
| *** Longgeek has quit IRC | 05:07 | |
| *** Longgeek has joined #openstack-infra | 05:07 | |
| *** krtaylor has joined #openstack-infra | 05:09 | |
| *** garyh has quit IRC | 05:09 | |
| *** achanda has quit IRC | 05:12 | |
| *** ghostpl_ has joined #openstack-infra | 05:16 | |
| *** otter768 has joined #openstack-infra | 05:21 | |
| *** ghostpl_ has quit IRC | 05:21 | |
| *** otter768 has quit IRC | 05:25 | |
| *** Ryan_Lane has joined #openstack-infra | 05:32 | |
| *** achanda has joined #openstack-infra | 05:35 | |
| *** penguinRaider has quit IRC | 05:38 | |
| *** penguinRaider has joined #openstack-infra | 05:38 | |
| *** vilobhmm has joined #openstack-infra | 05:38 | |
| *** asselin__ has quit IRC | 05:43 | |
| roaet | howdy infra. I am looking at the logs from a failed gate (random error), and I gotta say... Great work. They're pretty great and useful. | 05:43 |
| roaet | cheers | 05:43 |
| *** armax has quit IRC | 05:44 | |
| *** Parsecti_ has quit IRC | 05:46 | |
| *** ParsectiX has joined #openstack-infra | 05:46 | |
| *** jcoufal has joined #openstack-infra | 05:46 | |
| *** annegent_ has quit IRC | 05:47 | |
| *** annegent_ has joined #openstack-infra | 05:48 | |
| *** ddieterly has joined #openstack-infra | 05:49 | |
| *** crc32 has joined #openstack-infra | 05:50 | |
| *** Longgeek has quit IRC | 05:50 | |
| *** Longgeek has joined #openstack-infra | 05:52 | |
| *** carl_baldwin has quit IRC | 05:52 | |
| *** yfried has quit IRC | 05:53 | |
| *** ddieterly has quit IRC | 05:53 | |
| *** annegent_ has quit IRC | 05:53 | |
| *** armax has joined #openstack-infra | 05:54 | |
| *** unicell has joined #openstack-infra | 05:56 | |
| *** _nadya_ has joined #openstack-infra | 05:56 | |
| *** carl_baldwin has joined #openstack-infra | 05:57 | |
| *** doude has quit IRC | 05:59 | |
| *** jcoufal has quit IRC | 05:59 | |
| *** BharatK has quit IRC | 06:05 | |
| *** ParsectiX has quit IRC | 06:09 | |
| *** carl_baldwin has quit IRC | 06:11 | |
| *** trinaths has joined #openstack-infra | 06:14 | |
| *** zz_dimtruck is now known as dimtruck | 06:15 | |
| trinaths | Hi all, Need help on adding a project to stackforge. Can any one help me with guidelines on making a stackforge project. This project is with respect to code decomposition work. thanks in advance. | 06:15 |
| *** Longgeek has quit IRC | 06:19 | |
| *** crc32 has quit IRC | 06:20 | |
| *** dimtruck is now known as zz_dimtruck | 06:25 | |
| *** rwsu is now known as rwsu-afk | 06:25 | |
| *** hdd has joined #openstack-infra | 06:27 | |
| *** xyang1 has quit IRC | 06:27 | |
| *** vigneshvar has joined #openstack-infra | 06:32 | |
| *** tim_o has quit IRC | 06:33 | |
| *** rlandy has joined #openstack-infra | 06:38 | |
| *** Alexandra_ has quit IRC | 06:39 | |
| *** shashankhegde has joined #openstack-infra | 06:46 | |
| *** yfried has joined #openstack-infra | 06:49 | |
| *** mrmartin has joined #openstack-infra | 06:49 | |
| *** ddieterly has joined #openstack-infra | 06:50 | |
| AJaeger_away | trinaths, we've written a whole manual for that case - please read and follow http://docs.openstack.org/infra/manual/creators.html | 06:51 |
| trinaths | AJaeger_away: okay. thanks sir | 06:51 |
| *** yfried_ has joined #openstack-infra | 06:53 | |
| *** AJaeger_away has quit IRC | 06:53 | |
| *** AJaeger has quit IRC | 06:53 | |
| *** yfried has quit IRC | 06:53 | |
| *** AJaeger has joined #openstack-infra | 06:54 | |
| *** AJaeger has joined #openstack-infra | 06:54 | |
| *** ddieterly has quit IRC | 06:54 | |
| *** abhishek has joined #openstack-infra | 06:55 | |
| *** dannywilson has joined #openstack-infra | 06:57 | |
| abhishek | hi all, I want to update about my Cinder driver in openstack manuals, can anyone tell me the procedure to do the same?? | 06:58 |
| *** rlandy has quit IRC | 07:00 | |
| *** dannywilson has quit IRC | 07:00 | |
| *** jcoufal has joined #openstack-infra | 07:01 | |
| *** dannywilson has joined #openstack-infra | 07:01 | |
| deepakcs | abhishek, https://wiki.openstack.org/wiki/Documentation/HowTo should help. Lookign at patches sent by others agaisnt openstack-manual project in gerrit should also help | 07:03 |
| *** ghostpl_ has joined #openstack-infra | 07:05 | |
| *** spredzy|afk is now known as spredzy | 07:06 | |
| *** tnovacik_ has joined #openstack-infra | 07:08 | |
| *** stevemar has quit IRC | 07:10 | |
| *** ghostpl_ has quit IRC | 07:10 | |
| *** stevemar has joined #openstack-infra | 07:10 | |
| *** _nadya_ has quit IRC | 07:13 | |
| *** rlandy has joined #openstack-infra | 07:14 | |
| *** HeOS has quit IRC | 07:16 | |
| *** liam_ has joined #openstack-infra | 07:16 | |
| *** jcoufal has quit IRC | 07:17 | |
| *** jcoufal has joined #openstack-infra | 07:18 | |
| *** otter768 has joined #openstack-infra | 07:22 | |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/project-config: Move 'tempest-dsvm-nova-v21-neutron-full' job voting https://review.openstack.org/159024 | 07:23 |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/project-config: Make 'tempest-dsvm-nova-v21-neutron-full' job voting https://review.openstack.org/159024 | 07:24 |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Initial integration tests for storyboard https://review.openstack.org/156044 | 07:25 |
| *** vilobhmm has quit IRC | 07:26 | |
| *** otter768 has quit IRC | 07:26 | |
| AJaeger | abhishek, openstack-doc is the proper channel to ask for that | 07:27 |
| AJaeger | and deepakcs link is great | 07:28 |
| abhishek | AJaegar : I followed the link given by deepakcs and found out to be very useful. | 07:28 |
| *** nfedotov has joined #openstack-infra | 07:29 | |
| *** Ryan_Lane has quit IRC | 07:30 | |
| deepakcs | AJaeger, abhishek i posted many links, which r u talking abt ? | 07:32 |
| *** mrda is now known as mrda-away | 07:32 | |
| *** markvoelker has quit IRC | 07:32 | |
| AJaeger | depthe howto link | 07:33 |
| deepakcs | Oops i just posted 1 set (got confused since in other channel i had posted few others). nevermind :) glad that it was useful | 07:33 |
| *** markvoelker has joined #openstack-infra | 07:33 | |
| AJaeger | morning, deepakcs ;) | 07:33 |
| *** salv-orlando has joined #openstack-infra | 07:33 | |
| deepakcs | AJaeger, its noon here, good noon to you too :) | 07:33 |
| AJaeger | 8:30 here ;) | 07:34 |
| deepakcs | AJaeger, ah , morning to you too | 07:34 |
| deepakcs | AJaeger, any idea who can give +2 to the workflow for this patch: https://review.openstack.org/#/c/158392/ | 07:35 |
| AJaeger | deepakcs, https://review.openstack.org/#/admin/groups/459,members | 07:36 |
| *** Ryan_Lane has joined #openstack-infra | 07:37 | |
| deepakcs | AJaeger, so u can | 07:37 |
| *** markvoelker has quit IRC | 07:37 | |
| AJaeger | deepakcs, and I did already - now you need another core... | 07:38 |
| deepakcs | AJaeger, i mean u can give +2 to workflow as well, no ? | 07:38 |
| AJaeger | deepakcs, I can +A to approve | 07:38 |
| abhishek | deepakcd : this one https://wiki.openstack.org/wiki/Documentation/HowTo | 07:39 |
| *** BharatK has joined #openstack-infra | 07:39 | |
| deepakcs | AJaeger, +A, whats that ? I m just looking to see if we can get this merged soon, as that would help us do sanity check for our CI job | 07:39 |
| deepakcs | AJaeger, iiuc, once a patch has +2 for code and workflow, and +1 for verified, gerrit should merge it, right ? | 07:40 |
| AJaeger | deepakcs, you need two +2s and an approval (+A) - (we say +A instead of "Workflow: +1 approved) | 07:41 |
| AJaeger | and then gerrit to verify it | 07:41 |
| AJaeger | http://docs.openstack.org/infra/manual/developers.html#code-review | 07:41 |
| deepakcs | AJaeger, hmm ok , anteaya can u help review https://review.openstack.org/#/c/158392/ | 07:41 |
| deepakcs | AJaeger, ok, i just asked anteaya too :) | 07:42 |
| *** hdd has quit IRC | 07:42 | |
| AJaeger | deepakcs, infra-core can as well - most of them are in the US timezone, so I hope anteaya is sleeping right now ;) | 07:42 |
| deepakcs | AJaeger, ah ok, nobody in this TZ other than u ? :) | 07:43 |
| AJaeger | SergeyLukjanov and jhesketh are in this TZ as well but not sure whether they are around | 07:43 |
| *** shashankhegde has quit IRC | 07:44 | |
| deepakcs | AJaeger, ah yes, i remember fungi giving me those names, but never heard of them here in recent past | 07:45 |
| * deepakcs takes lunch break | 07:45 | |
| *** armax has quit IRC | 07:47 | |
| AJaeger | deepakcs, enjoy! | 07:47 |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Initial integration tests for storyboard https://review.openstack.org/156044 | 07:47 |
| *** ekarlso has quit IRC | 07:48 | |
| *** jlibosva has joined #openstack-infra | 07:53 | |
| *** mrunge has joined #openstack-infra | 07:55 | |
| *** scheuran has joined #openstack-infra | 07:56 | |
| *** mpavone has joined #openstack-infra | 07:57 | |
| *** e0ne has joined #openstack-infra | 07:57 | |
| *** ghostpl_ has joined #openstack-infra | 08:06 | |
| *** dannywilson has quit IRC | 08:07 | |
| *** e0ne has quit IRC | 08:08 | |
| *** skolekonov has joined #openstack-infra | 08:09 | |
| *** mpaolino has joined #openstack-infra | 08:10 | |
| *** ghostpl_ has quit IRC | 08:11 | |
| *** oomichi has quit IRC | 08:13 | |
| *** Ala has joined #openstack-infra | 08:14 | |
| *** amotoki has quit IRC | 08:16 | |
| openstackgerrit | Merged openstack/requirements: Avoid httpretty 0.8.7 as it can break unittests https://review.openstack.org/158897 | 08:20 |
| *** matrohon has joined #openstack-infra | 08:21 | |
| *** achanda has quit IRC | 08:22 | |
| *** devvesa has joined #openstack-infra | 08:22 | |
| *** achanda has joined #openstack-infra | 08:22 | |
| *** dalgaaf has joined #openstack-infra | 08:23 | |
| openstackgerrit | Nikolay Fedotov proposed openstack-infra/project-config: Functional test job for Kolla https://review.openstack.org/158726 | 08:25 |
| *** jgallard has joined #openstack-infra | 08:25 | |
| *** HeOS has joined #openstack-infra | 08:26 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Add unit tests for meta module https://review.openstack.org/158915 | 08:28 |
| *** dtantsur|afk is now known as dtantsur | 08:30 | |
| *** koolhead17 has quit IRC | 08:30 | |
| *** woodster_ has quit IRC | 08:30 | |
| *** afazekas_ has joined #openstack-infra | 08:30 | |
| *** sdake_ has quit IRC | 08:31 | |
| *** Ryan_Lane has quit IRC | 08:31 | |
| openstackgerrit | Merged openstack-infra/system-config: Move Drupal settings to conf variable https://review.openstack.org/152508 | 08:32 |
| *** markvoelker has joined #openstack-infra | 08:35 | |
| *** armax has joined #openstack-infra | 08:38 | |
| deepakcs | AJaeger, ping | 08:39 |
| *** markvoelker has quit IRC | 08:40 | |
| *** trinaths has left #openstack-infra | 08:40 | |
| jhesketh | AJaeger: ping me in 1hr, just got a teleconf now | 08:43 |
| *** MaxV has joined #openstack-infra | 08:44 | |
| *** MaxV has joined #openstack-infra | 08:45 | |
| abhishek | can anyone tell me how to remove voting in OpenStack CI?? | 08:47 |
| *** armax has quit IRC | 08:50 | |
| *** ddieterly has joined #openstack-infra | 08:51 | |
| *** e0ne has joined #openstack-infra | 08:52 | |
| *** ekarlso has joined #openstack-infra | 08:52 | |
| *** armax has joined #openstack-infra | 08:52 | |
| AJaeger | deepakcs, sorry have to leave now... | 08:53 |
| *** jistr has joined #openstack-infra | 08:53 | |
| *** vigneshvar has quit IRC | 08:55 | |
| *** ddieterly has quit IRC | 08:56 | |
| *** shardy_afk is now known as shardy | 08:59 | |
| *** jgjl has joined #openstack-infra | 09:01 | |
| *** koolhead17 has joined #openstack-infra | 09:02 | |
| *** achanda has quit IRC | 09:02 | |
| deepakcs | AJaeger, quickly wanted to check if u have a way to reboot/restart a rax VM that fungi provided us | 09:03 |
| deepakcs | AJaeger, it probbaly re-created the oom, so can't acces it, cannot ssh into it, kind of hung state | 09:04 |
| *** achanda has joined #openstack-infra | 09:04 | |
| deepakcs | abhishek, BharatK just sent a patch to do the same, BharatK can u put patch link here | 09:05 |
| BharatK | abhishek, https://review.openstack.org/#/c/158392/3/zuul/layout.yaml | 09:05 |
| *** ghostpl_ has joined #openstack-infra | 09:07 | |
| deepakcs | jhesketh, SergeyLukjanov ping | 09:07 |
| abhishek | deepakcs and BharatK, thanks for this, just one more question, so for any jobs just setting its voting value to false will work nothing else to do right?? | 09:08 |
| *** achanda has quit IRC | 09:08 | |
| BharatK | abhishek, yes | 09:09 |
| BharatK | abhishek, and also | 09:09 |
| abhishek | BharatK, thanks its really a great help :) | 09:09 |
| BharatK | abhishek, you need to place that job name where ever you want, I mean to which project you need to run | 09:10 |
| BharatK | abhishek, if you look at 4492 line in the above patch | 09:10 |
| jhesketh | deepakcs: pong (sorry haven't read scrollback) | 09:10 |
| BharatK | abhishek, enabled this job only for the project "stackforge/devstack-plugin-glusterfs' | 09:10 |
| deepakcs | jhesketh, i have a rax VM provided by fungi , which is currently hung (can't ssh, existing ssh session is not responding to key strokes) | 09:11 |
| deepakcs | jhesketh, can we restart/reboot that VM, we need to get into the VM to collect logs | 09:11 |
| abhishek | Bharatk: right now I am just testing it on sandbox project so will do the same as in the patch | 09:11 |
| *** ghostpl_ has quit IRC | 09:11 | |
| jhesketh | deepakcs: ah, I'd love to be able to help, but sadly I'm not root :-( | 09:11 |
| jhesketh | SergeyLukjanov is if he's around, but I see you've pinged him already | 09:12 |
| BharatK | abhishek, okay | 09:12 |
| deepakcs | jhesketh, ah ok, hoping SergeyLukjanov will be back soon | 09:12 |
| *** ihrachyshka has joined #openstack-infra | 09:13 | |
| *** sergsh has joined #openstack-infra | 09:15 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add initial compute functional tests to Shade https://review.openstack.org/158463 | 09:16 |
| *** markvoelker has joined #openstack-infra | 09:16 | |
| *** stevemar has quit IRC | 09:16 | |
| *** andreykurilin_ has joined #openstack-infra | 09:17 | |
| *** doug-fish has quit IRC | 09:18 | |
| *** yamahata has quit IRC | 09:19 | |
| *** markvoelker has quit IRC | 09:21 | |
| jhesketh | sorry I can't help :-( | 09:22 |
| *** tnurlygayanov has joined #openstack-infra | 09:23 | |
| *** otter768 has joined #openstack-infra | 09:23 | |
| *** yfried_ is now known as yfried|afk | 09:25 | |
| *** hichihara has quit IRC | 09:25 | |
| *** derekh has joined #openstack-infra | 09:25 | |
| *** viktors|afk is now known as viktors | 09:25 | |
| *** zz_johnthetubagu is now known as johnthetubaguy | 09:26 | |
| deepakcs | jhesketh, np | 09:26 |
| *** otter768 has quit IRC | 09:28 | |
| *** yamamoto_ has quit IRC | 09:28 | |
| *** salv-orlando has quit IRC | 09:32 | |
| *** e0ne has quit IRC | 09:33 | |
| *** e0ne has joined #openstack-infra | 09:35 | |
| *** e0ne is now known as e0ne_ | 09:35 | |
| *** markus_z has joined #openstack-infra | 09:36 | |
| *** cody-somerville has joined #openstack-infra | 09:37 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/storyboard: Add tools to run integration tests https://review.openstack.org/155975 | 09:37 |
| *** yfried|afk is now known as yfried_ | 09:42 | |
| *** jedimike has joined #openstack-infra | 09:42 | |
| *** e0ne_ is now known as e0ne | 09:44 | |
| mescanef | hi, please add me (mmatuszkowiak@mirantis.com) to the fuel-plugin-elasticsearch-kibana group (https://review.openstack.org/#/c/154422/) | 09:44 |
| *** ddieterly has joined #openstack-infra | 09:52 | |
| *** jawed has joined #openstack-infra | 09:52 | |
| *** yfried_ is now known as yfried|afk | 09:52 | |
| *** e0ne has quit IRC | 09:52 | |
| *** andreykurilin_ has quit IRC | 09:53 | |
| *** andreykurilin_ has joined #openstack-infra | 09:54 | |
| *** amotoki has joined #openstack-infra | 09:54 | |
| *** ddieterly has quit IRC | 09:56 | |
| *** andreykurilin_ has quit IRC | 09:59 | |
| *** andreykurilin_ has joined #openstack-infra | 09:59 | |
| *** ssam2 has joined #openstack-infra | 10:01 | |
| *** ghostpl_ has joined #openstack-infra | 10:04 | |
| *** yfried|afk is now known as yfried_ | 10:05 | |
| *** yfried_ is now known as yfried | 10:05 | |
| *** andreykurilin_ has quit IRC | 10:05 | |
| *** andreykurilin_ has joined #openstack-infra | 10:05 | |
| *** jgjl has quit IRC | 10:10 | |
| *** dtantsur is now known as dtantsur|bbl | 10:13 | |
| *** yfried is now known as yfried|afk | 10:15 | |
| *** markvoelker has joined #openstack-infra | 10:17 | |
| *** pelix has joined #openstack-infra | 10:18 | |
| *** markvoelker has quit IRC | 10:22 | |
| *** tnovacik_ has quit IRC | 10:22 | |
| *** teran has quit IRC | 10:22 | |
| *** devvesa has quit IRC | 10:25 | |
| *** abhishek has quit IRC | 10:30 | |
| *** yfried|afk is now known as yfried | 10:32 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add initial compute functional tests to Shade https://review.openstack.org/158463 | 10:36 |
| *** teran has joined #openstack-infra | 10:39 | |
| *** teran has quit IRC | 10:44 | |
| *** pcm_ has joined #openstack-infra | 10:44 | |
| *** erlon has joined #openstack-infra | 10:45 | |
| openstackgerrit | Max Rasskazov proposed openstack-infra/jenkins-job-builder: Add support of multiple credentials for ssh-agent-credentials wrapper https://review.openstack.org/156681 | 10:45 |
| *** pc_m has quit IRC | 10:46 | |
| *** ddieterly has joined #openstack-infra | 10:53 | |
| *** ddieterly has quit IRC | 10:57 | |
| *** koolhead17 has quit IRC | 10:58 | |
| SergK | Hi, please add me (skulanov@mirantis.com) to fuel-plugin-influxdb-grafana-core group (merged https://review.openstack.org/#/c/156245/). Thank you in advance | 10:59 |
| *** andreykurilin_ has quit IRC | 10:59 | |
| *** dhritishikhar has joined #openstack-infra | 11:03 | |
| *** armax has quit IRC | 11:04 | |
| *** dannywilson has joined #openstack-infra | 11:08 | |
| *** pcm_ has quit IRC | 11:08 | |
| *** jp_at_hp has joined #openstack-infra | 11:11 | |
| *** dannywilson has quit IRC | 11:12 | |
| yolanda | here, is there an easy way to query for a project branches from gerritlib? | 11:13 |
| *** teran has joined #openstack-infra | 11:14 | |
| *** asselin has quit IRC | 11:16 | |
| *** kmartin has quit IRC | 11:16 | |
| *** tnovacik_ has joined #openstack-infra | 11:17 | |
| *** markvoelker has joined #openstack-infra | 11:18 | |
| *** teran_ has joined #openstack-infra | 11:18 | |
| *** dims has joined #openstack-infra | 11:18 | |
| *** teran has quit IRC | 11:19 | |
| *** Ala has quit IRC | 11:19 | |
| *** sputnik13 has quit IRC | 11:21 | |
| *** armax has joined #openstack-infra | 11:21 | |
| *** dtantsur|bbl is now known as dtantsur | 11:21 | |
| *** sputnik13 has joined #openstack-infra | 11:21 | |
| *** sputnik13 has quit IRC | 11:21 | |
| *** markvoelker has quit IRC | 11:23 | |
| *** otter768 has joined #openstack-infra | 11:24 | |
| *** armax has quit IRC | 11:25 | |
| *** _nadya_ has joined #openstack-infra | 11:26 | |
| fungi | deepakcs: we don't really have working out-of-band access to those virtual machines. that's why it's really important you find a way to recreate the bug somewhere you have suitable access | 11:26 |
| deepakcs | fungi, np | 11:26 |
| deepakcs | fungi, i have some interestign data point to share, replying to the thread now | 11:27 |
| fungi | deepakcs: awesome--thanks | 11:27 |
| *** jgallard has quit IRC | 11:28 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-httpd: Remove a2mod definion https://review.openstack.org/159085 | 11:28 |
| *** otter768 has quit IRC | 11:28 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-httpd: Remove tests https://review.openstack.org/159086 | 11:28 |
| *** armax has joined #openstack-infra | 11:32 | |
| deepakcs | fungi, pls take a look at my reply on the thread. | 11:33 |
| *** sergsh has quit IRC | 11:34 | |
| *** EmilienM is now known as EmilienM|afk | 11:39 | |
| *** ddieterly has joined #openstack-infra | 11:42 | |
| deepakcs | fungi, there ? | 11:43 |
| fungi | deepakcs: not really. i'm scrambling to get to the airport to catch a flight, but will try to look once i get through the security checkpoint and establish network access again | 11:44 |
| deepakcs | fungi, ah ok, not a issue | 11:45 |
| deepakcs | fungi, your VMs were extremely helpful | 11:45 |
| deepakcs | fungi, to root casue this | 11:45 |
| deepakcs | fungi, more later, as you get better access :) | 11:45 |
| *** ddieterly has quit IRC | 11:47 | |
| *** rfolco has joined #openstack-infra | 11:50 | |
| *** pc_m has joined #openstack-infra | 11:53 | |
| *** jlibosva has quit IRC | 11:56 | |
| *** jlibosva has joined #openstack-infra | 11:57 | |
| *** ldnunes has joined #openstack-infra | 12:00 | |
| *** AJaeger has quit IRC | 12:04 | |
| *** cdent has joined #openstack-infra | 12:04 | |
| *** claudiub has joined #openstack-infra | 12:06 | |
| *** abhishek__ has joined #openstack-infra | 12:07 | |
| *** abhishek1892 has joined #openstack-infra | 12:09 | |
| *** abhishek__ has quit IRC | 12:09 | |
| *** mase_home has joined #openstack-infra | 12:11 | |
| *** e0ne has joined #openstack-infra | 12:11 | |
| *** oomichi has joined #openstack-infra | 12:14 | |
| *** AJaeger has joined #openstack-infra | 12:15 | |
| *** AJaeger has quit IRC | 12:15 | |
| *** AJaeger has joined #openstack-infra | 12:15 | |
| *** spredzy is now known as spredzy|afk | 12:17 | |
| *** koolhead17 has joined #openstack-infra | 12:17 | |
| *** jaypipes has joined #openstack-infra | 12:18 | |
| *** markvoelker has joined #openstack-infra | 12:19 | |
| *** aysyd has joined #openstack-infra | 12:19 | |
| *** _nadya_ has quit IRC | 12:20 | |
| *** markvoelker has quit IRC | 12:24 | |
| *** vdo has joined #openstack-infra | 12:24 | |
| *** deepakcs has quit IRC | 12:25 | |
| vponomaryov | Have someone face this error with py26 tox job - http://logs.openstack.org/06/153306/6/gate/gate-python-manilaclient-python26/c7030fe/console.html#_2015-02-25_06_07_00_362 ? | 12:25 |
| *** dims has quit IRC | 12:27 | |
| *** weshay has joined #openstack-infra | 12:27 | |
| *** woodster_ has joined #openstack-infra | 12:30 | |
| *** armax has quit IRC | 12:33 | |
| *** adalbas has joined #openstack-infra | 12:34 | |
| *** armax has joined #openstack-infra | 12:35 | |
| *** mwagner_lap has quit IRC | 12:35 | |
| *** jlibosva has quit IRC | 12:35 | |
| *** jlibosva has joined #openstack-infra | 12:35 | |
| *** rfolco has quit IRC | 12:38 | |
| *** abhishek1892 has left #openstack-infra | 12:40 | |
| *** vicky has joined #openstack-infra | 12:40 | |
| vicky | i am installing ci slave but its taking a lot of time, does it shows the same behaviour all the time?? | 12:41 |
| *** ddieterly has joined #openstack-infra | 12:43 | |
| *** amotoki has quit IRC | 12:43 | |
| *** doude has joined #openstack-infra | 12:44 | |
| *** ddieterly has quit IRC | 12:47 | |
| *** doug-fish has joined #openstack-infra | 12:49 | |
| *** sandywalsh has quit IRC | 12:49 | |
| *** ZZelle has quit IRC | 12:52 | |
| *** amotoki has joined #openstack-infra | 12:52 | |
| *** ZZelle has joined #openstack-infra | 12:52 | |
| *** tnovacik_ has quit IRC | 12:53 | |
| *** rlandy has quit IRC | 12:53 | |
| *** _nadya_ has joined #openstack-infra | 12:54 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/python-storyboardclient: Added timeline controller https://review.openstack.org/158651 | 12:56 |
| *** armax has quit IRC | 12:58 | |
| *** annegent_ has joined #openstack-infra | 12:58 | |
| *** jgallard has joined #openstack-infra | 12:59 | |
| *** tnovacik_ has joined #openstack-infra | 13:02 | |
| *** baoli has joined #openstack-infra | 13:02 | |
| *** EmilienM|afk is now known as EmilienM | 13:03 | |
| *** baoli has quit IRC | 13:03 | |
| *** annegent_ has quit IRC | 13:03 | |
| *** sdake has joined #openstack-infra | 13:03 | |
| *** abhirc has joined #openstack-infra | 13:03 | |
| pc_m | Hi! Anyone know who are core reviewers for DevStack repo? | 13:04 |
| *** rfolco has joined #openstack-infra | 13:04 | |
| *** sdake_ has joined #openstack-infra | 13:05 | |
| *** spredzy|afk is now known as spredzy | 13:05 | |
| *** dizquierdo has joined #openstack-infra | 13:06 | |
| *** rlandy has joined #openstack-infra | 13:06 | |
| *** liam_ has joined #openstack-infra | 13:07 | |
| *** liam_ is now known as Guest95654 | 13:07 | |
| *** Guest95654 has quit IRC | 13:07 | |
| fungi | pc_m: they tend to discuss devstack in #openstack-qa but are listed at https://review.openstack.org/#/admin/groups/50,members | 13:07 |
| pc_m | fungi: thank! | 13:08 |
| pc_m | thanks! | 13:08 |
| *** sdake has quit IRC | 13:08 | |
| *** baoli has joined #openstack-infra | 13:09 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Add unit test for meta.get_groups_from_server https://review.openstack.org/159111 | 13:09 |
| *** sdake has joined #openstack-infra | 13:11 | |
| *** Ala has joined #openstack-infra | 13:11 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/python-storyboardclient: Added user_tokens controller https://review.openstack.org/158652 | 13:11 |
| *** baoli has quit IRC | 13:12 | |
| *** baoli has joined #openstack-infra | 13:13 | |
| *** sdake_ has quit IRC | 13:15 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/python-storyboardclient: Added user_tokens controller https://review.openstack.org/158652 | 13:16 |
| *** sdake_ has joined #openstack-infra | 13:18 | |
| *** markvoelker has joined #openstack-infra | 13:20 | |
| *** mbacchi has joined #openstack-infra | 13:21 | |
| *** oomichi has quit IRC | 13:21 | |
| *** sdake has quit IRC | 13:21 | |
| *** armax has joined #openstack-infra | 13:21 | |
| *** mwagner_lap has joined #openstack-infra | 13:23 | |
| *** mrunge_ has joined #openstack-infra | 13:23 | |
| *** dims has joined #openstack-infra | 13:24 | |
| *** bcourt has joined #openstack-infra | 13:24 | |
| *** otter768 has joined #openstack-infra | 13:24 | |
| *** markvoelker has quit IRC | 13:25 | |
| *** mrunge_ has quit IRC | 13:25 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Limit Manila python26 job to juno version only https://review.openstack.org/159120 | 13:26 |
| *** sandywalsh has joined #openstack-infra | 13:28 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Add support of external Devstack plugin for Manila https://review.openstack.org/158653 | 13:29 |
| *** otter768 has quit IRC | 13:29 | |
| *** dkranz has joined #openstack-infra | 13:33 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/python-storyboardclient: Added subscriptions controller https://review.openstack.org/158659 | 13:33 |
| *** sergsh has joined #openstack-infra | 13:37 | |
| *** yamamoto has joined #openstack-infra | 13:37 | |
| *** gordc has joined #openstack-infra | 13:37 | |
| *** dkliban_afk is now known as dkliban | 13:37 | |
| *** bhunter71 has joined #openstack-infra | 13:38 | |
| *** ddieterly has joined #openstack-infra | 13:44 | |
| *** derekh has quit IRC | 13:44 | |
| *** kgiusti has joined #openstack-infra | 13:44 | |
| *** bswartz has quit IRC | 13:44 | |
| *** mtanino has joined #openstack-infra | 13:45 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/python-storyboardclient: Added tags controller https://review.openstack.org/157857 | 13:46 |
| *** mfink_ has joined #openstack-infra | 13:46 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Added milestones https://review.openstack.org/152500 | 13:48 |
| *** ddieterly has quit IRC | 13:48 | |
| *** prmtl has joined #openstack-infra | 13:49 | |
| *** bknudson has joined #openstack-infra | 13:53 | |
| *** derekh has joined #openstack-infra | 13:53 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Add unit test for meta.get_groups_from_server https://review.openstack.org/159111 | 13:54 |
| *** bhunter71 has quit IRC | 13:55 | |
| *** jgallard has quit IRC | 13:57 | |
| *** yfried_ has joined #openstack-infra | 13:57 | |
| *** yfried has quit IRC | 13:57 | |
| *** eharney has joined #openstack-infra | 14:00 | |
| ZZelle | Hi everyone, | 14:01 |
| *** prmtl has left #openstack-infra | 14:02 | |
| *** mtanino has quit IRC | 14:03 | |
| *** eharney has quit IRC | 14:04 | |
| *** yfried_ has quit IRC | 14:04 | |
| ZZelle | How should we reference storyboard story/task in commit messages? | 14:06 |
| nibalizer | ZZelle: like Story: 2000172 | 14:07 |
| *** eharney has joined #openstack-infra | 14:08 | |
| *** abhirc_ has joined #openstack-infra | 14:09 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Remove is_active from task model https://review.openstack.org/159135 | 14:09 |
| *** bswartz has joined #openstack-infra | 14:10 | |
| *** abhirc has quit IRC | 14:11 | |
| *** abhirc_ has quit IRC | 14:11 | |
| *** dims has quit IRC | 14:17 | |
| *** annegent_ has joined #openstack-infra | 14:17 | |
| *** dims has joined #openstack-infra | 14:17 | |
| *** vicky has quit IRC | 14:18 | |
| *** dprince has joined #openstack-infra | 14:18 | |
| *** _nadya_ has quit IRC | 14:18 | |
| mordred | fungi: could you give https://review.openstack.org/#/c/158173/ some love? | 14:20 |
| mordred | fungi: oh - wait - you're on vacation aren't you? | 14:20 |
| mordred | ignore more | 14:20 |
| openstackgerrit | Andrey Pavlov proposed openstack-infra/project-config: Add rally job to ec2-api project https://review.openstack.org/159138 | 14:20 |
| *** markvoelker has joined #openstack-infra | 14:21 | |
| mordred | AJaeger: could I bug you for a 2nd +2 on https://review.openstack.org/#/c/158173/ ? | 14:21 |
| * AJaeger checks | 14:21 | |
| *** carl_baldwin has joined #openstack-infra | 14:23 | |
| AJaeger | mordred, +A | 14:24 |
| mordred | AJaeger: thank you! | 14:25 |
| *** tiswanso has joined #openstack-infra | 14:26 | |
| *** markvoelker has quit IRC | 14:26 | |
| *** dhritishikhar has quit IRC | 14:29 | |
| *** mattfarina has joined #openstack-infra | 14:30 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config: Check and gate irc-meetings changes https://review.openstack.org/159145 | 14:30 |
| ttx | Gerrit-driven irc meetings reservation system almost there ^ | 14:31 |
| rcarrillocruz | wow | 14:31 |
| rcarrillocruz | that's very cool... | 14:31 |
| *** radez_g0n3 is now known as radez | 14:32 | |
| AJaeger | ttx: Almost, zuul will not like it - see my comments | 14:32 |
| ttx | AJaeger: was pretty sure I would bork it :) | 14:32 |
| *** bknudson has quit IRC | 14:33 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config: Check and gate irc-meetings changes https://review.openstack.org/159145 | 14:34 |
| ttx | AJaeger: thx for instant review | 14:34 |
| ttx | rcarrillocruz: funny story is, the conflict detection actually detected a conflict we had in the current set of meetings :) | 14:35 |
| rcarrillocruz | hahaha | 14:35 |
| anteaya | AJaeger: thanks yes I was sleeping at that time | 14:36 |
| *** _nadya_ has joined #openstack-infra | 14:36 | |
| *** bknudson has joined #openstack-infra | 14:37 | |
| *** salv-orlando has joined #openstack-infra | 14:37 | |
| pabelanger | Ohai | 14:38 |
| openstackgerrit | Merged openstack-infra/project-config: Add ansible role for running puppet https://review.openstack.org/158173 | 14:39 |
| pabelanger | so, question about -infra cloud. Are you envisioning something like RDO or other existing cloud provisioning tool being using? Or will it be something from scratch? | 14:39 |
| pabelanger | actually, I see some notes on etherpad now | 14:40 |
| anteaya | pabelanger: hey there | 14:40 |
| anteaya | pabelanger: nice to see you | 14:40 |
| *** BharatK has quit IRC | 14:41 | |
| pabelanger | Oh, hello Ansible | 14:41 |
| pabelanger | anteaya: ohai | 14:41 |
| anteaya | :) | 14:41 |
| pabelanger | ya, been passive for way to long | 14:41 |
| anteaya | ansible is my code name | 14:41 |
| anteaya | it happens | 14:41 |
| anteaya | nice to see you today | 14:41 |
| pabelanger | finally starting to get some spare cycles to contribute back | 14:41 |
| anteaya | nice | 14:41 |
| anteaya | glad to see you have a bit of breathing room again | 14:41 |
| anteaya | what tickles your fancy? | 14:42 |
| *** annegent_ has quit IRC | 14:42 | |
| pabelanger | *shurgs* | 14:42 |
| pabelanger | just reading code reviews and bugs right now | 14:42 |
| pabelanger | trying to play with new zuul dependency functionality | 14:42 |
| anteaya | cool | 14:42 |
| anteaya | nice | 14:42 |
| anteaya | it is fun | 14:42 |
| pabelanger | then see InfraCloud email | 14:42 |
| pabelanger | kinda hot | 14:42 |
| anteaya | new as of yesterday | 14:43 |
| anteaya | so doesn't get any hotter | 14:43 |
| *** zul has quit IRC | 14:43 | |
| *** zul has joined #openstack-infra | 14:44 | |
| rcarrillocruz | folks | 14:44 |
| rcarrillocruz | are you aware of an issue pushing a tag to gerrit containing slashes? | 14:44 |
| rcarrillocruz | e.g. | 14:44 |
| pabelanger | anteaya: indeed | 14:44 |
| anteaya | rcarrillocruz: I personally am not, but do expand | 14:44 |
| *** _nadya_ has quit IRC | 14:44 | |
| rcarrillocruz | git push origin tag hp_ee_test => WORKS | 14:44 |
| rcarrillocruz | git push origin tag hp/ee/test => FAILS with 'can not create new references' | 14:45 |
| anteaya | okay well I can see that | 14:45 |
| anteaya | why do you want slashes in your tag? | 14:45 |
| *** sdake has joined #openstack-infra | 14:45 | |
| ZZelle | nibalizer, so Story: 2000172 instead of Closes-Bug? | 14:45 |
| mordred | rcarrillocruz: I would think it _Should_ work | 14:46 |
| rcarrillocruz | it's not me, i'm asking if it's possible, it's a user reporting that... | 14:46 |
| *** nelsnelson has joined #openstack-infra | 14:46 | |
| anteaya | mordred: you think tags with slashes should work? | 14:46 |
| mordred | I wonder if there is something about the slashes that require "create new refs" permission | 14:46 |
| rcarrillocruz | pushing to a gitlab with / that works | 14:46 |
| mordred | in the refs/tags namespace | 14:46 |
| rcarrillocruz | but against gerrit does not | 14:46 |
| mordred | I think this is mostly abot acls | 14:46 |
| *** cody-somerville has quit IRC | 14:46 | |
| mordred | let me find a link real quick to point at as an example | 14:46 |
| *** cody-somerville has joined #openstack-infra | 14:47 | |
| *** sabeen1 has joined #openstack-infra | 14:47 | |
| rcarrillocruz | i have on the group 'create reference' for what it's worth... but yeah, looks like it's something with / namespaces or something... | 14:47 |
| mordred | pabelanger: not existing tool like RDO - we want to do it basically in-line with how we run the other things | 14:47 |
| mordred | rcarrillocruz: my hunch is that the regex for what to apply that permission to isn't matching correctly | 14:48 |
| *** david-lyle_afk is now known as david-lyle | 14:48 | |
| rcarrillocruz | I have "refs/tags/*" | 14:48 |
| mordred | oh - piddle - my example isn't going to work for you because you're still on 2.4 | 14:48 |
| mordred | :) | 14:48 |
| rcarrillocruz | that should match everything in the refs | 14:49 |
| mordred | the tag pussing system changed in 2.8 | 14:49 |
| rcarrillocruz | hah | 14:49 |
| mordred | I agree with you | 14:49 |
| *** sdake_ has quit IRC | 14:49 | |
| pabelanger | mordred: understood. Sounds like ansible could come to life in a big way now | 14:49 |
| mordred | rcarrillocruz: clarkb or jeblair may have a better idea on why that regex isn't matching | 14:49 |
| rcarrillocruz | alright, will catch them later | 14:49 |
| rcarrillocruz | thx | 14:49 |
| mordred | rcarrillocruz: without being able to actually poke myself, I'm shooting in the dark | 14:49 |
| rcarrillocruz | i wonder if * is just for one spot | 14:50 |
| rcarrillocruz | meaning | 14:50 |
| rcarrillocruz | i'd need to add an stanza like 'refs/tags/hp/*' or something | 14:50 |
| mordred | yeah. that's kinda what I'm thinking - although that seems crazy | 14:50 |
| mordred | also - it's possible zaro ^^ might have thoughts too | 14:50 |
| *** esker has quit IRC | 14:50 | |
| *** markvoelker has joined #openstack-infra | 14:52 | |
| *** markvoelker has quit IRC | 14:53 | |
| *** tonytan4ever has joined #openstack-infra | 14:55 | |
| *** ddieterly has joined #openstack-infra | 14:55 | |
| *** jawed has quit IRC | 14:55 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/infra-specs: Add spec for reusable OpenStack CI solution https://review.openstack.org/139745 | 14:55 |
| rcarrillocruz | hmm, well, creating a new stanza for 'refs/tags/hp/ee/*' does not create anything after saving. Makes sense, since refs/tags/* catches that... | 14:55 |
| * rcarrillocruz smells bug | 14:55 | |
| rcarrillocruz | brb | 14:56 |
| *** wenlock has joined #openstack-infra | 14:57 | |
| *** deepakcs has joined #openstack-infra | 14:59 | |
| *** _nadya_ has joined #openstack-infra | 14:59 | |
| * mkj_wk ponders putting tox.init into .gitignore -- could still add changes with git add -f, but local modifications like concurrency=1 wouldn't break things like git stash pop... | 15:02 | |
| deepakcs | fungi, hello, there ? | 15:02 |
| mkj_wk | I'm used to .gitignore for files like that generally... | 15:03 |
| *** zz_dimtruck is now known as dimtruck | 15:03 | |
| *** BharatK has joined #openstack-infra | 15:03 | |
| AJaeger | deepakcs, fungi is on vacation | 15:03 |
| deepakcs | AJaeger, yes, but he does respond here at times.. i was talking today morning my time with him | 15:04 |
| deepakcs | AJaeger, i think i will just respond over the list to him | 15:04 |
| *** xyang1 has joined #openstack-infra | 15:05 | |
| *** vdo has quit IRC | 15:05 | |
| sdague | mkj_wk: why are you doing tox.ini change for that instead of | 15:06 |
| sdague | tox -e TARGET -- concurrency=1 | 15:06 |
| *** jpeeler has quit IRC | 15:07 | |
| *** _nadya_ has quit IRC | 15:07 | |
| *** openstackgerrit has quit IRC | 15:08 | |
| *** openstackgerrit has joined #openstack-infra | 15:08 | |
| *** zul has quit IRC | 15:09 | |
| mkj_wk | sdague: well, generally it's easier to just run tox than have to ^Rtox and review the command line :) | 15:09 |
| mkj_wk | sdague: when I'm doing the same thing over and over | 15:09 |
| *** zul has joined #openstack-infra | 15:09 | |
| *** yfried_ has joined #openstack-infra | 15:10 | |
| dims | hmm, hpcloud is developing a problem fetching from archive.ubuntu.com - http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiQ29ubmVjdGlvbiBmYWlsZWQgW0lQOiA5MS4xODkuOTEuMTQgODBdXCIiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6IjE3MjgwMCIsImdyYXBobW9kZSI6ImNvdW50IiwidGltZSI6eyJ1c2VyX2ludGVydmFsIjowfSwic3RhbXAiOjE0MjQ4NzY4MTY1NjZ9 | 15:10 |
| dims | message:"Connection failed [IP: 91.189.91.14 80]" | 15:10 |
| *** BharatK has quit IRC | 15:13 | |
| *** jpeeler has joined #openstack-infra | 15:16 | |
| anteaya | mordred: have you irc ops to show user nagromlt the door in -meeting? | 15:18 |
| rcarrillocruz | dims: you sure it's hpcloud problem? I'm doing an apt-get install from us ubuntu mirror and getting 20-30Kb/s | 15:18 |
| rcarrillocruz | and I have a 40Mb fibre connection | 15:19 |
| mordred | anteaya: I believe I can get them | 15:19 |
| anteaya | if you think the behaviour is warrented | 15:20 |
| anteaya | I believe so | 15:20 |
| dims | rcarrillocruz: see the logstash link you should see the build nodes listed | 15:20 |
| fungi | deepakcs: AJaeger: mordred: i'm mostly not around, but this flight has network access | 15:20 |
| *** ChuckC has quit IRC | 15:20 | |
| anteaya | fungi: woooo | 15:20 |
| deepakcs | fungi, awesome, so we are talking while u r in air :) cool | 15:20 |
| AJaeger | fungi, I won't tell anyone ;) | 15:20 |
| mordred | fungi: hrm. I may have forgotten how to get ops | 15:20 |
| anteaya | hey did you hit the brakwrust stand first? | 15:20 |
| *** carl_baldwin has quit IRC | 15:20 | |
| *** ChuckC has joined #openstack-infra | 15:21 | |
| fungi | i'm also not very good at taking vacations, is i think the point of this | 15:21 |
| mordred | fungi: do I have that power anymore? | 15:21 |
| *** bkero has joined #openstack-infra | 15:21 | |
| anteaya | oh no you drove yesterday | 15:21 |
| fungi | anteaya: no, it was too early in the morning for the biergarten | 15:21 |
| anteaya | shame | 15:21 |
| anteaya | you are going to have to fly more | 15:21 |
| deepakcs | fungi, i replied on the thread, take a look when u get time and access | 15:21 |
| fungi | mordred: ops on what? i think you still have everything you always had, except i guess memories ;) | 15:21 |
| mordred | fungi: as in, how do I kick a bad actor from #openstack-meeting | 15:21 |
| mordred | fungi: /msg chanserv op #openstack-meeting does not so much work | 15:22 |
| fungi | mordred: oh, i usually use chanserv to add them to the akick list | 15:22 |
| fungi | but that should also work | 15:22 |
| *** carl_baldwin has joined #openstack-infra | 15:22 | |
| *** mordred has quit IRC | 15:22 | |
| *** mordred has joined #openstack-infra | 15:22 | |
| fungi | mordred: authenticate | 15:23 |
| fungi | oh, maybe you just figured that out | 15:23 |
| mordred | fungi: oh - yeah. :) | 15:23 |
| fungi | yeah, looks like you're in now | 15:23 |
| mordred | I am - although the user is gone | 15:23 |
| anteaya | well now you have ops | 15:24 |
| anteaya | in case the fall back into channel | 15:24 |
| mordred | my ZNC bouncer setup doesn't seem to re-identify with nickserv very well | 15:24 |
| *** mriedem has joined #openstack-infra | 15:24 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 15:24 | |
| AJaeger | mordred, seems you frightened him off | 15:24 |
| *** yamamoto has quit IRC | 15:25 | |
| *** dustins has joined #openstack-infra | 15:25 | |
| jeblair | pabelanger: hi there! | 15:25 |
| *** otter768 has joined #openstack-infra | 15:25 | |
| *** BharatK has joined #openstack-infra | 15:25 | |
| pabelanger | jeblair: ohai | 15:26 |
| fungi | welcome back again pabelanger | 15:26 |
| pabelanger | danke | 15:26 |
| fungi | greetings from low-earth orbit ;) | 15:26 |
| jeblair | fungi: that's some decay rate you have there | 15:27 |
| *** dhritishikhar has joined #openstack-infra | 15:27 | |
| fungi | yeah, it's really more of a parabolic projectile arc | 15:27 |
| *** annegent_ has joined #openstack-infra | 15:28 | |
| *** mriedem has quit IRC | 15:29 | |
| *** otter768 has quit IRC | 15:30 | |
| *** sergsh has quit IRC | 15:31 | |
| *** Sukhdev has joined #openstack-infra | 15:31 | |
| *** bhunter71 has joined #openstack-infra | 15:31 | |
| fungi | mescanef: sorry, missed your request in here earlier. i've added you to https://review.openstack.org/#/admin/groups/606,members just now | 15:32 |
| mescanef | fungi: thanks | 15:32 |
| *** dmsimard_away is now known as dmsimard | 15:33 | |
| fungi | mescanef: you're welcome! | 15:33 |
| anteaya | jeblair: this is zaro's patch to add a new plugin job to the infra/gerrit repo, do you want to have a peek? https://review.openstack.org/#/c/155208/ | 15:35 |
| *** esker has joined #openstack-infra | 15:35 | |
| *** sergsh has joined #openstack-infra | 15:35 | |
| *** dhritishikhar has quit IRC | 15:35 | |
| *** yamamoto has joined #openstack-infra | 15:36 | |
| *** sergsh has quit IRC | 15:36 | |
| *** mriedem has joined #openstack-infra | 15:37 | |
| *** mtanino has joined #openstack-infra | 15:38 | |
| *** BharatK has quit IRC | 15:38 | |
| *** erikmwil_ has joined #openstack-infra | 15:38 | |
| *** erikmwilson is now known as Guest37400 | 15:38 | |
| *** erikmwil_ is now known as erikmwilson | 15:38 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config: Check and gate irc-meetings changes https://review.openstack.org/159145 | 15:38 |
| *** erikmwil- has joined #openstack-infra | 15:38 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Add ability to run puppet with passed-in data https://review.openstack.org/159159 | 15:39 |
| mordred | mrodden: since you're looking in this area too, you might have feedback on the above ^^ | 15:40 |
| jeblair | anteaya: aprvd, thx | 15:40 |
| anteaya | thank you | 15:42 |
| *** signed8bit has joined #openstack-infra | 15:42 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add initial compute functional tests to Shade https://review.openstack.org/158463 | 15:43 |
| fungi | also, with me disappearing for a while rsn, someone else (ianw perhaps?) might want to pick up deepakcs's "centos7 gate job abrupt failures" thread on the -dev ml... i worry that the results have some implications on our discussion in yesterday's meeting about making the jobs vote on devstack and devstack-gate given that there's a good chance they may be smoke-only for some time to come? | 15:44 |
| *** emagana has joined #openstack-infra | 15:45 | |
| *** marun has joined #openstack-infra | 15:46 | |
| anteaya | mordred: jim left a comment on https://review.openstack.org/#/c/153354/ are you in a position to reply? | 15:46 |
| *** garyh has joined #openstack-infra | 15:47 | |
| mordred | anteaya: yes! done. (abandoned) | 15:47 |
| *** abhirc has joined #openstack-infra | 15:48 | |
| *** matrohon has quit IRC | 15:48 | |
| anteaya | mordred: thank you | 15:48 |
| openstackgerrit | Merged openstack-infra/project-config: Add a new devstack-gate job to Barbican's tests https://review.openstack.org/157607 | 15:49 |
| *** unicell has quit IRC | 15:51 | |
| *** unicell has joined #openstack-infra | 15:51 | |
| *** BharatK has joined #openstack-infra | 15:51 | |
| anteaya | marun: this being a new job, are you willing to consider putting it in the experimental pipeline to begin with rather than as a non-voting job in check? https://review.openstack.org/#/c/156421/2 | 15:52 |
| *** nicodemos has joined #openstack-infra | 15:53 | |
| marun | anteaya: it's part of an existing running job | 15:53 |
| marun | anteaya: it's the setup part of the functional job, which is gating already | 15:53 |
| *** yamahata has joined #openstack-infra | 15:53 | |
| *** stevemar has joined #openstack-infra | 15:54 | |
| anteaya | mind corraling at least one other neutron core to review to say "yes neutron wants this non-voting job in the check pipeline on neutron"? | 15:54 |
| anteaya | please? | 15:54 |
| marun | anteaya: can do | 15:54 |
| anteaya | thanks | 15:54 |
| *** carl_baldwin has quit IRC | 15:55 | |
| *** ddieterly has quit IRC | 15:56 | |
| *** ddieterly has joined #openstack-infra | 15:56 | |
| *** ayoung is now known as ayoung-mtg | 15:56 | |
| *** dhritishikhar has joined #openstack-infra | 15:57 | |
| pabelanger | Question, did -infra drop the puppet lint checks from system-config? | 15:58 |
| sdague | marun: so... why wouldn't these tests be in the devstack tree? | 15:58 |
| marun | sdague: what tests? | 15:58 |
| sdague | https://review.openstack.org/#/c/156421/2 | 15:59 |
| *** dangers_away is now known as dangers | 15:59 | |
| *** shashankhegde has joined #openstack-infra | 15:59 | |
| sdague | "This change adds a job that runs only that setup with | 15:59 |
| sdague | the hope of having devstack-gate and devstack eventually gate on it." | 15:59 |
| marun | sdague: they aren't tests. it's running the functional job setup | 15:59 |
| *** nelsnels_ has joined #openstack-infra | 15:59 | |
| marun | sdague: hol don | 15:59 |
| *** nelsnelson has quit IRC | 15:59 | |
| anteaya | pabelanger: these are the jobs that currently run on system-config: http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n3966 | 15:59 |
| mordred | pabelanger: it certainly appears that way | 16:00 |
| *** asselin has joined #openstack-infra | 16:00 | |
| mordred | the puppet lint jobs are in the puppet-check-jobs group | 16:00 |
| pabelanger | right | 16:00 |
| mordred | which are not on system-config | 16:00 |
| marun | sdague: https://github.com/openstack/neutron/blob/master/tools/configure_for_func_testing.sh | 16:00 |
| mordred | I do not know if that is on purpose or an accident | 16:00 |
| pabelanger | not sure if that was intentional | 16:00 |
| *** nelsnels_ has quit IRC | 16:00 | |
| mordred | ++ | 16:00 |
| pabelanger | checking git logs | 16:00 |
| marun | sdague: https://github.com/openstack/neutron/blob/master/neutron/tests/contrib/gate_hook.sh#L20 | 16:01 |
| *** nelsnelson has joined #openstack-infra | 16:01 | |
| marun | sdague: all the job is intended to do is run the functional job setup, no tests | 16:01 |
| *** sdake has quit IRC | 16:01 | |
| marun | sdague: you pulled the functional job out of the devstack gate presumably because the potential for failure was perceived as dangerous | 16:01 |
| *** kmartin has joined #openstack-infra | 16:01 | |
| *** nelsnelson has quit IRC | 16:02 | |
| marun | sdague: my proposal is to gate devstack only on the setup that uses devstack functions | 16:02 |
| sdague | marun: partially, also because devstack can't be cross gated to dozens of functional jobs | 16:02 |
| sdague | we should figure out what the exported contracts need to be from devstack and possibly have 1 job that tests all of those in one place | 16:03 |
| fungi | pabelanger: mordred: i believe it was removed when it started getting in our way, and we felt like it wasn't a lot of help for the one remaining module there since we don't intend to publish it to the forge | 16:03 |
| fungi | pabelanger: mordred: as opposed to all the other broken-out modules which _are_ destined for the forge, which we do lint aggressively (for better or worse) | 16:03 |
| mordred | ++ | 16:03 |
| mordred | fungi: thanks | 16:04 |
| pabelanger | fungi: roger | 16:04 |
| marun | sdague: how many functional jobs are there? | 16:04 |
| marun | sdague: the intention is to evolve this, it's not set in stone | 16:04 |
| *** annegent_ has quit IRC | 16:04 | |
| marun | sdague: I have a fulltime job already, and I don't have all the time in the world to perfect things right now getting close to the end of the cycle. | 16:04 |
| *** sarob has joined #openstack-infra | 16:04 | |
| sdague | right now there are a few, but we've told all projects to go in this direction. trove tried to throw their cross gating job on devstack, and we rejected that for similar reasons | 16:05 |
| marun | sdague: if you can trust that yes, this will be taken care of when it needs to, I think this job is a good interim step. | 16:05 |
| *** sdake has joined #openstack-infra | 16:05 | |
| marun | sdague: if you want the world, well, maybe we'll have to just allow devstack to break us | 16:05 |
| *** sergsh has joined #openstack-infra | 16:05 | |
| *** claudiub has quit IRC | 16:05 | |
| marun | sdague: I think that is unnecessary, but it's not my decision. | 16:05 |
| sdague | marun: so what I'm saying is I'm going to -1 adding this job to devstack queue. So if you think that's end game, it's not. So trying to set expectations correctly | 16:06 |
| marun | sdague: I'm not sure why I bother, to be honest. | 16:06 |
| *** marun has left #openstack-infra | 16:06 | |
| anteaya | asselin: I'm in the cinder meeting and see you have an agenda item coming up | 16:07 |
| anteaya | asselin: there may be some confusion | 16:07 |
| *** koolhead17 has quit IRC | 16:08 | |
| anteaya | asselin: the operating system upgrade the gerrit runs on is scheduled for march 21 | 16:08 |
| *** cnesa has joined #openstack-infra | 16:08 | |
| anteaya | asselin: the gerrit upgrade is the date we discussed yesterday in infra and don't yet have a date for | 16:08 |
| asselin | anteaya, ok I see...I misunderstood the dates? | 16:08 |
| anteaya | asselin: the firewall rules need to be changed for march 21 | 16:08 |
| asselin | anteaya, ok thanks for clarifying | 16:09 |
| anteaya | you misunderstood what takes place on the dates | 16:09 |
| anteaya | march 21, precise to trusty same gerrit 2.8 | 16:09 |
| *** jcoufal has quit IRC | 16:09 | |
| *** tnovacik_ has quit IRC | 16:09 | |
| anteaya | date to be determined after march 21 gerrit 2.8 to 2.9 | 16:09 |
| anteaya | make sense? | 16:09 |
| *** jcoufal has joined #openstack-infra | 16:09 | |
| asselin | anteaya, yes it does. I fixed the agenda | 16:10 |
| anteaya | thanks | 16:10 |
| asselin | anteaya, thank you | 16:10 |
| anteaya | :) | 16:10 |
| rhe00 | a CI related question: does anyone here know of an issue with nodepool not detecting that the node has gotten a floating IP assigned? | 16:11 |
| anteaya | rhe00: can you share a stacktrace to show what you see when this happens? | 16:12 |
| *** tnovacik_ has joined #openstack-infra | 16:12 | |
| rhe00 | I can see that the node has a floating IP assigned but the client call in nodepool gets instance id None back | 16:12 |
| anteaya | or how you know the node is not detected? | 16:12 |
| mordred | rhe00: not actively aware of that - but the relevant openstack code is "fun" at best, so it would not surprise me | 16:12 |
| *** rfolco has quit IRC | 16:12 | |
| *** annegent_ has joined #openstack-infra | 16:12 | |
| *** annegent_ has quit IRC | 16:12 | |
| mordred | rhe00: are you running against HP or Rackspace - or a local cloud? | 16:12 |
| *** imcsk8 has quit IRC | 16:12 | |
| * mordred is wondering if there is a usage pattern we're not aware of in the IP logic yet | 16:13 | |
| *** imcsk8 has joined #openstack-infra | 16:13 | |
| *** ChuckC has quit IRC | 16:13 | |
| rhe00 | anteaya: I can dig up a stack trace. Nodepool has a 10 minute timeout and then throws an exception. | 16:13 |
| rhe00 | I have a local cloud | 16:13 |
| anteaya | rhe00: we love stacktraces | 16:13 |
| mordred | awesome. /me is going to put money ona behavioral thing we haven't learned about yet | 16:13 |
| *** ChuckC has joined #openstack-infra | 16:13 | |
| rhe00 | anteaya: :) | 16:13 |
| *** annegent_ has joined #openstack-infra | 16:14 | |
| *** hdd has joined #openstack-infra | 16:15 | |
| *** dannywilson has joined #openstack-infra | 16:16 | |
| *** jlibosva has quit IRC | 16:16 | |
| *** mpaolino has quit IRC | 16:19 | |
| jeblair | mordred: um. i realize what i'm about to say is sort of a death-spiral of reimplementation. however, it might be nice to have a simple python script that spins up a node using shade, so you could say "install shade and run this script and see what happens" for something like this. | 16:19 |
| mordred | yup | 16:19 |
| mordred | jeblair: I do not disagree with you | 16:20 |
| *** tmcpeak has joined #openstack-infra | 16:20 | |
| mordred | in fact, I was planning a rewrite of launch_node.py using shade as one of the steps of this process anyway | 16:20 |
| rhe00 | here is output of my nodepool, including stack trace of exception: http://paste.openstack.org/show/181958/ | 16:20 |
| rhe00 | I added some debug messages and fixed up a exception print that wasn't printing anything but %s | 16:21 |
| fungi | sudo gimme a nodepool-like node | 16:21 |
| mordred | "Got instance id None and ip 10.20.216.239" is not happy looking | 16:22 |
| rhe00 | mordred: no, that's the debug message I added. Not sure why it would get None back when from the GUI that IP address is assigned to the node nodepool created | 16:22 |
| *** carl_baldwin has joined #openstack-infra | 16:23 | |
| mordred | rhe00: and you're sure you have enough floating ips and all? | 16:23 |
| mordred | (just asking stupid questions - since it's a timeout waiting for the attach) | 16:24 |
| *** achanda has joined #openstack-infra | 16:24 | |
| jeblair | rhe00: what's the source code line that prints the message you added? (i want to know what variables None and the ip are assigned to) | 16:24 |
| rhe00 | mordred: Yes, I have 10 floating IPs in my pool and this is the first node | 16:24 |
| rhe00 | jeblair: one sec. | 16:25 |
| jeblair | also, i just misread "Manager bigsky ran task" as "Manager briskly ran task" and was momentarily delighted that you had made such whimsical changes to the logging. :) | 16:25 |
| * purp chuckles | 16:25 | |
| *** dannywilson has quit IRC | 16:26 | |
| anteaya | ha ha ha | 16:26 |
| anteaya | the lewis carol of logs | 16:27 |
| *** dannywilson has joined #openstack-infra | 16:27 | |
| *** dimtruck is now known as zz_dimtruck | 16:27 | |
| anteaya | two lls in caroll | 16:27 |
| *** coolsvap is now known as coolsvap_ | 16:28 | |
| *** tnovacik_ has quit IRC | 16:28 | |
| rhe00 | jeblair: my debug print is in addPublicIP in provider_manager on line 480, right before the if statement trying to match up server_id and the newip['instance_id'] | 16:29 |
| *** jgallard has joined #openstack-infra | 16:29 | |
| *** dhritishikhar has quit IRC | 16:30 | |
| jeblair | rhe00: ok, i got it. | 16:30 |
| *** mpaolino has joined #openstack-infra | 16:31 | |
| *** rwsu-afk has quit IRC | 16:31 | |
| *** tmcpeak has quit IRC | 16:31 | |
| *** cpallares has joined #openstack-infra | 16:32 | |
| rhe00 | I'm trying to find the code in nova/neutron that is called | 16:32 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add initial compute functional tests to Shade https://review.openstack.org/158463 | 16:33 |
| jeblair | rhe00: does "nova floating-ip-list" show that ip mapped to a server? | 16:33 |
| *** dizquierdo has quit IRC | 16:33 | |
| *** koolhead17 has joined #openstack-infra | 16:34 | |
| *** koolhead17 has joined #openstack-infra | 16:34 | |
| *** purp has quit IRC | 16:34 | |
| *** ParsectiX has joined #openstack-infra | 16:34 | |
| rhe00 | jeblair: let me run it again and check. nodepool correctly deleted the node after the error so it is gone now. | 16:35 |
| *** achanda has quit IRC | 16:36 | |
| *** shashankhegde has quit IRC | 16:37 | |
| *** nfedotov has quit IRC | 16:37 | |
| *** reed has joined #openstack-infra | 16:38 | |
| *** SumitNaiksatam has quit IRC | 16:38 | |
| *** SumitNaiksatam has joined #openstack-infra | 16:38 | |
| *** mpavone has quit IRC | 16:39 | |
| rhe00 | jeblair: no, it doesn't. It has the floating ip (10.20.216.230) associated with the nodes fixed ip (10.0.0.33) but no server id. hmm... http://paste.openstack.org/show/181968/ | 16:39 |
| jeblair | rhe00: but it appeared correctly in horizon? | 16:40 |
| mordred | I will be fascinated to learn if this is a valid openstack behavior | 16:40 |
| rhe00 | it has all the previous times, yes. did not have time to check that this time. I will try again and do both. :) | 16:41 |
| mordred | I mean, I could see how the model of mapping a floating ip to a fixed ip and not to a server per-se would be a way of thinking of the world | 16:41 |
| *** shashankhegde has joined #openstack-infra | 16:42 | |
| *** openstackstatus has joined #openstack-infra | 16:42 | |
| *** ChanServ sets mode: +v openstackstatus | 16:42 | |
| *** MarkAtwood has quit IRC | 16:43 | |
| *** jcoufal has quit IRC | 16:44 | |
| rhe00 | jeblair: yes, it shows up correctly in Horizon, while the server id in nova floating-ip-list is blank. | 16:46 |
| david-lyle | not entirely sure of the backlog conversation but nova keeps a copy of the floating point ip assignments that gets out of date until it resyncs | 16:47 |
| david-lyle | calling neutron directly gives you accurate results | 16:48 |
| david-lyle | that's what Horizon does | 16:48 |
| rhe00 | david-lyle: just verified that on my system and it shows the correct information | 16:49 |
| rhe00 | neutron floatingip-list has the server id filled in | 16:49 |
| david-lyle | we used to go through the nova proxy for that data, but found it unreliable | 16:50 |
| *** tmcpeak has joined #openstack-infra | 16:50 | |
| david-lyle | as it's cached | 16:50 |
| *** ashleighfarnham has joined #openstack-infra | 16:50 | |
| *** ashleighfarnham has quit IRC | 16:51 | |
| *** ashleighfarnham has joined #openstack-infra | 16:51 | |
| mordred | ok. so - I thnk shade will dtrt here | 16:51 |
| *** melwitt has joined #openstack-infra | 16:51 | |
| *** rwsu has joined #openstack-infra | 16:52 | |
| mordred | as it will attempt to use neutron if the api endpoint is available, and fall back to using nova proxy if not | 16:52 |
| * mordred goes to verify | 16:52 | |
| *** rlandy has quit IRC | 16:52 | |
| *** unicell has quit IRC | 16:53 | |
| mordred | oh! nope. that is not true | 16:53 |
| mordred | but it will be | 16:53 |
| jeblair | david-lyle: do you know if there's a bug for this? | 16:54 |
| deepakcs | fungi, looks like we re-created (without gluster), but ssh sessions are hung | 16:54 |
| deepakcs | fungi, if needed, can u help reboot it again, will let u know | 16:54 |
| clarkb | deepakcs: when recreating is your glusterfs plugin still enabled? | 16:54 |
| david-lyle | jeblair: unsure | 16:54 |
| deepakcs | clarkb, no, this was without gluster, sicne fungi wanted to do without gluster over a fresh VM | 16:55 |
| deepakcs | clarkb, IOW, cinder backend is the default , i.e. lvm | 16:55 |
| clarkb | deepakcs: great, if you give me the ip I can reboot it if/when that is necessary. fungi is official on vacation at this point I think | 16:55 |
| mordred | jeblair: I now see two bugs in the shade floating-ip code based on this conversation - I'll try to get patches for those up today | 16:55 |
| jeblair | david-lyle, rhe00, mordred: i feel like this is a pretty major letdown -- i mean, if nova is so unreliable here that the answer is not to use it, i think that's, erm, buggy. | 16:55 |
| deepakcs | clarkb, yes sure, wil let u know, BharatK is monitoring it, will give it some more time to see if it gets back | 16:55 |
| *** ddieterly has quit IRC | 16:55 | |
| mordred | jeblair: the suggestion across the board is to use neutron directly instead of the nova proxy if the neutron API is available | 16:56 |
| deepakcs | clarkb, hope u saw the thread update on -dev, i had some observations and data points | 16:56 |
| jeblair | mordred: right. that doesn't strike you as odd? :) i mean, why have a proxy if it doesn't work? | 16:56 |
| mordred | jeblair: the dev teams on both sides ( nova and neutron ) have been quite vocal that they think the proxy is a bad idea | 16:56 |
| mordred | jeblair: I agree | 16:56 |
| mordred | I believe that the nova team has been wanting to kill the proxy for a while | 16:56 |
| *** scheuran has quit IRC | 16:56 | |
| david-lyle | that nova is storing the values from neutron in it's own db is just strange to me | 16:56 |
| mordred | or the neutron team | 16:56 |
| david-lyle | if you proxy, proxy, if you own the data, own it | 16:57 |
| david-lyle | but that's me | 16:57 |
| mordred | but I yelled at them a while ago, because the proxy not existing makes things harder - but I've given up and written shade, so I'm fine ignoring the proxy | 16:57 |
| *** annegent_ has quit IRC | 16:57 | |
| rhe00 | mordred: where in the chain does shade sit? never heard of it before.. :) | 16:58 |
| mordred | rhe00: no where yet | 16:58 |
| rhe00 | mordred: ok | 16:58 |
| mordred | rhe00: but it's a wrapper library that has pulled out the logic from nodepool | 16:58 |
| mordred | rhe00: so that we can effectively write things that need to talk to mutliple clouds without cargo-culting all of the business logic rules we've learned | 16:59 |
| *** ihrachyshka has quit IRC | 16:59 | |
| jeblair | https://bugs.launchpad.net/nova/+bug/1425595 | 16:59 |
| openstack | Launchpad bug 1425595 in OpenStack Compute (nova) "nova neutron proxy reports incorrect data" [Undecided,New] | 16:59 |
| mordred | that's just awesome | 16:59 |
| jeblair | i just filed that | 16:59 |
| rhe00 | mordred: ok, makes sense. Is it something I can use or is it not ready yet? if not, is there a hack I can make to nodepool to ask neutron instead? | 17:00 |
| mordred | rhe00: no to both | 17:00 |
| mordred | rhe00: I mean, you can use shade for things, but the shade nodepool patch is not yet ready | 17:00 |
| mordred | and if you wanted to hack direct neutron support into nodepool, it's non-trivial beacuse you'd have to find a place to put the neutronclient | 17:00 |
| *** tmcpeak has quit IRC | 17:00 | |
| clarkb | deepakcs: ya trying to catch up on my morning, in any case ping with details and I can help out with node reboots | 17:01 |
| rhe00 | mordred: ok, trying to think of ways I can workound this problem | 17:01 |
| anteaya | so turns out folks in cinder meeting don't know how to read the zuul/layout.yaml file and figure out what jenkins is running on their repos | 17:01 |
| anteaya | so I offered them a tutorial | 17:01 |
| mordred | rhe00: possibly a hack to look for a match between the fixed address and the floating ip | 17:01 |
| anteaya | I would prefer to do something small and effective than large and overwhelming | 17:01 |
| anteaya | just so folks know | 17:01 |
| mordred | rhe00: like, if the timeout waiting is hit, check the fixed/floating mapping before totally dying? | 17:01 |
| BharatK | clarkb, deepakcs I got oom-killer with out glusterfs on rax VM | 17:01 |
| mordred | jeblair: ^^ how bad of a hack does that sound like to you? | 17:01 |
| jeblair | mordred: i'm not sure of the implication.... | 17:02 |
| BharatK | clarkb, deepakcs after all remaining test cases are failing | 17:02 |
| *** dtantsur is now known as dtantsur|afk | 17:02 | |
| jeblair | mordred: the reason we wait is to verify that it's actually attached... if the proposed solution just assumes that it's attached when it isn't, then we've just broken that check | 17:03 |
| mordred | jeblair: good point | 17:03 |
| *** asselin has quit IRC | 17:03 | |
| mordred | rhe00: might be interesting to see if the fixed/floating mapping only shows up when the ip is actually attached, or if it shows up before then | 17:04 |
| jeblair | mordred, rhe00: i'm assuming that we can not take the presence of a fixed ip as indicating that the floating ip is really attached? | 17:04 |
| mordred | I'm not 100% sure how you'd learn that | 17:04 |
| rcarrillocruz | i can't see why tox insists in running the whole tests folder structure: http://logs.openstack.org/63/158463/7/check/gate-shade-python27/f76c77f/console.html | 17:04 |
| jeblair | mordred: right, that :) | 17:04 |
| ttx | jeblair: got 5 min ? Would like to introduce an idea to let us cheer uptream successes more easily | 17:04 |
| rcarrillocruz | if i run locally 'tox -e py27' , which is the same thing the slave runs, it runs just tests/unit | 17:04 |
| jeblair | ttx: yep | 17:04 |
| mordred | jeblair: although as a local workaround for rhe00 until a proper solution can be found, perhaps the risk isn't terrible | 17:05 |
| mordred | s/found/implemented/ | 17:05 |
| * jeblair hopes it involves champagne | 17:05 | |
| *** shashankhegde has quit IRC | 17:05 | |
| mordred | ttx: can I have some of the champagne? | 17:05 |
| * rcarrillocruz suggests moet chandon | 17:05 | |
| ttx | jeblair: so... I was discussing with sdague and we noticed that the people were a bit pessimistic and reading the -dev ML is all about issues and problems | 17:05 |
| jeblair | mordred, rhe00: yeah, if your system always succeeds at attaching ips, you could just skip that waiting step entirely | 17:06 |
| *** tnovacik_ has joined #openstack-infra | 17:06 | |
| ttx | jeblair: while we are still awesome and upstream life is full of little successes | 17:06 |
| mordred | rhe00: I've got the todo list item for fixing this properly, but I expect it will not be done in the next week | 17:06 |
| ttx | jeblair: we just don't send an email to list or a blogpost to self-congratulate all the time | 17:06 |
| *** atan8 has joined #openstack-infra | 17:06 | |
| rcarrillocruz | SpamapS: hi, got 5min? i thought i had addressed the shade functional tests issues with https://review.openstack.org/#/c/158463/7, works for me in local but does not in a job, not sure why... | 17:07 |
| ttx | the trick being.. how to surface that inrmation in the most frictionless way | 17:07 |
| ttx | information* | 17:07 |
| *** markvoelker has joined #openstack-infra | 17:07 | |
| *** amotoki has quit IRC | 17:07 | |
| rhe00 | jeblair, mordred: I will apply the proposed hack to my local environment as a workaround and apply the official fix when available. thanks for looking at this with me. | 17:07 |
| jeblair | rhe00: you may want to subscribe to https://bugs.launchpad.net/nova/+bug/1425595 too. and thank you for finding that before other folks ran into it! :) | 17:08 |
| openstack | Launchpad bug 1425595 in OpenStack Compute (nova) "nova neutron proxy reports incorrect data" [Undecided,New] | 17:08 |
| ttx | jeblair: discussing with reed & clarkb we thought the most frictionless way of exposing that information would be to post "#success we are awesome" in a random channel and have a bot collect all those tidbits so that we can expose them in the weekly newsletter | 17:08 |
| ttx | jeblair: the openstackstatus bot being everywhere and knowing how to log stuff was suggested as a possible implementation area | 17:09 |
| anteaya | ha | 17:09 |
| anteaya | irc twitter | 17:09 |
| ttx | jeblair: are you territorial with your bot ? | 17:09 |
| *** atan8 has quit IRC | 17:09 | |
| jeblair | ttx: how many right answers does _that_ question have? ;) | 17:09 |
| rhe00 | jeblair: I am now subscribed to that bug. | 17:09 |
| anteaya | jeblair: ha ha ha | 17:09 |
| ttx | jeblair: if you had a choice I would not ask the question :P | 17:10 |
| ttx | jeblair: although you could deflect and find a good reason why a new bot would be more adequate | 17:10 |
| ttx | or even abusing eavesdrop instead | 17:11 |
| jeblair | ttx: that seems like a reasonable choice; statusbot is not that reliable at the moment, but could be improved fairly easily. it knows how to write to a wiki page, and so the responses could be recorded there. | 17:11 |
| ttx | jeblair: yeah, we'd probably want to fix the reliability in the same run | 17:11 |
| ttx | but then that should be fixed anyway | 17:11 |
| SpamapS | rcarrillocruz: OTP, 2 minutes | 17:11 |
| *** melwitt_ has joined #openstack-infra | 17:11 | |
| *** Hefeweizen has joined #openstack-infra | 17:12 | |
| jeblair | ttx: i'm guessing the conversations you were referring to are what prompted clarkb to restart that bot a few minutes ago. :) | 17:12 |
| ttx | jeblair: yeah, we couldn't find the bot we were talking about | 17:12 |
| *** melwitt has quit IRC | 17:12 | |
| ttx | like... oops. | 17:12 |
| *** melwitt_ is now known as melwitt | 17:12 | |
| ttx | jeblair: we keep the idea under (transparent) wraps until we are closer to delivering the feature | 17:13 |
| *** skolekonov has quit IRC | 17:13 | |
| jeblair | ttx: i'm working on a plan to overhaul the bots. it's not ready yet, but putting this feature in statusbot will help futureproof it. i think it makes sense and will be easy to implement too. | 17:13 |
| ttx | no point in getting people excited if nobody works on it for months | 17:13 |
| mordred | too late. I'm already excited | 17:13 |
| mordred | #success ttx has made mordred excited | 17:14 |
| ttx | I need to complete irc-meetings first | 17:14 |
| jeblair | ttx: ftr, i have a personal policy of only starting mailing list threads about happy exiciting things :) | 17:14 |
| SpamapS | rcarrillocruz: will review your change, I think there are other ways to do that. | 17:14 |
| rcarrillocruz | thx | 17:14 |
| ttx | mordred: the newsletter reserves the right to edit NSFW or commercial content | 17:14 |
| sdague | yeh, I was more in favor of just starting more possitive ML threads :) | 17:14 |
| ttx | although I guess the wiki page won't :) | 17:14 |
| sdague | but there is nothing saying we can't do both | 17:14 |
| ttx | sdague: that doesn't prevent it, yes | 17:14 |
| sdague | ttx: agreed | 17:15 |
| mordred | ttx: the wiki page _is_ a wiki page | 17:15 |
| jeblair | sdague: i like your idea. but i also like ttx's idea. i'm feeling positive about both! | 17:15 |
| ttx | jeblair: yes, infra is actually one of the very few teams doing self-congratulation well | 17:15 |
| mordred | ttx: so I think editorial control can happen there too | 17:15 |
| jeblair | oops, i wasn't subscribed to statusbot in gertty... | 17:15 |
| ttx | oops. | 17:16 |
| * jeblair reviews mordred's patches to statusbot | 17:16 | |
| *** ddieterly has joined #openstack-infra | 17:16 | |
| *** annegent_ has joined #openstack-infra | 17:18 | |
| *** erikmwil- is now known as erikmwilson_ | 17:18 | |
| *** erikmwil_ has joined #openstack-infra | 17:18 | |
| *** erikmwilson is now known as Guest87489 | 17:18 | |
| *** erikmwil_ is now known as erikmwilson | 17:18 | |
| *** annegent_ has quit IRC | 17:18 | |
| *** erikmwilson has quit IRC | 17:18 | |
| *** erikmwilson_ is now known as erikmwilson | 17:18 | |
| anteaya | #success infra does self-congratulation | 17:19 |
| jeblair | #failure infra does not have successbot | 17:19 |
| anteaya | yet | 17:19 |
| SpamapS | We tried to setup a failbot .. but... | 17:20 |
| *** annegent_ has joined #openstack-infra | 17:21 | |
| *** tsg_ has joined #openstack-infra | 17:21 | |
| *** asselin has joined #openstack-infra | 17:21 | |
| anteaya | heh | 17:21 |
| *** tnovacik_ has quit IRC | 17:21 | |
| *** jamielennox is now known as jamielennox|away | 17:22 | |
| anteaya | mordred: so in reply to greghaynes question on https://review.openstack.org/#/c/140840/4 do you want to wait on his wip dib patch instead of using docker? | 17:22 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add initial compute functional tests to Shade https://review.openstack.org/158463 | 17:22 |
| *** jistr has quit IRC | 17:22 | |
| *** cody-somerville has quit IRC | 17:22 | |
| *** AJaeger_ has joined #openstack-infra | 17:23 | |
| mordred | jeblair: I had patches to statusbot? | 17:23 |
| jeblair | mordred: pbr and twitter | 17:23 |
| jeblair | i would rather not merge twitter unless we also support identica | 17:23 |
| jeblair | but i'm keen on pbr | 17:24 |
| mordred | jeblair: I can probably add identi.ca support pretty easily | 17:24 |
| AJaeger_ | could I get some reviews for https://review.openstack.org/#/c/156328 to reduce the jobs run for trove, please? The trove part has merged... | 17:24 |
| jeblair | (or whatever they're calling it now) | 17:24 |
| mordred | anteaya: yes - I do not want to merge that patch with the docker stuff | 17:24 |
| mordred | anteaya: that reminds me though - I need to double-check on the PPA I made with the debian packages of vhd-util | 17:25 |
| anteaya | mordred: great would you like to say so and mark it depends on and wip or shall I? | 17:25 |
| mordred | anteaya: WIP would be great | 17:25 |
| mordred | I'll do it | 17:25 |
| AJaeger_ | sdague: 156328 was done after you wondered why all those jobs run - so a review would be cool... | 17:25 |
| *** otter768 has joined #openstack-infra | 17:26 | |
| jeblair | AJaeger_, sdague: i just approved it; would you like me to revoke my approval? | 17:26 |
| *** Ala has quit IRC | 17:27 | |
| AJaeger_ | jeblair: no need for that IMO. | 17:27 |
| AJaeger_ | jeblair: thanks! | 17:27 |
| AJaeger_ | jeblair: sdague just wondered about these jobs so I improved the situation - but other than that I don't need his review on them | 17:27 |
| sdague | yeh, seems fine | 17:27 |
| AJaeger_ | sdague: thanks! | 17:28 |
| openstackgerrit | Erno Kuvaja proposed openstack-dev/hacking: Add own block in imports for six overwrites https://review.openstack.org/159196 | 17:28 |
| mordred | jeblair: oh - in your "don't forget to subscribe in gertty" list - don't forget to subscribe to openstack-infra/ansible-puppet | 17:28 |
| *** rwsu has quit IRC | 17:29 | |
| *** viktors is now known as viktors|afk | 17:29 | |
| openstackgerrit | Merged openstack-infra/project-config: Check and gate irc-meetings changes https://review.openstack.org/159145 | 17:30 |
| *** jamielennox|away is now known as jamielennox | 17:30 | |
| anteaya | so in the glusterfs world, where are we in the increase timeout for the glusterfs job from 120 to 180 patch? https://review.openstack.org/#/c/157835/1 | 17:30 |
| *** Sukhdev has quit IRC | 17:30 | |
| *** crc32 has joined #openstack-infra | 17:31 | |
| pleia2 | not feeling very well, going to get a bit more rest and will be back in a bit | 17:31 |
| *** otter768 has quit IRC | 17:31 | |
| clarkb | get better | 17:31 |
| anteaya | pleia2: rest | 17:31 |
| AJaeger_ | pleia2: get well! | 17:32 |
| AJaeger_ | anteaya: I'm also wondering about this glusterfs patch - https://review.openstack.org/#/c/158392/ | 17:33 |
| anteaya | dtroyer: oh you do make me laugh | 17:33 |
| AJaeger_ | I'm not sure whether everything is fully understood to enable it again and I wouldn't want to have it go in without anybody checking that we have no problems... | 17:33 |
| jeblair | mordred: i am subscribed to ansible-puppet as well as puppet-ansible. | 17:34 |
| anteaya | AJaeger_: well that job is on their own stackforge repo | 17:34 |
| anteaya | AJaeger_: agreed | 17:34 |
| AJaeger_ | anteaya: yeah, less chance for harm ;) | 17:34 |
| *** rwsu has joined #openstack-infra | 17:34 | |
| *** annegent_ has quit IRC | 17:34 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Remove explicit pylint job for Neutron https://review.openstack.org/159199 | 17:34 |
| anteaya | I think clarkb might have the latest update on where we are with this group | 17:34 |
| openstackgerrit | Merged openstack-infra/project-config: Add new trove xmldocs job https://review.openstack.org/156328 | 17:34 |
| *** annegent_ has joined #openstack-infra | 17:35 | |
| anteaya | clarkb: care to update AJaeger_ and myself on the glusterfs status so we can review patches accordingly? | 17:35 |
| clarkb | anteaya: AJaeger_ I would hold off on approving that just yet, we have given them nodes to test on and it looks like rax + centos7 may not work iwth tempest full | 17:35 |
| *** unicell1 has joined #openstack-infra | 17:35 | |
| clarkb | anteaya: AJaeger_ so it is possible they will chnage the underlying OS | 17:35 |
| anteaya | awesome | 17:35 |
| anteaya | so should we wip them? | 17:35 |
| clarkb | lets ask BharatK to WIP it | 17:35 |
| anteaya | with a note about centos7 incompatiblility | 17:36 |
| clarkb | BharatK: can you vote work in progress on 158392 | 17:36 |
| clarkb | BharatK: and give a short note about your debugging (maybe just link to the mailing list thread) | 17:36 |
| anteaya | and 157835 | 17:36 |
| *** sputnik13 has joined #openstack-infra | 17:37 | |
| AJaeger_ | I'll be back later... | 17:37 |
| *** AJaeger_ has quit IRC | 17:37 | |
| jeblair | mordred: should you add more entries to the examples section of 159159? | 17:37 |
| *** sergsh has quit IRC | 17:38 | |
| *** unicell has joined #openstack-infra | 17:38 | |
| *** gyee has joined #openstack-infra | 17:38 | |
| *** unicell1 has quit IRC | 17:39 | |
| *** dannywilson has quit IRC | 17:39 | |
| deepakcs | anteaya, clarkb reg. 158392, what is you guy's opinion. In the latest reply to the -dev thread on this issue, i asked if it was possible to scheduled the job on hpcloud always ? | 17:40 |
| deepakcs | anteaya, clarkb bcos there its running fine, see my latest reply in the thread for more details | 17:40 |
| clarkb | deepakcs: it is not possible to do that today | 17:40 |
| *** zz_dimtruck is now known as dimtruck | 17:40 | |
| *** annegent_ has quit IRC | 17:40 | |
| deepakcs | clarkb, i don't need anew VM, i was asking if there is a mechanism to have a particular job to run in hpcloud only (never on rax) ? | 17:41 |
| clarkb | well I guess thats not entirely true, if you changed the label to devstack-centos7-dib that is currently hpcloud only | 17:41 |
| clarkb | deepakcs: yes and I am saying no not really, but sort of | 17:41 |
| *** mwagner_lap has quit IRC | 17:41 | |
| deepakcs | clarkb, ok, sorry, didn't get ur response... so adding -dib schedules it in hpcloud ? | 17:41 |
| *** salv-orlando has quit IRC | 17:41 | |
| clarkb | deepakcs: lets back up | 17:41 |
| deepakcs | clarkb, sure | 17:42 |
| clarkb | deepakcs: typically we never want to run a job against only one cloud. The reason for this is clouds go away and we have something like 4 regions we operate in and our tests keep running as a result | 17:42 |
| *** HeOS has quit IRC | 17:42 | |
| clarkb | deepakcs: if you only schedule your test in hpcloud, then whenever hpcloud goes down or is unavailable for any reason your test will stop running | 17:42 |
| *** shashankhegde has joined #openstack-infra | 17:43 | |
| clarkb | deepakcs: so the official answer is no we don't do that. Reality is that we have a special centos7 dib built image in hpcloud right now as part of the testing for switching all of hpcloud to disk image builder built images | 17:43 |
| openstackgerrit | Merged openstack-infra/zuul: Stop metajob application of undefined attributes https://review.openstack.org/156716 | 17:43 |
| *** SumitNaiksatam has quit IRC | 17:43 | |
| *** annegent_ has joined #openstack-infra | 17:43 | |
| deepakcs | clarkb, ok, but then that means we cant enable our job until we root cause the rax + centos7 issue | 17:43 |
| clarkb | deepakcs: the problem with relying on that is we should clean it up as soon as we change over the normal centos7 image to disk image builder | 17:43 |
| deepakcs | clarkb, i don't know the background on normal Vs dib image, but as long as we run in hplocud, we seem to be fine | 17:44 |
| deepakcs | clarkb, so what i am not clear is, how does the normal/dib matter | 17:45 |
| *** sputnik13 has quit IRC | 17:45 | |
| clarkb | deepakcs: it matters because right now the devstack-centos7-dib image is only served by hpcloud | 17:46 |
| clarkb | deepakcs: but that won't be the case for the long term | 17:46 |
| sigmavirus24 | jogo: ping | 17:46 |
| *** btran has joined #openstack-infra | 17:46 | |
| deepakcs | clarkb, ah ok, so when that image goes away, it can be scheduled on rax ? | 17:46 |
| clarkb | deepakcs: yup | 17:46 |
| deepakcs | clarkb, got u now | 17:46 |
| deepakcs | clarkb, so what should we do now ? :) | 17:46 |
| mordred | jeblair: yes. I think that's an excellent idea | 17:47 |
| clarkb | deepakcs: I think you have a few options, use a different distro/release, fix centos7 tempest on rax, are the two that immediatel come to mind | 17:47 |
| deepakcs | clarkb, fixing tempest on rax+centos isn't easy as we need to understand whats the specific'ness of rax thats causing it. Becasue the same combo works on hpcloud, I was hoping someone with better expertise can help root cause it | 17:48 |
| clarkb | deepakcs: I know ianw is interested in getting tempest running on centos7, it is possible ianw is already working on the centos7 OOMs? | 17:48 |
| *** salv-orlando has joined #openstack-infra | 17:48 | |
| deepakcs | clarkb, so trying with different distro seems to be a good option | 17:48 |
| deepakcs | clarkb, i am not sure, i will try to get in touch with ianw and check, i and BharatK did update him about the issue we are seeing, so he is aware | 17:49 |
| *** EmilienM is now known as EmilienM|afk | 17:49 | |
| deepakcs | clarkb, if different distro, which one you recommend, which is the most used and works well ? | 17:49 |
| dougwig | hello infra. in discussing splitting a library out of neutron, to be put onto pypi and into global-requirements, because we have a spaghetti mess of internal dependencies between projects that I'm trying to resolve. | 17:49 |
| dougwig | one suggestion was to start creating that library in-tree in neutron, which would mean that neutron would be both a library and a not-library at the same time, but would make moving things around internally easier and not need to coordinate cross-repo changes. | 17:49 |
| dougwig | is that feasible, from your perspective? (the proposal, with separate repos suggested, is here: https://review.openstack.org/#/c/154736/) | 17:49 |
| clarkb | dougwig: ubuntu trusty is where most of the testing currently happens | 17:50 |
| clarkb | er deepakcs ^ | 17:50 |
| *** sputnik13 has joined #openstack-infra | 17:50 | |
| dougwig | clarkb: :) | 17:50 |
| *** Ryan_Lane has joined #openstack-infra | 17:50 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Remove job parameters from status.json https://review.openstack.org/155160 | 17:50 |
| deepakcs | clarkb, ok, any idea how does F20 or F21 works ? | 17:50 |
| clarkb | deepakcs: I don't think f21 currently works | 17:50 |
| clarkb | f20 was dropped iirc | 17:50 |
| deepakcs | clarkb, i am biased a bit towards rpm based distro as we mostly test with gluster on that | 17:50 |
| deepakcs | clarkb, Hmm so ubuntu is the only distro we are supporting on infra VMs then ? | 17:51 |
| jogo | sigmavirus24: pong | 17:51 |
| clarkb | dougwig: we pretty much stick to one repo to one python package. The tooling to do otherwise is pretty gross | 17:51 |
| clarkb | dougwig: but mordred can probably give proper details on that | 17:51 |
| sigmavirus24 | jogo: I'm not sure if you've been following flake8's issue tracker, but for the near future, it looks like pep8 1.6.* is far from being usable in hacking | 17:52 |
| clarkb | deepakcs: no we support f21, centos7, ubuntu precise and trusty for devstack right now | 17:52 |
| mordred | dougwig: yes - please don't do it - python is not good enough to handle it | 17:52 |
| mordred | dougwig: it's not like dpkg or rpm where this is expressable | 17:52 |
| clarkb | deepakcs: its just that devstack + tempest is not working on f21 and centos7 currently | 17:52 |
| dougwig | clarkb: i'll be honest, that's my leaning as well, so i'm channeling an argument i don't fully believe in. but i wanted to explore it properly. | 17:52 |
| *** MaxV has quit IRC | 17:52 | |
| sigmavirus24 | jogo: it breaks how it handles tox.ini, global config files, and other fun stuff related to configs with excludes and such. | 17:52 |
| deepakcs | clarkb, oh ok, thats good info to know. f21 also seems oom or some other issue ? | 17:52 |
| mordred | dougwig: the short answer is "it is completely unsupported by the tooling and there is no plans to support it" | 17:52 |
| sigmavirus24 | jogo: and the new maintainer is taking their sweet time fixing it so, it will cause otherwise excluded error codes to be included in the reports | 17:53 |
| *** jp_at_hp has quit IRC | 17:53 | |
| jogo | sigmavirus24: and that is why we pin pep8 hard | 17:53 |
| clarkb | deepakcs: its a different issue, the kernel doesn't update properly on rackspace and there is a bug that tempest runs into with the old kernel | 17:53 |
| sigmavirus24 | jogo: so flake8 2.4.0 will cap pep8 at < 1.6.0 | 17:53 |
| dougwig | mordred: is it "this is horrible don't even contemplate", or "this is kind of icky, we'd rather not" ? because i'm balancing ten levels of icky in both directions right now. | 17:53 |
| clarkb | deepakcs: ianw and afazekas are working on fixing that | 17:53 |
| jogo | sigmavirus24: cool, works for me | 17:53 |
| sigmavirus24 | jogo: it doesn't help that florent picked someone who had never previously worked on the project to maintain it | 17:53 |
| dhellmann | dougwig: under that proposal, I didn't think you'd need to publish the library separately from the rest of neutron, just that parts of neutron would be treated as more stable than others. Did I misunderstand? | 17:53 |
| mordred | dougwig: well, it's closer to the "this is horrible don't even contemplate" side | 17:53 |
| deepakcs | clarkb, ah ok and f20 was dropped because we have f21 or F20 had other issues ? | 17:53 |
| jogo | sigmavirus24: sounds like we are in for a ride | 17:53 |
| mordred | dougwig: while _physically_ possible, I will -2 block any support for it in infra | 17:53 |
| *** ssam2 has quit IRC | 17:54 | |
| sigmavirus24 | jogo: yep | 17:54 |
| clarkb | deepakcs: I am not sure why f20 was dropped so soon, we always intended on dropping it once fedora stopped supporting it | 17:54 |
| dougwig | dhellmann: i'd like to put proper versioned requirements.txt's into the dozen or so projects that are importing neutron now, rather than the implicit dependency we have now. | 17:54 |
| sigmavirus24 | jogo: just wanted to keep you in the loop | 17:54 |
| deepakcs | clarkb, hmm ok, bcos f21 is very new and we don't have it working , so i was hoping that f20 gets dropped once f21 gate starts working :) | 17:55 |
| deepakcs | clarkb, so that leaves us with ubuntu as the only option | 17:55 |
| dougwig | dhellmann: which has been causing all sorts of fun with "what version of master do *you* have today?" issues. | 17:55 |
| clarkb | deepakcs: or fixing centos7, or fixing f21 | 17:55 |
| *** mayurig has joined #openstack-infra | 17:55 | |
| dhellmann | dougwig: so what I thought you were talking about was just distributing all of neutron as a lib to start, to meet that goal, and then splitting part out to a lib later to reduce that overhead | 17:55 |
| deepakcs | clarkb, yeah, but fixing is un-deterministic, we can help ianw in his efforts, but we need a CI job as cinder has deadlines to adhere to :) | 17:56 |
| *** tnovacik_ has joined #openstack-infra | 17:56 | |
| *** derekh has quit IRC | 17:56 | |
| *** mpaolino has quit IRC | 17:56 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/devstack-gate: DO NOT MERGE: testing only https://review.openstack.org/158962 | 17:56 |
| mordred | dhellmann, dougwig: now, I _Do_ support us actually uploading teh server projects to pypi, fwiw | 17:57 |
| mordred | and that's not hard - we just never got around to doing it | 17:57 |
| deepakcs | clarkb, also given that the centos7 issue recreates only on rax and not on hpcloud, we can't be sure if it will re-create in our local lab env. | 17:57 |
| dhellmann | mordred: oh, I thought we were opposed to that? | 17:57 |
| deepakcs | clarkb, so one small request, can u help us provision a ubuntu VM, so that we can start testing on that ? | 17:58 |
| mordred | dhellmann: nope. we just originally didn't do it "because pip install nova isn't really something you'd expect to work" - but I think it's quite clear that the limitations that has are things people are fine with | 17:59 |
| clarkb | deepakcs: the way to do that would be to add an experimental job that runs with your plugin on ubuntu against your project | 17:59 |
| clarkb | deepakcs: then if we need to we can grab those VMs and hand them out | 17:59 |
| jogo | sigmavirus24: thanks for the heads up! | 17:59 |
| *** carl_baldwin has quit IRC | 17:59 | |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Set custom cpu_model for live_migrate https://review.openstack.org/141530 | 17:59 |
| mordred | dhellmann: I mean, you're obviously not going to get a configured neutron if you pip install neutron | 18:00 |
| deepakcs | clarkb, yeah but given the centos issue, we wanted to check once and then propose a ubuntu job | 18:00 |
| mordred | dhellmann: we also need to go through and make sure we've registered/squatted all the server project names ... | 18:00 |
| clarkb | deepakcs: you should check locally | 18:00 |
| *** cnesa has quit IRC | 18:00 | |
| deepakcs | clarkb, locally it runs, BharatK already tested with ubuntu, fedora20 and centos7 | 18:00 |
| clarkb | deepakcs: perfect, I think we can just add an experimental job and go from there | 18:00 |
| *** annegent_ has quit IRC | 18:00 | |
| deepakcs | clarkb, ok, so we will work on sending a patch for adding experimental ubuntu job. Thanks clarkb | 18:01 |
| dhellmann | mordred: ok, cool. dougwig, does making neutron pip-installable *as-is* fix your objection to incubating in-tree? | 18:01 |
| dougwig | sec | 18:02 |
| clarkb | deepakcs: no problem, and if we run into problems with that like OOMing we can hold those nodes then, but if it works locally I think its better to assume it will work upstream and deal with it if it doesn't | 18:02 |
| SpamapS | I so love that the largest portion of time I waste building new venvs for tox is to build lxml | 18:02 |
| SpamapS | that is _#WINNING_ | 18:02 |
| deepakcs | clarkb, so one clarification.. | 18:02 |
| anteaya | deepakcs: and please abandon other patches then so reviewers don't waste their time | 18:02 |
| *** jamielennox is now known as jamielennox|away | 18:02 | |
| clarkb | SpamapS: repeat after me: SAML SAML SAML | 18:03 |
| deepakcs | clarkb, we start with adding the job to openstack cinder project or you meant start with the stackforge project job ? | 18:03 |
| openstackgerrit | Merged openstack-infra/devstack-gate: Allow PROJECTS to be overridden https://review.openstack.org/155957 | 18:03 |
| deepakcs | anteaya, reg: https://review.openstack.org/#/c/157835 i think we can abandon it - what say BharatK ? | 18:03 |
| *** tmcpeak has joined #openstack-infra | 18:03 | |
| anteaya | deepakcs: abandon all you can, you can unabandon laster | 18:03 |
| anteaya | later | 18:03 |
| BharatK | deepakcs: yes deepak | 18:03 |
| clarkb | deepakcs: add it to your stackforge project. We will add it to cinder later once its working reliably | 18:03 |
| deepakcs | anteaya, sure, we will anteaya BharatK can u abandon right away ? | 18:03 |
| dougwig | dhellmann, mordred - sorry, meatspace intrusion. if we upload neutron to pypi, does it have to be on the openstack integrated release cadence? or can it be more free-form, as our other libraries are today? | 18:04 |
| SpamapS | clarkb: JOY JOY JOY | 18:04 |
| deepakcs | clarkb, ok sure, thanks | 18:04 |
| anteaya | but the more directions you have open, the harder it is for us to figure out what should merge, so we just walk away | 18:04 |
| BharatK | deepakcs: I will abandon this patch | 18:04 |
| deepakcs | anteaya, the last time i checked, i couldn't abandon the patch myself, does it need some special rights ? | 18:04 |
| anteaya | so only have open the minimum of what you need | 18:04 |
| anteaya | deepakcs: the author of the patch needs to abandon | 18:04 |
| mordred | dougwig: it will happen as a result of tagging the repo | 18:04 |
| deepakcs | BharatK, reg: 158392 (glusterfs check pipeline job for centos7), i think we can abandon that too, rigfht ? | 18:04 |
| dougwig | ok, as someone ignorant to how we tag repos now, is that something we can control ad hoc, or is that fixed to the release milestones? | 18:05 |
| anteaya | clarkb: also most of cinder has no idea what jobs are running on their repo | 18:05 |
| anteaya | I asked in their meeting today | 18:05 |
| BharatK | deepakcs: we need add as a experimental job right? | 18:05 |
| clarkb | anteaya: they just have to look at gerrit... | 18:05 |
| dhellmann | dougwig: you can control it, but you'd need to coordinate with ttx to pick good tags | 18:05 |
| mordred | dougwig: that is the only mechanism we have or support for releasing software. SO - I believe that would be "on the release cadence" which would include milestones | 18:05 |
| clarkb | anteaya: every job that is run against cinder is reported to cinder | 18:05 |
| anteaya | I offered to hold a tutorial to teach them so that they can answer questions about jobs and have some knowledge | 18:06 |
| anteaya | clarkb: yes, that is how we look at it | 18:06 |
| deepakcs | BharatK, yes, lets start with experimental | 18:06 |
| BharatK | deepakcs: Okay | 18:06 |
| anteaya | but my experience from the mid-cycles is that infra is becoming a scary black box to a lot of project devs | 18:06 |
| *** tmcpeak has quit IRC | 18:06 | |
| anteaya | and they want to know stuff but don't ask | 18:06 |
| *** hdd has quit IRC | 18:06 | |
| anteaya | because infra is too busy | 18:06 |
| *** shashankhegde has quit IRC | 18:07 | |
| anteaya | and they don't want to look like they don't know something they shouldn't | 18:07 |
| *** johnthetubaguy is now known as zz_johnthetubagu | 18:07 | |
| dougwig | dhellmann, mordred - forgive me for being obtuse, but the clients and oslo don't happen on the same cadence as the main projects/integrated release. is that the same mechanism? would there be a conflict in one repo conforming to both methods? | 18:07 |
| anteaya | but they don't know and they aren't the only project | 18:07 |
| *** marun has joined #openstack-infra | 18:08 | |
| mordred | dougwig: its' the same mechanism - but the thing is version numbers | 18:08 |
| mordred | dougwig: when we release neutron and nova, they have release version numbers | 18:09 |
| mordred | those version numbers are, like oslo and the client libs, driven by git tags | 18:09 |
| *** tsg_ has quit IRC | 18:09 | |
| mordred | while we could certainly make git tags at a more frequent cadence than 6 months to cause something to be published - it would still need to be within the confines of the server version number scheme | 18:10 |
| mordred | and the specifics of that would have to be sorted out with ttx | 18:10 |
| clarkb | anteaya: so the short answer is the jobs that are reported to cinder changes by the "jenkins" user are what we run | 18:10 |
| deepakcs | clarkb, anteaya AJaeger fungi thanks for all your time, i am going to sleep now. | 18:10 |
| openstackgerrit | Sean M. Collins proposed stackforge/gertty: Fix crash when pressing the reverse sort key https://review.openstack.org/159210 | 18:10 |
| clarkb | deepakcs: ok will try to review that ubuntu job as soon as its up | 18:10 |
| deepakcs | clarkb, anteaya AJaeger fungi BharatK will send a patch to add ubuntu experiemtnal job , pls bless it so that we can start on ubuntu testing our CI job. good day! | 18:10 |
| mordred | dougwig: also - if it feels like banging your head against a wall, that's ok - it's one of the more complex and intracably hard parts of the thing we do aroudn here | 18:10 |
| *** mfink_ has left #openstack-infra | 18:11 | |
| anteaya | clarkb: yes | 18:11 |
| mordred | and it hurts to touch :) | 18:11 |
| deepakcs | clarkb, awesome | 18:11 |
| *** mfink_ has joined #openstack-infra | 18:11 | |
| zaro | morning | 18:11 |
| clarkb | anteaya: if they are interested in how the things that end up reported are decided we have to look at the zuul layout.yaml | 18:11 |
| anteaya | clarkb: and deciphering the trail so that cinder devs can proactively be part of the discussion is what I am trying to address | 18:11 |
| anteaya | right | 18:11 |
| anteaya | we did in the cinder meeting | 18:11 |
| jeblair | wow, so that's the _third_ patch to fix that bug in gertty | 18:11 |
| clarkb | anteaya: I see, so its the before it starts reporting stuff how do we follow along | 18:11 |
| anteaya | noone knew what the zuul/layout.yaml file was saying | 18:12 |
| anteaya | right | 18:12 |
| clarkb | jeblair: :) I haven't nticed because you said grab 155773 | 18:12 |
| anteaya | and it isn't that they can't do it, they just never have | 18:12 |
| anteaya | so there is no group knowledge there for others to build on | 18:12 |
| anteaya | which is what I would like to address | 18:12 |
| clarkb | anteaya: so are they looking for a way to review the changes as they come in? | 18:12 |
| dougwig | mordred: right, thank you, and i appreciate the help. i'm trying to balance whether the dev gains of keeping the repo together outweigh the complexities of trying to treat one repo as both a lib and a server, throughout the infrastructure, and to validate whether my gut reaction is because the notion of that just seems really gross to me. :-) | 18:12 |
| *** vilobhmm has joined #openstack-infra | 18:12 | |
| *** vilobhmm1 has joined #openstack-infra | 18:13 | |
| anteaya | clarkb: I am looking for a way to get feedback on changes | 18:13 |
| clarkb | anteaya: which means learning what the layout.yaml means (and possibly jjb configs) and which project to watch? | 18:13 |
| mordred | dougwig: ++ | 18:13 |
| anteaya | since it is my preference for a new job added to a project that the project is at least aware of the change | 18:13 |
| anteaya | clarkb: yes | 18:13 |
| clarkb | anteaya: yes I think that is a reasonable thing to have projects be aware | 18:13 |
| anteaya | thanks | 18:13 |
| anteaya | :) | 18:13 |
| *** deepakcs has quit IRC | 18:14 | |
| * reed is surprised to see that identi.ca is still running... somehow | 18:14 | |
| anteaya | so that is somethign I am working towards | 18:14 |
| *** tonytan4ever has quit IRC | 18:14 | |
| *** deepakcs has joined #openstack-infra | 18:14 | |
| *** melwitt has quit IRC | 18:14 | |
| *** melwitt_ has joined #openstack-infra | 18:14 | |
| mordred | SpamapS: for your dogpile.cache patch - I have this hunch that we should do a follow on patch to allow passing in the dict config and the cache choice key as params, with current defaults of course | 18:15 |
| *** melwitt_ has quit IRC | 18:15 | |
| mordred | SpamapS: because then we could have the cache section of clouds.yaml as processed by os-client-config grok and pass-through dogpile input params | 18:15 |
| *** jamielennox|away is now known as jamielennox | 18:15 | |
| mordred | and the whole thing could be very sexy | 18:15 |
| *** melwitt has joined #openstack-infra | 18:15 | |
| clarkb | anteaya: my initial suggestion would be to just start with zuul layout.yaml. Job names should be descriptive enough to get an idea for what they are doing without looking at jjb configs | 18:16 |
| clarkb | anteaya: then its just a matter of understanding the templates in that file and the per project list. Perhaps we can point to specific portions of the zuul documentation to cover those items? | 18:17 |
| *** sputnik13 has quit IRC | 18:17 | |
| *** SumitNaiksatam has joined #openstack-infra | 18:17 | |
| *** vilobhmm has quit IRC | 18:17 | |
| mordred | jeblair: re: identi.ca support - if I change the patch to use the tweepy library, it supports both twitter and identi.ca | 18:17 |
| anteaya | clarkb: good idea | 18:18 |
| * anteaya goes to the zuul docs to see what might be helpful here | 18:18 | |
| *** deepakcs has quit IRC | 18:18 | |
| *** dimtruck is now known as zz_dimtruck | 18:19 | |
| anteaya | clarkb: I'm going to have a bite for lunch and browse the zuul docs, I'll see what I can find | 18:19 |
| clarkb | anteaya: ok let me know, its also possible that docs are lacking in specific areas and we can fix that | 18:20 |
| anteaya | and thanks for understanding | 18:20 |
| anteaya | yup | 18:20 |
| jeblair | mordred: as long as we can specify both | 18:20 |
| jeblair | anteaya: see http://docs.openstack.org/infra/manual/drivers.html#running-jobs-with-zuul | 18:20 |
| *** hdd has joined #openstack-infra | 18:20 | |
| jeblair | anteaya: also, it may not be necessary for everyone who reviews a change for suitability necessarily also review it for technical correctness. i would say that if the goal is to get someone from a project to buy in on a change, then their review of the commit message should be sufficient, and others can review whether it's technically correct. | 18:22 |
| SpamapS | mordred: yes that is super sexy and I agree. :-D | 18:22 |
| anteaya | jeblair: oh yes I agree | 18:22 |
| jeblair | anteaya: increasing technical knowledge is great, and we should do it. i just want to stress that i think increasing visibility of changes and increasing technical knowledge of the system are both worthwhile things, but separate. :) | 18:23 |
| anteaya | they don't need to know the syntax jsut the spirit of the change and the ramifications to their project | 18:23 |
| anteaya | that is all I am going for | 18:23 |
| jeblair | yep | 18:23 |
| anteaya | unfortunately the sheepdog change caught them completely unaware | 18:23 |
| anteaya | so far thingee was the only one who know about it that I know | 18:23 |
| jeblair | anteaya: but indeed they need to know there's this thing called zuul that runs stuff for them to get that far. | 18:23 |
| anteaya | the rest of the project didn't | 18:23 |
| anteaya | that I do believe they know | 18:24 |
| anteaya | but I can check and see | 18:24 |
| anteaya | :) | 18:24 |
| mordred | jeblair: there is no zuul only dana! | 18:24 |
| clarkb | anteaya: also fwiw the sheepdog thing was handled 100% correctly imo | 18:24 |
| anteaya | how was it handled | 18:25 |
| clarkb | anteaya: AJaeger specifically said I don't want to approve this until I hae cinder buy in | 18:25 |
| anteaya | I still don't know? | 18:25 |
| clarkb | anteaya: then you reviewed it and went and asked cinder | 18:25 |
| anteaya | thingee said they spoke | 18:25 |
| anteaya | noone could find anything in the meetings | 18:25 |
| anteaya | how did they ask cinder | 18:25 |
| clarkb | anteaya: via thsi change | 18:25 |
| anteaya | noone can find a record of them asking | 18:25 |
| clarkb | anteaya: this is how we propose things in this community | 18:25 |
| anteaya | right | 18:25 |
| clarkb | if proposing a change and having it be reviewed is problematic then what are we doing? | 18:25 |
| anteaya | thingee said he knew | 18:25 |
| anteaya | but I never saw his review on the patch | 18:26 |
| clarkb | anteaya: and the patch was not merged | 18:26 |
| anteaya | I don't see where thingee reviewed it | 18:26 |
| anteaya | that was what I was looking for | 18:26 |
| clarkb | because core reviewes for the change said "hold up lets get feedback" | 18:26 |
| anteaya | a cinder review | 18:26 |
| anteaya | the patch before it had no cinder reviewer | 18:26 |
| clarkb | but I get the impression that having the change up for review is the problem | 18:26 |
| anteaya | you and andreas reviewed it | 18:26 |
| clarkb | which should never be an issue | 18:26 |
| *** patrickeast has joined #openstack-infra | 18:26 | |
| anteaya | no not at all | 18:26 |
| anteaya | I didnt' see that anyone from cinder reviewed the patch that merged | 18:27 |
| anteaya | that was my problem | 18:27 |
| clarkb | anteaya: beause the patch that merged had nothing todo with cinder | 18:27 |
| clarkb | as I explained in my response to jgriffith | 18:27 |
| anteaya | so I asked in the cinder channel to see if anyoen knew about it | 18:27 |
| *** ghostpl_ has quit IRC | 18:27 | |
| anteaya | but the proposed patch built on it and stated the expectation of the authro to be in the gate | 18:28 |
| anteaya | which is not what at least one cinder core dev wants to see | 18:28 |
| clarkb | anteaya: yes and at that point cinder feedback was requested by the reviewers | 18:28 |
| anteaya | so I asked what the history was | 18:28 |
| clarkb | anteaya: what do they want to see? | 18:28 |
| anteaya | and noone knew anything | 18:28 |
| clarkb | yes but tahts ok because we have this review up to discuss it | 18:28 |
| anteaya | some history to point to | 18:28 |
| anteaya | somehwere | 18:28 |
| clarkb | the history is that specific change | 18:28 |
| clarkb | we are building it now | 18:28 |
| anteaya | but thingee said it was already discussed | 18:29 |
| anteaya | where was it discussed? | 18:29 |
| anteaya | I still don't know | 18:29 |
| clarkb | I think that is orthogonal to reviewing the change | 18:29 |
| anteaya | well cinder folks still don't know | 18:29 |
| openstackgerrit | Bharat Kumar Kobagana proposed openstack-infra/project-config: Run tempest-dsvm-full-glusterfs job on ubuntu https://review.openstack.org/159217 | 18:29 |
| anteaya | to the best of my knowledge | 18:29 |
| clarkb | anteaya: thats between cinder and thingee | 18:29 |
| clarkb | anteaya: I do not see how that affects us, has the change merged? | 18:30 |
| anteaya | well somehow someone with a plugin expects to be in the gate | 18:30 |
| anteaya | how did they get that expectation? | 18:30 |
| clarkb | I do not know, but again we have reviews of proposed changes to make sure things get in properly | 18:31 |
| *** shashankhegde has joined #openstack-infra | 18:31 | |
| clarkb | and as best as I can tell that system is working here | 18:31 |
| anteaya | oh | 18:31 |
| anteaya | okay | 18:31 |
| anteaya | I guess I interpret taht differently | 18:31 |
| *** zz_dimtruck is now known as dimtruck | 18:32 | |
| BharatK | clarkb: anteaya AJaeger please review the patch https://review.openstack.org/#/c/159217/ and let me know your comments | 18:32 |
| clarkb | I would approve the change I approved without asking cinder permission again because it doesn't affect cinder. That is a devstack plugin testing itself. And asking cinder for input on adding that same job to cinder was also the correct thing to do | 18:32 |
| jeblair | clarkb: that sounds good to me | 18:33 |
| clarkb | BharatK: looks correct | 18:33 |
| BharatK | clarkb: thank you very much clark | 18:34 |
| *** dimtruck is now known as zz_dimtruck | 18:34 | |
| openstackgerrit | MORITA Kazutaka proposed openstack-infra/project-config: Add Sheepdog test job to cinder check pipeline https://review.openstack.org/153868 | 18:35 |
| clarkb | there is another related point that is separate that we would like open source projects to do their testing of their drivers/backends/etc with us | 18:35 |
| clarkb | and to have jenkins report results on projects that are affected. The suggested method for that is to run the jobs as non voting in the check queue and if the parent project (say cinder) wants to gate on it they can as well | 18:35 |
| stevemar | re-bump, if i could get a +2/+A on https://review.openstack.org/#/c/158045/ it would be awesome (remove stable/main jobs for python-osc) | 18:36 |
| *** SotK has quit IRC | 18:37 | |
| *** sdake_ has joined #openstack-infra | 18:37 | |
| jeblair | clarkb, anteaya: indeed -- projects can say that they do or do not want non-voting jobs for plugins just as they can say that they do or do not want third-party ci systems reporting. | 18:37 |
| *** tonytan4ever has joined #openstack-infra | 18:37 | |
| anteaya | jeblair: right | 18:39 |
| anteaya | and that was the step I wanted to ensure we are enabling | 18:39 |
| anteaya | regardless of where the testing physicaly happenss | 18:39 |
| anteaya | clarkb: as for adding jobs taht might affect reporting time on patches | 18:40 |
| jeblair | clarkb, anteaya: (though note that if it's literally the same job (ie, has the same name) running on both the project and plugin repo, then that would pull the plugin into the integrate gate queue, which may not be desirable; but if the main project job has -nv and the plugin does not, that won't be a problem) | 18:40 |
| *** afazekas_ has quit IRC | 18:40 | |
| anteaya | clarkb: do you not feel that would benefit from a wider discussion | 18:40 |
| anteaya | clarkb: since I'm fine adding things but I do like full knowledge of affected systems when I do | 18:41 |
| *** sdake has quit IRC | 18:41 | |
| anteaya | jeblair: okay, how do we document that so project config reviews know what to watch for so we have jobs configured correctly | 18:41 |
| jeblair | clarkb, anteaya: i could (and have been in the past) convinced to use jhesketh's alternate user feature to have a second user to report these kinds of jobs. but _only_ a single second user (not one for every project that wants this). i'm not convinced it's necessary, but if the alternative is more complicated, we could look further into that. | 18:41 |
| clarkb | anteaya: I think asking the projects is the correct thing to do, I just don't think we need some special way to do it prior to proposing the change | 18:42 |
| anteaya | I make mistakes all the time, I don't want to make a mistake on this | 18:42 |
| *** BharatK has quit IRC | 18:42 | |
| clarkb | anteaya: I think thats is where I am getting hung up. From my perspective it seems to be that the ask is that people ask permission to propose a change | 18:42 |
| clarkb | rather than proposing a change being the proposal | 18:42 |
| anteaya | jeblair: I would be open to exploring that to see what the ramifications are of doing so | 18:42 |
| *** crc32 has quit IRC | 18:43 | |
| anteaya | clarkb: ah sorry no, if my part of the conversation has led to you believe that I am advocating for people to ask permission to propose patches that I have done a poor job illustrating my postion | 18:43 |
| anteaya | I am not advocating that people ask permission before they propose patches | 18:43 |
| clarkb | ok | 18:44 |
| *** teran has joined #openstack-infra | 18:45 | |
| *** sdake_ has quit IRC | 18:45 | |
| anteaya | and you are correct and I am incorrect | 18:45 |
| anteaya | https://review.openstack.org/#/c/154605/5 adds a job to the stackforge repo and not to the cinder repo | 18:46 |
| *** koolhead17 has quit IRC | 18:46 | |
| anteaya | so I'm sorry for being wrong there | 18:46 |
| *** sdake has joined #openstack-infra | 18:46 | |
| *** SotK has joined #openstack-infra | 18:46 | |
| *** achanda has joined #openstack-infra | 18:47 | |
| *** teran_ has quit IRC | 18:47 | |
| anteaya | I guess what threw me was the commit message in https://review.openstack.org/#/c/153868/2//COMMIT_MSG | 18:47 |
| jeblair | anteaya: yep. a misunderstanding corrected in the review process. #success :) | 18:48 |
| anteaya | as I had no idea what had taken place that the author had developed the expecation that they would be in the gate | 18:48 |
| anteaya | jeblair: ha ha ha | 18:48 |
| anteaya | part of this comes from my experience in the mid-cycles | 18:49 |
| *** dannywilson has joined #openstack-infra | 18:49 | |
| anteaya | I didn't attend one meeting where someone didn't have a rant becauase they were unaware of what someone else was doing | 18:49 |
| anteaya | so trying to do my part to work towards improving cross project communication | 18:49 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Document Cross-Repo Dependencies https://review.openstack.org/158855 | 18:49 |
| *** ChuckC has quit IRC | 18:49 | |
| anteaya | so that folks have more share and less frustration | 18:49 |
| anteaya | so I added to the frustration part of that | 18:50 |
| *** sputnik13 has joined #openstack-infra | 18:50 | |
| *** crc32 has joined #openstack-infra | 18:50 | |
| anteaya | and that was contrary to my wishes and motivation | 18:50 |
| anteaya | and I am sorry for that | 18:50 |
| anteaya | please accept my apology | 18:50 |
| *** markus_z has quit IRC | 18:51 | |
| *** sputnik13 has quit IRC | 18:51 | |
| *** teran has quit IRC | 18:52 | |
| * anteaya reads zuul docs | 18:53 | |
| *** dannywilson has quit IRC | 18:54 | |
| mordred | nibalizer: yes - I think my thinking was that we shoudln't make the module too magic, and one should expect that if you use it you'd have installed puppet properly before hand | 18:54 |
| *** ParsectiX has quit IRC | 18:54 | |
| mordred | however - returning sane error messages is probably a great idea | 18:54 |
| *** dannywilson has joined #openstack-infra | 18:54 | |
| *** ParsectiX has joined #openstack-infra | 18:54 | |
| mordred | something like "zomg, you don't have the directories, did you install puppet right?" | 18:54 |
| *** jgallard has quit IRC | 18:55 | |
| *** ParsectiX has quit IRC | 18:55 | |
| *** pelix has quit IRC | 18:55 | |
| nibalizer | or 'ya puppet is stupid and it needs magic directories it doesn't create, yolo' | 18:55 |
| *** ParsectiX has joined #openstack-infra | 18:55 | |
| mordred | nibalizer: I thnk the error message should totes have zomg and yolo in it | 18:56 |
| nibalizer | add in 'hella' and we're there | 18:57 |
| jroll | ++ | 18:58 |
| *** ddieterly has quit IRC | 18:58 | |
| SpamapS | hm.. gertty doesn't let you copy/paste stuff off screen? That seems .. misguided. | 18:58 |
| jroll | rather, totes agree. | 18:58 |
| clarkb | SpamapS: it does shift + mouse click and drag | 18:59 |
| jeblair | clarkb, anteaya: see my comment on 153868. i think the decison about whether to use an alternate account is whether it's easier for us to do that or what i described in my comment | 18:59 |
| SpamapS | clarkb: argh | 18:59 |
| SpamapS | clarkb: ty | 18:59 |
| jeblair | SpamapS: :( i even put it in the readme: http://git.openstack.org/cgit/stackforge/gertty/tree/README.rst#n140 | 18:59 |
| jeblair | i'm told the shift-click thing is a pretty standard behavior for terminal apps that support mice | 19:00 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/gear: Resolve python3 test failures https://review.openstack.org/158147 | 19:00 |
| * anteaya reads 153868 | 19:00 | |
| *** annegent_ has joined #openstack-infra | 19:01 | |
| SpamapS | jeblair: so you're saying I should.. read .. the readme? | 19:01 |
| SpamapS | like don't just rm it? | 19:01 |
| SpamapS | or encrypt it | 19:01 |
| SpamapS | but READ it? | 19:01 |
| jeblair | SpamapS: RMME | 19:01 |
| * SpamapS hides his shame with humor | 19:01 | |
| *** AJaeger_ has joined #openstack-infra | 19:02 | |
| SpamapS | TIL: shift-click is a pretty standard behavior for terminal apps that support mice | 19:02 |
| jeblair | to be fair, i put the bit about how to actually subscribe to things in the initial popup because people didn't read it in the reedme, and i didn't want them to have the "ed" user experience | 19:02 |
| clarkb | SpamapS: I have a giant book called Reamde and I read it | 19:03 |
| * SpamapS just tried it in elinks | 19:03 | |
| jeblair | so maybe we should have a second popup, after you dismiss the original one: "More things you would know if you read the README:" :) | 19:04 |
| SpamapS | ReamDe sounds like a discussion of the various forms of paper delivery to offices in Gearmany. | 19:04 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Document Cross-Repo Dependencies https://review.openstack.org/158855 | 19:04 |
| SpamapS | jeblair: OR, you could just make the pop up.. the README | 19:04 |
| clarkb | jeblair: your comment on 153868 sounds reasonable to me | 19:04 |
| anteaya | jeblair: that is a fair approach, I guess then we just have to figure out a way to document in project config which jobs can change to voting and which can't, as currently I get buy in from projects when the job is added and not so much when voting:false is removed | 19:04 |
| jeblair | SpamapS: the thing i like about Gearmany is the highly efficient distribution of jobs to workers | 19:04 |
| SpamapS | jeblair: rofl | 19:04 |
| anteaya | I assume taht if they were okay with it as non-voting, I don't need to ask when it turns to voting | 19:05 |
| SpamapS | jeblair: it hinges on their simple, if slightly verbose, communication method. | 19:05 |
| anteaya | but these jobs would be treated differently, or would in my mind | 19:05 |
| anteaya | unless I should change my expecations around patches that remove voting:false from zuul/layout.yaml | 19:06 |
| *** annegent_ has quit IRC | 19:06 | |
| jeblair | anteaya: if the job were named "-nv" that could be an indication that it should never change to voting :) | 19:06 |
| openstackgerrit | Brian Hunter proposed openstack/requirements: do not enforce global requirements for downstream repos https://review.openstack.org/159227 | 19:06 |
| anteaya | okay I guess I can add some documentation around that | 19:06 |
| SpamapS | I believe they call it Communicatinwitdertekstprotokolegnügen | 19:07 |
| anteaya | so this is more fodder for a project-config readme I think | 19:07 |
| jeblair | anteaya: in fact, there's a metajob that already does that, so the individual job would not need an entry | 19:07 |
| *** tmcpeak has joined #openstack-infra | 19:07 | |
| jeblair | anteaya: see line 546 in layout.yaml | 19:07 |
| *** tmcpeak has quit IRC | 19:07 | |
| *** shashankhegde has quit IRC | 19:07 | |
| jeblair | anteaya: heh, sorry it moved. 552. | 19:08 |
| *** zz_dimtruck is now known as dimtruck | 19:08 | |
| anteaya | you had the line number memorized? | 19:08 |
| anteaya | nice | 19:08 |
| jeblair | no, just a repo that was a few minutes out of date | 19:08 |
| anteaya | ah | 19:09 |
| anteaya | okay well let's drive that as a solution for a bit and see what happens | 19:09 |
| anteaya | thanks | 19:09 |
| *** tmcpeak has joined #openstack-infra | 19:10 | |
| jeblair | anteaya: yep, and if that ends up seeming more crazy than "create a second user and have the same zuul report as two different users even though it's really all the same system" our decision will be easy. :) | 19:10 |
| *** unicell has quit IRC | 19:10 | |
| *** unicell has joined #openstack-infra | 19:10 | |
| anteaya | yes | 19:11 |
| anteaya | yes it will | 19:11 |
| *** shashankhegde has joined #openstack-infra | 19:11 | |
| *** tmcpeak has quit IRC | 19:11 | |
| *** chuckC_ has joined #openstack-infra | 19:14 | |
| *** bdpayne has joined #openstack-infra | 19:14 | |
| *** andreykurilin_ has joined #openstack-infra | 19:15 | |
| *** mayurig has quit IRC | 19:16 | |
| clarkb | jenkins04 and 05 are both 503s | 19:17 |
| clarkb | I am investigating | 19:17 |
| clarkb | there is infact no jenkins daemon on jenkins04 | 19:17 |
| clarkb | Caused by: java.lang.OutOfMemoryError: unable to create new native thread | 19:18 |
| clarkb | I am so happy to have ha jenkins | 19:18 |
| *** annegent_ has joined #openstack-infra | 19:18 | |
| *** elliottk has left #openstack-infra | 19:18 | |
| *** sputnik13 has joined #openstack-infra | 19:18 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/infra-specs: Add spec for reusable OpenStack CI solution https://review.openstack.org/139745 | 19:19 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Document Cross-Repo Dependencies https://review.openstack.org/158855 | 19:19 |
| *** mayurig has joined #openstack-infra | 19:19 | |
| annegent_ | is there a fifth openstack meeting room on IRC, or only four? | 19:19 |
| annegent_ | (ha, "only" four I know is crazy) | 19:20 |
| *** mayurig has quit IRC | 19:21 | |
| clarkb | OpenJDK 64-Bit Server VM warning: OpenJDK 64-Bit Server VM warning: Attempt to deallocate stack guard pages failed. | 19:21 |
| *** HeOS has joined #openstack-infra | 19:21 | |
| *** sdake has quit IRC | 19:21 | |
| clarkb | jeblair: ^ that mean anything to you? zaro ^ maybe you have seen similar? | 19:21 |
| *** mayurig has joined #openstack-infra | 19:21 | |
| *** sputnik13 has quit IRC | 19:21 | |
| *** tsg_ has joined #openstack-infra | 19:22 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Replaced python-crontab with apscheduler https://review.openstack.org/158955 | 19:22 |
| clarkb | annegent_: I will pull up the list passed to the meeting bot | 19:22 |
| *** carl_baldwin has joined #openstack-infra | 19:22 | |
| annegent_ | danke clarkb! | 19:23 |
| *** tonytan4ever has quit IRC | 19:23 | |
| clarkb | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=1412&rra_id=all is jenkins 04 memory use | 19:23 |
| *** sdake has joined #openstack-infra | 19:24 | |
| *** sdake has quit IRC | 19:24 | |
| *** sdake has joined #openstack-infra | 19:24 | |
| clarkb | annegent_: https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/eavesdrop.pp#n62 | 19:25 |
| *** reed has quit IRC | 19:25 | |
| AJaeger_ | annegent_: so, only four ;( | 19:25 |
| annegent_ | AJaeger_: we can't use openstack-doc? | 19:26 |
| AJaeger_ | annegent_: we can! | 19:26 |
| annegent_ | AJaeger_: yay! | 19:26 |
| annegent_ | :) | 19:26 |
| AJaeger_ | we just don't have the meetingbot to do the nice minutes for us... | 19:26 |
| *** achanda has quit IRC | 19:27 | |
| openstackgerrit | Maru Newby proposed openstack-infra/project-config: Use neutron's api job to validate func job change https://review.openstack.org/159232 | 19:27 |
| AJaeger_ | the channel is logged now http://eavesdrop.openstack.org/irclogs/%23openstack-doc/ | 19:27 |
| *** achanda has joined #openstack-infra | 19:27 | |
| *** otter768 has joined #openstack-infra | 19:27 | |
| *** reed has joined #openstack-infra | 19:28 | |
| clarkb | ok I have copied the error report from /tmp on 04 to my homedir on 04 and will be starting the daemon there shortly | 19:28 |
| clarkb | now on to 05 | 19:29 |
| *** sputnik13 has joined #openstack-infra | 19:29 | |
| anteaya | go clark | 19:30 |
| * anteaya doesn't know what else she can do to help | 19:30 | |
| *** teran has joined #openstack-infra | 19:30 | |
| clarkb | 05 is same story, copied error log out of /tmp into my home dir and restarted the service | 19:30 |
| clarkb | anteaya: not sure what else I can do. the java error dump is massive and mostly in a language I don't speak | 19:30 |
| anteaya | clarkb: is there anything I can do to help? | 19:30 |
| anteaya | awesome | 19:30 |
| clarkb | anteaya: no I think our systems worked as expected and kept this from being catastrophic | 19:31 |
| *** cdent has quit IRC | 19:31 | |
| anteaya | and you cna't paste due to sensitive data issues, yeah? | 19:31 |
| anteaya | yay | 19:31 |
| *** armax has quit IRC | 19:31 | |
| clarkb | anteaya: ya its full of memory info not sure if private key data or anything like that may be included | 19:31 |
| anteaya | right | 19:32 |
| *** otter768 has quit IRC | 19:32 | |
| anteaya | looks like it disappeared shortly before 1200 | 19:32 |
| anteaya | http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=112 | 19:32 |
| anteaya | 05 took off about 6 hours earlier: http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=115 | 19:33 |
| clarkb | "JavaThread "Computer.threadPoolForRemoting [#120161]" daemon [_thread_blocked" there are thousands of entries like that, which makes me wonder if jenkins is leaking connection threads | 19:33 |
| clarkb | and eventually ends up with no more memory to make more | 19:33 |
| anteaya | there was a big spike in io throughput just before it left | 19:33 |
| *** dprince has quit IRC | 19:34 | |
| *** dkranz has quit IRC | 19:34 | |
| anteaya | tcp connections was on the rise before it went offline | 19:34 |
| anteaya | that was for 05 | 19:35 |
| anteaya | 04 doesn't show the same activity | 19:35 |
| *** sputnik13 has quit IRC | 19:36 | |
| anteaya | io spiked at 0600 on 04 as well but it continued for about another 6 hours | 19:36 |
| clarkb | anteaya: possible that 04 had less memory pressure but eventually succumbed to the problem | 19:36 |
| clarkb | I am "quickly" skimming the error dump | 19:37 |
| anteaya | kk | 19:37 |
| *** sabeen1 has quit IRC | 19:38 | |
| *** sputnik13 has joined #openstack-infra | 19:38 | |
| *** erikwilson has left #openstack-infra | 19:39 | |
| clarkb | it definitely looks like PSPermGen was 99% used prior to running out of memory and something like 30k threads were running | 19:39 |
| *** sabeen1 has joined #openstack-infra | 19:39 | |
| clarkb | (assuming I am reading this correctly) | 19:40 |
| anteaya | can you paste a chunk with confidence? | 19:40 |
| clarkb | well the thing I posted above, there is about 30k lines of that | 19:40 |
| anteaya | ah | 19:40 |
| anteaya | good enough | 19:40 |
| clarkb | which I think means we had about that many threads | 19:41 |
| clarkb | zaro: ^ am I reading this correctly? | 19:41 |
| *** spzala has joined #openstack-infra | 19:42 | |
| *** annegent_ has quit IRC | 19:42 | |
| *** annegent_ has joined #openstack-infra | 19:44 | |
| jeblair | clarkb: that error does not seem familiar to me | 19:45 |
| *** sdake_ has joined #openstack-infra | 19:46 | |
| *** rfolco has joined #openstack-infra | 19:46 | |
| bhunter71 | a question; when your puppetboard has a lot of crufty "old" hosts in it, how does one go about getting them out? | 19:47 |
| *** sdake__ has joined #openstack-infra | 19:48 | |
| *** ihrachyshka has joined #openstack-infra | 19:48 | |
| clarkb | bhunter71: on your master `puppet node deactivate nodecertname` iirc | 19:49 |
| clarkb | bhunter71: then you probably want to puppet cert revoke nodecertname too just to make sure it doesn't come back as a zombie | 19:49 |
| bhunter71 | great,thanks,clarkb! | 19:50 |
| *** e0ne has quit IRC | 19:50 | |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Set up ssh_known_host based on hostname https://review.openstack.org/136596 | 19:51 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Set custom cpu_model for live_migrate https://review.openstack.org/141530 | 19:51 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Setup /etc/hosts for aiopcpu https://review.openstack.org/136158 | 19:51 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Allow root user to ssh in as stack https://review.openstack.org/137176 | 19:51 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Enable live block migration https://review.openstack.org/135768 | 19:51 |
| *** sdake_ has quit IRC | 19:52 | |
| *** dprince has joined #openstack-infra | 19:54 | |
| tsg_ | clarkb: a question on adding a new library (that has been packaged for Debian) to Jenkins slaves | 19:58 |
| tsg_ | clarkb: you had mentioned a while ago that I had to add the lib to https://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/manifests/jenkins_params.pp and https://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/manifests/thick_slave.pp#n10 | 19:58 |
| tsg_ | and devstack | 19:58 |
| jeblair | andreaf: hi, i just saw your comments is 153023 and 95901. i left a followup comment in 95901 with a suggestion about how we could proceed | 19:59 |
| tsg_ | clarkb: are the instructions still the same? (the projects have been restructured since) | 19:59 |
| jeblair | andreaf: that's a bit unusual because that change has already merged, so i wanted to make sure you see it | 19:59 |
| *** jedimike has quit IRC | 19:59 | |
| *** achanda has quit IRC | 20:00 | |
| clarkb | tsg_: we are currently trying to move to having projects list their deps explicitly if possible, either in jobs via devstack or via bindep if not using devstack | 20:00 |
| clarkb | tsg_: the bindep work is in progress though so at the very least devstack is still a good start | 20:00 |
| andreaf | jeblair: thanks I'll check them now | 20:01 |
| *** annegent_ has quit IRC | 20:01 | |
| tsg_ | clarkb: is that towards Kilo? | 20:01 |
| tsg_ | clarkb: I am trying to see if I can get a Swift lib dependency for a Kilo feature in | 20:01 |
| *** pcrews has quit IRC | 20:02 | |
| *** _david_ has joined #openstack-infra | 20:02 | |
| clarkb | tsg_: is this dependency required for linting and unittests? if not devstack should be sufficient | 20:02 |
| clarkb | tsg_: if it is required for linting and unittests as well we can probably install it the old way in the interim | 20:02 |
| tsg_ | clarkb: yes, the dependency is required for unit tests | 20:02 |
| clarkb | then yes I would go with what I described in the past and the bindep work can pick up the changes from there | 20:03 |
| *** ghostpl_ has joined #openstack-infra | 20:03 | |
| *** doude has quit IRC | 20:04 | |
| tsg_ | clarkb: perfect - to recap I submit the change to https://github.com/openstack-infra/system-config/blob/master/modules/openstack_project/manifests/jenkins_params.pp and https://github.com/openstack-infra/system-config/blob/master/modules/openstack_project/manifests/thick_slave.pp#L10 | 20:05 |
| tsg_ | clarkb: any guidance on how to get it into devstack? | 20:05 |
| *** ghostpl_ has quit IRC | 20:05 | |
| *** ihrachyshka has quit IRC | 20:06 | |
| clarkb | tsg_: I think you need to update lib/swift in devstack to do configuration things and update files/deb/swift and files/rpm/swift to include the new dep | 20:06 |
| *** tmcpeak has joined #openstack-infra | 20:06 | |
| tsg_ | clarkb: thanks a bunch! | 20:07 |
| *** ChuckC has joined #openstack-infra | 20:07 | |
| *** ddieterly has joined #openstack-infra | 20:08 | |
| *** achanda has joined #openstack-infra | 20:08 | |
| *** chuckC_ has quit IRC | 20:08 | |
| *** emagana has quit IRC | 20:08 | |
| *** dimtruck is now known as zz_dimtruck | 20:09 | |
| anteaya | dhellmann: so your email, do you see any material being directed to expand the infra manual? | 20:09 |
| anteaya | dhellmann: or is the use case/audience completely different? | 20:10 |
| *** mwagner_lap has joined #openstack-infra | 20:11 | |
| clarkb | anteaya: I would read that to be specifically focused on the writing of code and design of projects aspects which may not quite fit in the infra manual | 20:11 |
| *** emagana has joined #openstack-infra | 20:11 | |
| *** matrohon has joined #openstack-infra | 20:11 | |
| clarkb | though possibly we could host it so that a developer doesn't ahve to look everywhee for the info (but really I don't think we should be approving changes to openstack wide project design things) | 20:12 |
| anteaya | okay | 20:12 |
| *** annegent_ has joined #openstack-infra | 20:13 | |
| *** thingee has joined #openstack-infra | 20:13 | |
| andreaf | jeblair: I replied to your comment - I'll work on a script to generate the GRENADE BRANCHES from features.yaml | 20:13 |
| *** _david__ has joined #openstack-infra | 20:13 | |
| *** sdake__ has quit IRC | 20:13 | |
| *** mriedem has quit IRC | 20:14 | |
| jeblair | andreaf: cool; in the mean time, do we need to hold off on approving the revert? | 20:15 |
| *** emagana has quit IRC | 20:16 | |
| *** zz_dimtruck is now known as dimtruck | 20:17 | |
| clarkb | SpamapS: re 158148, any reason to use silent over experimental or non voting? | 20:17 |
| *** _david_ has quit IRC | 20:17 | |
| openstackgerrit | Merged openstack-infra/project-config: Limit Manila python26 job to juno version only https://review.openstack.org/159120 | 20:17 |
| clarkb | SpamapS: usually we use silent for trend building and not active debug of things known to fail | 20:17 |
| openstackgerrit | Merged openstack-infra/project-config: Rename functional files to projects. https://review.openstack.org/158807 | 20:18 |
| *** carl_baldwin has quit IRC | 20:18 | |
| *** carl_baldwin has joined #openstack-infra | 20:19 | |
| *** shashankhegde has quit IRC | 20:19 | |
| *** tmcpeak has quit IRC | 20:21 | |
| *** annegent_ has quit IRC | 20:21 | |
| *** annegent_ has joined #openstack-infra | 20:21 | |
| andreaf | jeblair: it would nice to hold off - if it's something that can wait a bit - else I can carry my change as a local change until the other implementation is complete | 20:23 |
| openstackgerrit | Merged openstack-infra/project-config: Add support of external Devstack plugin for Manila https://review.openstack.org/158653 | 20:23 |
| *** ivar-lazzaro has joined #openstack-infra | 20:24 | |
| clarkb | greghaynes: any chance you have locally built an image with 157205? | 20:25 |
| *** mriedem has joined #openstack-infra | 20:25 | |
| mrodden | adreznec, https://github.com/locke105/ansible-jeepyb its rough but it works | 20:26 |
| *** BobBall is now known as BobBall_AWOL | 20:26 | |
| *** annegent_ has quit IRC | 20:27 | |
| *** rlandy has joined #openstack-infra | 20:27 | |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Temporarily disable swift-dsvm-functional for Icehouse" https://review.openstack.org/158133 | 20:28 |
| *** ghostpl_ has joined #openstack-infra | 20:28 | |
| *** emagana has joined #openstack-infra | 20:30 | |
| adreznec | mrodden: nice. are you going to send that as an example to the capstone team? | 20:30 |
| *** mayurig has quit IRC | 20:31 | |
| mrodden | adreznec, was more so you could use it as well, but its pretty tailored to work around RHEL6-isms | 20:32 |
| *** cpallares has quit IRC | 20:32 | |
| *** cpallares has joined #openstack-infra | 20:32 | |
| mrodden | i had to compile git 1.8 from source since there is a bug in the RHEL git 1.7 one :/ | 20:32 |
| mrodden | that manage-projects.py exposes | 20:33 |
| *** marzif_ has joined #openstack-infra | 20:33 | |
| *** pcrews has joined #openstack-infra | 20:34 | |
| *** ghostpl_ has quit IRC | 20:35 | |
| openstackgerrit | Paul Michali proposed openstack-infra/project-config: Setup non-voting VPNaaS func test for StrongSwan https://review.openstack.org/158389 | 20:35 |
| openstackgerrit | Merged openstack-infra/project-config: Remove stable maintenance jobs from openstackclient https://review.openstack.org/158045 | 20:37 |
| openstackgerrit | Merged openstack-infra/project-config: Adding anchor gate tests https://review.openstack.org/157898 | 20:37 |
| openstackgerrit | Merged openstack-infra/project-config: Actually test tripleo-puppet-elements https://review.openstack.org/157503 | 20:37 |
| dhellmann | anteaya: I think the audience is different. The infra manual is a good example of successfully doing this for different content. | 20:37 |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: Run openstackclient functional tests against keystoneclient master https://review.openstack.org/156456 | 20:40 |
| openstackgerrit | Matt Riedemann proposed openstack/requirements: Pin sqlalchemy-migrate >= 0.9.5 https://review.openstack.org/159242 | 20:40 |
| *** harlowja_at_home has joined #openstack-infra | 20:40 | |
| *** ghostpl_ has joined #openstack-infra | 20:42 | |
| *** baoli has quit IRC | 20:43 | |
| pleia2 | clarkb: so bare-precise on hpcloud-b4 still didn't build last night, I'm giving it one more shot manually and then it might be time for some deeper poking around | 20:46 |
| *** achanda has quit IRC | 20:47 | |
| clarkb | ya I gave it a go too and it failed :/ | 20:47 |
| pleia2 | also, I'm back to the land of the living now | 20:47 |
| clarkb | yay for living | 20:47 |
| *** achanda has joined #openstack-infra | 20:47 | |
| pleia2 | it also occurs to me that I should probably be getting root email now, update to hiera database? | 20:49 |
| *** dizquierdo has joined #openstack-infra | 20:50 | |
| clarkb | oh ya the sysadmins list | 20:50 |
| clarkb | its in git so dont forget to commit | 20:50 |
| *** dustins has quit IRC | 20:51 | |
| *** marzif_ has quit IRC | 20:51 | |
| pleia2 | k | 20:51 |
| openstackgerrit | Merged openstack-infra/project-config: Add grenade devstack check for trove as experimental https://review.openstack.org/155100 | 20:51 |
| *** dprince has quit IRC | 20:54 | |
| *** ghostpl_ has quit IRC | 20:54 | |
| *** bhunter71 has quit IRC | 20:54 | |
| asselin | pleia2, Hi, when do you think you will setup the netcat hello world on the gerrit port? | 20:55 |
| pleia2 | ooh, my bare-precise build on hpcloud-b4 didn't fail right away, seems like it may actually finish | 20:55 |
| pleia2 | asselin: I haven't really taken a look at it yet, so not sure yet, the ip change isn't for a few weeks so I think we have some time? | 20:56 |
| *** ghostpl_ has joined #openstack-infra | 20:56 | |
| mordred | pleia2, clarkb, jeblair, jhesketh: I know you are all busy and have a crapton of other things on your plates - but I'm a little bit blocked on waiting for reviews on shade - especially the dib-nodepool topic | 20:56 |
| asselin | pleia2, our firewall rule update should happen this week. I was hoping to test it during this time. | 20:57 |
| mordred | I've also got a PR ready to merge in upstream ansible taht can't merge until that topic is in a release | 20:57 |
| mordred | mrodden: awesome. I haven't looked at your code there - but I was thinking something similar to that just earlier today | 20:57 |
| clarkb | mordred now is when you review our things :) (see dhellmann's excellent ml note) | 20:57 |
| mordred | clarkb: :) | 20:57 |
| asselin | pleia2, last time, they fat fingerred the ip address, so it took even longer. best to check when they ask you to verify it's good or now. | 20:57 |
| mordred | clarkb: fair enough | 20:57 |
| clarkb | I have been doing review today will likely get to shade | 20:58 |
| *** dimtruck is now known as zz_dimtruck | 20:59 | |
| mordred | clarkb: cool. thanks! I will also review things | 20:59 |
| pleia2 | asselin: oh, I see, I'll see what I can get done this week | 21:00 |
| asselin | pleia2, thank you | 21:00 |
| mrodden | mordred, yeah wasn't too hard, but apparently my gerrit is much different than revew.openstack.org | 21:03 |
| mrodden | finding all the environment variables to override was fun | 21:03 |
| mrodden | tried to make it ansible-pull friendly | 21:04 |
| *** sputnik13 has quit IRC | 21:05 | |
| *** 92AAALG4Y is now known as dank_ | 21:05 | |
| *** Ryan_Lane has quit IRC | 21:06 | |
| asselin | anteaya, follow-up to your request on Monday. By reverting this change, our CI environment is able to pip install again: https://review.openstack.org/#/c/157535/. Somehow that change is not compatilbe with the way we have pip.conf setup. | 21:06 |
| *** spzala has quit IRC | 21:06 | |
| *** rfolco has quit IRC | 21:07 | |
| asselin | anteaya, especially with regards to how it's used for virtual environments | 21:07 |
| *** sputnik13 has joined #openstack-infra | 21:08 | |
| *** zz_dimtruck is now known as dimtruck | 21:08 | |
| *** dmsimard is now known as dmsimard_away | 21:12 | |
| *** shashankhegde has joined #openstack-infra | 21:12 | |
| jogo | just saw a git failure http://logs.openstack.org/30/141530/13/check/gate-tempest-dsvm-neutron-large-ops/53d0ba1/logs/devstack-gate-setup-workspace-new.txt | 21:13 |
| jogo | a whole slew of them it apepars | 21:13 |
| *** mayurig has joined #openstack-infra | 21:14 | |
| *** ldnunes has quit IRC | 21:14 | |
| *** _david__ has quit IRC | 21:14 | |
| *** dimtruck is now known as zz_dimtruck | 21:18 | |
| *** dannywil_ has joined #openstack-infra | 21:19 | |
| *** zz_dimtruck is now known as dimtruck | 21:21 | |
| *** sputnik13 has quit IRC | 21:22 | |
| *** dannywilson has quit IRC | 21:23 | |
| *** sputnik13 has joined #openstack-infra | 21:23 | |
| *** pcrews has quit IRC | 21:23 | |
| *** dannywil_ has quit IRC | 21:26 | |
| *** dannywilson has joined #openstack-infra | 21:27 | |
| *** otter768 has joined #openstack-infra | 21:28 | |
| *** tnovacik_ has quit IRC | 21:29 | |
| *** dannywilson has quit IRC | 21:31 | |
| zaro | clarkb: i've not seen that jenkins error before and there's not enought context in that error message. | 21:31 |
| zaro | clarkb: mabye this is related? https://stackoverflow.com/questions/11300857/how-many-threads-should-jenkins-run | 21:31 |
| *** sputnik13 has quit IRC | 21:32 | |
| *** sputnik13 has joined #openstack-infra | 21:33 | |
| *** bswartz has quit IRC | 21:33 | |
| *** otter768 has quit IRC | 21:33 | |
| clarkb | I dont think so but possibly. didnt look like we hit a thread limit instead was out of memory | 21:33 |
| *** sputnik13 has quit IRC | 21:33 | |
| asselin | anyone understand this error? why is pip six download timing out when it's already previosuly installed? http://15.126.198.151/73/154673/9/check/3par-iscsi-driver-master-client-pip-megatron-dsvm/ee8b17f/console.html | 21:34 |
| *** sputnik13 has joined #openstack-infra | 21:34 | |
| greghaynes | dstufft: Hey, so im on a box without pip and running get-pip.py results in hitting http://bugs.python.org/issue23476 AFAICT | 21:34 |
| greghaynes | Im wondering if youall bundled the broken requests version by chance? | 21:35 |
| *** markvoelker has quit IRC | 21:35 | |
| zaro | clarkb: the last reply had something to do with running bash script that doesn't return exit status | 21:35 |
| *** markvoelker has joined #openstack-infra | 21:36 | |
| zaro | clarkb: which caused stuck threads. | 21:36 |
| clarkb | zaro that response is odd because bash always returns an exit status | 21:36 |
| mkj_wk | https://storyboard.openstack.org/#!/story/883176 won't let me add a comment | 21:37 |
| mkj_wk | it's not showing me any error | 21:37 |
| mkj_wk | I try to add a comment and it comes back with no comment added | 21:37 |
| mkj_wk | is there some error showing up on the server side? | 21:37 |
| *** carl_baldwin has quit IRC | 21:38 | |
| zaro | clarkb: not actually not bash but the error inside of the bash script left thread hanging. i'm not sure how plausable that is but would need to test to verify. | 21:40 |
| *** markvoelker has quit IRC | 21:40 | |
| *** carl_baldwin has joined #openstack-infra | 21:40 | |
| *** markvoelker has joined #openstack-infra | 21:42 | |
| *** harlowja_at_home has quit IRC | 21:44 | |
| *** baoli has joined #openstack-infra | 21:45 | |
| pc_m | Hi: Is there a known problem with gate-infra-puppet-apply-precise? Or should I just do a recheck? It is failing installing puppet modules. | 21:47 |
| pc_m | On https://review.openstack.org/#/c/158389/ | 21:47 |
| *** tsg_ has quit IRC | 21:47 | |
| *** tsg_ has joined #openstack-infra | 21:48 | |
| *** AJaeger_ has quit IRC | 21:48 | |
| *** sdake_ has joined #openstack-infra | 21:48 | |
| *** harlowja_at_home has joined #openstack-infra | 21:48 | |
| *** dimtruck is now known as zz_dimtruck | 21:49 | |
| pleia2 | clarkb: success! Image bare-precise-1424897131.template.openstack.org in hpcloud-b4 is ready | 21:50 |
| *** dizquierdo has quit IRC | 21:50 | |
| *** aysyd has quit IRC | 21:51 | |
| *** tgohad has joined #openstack-infra | 21:52 | |
| *** radez is now known as radez_g0n3 | 21:53 | |
| *** tsg_ has quit IRC | 21:53 | |
| *** bhunter71 has joined #openstack-infra | 21:58 | |
| *** harlowja_at_home has quit IRC | 21:58 | |
| *** spzala has joined #openstack-infra | 21:58 | |
| *** zz_dimtruck is now known as dimtruck | 22:03 | |
| anteaya | asselin: thanks for sharing that, and good detective work | 22:04 |
| anteaya | asselin: have you talked to dtroyer about your findings? | 22:04 |
| anteaya | pleia2: yay | 22:04 |
| *** tmcpeak has joined #openstack-infra | 22:04 | |
| asselin | anteaya, no, still catching up. I'm now at the point I can try to understand what he was telling me the other day. | 22:05 |
| anteaya | asselin: ha ha ha | 22:05 |
| anteaya | asselin: you are ahead of me then | 22:05 |
| dstufft | greghaynes: no | 22:05 |
| *** adalbas has quit IRC | 22:05 | |
| jhesketh | Morning | 22:06 |
| dstufft | greghaynes: requests wasn't really broken either tbh, Mozilal removed a bunch of 1024 bit roots because they are weak and requests updates but as it turns out, OpenSSL validates the chain you send it, so if you sent it a chain that depends on that (even if you could validate part of that chain, e.g. by removing the last item) it failed :/ | 22:07 |
| *** tgohad has quit IRC | 22:07 | |
| asselin | dstufft, maybe you can answer my question? ^^ anyone understand this error? why is pip six download timing out when it's already previosuly installed? http://15.126.198.151/73/154673/9/check/3par-iscsi-driver-master-client-pip-megatron-dsvm/ee8b17f/console.html | 22:07 |
| anteaya | morning jhesketh | 22:08 |
| anteaya | pc_m: this is the first error I see: http://logs.openstack.org/89/158389/5/check/gate-infra-puppet-apply-precise/29d932b/console.html#_2015-02-25_20_37_17_238 | 22:08 |
| dstufft | asselin: you rely on a proxy don't you | 22:08 |
| asselin | dstufft, yes | 22:08 |
| anteaya | pc_m: seems to be inablity to find resources so perhaps a connection problem? pc_m though it did pass on recheck | 22:09 |
| anteaya | krotscheck: mkj_wk has one for you | 22:09 |
| dstufft | asselin: that's setuptools downloading six not pip, (things in a setup_requires get installed by setuptools currently). I'm not sure offhand if setuptools supports proxies or how'd you configure it if it does | 22:09 |
| *** mattfarina has quit IRC | 22:10 | |
| anteaya | dhellmann: very good | 22:10 |
| pc_m | anteaya: Yeah, I just kicked a recheck and it looks like it worked. This is the third recheck, with different failures over two patches and two days :( | 22:10 |
| asselin | dstufft, ok, it's fails intermittently. but thanks for the clues. i will look at setuptools to see what's up. | 22:10 |
| clarkb | jhesketh: morning, I have reviewed the swift logs changes that I didn't write | 22:10 |
| clarkb | pleia2: woot | 22:10 |
| clarkb | jogo: I only see the one failure | 22:11 |
| *** cody-somerville has joined #openstack-infra | 22:11 | |
| *** pcrews has joined #openstack-infra | 22:11 | |
| anteaya | pc_m: hmmm | 22:12 |
| clarkb | pc_m: so that job actually looks like it timed out | 22:12 |
| *** baoli has quit IRC | 22:12 | |
| *** baoli has joined #openstack-infra | 22:12 | |
| clarkb | which is possibly related to the centos issue of get stuck doing git things during puppet runs | 22:12 |
| greghaynes | dstufft: ah, fun. So its a system issue :( | 22:12 |
| dstufft | greghaynes: is it an old system? | 22:13 |
| *** sdake__ has joined #openstack-infra | 22:13 | |
| greghaynes | no, trusty and up to date | 22:13 |
| dstufft | like, would it have an old OpenSSL that doesn't have the ability access sha256 certs? | 22:13 |
| dstufft | ah | 22:13 |
| dstufft | ok | 22:13 |
| dstufft | trusty shoudln't have any problems with out certificates | 22:13 |
| greghaynes | yea, so something else is wonky here | 22:13 |
| *** bknudson has quit IRC | 22:15 | |
| *** sdake__ has quit IRC | 22:15 | |
| clarkb | greghaynes: I just tested get-pip locally and it worked | 22:15 |
| greghaynes | awesome | 22:15 |
| greghaynes | yay for me having a broken setup | 22:16 |
| *** sdake_ has quit IRC | 22:16 | |
| greghaynes | hah, and my apt mirror's disk is full, I wonder if thats related ;) | 22:16 |
| jhesketh | Thanks clarkb | 22:16 |
| clarkb | jogo: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=877&rra_id=all is probably why git failed in that case though | 22:18 |
| clarkb | I am going to see what is dosing us | 22:18 |
| openstackgerrit | Adam Sheldon proposed openstack-infra/gitdm: Add Adam Sheldon to email mapp file. https://review.openstack.org/159274 | 22:20 |
| pc_m | clarkb: thanks for the insight. | 22:20 |
| pleia2 | clarkb: sorry to pile on, but elasticsearch02 might need some attention too, root disk is full (I saw this via errors creating my account, it can't because full) http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=123 | 22:21 |
| *** carl_baldwin has quit IRC | 22:22 | |
| pleia2 | can't tell from here what's going on, the other elasticsearch servers don't seem to be having space problems | 22:23 |
| clarkb | pleia2: thanks, I would check /var/log elasticsearch, I am going to guess its logging filled up disk | 22:23 |
| clarkb | er /var/log/elasticsearch | 22:23 |
| *** carl_baldwin has joined #openstack-infra | 22:23 | |
| jogo | clarkb: thanks | 22:23 |
| jogo | that spike looks bad | 22:23 |
| *** mbacchi has quit IRC | 22:24 | |
| *** sdake_ has joined #openstack-infra | 22:24 | |
| *** mrda-away is now known as mrda | 22:24 | |
| pleia2 | clarkb: nods, *I* can't check since puppet can't create my authorized_keys file | 22:24 |
| clarkb | OH! | 22:24 |
| *** teran_ has joined #openstack-infra | 22:25 | |
| *** che-arne has joined #openstack-infra | 22:25 | |
| clarkb | pleia2: let me get puppet to run there then you can see how derped it is | 22:25 |
| *** tmcpeak has quit IRC | 22:25 | |
| *** mriedem has quit IRC | 22:26 | |
| clarkb | pleia2: ok you should be able to get in now, | 22:27 |
| pleia2 | clarkb: thanks | 22:27 |
| *** stevemar has quit IRC | 22:27 | |
| *** teran has quit IRC | 22:27 | |
| clarkb | pleia2: check out du -h in /var/log/elasticsearch, I am guessing that es isn't rotating files properl | 22:27 |
| *** teran__ has joined #openstack-infra | 22:27 | |
| clarkb | whihc is annoying because it mostly rotates them just doesn't let them fall off | 22:27 |
| pleia2 | sure, on it | 22:27 |
| clarkb | jogo: so nothing immediately jumps out other than we have a relatively high percentage of hardware irq time | 22:28 |
| *** ddieterly has quit IRC | 22:28 | |
| clarkb | jogo: which may mean our ability to do IO is failing then things pile up? | 22:28 |
| jogo | clarkb: we have seen disk IO on nodes seize up every so often | 22:29 |
| mtreinish | jogo: oh, yeah those are always fun to debug | 22:29 |
| clarkb | jogo: in rax dfw? | 22:29 |
| clarkb | jogo: these gitXX nodes are all in rax dfw | 22:29 |
| *** tmcpeak has joined #openstack-infra | 22:29 | |
| *** teran_ has quit IRC | 22:29 | |
| *** tmcpeak has quit IRC | 22:30 | |
| mtreinish | clarkb: everywhere, but anecdotally more often on HP do we have io problems in gate jobs | 22:30 |
| mtreinish | clarkb: we chalk it up to noisy neighbors when it happens | 22:30 |
| mtreinish | but I doubt that's it for you because the git nodes are sufficiently large right? | 22:30 |
| * jogo wonders what happens when we have our own cloud and become our own noisy neighbors | 22:31 | |
| jogo | clarkb: unrelated good news, haven't seen the nodebool slave node not coming online issue in a while now | 22:31 |
| clarkb | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=898&rra_id=all though looking at that we are doing much io at the time so likely more irqs simple due to throughput? | 22:32 |
| *** tmcpeak has joined #openstack-infra | 22:32 | |
| clarkb | mtreinish: no the gitXX hosts are the same flavor as gate nodes | 22:32 |
| mtreinish | clarkb: oh ok, I just always assumed you used bigg vms for them | 22:32 |
| clarkb | also 8MBps isnt all that crazy | 22:32 |
| *** mrunge is now known as mrunge_zzz | 22:33 | |
| *** esker has quit IRC | 22:33 | |
| *** pc_m has quit IRC | 22:34 | |
| openstackgerrit | Max Rydahl Andersen proposed openstack-infra/jenkins-job-builder: Remove nonexistent servername and cleanup build publisher https://review.openstack.org/156091 | 22:34 |
| clarkb | '[Wed Feb 25 22:10:33 2015] [warn] [client 23.253.252.78] Timeout waiting for output from CGI script /usr/libexec/git-core/git-http-backend' that seems to be the end result of the load though | 22:35 |
| *** mfink_ has quit IRC | 22:36 | |
| *** ParsectiX has quit IRC | 22:36 | |
| *** ParsectiX has joined #openstack-infra | 22:37 | |
| pleia2 | clarkb: so we probably should do some logrotation (we don't on any of them), but that's not the issue, the problem is the logs on es2 are simply *huge* compared to the other servers, like 158M vs 21K comparing elasticsearch.log.2015-01-07 on es2 to es3 | 22:37 |
| *** AJaeger has quit IRC | 22:37 | |
| clarkb | pleia2: ya the reason for that I think is es2 is getting all the requests from the apache elasticsearch api proxy | 22:37 |
| pleia2 | ah | 22:37 |
| clarkb | pleia2: so whenever there is an error in a search request because its malformed or whatever es2 logs the failre | 22:37 |
| *** AJaeger has joined #openstack-infra | 22:38 | |
| *** AJaeger has joined #openstack-infra | 22:38 | |
| clarkb | the other nodes never know and ocntinue to be happy campers | 22:38 |
| pleia2 | I see, that'll do it | 22:38 |
| clarkb | pleia2: I am 99% sure its safe to delete all but the most recent of those logs files | 22:38 |
| clarkb | (I already deleted a handful to get puppet to run) | 22:38 |
| pleia2 | it's not logging anything now since the disk is full, do we want to add some log rotation? | 22:38 |
| *** ParsectiX has quit IRC | 22:38 | |
| *** ParsectiX has joined #openstack-infra | 22:39 | |
| pleia2 | I can go ahead and clear out much of 2014 then | 22:39 |
| clarkb | ya lets go ahead and clear out most of it | 22:39 |
| pleia2 | k | 22:39 |
| clarkb | then for rotation we need to make sure whatever rotating + deleting we do basically only does dleeting and lets the existing rotation do its thing | 22:39 |
| *** tiswanso has quit IRC | 22:39 | |
| * pleia2 nods | 22:40 | |
| pleia2 | I'll put crafting that change on my todo list | 22:40 |
| pleia2 | and maybe make a story in the meantime | 22:40 |
| *** emagana has quit IRC | 22:40 | |
| *** emagana has joined #openstack-infra | 22:41 | |
| clarkb | ++ | 22:41 |
| *** ChuckC has quit IRC | 22:43 | |
| *** tmcpeak has quit IRC | 22:44 | |
| *** emagana has quit IRC | 22:45 | |
| *** bswartz has joined #openstack-infra | 22:46 | |
| *** matrohon has quit IRC | 22:46 | |
| openstackgerrit | Max Rydahl Andersen proposed openstack-infra/jenkins-job-builder: Initial work for supporting downstream-ext https://review.openstack.org/158117 | 22:46 |
| *** eharney has quit IRC | 22:47 | |
| *** jcoufal has joined #openstack-infra | 22:50 | |
| *** eharney has joined #openstack-infra | 22:50 | |
| clarkb | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=880&rra_id=all makes it look like things do pile up as a result which likely only leads to more pain | 22:51 |
| clarkb | I wonder if we can make haproxy smarter about that | 22:51 |
| *** tsg has joined #openstack-infra | 22:52 | |
| *** mrunge_zzz has quit IRC | 22:53 | |
| *** mayurig has quit IRC | 22:54 | |
| greghaynes | hrm? | 22:54 |
| greghaynes | you mean the connect backlog? | 22:54 |
| clarkb | greghaynes: or maybe update the hash algorithm temporarily | 22:56 |
| clarkb | like if we can put num_connections as a parameter to the hash | 22:56 |
| clarkb | problem with that is it can break our multi haproxy setup | 22:56 |
| clarkb | :/ | 22:56 |
| * greghaynes doesnt entirely understand the problem | 22:56 | |
| *** mayurig has joined #openstack-infra | 22:57 | |
| greghaynes | the issue is one of your backends dies out and you get a big connect backlog for that one? | 22:57 |
| *** mayurig has quit IRC | 22:57 | |
| *** mayurig has joined #openstack-infra | 22:57 | |
| greghaynes | because, if you want to take in active connectoins as a param theres a balance setup for that too | 22:57 |
| *** ChuckC has joined #openstack-infra | 22:58 | |
| clarkb | greghaynes: basically yes, one node will go awol because it has comparatively more IO to do | 22:59 |
| *** asselin_ has joined #openstack-infra | 23:00 | |
| clarkb | greghaynes: while it does that IO all new connections to it seem to pile up behind | 23:00 |
| clarkb | the problem here is we have two haproxy servers to get more bandwidth from rax, this works fine with the source ip hashing but not so good if we get smarter than that | 23:00 |
| *** crc32 has quit IRC | 23:00 | |
| greghaynes | oh, are they dns roundrobin'd or something? | 23:01 |
| clarkb | yes | 23:01 |
| clarkb | greghaynes: problem there is rax doesn't give us enough public bandwidth on just one node | 23:02 |
| clarkb | so we doubled up | 23:02 |
| greghaynes | yea, fun | 23:02 |
| greghaynes | and you always want to make sure clients hit the same backend because of replication? | 23:03 |
| clarkb | greghaynes: yes | 23:03 |
| greghaynes | its like file backed sessions all over again ;) | 23:03 |
| clarkb | so its possible that afs backed git repos fix these problems because we can synchronize replication with afs | 23:03 |
| clarkb | and just do connection count based balancing | 23:03 |
| *** AJaeger has quit IRC | 23:03 | |
| clarkb | or IO or etc | 23:04 |
| *** asselin_ has quit IRC | 23:04 | |
| greghaynes | yep, you could also make your connect timeouts and backlog low for now so you at least fail (and hopefully recover) faster | 23:04 |
| *** signed8b_ has joined #openstack-infra | 23:05 | |
| greghaynes | but youre right - you cant really do anything clever with the consistent client -> backend requirement | 23:05 |
| clarkb | hrm I would prefer to shoot the hog in the head instead of everything that comes behind it | 23:05 |
| *** dannywilson has joined #openstack-infra | 23:05 | |
| *** dannywilson has quit IRC | 23:05 | |
| *** dannywilson has joined #openstack-infra | 23:06 | |
| clarkb | also I wonder how much better our performance would be with newer git | 23:06 |
| *** AJaeger has joined #openstack-infra | 23:06 | |
| clarkb | and newer kernel and basically not ancient centos6 | 23:06 |
| clarkb | I should build a centos7 node and test | 23:07 |
| jeblair | clarkb: the machines normally run at very utilization | 23:07 |
| jeblair | clarkb: i'm not sure a newer kernel is going to help | 23:07 |
| clarkb | jeblair: when things do get slow there is significant system cpu time | 23:07 |
| clarkb | jeblair: which isn't necessarily fixed by a newer kernel but newer kernel may affect that | 23:07 |
| *** signed8bit has quit IRC | 23:07 | |
| clarkb | also after the git diff --quiet vs git diff --exit-code behavior on precise I am scared of old git | 23:08 |
| pleia2 | yeah, I do think newer git at least will help | 23:09 |
| anteaya | would the rax and centos7 issue that glusterfs dug up affect us here? | 23:09 |
| *** hichihara has joined #openstack-infra | 23:09 | |
| pleia2 | going to find some food | 23:09 |
| clarkb | anteaya: its certainly possible, though it failed deep into a tempest run which is lots of systemy things and not so much git | 23:09 |
| jeblair | clarkb: but there's also swapping activity at the same time because of memory exhaustion; that and a large number of processes could explain quite a bit of system time | 23:10 |
| *** erlon has quit IRC | 23:11 | |
| clarkb | jeblair: I don't think there was swapping during the recent occurence | 23:12 |
| clarkb | oh wait there was nevermind | 23:12 |
| jeblair | http://cacti.openstack.org/cacti/graph.php?action=zoom&local_graph_id=882&rra_id=5&view_type=&graph_start=1424901104&graph_end=1424903131&graph_height=120&graph_width=500&title_font_size=10 | 23:12 |
| *** reed has quit IRC | 23:13 | |
| *** gordc has quit IRC | 23:13 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Replaced python-crontab with apscheduler https://review.openstack.org/158955 | 23:15 |
| *** carl_baldwin has quit IRC | 23:15 | |
| mkj_wk | down the rabbit hole I go... git-review test suite is a bit fragile... ☺ | 23:17 |
| clarkb | mkj_wk: it spins up gerrit servers which is probably the most fragile bit | 23:18 |
| mkj_wk | well, that's not the fragility that is biting me now :) | 23:18 |
| mkj_wk | I can "killall java" until no processes killed | 23:19 |
| *** gyee has quit IRC | 23:20 | |
| mkj_wk | it turns out that doing an ssh gerrit query to look up review information causes stdin to get closed in the test suite and then it blows up trying to test submitting multiple commits, because the underlying ssh asks tries to read "yes" from stdin but finds it closed | 23:20 |
| mkj_wk | wouldn't possibly affect normal use where it's actually attached to a pty | 23:20 |
| openstackgerrit | Joe Gordon proposed openstack-infra/elastic-recheck: Make test_queries runnable as gating test https://review.openstack.org/150186 | 23:21 |
| openstackgerrit | Joe Gordon proposed openstack-infra/elastic-recheck: Add launchpad test to test_queries https://review.openstack.org/155138 | 23:21 |
| mkj_wk | at least, that's my best guess so far as to why totally unrelated code is suddenly complainig about EOF | 23:21 |
| mkj_wk | it doesn't break in the test suite if I set stdin to subprocess.PIPE in run_command_status, but that would kill real-life use ☺ | 23:22 |
| *** hdd has quit IRC | 23:22 | |
| mkj_wk | thus the rabbit hole | 23:23 |
| clarkb | don't I hope you don't have to dig too deep :0 | 23:23 |
| clarkb | er :) | 23:23 |
| jeblair | clarkb: so i'm wondering if there's an external rush of requests that triggers this, or if vm performance degrades (noisy neighbor?) enough to cause a backlog? | 23:23 |
| clarkb | jeblair: I would not be surprised if it is a VM performance degradation based on mtreinish and jogo comments earlier | 23:24 |
| clarkb | looking at jobs launched per hour graph we haven't really massively upticked use and we are predominantly the largest consumers of the mirror last time I was looking into performance issues | 23:24 |
| *** andreykurilin_ has quit IRC | 23:24 | |
| *** dkliban is now known as dkliban_afk | 23:25 | |
| jeblair | clarkb: i wonder if we should run dstat or similar with a smaller interval so we can compare logs with performance with greater accuracy, and hopefuly narrow cause and effect? | 23:25 |
| clarkb | jeblair: that sounds like a good idea | 23:26 |
| clarkb | especially since cacti is not very granular | 23:26 |
| *** achanda has quit IRC | 23:26 | |
| jeblair | clarkb: it looks like this is about a once a day occurance for each of the backends | 23:27 |
| jeblair | so we might want to go ahead and run it on all 5 | 23:27 |
| jeblair | i have to run for a bit | 23:27 |
| clarkb | jeblair: ya, the odd thing too is that daily occurence doesn't quite line up with our image builds at 1400UTC | 23:27 |
| clarkb | which is where I would expect them to be if it was based on a thundering herd | 23:28 |
| *** hdd has joined #openstack-infra | 23:28 | |
| *** asettle is now known as asettle-mtg | 23:28 | |
| *** ParsectiX has quit IRC | 23:28 | |
| *** ParsectiX has joined #openstack-infra | 23:29 | |
| *** otter768 has joined #openstack-infra | 23:29 | |
| morganfainberg | jroll, ping | 23:30 |
| morganfainberg | jroll, re: weird novaclient failure stuff with the RAX catalog for -infra things | 23:30 |
| krotscheck | Anyone know a glaringly obvious reason why locally my tests would pass, but on infra they throw DBInvalidUnicodeParameter errros? | 23:30 |
| openstackgerrit | Ryan Hsu proposed openstack-infra/os-loganalyze: Update SUPPORTS_SEV regex to support new devstack logs https://review.openstack.org/159286 | 23:30 |
| openstackgerrit | Merged openstack-infra/shade: Add hasExtension method to check cloud capabilities https://review.openstack.org/156954 | 23:31 |
| jroll | morganfainberg: oh ya, hi | 23:31 |
| jroll | morganfainberg: so you need an account with a broken catalog yes? | 23:31 |
| morganfainberg | jroll, well, it's more of a gut feeling | 23:31 |
| morganfainberg | jroll, do we need one? | 23:31 |
| jroll | morganfainberg: idk, if you want to properly test it than yes. correct? | 23:32 |
| morganfainberg | jroll, it's more of a question... how likely do you think this scenario is? | 23:32 |
| jroll | morganfainberg: oh, idk, that's the only difference we found | 23:32 |
| morganfainberg | jroll, if you think it's actually likely [more than -infra, cause -infra is cool like that] lets start getting an account stood up | 23:32 |
| jroll | morganfainberg: but I don't know much about keystoneclient, novaclient, or service catalogs :) | 23:33 |
| morganfainberg | right, but you know something about RAX customers i take it ;) | 23:33 |
| jroll | I'm just here to help out, if that's what you need | 23:33 |
| jroll | not really :P | 23:33 |
| morganfainberg | darn | 23:33 |
| *** tmcpeak has joined #openstack-infra | 23:33 | |
| *** dannywilson has quit IRC | 23:33 | |
| jroll | but I can try to get you an account | 23:33 |
| jroll | let me talk to some people | 23:33 |
| clarkb | wait is our catalog broken? | 23:34 |
| morganfainberg | can we poke at some folks to see if this scenario [the weird catalog] is common? more than -infra | 23:34 |
| *** otter768 has quit IRC | 23:34 | |
| morganfainberg | clarkb, no, not broken, just has legacy server stuff in it | 23:34 |
| jroll | clarkb: there's a bug in a certain novaclient with infra's account | 23:34 |
| morganfainberg | means new novaclient gets cranky about endpoints | 23:34 |
| morganfainberg | because new stuff is in there too | 23:34 |
| morganfainberg | in some very limited edge cases, looks like it's related to when we enabled v3 | 23:34 |
| morganfainberg | for novaclient | 23:34 |
| morganfainberg | v3 keystone [that is] | 23:35 |
| clarkb | mordred: 158199 is a shade change that you can approve if it looks good to you now | 23:35 |
| *** cody-somerville has quit IRC | 23:35 | |
| mordred | clarkb: beacuse our account existed pre opensatck - there are two entries for "compute" | 23:35 |
| clarkb | mordred: I accidentall approved it then relaized you hadn't +2'd >_> so removed my approval | 23:35 |
| *** baoli has quit IRC | 23:35 | |
| mordred | clarkb: almost with no exception if you're happy with a shade patch, I'm happy with it | 23:35 |
| *** achanda has joined #openstack-infra | 23:36 | |
| mordred | clarkb: but 158199 is not a shade patch | 23:36 |
| mordred | it's a fascinating stackalytics patch | 23:36 |
| morganfainberg | so since this *might* be more common than -infra, lets see if we can get a mirrored setup spun up so we can see if it's something that can be fixed in a good way. | 23:36 |
| morganfainberg | jroll, ^^ | 23:36 |
| morganfainberg | jroll, i expect i wont have time to work on this till the weekend anyway, so if it takes tomorrow/friday to setup all good. | 23:36 |
| clarkb | mordred sorry 158119 | 23:36 |
| jroll | morganfainberg: cool, in the meantime I'm asking if this account is something we can do | 23:37 |
| morganfainberg | jroll, great. thanks. | 23:37 |
| *** afazekas has quit IRC | 23:37 | |
| mordred | clarkb: :) | 23:37 |
| morganfainberg | if not i'll corner clarkb and fungi and mordred when i can pry them away from important things to see if we can duplicate this / get more directed info. | 23:37 |
| jroll | +1 | 23:37 |
| *** mrmartin has quit IRC | 23:38 | |
| * morganfainberg would rather have things less broken where possible. | 23:38 | |
| * morganfainberg goes back to staring into the depths of oslo.messaging to implement gearman magic around the oslo things. | 23:38 | |
| *** tmcpeak has quit IRC | 23:38 | |
| *** baoli has joined #openstack-infra | 23:38 | |
| morganfainberg | not hard, but i get the feeling if i'm not careful it wont be very robust. | 23:38 |
| jroll | morganfainberg: ok, it can be done, want me to do it? | 23:38 |
| mordred | morganfainberg: what do you need? | 23:38 |
| mordred | morganfainberg: do you want me to just get you a catalog? | 23:39 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Replaced python-crontab with apscheduler https://review.openstack.org/158955 | 23:39 |
| jroll | morganfainberg: I think we'll need an existing account though | 23:39 |
| jroll | or, mordred has a great question | 23:39 |
| jroll | what if we just mock the catalog call | 23:39 |
| morganfainberg | mordred, that would be good too. but i'm going to use rax's generosity to try and fix it directly with their service incase it's another edge case. lets start with the -infra catalog | 23:39 |
| openstackgerrit | Merged openstack-infra/shade: Add a method to create image snapshots from nova. https://review.openstack.org/158119 | 23:39 |
| morganfainberg | jroll, ^^ lets start w/ the catalog | 23:39 |
| jroll | ok, I'll wait | 23:40 |
| morganfainberg | i'll work from there. and if we have other edge cases i'll work with you to setup accounts. | 23:40 |
| *** yamamoto has quit IRC | 23:40 | |
| jroll | morganfainberg: I'll need an account to do this, so if you need it set up just pass me a tenant ID and I'll get it done | 23:40 |
| morganfainberg | sure. | 23:40 |
| mordred | morganfainberg: if it's a catalog from a couple of weeks ago, there are no security problems with me pastebininig it, right? | 23:40 |
| mordred | morganfainberg: or is there a thing I should be looking for to strip? | 23:40 |
| morganfainberg | mordred, should be zero issues pastebinning any catalog, but don't pastebin anything with a tokenid in it | 23:40 |
| mordred | morganfainberg: or is there a thing I should be looking for to strip? | 23:41 |
| mordred | gah | 23:41 |
| mordred | one sec | 23:41 |
| morganfainberg | though tokens from a couple weeks ago should be long since expired [one would hope] | 23:41 |
| mordred | morganfainberg: http://paste.openstack.org/show/182151 | 23:41 |
| mordred | token stripped | 23:41 |
| morganfainberg | mordred, awesome. | 23:41 |
| mordred | enjoy the two compute services | 23:41 |
| morganfainberg | hah, oh boy. | 23:41 |
| SpamapS | hrm | 23:42 |
| *** markvoelker has quit IRC | 23:42 | |
| morganfainberg | wow, thats fun. | 23:42 |
| SpamapS | why don't ansible core module docs show a description of what they return? | 23:42 |
| morganfainberg | SpamapS, because no one added the information yet? :P | 23:42 |
| *** markvoelker has joined #openstack-infra | 23:42 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Import from v2 instead of v1_1 https://review.openstack.org/157509 | 23:43 |
| *** chlong has quit IRC | 23:43 | |
| *** chlong_ has quit IRC | 23:44 | |
| jamielennox | morganfainberg: i can tell you already that keystoneclient doesn't handle multiple of the same service_type - there was a bug opened for it and we decided against fixiing it | 23:44 |
| clarkb | SpamapS: pretty sure ansible docs are that way to prevent us all from using ansible at once | 23:44 |
| clarkb | mordred: I am almost doing shade reviews. Just have to review this relatively giant thing from Shrews :P | 23:46 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Do not allow to pass *-cache on init https://review.openstack.org/157752 | 23:46 |
| mordred | clarkb: yay! I'm fixing the two merge conflicts - nothing substantive so I'm just going to carry over the previous reviews on them for expedience | 23:47 |
| clarkb | mordred: ya I +2'd both already so I think you can appriove them | 23:47 |
| *** markvoelker has quit IRC | 23:47 | |
| *** chlong has joined #openstack-infra | 23:48 | |
| *** dimtruck is now known as zz_dimtruck | 23:48 | |
| *** signed8b_ is now known as signed8bit_ZZZzz | 23:48 | |
| *** mayurig has quit IRC | 23:48 | |
| morganfainberg | jamielennox, really? | 23:48 |
| *** asselin_ has joined #openstack-infra | 23:48 | |
| morganfainberg | jamielennox, hm. we broke novaclient - it used to [sortof] merrily do the right thing before | 23:48 |
| jamielennox | morganfainberg: it's kind of an undefined area | 23:48 |
| morganfainberg | jamielennox, and this wont be the only case someone has deployed something in a way that is icky :( | 23:49 |
| jamielennox | morganfainberg: we decided that there was no reason to add it as new functionality | 23:49 |
| morganfainberg | jamielennox, i vaguely remember this convo | 23:49 |
| *** markvoelker has joined #openstack-infra | 23:49 | |
| clarkb | so as the poor user, why couldn't nova handle this. keystone should return the catalog info unopinionated | 23:49 |
| morganfainberg | clarkb, because keystone client is being asked .get_endpoint('compute') | 23:50 |
| morganfainberg | clarkb, what do we return | 23:50 |
| clarkb | morganfainberg: a list | 23:50 |
| clarkb | then novacleint can figure out which endpoints it needs to talk to | 23:50 |
| mordred | clarkb: that would assume that those endpoints carry versions | 23:50 |
| morganfainberg | that would break everyone i think. because until now it's been a string [historical, we inherited, please dont ask] | 23:50 |
| *** mayurig has joined #openstack-infra | 23:50 | |
| mordred | and that's it's possible tofigure out | 23:50 |
| *** bknudson has joined #openstack-infra | 23:51 | |
| clarkb | mordred: :/ | 23:51 |
| mordred | I think that's the problem ^^ in history, this was CRAZY | 23:51 |
| mordred | which makes backing out harder | 23:51 |
| mordred | it's ok, btw- shade handles the appropriately now :) | 23:51 |
| morganfainberg | the right answer might be .get_endpoint_smarter('compute') -- realize pseudocode™ | 23:51 |
| jamielennox | clarkb: a large part of all this was to remove things like having novaclient need to deal with the catalog | 23:51 |
| morganfainberg | and that can return a list | 23:51 |
| mordred | shade == dumping ground for all the bs hacks we find | 23:51 |
| openstackgerrit | Richard Jones proposed openstack/requirements: pip 1.6 (6.0) was released, so pip-missing-reqs needed an update https://review.openstack.org/159293 | 23:51 |
| morganfainberg | mordred, hey if we make this better and shade can avoid needing to do this, yay!, right? :) | 23:51 |
| *** baoli has quit IRC | 23:51 | |
| mordred | morganfainberg: yes! | 23:52 |
| mordred | morganfainberg: but only if you make it smart enough that I don't still need to do more things :) | 23:52 |
| jamielennox | morganfainberg: ok - so we pretty much don't have a choice here but to fix it in ksc right? | 23:52 |
| * mordred votes on shade being made irrelevant | 23:52 | |
| morganfainberg | jamielennox, i think so, but i think we need to fix it in a way that doesn't hork everyone | 23:52 |
| * dstufft votes on computers being made irrelevant | 23:52 | |
| jamielennox | mordred is filing bugs on all these things he has to hack around in ksc... | 23:52 |
| morganfainberg | jamielennox, so likely a new method? | 23:52 |
| morganfainberg | jamielennox, i'm going to troll through shade and find stuff and open bugs this weekend | 23:52 |
| SpamapS | my favorite type of project is one that starts with an eye toward self-annihilation. | 23:52 |
| mordred | jamielennox: to be fair - my "fix" is hard coding a service name to look for if the cloud endpoint is racksapce | 23:53 |
| SpamapS | tripleo-heat-templates 'merge.py' was that way | 23:53 |
| SpamapS | only took 2 years to kill. | 23:53 |
| mordred | SpamapS: :) | 23:53 |
| jamielennox | mordred: yea, ok - not an upstream issue | 23:53 |
| SpamapS | They merged the "deprecate that crap" patch this morning I believe. | 23:53 |
| jamielennox | mordred: it's not a new method i think | 23:53 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Replaced python-crontab with apscheduler https://review.openstack.org/158955 | 23:53 |
| clarkb | jamielennox: fwiw I think novaclient is the only thing that should deal with compute endpoits | 23:53 |
| StevenK | mordred: So, I have bent delorean to my will, and have successfully built os-cloud-config and oslo.i18n with it. I need to clean it up properly, but \o/ progress | 23:53 |
| morganfainberg | jamielennox, but since we weren't specific in the catalog in keystone before... we get some insanity we need to work around now :( [gosh this conversation is feeling more and more like the normal lately] | 23:54 |
| jamielennox | mordred: is it raising EndpointNotFound or is it returning the wrong thing (i don't know who asked) | 23:54 |
| clarkb | jamielennox: keystone should return the set of data that pertains to nova unopinionated and let nova be smart about what it needs | 23:54 |
| jamielennox | damn morganfainberg ^ | 23:54 |
| *** baoli has joined #openstack-infra | 23:54 | |
| morganfainberg | jamielennox, EndPointNotFound | 23:54 |
| dstufft | SpamapS: as I recall, r1chardj0n3s always planned for PyPI to be replaced by something better shortly after, and it was just a sort of prototype thing, 15 years later, still going strong(ish)! | 23:54 |
| jroll | clarkb: +1 | 23:54 |
| morganfainberg | clarkb, agreed, but we can't break everyone suddenly either ;) | 23:54 |
| jamielennox | clarkb: yes and no - novaclient should be dealing with the endpoint, the layout of the service catalog is completely keystone's domain, novaclient just asks for it | 23:54 |
| mordred | jamielennox: well, what happens is that you ask for compute and you get the old compute endpoint which you then get an auth exception for | 23:55 |
| mordred | or something | 23:55 |
| morganfainberg | jamielennox, but if there is 2 of a type, keystone needs to be better about saying what is wrong, not "OMG nothing found" | 23:55 |
| clarkb | right but keystoneclient deciding a valid compute endpoint shouldn't be given to nova to figure out is bonghits | 23:55 |
| jroll | jamielennox: but should keystone *client* touch the catalog or just pass it along | 23:55 |
| *** hdd has quit IRC | 23:55 | |
| jroll | ya | 23:55 |
| morganfainberg | or at least saying "derp 2 of these, tell me which to use" | 23:55 |
| jamielennox | jroll: IMO ksc should be the only thing interpretting the catalog | 23:55 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Replaced python-crontab with apscheduler https://review.openstack.org/158955 | 23:55 |
| jamielennox | clarkb: that would come down to filtering though right? | 23:56 |
| morganfainberg | clarkb, bonghits, crazy pants, pants on head... | 23:56 |
| jamielennox | clarkb: how is novaclient supposed to make a better decision on what endpoint to use? | 23:56 |
| anteaya | hp managed to come up with an interal title with the acronym TSA | 23:56 |
| jroll | lol | 23:56 |
| mordred | jamielennox: how is anything? | 23:56 |
| jamielennox | clarkb: all an endpoint is is a region, a url and an iterface | 23:56 |
| anteaya | really? | 23:56 |
| anteaya | that was a good idea? | 23:56 |
| jroll | anteaya: rackspace now has IPA | 23:56 |
| jamielennox | mordred: i don't know - but i'd like it to be in one place | 23:57 |
| jroll | which is also a beer and an openstack project | 23:57 |
| anteaya | rax is doing acronyms the right way | 23:57 |
| mordred | jamielennox: yes. I would love for it to be in one place | 23:57 |
| morganfainberg | jamielennox, i don't think it's unreasonable for ksc to own the catalog, i think we need to be able to at least say 300 - multiple options | 23:57 |
| mordred | jroll: rax has an IPA that is not ironic python agent? | 23:57 |
| mordred | or you're talking about ironic python agent? | 23:57 |
| jroll | mordred: yep, product org is now IPA | 23:57 |
| mordred | wow | 23:57 |
| jroll | :D | 23:57 |
| jamielennox | mordred: i took ksc as the service_catalog implementation because it was there and it made sense, cinderclient used to have its own and i think novaclient did as well | 23:57 |
| morganfainberg | jamielennox, if that makes sense: (^ mordred jroll clarkb ) | 23:57 |
| anteaya | jroll: can we borrow your acronym rollers | 23:58 |
| morganfainberg | jamielennox, yes that i think is what we fixed in the "turn on v3" patch for nvaclient | 23:58 |
| jroll | anteaya: no, all mine!:) | 23:58 |
| *** jcoufal has quit IRC | 23:58 | |
| *** gordc has joined #openstack-infra | 23:58 | |
| anteaya | jroll: I don't blame you | 23:58 |
| clarkb | mordred: what do you think of my comment on 153623? | 23:58 |
| anteaya | whoever allowed TSA to make it to the email needs a dose of reality | 23:58 |
| morganfainberg | anteaya, haha right?! | 23:59 |
| *** sdake_ has quit IRC | 23:59 | |
| openstackgerrit | Merged openstack-infra/shade: Add unit tests for meta module https://review.openstack.org/158915 | 23:59 |
| morganfainberg | anteaya, i laughed pretty hard. | 23:59 |
| openstackgerrit | Merged openstack-infra/shade: Add unit test for meta.get_groups_from_server https://review.openstack.org/159111 | 23:59 |
| anteaya | morganfainberg: oh good | 23:59 |
| clarkb | jroll: novaclient can make a better decision because it can query all endpoints given it and being novaclient decide which is useable | 23:59 |
| clarkb | er jamielennox ^ | 23:59 |
| jamielennox | morganfainberg: so if it's raising EndpointNotFound that's relatively easy to fix, if it's returning the wrong endpoint then the best i can do is say specify your filter better because the other endpoint obviously matched as well | 23:59 |
| anteaya | my first response was panic | 23:59 |
| anteaya | morganfainberg: yours was the better response | 23:59 |
| clarkb | keystoneclient doesn't know anything about nova api endpoints beyond where they are supposedly located | 23:59 |
| jamielennox | clarkb: but this was always the intention of the servicecatalog | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!