*** harlowja is now known as harlowja_away | 00:01 | |
morganfainberg | JayF, there is... a NC hockey fan? | 00:01 |
---|---|---|
JayF | morganfainberg: moreso than that, I was born and raised in NC | 00:02 |
morganfainberg | JayF, ahhh | 00:02 |
*** melwitt has quit IRC | 00:02 | |
fungi | morganfainberg: we make do with what we can get here | 00:02 |
JayF | morganfainberg: like I said, I'm the endangered species of "native NC hockey fan" that nobody outside of Raleigh believes exist | 00:02 |
fungi | morganfainberg: though fwiw, most of the players on the team are canadians, same with the rest of the nhl | 00:03 |
morganfainberg | Oh obviously i'm outside of Raliegh, so... I'm suddenlyconfused, by world view might be shifting | 00:03 |
*** tsg has joined #openstack-infra | 00:03 | |
morganfainberg | sure. | 00:03 |
JayF | fungi: at least we had Patty O'Sullivan for a season :) | 00:03 |
fungi | bwahahahaha | 00:03 |
fungi | the exception that makes the rule | 00:04 |
* morganfainberg goes back to watching the Kings play (SoCal native here) | 00:04 | |
*** ccit has joined #openstack-infra | 00:04 | |
JayF | fungi: also Josh Wesley was drafted iirc (by the canes, which is kinda cheating, but still) | 00:04 |
JayF | morganfainberg: no you aren't watching the kings play :) | 00:04 |
morganfainberg | true not right now | 00:04 |
morganfainberg | right now i'm staring at IRC | 00:04 |
JayF | morganfainberg: that's not for another 2 hours + banner raising. I just hope seeing the banner is burned into Shark memories so we don't choke in the playoffs again (I've since moved to CA and have Sharks season tickets... so yeah) | 00:05 |
*** ccit has left #openstack-infra | 00:05 | |
JayF | morganfainberg: you have no idea the quantity of smug I was after about 84 games last year (81+3) ;) | 00:05 |
openstackgerrit | A change was merged to openstack-infra/config: Improve jeepyb.rst content https://review.openstack.org/124127 | 00:05 |
morganfainberg | haha | 00:05 |
*** shashankhegde has joined #openstack-infra | 00:07 | |
openstackgerrit | A change was merged to openstack-infra/config: Stop statusbot joining #openstack-packaging https://review.openstack.org/124852 | 00:10 |
*** yamahata has joined #openstack-infra | 00:10 | |
*** harlowja_away is now known as harlowja | 00:11 | |
*** wenlock has quit IRC | 00:15 | |
*** sunil_ has joined #openstack-infra | 00:19 | |
*** otherwiseguy has quit IRC | 00:19 | |
*** terryw has joined #openstack-infra | 00:19 | |
*** gokrokve has joined #openstack-infra | 00:21 | |
*** openstackstatus has quit IRC | 00:23 | |
*** ivar-lazzaro has quit IRC | 00:23 | |
*** openstackstatus has joined #openstack-infra | 00:23 | |
*** ChanServ sets mode: +v openstackstatus | 00:24 | |
sunil_ | I am trying to install slave for our CI setup following http://www.joinfu.com/2014/02/setting-up-an-openstack-external-testing-system-part-2/...and running into this error:Error: /Stage[main]/Os_ext_testing::Base/File[/opt/nodepool-scripts]: Could not evaluate: Could not retrieve information from environment production source(s) puppet:///modules/openstack_project/nodepool/scripts | 00:24 |
sunil_ | does anybody know whats going on there? | 00:24 |
*** Sincler has quit IRC | 00:25 | |
sunil_ | somebody reported the same error on Sep 29 on IRC but the chat logs don't show any resolution | 00:25 |
*** patrickeast has quit IRC | 00:25 | |
fungi | does jaypipes need to update his blog post to account for the split between the config and project-config repositories maybe? | 00:25 |
pleia2 | or bring it into infra-manual as a 3rd party setup document? | 00:26 |
pleia2 | I'd love to see something more official than a blog post | 00:26 |
sunil_ | is there anywhere I can know more about the split? is there any quick fix I can apply? | 00:26 |
fungi | i keep pressing for that. will be easier to keep updated | 00:26 |
fungi | blog posts are far too point-in-time for something as dynamic as systems automation software | 00:27 |
pleia2 | yeah | 00:27 |
*** mfer has joined #openstack-infra | 00:27 | |
pleia2 | if it's something we want to do, I can work on it | 00:27 |
sunil_ | yeah, but there is hardly anything as good as his post which goes through detailed steps for newbies | 00:27 |
pleia2 | sunil_: indeed, sorry for the meta-conversaion :) | 00:28 |
*** bnemec has quit IRC | 00:28 | |
fungi | sunil_: probably no "quick" fix other than to dive deeper into the documentation we provide at http://ci.openstack.org/ and learn how these components fit together. that's an unfortunate end result of the "give someone a fish" vs "teach someone to fish" style of documentation | 00:28 |
fungi | recipes are no subsitiute for learning | 00:28 |
*** arosen has quit IRC | 00:28 | |
*** IAX has quit IRC | 00:29 | |
sunil_ | agreed, but when ou have deadlines, recipes are awesome...:) | 00:30 |
*** hdd has quit IRC | 00:30 | |
fungi | sunil_: the official announcement, if it helps: http://lists.openstack.org/pipermail/openstack-dev/2014-September/047207.html | 00:30 |
sunil_ | where can I get more info on that split you talked about | 00:30 |
*** prad has joined #openstack-infra | 00:31 | |
sunil_ | let me have a look | 00:31 |
fungi | yeah, some info and pointers to more detailed material are in the announcement | 00:32 |
anteaya | sunil_: tell the people giving you deadlines that unless they give you time to work with us and learn what you are doing your system will always be broken or disabled | 00:33 |
fungi | there are likely channel denizens in apac timezones starting to wake up now who might be around to provide additional guidance. it's unfortunately getting late-ish in the americas | 00:33 |
anteaya | sunil_: so your deadlines are actually creating obstacles for you to accomplish your goals | 00:33 |
sunil_ | yeah, that sounds odd but its true | 00:34 |
anteaya | the fact you have a deadline doesn't make you unique to the over 100 people in the same situation as yourself | 00:34 |
anteaya | sunil_: spend some time attending the third party meetings and reading the past longs | 00:34 |
anteaya | logs | 00:34 |
anteaya | http://eavesdrop.openstack.org/meetings/third_party/ | 00:35 |
pleia2 | aha! I thought I remembered some patch re: 3rd party to manual https://review.openstack.org/#/c/109800/ | 00:35 |
pleia2 | anteaya: would this be a place to transplant jaypipes' docs to? | 00:35 |
anteaya | sunil_: https://wiki.openstack.org/wiki/Meetings/ThirdParty | 00:36 |
anteaya | pleia2: let's bring this up at the infra meeting | 00:36 |
pleia2 | anteaya: ok :) | 00:36 |
anteaya | since joa actually tried to do that and then abandoned his patch because he was asked to put it in the ci.openstack.org/third-party.rst doc | 00:37 |
pleia2 | gah | 00:37 |
anteaya | I said I would make the patch with the info and never did | 00:37 |
anteaya | my heart is to put in in infra-manual | 00:37 |
anteaya | but nothing has gotten merged to that repo since late july | 00:37 |
anteaya | so I stopped reviewing it | 00:37 |
anteaya | it just fell down the list | 00:37 |
anteaya | and jim said he wanted it in ci.openstack.org/third-party | 00:38 |
sunil_ | anteaya: I am just beginning in the openstack world. and there is much to read and learn | 00:38 |
anteaya | I think it needs to come back onto the table again | 00:38 |
anteaya | sunil_: you have had your first excellent realization | 00:38 |
anteaya | sunil_: well done | 00:38 |
* anteaya gives sunil_ a cookie | 00:38 | |
sunil_ | :D | 00:38 |
fungi | our reach exceeds our grasp where documenting things vs building things is concerned, i'm afraid | 00:39 |
* pleia2 gives anteaya a cookie too | 00:39 | |
anteaya | sunil_: the best thing you can do is get your manager to give you space to learn what it is you are doing | 00:39 |
pleia2 | ok, off to Ubuntu Hour + Debian Dinner for real now, later all | 00:39 |
anteaya | sunil_: if you had 4 to 6 weeks to learn how to be an openstack contributor | 00:39 |
sunil_ | yeah, agreed | 00:39 |
anteaya | sunil_: you would learn so much about how to operate a third party ci | 00:39 |
anteaya | sunil_: send your boss here and I will tell them | 00:39 |
sunil_ | :D | 00:39 |
anteaya | they might not listen but I am willing to try | 00:40 |
anteaya | sunil_: i'm serious | 00:40 |
*** unicell has joined #openstack-infra | 00:40 | |
anteaya | if you don't know what you are doing you are just going to blow up your system and maybe ours | 00:40 |
anteaya | then i have to chase you down and disable you and you are doing to whine to me about re-enableing your system | 00:40 |
anteaya | it is horribly ineffective | 00:40 |
anteaya | and I've done it over 50 times with people in exactly your situation | 00:41 |
anteaya | but it is up to you | 00:41 |
sunil_ | no no...I am not going to do anything which blows up anything | 00:41 |
anteaya | think again | 00:41 |
anteaya | sunil_: best thing you can do | 00:42 |
anteaya | push everything off your desk | 00:42 |
*** mfer has quit IRC | 00:42 | |
anteaya | study this: http://docs.openstack.org/infra/manual/developers.html | 00:42 |
anteaya | follow every instruction | 00:42 |
anteaya | this should take you a week or more | 00:42 |
anteaya | ask questions about that document | 00:42 |
anteaya | after you have worked your way through the document | 00:42 |
anteaya | and you have successfully committed patches to the sandbox repo | 00:43 |
*** markmcclain has quit IRC | 00:43 | |
anteaya | then you can ask about how to set up your ci | 00:43 |
*** mmaglana has quit IRC | 00:43 | |
anteaya | and you will be able to answer many of them yourself | 00:43 |
anteaya | since you will by then understand the developer workflow | 00:43 |
sunil_ | yeah, that's where I started | 00:43 |
anteaya | good | 00:43 |
anteaya | what step are you on | 00:43 |
*** terryw has quit IRC | 00:44 | |
anteaya | haev you a launchpad account? | 00:44 |
sunil_ | yup | 00:44 |
anteaya | lets see it | 00:44 |
anteaya | post the url into channel | 00:44 |
sunil_ | hold on | 00:44 |
*** otherwiseguy has joined #openstack-infra | 00:45 | |
sunil_ | https://launchpad.net/~sunil-5 | 00:46 |
anteaya | great what it the next step in the developer manual after setting up a launchpad account? | 00:46 |
*** yaguang has joined #openstack-infra | 00:46 | |
anteaya | is 10-09 september 10? | 00:47 |
anteaya | so is this a month old or an hour old? | 00:47 |
sunil_ | don't remember...it was a while ago. | 00:47 |
anteaya | must be a month old | 00:47 |
anteaya | okay so launchpad account, next step | 00:47 |
sunil_ | but I did set up everything that I needed to | 00:47 |
anteaya | good | 00:48 |
anteaya | lets see your gerrit account | 00:48 |
sunil_ | signed all the agreements I needed to | 00:48 |
anteaya | good | 00:48 |
anteaya | review.openstack.org | 00:48 |
anteaya | log in | 00:48 |
anteaya | what is your gerrit username? | 00:49 |
sunil_ | sunil | 00:49 |
*** ayoung has joined #openstack-infra | 00:49 | |
anteaya | have you uploaded a patch? | 00:50 |
anteaya | or reviewed anything? | 00:50 |
sunil_ | only against sandbox project to test things to see if I get gerritt events and zuul sees them | 00:51 |
anteaya | is this you? https://review.openstack.org/#/q/owner:%22Sunil+Kumar+%253Csunil%2540embrane.com%253E%22,n,z | 00:51 |
sunil_ | yeah | 00:51 |
*** JayJ has quit IRC | 00:52 | |
anteaya | good now you need to submit a second patchset to the first patch | 00:52 |
anteaya | not a brand new patchset | 00:52 |
sunil_ | why? does the sandbox project need me to undo removal of random mytest file? | 00:53 |
anteaya | I'm rechecking this patchset to get you a fresh copy of how the docs will look once it is merged: https://review.openstack.org/#/c/104951/ | 00:53 |
*** markmcclain has joined #openstack-infra | 00:53 | |
openstackgerrit | A change was merged to openstack-infra/devstack-gate: Update README for post config split https://review.openstack.org/125470 | 00:53 |
anteaya | sunil_: why submit a new patchset to a patch that is a very good question | 00:54 |
*** terryw has joined #openstack-infra | 00:54 | |
anteaya | sunil_: I'm glad you asked | 00:54 |
anteaya | sunil_: what project do you want to test? | 00:54 |
*** otherwiseguy has quit IRC | 00:54 | |
sunil_ | I thought sandbox was a scratch pad sort and I could throw anything at it to test my setup | 00:54 |
sunil_ | I am not sure I am following you | 00:55 |
*** salv-orlando has quit IRC | 00:55 | |
openstackgerrit | A change was merged to openstack-infra/devstack-gate: Better check for pypi mirror host connectivity https://review.openstack.org/126290 | 00:55 |
*** mmedvede has joined #openstack-infra | 00:55 | |
*** hdd has joined #openstack-infra | 00:55 | |
anteaya | sunil_: right you aren't | 00:56 |
anteaya | sunil_: look over my questions again | 00:56 |
anteaya | answer anything you are able to answer | 00:56 |
sunil_ | you mean "[17:54] <anteaya> sunil_: what project do you want to test?"? | 00:57 |
anteaya | we can start there | 00:57 |
anteaya | if you would like to answer that | 00:57 |
sunil_ | oh...wait....:) Eventually, I am interested in the neutron project | 00:58 |
anteaya | yay | 00:58 |
anteaya | neutron | 00:58 |
anteaya | great | 00:58 |
sunil_ | I thought you were asking in the context of that commit I submitted for testing | 00:58 |
anteaya | do you know how to find neutron patch in gerrit | 00:58 |
anteaya | if you don't know, ask | 00:58 |
anteaya | do you know how to find a neutron patch in gerrit? | 00:59 |
sunil_ | search? | 00:59 |
anteaya | go ahead | 00:59 |
*** shashankhegde has quit IRC | 00:59 | |
anteaya | search for neutron patches in gerrit | 00:59 |
anteaya | post the url of what you come up with | 00:59 |
sunil_ | first on the list: https://review.openstack.org/#/c/127082/ | 01:00 |
sunil_ | submitted on Oct 8 | 01:00 |
anteaya | that will do | 01:00 |
anteaya | how many patchsets does that patch have? | 01:00 |
openstackgerrit | A change was merged to openstack-infra/devstack-gate: Remove TESTR_FULL option for running tempest https://review.openstack.org/124190 | 01:01 |
sunil_ | anteaya: I need to understand where you are going with this? | 01:01 |
sunil_ | 2 patchsets | 01:01 |
anteaya | sunil_: great | 01:01 |
anteaya | I am trying to help you | 01:01 |
anteaya | you asked for help, I am helping | 01:01 |
sunil_ | ok...:) | 01:01 |
sunil_ | please keep going | 01:01 |
*** homeless has quit IRC | 01:01 | |
anteaya | I am teaching you what you need to know to be an effective third party operator | 01:01 |
sunil_ | I appreciate all the help | 01:01 |
anteaya | this is my teaching style | 01:01 |
anteaya | okay then, let's proceed | 01:02 |
anteaya | how did the contributor submit two patchset to the same patch? | 01:02 |
anteaya | rather than two different patchsets like you did in sandbox? | 01:02 |
*** stevemar has joined #openstack-infra | 01:02 | |
anteaya | or two different patches like you did in sandbox? | 01:02 |
sunil_ | ah...now that makes sense. where u were going...:) he amended the change. I just did two different things...I didn't care because it was sandbox | 01:03 |
anteaya | right | 01:03 |
anteaya | and for you to be effecting in creating something that tests our workflow | 01:04 |
anteaya | if you know what our workflow is | 01:04 |
anteaya | your chances of creating something that tests it effectively increases | 01:04 |
sunil_ | yes, I agree | 01:04 |
anteaya | great | 01:04 |
anteaya | so create a second patchset to one of your sandbox patches | 01:05 |
anteaya | I don't care what the change is | 01:05 |
*** JayJ has joined #openstack-infra | 01:05 | |
anteaya | just create a second change on the same patch | 01:05 |
*** JayJ has quit IRC | 01:06 | |
sunil_ | I will do that from home later in the evening...I need to run now. | 01:06 |
anteaya | okay | 01:06 |
anteaya | we will pick up from this point next time | 01:06 |
anteaya | adieu | 01:07 |
sunil_ | but I got the gist of what you have been saying here | 01:07 |
anteaya | good | 01:07 |
*** JayJ has joined #openstack-infra | 01:07 | |
anteaya | and me telling you wouldn't have been nearly as effective | 01:07 |
anteaya | as me asking you questions so that you look for it yourself | 01:07 |
anteaya | even if you don't know why you are looking at the moment you are looking | 01:07 |
anteaya | and I'm glad you have an understanding now | 01:08 |
anteaya | i'm offline for the night | 01:08 |
fungi | w00t! mrmartin is teh geenius. i have openstackid.org up and running now, poked http/https holes in iptables for my source address and can log in with my openstack foundation credentials and set persistent stuff on my id profile. i think this is working | 01:08 |
openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Add groups portal prod and dev servers to cacti https://review.openstack.org/127097 | 01:09 |
anteaya | fungi: well done | 01:09 |
anteaya | and yay to mrmartin | 01:09 |
clarkb | fungi nice | 01:09 |
clarkb | fungi what was wrong with it? | 01:09 |
fungi | clarkb: nothing was particularly wrong with it that i could tell | 01:10 |
fungi | clarkb: retrying the launch worked fine | 01:10 |
clarkb | huh ok | 01:10 |
fungi | clarkb: so presumably something went sideways in rackspace or hung puppet agent or who knows | 01:11 |
clarkb | ya | 01:11 |
anteaya | yay for our own openid soon | 01:11 |
anteaya | I'm out | 01:11 |
anteaya | night | 01:11 |
fungi | also, i noticed rackspace had left us nastygrams that they've been rebooting groups.o.o daily due to memory overuse. it's only a 1gb instance so probably undersized and in need of a rebuild, but since it wasn't in cacti ot | 01:12 |
fungi | er, it's hard to tell what's going on with it for sure | 01:12 |
clarkb | I am on my way home and will check centos7 images when I get there | 01:12 |
openstackgerrit | Matthew Treinish proposed a change to openstack-infra/config: Add subunit2sql gearman workers https://review.openstack.org/108003 | 01:13 |
openstackgerrit | Matthew Treinish proposed a change to openstack-infra/config: Add subunit2sql server configuraion https://review.openstack.org/127060 | 01:13 |
fungi | also lifted my -2 from 127024 so we can add openstackid.org to cacti | 01:13 |
fungi | and with that i think i'm probably going to knock off for the night and try to look like i haven't been working this whole time when my wife gets home from class | 01:14 |
clarkb | kk goodnight | 01:14 |
openstackgerrit | A change was merged to openstack-infra/config: Add centos7 to nodepool diskimage config https://review.openstack.org/127065 | 01:16 |
*** nkinder has joined #openstack-infra | 01:18 | |
*** gokrokve has quit IRC | 01:19 | |
*** todd_dsm has joined #openstack-infra | 01:27 | |
*** achanda has joined #openstack-infra | 01:29 | |
*** hdd has quit IRC | 01:30 | |
*** jerryz has joined #openstack-infra | 01:34 | |
*** otherwiseguy has joined #openstack-infra | 01:38 | |
*** terryw has quit IRC | 01:38 | |
*** otter768 has joined #openstack-infra | 01:39 | |
ianw | clarkb: ^ any sign of things building? | 01:41 |
*** sdake_ has quit IRC | 01:41 | |
openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Consolidated functional test data bootstrap https://review.openstack.org/127106 | 01:43 |
*** baoli has joined #openstack-infra | 01:43 | |
*** oomichi_ has joined #openstack-infra | 01:44 | |
openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Use correct devstack dib element with centos7 https://review.openstack.org/127107 | 01:44 |
clarkb | ianw: ^ yup and hit that | 01:45 |
clarkb | mordred: jhesketh SergeyLukjanov fungi ^ a second set of eyes would be good before I self approve | 01:45 |
ianw | clarkb: damn it, copy paste error :( | 01:47 |
fungi | approved | 01:47 |
clarkb | fungi: danke | 01:47 |
fungi | and yeah, easy to type "nodepool" in that file | 01:47 |
openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Consolidated functional test data bootstrap https://review.openstack.org/127106 | 01:47 |
*** mmedvede has quit IRC | 01:48 | |
*** otherwiseguy has quit IRC | 01:49 | |
*** achanda_ has joined #openstack-infra | 01:49 | |
*** otherwiseguy has joined #openstack-infra | 01:49 | |
*** david-lyle has joined #openstack-infra | 01:50 | |
*** achanda has quit IRC | 01:52 | |
*** hdd has joined #openstack-infra | 01:55 | |
*** Ryan_Lane has quit IRC | 01:55 | |
*** markmcclain has quit IRC | 01:55 | |
openstackgerrit | A change was merged to openstack-infra/storyboard-webclient: Subscription https://review.openstack.org/104004 | 01:55 |
SergeyLukjanov | clarkb, 127107 is lgtm as well | 01:55 |
*** todd_dsm has quit IRC | 01:56 | |
SergeyLukjanov | clarkb, and I'm not trying to race you :) I just like to open 30 reviews in tabs and review them :) | 01:56 |
clarkb | SergeyLukjanov: :) | 01:56 |
SergeyLukjanov | folks, if I'm going to make my own installation of infra, will you recommend to use puppet 3 (vs 2), ubuntu 14.04 (vs 12.04)? | 01:58 |
clarkb | SergeyLukjanov: puppet3 for sure (puppet2.7 is officially eol and we are completely moved to 3 now) | 01:58 |
SergeyLukjanov | clarkb, oh, great, will notw | 01:59 |
SergeyLukjanov | note* | 01:59 |
clarkb | SergeyLukjanov: We are still mostly precise but should move to trusty in the near future. If you want more garuntees things will work then go with precise. But if you want to get ahead of the curve go with trusty | 01:59 |
*** penguinRaider has quit IRC | 01:59 | |
fungi | SergeyLukjanov: feedback on (and patches for) what's broken in 14.04 would be awesome, but if you want something closer to what we run now then 12.04 | 01:59 |
fungi | or what clarkb said | 01:59 |
SergeyLukjanov | yeah, I see 14.04 on master and 12.04 mostly on all other stuff | 02:00 |
SergeyLukjanov | fungi, clarkb, thx | 02:00 |
*** achanda_ has quit IRC | 02:00 | |
*** achanda has joined #openstack-infra | 02:02 | |
*** gokrokve has joined #openstack-infra | 02:03 | |
ianw | 2014-10-09 01:59:28.409 | fatal: unable to connect to git.openstack.org: | 02:03 |
ianw | 2014-10-09 01:59:28.409 | git.openstack.org: Temporary failure in name resolution | 02:03 |
ianw | http://logs.openstack.org/07/127107/1/gate/gate-config-puppet-syntax/a4a8b31/ - bummer | 02:04 |
clarkb | silly dns | 02:04 |
*** dimsum_ has joined #openstack-infra | 02:06 | |
*** nosnos has joined #openstack-infra | 02:06 | |
openstackgerrit | A change was merged to openstack-infra/config: Monitor openstackid.org system stats with Cacti https://review.openstack.org/127024 | 02:06 |
*** penguinRaider has joined #openstack-infra | 02:13 | |
*** jeffrey4l_ has joined #openstack-infra | 02:19 | |
jeffrey4l_ | hey guys. I create a new project in stackforge with upstream url. But there is nothing in https://github.com/stackforge/nova-salt-formula . The https://git.openstack.org/cgit/stackforge/nova-salt-formula/ repo is right. does anyone know what's going on? | 02:22 |
*** gokrokve has quit IRC | 02:23 | |
openstackgerrit | Kei YAMAZAKI proposed a change to openstack-infra/jenkins-job-builder: Add 'only-successful' and 'fingerprint' options to archive publisher https://review.openstack.org/127113 | 02:24 |
*** weshay has quit IRC | 02:25 | |
*** Longgeek has joined #openstack-infra | 02:26 | |
*** julim has quit IRC | 02:27 | |
*** dimsum_ has quit IRC | 02:28 | |
clarkb | jeffrey4l_: ownership wasn't quite right so gerrit couldn't replicate to github, we probably hit an api request limit. I went ahead and fixed ownership so now when you push code to gerrit it should get replicated | 02:28 |
openstackgerrit | Kei YAMAZAKI proposed a change to openstack-infra/jenkins-job-builder: Add 'only-successful' and 'fingerprint' options to archive publisher https://review.openstack.org/127113 | 02:28 |
*** dimsum_ has joined #openstack-infra | 02:28 | |
clarkb | jhesketh: 126482, touch is enough to make gerrit do the right thing? | 02:29 |
clarkb | jhesketh: the commit message doesn't really indicate the method used there | 02:29 |
jeffrey4l_ | clarkb, Got. I will try that. | 02:29 |
jeffrey4l_ | thanks a lot | 02:29 |
*** zz_dimtruck is now known as dimtruck | 02:31 | |
*** mmaglana has joined #openstack-infra | 02:33 | |
*** dimsum_ has quit IRC | 02:33 | |
openstackgerrit | A change was merged to openstack-infra/config: Add groups portal prod and dev servers to cacti https://review.openstack.org/127097 | 02:35 |
jeffrey4l_ | clarkb, I push some new code to the gerrit and merged 5 minute ago ( https://git.openstack.org/cgit/stackforge/cinder-salt-formula/ ), but the stackforge is still empty ( https://github.com/stackforge/cinder-salt-formula) | 02:39 |
openstackgerrit | A change was merged to openstack-infra/config: Add syslog tag to os-collect-config logs https://review.openstack.org/122466 | 02:39 |
clarkb | that is a different repo you linked | 02:40 |
*** jerryz has quit IRC | 02:42 | |
jeffrey4l_ | clarkb, I have several repo which both have the same issue. So I tried cinder-salt-formula just now~ | 02:43 |
clarkb | ok I fixed the first one you linked | 02:44 |
clarkb | can you give me the others? | 02:44 |
jeffrey4l_ | OK. hold on. | 02:44 |
*** openstackgerrit has quit IRC | 02:45 | |
jeffrey4l_ | There are another two https://github.com/stackforge/cinder-salt-formula https://github.com/stackforge/neutron-salt-formula | 02:46 |
*** Ryan_Lane has joined #openstack-infra | 02:47 | |
clarkb | jeffrey4l_: ok should be happy now | 02:49 |
jeffrey4l_ | clarkb, kk. I just tried nova-salt-formula, it works now. Thanks a lot. ;p | 02:50 |
*** mjturek has quit IRC | 02:54 | |
*** gokrokve has joined #openstack-infra | 02:54 | |
*** rainya has joined #openstack-infra | 02:55 | |
*** coolsvap|afk is now known as coolsvap | 02:55 | |
*** pcrews has quit IRC | 03:03 | |
*** armax has quit IRC | 03:03 | |
*** spzala has joined #openstack-infra | 03:06 | |
*** armax has joined #openstack-infra | 03:07 | |
*** Ryan_Lane has quit IRC | 03:08 | |
*** fandi has joined #openstack-infra | 03:09 | |
*** rushiagr_away is now known as rushiagr | 03:12 | |
*** stevemar has quit IRC | 03:12 | |
*** stevemar has joined #openstack-infra | 03:13 | |
*** dmsimard is now known as dmsimard_away | 03:15 | |
clarkb | ianw: centos7 image build is running now | 03:15 |
ianw | clarkb: fingers crossed! | 03:16 |
*** achanda has quit IRC | 03:19 | |
*** gokrokve has quit IRC | 03:23 | |
*** achanda has joined #openstack-infra | 03:24 | |
*** gokrokve has joined #openstack-infra | 03:24 | |
*** jeffrey4l_ has quit IRC | 03:25 | |
*** chuckC_ has joined #openstack-infra | 03:27 | |
*** harlowja is now known as harlowja_away | 03:29 | |
*** harlowja_away is now known as harlowja | 03:31 | |
*** amcrn has quit IRC | 03:32 | |
*** bknudson has quit IRC | 03:33 | |
*** loki184 has joined #openstack-infra | 03:33 | |
*** nosnos has quit IRC | 03:35 | |
*** coolsvap is now known as coolsvap|afk | 03:37 | |
*** achanda_ has joined #openstack-infra | 03:39 | |
*** gokrokve_ has joined #openstack-infra | 03:40 | |
*** achanda has quit IRC | 03:42 | |
*** gokrokve has quit IRC | 03:42 | |
*** jeffrey4l_ has joined #openstack-infra | 03:42 | |
*** coolsvap|afk is now known as coolsvap | 03:45 | |
*** ryanpetrello has quit IRC | 03:50 | |
*** ryanpetrello has joined #openstack-infra | 03:50 | |
*** ramashri has quit IRC | 03:54 | |
*** gokrokve_ has quit IRC | 03:57 | |
*** armax has quit IRC | 03:59 | |
*** spzala has quit IRC | 04:00 | |
*** tsg has quit IRC | 04:00 | |
*** rushiagr is now known as rushiagr_away | 04:08 | |
*** gokrokve has joined #openstack-infra | 04:09 | |
*** shashankhegde has joined #openstack-infra | 04:09 | |
*** gokrokve has quit IRC | 04:10 | |
clarkb | ianw: there are ready images for centos7 in hpcloud now | 04:10 |
*** che-arne has quit IRC | 04:10 | |
clarkb | I don't see any ready nodes though. one is building | 04:10 |
clarkb | ianw: the previous nodes hit Exception: Timeout waiting for ssh access | 04:12 |
clarkb | not sure yet if that is just coincidence or maybe the image isn't coming out right | 04:12 |
ianw | clarkb: awesome! it's a start | 04:13 |
ianw | clarkb: know if they were ping-able? | 04:13 |
ianw | does it timeout if the key isnt' right (cloud-init failure, etc), or does that give a different error | 04:14 |
*** maxbit has joined #openstack-infra | 04:14 | |
clarkb | ianw: I think timeout is what we expect from cloud init failures | 04:15 |
clarkb | ianw: it unpings and I cannot ssh as my user | 04:15 |
ianw | clarkb: is unpings a thing, or a typo? | 04:16 |
clarkb | ianw: I mean it does not respond to pings | 04:16 |
clarkb | ya my ssh connection timed out too | 04:17 |
clarkb | I think that if there are cloud init failures we have seen all sorts of weirdness, but it should boot enough to ping | 04:17 |
ianw | clarkb: ok ... asking the obvious but is there a console log? | 04:18 |
*** todd_dsm has joined #openstack-infra | 04:18 | |
clarkb | ianw: there is some way to get it, I am not going to go digging for it tonight | 04:19 |
clarkb | I can neverremember how to get that via nova client | 04:19 |
*** tsg has joined #openstack-infra | 04:20 | |
clarkb | oh hey its nova console-log | 04:20 |
ianw | clarkb: no worries, i can try syncing with you early .au time tomorrow | 04:21 |
*** baoli has quit IRC | 04:21 | |
*** todd_dsm has quit IRC | 04:21 | |
* clarkb wais for the next one to finish building really quickly | 04:21 | |
clarkb | nova console-log returns a newline... | 04:21 |
*** Ryan_Lane has joined #openstack-infra | 04:21 | |
ianw | hmm, bootloader maybe? | 04:24 |
clarkb | ya I managed to go to the vnc console really quickly before that node died | 04:24 |
clarkb | and it is unhappy about something booting | 04:24 |
ianw | the build-image.sh qcow2 boots for me, but maybe something differs in production | 04:25 |
clarkb | A start job is running for dev-disk-by\blahblah | 04:26 |
clarkb | it looks like a bunch of "OK" up to that point | 04:26 |
clarkb | and now (1 of 2) and (2 of 2) of the above is running | 04:26 |
clarkb | it just timed out waiting | 04:26 |
clarkb | Dependency failed for /boot | 04:26 |
clarkb | and so forth and now dropped to what must be initramfs prompt? | 04:27 |
clarkb | centos calls it "Emergency Mode!" | 04:27 |
ianw | clarkb: arrgh, ok ... first thing i'll do all fresh builds here and see if i can replicate anything like that | 04:28 |
clarkb | ianw: ok. maybe try unsetting release? | 04:29 |
clarkb | ianw: also I hope to publish our dib images in the near future so that you can just grab it and poke at it too | 04:29 |
ianw | clarkb: yeah, if not, maybe next step is to save the qcow2 somewhere and start poking at it | 04:29 |
clarkb | but that requires updates to our apache server on nodepool.o.o that I haven't had time to do | 04:29 |
ianw | clarkb: ok, well maybe we can figure out a one-off if not getting progress | 04:30 |
clarkb | ya shouldn't be too hard | 04:30 |
clarkb | though it is a 2.9GB image | 04:30 |
clarkb | ok back to my regularly scheduled evening. I wish you luck on your end | 04:30 |
ianw | clarkb: thanks for all your help getting it this far! | 04:31 |
*** Ryan_Lane has quit IRC | 04:32 | |
*** hdd has quit IRC | 04:33 | |
*** e0ne has joined #openstack-infra | 04:34 | |
*** amotoki has joined #openstack-infra | 04:34 | |
*** nosnos has joined #openstack-infra | 04:35 | |
*** tsg has quit IRC | 04:37 | |
*** rushiagr_away is now known as rushiagr | 04:37 | |
*** e0ne has quit IRC | 04:39 | |
*** rainya has quit IRC | 04:40 | |
*** gokrokve has joined #openstack-infra | 04:41 | |
*** gokrokve has quit IRC | 04:42 | |
*** loki184 has quit IRC | 04:42 | |
*** gokrokve has joined #openstack-infra | 04:42 | |
*** mmaglana has quit IRC | 04:43 | |
*** mmaglana has joined #openstack-infra | 04:43 | |
*** loki184 has joined #openstack-infra | 04:47 | |
*** mmaglana has quit IRC | 04:48 | |
*** gokrokve has quit IRC | 04:48 | |
*** otter768 has quit IRC | 04:48 | |
*** e0ne has joined #openstack-infra | 04:52 | |
*** loki184 has quit IRC | 04:53 | |
*** e0ne has quit IRC | 04:56 | |
*** hdd has joined #openstack-infra | 05:01 | |
*** HeOS has quit IRC | 05:02 | |
*** HeOS has joined #openstack-infra | 05:02 | |
*** crinkle has quit IRC | 05:03 | |
*** pabelanger has quit IRC | 05:03 | |
*** crinkle has joined #openstack-infra | 05:03 | |
*** sunil_ has quit IRC | 05:04 | |
*** sunil__ has joined #openstack-infra | 05:04 | |
*** jamielennox has quit IRC | 05:04 | |
*** pabelanger has joined #openstack-infra | 05:05 | |
*** wenlock has joined #openstack-infra | 05:05 | |
*** hdd has quit IRC | 05:06 | |
*** Ryan_Lane has joined #openstack-infra | 05:08 | |
*** jamielennox has joined #openstack-infra | 05:09 | |
*** achanda has joined #openstack-infra | 05:09 | |
*** david-lyle has quit IRC | 05:10 | |
*** achanda_ has quit IRC | 05:12 | |
*** sdake has quit IRC | 05:12 | |
*** Ryan_Lane has quit IRC | 05:14 | |
*** rainya has joined #openstack-infra | 05:16 | |
*** achanda_ has joined #openstack-infra | 05:16 | |
*** rainya has quit IRC | 05:18 | |
*** wenlock has quit IRC | 05:19 | |
*** achanda has quit IRC | 05:20 | |
*** wenlock has joined #openstack-infra | 05:21 | |
*** jcoufal has joined #openstack-infra | 05:22 | |
*** achanda has joined #openstack-infra | 05:24 | |
*** tsg has joined #openstack-infra | 05:24 | |
*** david-lyle has joined #openstack-infra | 05:27 | |
*** achanda_ has quit IRC | 05:27 | |
*** achanda_ has joined #openstack-infra | 05:29 | |
*** harlowja_at_home has joined #openstack-infra | 05:32 | |
*** achanda has quit IRC | 05:32 | |
*** harlowja is now known as harlowja_away | 05:35 | |
*** harlowja_at_home has quit IRC | 05:42 | |
*** dimtruck is now known as zz_dimtruck | 05:42 | |
*** gokrokve has joined #openstack-infra | 05:43 | |
*** gokrokve has quit IRC | 05:48 | |
*** yolanda has joined #openstack-infra | 05:49 | |
*** afazekas has joined #openstack-infra | 05:51 | |
*** yamahata has quit IRC | 05:51 | |
*** yamahata has joined #openstack-infra | 05:52 | |
*** achanda_ has quit IRC | 05:53 | |
*** dkehnm has quit IRC | 05:55 | |
*** jeffrey4l_ has left #openstack-infra | 05:55 | |
*** dkehnm has joined #openstack-infra | 05:57 | |
*** loki184 has joined #openstack-infra | 05:59 | |
*** coolsvap is now known as coolsvap|afk | 06:00 | |
*** shashankhegde has quit IRC | 06:02 | |
*** loki184 has quit IRC | 06:09 | |
*** loki184 has joined #openstack-infra | 06:09 | |
*** coolsvap|afk is now known as coolsvap | 06:12 | |
*** pkoniszewski has joined #openstack-infra | 06:13 | |
*** timrc is now known as timrc-afk | 06:14 | |
*** achanda has joined #openstack-infra | 06:16 | |
*** tsg has quit IRC | 06:17 | |
*** HeOS has quit IRC | 06:17 | |
*** achanda has quit IRC | 06:20 | |
*** ashaeron has joined #openstack-infra | 06:21 | |
*** jlibosva has joined #openstack-infra | 06:22 | |
*** wenlock has quit IRC | 06:26 | |
*** achanda has joined #openstack-infra | 06:29 | |
*** achanda has quit IRC | 06:34 | |
*** pcrews has joined #openstack-infra | 06:39 | |
*** ashaeron has quit IRC | 06:41 | |
*** vigneshvar has joined #openstack-infra | 06:42 | |
*** ashaeron has joined #openstack-infra | 06:43 | |
*** gokrokve has joined #openstack-infra | 06:43 | |
*** mrmartin has joined #openstack-infra | 06:46 | |
*** pcrews has quit IRC | 06:47 | |
*** gokrokve has quit IRC | 06:48 | |
*** MaxV has joined #openstack-infra | 06:49 | |
*** MaxV has quit IRC | 06:55 | |
*** camunoz has quit IRC | 06:55 | |
*** k4n0 has joined #openstack-infra | 06:56 | |
*** flaper87|afk is now known as flaper87 | 06:58 | |
*** r1chardj0n3s is now known as r1chardj0n3s_afk | 06:59 | |
AJaeger | transifex has a partial outage - in case you wonder about failing translation jobs ;( | 06:59 |
*** achanda has joined #openstack-infra | 06:59 | |
*** penguinRaider has quit IRC | 07:02 | |
*** k4n0 has quit IRC | 07:02 | |
*** penguinRaider has joined #openstack-infra | 07:03 | |
*** andreykurilin_ has joined #openstack-infra | 07:06 | |
*** arxcruz has joined #openstack-infra | 07:12 | |
*** andreykurilin_ has quit IRC | 07:13 | |
*** k4n0 has joined #openstack-infra | 07:15 | |
*** jerryz has joined #openstack-infra | 07:16 | |
*** doude has joined #openstack-infra | 07:18 | |
*** yaguang has quit IRC | 07:21 | |
*** yaguang has joined #openstack-infra | 07:22 | |
*** denis_makogon has joined #openstack-infra | 07:22 | |
*** jistr has joined #openstack-infra | 07:23 | |
*** achanda has quit IRC | 07:25 | |
*** andreaf has quit IRC | 07:26 | |
stevemar | AJaeger, we commented at the same time :\ | 07:31 |
AJaeger | ;) | 07:31 |
AJaeger | strange - let me check it out... | 07:32 |
stevemar | AJaeger, i'm still stuck, but i'll pick this up tomorrow, it's getting late on this side of the planet | 07:32 |
AJaeger | early here ;) | 07:32 |
stevemar | it's well past late, but ya know | 07:32 |
*** dizquierdo has joined #openstack-infra | 07:32 | |
AJaeger | stevemar, good night! | 07:33 |
stevemar | AJaeger, good morning :P | 07:33 |
* AJaeger was already wondering whether you moved ;) | 07:33 | |
stevemar | AJaeger, i owe you like 6 beers in paris | 07:33 |
AJaeger | Let's drink them together ;) | 07:33 |
stevemar | or wine, it being france and all | 07:33 |
stevemar | done | 07:34 |
AJaeger | sure! | 07:34 |
stevemar | i'm out for now, see ya ! | 07:34 |
AJaeger | stevemar, see you! | 07:34 |
*** andreykurilin_ has joined #openstack-infra | 07:35 | |
*** skolekonov has joined #openstack-infra | 07:35 | |
*** luqas has joined #openstack-infra | 07:35 | |
*** stevemar has quit IRC | 07:41 | |
*** mrmartin has quit IRC | 07:42 | |
*** k4n0 has quit IRC | 07:42 | |
*** gokrokve has joined #openstack-infra | 07:43 | |
*** jgallard has joined #openstack-infra | 07:44 | |
*** andreykurilin_ has quit IRC | 07:44 | |
*** Guest51022 has joined #openstack-infra | 07:44 | |
*** MaxV has joined #openstack-infra | 07:44 | |
*** HeOS has joined #openstack-infra | 07:45 | |
*** gokrokve has quit IRC | 07:48 | |
*** MaxV has quit IRC | 07:49 | |
*** achanda has joined #openstack-infra | 07:50 | |
*** SumitNaiksatam has quit IRC | 07:50 | |
*** SumitNaiksatam has joined #openstack-infra | 07:50 | |
*** kashyap has joined #openstack-infra | 07:51 | |
zaro | has | 07:52 |
*** Ryan_Lane has joined #openstack-infra | 07:54 | |
*** k4n0 has joined #openstack-infra | 07:55 | |
*** dmellado_ has joined #openstack-infra | 07:56 | |
*** dmellado_ has quit IRC | 07:57 | |
*** mpaolino has joined #openstack-infra | 08:00 | |
*** achanda has quit IRC | 08:01 | |
*** sunrenjie6 has quit IRC | 08:04 | |
*** jpich has joined #openstack-infra | 08:05 | |
*** yamamoto has quit IRC | 08:08 | |
*** shardy_z is now known as shardy | 08:09 | |
*** hashar has joined #openstack-infra | 08:10 | |
*** salv-orlando has joined #openstack-infra | 08:11 | |
*** jistr has quit IRC | 08:12 | |
*** BobBallAway is now known as BobBall | 08:15 | |
*** sunrenjie has joined #openstack-infra | 08:16 | |
*** MaxV has joined #openstack-infra | 08:20 | |
*** oomichi_ has quit IRC | 08:24 | |
*** katyafervent_awa is now known as katyafervent | 08:28 | |
*** derekh has joined #openstack-infra | 08:30 | |
*** ihrachyshka has joined #openstack-infra | 08:30 | |
*** jedimike has joined #openstack-infra | 08:31 | |
*** jistr has joined #openstack-infra | 08:31 | |
*** jgallard has quit IRC | 08:35 | |
*** david-lyle has quit IRC | 08:35 | |
*** loki184 has quit IRC | 08:37 | |
*** jp_at_hp has joined #openstack-infra | 08:40 | |
ashaeron | Anyone know if it is possible to generate a pydoc for a function by "inheriting" the pydoc from another similar function? | 08:43 |
*** gokrokve has joined #openstack-infra | 08:43 | |
*** vigneshvar has quit IRC | 08:45 | |
AJaeger | ashaeron, I suggest to ask on #openstack-dev | 08:45 |
ashaeron | AJaeger: alright, thanks | 08:45 |
*** jgallard has joined #openstack-infra | 08:46 | |
*** tty57 has joined #openstack-infra | 08:47 | |
*** dizquierdo has quit IRC | 08:48 | |
*** gokrokve has quit IRC | 08:48 | |
*** tty57 has quit IRC | 08:52 | |
*** loki184 has joined #openstack-infra | 09:01 | |
*** tty57 has joined #openstack-infra | 09:01 | |
*** Ryan_Lane has quit IRC | 09:02 | |
*** penguinRaider has quit IRC | 09:03 | |
*** dizquierdo has joined #openstack-infra | 09:06 | |
AJaeger | fungi, we've lost again the gerrit IRC bot ;( | 09:06 |
*** IvanBerezovskiy has joined #openstack-infra | 09:09 | |
*** dizquierdo has quit IRC | 09:15 | |
*** jgallard has quit IRC | 09:16 | |
*** jgallard has joined #openstack-infra | 09:16 | |
*** penguinRaider has joined #openstack-infra | 09:17 | |
*** zz_johnthetubagu is now known as johnthetubaguy | 09:17 | |
*** ociuhandu has joined #openstack-infra | 09:23 | |
*** katyafervent is now known as katyafervent_awa | 09:25 | |
*** sunrenjie has quit IRC | 09:29 | |
*** denis_makogon has quit IRC | 09:36 | |
*** Guest51022 has quit IRC | 09:38 | |
*** gokrokve has joined #openstack-infra | 09:43 | |
*** pelix has joined #openstack-infra | 09:44 | |
*** gokrokve has quit IRC | 09:48 | |
*** yolanda has quit IRC | 09:48 | |
*** coolsvap is now known as coolsvap|afk | 09:56 | |
*** lttrl has quit IRC | 09:57 | |
*** otherwiseguy has quit IRC | 09:59 | |
*** jgallard has quit IRC | 10:02 | |
*** lttrl has joined #openstack-infra | 10:02 | |
*** cdent has joined #openstack-infra | 10:08 | |
ttx | AJaeger: would you mind proposing translations updates for proposed/juno branches for cinder and horizon ? Today is the day :) | 10:09 |
ttx | AJaeger: johnthetubaguy was trying to generate them for nova, so you can also lend him a hand | 10:09 |
*** jerryz has quit IRC | 10:10 | |
johnthetubaguy | AJaeger: happy to help, but the script isn't working for me, -bash: declare: -g: invalid option | 10:10 |
jpich | ttx, AJaeger: FWIW amotoki told the translators team he would do it at 13:00 UTC today, for Horizon | 10:10 |
ttx | jpich: oh, great | 10:11 |
jpich | In case there are people scrambling to meet the deadline in the next couple of hours :-) | 10:11 |
*** hashar has quit IRC | 10:11 | |
ttx | I knew it was "today", not sure when toiday though :) | 10:11 |
jpich | That's fair enough :) | 10:11 |
AJaeger | ttx, for horizon Akihiro will do it - see http://lists.openstack.org/pipermail/openstack-i18n/2014-October/000806.html | 10:12 |
ttx | AJaeger: ok, so help only needed for cinder and nova | 10:12 |
AJaeger | ttx, I can do cinder and nova... | 10:12 |
ttx | AJaeger: awesome, thx! | 10:12 |
AJaeger | ttx, what'S my deadline? ;) | 10:12 |
ttx | AJaeger: asap | 10:12 |
ttx | can wait a couple hours | 10:13 |
AJaeger | ttx, anything I have to care about for proposed/juno? Handle it the same as a stable branch? | 10:13 |
johnthetubaguy | AJaeger: I have got halfway through nova, just hitting an issue | 10:13 |
johnthetubaguy | AJaeger: although it might be easier if you just run it on your box, which is fine too | 10:13 |
ttx | AJaeger: my understanding is that running the comands at https://review.openstack.org/#/c/126922/ on proposed/juno will do it | 10:13 |
AJaeger | ttx, yep | 10:14 |
AJaeger | johnthetubaguy, let me do it - I have everything set up ;) | 10:14 |
*** tnurlygayanov has joined #openstack-infra | 10:14 | |
johnthetubaguy | OK, cool, setup_loglevel_vars is failing with declare: -g: invalid option | 10:14 |
johnthetubaguy | duno what that is, so happy for you to do it :) | 10:15 |
AJaeger | seems to be a bash problem - works fine in the gate adn on my system | 10:15 |
*** _nadya_ has joined #openstack-infra | 10:18 | |
*** yamahata has quit IRC | 10:19 | |
amotoki | jpich: ttx: I will propose horizon translations 13UTC today as we planned. | 10:20 |
ttx | amotoki: thx! | 10:21 |
jpich | amotoki: Thank you! | 10:21 |
AJaeger | ttx, johnthetubaguy any specific commands to give to git review? IT tries rebasing on master and that fails ;( | 10:23 |
johnthetubaguy | oh yeah, you need to specifiy the branch | 10:24 |
johnthetubaguy | just like stable, but the proposed branch | 10:24 |
AJaeger | ttx, johnthetubaguy please check https://review.openstack.org/127189 | 10:24 |
AJaeger | johnthetubaguy, thanks | 10:24 |
*** psedlak_ has joined #openstack-infra | 10:25 | |
*** psedlak_ has quit IRC | 10:25 | |
johnthetubaguy | AJaeger: it seems to have deleted lots of things, is that what we would expect? | 10:25 |
*** unicell has quit IRC | 10:25 | |
AJaeger | johnthetubaguy, it should delete files that have less than 20 % translations | 10:26 |
AJaeger | just check msgid/msgstr ratio | 10:26 |
johnthetubaguy | AJaeger: ah, OK, its a kind of trim translations on release | 10:26 |
AJaeger | johnthetubaguy, a very recent change to the translation scripts that came to late for Juno - but ttx suggested to apply it for Juno as well... | 10:27 |
johnthetubaguy | cool | 10:27 |
AJaeger | johnthetubaguy, already imported in master | 10:28 |
johnthetubaguy | I saw that in the git commits when looking at why the script failed | 10:28 |
AJaeger | ttx, cinder patch is here https://review.openstack.org/127191 | 10:28 |
AJaeger | I'm out for lunch now ;) If anything is wrong, I'll fix afterwards... | 10:28 |
*** unicell has joined #openstack-infra | 10:29 | |
*** mkerrin has quit IRC | 10:29 | |
AJaeger | ttx, visually inspected the deleted files - looks fine to me... | 10:30 |
AJaeger | johnthetubaguy, which shell are you using to run the commands? | 10:30 |
*** pcm_ has joined #openstack-infra | 10:31 | |
johnthetubaguy | bash, but on mac | 10:31 |
johnthetubaguy | version 3.2.53(1)-release | 10:31 |
johnthetubaguy | its 10.8.5 I am running | 10:32 |
*** pcm__ has joined #openstack-infra | 10:32 | |
*** pcm_ has quit IRC | 10:35 | |
*** mkerrin has joined #openstack-infra | 10:37 | |
*** gokrokve has joined #openstack-infra | 10:43 | |
*** gokrokve has quit IRC | 10:48 | |
*** dimsum_ has joined #openstack-infra | 10:51 | |
*** lttrl has quit IRC | 10:53 | |
*** vigneshvar has joined #openstack-infra | 10:59 | |
*** doug-fish has joined #openstack-infra | 11:02 | |
*** dmsimard_away is now known as dmsimard | 11:07 | |
*** ZZelle has quit IRC | 11:11 | |
*** denis_makogon has joined #openstack-infra | 11:11 | |
*** ZZelle has joined #openstack-infra | 11:11 | |
*** MaxV has quit IRC | 11:12 | |
*** MaxV has joined #openstack-infra | 11:12 | |
*** dimsum_ has quit IRC | 11:13 | |
*** dimsum_ has joined #openstack-infra | 11:13 | |
*** dims_ has joined #openstack-infra | 11:14 | |
*** loki184 has quit IRC | 11:14 | |
*** MaxV has quit IRC | 11:17 | |
*** dimsum_ has quit IRC | 11:17 | |
*** dmellado_ has joined #openstack-infra | 11:17 | |
*** dmellado_ has quit IRC | 11:18 | |
*** fandi has quit IRC | 11:19 | |
*** trinaths has joined #openstack-infra | 11:23 | |
*** katyafervent_awa is now known as katyafervent | 11:24 | |
trinaths | Hi, How to know a Specific CI activity ? | 11:24 |
trinaths | I mean, How many patches it tested both voting and Non-voting | 11:24 |
trinaths | any clue ?? | 11:24 |
*** dmellado_ has joined #openstack-infra | 11:25 | |
*** dmellado_ has quit IRC | 11:25 | |
*** lttrl has joined #openstack-infra | 11:25 | |
ZZelle | trinaths, stackalytics perhaps ? | 11:26 |
*** MaxV has joined #openstack-infra | 11:27 | |
trinaths | ZZelle: True, but It doesn't help me for CI activity. It gives the latest commented CHANGE ID for CI. Not the count of changes it tested .. | 11:28 |
trinaths | ZZelle: Yes I got it, its with the changes to search criteria. Thanks :) | 11:29 |
*** amotoki_ has joined #openstack-infra | 11:34 | |
*** amotoki_ has quit IRC | 11:34 | |
*** trinaths has left #openstack-infra | 11:37 | |
*** bcrochet has left #openstack-infra | 11:38 | |
*** otherwiseguy has joined #openstack-infra | 11:38 | |
*** kashyap has quit IRC | 11:40 | |
*** otherwiseguy has quit IRC | 11:43 | |
*** gokrokve has joined #openstack-infra | 11:43 | |
*** julim has joined #openstack-infra | 11:45 | |
*** amotoki has quit IRC | 11:45 | |
*** coolsvap|afk is now known as coolsvap | 11:46 | |
*** sarob has quit IRC | 11:46 | |
*** gokrokve has quit IRC | 11:48 | |
*** mgagne has quit IRC | 11:48 | |
*** zz_gondoi has quit IRC | 11:49 | |
*** flaviof_zzz has quit IRC | 11:50 | |
*** StevenK has quit IRC | 11:50 | |
*** mgagne has joined #openstack-infra | 11:51 | |
*** mgagne is now known as Guest92054 | 11:51 | |
*** StevenK has joined #openstack-infra | 11:51 | |
*** gondoi has joined #openstack-infra | 11:52 | |
*** Guest51022 has joined #openstack-infra | 11:53 | |
*** tty57 has quit IRC | 11:58 | |
*** coolsvap is now known as coolsvap|afk | 12:01 | |
*** che-arne has joined #openstack-infra | 12:04 | |
*** mmedvede has joined #openstack-infra | 12:04 | |
*** afazekas has quit IRC | 12:04 | |
*** weshay has joined #openstack-infra | 12:10 | |
*** mpaolino has quit IRC | 12:11 | |
AJaeger | johnthetubaguy, I'm using bash 4 on Linux. Might be that arrays are not part of bash 3. | 12:13 |
AJaeger | ttx, is everything ok with the translation patches? | 12:13 |
*** cnesa16 has joined #openstack-infra | 12:13 | |
johnthetubaguy | AJaeger: gotcha, I guess I should/could brew in something newer, no worries | 12:13 |
ttx | AJaeger: looks good, reviewing now | 12:14 |
*** ctlaugh has quit IRC | 12:14 | |
*** markmcclain has joined #openstack-infra | 12:15 | |
*** baoli has joined #openstack-infra | 12:17 | |
*** dkliban_afk is now known as dkliban | 12:17 | |
*** rushiagr is now known as rushiagr_away | 12:20 | |
*** sarob has joined #openstack-infra | 12:20 | |
*** flaviof_zzz has joined #openstack-infra | 12:22 | |
*** lttrl has quit IRC | 12:22 | |
*** kgiusti has joined #openstack-infra | 12:22 | |
*** ctlaugh has joined #openstack-infra | 12:22 | |
*** openstackgerrit has joined #openstack-infra | 12:23 | |
*** dims_ has quit IRC | 12:23 | |
*** mpaolino has joined #openstack-infra | 12:24 | |
*** mbacchi has joined #openstack-infra | 12:24 | |
*** dimsum_ has joined #openstack-infra | 12:24 | |
*** spzala has joined #openstack-infra | 12:24 | |
fungi | AJaeger: thanks, openstackgerrit should be back now | 12:26 |
AJaeger | good morning, fungi - and thanks! | 12:26 |
*** salv-orlando has quit IRC | 12:27 | |
*** prad has quit IRC | 12:28 | |
*** otherwiseguy has joined #openstack-infra | 12:32 | |
*** marcusvrn_ has joined #openstack-infra | 12:32 | |
*** nosnos has quit IRC | 12:35 | |
*** nosnos has joined #openstack-infra | 12:36 | |
*** otherwiseguy has quit IRC | 12:37 | |
*** gokrokve has joined #openstack-infra | 12:38 | |
*** erlon_ has joined #openstack-infra | 12:38 | |
*** nosnos has quit IRC | 12:40 | |
*** mpaolino has quit IRC | 12:42 | |
*** packet has joined #openstack-infra | 12:43 | |
rfolco | fungi, morning. openstackgerrit was down? our zuul reported back without running anything... | 12:45 |
fungi | rfolco: when? uptime seems to be 10 days | 12:47 |
krtaylor | the scrollback says "openstackgerrit should be back now", or is that just the irc bot? | 12:47 |
fungi | openstackgerrit is nick of our irc bot | 12:48 |
rfolco | lol | 12:48 |
krtaylor | ok, nothing else then | 12:48 |
*** adalbas has joined #openstack-infra | 12:48 | |
*** wenlock has joined #openstack-infra | 12:48 | |
fungi | so i meant it should be back in the configured irc channels on freenode now | 12:48 |
*** JayJ has joined #openstack-infra | 12:49 | |
fungi | AJaeger had reported it as missing in action earlier | 12:49 |
rfolco | fungi, any pointers on how to debug/fix our zuul to not report back without running any test? | 12:49 |
krtaylor | rfolco, I guess we have to look elsewhere then | 12:49 |
*** rushiagr_away is now known as rushiagr | 12:49 | |
fungi | rfolco: you'd need to show me an example of a review on which it reported and an example layout.yaml | 12:50 |
rfolco | fungi, zuul log says the patch comes in, it adds to pipeline, and it reports back to gerrit | 12:50 |
*** miqui has joined #openstack-infra | 12:50 | |
rfolco | fungi, https://review.openstack.org/#/c/125492/ | 12:50 |
rfolco | fungi, http://paste.openstack.org/show/119888/ | 12:50 |
fungi | rfolco: i suspect i know what the misconfiguration is, but would need to see the pipeline configuration for your layout.yaml | 12:51 |
fungi | there's been a misunderstanding around how files filtering on jobs works | 12:52 |
*** radez_g0n3 is now known as radez | 12:52 | |
*** sgordon_ has joined #openstack-infra | 12:53 | |
fungi | probably worth an faq | 12:53 |
rfolco | fungi, it has been working fine for hours... the problem started more or less 3 hours ago. | 12:53 |
rfolco | fungi, http://paste.openstack.org/show/119889/ | 12:53 |
*** dkranz has quit IRC | 12:54 | |
fungi | okay, it's definitely not what i was thinking, since you're not restricting jobs by file patterns | 12:55 |
*** aysyd has joined #openstack-infra | 12:55 | |
*** zz_dimtruck is now known as dimtruck | 12:55 | |
fungi | rfolco: did you restart zuul around the time the misbehavior started? | 12:56 |
rfolco | fungi, no | 12:56 |
fungi | okay, so probably not a new change to the zuul project at fault, since you'd have to restart to pick it up | 12:56 |
rfolco | 126061,11 was good, 127203,1 is the first bad | 12:57 |
rfolco | fungi, and we locked down (pinned) project-config repo to not update it anymore and break us | 12:57 |
*** achuprin_ has joined #openstack-infra | 12:58 | |
*** hdd has joined #openstack-infra | 12:59 | |
fungi | rfolco: oh... the one with the empty comment was for a stable/icehouse change | 12:59 |
*** yaguang has quit IRC | 13:00 | |
*** hashar has joined #openstack-infra | 13:00 | |
*** yaguang has joined #openstack-infra | 13:00 | |
fungi | rfolco: on line 29 of your layout.yaml paste, you're configured all jobs to get skipped on stable/havana and stable/icehouse changes | 13:01 |
fungi | rfolco: so zuul literally runs no jobs at all on those changes, and reports back that it successfully did so | 13:01 |
*** amotoki has joined #openstack-infra | 13:01 | |
rfolco | fungi, that explains.. correct! | 13:02 |
rfolco | fungi, will change that thanks a lot for your patience!!! | 13:02 |
krtaylor | thanks fungi | 13:02 |
fungi | i'm looking back through the pipeline options in our ducumentation for a good recommendation | 13:02 |
*** penguinRaider has quit IRC | 13:02 | |
*** flaviof_zzz is now known as flaviof | 13:03 | |
fungi | aha, the "branch" option on the gerrit trigger for your pipeline | 13:03 |
fungi | rfolco: krtaylor: http://ci.openstack.org/zuul/zuul.html#pipelines | 13:03 |
*** hashar_ has joined #openstack-infra | 13:04 | |
fungi | rfolco: if you restrict branches on the trigger rather than on the jobs, you will only enqueue changes into that pipeline for the branches you want, rather than enqueue all changes and then limit the jobs to run by branch pattern | 13:04 |
*** hashar_ has quit IRC | 13:05 | |
fungi | the latter is what's causing you to report a successful run of no jobs on stable branch changes | 13:05 |
*** dimtruck is now known as zz_dimtruck | 13:05 | |
*** hashar_ has joined #openstack-infra | 13:06 | |
*** mjturek has joined #openstack-infra | 13:06 | |
rfolco | fungi, nice catch | 13:06 |
rfolco | saved us some debug time, owe_beer++ fungi | 13:06 |
fungi | best of luck with your systems! | 13:07 |
*** hashar has quit IRC | 13:07 | |
rfolco | thx again | 13:08 |
fungi | yw | 13:08 |
*** tty57 has joined #openstack-infra | 13:09 | |
*** dprince has joined #openstack-infra | 13:09 | |
*** zz_dimtruck is now known as dimtruck | 13:10 | |
*** sdake has joined #openstack-infra | 13:12 | |
*** sdake has quit IRC | 13:12 | |
*** sdake has joined #openstack-infra | 13:12 | |
*** jaypipes has joined #openstack-infra | 13:12 | |
*** nkinder has quit IRC | 13:13 | |
*** hashar_ has quit IRC | 13:13 | |
*** zz_jgrimm is now known as jgrimm | 13:13 | |
*** hashar has joined #openstack-infra | 13:14 | |
*** AJaeger has quit IRC | 13:17 | |
*** mriedem has joined #openstack-infra | 13:18 | |
*** xyang0 has joined #openstack-infra | 13:18 | |
*** vigneshvar has quit IRC | 13:19 | |
*** spzala has quit IRC | 13:21 | |
*** jgallard has joined #openstack-infra | 13:21 | |
*** AJaeger has joined #openstack-infra | 13:22 | |
*** che-arne has quit IRC | 13:23 | |
*** dimtruck is now known as zz_dimtruck | 13:24 | |
*** dustins has joined #openstack-infra | 13:26 | |
*** otherwiseguy has joined #openstack-infra | 13:26 | |
*** kgiusti has quit IRC | 13:28 | |
*** kgiusti has joined #openstack-infra | 13:29 | |
*** otherwiseguy has quit IRC | 13:31 | |
*** dangers_away is now known as dangers | 13:32 | |
*** markmcclain has quit IRC | 13:33 | |
*** portante has left #openstack-infra | 13:33 | |
*** eharney has joined #openstack-infra | 13:39 | |
*** bradjones has joined #openstack-infra | 13:39 | |
*** zns has joined #openstack-infra | 13:39 | |
*** aysyd has quit IRC | 13:40 | |
*** kgiusti has quit IRC | 13:40 | |
bradjones | hello infra! Was wondering if anyone can help point me in the direction of getting the openstackgerrit bot reporting in the horizon channel | 13:41 |
*** imcsk8 has quit IRC | 13:42 | |
*** imcsk8 has joined #openstack-infra | 13:42 | |
*** penguinRaider has joined #openstack-infra | 13:43 | |
*** tsg has joined #openstack-infra | 13:43 | |
fungi | bradjones: http://git.openstack.org/cgit/openstack-infra/project-config/tree/gerritbot/channels.yaml | 13:43 |
fungi | bradjones: it's just a code review away ;) | 13:43 |
bradjones | fungi: thanks, will update now | 13:44 |
*** afazekas has joined #openstack-infra | 13:45 | |
fungi | bradjones: also, gratuitous infra documentation link... http://ci.openstack.org/irc.html | 13:46 |
* fungi doesn't want to give the impression that asking in #openstack-infra is the only way to discover this information ;) | 13:47 | |
*** julim has quit IRC | 13:47 | |
openstackgerrit | Julie Pichon proposed a change to openstack-infra/project-config: Fix Horizon integration job definition https://review.openstack.org/127187 | 13:47 |
*** spzala has joined #openstack-infra | 13:49 | |
openstackgerrit | Bradley Jones proposed a change to openstack-infra/project-config: Added horizon channel https://review.openstack.org/127249 | 13:49 |
bradjones | fungi: sure is the quickest ;) | 13:49 |
*** che-arne has joined #openstack-infra | 13:49 | |
bradjones | fungi: thanks for the help | 13:50 |
openstackgerrit | Julie Pichon proposed a change to openstack-infra/project-config: Fix Horizon integration job definition https://review.openstack.org/127187 | 13:51 |
*** otherwiseguy has joined #openstack-infra | 13:52 | |
AJaeger | bradjones, fungi : Do we need to add the havana channel to accessbot/channels.yaml as well? | 13:54 |
*** Sincler has joined #openstack-infra | 13:55 | |
AJaeger | s/havana/openstack-horizon/ | 13:55 |
fungi | AJaeger: it's not already in there? that surprises me | 13:55 |
* AJaeger was wired wrongly ;( | 13:56 | |
AJaeger | I looked for havana, don't know what I smoked ;(((( | 13:56 |
AJaeger | false alarm, bradjones and fungi | 13:56 |
*** gokrokve has quit IRC | 13:56 | |
fungi | you were just trying to remind me to delete all those stable/havana branches | 13:56 |
fungi | i'll do that now before i forget again. it's been 9 days since i tagged them all and sent the announcement | 13:57 |
AJaeger | Thanks for always finding something good in my mistakes, fungi! | 13:57 |
*** penguinRaider has quit IRC | 13:59 | |
*** jgrimm is now known as zz_jgrimm | 13:59 | |
fungi | that's why i'm here! | 13:59 |
AJaeger | And that's why I'm glad to have you here ;) | 14:00 |
*** esker has joined #openstack-infra | 14:00 | |
*** nkinder has joined #openstack-infra | 14:03 | |
*** kashyap has joined #openstack-infra | 14:04 | |
*** dmellado has quit IRC | 14:07 | |
*** homeless has joined #openstack-infra | 14:08 | |
openstackgerrit | A change was merged to openstack-infra/project-config: Fix Horizon integration job definition https://review.openstack.org/127187 | 14:08 |
*** gokrokve has joined #openstack-infra | 14:09 | |
*** hdd has quit IRC | 14:09 | |
*** zz_dimtruck is now known as dimtruck | 14:09 | |
*** dmellado has joined #openstack-infra | 14:10 | |
*** salv-orlando has joined #openstack-infra | 14:10 | |
*** pkoniszewski has quit IRC | 14:11 | |
jpich | How long till I can make use of a "new" job definition, after the infra patch merges? | 14:12 |
*** dkranz has joined #openstack-infra | 14:13 | |
fungi | jpich: that merge will get picked up in the 14:15 utc puppet apply pulse in a minute, and then it takes around 15 minutes for the job updates to get established on all the jenkins masters | 14:14 |
fungi | jpich: so you could try rechecking an affected change around 14:30 utc | 14:14 |
jpich | fungi: Super, thank you :) | 14:14 |
fungi | you're welcome! | 14:14 |
ttx | fungi: weird set of 00000 jobs in post pipeline | 14:15 |
ttx | triggered roughly 13 min ago | 14:15 |
ttx | any idea what that is for ? | 14:16 |
*** otherwiseguy has quit IRC | 14:16 | |
AJaeger | anybody tagged some branches or releases? | 14:16 |
fungi | ttx: i think that's zuul reacting to my stable/havana branch deletions | 14:16 |
ttx | ah, yes that would do that | 14:16 |
fungi | those should all fail miserably | 14:16 |
fungi | but i'll keep an eye on one or two and make sure they aren't wreaking some sort of unanticipated havoc | 14:17 |
*** mwagner_lap has joined #openstack-infra | 14:19 | |
*** zns has quit IRC | 14:22 | |
*** ryanpetrello has quit IRC | 14:23 | |
AJaeger | fungi, once you have some idle time, I would appreciate a review of https://review.openstack.org/#/c/126499/ - this might need more rebases otherwise. This is creating and using two new templates in layout.yaml | 14:23 |
openstackgerrit | Eric Harney proposed a change to openstack-infra/git-review: Fix ---list and "departement" typos in man page https://review.openstack.org/127256 | 14:24 |
*** dizquierdo has joined #openstack-infra | 14:26 | |
fungi | AJaeger: i'll have a look once i'm done getting stuff prepped for the tc election tomorrow | 14:26 |
*** bnemec has joined #openstack-infra | 14:26 | |
*** bknudson has joined #openstack-infra | 14:26 | |
*** ihrachyshka has quit IRC | 14:26 | |
AJaeger | fungi, nothing critical - just me avoiding rebases ;) Take your time, TC elections are far more important | 14:27 |
*** zns has joined #openstack-infra | 14:28 | |
*** dimtruck is now known as zz_dimtruck | 14:29 | |
*** annegent_ has joined #openstack-infra | 14:31 | |
openstackgerrit | Bradley Jones proposed a change to stackforge/gertty: Use local timezone for the updated column https://review.openstack.org/127260 | 14:31 |
*** tonytan4ever has joined #openstack-infra | 14:32 | |
*** stevemar has joined #openstack-infra | 14:32 | |
*** habib has joined #openstack-infra | 14:36 | |
*** charz has quit IRC | 14:37 | |
*** zaphod42 has quit IRC | 14:37 | |
*** dustins has quit IRC | 14:37 | |
*** zz_dimtruck is now known as dimtruck | 14:37 | |
*** zaphod42 has joined #openstack-infra | 14:37 | |
*** dizquierdo has quit IRC | 14:38 | |
*** charz has joined #openstack-infra | 14:39 | |
*** dustins has joined #openstack-infra | 14:40 | |
*** markmcclain has joined #openstack-infra | 14:41 | |
*** markmcclain has quit IRC | 14:41 | |
*** rainya has joined #openstack-infra | 14:41 | |
*** k4n0 has quit IRC | 14:42 | |
*** zaphod42 has quit IRC | 14:42 | |
*** zaphod42 has joined #openstack-infra | 14:42 | |
*** pkoniszewski has joined #openstack-infra | 14:42 | |
*** hdd has joined #openstack-infra | 14:42 | |
*** markmcclain has joined #openstack-infra | 14:43 | |
*** hashar has quit IRC | 14:43 | |
*** isviridov is now known as isviridov_meet | 14:43 | |
*** IAX has joined #openstack-infra | 14:46 | |
fungi | #status note upgraded all pypi mirrors from bandersnatch 1.5 to 1.6.1 for https://bitbucket.org/pypa/bandersnatch/issue/52 | 14:46 |
openstackstatus | fungi: unknown command | 14:46 |
*** zz_jgrimm is now known as jgrimm | 14:46 | |
*** otherwiseguy has joined #openstack-infra | 14:47 | |
*** jheroux has joined #openstack-infra | 14:47 | |
*** bhunter71 has joined #openstack-infra | 14:49 | |
*** HeOS has quit IRC | 14:51 | |
*** annegent_ has quit IRC | 14:51 | |
*** pcrews has joined #openstack-infra | 14:52 | |
*** gokrokve has quit IRC | 14:52 | |
*** JayJ has quit IRC | 14:53 | |
*** markmcclain has quit IRC | 14:53 | |
*** JayJ has joined #openstack-infra | 14:54 | |
*** hashar has joined #openstack-infra | 14:55 | |
*** dizquierdo has joined #openstack-infra | 14:55 | |
*** bhunter71 has quit IRC | 14:56 | |
*** AJaeger has quit IRC | 14:57 | |
ttx | clarkb: catching up on the gerrit-powered agenda status | 14:58 |
*** yamahata has joined #openstack-infra | 14:58 | |
ttx | clarkb: lbragstad removed some of the check/gate logic, apparently after discussion that jenkins would do it | 14:59 |
ttx | which confuses me a bit | 15:00 |
ttx | lbragstad: you around ? | 15:00 |
lbragstad | ttx: o/ | 15:00 |
lbragstad | ttx: I removed most of that logic since it didn't seem like something the average enduser would be concerned about | 15:00 |
ttx | we still need the code to do that, though ? | 15:01 |
ttx | i.e. checking for meeting conflicts ? | 15:01 |
lbragstad | ttx: yes, that is still done by gerrit-powered-agenda | 15:01 |
*** prad has joined #openstack-infra | 15:01 | |
clarkb | We had talked about making a two step publish process. first step compile second step push to wiki via authenticated slave. | 15:01 |
lbragstad | that step could use the meeting object API to check for conflicts | 15:02 |
*** HeOS has joined #openstack-infra | 15:02 | |
ttx | hmm, ok, I'll dive a bit more I guess | 15:02 |
clarkb | though I think check/gate should look for errors as early in the process as possible | 15:02 |
ttx | lbragstad: I was about to prepare a change to produce a single .ics | 15:02 |
*** datsun180b has joined #openstack-infra | 15:02 | |
ttx | because currently it builds one .ics file per meeting | 15:02 |
*** atiwari has joined #openstack-infra | 15:03 | |
ttx | while currently we have a single one with all meetings | 15:03 |
ttx | lbragstad: any reason for not doing it in a single file ? | 15:03 |
lbragstad | ttx: when we originally met with the capstone group I thought each meeting was to be represented as a single .ics file? | 15:04 |
ttx | lbragstad: ah, probably a communication error then | 15:04 |
lbragstad | ttx: I apologize about that | 15:04 |
ttx | If we want to preserve the gcal experience, we should let people subscribe to a single ics with all of them | 15:05 |
*** spzala has quit IRC | 15:05 | |
ttx | it's an easy fix | 15:05 |
ttx | just wanted to make sure the current situation wasn't done on purpose :) | 15:05 |
ttx | will give me a nice intro to the code. | 15:05 |
*** datsun180b has quit IRC | 15:06 | |
*** datsun180b has joined #openstack-infra | 15:06 | |
lbragstad | ttx: I think that could be done with a flag, unless you outputting a single .ics with all meetings to be the default behavior | 15:07 |
lbragstad | s/you/you think/ | 15:07 |
*** mfer has joined #openstack-infra | 15:07 | |
ttx | will do! | 15:07 |
lbragstad | clarkb: fwiw, we check for conflicts before writing/converting anything and bomb out early | 15:08 |
*** zaphod42 has quit IRC | 15:08 | |
lbragstad | ttx: don't hesitate to poke at me if you need anything, I can also pick up something if you need me to. | 15:08 |
*** jistr has quit IRC | 15:08 | |
*** zaphod42 has joined #openstack-infra | 15:09 | |
*** tsg has quit IRC | 15:09 | |
*** spzala has joined #openstack-infra | 15:10 | |
lbragstad | ttx: clarkb note on the project: in June mrodden and I were going through and doing a little bit of a rewrite and discovered an issue with namespaces/imports, which lead us to rename the project to arbiter ( mrodden came up with the cool name). | 15:10 |
*** bhunter71 has joined #openstack-infra | 15:11 | |
*** zaphod42 has quit IRC | 15:13 | |
*** mrmartin has joined #openstack-infra | 15:14 | |
*** salv-orlando has quit IRC | 15:15 | |
*** thedodd has joined #openstack-infra | 15:15 | |
*** achanda has joined #openstack-infra | 15:17 | |
*** amotoki has quit IRC | 15:20 | |
*** julim has joined #openstack-infra | 15:22 | |
*** ashaeron has quit IRC | 15:22 | |
*** kashyap has quit IRC | 15:23 | |
*** achanda has quit IRC | 15:24 | |
*** dkliban is now known as dkliban_biab | 15:29 | |
corvus | fungi, clarkb, mordred, SergeyLukjanov, jhesketh, ttx: hi there | 15:30 |
*** corvus is now known as jeblair | 15:30 | |
anteaya | corvus: welcome back | 15:30 |
anteaya | jeblair: how was vacation? | 15:30 |
ttx | jeblair: o/ | 15:30 |
*** lnxnut has joined #openstack-infra | 15:31 | |
fungi | heyhey! | 15:33 |
fungi | btw, everything fell over as soon as you left, so we all just gave up and drank for the past week and a half | 15:33 |
anteaya | wooooo | 15:33 |
jeblair | anteaya: excellent, thanks. i saw some amazing things and ate delicious food. i stood in a prairie at 14,000 feet with mountains towering over me. | 15:33 |
anteaya | wow | 15:34 |
anteaya | that sounds awesome | 15:34 |
jeblair | anteaya, fungi: related to that, i also learned that multi-lingual drinking games are HARD. | 15:34 |
*** isviridov_meet is now known as isviridov_away | 15:34 | |
anteaya | sounds like tibet | 15:34 |
fungi | jeblair: especially when it involves shochu? | 15:34 |
*** dustins has quit IRC | 15:34 | |
fungi | (or whatever the local variant is) | 15:34 |
*** skolekonov has quit IRC | 15:34 | |
jeblair | anteaya: it's culturally, but not administratively, tibetan | 15:35 |
anteaya | wish it was both | 15:35 |
anteaya | but yay culturally tibetan | 15:35 |
anteaya | sounds very spiritually refreshing | 15:35 |
jeblair | the aba prefecture | 15:35 |
*** TheJulia has joined #openstack-infra | 15:36 | |
* anteaya looks it up | 15:36 | |
jeblair | i'll let you know when we have some pictures up | 15:37 |
*** dustins has joined #openstack-infra | 15:37 | |
*** HeOS has quit IRC | 15:38 | |
*** pkoniszewski has quit IRC | 15:38 | |
anteaya | jeblair: I can't wait for your pictures | 15:39 |
anteaya | jeblair: did you see temples? | 15:39 |
*** spzala_ has joined #openstack-infra | 15:39 | |
anteaya | the internets say there are lots there | 15:39 |
jeblair | anteaya: yes indeed. we visited one that was surrounded by a particularly high number of prayer flags | 15:41 |
*** HeOS has joined #openstack-infra | 15:41 | |
*** spzala has quit IRC | 15:41 | |
*** spzala_ is now known as spzala | 15:41 | |
anteaya | oh lovely | 15:41 |
anteaya | I feel vicariously spiritually refreshed just hearing about it | 15:42 |
anteaya | thank you | 15:42 |
*** denis_makogon_ has joined #openstack-infra | 15:44 | |
*** alazarev has joined #openstack-infra | 15:45 | |
zhiyan | fungi: hello, may i ask a quick question, i'm not sure why this failure happened in this test http://logs.openstack.org/54/116654/4/check/check-tempest-dsvm-full-icehouse/16b87c3/logs/devstacklog.txt.gz#_2014-10-08_16_29_39_382 , actually the change passed pep8 and dsvm-full checks. thanks. | 15:45 |
*** ramashri has joined #openstack-infra | 15:45 | |
*** kgiusti has joined #openstack-infra | 15:47 | |
jeblair | fungi: know anything about a storyboard-dev.openstack.org server? | 15:47 |
*** otherwiseguy has quit IRC | 15:48 | |
*** HeOS has quit IRC | 15:49 | |
zhiyan | fungi: oh, i got it. nvm. | 15:49 |
*** HeOS has joined #openstack-infra | 15:49 | |
*** hashar has quit IRC | 15:50 | |
*** zaphod42 has joined #openstack-infra | 15:52 | |
*** kashyap has joined #openstack-infra | 15:52 | |
clarkb | jeblair welcome back | 15:55 |
*** markmcclain has joined #openstack-infra | 15:56 | |
fungi | jeblair: hrm... that doesn't ring a bell | 15:56 |
*** doude has quit IRC | 15:56 | |
jeblair | clarkb: thanks! | 15:56 |
jeblair | fungi: i noticed it's spamming me because it does not have a dns entry | 15:56 |
fungi | jeblair: also seems to be not reachable | 15:56 |
fungi | aha | 15:57 |
fungi | checking in our tenant then | 15:57 |
jeblair | mordred: know anything about a server that thinks it is called storyboard-dev.openstack.org? | 15:57 |
*** timrc-afk is now known as timrc | 15:57 | |
fungi | jeblair: it's definitely in our openstackci tenant in rackspace | 15:57 |
fungi | 23.253.90.209 | 15:58 |
jeblair | fungi: is there a created date? | 15:58 |
*** markmcclain1 has joined #openstack-infra | 15:58 | |
fungi | 2014-01-027 | 15:58 |
fungi | er 2014-01-27 | 15:58 |
mordred | hrm. didnt we have a storyboard-dev server ages ago? | 15:58 |
jeblair | mordred: never that i'm aware of. | 15:59 |
fungi | appears we've had a storyboard-dev server *since* ages ago ;) | 15:59 |
*** dkliban_biab is now known as dkliban | 15:59 | |
fungi | (at least 9 months anyway) | 15:59 |
*** arxcruz has quit IRC | 15:59 | |
jeblair | it's not in puppet or dns; i think it should be deleted | 15:59 |
anteaya | did it start spamming as a result of the rax restarts? | 15:59 |
fungi | i'm happy to delete it now | 15:59 |
mordred | I agree | 15:59 |
anteaya | was that a week ago? | 15:59 |
jeblair | anteaya: quite possibly | 15:59 |
*** mmaglana has joined #openstack-infra | 16:00 | |
fungi | perhaps it was shut down and got inadvertently activated during the rackspace rolling outage | 16:00 |
anteaya | a gift for your return | 16:00 |
*** markmcclain has quit IRC | 16:00 | |
fungi | anyway, deleting now | 16:00 |
jeblair | anteaya: yes, that cron spam was one gift of many :) | 16:00 |
anteaya | woooo, everything is excited you are back | 16:01 |
*** otherwiseguy has joined #openstack-infra | 16:02 | |
*** Guest92054 is now known as mgagne | 16:03 | |
*** markmcclain1 has quit IRC | 16:03 | |
*** armax has joined #openstack-infra | 16:03 | |
*** mgagne is now known as mgagne_ | 16:03 | |
*** markmcclain has joined #openstack-infra | 16:04 | |
*** mgagne_ is now known as Guest31178 | 16:04 | |
mtreinish | man we run a lot of tests... | 16:04 |
clarkb | mtreinish just a few | 16:04 |
mtreinish | I've been running subunit2sql off the gerrit stream since about midnight and it's already at >2.2 M tempest tests executed | 16:05 |
*** gondoi is now known as zz_gondoi | 16:05 | |
mtreinish | including a bunch of tests I've never seen before | 16:05 |
*** derekh has quit IRC | 16:05 | |
*** Guest31178 has quit IRC | 16:05 | |
*** Guest31178 has joined #openstack-infra | 16:05 | |
*** zz_gondoi is now known as gondoi | 16:05 | |
*** yamahata has quit IRC | 16:06 | |
*** todd_dsm has joined #openstack-infra | 16:06 | |
clarkb | neat | 16:06 |
*** Guest31178 is now known as mgagne | 16:07 | |
*** kgiusti has quit IRC | 16:08 | |
*** yaguang has quit IRC | 16:08 | |
*** tsg has joined #openstack-infra | 16:10 | |
*** denis_makogon has quit IRC | 16:10 | |
*** denis_makogon_ is now known as denis_makogon | 16:11 | |
*** dmakogon_ has joined #openstack-infra | 16:11 | |
*** dimtruck is now known as zz_dimtruck | 16:12 | |
*** kgiusti has joined #openstack-infra | 16:12 | |
mtreinish | clarkb: well they were all from manila and other projects where they're writing tests outside the tempest repo... | 16:15 |
clarkb | fungi I dont know if you saw but late last night the centos7 image was having boot failures. ianw is debugging (ianw's local image does boot with kvm so currently a bit stumped) | 16:18 |
clarkb | may try publishing that inage some how to further aid debugging | 16:19 |
fungi | clarkb: yeah, saw that in the scrollback | 16:19 |
*** ChuckC__ has joined #openstack-infra | 16:19 | |
*** thedodd has quit IRC | 16:20 | |
*** garyh has joined #openstack-infra | 16:20 | |
*** yaguang has joined #openstack-infra | 16:21 | |
*** cdent has quit IRC | 16:23 | |
*** thedodd has joined #openstack-infra | 16:23 | |
*** MaxV has quit IRC | 16:24 | |
clarkb | ianw also pinged karanbir late last night but didnt seem to know why that was happening | 16:25 |
clarkb | apparently the base image we start with is the same as what is used in hpcloud | 16:26 |
clarkb | so dib may be doing somethibg funny | 16:26 |
*** david-lyle has joined #openstack-infra | 16:26 | |
zaro | clarkb, fungi : we really need to update gearman-plugin. the one currently installed doesn't work. | 16:26 |
zaro | morning | 16:27 |
clarkb | zaro huh? | 16:27 |
clarkb | I thought we decided it does work | 16:28 |
clarkb | and we could not reproduce what hashar saw | 16:28 |
*** andreykurilin_ has joined #openstack-infra | 16:28 | |
fungi | (modulo that one eventual consistency bug you were ironing out) | 16:28 |
*** zz_dimtruck is now known as dimtruck | 16:29 | |
*** ChuckC__ has quit IRC | 16:29 | |
fungi | oh, right, you determined that was probably just a delay waiting to lock you were seeing? | 16:29 |
fungi | or possibly some sort of event batching in jenkins? | 16:29 |
clarkb | ya event batching | 16:29 |
*** kgiusti has quit IRC | 16:31 | |
*** Guest51022 has quit IRC | 16:31 | |
*** dkliban is now known as dkliban_biab | 16:31 | |
clarkb | zaro is there a change up somewhere with bugfixes? | 16:32 |
clarkb | I am happy to upgrade the plugin but need more infoos | 16:33 |
*** ChuckC___ has joined #openstack-infra | 16:33 | |
*** ChuckC___ has joined #openstack-infra | 16:33 | |
*** yaguang has quit IRC | 16:33 | |
*** melwitt has joined #openstack-infra | 16:34 | |
*** patrickeast has joined #openstack-infra | 16:34 | |
*** kgiusti has joined #openstack-infra | 16:34 | |
*** ChuckC___ has quit IRC | 16:34 | |
*** AJaeger has joined #openstack-infra | 16:35 | |
*** ChuckC__ has joined #openstack-infra | 16:35 | |
zaro | clarkb: i guess we didn't test enough. i took a closer look and was able to repro. fix is up, https://review.openstack.org/#/c/125755/ | 16:35 |
*** otherwiseguy has quit IRC | 16:35 | |
openstackgerrit | Aaron Rosen proposed a change to openstack-infra/project-config: Congress enable nonvoting py33 test https://review.openstack.org/127142 | 16:35 |
zaro | clarkb: i think i forgot to test one additional case with that change, changing node labels. i'll need to do that and fix up hashar's nits | 16:36 |
openstackgerrit | patrick-crews proposed a change to openstack-infra/config: Adding tripleo-ci files to be indexed by logstash https://review.openstack.org/107841 | 16:36 |
clarkb | zaro can you also explain somewhere what is broken? | 16:37 |
clarkb | my testing indicated saveable listener had not changed | 16:37 |
clarkb | and I spent a lot of time in the jenkins source trying to disprove that | 16:38 |
fungi | or were we always technically broken there but behavior in prior versions merely masked it? | 16:39 |
*** jpich has quit IRC | 16:39 | |
*** shashankhegde has joined #openstack-infra | 16:39 | |
*** gondoi is now known as zz_gondoi | 16:39 | |
*** luqas has quit IRC | 16:40 | |
*** habib has quit IRC | 16:40 | |
*** ChuckC__ has quit IRC | 16:40 | |
*** bdpayne has joined #openstack-infra | 16:40 | |
*** melwitt has quit IRC | 16:41 | |
*** ChuckC__ has joined #openstack-infra | 16:41 | |
openstackgerrit | Aaron Rosen proposed a change to openstack-infra/project-config: Congress: enable nonvoting py34 test https://review.openstack.org/127142 | 16:41 |
clarkb | (that change has changed significantly since I first reviewed it. I will try rereviewing soon) | 16:41 |
*** melwitt has joined #openstack-infra | 16:41 | |
*** zz_gondoi is now known as gondoi | 16:41 | |
AJaeger | clarkb, fungi: What do you think of getting the bashate fixes into the config repo? https://review.openstack.org/#/c/118944/ | 16:41 |
openstackgerrit | Aaron Rosen proposed a change to openstack-infra/project-config: Congress: enable nonvoting py34 test https://review.openstack.org/127142 | 16:43 |
pleia2 | AJaeger: can I borrow you in an hour or so to ask some questions about how the translations workflow currently works with transifex+ci and stuff? (been looking through some scripts but probably faster just to ask higher level questions) | 16:43 |
openstackgerrit | Anita Kuno proposed a change to openstack-infra/project-config: Rename config => system-config https://review.openstack.org/126075 | 16:43 |
openstackgerrit | Anita Kuno proposed a change to openstack-infra/project-config: Rename config => system-config for nodepool https://review.openstack.org/126076 | 16:43 |
openstackgerrit | Anita Kuno proposed a change to openstack-infra/project-config: Rename config => system-config in tools/ https://review.openstack.org/126077 | 16:43 |
openstackgerrit | Anita Kuno proposed a change to openstack-infra/project-config: Rename config => system-config in README https://review.openstack.org/126080 | 16:43 |
AJaeger | pleia2: sure, shoot... | 16:44 |
pleia2 | AJaeger: in another meeting now, but an hour from now? | 16:44 |
AJaeger | pleia2: ping me and let's see whether it works ;) | 16:44 |
pleia2 | k :) | 16:44 |
*** jgallard has quit IRC | 16:45 | |
jeblair | pleia2: clarkb also has knowledgablenessity about this | 16:46 |
fungi | AJaeger: i'm not opposed to 118944 but don't have time right now to review hundreds of lines of whitespace changes | 16:46 |
*** kgiusti has quit IRC | 16:46 | |
*** bradjones has quit IRC | 16:46 | |
*** yaguang has joined #openstack-infra | 16:46 | |
pleia2 | jeblair: I asked him yesterday, fungi suggested picking AJaeger's brain | 16:46 |
fungi | i just know AJaeger has written a fleet of recent improvements to it | 16:47 |
clarkb | I can chat too but will be DMVing in near future | 16:48 |
*** HeOS has quit IRC | 16:48 | |
pleia2 | clarkb: woo, happy OR license day | 16:48 |
zaro | clarkb: will do, but basically i could not get some of the events to fire when making changes to projects. for example creating a new project (from a copy) or updating projects thru the REST API. | 16:48 |
AJaeger | fungi: understood... | 16:49 |
*** kgiusti has joined #openstack-infra | 16:50 | |
zaro | clarkb: also jenkins no longer polls the jobs folder for changes. if you change config.xml files underneath jenkins won't automatically update with those changes. you need to specifically tell it to reload. | 16:50 |
AJaeger | anteaya: yes, you need to rename the checks - otherwise the jobs will not work at all | 16:51 |
anteaya | actually the jobs didn't work when they were renamed | 16:51 |
anteaya | as I had renamed them in the first patchset | 16:51 |
flaper87 | mmh, for some reason there's no member in the zaqar-milestone group and I, obviously, can't add myself. https://review.openstack.org/#/admin/projects/openstack/zaqar,access | 16:51 |
flaper87 | anyone with enough power can add me to that group? | 16:51 |
flaper87 | please :) | 16:51 |
*** johnthetubaguy is now known as zz_johnthetubagu | 16:52 | |
fungi | flaper87: done | 16:52 |
AJaeger | anteaya: did you rename projects.yaml also? You need to change both files | 16:52 |
flaper87 | fungi: cheers | 16:52 |
*** gondoi is now known as zz_gondoi | 16:52 | |
*** shashankhegde has quit IRC | 16:53 | |
AJaeger | pleia2: see also https://review.openstack.org/126574 - I documented the script a bit better (the common file has much better documentation) | 16:53 |
anteaya | AJaeger: I'll look at that, I'm trying to stay lightly doing stuff while waiting on electoral things | 16:54 |
anteaya | so yeah, only giving this about 20% of my attention now | 16:54 |
pleia2 | AJaeger: yes, that was helpful | 16:55 |
AJaeger | pleia2: but ask - and then let's document further if needed ;) | 16:55 |
AJaeger | pleia2: We could as well write finally a wiki page with details :) | 16:56 |
*** ChuckC__ has quit IRC | 16:57 | |
*** ChuckC__ has joined #openstack-infra | 16:57 | |
*** dkliban_biab is now known as dkliban | 16:58 | |
*** gyee has quit IRC | 17:01 | |
zaro | clarkb: i can't get gearman-plugin on jenkins-dev to connect to zuul-dev.o.o | 17:03 |
zaro | clarkb: i see that there's a gearman process running on zuul-dev but i can't seem to telnet to it. | 17:03 |
*** kgiusti has quit IRC | 17:04 | |
*** zns has quit IRC | 17:04 | |
*** _nadya_ has quit IRC | 17:04 | |
*** andreaf has joined #openstack-infra | 17:05 | |
*** jlibosva has quit IRC | 17:05 | |
*** jp_at_hp has quit IRC | 17:07 | |
fungi | zaro: seems to be listening only on :: not 127.0.0.1 | 17:07 |
fungi | zaro: i can 'nc :: 4730' and get a socket, but 'nc 127.0.0.1 4730' seems to be refused | 17:07 |
*** kgiusti has joined #openstack-infra | 17:08 | |
*** salv-orlando has joined #openstack-infra | 17:08 | |
mordred | fungi: who needs 127.0.0.1 when you have :: ? | 17:09 |
fungi | mordred: indeed | 17:10 |
jedimike | :: always makes me think, "haha, a static ip!" | 17:10 |
* jedimike slinks away into bad joke corner | 17:10 | |
pleia2 | AJaeger: ok, around now, I'm going to start with the stupid questions :) this page is horrible and doesn't actually tell me what projects even have translations, help! https://www.transifex.com/projects/p/openstack/ | 17:11 |
pleia2 | I guess I need to sign up for an account? | 17:11 |
*** tsg has quit IRC | 17:11 | |
fungi | zaro: looks like the configuration may be in need of updating. the gearman status shows no workers at all, not even the merger (which is also running). i even stopped them and started them again | 17:11 |
*** tsg has joined #openstack-infra | 17:11 | |
*** ryanpetrello has joined #openstack-infra | 17:11 | |
*** koolhead17 has joined #openstack-infra | 17:11 | |
zaro | fungi: yeah, it's because the gearman plugin isn't connected to gear server on zuul-dev. connection is refused | 17:12 |
*** tonytan4ever has quit IRC | 17:12 | |
openstackgerrit | patrick-crews proposed a change to openstack-infra/config: Adding tripleo-ci files to be indexed by logstash https://review.openstack.org/107841 | 17:12 |
fungi | zaro: oh, for that matter, the zuul-server process has a defunct child from immediately after i started it. looking in its logs now | 17:12 |
*** zns has joined #openstack-infra | 17:13 | |
fungi | zaro: and the logs are empty | 17:13 |
*** kgiusti has quit IRC | 17:14 | |
*** habib has joined #openstack-infra | 17:14 | |
fungi | zaro: so, yeah, probably the config/layout haven't kept pace with changes in master and need to be revisited | 17:14 |
*** habib has quit IRC | 17:14 | |
*** habib has joined #openstack-infra | 17:15 | |
*** gyee has joined #openstack-infra | 17:15 | |
AJaeger | pleia2: I'm ready as well. | 17:16 |
AJaeger | let me check the transifex page. | 17:17 |
pleia2 | thanks | 17:17 |
*** zns has quit IRC | 17:18 | |
*** kgiusti has joined #openstack-infra | 17:18 | |
AJaeger | pleia2: use https://www.transifex.com/organization/openstack | 17:18 |
zaro | thanks fungi, i'll look into updating the puppet so gear server will work again. | 17:18 |
AJaeger | that should work without an account. | 17:18 |
pleia2 | oh, there we go! | 17:19 |
*** Ryan_Lane has joined #openstack-infra | 17:19 | |
AJaeger | pleia2: Let's go one step back: What's the background of the questions? What is your goal? | 17:19 |
*** harlowja_away is now known as harlowja | 17:19 | |
*** shashankhegde has joined #openstack-infra | 17:19 | |
pleia2 | AJaeger: right, so we're looking to replace transifex (hopefully next cycle) so I need to understand how we're doing things now so I can understand what I need to focus on with pootle and zanata functionality | 17:19 |
*** ChuckC__ has quit IRC | 17:19 | |
*** bswartz has quit IRC | 17:20 | |
*** unicell has quit IRC | 17:20 | |
AJaeger | pleia2: finally ;) I'm aware of those efforts | 17:20 |
pleia2 | we have pootle and zanata demos up now, but evaluation has kind of stalled because I don't have great instructions for the translators about how they can evaluate them | 17:20 |
AJaeger | What do you think of using this etherpad https://etherpad.openstack.org/p/transifex - and documenting everything there | 17:20 |
pleia2 | wfm | 17:20 |
AJaeger | shall we use the etherpad chat, then? | 17:21 |
*** zns has joined #openstack-infra | 17:21 | |
*** arosen1 has joined #openstack-infra | 17:21 | |
pleia2 | k | 17:21 |
jedimike | we're getting hit by https://bugs.launchpad.net/ubuntu/+source/openvswitch/+bug/1379201 when building new nodepool images, can't compile openvswitch module, anyone here seen that before? | 17:21 |
*** maxbit has quit IRC | 17:21 | |
uvirtbot | Launchpad bug 1379201 in openvswitch "openvswitch-datapath-dkms 1.4.6-0ubuntu1.12.04.3: openvswitch kernel module failed to build" [Undecided,Confirmed] | 17:21 |
j^2 | So i’m seening a lot of merge conflicts in openstack-chef; but all the error says is “Patch in Merge Conflict” and no link to see the conflict. Is there a way to see whats broken? | 17:21 |
arosen1 | Hi, anyone hitting this error today? http://paste.openstack.org/show/119948/ I'm wondering if it's related to having python-six installed from packages and pip (and my system is using six from packages). Jenkins upstream though has python-six installed as a packages too though. | 17:22 |
*** maxbit has joined #openstack-infra | 17:22 | |
*** jgallard has joined #openstack-infra | 17:22 | |
clarkb | j^2 you can run the rebase locally | 17:22 |
clarkb | git rebase -i origin/master | 17:23 |
j^2 | should i abandon the review then? or if i push up another review would it get out of that state? | 17:23 |
*** alexpilotti has joined #openstack-infra | 17:23 | |
clarkb | push a new patch with conflicts resolved | 17:23 |
j^2 | clarkb: rock on, thanks! | 17:23 |
arosen1 | hrm i moved six.py from /usr/lib/python2.7/dist-packages on my box so the one from pip is used and that fixes the issue. | 17:27 |
arosen1 | it seems like the depenency of python-debian and six prevent us from really uninstalling it unless we use some nodeps option | 17:28 |
fungi | arosen1: running in a virtualenv with ststem site-packages enabled i take it? | 17:29 |
fungi | er, system site-packages | 17:29 |
ameade | mtreinish: Hey, i'm trying to override the value for OS_TEST_TIMEOUT in our CI system but devstack-gate does not pass along environment variables into the tox command | 17:30 |
ameade | mtreinish: so it continues to use the default in tempests .testr.conf | 17:30 |
ameade | mtreinish: Right now I have a crazy hack in local.conf to get around it but I'm wondering if there is a better way | 17:30 |
*** baoli has quit IRC | 17:31 | |
*** achanda has joined #openstack-infra | 17:32 | |
*** baoli has joined #openstack-infra | 17:32 | |
*** unicell has joined #openstack-infra | 17:32 | |
arosen1 | fungi: this is an issue i hit with the python-openstackclient; devstack just does sudo python setup.py develop; and just runs it like that; so i'm supprised we don't hit this in the gate either. | 17:32 |
*** todd_dsm has quit IRC | 17:32 | |
*** jgallard has quit IRC | 17:32 | |
vishy | do we have any statistics on how long a single recheck takes on average and how long a single reverify takes on average? | 17:34 |
*** yfried has joined #openstack-infra | 17:34 | |
fungi | jogo: ^ ? | 17:34 |
clarkb | vishy test time is captured in graphite | 17:34 |
*** dimtruck is now known as zz_dimtruck | 17:35 | |
clarkb | but not time from comment to comment | 17:35 |
fungi | my guess is he's asking whether anyone has run time series analysis or anything | 17:35 |
vishy | because according to jogo’s email we have about 5 rechecks per patchset | 17:35 |
fungi | huh? looked like he said average was ~0.7 rechecks per patchset | 17:35 |
*** habib has quit IRC | 17:35 | |
clarkb | best case is about 50 minutes. worst case depends on day | 17:35 |
fungi | unless i misread his e-mail | 17:35 |
*** jcoufal has quit IRC | 17:35 | |
*** habib has joined #openstack-infra | 17:36 | |
clarkb | fungi that is how I read too | 17:36 |
*** tty57 has quit IRC | 17:36 | |
vishy | fungi: it said per revision | 17:36 |
vishy | unless he misstated | 17:36 |
fungi | vishy: oh, you're multiplying by the average patchset count per change | 17:36 |
clarkb | patchset == revision | 17:36 |
fungi | got it | 17:36 |
vishy | aye | 17:36 |
vishy | ok 5 rechecks per change before merge | 17:37 |
fungi | on average for nova over the course of the past 6 months, sounds like | 17:37 |
*** achanda has quit IRC | 17:37 | |
clarkb | yup. and doesnt account for blind rechecks but thats fine | 17:37 |
vishy | so that is 8700+ hours spent in rechecks over the past 6 months | 17:38 |
fungi | those are likely statistically insignificant anyway | 17:38 |
vishy | just for nova | 17:38 |
fungi | (the blind rechecks i mean) | 17:38 |
vishy | 17:38 | |
clarkb | fungi no they are very significant | 17:38 |
fungi | oh? | 17:38 |
clarkb | I think blind rechecks are majority of rechecks | 17:38 |
*** habib has quit IRC | 17:38 | |
fungi | interesting | 17:38 |
vishy | by blind you mean a recheck when we don’t know what the source of the bug is? | 17:38 |
fungi | i assumed you meant rechecking just to see if a change had regressed | 17:39 |
clarkb | vishy no I mean dev didnt debug -1 at all | 17:39 |
clarkb | just rechecked | 17:39 |
mtreinish | ameade: hmm, yeah getting an env variable passed on the way down get's tricky | 17:39 |
fungi | clarkb: oh, his methodology did try to account for that | 17:39 |
clarkb | fungi it did? | 17:39 |
fungi | clarkb: he ignored rechecks where at least one of the same jobs failed on the subsequent run | 17:39 |
mtreinish | ameade: I thought there was a way to get env variables shared by the tox env | 17:39 |
mtreinish | clarkb: ^^^ do you remember? | 17:39 |
clarkb | oh cool I missed that | 17:39 |
ameade | mtreinish: I know how we can make it work but not sure that is the answer | 17:40 |
ameade | mtreinish: we just add -E to the sudo command | 17:40 |
clarkb | mtreinish the issue is d-g does not pass env through sudo | 17:40 |
fungi | vishy: so, yes, that estimate doesn't sound especially surprising | 17:40 |
*** ivar-lazzaro has joined #openstack-infra | 17:40 | |
mtreinish | ah, ok | 17:40 |
*** SumitNaiksatam has quit IRC | 17:40 | |
fungi | vishy: particularly if taken in context as percentage of overall time spent running jobs | 17:40 |
*** akerr has joined #openstack-infra | 17:41 | |
fungi | which i would guess is somewhere around an order of magnitude higher | 17:41 |
clarkb | pep8 failed resulting in recheck happens way more than you expect :( but if jogo filtered that that is great | 17:41 |
fungi | but having numbers around that too would help | 17:41 |
fungi | vishy: hopefully that is time spent by developers hacking on all their other changes in parallel though, not sitting on their thumbs because they work on only one thing at a time | 17:42 |
*** bradm has quit IRC | 17:43 | |
clarkb | hrm need to clarify with jogo | 17:45 |
*** katyafervent is now known as katyafervent_awa | 17:45 | |
*** tonytan4ever has joined #openstack-infra | 17:46 | |
*** otherwiseguy has joined #openstack-infra | 17:46 | |
openstackgerrit | Jaime Flynn proposed a change to openstack-infra/jenkins-job-builder: Added flexible publish support https://review.openstack.org/127300 | 17:50 |
*** amcrn has joined #openstack-infra | 17:53 | |
jogo | clarkb: ? | 17:53 |
*** dkliban is now known as dkliban_brb | 17:55 | |
clarkb | jogo was hoping you might have collected numbers on the rechecks you excluded | 17:55 |
clarkb | maybe broken out by job too | 17:55 |
jogo | clarkb: ahh | 17:56 |
jogo | I didn't break out by job, but that would be easy to do | 17:56 |
jogo | most rechecks are valid though | 17:56 |
jogo | valid == the failed jobs before don't show up after | 17:56 |
clarkb | ok | 17:56 |
clarkb | I think that contradicts what sdague found in the past which maybe means we are getting better | 17:57 |
jogo | clarkb: I have some data for you, one moment | 17:57 |
*** tgohad has joined #openstack-infra | 17:58 | |
*** baoli has quit IRC | 17:59 | |
*** baoli has joined #openstack-infra | 17:59 | |
*** lnxnut has quit IRC | 18:00 | |
*** SumitNaiksatam has joined #openstack-infra | 18:00 | |
*** mattoliverau has quit IRC | 18:00 | |
*** jhesketh has quit IRC | 18:00 | |
*** mattoliverau has joined #openstack-infra | 18:01 | |
*** tsg has quit IRC | 18:01 | |
*** jhesketh has joined #openstack-infra | 18:02 | |
*** amcrn has quit IRC | 18:02 | |
*** zz_dimtruck is now known as dimtruck | 18:02 | |
*** mfink has joined #openstack-infra | 18:03 | |
*** andreykurilin_ has quit IRC | 18:04 | |
*** _nadya_ has joined #openstack-infra | 18:04 | |
j^2 | is this a known issue? fatal: unable to connect to git.openstack.org ? | 18:05 |
*** baoli has quit IRC | 18:05 | |
*** rainya has quit IRC | 18:05 | |
j^2 | for reviews | 18:05 |
j^2 | sorry forgot to put that in | 18:05 |
pleia2 | j^2: we see it sometimes, bug 1352987 | 18:06 |
uvirtbot | Launchpad bug 1352987 in openstack-ci "fatal: unable to connect to git.openstack.org:" [Medium,Triaged] https://launchpad.net/bugs/1352987 | 18:06 |
fungi | j^2: i don't know what you mean by "for reviews" | 18:06 |
j^2 | pleia2: nice thanks | 18:06 |
j^2 | fungi: our reviews when attempting to merge are failing on unable to connect | 18:06 |
fungi | j^2: care to link to an example? | 18:07 |
fungi | j^2: you mean the jobs run on them after they're approved sometimes fail with that error? | 18:07 |
*** baoli has joined #openstack-infra | 18:08 | |
*** derekh has joined #openstack-infra | 18:08 | |
j^2 | fungi: http://logs.openstack.org/08/124808/1/gate/gate-cookbook-openstack-telemetry-chef-unit/7017e64/console.html | 18:08 |
*** andreaf has quit IRC | 18:08 | |
*** rainya has joined #openstack-infra | 18:08 | |
*** che-arne has quit IRC | 18:09 | |
fungi | j^2: ahh, yep, looks like a dns resolution error on a worker in rackspace dfw | 18:09 |
fungi | j^2: did you witness a rash of these recently? | 18:09 |
*** denis_makogon has quit IRC | 18:09 | |
pleia2 | AJaeger: you are AMAZING, thank you so much for taking the time to document this with me today :) | 18:09 |
j^2 | fungi: yep, more or less all morning | 18:09 |
fungi | ick | 18:10 |
pleia2 | (wiki page incoming, it will be awesome) | 18:10 |
fungi | running some correlations now | 18:10 |
j^2 | fungi: awesome thanks :) | 18:10 |
AJaeger | pleia2: you're asking great questions - and documenting this was overdue... | 18:10 |
*** dkliban_brb is now known as dkliban_errand | 18:11 | |
jogo | clarkb: http://paste.openstack.org/show/119955/ | 18:11 |
vishy | fungi: obviously people can multitask but I think a big part of the slow review process is because we can’t do these things quickly. It makes the back and forth between reviewers and patch submitters take exponentially longer because you can’t go back and forth multiple times quickly. People lose track of things because of the long cycle times. | 18:12 |
SergeyLukjanov | jeblair, hey! | 18:12 |
fungi | j^2: yep, there have definitely been a higher number of those today than over the preceding week, and all in rackspace | 18:12 |
jogo | clarkb: that list stops at the first failure before and after | 18:12 |
j^2 | fungi: lovely, should we hold off and then do recheck no bug on anything effected by it? | 18:12 |
j^2 | like in a few hours? | 18:13 |
fungi | vishy: i totally agree with that. hopefully as devs start to focus more on fixing the bugs causing most of that the situation will improve dramatically | 18:13 |
*** baoli has quit IRC | 18:14 | |
vishy | fungi: yes fixing gate bugs and removing unnecessary gating tests | 18:14 |
fungi | j^2: not sure... i'm looking to see if rackspace is admitting to any ongoing issues today with their networks | 18:14 |
j^2 | kk | 18:14 |
vishy | hopefully we can make some serious progress on that during the kilo cycle | 18:14 |
clarkb | jogo stops at the first one? | 18:14 |
*** dizquierdo has quit IRC | 18:14 | |
jogo | clarkb: first failed job | 18:15 |
jogo | so if py26 and 27 failed it only shows 267 | 18:15 |
jogo | 26 | 18:15 |
mtreinish | jogo: ah, ok that explains all the unit test failures. I was going to say that people recheck on the unit tests way more. | 18:15 |
jogo | just fixed and re-running | 18:15 |
clarkb | jogo oh gotcha first per recheck | 18:16 |
fungi | j^2: nothing of note posted on status.rackspace.com but it does look like it's improved dramatically in the past couple hours | 18:16 |
j^2 | fungi: cool cool, thanks for the update | 18:16 |
clarkb | fungi maybe unbound broke again? | 18:16 |
fungi | clarkb: maybe. now that you mention it, seems to be all precise nodes | 18:17 |
*** pelix has quit IRC | 18:17 | |
fungi | clarkb: though it's possible that the error message git provides has changed between precise and trusty and so my search is being too specific | 18:17 |
*** HeOS has joined #openstack-infra | 18:17 | |
*** kgiusti has quit IRC | 18:18 | |
fungi | clarkb: also not really hitting devstack, mostly just bare and py3k | 18:19 |
clarkb | huh | 18:19 |
*** amcrn has joined #openstack-infra | 18:20 | |
*** achanda has joined #openstack-infra | 18:20 | |
fungi | i grabbed a random bare-precise node in rax-iad and can resolve git.openstack.org from the command line on it fine though | 18:20 |
*** achanda has quit IRC | 18:20 | |
*** kgiusti has joined #openstack-infra | 18:21 | |
fungi | repeated the same commands being run in the example failure log and got no errors. working as designed | 18:22 |
fungi | so whatever it is, it's intermittent or has since ceased | 18:22 |
*** achanda has joined #openstack-infra | 18:23 | |
fungi | also resolv.conf and unbound configuration look correct | 18:24 |
mtreinish | ameade: yeah, so I expect there is probably a good reason that we don't pass the env through sudo | 18:24 |
fungi | clarkb: i'm going to guess it's random udp datagram loss through some part of their network | 18:25 |
mtreinish | but if there isn't, then I suppose that's a change you could propose | 18:25 |
*** achanda has quit IRC | 18:25 | |
clarkb | there is | 18:25 |
fungi | mtreinish: ameade: by default sudo sanitizes the calling environment because not doing so is a security risk | 18:25 |
clarkb | we donr want to make d-g a dependency of tempest | 18:25 |
clarkb | this has come up before | 18:26 |
openstackgerrit | Jaime Flynn proposed a change to openstack-infra/jenkins-job-builder: Added flexible publish support https://review.openstack.org/127300 | 18:27 |
mtreinish | clarkb: ok, yeah I think I remeber that now that you said it | 18:27 |
*** e0ne has joined #openstack-infra | 18:28 | |
AJaeger | pleia2: please check https://wiki.openstack.org/wiki/Translations/Infrastructure - I've added markup and add some more text | 18:28 |
AJaeger | pleia2: over to you for any polishing you like to do - or extra questions... | 18:29 |
ameade | clarkb, mtreinish: I'm not clear on how that makes d-g a dependency for tempest | 18:29 |
pleia2 | AJaeger: thanks, I'll add some links to scripts on git.o.o too in order to help people find their way | 18:30 |
clarkb | ameade it is not a direct dependency but allows you to do what you are trying to do. then you must always override tempest defaults | 18:30 |
clarkb | at that point you are dependent on d-g or sonethibg else to properly configure your environment | 18:30 |
*** dustins has quit IRC | 18:31 | |
AJaeger | pleia2: Great! | 18:32 |
jogo | clarkb: http://paste.openstack.org/show/119967 | 18:32 |
jogo | now with all failed jobs | 18:33 |
*** dustins has joined #openstack-infra | 18:33 | |
jogo | a lot of py26 jobs | 18:33 |
AJaeger | pleia2: Let's enhance the bot so that it includes a link to the wiki page - might help the projects to understand what's going on... | 18:33 |
AJaeger | pleia2: I'll send an email to the i18n mailing list to inform them about the page... | 18:33 |
jogo | mtreinish: ^ | 18:33 |
pleia2 | AJaeger: sounds good | 18:34 |
*** kashyap has quit IRC | 18:34 | |
mtreinish | jogo: yeah it's still looks like mostly unit tests | 18:35 |
openstackgerrit | Yathiraj Udupi proposed a change to openstack/requirements: Add kafka-python dependency needed for ceilometer kafka publisher https://review.openstack.org/127309 | 18:36 |
*** achanda has joined #openstack-infra | 18:36 | |
*** dkliban_errand is now known as dkliban | 18:38 | |
jogo | mtreinish: yeah | 18:38 |
jogo | that is for nova btw | 18:39 |
clarkb | jogo is it the same 800 change span? | 18:39 |
*** mrmartin has quit IRC | 18:39 | |
jedimike | bit of a warning here: precise upgraded the kernel from 3.2.0-69 to 3.2.0-70, if you upgrade, your openvswitch installation will stop working | 18:41 |
*** achanda has quit IRC | 18:41 | |
*** kgiusti has quit IRC | 18:42 | |
anteaya | jedimike: good warning | 18:42 |
jedimike | https://bugs.launchpad.net/ubuntu/+source/openvswitch/+bug/1379201 is open for it with the symptom and cause | 18:42 |
uvirtbot | Launchpad bug 1379201 in openvswitch "openvswitch-datapath-dkms 1.4.6-0ubuntu1.12.04.3: openvswitch kernel module failed to build" [Undecided,Confirmed] | 18:42 |
jogo | clarkb: that was 1600 or so changes I think, all in nova last 6 months | 18:44 |
*** derekh has quit IRC | 18:44 | |
openstackgerrit | A change was merged to openstack-infra/project-config: Congress: enable nonvoting py34 test https://review.openstack.org/127142 | 18:44 |
jogo | and not sure what the exact number of patch revisions is | 18:44 |
*** achanda has joined #openstack-infra | 18:44 | |
jogo | but a lot | 18:45 |
*** achanda has quit IRC | 18:45 | |
jedimike | anteaya, it's been causing us headaches today with devstack testing, doesn't look like there's much option but to pin the older kernel for now | 18:45 |
*** kgiusti has joined #openstack-infra | 18:46 | |
*** andreaf has joined #openstack-infra | 18:47 | |
*** e0ne has quit IRC | 18:48 | |
*** spzala has quit IRC | 18:50 | |
anteaya | :( | 18:52 |
clarkb | jedimike upgrade to trusty | 18:52 |
*** dprince has quit IRC | 18:52 | |
*** otter768 has joined #openstack-infra | 18:52 | |
pleia2 | AJaeger: I can't find this (or anything named similarly): "openstack-generate-doc-book (part of openstack-doc-tools repository)" | 18:53 |
jedimike | clarkb, yes, I'd very much like to :) | 18:53 |
AJaeger | pleia2: openstack-doc-tools/os_doc_tools/handle_pot.py is the file and when you run python setup.py install, a script openstack-generate-doc-book is created (see the setup.cfg file) | 18:54 |
pleia2 | AJaeger: aha, I'll edit to make that more clear | 18:54 |
bookwar | we'd like to add some functionality to docimpact tag handling, can someone direct me to the source code for this hook? search for docimpact on github didn't show anything useful | 18:56 |
*** kgiusti has quit IRC | 18:57 | |
AJaeger | bookwar: it's in jeepby | 18:58 |
AJaeger | bookwar: jeepyb/jeepyb/cmd/notify_impact.py | 18:58 |
*** rushiagr is now known as rushiagr_away | 19:00 | |
*** achanda has joined #openstack-infra | 19:00 | |
*** ChuckC__ has joined #openstack-infra | 19:00 | |
openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Script to generate a unique address list for ATCs https://review.openstack.org/127315 | 19:00 |
fungi | anteaya: tristanC: ^ that may be helpful | 19:01 |
*** kgiusti has joined #openstack-infra | 19:01 | |
fungi | anteaya: tristanC: i'm including its output along with the normal csv file dump in an e-mail to you in moments | 19:01 |
pleia2 | AJaeger: so is tools/generatepot similar to openstack-generate-docbook, and so both would actually land in tools/ and be called openstack-generate-pot & openstack-generate-docbook respectively? | 19:01 |
*** achanda has quit IRC | 19:02 | |
*** akerr is now known as akerr_away | 19:02 | |
*** akerr_away is now known as akerr | 19:02 | |
AJaeger | pleia2: the goal was to move tools/generatepot to openstack-doc-tools but the final step is missing... | 19:02 |
AJaeger | tools/generatepot is openstack-generate-pot | 19:02 |
pleia2 | hm, so is openstack-generate-docbook actually tools/generatedocbook ? | 19:03 |
*** akerr has left #openstack-infra | 19:03 | |
AJaeger | pleia2: there's no tools/generatedocbook anymore but previously it was the same | 19:03 |
pleia2 | gotcha | 19:03 |
*** jedimike has quit IRC | 19:04 | |
anteaya | fungi: nice job on the comments in there | 19:04 |
pleia2 | ok, https://wiki.openstack.org/wiki/Translations/Infrastructure is prettified with links | 19:04 |
anteaya | like following the bouncing ball in kids sing-a-long videos | 19:05 |
anteaya | my kind of comments | 19:05 |
fungi | anteaya: yeah, it's more a demonstration with some code than a serious piece of software | 19:05 |
anteaya | I like it | 19:05 |
fungi | anteaya: that was driven out of making sure the extra-atcs don't get extra-votes ;) | 19:06 |
anteaya | which script removes jenkins and the openstack lists? | 19:06 |
anteaya | thank you! | 19:06 |
fungi | anteaya: that would still be a manual removal | 19:06 |
*** dustins has quit IRC | 19:06 | |
anteaya | okay, I would have looked for it anyway | 19:06 |
anteaya | but good to know | 19:06 |
bookwar | AJaeger: ia it ok to add "[doc]" tag to the bug title? we'd rather make it configurable, but i am not sure if you let us put this much configuration into project.yaml :) | 19:06 |
AJaeger | pleia2: thanks! | 19:06 |
bookwar | s/ia/is | 19:07 |
AJaeger | bookwar: please talk with annegentle | 19:07 |
fungi | anteaya: and it's just those two addresses which jump out at me, skimming the list for anything matching 'openstack\.org' which i don't already know to correspond to an actual human being | 19:07 |
anteaya | great | 19:08 |
*** mwagner_lap has quit IRC | 19:08 | |
anteaya | I'll look as well but yes, those two are on my radar | 19:08 |
anteaya | hopefully we don't have others | 19:09 |
fungi | anteaya: ideally we would code review an additional list somewhere of these which the script also pulls in, call it "robot-atcs" or something like that. i just wouldn't hard-code those contributor addresses into any of the tooling | 19:09 |
*** jcoufal has joined #openstack-infra | 19:10 | |
*** dustins has joined #openstack-infra | 19:11 | |
*** otter768 has quit IRC | 19:12 | |
*** wenlock has quit IRC | 19:13 | |
openstackgerrit | Adam Gandelman proposed a change to openstack-infra/project-config: Run sideways ironic greande only on juno branches https://review.openstack.org/127319 | 19:13 |
anteaya | fungi: that sounds like an idea | 19:14 |
*** dkliban is now known as dkliban_brb | 19:15 | |
*** spzala has joined #openstack-infra | 19:15 | |
openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Consolidated functional test data bootstrap https://review.openstack.org/127106 | 19:15 |
*** shashankhegde has quit IRC | 19:18 | |
*** annegent_ has joined #openstack-infra | 19:20 | |
*** sgordon_ has quit IRC | 19:20 | |
*** hashar has joined #openstack-infra | 19:22 | |
pleia2 | jogo: are you in town next week? doing an e-r lightning talk at the summit and could use some slide review (when I write them), could do online if not | 19:24 |
*** ChuckC__ has quit IRC | 19:24 | |
openstackgerrit | Adam Gandelman proposed a change to openstack-infra/project-config: Adds ironic grenade forward testing https://review.openstack.org/127321 | 19:26 |
*** radez is now known as radez_g0n3 | 19:26 | |
*** atiwari has quit IRC | 19:26 | |
*** ramashri has quit IRC | 19:27 | |
fungi | anteaya: tristanC: rolls have been sent to you | 19:27 |
*** annegent_ has quit IRC | 19:27 | |
fungi | tasty, hot, buttery electorate rolls | 19:27 |
*** afazekas has quit IRC | 19:28 | |
fungi | i think the next iteration on the email_stats.py script should leverage gerrit's rest api rather than relying on a database dump... i think that's actually doable, and should make it possible for anyone to generate the same information without assistance | 19:29 |
anteaya | fungi: yum electoral rolls | 19:31 |
anteaya | I'm still editing the wikipage | 19:31 |
anteaya | once i finish I will move to going over the rolls and thank you | 19:31 |
anteaya | oooohhhh | 19:31 |
anteaya | that sounds like a good direction | 19:32 |
anteaya | the might also free you up on the creation end | 19:32 |
anteaya | though I would still verify with you | 19:32 |
fungi | i could even have it output a cryptographic checksum of the data we could record for reference | 19:32 |
anteaya | that would be great | 19:32 |
anteaya | all offical like | 19:33 |
*** otter768 has joined #openstack-infra | 19:33 | |
fungi | i'll noodle on that... it's a few months before i need to worry about it again, i hope (so long as no one abdicates easry) | 19:33 |
fungi | s/easry/early/ | 19:33 |
anteaya | i hope the same | 19:35 |
*** kgiusti has quit IRC | 19:35 | |
*** ChuckC__ has joined #openstack-infra | 19:35 | |
*** ociuhandu has quit IRC | 19:37 | |
*** jamespage_ has joined #openstack-infra | 19:37 | |
*** kgiusti has joined #openstack-infra | 19:37 | |
*** jamespage_ has quit IRC | 19:38 | |
*** e0ne has joined #openstack-infra | 19:39 | |
*** otter768 has quit IRC | 19:45 | |
*** ramashri has joined #openstack-infra | 19:47 | |
*** david-lyle is now known as david-lyle_afk | 19:47 | |
*** dimsum_ has quit IRC | 19:48 | |
*** ChuckC__ has quit IRC | 19:48 | |
*** bradm has joined #openstack-infra | 19:51 | |
*** MaxV has joined #openstack-infra | 19:53 | |
*** ivar-laz_ has joined #openstack-infra | 19:55 | |
*** Longgeek has quit IRC | 19:55 | |
*** datsun180b has quit IRC | 19:57 | |
*** andreykurilin_ has joined #openstack-infra | 19:57 | |
*** ivar-lazzaro has quit IRC | 19:57 | |
*** maxbit has quit IRC | 19:59 | |
*** dvorak has quit IRC | 20:02 | |
*** med_` is now known as med | 20:02 | |
stevemar | something going on with check-tempest-dsvm-neutron-icehouse ? | 20:02 |
*** med is now known as med_ | 20:02 | |
AJaeger | pleia2: thanks for mkaing the wiki page nice! | 20:03 |
*** med_ is now known as Guest20289 | 20:03 | |
*** Guest20289 is now known as medberry_cant | 20:03 | |
stevemar | something alone the lines of 'connection to /var/run/openvswitch/db.sock failed' | 20:03 |
anteaya | okay done the latest pass: https://wiki.openstack.org/wiki/TC_Elections_October_2014#Responses_to_TC_Election_Questions | 20:05 |
anteaya | I hope folks are reading as we go along | 20:05 |
anteaya | getting hefty | 20:05 |
*** shashankhegde has joined #openstack-infra | 20:06 | |
jogo | pleia2: yeah I'll be in town next week | 20:06 |
jogo | pleia2: we can do f2f | 20:06 |
anteaya | as usual, if anyone spots an error of fact or an omission let me know so I can fix | 20:06 |
anteaya | I'm going to take a walk now and will be back in a few hours | 20:06 |
*** kgiusti has quit IRC | 20:08 | |
*** fifieldt has quit IRC | 20:08 | |
*** medberry_cant is now known as medberry | 20:09 | |
*** medberry is now known as Guest28114 | 20:09 | |
*** r1chardj0n3s_afk is now known as r1chardj0n3s | 20:10 | |
*** kgiusti has joined #openstack-infra | 20:13 | |
*** jcoufal has quit IRC | 20:13 | |
*** ivar-laz_ has quit IRC | 20:15 | |
*** jamespage_ has joined #openstack-infra | 20:17 | |
pleia2 | AJaeger: sure thing :) | 20:17 |
*** jamespage_ has quit IRC | 20:17 | |
pleia2 | jogo: great | 20:17 |
*** dvorak has joined #openstack-infra | 20:17 | |
*** zns has quit IRC | 20:18 | |
*** esker has quit IRC | 20:18 | |
fungi | stevemar: you could search on logstash.openstack.org for that to see if it's common and whether it happens on successful runs as well as failures. if it's common you could try spotting a likely bug on the elastic-recheck page | 20:19 |
stevemar | fungi, i checked ER page, nothing really came up | 20:20 |
*** e0ne has quit IRC | 20:21 | |
*** fifieldt has joined #openstack-infra | 20:21 | |
*** e0ne has joined #openstack-infra | 20:21 | |
fungi | stevemar: looks very bursty on the 7-day graph in logstash | 20:22 |
jogo | can someone remove my from sqlalchemy-migrate-core | 20:23 |
jogo | remove me from*, gerrit won't let me do it | 20:23 |
*** tonytan4ever has quit IRC | 20:23 | |
openstackgerrit | Spencer Krum proposed a change to openstack-infra/puppet-storyboard: Integration Testing https://review.openstack.org/126086 | 20:24 |
*** leifmadsen has quit IRC | 20:24 | |
fungi | jogo: done | 20:24 |
stevemar | fungi, i've had 3 of the same error in the last hour or so | 20:24 |
stevemar | 'ERROR neutron.agent.linux.ovs_lib [-] Unable to retrieve bridges. Exception' | 20:24 |
stevemar | http://logs.openstack.org/75/126475/6/check/check-tempest-dsvm-neutron-icehouse/aa130cc/logs/devstacklog.txt.gz, http://logs.openstack.org/11/126111/3/check/check-tempest-dsvm-neutron-icehouse/b8b6eb6/logs/devstacklog.txt.gz and http://logs.openstack.org/08/126108/6/check/check-tempest-dsvm-neutron-icehouse/1c77c29/logs/devstacklog.txt.gz | 20:24 |
jogo | fungi: thanks | 20:25 |
stevemar | let me check log stash for that one | 20:25 |
clarkb | could that be related to the thing jedimike pointed out? | 20:25 |
*** unicell has quit IRC | 20:26 | |
fungi | stevemar: digging in logstash, it cropped up in the icehouse backward-compat jobs for changes on master with the first occurrence at 17:07 utc today | 20:26 |
fungi | stevemar: before that, we saw similar errors in tripleo jobs on the 5th, but nothing between then and when this cropped up a few hours ago | 20:26 |
stevemar | seems suspicious -_- | 20:27 |
fungi | stevemar: clarkb: yes, sounds very much like what jedimike mentioned above | 20:27 |
fungi | stevemar: bug 1379201 | 20:28 |
uvirtbot | Launchpad bug 1379201 in openvswitch "openvswitch-datapath-dkms 1.4.6-0ubuntu1.12.04.3: openvswitch kernel module failed to build" [Undecided,Confirmed] https://launchpad.net/bugs/1379201 | 20:28 |
*** baoli has joined #openstack-infra | 20:28 | |
*** baoli has quit IRC | 20:28 | |
*** leifmadsen has joined #openstack-infra | 20:28 | |
*** leifmadsen has quit IRC | 20:28 | |
*** leifmadsen has joined #openstack-infra | 20:28 | |
stevemar | fungi, silly question, how did you find the bug? it's not on the ER page | 20:28 |
*** e0ne has quit IRC | 20:28 | |
fungi | clarkb: should i delete all today's precise devstack images? | 20:28 |
*** baoli has joined #openstack-infra | 20:28 | |
clarkb | fungi I dont think so. it will just break again | 20:29 |
fungi | stevemar: jedimike linked it earlier. it's not an openstack bug and nobody's added it to e-r | 20:29 |
clarkb | we need a proper fix | 20:29 |
clarkb | maybe nodepool script kernel pin? | 20:29 |
clarkb | then rebuild? | 20:29 |
openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Consolidated functional test data bootstrap https://review.openstack.org/127106 | 20:29 |
*** tonytan4ever has joined #openstack-infra | 20:29 | |
fungi | though i guess we could also add an effects task on openstack neutron | 20:29 |
stevemar | ohhh, I'll try to add it to e-r? | 20:30 |
stevemar | minus the ? | 20:30 |
fungi | stevemar: go for it | 20:30 |
fungi | i've added neutron to that bug, for tracking purposes | 20:31 |
openstackgerrit | Khai Do proposed a change to openstack-infra/gearman-plugin: update to work with Jenkins LTS ver 1.565.3 https://review.openstack.org/125755 | 20:31 |
zaro | clarkb, hashar: ^ | 20:32 |
*** zns has joined #openstack-infra | 20:34 | |
*** otherwiseguy has quit IRC | 20:34 | |
*** alexpilotti has quit IRC | 20:35 | |
hashar | zaro: hi! I hope my comments earlier today made some sense | 20:36 |
hashar | zaro: I don't know Java at all nor do I know about the jenkins api / architecture :( | 20:36 |
*** HeOS has quit IRC | 20:38 | |
zaro | hashar: yes, thanks for reviewing. i just replied to your comments. i'm not sure how we are currently getting it to work in our env. | 20:38 |
*** rainya has quit IRC | 20:38 | |
zaro | hashar: maybe it's because we build our slaves only daily and build them fresh every time :) | 20:39 |
*** DuncanT- has quit IRC | 20:41 | |
*** DuncanT- has joined #openstack-infra | 20:43 | |
*** koolhead17 has quit IRC | 20:43 | |
fungi | jhesketh: mikal: if either if you are around yet, turbo-hipster went off the rails when i deleted nova's stable/havana branch earlier today | 20:45 |
*** vhoward has left #openstack-infra | 20:45 | |
hashar | zaro: you also commented about different testing scenarios. Can they be made actual tests or is that too much hassle? | 20:46 |
*** _nadya_ has quit IRC | 20:48 | |
*** esker has joined #openstack-infra | 20:50 | |
hashar | zaro: will read the new patch tomorrow and might well give it a try on monday (it is holiday in US apparently so that is convenient) | 20:50 |
zaro | hashar: well. i know the code to register functions works and we do have tests for that. it's the jenkins events that stopped working as expected so would i be testing the event system? | 20:51 |
stevemar | fungi, silly question, whats the syntax of the search for logstash? (project and build status) | 20:51 |
zaro | hashar: what? i didn't there was a holiday! you french know more about us than we do :) | 20:52 |
fungi | stevemar: i usually just search on the failure message and then add columns for things like project and build status to get a quick birds-eye view for sanity | 20:52 |
fungi | stevemar: but the syntax is lucene http://www.lucenetutorial.com/lucene-query-syntax.html | 20:53 |
*** david-lyle_afk is now known as david-lyle | 20:53 | |
stevemar | fungi, ah okay like gerrit | 20:53 |
fungi | yep | 20:53 |
hashar | zaro: oh miight be mistaken :] | 20:53 |
zaro | hashar: just checked, columbus day. not really a holiday, not one anybody has to stop working for anyways. | 20:54 |
*** pcm__ has quit IRC | 20:54 | |
hashar | zaro: ah we refer to it as IIndigenous People's Day :D | 20:54 |
hashar | zaro: got it for testing the event system. Probably not much that can be done on that front | 20:55 |
stevemar | fungi, OK now i'm getting somewhere :) | 20:55 |
fungi | we celebrate the hegemony of barbaric imperialist invaders subjugating native peoples everywhere | 20:55 |
mtreinish | zaro: I'm taking Monday off :) | 20:55 |
stevemar | TIL log stash | 20:56 |
zaro | mtreinish: celebrating with the indigenous people? | 20:56 |
*** rainya has joined #openstack-infra | 20:56 | |
mriedem | we probably shouldn't even have a pep8 job for sqlalchemy-migrate: | 20:57 |
mriedem | http://logs.openstack.org/17/121517/6/check/gate-sqlalchemy-migrate-pep8/f73fe21/ | 20:57 |
mriedem | the project has rejected patches to get pep8 to pass | 20:57 |
mtreinish | heh, no just taking a few days off. It just happened to be columbus day | 20:57 |
stevemar | you can become canadian for a day and celebrate canadian thanksgiving on monday | 20:57 |
fungi | i can't think of a better reason to be canadian for a day | 20:58 |
*** jcoufal has joined #openstack-infra | 20:58 | |
*** AJaeger has quit IRC | 20:59 | |
openstackgerrit | Steve Martinelli proposed a change to openstack-infra/elastic-recheck: Add query for bug 1379201 https://review.openstack.org/127346 | 21:00 |
uvirtbot | Launchpad bug 1379201 in openvswitch "openvswitch-datapath-dkms 1.4.6-0ubuntu1.12.04.3: openvswitch kernel module failed to build" [Undecided,Confirmed] https://launchpad.net/bugs/1379201 | 21:01 |
stevemar | yay my first ER commit (maybe) | 21:01 |
*** bhunter71 has quit IRC | 21:01 | |
*** dustins has quit IRC | 21:01 | |
ianw | clarkb: hey, as you noticed, no repo ... i rebuilt my images using build-image.sh and it boots OK with kvm locally | 21:01 |
ianw | clarkb: so two things, first are there any logs of the build available | 21:02 |
ianw | clarkb: and two, if we can get the built image somewhere public, i can import that fairly quickly into an openstack instance and see if it happens there | 21:03 |
clarkb | ianw yes publicly too at http://nodepool.openstack.org | 21:03 |
clarkb | fungi ^ thoughts on how to publish a 2.9GB image? | 21:03 |
clarkb | I am currently at deq so hard for me to do that | 21:04 |
*** otherwiseguy has joined #openstack-infra | 21:04 | |
*** julim has quit IRC | 21:04 | |
*** markmcclain has quit IRC | 21:05 | |
waynr | anyone have advice for setting variables in a shell script but also allowing that script to contain '{}' characters? (jenkins-job-builder) | 21:06 |
clarkb | waynr escape the {}s by doubling them up | 21:07 |
clarkb | so {} becomes {{}} | 21:07 |
waynr | clarkb: thanks | 21:07 |
clarkb | ianw find the logs? | 21:07 |
ianw | clarkb: yep, thanks, should have realised they were there ... old centos7 images did have a separate partition for /boot, which seems involved. digging to see if something related | 21:08 |
ianw | clarkb: yeah "Using locally cached http://buildlogs.centos.org/centos/7/cloud/CentOS-7-Broken-20140620-Nightly.qcow2" | 21:11 |
ianw | clarkb: is d-i-b on nodepool updated? | 21:11 |
*** chianingwang has joined #openstack-infra | 21:11 | |
clarkb | lol "broken" | 21:11 |
clarkb | it isnt latest dib. iir | 21:11 |
clarkb | I can fix that later | 21:11 |
ianw | clarkb: yeah, i think that's the issue | 21:11 |
clarkb | ok thanks | 21:11 |
clarkb | we need an explicit install for it then | 21:12 |
clarkb | right now nodepool gets it as a dep | 21:12 |
clarkb | ianw you can write that change if you like | 21:12 |
clarkb | or I can in a bit | 21:12 |
clarkb | about to get car registered in a new state | 21:13 |
ianw | clarkb: at vmware, the main build spits out "esx-broken-foo" ... but it was short for "broken-out" as it was split out of something else once and stuck. caused constant confusion | 21:13 |
*** andreykurilin_ has quit IRC | 21:13 | |
ianw | clarkb: ok, i'll have a look now | 21:13 |
fungi | clarkb: we probably ought to publish images on swift with cdn fronting, ideally | 21:13 |
*** ivar-lazzaro has joined #openstack-infra | 21:14 | |
fungi | clarkb: given they're large and relatively static | 21:14 |
*** zul has quit IRC | 21:14 | |
*** HenryG has quit IRC | 21:14 | |
clarkb | fungi++ that is an excellent idea | 21:14 |
ianw | fungi / clarkb : happy to have a look at that in short-term future | 21:15 |
*** ayoung is now known as ayoung-afk | 21:16 | |
fungi | clarkb: ianw: also if our service providers had a mechanism by which we could mark those images we upload public, then we could also publish the latest uuids for them as a convenience (so users of those providers don't have to download and reupload them to use them). no idea if that's even remotely possible though | 21:17 |
*** jgrimm is now known as zz_jgrimm | 21:17 | |
fungi | in glance itself, i mean | 21:17 |
clarkb | hpcloud does but you need extra bits like canonical have iirc | 21:18 |
*** homeless has quit IRC | 21:18 | |
*** zul has joined #openstack-infra | 21:19 | |
*** homeless has joined #openstack-infra | 21:19 | |
*** mbacchi has quit IRC | 21:21 | |
mattoliverau | morning | 21:23 |
*** mmedvede has quit IRC | 21:27 | |
*** jcoufal has quit IRC | 21:29 | |
*** mfer has quit IRC | 21:32 | |
*** tonytan4ever has quit IRC | 21:33 | |
*** froek has left #openstack-infra | 21:38 | |
*** adalbas has quit IRC | 21:40 | |
*** shashankhegde has quit IRC | 21:41 | |
*** mriedem has quit IRC | 21:41 | |
*** esker has quit IRC | 21:42 | |
*** zz_gondoi is now known as gondoi | 21:42 | |
*** shashankhegde has joined #openstack-infra | 21:42 | |
*** dangers is now known as dangers_away | 21:47 | |
*** Sincler has quit IRC | 21:49 | |
*** otherwiseguy has quit IRC | 21:49 | |
*** xyang0 has quit IRC | 21:53 | |
*** mmedvede has joined #openstack-infra | 21:56 | |
mtreinish | dhellmann, jeblair, fungi, clarkb, etc.: can you guys take a look at https://review.openstack.org/122478 | 21:59 |
*** thedodd has quit IRC | 21:59 | |
mtreinish | it's more procedural, because we're already installing it in devstack on every run | 22:00 |
mtreinish | but we can't add it to a requirements list and use it until that lands | 22:00 |
*** jheroux has quit IRC | 22:03 | |
*** annegent_ has joined #openstack-infra | 22:07 | |
*** annegent_ has quit IRC | 22:07 | |
*** achanda has joined #openstack-infra | 22:08 | |
*** mfink has quit IRC | 22:08 | |
*** Sukhdev has joined #openstack-infra | 22:09 | |
*** packet has quit IRC | 22:14 | |
*** hashar has quit IRC | 22:14 | |
*** packet has joined #openstack-infra | 22:14 | |
fungi | mattoliverau: do you help maintain the turbo-hipster ci? | 22:14 |
fungi | if not i'll give jhesketh a few more minutes to suck down his coffee | 22:15 |
mattoliverau | fungi: Yeah, but not as much as jhesketh.. aka I have access and can poke :P | 22:17 |
jeblair | mtreinish: lgtm | 22:17 |
mtreinish | jeblair: cool, thanks | 22:17 |
*** mfink has joined #openstack-infra | 22:18 | |
fungi | mattoliverau: you might want to disable it before i do | 22:18 |
fungi | mattoliverau: and then possibly see what needs to be done to get it to stop trying to check out the stable/hava branch i just deleted upstream earlier today | 22:18 |
fungi | er, stable/havana | 22:19 |
*** packet has quit IRC | 22:19 | |
openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/project-config: Grant sahara-core to rebase changes in sahara https://review.openstack.org/127368 | 22:20 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/project-config: Grant sahara-core to rebase changes in extra sahara projects https://review.openstack.org/127369 | 22:20 |
fungi | mattoliverau: or leave that second part to jhesketh | 22:20 |
jeblair | fungi: huzzah! | 22:22 |
fungi | jeblair: yes, there was much rejoicing | 22:23 |
fungi | jeblair: other tidbits you probably won't find in meeting logs from while you were out... | 22:23 |
openstackgerrit | Khai Do proposed a change to openstack-infra/jenkins-job-builder: fix delete job command https://review.openstack.org/127370 | 22:23 |
*** dkranz has quit IRC | 22:23 | |
openstackgerrit | Ian Wienand proposed a change to openstack-infra/config: Install latest diskimage-builder on nodepool https://review.openstack.org/127371 | 22:23 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/project-config: Add sahara buildimages jobs for two more plugins https://review.openstack.org/127372 | 22:24 |
jogo | krotscheck: ping | 22:24 |
krotscheck | yeees? | 22:24 |
fungi | jeblair: the zuul pipeline precedence was adjusted to make gate high like pre-release/release/tag, so that check could be at normal and everything else low (this prevented merge-check spikes from delaying check jobs starting) | 22:24 |
ianw | clarkb /fungi : ^ hopefully that's what you were thinking for nodepools d-i-b? | 22:24 |
jogo | krotscheck: you are one of resident UI experts right? | 22:24 |
fungi | jeblair: we upgraded all the jenkins masters because of a ton of security vulnerabilities they announced | 22:25 |
krotscheck | jogo: That’s what the sign on the door says. | 22:25 |
mtreinish | jogo: oh, good call get krotscheck to makes all the dashboards :) | 22:25 |
* krotscheck doesn’t actually have a door. | 22:25 | |
krotscheck | Wait a sec, did I just get volunteered for something? | 22:25 |
fungi | jeblair: which left us with maybe a weird situation with job registration for node label changes in the gearman plugin, zaro and clarkb have been hacking on that but it's been basically non-impacting for us | 22:26 |
jogo | krotscheck: so mtreinish and fungi and I were talking about http://lists.openstack.org/pipermail/openstack-dev/2014-October/048203.html | 22:26 |
jogo | and I was thinking if I could get the bits and pieces together, maybe you could help make the UI itself | 22:26 |
fungi | jeblair: also i upgraded bandersnatch on all our pypi mirrors with the latest release in hopes of squashing the hang-on-teardown issue we were seeing causing the mirrors to go stale (though there's also a mitigation for that in place involving timeout+flock) | 22:27 |
jogo | krotscheck: this is a very rough idea right now though | 22:27 |
krotscheck | jogo: Sure, can you find a couple of resources to take over for me on StoryBoard while I switch over to doing dashboards? | 22:28 |
zaro | fungi: i'm not sure how it even works :/ | 22:28 |
jeblair | fungi: oh, was check or gate at low priority before? | 22:28 |
krotscheck | :D | 22:28 |
*** nkinder has quit IRC | 22:28 | |
jogo | krotscheck: I can try to use it and file bugs maybe | 22:28 |
* krotscheck is reading the thread. | 22:29 | |
*** ramashri has quit IRC | 22:29 | |
jeblair | jogo: post-merge and periodic aren't really the same thing | 22:29 |
jogo | krotscheck: I was thinking make a functional but ugly version first | 22:29 |
jeblair | jogo: i think there are actually 3 cases we're dealing with: | 22:29 |
jogo | jeblair: ok, so I am at a bit of loss for terminology here | 22:29 |
*** dkliban_brb is now known as dkliban_afk | 22:30 | |
jeblair | 1) post -- something that runs in response to a specific change merging | 22:30 |
krotscheck | This feels almost like a puppetboard for gerrit-ish things. | 22:30 |
jeblair | that includes things like documentation publishing, translation updates, updating the branch tarball, etc | 22:30 |
* jogo looks up puppetboard | 22:30 | |
krotscheck | jogo: puppetboard.openstack.org | 22:31 |
fungi | ianw: other than a typo i marked inline, yes i think so | 22:31 |
jeblair | ideally, they should actually report back to gerrit, but since gerrit does not include the merge commit sha in the change-merged event, we don't have the info needed for that | 22:31 |
jeblair | to correct that situation, we should patch gerrit | 22:31 |
jeblair | it should not be an extensive change | 22:31 |
fungi | jeblair: gate was at normal, check was at low, so we basically shifted gate and check up a notch | 22:32 |
jeblair | 2) low-priority periodic jobs -- something we run daily (current periodic jobs) | 22:32 |
jeblair | 3) continuous -- somewhere between the two -- we run as often as practical in order to narrow the window of breakages | 22:33 |
jeblair | jogo: ^ all of the preceeding was addressed to you :) | 22:33 |
jogo | jeblair: right, so I like the terminology here too | 22:34 |
krotscheck | Read-only dashes aren’t that hard. | 22:34 |
jeblair | jogo: i think that perhaps rather than depending entirely on logstash and graphite (both of which have a loose coupling with zuul) we should use the mysql reporter for zuul and build the dashboard from that | 22:34 |
openstackgerrit | Ian Wienand proposed a change to openstack-infra/config: Install latest diskimage-builder on nodepool https://review.openstack.org/127371 | 22:35 |
jogo | jeblair: so I was thinking a read only dashboard for things that do not report on gerrit | 22:35 |
jogo | mysql reporter for zuul? | 22:35 |
jeblair | jogo: iow, zuul should be able to provide its own dashboard of runs it has triggered, since it has all of the information necessary (once recorded in mysql) | 22:35 |
krotscheck | zuul-webclient? | 22:35 |
jogo | jeblair: that sounds even better | 22:36 |
*** gondoi is now known as zz_gondoi | 22:36 | |
*** zns has quit IRC | 22:36 | |
jogo | is the mysql reporter an idea or a working thing? | 22:36 |
jeblair | krotscheck: ideally yes, it should be a different process; currently the zuul webserver is built-in. no one has moved it out yet. i don't think it needs to be a different project though (at this point), just a different process. | 22:37 |
*** MaxV has quit IRC | 22:38 | |
krotscheck | jeblair: Seems sane. I don’t know that much about zuul yet, but it’s not like there’s anything impossible left on this planet. | 22:38 |
jogo | jeblair: so one of the benefits of using graphite for this is, there is a lot of great tooling already built a round it | 22:38 |
jeblair | jogo: https://review.openstack.org/#/c/65885/ | 22:38 |
krotscheck | jeblair, jogo: What kind of a timelilne are we looking at here? | 22:38 |
jeblair | jogo: i think we might augment it with graphite and logstash, but i think we should not depend on it or logstash because of the too-loose coupling | 22:39 |
jogo | jeblair: why is the loose coupling a concern? | 22:39 |
jeblair | jogo: with a mysql db, we can have assurance we know each success, failure, timestamp, and log url for each run | 22:39 |
mattoliverau | fungi: I have turned off TH voting while I take a look at the issue | 22:40 |
jeblair | jogo: because zuul does not require either of them, and does not even know about one of them | 22:40 |
jogo | jeblair: so using mysql db instead of logstash would be nice | 22:40 |
jogo | but being able to build a time series and an alert from graphite is really powerful | 22:40 |
jeblair | jogo: i'm not saying it isn't. i _do_ think you should use it to build graphs | 22:41 |
jogo | jeblair: and mysqldb to get the specific details | 22:41 |
jeblair | jogo: but i'm saying the part that lists what the jobs are, what the latest result is, and the result history for each run should be built from local data | 22:41 |
fungi | mattoliverau: thanks! | 22:41 |
* krotscheck idly drops https://github.com/mbostock/d3/wiki/Gallery into the graphing conversation. | 22:41 | |
jogo | jeblair: agreed, using a mysql db for that would be wondeful | 22:42 |
jogo | krotscheck: we need more bubble charts | 22:42 |
*** HeOS has joined #openstack-infra | 22:43 | |
jeblair | erm | 22:43 |
jeblair | why are more than one result set showing up in the javascript ci tables in gerrit? | 22:43 |
jogo | jeblair: I see the building the list of specific jobs etc and building the general tracking as two equally important parts | 22:43 |
anteaya | stevemar: are you canadian? | 22:43 |
*** groknix has joined #openstack-infra | 22:44 | |
jeblair | jogo: yes, we need both | 22:44 |
*** prad has quit IRC | 22:44 | |
fungi | jeblair: sdague is trying to refine the "experimental results mask check results" issue with the table. that's an iteration in that direction aiui (pipeline names mentioned in the result comments are working into this next) | 22:44 |
anteaya | stevemar: I can't imagine many non-canadians knowing about thankgiving being on monday | 22:44 |
jeblair | fungi: but it's showing results from old patchsets | 22:44 |
jeblair | fungi: cf https://review.openstack.org/#/c/65885/ | 22:45 |
jeblair | fungi: only the last one is relevant | 22:45 |
*** kgiusti has quit IRC | 22:45 | |
jogo | jeblair: so this came up in part because of the rough roadmap to continuous testing | 22:45 |
jeblair | fungi: also, experimental results did not mask check results | 22:45 |
jogo | jeblair: and what the status of that is, so besides a dashboard. what is the status? | 22:45 |
jeblair | jogo: yeah, i think we need to get the dashboard up. there may be some small changes to zuul after that, but mostly the dash. | 22:45 |
jeblair | jogo: i think first step in the dash is to get the mysql reporter merged and start using it | 22:46 |
jeblair | jogo: (so we have data to work with) | 22:46 |
jogo | jeblair: can the mysql db include links to the logs? | 22:46 |
jeblair | jogo: maybe clarkb or fungi would be interested in reviewing https://review.openstack.org/#/c/65885/ | 22:46 |
fungi | jeblair: those are all results from the most recent patchset | 22:46 |
stevemar | anteaya, i hope so, we almost shared a back to toronto 2 conferences back :P | 22:46 |
fungi | jeblair: indicating all the rechecks performed on it | 22:46 |
fungi | jeblair: i think the concern expressed was that "voting" experimental job results look the same as voting check results when mashed together into one table | 22:47 |
*** HeOS has quit IRC | 22:48 | |
jeblair | jogo: i think it should, or at least, the information needed to construct it. i'm not sure whether the current revision of that patch includes it | 22:48 |
fungi | and the other concern it was attempting to address is people recheck-spamming a semi broken change until they get a passing grade | 22:48 |
fungi | which does show in the comments, but is not immediately obvious when glancing at the results table | 22:48 |
anteaya | stevemar: did we, did I know you are canadian and forgot? | 22:48 |
anteaya | I can't imagine forgetting | 22:48 |
jeblair | fungi: ah yes, you are right they are all for the current patchset. however, it was a deliberate choice for it to show only the most recent test | 22:48 |
anteaya | stevemar: where are you? | 22:49 |
jogo | fungi: won't continuous jobs not be tied to patchsets? | 22:49 |
jogo | err jeblair ^ | 22:49 |
anteaya | stevemar: now I remember, d'oh, you have been hanging in keystone | 22:49 |
jeblair | jogo: i meant the current revision of the patch to add the mysql reporter | 22:49 |
stevemar | anteaya, you did forget :O we talked about how ford was a bum, there ya go! | 22:49 |
anteaya | stevemar: I didnt' connect the dots, sorry about that | 22:49 |
jeblair | jogo: as in, if it doesn't include the necessary log data, we should add it | 22:49 |
anteaya | stevemar: yeah, you showed me your great backpack | 22:49 |
fungi | jeblair: i'm happy to approve a revert of that change as well. i'm more or less ambivalent on it as a design element but sdague was quite eager for that | 22:50 |
anteaya | stevemar: faces and nicks don't always match in my brain, sorry about that | 22:50 |
jogo | jeblair: but the schema isn't useful for continuous jobs | 22:50 |
jogo | I think | 22:50 |
stevemar | anteaya, haha, keystone is where i spend most of my days, i've been dabbling in infra lately, trying to not increase the work load for you all | 22:50 |
jeblair | fungi: yeah, i was happy with what i discussed with sdague about it, i just thought that it would show only the most recent of each set (eg, most recent check and most recent experimental, with timestamps of each) | 22:51 |
jeblair | jogo: what about the schema is not useful? | 22:51 |
anteaya | stevemar: and we are so grateful!! | 22:52 |
anteaya | stevemar: thank you | 22:52 |
fungi | jeblair: i think the roadmap he had included getting it to collapse all but the most recent result from each pipeline on the patchset with a click-on-header toggle to expose | 22:52 |
jeblair | jogo: yes, you are right. perhaps that should be -1'd with the comment that it should accomodate periodic jobs better | 22:52 |
*** groknix_ has joined #openstack-infra | 22:52 | |
*** hdd has quit IRC | 22:52 | |
jeblair | fungi: i think i would have preferred a 'one step forward' approach rather than 'one step backward and one step forward'. is anyone working on this while he's gone? | 22:52 |
*** JayJ has quit IRC | 22:53 | |
*** JayJ has joined #openstack-infra | 22:54 | |
fungi | jeblair: yeah, i think clarkb had the pipeline patch in progress... | 22:54 |
jeblair | jogo: but yeah, the columns should be a superset of the different types of changes in the zuul model so it would work for 'ref' updates and plain old branch-tip testing too. i don't think that will be hard. | 22:54 |
fungi | jeblair: aha, https://review.openstack.org/125244 | 22:54 |
fungi | jeblair: i hadn't approved because i wasn't sure if he was ready for it to go in yet | 22:54 |
*** groknix has quit IRC | 22:55 | |
jeblair | haha | 22:55 |
clarkb | ya pipeline names are up for review | 22:55 |
jeblair | i read that change and immediately said "i think it would read better if we said 'Check build succeeded'". | 22:56 |
*** dmsimard is now known as dmsimard_away | 22:56 | |
jeblair | and then i went to read sean's comment that prompted the second patchset | 22:56 |
jeblair | though the point about it reading as an imperative is well taken :) | 22:57 |
jogo | jeblair: where can I find the list of types of zuul changes? | 22:57 |
fungi | yeah, english-- | 22:57 |
jeblair | jogo: zuul/model.py | 22:57 |
jogo | searching for 'branch-tip' in docs didn't work | 22:57 |
jeblair | jogo: i think the timer may emit NullChange objects right now, though it should probably emit Ref changes with appropriate values. | 22:59 |
fungi | also, worth noting, we triggered post jobs for all the branch deletion events today, with a commit hash of 0000000... (the jobs thankfully all failed to check out that commit, so no lasting effect) | 23:00 |
fungi | not sure if it's worth special-casing the zero-hash and making zuul ignore those | 23:01 |
fungi | i think it's done this on previous branch deletions as well | 23:01 |
fungi | so probably a long-standing behavior at this point | 23:01 |
*** andreaf has quit IRC | 23:01 | |
jeblair | jogo: (right now, i think branch selection in periodic jobs happens in the job itself; if we made the timer trigger a little more sophisticated (eg, have it emit ref objects) we could have the branch selection in zuul which would give us nicer data for dashboard/reporting) | 23:01 |
*** ramashri has joined #openstack-infra | 23:02 | |
*** baoli has quit IRC | 23:02 | |
jogo | jeblair: nice | 23:02 |
jeblair | fungi: very long standing, and yeah, would be easy to ignore (though it should be configurable; it's conceivable you would want to run a job on branch deletion) | 23:02 |
fungi | agreed | 23:03 |
*** ramashri_ has joined #openstack-infra | 23:04 | |
jogo | jeblair: so it sounds like with a few minor things we get all the data needed to report information about specific jobs | 23:05 |
jeblair | jogo: yup! | 23:05 |
jogo | jeblair: what do you think is needed w.r.t graphite | 23:05 |
jogo | jeblair: as in what kinds of graphs | 23:05 |
jeblair | jogo: and we can expose zuul's data with json | 23:06 |
jogo | jeblair: I was thinking a way to automatically generate success/failure rate graphs per job | 23:06 |
jeblair | jogo: that should already be in graphite | 23:06 |
jogo | jeblair: you mean the data from mysql? | 23:06 |
jeblair | jogo: yep | 23:06 |
jogo | jeblair: right, now what data we need for graphite as I think we have it all, but what graphs would we want | 23:07 |
jeblair | jogo: yeah, i think job success/failure rate over time is the main one | 23:07 |
*** HenryG has joined #openstack-infra | 23:07 | |
*** ramashri has quit IRC | 23:08 | |
jeblair | jogo: (zuul's data will tell you what jobs to check in graphite, so you can automatically make a graph for each job) | 23:08 |
jeblair | jogo: (kind of like the pipeline sparklines on the status page) | 23:08 |
jogo | jeblair: maybe graphite has that too | 23:08 |
jogo | but pulling that from zuul makes more sense | 23:09 |
*** MaxV has joined #openstack-infra | 23:09 | |
jeblair | jogo: we keep data longer in graphite than we keep jobs in zuul | 23:09 |
jeblair | jogo: so if you iterated over all the jobs in graphite, you'd have way more than we're actually interested in | 23:09 |
jogo | jeblair: exactly | 23:09 |
jogo | jeblair: renames and all | 23:09 |
jeblair | jogo: yep, so getting the jobs from zuul and trends from graphite seems the best mix. | 23:10 |
jogo | is there a REST call to list active jobs today? | 23:10 |
jogo | or would this come from the JSON output from the mysql thing | 23:10 |
jeblair | jogo: only thing today is the status json endpoint; i'm imagining this comes from the mysql thing | 23:11 |
*** lttrl has joined #openstack-infra | 23:11 | |
jogo | jeblair: right | 23:12 |
*** MaxV has quit IRC | 23:13 | |
jogo | jeblair: so I am going to start playing around with what types of graphs we may want. I think there may be two | 23:13 |
jogo | long and short term | 23:13 |
*** dimtruck is now known as zz_dimtruck | 23:14 | |
jogo | long = {3-6}.months, short = {2-14 days} | 23:14 |
*** bknudson has quit IRC | 23:17 | |
jeblair | jogo: ++ | 23:17 |
*** hdd has joined #openstack-infra | 23:17 | |
jogo | jeblair: cool, time to relocate. I didn't realize how close we were to getting this up | 23:18 |
*** chianingwang has quit IRC | 23:21 | |
*** kgiusti has joined #openstack-infra | 23:24 | |
*** kgiusti has left #openstack-infra | 23:24 | |
*** flaper87 is now known as flaper87|afk | 23:25 | |
openstackgerrit | A change was merged to openstack-dev/pbr: tests: factorize has_opt handling https://review.openstack.org/122167 | 23:27 |
openstackgerrit | A change was merged to openstack-dev/pbr: autodoc: allow to exclude modules from auto-generation https://review.openstack.org/122168 | 23:27 |
*** nkinder has joined #openstack-infra | 23:34 | |
*** JayJ has quit IRC | 23:37 | |
*** david-lyle has quit IRC | 23:40 | |
*** hdd has quit IRC | 23:40 | |
*** rainya has quit IRC | 23:41 | |
*** zz_jgrimm is now known as jgrimm | 23:43 | |
*** groknix has joined #openstack-infra | 23:45 | |
*** groknix_ has quit IRC | 23:45 | |
*** groknix_ has joined #openstack-infra | 23:47 | |
*** TheJulia has quit IRC | 23:48 | |
*** groknix has quit IRC | 23:50 | |
*** TheJulia has joined #openstack-infra | 23:50 | |
*** dmsimard_away is now known as dmsimard | 23:55 | |
openstackgerrit | Ian Wienand proposed a change to openstack-infra/config: Install latest diskimage-builder on nodepool https://review.openstack.org/127371 | 23:57 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!