| *** bknudson has joined #openstack-infra | 00:01 | |
| asselin | speaking of fixing log servers, heyongli anteaya, let me know your thoughs on this patch: https://review.openstack.org/#/c/138913/ | 00:01 |
|---|---|---|
| heyongli | asselin, i post a comments there. | 00:02 |
| *** gus_ is now known as gus | 00:02 | |
| asselin | heyongli, thanks | 00:02 |
| heyongli | how about put it into scerio testing? or i elimating the ecodeded information? | 00:02 |
| *** bdpayne_ has joined #openstack-infra | 00:03 | |
| heyongli | we need know the vendor/product just becuase we need to verification the alloction. nothing more. | 00:03 |
| asselin | heyongli, is that addressed to me? i really didn't understand.... | 00:04 |
| *** bdpayne has quit IRC | 00:05 | |
| heyongli | asselin, sorry, i missing reading the reviewing link..-:) | 00:05 |
| *** marun has quit IRC | 00:07 | |
| heyongli | asselin, i'm going to reading your patches late today. | 00:07 |
| asselin | heyongli, ok thanks. | 00:07 |
| *** wenlock has joined #openstack-infra | 00:09 | |
| *** wenlock1 has joined #openstack-infra | 00:09 | |
| *** wenlock has quit IRC | 00:09 | |
| *** wenlock1 has quit IRC | 00:09 | |
| *** Masahiro has joined #openstack-infra | 00:10 | |
| *** Ryan_Lane has quit IRC | 00:10 | |
| anteaya | asselin: glad you two are meeting each other | 00:11 |
| anteaya | :D | 00:11 |
| anteaya | asselin: so first pass, I like the direction here and support making it easier for third party ci to set up a log server | 00:11 |
| anteaya | I see we create a thirdpartyci directory in system-config | 00:11 |
| anteaya | I don't yet know how I feel about that | 00:11 |
| clarkb | jhesketh: anything else I can help with on the swift front? | 00:11 |
| *** Ryan_Lane has joined #openstack-infra | 00:12 | |
| clarkb | jhesketh: if not I am going to switch into other things, but I am happy to keep pushing on that if possible | 00:12 |
| anteaya | I don't know enough about setting up a log server with puppet to know if this is a stupid question, so I will just ask | 00:12 |
| anteaya | asselin: what is the viability of these being its own module? | 00:12 |
| *** wenlock has joined #openstack-infra | 00:12 | |
| jhesketh | clarkb: I haven't determined what's next, but I think it'll be just switching some more jobs over (eg infra) | 00:12 |
| asselin | anteaya, yeah, not sure either, but wanted to throw something out there and see if it sticks | 00:12 |
| clarkb | jhesketh: gotcha | 00:12 |
| openstackgerrit | Merged openstack-infra/project-config: Add hacking to openstack-qa gerritbot https://review.openstack.org/139132 | 00:12 |
| jhesketh | clarkb: so I should be good. Thanks heaps for your help :-) | 00:12 |
| clarkb | anteaya: asselin: I think if we make a module it should be for generic apache static file hosting | 00:13 |
| asselin | anteaya, like the other puppet modules? | 00:13 |
| clarkb | anteaya: asselin: then we can put it in front of logs, ci.o.o, tarballs, etc | 00:13 |
| asselin | clarkb, anteaya ok that makes more sense. put all the static stuff in a new module | 00:13 |
| anteaya | clarkb: so would it be better to do that, instead of teh current direction asselin is taking? | 00:13 |
| *** shashankhegde has quit IRC | 00:14 | |
| clarkb | I haven't read asselin's patch yet | 00:14 |
| *** Masahiro has quit IRC | 00:14 | |
| clarkb | let me do that really quickly | 00:14 |
| anteaya | thanks | 00:14 |
| clarkb | oh I forgot about os_loganalyze | 00:15 |
| clarkb | so maybe this isn't just generic static file hosting | 00:15 |
| clarkb | however I don't think that should live in openstack_prject if you want to make it generic | 00:15 |
| clarkb | whatever it is should live outside of openstack_project | 00:15 |
| clarkb | also not a huge fan of thirdpartyci/install_log_server | 00:16 |
| clarkb | that doensn't actually ensure that puppet is updating things over time | 00:16 |
| *** shashankhegde has joined #openstack-infra | 00:17 | |
| *** dimtruck is now known as zz_dimtruck | 00:17 | |
| anteaya | I like the idea of stuff meant for third party is its own module if at all possible | 00:17 |
| clarkb | anteaya: its not meant for third party | 00:17 |
| anteaya | but defintely outside of openstack_project | 00:17 |
| anteaya | I misread then | 00:17 |
| clarkb | at least not strictly | 00:18 |
| anteaya | ah | 00:18 |
| clarkb | anteaya: we use it | 00:18 |
| clarkb | they want to use it too | 00:18 |
| anteaya | right sorry | 00:18 |
| anteaya | multipurpose | 00:18 |
| clarkb | which i think is great | 00:18 |
| *** pc_m has joined #openstack-infra | 00:18 | |
| asselin | right, we want to be as close as possible, if not the same as upstream | 00:18 |
| clarkb | but I am wary of making it look like this is a one time script run deal | 00:18 |
| clarkb | because that doesn't help people get updates over time | 00:18 |
| *** openstackgerrit has quit IRC | 00:18 | |
| *** sputnik13 has quit IRC | 00:18 | |
| asselin | clarkb, I haven't used puppet to auto-update. | 00:19 |
| *** openstackgerrit has joined #openstack-infra | 00:19 | |
| *** sputnik13 has joined #openstack-infra | 00:19 | |
| asselin | perhaps the script should be removed | 00:19 |
| asselin | I'm hoping to get help from others who use puppet auto-update to iron out that part (and me learn from) | 00:20 |
| anteaya | asselin: you are doing everything right | 00:20 |
| anteaya | \o/ | 00:20 |
| *** andreykurilin_ has quit IRC | 00:21 | |
| *** sabeen1 has quit IRC | 00:21 | |
| asselin | anteaya, krtaylor btw, I added this to monday's agenda. | 00:21 |
| openstackgerrit | Khai Do proposed openstack-infra/gerritlib: Doc generation support https://review.openstack.org/94861 | 00:22 |
| *** hdd has quit IRC | 00:22 | |
| anteaya | asselin: thanks for doing so | 00:22 |
| anteaya | :D | 00:22 |
| anteaya | asselin: so what are your thoughts, would you like to mark that wip and incorporate some of clarkb's thoughts? | 00:23 |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/devstack-gate: Add conf to replace nova V2 endpoint with V2.1 API https://review.openstack.org/138949 | 00:24 |
| asselin | anteaya, I'd like to discuss with others, and hoping to get more comments. | 00:25 |
| anteaya | asselin: okay | 00:25 |
| asselin | anteaya, I like clarkb's comments and think others will have good ideas to make it useful longterm. | 00:26 |
| clarkb | I will leave them on the change in a bit | 00:27 |
| asselin | clarkb, thanks | 00:28 |
| *** marun has joined #openstack-infra | 00:28 | |
| anteaya | clarkb: great thanks | 00:29 |
| anteaya | I tried to summarize them but it is better coming from clark | 00:29 |
| anteaya | asselin: in short, great work and I love the direction, we have a starting point for refinement | 00:29 |
| asselin | anteaya, thanks | 00:30 |
| *** sputnik13 has quit IRC | 00:35 | |
| *** tnovacik has quit IRC | 00:35 | |
| openstackgerrit | Khai Do proposed stackforge/python-jenkins: fix typo, must be 'classifier' to appear on pypi.python.org https://review.openstack.org/139286 | 00:36 |
| *** bdpayne_ has quit IRC | 00:37 | |
| *** craigbr has quit IRC | 00:39 | |
| *** david-lyle is now known as david-lyle_afk | 00:39 | |
| nibalizer | i agree with clark ^^^ up there | 00:40 |
| nibalizer | putting that in a module is a good idea | 00:40 |
| *** otter768 has joined #openstack-infra | 00:42 | |
| *** ZZelle_ has quit IRC | 00:42 | |
| openstackgerrit | Khai Do proposed openstack-infra/jenkins-job-builder: fix typo, must be 'classifier' to appear on pypi.python.org https://review.openstack.org/139289 | 00:43 |
| *** Ryan_Lane has quit IRC | 00:43 | |
| anteaya | nibalizer: can you comment as such? | 00:43 |
| openstackgerrit | Khai Do proposed stackforge/python-jenkins: fix typo, must be 'classifier' to appear on pypi.python.org https://review.openstack.org/139286 | 00:43 |
| anteaya | nibalizer: that way when folks look at if for the first time during the third party meeting they take your thougts into account | 00:43 |
| anteaya | many of them don't read infra backscroll | 00:44 |
| nibalizer | anteaya: yup done :) | 00:44 |
| anteaya | thanks | 00:44 |
| anteaya | :D | 00:44 |
| nibalizer | what time is third party meeting these days? | 00:44 |
| nibalizer | i can be sure to be hailable | 00:44 |
| dims_ | sdague: when you get a chance, can you please peek at https://review.openstack.org/#/c/137372/ and https://review.openstack.org/#/c/138710/ ? both have one +2 | 00:44 |
| anteaya | nibalizer: what changes suggested by ivan? can you add a link? | 00:45 |
| anteaya | nibalizer: would be great if you were hailable, would love to have you | 00:45 |
| *** pc_m has quit IRC | 00:45 | |
| anteaya | nibalizer: we now have two meetings a week, lots to choose from | 00:45 |
| anteaya | Twice weekly: Mondays at 1800 UTC as well as Tuesdays at 0800 UTC | 00:46 |
| anteaya | #openstack-meeting for both | 00:46 |
| *** otter768 has quit IRC | 00:47 | |
| *** salv-orlando has quit IRC | 00:47 | |
| *** salv-orlando has joined #openstack-infra | 00:48 | |
| *** teran_ has joined #openstack-infra | 00:48 | |
| *** teran has quit IRC | 00:49 | |
| nibalizer | okay, the monday meeting is much more makeable for me | 00:49 |
| anteaya | I can understand why | 00:50 |
| *** shakamunyi has quit IRC | 00:50 | |
| nibalizer | anteaya: link posted | 00:51 |
| anteaya | thank you | 00:51 |
| anteaya | the remove the variables guy | 00:51 |
| anteaya | cool | 00:51 |
| *** marun has quit IRC | 00:52 | |
| *** CIUnitTester has quit IRC | 00:53 | |
| *** sarob has quit IRC | 00:55 | |
| *** sarob_ has joined #openstack-infra | 00:55 | |
| *** boris-42 has quit IRC | 00:57 | |
| *** lttrl has quit IRC | 01:00 | |
| *** dims_ has quit IRC | 01:00 | |
| clarkb | jeblair: so thinking about my comment on gear change. Should the server at least close the connection? the remote end may not know of the problem and i am not sure we close the connection there | 01:01 |
| bknudson | is the merge conflict checker still working? we used to get a merge conflict warning as soon as something was merged. | 01:03 |
| clarkb | bknudson: no its not reliable right now iirc | 01:03 |
| clarkb | we need to restart zuul to pick up a bug fix | 01:03 |
| bknudson | ok, so you know about it... and now I do. | 01:04 |
| clarkb | it wasn't properly iterating over paged query results when looking for things to merge check | 01:04 |
| jesusaurus | clarkb: oh? what bug did you find? | 01:04 |
| bknudson | there is no way to safely iterate over paged query results! | 01:04 |
| jesusaurus | huh | 01:05 |
| clarkb | bknudson: gerrit gives you a stablish way | 01:05 |
| clarkb | bknudson: basically gerrit says do X, zuul wasn't completely doing that right | 01:05 |
| *** Ryan_Lane has joined #openstack-infra | 01:05 | |
| *** adalbas has quit IRC | 01:05 | |
| bknudson | hmm.. y, maybe with a version you could do it safely. | 01:05 |
| clarkb | bknudson: I don't know why you can't do it safely. You can certainly do it unstabley | 01:05 |
| *** Masahiro has joined #openstack-infra | 01:06 | |
| clarkb | bknudson: gerrit gives each change in a query a sortkey attribute. To resume from that change +1 you feed that sortkey into gerrit. I am unsure of how they actually implement that behind the scenes | 01:07 |
| clarkb | see https://review.openstack.org/Documentation/rest-api-changes.html#list-changes | 01:08 |
| *** yamahata has joined #openstack-infra | 01:09 | |
| *** melwitt has quit IRC | 01:11 | |
| *** wenlock has left #openstack-infra | 01:12 | |
| *** jerryz has joined #openstack-infra | 01:17 | |
| *** hdd has joined #openstack-infra | 01:22 | |
| *** packet has quit IRC | 01:24 | |
| *** yaguang has joined #openstack-infra | 01:24 | |
| fungi | i assume we will just restart zuul during saturday's gerrit maintenance window | 01:28 |
| clarkb | +1 | 01:28 |
| clarkb | jeblair: I think I have reconvinced myself that geard not directly closing a connection when it has gone bad can't be a good thing | 01:30 |
| clarkb | jeblair: mostly I don't trust garbage collection | 01:30 |
| *** dims has joined #openstack-infra | 01:31 | |
| *** sputnik13 has joined #openstack-infra | 01:31 | |
| *** Sincler has quit IRC | 01:33 | |
| jeblair | clarkb: oh hi | 01:34 |
| clarkb | jeblair: o/ | 01:34 |
| *** sputnik13 has quit IRC | 01:35 | |
| clarkb | jeblair: I have become wary of GC properly closing file like objects since the crm114 file descriptor leaking | 01:35 |
| jeblair | clarkb: what caused that? | 01:36 |
| clarkb | jeblair: I think gear may want an explicit close on an unregistered connection | 01:36 |
| clarkb | jeblair: I would have to dig through git but the pipes for stdin and stdout would not always be closed due to exceptions | 01:37 |
| clarkb | jeblair: and when that happend they could leak even though they should've been cleanly garbage collected | 01:37 |
| clarkb | jeblair: that may have been a specific problem with subprocess though | 01:37 |
| *** timrc is now known as timrc-afk | 01:37 | |
| jeblair | clarkb: i suspect that has something to do with the high-level subprocess interface as opposed to the lower level stuff we're doing here | 01:37 |
| clarkb | jeblair: that is very possible | 01:38 |
| clarkb | jeblair: is it possible we are not garbage collecting in geard? any other references to the connection? | 01:38 |
| jeblair | clarkb: that paradigm (drop and let gc handle it) is basically unchanged here and i don't think we are having problems | 01:38 |
| jeblair | clarkb: oh, are you seeing problems with leaking file descriptors? | 01:39 |
| clarkb | jeblair: not directly. But if we go back to the zuul mergers and their behavior under new geard | 01:39 |
| clarkb | jeblair: they would essentially stop getting data but kept the connection open (I checked both sides with netstat) | 01:39 |
| clarkb | jeblair: but as soon as we restarted the merger it would reconnect and start working again. Which seems like it could be a connection that geard things is dead but is not getting closed | 01:40 |
| jeblair | clarkb: yeah, but there are no connection related events in the logs (ie, no 'connection reset...' etc...) | 01:40 |
| jeblair | clarkb: however | 01:40 |
| openstackgerrit | Richard Jones proposed openstack/requirements: Add new angular dependencies to global-requirements.txt for Horizon https://review.openstack.org/139298 | 01:40 |
| clarkb | jeblair: right because the client may not know anything had gone wrong if the problems were all server side | 01:40 |
| jeblair | clarkb: on either side | 01:40 |
| jeblair | clarkb: i'm fairly certain from the logs that geard sent NOOP; worker received it, worker sent GRAB_JOB_UNIQ, and geard did not process any more input from that worker | 01:41 |
| jeblair | clarkb: so it's looking more like a read event was not delivered | 01:41 |
| clarkb | jeblair: huh | 01:41 |
| jeblair | clarkb: during that poll loop, a lot of other things happened, like connections being registered and unregistered | 01:42 |
| openstackgerrit | Richard Jones proposed openstack/requirements: Add new angular deps to global-requirements.txt for Horizon https://review.openstack.org/139298 | 01:42 |
| jeblair | clarkb: so i'm wondering if that had something to do with it | 01:42 |
| clarkb | jeblair: gotcha | 01:42 |
| jeblair | clarkb: aiui, the registering functions are not supposed to have that kind of impact, but i'm going to try some experiments with that | 01:42 |
| clarkb | experiments++ | 01:43 |
| jeblair | clarkb: i _think_ i may have gotten some kind of replication going on by throwing huge amounts of traffic at it while having a couple of hundred clients connect and disconnect at the same time; i'm not comfortable enough with the process to say for sure yet | 01:44 |
| jeblair | but now i need food and a break; will pick this up tomorrow | 01:45 |
| clarkb | ya I need to drop off too | 01:45 |
| clarkb | ping if I can help | 01:45 |
| jeblair | thx, enjoy | 01:46 |
| *** Guest83276 has quit IRC | 01:46 | |
| *** sarob_ has quit IRC | 01:46 | |
| *** salv-orlando has quit IRC | 01:47 | |
| *** salv-orlando has joined #openstack-infra | 01:48 | |
| *** salv-orlando has quit IRC | 01:49 | |
| *** nosnos has joined #openstack-infra | 01:52 | |
| heyongli | jogo, ping | 01:56 |
| *** esker has joined #openstack-infra | 02:02 | |
| fungi | for science! | 02:05 |
| *** bnemec has quit IRC | 02:06 | |
| heyongli | jogo, beside the fake-libvirt driver, does this big impact to third-party CI? | 02:07 |
| *** dannywilson has quit IRC | 02:07 | |
| openstackgerrit | Merged openstack-infra/reviewday: Add os-net-config. https://review.openstack.org/137168 | 02:12 |
| *** ChuckC_ has quit IRC | 02:12 | |
| *** ChuckC_ has joined #openstack-infra | 02:12 | |
| *** alexpilotti has joined #openstack-infra | 02:15 | |
| *** ChuckC_ has quit IRC | 02:17 | |
| *** Masahiro has quit IRC | 02:22 | |
| *** Masahiro has joined #openstack-infra | 02:24 | |
| *** hdd has quit IRC | 02:32 | |
| *** sarob has joined #openstack-infra | 02:35 | |
| *** yamahata has quit IRC | 02:35 | |
| openstackgerrit | Merged openstack-infra/infra-specs: Use Change-Id instead of URL for dependent patches https://review.openstack.org/137135 | 02:37 |
| *** sarob has quit IRC | 02:37 | |
| *** yamamoto_ has joined #openstack-infra | 02:38 | |
| openstackgerrit | Merged openstack-infra/infra-specs: Make metadata.json all lowercase https://review.openstack.org/136009 | 02:38 |
| *** zz_dimtruck is now known as dimtruck | 02:39 | |
| *** ryanpetrello has quit IRC | 02:40 | |
| *** baoli has joined #openstack-infra | 02:41 | |
| *** ryanpetrello has joined #openstack-infra | 02:43 | |
| *** otter768 has joined #openstack-infra | 02:43 | |
| *** asettle is now known as asettle-walks | 02:44 | |
| *** esker has quit IRC | 02:46 | |
| *** nosnos has quit IRC | 02:48 | |
| *** otter768 has quit IRC | 02:48 | |
| *** ChuckC_ has joined #openstack-infra | 02:49 | |
| *** r-daneel has quit IRC | 02:50 | |
| *** shakamunyi has joined #openstack-infra | 02:50 | |
| *** salv-orlando has joined #openstack-infra | 02:50 | |
| *** shakamunyi has quit IRC | 02:50 | |
| *** shashankhegde has quit IRC | 02:51 | |
| *** Philip__ has quit IRC | 02:53 | |
| *** harlowja_ is now known as harlowja_away | 02:54 | |
| *** salv-orlando has quit IRC | 02:55 | |
| *** fandi has joined #openstack-infra | 02:56 | |
| *** Ark has joined #openstack-infra | 02:57 | |
| *** Ark is now known as Guest87450 | 02:57 | |
| *** shakamunyi has joined #openstack-infra | 02:59 | |
| *** achanda has joined #openstack-infra | 03:01 | |
| *** Guest87450 has quit IRC | 03:02 | |
| *** sarob has joined #openstack-infra | 03:02 | |
| *** sarob has quit IRC | 03:02 | |
| *** wuhg has joined #openstack-infra | 03:06 | |
| *** sarob has joined #openstack-infra | 03:06 | |
| *** emagana has joined #openstack-infra | 03:11 | |
| *** achanda has quit IRC | 03:11 | |
| *** Ryan_Lane has quit IRC | 03:12 | |
| *** koolhead17 has joined #openstack-infra | 03:12 | |
| *** spzala has quit IRC | 03:14 | |
| *** asettle-walks has quit IRC | 03:16 | |
| *** talluri has joined #openstack-infra | 03:20 | |
| *** ivar-laz_ has joined #openstack-infra | 03:22 | |
| *** asettle has joined #openstack-infra | 03:24 | |
| *** patrickeast has quit IRC | 03:24 | |
| *** gyee has quit IRC | 03:25 | |
| *** ivar-lazzaro has quit IRC | 03:25 | |
| *** ivar-laz_ has quit IRC | 03:27 | |
| *** talluri has quit IRC | 03:27 | |
| *** dims has quit IRC | 03:28 | |
| fungi | zuul is going to hate me. i'm about to dump 207 changes into gerrit | 03:31 |
| fungi | no, wait, only 206 ;) | 03:31 |
| clarkb | uh | 03:33 |
| clarkb | in which repo? | 03:33 |
| jhesketh | fungi: that's impressive, what are you doing? | 03:34 |
| *** Masahiro has quit IRC | 03:38 | |
| fungi | clarkb: one per repo for >200 repos | 03:38 |
| fungi | replacing wiki links with links to infra manual sections | 03:39 |
| *** rkukura_ has joined #openstack-infra | 03:40 | |
| anteaya | ha ha ha | 03:41 |
| *** rkukura has quit IRC | 03:41 | |
| *** rkukura_ is now known as rkukura | 03:41 | |
| anteaya | all hail fungi our new default ptl | 03:42 |
| *** stevemar has joined #openstack-infra | 03:42 | |
| *** Masahiro has joined #openstack-infra | 03:44 | |
| greghaynes | Someone is going to get a lot of election emails when that time comes ;) | 03:44 |
| *** talluri has joined #openstack-infra | 03:45 | |
| fungi | i usually have a change in at least one project per program every cycle or so | 03:47 |
| fungi | it's rare there's an election i don't vote in | 03:47 |
| anteaya | doing your civic duty | 03:48 |
| *** Masahiro has quit IRC | 03:49 | |
| sweston | asselin: apologies, just got your message. I will have to review it tomorrow. | 03:50 |
| *** talluri has quit IRC | 03:51 | |
| *** salv-orlando has joined #openstack-infra | 03:51 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/infra-specs: Workflow documentation is now in infra-manual https://review.openstack.org/139423 | 03:54 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/jeepyb: Workflow documentation is now in infra-manual https://review.openstack.org/139424 | 03:54 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/jenkins-job-builder: Workflow documentation is now in infra-manual https://review.openstack.org/139425 | 03:54 |
| stevemar | fungi, you are clogging up the gate! | 03:54 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/nose-html-output: Workflow documentation is now in infra-manual https://review.openstack.org/139426 | 03:54 |
| stevemar | fungi, i hope you hate that automated | 03:54 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/os-loganalyze: Workflow documentation is now in infra-manual https://review.openstack.org/139427 | 03:54 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Workflow documentation is now in infra-manual https://review.openstack.org/139428 | 03:54 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/pypi-mirror: Workflow documentation is now in infra-manual https://review.openstack.org/139429 | 03:54 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/reviewday: Workflow documentation is now in infra-manual https://review.openstack.org/139430 | 03:54 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/reviewstats: Workflow documentation is now in infra-manual https://review.openstack.org/139431 | 03:54 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/storyboard: Workflow documentation is now in infra-manual https://review.openstack.org/139432 | 03:54 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/storyboard-webclient: Workflow documentation is now in infra-manual https://review.openstack.org/139433 | 03:54 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Workflow documentation is now in infra-manual https://review.openstack.org/139434 | 03:54 |
| jhesketh | it begins... | 03:55 |
| *** salv-orlando has quit IRC | 03:56 | |
| fungi | stevemar: semi-automated | 03:56 |
| anteaya | look at the graph climb | 03:56 |
| jhesketh | we now have a heap of trivial review to chew through too | 03:57 |
| *** Daviey has quit IRC | 03:57 | |
| *** Daviey has joined #openstack-infra | 03:58 | |
| openstackgerrit | Jeremy Stanley proposed stackforge/python-jenkins: Workflow documentation is now in infra-manual https://review.openstack.org/139493 | 03:58 |
| *** pcrews has quit IRC | 03:58 | |
| *** Masahiro has joined #openstack-infra | 03:59 | |
| anteaya | enough fun for everybody | 03:59 |
| *** alexpilotti has quit IRC | 04:00 | |
| openstackgerrit | Merged openstack-infra/pypi-mirror: Replace md5 module with hashlib module https://review.openstack.org/108671 | 04:02 |
| openstackgerrit | Merged openstack-infra/pypi-mirror: Bump hacking to 0.9.x series https://review.openstack.org/108673 | 04:02 |
| *** koolhead17 has quit IRC | 04:05 | |
| *** shashankhegde has joined #openstack-infra | 04:07 | |
| *** asettle has quit IRC | 04:07 | |
| *** pcm_ has quit IRC | 04:07 | |
| fungi | at least i waited until zuul was basically idle ;) | 04:14 |
| *** baoli has quit IRC | 04:14 | |
| *** rajesht has joined #openstack-infra | 04:14 | |
| *** baoli has joined #openstack-infra | 04:14 | |
| *** weshay has quit IRC | 04:14 | |
| *** david-ly_ has joined #openstack-infra | 04:15 | |
| *** r-daneel has joined #openstack-infra | 04:15 | |
| fungi | that was the result of running about 50 different regular expressions over all the projects in our gerrit to update workflow urls (there were so many wiki url formats and variations over time to account for) | 04:15 |
| fungi | also included wording cleanup when link text mentioned it being a wiki article | 04:16 |
| fungi | and corrected some old github urls to git.openstack.org anywhere gratuitous | 04:16 |
| anteaya | holy crow | 04:17 |
| anteaya | much to review | 04:17 |
| anteaya | and nice work fungi | 04:17 |
| *** david-lyle_afk has quit IRC | 04:17 | |
| fungi | well, for sanity's sake i did keep it to one change per project | 04:17 |
| anteaya | how kind of you | 04:18 |
| anteaya | :D | 04:18 |
| anteaya | can any claim sanity still? | 04:18 |
| fungi | and fewer than 50% of the projects needed changes as far as i could find | 04:18 |
| fungi | which is why there weren't 400+ changes | 04:18 |
| mattoliverau | fungi: busy man! There are slight typos at least in the swift docs you link to a section of the infra manual when I suspect you meant to link directly to the top of the page. and there is an extra part of a sentence that now isn't required. E.g: https://review.openstack.org/#/c/139393/ do you want me to submit a patch set over them and baby sit them for you or is this a bigger problem in other changes too? | 04:18 |
| fungi | mattoliverau: feel free to leave inline comments or update ones you find. i spot checked a significant percentage but there are likely more than a few errors | 04:19 |
| *** asettle has joined #openstack-infra | 04:20 | |
| anteaya | and thank goodness there aren't 400+ changes | 04:20 |
| fungi | i tended to link to different subsections of the manual depending on what wiki pages and subsections were in the original urls | 04:21 |
| anteaya | I'm interested in your 50 regex's | 04:21 |
| fungi | i can paste the list of url formats i found, though a lot of the other expressions are just trial-and-error iteration scattered through my shell history | 04:22 |
| anteaya | it would be interesting to me | 04:23 |
| anteaya | at the very least to be able to say "oh look at that" | 04:23 |
| anteaya | put don't put too much effort into it | 04:23 |
| anteaya | it is after all after 11 | 04:23 |
| fungi | http://paste.openstack.org/show/145114 | 04:25 |
| fungi | that was the cleaned up list of original urls i stream edited | 04:26 |
| fungi | those were all found embedded in the contents of one or more git repositories | 04:26 |
| fungi | the rest of the stream edits i applied were matching on various phrases found on the same vicinity as those urls | 04:27 |
| anteaya | what is the purpose of the /wiki/ part | 04:27 |
| anteaya | cool | 04:27 |
| anteaya | because tehre is wiki.o.o/wiki/foo | 04:28 |
| anteaya | and just wiki.o.o/foo | 04:28 |
| fungi | our current wiki redirects requests to /wiki/whatever so that static content can be kept outside of that tree and then everything in /wiki is mapped straight to the application | 04:28 |
| anteaya | interesting | 04:29 |
| *** dims has joined #openstack-infra | 04:29 | |
| anteaya | the links don't need it though | 04:29 |
| anteaya | but if you do copy paste you get /wiki/ in there | 04:29 |
| *** dannywilson has joined #openstack-infra | 04:29 | |
| fungi | yeah, my point is that when hunting for these in projects, conventions varied at different points in time, between different projects, and were cargo-culted from one to another | 04:30 |
| fungi | through page renames, wiki platform migrations, subsection title edits, and so on | 04:31 |
| *** yaguang has quit IRC | 04:32 | |
| *** yaguang has joined #openstack-infra | 04:32 | |
| *** doug-fish has left #openstack-infra | 04:32 | |
| *** HeOS has quit IRC | 04:33 | |
| *** dims has quit IRC | 04:34 | |
| *** sarob has quit IRC | 04:35 | |
| anteaya | yep | 04:35 |
| fungi | mattoliverau: i see the error you mention. that looks like it appears in 6 projects. i'll whip up corrected patchsets for those. thanks! | 04:36 |
| mattoliverau | fungi: I just patched the swift ones :) | 04:36 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Remove uneeded version string from setup.cfg https://review.openstack.org/139516 | 04:40 |
| *** yaguang_ has joined #openstack-infra | 04:41 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Remove unneeded version string from setup.cfg https://review.openstack.org/139516 | 04:41 |
| fungi | mattoliverau: thanks, i'll get the other 4 then | 04:41 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/jeepyb: Workflow documentation is now in infra-manual https://review.openstack.org/139424 | 04:41 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/pypi-mirror: Workflow documentation is now in infra-manual https://review.openstack.org/139429 | 04:41 |
| fungi | those ^ were two of them (cinder and manila were the others) | 04:42 |
| fungi | and with that, i'm going to knock off and watch some cartoons. later all | 04:43 |
| mattoliverau | fungi: 6 out of a zillion, nice work! | 04:43 |
| fungi | mattoliverau: well, 6 containing an error you spotted in two changes right off the bat. there are likely plenty more lurking | 04:44 |
| *** otter768 has joined #openstack-infra | 04:44 | |
| fungi | for every bug you see, there are a thousand more crawling inside the walls | 04:44 |
| *** yaguang has quit IRC | 04:44 | |
| clarkb | just a thousand more? | 04:46 |
| openstackgerrit | Merged openstack-infra/subunit2sql: Remove unneeded version string from setup.cfg https://review.openstack.org/139516 | 04:47 |
| *** otter768 has quit IRC | 04:49 | |
| *** yaguang_ has quit IRC | 04:49 | |
| *** dannywilson has quit IRC | 04:50 | |
| *** r-daneel has quit IRC | 04:53 | |
| *** harlowja_at_home has joined #openstack-infra | 04:57 | |
| *** talluri has joined #openstack-infra | 05:01 | |
| *** emagana has quit IRC | 05:03 | |
| *** yaguang_ has joined #openstack-infra | 05:05 | |
| *** talluri has quit IRC | 05:06 | |
| *** chandankumar has joined #openstack-infra | 05:08 | |
| *** nikhil_k|afk is now known as nikhil_k | 05:08 | |
| *** bhunter71 has quit IRC | 05:08 | |
| *** chandankumar has quit IRC | 05:09 | |
| *** heyongli has quit IRC | 05:10 | |
| *** heyongli has joined #openstack-infra | 05:10 | |
| *** dannywilson has joined #openstack-infra | 05:11 | |
| *** Masahiro has quit IRC | 05:12 | |
| *** baoli has quit IRC | 05:15 | |
| *** shashankhegde has quit IRC | 05:15 | |
| *** koolhead17 has joined #openstack-infra | 05:16 | |
| *** koolhead_ has joined #openstack-infra | 05:22 | |
| *** chandankumar has joined #openstack-infra | 05:24 | |
| jamielennox | is there an error for tests failing with: [ERROR] /opt/stack/new/devstack/functions-common:549 Cloning not allowed in this configuration | 05:25 |
| *** koolhead17 has quit IRC | 05:25 | |
| jamielennox | everything in oslo.utils is failing | 05:27 |
| *** Masahiro has joined #openstack-infra | 05:27 | |
| *** talluri has joined #openstack-infra | 05:28 | |
| *** koolhead_ has quit IRC | 05:29 | |
| *** yaguang_ has quit IRC | 05:29 | |
| *** yaguang has joined #openstack-infra | 05:30 | |
| *** koolhead17 has joined #openstack-infra | 05:30 | |
| *** avozza is now known as zz_avozza | 05:30 | |
| *** koolhead17 has joined #openstack-infra | 05:30 | |
| *** AlexF has joined #openstack-infra | 05:32 | |
| *** koolhead17 has quit IRC | 05:33 | |
| *** dimtruck is now known as zz_dimtruck | 05:38 | |
| *** yamamot__ has joined #openstack-infra | 05:40 | |
| *** salv-orlando has joined #openstack-infra | 05:40 | |
| *** yamamo___ has joined #openstack-infra | 05:43 | |
| *** yamamoto_ has quit IRC | 05:43 | |
| *** salv-orlando has quit IRC | 05:45 | |
| *** emagana has joined #openstack-infra | 05:45 | |
| *** yamamot__ has quit IRC | 05:46 | |
| *** yaguang has quit IRC | 05:50 | |
| *** Longgeek has joined #openstack-infra | 05:52 | |
| *** AlexF has quit IRC | 05:55 | |
| *** mika has quit IRC | 05:58 | |
| *** bnemec has joined #openstack-infra | 06:01 | |
| *** emagana has quit IRC | 06:06 | |
| *** emagana has joined #openstack-infra | 06:07 | |
| *** shakamunyi has quit IRC | 06:07 | |
| jhesketh | fungi: what we also need to do is add redirects from all the wiki pages to the new docs pages | 06:08 |
| *** rushiagr is now known as rushiagr_away | 06:10 | |
| *** emagana has quit IRC | 06:11 | |
| *** mrmartin has joined #openstack-infra | 06:12 | |
| *** ildikov has quit IRC | 06:15 | |
| *** harlowja_at_home has quit IRC | 06:18 | |
| *** zz_avozza is now known as avozza | 06:21 | |
| *** mfisch has quit IRC | 06:23 | |
| *** mfisch has joined #openstack-infra | 06:27 | |
| *** mfisch is now known as Guest45087 | 06:27 | |
| *** koolhead17 has joined #openstack-infra | 06:28 | |
| *** Longgeek has quit IRC | 06:30 | |
| *** koolhead17 has quit IRC | 06:30 | |
| *** sarob has joined #openstack-infra | 06:31 | |
| *** avozza is now known as zz_avozza | 06:31 | |
| *** koolhead17 has joined #openstack-infra | 06:31 | |
| *** Longgeek has joined #openstack-infra | 06:32 | |
| *** zz_avozza is now known as avozza | 06:33 | |
| *** sputnik13 has joined #openstack-infra | 06:33 | |
| *** Masahiro has quit IRC | 06:35 | |
| *** koolhead_ has joined #openstack-infra | 06:35 | |
| *** koolhead17 has quit IRC | 06:35 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Fix puppet gate check jobs naming https://review.openstack.org/139539 | 06:35 |
| openstackgerrit | Merged openstack-infra/project-config: Workflow documentation is now in infra-manual https://review.openstack.org/139428 | 06:36 |
| *** koolhead_ has quit IRC | 06:36 | |
| *** Masahiro has joined #openstack-infra | 06:39 | |
| *** reed has quit IRC | 06:39 | |
| openstackgerrit | Merged openstack-infra/project-config: Create project for puppet-zanata module https://review.openstack.org/137448 | 06:39 |
| *** asettle has quit IRC | 06:39 | |
| *** dannywilson has quit IRC | 06:39 | |
| *** dannywilson has joined #openstack-infra | 06:45 | |
| *** otter768 has joined #openstack-infra | 06:45 | |
| *** dannywilson has quit IRC | 06:46 | |
| *** sarob has quit IRC | 06:46 | |
| *** rushiagr_away is now known as rushiagr | 06:49 | |
| *** openstackgerrit has quit IRC | 06:49 | |
| *** openstackgerrit has joined #openstack-infra | 06:49 | |
| *** HeOS has joined #openstack-infra | 06:49 | |
| *** otter768 has quit IRC | 06:50 | |
| *** groknix has joined #openstack-infra | 06:52 | |
| *** amotoki is now known as amotoki__away | 06:55 | |
| *** enikanorov_ has joined #openstack-infra | 07:04 | |
| openstackgerrit | Sabari proposed openstack/requirements: Update urllib>=1.8.3 https://review.openstack.org/139545 | 07:06 |
| *** enikanorov__ has quit IRC | 07:07 | |
| *** yfried_ has quit IRC | 07:10 | |
| *** avozza is now known as zz_avozza | 07:12 | |
| *** shashankhegde has joined #openstack-infra | 07:13 | |
| *** stevemar has quit IRC | 07:13 | |
| *** zul has quit IRC | 07:14 | |
| *** koolhead17 has joined #openstack-infra | 07:19 | |
| *** koolhead17 has joined #openstack-infra | 07:19 | |
| *** mrunge has joined #openstack-infra | 07:25 | |
| *** salv-orlando has joined #openstack-infra | 07:29 | |
| *** sputnik13 has quit IRC | 07:30 | |
| *** shashankhegde has quit IRC | 07:31 | |
| *** salv-orlando has quit IRC | 07:34 | |
| *** tnovacik has joined #openstack-infra | 07:44 | |
| *** koolhead17 has quit IRC | 07:45 | |
| *** koolhead17 has joined #openstack-infra | 07:45 | |
| *** HeOS has quit IRC | 07:50 | |
| *** koolhead17 has quit IRC | 07:50 | |
| *** doude has quit IRC | 07:50 | |
| *** doude_ has joined #openstack-infra | 07:50 | |
| *** armax has quit IRC | 07:55 | |
| *** tnovacik has quit IRC | 07:58 | |
| *** zz_avozza is now known as avozza | 07:59 | |
| *** dtantsur|afk is now known as dtantsur | 07:59 | |
| *** ala_ has joined #openstack-infra | 08:02 | |
| heyongli | anteaya, if we could not upstream our CI test cases, what the process to use the private test cases to setting up the CI? | 08:04 |
| heyongli | anteaya, of course , we happy to put all private test cases to git hub or somewhere everyone can access that. | 08:05 |
| *** zul has joined #openstack-infra | 08:07 | |
| *** teran_ has quit IRC | 08:08 | |
| *** jerryz has quit IRC | 08:09 | |
| *** talluri has quit IRC | 08:15 | |
| *** teran has joined #openstack-infra | 08:19 | |
| *** teran has quit IRC | 08:24 | |
| *** ashaeron has joined #openstack-infra | 08:27 | |
| *** berendt has joined #openstack-infra | 08:27 | |
| *** arxcruz has joined #openstack-infra | 08:31 | |
| *** jcoufal has joined #openstack-infra | 08:31 | |
| *** mrmartin has quit IRC | 08:32 | |
| *** Masahiro has quit IRC | 08:36 | |
| *** _nadya_ has joined #openstack-infra | 08:37 | |
| *** markus_z has joined #openstack-infra | 08:40 | |
| *** yamamo___ has quit IRC | 08:41 | |
| *** oomichi has quit IRC | 08:41 | |
| *** MaxV has joined #openstack-infra | 08:41 | |
| *** luqas has joined #openstack-infra | 08:42 | |
| *** shashankhegde has joined #openstack-infra | 08:42 | |
| *** mpaolino has joined #openstack-infra | 08:46 | |
| *** otter768 has joined #openstack-infra | 08:46 | |
| *** Masahiro has joined #openstack-infra | 08:47 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Fix puppet gate check jobs naming https://review.openstack.org/139539 | 08:47 |
| *** dalgaaf has joined #openstack-infra | 08:48 | |
| *** vigneshvar has joined #openstack-infra | 08:48 | |
| *** dtantsur is now known as dtantsur|brb | 08:49 | |
| *** otter768 has quit IRC | 08:50 | |
| *** shashankhegde has quit IRC | 08:51 | |
| *** jpich has joined #openstack-infra | 08:55 | |
| *** jedimike has joined #openstack-infra | 08:56 | |
| *** derekh has joined #openstack-infra | 08:58 | |
| openstackgerrit | Merged openstack-infra/storyboard: Workflow documentation is now in infra-manual https://review.openstack.org/139432 | 08:58 |
| *** AlexF has joined #openstack-infra | 08:59 | |
| *** _nadya_ has quit IRC | 09:01 | |
| *** salv-orlando has joined #openstack-infra | 09:03 | |
| *** salv-orlando has quit IRC | 09:04 | |
| *** salv-orlando has joined #openstack-infra | 09:05 | |
| *** yamamoto_ has joined #openstack-infra | 09:09 | |
| *** Hal_ has joined #openstack-infra | 09:10 | |
| *** Guest45087 has quit IRC | 09:11 | |
| *** skolekonov has joined #openstack-infra | 09:11 | |
| *** koolhead17 has joined #openstack-infra | 09:13 | |
| *** jistr has joined #openstack-infra | 09:14 | |
| *** mfisch has joined #openstack-infra | 09:15 | |
| *** talluri has joined #openstack-infra | 09:15 | |
| *** mfisch is now known as Guest3214 | 09:15 | |
| *** salv-orl_ has joined #openstack-infra | 09:16 | |
| openstackgerrit | Antoine Musso proposed openstack-infra/gerritlib: Doc generation support https://review.openstack.org/94861 | 09:16 |
| openstackgerrit | Merged openstack-dev/hacking: Workflow documentation is now in infra-manual https://review.openstack.org/139409 | 09:20 |
| *** salv-orlando has quit IRC | 09:20 | |
| *** talluri has quit IRC | 09:21 | |
| *** e0ne has joined #openstack-infra | 09:22 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/devstack-gate: Add is_debian and uses_debs functions https://review.openstack.org/130768 | 09:22 |
| *** luqas has left #openstack-infra | 09:22 | |
| *** teran has joined #openstack-infra | 09:23 | |
| *** luqas has joined #openstack-infra | 09:23 | |
| *** AlexF has quit IRC | 09:23 | |
| *** yamamoto_ has quit IRC | 09:23 | |
| *** jp_at_hp has joined #openstack-infra | 09:24 | |
| openstackgerrit | Christian Berendt proposed openstack-infra/jeepyb: Improve the generated RSS feed of openstackwatch https://review.openstack.org/127747 | 09:29 |
| *** andreykurilin_ has joined #openstack-infra | 09:32 | |
| *** yamamoto has joined #openstack-infra | 09:35 | |
| *** zxiiro has quit IRC | 09:36 | |
| *** jklare has quit IRC | 09:37 | |
| *** luqas has quit IRC | 09:37 | |
| *** luqas has joined #openstack-infra | 09:37 | |
| *** vigneshvar has quit IRC | 09:38 | |
| *** luqas has quit IRC | 09:39 | |
| *** luqas has joined #openstack-infra | 09:40 | |
| *** jlibosva has joined #openstack-infra | 09:40 | |
| *** ihrachyshka has joined #openstack-infra | 09:43 | |
| *** luqas has quit IRC | 09:46 | |
| *** sarob has joined #openstack-infra | 09:47 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/infra-specs: Zuul could use different yaml files https://review.openstack.org/133249 | 09:47 |
| *** e0ne has quit IRC | 09:47 | |
| *** luqas has joined #openstack-infra | 09:49 | |
| *** yamamoto has quit IRC | 09:50 | |
| *** luqas has quit IRC | 09:50 | |
| *** HeOS has joined #openstack-infra | 09:50 | |
| *** mpaolino has quit IRC | 09:50 | |
| *** luqas has joined #openstack-infra | 09:51 | |
| *** sarob has quit IRC | 09:51 | |
| *** vigneshvar has joined #openstack-infra | 09:51 | |
| *** luqas has quit IRC | 09:53 | |
| *** luqas has joined #openstack-infra | 09:53 | |
| *** derekh has quit IRC | 09:53 | |
| *** andreykurilin_ has quit IRC | 09:54 | |
| *** andreykurilin_ has joined #openstack-infra | 09:54 | |
| *** luqas has quit IRC | 09:55 | |
| *** luqas has joined #openstack-infra | 09:55 | |
| *** jklare has joined #openstack-infra | 09:56 | |
| *** luqas__ has joined #openstack-infra | 09:58 | |
| *** jklare has quit IRC | 09:58 | |
| *** luqas has quit IRC | 09:58 | |
| *** mrmartin has joined #openstack-infra | 09:59 | |
| *** luqas__ has quit IRC | 10:00 | |
| *** luqas__ has joined #openstack-infra | 10:00 | |
| *** chandankumar has quit IRC | 10:02 | |
| *** luqas__ has quit IRC | 10:03 | |
| *** luqas__ has joined #openstack-infra | 10:03 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add non-voting docs job for git-review https://review.openstack.org/139581 | 10:04 |
| *** mika has joined #openstack-infra | 10:04 | |
| *** jerryz has joined #openstack-infra | 10:04 | |
| *** luqas__ has quit IRC | 10:04 | |
| *** luqas__ has joined #openstack-infra | 10:05 | |
| *** jklare has joined #openstack-infra | 10:05 | |
| *** MaxV has quit IRC | 10:06 | |
| *** luqas__ has quit IRC | 10:07 | |
| *** luqas__ has joined #openstack-infra | 10:08 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Use Depends-On: Change-ID https://review.openstack.org/139582 | 10:08 |
| *** chandankumar has joined #openstack-infra | 10:09 | |
| *** jklare has quit IRC | 10:09 | |
| *** luqas__ has quit IRC | 10:09 | |
| *** luqas has joined #openstack-infra | 10:10 | |
| *** jklare has joined #openstack-infra | 10:10 | |
| *** luqas__ has joined #openstack-infra | 10:12 | |
| *** luqas has quit IRC | 10:12 | |
| *** MaxV has joined #openstack-infra | 10:13 | |
| *** luqas__ has quit IRC | 10:13 | |
| *** luqas___ has joined #openstack-infra | 10:13 | |
| *** luqas___ has quit IRC | 10:15 | |
| *** luqas__ has joined #openstack-infra | 10:15 | |
| *** e0ne has joined #openstack-infra | 10:16 | |
| *** luqas__ has quit IRC | 10:17 | |
| *** luqas__ has joined #openstack-infra | 10:17 | |
| *** jklare has quit IRC | 10:17 | |
| *** luqas__ has quit IRC | 10:19 | |
| *** luqas has joined #openstack-infra | 10:20 | |
| *** andreykurilin_ has quit IRC | 10:20 | |
| *** andreykurilin_ has joined #openstack-infra | 10:21 | |
| *** jklare has joined #openstack-infra | 10:21 | |
| *** amotoki__away is now known as amotoki | 10:22 | |
| *** luqas has quit IRC | 10:23 | |
| *** luqas has joined #openstack-infra | 10:23 | |
| *** SumitNaiksatam has quit IRC | 10:25 | |
| *** pelix has joined #openstack-infra | 10:26 | |
| *** luqas has quit IRC | 10:26 | |
| *** luqas has joined #openstack-infra | 10:26 | |
| *** luqas has quit IRC | 10:28 | |
| openstackgerrit | Merged openstack-dev/pbr: Workflow documentation is now in infra-manual https://review.openstack.org/139412 | 10:28 |
| *** cdent has joined #openstack-infra | 10:29 | |
| *** luqas has joined #openstack-infra | 10:29 | |
| *** cnesa has quit IRC | 10:30 | |
| *** vigneshvar has quit IRC | 10:31 | |
| *** luqas has quit IRC | 10:31 | |
| *** luqas has joined #openstack-infra | 10:31 | |
| *** ldnunes has joined #openstack-infra | 10:32 | |
| *** Masahiro has quit IRC | 10:33 | |
| *** SumitNaiksatam has joined #openstack-infra | 10:34 | |
| *** luqas__ has joined #openstack-infra | 10:35 | |
| *** jklare has quit IRC | 10:35 | |
| *** luqas has quit IRC | 10:35 | |
| *** luqas__ has quit IRC | 10:36 | |
| *** luqas__ has joined #openstack-infra | 10:37 | |
| *** jklare has joined #openstack-infra | 10:41 | |
| *** vigneshvar has joined #openstack-infra | 10:44 | |
| *** mika has quit IRC | 10:45 | |
| *** mika has joined #openstack-infra | 10:45 | |
| *** jklare has quit IRC | 10:46 | |
| *** otter768 has joined #openstack-infra | 10:47 | |
| *** talluri has joined #openstack-infra | 10:48 | |
| *** hashar has joined #openstack-infra | 10:50 | |
| *** jklare has joined #openstack-infra | 10:50 | |
| *** yamamoto has joined #openstack-infra | 10:50 | |
| *** otter768 has quit IRC | 10:51 | |
| *** mpaolino has joined #openstack-infra | 10:53 | |
| *** talluri has quit IRC | 10:53 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/infra-specs: Add nodepool disk image builder testing spec. https://review.openstack.org/139598 | 10:54 |
| *** yamamoto has quit IRC | 10:56 | |
| *** jp_at_hp has quit IRC | 10:57 | |
| *** jp_at_hp has joined #openstack-infra | 10:58 | |
| *** cnesa has joined #openstack-infra | 11:01 | |
| *** pc_m has joined #openstack-infra | 11:01 | |
| *** Hal_ has quit IRC | 11:07 | |
| *** derekh has joined #openstack-infra | 11:09 | |
| *** hashar has quit IRC | 11:11 | |
| *** salv-orlando has joined #openstack-infra | 11:13 | |
| *** salv-orl_ has quit IRC | 11:17 | |
| *** jp_at_hp has quit IRC | 11:24 | |
| *** rlandy has joined #openstack-infra | 11:27 | |
| *** rdopiera has joined #openstack-infra | 11:28 | |
| *** akrivoka has joined #openstack-infra | 11:28 | |
| *** ashaeron has quit IRC | 11:29 | |
| *** ashaeron has joined #openstack-infra | 11:29 | |
| *** talluri has joined #openstack-infra | 11:29 | |
| rdopiera | I have a question about the master tarballs on http://tarballs.openstack.org/ -- how often are they regenerated, and what do we need to do to have one generated for tuskar-ui? | 11:29 |
| *** vigneshvar has quit IRC | 11:32 | |
| *** derekh has quit IRC | 11:34 | |
| *** Masahiro has joined #openstack-infra | 11:34 | |
| *** aysyd has joined #openstack-infra | 11:35 | |
| *** akrivoka has quit IRC | 11:37 | |
| *** Masahiro has quit IRC | 11:39 | |
| *** _nadya_ has joined #openstack-infra | 11:40 | |
| *** talluri has quit IRC | 11:40 | |
| *** ildikov has joined #openstack-infra | 11:41 | |
| *** akrivoka has joined #openstack-infra | 11:41 | |
| *** vigneshvar has joined #openstack-infra | 11:46 | |
| *** derekh has joined #openstack-infra | 11:47 | |
| *** luqas has joined #openstack-infra | 11:47 | |
| *** luqas__ has quit IRC | 11:47 | |
| *** luqas has quit IRC | 11:49 | |
| *** luqas has joined #openstack-infra | 11:49 | |
| *** isviridov_break is now known as isviridov | 11:50 | |
| *** luqas has quit IRC | 11:51 | |
| *** luqas has joined #openstack-infra | 11:52 | |
| *** luqas has quit IRC | 11:53 | |
| *** teran has quit IRC | 11:53 | |
| *** luqas has joined #openstack-infra | 11:54 | |
| *** teran has joined #openstack-infra | 11:54 | |
| *** amotoki is now known as amotoki__away | 11:54 | |
| *** luqas has quit IRC | 11:56 | |
| *** luqas__ has joined #openstack-infra | 11:56 | |
| *** teran has quit IRC | 11:58 | |
| *** luqas__ has quit IRC | 11:58 | |
| *** luqas has joined #openstack-infra | 11:59 | |
| *** derekh has quit IRC | 11:59 | |
| *** luqas has quit IRC | 12:01 | |
| *** luqas__ has joined #openstack-infra | 12:01 | |
| *** yfried_ has joined #openstack-infra | 12:01 | |
| *** jpich has quit IRC | 12:01 | |
| *** teran has joined #openstack-infra | 12:02 | |
| *** jpich has joined #openstack-infra | 12:02 | |
| *** talluri has joined #openstack-infra | 12:02 | |
| *** sandywalsh has quit IRC | 12:02 | |
| *** luqas___ has joined #openstack-infra | 12:03 | |
| *** luqas__ has quit IRC | 12:03 | |
| *** markus_z has quit IRC | 12:04 | |
| *** dims has joined #openstack-infra | 12:04 | |
| *** sandywalsh has joined #openstack-infra | 12:05 | |
| *** dtantsur|brb is now known as dtantsur | 12:06 | |
| *** luqas__ has joined #openstack-infra | 12:07 | |
| *** luqas___ has quit IRC | 12:07 | |
| *** luqas__ has quit IRC | 12:08 | |
| *** andreykurilin_ has quit IRC | 12:09 | |
| *** luqas has joined #openstack-infra | 12:09 | |
| *** luqas has quit IRC | 12:10 | |
| *** luqas has joined #openstack-infra | 12:11 | |
| *** luqas__ has joined #openstack-infra | 12:13 | |
| *** luqas has quit IRC | 12:13 | |
| sdague | heyongli: we need to separate the concepts of "in tempest" with upstream testing. | 12:13 |
| *** luqas__ has quit IRC | 12:15 | |
| *** luqas has joined #openstack-infra | 12:16 | |
| rdopiera | where should I go with questions about tarballs.openstack.org? | 12:17 |
| sdague | jamielennox: what's the test job? | 12:17 |
| *** dmsimard_away is now known as dmsimard | 12:18 | |
| *** luqas__ has joined #openstack-infra | 12:19 | |
| *** luqas has quit IRC | 12:20 | |
| *** luqas__ has quit IRC | 12:20 | |
| *** luqas__ has joined #openstack-infra | 12:20 | |
| *** mrmartin has quit IRC | 12:22 | |
| *** jp_at_hp has joined #openstack-infra | 12:22 | |
| openstackgerrit | Sergey Lukjanov proposed openstack-infra/project-config: Configurable sources for prepare_node.sh https://review.openstack.org/139611 | 12:22 |
| *** luqas__ has quit IRC | 12:22 | |
| *** luqas__ has joined #openstack-infra | 12:23 | |
| *** luqas__ has quit IRC | 12:24 | |
| *** luqas__ has joined #openstack-infra | 12:25 | |
| *** jcoufal has quit IRC | 12:25 | |
| *** luqas__ has quit IRC | 12:26 | |
| *** ildikov has quit IRC | 12:27 | |
| *** jcoufal has joined #openstack-infra | 12:27 | |
| *** luqas has joined #openstack-infra | 12:27 | |
| *** jcoufal has quit IRC | 12:28 | |
| rdopiera | is there noone to help a developer in distress? | 12:29 |
| *** jcoufal has joined #openstack-infra | 12:29 | |
| ekarlso- | rdopiera: lots of the folks are us based | 12:29 |
| *** luqas has quit IRC | 12:29 | |
| *** luqas has joined #openstack-infra | 12:30 | |
| *** mase_x200 has joined #openstack-infra | 12:31 | |
| *** luqas has quit IRC | 12:32 | |
| *** luqas has joined #openstack-infra | 12:33 | |
| *** teran has quit IRC | 12:34 | |
| *** luqas has quit IRC | 12:35 | |
| *** luqas has joined #openstack-infra | 12:35 | |
| sdague | rdopiera: yeh, ttx or jhesketh are the only currently awake folks that might know | 12:37 |
| sdague | most of the rest start coming on line in about 1.5 hrs | 12:37 |
| sdague | oh, or SergeyLukjanov maybe | 12:37 |
| *** Ark has joined #openstack-infra | 12:38 | |
| *** luqas__ has joined #openstack-infra | 12:38 | |
| SergeyLukjanov | I'm here | 12:38 |
| SergeyLukjanov | rdopiera, sdague, what's the question? | 12:38 |
| *** Ark is now known as Guest6728 | 12:38 | |
| *** luqas has quit IRC | 12:39 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/infra-specs: StoryBoard task branch support https://review.openstack.org/139613 | 12:39 |
| *** luqas___ has joined #openstack-infra | 12:41 | |
| *** luqas__ has quit IRC | 12:42 | |
| *** mbacchi has joined #openstack-infra | 12:43 | |
| *** _nadya_ has quit IRC | 12:45 | |
| rdopiera | SergeyLukjanov: I was wondering how to trigger building a new -master tarball for a project | 12:46 |
| *** markus_z has joined #openstack-infra | 12:46 | |
| rdopiera | SergeyLukjanov: because the one for tuskar-ui was quite ancient | 12:46 |
| *** markus_z has quit IRC | 12:46 | |
| *** luqas___ has quit IRC | 12:46 | |
| rdopiera | SergeyLukjanov: but it seems that it just got built | 12:46 |
| *** luqas has joined #openstack-infra | 12:47 | |
| *** otter768 has joined #openstack-infra | 12:48 | |
| *** mwagner_lap has quit IRC | 12:48 | |
| *** dprince has joined #openstack-infra | 12:48 | |
| *** luqas has quit IRC | 12:48 | |
| *** ZZelle has quit IRC | 12:48 | |
| *** weshay has joined #openstack-infra | 12:48 | |
| *** luqas has joined #openstack-infra | 12:49 | |
| *** luqas has quit IRC | 12:50 | |
| SergeyLukjanov | rdopiera, okay, I'll check | 12:50 |
| *** luqas has joined #openstack-infra | 12:51 | |
| *** markus_z has joined #openstack-infra | 12:51 | |
| *** Longgeek has quit IRC | 12:52 | |
| *** luqas has quit IRC | 12:52 | |
| *** otter768 has quit IRC | 12:53 | |
| *** luqas has joined #openstack-infra | 12:53 | |
| *** Guest6728 has quit IRC | 12:53 | |
| *** luqas has quit IRC | 12:54 | |
| *** mikedillion has joined #openstack-infra | 12:55 | |
| *** luqas has joined #openstack-infra | 12:55 | |
| *** ZZelle has joined #openstack-infra | 12:55 | |
| *** luqas has quit IRC | 12:56 | |
| *** luqas has joined #openstack-infra | 12:57 | |
| *** mfink has quit IRC | 12:58 | |
| *** luqas has quit IRC | 13:00 | |
| *** _nadya_ has joined #openstack-infra | 13:00 | |
| *** luqas has joined #openstack-infra | 13:00 | |
| *** luqas has quit IRC | 13:01 | |
| *** luqas has joined #openstack-infra | 13:02 | |
| *** fandi has quit IRC | 13:02 | |
| *** luqas has quit IRC | 13:04 | |
| *** luqas has joined #openstack-infra | 13:04 | |
| *** chandankumar has quit IRC | 13:05 | |
| *** luqas has quit IRC | 13:05 | |
| *** luqas has joined #openstack-infra | 13:06 | |
| *** luqas has quit IRC | 13:07 | |
| *** luqas has joined #openstack-infra | 13:08 | |
| fungi | rdopiera: are you saying the http://tarballs.openstack.org/tuskar-ui/tuskar-ui-master.tar.gz with today's timestamp has old contents? | 13:08 |
| *** Masahiro has joined #openstack-infra | 13:08 | |
| *** ZZelle has quit IRC | 13:09 | |
| *** luqas has quit IRC | 13:10 | |
| *** luqas__ has joined #openstack-infra | 13:10 | |
| *** hdd has joined #openstack-infra | 13:10 | |
| *** yamamoto has joined #openstack-infra | 13:10 | |
| *** luqas__ has quit IRC | 13:11 | |
| *** ZZelle has joined #openstack-infra | 13:11 | |
| *** mriedem has joined #openstack-infra | 13:12 | |
| *** luqas has joined #openstack-infra | 13:12 | |
| *** Masahiro has quit IRC | 13:13 | |
| *** luqas has quit IRC | 13:13 | |
| *** luqas has joined #openstack-infra | 13:14 | |
| *** luqas has quit IRC | 13:15 | |
| *** luqas has joined #openstack-infra | 13:16 | |
| *** Longgeek has joined #openstack-infra | 13:17 | |
| *** luqas has quit IRC | 13:18 | |
| *** luqas has joined #openstack-infra | 13:18 | |
| *** mikedillion has quit IRC | 13:19 | |
| *** luqas has quit IRC | 13:21 | |
| *** luqas__ has joined #openstack-infra | 13:21 | |
| *** baoli has joined #openstack-infra | 13:21 | |
| *** berendt has quit IRC | 13:21 | |
| *** baoli has quit IRC | 13:21 | |
| *** e0ne has quit IRC | 13:22 | |
| *** baoli has joined #openstack-infra | 13:22 | |
| *** luqas__ has quit IRC | 13:22 | |
| *** luqas__ has joined #openstack-infra | 13:22 | |
| *** andreaf has quit IRC | 13:23 | |
| *** koolhead17 has quit IRC | 13:26 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/storyboard-webclient: Retrieve task statuses from the backend https://review.openstack.org/138389 | 13:26 |
| *** mwagner_lap has joined #openstack-infra | 13:26 | |
| *** koolhead17 has joined #openstack-infra | 13:27 | |
| *** e0ne has joined #openstack-infra | 13:28 | |
| *** yfried_ has quit IRC | 13:28 | |
| *** dims has quit IRC | 13:29 | |
| *** dims has joined #openstack-infra | 13:29 | |
| *** koolhead17 has quit IRC | 13:31 | |
| *** pblaho has joined #openstack-infra | 13:32 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/infra-specs: StoryBoard task milestone support https://review.openstack.org/139626 | 13:33 |
| openstackgerrit | yolanda.robla proposed openstack-infra/storyboard-webclient: Read user preferences from backend https://review.openstack.org/137798 | 13:35 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/infra-specs: StoryBoard task branch support https://review.openstack.org/139613 | 13:37 |
| *** jgallard has joined #openstack-infra | 13:37 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/infra-specs: StoryBoard task milestone support https://review.openstack.org/139626 | 13:38 |
| *** mfink has joined #openstack-infra | 13:39 | |
| *** ZZelle has quit IRC | 13:39 | |
| *** talluri has quit IRC | 13:41 | |
| dhellmann | sdague, jamielennox : re oslo.utils: log - http://logs.openstack.org/62/139362/1/check/gate-tempest-dsvm-neutron-src-oslo.utils-icehouse/f93d146/logs/devstacklog.txt.gz and example failing patch - https://review.openstack.org/#/c/139362/ | 13:42 |
| *** skolekonov has quit IRC | 13:42 | |
| dhellmann | sdague: the same job for oslo.middleware is also failing | 13:42 |
| fungi | anybody else having trouble logging into storyboard? | 13:44 |
| dhellmann | sdague: and for oslo.serialization | 13:44 |
| sdague | dhellmann: so this is because oslo.utils doesn't exist in icehouse, right? | 13:45 |
| sdague | and something is trying to use it | 13:45 |
| dhellmann | is it? I don't know where these jobs came from. They didn't used to fail | 13:45 |
| dhellmann | the failure is in a clone operation in the oslo installation function in devstack | 13:46 |
| dhellmann | so maybe we have an icehouse version of devstack trying to install libraries that don't exist for icehouse? | 13:46 |
| *** ZZelle has joined #openstack-infra | 13:46 | |
| sdague | yeh, so this is a result of the stable-compat patch | 13:46 |
| sdague | we were only running this on master | 13:46 |
| dhellmann | right, so we just need to remove the new libs from the devstack branch | 13:47 |
| sdague | https://review.openstack.org/#/c/137451/ - so .... have the proper requirements uncaps happened for that to be safe? | 13:47 |
| sdague | dhellmann: no, they aren't in the devstack branch | 13:48 |
| sdague | that's the point | 13:48 |
| sdague | you've specifically told the job test with this library | 13:48 |
| sdague | from git | 13:48 |
| sdague | but it doesn't exist in the icehouse world | 13:48 |
| sdague | so it tries cloning things, which is forbidden, and dies | 13:48 |
| dhellmann | sdague: they do appear to be in the stable/icehouse version of lib/oslo - http://git.openstack.org/cgit/openstack-dev/devstack/tree/lib/oslo?h=stable/icehouse#n33 | 13:48 |
| sdague | hmmmm | 13:49 |
| dhellmann | yeah, the job shouldn't exist at all, but devstack is going to try to install this lib for other jobs, too | 13:49 |
| sdague | ok, so much for that theory | 13:49 |
| dhellmann | no, I think we're both right this time :-) | 13:49 |
| sdague | oh... wait | 13:49 |
| sdague | what's in stackrc | 13:49 |
| sdague | because lib/oslo in icehouse might be slightly wrong | 13:49 |
| sdague | because that backport of this infrastructure was.... interesting | 13:50 |
| dhellmann | regardless of the GIT_DIR settings, there are calls to install those libraries | 13:50 |
| dhellmann | and I think we probably don't want that? | 13:50 |
| dhellmann | as far as removing the jobs, my patch removed them all because we assumed the caps would be safe. We've reverted the caps now, though, so we don't want them all removed. I think we just want to remove the jobs that are "invalid" because they test combinations that don't make sense, like oslo.utils and icehouse | 13:51 |
| sdague | dhellmann: ok, so you feel confident https://review.openstack.org/#/c/137451/ is the right patch | 13:53 |
| sdague | ? | 13:53 |
| sdague | if so I'll approve | 13:53 |
| dhellmann | sdague: no, I think that's wrong. Let me work up another patch. | 13:54 |
| dhellmann | I think we do want some of these stable-compat-jobs, we just don't want all of them for all libraries | 13:54 |
| sdague | ok | 13:54 |
| sdague | yeh, that's why I -1ed that patch, because I knew a bunch of stuff was in flight, and wanted to make sure we were all in sync | 13:55 |
| *** ZZelle has quit IRC | 13:55 | |
| *** yamamoto has quit IRC | 13:56 | |
| dhellmann | right, that was the right response there. I'll abandon that one after I post this one I'm working on now. | 13:56 |
| *** alexpilotti has joined #openstack-infra | 13:56 | |
| *** stevemar has joined #openstack-infra | 13:57 | |
| *** xyang8 has joined #openstack-infra | 13:59 | |
| *** xyang8 is now known as xyang1 | 13:59 | |
| *** spzala has joined #openstack-infra | 14:00 | |
| *** jcoufal has quit IRC | 14:00 | |
| *** smoser has quit IRC | 14:00 | |
| *** ZZelle has joined #openstack-infra | 14:02 | |
| *** vigneshvar has quit IRC | 14:03 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: Clean up Oslo stable compat jobs https://review.openstack.org/139634 | 14:04 |
| dhellmann | sdague: I think this is what we want in project-config ^^ | 14:04 |
| *** miqui_ has joined #openstack-infra | 14:04 | |
| *** dims has quit IRC | 14:05 | |
| sdague | dhellmann: also - https://review.openstack.org/#/c/139631/1/lib/oslo,cm | 14:05 |
| *** dims has joined #openstack-infra | 14:06 | |
| *** talluri has joined #openstack-infra | 14:06 | |
| dhellmann | sdague: I think oslo.db should come out, too, we didn't actually release that until juno according to my notes | 14:06 |
| sdague | hmmm ok | 14:06 |
| dhellmann | it was created in icehouse, but nothing was using it and there was no release, irrc | 14:06 |
| *** kgiusti has joined #openstack-infra | 14:07 | |
| sdague | ok, updating the patch accordingly | 14:07 |
| *** derekh has joined #openstack-infra | 14:07 | |
| dhellmann | sdague: should that patch modify stackrc, too? it probably doesn't matter if the variables are set up if nothing is going to use them | 14:07 |
| *** andreaf has joined #openstack-infra | 14:07 | |
| *** radez_g0n3 is now known as radez | 14:07 | |
| dhellmann | ah, ps2 does | 14:07 |
| sdague | dhellmann: if we are dropping oslo.db | 14:07 |
| dhellmann | sdague: oh, there are a bunch of other libs referenced in stackrc that don't exist | 14:08 |
| dhellmann | i18n, log, etc. | 14:08 |
| *** rlandy has quit IRC | 14:09 | |
| sdague | ok, what should the icehouse list be? | 14:09 |
| sdague | like I said, this backport was complex, so I erred on the side of acceptance | 14:09 |
| dhellmann | cliff, config, messaging, vmware, pycadf, stevedore, taskflow | 14:09 |
| dhellmann | almost all of these libs really were created in juno | 14:10 |
| sdague | rootwrap goes back to icehouse, no? | 14:10 |
| dhellmann | I didn't think so as a separate library, but you might be right, let me look | 14:11 |
| dhellmann | it was in the incubator | 14:11 |
| dhellmann | well, I think, still checking | 14:11 |
| sdague | ok, I'll wait before I rev it again | 14:11 |
| *** ZZelle has quit IRC | 14:12 | |
| dhellmann | it looks like you're right, oslo.rootwrap should be in icehouse. | 14:12 |
| dhellmann | there's no stable branch in that repository, though :-/ | 14:13 |
| dhellmann | there's a stable/juno but not stable/icehouse | 14:13 |
| dhellmann | I don't know what that's going to do to the test job | 14:13 |
| *** yamamoto has joined #openstack-infra | 14:13 | |
| dhellmann | 1.0.0 was released dec 2013 so that's definitely icehouse | 14:13 |
| *** smoser has joined #openstack-infra | 14:14 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: Clean up Oslo stable compat jobs https://review.openstack.org/139634 | 14:14 |
| *** koolhead17 has joined #openstack-infra | 14:17 | |
| *** ZZelle has joined #openstack-infra | 14:17 | |
| anteaya | heyongli: okay hopefully jogo will be online again soon at the same time as you and we can work this out | 14:18 |
| anteaya | heyongli: have you been told you can't upstream your test cases? I can't say anywhere in the backscroll in this channel that says that, but if someone did say that can you link me? | 14:19 |
| anteaya | heyongli: or are you just assuming that conclusion because you haven't yet heard where to put your testcases upstream? | 14:19 |
| *** mattfarina has joined #openstack-infra | 14:20 | |
| anteaya | sdague: are you working with the understanding that heyongli's tests can't find a home upstream? | 14:20 |
| *** shakamunyi has joined #openstack-infra | 14:21 | |
| sdague | a little, jogo was primary point person there so I'm letting him mostly handle it | 14:22 |
| *** avozza is now known as zz_avozza | 14:22 | |
| sdague | this isn't so much a place for tests, but actually figuring out the right test architecture here | 14:22 |
| sdague | we'll find the right upstream place first | 14:22 |
| sdague | we'll find the right upstream place after | 14:22 |
| sdague | but first we actually need the overall plan of how we're going to cover this functionality | 14:23 |
| *** bcourt has quit IRC | 14:23 | |
| *** Hal_ has joined #openstack-infra | 14:24 | |
| jogo | heyongli: o/ | 14:24 |
| anteaya | here's jogo | 14:24 |
| anteaya | jogo: sometimes jetlag can be helpful | 14:24 |
| jogo | anteaya: in NYC so its actually 9AM HERE :) | 14:25 |
| jogo | here* | 14:25 |
| anteaya | cool | 14:26 |
| *** bcourt has joined #openstack-infra | 14:26 | |
| openstackgerrit | Brant Knudson proposed openstack-infra/reviewstats: markmc is not nova-core https://review.openstack.org/139637 | 14:26 |
| anteaya | so let's assume heyongli is offline now since it will be very late in china | 14:26 |
| anteaya | what artifact can we leave in channel that he can take to his supervisor to say this is the status of his work | 14:26 |
| *** e0ne has quit IRC | 14:28 | |
| *** bhunter71 has joined #openstack-infra | 14:29 | |
| *** dustins has joined #openstack-infra | 14:29 | |
| *** alexpilotti has quit IRC | 14:30 | |
| *** denis_makogon has quit IRC | 14:31 | |
| *** alexpilotti has joined #openstack-infra | 14:31 | |
| openstackgerrit | Mike Heald proposed openstack-infra/infra-specs: Result set management and paging specification https://review.openstack.org/139638 | 14:31 |
| anteaya | jogo: any thoughts? | 14:31 |
| *** cpowell has joined #openstack-infra | 14:32 | |
| *** dizquierdo has joined #openstack-infra | 14:32 | |
| jogo | anteaya: yeah responding in -qa | 14:32 |
| jogo | anteaya: it sounds like there is subtle details we need to take into account for what method makes the most sense | 14:33 |
| anteaya | yes, agreed | 14:34 |
| openstackgerrit | Brant Knudson proposed openstack-infra/reviewstats: Format keystone.json https://review.openstack.org/139640 | 14:34 |
| openstackgerrit | Brant Knudson proposed openstack-infra/reviewstats: Alphabetize keystone cores https://review.openstack.org/139641 | 14:34 |
| *** spzala has quit IRC | 14:34 | |
| openstackgerrit | Brant Knudson proposed openstack-infra/reviewstats: Add new keystone subprojects https://review.openstack.org/139642 | 14:34 |
| anteaya | mostly my role here is to make sure noone gets stuck and all the people that need to talk to each other find each other | 14:34 |
| anteaya | and I'm glad you are responding in -qa | 14:35 |
| anteaya | thank you | 14:35 |
| anteaya | at least now he has an action item, a spec | 14:35 |
| anteaya | he has something to work on | 14:35 |
| anteaya | thank you | 14:35 |
| *** hdd has quit IRC | 14:37 | |
| *** alexpilotti has quit IRC | 14:38 | |
| fungi | hrm, for whatever reason the storyboard auth 404 i was getting on my netbook is not happening on my desktop. must have been an issue on my end | 14:39 |
| jogo | anteaya: thank you, that is a very important role | 14:40 |
| *** dustins has quit IRC | 14:40 | |
| *** alexpilotti has joined #openstack-infra | 14:40 | |
| *** e0ne has joined #openstack-infra | 14:41 | |
| *** dannywilson has joined #openstack-infra | 14:41 | |
| *** dannywilson has quit IRC | 14:41 | |
| *** ddieterly has joined #openstack-infra | 14:42 | |
| *** dustins has joined #openstack-infra | 14:42 | |
| *** signed8bit has joined #openstack-infra | 14:42 | |
| *** alexpilotti has quit IRC | 14:42 | |
| *** cdent has quit IRC | 14:42 | |
| *** berendt has joined #openstack-infra | 14:43 | |
| anteaya | jogo: okay thanks, I'll keep doing this you keep doing that and hopefully at some point there will be something to show for it | 14:43 |
| anteaya | to heyongli's credit he does keep showing up, which is all I asked of him | 14:43 |
| anteaya | so it is early but so far I am impressed | 14:43 |
| jogo | anteaya: yeah | 14:43 |
| anteaya | cool | 14:44 |
| bknudson | gerrit has a rest API? | 14:44 |
| anteaya | I'm out for a good chunk of the day, leave messages if there is more | 14:44 |
| anteaya | bknudson: with 2.8 it does | 14:44 |
| anteaya | bknudson: we didn't have it with 2.4, we upgraded just before atlanta | 14:44 |
| bknudson | anteaya: is it on a different port than normal gerrit? | 14:44 |
| *** mrmartin has joined #openstack-infra | 14:45 | |
| anteaya | I don't know the answer to that question | 14:45 |
| anteaya | curl works, that I do know | 14:45 |
| fungi | bknudson: yes, 443/tcp (with tls) | 14:45 |
| *** mikedillion has joined #openstack-infra | 14:45 | |
| fungi | bknudson: https://review.openstack.org/Documentation/rest-api.html | 14:45 |
| bknudson | have an example? e.g., get group | 14:45 |
| anteaya | this works: curl -X GET 'https://review.openstack.org/accounts/cboylan' | 14:45 |
| anteaya | fungi knows all the things | 14:46 |
| *** zxiiro has joined #openstack-infra | 14:46 | |
| fungi | anteaya: that is so untrue | 14:46 |
| bknudson | ah, that did work... will get to work | 14:46 |
| bknudson | maybe can automate reviewstats | 14:46 |
| bknudson | since we can't keep it in sync | 14:46 |
| bknudson | I probably need to authenticate to list groups | 14:47 |
| fungi | bknudson: for authenticated queries, you need to generate an password at https://review.openstack.org/#/settings/http-password | 14:47 |
| fungi | bknudson: you may find this a helpful example... https://review.openstack.org/80437 | 14:48 |
| *** jogo is now known as flashgordon | 14:48 | |
| fungi | (tweak the GERRITUSER and HTTPPASSWORD to reflect your creds) | 14:48 |
| *** otter768 has joined #openstack-infra | 14:48 | |
| fungi | bknudson: in fact, that could possibly forklift the core reviewer determination in reviewstats so that it ceases being static/hard-coded | 14:49 |
| openstackgerrit | Jan Klare proposed openstack-infra/project-config: Added gate-{name}-chef-rake job-template https://review.openstack.org/137134 | 14:49 |
| bknudson | fungi: that looks like what's needed for reviewstats | 14:49 |
| *** armax has joined #openstack-infra | 14:50 | |
| fungi | bknudson: yes, proof that while i don't actually know everything (sorry anteaya!), i _can_ predict the future | 14:50 |
| *** luqas__ has quit IRC | 14:50 | |
| anteaya | :D | 14:50 |
| bknudson | knowledge of the future is included in knowing everything. | 14:50 |
| anteaya | that is a handy skill too | 14:51 |
| anteaya | bknudson: + | 14:51 |
| *** luqas__ has joined #openstack-infra | 14:51 | |
| fungi | bknudson: i originally whipped that up as an example of how the organizers of the summit core reviewer parties could build the various lists of invitees they wanted | 14:51 |
| fungi | so no, i didn't actually predict you'd need it, just got lucky ;) | 14:52 |
| *** dansmith is now known as superdan | 14:52 | |
| *** dizquierdo_ has joined #openstack-infra | 14:52 | |
| *** luqas__ has quit IRC | 14:52 | |
| *** luqas__ has joined #openstack-infra | 14:53 | |
| dkranz | fungi: Can't remember if I asked this before, but is there a way I can look at the history of a job like periodic-tempest-dsvm-all-master in jenkins? Or how else would I be able to compare historical results? | 14:53 |
| *** mpaolino has quit IRC | 14:53 | |
| *** mase_x200 has quit IRC | 14:53 | |
| *** otter768 has quit IRC | 14:53 | |
| fungi | dkranz: depends on the level of granularity you want | 14:54 |
| *** luqas__ has quit IRC | 14:54 | |
| fungi | dkranz: we have pass/fail for the job overall tracked at graphite.openstack.org | 14:54 |
| dkranz | fungi: I need to see the logs, but was not aware of the above site | 14:54 |
| fungi | dkranz: mtreinish's subunit2sql is getting us test-by-test granularity trends | 14:55 |
| *** luqas__ has joined #openstack-infra | 14:55 | |
| *** r-daneel has joined #openstack-infra | 14:55 | |
| *** sputnik13 has joined #openstack-infra | 14:55 | |
| fungi | dkranz: for log-level detail, you are probably stuck with the 10 days in logstash.openstack.org _or_ downloading some subset of our 14tb of compressed logs from the past 4 months and performing local analysis | 14:55 |
| *** sputnik13 has quit IRC | 14:55 | |
| *** dizquierdo has quit IRC | 14:56 | |
| *** luqas__ has quit IRC | 14:56 | |
| dkranz | fungi: I looked at logstash but became suspicious as to whether this job was actually running for several days | 14:56 |
| dkranz | fungi: Perhaps I am missing something, but this kind of thing is trivial with "normal" jenkins | 14:57 |
| *** luqas__ has joined #openstack-infra | 14:57 | |
| *** Masahiro has joined #openstack-infra | 14:57 | |
| dkranz | fungi: As we more to more periodic testing, as we must, we need to be able to track things more closely for people watching the jobs | 14:57 |
| dkranz | fungi: move to | 14:57 |
| fungi | dkranz: "normal" jenkins doesn't run nearly as many jobs as we do. even when we had only one jenkins master we had to crank the log retention in it down to 24 hours to keep it from falling over from performance degredation | 14:57 |
| *** lukego has joined #openstack-infra | 14:58 | |
| dkranz | fungi: I understand that, but perhaps this should be revisited for periodic jobs only | 14:58 |
| fungi | dkranz: now we have 8 jenkins masters, so what little history it would have tracked is disjoint across them | 14:58 |
| dkranz | fungi: why not run all the periodic jobs on one master? | 14:58 |
| dkranz | fungi: I really do understand the issue we have, but if we are going to have more periodic jobs we need something better I think | 14:59 |
| *** luqas__ has quit IRC | 14:59 | |
| *** luqas__ has joined #openstack-infra | 14:59 | |
| dkranz | fungi: I am watching the tempest jobs which is why I was asking | 14:59 |
| fungi | dkranz: well, at least at the moment, it's not designed to support that. nodepool evenly distributes single-use workers across all the jenkins masters and then they pick up jobs as they become available | 14:59 |
| dkranz | fungi: ok, I get that it is not trivial | 15:00 |
| *** amitgandhinz has joined #openstack-infra | 15:00 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Workflow documentation is now in infra-manual https://review.openstack.org/139415 | 15:00 |
| fungi | dkranz: with some creativity in nodepool configuration we could probably build specially-labeled single-use workers separate from our normal pools and only assign them to a single jenkins master | 15:00 |
| fungi | dkranz: but that wouldn't be very helpful soon when we stop using jenkins | 15:00 |
| *** luqas__ has quit IRC | 15:00 | |
| *** luqas__ has joined #openstack-infra | 15:01 | |
| dkranz | fungi: We just need to define the workflow of a "watcher" | 15:01 |
| *** Guest3214 is now known as mfisch | 15:01 | |
| *** mfisch has joined #openstack-infra | 15:01 | |
| dkranz | fungi: jenkins is designed, at least in part, around just that | 15:01 |
| fungi | dkranz: as that's a significant goal, we're trying to avoid growing new dependence on features of jenkins we're not already using (so we can finish replacing the bits we do use) | 15:01 |
| openstackgerrit | Dan Nguyen proposed openstack/requirements: Add requirement for lastest trove client https://review.openstack.org/139648 | 15:01 |
| *** Masahiro has quit IRC | 15:01 | |
| lukego | Howdy! I plan to decommission my 3rd party CI “Tail-f NCS” now. This has been succeeded by a new CI called “Cisco Tail-f CI” that is operated by Cisco’s team and now actively voting. Is there a notification process I should follow or just switch it off? | 15:02 |
| *** alexpilotti has joined #openstack-infra | 15:02 | |
| fungi | dkranz: but yes, if you have some more specific data you want to trend, we should make sure we find a way to capture that over time | 15:02 |
| dkranz | fungi: I get that we don't like the job scheduling/execution stuff in jenkins, and that right now no one pays attention to periodic jobs, but that has to change. So what will replace the jdnkins ui? | 15:02 |
| *** pblaho has quit IRC | 15:02 | |
| *** barnaby has joined #openstack-infra | 15:02 | |
| dkranz | fungi: I will send something to the ml about this | 15:03 |
| *** luqas__ has quit IRC | 15:03 | |
| dkranz | fungi: thanks for the clarification | 15:03 |
| fungi | dkranz: i can't remember if you were at the qa and infra sessions at the summit, but the proposal was a tracking dashboard for job "health", possibly using a mysql reporter in zuul | 15:03 |
| *** luqas__ has joined #openstack-infra | 15:03 | |
| *** _nadya_ has quit IRC | 15:04 | |
| dkranz | fungi: I did hear about that but am not sure it is good enough for periodic job watchers to really do their job of investigation | 15:04 |
| *** cdent has joined #openstack-infra | 15:04 | |
| fungi | dkranz: since the e-mail reporting from periodic job failures falls on deaf ears much of the time, i'm unconvinced a web interface will force people to pay attention either, but i suppose it's worth a try | 15:04 |
| dkranz | fungi: once there are real periodic jobs and real watchers of course | 15:04 |
| dkranz | fungi: I am expressing the idea that this is partly a chicken-and-egg problem | 15:05 |
| *** bcourt has quit IRC | 15:05 | |
| fungi | you may be right | 15:05 |
| *** zxiiro has quit IRC | 15:05 | |
| fungi | it's still a problem we want to solve | 15:05 |
| *** akrivoka has left #openstack-infra | 15:05 | |
| dkranz | fungi: at this point some one less determined than I am might just hope that some one else starts looking at the periodic tempest jobs | 15:05 |
| fungi | but knowing what metrics you are missing would be useful | 15:05 |
| fungi | or s/metrics/data/ in general | 15:06 |
| *** luqas__ has quit IRC | 15:06 | |
| dkranz | fungi: ok, I will send something to the ml with a propose set of requirements for periodic job watchers | 15:06 |
| *** luqas___ has joined #openstack-infra | 15:06 | |
| dhellmann | sdague: https://jenkins05.openstack.org/job/gate-devstack-unit-tests/37/console | 15:06 |
| *** zxiiro has joined #openstack-infra | 15:07 | |
| mtreinish | fungi: although I don't think periodics get picked up by subunit2sql right now | 15:07 |
| *** lukego has quit IRC | 15:07 | |
| fungi | as i said, we have long-long-term trending for job pass/fail rate in various pipelines, the subunit2sql work is getting us that for test-level trending as well, and then we have shorter-term queryable job logs indexed, with longer-term archival of the artifacts which can be investigated with some additional effort to retrieve them | 15:07 |
| *** dims is now known as dimsum__ | 15:07 | |
| fungi | mtreinish: hrm, how would it not get periodic jobs? is it just filtering them by job name right now? | 15:08 |
| openstackgerrit | Merged openstack-infra/reviewstats: Format keystone.json https://review.openstack.org/139640 | 15:08 |
| fungi | mtreinish: or is it specifically wanting to see a gerrit change to map to the results at the moment? | 15:08 |
| openstackgerrit | Merged openstack-infra/reviewstats: Alphabetize keystone cores https://review.openstack.org/139641 | 15:08 |
| *** teran has joined #openstack-infra | 15:08 | |
| mtreinish | fungi: it's filtering by job name and build_queue to gate: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/logstash/jenkins-log-client.yaml#n14 | 15:08 |
| *** luqas__ has joined #openstack-infra | 15:09 | |
| mtreinish | it's fixable, we just started with gate | 15:09 |
| *** prad has joined #openstack-infra | 15:09 | |
| fungi | mtreinish: oh, right. so architecturally, conceptually, it will get us that if we want | 15:09 |
| *** luqas___ has quit IRC | 15:09 | |
| mtreinish | yeah, I think that was the eventually intent too. We just had to start somewhere | 15:10 |
| fungi | absolutely | 15:10 |
| fungi | speaking of which, are we to the point where you're ready for me to add the read-only query account in the backend db so you can test? | 15:10 |
| *** markmcclain has joined #openstack-infra | 15:10 | |
| bknudson | fungi: does who-approves take a long time to run? | 15:10 |
| fungi | want to make sure i'm not blocking your progress on that | 15:10 |
| *** talluri has quit IRC | 15:11 | |
| mtreinish | fungi: I think so, at least I'm ready to test things, but I'm still waiting for a second +2 on the 2 patches to add the proxy | 15:11 |
| *** luqas has joined #openstack-infra | 15:11 | |
| fungi | bknudson: a while, yes. the queries are... not fast. several minutes i think though it's been a while since i ran it (couple months) | 15:11 |
| *** prad has quit IRC | 15:11 | |
| *** luqas__ has quit IRC | 15:12 | |
| fungi | mtreinish: oh. i guess make some noise when there are system-config cores watching ;) | 15:12 |
| mtreinish | fungi: heh, I've been trying that :) I'm probably just picking bad times | 15:12 |
| fungi | all times here are bad times | 15:12 |
| mtreinish | heh, fair enough | 15:13 |
| openstackgerrit | Merged openstack-infra/reviewstats: Add new keystone subprojects https://review.openstack.org/139642 | 15:13 |
| fungi | speaking of bad times, wow. i think we're having a problem booting new nodepool nodes | 15:13 |
| *** teran has quit IRC | 15:13 | |
| fungi | just judging from the graph | 15:13 |
| fungi | checking logs now for details | 15:13 |
| *** bnemec is now known as beekneemech | 15:13 | |
| mtreinish | SergeyLukjanov: if you get a sec, https://review.openstack.org/138853 and https://review.openstack.org/122311 are needed to add public access to subunit2sql data | 15:13 |
| openstackgerrit | Merged openstack-infra/reviewstats: markmc is not nova-core https://review.openstack.org/139637 | 15:14 |
| *** eharney has joined #openstack-infra | 15:14 | |
| openstackgerrit | Merged openstack-infra/reviewstats: Workflow documentation is now in infra-manual https://review.openstack.org/139431 | 15:14 |
| fungi | bknudson: anyway, if you see some benefit to that script as-is, i'll try to get it parameterized and better commented and maybe contribute it to reviewstats (seems as good a home for the code as any) | 15:15 |
| *** yamahata has joined #openstack-infra | 15:15 | |
| fungi | bknudson: maybe later today, once nodepool isn't falling over ;) | 15:15 |
| *** mpaolino has joined #openstack-infra | 15:16 | |
| sdague | dhellmann: oh, I need to update test tests | 15:16 |
| bknudson | fungi: don't let me distract you from something important... btw, it finally finished, KeyError: ' os-ansible-deployment-core'... will look at it. | 15:16 |
| fungi | bknudson: that group might be missing in gerrit or something | 15:17 |
| fungi | bknudson: it was, by all accounts, a very quick and dirty script with basically no error handling | 15:17 |
| dhellmann | sdague: yeah, I wasn't sure where to address that or I would have tried updating the patch myself | 15:17 |
| bknudson | it's fishy that the name starts with space. | 15:18 |
| fungi | bknudson: oho! i didn't spot that | 15:18 |
| odyssey4me | is it at all possible to merge multiple commits, but have one review for it? | 15:18 |
| fungi | odyssey4me: gerrit tries to address that use case with dependent changes | 15:19 |
| fungi | odyssey4me: basically you can push a series of commits to gerrit and it creates a review change for each of them with a dependency between them | 15:19 |
| *** pblaho has joined #openstack-infra | 15:19 | |
| *** teran has joined #openstack-infra | 15:19 | |
| *** jamesmcarthur has joined #openstack-infra | 15:20 | |
| odyssey4me | fungi: the use case we're trying to address is for backporting multiple patches in one go, without having to review each individual patch again | 15:20 |
| openstackgerrit | Christian Berendt proposed openstack-infra/project-config: Add new project packstack-vagrant to stackforge https://review.openstack.org/139660 | 15:20 |
| *** andreykurilin_ has joined #openstack-infra | 15:20 | |
| openstackgerrit | Christian Berendt proposed openstack-infra/project-config: Add new project packstack-vagrant to stackforge https://review.openstack.org/139660 | 15:21 |
| openstackgerrit | Christian Berendt proposed openstack-infra/project-config: Add new project packstack-vagrant to stackforge https://review.openstack.org/139660 | 15:21 |
| *** ryanpetrello has quit IRC | 15:21 | |
| fungi | odyssey4me: oh, in that case i'd probably just cherry pick them all onto each other without creating separate commits (so they effectively squash when you commit) and just add co-authored-by header lines in the combined commit message | 15:21 |
| fungi | odyssey4me: or cherry-pick them as independent changes but not closely review them if you don't want to do so | 15:21 |
| fungi | just rubber-stamp approve them in gerrit | 15:22 |
| odyssey4me | fungi: ah, that's a way of keeping some level of history I suppose | 15:22 |
| *** tonytan4ever has joined #openstack-infra | 15:22 | |
| fungi | odyssey4me: there's also the possibility of proposing merge commits from one branch to another, but that drags in history you may be wanting to filter, so likely not applicable here | 15:23 |
| *** dims_ has joined #openstack-infra | 15:24 | |
| *** xyang1 has quit IRC | 15:25 | |
| *** ChuckC_ has quit IRC | 15:26 | |
| fungi | okay, so a lot of the building node pileup seems to be instances stuck in a building state in hpcloud, mostly az3 (that may be proportional to the az imbalance in our nodepool config though) | 15:26 |
| *** ryanpetrello has joined #openstack-infra | 15:26 | |
| *** spzala has joined #openstack-infra | 15:26 | |
| fungi | looks like quite a few are in a building state for 3 hours or more | 15:26 |
| fungi | tteggel: ^ any idea if something happened internally? | 15:26 |
| odyssey4me | thanks for the suggestions fungi :) | 15:27 |
| *** hdd has joined #openstack-infra | 15:27 | |
| fungi | odyssey4me: any time. gerrit can be a slightly odd beast, since it is designed around the lkml patch iteration workflow where changes get updated and squashed before getting pulled into mainline | 15:28 |
| *** xyang1 has joined #openstack-infra | 15:28 | |
| *** dimsum__ has quit IRC | 15:28 | |
| fungi | basically rebasing outside of public git repositories between proposals | 15:28 |
| fungi | as opposed to the github pull request "everything's a branch" merge model to which a lot of people have more recently become accustomed | 15:29 |
| tteggel | fungi: we've had some *ahem* challenges in the last few days | 15:30 |
| fungi | tteggel: okay, duly noted--thanks for confirming! | 15:30 |
| fungi | i'll clean up what i can on our side | 15:30 |
| *** teran_ has joined #openstack-infra | 15:30 | |
| *** zz_dimtruck is now known as dimtruck | 15:30 | |
| tteggel | fungi: do you think you're currently expreiencing an issue? | 15:31 |
| fungi | tteggel: starting around 3 hours ago, a lot of instances we've tried to boot from snapshots are stuck and never reach available state in nova | 15:32 |
| *** lukego has joined #openstack-infra | 15:32 | |
| openstackgerrit | Antoine Musso proposed openstack-infra/zuul: Cloner: set zuul_branch on ref-update events https://review.openstack.org/138433 | 15:32 |
| fungi | i'm trying to delete them now (normally nodepool will do that itself after 8 hours) | 15:32 |
| tteggel | fungi: our heath stats look clean for the last few hours with maybe a blip in east AZ2 around 1100 UTC | 15:33 |
| *** teran has quit IRC | 15:33 | |
| tteggel | fungi: checking snapshot stats, hang on | 15:33 |
| fungi | tteggel: eh, maybe unrelated then. it would have been about 1200 utc when we started seeing this | 15:33 |
| fungi | tteggel: and it's happening across all three azs | 15:34 |
| *** _nadya_ has joined #openstack-infra | 15:34 | |
| *** reed has joined #openstack-infra | 15:34 | |
| tteggel | fungi: east? | 15:34 |
| fungi | tteggel: yep, east | 15:34 |
| fungi | ("region b" is what we had been calling it, but i gather it had several confusingly different names within hpcloud) | 15:35 |
| *** rushiagr is now known as rushiagr_away | 15:35 | |
| tteggel | fungi: hah yeah, you don't know the half of it! region-b works for me | 15:35 |
| fungi | tteggel: well, i know maybe an eighth of it. i did work at hpcloud for a while | 15:36 |
| tteggel | fungi: didn't know that | 15:36 |
| *** jlibosva has quit IRC | 15:37 | |
| clarkb | before region b existed | 15:38 |
| fungi | well, i'm sure it was already a twinkle in some division's eye | 15:39 |
| fungi | but yes, i left before it was online | 15:39 |
| *** AJaeger has joined #openstack-infra | 15:39 | |
| *** ildikov has joined #openstack-infra | 15:40 | |
| tteggel | so we had 30 mins in region-b az2 from 1300 UTC where we weren't getting sshable VMs | 15:40 |
| openstackgerrit | Antoine Musso proposed openstack-infra/zuul: Cloner: set zuul_branch on ref-update events https://review.openstack.org/138433 | 15:40 |
| tteggel | no other "events" today that I'm aware of | 15:40 |
| AJaeger | Hi! Looking at https://wiki.openstack.org/wiki/Gerrit_Workflow, I notice that https://wiki.openstack.org/wiki/Gerrit_Workflow#Maintaining_Dependency_Chains is not in infra-manuals, the rest looks fine. | 15:40 |
| *** spzala has quit IRC | 15:41 | |
| AJaeger | Should we move over the "Maintaining Dependency Chains" section to infra-manual so that we can delete the Gerrit_Workflow page? | 15:41 |
| fungi | tteggel: thanks for having a look. it might have been something on our side but i'm not finding evidence yet | 15:41 |
| *** wenlock has joined #openstack-infra | 15:42 | |
| fungi | AJaeger: yes, i think that would be great | 15:42 |
| *** mestery has quit IRC | 15:42 | |
| tteggel | fungi: np. let me know if you need any more help. | 15:42 |
| openstackgerrit | Antoine Musso proposed openstack-infra/zuul: cloner: support for ref-updated parameters https://review.openstack.org/137675 | 15:43 |
| fungi | AJaeger: last night i took a stab at updating over 200 projects which had embedded links to our workflow wiki articles, pointing them at the corresponding infra manual sections, so hopefully we will start driving down traffic to those on the wiki soon | 15:43 |
| AJaeger | Ok, I'll give it a go ;) | 15:43 |
| fungi | and driving up traffic to infra manual instead | 15:43 |
| AJaeger | fungi: yeah, I noticed. You are crazy ;) | 15:43 |
| fungi | it needed to be done | 15:43 |
| AJaeger | fungi: that's why I was reviewing the pages to check that we can delete them eventually... | 15:44 |
| fungi | that would be awesome | 15:44 |
| SergeyLukjanov | mtreinish, I'll do it today | 15:44 |
| AJaeger | fungi: yeah, I started on the Documentation wiki pages to add links and remove content. But that needs some more iterations... | 15:44 |
| AJaeger | fungi, could you do a review today of infra-manual, please? I'd like to have a shorter queue there... Hope others review as well.. | 15:45 |
| mtreinish | SergeyLukjanov: ok, great thanks | 15:45 |
| fungi | AJaeger: sure. did we already accumulate a bunch of new changes in the past day or two? | 15:46 |
| clarkb | by the way I tried running devstack on a 2GB 2vcpu mavhine the other day and OOMed | 15:47 |
| fungi | heh | 15:48 |
| clarkb | was pretty spectacular. didnt even get a chance to do anything useful | 15:48 |
| mtreinish | clarkb: heh, yeah it'll do that | 15:48 |
| *** tonytan4ever has quit IRC | 15:52 | |
| AJaeger | fungi: yeah, a few | 15:52 |
| *** pcrews has joined #openstack-infra | 15:52 | |
| *** berendt has quit IRC | 15:53 | |
| *** talluri has joined #openstack-infra | 15:54 | |
| *** prad has joined #openstack-infra | 15:55 | |
| *** yamahata has quit IRC | 15:57 | |
| *** emagana has joined #openstack-infra | 15:57 | |
| *** e0ne has quit IRC | 15:59 | |
| AJaeger | clarkb: could you review https://review.openstack.org/#/c/138770/, please? We should get rid of the page and point to the new manual... | 15:59 |
| jamesmcarthur | fungi, clarkb: My apologies. I neglected to come back and update IRC. We completed the code push for openstack.org upgrade to Silverstripe 3 yesterday evening ~6pm. Everything is functioning as expected. If you all run into any issues, please let me know. | 15:59 |
| *** ildikov_ has joined #openstack-infra | 16:00 | |
| *** thedodd has joined #openstack-infra | 16:01 | |
| *** cnesa has quit IRC | 16:01 | |
| *** e0ne has joined #openstack-infra | 16:01 | |
| *** jamesmcarthur has quit IRC | 16:01 | |
| *** cnesa has joined #openstack-infra | 16:02 | |
| clarkb | AJaeger shouldnt the wiki links in 138770 be updated too? | 16:03 |
| *** cnesa has quit IRC | 16:03 | |
| *** ildikov has quit IRC | 16:04 | |
| *** lukego has quit IRC | 16:04 | |
| bknudson | fungi: added some logging and found it -- the tool fetches project from gerrit and gerrit is saying "label-Code-Review = -2..+2 group os-ansible-deployment-core" (there's an extra space). I'll just fix the regex. | 16:05 |
| AJaeger | clarkb: see https://review.openstack.org/#/c/138843/ | 16:05 |
| *** marcusvrn has quit IRC | 16:05 | |
| *** cnesa has joined #openstack-infra | 16:07 | |
| *** rushiagr_away is now known as rushiagr | 16:07 | |
| fungi | bknudson: awesome--thanks. i think that means we have a minor consistency issue in that acl file. checking now | 16:07 |
| *** marcusvrn has joined #openstack-infra | 16:08 | |
| fungi | bknudson: yep! http://git.openstack.org/cgit/openstack-infra/project-config/tree/gerrit/acls/stackforge/os-ansible-deployment.config#n10 | 16:08 |
| clarkb | silly gerrit not showing child changes by default | 16:08 |
| *** yamamoto has quit IRC | 16:08 | |
| fungi | i probably should do another pass with my acl normalization script | 16:08 |
| jeblair | clarkb: gertty does ;) | 16:09 |
| clarkb | jeblair I am on my phone :) I didnt approve 138770 as I thought you might want to look | 16:10 |
| ashp | zuul is meant to git clone from gerrit if it needs to, right? I tried pushing a test through a pipeline I haven't tested before and it failed with: 2014-12-05 16:02:27,150 ERROR zuul.IndependentPipelineManager: Unable to find change queue for project metacloud/spine-config | 16:10 |
| jeblair | ashp: gee we should change that error text :). zuul will only work with projects that show up in its config; so you need to add a section for metacloud/spine-config to the layout.yaml file and make sure it has a section for the pipeline in question | 16:12 |
| ashp | It has those sections, this is a migration from one infrastructure that works to another | 16:13 |
| *** cnesa2 has joined #openstack-infra | 16:13 | |
| ashp | I suspect the right thing to do in this case is just tar up all the git repos checked out on old zuul | 16:13 |
| ashp | and dump them into new zuul | 16:13 |
| *** cnesa has quit IRC | 16:13 | |
| openstackgerrit | Mike Heald proposed openstack-infra/infra-specs: Proposal for a 'fail-fast' option on project pipelines https://review.openstack.org/129255 | 16:14 |
| *** luqas has quit IRC | 16:15 | |
| *** luqas__ has joined #openstack-infra | 16:15 | |
| sdague | jeblair / fungi - the building part of the graph for nodes looks... weird | 16:15 |
| sdague | is one of the clouds gone silly? | 16:16 |
| fungi | sdague: yes, we're gettign a lot of nodes stuck in a "building" state in hpcloud | 16:16 |
| sdague | ok | 16:16 |
| jeblair | ashp: okay, so what that error actually means is "there is not an entry for the pipeline that was just triggered for the project metacloud/spine-config"... if the only triggering event was for the pipeline you are interested in, then i'm pretty sure there's a config error. if there was more than one event, or you are looking at the wrong one in the logs, then that message may be harmless | 16:16 |
| *** luqas__ has quit IRC | 16:16 | |
| fungi | sdague: unfortunately because nodepool holds a row lock in the nodes table for those, i can't use the cli to delete them | 16:16 |
| *** luqas__ has joined #openstack-infra | 16:16 | |
| *** sabeen has joined #openstack-infra | 16:17 | |
| fungi | until it stops waiting for them to finish building anyway | 16:17 |
| jeblair | ashp: (eg, it may be saying there are no post jobs configured and maybe you don't care about that; but if there are no check jobs then you do) | 16:17 |
| ekarlso- | phschwartz: u around ? | 16:17 |
| openstackgerrit | Jan Klare proposed openstack-infra/project-config: Added gate-{name}-chef-rake job-template https://review.openstack.org/137134 | 16:17 |
| *** thedodd has quit IRC | 16:17 | |
| *** koolhead17 has quit IRC | 16:17 | |
| *** xyang1 has quit IRC | 16:17 | |
| sdague | fungi: doh | 16:18 |
| *** koolhead17 has joined #openstack-infra | 16:18 | |
| fungi | sdague: i'm trying to get a feel now for whether the problem is continuing, in which case a nodepool restart won't help for long | 16:18 |
| *** luqas__ has quit IRC | 16:19 | |
| *** thedodd has joined #openstack-infra | 16:19 | |
| *** luqas__ has joined #openstack-infra | 16:19 | |
| sdague | ok, no prob. it seems to be a light day, plus the test pruning means we're not consuming all the nodes all the time | 16:19 |
| sdague | so at least we aren't out of capacity | 16:19 |
| sdague | just take a bit longer for tests to start | 16:19 |
| *** tonytan4ever has joined #openstack-infra | 16:19 | |
| *** ildikov_ has quit IRC | 16:19 | |
| fungi | sdague: right, depending on what i find, we may simply let it ride until tomorrow (we already have a gerrit restart and a zuul restart on our plate then anyway) | 16:20 |
| *** ala_ has quit IRC | 16:20 | |
| *** groknix has quit IRC | 16:20 | |
| jeblair | it should be self-correcting | 16:20 |
| fungi | yeah, assuming it's not still accumulating anyway | 16:20 |
| jeblair | just maybe not as fast as we would like | 16:20 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Copy over "Maintaining Dependency Chains" section https://review.openstack.org/139673 | 16:21 |
| *** luqas___ has joined #openstack-infra | 16:21 | |
| *** luqas__ has quit IRC | 16:21 | |
| *** mestery has joined #openstack-infra | 16:21 | |
| AJaeger | fungi, jeblair, clarkb ^ is the patch to allow us to remove the GerritWorkflow wiki page. I'm not happy with the content I'm adding, please advise what to remove and change. | 16:22 |
| fungi | i'm semi-afk for a bit. have a couple things to take care of, then will be back to continue this | 16:22 |
| openstackgerrit | Merged openstack-infra/infra-manual: Bugs elastic-recheck tracks are in openstack-gate https://review.openstack.org/139138 | 16:22 |
| AJaeger | clarkb, jeblair thanks for the reviews! | 16:22 |
| *** koolhead17 has quit IRC | 16:22 | |
| openstackgerrit | Merged openstack-infra/infra-manual: Remove obsolete introduction https://review.openstack.org/139156 | 16:23 |
| jeblair | AJaeger: ok, i'll probably save that one for after i've woken up then :) | 16:23 |
| *** luqas___ has quit IRC | 16:23 | |
| clarkb | AJaeger I almost think remove all but second section | 16:24 |
| AJaeger | jeblair: yes, please be fully awake for it! | 16:24 |
| *** luqas has joined #openstack-infra | 16:24 | |
| AJaeger | clarkb: that's the kind of feedback I'm looking for... | 16:24 |
| *** ChuckC_ has joined #openstack-infra | 16:24 | |
| *** xyang1 has joined #openstack-infra | 16:25 | |
| clarkb | this isnt meant to be a git tutorial. describe how changes amd patchsets work and be done is what I lean towards | 16:25 |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Set check-ansible-aio-build to use devstack-trusty image https://review.openstack.org/139676 | 16:25 |
| ashp | jeblair: Well you're right, it's definitely configuration | 16:25 |
| ashp | jeblair: I had a lot of troubles dragging our old config over, with various bits having changed over time in zuul | 16:26 |
| openstackgerrit | Merged openstack-infra/system-config: Rework stackforge.html for infra manual changes https://review.openstack.org/138770 | 16:26 |
| sdague | clarkb: it might be nice to provide "learn more" references about git usage in openstack | 16:26 |
| ashp | This is my current conf (relevant bits, at least) http://pastebin.com/iKN0qmsx and the error | 16:26 |
| ashp | so I'm sure just one of these has been changed or needs renaming :/ | 16:26 |
| JayF | fungi: for https://review.openstack.org/#/c/134436/8, I am removing the buildimage-coreos job from IPA check pipeline because it's not needed anymore. That comment in the commit message is accurate. | 16:26 |
| *** luqas has quit IRC | 16:26 | |
| *** luqas has joined #openstack-infra | 16:26 | |
| clarkb | sdague ya, and shove that somewhere else in the manual. Reading the wiki text makes me think it should not be on the wiki though | 16:27 |
| gilliard | Hi infra. Any chance of someone looking at https://review.openstack.org/#/c/139016/ please? | 16:27 |
| sdague | clarkb: well it could even be external links | 16:27 |
| sdague | like https://dague.net/2014/07/24/splitting-up-git-commits/ was something folks found useful | 16:27 |
| *** lukego has joined #openstack-infra | 16:27 | |
| sdague | but I don't think replicating it all back into manuals makes sense | 16:27 |
| *** yamamoto has joined #openstack-infra | 16:28 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Explain Zuul setup without gating https://review.openstack.org/139678 | 16:28 |
| *** mestery has quit IRC | 16:28 | |
| *** ChuckC_ is now known as ChuckC | 16:28 | |
| *** mestery has joined #openstack-infra | 16:28 | |
| openstackgerrit | Merged openstack-infra/system-config: Replace links to GerritWorkflow https://review.openstack.org/138843 | 16:29 |
| *** luqas__ has joined #openstack-infra | 16:29 | |
| *** luqas has quit IRC | 16:29 | |
| clarkb | sdague that works too. I just wonder if a git rebase tutorial on the wiki is what we need | 16:29 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Explain Zuul setup without gating https://review.openstack.org/139678 | 16:29 |
| clarkb | the content there is sort of bad :( | 16:30 |
| AJaeger | clarkb: yeah ;( I already tried improving it but I'm not happy ;( | 16:30 |
| openstackgerrit | Merged openstack/requirements: Fix casing of xstatic-* https://review.openstack.org/130287 | 16:32 |
| *** luqas has joined #openstack-infra | 16:32 | |
| *** dizquierdo_ has quit IRC | 16:32 | |
| *** luqas__ has quit IRC | 16:32 | |
| sdague | honestly, I feel like there are a ton of better resources for doing git than we can write for our wiki | 16:32 |
| sdague | and better to just reference them | 16:32 |
| *** lukego has quit IRC | 16:33 | |
| *** luqas has quit IRC | 16:33 | |
| *** luqas has joined #openstack-infra | 16:34 | |
| AJaeger | I'm fine with abandaning the patch as well... | 16:34 |
| * AJaeger is afk for a while now | 16:34 | |
| *** luqas has quit IRC | 16:35 | |
| *** luqas has joined #openstack-infra | 16:36 | |
| clarkb | sdague ++ | 16:36 |
| odyssey4me | clarkb: did I do this correctly? https://review.openstack.org/#/c/139676/ | 16:36 |
| *** nfedotov has left #openstack-infra | 16:37 | |
| *** david-ly_ is now known as david-lyle | 16:37 | |
| *** _buzz_ has joined #openstack-infra | 16:37 | |
| *** luqas__ has joined #openstack-infra | 16:37 | |
| *** luqas has quit IRC | 16:37 | |
| clarkb | odyssey4me you also need 'dsvm' in the job name so that zuul triggers the job on the right node type | 16:39 |
| *** _buzz has quit IRC | 16:39 | |
| *** ashaeron has quit IRC | 16:39 | |
| *** thedodd has quit IRC | 16:39 | |
| clarkb | there are two halves there. letting jenkins know and letting zuul know | 16:39 |
| *** luqas__ has quit IRC | 16:40 | |
| odyssey4me | clarkb: so the job name in zuul (and jenkins) needs to start with dvsm? | 16:40 |
| *** luqas__ has joined #openstack-infra | 16:40 | |
| *** xyang1 has quit IRC | 16:41 | |
| *** jpich has quit IRC | 16:41 | |
| *** markus_z has quit IRC | 16:41 | |
| *** luqas__ has quit IRC | 16:42 | |
| *** luqas__ has joined #openstack-infra | 16:43 | |
| *** isviridov is now known as isviridov_away | 16:44 | |
| annegentle | how do redirects work with the OpenStack wiki? | 16:44 |
| ashp | I am absolutely baffled by why this can't see a change queue, maybe it's becausae we don't assign queue names to jobs :/ | 16:44 |
| ashp | When I start it up: "Created queue: <ChangeQueue config_gate: metacloud/spine-config>" | 16:45 |
| *** Masahiro has joined #openstack-infra | 16:46 | |
| *** luqas has joined #openstack-infra | 16:46 | |
| *** luqas__ has quit IRC | 16:46 | |
| jeblair | ashp: can you paste your whole config file? | 16:46 |
| ashp | jeblair: I can, hang on | 16:47 |
| *** dims_ is now known as dimsum__ | 16:47 | |
| clarkb | odyssey4me: no it does not need to start with dsvm | 16:47 |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Set check-ansible-aio-build to use devstack-trusty image https://review.openstack.org/139676 | 16:47 |
| clarkb | odyssey4me: if you grep for 'dsvm' in project-config you should get many examples | 16:48 |
| odyssey4me | clarkb: I pretty much did that and think I have it | 16:48 |
| odyssey4me | thanks :) | 16:48 |
| *** xyang1 has joined #openstack-infra | 16:48 | |
| *** mjturek has quit IRC | 16:48 | |
| annegentle | fungi: I'm merging the changes from wiki to docs, but wondered what the mechanism is for redirects in the wiki? | 16:48 |
| ashp | jeblair: http://pastebin.com/Mnk5hgQh | 16:49 |
| clarkb | odyssey4me: yup +2 | 16:49 |
| ashp | jeblair: if it's a horror I apologize, I inherited it | 16:49 |
| *** luqas__ has joined #openstack-infra | 16:49 | |
| *** otter768 has joined #openstack-infra | 16:49 | |
| *** luqas has quit IRC | 16:50 | |
| *** Masahiro has quit IRC | 16:50 | |
| clarkb | annegentle: http://www.mediawiki.org/wiki/Help:Redirects like that? | 16:51 |
| *** luqas__ has quit IRC | 16:51 | |
| *** luqas__ has joined #openstack-infra | 16:52 | |
| *** emagana_ has joined #openstack-infra | 16:52 | |
| *** thedodd has joined #openstack-infra | 16:53 | |
| *** luqas__ has quit IRC | 16:53 | |
| jeblair | ashp: okay, so what happens is that when you upload a patchset, zuul creates an event for each pipeline that has a matching trigger | 16:53 |
| *** luqas__ has joined #openstack-infra | 16:53 | |
| jeblair | ashp: the 'check' pipeline triggers on 'patchset-created' so that fires off an event | 16:54 |
| *** otter768 has quit IRC | 16:54 | |
| jeblair | ashp: the spine-config project, however, does not have any 'check' jobs defined, so it emits the error message we saw earlier and processing for that pipeline is complete | 16:54 |
| jeblair | ashp: then it moves on to the next one | 16:54 |
| clarkb | jeblair: last chance to review https://review.openstack.org/#/c/137401/ othrewise I will just approve it | 16:54 |
| *** mwagner_lap has quit IRC | 16:54 | |
| clarkb | (you had suggested that fix so I thought oyu may be interested) | 16:55 |
| ashp | Ah, hmm, I wonder how this worked in our old environment then, maybe zuul was just significantly different back then | 16:55 |
| ashp | our old system is running zuul from about 2.5 years ago | 16:55 |
| jeblair | ashp: config_gate is apparently supposed to trigger on it, however, it will only trigger on a patchset-created event if it arrives with a workflow=1 vote attached to it | 16:55 |
| *** emagana has quit IRC | 16:55 | |
| *** luqas__ has quit IRC | 16:55 | |
| jeblair | ashp: that can't ever actually happen, so it does not match the config_gate pipeline and no event fires, and processing continues to the next one | 16:56 |
| *** luqas has joined #openstack-infra | 16:56 | |
| ashp | ahhhhhh | 16:56 |
| jeblair | ashp: gate does not match patchset-created so it's done | 16:56 |
| ashp | OK, that makes sense | 16:56 |
| *** talluri has quit IRC | 16:56 | |
| jeblair | ashp: i'm guessing from names that maybe you want to change 'patchset-created' to 'comment-added' within the config_gate pipeline definition, to make it more like gate | 16:56 |
| sdague | fungi: so fwiw, we do seem to have hit capacity with the building nodes | 16:57 |
| *** luqas has quit IRC | 16:57 | |
| sdague | and they are growing | 16:57 |
| jeblair | ashp: though i don't actually see the difference immediately, and wonder why you don't just use gate | 16:57 |
| *** luqas has joined #openstack-infra | 16:57 | |
| ashp | I honestly have no idea why it's different, it may honestly be a weird legacy attempt at something | 16:57 |
| jeblair | sdague: that probably means the hpcloud problem is ongoing | 16:57 |
| sdague | jeblair: yeh, so like all of hpcloud is offline? | 16:58 |
| pleia2 | good morning | 16:58 |
| jeblair | sdague: not all, there's still quite a bit of capacity in use | 16:58 |
| jeblair | s/quite a bit/a bit/ :) | 16:59 |
| jeblair | enough to make it confusing at least | 16:59 |
| sdague | ok | 16:59 |
| *** luqas__ has joined #openstack-infra | 17:00 | |
| sdague | yeh, the 450+ building nodes definitely makes it confusing | 17:00 |
| *** luqas has quit IRC | 17:00 | |
| jeblair | 369 out of 479 hpcloud nodes are building | 17:01 |
| ashp | changed to use gate, still didn't find a change queue | 17:01 |
| ashp | guess I should try check :) | 17:01 |
| clarkb | I think you want both check and gate | 17:01 |
| ashp | yep | 17:02 |
| *** emagana_ has quit IRC | 17:02 | |
| *** luqas has joined #openstack-infra | 17:03 | |
| *** luqas__ has quit IRC | 17:03 | |
| odyssey4me | clarkb: it appears that something's wrong in the project layout - must the dvsm job be in quotes or something? | 17:04 |
| *** xyang1 has quit IRC | 17:04 | |
| *** luqas has quit IRC | 17:04 | |
| *** cdent has quit IRC | 17:04 | |
| *** luqas has joined #openstack-infra | 17:05 | |
| *** rdopiera has quit IRC | 17:05 | |
| clarkb | odyssey4me: it already is in quotes | 17:05 |
| clarkb | odyssey4me: the quotes are important in yaml when you use {} as {} may mean a dict starts here | 17:05 |
| *** lbiasi has joined #openstack-infra | 17:05 | |
| jeblair | i think the hpcloud problem stopped a bit over 1.5 hours ago based on building times | 17:05 |
| jeblair | i will restart nodepool | 17:05 |
| openstackgerrit | Merged openstack-infra/reviewday: Workflow documentation is now in infra-manual https://review.openstack.org/139430 | 17:06 |
| clarkb | odyssey4me: I see the problem | 17:06 |
| *** mrmartin has quit IRC | 17:07 | |
| clarkb | odyssey4me: commented on the change | 17:07 |
| *** luqas has quit IRC | 17:07 | |
| *** luqas__ has joined #openstack-infra | 17:07 | |
| odyssey4me | clarkb: ah, both the quotes - and of course the : | 17:08 |
| odyssey4me | thanks | 17:08 |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Set check-ansible-aio-build to use devstack-trusty image https://review.openstack.org/139676 | 17:09 |
| *** xyang1 has joined #openstack-infra | 17:09 | |
| david-lyle | question about getting xstatic-* packages to publish to pypi on tag push, do I just need to add them to project-config/zuul/layout.yaml? I think openstackci has been added as a Package Index Owner on them in pypi already | 17:09 |
| dhellmann | sdague: where do we stand with https://review.openstack.org/#/c/139634/2 and https://review.openstack.org/#/c/139631 ? (looks like we're waiting for tests on the latter) | 17:09 |
| *** yjiang5 is now known as yjiang5_away | 17:09 | |
| *** erlon has quit IRC | 17:09 | |
| *** luqas___ has joined #openstack-infra | 17:09 | |
| *** luqas__ has quit IRC | 17:10 | |
| clarkb | david-lyle: yup. If pypi has the packages and openstackci is an owner then the last step is getting the jobs in the zuul layout file | 17:10 |
| jeblair | clarkb, yolanda: 137401 wasn't quite the implementation i was expecting; left a comment on it | 17:10 |
| clarkb | jeblair: thank you | 17:10 |
| *** marun has joined #openstack-infra | 17:10 | |
| *** arxcruz has quit IRC | 17:11 | |
| *** luqas___ has quit IRC | 17:11 | |
| *** luqas___ has joined #openstack-infra | 17:12 | |
| *** HeOS_ has quit IRC | 17:12 | |
| *** talluri has joined #openstack-infra | 17:12 | |
| openstackgerrit | Jan Klare proposed openstack-infra/project-config: Added gate-{name}-chef-rake job-template https://review.openstack.org/137134 | 17:13 |
| yolanda | jeblair, so the idea is to preserve the method in provider_manager, but not use submitTask there, right? | 17:13 |
| jeblair | yolanda: yes, then it should be a fairly small change and keeps the interface consistent | 17:13 |
| *** luqas___ has quit IRC | 17:13 | |
| *** luqas__ has joined #openstack-infra | 17:13 | |
| yolanda | jeblair, ok | 17:14 |
| jeblair | yolanda: (and keeps api details out of nodepool.py) | 17:14 |
| clarkb | yolanda: I commented on https://review.openstack.org/#/c/129560/ too | 17:14 |
| *** vigneshvar has joined #openstack-infra | 17:14 | |
| yolanda | jeblair, i'll update it on monday | 17:14 |
| yolanda | btw, we have the change running privately and solved the bug for us, so it's working fine and the general idea worked | 17:15 |
| yolanda | clarkb, i saw it, good point | 17:15 |
| *** luqas__ has quit IRC | 17:15 | |
| *** luqas__ has joined #openstack-infra | 17:16 | |
| *** luqas__ has quit IRC | 17:17 | |
| *** luqas__ has joined #openstack-infra | 17:18 | |
| *** shashankhegde has joined #openstack-infra | 17:18 | |
| openstackgerrit | Merged openstack-infra/system-config: Clarify puppet apply iteration docu https://review.openstack.org/139131 | 17:18 |
| *** Ryan_Lane has joined #openstack-infra | 17:18 | |
| jeblair | yolanda: great! hopefully we can run it upstream soon :) | 17:19 |
| yolanda | jeblair, clarkb, i published the spec for image testing in nodepool as well | 17:19 |
| annegentle | clarkb: no, I understand how redirects are done within mediawiki, want to ensure we redirect https://wiki.openstack.org/wiki/Gerrit_Workflow to http://docs.openstack.org/infra/manual/developers.html#development-workflow for all traffic | 17:20 |
| clarkb | annegentle: oh you want to redirect to an external site | 17:20 |
| *** xyang1 has quit IRC | 17:20 | |
| annegentle | we'll have the same need for wiki.openstack.org/blahbahtcblah to governance.openstack.org | 17:20 |
| *** Sincler has joined #openstack-infra | 17:21 | |
| annegentle | right and fungi has been doing a lot of patches, which is fine for our stuff, but we need a redirect for all the pages we don't have control of | 17:21 |
| *** subscope has joined #openstack-infra | 17:21 | |
| *** xyang1 has joined #openstack-infra | 17:21 | |
| clarkb | fungi and ttx will have to chime in for what they inteded on doing but I thought they would just edit the pages to link to the new site? looks like there is an extension for mediawiki that allows external redirects but "its a security risk" | 17:22 |
| *** luqas__ has quit IRC | 17:22 | |
| subscope | hi | 17:22 |
| clarkb | hello | 17:22 |
| subscope | Is there any way to retrigger database CI tests from gerrit? | 17:23 |
| ashp | clarkb: ah, our madness around projects was because that one job is meant to auto-merge if approved | 17:23 |
| annegentle | clarkb: fungi: ugh on security risk. Seems like we need a solution. That page is sixth-highest visited for the wiki. | 17:23 |
| ashp | clarkb: maybe there is a cleaner way to handle that these days :) | 17:23 |
| *** talluri has quit IRC | 17:24 | |
| *** andreykurilin_ has quit IRC | 17:24 | |
| *** mikedillion has quit IRC | 17:24 | |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Set check-ansible-aio-build to use devstack-trusty image https://review.openstack.org/139676 | 17:25 |
| *** talluri has joined #openstack-infra | 17:25 | |
| *** mikedillion has joined #openstack-infra | 17:25 | |
| mestery | Hey, question for infra on gerrit groups: Is it intentional that any member of a gerrit group can add/remove members in said group? Just curious. | 17:25 |
| *** shakamunyi has quit IRC | 17:25 | |
| AJaeger | reed: can you update https://wiki.openstack.org/wiki/Main_Page and update the link to the Gerrit_Workflow page with a link to infra manual, please? | 17:25 |
| clarkb | mestery: it should depend on the group. For eg core that is how it works but for the -ci groups only the owner should be able to do that | 17:26 |
| *** sputnik13 has joined #openstack-infra | 17:26 | |
| mestery | clarkb: Cool, just verifying. Tahnks! | 17:26 |
| annegentle | AJaeger: we really need to get an external redirect before we go too crazy here with the GerritWorkflow page moving out :) | 17:26 |
| clarkb | mestery: if you are seeing something diferrent would be good to file a bug | 17:27 |
| annegentle | AJaeger: it's fifth highest if I combine wiki hits for Neutron/ Neutron | 17:27 |
| clarkb | mestery: mostly curious if you are seeing -ci groups being able to self manage (which should not be the case) | 17:27 |
| annegentle | AJaeger: what was the criteria for moving a wiki page to the infra manual? | 17:27 |
| mestery | clarkb: No, the CI groups are self managing just fine, was curiuous on the core groups actually. Didn't expect any core to be able to add/remove. | 17:27 |
| ashp | jeblair: Sorry to keep asking annoying questions but as you were so helpful before - do you know if there's a clean way to auto-merge a gerrit review if jenkins approves it. It's looking more and more like we were exploiting a bug in an old version to achieve this before | 17:28 |
| *** MaxV has quit IRC | 17:28 | |
| AJaeger | annegentle: reed updated one page this way: https://wiki.openstack.org/wiki/ReviewChecklist - but I don't think it's optimal | 17:28 |
| annegentle | AJaeger: hm | 17:28 |
| annegentle | AJaeger: how did you know what to move out? | 17:29 |
| reed | annegentle, AJaeger, I just finished talking briefly with thierry about this very topic | 17:29 |
| AJaeger | jeblair, annegentle I guess a spec for the move to infra-manual would have been great | 17:29 |
| annegentle | AJaeger: :) | 17:29 |
| annegentle | reed: do tell :) | 17:29 |
| nibalizer | ashp: i mean i could come up with some hacks... | 17:29 |
| *** talluri has quit IRC | 17:29 | |
| reed | gutting the wiki the way we've done it is not trivial, its scope has changed quite a lot now | 17:29 |
| reed | we have removed pieces that have been there for a long time, linked from all over | 17:30 |
| clarkb | yolanda: note I am -1 on https://review.openstack.org/#/c/130500/1 because it is not required to make your use case work | 17:30 |
| clarkb | yolanda: 1.15 is valid under the requirements as listed | 17:30 |
| *** Hal_ has quit IRC | 17:30 | |
| reed | I don't know how to fix it | 17:30 |
| AJaeger | reed, we removed reviewchecklist - and all inner wiki links have been updated. | 17:30 |
| ashp | nibalizer: hacks are always good | 17:31 |
| reed | AJaeger, is google aware of that? are internal documents at IBM (for example) updated? | 17:31 |
| ashp | nibalizer: apparently that's what we did before | 17:31 |
| ashp | I am prodding them to stop auto approving things | 17:31 |
| AJaeger | reed: Agreed | 17:31 |
| clarkb | yolanda: and ssh to gracefully fallback to rsa right? | 17:31 |
| yolanda | clarkb, not in our case | 17:31 |
| annegentle | reed: yeah it's the external redirects I'd need to be comfortable with much more movement | 17:31 |
| yolanda | i had to upgrade paramiko because it was giving a cipher errors | 17:31 |
| reed | AJaeger, i'm heading to the home page and fix the visible links | 17:32 |
| clarkb | yolanda: were you giving paramiko an ecdsa private key? | 17:32 |
| annegentle | let's see what clarkb and fungi can come up with for external redirects before anything else moves. | 17:32 |
| AJaeger | thanks, reed | 17:32 |
| clarkb | yolanda: if you give it an rsa key it should work aiui | 17:32 |
| yolanda | clarkb, it was an rsa key, we did not change that | 17:32 |
| AJaeger | annegentle: do you think I can continue fixing the innerwiki links? | 17:32 |
| yolanda | but it got errors when connecting to ssh and aborting | 17:32 |
| annegentle | AJaeger: innerwiki fixing would be good. Let me check the stats on review checklist and such | 17:33 |
| clarkb | hrm, oh is it the host key that it failed on? | 17:33 |
| AJaeger | annegentle: I'm looking at https://wiki.openstack.org/wiki/Special:WhatLinksHere/Gerrit_Workflow and try to make it an empty list ;) | 17:33 |
| yolanda | clarkb, it was working fine for ubuntu nodes but not for debian ones | 17:33 |
| annegentle | reed: also side note, we should figure out how to give more people access to web stats for these kinds of things | 17:33 |
| annegentle | AJaeger: heh. | 17:33 |
| *** _nadya_ has quit IRC | 17:33 | |
| AJaeger | annegentle: https://wiki.openstack.org/wiki/Special:WhatLinksHere/ReviewChecklist is empty already ;) | 17:34 |
| reed | annegentle, install and run piwik on our own? | 17:34 |
| AJaeger | so, only external links | 17:34 |
| nibalizer | ashp: so you could write a little program that watches the gerrit event stream and when it sees the jenkins +1s it adds a +a | 17:34 |
| *** marcusvrn has quit IRC | 17:34 | |
| nibalizer | idunno if you can configure zuul to just report +a instead of v+1 | 17:34 |
| jeblair | reed, annegentle, AJaeger, clarkb, fungi: if nothing else, we can have apache on wiki.o.o permanently redirect for us (which will inform google, etc) | 17:34 |
| clarkb | yolanda: the user key should definitely continue to work, but if the host key is only ecdsa (and maybe if it is rsa too) paramiko might not like that | 17:34 |
| clarkb | jeblair: oh good point | 17:34 |
| reed | annegentle, AJaeger, the (re)design of docs.o.o/developer is now more urgent IMHO | 17:34 |
| yolanda | clarkb, i can do another try and log error to have exact use case | 17:35 |
| annegentle | reed: info arch or the web design? | 17:35 |
| *** marcusvrn has joined #openstack-infra | 17:35 | |
| reed | annegentle, info arch | 17:35 |
| annegentle | reed: docs.openstack.org redesign is my top | 17:35 |
| annegentle | reed: to get the new web design | 17:35 |
| clarkb | yolanda: ok I will remove my -1. I still don't want to merge that until jeblair sorts out gear problems a little bit better. Just in case some external python dependency was causing problems | 17:35 |
| clarkb | jeblair: ^ is that still a concern? | 17:35 |
| annegentle | reed: info arch, boy, that's not a project for anyone now is it? | 17:35 |
| *** mestery has quit IRC | 17:35 | |
| reed | info architecture first... I have a draft, didn't have time to complete it | 17:36 |
| AJaeger | jeblair: yeah, let's do that | 17:36 |
| reed | s/complete/ put it in a form that looks like a conversation starter | 17:36 |
| annegentle | reed: ok cool, I know you mentioned it but didn't know how far you got. It would be great to meet on that | 17:36 |
| annegentle | reed: since the web design will be applied as well | 17:36 |
| jeblair | clarkb: which? | 17:36 |
| *** shashankhegde has quit IRC | 17:36 | |
| jeblair | oh there's a new web design, neat. | 17:36 |
| clarkb | jeblair: updating nodepool dependencies. In this case paramiko and python-glanceclient | 17:36 |
| reed | AJaeger, where should the wiki home page link to? | 17:36 |
| jeblair | clarkb: can we defer that a bit longer? | 17:37 |
| clarkb | jeblair: we had been concerned that since they would all be latest versions on new trusty node that that may have contributed to some of the gear trouble | 17:37 |
| reed | there is no 1-1 link from gerritWorkflow to new manual, isn't there? | 17:37 |
| clarkb | jeblair: yup I don't think its urgent. The requireemnts files allow ou to install newer versions if you want them | 17:37 |
| clarkb | yolanda: ^ | 17:37 |
| ashp | nibalizer: yeah I think I'll suggest they just use the approve button :D | 17:37 |
| *** tonytan4ever has quit IRC | 17:37 | |
| annegentle | jeblair: reed: I'd love more eyes on the spec for implementing the redesign: https://review.openstack.org/#/c/139154/ | 17:37 |
| ashp | nibalizer: I don't need more custom madness, we already have enough of that | 17:37 |
| clarkb | yolanda: maybe we can WIP those changes until we are ready to update those dependencies? | 17:37 |
| annegentle | have to head to lunch but would seriously appreciate input | 17:37 |
| AJaeger | reed: I would like to the "Developer's Guide": http://docs.openstack.org/infra/manual/developers.html | 17:37 |
| * nibalizer nods | 17:37 | |
| *** beekneemech has quit IRC | 17:37 | |
| clarkb | https://review.openstack.org/#/c/128368/1 and https://review.openstack.org/#/c/130500/1 | 17:37 |
| reed | AJaeger, deal | 17:38 |
| yolanda | clarkb, fine for me | 17:38 |
| *** jklare has quit IRC | 17:38 | |
| jeblair | annegentle: oh awesome, i will look at that, thanks | 17:38 |
| jeblair | clarkb: i'm going to go work on gear stuff | 17:39 |
| *** Ryan_Lane has quit IRC | 17:39 | |
| clarkb | jeblair: aewsome. gl | 17:40 |
| reed | AJaeger, done, please check it | 17:40 |
| *** mikedillion has quit IRC | 17:40 | |
| AJaeger | reed: remove the "|" | 17:40 |
| *** mpaolino has quit IRC | 17:40 | |
| clarkb | yolanda: and finally I responded to your comments on https://review.openstack.org/#/c/126747/. will get a new patch up today | 17:40 |
| *** derekh has quit IRC | 17:40 | |
| yolanda | clarkb, i saw that, you look so busy | 17:40 |
| *** jklare has joined #openstack-infra | 17:41 | |
| AJaeger | reed, same with "Guidelines for Code reviewers" | 17:41 |
| clarkb | yolanda: just trying to catch up on nodepool :) | 17:41 |
| reed | thanks AJaeger | 17:41 |
| AJaeger | looks fine now, reed ! Thanks! | 17:42 |
| *** dannywilson has joined #openstack-infra | 17:42 | |
| *** zz_avozza is now known as avozza | 17:42 | |
| *** ayoung has quit IRC | 17:44 | |
| *** jistr has quit IRC | 17:45 | |
| *** ddieterly has quit IRC | 17:46 | |
| *** dannywilson has quit IRC | 17:46 | |
| *** yamamoto has quit IRC | 17:49 | |
| *** HeOS_ has joined #openstack-infra | 17:50 | |
| *** lttrl has joined #openstack-infra | 17:51 | |
| *** koolhead17 has joined #openstack-infra | 17:52 | |
| *** ddieterly has joined #openstack-infra | 17:53 | |
| *** pblaho has quit IRC | 17:54 | |
| *** ddieterly has quit IRC | 17:54 | |
| clarkb | ok I marked those nodepool changes WIP | 17:54 |
| zaro | morning | 17:55 |
| clarkb | good morning | 17:55 |
| *** rickerc_ has joined #openstack-infra | 17:55 | |
| *** krtaylor has quit IRC | 17:56 | |
| *** ddieterly has joined #openstack-infra | 17:56 | |
| *** HeOS has quit IRC | 17:56 | |
| *** rickerc has quit IRC | 17:56 | |
| *** rickerc_ is now known as rickerc | 17:56 | |
| *** craigbr has joined #openstack-infra | 17:57 | |
| *** boris-42 has joined #openstack-infra | 17:57 | |
| *** BobBall is now known as BobBall_AWOL | 17:57 | |
| AJaeger | why has every project it's own section on how to contribute in the wiki? That wiki is full of duplication ;( | 17:59 |
| *** jgallard has quit IRC | 17:59 | |
| *** rickerc_ has joined #openstack-infra | 18:00 | |
| *** rickerc has quit IRC | 18:01 | |
| *** rickerc_ is now known as rickerc | 18:01 | |
| pleia2 | AJaeger: yeah, and they aren't updated, that's why we don't love the wiki :) | 18:01 |
| *** rwsu has joined #openstack-infra | 18:02 | |
| *** shashankhegde has joined #openstack-infra | 18:03 | |
| *** wuhg has quit IRC | 18:03 | |
| *** patrickeast has joined #openstack-infra | 18:05 | |
| *** emagana_ has joined #openstack-infra | 18:05 | |
| *** subscope has quit IRC | 18:06 | |
| *** melwitt has joined #openstack-infra | 18:06 | |
| *** shakamunyi has joined #openstack-infra | 18:07 | |
| cloudnull | Is there something that needs to be setup to be able to delete a "proposed/*" branch on a stackforge project? | 18:07 |
| craigbr | We finally pushed a new tag for python-monascaclient and that updated enough of the openstack pypi mirrors to get our check jobs to run but http://pypi.region-b.geo-1.openstack.org/simple/python-monascaclient/ did not get the new one and the gate job fails. Is there any way to fix pypi.region-b.geo-1.openstack.org? See https://review.openstack.org/139198 | 18:07 |
| clarkb | craigbr: how recently did you push the new tag? | 18:08 |
| *** achanda has joined #openstack-infra | 18:08 | |
| *** lbiasi_ has joined #openstack-infra | 18:08 | |
| *** esker has joined #openstack-infra | 18:08 | |
| odyssey4me | I take it that nodepool is still in a half state of being? The node count seems very, very low. | 18:08 |
| *** esker has quit IRC | 18:08 | |
| *** esker has joined #openstack-infra | 18:09 | |
| *** mrmartin has joined #openstack-infra | 18:09 | |
| *** mestery has joined #openstack-infra | 18:09 | |
| craigbr | about 2 hours ago | 18:09 |
| pleia2 | fungi: happen to be about? could use a quick chat about some of your doc changes | 18:10 |
| *** sputnik13 has quit IRC | 18:10 | |
| *** sputnik13 has joined #openstack-infra | 18:11 | |
| clarkb | craigbr: it appears that that bandersnatch has fallen way behind again :/ I have manually started a resync | 18:12 |
| *** lbiasi has quit IRC | 18:12 | |
| *** lbiasi_ is now known as lbiasi | 18:12 | |
| clarkb | doing it in the foreground too to see if I can catch it falling over | 18:12 |
| *** krtaylor has joined #openstack-infra | 18:13 | |
| craigbr | clarkb: Thanks | 18:13 |
| clarkb | cloudnull: yes, but we don't hand it out because gerrit isn't very good about delete permissions | 18:13 |
| clarkb | it requires "ownership" which lets you do a whole host of things | 18:13 |
| *** dtantsur is now known as dtantsur|afk | 18:13 | |
| *** mwagner_lap has joined #openstack-infra | 18:14 | |
| *** pelix has quit IRC | 18:14 | |
| cloudnull | clarkb: for integration branches do I need to raise a ticket to have them removed? | 18:15 |
| *** ChuckC has quit IRC | 18:16 | |
| *** marcusvrn has quit IRC | 18:16 | |
| *** ivar-lazzaro has joined #openstack-infra | 18:16 | |
| fungi | pleia2: yep, back now. took longer than anticipated | 18:17 |
| clarkb | cloudnull: any branch removal will require that | 18:17 |
| clarkb | fungi: ^ iirc we talked about this recently | 18:17 |
| *** avozza is now known as zz_avozza | 18:17 | |
| *** achanda has quit IRC | 18:17 | |
| fungi | pleia2: chat away, though i'm going to also catch up on the massive scrollback | 18:17 |
| cloudnull | clarkb: tyvm, will do. | 18:17 |
| *** achanda has joined #openstack-infra | 18:18 | |
| pleia2 | fungi: I started leaving -1s :) this is an issue in many patches, including merged 139428: https://review.openstack.org/#/c/139416/1/CONTRIBUTING.rst | 18:18 |
| pleia2 | fungi: I can keep with the -1s so they don't get merged and you can identify them easily | 18:18 |
| fungi | pleia2: yeah, we could do that. i pondered taking that route, but the contents/formats/names of those files varies so widely it's not easy to solve without manual editing | 18:19 |
| pleia2 | 139431 merged too | 18:19 |
| pleia2 | it's confusing as it is now, tells users to reread | 18:19 |
| fungi | pleia2: i'd estimate somewhere along the lines of 100 projects have some semblance of that | 18:20 |
| fungi | pleia2: about half the ones i updatyed | 18:20 |
| *** ayoung has joined #openstack-infra | 18:20 | |
| openstackgerrit | Lin Hua Cheng proposed openstack/requirements: Update xstatic-font-awesome to 4.2.0 https://review.openstack.org/139207 | 18:20 |
| openstackgerrit | David Lyle proposed openstack-infra/reviewstats: Updating horizon core https://review.openstack.org/139694 | 18:20 |
| *** teran_ has quit IRC | 18:20 | |
| pleia2 | fungi: some of the wording is ok so I've left those, but the one I identified really should be fixed somehow, it pretty much says the same thing "read this, then read this, which is included in the first already" | 18:20 |
| fungi | pleia2: i can take a stab at identifying and updating those, but was hoping to get some collaborative effort from individual projects to further refine those starting points | 18:20 |
| pleia2 | I'll keep combing through them | 18:21 |
| *** baoli has quit IRC | 18:22 | |
| fungi | pleia2: ideally, i think the contributing et cetera files should have linked to the developer section of how to contribute rather than calling out the readable name of it. that would have resulted in me more easily linking to the account setup section of the developers guide instead | 18:22 |
| pleia2 | hindsight, eh? | 18:22 |
| *** achanda has quit IRC | 18:22 | |
| fungi | which i think was the original intent of that paragraph | 18:22 |
| *** gyee has joined #openstack-infra | 18:23 | |
| *** baoli has joined #openstack-infra | 18:24 | |
| *** baoli has quit IRC | 18:25 | |
| *** gyee has quit IRC | 18:25 | |
| *** gyee has joined #openstack-infra | 18:25 | |
| *** baoli has joined #openstack-infra | 18:25 | |
| pleia2 | ok, I think I've reviewed them all | 18:26 |
| dhellmann | fungi, anteaya : could you take a look at https://review.openstack.org/#/c/139634/2 when you have a few minutes, please? Oslo is sorta blocked until we fix the way some of the stable jobs run, and this will unblock a few libs for us I think | 18:28 |
| *** radez is now known as radez_g0n3 | 18:29 | |
| openstackgerrit | Julien Danjou proposed openstack-infra/git-review: Allow to specify which commit to send https://review.openstack.org/139701 | 18:30 |
| *** harlowja_away is now known as harlowja_ | 18:31 | |
| *** thedodd has quit IRC | 18:32 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Support multiple image formats in a diskimage https://review.openstack.org/126747 | 18:32 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Remove unnecessary path joining for dib filenames https://review.openstack.org/139704 | 18:32 |
| *** jerryz has quit IRC | 18:33 | |
| *** marcusvrn has joined #openstack-infra | 18:34 | |
| *** amcrn has joined #openstack-infra | 18:34 | |
| *** Masahiro has joined #openstack-infra | 18:35 | |
| fungi | okay, caught up on scrollback | 18:35 |
| *** gyee has quit IRC | 18:35 | |
| fungi | annegentle: pleia2: AJaeger: clarkb: jeblair: so the point of my change flurry last night was to preemptively drive down traffic currently heading to the somewhat gutted wiki pages from individual project dev workflow instructions. i agree some could probably use improvement so feel free to -1 where you like. as for wiki redirects, for infra documents we can definitely add rewrites in apache when it | 18:37 |
| fungi | makes sense | 18:37 |
| *** e0ne has quit IRC | 18:37 | |
| fungi | we can likely do the same for non-infra documents too, if there's a need | 18:38 |
| *** chuckC_ has joined #openstack-infra | 18:38 | |
| *** gyee has joined #openstack-infra | 18:38 | |
| fungi | i'd like to limit that to particularly formerly popular wiki pages though | 18:38 |
| *** gyee has quit IRC | 18:38 | |
| *** gyee has joined #openstack-infra | 18:39 | |
| jkt | can I somehow trigger a zuul job for a pipeline which listens just for ref-updated? | 18:39 |
| fungi | otherwise, leaving a hyperlink in the document saying it has moved somewhere else is i think fine for less heavily-trafficed articles in that situation | 18:39 |
| *** Masahiro has quit IRC | 18:39 | |
| clarkb | jkt: typically that requires access to the gearman bus where jobs can just be run directly | 18:39 |
| clarkb | jkt: what are you trying to do? | 18:39 |
| fungi | jkt: there is a script in the zuul repo which injects work requests directly into gearman | 18:39 |
| *** SumitNaiksatam has quit IRC | 18:39 | |
| clarkb | jkt: just rerun a failed job or have manual control over some refs? | 18:39 |
| clarkb | and ya that script in the zuul repo is the way to do it | 18:40 |
| jkt | clarkb: in KDE, we have a ton of depending projects, and just some "leaves" of that dep tree are in zuul | 18:40 |
| fungi | note that the script really isn't retriggering it "in zuul" so much as "in gearman" (the zuul scheduler will know nothing about it, and so it won't appear in zuul's status data) | 18:40 |
| jkt | clarkb: I was thinking about importing all of them into gerrit, and letting the ref-updated trigger a rebuild of the libraries | 18:40 |
| *** emagana_ has quit IRC | 18:40 | |
| jkt | clarkb: the idea is to keep these outside-of-gerrit-active-review dependencies up-to-date so that actual, real, reviewed projects are checked against a fresh state | 18:41 |
| jeblair | clarkb, fungi: found it. it's slightly embarassing. :) | 18:41 |
| *** Ryan_Lane has joined #openstack-infra | 18:41 | |
| *** emagana has joined #openstack-infra | 18:41 | |
| fungi | jkt: our post pipeline works on ref-updated events i believe | 18:41 |
| clarkb | jkt: so that should just work if you have them in gerrit. If you don't have them in gerrit then I think you will want to use the script and fire it off some other way | 18:41 |
| clarkb | jkt: maybe by polling HEAD of those projects? | 18:41 |
| jkt | fungi: do you mean the enqueue thing? that appears to work just on gerrit changes (and I tried that) | 18:42 |
| *** ashaeron has joined #openstack-infra | 18:42 | |
| fungi | jkt: no, zuul listens to the gerrit event stream. projects defined in layout.yaml with post pipeline jobs should trigger them on ref-updated | 18:42 |
| clarkb | jeblair: \o/ | 18:42 |
| jkt | clarkb: the projects are semi-dormant, and because of a globally set replication, I would like to avoid pushing some older commit into gerrit's mirror | 18:42 |
| fungi | jeblair: clearly we should all be embarrassed if it's taken us staring at it for this long. change coming? | 18:43 |
| jkt | fungi: yes, and I'm asking whether it's possible to trigger that by hand, "as if it happened" | 18:43 |
| clarkb | jkt: it is let me dig it up | 18:43 |
| fungi | jkt: oh, okay. then yes the trigger-job.py | 18:43 |
| fungi | jkt: sudo /opt/zuul/tools/trigger-job.py --url=http://zm07.openstack.org/p --job static-governance-publish --project openstack/governance --pipeline post --newrev 2fb800ac7f38d489da2eb35e5f8edcdc21938ece --refname master --logpath 2f/2fb800ac7f38d489da2eb35e5f8edcdc21938ece/post/static-governance-publish/a368683 | 18:43 |
| *** dannywilson has joined #openstack-infra | 18:44 | |
| jkt | fungi: ah thanks, that's exactly what I was looking for | 18:44 |
| clarkb | jkt: zuul/tools/trigger-job.py is the script you want. We haven't fully pulled that into zuul enqueue yet | 18:44 |
| *** shakamunyi has quit IRC | 18:44 | |
| clarkb | zuul enqueue operates with zuul. trigger-job.py operates with gearman directly | 18:44 |
| *** dannywilson has quit IRC | 18:44 | |
| *** emagana has quit IRC | 18:45 | |
| clarkb | jeblair: I am excited to review the fix | 18:46 |
| *** shakamunyi has joined #openstack-infra | 18:46 | |
| *** nfedotov has joined #openstack-infra | 18:48 | |
| *** shakamunyi has quit IRC | 18:48 | |
| AJaeger | Updated wiki internal links for Gerrit_Workflow https://wiki.openstack.org/wiki/Special:WhatLinksHere/Gerrit_Workflow | 18:48 |
| *** talluri has joined #openstack-infra | 18:48 | |
| *** jp_at_hp has quit IRC | 18:49 | |
| *** zz_avozza is now known as avozza | 18:49 | |
| fungi | clarkb: jeblair: i think we're overdue to approve https://review.openstack.org/119466 but right before the weekend seems like bad timing... any objections to me pulling the trigger on that monday morning? | 18:49 |
| *** yamamoto has joined #openstack-infra | 18:49 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Explain Zuul setup without gating https://review.openstack.org/139678 | 18:50 |
| *** ashaeron has quit IRC | 18:50 | |
| clarkb | fungi: Ithink you can do it now. That shouldn't actually change the mirror | 18:50 |
| clarkb | its code celanup that won't hit the server | 18:50 |
| *** otter768 has joined #openstack-infra | 18:50 | |
| fungi | it will make /srv/static/mirror/web/openstack absent | 18:51 |
| pleia2 | fungi: if we can decide on alternate text for https://review.openstack.org/#/c/139416 I can push up changes to all the rest of them and fix the ones that already merged (I'm sure you have better things to do :)) | 18:51 |
| fungi | pleia2: i welcome the help, though i don't want to pretend your time is any less valuable than mine | 18:51 |
| AJaeger | Do we have some todo list on what needs to be done for the infra-manual? There's still some wiki work to do. | 18:52 |
| AJaeger | Should we use the etherpad for that? | 18:52 |
| *** shakamunyi has joined #openstack-infra | 18:52 | |
| pleia2 | AJaeger: yeah, keep using the wiki | 18:52 |
| pleia2 | err etherpad | 18:53 |
| fungi | heh | 18:53 |
| dhellmann | fungi, anteaya : could you take a look at https://review.openstack.org/#/c/139634/2 when you have a few minutes, please? Oslo is sorta blocked until we fix the way some of the stable jobs run, and this will unblock a few libs for us I think | 18:53 |
| *** prad has quit IRC | 18:53 | |
| fungi | pleia2: i like your proposed wording just fine | 18:53 |
| dhellmann | the other patch is in devstack, so I'm looking for reviewers there, too | 18:53 |
| pleia2 | fungi: ok, thanks | 18:54 |
| fungi | dhellmann: yep, was just looking at that | 18:54 |
| clarkb | fungi: no that was already done in a previous change | 18:54 |
| dhellmann | fungi: thanks | 18:54 |
| clarkb | fungi: tl;dr I think its perfectly fine to approve that now | 18:54 |
| fungi | clarkb: oh, great | 18:54 |
| clarkb | then monday we can rm the vhost | 18:54 |
| *** xyang1 has quit IRC | 18:54 | |
| fungi | clarkb: and then once it merges... | 18:54 |
| fungi | yeah, that | 18:54 |
| fungi | can happen | 18:54 |
| *** avozza is now known as zz_avozza | 18:54 | |
| *** otter768 has quit IRC | 18:54 | |
| *** yamamoto has quit IRC | 18:54 | |
| *** ZZelle has quit IRC | 18:57 | |
| *** ZZelle has joined #openstack-infra | 18:58 | |
| *** tonytan4ever has joined #openstack-infra | 18:59 | |
| *** Ryan_Lane has quit IRC | 18:59 | |
| *** Ryan_Lane has joined #openstack-infra | 18:59 | |
| AJaeger | pleia2: starting at line 82 in https://etherpad.openstack.org/p/infra-manual-sprint-December-2014 | 19:01 |
| AJaeger | fungi, pleia2 could you review the above and check that the list of pages is complete, please? | 19:01 |
| *** nfedotov has quit IRC | 19:03 | |
| *** thedodd has joined #openstack-infra | 19:04 | |
| *** nfedotov has joined #openstack-infra | 19:05 | |
| *** MarkAtwood has joined #openstack-infra | 19:08 | |
| *** SumitNaiksatam has joined #openstack-infra | 19:09 | |
| fungi | AJaeger: there are parts of how to contribute which also got extracted into infra-manual, so i've added notes for them in the etherpad | 19:09 |
| *** sputnik13 has quit IRC | 19:11 | |
| *** emagana has joined #openstack-infra | 19:12 | |
| *** sputnik13 has joined #openstack-infra | 19:12 | |
| pleia2 | AJaeger: thanks, reviewing | 19:12 |
| *** talluri has quit IRC | 19:13 | |
| *** teran has joined #openstack-infra | 19:13 | |
| *** teran has quit IRC | 19:14 | |
| AJaeger | thanks! | 19:15 |
| reed | fungi, I disagree with this change https://review.openstack.org/#/c/139345/1/classic_fancy/index.html.tmpl | 19:16 |
| *** emagana has quit IRC | 19:16 | |
| *** dprince_ has joined #openstack-infra | 19:17 | |
| fungi | reed: me too! i'll revert it | 19:17 |
| *** mikedillion has joined #openstack-infra | 19:17 | |
| reed | ok, thanks | 19:17 |
| *** stevemar2 has joined #openstack-infra | 19:18 | |
| *** dprince has quit IRC | 19:18 | |
| *** stevemar has quit IRC | 19:18 | |
| fungi | reed: https://review.openstack.org/139713 | 19:19 |
| *** gothicmindfood has quit IRC | 19:19 | |
| fungi | reed: want to do the honors of approving that? | 19:20 |
| * fungi is not in the core of the planet | 19:20 | |
| mtreinish | clarkb, jeblair: if you get a sec do you want to help push through the mysql-proxy stuff? | 19:21 |
| nibalizer | mtreinish: can you link it? | 19:21 |
| nibalizer | i dont have core but i can review | 19:22 |
| *** craigbr has quit IRC | 19:22 | |
| nibalizer | iirc its ready | 19:22 |
| mtreinish | nibalizer: I think you already did :) | 19:22 |
| mtreinish | https://review.openstack.org/122311 and https://review.openstack.org/138853 | 19:22 |
| nibalizer | okay so no new patchsets? | 19:22 |
| mtreinish | I guess you didn't review the second one, but it's pretty straightforward | 19:22 |
| *** teran has joined #openstack-infra | 19:23 | |
| *** lukego has joined #openstack-infra | 19:23 | |
| *** lukego has quit IRC | 19:23 | |
| nibalizer | :) lgtm | 19:24 |
| reed | fungi, since ttx approved the other one shall we wait for him? | 19:24 |
| mtreinish | oops, actually just found an issue with that first patch. I forgot to update the worker in site.pp to use the splited hiera entries | 19:24 |
| *** craigbr has joined #openstack-infra | 19:25 | |
| *** gothicmindfood has joined #openstack-infra | 19:25 | |
| *** ayoung has quit IRC | 19:25 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/system-config: Switch subunit2sql to use decomposed uri https://review.openstack.org/138853 | 19:27 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/system-config: Add mysql-proxy to enable read-only access to a db https://review.openstack.org/122311 | 19:27 |
| mtreinish | fungi: ^^^ the first patch had to be respun... | 19:27 |
| fungi | reed: no, i think revert etiquitte is to approve asap and then discuss as needed. it can always be reproposed later if there is consensus | 19:28 |
| fungi | mtreinish: oh, whoops! great catch | 19:29 |
| *** packet has joined #openstack-infra | 19:31 | |
| *** xyang1 has joined #openstack-infra | 19:31 | |
| *** thedodd has quit IRC | 19:32 | |
| *** sarob has joined #openstack-infra | 19:33 | |
| *** _nadya_ has joined #openstack-infra | 19:34 | |
| openstackgerrit | Merged openstack-infra/system-config: Remove pypi mirror from static.openstack.org https://review.openstack.org/119466 | 19:34 |
| *** gyee has quit IRC | 19:34 | |
| *** dannywilson has joined #openstack-infra | 19:35 | |
| *** tonytan_brb has joined #openstack-infra | 19:36 | |
| *** ihrachyshka has quit IRC | 19:37 | |
| *** tonytan4ever has quit IRC | 19:37 | |
| openstackgerrit | Merged openstack-infra/project-config: Clean up Oslo stable compat jobs https://review.openstack.org/139634 | 19:37 |
| clarkb | fungi: I think jeblair is trying to make the gear thing as suspenseful as possible | 19:38 |
| *** ihrachyshka has joined #openstack-infra | 19:38 | |
| clarkb | mtreinish: I will put mysql thing on queue for this afternoon | 19:39 |
| clarkb | I haven't looked at the proxy changes yet | 19:39 |
| dougwig | anteaya, fungi - got a sec to chat about splitting the neutron repo? the new repos got created empty a few days ago. i've got a script that splits out the relevant commits and prunes history. i don't have rights to push directly to openstack repos. how can i/we get the new repo/commits/history up to the new empty repos (timeframe early next week) ? | 19:39 |
| *** nfedotov1 has joined #openstack-infra | 19:39 | |
| *** nfedotov has quit IRC | 19:40 | |
| clarkb | why did we create the repos as empty? | 19:40 |
| clarkb | was that just a miscommunication? | 19:40 |
| *** sarob has quit IRC | 19:40 | |
| dougwig | yes, i believe that was wires being crossed. | 19:41 |
| *** thedodd has joined #openstack-infra | 19:41 | |
| *** nfedotov1 has quit IRC | 19:41 | |
| mestery | Yeah, we jumped the gun a bit I think. | 19:41 |
| *** bdpayne has joined #openstack-infra | 19:41 | |
| mestery | clarkb: ^^^ | 19:41 |
| *** Hal has joined #openstack-infra | 19:41 | |
| clarkb | you will need someone from the infra root team to force push into those repos | 19:42 |
| mestery | I spoke with fungi about it after they merged, now dougwig and I looking at our options. | 19:42 |
| *** Hal has quit IRC | 19:42 | |
| clarkb | so you probably want to find a time where you can freeze changes to the affected soruce repo(s), split again with latest updates, then provide that to one of us to push into the empty repos | 19:42 |
| bknudson | it turns out that the core teams for projects are difficult to calculate... some projects have subprojects with different core teams. | 19:43 |
| *** dustins has quit IRC | 19:43 | |
| dougwig | will sometime early next week work? that's the neutron meetup, when we were planning on getting the new repos pushed. | 19:43 |
| *** ddieterly has quit IRC | 19:43 | |
| bknudson | e.g., keystone has pycadf which we got fro oslo and has a bunch of oslo core in it. | 19:43 |
| mtreinish | clarkb: ok cool, thanks | 19:43 |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/gear: Workflow documentation is now in infra-manual https://review.openstack.org/139416 | 19:44 |
| bknudson | should have said programs for projects | 19:44 |
| clarkb | dougwig: maybe? I think it mostly depends on when you guys can freeze | 19:44 |
| bknudson | are the core group members for each project in git? | 19:45 |
| clarkb | bknudson: no they are all in gerrit | 19:45 |
| dolphm | bknudson: not officially | 19:45 |
| clarkb | git does have notes about who voted but that is likely not a full picture | 19:45 |
| clarkb | bknudson: what are you trying to do? just list group membership? | 19:45 |
| mestery | clarkb: We can freeze when it's convenient for you folks, Monday would work best, right dougwig ? | 19:45 |
| bknudson | clarkb: there was a complaint about reviewstats not being up to date with core members so I was wondering if there was a way to automate it. | 19:46 |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/gear: Workflow documentation is now in infra-manual https://review.openstack.org/139416 | 19:46 |
| clarkb | bknudson: you could do something like for project in program: list project ACLs, find core group name via the +2 rights, use gerrit rest api to list core groups members | 19:46 |
| dougwig | any day is fine. if we do it monday, i likely won't have unit test fixes done, but then we can hold off on the co-gate job and just let it be broken for a few days. | 19:46 |
| clarkb | bknudson: yup you can automate by doing something like ^ | 19:46 |
| *** nfedotov has joined #openstack-infra | 19:46 | |
| bknudson | clarkb: the problem is for keystone we'd probably want 2 groups (maybe), one for keystone, python-keystoneclient and one for pycadf (maybe?) | 19:47 |
| *** craigbr has quit IRC | 19:47 | |
| fungi | bknudson: which is what my script linked earlier does | 19:47 |
| clarkb | bknudson: right so you would have to check each project in each program | 19:47 |
| clarkb | I don't foresee monday being particularly bad | 19:47 |
| fungi | bknudson: but yeah, the trick with reviewstats is that it's trying to paint a per-program picture when approvers/core reviewers are really a per-project concept in gerrit | 19:47 |
| clarkb | dougwig: mestery: if you want to give a rough time monday I can do my best to be around | 19:47 |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/project-config: Adjust wording for new Workflow URLs https://review.openstack.org/139718 | 19:48 |
| dougwig | what works best for you (including timezone) ? i'm at the meetup that day, so any time will be good for me. | 19:48 |
| clarkb | I am PST and later in the morning is likely best | 19:48 |
| dougwig | mestery: is one time better than another for freezing neutron itself? | 19:48 |
| clarkb | ~1800 UTC | 19:48 |
| fungi | dougwig: and i'm around a few hours earlier than clarkb if needed | 19:49 |
| dougwig | clarkb: i'm so glad you said that. i'm allergic to mornings. :) | 19:49 |
| mestery | I think the earlier the better | 19:49 |
| mestery | We may be best to go with fungi for this one (Sorry clarkb) ;)( | 19:49 |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/reviewstats: Adjust wording for new Workflow URLs https://review.openstack.org/139719 | 19:50 |
| *** mjturek has joined #openstack-infra | 19:50 | |
| mestery | dougwig: We need to make sure we get this done so that the other neutron work next week can proceed ok | 19:50 |
| dougwig | 9am pacific? we should be settled with network access at that point. | 19:50 |
| mestery | We don't want to bottleneck the refactoring folks | 19:50 |
| mestery | dougwig: Works for me | 19:50 |
| fungi | mestery: so, yeah, if you have the split-out versions of those repositories somewhere i can clone from, i can push --force them into those repositories pretty quickly | 19:51 |
| mestery | fungi: dougwig should have those ready to roll Monday morning then. | 19:51 |
| mestery | thanks fungi! | 19:51 |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/gerritlib: Workflow documentation is now in infra-manual https://review.openstack.org/139419 | 19:51 |
| fungi | mestery: dougwig: find me when you're ready (or clarkb may also be around by then, but don't want to intersect his breakfast) | 19:52 |
| mestery | awesome, thanks fungi and clarkb! | 19:52 |
| dougwig | ok, so i'll be ready to rough split into the three sub-repos, and prune neutron, by 9am pdt monday, and we'll have a few days where the sub-repos have failing tests (something to fix during the meetup). neutron will be down temporarily, then come back with some missing code, but still pass everything cleanly. | 19:52 |
| dougwig | how much freeze time do we need? communicate until 11am pdt to folks? | 19:53 |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/gearman-plugin: Workflow documentation is now in infra-manual https://review.openstack.org/139417 | 19:53 |
| * AJaeger signs off, have a great weekend! | 19:54 | |
| *** shakamunyi has quit IRC | 19:54 | |
| *** AJaeger has quit IRC | 19:54 | |
| fungi | dougwig: that's plenty | 19:54 |
| *** ddieterly has joined #openstack-infra | 19:54 | |
| *** mjturek has quit IRC | 19:54 | |
| fungi | dougwig: just make sure devs know to repropose outstanding changes touching those files to the new repos | 19:54 |
| fungi | dougwig: i would say have your deletion changes ready to go, and an extra core on hand so that you can sanely approve them if you need a last-minute rebase | 19:55 |
| *** alexpilotti has quit IRC | 19:55 | |
| dougwig | we've communicated everything but the 'when' on the re-proposing issue. we'll do a ML post. | 19:55 |
| fungi | that should also cause any remaining changes proposed against those files to get marked -1 by jenkins for a merge conflict | 19:55 |
| dougwig | i'll have a roomful of cores. waiting for the repo. :) | 19:55 |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/infra-specs: Workflow documentation is now in infra-manual https://review.openstack.org/139423 | 19:56 |
| dougwig | thanks all. fungi, "see" you monday. i assume you'll need access to the doctored local git repos. what's best for you for that? file transfer, or access to a server somewhere? | 19:57 |
| *** mrmartin has quit IRC | 19:57 | |
| dougwig | i think gerrit will choke on that kind of submission, unless i'm missing something. | 19:57 |
| *** teran_ has joined #openstack-infra | 19:57 | |
| fungi | dougwig: if you have a github account, you could push them to that as public repos, then delete them as soon as we' | 19:57 |
| fungi | re done | 19:57 |
| dougwig | ok, that's easy. | 19:58 |
| openstackgerrit | Merged openstack-dev/specs-cookiecutter: Workflow documentation is now in infra-manual https://review.openstack.org/139413 | 19:58 |
| dougwig | you get one guess what my username is. | 19:58 |
| fungi | but really anywhere you can put a public git repo (bitbucket, your own webserver, whatever) works for me | 19:58 |
| fungi | dougwig: i bet your username is as easy to guess as mine | 19:58 |
| openstackgerrit | Merged openstack-dev/cookiecutter: Workflow documentation is now in infra-manual https://review.openstack.org/139407 | 19:58 |
| *** shakamunyi has joined #openstack-infra | 19:59 | |
| *** ayoung has joined #openstack-infra | 19:59 | |
| openstackgerrit | Kyle Rockman proposed openstack-infra/jenkins-job-builder: add support for pyton and tox matrix project axis https://review.openstack.org/134025 | 19:59 |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/nose-html-output: Workflow documentation is now in infra-manual https://review.openstack.org/139426 | 19:59 |
| *** shakamunyi has quit IRC | 20:00 | |
| *** teran has quit IRC | 20:01 | |
| *** craigbr has joined #openstack-infra | 20:01 | |
| mtreinish | pleia2: ^^^ that project's still a thing? | 20:01 |
| *** shakamunyi has joined #openstack-infra | 20:01 | |
| mtreinish | is it used anywhere? | 20:01 |
| *** e0ne has joined #openstack-infra | 20:01 | |
| pleia2 | mtreinish: heh, not really, I think we should attic it | 20:01 |
| fungi | no need to attic, just update the readme to say it's defunct and add a read-only acl in gerrit | 20:02 |
| jeblair | fungi, clarkb: sorry, the error we were looking at had a one line fix, but i'm finding some additional potential problems in fixing it. i think i can still get something today | 20:02 |
| jeblair | fungi: ++ | 20:02 |
| *** HeOS has joined #openstack-infra | 20:02 | |
| fungi | jeblair: don't apologize, the suspense is just excruciating ;) | 20:02 |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/os-loganalyze: Workflow documentation is now in infra-manual https://review.openstack.org/139427 | 20:03 |
| pleia2 | ok, I think I got all the ones with that specific issue, off to lunch date | 20:05 |
| clarkb | yup I am off to lunch nowish too | 20:05 |
| clarkb | and 9am monday should work for me but sounds like fungi has it covered if not | 20:06 |
| clarkb | dougwig: a couple hours is probably plent | 20:06 |
| dougwig | ok, thanks | 20:06 |
| clarkb | jeblair: fix all the bugs! | 20:07 |
| clarkb | hpcloud region b pypi mirror sync is still going. It is in a screen owned by me if anyone wants to follow along | 20:08 |
| clarkb | its not that exciting | 20:08 |
| openstackgerrit | Kyle Rockman proposed openstack-infra/jenkins-job-builder: hipchat bug fix https://review.openstack.org/133997 | 20:08 |
| craigbr | clarkb: How long do you think it will take? Still hasn't synced ours | 20:08 |
| *** radez_g0n3 is now known as radez | 20:08 | |
| odyssey4me | evening all - https://review.openstack.org/139676 has been stuck waiting for a precise node for 2 hours... any news on what's going on with that? | 20:09 |
| fungi | clarkb: i missed--what was the mirror missing this time? | 20:12 |
| *** sputnik13 has quit IRC | 20:12 | |
| *** sputnik13 has joined #openstack-infra | 20:12 | |
| *** dprince_ has quit IRC | 20:14 | |
| fungi | odyssey4me: i think the gate pipeline is probably using them all... we don't build as many as we do trusty because they're usually in less demand | 20:14 |
| odyssey4me | it would appear that https://review.openstack.org/139718 is stuck waiting for the same | 20:14 |
| *** dprince has joined #openstack-infra | 20:14 | |
| reed | major improvement: people can upgrade their membership themselves now: https://bugs.launchpad.net/openstack-org/+bug/1317957/comments/69 | 20:15 |
| uvirtbot | Launchpad bug 1317957 in openstack-org "Server error when updating contacts" [Critical,Fix committed] | 20:15 |
| fungi | reed: awesome! i'll make sure to point people to that now when they come in with non-member accounts trying to figure out what's going on | 20:15 |
| reed | fungi, we should put that info in ask ... it gets so much more websearch hits than the bug report | 20:16 |
| openstackgerrit | Brant Knudson proposed openstack-infra/system-config: WIP: Tool to calculate reviewstats info https://review.openstack.org/139727 | 20:17 |
| odyssey4me | fungi: ah... I take it that the infra update to precise is still in planning then :) | 20:17 |
| fungi | looks like the provider of the hour is rax-iad... it has accumulated all the bare-precise demand in a building state, some for more than an hour | 20:17 |
| clarkb | fungi mirror resync was essentially dead so a bunch of stuff | 20:18 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Workflow documentation is now in infra-manual https://review.openstack.org/139433 | 20:18 |
| clarkb | so I am running it in foreground | 20:18 |
| *** tonytan_brb has quit IRC | 20:19 | |
| fungi | i wish i had a better idea as to how to factor building nodes into demand satisfaction without severely over-provisioning | 20:19 |
| fungi | when it takes many times longer to build the node than the average duration of the jobs which run on it, we'll spend a lot more time waiting for the nodes to become ready while nodepool continues to think the demand is met | 20:20 |
| fungi | and they'll tend to "pile up" on the worst-performing provider as a result | 20:22 |
| fungi | maybe if nodepool trended average building time for a label+provider combination and proportionally preferred providers with the lower average build time per label when satisfying demand | 20:23 |
| fungi | but that seems overly complex | 20:23 |
| *** Masahiro has joined #openstack-infra | 20:23 | |
| fungi | and subject to hysteresis if the build time is inversely proportional to the load we're placing on a provider | 20:24 |
| fungi | er, directly proportional (or if build speed is inversely proportional i guess) | 20:25 |
| mtreinish | fungi: heh I was just about to ask you about that :) | 20:25 |
| mtreinish | like is it magic where it gets faster as load increases :) | 20:25 |
| *** emagana has joined #openstack-infra | 20:26 | |
| fungi | we need some of that magic | 20:27 |
| *** ldnunes has quit IRC | 20:27 | |
| *** mfink has quit IRC | 20:27 | |
| *** Masahiro has quit IRC | 20:27 | |
| *** emagana has quit IRC | 20:31 | |
| *** tonytan4ever has joined #openstack-infra | 20:31 | |
| *** rushiagr is now known as rushiagr_away | 20:31 | |
| *** tonytan4ever has quit IRC | 20:32 | |
| *** berendt has joined #openstack-infra | 20:33 | |
| *** berendt has quit IRC | 20:33 | |
| *** prad has joined #openstack-infra | 20:33 | |
| mestery | clarkb: When I go to add an account to the "neutron-ci" group now, it says "Account not active". I'm trying to make it active by adding it to the group. What am I missing here? | 20:34 |
| *** sputnik13 has quit IRC | 20:35 | |
| nelsnelson | Greetings, channel. I'm using the github.com/openstack-infra/devstack-gate source to try to get a node setup with the devstack-gate tempest tests. However, when the puppet apply step is executed, I am no longer able to shell into the host. https://gist.github.com/nelsnelson/5e472a71eee541eb9752 | 20:36 |
| *** tonytan4ever has joined #openstack-infra | 20:37 | |
| *** sputnik13 has joined #openstack-infra | 20:37 | |
| clarkb | mestery account activeness still requires a gerrit admin | 20:39 |
| mestery | clarkb: Interesting. In this case, the freescale CI just needs voting rights, can you verify it's inactive? And how is that differenent than having voting rights? | 20:40 |
| *** koolhead17 has quit IRC | 20:40 | |
| *** koolhead17 has joined #openstack-infra | 20:40 | |
| *** thedodd has quit IRC | 20:42 | |
| odyssey4me | ah, finally, the check has passed - clarkb / fungi - can you perhaps +w please? https://review.openstack.org/#/c/139676/ | 20:42 |
| *** koolhead17 has quit IRC | 20:45 | |
| *** _buzz_ has quit IRC | 20:47 | |
| *** craigbr has quit IRC | 20:47 | |
| *** hdd has quit IRC | 20:49 | |
| clarkb | mestery gerrit accounts can be active or inactive | 20:49 |
| clarkb | mestery inactive accounts cant do anything | 20:50 |
| odyssey4me | thank you fungi :) | 20:50 |
| clarkb | voting rights are an attribute of active accounys | 20:50 |
| fungi | mestery: "inactive" is basically a means of disabling the account entirely | 20:50 |
| fungi | mestery: which requires an administrative privilege in gerrit | 20:50 |
| mestery | clarkb: OK, makes sense. Can you reactivate said freescale-ci account then for me? We're ready to re-enable it's voting rights. :) | 20:50 |
| mestery | fungi: Makes sense, got it now. | 20:50 |
| *** thedodd has joined #openstack-infra | 20:51 | |
| HenryG | Is there an easy way to extract the tox run times from the last N gate-neutron-python27 jobs? | 20:51 |
| *** otter768 has joined #openstack-infra | 20:51 | |
| *** yamamoto has joined #openstack-infra | 20:52 | |
| *** _buzz has joined #openstack-infra | 20:52 | |
| fungi | mestery: activated it | 20:54 |
| clarkb | mestery I can when I am back on laptop | 20:54 |
| mestery | Thanks fungi. clarkb, fungi was able to assist. :) | 20:54 |
| *** andreaf has quit IRC | 20:56 | |
| *** otter768 has quit IRC | 20:56 | |
| *** yamamoto has quit IRC | 20:57 | |
| fungi | HenryG: might be able to mine that out of graphite.openstack.org? for example stats.timers.zuul.pipeline.gate.job.gate-tempest-dsvm-full.SUCCESS.count | 20:57 |
| fungi | HenryG: i'm not entirely certain what the timers stats are representing there | 20:58 |
| *** shakamunyi has quit IRC | 20:59 | |
| *** sabeen3 has joined #openstack-infra | 21:03 | |
| *** mikedillion has quit IRC | 21:03 | |
| *** sabeen has quit IRC | 21:04 | |
| *** Sincler has quit IRC | 21:05 | |
| *** sarob has joined #openstack-infra | 21:06 | |
| *** shakamunyi has joined #openstack-infra | 21:06 | |
| *** _nadya_ has quit IRC | 21:06 | |
| *** andreaf has joined #openstack-infra | 21:07 | |
| *** dkehn has quit IRC | 21:08 | |
| HenryG | fungi: thanks, that is an interesting tool. Unfortunately I can't seem to get the right data out of it. | 21:08 |
| *** dprince has quit IRC | 21:08 | |
| fungi | HenryG: i often have that problem as well. i think digging in the zuul source for statsd calls might help provide context as to what those are tracking | 21:09 |
| *** ChuckC has joined #openstack-infra | 21:10 | |
| fungi | HenryG: some if it is at least highlighthed in the zuul docs... http://ci.openstack.org/zuul/statsd.html#metrics | 21:10 |
| *** weshay has quit IRC | 21:12 | |
| *** tonytan4ever has quit IRC | 21:13 | |
| *** stevemar2 is now known as stevemar | 21:19 | |
| *** cnesa2 has quit IRC | 21:20 | |
| pc_m | dougwig: ping | 21:21 |
| *** nfedotov has quit IRC | 21:21 | |
| openstackgerrit | Merged openstack-infra/infra-manual: Fix the link to Corporate CLA https://review.openstack.org/138932 | 21:24 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/infra-manual: Use Depends-On: Change-Id https://review.openstack.org/139582 | 21:26 |
| *** e0ne has quit IRC | 21:26 | |
| *** baoli has quit IRC | 21:26 | |
| *** emagana has joined #openstack-infra | 21:27 | |
| *** hdd has joined #openstack-infra | 21:28 | |
| *** groknix has joined #openstack-infra | 21:29 | |
| openstackgerrit | Merged openstack-infra/infra-manual: Use Depends-On: Change-Id https://review.openstack.org/139582 | 21:30 |
| *** ChuckC has quit IRC | 21:30 | |
| *** sabeen3 has quit IRC | 21:31 | |
| *** sabeen has joined #openstack-infra | 21:31 | |
| *** chuckC_ has quit IRC | 21:31 | |
| *** Ryan_Lane has quit IRC | 21:32 | |
| *** Ryan_Lane has joined #openstack-infra | 21:33 | |
| *** esker has quit IRC | 21:35 | |
| *** esker has joined #openstack-infra | 21:37 | |
| openstackgerrit | Richard Jones proposed openstack/requirements: Add new angular deps to global-requirements.txt for Horizon https://review.openstack.org/139298 | 21:37 |
| *** packet has quit IRC | 21:37 | |
| *** boris-42 has quit IRC | 21:37 | |
| *** mriedem has quit IRC | 21:41 | |
| *** sputnik13 has quit IRC | 21:41 | |
| *** Longgeek has quit IRC | 21:42 | |
| *** lbiasi has quit IRC | 21:44 | |
| *** lbiasi has joined #openstack-infra | 21:44 | |
| *** groknix has quit IRC | 21:46 | |
| *** stevemar has quit IRC | 21:47 | |
| *** tonytan4ever has joined #openstack-infra | 21:47 | |
| *** esker has quit IRC | 21:49 | |
| *** baoli has joined #openstack-infra | 21:52 | |
| *** signed8b_ has joined #openstack-infra | 21:54 | |
| *** rickerc has quit IRC | 21:56 | |
| *** mattfarina has quit IRC | 21:57 | |
| *** signed8bit has quit IRC | 21:57 | |
| dougwig | pc_m: ack | 21:59 |
| *** craigbr has joined #openstack-infra | 21:59 | |
| openstackgerrit | James E. Blair proposed openstack-infra/gear: Use non-blocking IO in server https://review.openstack.org/128754 | 22:01 |
| *** hamzy is now known as hamzy_vacation | 22:02 | |
| *** gyee has joined #openstack-infra | 22:03 | |
| *** teran has joined #openstack-infra | 22:03 | |
| fungi | yay! | 22:04 |
| jeblair | clarkb, fungi: if you give me a minute before you look, i'm adding some comments to that. | 22:04 |
| fungi | k | 22:05 |
| clarkb | kk | 22:05 |
| clarkb | I am reviewing mysql proxy now | 22:05 |
| clarkb | mtreinish: ^ | 22:05 |
| *** ryanpetrello_ has joined #openstack-infra | 22:06 | |
| clarkb | lol mysql proxy is alpha code and should not be used in production :) | 22:06 |
| *** ryanpetrello has quit IRC | 22:06 | |
| clarkb | we can test it for them | 22:06 |
| *** ryanpetrello_ is now known as ryanpetrello | 22:06 | |
| *** teran_ has quit IRC | 22:06 | |
| fungi | sounds like openstack? | 22:06 |
| * fungi dodges tomatoes | 22:06 | |
| *** sabeen has quit IRC | 22:07 | |
| clarkb | what does this proxy lua script thing do? | 22:08 |
| clarkb | docs say "finer control" | 22:08 |
| Shrews | clarkb: that has been around for years and years | 22:09 |
| Shrews | so not sure about that whole "alpha" thing | 22:09 |
| *** Ark has joined #openstack-infra | 22:10 | |
| *** Ark is now known as Guest67018 | 22:10 | |
| clarkb | Shrews: that is what the ocs say | 22:10 |
| mordred | why are we looking at mysql-proxy? | 22:10 |
| clarkb | http://dev.mysql.com/doc/mysql-proxy/en/mysql-proxy-introduction.html | 22:10 |
| Shrews | clarkb: well, Jan was working on that in 2007... so their docs suck :) | 22:11 |
| clarkb | Shrews: or maybe latest "release" is an alpha? | 22:11 |
| clarkb | mordred: read only access to the subunit2sql db | 22:11 |
| clarkb | mordred: https://review.openstack.org/#/c/122311/15 please review | 22:11 |
| mordred | I will - please don't merge adding mysql-proxy until I've had a chance to dig in | 22:11 |
| clarkb | mordred: kk | 22:11 |
| Shrews | or... alternatively... use a read-only user? | 22:12 |
| *** prad has quit IRC | 22:12 | |
| Shrews | like, simple options first, IMO | 22:12 |
| mordred | Shrews: yah. that. or a read-only replica | 22:12 |
| fungi | Shrews: it will already be back to a read-only account in the db | 22:12 |
| fungi | er, backed | 22:12 |
| *** Masahiro has joined #openstack-infra | 22:12 | |
| mtreinish | clarkb: it used to split the queries | 22:12 |
| jeblair | clarkb, fungi: ok, https://review.openstack.org/#/c/128754/ has comments on PS7 and PS8 that should explain the motivations for the changes | 22:12 |
| clarkb | mtreinish: but why is that necessary? its a read only account with a read only proxy | 22:13 |
| clarkb | mtreinish: just extra cautious? in any case I am +2 but didn't approve so mordred can look at it | 22:13 |
| mtreinish | clarkb: it's dumb the readonly backend option registers it only | 22:13 |
| fungi | clarkb: mordred: mtreinish: yeah, something like tcpproxy might be a simpler solution there | 22:13 |
| mtreinish | but the proxy doesn't know what to do with the backend without a script using it | 22:13 |
| *** ryanpetrello has quit IRC | 22:14 | |
| mtreinish | so the lua script splits out the queries and sends the read ones to the read only backend | 22:14 |
| mtreinish | and drops the others because there isn't a r/w backend registered | 22:14 |
| mtreinish | you don't want to know how long it took me to figure that out... | 22:14 |
| fungi | mtreinish: though i agree the benefit over letting mysqld reject the other queries because the account lacks sufficient permissions seems as effective | 22:14 |
| *** zz_avozza is now known as avozza | 22:15 | |
| fungi | er, it's getting close to beer-forty, but you know what i meant to say there | 22:15 |
| mtreinish | fungi: yeah that would work fine, I just went down this path because you mentioned it in Darmstadt | 22:15 |
| fungi | oops! :/ | 22:15 |
| sdague | blame the beer :) | 22:16 |
| fungi | when i said proxy i probably meant tcpproxy (because the trove instance is on an rfc-1918 address) | 22:16 |
| mtreinish | sdague: heh, it was pre-beer on the way back to hotel | 22:16 |
| Shrews | fungi drinks beer? absurd! | 22:16 |
| mtreinish | fungi: I'm pretty sure you said mysql-proxy, something about being told it can do all these things | 22:16 |
| mtreinish | I wouldn't have known about it otherwise :) | 22:16 |
| clarkb | mysql proxy should be fine | 22:16 |
| fungi | i might have said application-level proxy, but i'll feign beer in that case | 22:17 |
| clarkb | was just curious about the decisions and now I know a lot more about mysql proxy :) | 22:17 |
| *** Masahiro has quit IRC | 22:17 | |
| jeblair | there's a certain amount of thinking like 'mysql-proxy keeps mysql itself from being directly accessible and therefore may mitigate vulnerabilities in it, since it's traditionally kind of a squishy center thing as far as network security goes' | 22:18 |
| jeblair | i'll let mysql experts weigh in on how valid a concern that is :) | 22:18 |
| fungi | anyway, we need some mechanism of making that trove db queryable over the internet, so whether that's a layer-3 nat or a layer-4 nat/proxy or a layer-7 proxy or a local replica on the nova instance or whatever | 22:18 |
| jeblair | (also, we don't control the upgrade timing of that mysql server (trove), so it's perhaps extra squishy) | 22:19 |
| *** avozza is now known as zz_avozza | 22:19 | |
| Shrews | jeblair: if it's a security thing, a read-replica is probably better | 22:19 |
| fungi | in most cases i'd buy the extra security argument, but in this case it's a database doing nothing but tracking test result statistics | 22:20 |
| craigbr | clarkb Thanks for restarting the mirror. Our package is now mirrored correctly | 22:20 |
| clarkb | craigbr: no problem | 22:20 |
| openstackgerrit | Christian Berendt proposed openstack-infra/project-config: Add new project packstack-vagrant to stackforge https://review.openstack.org/139660 | 22:20 |
| fungi | so unless someone decides to hack that database and turn it into a warezhouse, i'm not sure what other real attraction there is | 22:20 |
| *** Guest67018 has quit IRC | 22:21 | |
| mtreinish | fungi: heh, but someone could steal all the secrets from the test results :) | 22:22 |
| fungi | secret tests! secret tests! | 22:22 |
| clarkb | so that is why we don't have any write access to es | 22:22 |
| Shrews | fungi: ever hear of the mysql bug where if you kept trying invalid passwords long and fast enough you'd eventually get in as root? | 22:22 |
| clarkb | its not that its sensitive data, its that its basically a free 6TB datastore if we do that | 22:22 |
| fungi | Shrews: heh | 22:22 |
| Shrews | fungi: awesome bug | 22:22 |
| fungi | Shrews: is that still around? | 22:23 |
| * Shrews mentions just out of nostalgia | 22:23 | |
| fungi | i remember that but it was, like, years ago | 22:23 |
| Shrews | fungi: gawd i hope not | 22:23 |
| fungi | pretty sure it was fixed ;) | 22:23 |
| Shrews | i mean, i guarantee there are installations with a mysql old enough | 22:23 |
| fungi | ouch | 22:23 |
| Shrews | but, yeah, already fixed in code | 22:23 |
| *** cpowell has quit IRC | 22:24 | |
| *** teran_ has joined #openstack-infra | 22:24 | |
| *** mfink has joined #openstack-infra | 22:25 | |
| mtreinish | clarkb, fungi: I just noticed that jenkins hasn't voted on either of those patches yet | 22:26 |
| *** mbacchi has quit IRC | 22:26 | |
| mtreinish | the last rev was from this afternoon | 22:26 |
| clarkb | mtreinish: needs precise nodes | 22:26 |
| clarkb | mtreinish: I think there are no precise nodes because hpcloud | 22:26 |
| clarkb | fungi: ^ | 22:26 |
| mtreinish | ah ok, yeah I see that now on the status page | 22:26 |
| fungi | clarkb: no, now it's because rax-iad | 22:27 |
| *** shashankhegde has quit IRC | 22:27 | |
| *** teran has quit IRC | 22:28 | |
| fungi | clarkb: for whatever reason the overwhelming majority of bare-precise nodes are in a building state in rax-iad for up to 1 hour each | 22:28 |
| fungi | we seem to have no more than one actively running jobs at any particular point in time, and a dozen "building" | 22:29 |
| openstackgerrit | Merged openstack-infra/project-config: Make agent_ssh check job voting for IPA https://review.openstack.org/134436 | 22:29 |
| *** andreaf has quit IRC | 22:29 | |
| clarkb | :/ | 22:29 |
| fungi | status.rackspace.com looks not promising too | 22:29 |
| *** shashankhegde has joined #openstack-infra | 22:30 | |
| *** zz_avozza is now known as avozza | 22:30 | |
| clarkb | jeblair: ok those changes lgtm | 22:33 |
| clarkb | jeblair: I assume this is far mor etested than the earlier patchsets? | 22:33 |
| clarkb | jeblair: with that said should I plan to give the trusty host another chance on monday? | 22:33 |
| *** baoli has quit IRC | 22:35 | |
| jeblair | clarkb: it is not more tested than the earlier ones -- they were all tested about as well as i can with our current state of tooling. | 22:36 |
| fungi | jeblair: did the read and write to connection methods just move (or do i need to go comparing every line to spot what also changed within them)? | 22:36 |
| jeblair | fungi: they moved and changed slightly; sorry about that | 22:37 |
| clarkb | jeblair: gotcha | 22:37 |
| fungi | no worries--making sure i knew what to look for | 22:37 |
| clarkb | jeblair: but you were able to reproduce the bug? | 22:37 |
| clarkb | jeblair: I guess maybe that is what I am getting at. Was bug reproduced and conseuqently squashed? | 22:37 |
| clarkb | but changes lgtm | 22:37 |
| jeblair | clarkb: i did not get to the point of creating a succinct test case for it; i confirmed it with logs from production | 22:38 |
| jeblair | 1 sec, will paste | 22:39 |
| *** kgiusti has left #openstack-infra | 22:39 | |
| jeblair | clarkb: http://paste.openstack.org/show/145779/ | 22:39 |
| jeblair | clarkb: actually http://paste.openstack.org/show/145780/ | 22:40 |
| *** aysyd has quit IRC | 22:40 | |
| *** craigbr has quit IRC | 22:41 | |
| *** mmaglana has joined #openstack-infra | 22:41 | |
| *** avozza is now known as zz_avozza | 22:41 | |
| *** koolhead17 has joined #openstack-infra | 22:41 | |
| jeblair | er that still doesn't make sense, sorry, one more | 22:42 |
| *** koolhead17 has quit IRC | 22:42 | |
| *** koolhead17 has joined #openstack-infra | 22:42 | |
| jeblair | clarkb: http://paste.openstack.org/show/145782/ | 22:42 |
| clarkb | :) | 22:42 |
| jeblair | clarkb: lines 14, 40, and 44 indicate that it short-circuited the loop in which it should have processed the input from line 9 | 22:43 |
| jeblair | clarkb: (basically, it should have processed it in the blank space in line 43) | 22:44 |
| *** penguinRaider has joined #openstack-infra | 22:45 | |
| *** Ryan_Lane has quit IRC | 22:45 | |
| clarkb | jeblair: gotcha | 22:45 |
| clarkb | I will probably need more time with those logs to fully understand it | 22:46 |
| *** Ryan_Lane has joined #openstack-infra | 22:47 | |
| *** signed8b_ has quit IRC | 22:47 | |
| jeblair | i believe i was able to eventually reproduce it with some stress testing. i will try that again now with full understanding and see what kind of significance i can get out of that | 22:47 |
| *** tonytan4ever has quit IRC | 22:47 | |
| clarkb | I do think that this new patchset is much better error handling | 22:47 |
| clarkb | I like explicitly closing connections that have gone bad :) and it no longer short circuits the iteration | 22:47 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/infra-specs: Add spec for in-tree 3rd party ci solution https://review.openstack.org/139745 | 22:48 |
| *** alexpilotti has joined #openstack-infra | 22:49 | |
| *** r-daneel has quit IRC | 22:49 | |
| openstackgerrit | Michael Pratt proposed openstack-infra/git-review: Add reviewers on upload https://review.openstack.org/139165 | 22:49 |
| jeblair | i forgot to mention, the flushAllConnections method is an extra protection against this kind of bug -- it makes it safe for that loop to exit. so now the code tries hard not to for efficiency reasons, but if it does, it should be okay. | 22:50 |
| jeblair | (that means we don't have to have _lostConnection (which shouldn't error but could, say, if there's a bug or in pathological cases) wrapped in an exception handler all the time | 22:50 |
| *** Ryan_Lane has quit IRC | 22:51 | |
| *** otter768 has joined #openstack-infra | 22:52 | |
| *** andreykurilin_ has joined #openstack-infra | 22:52 | |
| *** Ryan_Lane has joined #openstack-infra | 22:53 | |
| *** Ryan_Lane has quit IRC | 22:56 | |
| *** Ryan_Lane has joined #openstack-infra | 22:57 | |
| *** otter768 has quit IRC | 22:57 | |
| jeblair | clarkb, fungi: i believe this also explains the timeout errors we saw (we should not expect to see any as asyncio is designed to mitigate that specific problem) | 22:58 |
| *** ChuckC has joined #openstack-infra | 22:59 | |
| clarkb | It might be a bit hard for me to put taht in place today, but I am all for doing it asap if possible | 22:59 |
| clarkb | monday should be fine though | 22:59 |
| fungi | yeah, i don't see anything immediately concerning about the patch | 23:00 |
| fungi | i'm all for giving it a go early in the week | 23:00 |
| *** alexpilotti has quit IRC | 23:00 | |
| *** timrc-afk is now known as timrc | 23:01 | |
| *** shakamunyi has quit IRC | 23:01 | |
| fungi | whoops. i hit workflow +1 instead of code review +2 on it, but caught it right away at least :/ | 23:02 |
| nibalizer | fungi: http://thedoomthatcametopuppet.tumblr.com/post/104397636603/my-head-was-aching-and-i-had-a-singular | 23:04 |
| nibalizer | puppet docs + hp lovecraft + markov generator | 23:04 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/system-config: Add support to the subunit workers to reuse zuul uuids https://review.openstack.org/139750 | 23:05 |
| mtreinish | jeblair: ^^^ I think that's something we talked about doing a while ago | 23:05 |
| *** dmsimard is now known as dmsimard_away | 23:07 | |
| *** j^2 has left #openstack-infra | 23:08 | |
| openstackgerrit | James E. Blair proposed openstack-infra/gear: Use non-blocking IO in server https://review.openstack.org/128754 | 23:09 |
| jeblair | clarkb, fungi: ^ minor log quieting change | 23:09 |
| *** dkehn has joined #openstack-infra | 23:09 | |
| jeblair | clarkb, fungi: okay, so i think i can fairly reliably reproduce the merger problem, and, incedentally, the timeout problem with the old code | 23:09 |
| jeblair | clarkb, fungi: basically the process is: setup: run server on machine A; run 4 workers with a test function on machine B, run 200 more workers without the test function on machine A. test iteration: run a client that submits 40 test jobs, stop all 200 workers on A while they are running | 23:11 |
| clarkb | jeblair: simple update just being specific to aboid logging too much | 23:11 |
| jeblair | clarkb, fungi: i can usually get most or all of the 4 test workers stuck after repeating the test iteration a few times (about 4) | 23:11 |
| jeblair | (usually even after the first time, one of them is stuck, and occasionally the client gets a timeout error) | 23:12 |
| clarkb | jeblair: cool, that is good news | 23:12 |
| clarkb | jeblair: and I take it latest patchset there is a bit more immune to that behavior? | 23:12 |
| jeblair | and i have not been able to reproduce either with >8 iterations with the new patchset | 23:12 |
| clarkb | woot | 23:12 |
| jeblair | also, you know how status sometimes hangs even if you echo|nc? that seems better now :) | 23:13 |
| *** mmaglana has quit IRC | 23:14 | |
| openstackgerrit | Aaron Rosen proposed openstack/requirements: Add nova-docker to tracked project list https://review.openstack.org/122221 | 23:15 |
| *** vigneshvar has quit IRC | 23:18 | |
| *** amitgandhinz has quit IRC | 23:18 | |
| *** alexpilotti has joined #openstack-infra | 23:20 | |
| *** boris-42 has joined #openstack-infra | 23:21 | |
| mtreinish | clarkb: heh, this contradicts the other mysql-proxy docs: http://dev.mysql.com/doc/relnotes/mysql-proxy/en/mysql-proxy-news-0-5-0.html | 23:22 |
| mtreinish | it must be beta alpha software | 23:22 |
| *** rwsu has quit IRC | 23:24 | |
| *** andreykurilin_ has quit IRC | 23:28 | |
| fungi | gamma software | 23:29 |
| *** thedodd has quit IRC | 23:30 | |
| *** ddieterly has quit IRC | 23:32 | |
| *** koolhead17 has quit IRC | 23:34 | |
| mordred | it's a pet project from Jan | 23:34 |
| mordred | it WAS "the future" for a minute | 23:34 |
| mordred | then Oracle bought Sun | 23:35 |
| mordred | and I believe people stopped caring | 23:35 |
| mordred | Jan, btw, is a genius | 23:35 |
| *** jedimike has quit IRC | 23:37 | |
| SergeyLukjanov | jeblair, clarkb, fungi, etherpad for tomorrow's renaming - https://etherpad.openstack.org/p/repo-renaming-2014-12-06 | 23:37 |
| openstackgerrit | Sergey Lukjanov proposed openstack-infra/project-config: Configurable sources for prepare_node.sh https://review.openstack.org/139611 | 23:39 |
| openstackgerrit | Sergey Lukjanov proposed openstack-infra/project-config: Rename the heat-translator project repo https://review.openstack.org/131558 | 23:41 |
| mtreinish | mordred: isn't that pretty much the story with most things coming from Sun after they got bought out? :) | 23:42 |
| openstackgerrit | Sergey Lukjanov proposed openstack-infra/project-config: Configurable sources for prepare_node.sh https://review.openstack.org/139611 | 23:42 |
| mordred | mtreinish: yah | 23:45 |
| *** arosen1 has left #openstack-infra | 23:45 | |
| *** yamamoto has joined #openstack-infra | 23:54 | |
| openstackgerrit | Merged openstack/requirements: Bump oslo.concurrency, as keystone is now importing oslo_concurrency https://review.openstack.org/138813 | 23:58 |
| *** yamamoto has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!