| clarkb | anteaya: when there is a cross wind and no head on runway planes have to land funny http://www.newschoolbeer.com/2015/11/breakside-brewery-to-open-new-northwest-portland-brewpub.html | 00:00 |
|---|---|---|
| clarkb | thats the wrong link but also a good one | 00:00 |
| anteaya | ha ha ha | 00:00 |
| clarkb | https://www.youtube.com/watch?v=r-pmnGAe8EQ there video | 00:00 |
| anteaya | ha ha ha | 00:00 |
| pleia2 | beer++ | 00:00 |
| anteaya | the beer link is to prep for the vid | 00:00 |
| clarkb | basically they point their nose into the wind but because of the wind they still go in direction of runway | 00:00 |
| clarkb | then once back wheels are down they point nose forward and finish up landing | 00:01 |
| pleia2 | heh, poor airplanes | 00:01 |
| *** rbrndt has quit IRC | 00:02 | |
| fungi | definitely not one to watch before getting on a flight | 00:02 |
| *** Sukhdev has quit IRC | 00:02 | |
| clarkb | there are two tells as a passenger, the first one is just looking out the window | 00:02 |
| *** sridhar_ram1 has quit IRC | 00:02 | |
| clarkb | the other is if the plane does a rotation after wheels down | 00:02 |
| *** apoorvad has quit IRC | 00:03 | |
| docaedo | clarkb: crosswind landings are neat and all but that breakside link is great news, thanks for sharing! | 00:03 |
| clarkb | docaedo: :) also I tried that commons farmhouse and its ok | 00:04 |
| clarkb | docaedo: a bit sweet for me | 00:04 |
| clarkb | (needed more hops imo to cut the sweetness) | 00:04 |
| clarkb | or drier ferment | 00:04 |
| *** otter768 has joined #openstack-infra | 00:04 | |
| *** sridhar_ram has joined #openstack-infra | 00:04 | |
| *** Sukhdev has joined #openstack-infra | 00:04 | |
| anteaya | clarkb: glad you had a good flightdeck team | 00:04 |
| clarkb | docaedo: the only problem with that location is its too close to the twin's pediatrician >_> | 00:06 |
| docaedo | clarkb: ah ok fair enough re: farmhouse ale. Maybe I'm loving it because I don't usually like sour/farmhouse ales but that one seems just right | 00:06 |
| *** lhcheng has quit IRC | 00:07 | |
| docaedo | as long as we're talking about beer, have a favorite CDA recipe? I need to brew post thanksgiving :) | 00:07 |
| clarkb | docaedo: I really like farmhouse to be dry and funky | 00:07 |
| clarkb | docaedo: let me pull up beersmith on other computer really quick | 00:07 |
| clarkb | no CDA there hrm maybe its on other other computer I don't have access to | 00:08 |
| *** apoorvad has joined #openstack-infra | 00:08 | |
| *** akshai has quit IRC | 00:08 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: neutron_upgrades: added meeting_id and agenda_url https://review.openstack.org/247464 | 00:08 |
| openstackgerrit | Merged openstack-infra/irc-meetings: Changed from Chef Cookbooks to OpenStack-Chef https://review.openstack.org/248829 | 00:09 |
| *** sfinucan has quit IRC | 00:09 | |
| *** gouthamr has quit IRC | 00:09 | |
| docaedo | clarkb: on paper this looks good to me but hard to tell for sure - https://www.brewtoad.com/recipes/pdx-cda-ba52d9 | 00:09 |
| *** boris-42 has joined #openstack-infra | 00:09 | |
| *** hichihara has joined #openstack-infra | 00:10 | |
| *** pradk has joined #openstack-infra | 00:10 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 00:10 | |
| clarkb | 20% specialty malt seems high | 00:10 |
| *** tsg has quit IRC | 00:10 | |
| pleia2 | sweet farmhouse ales are always a bit disappoint | 00:11 |
| clarkb | the internets say not really. Brewing all those SMaSH beers has polluted my brain | 00:12 |
| clarkb | docaedo: my typical brew has been wyeast 1056, 11 lb maris otter, 4 oz of $hop | 00:12 |
| clarkb | stupid simple but so good | 00:12 |
| docaedo | clarkb: that sounds good | 00:12 |
| clarkb | mash at 152F | 00:13 |
| clarkb | I really like simcoe and galaxy | 00:13 |
| * pleia2 named her cat simcoe \o/ | 00:14 | |
| pleia2 | obviously it's one of my favorites too :) | 00:14 |
| *** Sukhdev has quit IRC | 00:14 | |
| docaedo | simcoe is good - I've been doing single-hop IPAs with citra for a while, I think it's one of my favs | 00:15 |
| *** signed8bit_ZZZzz is now known as signed8bit | 00:15 | |
| clarkb | docaedo: oh gigantic publishes their recipes let me see if they have one | 00:15 |
| clarkb | docaedo: http://giganticbrewing.com/media/Black-Friday-Imperial-CDA-Recipe.docx | 00:16 |
| clarkb | docaedo: even the name is on point :) | 00:16 |
| *** openstackgerrit has quit IRC | 00:16 | |
| *** openstackgerrit has joined #openstack-infra | 00:17 | |
| *** markmcd has quit IRC | 00:17 | |
| docaedo | clarkb: ooh thanks! | 00:17 |
| *** markmcd has joined #openstack-infra | 00:19 | |
| clarkb | you can probably cut the sugar and mash at 149F ish | 00:19 |
| openstackgerrit | Sahdev Zala proposed openstack/requirements: Add tosca-parser to the global requirments projects https://review.openstack.org/248950 | 00:19 |
| clarkb | and their hop utilization is going to be much better than a homebrewers so adjust that until IBUs look right | 00:20 |
| clarkb | basically scale down to your gear then scale back up to get IBUs | 00:20 |
| *** Sukhdev has joined #openstack-infra | 00:20 | |
| docaedo | :) | 00:21 |
| clarkb | docaedo: do you beersmith? its like magical and runs on linux | 00:22 |
| clarkb | very good for mathsing this stuff | 00:22 |
| *** otter768 has quit IRC | 00:23 | |
| *** rossella_s has quit IRC | 00:23 | |
| *** rossella_s has joined #openstack-infra | 00:23 | |
| docaedo | clarkb: I do not, I always figured I did not brew enough to buy software (but then imagined it cost more than two growler fills) You've almost sold me... | 00:24 |
| *** sflanigan has joined #openstack-infra | 00:25 | |
| *** sflanigan has joined #openstack-infra | 00:25 | |
| *** ivar-laz_ has joined #openstack-infra | 00:26 | |
| *** ivar-lazzaro has quit IRC | 00:26 | |
| clarkb | you can use it free for some time period | 00:26 |
| clarkb | try it and decide? | 00:26 |
| *** otter768 has joined #openstack-infra | 00:26 | |
| docaedo | clarkb: this will happen, and one day soon my taps will once again flow with beer! | 00:27 |
| *** rlandy has quit IRC | 00:29 | |
| *** rlandy has joined #openstack-infra | 00:30 | |
| *** Sukhdev has quit IRC | 00:33 | |
| *** js5175-att has quit IRC | 00:33 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 00:37 | |
| *** rebase has quit IRC | 00:39 | |
| greghaynes | docaedo: clarkb I use an android app that is free | 00:43 |
| greghaynes | It is called "wort" | 00:43 |
| *** salv-orlando has quit IRC | 00:43 | |
| docaedo | greghaynes: for free I do like brewtoad (especially since it doesn't matter which device I use), but I will look at this wort app you speak of | 00:44 |
| greghaynes | I havent done a ton of research into the different apps, it works and is free so I kind of stopped my search there ;) | 00:44 |
| *** bpokorny has quit IRC | 00:44 | |
| *** otter768 has quit IRC | 00:45 | |
| *** sdake_ has joined #openstack-infra | 00:45 | |
| *** sdake has quit IRC | 00:45 | |
| *** gildub has joined #openstack-infra | 00:47 | |
| docaedo | greghaynes: other nice thing about brewtoad.com is you can find some good recipes there :) | 00:48 |
| openstackgerrit | Tim Hinrichs proposed openstack-infra/project-config: Fix congress ENABLED_SERVICES https://review.openstack.org/248956 | 00:48 |
| anteaya | tonyb: you about? | 00:48 |
| tonyb | anteaya: Yup | 00:48 |
| tonyb | anteaya: how can I help? | 00:49 |
| anteaya | tonyb: seems the docs team has a meeting scheduled: http://lists.openstack.org/pipermail/openstack-docs/2015-November/007916.html but I don't have the channel booked in my ical feed | 00:49 |
| anteaya | and some poor soul showed up and is the lone participant | 00:49 |
| anteaya | just letting you know the meeting isn't in ical | 00:49 |
| tonyb | Hmm okay I'll look into it. | 00:50 |
| anteaya | tonyb: problem solved | 00:51 |
| anteaya | particpant is a day early | 00:51 |
| tonyb | anteaya: wrong week? | 00:51 |
| anteaya | right week, wrong day | 00:51 |
| tonyb | anteaya: Ahhh | 00:51 |
| anteaya | thanks, sorry for noise | 00:51 |
| tonyb | anteaya: np | 00:51 |
| *** bpokorny has joined #openstack-infra | 00:51 | |
| *** Swami has quit IRC | 00:53 | |
| *** r-daneel has quit IRC | 00:55 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Sent HAProxy stats to statsd https://review.openstack.org/248961 | 00:56 |
| jeblair | clarkb, fungi, mordred, yolanda: ^ that's ready, and it's now running on git.o.o | 00:56 |
| fungi | thanks, that'll be handy for troubleshooting when we get more failures (saw another one hit e-r today) | 00:57 |
| jeblair | clarkb, fungi, mordred, yolanda: so... i've been thinking that since it's looking like systemd is the winner in the init wars, perhaps we should consider using systemd unit files... | 00:58 |
| *** xyang1 has quit IRC | 00:58 | |
| jeblair | clarkb, fungi, mordred, yolanda: if we decide not to, and stick with sysvinit compatibility, i'm perfectly happy to rework that change to do that | 00:58 |
| fungi | yeah, i've written at least one. they're pretty simple as long as you want to do common/simple things | 00:58 |
| clarkb | jeblair: I am happy to systemd, the git daemon for the backends already does so | 00:59 |
| clarkb | its just easier to leverage the thing that the distros want you to use | 00:59 |
| jeblair | clarkb: ah, okay, precedent | 00:59 |
| jeblair | i didn't see any sysvinit for centos, so i thought this would be easier | 00:59 |
| fungi | i do enjoy the lack of boilerplate scripting at least | 00:59 |
| anteaya | jeblair: whitespace oops | 00:59 |
| nibalizer | jeblair: you have some whitespace in the python script | 00:59 |
| jeblair | (especially since i haven't bothered to actually daemonize the script) | 00:59 |
| anteaya | jeblair: I heard you copyright that | 00:59 |
| *** hidekazu has joined #openstack-infra | 01:00 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Sent HAProxy stats to statsd https://review.openstack.org/248961 | 01:01 |
| jeblair | anteaya: it's an important part of my artistic vision | 01:01 |
| jeblair | you're all cramping my stile | 01:01 |
| jeblair | style | 01:01 |
| anteaya | ha ha ha | 01:01 |
| * anteaya moves back | 01:01 | |
| jesusaurus | jeblair: on the topic of putting more things in statsd, did you happen to see https://review.openstack.org/246037 ? | 01:02 |
| *** yamamoto has joined #openstack-infra | 01:02 | |
| jeblair | http://graphite.openstack.org/render/?width=586&height=308&_salt=1448327012.786&target=stats.haproxy.balance_git_https.FRONTEND.stot&from=-1hours | 01:03 |
| *** elo has joined #openstack-infra | 01:03 | |
| * anteaya goes back to looking up geocentric planetary nodes | 01:03 | |
| jeblair | overall https connections per second ^ | 01:03 |
| anteaya | impressive | 01:04 |
| jeblair | (the gaps are me restarting the injector) | 01:05 |
| *** sridhar_ram has quit IRC | 01:05 | |
| *** sridhar_ram1 has joined #openstack-infra | 01:05 | |
| jeblair | jesusaurus: not yet, thanks... | 01:05 |
| *** eil397 has quit IRC | 01:06 | |
| *** sridhar_ram1 has quit IRC | 01:07 | |
| *** yamamoto has quit IRC | 01:07 | |
| anteaya | ah I wondered | 01:08 |
| *** nelsnelson has quit IRC | 01:09 | |
| clarkb | jeblair: ya so trying to coordinate between sysv compat layer and systemd or upstart is painful | 01:12 |
| *** sridhar_ram has joined #openstack-infra | 01:12 | |
| *** sdake_ is now known as sdake | 01:12 | |
| *** eliqiao_ is now known as eliqiao | 01:12 | |
| *** glauco_ has quit IRC | 01:13 | |
| clarkb | thats sort of why I gave up and am embracing systemd for service management | 01:13 |
| clarkb | it was either that or run gentoo :) | 01:13 |
| *** glauco has joined #openstack-infra | 01:13 | |
| openstackgerrit | Kirill Zaitsev proposed openstack-infra/irc-meetings: Adds agenda and id to murano meeting info https://review.openstack.org/248966 | 01:14 |
| hidekazu | hello, I want to update irc-meeting yaml file to show murano meeting logs and agenda. I saw irc-meetings repository. https://github.com/openstack-infra/irc-meetings But I can't find how to commit irc-meetings repository. | 01:14 |
| clarkb | jeblair: it might be nice to have a docstring/comment with example output from haproxy | 01:14 |
| clarkb | hidekazu: its the same method as any other openstack project | 01:14 |
| mordred | clarkb: docker | 01:14 |
| clarkb | hidekazu: http://docs.openstack.org/infra/manual/developers.html | 01:14 |
| clarkb | mordred: there ar ea lot of things you cna't and shouldn't docker though | 01:14 |
| clarkb | like iscsi | 01:15 |
| mordred | clarkb: totes | 01:15 |
| mordred | clarkb: well | 01:15 |
| *** sputnik13 has quit IRC | 01:15 | |
| hidekazu | @clarkb: thanks! should I report bug? | 01:15 |
| mordred | clarkb: who wants iscsi really? | 01:15 |
| clarkb | hidekazu: no just updating it is fine | 01:15 |
| jeblair | clarkb: yep. unfortunately, i don't have that handy. | 01:15 |
| hidekazu | @clarkb: thanks again. I will do. | 01:15 |
| *** rebase has joined #openstack-infra | 01:15 | |
| * anteaya notes that is a great nick | 01:16 | |
| *** apoorvad has quit IRC | 01:17 | |
| pabelanger | fungi: wouldn't mind your feedback: https://review.openstack.org/#/c/248317/ | 01:17 |
| pabelanger | clarkb: do you mind commenting when you have a moment? https://github.com/puppetlabs/puppetlabs-apache/pull/1271 | 01:18 |
| pabelanger | clarkb: want to make sure it is what you expected | 01:18 |
| *** sambetts-afk has quit IRC | 01:18 | |
| jeblair | jesusaurus: i left a few comments on https://review.openstack.org/246037 | 01:19 |
| clarkb | jeblair: I think pep8 doesn't like the trailing whitespace | 01:20 |
| clarkb | and other than the comment/docstring lgtm can add that ina followup | 01:21 |
| *** ashleighfarnham has quit IRC | 01:21 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Sent HAProxy stats to statsd https://review.openstack.org/248961 | 01:22 |
| *** ccrouch has quit IRC | 01:23 | |
| clarkb | pabelanger: yes general shape looks good | 01:24 |
| clarkb | pabelanger: how does it handle notifying the service? is the consumer of that define supposed to do it themselves? | 01:24 |
| *** sridhar_ram has quit IRC | 01:25 | |
| clarkb | oh its after the github comments | 01:25 |
| clarkb | thats almost impossible to read, thanks github | 01:25 |
| clarkb | pabelanger: I don't think mode is meaningful on a symlink but other than that ya lgtm | 01:25 |
| jesusaurus | jeblair: thanks for the comments. is your concern that making this information available would lead to tooling that depends on the information? my think is that these numbers would allow us to more intelligently tweak the algorithm, not prevent us from tweaking the allocation algorithm | 01:25 |
| *** hdd has joined #openstack-infra | 01:26 | |
| pabelanger | clarkb: ya, we expect custom_config.pp to handle the notifications, so far from what I tested it works as expected | 01:26 |
| *** Yanyanhu has joined #openstack-infra | 01:28 | |
| *** jgriffith_away is now known as jgriffith | 01:30 | |
| *** ivar-lazzaro has joined #openstack-infra | 01:32 | |
| *** tiswanso has quit IRC | 01:33 | |
| *** hurgleburgler has quit IRC | 01:34 | |
| *** bcourt has quit IRC | 01:35 | |
| *** ivar-laz_ has quit IRC | 01:36 | |
| *** ivar-lazzaro has quit IRC | 01:36 | |
| *** zhenguo has joined #openstack-infra | 01:38 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: bdist_wheel/universal is the canonical option https://review.openstack.org/248972 | 01:38 |
| *** baoli has quit IRC | 01:38 | |
| *** baoli has joined #openstack-infra | 01:39 | |
| *** thorst has joined #openstack-infra | 01:40 | |
| *** tiswanso has joined #openstack-infra | 01:40 | |
| *** thorst has quit IRC | 01:40 | |
| *** thorst has joined #openstack-infra | 01:41 | |
| *** julim has joined #openstack-infra | 01:43 | |
| *** hidekazu has left #openstack-infra | 01:46 | |
| *** fitoduarte has quit IRC | 01:50 | |
| *** zhurong has joined #openstack-infra | 01:52 | |
| jeblair | jesusaurus: i think the question is whether you want this for nodepool users to tune their params, in which case we should keep it simple and stable, or nodepool devs to tune the algorithm, in which case we shouldn't spend much time on it because it's getting replaced in zuulv3. | 01:56 |
| jeblair | jesusaurus: my feedback was assuming the former :) | 01:57 |
| *** tsg has joined #openstack-infra | 01:57 | |
| *** Kennan has quit IRC | 01:57 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul: Update to statsd 3.0 https://review.openstack.org/229232 | 01:57 |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul: Handle a float in assertReportedStat https://review.openstack.org/248975 | 01:57 |
| *** glauco has quit IRC | 01:59 | |
| *** glauco has joined #openstack-infra | 02:00 | |
| SpamapS | jeblair: re os-performance-tools installed not on the image: sure. I wasn't sure about that either. :) | 02:03 |
| *** Yanyanhu has quit IRC | 02:03 | |
| *** thorst has quit IRC | 02:04 | |
| *** glauco has quit IRC | 02:04 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: Add DIB_LOCAL_CONFIG_USERNAME https://review.openstack.org/248976 | 02:06 |
| pabelanger | ianw: thoughts? ^ | 02:06 |
| *** kgiusti has quit IRC | 02:06 | |
| *** pcrews has quit IRC | 02:07 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: Add DIB_LOCAL_CONFIG_USERNAME to local-config https://review.openstack.org/248976 | 02:07 |
| *** thorst has joined #openstack-infra | 02:08 | |
| *** shashank_hegde has quit IRC | 02:09 | |
| ianw | pabelanger: interesting, i haven't really used that, but seems ok ... you want this to override "cloud-user"? | 02:10 |
| ianw | i generally attach an iso with my key to be picked up | 02:11 |
| *** rhallisey has quit IRC | 02:11 | |
| *** amotoki has joined #openstack-infra | 02:13 | |
| pabelanger | ianw: Ya, there might be a better way to do it. But I couldn't see any other way to add a local ssh key to the existing cloud user account | 02:13 |
| pabelanger | I mean, I could build an element to do it, but this seems to be one way to add it using existing elements | 02:13 |
| *** yamamoto has joined #openstack-infra | 02:17 | |
| *** Kennan has joined #openstack-infra | 02:17 | |
| openstackgerrit | Di Xu proposed openstack-infra/jenkins-job-builder: Support deep merge of defaults https://review.openstack.org/150730 | 02:18 |
| *** signed8bit_ZZZzz is now known as signed8bit | 02:19 | |
| *** yamamoto has quit IRC | 02:21 | |
| *** thorst has quit IRC | 02:22 | |
| *** apoorvad has joined #openstack-infra | 02:23 | |
| openstackgerrit | Merged openstack-infra/project-config: Add ansible-role-zuul project https://review.openstack.org/248317 | 02:24 |
| *** btully has quit IRC | 02:28 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Make secure.conf optional and backwards-compat https://review.openstack.org/232800 | 02:28 |
| *** signed8bit has quit IRC | 02:32 | |
| *** gouthamr has joined #openstack-infra | 02:34 | |
| *** david-ly_ has quit IRC | 02:36 | |
| *** bcourt has joined #openstack-infra | 02:37 | |
| greghaynes | pabelanger: check out http://docs.openstack.org/developer/diskimage-builder/elements/devuser/README.html | 02:37 |
| *** rguillebert has quit IRC | 02:37 | |
| greghaynes | pabelanger: ah, you want to use an existing user in the image | 02:38 |
| greghaynes | fair enough | 02:38 |
| *** glauco has joined #openstack-infra | 02:38 | |
| *** dims has joined #openstack-infra | 02:40 | |
| pabelanger | greghaynes: ya, I see that too. Some overlap | 02:41 |
| *** Kennan has quit IRC | 02:42 | |
| *** shashank_hegde has joined #openstack-infra | 02:45 | |
| *** otter768 has joined #openstack-infra | 02:46 | |
| *** salv-orlando has joined #openstack-infra | 02:47 | |
| *** otter768 has quit IRC | 02:50 | |
| *** eil397 has joined #openstack-infra | 02:56 | |
| *** rebase has quit IRC | 02:56 | |
| *** eil397 has quit IRC | 02:59 | |
| *** salv-orlando has quit IRC | 02:59 | |
| *** eil397 has joined #openstack-infra | 02:59 | |
| *** bardia has quit IRC | 03:00 | |
| *** yamamoto has joined #openstack-infra | 03:04 | |
| *** Sree has joined #openstack-infra | 03:08 | |
| *** rlandy has quit IRC | 03:10 | |
| *** ramineni has joined #openstack-infra | 03:12 | |
| *** Kennan has joined #openstack-infra | 03:13 | |
| ramineni | hi, could someone please review https://review.openstack.org/#/c/248956/ , | 03:13 |
| ramineni | need to get it merged quickly as tempest tests are failing because of it :( | 03:13 |
| *** jhesketh has joined #openstack-infra | 03:14 | |
| *** pradk has quit IRC | 03:15 | |
| *** dims has quit IRC | 03:17 | |
| *** eil397 has quit IRC | 03:18 | |
| *** pcrews has joined #openstack-infra | 03:19 | |
| *** xiexs_ has quit IRC | 03:20 | |
| *** dims has joined #openstack-infra | 03:22 | |
| *** yuanying has quit IRC | 03:23 | |
| *** pcaruana has quit IRC | 03:27 | |
| *** apoorvad has quit IRC | 03:27 | |
| openstackgerrit | Di Xu proposed openstack-infra/jenkins-job-builder: Support deep merge of defaults https://review.openstack.org/150730 | 03:30 |
| *** rick_ has joined #openstack-infra | 03:32 | |
| *** dims has quit IRC | 03:35 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: Fix a typo in tap-as-a-service job template https://review.openstack.org/248987 | 03:41 |
| *** gildub has quit IRC | 03:46 | |
| *** kushal has joined #openstack-infra | 03:49 | |
| *** asselin has joined #openstack-infra | 03:51 | |
| *** asselin_ has joined #openstack-infra | 03:52 | |
| *** spzala has quit IRC | 04:01 | |
| *** asselin_ has quit IRC | 04:05 | |
| *** asselin has quit IRC | 04:05 | |
| *** bpokorny has quit IRC | 04:06 | |
| *** spzala has joined #openstack-infra | 04:06 | |
| *** yuanying has joined #openstack-infra | 04:08 | |
| *** david-lyle has joined #openstack-infra | 04:08 | |
| zaro | clarkb: maybe we leave it for hugo to investigate. we do have workarounds for it, even revert in our fork if necessary. | 04:09 |
| *** akshai has joined #openstack-infra | 04:10 | |
| *** hdd has quit IRC | 04:10 | |
| *** thorst has joined #openstack-infra | 04:11 | |
| *** akshai_ has joined #openstack-infra | 04:11 | |
| *** otter768 has joined #openstack-infra | 04:13 | |
| *** bcourt has quit IRC | 04:14 | |
| *** akshai has quit IRC | 04:15 | |
| *** thorst has quit IRC | 04:15 | |
| *** gildub has joined #openstack-infra | 04:16 | |
| *** ayoung has quit IRC | 04:20 | |
| *** btully has joined #openstack-infra | 04:29 | |
| openstackgerrit | Di Xu proposed openstack-infra/jenkins-job-builder: Support deep merge of defaults https://review.openstack.org/150730 | 04:31 |
| *** shashank_hegde has quit IRC | 04:32 | |
| *** pcrews has quit IRC | 04:32 | |
| openstackgerrit | David Pursehouse proposed openstack-infra/lodgeit: Fix up the tests and add tox configuration to run them https://review.openstack.org/234637 | 04:33 |
| notmyname | does infra run ask.openstack.org/ | 04:39 |
| notmyname | ? | 04:39 |
| notmyname | cause it's down right now | 04:39 |
| openstackgerrit | Merged openstack-infra/irc-meetings: Adds agenda and id to murano meeting info https://review.openstack.org/248966 | 04:39 |
| StevenK | Well, it's up, it's just ISEing | 04:43 |
| *** spzala has quit IRC | 04:44 | |
| greghaynes | ISE ISE baby | 04:49 |
| openstackgerrit | Masayuki Igawa proposed openstack/os-testr: Add colored output feature to subunit-trace https://review.openstack.org/249005 | 04:53 |
| *** mahatic has joined #openstack-infra | 04:54 | |
| *** ddieterl_ has quit IRC | 04:55 | |
| *** maishsk has quit IRC | 04:56 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Make secure.conf optional and backwards-compat https://review.openstack.org/232800 | 04:56 |
| *** maishsk has joined #openstack-infra | 04:56 | |
| StevenK | notmyname: To answer your question, yes, they do -- it's in system-config and managed by puppet | 04:57 |
| notmyname | StevenK: thanks | 04:57 |
| greghaynes | http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=156 | 04:57 |
| openstackgerrit | Jamie Lennox proposed openstack/requirements: Bump version of requests-mock https://review.openstack.org/249006 | 04:57 |
| greghaynes | looks like maybe out of disk space? | 04:57 |
| greghaynes | if not, it is really close | 04:58 |
| StevenK | Or it's hit the reserved FS limit? | 04:58 |
| *** otter768 has quit IRC | 04:59 | |
| *** chenli has joined #openstack-infra | 04:59 | |
| *** maishsk has quit IRC | 04:59 | |
| *** akshai_ has quit IRC | 05:00 | |
| chenli | hello, anyone can help here ? I try to run git review command, I get an error : http://paste.openstack.org/show/479810 | 05:01 |
| openstackgerrit | Masayuki Igawa proposed openstack/os-testr: Add .eggs/* to .gitignore https://review.openstack.org/249008 | 05:02 |
| nibalizer | its full of postgres backups | 05:03 |
| chenli | any core here >? | 05:03 |
| StevenK | nibalizer: How many postgres backups? | 05:04 |
| nibalizer | we're configured to store 30 | 05:06 |
| nibalizer | we don't have enough space for that in /var | 05:06 |
| nibalizer | but we do in /opt | 05:06 |
| *** maishsk has joined #openstack-infra | 05:08 | |
| *** sdake_ has joined #openstack-infra | 05:09 | |
| *** gouthamr has left #openstack-infra | 05:10 | |
| *** sdake has quit IRC | 05:10 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Move pgsql backups to cinder volume https://review.openstack.org/249009 | 05:12 |
| *** ashishb has joined #openstack-infra | 05:14 | |
| *** rcernin has joined #openstack-infra | 05:15 | |
| nibalizer | chenli: that error seems pretty self-explanatory | 05:21 |
| nibalizer | greghaynes: StevenK: want to review ^^ | 05:21 |
| *** Sukhdev has joined #openstack-infra | 05:24 | |
| clarkb | niablizer I think you can go ahead and move a bunch to get service happy again then worry about that patch in the morning if you like | 05:25 |
| clarkb | I think we should consider fewer backups if / ismt big enough too | 05:26 |
| clarkb | nibalizer are they getting properly compressed? if so I am impressed by our ability to generate text :) | 05:26 |
| *** sdake_ has quit IRC | 05:26 | |
| nibalizer | clarkb: ya i'm moving files now | 05:27 |
| nibalizer | its back :) | 05:29 |
| *** achanda has joined #openstack-infra | 05:29 | |
| nibalizer | I've moved a few of the backup files to /opt | 05:29 |
| nibalizer | clarkb: the backups are about 600 MB now | 05:29 |
| nibalizer | s/now/each/ | 05:29 |
| clarkb | and file reports they are gzipped? | 05:30 |
| clarkb | thats an awful lot of human generated text | 05:31 |
| nibalizer | yes, they have .gz in the name, file reports as gziped, and they respond as expected to zcat | 05:31 |
| *** rcernin has quit IRC | 05:34 | |
| *** sabeen has joined #openstack-infra | 05:38 | |
| *** mahatic has quit IRC | 05:38 | |
| *** maishsk has quit IRC | 05:41 | |
| *** achanda has quit IRC | 05:41 | |
| *** mahatic has joined #openstack-infra | 05:43 | |
| *** Sukhdev has quit IRC | 05:45 | |
| *** harlowja_at_home has joined #openstack-infra | 05:48 | |
| *** pcaruana has joined #openstack-infra | 05:49 | |
| *** aukhan has joined #openstack-infra | 05:51 | |
| *** abregman has joined #openstack-infra | 05:55 | |
| *** ddieterly has joined #openstack-infra | 05:55 | |
| *** salv-orlando has joined #openstack-infra | 05:56 | |
| *** nelsnelson has joined #openstack-infra | 05:58 | |
| *** ddieterly has quit IRC | 06:00 | |
| *** salv-orlando has quit IRC | 06:01 | |
| *** hughhalf has quit IRC | 06:04 | |
| *** zhurong_ has joined #openstack-infra | 06:05 | |
| *** zhurong has quit IRC | 06:09 | |
| *** gouthamr has joined #openstack-infra | 06:10 | |
| *** shashank_hegde has joined #openstack-infra | 06:11 | |
| *** nadya_ has joined #openstack-infra | 06:11 | |
| *** wznoinsk has quit IRC | 06:11 | |
| *** wznoinsk has joined #openstack-infra | 06:12 | |
| *** hughhalf has joined #openstack-infra | 06:12 | |
| *** aopincar has joined #openstack-infra | 06:12 | |
| *** pasquier-s has quit IRC | 06:13 | |
| *** thorst has joined #openstack-infra | 06:13 | |
| *** pasquier-s has joined #openstack-infra | 06:14 | |
| *** Ramanjaneya has joined #openstack-infra | 06:16 | |
| *** thorst has quit IRC | 06:17 | |
| *** rcernin has joined #openstack-infra | 06:18 | |
| *** Ramanjaneya has quit IRC | 06:26 | |
| *** pcaruana has quit IRC | 06:28 | |
| *** mrmartin has joined #openstack-infra | 06:31 | |
| *** mahatic has quit IRC | 06:31 | |
| *** Ramanjaneya has joined #openstack-infra | 06:32 | |
| *** nadya_ has quit IRC | 06:33 | |
| *** mrmartin has quit IRC | 06:35 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/249031 | 06:36 |
| *** e0ne has joined #openstack-infra | 06:40 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/248430 | 06:41 |
| openstackgerrit | Mohankumar proposed openstack-infra/project-config: Add networking-sfc-dashboard https://review.openstack.org/248695 | 06:43 |
| *** boris-42 has quit IRC | 06:48 | |
| *** rick_ has quit IRC | 06:53 | |
| *** ddieterly has joined #openstack-infra | 06:57 | |
| *** nadya_ has joined #openstack-infra | 06:59 | |
| *** HeOS has quit IRC | 07:01 | |
| *** ddieterly has quit IRC | 07:01 | |
| openstackgerrit | Tom Fifield proposed openstack-infra/shade: Add Swift Object Download support https://review.openstack.org/249039 | 07:03 |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/249031 | 07:03 |
| *** e0ne has quit IRC | 07:08 | |
| *** otter768 has joined #openstack-infra | 07:11 | |
| *** chenli has left #openstack-infra | 07:14 | |
| *** jgriffith is now known as jgriffith_away | 07:15 | |
| *** otter768 has quit IRC | 07:15 | |
| *** pcrews has joined #openstack-infra | 07:15 | |
| *** btully has quit IRC | 07:16 | |
| *** yonglihe has quit IRC | 07:21 | |
| *** harlowja_at_home has quit IRC | 07:23 | |
| *** pcrews has quit IRC | 07:24 | |
| openstackgerrit | Mohankumar proposed openstack-infra/project-config: Add networking-sfc-dashboard https://review.openstack.org/248695 | 07:24 |
| *** mjb has quit IRC | 07:26 | |
| *** vinay_yadhav has joined #openstack-infra | 07:27 | |
| *** rick_ has joined #openstack-infra | 07:31 | |
| *** denisra has quit IRC | 07:33 | |
| *** mjb has joined #openstack-infra | 07:33 | |
| *** sabeen has quit IRC | 07:33 | |
| *** denisra has joined #openstack-infra | 07:33 | |
| *** korzen has joined #openstack-infra | 07:42 | |
| *** ajo has quit IRC | 07:42 | |
| *** scheuran has joined #openstack-infra | 07:43 | |
| *** ajo has joined #openstack-infra | 07:46 | |
| *** nmagnezi has joined #openstack-infra | 07:47 | |
| *** placko has joined #openstack-infra | 07:48 | |
| *** matrohon has joined #openstack-infra | 07:49 | |
| *** btully has joined #openstack-infra | 07:51 | |
| *** btully has quit IRC | 07:56 | |
| *** ddieterly has joined #openstack-infra | 07:58 | |
| *** vinay_yadhav has quit IRC | 07:59 | |
| *** otter768 has joined #openstack-infra | 08:00 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Start using cgit::lb class https://review.openstack.org/181829 | 08:00 |
| *** HeOS has joined #openstack-infra | 08:01 | |
| *** jyuso1 has joined #openstack-infra | 08:01 | |
| openstackgerrit | Kairat Kushaev proposed openstack/requirements: Bump oslo.middleware to support CORS in glance https://review.openstack.org/249057 | 08:01 |
| *** larainema has quit IRC | 08:02 | |
| openstackgerrit | Isaac Beckman proposed openstack-infra/devstack-gate: Only create multinode GRE bridge interfaces once https://review.openstack.org/239363 | 08:02 |
| *** ddieterly has quit IRC | 08:02 | |
| *** nmagnezi has quit IRC | 08:02 | |
| *** [1]Thelo has joined #openstack-infra | 08:04 | |
| *** gildub has quit IRC | 08:04 | |
| *** matrohon1 has joined #openstack-infra | 08:05 | |
| *** matrohon1 has quit IRC | 08:05 | |
| *** otter768 has quit IRC | 08:05 | |
| *** ramineni has quit IRC | 08:06 | |
| *** Thelo has quit IRC | 08:06 | |
| *** [1]Thelo is now known as Thelo | 08:06 | |
| openstackgerrit | Steve Kowalik proposed openstack-infra/project-config: Fix two errors in setup_training_guides https://review.openstack.org/249058 | 08:06 |
| *** ramineni has joined #openstack-infra | 08:08 | |
| *** ramineni has quit IRC | 08:10 | |
| *** gchamoul|AfK is now known as gchamoul | 08:11 | |
| *** ildikov has quit IRC | 08:11 | |
| *** mahatic has joined #openstack-infra | 08:12 | |
| *** larainema has joined #openstack-infra | 08:12 | |
| *** arxcruz has joined #openstack-infra | 08:12 | |
| *** bdemers has quit IRC | 08:12 | |
| *** wuhg has joined #openstack-infra | 08:13 | |
| *** salv-orlando has joined #openstack-infra | 08:13 | |
| *** dingyichen has quit IRC | 08:13 | |
| openstackgerrit | Merged openstack-infra/project-config: Place constraints comment at proper place https://review.openstack.org/248872 | 08:14 |
| *** bdemers has joined #openstack-infra | 08:14 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix a typo in tap-as-a-service job template https://review.openstack.org/248987 | 08:14 |
| *** ramineni has joined #openstack-infra | 08:16 | |
| *** mpavone has joined #openstack-infra | 08:16 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix congress ENABLED_SERVICES https://review.openstack.org/248956 | 08:17 |
| *** salv-orlando has quit IRC | 08:21 | |
| *** mrmartin has joined #openstack-infra | 08:25 | |
| *** kaisers1 has left #openstack-infra | 08:25 | |
| openstackgerrit | David TARDIVEL proposed openstack-infra/project-config: Add coverage check on Watcher. https://review.openstack.org/248736 | 08:28 |
| *** salv-orlando has joined #openstack-infra | 08:29 | |
| *** fhubik has joined #openstack-infra | 08:31 | |
| *** ifarkas has joined #openstack-infra | 08:32 | |
| *** nmagnezi has joined #openstack-infra | 08:32 | |
| *** salv-orlando has quit IRC | 08:33 | |
| *** rick_ has quit IRC | 08:33 | |
| *** yfried has joined #openstack-infra | 08:34 | |
| *** sshnaidm has joined #openstack-infra | 08:37 | |
| *** Ala has joined #openstack-infra | 08:40 | |
| *** shashank_hegde has quit IRC | 08:43 | |
| *** ildikov has joined #openstack-infra | 08:43 | |
| *** markus_z has joined #openstack-infra | 08:45 | |
| *** sdake has joined #openstack-infra | 08:45 | |
| oomichi | "Also, the nosetests test runner is **not** recommended to run Tempest." as :q | 08:47 |
| oomichi | "Also, the nosetests test runner is **not** recommended to run Tempest." on README.rst | 08:47 |
| *** jlanoux has joined #openstack-infra | 08:48 | |
| *** sdake has quit IRC | 08:48 | |
| *** sdake has joined #openstack-infra | 08:48 | |
| *** dizquierdo has joined #openstack-infra | 08:48 | |
| *** e0ne has joined #openstack-infra | 08:49 | |
| openstackgerrit | Merged openstack-infra/project-config: Add tacker pypi jobs https://review.openstack.org/235602 | 08:52 |
| ramineni | hi, how much time is needed after the infra patch is merged, to take th changes in? for doing a recheck | 08:54 |
| ramineni | infra patch got merged now, but still jenkins recheck is showng same failure , which should be fixed by merge | 08:55 |
| yolanda | ramineni, give it an hour. The change needs to be applied and jobs need to be regenerated | 08:57 |
| yolanda | if in an hour it continues failing, let me know | 08:57 |
| *** shardy has joined #openstack-infra | 08:57 | |
| ramineni | yolanda: thanks for the reply. sure, will check after an hour | 08:58 |
| *** ddieterly has joined #openstack-infra | 08:58 | |
| *** jordanP has joined #openstack-infra | 08:59 | |
| *** samuelBartel has joined #openstack-infra | 08:59 | |
| *** sdake has quit IRC | 09:01 | |
| *** arxcruz has quit IRC | 09:01 | |
| *** arxcruz has joined #openstack-infra | 09:01 | |
| openstackgerrit | Merged openstack-infra/project-config: remove python26-jobs from remaining oslo libraries https://review.openstack.org/248802 | 09:02 |
| *** ddieterly has quit IRC | 09:03 | |
| *** yfried has quit IRC | 09:03 | |
| *** GonZo2000 has quit IRC | 09:06 | |
| *** fhubik is now known as fhubik_brb | 09:06 | |
| *** fhubik_brb is now known as fhubik | 09:07 | |
| andreaf | yolanda: nice, test nodes are coming up and jobs are running now - just curious, what happened there? | 09:07 |
| yolanda | andreaf, where? | 09:07 |
| andreaf | yolanda: with zuul, for a bit I saw no test nodes in the graph, and jobs queued | 09:08 |
| *** Sree has quit IRC | 09:08 | |
| yolanda | andreaf, i don't know , i didn't take any action on that | 09:08 |
| openstackgerrit | Merged openstack-infra/project-config: Switch Ansible role jobs to use 'dsvm-functional-trusty' https://review.openstack.org/248757 | 09:08 |
| yolanda | this morning? | 09:08 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/glean: Fix creation of vlan interfaces in Debian/Ubuntu https://review.openstack.org/244625 | 09:08 |
| *** zer0c00l has quit IRC | 09:08 | |
| *** Sree has joined #openstack-infra | 09:09 | |
| *** Ala has quit IRC | 09:09 | |
| andreaf | yolanda: yes - I wonder if it was a stale cache of the graphs or so then | 09:09 |
| openstackgerrit | Merged openstack-infra/project-config: Bump RAM to 1G for ironic-inspector IPA job https://review.openstack.org/248799 | 09:09 |
| *** hashar has joined #openstack-infra | 09:09 | |
| *** fitoduarte has joined #openstack-infra | 09:09 | |
| yolanda | andreaf, chart is back again? when that happens, it means that graphite is down | 09:10 |
| *** mattoliverau has quit IRC | 09:10 | |
| andreaf | yolanda: ah ok - yes the graph looks good now | 09:10 |
| openstackgerrit | Merged openstack-infra/project-config: Move the AMQP 1.0 tests from Fedora21 to Centos7 https://review.openstack.org/248806 | 09:10 |
| *** derekh has joined #openstack-infra | 09:10 | |
| andreaf | yolanda: but you can see all graphs went down to zero for a bit | 09:11 |
| *** yamahata has quit IRC | 09:11 | |
| *** matt6434 has joined #openstack-infra | 09:11 | |
| openstackgerrit | Merged openstack-infra/project-config: Make Horizon Integration Tests voting https://review.openstack.org/248673 | 09:11 |
| andreaf | yolanda: http://bit.ly/1Nbv0Xr | 09:11 |
| yolanda | andreaf yes.. let me check logs | 09:12 |
| andreaf | http://bit.ly/1OpqFio | 09:12 |
| openstackgerrit | Merged openstack-infra/project-config: Add python implementation for monasca-log-api https://review.openstack.org/248132 | 09:12 |
| *** fhubik is now known as fhubik_brb | 09:13 | |
| *** Ala has joined #openstack-infra | 09:13 | |
| openstackgerrit | Merged openstack-infra/project-config: Add stable branch notifications to #openstack-dns https://review.openstack.org/248712 | 09:13 |
| *** adduarte has joined #openstack-infra | 09:13 | |
| openstackgerrit | Merged openstack-infra/subunit2sql: Add reno release notes to subunit2sql https://review.openstack.org/247737 | 09:14 |
| *** fitoduarte has quit IRC | 09:16 | |
| *** rguillebert has joined #openstack-infra | 09:16 | |
| *** openstackgerrit has quit IRC | 09:16 | |
| *** dtantsur|afk is now known as dtantsur | 09:17 | |
| *** openstackgerrit has joined #openstack-infra | 09:17 | |
| yolanda | andreaf, no relevant errors on zuul | 09:17 |
| *** claudiub has joined #openstack-infra | 09:19 | |
| *** akscram1 is now known as akscram | 09:20 | |
| *** zhurong_ has quit IRC | 09:22 | |
| *** fhubik_brb is now known as fhubik | 09:24 | |
| *** zeih has joined #openstack-infra | 09:25 | |
| *** mdbooth has joined #openstack-infra | 09:27 | |
| *** sflanigan has quit IRC | 09:27 | |
| *** sflanigan has joined #openstack-infra | 09:27 | |
| *** sflanigan has joined #openstack-infra | 09:27 | |
| *** bexelbie_ has joined #openstack-infra | 09:30 | |
| *** bexelbie_ is now known as bexelbie | 09:31 | |
| *** fhubik is now known as fhubik_brb | 09:32 | |
| *** claudiub has quit IRC | 09:33 | |
| *** oomichi has quit IRC | 09:34 | |
| *** claudiub has joined #openstack-infra | 09:34 | |
| *** fhubik_brb is now known as fhubik | 09:34 | |
| *** achanda has joined #openstack-infra | 09:35 | |
| *** ashishb has quit IRC | 09:35 | |
| *** ifarkas has quit IRC | 09:36 | |
| *** ifarkas has joined #openstack-infra | 09:36 | |
| *** ashishb has joined #openstack-infra | 09:41 | |
| lxsli | jenkins seems a bit slow? | 09:42 |
| *** ociuhandu has quit IRC | 09:42 | |
| *** arxcruz has quit IRC | 09:43 | |
| *** jistr has joined #openstack-infra | 09:44 | |
| *** jcoufal has joined #openstack-infra | 09:46 | |
| *** dizquierdo has quit IRC | 09:50 | |
| *** andymaier has joined #openstack-infra | 09:54 | |
| *** maishsk has joined #openstack-infra | 09:55 | |
| *** AJaeger has joined #openstack-infra | 09:58 | |
| *** arxcruz has joined #openstack-infra | 09:59 | |
| *** woodster_ has quit IRC | 09:59 | |
| *** ddieterly has joined #openstack-infra | 10:00 | |
| *** otter768 has joined #openstack-infra | 10:01 | |
| *** zhenguo has quit IRC | 10:02 | |
| *** ddieterly has quit IRC | 10:05 | |
| *** otter768 has quit IRC | 10:06 | |
| openstackgerrit | Tom Fifield proposed openstack-infra/shade: Add Swift Object Download support https://review.openstack.org/249039 | 10:09 |
| *** mahatic has quit IRC | 10:12 | |
| *** nmagnezi has quit IRC | 10:13 | |
| *** achanda has quit IRC | 10:14 | |
| *** thorst has joined #openstack-infra | 10:15 | |
| *** mahatic has joined #openstack-infra | 10:16 | |
| *** tdurakov has quit IRC | 10:16 | |
| *** Guest67865 has joined #openstack-infra | 10:16 | |
| *** ildikov has quit IRC | 10:19 | |
| *** thorst has quit IRC | 10:20 | |
| *** fhubik is now known as fhubik_brb | 10:20 | |
| *** ramineni1 has joined #openstack-infra | 10:21 | |
| *** ramineni has quit IRC | 10:22 | |
| *** nmagnezi has joined #openstack-infra | 10:24 | |
| *** tdurakov has joined #openstack-infra | 10:29 | |
| openstackgerrit | David Pursehouse proposed openstack-infra/lodgeit: Show the currently running version on the about page https://review.openstack.org/249113 | 10:29 |
| *** jlanoux_ has joined #openstack-infra | 10:29 | |
| AJaeger | yolanda, thanks a lot for your reviews! Could you push https://review.openstack.org/248435 and https://review.openstack.org/248549 also on your queue, please? | 10:29 |
| yolanda | AJaeger, sure | 10:30 |
| AJaeger | thanks | 10:30 |
| AJaeger | yolanda: looking at status.openstack.org/zuul, we have quite some load at the moment - do we have a problem with ready nodes? | 10:31 |
| AJaeger | Or is Zuul too busy? | 10:31 |
| yolanda | AJaeger, i haven't looked but i 'll check | 10:31 |
| *** glauco has quit IRC | 10:32 | |
| *** glauco has joined #openstack-infra | 10:32 | |
| *** jlanoux has quit IRC | 10:32 | |
| AJaeger | seems we're building lots of nodes now, so might go down... | 10:32 |
| *** ildikov has joined #openstack-infra | 10:32 | |
| AJaeger | looking at the graphs it seems we are just backlogged - we build 100s of nodes over an hour ago which looks quite late... | 10:33 |
| *** adduarte has quit IRC | 10:33 | |
| AJaeger | So, current status might be fine if I interpret http://grafana.openstack.org/dashboard/db/zuul-status correctly | 10:34 |
| *** ldnunes has joined #openstack-infra | 10:34 | |
| *** fhubik_brb is now known as fhubik | 10:36 | |
| *** salv-orlando has joined #openstack-infra | 10:38 | |
| yolanda | nodepool seems ok for me | 10:38 |
| yolanda | do you notice a special demand of some slave type? | 10:38 |
| *** tdurakov has quit IRC | 10:41 | |
| *** salv-orlando has quit IRC | 10:42 | |
| *** dizquierdo has joined #openstack-infra | 10:43 | |
| AJaeger | I think we're fine now - we seem to have been stuck some time ago and currently recover | 10:43 |
| BobBall | What conditions make reviews bold in Gerrit's web view? I know that changes go unbold after I have reviewed them, but some changes have gone bold again even though they have a +1 from me in the latest changeset | 10:43 |
| *** aspiers has quit IRC | 10:43 | |
| claudiub | I think when there are new updates on that review, like someone else reviewed it / left comments. | 10:45 |
| BobBall | OK - then how do I make it go unbold? normally bold indicates that I need to _do_ something... :) | 10:46 |
| BobBall | I mean "normally I interpret bold as meaning I need to do something" | 10:46 |
| *** markus_z has quit IRC | 10:47 | |
| openstackgerrit | Merged openstack-infra/project-config: Really skip directories for translation sync https://review.openstack.org/248561 | 10:48 |
| *** aukhan has quit IRC | 10:48 | |
| openstackgerrit | Julien Danjou proposed openstack-infra/system-config: Rename Ceilometer to Telemetry https://review.openstack.org/243020 | 10:48 |
| *** dtantsur is now known as dtantsur|brb | 10:50 | |
| *** Liuqing has joined #openstack-infra | 10:50 | |
| AJaeger | BobBall: it means: Something has changed, you might want to review what has changed ;) | 10:51 |
| BobBall | And I've reviewed it and my last review still stands | 10:52 |
| BobBall | but I keep re-reviewing because the bold doesn't go away :/ | 10:52 |
| BobBall | so I forget lol | 10:52 |
| AJaeger | BobBall: here's a different query for you: | 10:53 |
| AJaeger | https://review.openstack.org/#/q/is:watched+status:open+label:Code-Review%253D0%252Cself,n,z | 10:53 |
| AJaeger | Configure the repos you want to watch and only see those that you didn't review with the above link | 10:53 |
| *** matt6434 has quit IRC | 10:54 | |
| BobBall | Ah - I'll check it out. Thanks. | 10:54 |
| yolanda | mm, gerrit is so slow for me | 10:54 |
| AJaeger | yolanda: your typing is faster than mine ;) | 10:55 |
| *** matt6434 has joined #openstack-infra | 10:55 | |
| AJaeger | something odd is currently happening | 10:55 |
| *** flwang has quit IRC | 10:55 | |
| yolanda | AJaeger, gerrit is failing | 10:55 |
| yolanda | full of jetty errors | 10:55 |
| AJaeger | ;-(((( | 10:55 |
| yolanda | will restart | 10:55 |
| odyssey4me | yeah, I'm seeing quite a bit of slowness | 10:55 |
| odyssey4me | also, the check queue seems a little larger than normal for this time of day? | 10:56 |
| AJaeger | odyssey4me: yes, it is... | 10:56 |
| *** maishsk has quit IRC | 10:59 | |
| dmellado | mm | 10:59 |
| dmellado | is gerrit down? | 10:59 |
| bauzas | yup | 10:59 |
| yolanda | i'm restarting that | 10:59 |
| dmellado | ty yolanda | 11:00 |
| yolanda | is that better now? | 11:00 |
| *** flwang has joined #openstack-infra | 11:00 | |
| dmellado | yolanda: yep, just loaded ;) | 11:00 |
| yolanda | cool | 11:00 |
| *** amotoki has quit IRC | 11:01 | |
| *** ddieterly has joined #openstack-infra | 11:02 | |
| lxsli | thanks yolanda ! | 11:03 |
| yolanda | np | 11:03 |
| *** dims has joined #openstack-infra | 11:06 | |
| odyssey4me | ty yolanda - it is better now | 11:06 |
| yolanda | ++ | 11:06 |
| *** ddieterly has quit IRC | 11:06 | |
| odyssey4me | another issue though, https://review.openstack.org/248757 merged around two hours ago but the jobs are still showing as NOT_REGISTERED | 11:07 |
| *** dgonzalez has joined #openstack-infra | 11:08 | |
| odyssey4me | you can test with https://review.openstack.org/248632 if you need something to try it out with | 11:08 |
| *** yamamoto has quit IRC | 11:10 | |
| *** aysyd has joined #openstack-infra | 11:10 | |
| *** Sree has quit IRC | 11:12 | |
| *** Sree has joined #openstack-infra | 11:13 | |
| *** rcernin is now known as rcernin|lunch | 11:13 | |
| AJaeger | odyssey4me: with the high load on the server,better wait some more ;( | 11:17 |
| *** Sree has quit IRC | 11:17 | |
| AJaeger | Looking at the puppet runs, it should have been updated ;( | 11:19 |
| *** Daisy_ has joined #openstack-infra | 11:19 | |
| *** ociuhandu has joined #openstack-infra | 11:21 | |
| *** AJaeger has quit IRC | 11:23 | |
| odyssey4me | AJaeger yeah, it's usually done within 30 mins | 11:25 |
| *** jlanoux_ has quit IRC | 11:27 | |
| *** jlanoux has joined #openstack-infra | 11:28 | |
| openstackgerrit | Flavio Percoco proposed openstack-infra/project-config: Fix job deffinition for ceph job https://review.openstack.org/249148 | 11:36 |
| *** Daisy_ has quit IRC | 11:37 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: Gnocchi: Fix mapping between of stable branches https://review.openstack.org/248050 | 11:38 |
| *** Daisy has joined #openstack-infra | 11:38 | |
| *** daemontool has joined #openstack-infra | 11:38 | |
| *** achanda has joined #openstack-infra | 11:39 | |
| *** daemontool has quit IRC | 11:40 | |
| *** hashar is now known as hasharLunch | 11:40 | |
| *** daemontool has joined #openstack-infra | 11:40 | |
| *** Daisy has quit IRC | 11:41 | |
| *** Daisy has joined #openstack-infra | 11:41 | |
| *** Daisy has quit IRC | 11:43 | |
| *** markus_z has joined #openstack-infra | 11:43 | |
| *** fhubik is now known as fhubik_brb | 11:46 | |
| *** Daisy has joined #openstack-infra | 11:46 | |
| *** jlanoux_ has joined #openstack-infra | 11:46 | |
| *** ramineni1 has quit IRC | 11:47 | |
| *** ildikov has quit IRC | 11:48 | |
| *** jlanoux has quit IRC | 11:49 | |
| *** Daisy has quit IRC | 11:51 | |
| *** Daisy has joined #openstack-infra | 11:51 | |
| *** dtantsur|brb is now known as dtantsur | 11:51 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/248430 | 11:53 |
| *** Daisy has quit IRC | 11:53 | |
| *** ihrachys has joined #openstack-infra | 11:53 | |
| *** Daisy has joined #openstack-infra | 11:53 | |
| *** oomichi has joined #openstack-infra | 11:57 | |
| *** yamamoto has joined #openstack-infra | 11:57 | |
| odyssey4me | yolanda any ideas why we still have NOT_REGISTERED jobs even after the merge 3 hours ago? | 11:58 |
| *** baoli has quit IRC | 11:58 | |
| openstackgerrit | Ivan Kolodyazhny proposed openstack-infra/project-config: Skip unsupported tests for BlockDeviceDriver https://review.openstack.org/248021 | 11:58 |
| yolanda | odyssey4me, that normally indicates that the job is not registered with jenkins, or that the node type requested is not present | 11:58 |
| *** sdake has joined #openstack-infra | 11:58 | |
| yolanda | i cannot look now, but i will have some time in a while | 11:59 |
| odyssey4me | yolanda ok, thanks | 11:59 |
| *** markus_z is now known as markus_z_meeting | 11:59 | |
| *** otter768 has joined #openstack-infra | 12:02 | |
| *** ddieterly has joined #openstack-infra | 12:02 | |
| *** sdake has quit IRC | 12:03 | |
| *** GonZo2000 has joined #openstack-infra | 12:05 | |
| *** GonZo2000 has quit IRC | 12:05 | |
| *** GonZo2000 has joined #openstack-infra | 12:05 | |
| *** Daisy has quit IRC | 12:05 | |
| *** Daisy has joined #openstack-infra | 12:06 | |
| *** otter768 has quit IRC | 12:06 | |
| *** ddieterly has quit IRC | 12:07 | |
| *** mpavone has quit IRC | 12:07 | |
| odyssey4me | yolanda how do I gain the ability to change the topic of the project channel for which I'm the PTL? | 12:08 |
| odyssey4me | it would appear that it has something to do with https://git.openstack.org/cgit/openstack-infra/project-config/tree/accessbot/channels.yaml#n37 ? | 12:08 |
| *** daemontool has quit IRC | 12:08 | |
| *** sdake has joined #openstack-infra | 12:09 | |
| *** daemontool has joined #openstack-infra | 12:09 | |
| *** Daisy has quit IRC | 12:11 | |
| *** thorst has joined #openstack-infra | 12:15 | |
| *** salv-orlando has joined #openstack-infra | 12:17 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: Gnocchi: Fix mapping between of stable branches https://review.openstack.org/248050 | 12:19 |
| *** mpavone has joined #openstack-infra | 12:20 | |
| *** thorst has quit IRC | 12:20 | |
| *** salv-orlando has quit IRC | 12:22 | |
| *** rossella_s has quit IRC | 12:23 | |
| *** rossella_s has joined #openstack-infra | 12:23 | |
| *** mahatic has quit IRC | 12:24 | |
| *** zeih has quit IRC | 12:27 | |
| *** zeih has joined #openstack-infra | 12:28 | |
| *** ramineni has joined #openstack-infra | 12:30 | |
| *** sergmelikyan has joined #openstack-infra | 12:30 | |
| *** mahatic has joined #openstack-infra | 12:30 | |
| *** fhubik_brb is now known as fhubik | 12:34 | |
| *** rcernin|lunch is now known as rcernin | 12:36 | |
| *** ashishb has quit IRC | 12:38 | |
| *** wolsen has quit IRC | 12:41 | |
| *** ildikov has joined #openstack-infra | 12:41 | |
| yolanda | odyssey4me, what jobs are causing you problems? can you share link? | 12:42 |
| odyssey4me | yolanda I think I've figured out the cause - perhaps you can help me verify. | 12:42 |
| yolanda | ok | 12:43 |
| odyssey4me | the job is defined here: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/ansible-role-jobs.yaml#L34-L52 | 12:43 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: zuul: enable beaker jobs for puppet-mistral https://review.openstack.org/249179 | 12:43 |
| odyssey4me | yolanda and one of them is executed here: https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L6794 | 12:44 |
| *** isaacb has joined #openstack-infra | 12:45 | |
| odyssey4me | yolanda but we have a function here which bypasses the dsvm node allocation: https://github.com/openstack-infra/project-config/blob/master/zuul/openstack_functions.py#L132-L135 | 12:45 |
| *** maishsk has joined #openstack-infra | 12:45 | |
| odyssey4me | yolanda so I think we're missing a node allocation here: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/projects.yaml#L3450-L3457 | 12:46 |
| odyssey4me | oh no - there is a node allocation... | 12:46 |
| *** trown|outttypeww is now known as trown | 12:47 | |
| jyuso1 | hi guys,i want to ask a question about applying a patch to my local CI env. | 12:47 |
| *** yamamoto has quit IRC | 12:47 | |
| jyuso1 | I use "git fetch xxx && git checkout FETCH_HEAD" command to patch now,should i use "git rebase master" operation after it? | 12:47 |
| odyssey4me | yolanda ok, perhaps it's best to actually review a check job: https://review.openstack.org/248632 | 12:48 |
| yolanda | odyssey4me, that job is a new one? i see job is created on jenkins, but not run | 12:49 |
| odyssey4me | yolanda yes, the job merged this morning | 12:49 |
| odyssey4me | yolanda https://review.openstack.org/248757 | 12:50 |
| yolanda | ok looking at jenkins, it needs devstack-trusty | 12:50 |
| odyssey4me | yolanda yeah, or ubuntu-trusty is an option I think | 12:51 |
| yolanda | and in projects.yaml i see it restricts to bare-precise or bare-trusty? | 12:51 |
| odyssey4me | ok, so your thinking is that if we switch https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/projects.yaml#L3452 to include 'devstack-trusty' as well, then it should work? | 12:53 |
| openstackgerrit | Ivan Kolodyazhny proposed openstack-infra/project-config: Skip unsupported tests for BlockDeviceDriver https://review.openstack.org/248021 | 12:53 |
| yolanda | odyssey4me, i think so, because if you look at job configuration, it's restricting the labels where it can be run to devstack-trusty | 12:54 |
| *** dewsday has joined #openstack-infra | 12:54 | |
| *** dprince has joined #openstack-infra | 12:54 | |
| *** dewsday has left #openstack-infra | 12:54 | |
| odyssey4me | ok, thanks yolanda I'll work up a patch | 12:55 |
| *** baoli has joined #openstack-infra | 12:55 | |
| *** bdemers has quit IRC | 12:55 | |
| yolanda | anytime | 12:56 |
| *** yamamoto has joined #openstack-infra | 12:59 | |
| *** tiswanso has quit IRC | 12:59 | |
| *** andymaier has quit IRC | 12:59 | |
| *** gordc has joined #openstack-infra | 12:59 | |
| *** mpavone has quit IRC | 13:00 | |
| *** gouthamr has left #openstack-infra | 13:00 | |
| *** markus_z_meeting is now known as markus_z | 13:01 | |
| *** zhenguo has joined #openstack-infra | 13:01 | |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Include devstack-trusty nodes for OSA role jobs https://review.openstack.org/249189 | 13:01 |
| odyssey4me | yolanda ^ | 13:01 |
| *** oomichi has quit IRC | 13:02 | |
| *** ddieterly has joined #openstack-infra | 13:03 | |
| *** rhallisey has joined #openstack-infra | 13:04 | |
| *** kgiusti has joined #openstack-infra | 13:04 | |
| *** salv-orl_ has joined #openstack-infra | 13:05 | |
| *** marcusvrn_ has quit IRC | 13:05 | |
| *** jhesketh has quit IRC | 13:06 | |
| *** olaph has quit IRC | 13:06 | |
| *** jhesketh has joined #openstack-infra | 13:07 | |
| *** ddieterly has quit IRC | 13:08 | |
| yolanda | odyssey4me, actually i think i was wrong. I see it uses devstack-trusty, but nodes are set correctly | 13:09 |
| *** amuller has joined #openstack-infra | 13:10 | |
| yolanda | so i'm comparing with another jobs of same type, such as pep8, that were executed properly | 13:10 |
| odyssey4me | ok, thanks yolanda | 13:11 |
| yolanda | odyssey4me, the ones using bare-precise || bare-trusty seem to have executed. There are also nodes with centos7 failing right? | 13:11 |
| *** mpavone has joined #openstack-infra | 13:12 | |
| odyssey4me | yolanda our particular roles have no centos, pabelanger does have one though | 13:12 |
| yolanda | odyssey4me .. https://jenkins01.openstack.org/view/All/job/gate-openstack-ansible-apt_package_pinning-dsvm-functional-centos7-nv/ ? | 13:13 |
| *** bpokorny has joined #openstack-infra | 13:14 | |
| odyssey4me | yolanda oh, that's odd - that shouldn't be happening | 13:14 |
| yolanda | seems there is some misconfiguration on the job and nodes, but i'm not sure | 13:14 |
| *** wolsen has joined #openstack-infra | 13:14 | |
| yolanda | i see this one was created yesterday | 13:15 |
| odyssey4me | yolanda yeah, the change was made to give these jobs access to sudo | 13:16 |
| *** dolpher has quit IRC | 13:16 | |
| odyssey4me | perhaps it's best to wait until pabelanger gets online - he's more familiar than I am with the effects of the change and can probably point us right | 13:16 |
| *** dolpher has joined #openstack-infra | 13:17 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/subunit2sql: Fix documentation before the release https://review.openstack.org/249199 | 13:18 |
| yolanda | odyssey4me, so in ansible roles template i see | 13:20 |
| yolanda | - job-group: | 13:20 |
| yolanda | name: 'ansible-role-jobs' | 13:20 |
| yolanda | jobs: | 13:20 |
| yolanda | - 'gate-{name}-docs' | 13:20 |
| yolanda | - 'gate-{name}-pep8' | 13:20 |
| yolanda | - 'gate-{name}-tox-{envlist}': | 13:20 |
| yolanda | envlist: ansible-lint | 13:20 |
| yolanda | - '{pipeline}-{name}-dsvm-functional-{ostype}{job-suffix}': | 13:20 |
| yolanda | job-suffix: '-nv' | 13:20 |
| yolanda | ostype: | 13:20 |
| yolanda | - centos7 | 13:20 |
| yolanda | - trusty | 13:20 |
| yolanda | that's generating jobs for trusty and centos7 | 13:20 |
| *** olaph has joined #openstack-infra | 13:21 | |
| *** jyuso1 has quit IRC | 13:21 | |
| *** daemontool has quit IRC | 13:22 | |
| *** Sree has joined #openstack-infra | 13:23 | |
| yolanda | odyssey4me, so actually the idea of restricting slaves is ok, but look at another samples on projects.yaml... you can define general labels, bare-precise || bare-trusty, but then you can add a jobs section in the project | 13:23 |
| yolanda | and set the dsvm ones to use different nodes, such as centos7 or trusty | 13:23 |
| odyssey4me | so the thing is that this job template is used for projects where not all of them support centos, so how do we restrict the jobs kicked off for the projects? | 13:25 |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/subunit2sql: Fix documentation before the release https://review.openstack.org/249199 | 13:25 |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: [sahara] scenario jobs voting in master branch https://review.openstack.org/249203 | 13:26 |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: [sahara] scenario jobs voting in master branch https://review.openstack.org/249203 | 13:27 |
| *** spzala has joined #openstack-infra | 13:27 | |
| openstackgerrit | Dmitriy Ukhlov proposed openstack/requirements: Updates pika-pool library https://review.openstack.org/249206 | 13:29 |
| openstackgerrit | Antoine Musso proposed openstack-infra/zuul: zuul-cloner: recognizes bare repos in cache dir https://review.openstack.org/249207 | 13:29 |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: [sahara] scenario jobs voting in master branch https://review.openstack.org/249203 | 13:30 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Fix tags causing 500 error when editing stories https://review.openstack.org/249208 | 13:30 |
| *** dizquierdo has quit IRC | 13:30 | |
| *** doug-fish has joined #openstack-infra | 13:30 | |
| *** jhesketh has quit IRC | 13:30 | |
| *** Liuqing_ has joined #openstack-infra | 13:31 | |
| *** Liuqing has quit IRC | 13:32 | |
| *** weshay_xchat is now known as weshay | 13:34 | |
| *** markvoelker has quit IRC | 13:35 | |
| *** pradk has joined #openstack-infra | 13:35 | |
| *** thorst has joined #openstack-infra | 13:36 | |
| *** thorst_ has joined #openstack-infra | 13:37 | |
| *** Sree__ has joined #openstack-infra | 13:37 | |
| *** daemontool has joined #openstack-infra | 13:39 | |
| *** Sree has quit IRC | 13:40 | |
| *** thorst has quit IRC | 13:41 | |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: [sahara] scenario jobs voting in master branch https://review.openstack.org/249203 | 13:43 |
| *** aopincar has quit IRC | 13:43 | |
| *** bexelbie_ has joined #openstack-infra | 13:43 | |
| *** thiagop has joined #openstack-infra | 13:43 | |
| *** bexelbie is now known as Guest8927 | 13:44 | |
| *** bexelbie_ is now known as bexelbie | 13:44 | |
| *** thorst_ has quit IRC | 13:44 | |
| *** bpokorny has quit IRC | 13:45 | |
| *** thorst_ has joined #openstack-infra | 13:45 | |
| openstackgerrit | Michael Krotscheck proposed openstack/requirements: Update oslo.middleware to 3.0.0 https://review.openstack.org/249216 | 13:45 |
| krotscheck | This... is going to be interesting. | 13:45 |
| openstackgerrit | Christian Berendt proposed openstack-infra/irc-meetings: [docinstallteam] change agenda_url https://review.openstack.org/249217 | 13:45 |
| *** claudiub|2 has joined #openstack-infra | 13:46 | |
| *** claudiub has quit IRC | 13:46 | |
| *** thorst_ has quit IRC | 13:49 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Don't add unexpected `story_id` attribute to Comment https://review.openstack.org/249219 | 13:49 |
| *** fhubik is now known as fhubik_brb | 13:49 | |
| *** fhubik_brb is now known as fhubik | 13:50 | |
| *** fhubik is now known as fhubik_brb | 13:50 | |
| *** fhubik_brb is now known as fhubik | 13:53 | |
| *** ayoung has joined #openstack-infra | 13:53 | |
| *** markvoelker has joined #openstack-infra | 13:53 | |
| *** fhubik is now known as fhubik_brb | 13:54 | |
| *** fhubik_brb is now known as fhubik | 13:54 | |
| *** fhubik is now known as fhubik_brb | 13:54 | |
| *** sergmelikyan has quit IRC | 13:55 | |
| *** daemontool has quit IRC | 13:56 | |
| *** daemontool has joined #openstack-infra | 13:57 | |
| *** achanda has quit IRC | 13:57 | |
| *** daemontool has quit IRC | 13:58 | |
| *** maishsk has quit IRC | 13:58 | |
| *** daemontool has joined #openstack-infra | 13:59 | |
| *** salv-orl_ has quit IRC | 14:00 | |
| *** tiswanso has joined #openstack-infra | 14:00 | |
| *** w__ has joined #openstack-infra | 14:00 | |
| openstackgerrit | Andrey Pavlov proposed openstack-infra/project-config: Rework ec2api jobs for new tempest`s plugin technology https://review.openstack.org/246890 | 14:01 |
| *** maishsk has joined #openstack-infra | 14:01 | |
| *** olaph has quit IRC | 14:01 | |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: Added new repo for fuel-plugin-virtual-accelerator in Openstack NS https://review.openstack.org/249229 | 14:02 |
| *** otter768 has joined #openstack-infra | 14:03 | |
| *** rcernin has quit IRC | 14:03 | |
| *** ddieterly has joined #openstack-infra | 14:04 | |
| *** Ramanjaneya has quit IRC | 14:04 | |
| *** achanda has joined #openstack-infra | 14:06 | |
| *** dtardivel has joined #openstack-infra | 14:06 | |
| *** trukisesst has joined #openstack-infra | 14:07 | |
| *** jhesketh has joined #openstack-infra | 14:07 | |
| *** otter768 has quit IRC | 14:08 | |
| *** ddieterly has quit IRC | 14:08 | |
| *** abregman is now known as abregman|brb | 14:10 | |
| *** w__ has quit IRC | 14:11 | |
| *** rlandy has joined #openstack-infra | 14:17 | |
| *** eharney has joined #openstack-infra | 14:19 | |
| *** hichihara has quit IRC | 14:20 | |
| *** alivigni has joined #openstack-infra | 14:22 | |
| *** regXboi has joined #openstack-infra | 14:23 | |
| *** trukisesst3 has joined #openstack-infra | 14:23 | |
| *** zz_dimtruck is now known as dimtruck | 14:25 | |
| *** trukisesst has quit IRC | 14:26 | |
| mordred | krotscheck: your commit message there makes me sad | 14:29 |
| mordred | krotscheck: not surprised, of course, but sad | 14:29 |
| ttx | mordred: would you be around to kill a tag I just pushed by mistake during release tools testing | 14:29 |
| *** Sree__ has quit IRC | 14:30 | |
| mordred | ttx: sure | 14:31 |
| *** Sree has joined #openstack-infra | 14:32 | |
| mordred | ttx: which tag/repo ? | 14:32 |
| ttx | mordred: hmm, dims decided to let it live | 14:32 |
| *** amotoki has joined #openstack-infra | 14:32 | |
| mordred | kk | 14:32 |
| ttx | was 3.0.1 for oslo.rootwrap | 14:32 |
| *** akshai has joined #openstack-infra | 14:32 | |
| ttx | it's valid, just useless. | 14:32 |
| dims | y, we are ok | 14:33 |
| mordred | \o/ | 14:33 |
| dims | :) | 14:33 |
| *** mriedem_away is now known as mriedem | 14:33 | |
| dims | ttx : we can try the pylockfile next time we have to test :) (need this to merge first https://review.openstack.org/#/c/248972/) | 14:34 |
| *** Sree has quit IRC | 14:36 | |
| *** mtanino has joined #openstack-infra | 14:37 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/release-tools: New tooling for service releases https://review.openstack.org/249241 | 14:37 |
| openstackgerrit | Antoine Musso proposed openstack-infra/zuul: zuul-cloner: recognizes bare repos in cache dir https://review.openstack.org/249207 | 14:37 |
| openstackgerrit | Igor Belikov proposed openstack-infra/project-config: Don't trigger gate-fuel-web-python26 job for fuel-web https://review.openstack.org/249242 | 14:37 |
| *** ddieterly has joined #openstack-infra | 14:38 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/release-tools: [WIP] New tooling for service releases https://review.openstack.org/249241 | 14:38 |
| krotscheck | mordred: At least they're not swift. | 14:38 |
| openstackgerrit | Merged openstack/requirements: Updated from generate-constraints https://review.openstack.org/248430 | 14:38 |
| *** tsg has quit IRC | 14:39 | |
| openstackgerrit | Moises Trovó proposed openstack-infra/zmq-event-publisher: Override parameters with environment variables https://review.openstack.org/235545 | 14:40 |
| openstackgerrit | Qiming Teng proposed openstack-infra/project-config: Add release notes jobs for senlin https://review.openstack.org/249244 | 14:40 |
| *** abregman|brb is now known as abregman | 14:41 | |
| *** EricGonczer_ has joined #openstack-infra | 14:44 | |
| *** goodygum_ is now known as noqa_v_qoovnie | 14:44 | |
| *** jgriffith_away is now known as jgriffith | 14:47 | |
| *** AJaeger has joined #openstack-infra | 14:48 | |
| *** bdemers has joined #openstack-infra | 14:49 | |
| *** bexelbie_ has joined #openstack-infra | 14:52 | |
| *** hasharLunch is now known as hashar | 14:52 | |
| *** achanda has quit IRC | 14:53 | |
| *** achanda has joined #openstack-infra | 14:54 | |
| *** bexelbie has quit IRC | 14:54 | |
| *** trukisesst has joined #openstack-infra | 14:55 | |
| *** olaph has joined #openstack-infra | 14:55 | |
| *** achanda_ has joined #openstack-infra | 14:56 | |
| dhellmann | fungi : if you're online already, do you have a few minutes to chat with me and ttx in #openstack-release? | 14:57 |
| *** trukisesst3 has quit IRC | 14:57 | |
| *** ramineni has quit IRC | 14:58 | |
| AJaeger | we still have a NOT_REGISTERED - as odyssey4me pointed out a few hours ago: https://review.openstack.org/248757 is merged but https://review.openstack.org/248632 does not use it. pabelanger, are you around? | 14:58 |
| *** akshai has quit IRC | 14:59 | |
| *** achanda has quit IRC | 14:59 | |
| *** akshai has joined #openstack-infra | 15:00 | |
| fungi | dhellmann: yep | 15:01 |
| *** akshai has quit IRC | 15:02 | |
| *** boris-42 has joined #openstack-infra | 15:02 | |
| *** salv-orlando has joined #openstack-infra | 15:04 | |
| *** thorst_ has joined #openstack-infra | 15:04 | |
| *** dkranz has joined #openstack-infra | 15:05 | |
| *** thorst_ has quit IRC | 15:05 | |
| *** thorst_ has joined #openstack-infra | 15:06 | |
| *** bhunter71 has joined #openstack-infra | 15:07 | |
| *** dims_ has joined #openstack-infra | 15:08 | |
| AJaeger | pabelanger, infra-root, could you look at the above, please? I don't see the job generated in jenkins01. | 15:08 |
| *** dims has quit IRC | 15:09 | |
| odyssey4me | AJaeger after a chat with yolanda I put this in, but we're not sure if this will make a difference: https://review.openstack.org/249189 | 15:09 |
| *** burgerk has joined #openstack-infra | 15:10 | |
| yolanda | odyssey4me, the change as it is right now won't work... but if you amend that, and add the right nodes for the jobs you need, it will make more sense | 15:10 |
| *** thorst_ has quit IRC | 15:10 | |
| AJaeger | odyssey4me, yolanda I would just add this to jenkins/jobs/ansible-role-jobs.yaml for the functional job. | 15:11 |
| *** burgerk_ has joined #openstack-infra | 15:11 | |
| yolanda | yes, i mean it | 15:11 |
| odyssey4me | AJaeger ah ok, then the jobs would also need to be renamed to reflect the correct node required, correct? | 15:12 |
| AJaeger | that one has already "node: 'devstack-{ostype}'", so change that | 15:12 |
| AJaeger | odyssey4me: right now your change is a noop, since the job itself overrides it. | 15:12 |
| *** hurgleburgler has joined #openstack-infra | 15:13 | |
| AJaeger | odyssey4me: we have zuul/openstack_functions.py that will do the right thing based on the job name | 15:14 |
| AJaeger | odyssey4me: check function devstack_params | 15:14 |
| odyssey4me | AJaeger will this override that though? https://github.com/openstack-infra/project-config/blob/master/zuul/openstack_functions.py#L132-L135 | 15:14 |
| pabelanger | AJaeger: 1 min, looking | 15:15 |
| *** peristeri has joined #openstack-infra | 15:15 | |
| *** burgerk has quit IRC | 15:15 | |
| *** dizquierdo has joined #openstack-infra | 15:15 | |
| AJaeger | thanks, pabelanger | 15:15 |
| AJaeger | odyssey4me: but we use the same setup for the puppet modules as well where it works. | 15:15 |
| pabelanger | AJaeger: I have an idea of the issue | 15:16 |
| pabelanger | AJaeger: let me get a patch up to simplify | 15:16 |
| jeblair | Nov 24 09:39:45 jenkins01 puppet-agent[20055]: (/Stage[main]/Jenkins::Job_builder/Exec[jenkins_jobs_update]) Command exceeded timeout | 15:16 |
| *** btully has joined #openstack-infra | 15:17 | |
| *** sridhar_ram has joined #openstack-infra | 15:17 | |
| AJaeger | jeblair: are you suggesting we should first run puppet manually? | 15:18 |
| odyssey4me | thanks pabelanger, and good morning :) | 15:18 |
| *** markvoelker has quit IRC | 15:18 | |
| *** rbrndt has joined #openstack-infra | 15:18 | |
| *** tiswanso has quit IRC | 15:18 | |
| jeblair | AJaeger: that usually happens when someone makes a change that causes all jobs to update, and usually we need to fix it by running jjb manually | 15:18 |
| *** markvoelker has joined #openstack-infra | 15:18 | |
| jeblair | AJaeger: it is likely the cause of the current problem | 15:18 |
| jeblair | Nov 24 03:24:50 jenkins01 puppet-agent[19633]: (/Stage[main]/Jenkins::Job_builder/Exec[jenkins_jobs_update]) Command exceeded timeout | 15:19 |
| *** tiswanso has joined #openstack-infra | 15:19 | |
| jeblair | that's the first timeout ^ | 15:19 |
| pabelanger | AJaeger: actually, my fix would be noop, so I think we should look at jeblair fix first | 15:19 |
| yolanda | jeblair, AJaeger, but in that case, i saw jobs were created on jenkins01 | 15:20 |
| yolanda | entries are there | 15:20 |
| *** sergmelikyan has joined #openstack-infra | 15:21 | |
| pabelanger | AJaeger: yolanda: I don't see why this would not work | 15:21 |
| AJaeger | yolanda: https://jenkins01.openstack.org/view/All/job/gate-openstack-ansible-apt_package_pinning-dsvm-functional-trusty-nv/ exists but the variant without -nv does not | 15:22 |
| AJaeger | jeblair: are you running jjb manually now? | 15:23 |
| e0ne | hi. could anybody review https://review.openstack.org/#/c/248021/, please? | 15:23 |
| jeblair | AJaeger: not yet | 15:23 |
| cloudnull | mornings o/ | 15:24 |
| AJaeger | jeblair: could you afterwards review the release-notes post job again, please? https://review.openstack.org/#/c/248256/ | 15:24 |
| jeblair | https://review.openstack.org/240116 | 15:25 |
| jeblair | that change to jjb affected all of our jobs | 15:25 |
| *** tsg has joined #openstack-infra | 15:25 | |
| mordred | pabelanger: was it you who recently made a patch to update something to statsd 3.0 or something? | 15:27 |
| *** maishsk has quit IRC | 15:27 | |
| jeblair | i have to run; can another infra-root run jjb on all masters in screen? | 15:27 |
| *** maishsk has joined #openstack-infra | 15:27 | |
| *** maishsk has quit IRC | 15:27 | |
| AJaeger | thanks jeblair for looking into this | 15:27 |
| yolanda | AJaeger, so you missed the one without -nv ? i looked at the one with -nv, and saw it was created, but never run | 15:28 |
| mordred | jeblair: yay | 15:28 |
| AJaeger | sdague: could you review https://review.openstack.org/#/c/248021/ for e0ne, please? The DEVSTACK_GATE_TEMPEST_REGEX is one thing that I'd like you to look at | 15:28 |
| AJaeger | yolanda: yes, the one without -nv is missing | 15:29 |
| *** abregman has quit IRC | 15:29 | |
| yolanda | AJaeger, ok, i thought it was some problem with labels, because we talked also about some job, generated for centos, that should not be there | 15:29 |
| *** maishsk has joined #openstack-infra | 15:30 | |
| *** ccrouch has joined #openstack-infra | 15:30 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Link to the relevant story in comment notifications https://review.openstack.org/249273 | 15:30 |
| mordred | jeblair: it's been a while since I've run jjb by hand - anything other than jenkins-jobs update --delete-old /etc/jenkins_jobs/config ? | 15:30 |
| e0ne | AJaeger, sdague: I can provide testr list-tests with current regexp | 15:30 |
| pabelanger | mordred: not me. I know ianw was recently updating statsd requirements (well a few months ago) | 15:30 |
| *** ccrouch has quit IRC | 15:31 | |
| fungi | mordred: time sudo -H jenkins-jobs update --delete-old /etc/jenkins_jobs/config | 15:32 |
| mordred | fungi: sweet. I'm starting on 01 now | 15:32 |
| fungi | mordred: the -H is necessary so that root's copy of the cache gets updated | 15:32 |
| *** ccrouch has joined #openstack-infra | 15:33 | |
| fungi | otherwise puppet agent will just continue to be broken when it tries to rerun it later | 15:33 |
| *** ccrouch has quit IRC | 15:33 | |
| *** ccrouch has joined #openstack-infra | 15:33 | |
| e0ne | added 'testr list-tests' results as a comment to my patch | 15:34 |
| *** salv-orlando has quit IRC | 15:36 | |
| *** akshai has joined #openstack-infra | 15:36 | |
| mordred | fungi: I have jjb running in a screen on jenkins01-07 | 15:36 |
| *** asselin_ has joined #openstack-infra | 15:36 | |
| *** asselin has joined #openstack-infra | 15:36 | |
| *** maishsk has quit IRC | 15:36 | |
| *** pcrews has joined #openstack-infra | 15:36 | |
| fungi | thanks mordred! | 15:37 |
| AJaeger | thanks, mordred ! | 15:37 |
| *** dprince has quit IRC | 15:39 | |
| *** sridhar_ram1 has joined #openstack-infra | 15:40 | |
| *** salv-orlando has joined #openstack-infra | 15:40 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/release-tools: Release tagging automation https://review.openstack.org/249241 | 15:40 |
| *** sridhar_ram has quit IRC | 15:41 | |
| anteaya | AJaeger: I think sdague said he was out this week, I recall that from last week's backscroll | 15:41 |
| *** asselin has left #openstack-infra | 15:41 | |
| *** asselin_ has left #openstack-infra | 15:41 | |
| *** dprince has joined #openstack-infra | 15:41 | |
| *** asselin has joined #openstack-infra | 15:42 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: Add DIB_LOCAL_CONFIG_USERNAME to local-config https://review.openstack.org/248976 | 15:42 |
| AJaeger | anteaya: thanks for the info | 15:42 |
| anteaya | welcome | 15:43 |
| openstackgerrit | Merged openstack-infra/nodepool: Add provider node stats https://review.openstack.org/248299 | 15:44 |
| *** sfinucan has joined #openstack-infra | 15:46 | |
| lifeless | armax: could you please +1 https://review.openstack.org/#/c/247306/ ? | 15:46 |
| lifeless | armax: infra needs your vote to move forward on it | 15:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/jenkins-job-builder: Add template-name as a variable that can be used in a template https://review.openstack.org/247263 | 15:46 |
| * armax looks | 15:46 | |
| armax | I did at one point | 15:47 |
| pabelanger | yolanda: AJaeger: it should be noted that both https://jenkins01.openstack.org/view/All/job/gate-ansible-role-nodepool-dsvm-functional-trusty-nv/ and https://jenkins01.openstack.org/view/All/job/gate-ansible-role-nodepool-dsvm-functional-trusty/ exist too. So, I would expect the other ansible jobs to work, since they use the same job template | 15:47 |
| clarkb | mordred: did you run with sudo -H ? | 15:47 |
| mordred | clarkb: yes | 15:47 |
| clarkb | woot | 15:48 |
| clarkb | (thats what got me last time) | 15:48 |
| *** jzerebecki has quit IRC | 15:48 | |
| *** sergmelikyan has quit IRC | 15:48 | |
| odyssey4me | pabelanger this is why I'm wondering whether https://github.com/openstack-infra/project-config/blob/master/zuul/openstack_functions.py#L132-L135 is interfering with the node allocation | 15:49 |
| lifeless | armax: yeah, Nakato added the stable change to the same patch | 15:49 |
| pabelanger | odyssey4me: Ah, ya. That might also explain it | 15:49 |
| pabelanger | odyssey4me: didn't know about that | 15:49 |
| lifeless | armax: thanks | 15:49 |
| lifeless | clarkb: mordred: https://review.openstack.org/#/c/247306/ now has armax' vote | 15:49 |
| pabelanger | odyssey4me: we should likely remove that, as it is not needed anymore | 15:49 |
| pabelanger | odyssey4me: it should be matching the devstack name now | 15:50 |
| *** salv-orlando has quit IRC | 15:51 | |
| odyssey4me | pabelanger so that was implemented for the openstack-ansible integrated test jobs, but I think we're at a point where we can probably implement that another way and remove the functions code | 15:51 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Set puppet DIB_INSTALLTYPE in tripleo.sh not toci_instack.sh https://review.openstack.org/246457 | 15:51 |
| AJaeger | pabelanger: I also think it will work once jjb has been run manually... | 15:52 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add docs-on-rtfd hook for ansible-role-{nodepool|zuul} https://review.openstack.org/248396 | 15:53 |
| *** achanda_ has quit IRC | 15:53 | |
| pabelanger | odyssey4me: Ah, ya. So it can't be removed just yet | 15:53 |
| jeblair | mordred: thanks | 15:54 |
| odyssey4me | ok, so for now we wait and see | 15:54 |
| *** Liuqing_ has quit IRC | 15:54 | |
| jeblair | mordred: we have some images on internap that show up in 'image list' but nodepool doesn't know about them because when it uploaded them, it got: | 15:56 |
| jeblair | OpenStackCloudException: Image creation failed: Unable to establish connection to https://image.api.nyj01.cloud.iweb.com/v1/images/670158e7-bd75-4da0-932f-48f91992b9fa (Inner Exception: Connection failure that may be retried.) | 15:56 |
| jeblair | mordred: so it deleted the local record | 15:57 |
| mordred | jeblair: oh nice! | 15:57 |
| mordred | jeblair: we should catch that exception and retry, dontcha think? | 15:57 |
| *** arxcruz has quit IRC | 15:57 | |
| *** bexelbie__ has joined #openstack-infra | 15:57 | |
| mordred | (given that it's a connection failure that may be retried) | 15:57 |
| *** bexelbie__ is now known as bexelbie | 15:58 | |
| *** bexelbie_ has quit IRC | 15:59 | |
| *** achanda has joined #openstack-infra | 15:59 | |
| *** hdd has joined #openstack-infra | 16:00 | |
| *** aspiers has joined #openstack-infra | 16:00 | |
| jeblair | mordred: maybe? i guess i'm still trying to work out why internap thinks there is an image at all... how many requests are involved in that? | 16:00 |
| *** salv-orlando has joined #openstack-infra | 16:00 | |
| mordred | jeblair: just one - it's a v1 call | 16:00 |
| *** isaacb has quit IRC | 16:01 | |
| mordred | jeblair: so it's just a put call | 16:01 |
| mordred | jeblair: oh - wait | 16:01 |
| mordred | jeblair: no, sorry, it's 2 calls in v1 | 16:01 |
| *** sergmelikyan has joined #openstack-infra | 16:01 | |
| *** trukisesst3 has joined #openstack-infra | 16:01 | |
| mordred | jeblair: it's an image_create call with the image metadata but not data, then an image_update call with teh image contents | 16:01 |
| jeblair | File "/usr/local/lib/python2.7/dist-packages/shade/__init__.py", line 2212, in create_image | 16:02 |
| jeblair | "Image creation failed: {message}".format(message=str(e))) | 16:02 |
| *** hashar has quit IRC | 16:02 | |
| jeblair | mordred: can you tell which one failed? that line doesn't exist anymore on the filesystem since shade has updated | 16:02 |
| mordred | jeblair: one sec | 16:02 |
| *** trukisesst3 has quit IRC | 16:02 | |
| *** tmorin has joined #openstack-infra | 16:03 | |
| *** trukisesst3 has joined #openstack-infra | 16:03 | |
| tmorin | fungi, sdague, armax, mestery: I wanted to talk about https://review.openstack.org/#/c/243610 | 16:03 |
| lxsli | mriedem: happy to purge orphaned bw_usage_cache rows. How should I do that please? Extra lines in my migration script? Deleting rows doesn't seem suitable for an online data migration | 16:03 |
| jeblair | mordred: i'm guessing the answer is no, because the exception is masked? | 16:03 |
| lxsli | ohhh wrong channel sorry >.< | 16:04 |
| mordred | jeblair: no - they're both covered by the same exception there ... there should be a task manager call for ImageCreate and one for ImageUpdate | 16:04 |
| tmorin | fungi, sdague, armax, mestery: would you have 5-10 minutes ? | 16:04 |
| mordred | jeblair: yah - and that should be fixed much better in 1.2.0 | 16:04 |
| *** otter768 has joined #openstack-infra | 16:04 | |
| mestery | tmorin: Yes, lurking and here | 16:04 |
| fungi | tmorin: i'm on a conference call for the next 30-60 minutes but can sort of multitask | 16:04 |
| tmorin | ok | 16:04 |
| *** salv-orlando has quit IRC | 16:04 | |
| mordred | jeblair: so if you can look for the task manager entries for internap for Image* it should be possible to see if an update was attempted | 16:05 |
| jeblair | mordred: ok, while i see if i can deduce by task calls, can you re-review https://review.openstack.org/226087 ? :) | 16:05 |
| mordred | yup | 16:05 |
| *** amitgandhinz has joined #openstack-infra | 16:05 | |
| openstackgerrit | Sébastien Han proposed openstack-infra/project-config: Add Ceph DevStack plugin to Stackforge https://review.openstack.org/188768 | 16:05 |
| tmorin | fungi, mestery: the basic issue is that as-is we are stuck (can't merge changes in backports, can't fix the requirements in our master to have code ready to fork a liberty release) | 16:05 |
| *** trukisesst has quit IRC | 16:05 | |
| mordred | jeblair: done | 16:06 |
| AJaeger | tmorin: developing on stable/liberty seems for me the best approach - but that means changing the ACLS AFAIU, armax. | 16:06 |
| tmorin | fungi, mestery: we would like to advance before a decision is made to eventually let subproject maintain their stable branches | 16:06 |
| tmorin | hi AJaeger | 16:06 |
| fungi | tmorin: it seems like working around this by dropping requirements sync/enforcement jobs is at best a short-term fix | 16:06 |
| *** fhubik_brb is now known as fhubik | 16:07 | |
| armax | tmorin: russellb, mestery and I will have to suggest the latest ML threads on the topic…we’ll reach a conclusion asap | 16:07 |
| *** ericksonsantos has joined #openstack-infra | 16:07 | |
| tmorin | fungi: yes, this is understood, but we need a short term fix | 16:07 |
| armax | right now I am in a meeting and I can’t give you devoted attention, please bear with us | 16:07 |
| fungi | also i'll admit i've been internetless for more than a week and am just now starting to catch up, so haven't read all the backstory | 16:08 |
| tmorin | armax: ok | 16:08 |
| tmorin | could it be considered to make the check-reqs job non-voting as a temporary measure ? | 16:08 |
| *** otter768 has quit IRC | 16:09 | |
| jeblair | mordred: i can't tell -- this is nodepool-pre-shade, so shade is not using the nodepool task manager | 16:10 |
| AJaeger | armax, mestery: gate-networking-cisco-requirements is also non-voting for now - but as temporary measure to get files into global requirements. We souuld follow up with Sambetts | 16:10 |
| *** nmagnezi has quit IRC | 16:10 | |
| mordred | jeblair: ohhhh | 16:11 |
| mordred | jeblair: I've got a patch up to pass in the nodepool task manager to shade | 16:11 |
| mordred | jeblair: lemme update that | 16:11 |
| anteaya | tmorin: what happened to get you into this positon? | 16:11 |
| tmorin | AJaeger: yes, I saw about gate-networking-cisco-requirements -- I was thinking we should also, *temporarily* be allowed to do the same | 16:11 |
| anteaya | I'd like to know so we can avoid this workflow in future | 16:12 |
| *** amitgandhinz has quit IRC | 16:12 | |
| jeblair | mordred: okay, but that's a whole other can of worms -- like we don't want a 45 minute upload task blocking everything | 16:12 |
| pabelanger | AJaeger: yolanda: odyssey4me: https://review.openstack.org/#/c/248632/ looks better now \o/ | 16:12 |
| *** amuller has quit IRC | 16:12 | |
| mordred | jeblair: oh right | 16:12 |
| fungi | tmorin: if neutron are okay with it (and hopefully qa as well) as a short-term measure, then i don't see why we'd object from an infrastructure standpoint. just no guarantees we can work around other job-related assumptions about branches being mismatched | 16:12 |
| pabelanger | AJaeger: yolanda odyssey4me: okay, I lied | 16:12 |
| tmorin | anteaya: hi, basically we tried to be the good pupils (enable check-resq jobs) without understanding that this wouldn't work for a delayed release, nor for doing backports | 16:12 |
| mordred | jeblair: so - I know which exception to try/except | 16:12 |
| pabelanger | I swear the job was registered | 16:13 |
| mordred | gimme a sec to get that into a patch | 16:13 |
| pabelanger | o/0 | 16:13 |
| pabelanger | okay, something up with browser, refreshing | 16:13 |
| anteaya | tmorin: why not remove the check requirements rather than making them non-voting? | 16:13 |
| tmorin | fungi: understood - we have few CI jobs for now, so that shouldn't be too complex, we already have branch-overriding jobs so that our master is tested against stable/liberty | 16:13 |
| jeblair | mordred: anyway, i'm assuming it's the second request that failed -- that would explain why there is a record in glance despite the failure, yeah? | 16:13 |
| tmorin | anteaya: yes, that would work too | 16:13 |
| anteaya | AJaeger: is there anything that says a repo has to use the check requirements job? | 16:14 |
| mordred | jeblair: yes. that would make the most sense | 16:14 |
| tmorin | anteaya: but having them for the soon-to-come stable/liberty branch would be nice, right, even if non-voting... | 16:14 |
| anteaya | I'm more in favour of you not using a job at all rather than using it poorly | 16:14 |
| fungi | tmorin: that's likely to be hacky and might not be testing what you expect, but as long as you/armax are comfortable with it then i'll lift my -1 | 16:14 |
| anteaya | tmorin: seems like you are asking us to do something that is beyond nice anyway | 16:14 |
| lifeless | anteaya: we won't accept them into global-requirements as a cross-check or a tested project if they don't | 16:14 |
| anteaya | lifeless: okay great, that is the consequence of lifting the job | 16:15 |
| anteaya | lifeless: thank you | 16:15 |
| lifeless | there may be more consequences, but thats the immediate one I know of | 16:15 |
| *** Ala has quit IRC | 16:15 | |
| anteaya | tmorin: so you don't have to have check requirements on your repo, you just need to have it if you want into global requirements | 16:15 |
| fungi | tmorin: my remaining objection with 243610 is from a technical perspective. if you _know_ those jobs aren't going to succeed for now, there's no reason to run them even nonvoting. experimental at most | 16:16 |
| openstackgerrit | Merged openstack-infra/system-config: Add shade logging to nodepool https://review.openstack.org/226087 | 16:16 |
| *** matrohon has quit IRC | 16:16 | |
| anteaya | tmorin: I'd prefer you lift the job until you get yourself sorted out then put the job back, rather than change how the job works on your repo | 16:16 |
| *** rcernin has joined #openstack-infra | 16:16 | |
| tmorin | anteaya: about "nice": yes, well, I meant "useful" | 16:16 |
| anteaya | well sounds like your definition of useful and mine differ | 16:16 |
| *** mpavone has quit IRC | 16:17 | |
| anteaya | so how about you remove them from your repo until we can agree they are useful to you | 16:17 |
| *** rossella_s has quit IRC | 16:17 | |
| tmorin | lifeless: we are not introducing new requirements, our reqs are a subset of neutron's requirements plus sphinx specific ones already used in some other places | 16:17 |
| *** rossella_s has joined #openstack-infra | 16:18 | |
| tmorin | fungi: the job will be useful for the stable/liberty branch to come | 16:18 |
| fungi | tmorin: you can add the job back at that point, and/or restrict it to just run for stable/liberty changes | 16:18 |
| tmorin | anteaya, fungi: I'm fine with removing the job if this is what makes consensus | 16:18 |
| e0ne | AJaeger: thanks for review! | 16:18 |
| anteaya | tmorin: it is what I would prefer to see | 16:18 |
| *** amuller has joined #openstack-infra | 16:19 | |
| anteaya | AJaeger: can we remove the job from cisco as well, for the same reason? | 16:19 |
| tmorin | fungi, anteaya: ok, what I will do then is update the change to remove the job, and see if everyone agress | 16:19 |
| anteaya | tmorin: thank you | 16:19 |
| zaro | morning | 16:19 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Retry API calls if they get a Retryable failure https://review.openstack.org/249304 | 16:19 |
| anteaya | morning zaro | 16:19 |
| mordred | jeblair: ^^ | 16:19 |
| lifeless | tmorin: we can't sync requirements to you | 16:19 |
| fungi | tmorin: an alternative would be to replace "voting: false" with "branch: stable/liberty" and then it will remain voting but only run on changes to stable/liberty | 16:19 |
| tmorin | fungi, anteaya: we'll add it back when we'll have clear guidelines on how to do this | 16:19 |
| tmorin | lifeless: understood, that will have to be manual | 16:20 |
| clarkb | mordred: is retrying that going to make 2 images in glance or get the original image record to line up server and client side | 16:20 |
| lifeless | tmorin: if you're not checking that you only land compatible reuquirements | 16:20 |
| anteaya | tmorin: yes clear guidelines seem helpful in this situation | 16:20 |
| lifeless | tmorin: which means you need to be removed from the projects.txt list in openstack/requirements | 16:20 |
| greghaynes | jeblair: mordred I wonder if nodepool should detect that failure too and attempt a delete along with the db row deletion? | 16:20 |
| mordred | clarkb: the retryable exception gets thrown when the connection itself failed in a way that did not result in the aPI call being made | 16:20 |
| tmorin | fungi: 'branch: stable/liberty' would work for us as well | 16:20 |
| lifeless | tmorin: we're talking about the networking-bgvpn thing right? | 16:20 |
| clarkb | mordred: except according to jeblair we have evidence the api call was made and glance has an image | 16:20 |
| mordred | clarkb: two different calls | 16:21 |
| tmorin | lifeless: yes, we are | 16:21 |
| fungi | tmorin: anyway, as i said, i'm happy to look to neutron and qa leadership for policy in this regard. from an infra perspective i simply want whatever you're running to at least make some sense | 16:21 |
| greghaynes | clarkb: I think this is a second call | 16:21 |
| clarkb | wait | 16:21 |
| mordred | clarkb: the sequence was "create image -> success ; update image -> retryable exception" | 16:21 |
| lifeless | tmorin: so yes, if you're disabling check-requirements, we must remove you from projects.txt | 16:21 |
| clarkb | glance can have an image after one call but requires 2 calls to make it useable? | 16:21 |
| pabelanger | could I trouble an infra-root to add me to https://review.openstack.org/#/admin/groups/1194,members and https://review.openstack.org/#/admin/groups/1195,members please? | 16:21 |
| mordred | clarkb: in v1, yes | 16:21 |
| *** rossella_s has quit IRC | 16:21 | |
| greghaynes | in v2 it requires N :p | 16:21 |
| mordred | clarkb: which is what this is using | 16:21 |
| tmorin | lifeless: why ? (what breaks if you don't ?) | 16:21 |
| *** rossella_s has joined #openstack-infra | 16:22 | |
| fungi | pabelanger: done | 16:22 |
| clarkb | I should buy a lighter keyboard | 16:22 |
| lifeless | tmorin: the periodic job that updates requirements | 16:22 |
| tmorin | lifeless: keeping in mind the assumption we don't add stuff that is not already there | 16:22 |
| zaro | mordred: rollback update, https://review.openstack.org/#/c/245598/ | 16:22 |
| fungi | clarkb: heavier keyboards make for better bludgeons | 16:22 |
| lifeless | tmorin: we can't make that assumption | 16:22 |
| anteaya | clarkb: do you need to start fires while you type? | 16:22 |
| lifeless | tmorin: because you're an independent team | 16:22 |
| zaro | anteaya: maybe you can help test the rollback. | 16:22 |
| mordred | infra-root: the channel topic in #openstack-meeting is out of sync - I have too many tasks I'm context switching -can someone help? | 16:22 |
| tmorin | lifeless: ok, understood | 16:22 |
| fungi | mordred: on it | 16:22 |
| clarkb | fungi: I am afraid that one day I will throw it across the room and take out a wall | 16:22 |
| lifeless | tmorin: and the files that reflect that assumption are under your review | 16:22 |
| anteaya | zaro: I would love to test the rollback | 16:22 |
| mordred | clarkb: :) | 16:22 |
| jeblair | mordred, infra-root: will fix topic | 16:22 |
| tmorin | lifeless: means I have to make a change on the requirements project as well | 16:22 |
| fungi | thanks jeblair | 16:23 |
| *** flepied has quit IRC | 16:23 | |
| lifeless | tmorin: http://git.openstack.org/cgit/openstack/requirements/tree/README.rst#n102 | 16:23 |
| lifeless | tmorin: is the documentation abou this | 16:23 |
| clarkb | anteaya: I should avoid doing that too | 16:23 |
| *** achanda_ has joined #openstack-infra | 16:23 | |
| anteaya | clarkb: you never know when you need a lighter | 16:23 |
| tmorin | lifeless: I think I understand, I'll read to confirm | 16:23 |
| lifeless | tmorin: we require the check job be present beforce accepting into projects.txt; if you disable it, we need to remove it. | 16:23 |
| zaro | anteaya: msg you the VM with running the rolled back gerrit | 16:23 |
| zaro | anteaya: maybe play around to make sure it's working as expected? | 16:24 |
| lifeless | tmorin: as I said in the mailing list thread, *all* our code assumes 'code on master is targeting master' | 16:24 |
| tmorin | lifeless: understood, I'll do both things then | 16:24 |
| anteaya | zaro: as so as you help me figure out how to sign in I will be happy to | 16:24 |
| lifeless | tmorin: at least from my perspective, things would work a lot better if you're targeting liberty, ig your branch was called liberty :) | 16:24 |
| zaro | anteaya: sign in as any user you want | 16:24 |
| tmorin | lifeless: thanks for pointing our the reverse flow of net-bgpvpn adding reqs being propagated into global requirements - this is indeed an important data point | 16:25 |
| *** flepied has joined #openstack-infra | 16:25 | |
| zaro | anteaya: you can push with same account as on review.o.o | 16:25 |
| tmorin | lifeless: yes, but based on existing ACLs and policy on "what stable/* means", we can't work in a stable/liberty branch | 16:25 |
| anteaya | zaro: okay | 16:25 |
| tmorin | fungi, anteaya, lifeless: thanks for your feedback, it seems we have a working short term solution | 16:26 |
| lifeless | tmorin: I understand that too; FWIW I'm in favour of addressing those acls and policy, rather than changing the conventions around master and what that implies | 16:26 |
| *** achanda has quit IRC | 16:26 | |
| zaro | anteaya: i've updated https://review.openstack.org/#/c/245598/ if you would like to know how i got to this point. | 16:26 |
| tmorin | which is removing the check-reqs job and removing us from projects.txt, until we know better | 16:26 |
| lifeless | tmorin: but - I'm not trying to drive a particular outcome, just illuminating the current consequences | 16:26 |
| fungi | tmorin: and from an existing acl policy perspective, i think it's up to neutron to decide whether that should be adjusted (presumably that's what armax and others are deliberating on) | 16:26 |
| *** bexelbie has quit IRC | 16:27 | |
| tmorin | fungi: this may even go beyond neutron, but I think the discuss on openstack-dev is in good shape | 16:27 |
| anteaya | tmorin: glad you have what you need to continue the discussion | 16:28 |
| * zaro stepping away for about 1/2 hr. | 16:28 | |
| fungi | if developing for master and backporting to stable under control of the neutron stable branch maintainers is a requirement of being part of neutron, then networking-bgpvpn may not yet be a fit for inclusion in neutron. otherwise, the acls in place are probably insufficient to cover neutron's desired landscape of possible development models | 16:28 |
| openstackgerrit | Mikhail S Medvedev proposed openstack-infra/ciwatch: Use zuul gerrit event listener implementation https://review.openstack.org/248919 | 16:28 |
| fungi | anyway, those are the two possible outcomes i see | 16:28 |
| tmorin | fungi: yes | 16:29 |
| *** zhenguo has quit IRC | 16:29 | |
| anteaya | zaro: thanks I'm in, that should give me some time to orient myself and poke around a bit | 16:29 |
| lifeless | fungi: if you have a sec, 247306 could use another vote | 16:30 |
| *** rebase has joined #openstack-infra | 16:30 | |
| *** dims_ has quit IRC | 16:30 | |
| anteaya | AJaeger: did you want me to offer a patch to address the non-voting requirements cisco plugin job? | 16:30 |
| *** EricGonczer_ has quit IRC | 16:31 | |
| clarkb | catching back up from last night | 16:31 |
| clarkb | nibalizer fixed ask.o.o's full / by moving some DB backups onto the ephemeral drive | 16:31 |
| *** EricGonczer_ has joined #openstack-infra | 16:31 | |
| *** trukise has joined #openstack-infra | 16:32 | |
| clarkb | he proposed a change to put all DB backups there, I am not super comfortable with that becuase its supposed to be "ephemeral" | 16:32 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Decouple nodepool db and config from builders https://review.openstack.org/222398 | 16:32 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Builders distinguish between failure and exception https://review.openstack.org/242131 | 16:32 |
| clarkb | maybe we need to reduce the retention instead and see if logrotate can do something like 7 days then a few weeklies? | 16:32 |
| *** matrohon has joined #openstack-infra | 16:32 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Decouple builders from nodepool instance https://review.openstack.org/232135 | 16:32 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Builders can be run on their own https://review.openstack.org/232251 | 16:32 |
| *** korzen has quit IRC | 16:33 | |
| *** placko has quit IRC | 16:33 | |
| *** trukise has quit IRC | 16:34 | |
| *** rebase has quit IRC | 16:34 | |
| openstackgerrit | Thomas Morin proposed openstack/requirements: Remove networking-bgpvpn from projects.txt https://review.openstack.org/249312 | 16:35 |
| *** trukise has joined #openstack-infra | 16:36 | |
| *** yonglihe has joined #openstack-infra | 16:37 | |
| *** dizquierdo has quit IRC | 16:38 | |
| *** signed8bit has joined #openstack-infra | 16:40 | |
| *** salv-orlando has joined #openstack-infra | 16:41 | |
| *** salv-orlando has quit IRC | 16:41 | |
| *** salv-orlando has joined #openstack-infra | 16:41 | |
| openstackgerrit | Anita Kuno proposed openstack-infra/project-config: Remove non-voting requirements check job from cisco plugin https://review.openstack.org/249318 | 16:43 |
| anteaya | AJaeger: ^^ | 16:43 |
| pleia2 | good morning | 16:43 |
| *** daemontool has quit IRC | 16:43 | |
| anteaya | morning pleia2 | 16:43 |
| *** daemontool has joined #openstack-infra | 16:44 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/subunit2sql: Fix documentation before the release https://review.openstack.org/249199 | 16:45 |
| anteaya | lifeless: https://review.openstack.org/#/c/249318/ if you are able to ensure my commit message is accurate I would be grateful | 16:45 |
| rcarrillocruz | trukise: welcome to the channel :-) | 16:46 |
| rcarrillocruz | yolanda: sergio ^ | 16:46 |
| *** dims has joined #openstack-infra | 16:46 | |
| yolanda | hi trukise, welcome | 16:47 |
| *** sabeen1 has joined #openstack-infra | 16:49 | |
| *** daemontool has quit IRC | 16:49 | |
| *** scheuran has quit IRC | 16:50 | |
| *** bnemec has quit IRC | 16:50 | |
| *** Swami has joined #openstack-infra | 16:51 | |
| *** ashishb has joined #openstack-infra | 16:51 | |
| clarkb | nibalizer for ask what do think about changing retention instead of using ephemeral disk? | 16:52 |
| nibalizer | :shrug: the ephemeral disk is completely empty so there isn't a reason not to use it imho | 16:53 |
| nibalizer | clarkb: i don't have a strong opinion | 16:53 |
| clarkb | except its ephemeral :) | 16:53 |
| *** dprince has quit IRC | 16:54 | |
| mordred | ECONTEXT | 16:54 |
| clarkb | mordred ask.o.o filled /last night | 16:54 |
| mordred | ah | 16:54 |
| mordred | lovely | 16:54 |
| clarkb | stopped working | 16:54 |
| mordred | yeah. full / == bad | 16:54 |
| clarkb | postgres backups were reason | 16:54 |
| clarkb | nibalizer has a change up to write them to /opt | 16:54 |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: networking-bgpvpn: remove check-requirements jobs https://review.openstack.org/249322 | 16:55 |
| clarkb | I think on rax ephemeral is not actually ephemeral though | 16:55 |
| clarkb | so not end of world | 16:55 |
| *** fhubik is now known as fhubik_brb | 16:56 | |
| *** trukise has left #openstack-infra | 16:56 | |
| nibalizer | so the backups are currently going to /var/backups/postgres_backups | 16:56 |
| nibalizer | or maybe pgsql_backups | 16:56 |
| *** sridhar_ram1 is now known as sridhar_ram | 16:56 | |
| nibalizer | we keep 30, they are gziped and about 6-700 mb each | 16:56 |
| nibalizer | which as clark pointed out is an impressive ammount of text | 16:57 |
| clarkb | generated by humans apparently | 16:57 |
| nibalizer | we shuld be vigilant though | 16:57 |
| nibalizer | ask.puppetlabs.com is periodically overrun with spambots | 16:58 |
| openstackgerrit | Christian Schwede proposed openstack-infra/project-config: Add Ceph DevStack plugin to Stackforge https://review.openstack.org/188768 | 16:58 |
| *** e0ne has quit IRC | 16:58 | |
| *** dprince has joined #openstack-infra | 16:59 | |
| *** lykinsbd has joined #openstack-infra | 17:00 | |
| openstackgerrit | Mike Fedosin proposed openstack/requirements: Rename semantic-version dep to semantic_version https://review.openstack.org/249327 | 17:00 |
| *** ssancheztrujillo has joined #openstack-infra | 17:01 | |
| *** abregman has joined #openstack-infra | 17:02 | |
| greghaynes | clarkb: secure.conf change passes tests now FYI | 17:02 |
| lifeless | anteaya: I don't understand the intent of your patch | 17:03 |
| lifeless | anteaya: the cisco plugin isn't in requirements/projects.txt, so we don't care whether they run the check job or not | 17:03 |
| lifeless | anteaya: but if they are aiming to be there (And the comment in the section you're removing suggests they do) | 17:04 |
| lifeless | anteaya: then a non-voting run is the usual pattern to work up to voting | 17:04 |
| *** samuelBartel has quit IRC | 17:04 | |
| notmorgan | lifeless: you're up ... early? but good morning sir! | 17:04 |
| lifeless | notmorgan: ECATs | 17:04 |
| notmorgan | lifeless: ah. | 17:05 |
| lifeless | notmorgan: then couldn't get back to sleep | 17:05 |
| lifeless | notmorgan: :/ | 17:05 |
| notmorgan | lifeless: yah | 17:05 |
| *** jlanoux_ has quit IRC | 17:06 | |
| *** sdake_ has joined #openstack-infra | 17:07 | |
| anteaya | lifeless: the issue from my perspective is that having requirements check be non-voting is an outlier | 17:07 |
| anteaya | lifeless: that was the red flag that prompted the question on tmorin's patch | 17:07 |
| *** sdake has quit IRC | 17:07 | |
| anteaya | lifeless: so if there is a workflow for how projects are supposed to be using the requirements check job template I would like it documented so I can follow it | 17:08 |
| lifeless | anteaya: I understand; I can see pros and cons there. What is the exepcted pattern for a project that wants to build up to having the job passs ? | 17:08 |
| anteaya | because at the moment I having been working with the belief that requirements check should always be voting | 17:09 |
| *** fhubik_brb is now known as fhubik | 17:09 | |
| anteaya | lifeless: sure that is fine, the patch was intended to follow policy not create it | 17:09 |
| lifeless | anteaya: the only docs I'm aware of are the ones I wrote for requirements/README.rst, which simply require the job to be used for things in projects.txt. | 17:09 |
| anteaya | lifeless: I thought I was following a policy | 17:09 |
| anteaya | lifeless: so perhaps there needs to be a dicussion about workflow for a repo that wants in to requirements | 17:10 |
| openstackgerrit | Thomas Morin proposed openstack/requirements: Remove networking-bgpvpn from projects.txt https://review.openstack.org/249312 | 17:10 |
| anteaya | because I don't know what that workflow is | 17:10 |
| jeblair | mgagne: i'm having trouble launching instances on internap, do you have a fem moments to help? | 17:10 |
| anteaya | all I know is that every project that uses a template differently than the others creats havoc for someone | 17:10 |
| lifeless | anteaya: I thought the normal pattern for anyone adding a job was to add it nonvoting, then fix it, then make it voting; the same pattern would apply here | 17:10 |
| lifeless | anteaya: understood; I value the benefits of consistency | 17:11 |
| anteaya | lifeless: if that was the case the tmorin patch wouldn't have raised a red flag | 17:11 |
| lifeless | anteaya: tmorin's patch is the reverse: its taking a voting thing non-voting | 17:11 |
| lifeless | anteaya: that should always raise a flag IMO | 17:11 |
| anteaya | it doesn't for me | 17:11 |
| anteaya | the workflow for a brand new job is to start is off as experimental | 17:11 |
| anteaya | then to non-voting in check then to voting in check and gate | 17:12 |
| tmorin | lifeless: it you can review https://review.openstack.org/#/c/249312/, that will allow the zuul change to go through | 17:12 |
| anteaya | the workflow I know for jobs taht have a template is use the template or don't | 17:12 |
| tmorin | lifeless: s/it/if/ | 17:12 |
| anteaya | for jobs that have a template folks can indicate if they want certain branches tested or voting or not | 17:13 |
| *** tmorin has left #openstack-infra | 17:13 | |
| *** ayoung has quit IRC | 17:13 | |
| anteaya | that is the perspective I carry in my head at the moment with others may or may not agree with | 17:13 |
| anteaya | s/with/which | 17:13 |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/subunit2sql: Fix documentation before the release https://review.openstack.org/249199 | 17:13 |
| openstackgerrit | Merged openstack-infra/project-config: Flip Neutron's unit tests to -constraints https://review.openstack.org/247306 | 17:14 |
| *** eil397 has joined #openstack-infra | 17:15 | |
| ryanpetrello | anybody know if the README on https://github.com/stackforge/pecan could be updated to point to github.com/pecan/pecan | 17:17 |
| ryanpetrello | or at least see if the "This project is no longer maintained." could be removed (because it's not true) | 17:17 |
| ryanpetrello | the project's still maintained - it just moved :) | 17:17 |
| *** nadya_ has quit IRC | 17:17 | |
| *** sdake_ has quit IRC | 17:17 | |
| openstackgerrit | gordon chung proposed openstack-infra/project-config: rename ceilometer-specs to telemetry-specs https://review.openstack.org/248897 | 17:18 |
| ryanpetrello | I had a nice simple README uploaded there that explained the move: https://github.com/stackforge/pecan/commit/b49e8c7be413512866390e0a03ee18802ad3d046 | 17:18 |
| *** dims has quit IRC | 17:18 | |
| ryanpetrello | mordred or jeblair or clarkb ^ | 17:18 |
| *** dims_ has joined #openstack-infra | 17:18 | |
| *** mahatic has quit IRC | 17:19 | |
| *** regXboi has quit IRC | 17:19 | |
| mgagne | jeblair sure | 17:19 |
| mgagne | jeblair going to grab a coffee in a moment | 17:19 |
| *** david-ly_ has joined #openstack-infra | 17:19 | |
| *** matrohon has quit IRC | 17:19 | |
| jeblair | ryanpetrello: yeah, i think we ought to be able to revert that last commit -- it looks like it was erroneously trying to do what you had already done :) | 17:21 |
| ryanpetrello | jeblair: great - thanks :D | 17:21 |
| ryanpetrello | I know this URL's going to disappear at some point, but I'd like to point folks in the right direction as long as possible :) | 17:22 |
| jeblair | mgagne: i currently have a server in build state: c350ea27-30ce-49cd-93e9-43d64bccc2ca and it's not advancing beyond 'spawning' | 17:22 |
| *** ihrachys has quit IRC | 17:22 | |
| anteaya | zaro: I was trying to locate the most recent patchset by patchset number in the rollback instance to test the most recent patchset (assuming it is a new patchset you created when at 2.11) and am now getting server not available errors | 17:23 |
| *** aspiers_ has joined #openstack-infra | 17:23 | |
| *** david-l__ has joined #openstack-infra | 17:23 | |
| *** david-ly_ has quit IRC | 17:23 | |
| *** david-lyle has quit IRC | 17:23 | |
| *** mohankumar has joined #openstack-infra | 17:24 | |
| mgagne | jeblair looks like you didn't provide any networks. I found out yesterday that if you have cells, the network sanity check is not performed by the API (fail if you have 2>=networks and didn't provide any). The instance is scheduled and stay in spawning for a while before failing with No valid host found. | 17:24 |
| zaro | anteaya: sorry should be back on now. i forgot to run gerrit as a daemon. | 17:25 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API https://review.openstack.org/221964 | 17:25 |
| jeblair | mgagne: aha, hrm, i thought i specified one, but i will look into that assuming something is wrong there. is inap-17301-WAN2344 the one i should use? | 17:25 |
| mgagne | jeblair yes | 17:26 |
| mordred | jeblair, ryanpetrello: https://review.openstack.org/#/c/249334/ | 17:26 |
| zaro | anteaya: new patches i created with 2.11 are 236753, and 236754 | 17:26 |
| *** aspiers has quit IRC | 17:26 | |
| mgagne | jeblair I found the source of the bug mentioned above, will deploy in prod soon | 17:26 |
| *** ayoung has joined #openstack-infra | 17:26 | |
| jeblair | mordred: oh you're doing that to... :) | 17:26 |
| mgagne | jeblair bug was introduced in 2013 =) | 17:26 |
| jeblair | mordred: one sec | 17:26 |
| mordred | jeblair: sorry - I should have said "yeah, on it" | 17:27 |
| jeblair | mordred, ryanpetrello: i changed the commit message on https://review.openstack.org/249334 | 17:27 |
| ekarlso | hey guys, what's needed to make a plugin in devstack work with the new plugin model ? ref designate | 17:27 |
| mordred | jeblair: ++ | 17:27 |
| mgagne | https://github.com/openstack/nova/commit/1d9a0a620d78ab54f7a3da61b803a97cdbdd01f2 | 17:27 |
| jeblair | mordred: cool, i'll finish pushing that through | 17:27 |
| mordred | jeblair: woot | 17:28 |
| ryanpetrello | jeblair mordred: thanks a ton! | 17:28 |
| *** dtantsur is now known as dtantsur|afk | 17:28 | |
| anteaya | zaro: okay thanks | 17:28 |
| jeblair | ryanpetrello, mordred: https://github.com/stackforge/pecan/ | 17:28 |
| ryanpetrello | \o/ | 17:29 |
| *** yamamoto has quit IRC | 17:29 | |
| jeblair | and it's read-only again | 17:29 |
| mordred | jeblair: oh, that's nice "emonty commited with jeblai" - I don't think I'd notcied that before | 17:29 |
| anteaya | zaro: I'd gotten as far as 236750 :) | 17:29 |
| *** david-l__ has quit IRC | 17:30 | |
| jeblair | mordred: heh, yeah, of course the wording is wrong -- i'm the committer, you're the author, but i guess that collided with the way github normally says those things :) | 17:30 |
| anteaya | elmiko: devstack plugin questions probably have a better audience in #openstack-qa | 17:30 |
| *** ccrouch has quit IRC | 17:31 | |
| jeblair | ekarlso: ^ | 17:31 |
| *** ccrouch has joined #openstack-infra | 17:31 | |
| mordred | jeblair: heh | 17:31 |
| elmiko | o.O | 17:31 |
| fungi | elmiko: i think anteaya meant to reply to ekarlso and mistyped | 17:33 |
| mordred | fungi, jeblair, clarkb: I got this on jenkins02: | 17:33 |
| mordred | urllib2.HTTPError: HTTP Error 502: Proxy Error | 17:33 |
| mordred | INFO:jenkins_jobs.builder:Cache saved | 17:33 |
| elmiko | fungi: seems reasonable =) | 17:33 |
| mordred | same with 05 | 17:33 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Fail early if no data is found in the database https://review.openstack.org/249338 | 17:33 |
| clarkb | mordred check thread count under /monitoring | 17:33 |
| mordred | the others are still running | 17:33 |
| anteaya | elmiko: I did so, sorry about that | 17:33 |
| fungi | mordred: restart it. when jenkins is loaded or breaking, incidence of that will increase | 17:33 |
| ekarlso | anteaya: kewl | 17:34 |
| fungi | mordred: jjb will pick up where it left off, in theory | 17:34 |
| elmiko | anteaya: hehe no worries | 17:34 |
| mordred | fungi, clarkb: AWESOME | 17:34 |
| anteaya | fungi: thank you | 17:34 |
| mordred | clarkb: can I use your playbook to restart just one master? | 17:34 |
| fungi | mordred: but if the jjb update dies with too much frequency then a jenkins restart will make it less frequent again | 17:34 |
| mordred | cool | 17:34 |
| anteaya | zaro: so far the gui for editing topic and commit message work on patchset 236574 | 17:35 |
| clarkb | mordred you have to change the hosts glob | 17:35 |
| *** mohankumar has quit IRC | 17:35 | |
| clarkb | mordred I have no idea if ansible has a better system for doing that than cp and sed | 17:35 |
| *** derekh has quit IRC | 17:35 | |
| anteaya | zaro: sorry that was 235754 | 17:36 |
| mordred | clarkb: -l jenkins02.openstack.org I believe should do it | 17:37 |
| anteaya | zaro: I don't know if you care or not but I am using the new screen and in ff 42 and don't see a 'copy to clipboard' button like mordred and I tested last week | 17:37 |
| anteaya | zaro: I don't know if I should be seeing it or not | 17:38 |
| *** bcourt has joined #openstack-infra | 17:38 | |
| *** jordanP has quit IRC | 17:38 | |
| zaro | anteaya: i think that bug was only with 2.11 | 17:39 |
| anteaya | ah yes sorry and I am on 2.8 again | 17:39 |
| anteaya | yup thanks | 17:39 |
| anteaya | okay back in a bit | 17:39 |
| zaro | anteaya: fwiw, the little copy icons are next to change id and commit message on old screen | 17:39 |
| anteaya | I'll look when I get back | 17:39 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Add template-name as a variable that can be used in a template https://review.openstack.org/247263 | 17:40 |
| zaro | anteaya: git review won't work with that test site. old screen has the download link, something like 'git fetc ...' | 17:41 |
| *** trown is now known as trown|lunch | 17:41 | |
| *** HeOS has quit IRC | 17:42 | |
| *** shardy has quit IRC | 17:44 | |
| *** david-lyle has joined #openstack-infra | 17:44 | |
| *** electrofelix has joined #openstack-infra | 17:46 | |
| *** ashleighfarnham has joined #openstack-infra | 17:46 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Fix documentation before the release https://review.openstack.org/249199 | 17:47 |
| *** lykinsbd has quit IRC | 17:48 | |
| mriedem | mordred: did pbr change somehow such that it doesn't blow up when the version in setup.cfg of a project conflicts with a release tag on the same repo? | 17:49 |
| mriedem | i would expect juno side grenade to be failing: http://logs.openstack.org/16/216716/1/check/gate-grenade-dsvm/b9a97bb//logs/old/devstacklog.txt.gz#_2015-11-24_17_17_15_859 | 17:49 |
| *** maishsk has joined #openstack-infra | 17:49 | |
| mriedem | since nova stable/juno setup.cfg says the version is 2014.2.4 and that tag already exists in the repo | 17:49 |
| *** shashank_hegde has joined #openstack-infra | 17:50 | |
| *** yamahata has joined #openstack-infra | 17:51 | |
| *** placko has joined #openstack-infra | 17:51 | |
| jeblair | mgagne: found it, thanks! entirely my fault. btw 65c94183-8256-4f90-978a-9f0037ddf5c7 seems stuck in build/delete. | 17:51 |
| *** zz_zz_ja is now known as zz_zz_zz_ja | 17:51 | |
| mgagne | jeblair no problem. every error raised by Nova and forward to notifications.error are sent to our monitoring system. Let me tell you it forces us to fix bugs =) | 17:52 |
| mgagne | jeblair ok, will try to cleanup the instance | 17:53 |
| lifeless | anteaya: sorry, family getting up | 17:53 |
| jeblair | mgagne: oh you must love it when i leave nodepool in an error loop :) | 17:53 |
| mgagne | jeblair :D | 17:53 |
| lifeless | anteaya: I differ slightly in my views; I see the experimental -> nonvoting -> voting path as applying to any job that is being added to a new context | 17:54 |
| mgagne | jeblair tbh, they think it's mordred | 17:54 |
| mriedem | lifeless: question to you on pbr also ^ | 17:54 |
| lifeless | anteaya: the case where the job is new to the system as a whole is one special case of the general case | 17:54 |
| jeblair | mgagne: excellent :) | 17:54 |
| lifeless | mriedem: no, but we agreed at the summit to remove things from setup.cfg | 17:54 |
| mriedem | lifeless: yeah, but that's not hte case here (it's not post-versioning), so i'm not sure why pbr doesn't fail | 17:55 |
| mriedem | because https://github.com/openstack/nova/blob/stable/juno/setup.cfg#L3 | 17:55 |
| mriedem | https://github.com/openstack/nova/blob/2014.2.4/setup.cfg#L3 | 17:55 |
| lifeless | mriedem: very old pbr | 17:55 |
| *** AJaeger has quit IRC | 17:55 | |
| mriedem | 0.11 | 17:56 |
| lifeless | hmm | 17:56 |
| dims_ | anteaya : hopefully a quick one https://review.openstack.org/#/c/248972/ since lifeless and AJaeger have already blessed it | 17:56 |
| mriedem | 0.11 had the change which would break on the case like that | 17:56 |
| mriedem | i remember it from before | 17:56 |
| *** AJaeger has joined #openstack-infra | 17:56 | |
| *** maishsk has quit IRC | 17:56 | |
| *** nmagnezi has joined #openstack-infra | 17:57 | |
| flaper87 | jeblair: hey, how hard would it be to make gertty load a dashboard template? It'd be super cool to be able to do that, I might even help :D | 17:57 |
| dims_ | anteaya : background, ran into it when pylockfile job failed to upload to pypi since that script was using older wheel/universal syntax. thanks in advance! | 17:57 |
| electrofelix | zaro waynr zxiiro: https://review.openstack.org/150730 is another fairly major change that I think is ready to land, and we may want to look at https://review.openstack.org/230613 to see if it still works afterwards. | 17:57 |
| asselin | puppet really needs to fix this: Error: Duplicate declaration: Httpd_mod[rewrite] is already declared in file /etc/puppet/modules/zuul/manifests/init.pp:407; cannot redeclare at /etc/puppet/modules/httpd/manifests/mod.pp:11 on node test-ci.openstacklocal | 17:57 |
| lifeless | mriedem: is there a pip freeze output around somewhere to look at? | 17:58 |
| mriedem | lifeless: http://logs.openstack.org/16/216716/1/check/gate-grenade-dsvm/b9a97bb//logs/pip-freeze.txt.gz | 17:58 |
| *** mohankumar has joined #openstack-infra | 17:58 | |
| mriedem | lifeless: although that's most likely the kilo side after the upgrade | 17:58 |
| mtreinish | nibalizer: whenever you're around I think the set of patches in: https://etherpad.openstack.org/p/the-big-subunit2sql-migration should be stable now | 17:59 |
| mtreinish | once those all land we can start working through the manual steps | 17:59 |
| *** ihrachys has joined #openstack-infra | 17:59 | |
| mriedem | lifeless: apparently it installed pbr 1.8.1 http://logs.openstack.org/16/216716/1/check/gate-grenade-dsvm/b9a97bb//logs/old/devstacklog.txt.gz#_2015-11-24_17_15_32_386 | 17:59 |
| mriedem | lifeless: so g-r pbr on stable/juno isn't being taken into effect | 17:59 |
| mriedem | probably b/c of testtools | 18:00 |
| *** sergmelikyan has quit IRC | 18:00 | |
| lifeless | mriedem: -e git+https://git.openstack.org/openstack/nova@4b158202e63d0aa252087664f8e3f64080988a21#egg=nova-dev | 18:00 |
| lifeless | mriedem: I'm speculating but it may have avoided a version entirely | 18:00 |
| jeblair | flaper87: i think it would be cool; i haven't looked at it though, so don't really know what might be involved... | 18:00 |
| *** ivar-lazzaro has joined #openstack-infra | 18:00 | |
| mriedem | lifeless: that's the kilo change | 18:00 |
| *** ccrouch has quit IRC | 18:00 | |
| *** e0ne has joined #openstack-infra | 18:01 | |
| *** ccrouch has joined #openstack-infra | 18:01 | |
| lifeless | mriedem: true, but if develop mode is being used on both sides I'd expect the same | 18:01 |
| flaper87 | jeblair: If I manage to get 1 finger out of this huge pile of ______ I'm in, I'll take a look and let you know | 18:01 |
| lifeless | mranyhow, pbr really can't be pinned, because setuptools can't handle conflicts | 18:01 |
| pabelanger | fungi: thanks! | 18:01 |
| AJaeger | just catching up with backscroll: anteaya, yes, we should remove the job from cisco as well. Will you send a change? | 18:01 |
| lifeless | AJaeger: cisco is going to be the same pattern? | 18:02 |
| nibalizer | mtreinish: I'll be avilable after the infra meeting | 18:02 |
| mtreinish | nibalizer: ok cool, thanks | 18:03 |
| *** david-lyle has quit IRC | 18:03 | |
| jeblair | flaper87: cool, happy to help with advice, i'm in the middle of another gertty project right now unable to contribute hacking atm. | 18:03 |
| mriedem | lifeless: yeah, fixtures 1.0.0 has uncapped testtools which has uncapped pbr so we pull in latest pbr, | 18:03 |
| mriedem | but as you say, maybe that doesn't matter in this case | 18:03 |
| mriedem | lifeless: but that would mean pbr did change between 0.11 and 1.8.1 to treat the versions differently, at least in dev mode | 18:04 |
| *** [1]Thelo has joined #openstack-infra | 18:04 | |
| AJaeger | just catching up with backscroll: anteaya, yes, we should remove the job from cisco as well. Will you send a change? | 18:04 |
| *** jistr has quit IRC | 18:04 | |
| lifeless | mriedem: *perhaps* | 18:04 |
| AJaeger | oops, sorry about the duplicate | 18:04 |
| lifeless | mriedem: without sitting down and testing, I wouldn't want to speculate | 18:04 |
| AJaeger | lifeless: cisco has a comment "Waiting for merge to global requirements" | 18:05 |
| *** ssancheztrujillo has quit IRC | 18:05 | |
| *** otter768 has joined #openstack-infra | 18:05 | |
| lifeless | AJaeger: yes, which suggests it *won't* be the same as networking-bgpvpn | 18:05 |
| *** sshnaidm has quit IRC | 18:05 | |
| AJaeger | lifeless: correct | 18:05 |
| lifeless | AJaeger: which is why removing their job doesn't make sense to me | 18:05 |
| *** Thelo has quit IRC | 18:06 | |
| *** [1]Thelo is now known as Thelo | 18:06 | |
| lifeless | AJaeger: its nonvoting todaty, and they've expressed an intent to be synced | 18:06 |
| *** placko has quit IRC | 18:06 | |
| lifeless | AJaeger: but ultimately IMO its up to cisco - if their master matches master, we can sync once they're installable | 18:06 |
| AJaeger | lifeless, anteaya : then let's leave it in - but let's figure out whether the TODO is still valid... | 18:06 |
| lifeless | Nakato: https://review.openstack.org/#/c/247306/ is in - \o/ | 18:06 |
| AJaeger | lifeless: they seem to not make any progress, see https://review.openstack.org/#/c/215673/4 ;( | 18:07 |
| *** kushal has quit IRC | 18:07 | |
| lifeless | AJaeger: https://review.openstack.org/#/c/249312/ - you may want to 2A that | 18:07 |
| *** markus_z has quit IRC | 18:08 | |
| AJaeger | lifeless: I'm not core on requirements, so can only +1 | 18:08 |
| *** placko has joined #openstack-infra | 18:09 | |
| *** otter768 has quit IRC | 18:09 | |
| mgagne | jeblair ok, you should get a badrequest if you don't provide networks now =) | 18:10 |
| lifeless | mriedem: 0.11.. has nothing likely in it | 18:11 |
| *** david-lyle has joined #openstack-infra | 18:11 | |
| asselin | pabelanger, can you help me resolve this issue: Error: Duplicate declaration: Httpd_mod[rewrite] is already declared in file /etc/puppet/modules/zuul/manifests/init.pp:407; cannot redeclare at /etc/puppet/modules/httpd/manifests/mod.pp:11 on node test-ci.openstacklocal | 18:11 |
| *** ayoung has quit IRC | 18:12 | |
| *** hemna has quit IRC | 18:12 | |
| *** ayoung has joined #openstack-infra | 18:12 | |
| lifeless | mriedem: even better, pbr 0.11 *cannot* install juno | 18:12 |
| *** claudiub|2 has quit IRC | 18:12 | |
| mriedem | lifeless: yeah it's not using pbr 0.11 | 18:12 |
| lifeless | UnicodeDecodeError: 'utf8' codec can't decode byte 0xa0 in position 1187750: invalid start byte | 18:13 |
| mriedem | it's using 1.8.1 | 18:13 |
| mriedem | b/c of deps pulling it in | 18:13 |
| lifeless | error in setup command: Error parsing /home/robertc/work/nova/setup.cfg: UnicodeDecodeError: 'utf8' codec can't decode byte 0xa0 in position 1187750: invalid start byte | 18:13 |
| *** shashank_hegde has quit IRC | 18:13 | |
| lifeless | UnicodeDecodeError: 'utf8' codec can't decode byte 0xa0 in position 1187750: invalid start byte | 18:13 |
| lifeless | error in setup command: Error parsing /home/robertc/work/nova/setup.cfg: UnicodeDecodeError: 'utf8' codec can't decode byte 0xa0 in position 1187750: invalid start byte | 18:13 |
| lifeless | bah, soryr for double paste | 18:13 |
| lifeless | mriedem: yeah, which is a good thing, because of that utf8 decode bug :) | 18:13 |
| jeblair | mgagne: that was fast :) | 18:13 |
| mgagne | jeblair yea, I found the issue and solution yesterday :-/ | 18:13 |
| *** achanda has joined #openstack-infra | 18:13 | |
| *** trown|lunch is now known as trown | 18:14 | |
| pabelanger | asselin: where is the log for this? | 18:14 |
| asselin | pabelanger, my test system | 18:14 |
| asselin | seems to be a recent issue, but not sure how long...perhaps within a month? | 18:15 |
| mordred | infra-root: jjb runs are done everywhere but 1 and 2 | 18:16 |
| pabelanger | asselin: looks like httpd_mod { 'rewrite' ... } is getting called twice some place | 18:16 |
| clarkb | mordred: and 2 is running the restart playbook? | 18:16 |
| pabelanger | puppet-zuul looks good | 18:16 |
| mordred | clarkb: no. not yet | 18:16 |
| AJaeger | mordred: wow, that takes long ;( | 18:16 |
| lifeless | mriedem: http://paste.openstack.org/show/479907/ works, though the UNKNOWN is strange and new | 18:16 |
| mordred | AJaeger: yah ... we have a LOT of jobs | 18:16 |
| asselin | pabelanger, yeah...looking for the culprit....and seeing two different ways to install mods, also httpd::mod | 18:17 |
| *** achanda_ has quit IRC | 18:17 | |
| clarkb | mordred: AJaeger and updates are O(n^2) with gearman plugin | 18:17 |
| yolanda | clarkb, mordred, so what's the play for that? run jjb manually and... restart jenkins? | 18:17 |
| lifeless | mriedem: oh, its because there is no 2.4 tag in juno | 18:17 |
| mordred | yolanda: on each jenkins master, in a screen session, run: time sudo -H jenkins-jobs update --delete-old /etc/jenkins_jobs/config | 18:17 |
| *** mriedem has quit IRC | 18:17 | |
| mordred | yolanda: the restarting is just because 2 was starting to be a bit a of a wank | 18:17 |
| mordred | yolanda: not strictly necessary for the operation | 18:18 |
| waynr | electrofelix: thanks for the heads up, i'll try to keep an eye on those changes | 18:18 |
| yolanda | so one thing that we have downstream, and that is quite useful, is have a runbook. We have documented typical infra failures and have the right actions to perform on each case, so any root knows how to fix properly | 18:18 |
| yolanda | because for example, we could fix running jjb, but without the right parameters | 18:18 |
| mordred | yolanda: I think that would be nice | 18:18 |
| waynr | electrofelix: do you know what we need to do to create a 2.x branch for JJB? | 18:18 |
| AJaeger | clarkb: So, we need to remove some more jobs ;) | 18:18 |
| lifeless | mrodden: erm, so this is weird :) | 18:18 |
| lifeless | bah | 18:19 |
| yolanda | mordred, having something on the public infra documentations sounds good? | 18:19 |
| clarkb | yolanda: mordred I mena for jjb we should just fix geraman | 18:19 |
| lifeless | fail IBM internets:) | 18:19 |
| lifeless | mordred: you should get on that | 18:19 |
| clarkb | which I started a while back then babies happened | 18:19 |
| pabelanger | asselin: I'd be careful using httpd::mod, it lacks redhat support | 18:20 |
| waynr | electrofelix: asking because I began dissecting cmd.py last night and hoping to be ready for initial review in a week or so | 18:20 |
| pabelanger | asselin: other then that, do you see the error in the gate? | 18:20 |
| *** kevinbenton has quit IRC | 18:20 | |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Get public IPs from supplied networks https://review.openstack.org/249351 | 18:20 |
| jeblair | mordred, clarkb: that's the nodepool workaround i came up with for internap (before we move to shade which should handle this via other means) | 18:21 |
| *** kushal has joined #openstack-infra | 18:21 | |
| asselin | pabelanger, I didn't look. my 3rd party ci folks are running into it and I reproduced it too | 18:21 |
| *** mriedem has joined #openstack-infra | 18:21 | |
| clarkb | pabelanger: well there is nothing to support on red hat fwiw | 18:21 |
| clarkb | red hat modules are enabled when installed | 18:22 |
| clarkb | unlike on debian where you can install and enable independently | 18:22 |
| *** achanda has quit IRC | 18:22 | |
| pabelanger | clarkb: that is true | 18:22 |
| lifeless | mriedem: welcome back to the internets | 18:23 |
| openstackgerrit | Moises Trovó proposed openstack-infra/zmq-event-publisher: Override parameters with environment variables https://review.openstack.org/235545 | 18:23 |
| lifeless | mriedem: now, I have at least a proximate cause for the behaviour | 18:23 |
| lifeless | git describe origin/stable/juno | 18:23 |
| lifeless | 2014.2.3-53-g22f65f7 | 18:23 |
| anteaya | zaro: thanks found the download link, never used it before | 18:24 |
| clarkb | jeblair: does tripleo cloud use net label too? | 18:24 |
| mriedem | lifeless: hmm | 18:24 |
| jeblair | clarkb: yes it does | 18:25 |
| mriedem | lifeless: not what i have: | 18:25 |
| mriedem | mriedem@ubuntu:~/git/nova$ git describe origin/stable/juno | 18:25 |
| mriedem | 2014.2.4 | 18:25 |
| jeblair | clarkb: i don't know which thing is matching tripleo right now, but since this new thing is last, it shouldn't affect | 18:25 |
| anteaya | lifeless: okay that is fine, but if your view is the prevailing view including templates (which it isn't for me) then I can see red flags not being raised when something moves between voting and non-voting | 18:26 |
| clarkb | jeblair: gotcha | 18:27 |
| anteaya | dims_: done | 18:28 |
| dims_ | thanks anteaya | 18:28 |
| clarkb | I wish there was a better way to test all these using the integration job | 18:29 |
| anteaya | AJaeger: what was the reason you red flagged tmorin's change, I'm glad you did but I am interested in what your thought process was if you recall | 18:29 |
| clarkb | "here is a neutron with all possible neutron return values (should have len() of 1) | 18:29 |
| *** yamamoto has joined #openstack-infra | 18:29 | |
| lifeless | mriedem: so I did a pull first | 18:30 |
| lifeless | mriedem: and I have the 2014.2.4 tag | 18:30 |
| anteaya | clarkb: babies have a tendency to happen | 18:30 |
| AJaeger | pabelanger, odyssey4me : the gate-openstack-ansible-apt_package_pinning-dsvm-functional-trusty is looking fine now on https://review.openstack.org/#/c/248632/, so the jjb restart fixed the problem | 18:30 |
| lifeless | mriedem: tag 2014.2.4 | 18:30 |
| lifeless | Tagger: Alan Pevec <alan.pevec@redhat.com> | 18:30 |
| lifeless | Date: Thu Nov 19 19:53:10 2015 +0100 | 18:30 |
| lifeless | mriedem: but if I have the oddity; then the gate could too | 18:30 |
| pabelanger | AJaeger: \o/ | 18:31 |
| AJaeger | anteaya: the explanation about the workflow was something that surprised me. The workflow they proposed was not one that is used anywhere else and therefore I wanted some discusion on it. | 18:31 |
| lifeless | anteaya: huh, voting -> nonvoting should always raise flags | 18:31 |
| anteaya | AJaeger: great, that is what I thought | 18:31 |
| *** fitoduarte has joined #openstack-infra | 18:31 | |
| anteaya | lifeless: no, it happens all the time | 18:31 |
| *** tjones has joined #openstack-infra | 18:31 | |
| AJaeger | but normally it happens for "We need some time to fix this, will revert soon again" | 18:31 |
| *** zeih has quit IRC | 18:31 | |
| lifeless | anteaya: you just said 'then I can see red flags not being raised when something moves between voting and non-voting' coupled to whether my view is prevailing or not | 18:31 |
| anteaya | right | 18:32 |
| lifeless | anteaya: but you just said it happens all the time and you don't see red flags there | 18:32 |
| lifeless | anteaya: which means that either the double negative is confusing me | 18:32 |
| lifeless | anteaya: or I'm confused for some other reason | 18:32 |
| anteaya | if someone uses the requirement checks job template and you are fine with it being a non-voting state at some point then I can see red flags not being raised in future | 18:32 |
| AJaeger | pabelanger, odyssey4me : but failing https://jenkins01.openstack.org/job/gate-openstack-ansible-apt_package_pinning-dsvm-functional-trusty/1/console | 18:33 |
| anteaya | jobs change status all the time for jobs specific to taht repo | 18:33 |
| lifeless | anteaya: ok. It *must* raise a red flag if and only if they are in requirements/projects.txt | 18:33 |
| lifeless | anteaya: ideally this would be a lint check on layout.yaml | 18:33 |
| anteaya | and requirements check was always voting before now the cisco job being a notable exception | 18:33 |
| anteaya | but if we leave it in, others will copy like tmorin did and patches will get in | 18:34 |
| openstackgerrit | Merged openstack-infra/system-config: Sent HAProxy stats to statsd https://review.openstack.org/248961 | 18:34 |
| anteaya | lifeless: well that should be documented in zuul/layout.yaml then | 18:34 |
| clarkb | greghaynes: seems like https://review.openstack.org/#/c/222398/ is the big scary one :) | 18:34 |
| *** yamamoto has quit IRC | 18:34 | |
| *** mrmartin has quit IRC | 18:34 | |
| lifeless | anteaya: makes sense to document it to me | 18:34 |
| anteaya | lifeless: because I don't think other reviewers of that file know that | 18:34 |
| AJaeger | anteaya, leifmadsen : let me document the template... | 18:34 |
| anteaya | AJaeger: okay | 18:34 |
| lifeless | anteaya: it is documented from the requirements side already | 18:34 |
| odyssey4me | ah, thanks AJaeger - so it seems our change to get it to have sudo access had no effect :p | 18:34 |
| AJaeger | sorry, meant lifeless instead of leifmadsen | 18:34 |
| leifmadsen | :) | 18:35 |
| odyssey4me | pabelanger ping? | 18:35 |
| pabelanger | AJaeger: odyssey4me Ya, looks like some tweaking is needed for test job | 18:35 |
| pabelanger | odyssey4me: pong | 18:35 |
| anteaya | lifeless: that may be but if project-config reviewers don't know that then they won't review for it | 18:35 |
| lifeless | AJaeger: please do; a reference to the requirements readme section might be helpful | 18:35 |
| *** shashank_hegde has joined #openstack-infra | 18:35 | |
| AJaeger | found one more non-voting: gate-kuryr-requirements | 18:37 |
| lifeless | also not in projects.txt, so fine with me | 18:37 |
| AJaeger | lifeless: which link should I add? | 18:37 |
| *** ccrouch has quit IRC | 18:37 | |
| *** ccrouch has joined #openstack-infra | 18:37 | |
| *** ddieterly has quit IRC | 18:37 | |
| lifeless | AJaeger: http://git.openstack.org/cgit/openstack/requirements/tree/README.rst#n102 (or perhaps the rendered copy?) | 18:37 |
| AJaeger | and there's gate-murano-agent-requirements - also not in requriments | 18:38 |
| asselin | pabelanger, would be nice if puppet gives to a stacktrace of who's declaring what when there's an error | 18:38 |
| AJaeger | and gate-solum-requirements | 18:38 |
| AJaeger | but there's also cliff which is in requirements! | 18:38 |
| lifeless | AJaeger: we should fix that asap | 18:39 |
| lifeless | AJaeger: it led to the confusion haypo and i have been discussing | 18:39 |
| lifeless | since cliff landed a non-requirements-compatible change | 18:39 |
| lifeless | AJaeger: a linter would be better than docs IMO | 18:40 |
| lifeless | AJaeger: I'm not quite sure what would be involved in wiring that up | 18:40 |
| AJaeger | lifeless: I have no good solution right now | 18:41 |
| mordred | jeblair: looks great | 18:41 |
| lifeless | AJaeger: if we can get a list of (job, project) tuples out of zuul | 18:41 |
| lifeless | erm, (job, project, branch) | 18:42 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Document check-requirements template https://review.openstack.org/249375 | 18:42 |
| *** kzaitsev_mb has joined #openstack-infra | 18:42 | |
| lifeless | then we could clone requirements and check | 18:42 |
| AJaeger | lifeless, anteaya ^ | 18:42 |
| kzaitsev_mb | someone said murano here | 18:42 |
| AJaeger | lifeless: you could just parse zuul/layout.yaml. | 18:42 |
| lifeless | AJaeger: long as we're not reimplementing the guts of zuul :) | 18:43 |
| *** ihrachys has quit IRC | 18:43 | |
| AJaeger | kzaitsev_mb: ;) everything fine ;) gate-murano-agent-requirements is not in the global-requirements process but if you want to go there, you need to make it voting first | 18:43 |
| jeblair | lifeless: what's the tldr version of what you want? | 18:43 |
| openstackgerrit | Merged openstack-infra/project-config: bdist_wheel/universal is the canonical option https://review.openstack.org/248972 | 18:43 |
| *** bardia has joined #openstack-infra | 18:43 | |
| *** ihrachys has joined #openstack-infra | 18:43 | |
| AJaeger | jeblair: check that every repo in requirements/projects.txt uses the requirements check template | 18:44 |
| lifeless | jeblair: to check that every project in requirements/proejcts.txt has a check-requirements gate job | 18:44 |
| lifeless | jeblair: and not permit removing those jobs in changes to layout.yaml | 18:44 |
| jeblair | at least checking the template should be a simple matter of yaml parsing | 18:44 |
| lifeless | jeblair: (or making them non-voting) | 18:44 |
| jeblair | determining whether they are made non-voting is more complex | 18:45 |
| kzaitsev_mb | sorry, I'm on other meeting, would be free in 5 mins I guess ) | 18:45 |
| AJaeger | oops, my change had a bad negation in it ;( | 18:45 |
| AJaeger | kzaitsev_mb: no worries | 18:45 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Document check-requirements template https://review.openstack.org/249375 | 18:45 |
| anteaya | kzaitsev_mb: I am curious why you are running the job if you don't want it to be voting | 18:45 |
| *** nadya_ has joined #openstack-infra | 18:46 | |
| jeblair | that would probably be a 'import zuul; load config; examine config data structures' kind of effort. | 18:46 |
| AJaeger | anteaya: fixed | 18:46 |
| anteaya | thanks | 18:46 |
| jeblair | either that, or parse the zuul config test output | 18:46 |
| jeblair | (which is not really meant to be parseable) | 18:46 |
| *** fhubik has quit IRC | 18:46 | |
| AJaeger | lifeless: cliff as non-voting is there since April 2014 ;( | 18:47 |
| *** bnemec has joined #openstack-infra | 18:47 | |
| *** mtanino has quit IRC | 18:47 | |
| AJaeger | lifeless: change is I40b2cf4030df66c851d7d11da4f81f645d110e76 . Do you want to propose a fix? | 18:47 |
| AJaeger | anteaya: use case with voting turned off would be for me: Ensure that no extra requirements come in while getting some into global-requirements | 18:49 |
| *** dramalho has joined #openstack-infra | 18:49 | |
| anteaya | okay I think a link to the patchset up for global-requirements in the comments for making a job non-voting would be in order, do you think? | 18:50 |
| lifeless | AJaeger: its probably failing at the moment | 18:51 |
| kzaitsev_mb | AJaeger: ok, I caught up =) Let me see, why do we have the job, and where do we have it (cause I do not see it in latest patchsets to agent, oddly) | 18:51 |
| lifeless | AJaeger: let me ping dhellmann | 18:51 |
| lifeless | jeblair: yeah, is zuul's api stable enough for a proejct-config script to sanely import and grovel around like that | 18:51 |
| kzaitsev_mb | anteaya: well, if it is green and the requirements match global — we definitelly want it voting. Although it might be not the case. | 18:52 |
| lifeless | jeblair: or will we be creating tech debt/a future foot gun ? | 18:52 |
| mordred | jeblair, clarkb, fungi, yolanda: could I get a review on https://review.openstack.org/#/c/241495/ ? once that's in, testing puppet apply on individual nodes will be faily easy to do | 18:52 |
| kzaitsev_mb | And if it's not the case — we probably do not need it, as it is a waste of resources anyway | 18:52 |
| jeblair | lifeless: i think it could be fairly debt-attracting; we've shied away from considering that an external api | 18:52 |
| *** apoorvad has joined #openstack-infra | 18:52 | |
| *** eil397 has quit IRC | 18:53 | |
| lifeless | jeblair: what about a command line thing to dump some sort of yaml/json to stdout ? | 18:53 |
| pabelanger | leifmadsen: you! | 18:53 |
| leifmadsen | pabelanger, OHAI | 18:53 |
| lifeless | jeblair: e.g. zull --dump-config --no-daemon | 18:53 |
| lifeless | (dump-jobs perhaps , whatever - thats bikeshed territory) | 18:54 |
| jeblair | lifeless: that might be a better approach -- the current config test outputs human readable text, making that optionally output yaml/json should be easy | 18:54 |
| fungi | lifeless: we basically already have that (its output by our layout check jobs for example) | 18:54 |
| anteaya | kzaitsev_mb: are you wanting to be in global requirements? | 18:54 |
| fungi | er, what jeblair just said | 18:54 |
| kzaitsev_mb | anteaya: you meant the agent? | 18:55 |
| lifeless | HenryG: so https://review.openstack.org/#/c/215673/4 - is that still in progress? | 18:55 |
| *** HeOS has joined #openstack-infra | 18:55 | |
| anteaya | kzaitsev_mb: yes the job is gate-murano-agent-requirements | 18:55 |
| *** ihrachys has quit IRC | 18:55 | |
| anteaya | kzaitsev_mb: do you want that in global requirements? | 18:55 |
| dhellmann | lifeless, AJaeger : what's up with cliff? | 18:56 |
| jeblair | mordred: ah, i understand what that change is doing! lgtm. | 18:56 |
| mordred | jeblair: yay! | 18:56 |
| mordred | jeblair: it's so good when the change is understandable | 18:56 |
| HenryG | lifeless: yeah, that's going to take a while due to some deps not supporting py3 | 18:57 |
| lifeless | dhellmann: the check-requirements job on it is non-voting / missing | 18:57 |
| jeblair | mordred: it took me a minute :) | 18:57 |
| openstackgerrit | Michael Krotscheck proposed openstack/requirements: Update oslo.middleware to 3.0.0 https://review.openstack.org/249216 | 18:57 |
| mordred | jeblair: blast | 18:57 |
| lifeless | dhellmann: but it is in requirements/proejcts.txt | 18:57 |
| *** ihrachys has joined #openstack-infra | 18:57 | |
| dhellmann | lifeless : oh, that's definitely an oversight we should fix that | 18:57 |
| lifeless | dhellmann: we can't make it voting right now because it has this unicodecsv change | 18:57 |
| dhellmann | lifeless : (by making cliff comply with requirements) | 18:57 |
| *** achanda has joined #openstack-infra | 18:57 | |
| dhellmann | ah, yeah, so we need that in the requirements list? | 18:57 |
| lifeless | dhellmann: well, we need to figure out whats up with it | 18:58 |
| AJaeger | kzaitsev_mb: you have it on stable branches - so you should have it everyhwere: https://review.openstack.org/#/c/230407/ | 18:58 |
| nibalizer | I won't be able to attend the infra meeting today folks, sorry | 18:58 |
| lifeless | dhellmann: haypo put up the change to requirements once I pointed this out | 18:58 |
| lifeless | dhellmann: but I haven't looked into it yet | 18:58 |
| anteaya | nibalizer: hope everything is alright | 18:58 |
| AJaeger | dhellmann: change that did part of it is I40b2cf4030df66c851d7d11da4f81f645d110e76 | 18:58 |
| dhellmann | AJaeger : looks like I dropped the ball on restoring those jobs | 18:59 |
| kzaitsev_mb | anteaya: tbh, I'm not sure that we do want murano-agent to be in global requirements — gotta check that with the others. | 18:59 |
| AJaeger | kzaitsev_mb: ah, you run the update manaully... | 18:59 |
| *** fedexo has joined #openstack-infra | 18:59 | |
| *** adduarte has joined #openstack-infra | 19:00 | |
| lifeless | dhellmann: https://review.openstack.org/#/c/247962/ - click through and look at the linked bug | 19:00 |
| fungi | it's that (weekly meeting) time again! let's all head on over to #openstack-meeting | 19:00 |
| *** bardia has quit IRC | 19:00 | |
| lifeless | dhellmann: and the patch to cliff | 19:00 |
| kzaitsev_mb | AJaeger: strange, that it's not here https://review.openstack.org/#/c/240808/ | 19:00 |
| *** pradk has quit IRC | 19:00 | |
| lifeless | dhellmann: in fact, you have ;) | 19:00 |
| anteaya | kzaitsev_mb: okay well having the requirements check job running if you don't want to be in requirements doesn't serve a purpose in my mind | 19:00 |
| AJaeger | kzaitsev_mb: the requirements jobs are only run if requirements files change | 19:00 |
| kzaitsev_mb | AJaeger: yeah, in kilo murano still had non-standard requirements. We're only getting the OpenstackProposalBot from liberty and on =) | 19:00 |
| AJaeger | kzaitsev_mb: you can run it only on liberty and newer... | 19:01 |
| kzaitsev_mb | AJaeger: oh, I see. | 19:01 |
| dhellmann | lifeless : I think this is coming back to the cmd2 use again. Dropping that has been on my todo list for ages, and keeps getting pushed down. | 19:01 |
| AJaeger | dhellmann: will you send a change for cliff or shall I? | 19:01 |
| *** wuhg has quit IRC | 19:01 | |
| jeblair | let's all go to the meeting... let's all go to the meeting... let's all go to the meeting, and have ourselves a ... meeting. | 19:01 |
| dhellmann | AJaeger : if you send it I can vote on it. | 19:01 |
| lifeless | dhellmann: what I don't understand is how unicodecsv being installed breaks things | 19:01 |
| lifeless | dhellmann: it looks to me like it just becomes unnecessary at that point | 19:02 |
| dhellmann | lifeless : I'd have to ask haypo | 19:02 |
| dhellmann | yeah | 19:02 |
| *** pradk has joined #openstack-infra | 19:02 | |
| lifeless | dhellmann: https://review.openstack.org/#/c/226966/2/cliff/formatters/commaseparated.py | 19:02 |
| kzaitsev_mb | anteaya: well, tbh it does, since we would be sure, that murano-agent only depnds on everything standard. Even if it's not in global requirements. | 19:02 |
| *** pradk has quit IRC | 19:02 | |
| lifeless | dhellmann: I think haypo was wrong to worriy about it | 19:02 |
| freerunner | AJaeger: We still have non-global requirement in murano-agent.. https://github.com/openstack/murano-agent/blob/master/requirements.txt#L21 | 19:02 |
| lifeless | dhellmann: we have no way in the requirmens machinery at the moment to express the difference between | 19:02 |
| freerunner | kzaitsev_mb: ^^ | 19:02 |
| lifeless | dhellmann: 'not needed' and 'must not have' | 19:02 |
| *** dramalho has quit IRC | 19:03 | |
| anteaya | kzaitsev_mb: okay can we have it voting? | 19:03 |
| *** fitoduarte has quit IRC | 19:03 | |
| kzaitsev_mb | freerunner: well, that probably means, that we can remove the job completely. | 19:03 |
| *** kozhukalov_ has joined #openstack-infra | 19:03 | |
| dhellmann | lifeless : yeah, I think this version check for installing the lib is not needed | 19:03 |
| lifeless | dhellmann: if we make unicodecsv be prevented on 3.x, then noone in the openstack context *can* have it as a dep even if they want ro | 19:03 |
| dhellmann | lifeless : right | 19:03 |
| lifeless | dhellmann: and as having it there is not harmful, I propose we just accept the requirements sync | 19:03 |
| dhellmann | ok, so -2 to the requirements patch and remove the version check in cliff | 19:03 |
| freerunner | kzaitsev_mb: AJaeger: anteaya: I can't find 'bunch' in the global-requirements. So, if we make it voting, it will become broken. | 19:04 |
| kzaitsev_mb | anteaya: AJaeger: would it be ok, if we come back to you tomorrow, after pinging our PTL and the rest of the community (most of them are probably asleep by now) =)) | 19:04 |
| lifeless | dhellmann: the version check in cliff's code is fine IMO | 19:04 |
| dhellmann | lifeless : not in the code, in the requirements file | 19:04 |
| lifeless | dhellmann: we'll just have a stubby requirement until 2.7 EOLs | 19:04 |
| anteaya | kzaitsev_mb: freerunner I'm fine either way, voting or gone, but having it non-voting is a grey area right now that I would like to clean up if possible | 19:04 |
| anteaya | kzaitsev_mb: freerunner thank you | 19:04 |
| lifeless | freerunner: are you trying to make it voting? You need to be adding your requirements to openstack/requirements if so | 19:05 |
| lifeless | freerunner: if you're not trying to make it voting, there's not much point having the job | 19:05 |
| kzaitsev_mb | anteaya: I believe there are 2 options here — we either start working towards removing non-standard requirements and makeing the job voting. Or we decide, that we keep those and remove the job =) | 19:05 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add check-requirements for cliff https://review.openstack.org/249380 | 19:06 |
| anteaya | kzaitsev_mb: yes, voting or remove the job | 19:06 |
| AJaeger | dhellmann, lifeless: here's the cliff change ^ | 19:06 |
| freerunner | kzaitsev_mb anteaya lifeless: Voting is preferred, ofc. We need some time to try to investigate, how we can remove 'bunch' | 19:06 |
| lifeless | fror add it to global requirements.... | 19:06 |
| dhellmann | AJaeger : oh, I thought you meant a change *in* cliff. I can't +2 that one. :-) | 19:06 |
| lifeless | freerunner: or did you get rejected? | 19:07 |
| AJaeger | kzaitsev_mb: sure, figure it out but please figure out where you want to go ;) | 19:07 |
| freerunner | lifeless: We're not tryed yet. | 19:07 |
| AJaeger | dhellmann: I will find others to +2 ;) | 19:07 |
| AJaeger | dhellmann: your +1 would still be good | 19:07 |
| dhellmann | AJaeger : I added the cliff core folks to the review | 19:07 |
| AJaeger | thanks, dhellmann | 19:07 |
| lifeless | dhellmann: so I'm going to approve https://review.openstack.org/#/c/217142/ | 19:08 |
| kzaitsev_mb | anteaya: either way — we should ping the rest of our team, to make sure, they're aware of that. =) would come up with some solution tomorrow (or before the end of the week at least =) | 19:08 |
| dhellmann | lifeless : I just voted +2 on another one, let me find that | 19:08 |
| anteaya | kzaitsev_mb: thank you | 19:08 |
| dhellmann | oh, that was liberty | 19:08 |
| kzaitsev_mb | freerunner: well, that's up to debate imho. I'd better remove the job ) | 19:08 |
| *** ddieterly has joined #openstack-infra | 19:09 | |
| *** mohankumar has quit IRC | 19:09 | |
| *** unicell has joined #openstack-infra | 19:09 | |
| *** kevinbenton has joined #openstack-infra | 19:10 | |
| freerunner | kzaitsev_mb: Heh ;) Let's try to discuss it tomorrow, yep. | 19:10 |
| *** ihrachys has quit IRC | 19:11 | |
| jhesketh | Morning | 19:12 |
| *** ihrachys has joined #openstack-infra | 19:12 | |
| lifeless | mriedem: is it possible that two differnet 2014.2.4 tags have been pushed at different times | 19:12 |
| mriedem | lifeless: i'd hope not | 19:12 |
| lifeless | mriedem: the 2014.2.4 I have here is 044154de11ddd0d250e3486718843642ddaf579a | 19:12 |
| *** sridhar_ram has quit IRC | 19:12 | |
| *** placko has quit IRC | 19:12 | |
| *** arborism has joined #openstack-infra | 19:13 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 19:13 | |
| fungi | i believe gerrit would reject a push to overwrite a tag, unless it was first deleted (which is also disallows by policy hence not likely without gerrit admin collusion?) | 19:14 |
| lifeless | mriedem: I see a 2014.2.4 with this in gitk: | 19:14 |
| *** ccrouch has quit IRC | 19:14 | |
| lifeless | Follows: 2014.2.2 | 19:14 |
| lifeless | Precedes: 2014.2.4 | 19:14 |
| lifeless | erm | 19:14 |
| lifeless | 2014.2.3 | 19:14 |
| *** ccrouch has joined #openstack-infra | 19:14 | |
| clarkb | fungi: you can --force as admin | 19:14 |
| clarkb | fungi: er s/admin/project creator/ | 19:15 |
| fungi | clarkb: yeah, by "policy" there i mean default acls | 19:15 |
| mriedem | lifeless: i have 044154de11ddd0d250e3486718843642ddaf579a | 19:15 |
| lifeless | so I dunno | 19:16 |
| lifeless | anyhow, when git describe says 2014.2.3, pbr is going to be ok with things | 19:16 |
| lifeless | figure out why that happens,a nd you'll get the version error we expect :) | 19:17 |
| *** mtanino has joined #openstack-infra | 19:18 | |
| mriedem | asselin: at what point will we have a global elastic-recheck job for 3rd party CIs? that would be *awesome* | 19:19 |
| mriedem | so that when hyper-v and xen ci fails in nova for known things, e-r would tell us - would have to be like a 3rd party e-r though | 19:19 |
| mriedem | since i don't suppose anyone will ever have 3rd party ci publishing logs to the community logstash index | 19:20 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add check-requirements for cliff https://review.openstack.org/249380 | 19:20 |
| clarkb | mriedem: I am not sure we would ever have that unless someone wants to give us a whole heck fo a lot of disk and cpu | 19:20 |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Start using cgit::lb class https://review.openstack.org/181829 | 19:20 |
| asselin | mriedem, yeah. mmedvede made progress is getting logstash for 3rd party ci, so we're going towards that direction | 19:20 |
| mriedem | clarkb: i know, i can dream... | 19:20 |
| clarkb | we are already just barely riding the line with our stuff | 19:20 |
| clarkb | eg two indexes leak over and we hit OOM protection | 19:20 |
| *** kzaitsev_mb has quit IRC | 19:20 | |
| *** achanda has quit IRC | 19:21 | |
| mriedem | yeah, but like, couldn't a 3rd party ci team have their own e-r bot that is then used to report back on failed changes | 19:21 |
| fungi | however our e-r stack including logstash/es are puppeted and runnable by any third-party ci operators as well | 19:21 |
| asselin | clarkb, I think the idea would be the 3rd party ci itself would give recheck comments | 19:21 |
| mriedem | fungi: yeah | 19:21 |
| clarkb | asselin: thats not "global" | 19:21 |
| clarkb | thats multiple instances of this tool | 19:21 |
| clarkb | which is fine | 19:21 |
| *** dramalho has joined #openstack-infra | 19:21 | |
| *** burgerk_ has quit IRC | 19:22 | |
| *** adduarte has quit IRC | 19:22 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 19:23 | |
| lifeless | mriedem: (test)robertc@lifeless-z140:~/work/nova$ git describe origin/stable/juno | 19:24 |
| lifeless | 2014.2.3-53-g22f65f7 | 19:24 |
| lifeless | (test)robertc@lifeless-z140:~/work/nova$ git describe gerrit/stable/juno | 19:24 |
| lifeless | 2014.2.4 | 19:24 |
| *** tjones has quit IRC | 19:24 | |
| lifeless | mriedem: origin is origin https://git.openstack.org/openstack/nova | 19:24 |
| lifeless | mriedem: gerrit is well gerrit | 19:24 |
| *** achanda has joined #openstack-infra | 19:25 | |
| *** kdas_ has joined #openstack-infra | 19:25 | |
| *** kushal has quit IRC | 19:26 | |
| lifeless | git rev-parse origin/stable/juno | 19:26 |
| lifeless | 22f65f7059924a3704bfc986db62cf01e36d1da2 | 19:26 |
| lifeless | git rev-parse gerrit/stable/juno | 19:26 |
| lifeless | 044154de11ddd0d250e3486718843642ddaf579a | 19:26 |
| *** tjones has joined #openstack-infra | 19:27 | |
| lifeless | mriedem: so - for some reason my origin remote was stale. Fixed and I see 2014.2.4 | 19:27 |
| *** abregman is now known as abregman|nearby | 19:27 | |
| *** ccrouch has quit IRC | 19:27 | |
| lifeless | mriedem: and yet I don't get an error from pbr. ooo. | 19:28 |
| *** ccrouch has joined #openstack-infra | 19:28 | |
| lifeless | mriedem: I shall investigate more | 19:28 |
| lifeless | ls | 19:28 |
| *** tjones has left #openstack-infra | 19:28 | |
| lifeless | mriedem: hmm, there was a cached egg info somewhere pbr was trusting and not rebuilding.We'll have to revisit that cache code I think | 19:29 |
| lifeless | mordred: ^ | 19:30 |
| *** hashar has joined #openstack-infra | 19:30 | |
| *** aspiers_ has quit IRC | 19:30 | |
| mordred | lifeless: stellar | 19:31 |
| *** trukisesst3 has quit IRC | 19:31 | |
| lifeless | mordred: by revisit I mean delete | 19:31 |
| *** ihrachys has quit IRC | 19:33 | |
| *** mrmartin has joined #openstack-infra | 19:35 | |
| *** ashishb has quit IRC | 19:36 | |
| openstackgerrit | Vilobh Meshram proposed openstack/requirements: Add python consul client https://review.openstack.org/246021 | 19:39 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Add rollback script for 2.11 https://review.openstack.org/245598 | 19:39 |
| *** sabeen1 has quit IRC | 19:41 | |
| *** salv-orlando has quit IRC | 19:41 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Add rollback script for 2.11 https://review.openstack.org/245598 | 19:41 |
| asselin | :q | 19:42 |
| asselin | oops | 19:42 |
| Shrews | mordred: On 247205, I agree soooo much with SpamapS about missing tests. At the same time, I don't think we have a real good solution for testing that particular code path yet, right? | 19:42 |
| mordred | zaro: ^^ there is your data migration (fungi, jeblair in case you're curious) | 19:43 |
| fungi | thanks mordred! splintering discussion across channels is confusing | 19:43 |
| mordred | fungi: (sorry) | 19:44 |
| *** claudiub has joined #openstack-infra | 19:45 | |
| zaro | mordred: thanks | 19:46 |
| *** regXboi has joined #openstack-infra | 19:46 | |
| *** mrmartin has quit IRC | 19:47 | |
| *** sdake has joined #openstack-infra | 19:49 | |
| *** Sukhdev has joined #openstack-infra | 19:51 | |
| openstackgerrit | Merged openstack-infra/shade: Retry API calls if they get a Retryable failure https://review.openstack.org/249304 | 19:51 |
| *** sergmelikyan has joined #openstack-infra | 19:51 | |
| *** sdake_ has joined #openstack-infra | 19:52 | |
| openstackgerrit | Merged openstack-infra/glean: Fix creation of vlan interfaces in Debian/Ubuntu https://review.openstack.org/244625 | 19:52 |
| jesusaurus | clarkb: re: voting on log_processor, i don't think we've added infra-core to log-processor-core yet, would you mind doing the needful? | 19:53 |
| *** dims has joined #openstack-infra | 19:53 | |
| clarkb | jesusaurus: they are there https://review.openstack.org/#/admin/groups/811,members | 19:53 |
| clarkb | its just caching or doing something funny | 19:54 |
| jesusaurus | yep, looks like we still need to add infra-core to log-processor-core and log-processor-release | 19:54 |
| jesusaurus | clarkb: i see nothing at https://review.openstack.org/#/admin/groups/1188,members | 19:54 |
| *** sdake has quit IRC | 19:54 | |
| jesusaurus | oh, that's a different group | 19:54 |
| *** achanda has quit IRC | 19:54 | |
| clarkb | oh! | 19:54 |
| clarkb | haha | 19:54 |
| *** mrmartin has joined #openstack-infra | 19:55 | |
| clarkb | done | 19:55 |
| clarkb | should infra core be in the release group too? | 19:55 |
| *** sridhar_ram has joined #openstack-infra | 19:55 | |
| jesusaurus | thanks | 19:55 |
| jesusaurus | yeah, i think so | 19:55 |
| *** dims_ has quit IRC | 19:56 | |
| *** achanda has joined #openstack-infra | 19:57 | |
| *** abregman|nearby is now known as abregman|afk | 19:57 | |
| zaro | rcarrillocruz: hey, i remember you and cody-somerville asked about a gerrit feature to review tags and branches. | 19:57 |
| rcarrillocruz | good memory | 19:58 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: move add_comment.py to a console script https://review.openstack.org/249396 | 19:58 |
| rcarrillocruz | :-) | 19:58 |
| thingee | asselin: where can I find the current CI repo being recommended for vendors? | 19:58 |
| rcarrillocruz | i can tell you release managers and all in downstream would be happy with it | 19:58 |
| rcarrillocruz | why? | 19:58 |
| rcarrillocruz | is it coming? | 19:58 |
| thingee | asselin: preparing things for the ironic folks | 19:58 |
| asselin | thingee, https://github.com/openstack-infra/puppet-openstackci/tree/master/contrib | 19:59 |
| zaro | rcarrillocruz: i talked to one of the gerit maintainers and he says he thought about adding that feature in gerrit but opted against it because the workflow can be so varied between users. | 20:00 |
| *** rfolco_ has quit IRC | 20:00 | |
| clarkb | zaro: I think the implementation would be similar to change review. push to refs/proposed_tag refs/proposed_branch or whatever, this makes a "change", vote and instead of merging you just create the thing | 20:01 |
| clarkb | then you can ACL it just like anything else | 20:02 |
| rcarrillocruz | ++ | 20:02 |
| openstackgerrit | Henry Gessau proposed openstack/requirements: Add networking-cisco repo to projects list https://review.openstack.org/215673 | 20:02 |
| * jesusaurus thinks it would be really useful to review tag creation | 20:02 | |
| rcarrillocruz | that's how i pictured, exactly as a regular change | 20:02 |
| asselin | thingee, http://lists.openstack.org/pipermail/openstack-dev/2015-November/080058.html | 20:02 |
| zaro | clarkb: the problem is that there needs to be some checks in place to make sure that it's a valid change. | 20:02 |
| clarkb | zaro: for tags you would check "does this sha1 exist" | 20:03 |
| clarkb | same for branches | 20:03 |
| clarkb | otherwise reject | 20:03 |
| krotscheck | crinkle: For that wheel mirror patch - should the known hosts file include all of our pypi mirrors? There seem to be a couple missing. | 20:03 |
| krotscheck | (https://review.openstack.org/#/c/165240/20/modules/openstack_project/templates/wheel_mirror/known_hosts.erb) | 20:03 |
| clarkb | (I think gerrit has a track record of trying to make simple things complicated and really need to keep it simple) | 20:03 |
| zaro | i think that's just one thing that you might want to check for. others might be is it a valid name? | 20:03 |
| zaro | *valid/approved | 20:04 |
| openstackgerrit | Merged openstack-infra/system-config: Add puppet apply settings to puppet.conf https://review.openstack.org/241495 | 20:04 |
| clarkb | zaro: if you want to be defensive sure, but git should already only allow pusing of valid names | 20:04 |
| *** ashishb has joined #openstack-infra | 20:04 | |
| *** bdemers has quit IRC | 20:04 | |
| crinkle | krotscheck: sounds likely! but i'm not really sure, i just helped make the puppet tests pass | 20:04 |
| zaro | i mean valid to humans | 20:04 |
| krotscheck | crinkle: Got it, will add a comment. | 20:04 |
| crinkle | krotscheck: i suspect greghaynes will be back online in a bit to answer | 20:04 |
| clarkb | zaro: that is what review is for | 20:05 |
| clarkb | zaro: if it isn't valid abandon it | 20:05 |
| clarkb | (this is why we want reviewable tags fwiw) | 20:05 |
| *** bdemers has joined #openstack-infra | 20:05 | |
| *** otter768 has joined #openstack-infra | 20:06 | |
| anteaya | pleia2: is feb 10-12 an option for the infra mid-cycle? | 20:06 |
| *** dtardivel has quit IRC | 20:07 | |
| *** fitoduarte has joined #openstack-infra | 20:08 | |
| openstackgerrit | Tom Cocozzello proposed openstack-infra/project-config: Remove python26 from keystone projects https://review.openstack.org/249400 | 20:08 |
| asselin | pabelanger, fyi I found the issue, we have a mixed mode with httpd::mod and httpd_mod. i'll submit some patches to fix it. | 20:08 |
| pleia2 | anteaya: I don't have any information yet | 20:09 |
| anteaya | pleia2: okay thanks | 20:10 |
| yolanda | so if that mid-cycle is related to infra-cloud, some of us need to attend: rcarrillocruz, crinkle, myself... i guess we need to discuss at some near point | 20:10 |
| openstackgerrit | Tom Cocozzello proposed openstack-infra/project-config: Remove python26 from keystone projects https://review.openstack.org/249400 | 20:10 |
| hashar | zaro: hello, sorry been mostly silent recently. Was wondering where to fill feature request for the Jenkins gearman plugin :-} storyboard/launchpad/jenkins jira confuses me :/ | 20:10 |
| *** otter768 has quit IRC | 20:10 | |
| zaro | clarkb: you do nave a compelling argument. i'm not reemembering why having CI check made more sense to me when i discussed with DavidP. I'm guessing it was because the lists of things to check were pretty big for for them before tags/branches would get created. | 20:10 |
| *** changbl has quit IRC | 20:11 | |
| zaro | hashar: hey, good Q :) | 20:13 |
| *** ociuhandu has quit IRC | 20:13 | |
| openstackgerrit | Merged openstack-infra/project-config: Add tempest to magnum devstack gate https://review.openstack.org/248123 | 20:13 |
| zaro | i would put them in the jenkins jira tracker | 20:13 |
| pleia2 | yolanda: yes, the mid-cycle would be focused on infra-cloud | 20:14 |
| hashar | zaro: deal! | 20:14 |
| fungi | asselin: thingee: also known as https://git.openstack.org/cgit/openstack-infra/puppet-openstackci | 20:14 |
| *** signed8bit is now known as signed8bit_ZZZzz | 20:14 | |
| hashar | zaro: also for what it is worth, seems the plugin works with Jenkins 1.625.2 | 20:14 |
| yolanda | pleia2 ok, so share with us dates and plans if you organize it, and we can help on whatever is needed | 20:15 |
| fungi | asselin: thingee: especially if you're writing up official documentation--please don't point people to github. it makes many assume we use github development workflow for those repos | 20:15 |
| zaro | hashar: that's just crazy! | 20:15 |
| *** sdake_ has quit IRC | 20:15 | |
| asselin | fungi, the issue I have with that link is it doesn't show it "pretty" Any tips to resolve that | 20:15 |
| *** sdake has joined #openstack-infra | 20:15 | |
| *** AJaeger has quit IRC | 20:15 | |
| pleia2 | yolanda: will do :) | 20:15 |
| fungi | asselin: start publishing documentation and link to that instead if you want something "pretty" | 20:15 |
| *** ldnunes has quit IRC | 20:15 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 20:16 | |
| * pleia2 seeks lunch | 20:16 | |
| asselin | fungi, within system-config for puppet module? | 20:16 |
| zaro | anteaya, dimtruck : so if you would like to test the reverted change to fix https://code.google.com/p/gerrit/issues/detail?id=3365 it's up on review-dev.o.o thanks. | 20:17 |
| *** hdd has quit IRC | 20:17 | |
| fungi | asselin: documentation for our puppet modules would be awesome, even if it's just a job that runs README.rst through docutils and stuffs the result up in some subpath of docs.openstack.org/infra | 20:17 |
| dimtruck | zaro: thanks! | 20:17 |
| anteaya | zaro: thanks, will test, going to finish sitting in on the tc meeting then a cup of tea | 20:18 |
| asselin | fungi, yeah I will look into that. thanks! | 20:18 |
| *** otter768 has joined #openstack-infra | 20:18 | |
| fungi | asselin: thank you too! | 20:18 |
| openstackgerrit | Tom Cocozzello proposed openstack-infra/project-config: Remove python26 from keystone projects https://review.openstack.org/249400 | 20:19 |
| openstackgerrit | David Caro proposed openstack-infra/jenkins-job-builder: Added support for the workflow job type https://review.openstack.org/248169 | 20:20 |
| clarkb | for all of these ^ changes it might be easier if infra just pulled them all out when the slaves go away? | 20:20 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: Typo in pypi-extract-universal.py https://review.openstack.org/249403 | 20:20 |
| clarkb | I worry about conflicts and completeness otherwise | 20:20 |
| *** placko has joined #openstack-infra | 20:20 | |
| *** apoorvad has quit IRC | 20:21 | |
| fungi | clarkb: that would be my preference too, but it seems like some individual projects are eager to start ripping out their 2.6 support ahead of our schedule | 20:21 |
| openstackgerrit | Tom Cocozzello proposed openstack-infra/project-config: Remove python26 from keystone projects https://review.openstack.org/249400 | 20:22 |
| *** sergmelikyan has quit IRC | 20:23 | |
| *** haypo has joined #openstack-infra | 20:23 | |
| clarkb | which is fine once juno is eol'd | 20:23 |
| clarkb | but before that point not so good | 20:23 |
| clarkb | (and infra can handle it as part of juno eol) | 20:23 |
| haypo | clarkb: hi. would you mind to review the update patch https://review.openstack.org/#/c/247936/ to add liberasurecode packages? this change blocks my python 3 work on swift | 20:24 |
| dimtruck | zaro: tested the redirect. +1 | 20:24 |
| fungi | clarkb: well, 2014.2.4 releases are out 5 days ago so i don't see anyone approving more stable changes for stable/juno before eol. i'd be working through it already except i first want to make sure i'm caught up on the related ml threads | 20:24 |
| dimtruck | i'm going to run more manual tests against it just to make sure i don't find anything. | 20:25 |
| clarkb | fungi: I know of at least one project (swiftclient) that isn't quite ready yet | 20:25 |
| clarkb | unless they went ahead and got that done yesterday | 20:25 |
| *** EricGonczer_ has quit IRC | 20:25 | |
| *** ayoung has quit IRC | 20:26 | |
| *** ayoung has joined #openstack-infra | 20:26 | |
| clarkb | greghaynes: I think I found a small bug in https://review.openstack.org/#/c/222398/33 but lgtm otherwise | 20:27 |
| anteaya | dimtruck: thanks | 20:27 |
| *** EricGonczer_ has joined #openstack-infra | 20:28 | |
| *** sergmelikyan has joined #openstack-infra | 20:29 | |
| *** changbl has joined #openstack-infra | 20:31 | |
| *** fedexo has quit IRC | 20:31 | |
| *** placko has quit IRC | 20:33 | |
| *** EricGonczer_ has quit IRC | 20:33 | |
| *** ashishb has quit IRC | 20:34 | |
| *** EricGonczer_ has joined #openstack-infra | 20:34 | |
| *** ociuhandu has joined #openstack-infra | 20:35 | |
| hashar | zaro: filled a bug, but I think it is an issue in the rebuilder Jenkins plugin rather than in Gearman plugin :-} OFFLINE_NODE_WHEN_COMPLETE is not reinserted when manually rebuilding (i.e. without 'recheck' but directly in the web GUI) | 20:36 |
| *** e0ne has quit IRC | 20:38 | |
| *** EricGonczer_ has quit IRC | 20:38 | |
| electrofelix | waynr: I was hoping that we might be able to refactor the api's without needing to create a separate branch, but if not I think its not to difficult to request one. | 20:38 |
| zaro | dimtruck: you can apply that +1 here if you like https://review.openstack.org/#/c/248411/ | 20:38 |
| dimtruck | zaro: will do | 20:39 |
| *** Swami has quit IRC | 20:39 | |
| *** nadya_ has quit IRC | 20:41 | |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: modify openstackclient functional tests to use neutron dsvm https://review.openstack.org/249411 | 20:42 |
| electrofelix | waynr: at the very least I recall Thierry sent out an email about stable branches and the various release cycles and I'm pretty sure we'd match at least one of them and could just follow the suggestions. | 20:42 |
| *** yamahata has quit IRC | 20:42 | |
| anteaya | stevemar: is that test voting right now? | 20:43 |
| stevemar | anteaya: yes maam | 20:43 |
| *** achanda has quit IRC | 20:43 | |
| anteaya | stevemar: okay so if that change breaks the job you can't merge any code | 20:43 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/puppet-zuul: Migrato to httpd::mod from httpd_mod https://review.openstack.org/249412 | 20:43 |
| asselin | pabelanger, ^^ | 20:44 |
| zaro | hashar: i think only gearman knows about OFFLINE_NODE_WHEN_COMPLETE so why do you expect it to do that when you manually kick on build from UI? | 20:44 |
| anteaya | stevemar: so my suggestion is to make a new job with that change and add it to the experimental pipeline | 20:44 |
| asselin | migrato...is that italian? | 20:44 |
| waynr | electrofelix: i seem to recall someone else preferring to work off a branch | 20:44 |
| anteaya | stevemar: then if that job builds make it non-voting in check, so two jobs running the old one voting and this new one non-voting | 20:44 |
| hashar | zaro: the rebuild plugin doesn't reinject the parameter anyway since it is not in the default list of parameters of the job | 20:44 |
| waynr | s/branch/separate branch/ | 20:44 |
| waynr | but I don't really care | 20:45 |
| anteaya | stevemar: once the job is stable, the new job runs voting in check and gate and you remove the old job | 20:45 |
| anteaya | stevemar: make sense? | 20:45 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/puppet-zuul: Migrate to httpd::mod from httpd_mod https://review.openstack.org/249412 | 20:45 |
| hashar | zaro: from a manual rebuild, I would expect the node to be discarded, just like if it got triggered by Zuul :D | 20:45 |
| *** EricGonczer_ has joined #openstack-infra | 20:45 | |
| mtreinish | nibalizer: let me know when you're back around. I've got a couple hours, so lets see if we can get things moving | 20:45 |
| stevemar | anteaya: it does, i was thinking of just skipping the functional tests that fail (if any) if a failure did happen | 20:45 |
| anteaya | stevemar: add that as a comment on the patch, that way if this change breaks the job you are taking responsiblity for the outcome | 20:46 |
| stevemar | anteaya: cool with me | 20:46 |
| mordred | greghaynes, yolanda, clarkb, fungi: it seems like it's time for a glean release with that latest patch | 20:46 |
| zaro | hashar: no, if you want it to work like zuul then you need to trigger the job by sending to gearman. | 20:46 |
| electrofelix | waynr: sure, if it looks like there will be a break in compatibility that can't be easily masked it makes sense, but given the rate of reviews I think we'd still have plenty of time to cut a release and branch | 20:46 |
| mordred | and it has a new feature - dealing with vlans, so perhaps v 1.5.0 ? | 20:46 |
| *** placko has joined #openstack-infra | 20:47 | |
| clarkb | mordred: wfm | 20:47 |
| *** placko has quit IRC | 20:47 | |
| anteaya | stevemar: thanks | 20:47 |
| *** eil397 has joined #openstack-infra | 20:47 | |
| *** placko has joined #openstack-infra | 20:48 | |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: modify openstackclient functional tests to use neutron dsvm https://review.openstack.org/249411 | 20:49 |
| zaro | hashar: the gearman plugin is the thing that knows about OFFLINE_NODE_WHEN_COMPLETE and will do something with it. | 20:49 |
| fungi | mordred: glean release sounds fine | 20:49 |
| stevemar | anteaya: thanks for the suggestion! | 20:49 |
| hashar | zaro: so doing a manual rebuild bypass the gearman plugin ? | 20:49 |
| zaro | hashar: triggering with the build buton on jenkins UI will bypass gearman plugin code. | 20:49 |
| stevemar | anteaya: i gotta remember that not everyone knows all the details about all the proejcts :) | 20:50 |
| mordred | infra-root: copying hiera data to hosts works!!! | 20:50 |
| openstackgerrit | JJ Asghar proposed openstack-infra/system-config: Adding openstack-opportunities@lists.openstack.org https://review.openstack.org/249415 | 20:50 |
| stevemar | anteaya: it's just test code, so i ain't worried if things break, we can clean up our own mess | 20:50 |
| clarkb | mordred: what was missing for that again? | 20:50 |
| openstackgerrit | Sylvain Bauza proposed openstack-infra/project-config: add release notes jobs for novaclient https://review.openstack.org/248898 | 20:50 |
| mordred | clarkb: the patch we just landed | 20:50 |
| hashar | zaro: ah I see. So I will just disable the rebuild link entirely :-} thank you! | 20:50 |
| mordred | clarkb: I have now verified that it works as expected | 20:50 |
| anteaya | stevemar: great, it is archievd | 20:50 |
| zaro | hashar: you can use this to test https://github.com/zaro0508/gearman-plugin-client | 20:50 |
| clarkb | mordred: awesme | 20:50 |
| stevemar | anteaya: \o/ | 20:51 |
| anteaya | stevemar: I have so much more understanding for folks willing to clean up after themselves | 20:51 |
| mordred | infra-root: also, jjb re-run is done everywhere | 20:52 |
| *** matt6434 is now known as mattoliverau | 20:52 | |
| *** aysyd has quit IRC | 20:52 | |
| pleia2 | cool | 20:52 |
| jeblair | mordred: huzzah! | 20:53 |
| hashar | zaro: yeah noticed that one. Needs shell access though :-} I will just disable the rebuild plugin on those jobs | 20:53 |
| *** placko has quit IRC | 20:57 | |
| *** abregman|afk has quit IRC | 20:57 | |
| *** maishsk has joined #openstack-infra | 20:58 | |
| *** sdake has quit IRC | 20:59 | |
| *** sdake has joined #openstack-infra | 20:59 | |
| *** salv-orlando has joined #openstack-infra | 21:00 | |
| *** mrmartin has quit IRC | 21:01 | |
| *** salv-orl_ has joined #openstack-infra | 21:01 | |
| *** baoli has quit IRC | 21:02 | |
| *** sridhar_ram1 has joined #openstack-infra | 21:02 | |
| *** Sukhdev has quit IRC | 21:04 | |
| openstackgerrit | Doug Wiegley proposed openstack-infra/project-config: Add python3 testing to neutron-lib https://review.openstack.org/249421 | 21:04 |
| *** sridhar_ram has quit IRC | 21:04 | |
| *** salv-orlando has quit IRC | 21:05 | |
| mordred | clarkb, pleia2, fungi, jhesketh: could you please +A the patches before this one: https://review.openstack.org/#/c/248752/ I have verified that they work on our systems | 21:06 |
| * pleia2 has a look | 21:07 | |
| *** tsg has quit IRC | 21:07 | |
| flwang | greetings, can anybody help approve this one https://review.openstack.org/#/c/248490/ ? it's blocking zaqar client's functional test | 21:07 |
| pleia2 | ah, inventory_hostname, nice | 21:07 |
| flwang | the patch just adds a environment variable, thanks | 21:07 |
| mtreinish | pleia2, mordred: if you get a sec, can you take a pass at all the reviews listed on: https://etherpad.openstack.org/p/the-big-subunit2sql-migration | 21:08 |
| mtreinish | you should have +2 on all of them except for 1 | 21:08 |
| openstackgerrit | Merged openstack-infra/ansible-puppet: Use inventory_hostname to avoid fact gathering https://review.openstack.org/248751 | 21:08 |
| *** otter768 has quit IRC | 21:08 | |
| pleia2 | mordred: please see my comment on https://review.openstack.org/#/c/248720/ | 21:10 |
| *** tsg has joined #openstack-infra | 21:11 | |
| *** dprince has quit IRC | 21:11 | |
| pleia2 | mtreinish: I haven't kept up, are we ready to land these changes? (looking at the one to turn off db backups now) | 21:12 |
| *** rossella_s has quit IRC | 21:14 | |
| *** rossella_s has joined #openstack-infra | 21:14 | |
| openstackgerrit | Antoine Musso proposed openstack-infra/jenkins-job-builder: [WMF] pin python-jenkins ==0.4.8 https://review.openstack.org/249425 | 21:15 |
| mordred | pleia2: me lookie | 21:16 |
| *** dramalho has quit IRC | 21:16 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Restrict the file list to when copy_hieradata https://review.openstack.org/248720 | 21:16 |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Remove stray debug lines https://review.openstack.org/248752 | 21:16 |
| mordred | pleia2: it was a commit message issue - fixed and rebaed the final patch in the series | 21:17 |
| mordred | pleia2: (thanks!) | 21:17 |
| pleia2 | mordred: thanks :) | 21:17 |
| jeblair | +3 | 21:18 |
| *** haypo has left #openstack-infra | 21:18 | |
| openstackgerrit | Merged openstack-infra/ansible-puppet: Restrict the file list to when copy_hieradata https://review.openstack.org/248720 | 21:18 |
| *** Ala has joined #openstack-infra | 21:18 | |
| openstackgerrit | Merged openstack-infra/ansible-puppet: Remove stray debug lines https://review.openstack.org/248752 | 21:19 |
| *** kgiusti has quit IRC | 21:19 | |
| clarkb | back from lunch | 21:20 |
| jhesketh | mordred: done | 21:20 |
| pleia2 | mtreinish: went through the patches I was confident about (so, all but the 2 subunit2sql ones), didn't approve anything, just review+vote for now | 21:20 |
| mordred | jhesketh, pleia2: thanks! | 21:20 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: remove debug statement in release_from_yaml.py https://review.openstack.org/249426 | 21:21 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: fix error handling and bug reporting in release script https://review.openstack.org/249427 | 21:21 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: make release_from_yaml.py figure out the deliverable files for us https://review.openstack.org/249428 | 21:21 |
| *** yonglihe has quit IRC | 21:21 | |
| *** akshai has quit IRC | 21:22 | |
| *** akshai has joined #openstack-infra | 21:23 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Update system-config and puppet modules everywhere https://review.openstack.org/249430 | 21:24 |
| openstackgerrit | Cody Herriges proposed openstack-infra/project-config: (WIP) Test pupept-openstack modules on more Puppet https://review.openstack.org/249431 | 21:25 |
| *** regXboi has quit IRC | 21:25 | |
| openstackgerrit | Cody Herriges proposed openstack-infra/project-config: (WIP) Test pupept-openstack modules on more Puppet https://review.openstack.org/249431 | 21:25 |
| *** kdas_ has quit IRC | 21:25 | |
| *** otter768 has joined #openstack-infra | 21:29 | |
| mtreinish | pleia2: yeah, they should all be good to land now. But, either way nothing will take effect until I push the release | 21:30 |
| mtreinish | that's what triggers everything | 21:30 |
| mtreinish | well except for the pin reverts :) | 21:31 |
| mtreinish | pleia2: thanks for the reviews | 21:31 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Copy system-config and puppet modules everywhere https://review.openstack.org/249434 | 21:31 |
| *** arborism has quit IRC | 21:31 | |
| mordred | infra-root: ^^ https://review.openstack.org/249434 and https://review.openstack.org/249430 are two alternate ways of making sure that the puppet modules are all on the target machines before we run puppet apply | 21:32 |
| pleia2 | mtreinish: ok, approved the first two, need more eyes on the rest | 21:32 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Copy system-config and puppet modules everywhere https://review.openstack.org/249434 | 21:33 |
| *** sergmelikyan has quit IRC | 21:33 | |
| mordred | (minor change) | 21:33 |
| mordred | they both work - the synchronize version is a bit faster | 21:33 |
| mordred | and also has the benefit of making each run operate from a consistent state | 21:33 |
| mordred | so I'm more inclined to do https://review.openstack.org/249434 - but would love opinions from folks | 21:34 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Revert "Allow to delete nodes with missing target or provider" https://review.openstack.org/247071 | 21:34 |
| clarkb | mordred: not sure why the non synchronize method does the ansible galaxy install | 21:34 |
| jeblair | mordred, clarkb: i think we have decided along with yolanda to revert that ^, clarkb added the docs. the test in that change just flaked and failed an unrelated change so maybe we could go ahead and approve the revert? | 21:34 |
| clarkb | mordred: that shouldn't be required right? is it possible that is why it is slower? | 21:35 |
| jeblair | mordred: reading your changes | 21:35 |
| mordred | clarkb: it doens't need to - I can remove that | 21:35 |
| clarkb | jeblair: my only concern with reverting now is that we will ahve to rebase the image builders again | 21:35 |
| mordred | clarkb: but no - install_modules.sh is the slow part | 21:35 |
| clarkb | jeblair: and I think they are very close ... | 21:35 |
| mtreinish | pleia2: cool, thanks. I'll probably just fast approve the subunit2sql ones. Unless SpamapS shows up to save the day | 21:35 |
| mordred | clarkb: rsyncing the tree turns out to be faster than a bash loop over the dirs and a git pull | 21:35 |
| openstackgerrit | Merged openstack-infra/puppet-subunit2sql: Stop attempting to run a mysqldump before migrations https://review.openstack.org/246686 | 21:35 |
| *** Ala has quit IRC | 21:36 | |
| *** Ala has joined #openstack-infra | 21:36 | |
| mordred | clarkb: now - to be fair, I've only tested this on one node - so it's possible that 20 parallel rsyncs from the same host outbound will be slower than 20 parallel bash loop/fetches | 21:36 |
| mordred | but I didn't want to start shotgunning ansible playbooks across too many of our nodes before they're actually reviewed | 21:37 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Disable InsecurePlatform Warnings https://review.openstack.org/247069 | 21:37 |
| pabelanger | asselin: odd we didn't see it sooner | 21:37 |
| clarkb | ya I don't think we should worry too much about it | 21:37 |
| jeblair | clarkb: i'd be more sympathetic to that if we had managed to avoid approving the original change very recently. | 21:37 |
| clarkb | I just noticed the one was doing more work than the other | 21:37 |
| mordred | clarkb: it's not a long time in either case | 21:37 |
| *** dims has quit IRC | 21:37 | |
| jeblair | i know i'm trying to keep out of the way of the builders | 21:37 |
| mordred | clarkb: I think I'm more focused on the sync case providing each host for a given run with the exact same config state | 21:38 |
| clarkb | mordred: ya that is nice | 21:38 |
| asselin | pabelanger, yeah.... | 21:38 |
| mordred | clarkb: so since it seems to be low-cost for now, maybe we start with that and if the rsync becomesa bottleneck we cna always move to the install_modules.sh everwhere? | 21:38 |
| *** dims has joined #openstack-infra | 21:38 | |
| clarkb | mordred: sure | 21:39 |
| *** sabeen1 has joined #openstack-infra | 21:39 | |
| jeblair | clarkb: if it helps -- removing a flaky test will help land the builders :) | 21:40 |
| *** sergmelikyan has joined #openstack-infra | 21:41 | |
| jeblair | clarkb: there are no merge conflicts with the builders? what problem are you seeing? | 21:41 |
| clarkb | I think there are | 21:42 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-subunit2sql: Lets time the super long migrations we have to run https://review.openstack.org/246041 | 21:42 |
| mtreinish | pleia2: ^^^ isn't it great when your patches merge conflict with each other | 21:42 |
| clarkb | needed a rebase after that change merged | 21:42 |
| clarkb | its how I found that change | 21:42 |
| *** sabeen3 has joined #openstack-infra | 21:43 | |
| jeblair | clarkb: my git disagrees http://paste.openstack.org/show/479921/ | 21:43 |
| *** sabeen1 has quit IRC | 21:43 | |
| clarkb | ok | 21:43 |
| *** gordc has quit IRC | 21:45 | |
| *** elo has quit IRC | 21:46 | |
| *** jaypipes has quit IRC | 21:47 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: gerrit: allow puppet openstack release team to manage puppet-keystone https://review.openstack.org/249440 | 21:47 |
| *** ayoung has quit IRC | 21:48 | |
| EmilienM | I'm unable to create branches on puppet-keystone anymore, can anyone review ^ if possible today? I'm in the release process, thanks | 21:48 |
| *** otter768 has quit IRC | 21:48 | |
| *** dimtruck is now known as zz_dimtruck | 21:48 | |
| *** boris-42 has quit IRC | 21:48 | |
| *** nmagnezi has quit IRC | 21:49 | |
| EmilienM | clarkb: maybe if you can look ^ | 21:49 |
| *** bardia has joined #openstack-infra | 21:49 | |
| pleia2 | mtreinish: doh :) | 21:49 |
| anteaya | EmilienM: you could create branches on puppet-keystone previously? | 21:50 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Stop using nova client in test_compute https://review.openstack.org/249443 | 21:50 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Clean up compute functional tests https://review.openstack.org/249444 | 21:50 |
| EmilienM | anteaya: yes but we recently created this ACL for the repo | 21:50 |
| EmilienM | and I missed that part I guess | 21:50 |
| EmilienM | I did not produce a after before the change | 21:50 |
| *** yamahata has joined #openstack-infra | 21:50 | |
| EmilienM | so I'm seeing the issue now | 21:51 |
| *** hemna has joined #openstack-infra | 21:51 | |
| anteaya | EmilienM: yes I see you created juno and kilo: http://git.openstack.org/cgit/openstack/puppet-keystone/refs/ | 21:51 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Ensure system-config hieradata link exists https://review.openstack.org/249445 | 21:51 |
| anteaya | EmilienM: ah okay, that makes sense | 21:51 |
| EmilienM | anteaya: the ACL for puppet-keystone is new | 21:51 |
| clarkb | EmilienM: where is that change? | 21:51 |
| mordred | clarkb, jeblair, pleia2: puppet apply from ansible works | 21:51 |
| EmilienM | I did a mistake in the acl :( | 21:51 |
| mordred | with that change above | 21:51 |
| mordred | I have not verified the puppetdb reports yet | 21:51 |
| EmilienM | anteaya: https://github.com/openstack-infra/project-config/commit/5b49af8f646c4836f79f9e2f0c07c02d5c53919f | 21:52 |
| anteaya | EmilienM: it happens | 21:52 |
| EmilienM | clarkb: ^ | 21:52 |
| clarkb | you need a create clause | 21:52 |
| openstackgerrit | Merged openstack-infra/subunit2sql: Fix documentation before the release https://review.openstack.org/249199 | 21:52 |
| anteaya | EmilienM: thanks that makes sense now | 21:52 |
| mordred | but I have now successfully run the hiera-copy/modules-sync/puppet-apply and it totally worked - and it worked on a host that has hiera values it needs (the patch above fixed that) | 21:52 |
| *** Swami has joined #openstack-infra | 21:53 | |
| EmilienM | clarkb: this is what I did, isn't? | 21:53 |
| anteaya | clarkb: https://review.openstack.org/#/c/249440/1 | 21:53 |
| openstackgerrit | Merged openstack-infra/subunit2sql: Fail early if no data is found in the database https://review.openstack.org/249338 | 21:54 |
| clarkb | EmilienM: ^F create no results | 21:55 |
| *** maishsk has quit IRC | 21:55 | |
| anteaya | clarkb: he is adding the create clause in 249440 | 21:56 |
| *** rhallisey has quit IRC | 21:57 | |
| EmilienM | clarkb: sorry? I don't get it | 21:58 |
| *** glauco has quit IRC | 21:58 | |
| clarkb | neither do I | 21:58 |
| *** glauco_ has joined #openstack-infra | 21:58 | |
| clarkb | I asked for original change, it doesn't do create | 21:58 |
| clarkb | I see there is now a 249440 change | 21:58 |
| EmilienM | yes | 21:58 |
| clarkb | not sure how I was supposed to know about that one | 21:58 |
| clarkb | anyways reviewing it now | 21:58 |
| *** glauco_ has quit IRC | 21:58 | |
| anteaya | clarkb: he linked it in backscroll | 21:58 |
| EmilienM | clarkb: I'm not able to create a branch since this change | 21:58 |
| anteaya | clarkb: you must have missed it | 21:59 |
| EmilienM | yes, I sent the link to anita on IRC a few min ago | 21:59 |
| openstackgerrit | Merged openstack-infra/project-config: modify openstackclient functional tests to use neutron dsvm https://review.openstack.org/249411 | 21:59 |
| anteaya | then EmilienM and you were talking past each other since | 21:59 |
| anteaya | I was trying to help | 21:59 |
| *** akshai has quit IRC | 21:59 | |
| anteaya | EmilienM: well openstackgerrit showed the link | 22:00 |
| *** akshai has joined #openstack-infra | 22:01 | |
| EmilienM | thank you anteaya and clarkb ! | 22:02 |
| anteaya | EmilienM: glad we got it sorted out | 22:04 |
| *** sergmelikyan has quit IRC | 22:04 | |
| *** hashar has quit IRC | 22:04 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Clean up compute functional tests https://review.openstack.org/249444 | 22:06 |
| openstackgerrit | Merged openstack-infra/project-config: gerrit: allow puppet openstack release team to manage puppet-keystone https://review.openstack.org/249440 | 22:06 |
| openstackgerrit | Dmitriy Ukhlov proposed openstack/requirements: Updates pika-pool library https://review.openstack.org/249206 | 22:07 |
| *** ashleighfarnham has quit IRC | 22:07 | |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: Remove py26 jobs from openstackclient https://review.openstack.org/249450 | 22:07 |
| *** apoorvad has joined #openstack-infra | 22:08 | |
| *** abregman|afk has joined #openstack-infra | 22:08 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Fix resource leak in test_compute https://review.openstack.org/249452 | 22:09 |
| *** sergmelikyan has joined #openstack-infra | 22:10 | |
| *** bdemers has quit IRC | 22:10 | |
| *** abregman|afk has quit IRC | 22:10 | |
| anteaya | stevemar: did you see the remove py26 jobs on a keystone repo? I asked the patch owner to get your +1 on that one | 22:10 |
| *** abregman has joined #openstack-infra | 22:10 | |
| anteaya | stevemar: tom someone? | 22:11 |
| anteaya | stevemar: oh you did | 22:12 |
| *** Sukhdev has joined #openstack-infra | 22:12 | |
| *** baoli has joined #openstack-infra | 22:12 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Decouple nodepool db and config from builders https://review.openstack.org/222398 | 22:14 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Builders distinguish between failure and exception https://review.openstack.org/242131 | 22:14 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Decouple builders from nodepool instance https://review.openstack.org/232135 | 22:14 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Builders can be run on their own https://review.openstack.org/232251 | 22:14 |
| *** trown is now known as trown|outttypeww | 22:15 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Print the JJB template name in devstack jobs https://review.openstack.org/247264 | 22:15 |
| *** alivigni has quit IRC | 22:15 | |
| *** SotK has quit IRC | 22:16 | |
| *** Piet has quit IRC | 22:16 | |
| *** dramalho has joined #openstack-infra | 22:17 | |
| *** SotK has joined #openstack-infra | 22:17 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Clean up compute functional tests https://review.openstack.org/249444 | 22:18 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Fix resource leak in test_compute https://review.openstack.org/249452 | 22:18 |
| jeblair | clarkb: are you still opposed to landing https://review.openstack.org/247071 now? | 22:18 |
| *** ZZelle_ has joined #openstack-infra | 22:18 | |
| clarkb | jeblair: no | 22:19 |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: [sahara] scenario jobs voting in master branch https://review.openstack.org/249203 | 22:19 |
| *** baoli has quit IRC | 22:19 | |
| clarkb | will review it | 22:19 |
| greghaynes | https://review.openstack.org/#/c/249351/ is a new nodepool race fail? :( | 22:19 |
| *** signed8b_ has joined #openstack-infra | 22:20 | |
| *** zaina has joined #openstack-infra | 22:20 | |
| *** signed8bit has quit IRC | 22:20 | |
| *** thorst_ has joined #openstack-infra | 22:21 | |
| greghaynes | I think I hit that one locally last night, so it seems kind of new | 22:21 |
| *** dramalho has quit IRC | 22:22 | |
| *** thorst__ has joined #openstack-infra | 22:22 | |
| *** abregman has quit IRC | 22:23 | |
| jeblair | greghaynes: that's what i'm trying to fix with the revert clarkb is reviewing now (and you have previously +1d) | 22:24 |
| openstackgerrit | Merged openstack-infra/nodepool: Revert "Allow to delete nodes with missing target or provider" https://review.openstack.org/247071 | 22:24 |
| jeblair | greghaynes: and fixed! :) | 22:24 |
| *** ccrouch has quit IRC | 22:24 | |
| greghaynes | jeblair: oh! I didnt connect those two dots, I thought the revert was just because the node leak | 22:24 |
| jeblair | greghaynes: it was; the renewed urgency on my part was due to the flaky test | 22:25 |
| *** elo has joined #openstack-infra | 22:25 | |
| openstackgerrit | Merged openstack-infra/shade: boot-from-volume and network params for server create https://review.openstack.org/247205 | 22:25 |
| *** ccrouch has joined #openstack-infra | 22:25 | |
| *** thorst_ has quit IRC | 22:25 | |
| openstackgerrit | Merged openstack-infra/nodepool: Get public IPs from supplied networks https://review.openstack.org/249351 | 22:26 |
| greghaynes | awesome. Now we just have the one pymysql fixture race to figure out | 22:26 |
| *** thorst__ has quit IRC | 22:26 | |
| jeblair | dstufft: i'm still seeing errors with HTTPError: 404 Client Error: Not Found for url: https://pypi.python.org/packages/source/b/bendacoder-pyDb/bendacoder-pyDb-1.1.0.tar.gz | 22:26 |
| *** thorst_ has joined #openstack-infra | 22:27 | |
| jeblair | dstufft: and we have a bandersnatch mirror that's dead in the water because of that... any idea how i can proceed? | 22:27 |
| clarkb | jeblair: I have no idea if this will work, but maybe we can have that mirror pull from another one of our mirrors | 22:27 |
| clarkb | as a temporary workaround? | 22:27 |
| jeblair | clarkb: i'll give that a try | 22:28 |
| nibalizer | mtreinish: pleia2 I'm available now | 22:30 |
| nibalizer | though maybe the deed is done? | 22:30 |
| stevemar | anteaya: yep, tom is new, he pinged me about it | 22:30 |
| pleia2 | nibalizer: https://review.openstack.org/246041 | 22:30 |
| clarkb | nibalizer: are you still planning on doing the logstash stuff today? I am around if so | 22:31 |
| stevemar | anteaya: we discussed it in keystone-meeting to remove py26 | 22:31 |
| anteaya | stevemar: wonderful, way to go new tom | 22:31 |
| anteaya | stevemar: lovely | 22:31 |
| stevemar | anteaya: he needs to idle in infra -_- | 22:31 |
| *** dizquierdo has joined #openstack-infra | 22:31 | |
| mtreinish | nibalizer: yep that patch pleia2 linked should be the last one we need to land | 22:31 |
| *** thorst_ has quit IRC | 22:31 | |
| pleia2 | nibalizer: ah, this one too: https://review.openstack.org/#/c/248906/ | 22:31 |
| *** achanda has joined #openstack-infra | 22:31 | |
| anteaya | stevemar: he'll figure it out | 22:31 |
| *** Ala has quit IRC | 22:31 | |
| pleia2 | but both are pretty straight forward :) | 22:31 |
| mtreinish | nibalizer: then it's just manual steps before I push the release to to trigger armageddon | 22:32 |
| anteaya | clarkb: what are you doing today for logstash? | 22:32 |
| *** unicell1 has joined #openstack-infra | 22:32 | |
| clarkb | anteaya: nibalizer wanted to merge a series of patches to update the puppeting for the logstash workers | 22:32 |
| clarkb | the actual service doesnt change at all | 22:32 |
| anteaya | clarkb: cool | 22:32 |
| anteaya | clarkb: great | 22:32 |
| *** signed8b_ has quit IRC | 22:32 | |
| anteaya | clarkb: haven't debugged horizon yet, any time frame in your mind to moving to logstash 2.0? | 22:33 |
| clarkb | anteaya: I still have to untablgle the puppet for that | 22:33 |
| anteaya | was hoping to continue picking away at that and figuring out parsing | 22:33 |
| *** achanda has quit IRC | 22:33 | |
| anteaya | clarkb: okay | 22:33 |
| clarkb | probably next week at the earliest | 22:33 |
| clarkb | since we are fast approaching clarkb figures out turkey | 22:34 |
| anteaya | oh good, didn't want to slow you down | 22:34 |
| anteaya | yeah that too | 22:34 |
| anteaya | are you smoking one this year? | 22:34 |
| *** ssancheztrujillo has joined #openstack-infra | 22:34 | |
| clarkb | no its going to be cold (for us anyways) and doing it at my place not my brothers | 22:34 |
| clarkb | so no covered patio | 22:34 |
| *** unicell has quit IRC | 22:34 | |
| anteaya | oh okay | 22:35 |
| clarkb | (to give you an idea of how cold it is I am currently saving space in my fridge by storing my beer outside, so its refridgerator temps) | 22:35 |
| clarkb | I think canada cold is probably closer to freezer temps | 22:35 |
| anteaya | you can make ice outside now it is true | 22:36 |
| *** glauco_ has joined #openstack-infra | 22:36 | |
| anteaya | I like being able to store the drinks outside | 22:36 |
| anteaya | how cold does portland usually get? | 22:37 |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Fetch puppet logs and facts after puppet run https://review.openstack.org/240446 | 22:37 |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Remove copy_hieradata value from vars file https://review.openstack.org/249466 | 22:37 |
| nibalizer | clarkb: we can just push it | 22:37 |
| nibalizer | since i'm also helping mordred with puppet apply | 22:37 |
| clarkb | anteaya: this is normalish, its either sunny and just below freezing or wet and just above freezing from about december to march | 22:38 |
| nibalizer | mtreinish: pleia2 approved 246041 | 22:38 |
| *** signed8bit has joined #openstack-infra | 22:38 | |
| *** mriedem has quit IRC | 22:38 | |
| anteaya | clarkb: nice | 22:38 |
| anteaya | I vote for sunny and below freezing | 22:38 |
| anteaya | that's my favourite | 22:39 |
| *** ssancheztrujillo has quit IRC | 22:39 | |
| *** ssancheztrujillo has joined #openstack-infra | 22:39 | |
| mtreinish | nibalizer: cool, then we're on step 4: https://etherpad.openstack.org/p/the-big-subunit2sql-migration | 22:40 |
| *** ssancheztrujillo has quit IRC | 22:41 | |
| *** ssancheztrujillo has joined #openstack-infra | 22:41 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Fetch puppet logs and facts after puppet run https://review.openstack.org/240446 | 22:41 |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Remove copy_hieradata value from vars file https://review.openstack.org/249466 | 22:41 |
| nibalizer | so for https://review.openstack.org/#/c/248906/ won't that not have an effect until we rebuild nodes ? | 22:41 |
| mordred | nibalizer: ^^ k. I don't have the actual posting to puppetdb working, but everything else does | 22:42 |
| anteaya | mtreinish: I'll take 9a as a work item | 22:42 |
| mtreinish | nibalizer: that's fine, because we haven't pushed the release yet | 22:42 |
| mtreinish | anteaya: heh, thanks :) | 22:42 |
| * anteaya does 9a | 22:42 | |
| mtreinish | nibalizer: we just need to make sure we don't end up with 1.0.0 on the images until after the migration is finished | 22:43 |
| nibalizer | ok | 22:43 |
| openstackgerrit | Merged openstack-infra/puppet-subunit2sql: Lets time the super long migrations we have to run https://review.openstack.org/246041 | 22:43 |
| nibalizer | approved then | 22:43 |
| *** zaina has quit IRC | 22:43 | |
| openstackgerrit | Merged openstack-infra/project-config: Set a temporary cap on subunit2sql before 1.0.0 release https://review.openstack.org/248906 | 22:43 |
| mtreinish | nibalizer: cool, ok then I think we're ready to kill the subunit worker and stop puppet | 22:44 |
| pleia2 | woo | 22:44 |
| greghaynes | jeblair: So I am noticing some nodepool patches that are going to conflict with builders, do we have any plan for eventually making a push so we dont have to spin wheels on rebase/re-review cycling? | 22:45 |
| greghaynes | like, maybe at some point start basing changes off of the builder series | 22:45 |
| *** zaina has joined #openstack-infra | 22:45 | |
| *** zaina has quit IRC | 22:45 | |
| *** sergmelikyan has quit IRC | 22:45 | |
| pleia2 | nibalizer: ooh, congrats on scale talk acceptance | 22:46 |
| nibalizer | pleia2: thanks | 22:47 |
| *** ssancheztrujillo has left #openstack-infra | 22:48 | |
| *** unicell1 has quit IRC | 22:49 | |
| *** doug-fis_ has joined #openstack-infra | 22:49 | |
| elo | how does an project start getting tracked for metric for activity dashboard? | 22:49 |
| *** unicell has joined #openstack-infra | 22:49 | |
| *** fedexo has joined #openstack-infra | 22:51 | |
| elo | i noticed that the astara project is not a subproject in http://activity.openstack.org | 22:51 |
| nibalizer | mordred: for https://review.openstack.org/#/c/249434/ isn't that going to be painfully slow? | 22:51 |
| nibalizer | pleia2: which one of us is doing the rootish stuff for mtreinish ? | 22:51 |
| anteaya | is mrmartin doing activity.o.o things? | 22:52 |
| nibalizer | i guess it's a one time cost then just an rsync | 22:52 |
| anteaya | elo: I'm not exactly sure | 22:52 |
| pleia2 | nibalizer: I had not volunteered ;) | 22:52 |
| nibalizer | but git is pretty good at things, seems odd to use rsync to ensure git repo state | 22:52 |
| nibalizer | pleia2: ok | 22:52 |
| mtreinish | pleia2: heh, I dunno it sounds like you just did :) | 22:52 |
| *** doug-fish has quit IRC | 22:53 | |
| *** doug-fis_ has quit IRC | 22:53 | |
| nibalizer | mtreinish: no its fine for me to do it | 22:53 |
| *** sergmelikyan has joined #openstack-infra | 22:53 | |
| mtreinish | nibalizer: ok, cool thanks | 22:53 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: zuul: enable beaker jobs for puppet-mistral https://review.openstack.org/249179 | 22:54 |
| anteaya | reed: you are listed as an activity.o.o core reviewer: https://review.openstack.org/#/admin/groups/208,members | 22:54 |
| anteaya | reed: how does someone add a project to activity.o.o for tracking? | 22:55 |
| *** hemna is now known as hemnafk | 22:55 | |
| *** wuhg has joined #openstack-infra | 22:57 | |
| *** peristeri has quit IRC | 22:57 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: [docinstallteam] change agenda_url https://review.openstack.org/249217 | 22:58 |
| *** FallenPegasus has joined #openstack-infra | 22:59 | |
| mordred | nibalizer: nope | 23:00 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Add test for failing provider loading https://review.openstack.org/249470 | 23:00 |
| mordred | nibalizer: it's actually pretty snappy | 23:00 |
| jeblair | greghaynes: my priorities are a) new clouds b) builders c) zuulv3. i'm basically ignoring nodepool patches that are outside of those. | 23:00 |
| mordred | nibalizer: the rsync is actually a bit quicker than the git | 23:00 |
| jeblair | clarkb: apparently that does not work. i may just need to rsync from an existing mirror | 23:00 |
| greghaynes | jeblair: Ya, I have seen it for bugfixes a few times and it scares me because I have caught at least one time we would have regressed on a bugfix becuase of a merge conflict resolve failure | 23:01 |
| greghaynes | ignoring broken providers is an example | 23:01 |
| greghaynes | (also, you should check out that test for it) | 23:02 |
| jeblair | greghaynes: if you see a problem with that patch, do you mind leaving a review comment to that effect? :) | 23:02 |
| nibalizer | disabling puppet on subunit-worker01 | 23:02 |
| greghaynes | jeblair: sure | 23:02 |
| nibalizer | stopping worker | 23:03 |
| jeblair | greghaynes: oh i see what you mean -- because there wasn't a test for that, but you added one | 23:03 |
| jeblair | greghaynes: thanks :) | 23:04 |
| greghaynes | jeblair: Yep | 23:04 |
| *** mestery has quit IRC | 23:04 | |
| jeblair | greghaynes: you'll note i haven't been pushing on that one since it's not in my critical path :) | 23:04 |
| nibalizer | mtreinish: okay im gonna see about taking a snapshot of this trove database | 23:04 |
| *** doug-fish has joined #openstack-infra | 23:04 | |
| *** mestery has joined #openstack-infra | 23:05 | |
| mtreinish | nibalizer: ok | 23:05 |
| mtreinish | I think SpamapS just meant trove backup | 23:05 |
| greghaynes | jeblair: Ya. I just dont have a great strategy for making sure I dont mess up merge conflicts other than to hope tests catch fixes or to try and avoid conflicting with bugs, and once a fix it up it tends to eventually get merged. | 23:05 |
| mtreinish | I think it does a snapshot under the covers | 23:05 |
| greghaynes | jeblair: Normally it isnt a huge issue, this is just a conflict magnet | 23:05 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add baremetal hpuswest node definition https://review.openstack.org/208751 | 23:06 |
| mtreinish | clarkb: is puppet running on logstash.o.o? | 23:06 |
| *** ddieterly has quit IRC | 23:07 | |
| greghaynes | jeblair: BTW, do we have a topic for new clouds? | 23:07 |
| clarkb | mtreinish: it should be | 23:08 |
| clarkb | jeblair: :( | 23:08 |
| mtreinish | clarkb: ok, just wanted to make sure, before it's time to push the release | 23:08 |
| *** otter768 has joined #openstack-infra | 23:08 | |
| *** doug-fish has quit IRC | 23:08 | |
| clarkb | mtreinish: you cna check on puppetbaord | 23:09 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Added support for the workflow job type https://review.openstack.org/248169 | 23:09 |
| clarkb | http://puppetboard.openstack.org | 23:09 |
| clarkb | see when puppet last ran there | 23:09 |
| mtreinish | clarkb: but that doesn't have the friendly personal touch I get by asking you :) | 23:10 |
| anteaya | clarkb, the friendly ui to puppetboard | 23:10 |
| *** boris-42 has joined #openstack-infra | 23:10 | |
| *** ddieterly has joined #openstack-infra | 23:11 | |
| *** baoli has joined #openstack-infra | 23:11 | |
| *** dkranz has quit IRC | 23:12 | |
| *** baoli has quit IRC | 23:13 | |
| *** baoli has joined #openstack-infra | 23:14 | |
| openstackgerrit | Fei Long Wang proposed openstack-infra/project-config: Create Zaqar UI repo https://review.openstack.org/248850 | 23:15 |
| *** baoli has quit IRC | 23:16 | |
| jeblair | greghaynes: no, but i can try to start one | 23:16 |
| *** ZZelle_ has quit IRC | 23:17 | |
| nibalizer | gonna take a trove backup | 23:17 |
| tsg | clarkb: on bug 238926, the RH package maintainer for liberasurecode just informed me that the package is now available on F22 (https://bodhi.fedoraproject.org/updates/liberasurecode-1.0.9-3.fc22) | 23:18 |
| clarkb | tsg: so the current change is fine? can you test and confirm that you can install it on f22? | 23:19 |
| nibalizer | mtreinish: the backup is building | 23:19 |
| mtreinish | nibalizer: ok cool | 23:19 |
| mtreinish | nibalizer: we probably can check the free space on the database server while that's running too | 23:19 |
| mtreinish | pleia2: did you end up resizing it when we were talking about that the other day? | 23:20 |
| nibalizer | im not sure what tha tmeans | 23:20 |
| nibalizer | what database server? | 23:20 |
| *** signed8bit is now known as signed8bit_ZZZzz | 23:20 | |
| mordred | nibalizer, Hunner: u'The POST method is not allowed for /' | 23:20 |
| mtreinish | nibalizer: the subunit2sql server (the one we're backing up now) | 23:20 |
| pleia2 | mtreinish: I did not, I haven't done it before and am not familiar with how that works (online resize?) | 23:20 |
| mordred | nibalizer: I got the SSL context figured out in requests (ZOMG INTERFACE MY EYES MY EYES) | 23:21 |
| mtreinish | ok, well we should wait until the backup is done then | 23:21 |
| mordred | nibalizer: but I'm getting that 405 - which means I'm guessing / is not what I should be posting to | 23:21 |
| mtreinish | nibalizer, pleia2: yeah we just need to make sure we have enough free space for the migration | 23:21 |
| nibalizer | likely not | 23:21 |
| tsg | clarkb: I will test on F22 and comment - I am not sure if we need to enable updates-testing repo or the package appears in "updates" repo | 23:21 |
| clarkb | tsg: if its easier you can still chang eit to >22 | 23:21 |
| nibalizer | mtreinish: i dont really have a lot of visibilyt into that, its just a trove db | 23:22 |
| *** FallenPegasus has quit IRC | 23:22 | |
| mtreinish | nibalizer: there should be a dropdown somewhere in the ui | 23:22 |
| nibalizer | volume | 320 | 23:22 |
| nibalizer | volume_used | 289.99 | 23:22 |
| pleia2 | nibalizer: one of the pages has a link where you can resize, and the resize box allows you to go up to 500G | 23:23 |
| mtreinish | nibalizer: yeah, we should be able to increase that to 500, which should give us enough free space to run the migration | 23:23 |
| mtreinish | but we should probably wait until after the backup is done | 23:23 |
| *** sabeen3 has quit IRC | 23:23 | |
| *** dingyichen has joined #openstack-infra | 23:24 | |
| tsg | clarkb: the devstack guys are waiting on the package to appear in F22 anyway so it should ok to wait a bit | 23:24 |
| clarkb | ok | 23:24 |
| tsg | clarkb: I will resubmit tonight if I see this taking longer | 23:24 |
| openstackgerrit | Merged openstack/requirements: Add python consul client https://review.openstack.org/246021 | 23:24 |
| *** apoorvad has quit IRC | 23:25 | |
| mtreinish | pleia2: yeah it is an online resize, it just bumps the size of the backing filesystem. I don't know what the backend store but it's either a file somewhere or using something that natively supports resizing | 23:26 |
| *** EricGonczer_ has quit IRC | 23:26 | |
| openstackgerrit | Qiming Teng proposed openstack-infra/project-config: Add release notes jobs for senlin https://review.openstack.org/249244 | 23:26 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Keep going on network timeouts or service errors https://review.openstack.org/238598 | 23:26 |
| *** tlian has joined #openstack-infra | 23:26 | |
| mordred | nibalizer: according to the pdb docs: https://docs.puppetlabs.com/puppetdb/3.2/api/command/v1/commands.html#store-report-version-6 the endpoint is /pdb/cmd/v1 | 23:27 |
| jeblair | clarkb: i'm rsyncing dfw -> nyj01 | 23:27 |
| mordred | nibalizer: but when I try to use that, I get Not Found | 23:27 |
| nibalizer | we're on 2.2 | 23:27 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Update default to F23 https://review.openstack.org/247296 | 23:27 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Pre-install python on F23 images https://review.openstack.org/249479 | 23:27 |
| ianw | greghaynes: ^ so that brings fedora-minimal & fedora inline | 23:28 |
| *** dims_ has joined #openstack-infra | 23:28 | |
| clarkb | mordred: pdb != pdb I was confused for a moment | 23:28 |
| *** dims has quit IRC | 23:29 | |
| *** thorst has joined #openstack-infra | 23:29 | |
| *** jffische has joined #openstack-infra | 23:29 | |
| mordred | ah | 23:30 |
| mordred | nibalizer: cool - different endpoint | 23:30 |
| mtreinish | anteaya: if you get a sec: https://review.openstack.org/#/c/247868/ the depends on has already landed | 23:31 |
| mordred | nibalizer: it does not like /commands :) | 23:32 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Keep going on network timeouts or service errors https://review.openstack.org/238598 | 23:32 |
| nibalizer | mordred: https://github.com/nibalizer/puppetdb-hacking/blob/master/reports.sh | 23:32 |
| nibalizer | thats how i was doing it | 23:32 |
| nibalizer | technically hunner and I tested on 2.3 and i think we are running 2.2 on puppetdb.openstack.org | 23:32 |
| mordred | yup | 23:33 |
| mordred | it's /v3 - totally missing from the docs | 23:33 |
| * anteaya stops staring into the abyss to review that patch | 23:33 | |
| nibalizer | oh | 23:33 |
| nibalizer | anywyas that shell script should get you there | 23:33 |
| mordred | just like not even in the docs at all | 23:33 |
| mordred | requests.post('https://puppetdb.openstack.org:8081/v3/commands', json=json.load(open("/var/lib/puppet/reports/ask-staging.openstack.org/201511242211_puppetdb.json", 'r')), cert=('/var/lib/puppet/ssl/certs/puppetmaster.openstack.org.pem', '/var/lib/puppet/ssl/private_keys/puppetmaster.openstack.org.pem'), verify='/var/lib/puppet/ssl/ca/ca_crt.pem') | 23:33 |
| mordred | that works | 23:33 |
| nibalizer | trove backup-show is really a wealth of information ---- not | 23:33 |
| *** claudiub has quit IRC | 23:33 | |
| nibalizer | status is BULDING | 23:33 |
| nibalizer | that could mean anything lol | 23:33 |
| zxiiro | In JJB how do I pass a boolean to a parameter through inheritance from a project section? for example I defined "boolvar" in project and I want to set a job template section: Disabled: '{boolvar}' | 23:34 |
| zxiiro | this passes a string unfortunately | 23:34 |
| notmorgan | fungi / clarkb / zaro: ping re apache-fu things from meeting today. there is an "easy reproducer" bit? /me is lookin to dust off the wonderful apache skills | 23:34 |
| clarkb | notmorgan: deploy latest gerrit release and put behind apache using our config which I will dig up in a sec | 23:34 |
| notmorgan | clarkb: cool thnx | 23:34 |
| clarkb | notmorgan: oh and configure that gerrit to auth with openid | 23:34 |
| notmorgan | ok yeah. | 23:35 |
| clarkb | since the weirdness happens when you login and it does the redirect thing back to gerrit | 23:35 |
| notmorgan | ah ok | 23:35 |
| notmorgan | clarkb: 2.11.5? | 23:35 |
| clarkb | notmorgan: https://git.openstack.org/cgit/openstack-infra/puppet-gerrit/tree/templates/gerrit.vhost.erb is apache vhost template | 23:35 |
| notmorgan | or the 2.12rc? | 23:35 |
| clarkb | notmorgan: ya 2.1..5 | 23:35 |
| notmorgan | k | 23:35 |
| clarkb | er 2.11.5 | 23:36 |
| notmorgan | coo | 23:36 |
| notmorgan | yah | 23:36 |
| *** signed8bit_ZZZzz is now known as signed8bit | 23:36 | |
| anteaya | I thought we were on 2.11.4 | 23:36 |
| mtreinish | nibalizer: heh, yeah that's useful | 23:36 |
| notmorgan | anteaya: i'm digging into the reason 2.11.5 is unhappy | 23:36 |
| *** jffische has quit IRC | 23:36 | |
| clarkb | anteaya: either should work since bug is present in both | 23:36 |
| notmorgan | anteaya: or whatever, but yeah :) | 23:36 |
| *** thorst has quit IRC | 23:36 | |
| zxiiro | nevermind figured it out with the {obj:key} thing | 23:36 |
| *** sergmelikyan has quit IRC | 23:37 | |
| anteaya | https://review.openstack.org/#/c/241309/1/modules/openstack_project/manifests/review.pp | 23:37 |
| anteaya | clarkb notmorgan okay | 23:37 |
| clarkb | notmorgan: there is a setup script to get started and it runs a h2 db which is fine | 23:37 |
| clarkb | notmorgan: you iwll likely need to stop it after that, edit config for openid, then start again | 23:37 |
| anteaya | notmorgan: no I mean current review.o.o is on gerrit 2.8, right now our upgrade path is pointed at 2.11.4 | 23:38 |
| zaro | notmorgan: can repro with 2.11.5 as well | 23:38 |
| notmorgan | clarkb: yah i remember setting up gerrit in the past | 23:38 |
| notmorgan | zaro: awesome. thnx for confirming | 23:38 |
| openstackgerrit | Merged openstack-infra/project-config: Add release notes jobs to subunit2sql https://review.openstack.org/247868 | 23:39 |
| *** akshai has quit IRC | 23:39 | |
| *** akshai has joined #openstack-infra | 23:40 | |
| *** Swami has quit IRC | 23:40 | |
| zaro | notmorgan: dimtruck is also trying his apache-fu on it as well. you might want to bounce ideas off him as well | 23:40 |
| * notmorgan nods | 23:40 | |
| notmorgan | well i'm setting up a quick env for it and we'll see how it shakes out | 23:40 |
| *** gildub has joined #openstack-infra | 23:40 | |
| zaro | repro steps are in the bug, https://code.google.com/p/gerrit/issues/detail?id=3365 | 23:41 |
| clarkb | notmorgan: the hack fix was rewrite //\(.*\) to /$1 with a redirect but that never seemed to match because // was being treated as / | 23:42 |
| *** thiagop has quit IRC | 23:42 | |
| notmorgan | clarkb: aye. that was what i was going to look at trying first | 23:42 |
| *** rcernin has quit IRC | 23:42 | |
| notmorgan | clarkb: it's odd in some versions of mod_rewrite to strip out extra trailing slashes elegantly | 23:42 |
| notmorgan | i remember having some odd issues with this in the past | 23:43 |
| notmorgan | where it just ... worked some places. | 23:43 |
| notmorgan | and then didn't other times. | 23:43 |
| *** tlian has quit IRC | 23:44 | |
| *** akshai_ has joined #openstack-infra | 23:45 | |
| *** akshai has quit IRC | 23:46 | |
| *** sridhar_ram1 has quit IRC | 23:46 | |
| openstackgerrit | Merged openstack-infra/puppet-gerrit: Allow puppet to configure 'Report Bug' in Gerrit UI. https://review.openstack.org/221388 | 23:50 |
| clarkb | greghaynes: I have reviewed the entire builder stack except for the last change | 23:51 |
| clarkb | I think we could try merging next week if someone else is able to review as well | 23:51 |
| *** apoorvad has joined #openstack-infra | 23:51 | |
| *** ccrouch has quit IRC | 23:51 | |
| mtreinish | nibalizer: is it still building? | 23:51 |
| jesusaurus | greghaynes: jeblair: for 246037 are you suggesting changing the variable names or just the statsd keys? | 23:52 |
| *** rbrndt has quit IRC | 23:52 | |
| *** otter768 has quit IRC | 23:53 | |
| * jesusaurus is tempted to change the variable names in another change and rebase on top of it | 23:53 | |
| *** gildub has quit IRC | 23:53 | |
| *** ccrouch has joined #openstack-infra | 23:54 | |
| nibalizer | mtreinish: yep | 23:55 |
| mtreinish | sigh, I wonder what it's doing | 23:57 |
| clarkb | building of course | 23:58 |
| *** sridhar_ram has joined #openstack-infra | 23:58 | |
| *** Swami has joined #openstack-infra | 23:59 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 23:59 | |
| pleia2 | hah | 23:59 |
| mtreinish | clarkb: haha | 23:59 |
| mtreinish | clarkb: it is supposed to be a backup/snapshot. I don't really think of building anything when I think of backing up | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!