| *** markvoelker has joined #openstack-infra | 00:00 | |
| *** r-daneel has quit IRC | 00:01 | |
| *** laughterwym has joined #openstack-infra | 00:02 | |
| *** mtanino has joined #openstack-infra | 00:03 | |
| tchaypo | is the data in the gitdm repo still used by anyone? | 00:03 |
|---|---|---|
| openstackgerrit | Merged openstack-infra/project-config: Add lbaasv1 api job to the check queue, non-voting https://review.openstack.org/187791 | 00:05 |
| *** xyang1 has quit IRC | 00:06 | |
| openstackgerrit | Arkadiy Kraminsky proposed openstack-infra/puppet-zuul: add notification for existing pidfile https://review.openstack.org/194449 | 00:07 |
| *** SumitNaiksatam has quit IRC | 00:09 | |
| *** yamamoto has joined #openstack-infra | 00:10 | |
| openstackgerrit | Merged openstack-infra/zuul: Don't send reports without any job https://review.openstack.org/188383 | 00:11 |
| *** ashleighfarnham has quit IRC | 00:12 | |
| *** Longgeek has joined #openstack-infra | 00:13 | |
| *** fallenpe_ has quit IRC | 00:13 | |
| *** esmute__ has quit IRC | 00:13 | |
| *** asettle has joined #openstack-infra | 00:15 | |
| *** puranamr has joined #openstack-infra | 00:15 | |
| *** fallenpegasus has joined #openstack-infra | 00:17 | |
| openstackgerrit | Kurt Taylor proposed openstack-infra/infra-specs: Host a CI monitoring dashboard service https://review.openstack.org/194437 | 00:19 |
| *** claudiub has joined #openstack-infra | 00:19 | |
| ianw | dstufft: if you have any thought on https://bugs.launchpad.net/devstack/+bug/1467569 i would be glad to hear it. python 2.7.9 on fedora includes the rewheel stuff, which makes python pkg dependent on python-pip | 00:20 |
| openstack | Launchpad bug 1467569 in devstack "f22: python-pip removal pull python too" [Undecided,New] | 00:20 |
| ianw | our old method of purging system python-pip packages therefore attempts to remove the world | 00:21 |
| dstufft | probably can't do that anymore | 00:21 |
| dstufft | since python-pip and python have circular dependencies | 00:22 |
| *** abitha has quit IRC | 00:24 | |
| ianw | dstufft: yeah, i got that far :) is "python -m ensurepip" in some ways a replacement for get-pip.py? or do we just have to use the system pip and that's it? | 00:25 |
| ianw | istr we got to this point as system packaged pip had issues, so we started grabbing the latest | 00:25 |
| *** Swami has quit IRC | 00:25 | |
| dstufft | ensurepip and get-pip.py are different in that ensurepip uses the bundled pip while get-pip.py pulls the latest from PyPI | 00:26 |
| ianw | dstufft: so you'd think that leaving python-pip package alone, and just calling get-pip.py is probably the right thing? | 00:27 |
| *** doude_ has joined #openstack-infra | 00:27 | |
| *** doude has quit IRC | 00:28 | |
| dstufft | I forgot to update it with the latest release (oops :|) but there is a PyPA COPR for the latest pip | 00:28 |
| dstufft | I need to automate that still | 00:28 |
| ianw | https://git.openstack.org/cgit/openstack-dev/devstack/tree/tools/install_pip.sh <- the right thing for this to do | 00:28 |
| *** jasondotstar has quit IRC | 00:29 | |
| *** jamielennox|away is now known as jamielennox | 00:29 | |
| dstufft | ianw: if I can figure out how to get some automation around it, the "Right" thing to do is probably: dnf copr enable pypa/pypa && yum update | 00:29 |
| dstufft | I guess I should probably figure out how to do a jenkins or get right with the idea of travis pushing releases | 00:31 |
| openstackgerrit | Kurt Taylor proposed openstack-infra/infra-specs: Host a CI monitoring dashboard service https://review.openstack.org/194437 | 00:32 |
| *** esker has quit IRC | 00:32 | |
| *** resker has joined #openstack-infra | 00:36 | |
| *** ociuhandu has quit IRC | 00:38 | |
| *** puranamr has quit IRC | 00:38 | |
| *** zz_dimtruck is now known as dimtruck | 00:39 | |
| ianw | dstufft: ok, is this a long way down your todo list? i think we just need to skip this on f22 at this point. | 00:40 |
| dstufft | ianw: I can manually release it now | 00:40 |
| *** mriedem has quit IRC | 00:43 | |
| *** nelsnelson has quit IRC | 00:44 | |
| *** Longgeek has quit IRC | 00:46 | |
| *** fallenpegasus has quit IRC | 00:47 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/project-config: Use DEVSTACK_GATE_SETTINGS in tempest-dsvm-cells job definition https://review.openstack.org/194410 | 00:47 |
| *** fallenpegasus has joined #openstack-infra | 00:49 | |
| ianw | dstufft: i'm not sure it matters right now, it's just those periods where we hit a bug and quickly need to get the latest version to get ci working again | 00:50 |
| dstufft | ianw: well I intended to make sure it was up to date | 00:50 |
| dstufft | I just forgot :) | 00:50 |
| *** nihilifer has quit IRC | 00:51 | |
| *** rlandy has quit IRC | 00:51 | |
| *** yamamoto has quit IRC | 00:52 | |
| lifeless | ok https://review.openstack.org/#/c/189250/ is green again | 00:52 |
| lifeless | but it needs https://review.openstack.org/#/c/194401/ reviewed | 00:53 |
| *** DericHorn-HP has joined #openstack-infra | 00:53 | |
| clarkb | the eplite table encoding conversion is now documebted updtream and we should expect a longish downtime to make that change | 00:53 |
| clarkb | unless mysqlers know how to make it faster | 00:53 |
| *** bradjones has quit IRC | 00:54 | |
| *** dims has quit IRC | 00:55 | |
| openstackgerrit | Merged openstack-infra/zuul: Check that empty reports aren't sent https://review.openstack.org/191588 | 00:56 |
| *** dims has joined #openstack-infra | 00:57 | |
| *** bradjones has joined #openstack-infra | 00:59 | |
| *** bradjones has quit IRC | 00:59 | |
| *** bradjones has joined #openstack-infra | 00:59 | |
| *** puranamr has joined #openstack-infra | 00:59 | |
| *** resker has quit IRC | 01:00 | |
| *** yamamoto has joined #openstack-infra | 01:02 | |
| *** dboik has joined #openstack-infra | 01:02 | |
| *** puranamr has quit IRC | 01:04 | |
| dstufft | ianw: ok, they are building and will be live in a bit | 01:06 |
| dstufft | ianw: https://copr.fedoraproject.org/coprs/pypa/pypa/builds/ | 01:06 |
| *** bradjones has quit IRC | 01:07 | |
| *** dboik has quit IRC | 01:07 | |
| *** esmute__ has joined #openstack-infra | 01:07 | |
| *** bradjones has joined #openstack-infra | 01:09 | |
| *** bradjones has quit IRC | 01:09 | |
| *** bradjones has joined #openstack-infra | 01:09 | |
| *** esker has joined #openstack-infra | 01:10 | |
| *** yamamoto has quit IRC | 01:10 | |
| *** esmute__ has quit IRC | 01:11 | |
| clarkb | https://github.com/ether/etherpad-lite/wiki/How-to-use-Etherpad-Lite-with-MySQL documents the table conversion and seems to indicate the etherpad lite isn't going to do db migrations properly for us (at least not yet) | 01:14 |
| *** esmute__ has joined #openstack-infra | 01:14 | |
| *** Longgeek has joined #openstack-infra | 01:15 | |
| *** jasondotstar has joined #openstack-infra | 01:15 | |
| *** Kennan has quit IRC | 01:16 | |
| *** Kennan has joined #openstack-infra | 01:16 | |
| *** esker has quit IRC | 01:17 | |
| *** stevemar has joined #openstack-infra | 01:19 | |
| *** cing has joined #openstack-infra | 01:21 | |
| *** patrickeast has quit IRC | 01:23 | |
| *** esmute__ has quit IRC | 01:24 | |
| *** sdake has joined #openstack-infra | 01:24 | |
| *** asselin_ has joined #openstack-infra | 01:26 | |
| *** esker has joined #openstack-infra | 01:27 | |
| *** sdake_ has joined #openstack-infra | 01:27 | |
| *** shardy has quit IRC | 01:27 | |
| *** shardy has joined #openstack-infra | 01:28 | |
| *** sdake has quit IRC | 01:31 | |
| *** yamahata has quit IRC | 01:33 | |
| *** larainema has joined #openstack-infra | 01:34 | |
| *** asselin__ has joined #openstack-infra | 01:36 | |
| *** esmute__ has joined #openstack-infra | 01:36 | |
| *** esker has quit IRC | 01:37 | |
| *** asselin_ has quit IRC | 01:39 | |
| *** alexpilotti has quit IRC | 01:40 | |
| *** esmute__ has quit IRC | 01:40 | |
| lifeless | fungi: https://review.openstack.org/#/c/194401/ is what needs approved next | 01:42 |
| *** SumitNaiksatam has joined #openstack-infra | 01:42 | |
| *** esmute__ has joined #openstack-infra | 01:44 | |
| *** otter768 has joined #openstack-infra | 01:44 | |
| *** asettle has quit IRC | 01:44 | |
| *** yamamoto has joined #openstack-infra | 01:46 | |
| *** esmute__ has quit IRC | 01:47 | |
| *** otter768 has quit IRC | 01:49 | |
| *** esmute__ has joined #openstack-infra | 01:49 | |
| *** julim has quit IRC | 01:53 | |
| *** sdake_ has quit IRC | 01:58 | |
| *** sqchen has joined #openstack-infra | 01:58 | |
| *** hdd has joined #openstack-infra | 01:58 | |
| *** sdake has joined #openstack-infra | 01:58 | |
| *** esmute__ has quit IRC | 01:58 | |
| *** esmute__ has joined #openstack-infra | 01:59 | |
| sqchen | anybody here can help with configuing gate job for horizon? | 02:00 |
| clarkb | sqchen: usually best to just ask then we can chime in as able | 02:01 |
| clarkb | lifeless: that particular change did fail a test and got a -1, not sure if related to change though | 02:02 |
| *** unicell1 has quit IRC | 02:02 | |
| lifeless | clarkb: its not related | 02:03 |
| lifeless | clarkb: flaky test in kilo | 02:03 |
| lifeless | clarkb: elastic-recheck spotted it and I've rechecked it | 02:03 |
| clarkb | lifeless: as far as the change goes it looks like its just code move and we still install pbr to that venv | 02:03 |
| clarkb | so I don't grok the diff + commit message | 02:04 |
| lifeless | clarkb: see, thats why bash is a bad language | 02:04 |
| lifeless | clarkb: the variable scope is moved out of the function | 02:04 |
| clarkb | :) | 02:04 |
| *** claudiub has quit IRC | 02:04 | |
| clarkb | oh is PIP_VIRTUAL_ENV a thing pip uses directly? | 02:04 |
| clarkb | affecting the later pip runs | 02:05 |
| lifeless | clarkb: yup | 02:05 |
| clarkb | gotcha | 02:05 |
| lifeless | state is nasty | 02:05 |
| lifeless | bbiab | 02:05 |
| clarkb | I have no +2 but gave you a +1 | 02:07 |
| *** tlian has joined #openstack-infra | 02:07 | |
| *** sdake has quit IRC | 02:07 | |
| lifeless | thank you! | 02:10 |
| *** tjones1 has quit IRC | 02:10 | |
| *** patrickeast has joined #openstack-infra | 02:14 | |
| *** ddieterly has joined #openstack-infra | 02:16 | |
| *** jerryz has quit IRC | 02:20 | |
| openstackgerrit | Khai Do proposed stackforge/python-jenkins: WIP: support scriptText api to execute groovy scripts on the server https://review.openstack.org/194468 | 02:24 |
| openstackgerrit | Khai Do proposed stackforge/python-jenkins: Support scriptText api to execute groovy scripts on the server https://review.openstack.org/194468 | 02:26 |
| *** DericHorn-HP has quit IRC | 02:30 | |
| *** sqchen has quit IRC | 02:31 | |
| *** sqchen has joined #openstack-infra | 02:33 | |
| *** dims has quit IRC | 02:36 | |
| *** DericHorn-HP has joined #openstack-infra | 02:39 | |
| *** fallenpegasus has quit IRC | 02:42 | |
| *** fallenpegasus has joined #openstack-infra | 02:44 | |
| *** AzherKhan has joined #openstack-infra | 02:47 | |
| *** jasondotstar has quit IRC | 02:47 | |
| *** fallenpegasus has quit IRC | 02:47 | |
| openstackgerrit | liusheng proposed openstack/requirements: Bump oslo.messaging to greater than or equal to 1.11.0 https://review.openstack.org/194475 | 02:48 |
| *** sqchen has quit IRC | 02:51 | |
| *** asettle has joined #openstack-infra | 02:51 | |
| *** sqchen has joined #openstack-infra | 02:51 | |
| *** Longgeek has quit IRC | 02:55 | |
| *** juggler has quit IRC | 02:56 | |
| *** juggler has joined #openstack-infra | 02:57 | |
| *** DericHorn-HP has quit IRC | 02:57 | |
| *** hdd has quit IRC | 02:57 | |
| *** bdemers has joined #openstack-infra | 02:57 | |
| *** puranamr has joined #openstack-infra | 02:58 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/infra-specs: Spec for diskimage-builder image caching https://review.openstack.org/194477 | 02:59 |
| ianw | greghaynes: ^ not sure about where to store the images, nodepool host seems fine but others probably disagree | 03:00 |
| *** arxcruz has quit IRC | 03:02 | |
| *** puranamr has quit IRC | 03:05 | |
| *** puranamr has joined #openstack-infra | 03:05 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/infra-specs: Spec for diskimage-builder image caching https://review.openstack.org/194477 | 03:06 |
| *** tlian has quit IRC | 03:16 | |
| *** tlian has joined #openstack-infra | 03:17 | |
| *** ivar-laz_ has joined #openstack-infra | 03:19 | |
| *** erlon has quit IRC | 03:20 | |
| *** jogo has joined #openstack-infra | 03:22 | |
| *** Longgeek has joined #openstack-infra | 03:23 | |
| *** ivar-lazzaro has quit IRC | 03:23 | |
| *** ctlaugh has quit IRC | 03:23 | |
| *** ivar-laz_ has quit IRC | 03:24 | |
| *** achanda has joined #openstack-infra | 03:25 | |
| *** sdake has joined #openstack-infra | 03:25 | |
| *** sdake_ has joined #openstack-infra | 03:27 | |
| *** prometheanfire has joined #openstack-infra | 03:27 | |
| prometheanfire | so, about getting something into disk-image-builder... | 03:28 |
| prometheanfire | I'm generating stage4 images for making my openstack qcow2 files | 03:28 |
| greghaynes | ianw: hrm, I wonder if we could use dib itself to cache the images...d | 03:29 |
| prometheanfire | I could publish them officially for gentoo probably | 03:29 |
| * prometheanfire is infra there | 03:29 | |
| greghaynes | prometheanfire: fun | 03:29 |
| prometheanfire | all that would be needed is to run the last half of this script I think, which might make my 'disk image builder thing' the easiest distro. https://github.com/prometheanfire/gentoo-cloud-prep/blob/master/03-prep-that-image.sh | 03:30 |
| prometheanfire | gonna look into it by the 7th, hopefully have a review in by then | 03:30 |
| greghaynes | prometheanfire: yep, so that sould be super easy - check out root.d on http://docs.openstack.org/developer/diskimage-builder/developer/developing_elements.html#phase-subdirectories | 03:31 |
| greghaynes | prometheanfire: basically you just have to generate your base rootfs in a dir passed in by an environment var | 03:31 |
| prometheanfire | then I can tell people to test openstack (non-voting) on gentoo, that's a stretch :P | 03:31 |
| *** sdake has quit IRC | 03:31 | |
| *** sdake__ has joined #openstack-infra | 03:31 | |
| *** fedexo has joined #openstack-infra | 03:32 | |
| prometheanfire | ya, all my stuff would be outside chroot too, since that's done by catalyst on gentoo's infra | 03:32 |
| greghaynes | prometheanfire: heh, well I would be happy to accept a DIB test to gate on gentoo image builds passing | 03:32 |
| greghaynes | so, thats a start ;) | 03:32 |
| *** bdemers has quit IRC | 03:32 | |
| prometheanfire | heh | 03:33 |
| *** bdemers has joined #openstack-infra | 03:33 | |
| *** bdemers has quit IRC | 03:34 | |
| prometheanfire | oddly, I think that getting an 'offical' openstack gentoo image thing is going to be easier then getting an on gentoo's side | 03:34 |
| prometheanfire | the stage4's are all in catalyst, so that meets with the reqs of gentoo-infra | 03:34 |
| *** bdemers has joined #openstack-infra | 03:34 | |
| prometheanfire | the qcow2 stuff catalyst can't do that I know of | 03:34 |
| prometheanfire | so I can't make those official yet | 03:34 |
| jeblair | oregon/washington/new york peeps: there's a strong geomagnetic storm; you might be able to see the aurora. http://www.swpc.noaa.gov/ | 03:35 |
| prometheanfire | wish I was that far north :( | 03:35 |
| davidlenwell | yeah .. nothing from the bay area.. boo | 03:35 |
| *** sdake_ has quit IRC | 03:35 | |
| greghaynes | oooo | 03:36 |
| greghaynes | when it eventally gets dark here, that is | 03:36 |
| crinkle | oooh | 03:37 |
| prometheanfire | nothing in satx, but that's a given | 03:37 |
| *** DericHorn-HP has joined #openstack-infra | 03:38 | |
| *** DericHorn-HP has quit IRC | 03:38 | |
| *** achanda has quit IRC | 03:39 | |
| tonyb | jhesketh: ping? | 03:39 |
| greghaynes | ianw: so crazy idea maybe - What if we make some tooling that does preemptive caching for a set of elements and we run that for the set of DIB elements we are building for, we then rsync the cache dir up to a mirror location and also have a tool that will export the proper source-repository overrides to direct downloads at the mirror | 03:40 |
| *** larainema has quit IRC | 03:40 | |
| greghaynes | ianw: should be doable with the information in elements already, and then we dont have to write out any new info on what files we want to mirror | 03:40 |
| *** laughterwym has quit IRC | 03:40 | |
| prometheanfire | greghaynes: signed? don't like plaintext :P | 03:41 |
| greghaynes | prometheanfire: well, this isnt for public consumption | 03:41 |
| greghaynes | https://review.openstack.org/#/c/194477/1/specs/dib-image-cache.rst | 03:42 |
| jroll | jeblair: too far north for the bay? :( | 03:42 |
| prometheanfire | as long as it doesn't traverse the public internet then fine, if it traverses the net... | 03:42 |
| *** laughterwym has joined #openstack-infra | 03:43 | |
| *** asselin__ has quit IRC | 03:43 | |
| *** harlowja has quit IRC | 03:43 | |
| *** tlian has quit IRC | 03:44 | |
| *** otter768 has joined #openstack-infra | 03:45 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: experiment upgrade job with beaker https://review.openstack.org/194293 | 03:45 |
| jhesketh | tonyb: pong | 03:46 |
| *** coolsvap|away is now known as coolsvap | 03:47 | |
| tonyb | Do you have time to help me work out why files that should be published to eavesdrop.o.o aren't? | 03:47 |
| tonyb | jhesketh: my current theories are a) they are but there is a ServerAlias hiding them ; or b) they're not being uploaded beacuse the scp publisher needs a '-r' flag | 03:48 |
| tonyb | jhesketh: of course I could be on crack and I really doubt that option 2 is it .... | 03:48 |
| *** spzala has quit IRC | 03:48 | |
| jhesketh | tonyb: do you have a link to the publish job(s)? | 03:50 |
| greghaynes | ianw: replied on spec, sorry if its a bit hard to parse | 03:50 |
| tonyb | jhesketh: I can. (assuming I'm looking at the right thing | 03:50 |
| *** otter768 has quit IRC | 03:50 | |
| tonyb | jhesketh: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/infra.yaml#n119 | 03:51 |
| *** ddieterly has quit IRC | 03:51 | |
| tonyb | jhesketh: in review: https://review.openstack.org/#/c/193123/ we added a 'calendars' directory that we need along with *.ics and *.html | 03:52 |
| jhesketh | tonyb: err sorry, I meant in jenkins | 03:52 |
| tonyb | jhesketh: Umm I don't know how to get that. | 03:52 |
| tonyb | jhesketh: I can link to the output from the Jenkins gate job. | 03:52 |
| tonyb | jhesketh: http://logs.openstack.org/23/193123/1/gate/gate-irc-meetings-tox-ical/b4dad66/ | 03:53 |
| tonyb | but I'm sure that's not what you mean | 03:53 |
| jhesketh | ah right, it's in the post queue | 03:53 |
| tonyb | jhesketh: feel free to tell me how to find the thing you *actually* want | 03:53 |
| * tonyb likes to learn | 03:54 | |
| *** abitha has joined #openstack-infra | 03:54 | |
| jhesketh | tonyb: so I'm not sure if there's a better way, but because the output isn't published anywhere (well other than the final scp location) you have to visit each jenkins0[1-7].o.o to find recent irc-meetings-publish runs | 03:54 |
| jhesketh | which I'm doing currently | 03:55 |
| tonyb | jhesketh: okay your start at j1, I'll start a j7 and meet you in the middle | 03:55 |
| jhesketh | heh | 03:56 |
| jhesketh | this looks to be most recent: https://jenkins03.openstack.org/job/irc-meetings-publish/11/console | 03:56 |
| jhesketh | it appears to have worked | 03:57 |
| jhesketh | maybe I'll use my root powers for the first time to take a look! | 03:57 |
| tonyb | jhesketh: it uploaded the files but not the dir | 03:57 |
| tonyb | if I read the last 5 lines correctly | 03:57 |
| jhesketh | tonyb: right, but the index.html also still links to meetings, not calendars | 03:57 |
| *** larainema has joined #openstack-infra | 03:58 | |
| tonyb | jhesketh: No. | 03:58 |
| tonyb | http://eavesdrop.openstack.org/calendars/akanda-team-meeting.ics | 03:58 |
| tonyb | jhesketh: and from the URL you gave me: 2015-06-22 04:08:32.477 | /home/jenkins/workspace/irc-meetings-publish$ /home/jenkins/workspace/irc-meetings-publish/.tox/ical/bin/yaml2ical -y meetings -i output/calendars/ -f" | 03:59 |
| *** Longgeek has quit IRC | 04:00 | |
| *** Longgeek has joined #openstack-infra | 04:00 | |
| jhesketh | tonyb: that's correct isn't it? | 04:02 |
| *** harlowja_at_home has joined #openstack-infra | 04:02 | |
| tonyb | Yeah they build job seems okay and the generated index.html points to the correct calendars/*.ics but that dir isn't accessable from here | 04:03 |
| *** david-lyle_ has quit IRC | 04:03 | |
| tonyb | jhesketh: I may be talking in circles | 04:04 |
| *** jamespage has quit IRC | 04:05 | |
| *** gnuoy has quit IRC | 04:05 | |
| jhesketh | tonyb: the index.html on eavesdrop has a mod time the same as the upload | 04:05 |
| jhesketh | but contains 'meetings' in the url | 04:05 |
| jhesketh | tonyb: actually so does http://logs.openstack.org/23/193123/1/gate/gate-irc-meetings-tox-ical/b4dad66/site-index.html | 04:05 |
| *** gnuoy has joined #openstack-infra | 04:06 | |
| *** jamespage has joined #openstack-infra | 04:06 | |
| jhesketh | tonyb: actually, does the job use a different template to that in the irc-meetings folder | 04:06 |
| * jhesketh thinks it does | 04:06 | |
| tonyb | jhesketh: hang on. Where are you seeing meetings in the URL? | 04:06 |
| tonyb | jhesketh: I don't see that here at all | 04:06 |
| jhesketh | tonyb: nevermind, I'm looking in the wrong spot | 04:07 |
| jhesketh | tonyb: on the bright side, it just looks like the calendars aren't being uploaded? | 04:08 |
| jhesketh | ie the folder | 04:08 |
| tonyb | jhesketh: okay. | 04:08 |
| tonyb | wow so my option 2 was correct | 04:08 |
| tonyb | jhesketh: can I add 'recurse: yes' or somethign similar to the yaml I posed befoer? | 04:08 |
| tonyb | jhesketh: where can I see the options that the scp publisher takes? | 04:09 |
| jhesketh | tonyb: likely, yes | 04:09 |
| jhesketh | tonyb: look for other jobs or at the jenkins plugin | 04:09 |
| * jhesketh looks too | 04:09 | |
| *** unicell has joined #openstack-infra | 04:09 | |
| tonyb | jhesketh: keep-hierarchy: true ? | 04:11 |
| *** dimtruck is now known as zz_dimtruck | 04:11 | |
| jhesketh | tonyb: I /think/ that'll make it upload 'output' into a folder called 'output' | 04:13 |
| tonyb | jhesketh: okay | 04:13 |
| jhesketh | tonyb: it's odd though, because I assume the job was working before and uploading the icals? | 04:14 |
| *** mtanino has quit IRC | 04:15 | |
| tonyb | jhesketh: no it was uploading *the* ical (that has all the meetings in it) but not the individual icals | 04:15 |
| tonyb | jhesketh: that's a 'recent' change | 04:15 |
| *** jogo has quit IRC | 04:16 | |
| tonyb | jhesketh: we /could/ just put the icals in the / with the index.html but that's gross | 04:16 |
| jhesketh | tonyb: so I think we need to do something like http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/macros.yaml#n662 | 04:18 |
| jhesketh | where we need the ** to make it recursive | 04:18 |
| *** abitha has quit IRC | 04:18 | |
| jhesketh | tonyb: and I think we do need keep-hierarchy as it'll apply to the ** part (looking at the output of a dsvm job) | 04:19 |
| *** mestery has joined #openstack-infra | 04:19 | |
| tonyb | jhesketh: I was just going to ask you that after relising that the scp plugin wan't something "we" write | 04:19 |
| *** kaisers has quit IRC | 04:19 | |
| tonyb | jhesketh: So how can I test this? | 04:19 |
| *** jogo has joined #openstack-infra | 04:20 | |
| jhesketh | tonyb: with difficulty... it'd probably involve setting up a jenkins to test on | 04:21 |
| tonyb | jhesketh: Umm yeah, Well I suppose I'll just write up the problem and suggest a patch and see where the review leads me. | 04:21 |
| jhesketh | tonyb: we could make the gate job scp its results to the static log server like it used to before we started uploading the swift | 04:21 |
| *** kaisers has joined #openstack-infra | 04:22 | |
| jhesketh | tonyb: fungi setup the scp dest so he probably knows more about it :-) | 04:22 |
| *** sdake__ has quit IRC | 04:24 | |
| *** ildikov has quit IRC | 04:24 | |
| *** ParsectiX has joined #openstack-infra | 04:25 | |
| tonyb | jhesketh: okay. We'll see what he says overnight. | 04:25 |
| jhesketh | cheers | 04:28 |
| *** Longgeek has quit IRC | 04:29 | |
| *** sqchen has left #openstack-infra | 04:32 | |
| *** harlowja_at_home has quit IRC | 04:32 | |
| *** Longgeek has joined #openstack-infra | 04:32 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/project-config: Have irc-meetings-publish also publish directories https://review.openstack.org/194488 | 04:35 |
| tonyb | jhesketh: ^^ | 04:35 |
| *** puranamr has quit IRC | 04:38 | |
| ianw | greghaynes: i was thinking to minimize the downloading every time | 04:39 |
| *** husanu has quit IRC | 04:39 | |
| *** husanu has joined #openstack-infra | 04:41 | |
| greghaynes | ianw: yes, we should be able to do the same amount of downloads either way - im thinking just do the source-repositories parts, not a full dib run | 04:41 |
| *** hdd has joined #openstack-infra | 04:42 | |
| *** bdemers has quit IRC | 04:44 | |
| *** bdemers has joined #openstack-infra | 04:45 | |
| ianw | greghaynes: ok, source-repositories is a new one for me ... do you mean we port builds to use that element to get their qcows? | 04:46 |
| *** yfried__ has quit IRC | 04:48 | |
| *** linkedinyou has quit IRC | 04:49 | |
| *** mestery has quit IRC | 04:49 | |
| *** husanu has quit IRC | 04:50 | |
| *** shardy has quit IRC | 04:51 | |
| *** shardy has joined #openstack-infra | 04:51 | |
| *** husanu has joined #openstack-infra | 04:52 | |
| *** ddieterly has joined #openstack-infra | 04:52 | |
| greghaynes | ianw: yes. right now theres not a consistent way to override images that are used for the distro elements, so im thinking we make that consistent, then just use the same tooling dib uses to download images to mirror and override them | 04:56 |
| greghaynes | and in theory source-repositories should be able to do that for us | 04:56 |
| *** ddieterly has quit IRC | 04:56 | |
| ianw | ok, yeah at the moment things use "cache-url" to grab the url they construct in some way | 04:57 |
| ianw | i guess also having the images mirrored in one place only partially solves the issue -- it stops us hitting upstream mirrors, but if the mirror is on rax we still have the connectivity issue to hp | 04:58 |
| ianw | so like pypi we probably need per region mirrors | 04:58 |
| *** puranamr has joined #openstack-infra | 04:58 | |
| greghaynes | yea, and then well want some smart logic for how were overriding url's rather than a static list of resource -> env var we need to set | 04:59 |
| greghaynes | Ill play with making the distro elements use source-repositories so I can try and remember what the issues are around that | 05:00 |
| *** asettle has quit IRC | 05:00 | |
| *** bhunter71 has quit IRC | 05:00 | |
| *** husanu has quit IRC | 05:01 | |
| ianw | greghaynes: so do you think we should repurpose the pypi mirror into a more generic "devel" or "ci" mirror | 05:01 |
| *** unicell1 has joined #openstack-infra | 05:02 | |
| *** husanu has joined #openstack-infra | 05:03 | |
| ianw | maybe we want some other type of mirror too, and it seems 95% of the infrastructure in terms of puppet setup, etc, are the same | 05:03 |
| greghaynes | hrm, it does seem like all of that should be in the same place, it is going to scale out in the same way | 05:03 |
| *** puranamr has quit IRC | 05:03 | |
| *** sabeen2 has joined #openstack-infra | 05:03 | |
| *** unicell has quit IRC | 05:04 | |
| *** sabeen has quit IRC | 05:05 | |
| *** krtaylor has quit IRC | 05:05 | |
| *** flwang has quit IRC | 05:05 | |
| *** armax has joined #openstack-infra | 05:08 | |
| *** zz_dimtruck is now known as dimtruck | 05:11 | |
| *** boris-42 has quit IRC | 05:12 | |
| *** ParsectiX has quit IRC | 05:18 | |
| *** woodster_ has quit IRC | 05:21 | |
| *** deepakcs has joined #openstack-infra | 05:22 | |
| *** dimtruck is now known as zz_dimtruck | 05:22 | |
| *** alexsyip has joined #openstack-infra | 05:23 | |
| *** patrickeast has quit IRC | 05:23 | |
| *** patrickeast has joined #openstack-infra | 05:24 | |
| *** hdd has quit IRC | 05:24 | |
| *** krtaylor has joined #openstack-infra | 05:24 | |
| *** sabeen2 has quit IRC | 05:27 | |
| *** alexsyip has quit IRC | 05:28 | |
| *** nikil89_ has joined #openstack-infra | 05:31 | |
| *** fawadkhaliq has joined #openstack-infra | 05:38 | |
| *** enikanorov2 has joined #openstack-infra | 05:39 | |
| *** abregman has joined #openstack-infra | 05:39 | |
| *** ildikov has joined #openstack-infra | 05:41 | |
| *** larainema has quit IRC | 05:41 | |
| *** larainema has joined #openstack-infra | 05:41 | |
| * larainema | 05:41 | |
| jhesketh | tonyb: thanks for that patch, small nit that I'd like fixed if possible though please | 05:45 |
| *** otter768 has joined #openstack-infra | 05:46 | |
| openstackgerrit | Wayne Warren proposed openstack-infra/infra-specs: Add JJB DSL Roadmap spec. https://review.openstack.org/194497 | 05:46 |
| openstackgerrit | Tony Breeds proposed openstack-infra/project-config: Have irc-meetings-publish also publish directories https://review.openstack.org/194488 | 05:47 |
| *** fedexo has quit IRC | 05:47 | |
| openstackgerrit | David Lenwell proposed openstack-infra/infra-specs: Spec to host refstack.org in infra https://review.openstack.org/188207 | 05:48 |
| *** otter768 has quit IRC | 05:51 | |
| *** yfried__ has joined #openstack-infra | 05:52 | |
| *** larainema has quit IRC | 05:53 | |
| *** ddieterly has joined #openstack-infra | 05:53 | |
| *** salv-orlando has joined #openstack-infra | 05:54 | |
| *** mrmartin has joined #openstack-infra | 05:54 | |
| *** stevemar has quit IRC | 05:54 | |
| *** stevemar has joined #openstack-infra | 05:54 | |
| *** larainema_ has joined #openstack-infra | 05:55 | |
| *** larainema has joined #openstack-infra | 05:55 | |
| *** patrickeast has quit IRC | 05:56 | |
| *** husanu has quit IRC | 05:56 | |
| *** salv-orlando has quit IRC | 05:56 | |
| *** husanu has joined #openstack-infra | 05:58 | |
| *** ddieterly has quit IRC | 05:58 | |
| *** salv-orlando has joined #openstack-infra | 05:58 | |
| tonyb | jhesketh: fixed | 05:59 |
| tonyb | jhesketh: Well changed I wasn't game to remove it altogether. Only because you seemed unsure. | 05:59 |
| jhesketh | tonyb: heh, I was a little, but lgtm | 06:00 |
| openstackgerrit | David Lenwell proposed openstack-infra/infra-specs: Spec to host refstack.org in infra https://review.openstack.org/188207 | 06:00 |
| tonyb | jhesketh: \o/ | 06:00 |
| tonyb | if this lands I will have earned by "infra badge" | 06:00 |
| *** laughterwym_ has joined #openstack-infra | 06:03 | |
| *** laughterwym has quit IRC | 06:05 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/system-config: Symlink yaml2ical calendar folder to apache dir https://review.openstack.org/194504 | 06:08 |
| jhesketh | tonyb: I noticed ^ would also be needed | 06:08 |
| tonyb | jhesketh: Ahh okay that makes sense. | 06:10 |
| *** stevemar2 has joined #openstack-infra | 06:10 | |
| tonyb | jhesketh: Thanks for digging more into it. | 06:11 |
| *** Kennan has quit IRC | 06:11 | |
| *** Kennan2 has joined #openstack-infra | 06:11 | |
| jhesketh | no trouble :-) | 06:12 |
| *** stevemar has quit IRC | 06:12 | |
| *** yamada-h has joined #openstack-infra | 06:12 | |
| *** _nadya_ has joined #openstack-infra | 06:14 | |
| *** mohankumar has joined #openstack-infra | 06:15 | |
| *** hichihara has quit IRC | 06:15 | |
| *** stevemar2 is now known as stevemar | 06:17 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/infra-specs: Spec for diskimage-builder image caching https://review.openstack.org/194477 | 06:19 |
| *** yamada-h has quit IRC | 06:20 | |
| *** yamada-h has joined #openstack-infra | 06:20 | |
| *** yamada-h has quit IRC | 06:22 | |
| *** nikil89_ is now known as naggappan | 06:23 | |
| *** mrmartin has quit IRC | 06:24 | |
| *** mrmartin has joined #openstack-infra | 06:26 | |
| *** mrunge has joined #openstack-infra | 06:31 | |
| *** ParsectiX has joined #openstack-infra | 06:34 | |
| *** dtantsur|afk is now known as dtantsur | 06:36 | |
| *** k4n0 has joined #openstack-infra | 06:37 | |
| *** ihrachyshka has joined #openstack-infra | 06:38 | |
| *** mrmartin has quit IRC | 06:39 | |
| *** markvoelker has quit IRC | 06:40 | |
| tchaypo | looking at the graphite graphs for the stable jobs, some of them only ever seem to have had success | 06:41 |
| *** kushal has joined #openstack-infra | 06:46 | |
| tchaypo | for instance, stats.zuul.pipeline.periodic-stable.job.periodic-ceilometer-python27-havana | 06:47 |
| *** armax has quit IRC | 06:49 | |
| *** jtomasek has joined #openstack-infra | 06:49 | |
| *** fallenpegasus has joined #openstack-infra | 06:51 | |
| *** mmedvede has quit IRC | 06:53 | |
| Kennan2 | hi tchaypo | 06:53 |
| *** Kennan2 is now known as Kennan | 06:53 | |
| *** kushal has quit IRC | 06:54 | |
| *** ddieterly has joined #openstack-infra | 06:54 | |
| *** fawadkhaliq has quit IRC | 06:55 | |
| *** mpaolino has joined #openstack-infra | 06:55 | |
| Kennan | lifeless there? | 06:55 |
| *** fawadkhaliq has joined #openstack-infra | 06:55 | |
| *** Longgeek_ has joined #openstack-infra | 06:56 | |
| *** kushal has joined #openstack-infra | 06:56 | |
| *** ddieterly has quit IRC | 06:58 | |
| *** Longgeek has quit IRC | 06:59 | |
| *** yfried__ has quit IRC | 07:01 | |
| *** Ala has joined #openstack-infra | 07:01 | |
| lifeless | Kennan: hi | 07:02 |
| *** macjack has quit IRC | 07:03 | |
| Kennan | hi lifeless do you know anything about build atomic image in infra? | 07:03 |
| Kennan | this https://fedorapeople.org/groups/ have some images, Our atomic image is old, I am trying to find ways to how to build that | 07:04 |
| lifeless | Kennan: I don't, sorry. | 07:05 |
| lifeless | Kennan: I know they exist is about all | 07:05 |
| Kennan | OK lifeless anyone here know about fedora atomic image? | 07:05 |
| *** yfried__ has joined #openstack-infra | 07:06 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-iptables: Support side-loading iptables rules https://review.openstack.org/193847 | 07:07 |
| lifeless | Kennan: some of the fedora folk might | 07:08 |
| *** laughterwym has joined #openstack-infra | 07:09 | |
| *** jlanoux has joined #openstack-infra | 07:10 | |
| *** shardy has quit IRC | 07:11 | |
| *** shardy has joined #openstack-infra | 07:11 | |
| *** laughterwym_ has quit IRC | 07:12 | |
| Kennan | yes, I am not sure where can find them. lifeless :) | 07:12 |
| *** sshnaidm has joined #openstack-infra | 07:13 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/project-config: Create a puppet module for os_client_config https://review.openstack.org/188895 | 07:13 |
| *** sergmelikyan has joined #openstack-infra | 07:13 | |
| *** HeOS has quit IRC | 07:13 | |
| lifeless | Kennan: perhaps in a fedora channel ? | 07:18 |
| *** samuelBartel has joined #openstack-infra | 07:19 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Alpha-sort modules.env https://review.openstack.org/191245 | 07:20 |
| openstackgerrit | Spencer Krum proposed openstack-infra/project-config: Add beaker-localhost and beaker-nodepool hypervisors https://review.openstack.org/185754 | 07:21 |
| openstackgerrit | Fatih Degirmenci proposed openstack-infra/jenkins-job-builder: Add Google Cloud Storage Plugin support https://review.openstack.org/192397 | 07:22 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Bring in module to manage update-alternatives https://review.openstack.org/171556 | 07:22 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Add puppet-community/archive module https://review.openstack.org/164569 | 07:22 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Load in nanliu/git module https://review.openstack.org/164355 | 07:22 |
| *** bexelbie has joined #openstack-infra | 07:24 | |
| openstackgerrit | Steve Kowalik proposed openstack-infra/project-config: Sprinke in Horizon translations for Zanata https://review.openstack.org/194525 | 07:25 |
| openstackgerrit | Steve Kowalik proposed openstack-infra/project-config: Sprinkle in Horizon translations for Zanata https://review.openstack.org/194525 | 07:26 |
| *** boris-42 has joined #openstack-infra | 07:32 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Set the openstack_project::users_install class to run in 'setup' stage https://review.openstack.org/161048 | 07:32 |
| *** cpallares has quit IRC | 07:33 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Use Puppet Stages to setup users first https://review.openstack.org/161048 | 07:33 |
| StevenK | AJaeger: I absolutely love your work WRT horizon and .pot files, thanks! | 07:34 |
| nibalizer | StevenK: what is your middle name | 07:34 |
| nibalizer | i just realized we have the same 2 letter intials | 07:34 |
| *** arxcruz has joined #openstack-infra | 07:35 | |
| StevenK | nibalizer: "Adam" | 07:36 |
| *** ihrachyshka has quit IRC | 07:37 | |
| *** cpallares has joined #openstack-infra | 07:37 | |
| *** salv-orl_ has joined #openstack-infra | 07:37 | |
| *** shardy has quit IRC | 07:38 | |
| *** shardy has joined #openstack-infra | 07:38 | |
| *** fawadkhaliq has quit IRC | 07:39 | |
| *** salv-orlando has quit IRC | 07:40 | |
| mrunge | Kennan, please ask at #fedora-devel | 07:40 |
| *** bexelbie_ has joined #openstack-infra | 07:41 | |
| *** dizquierdo has joined #openstack-infra | 07:41 | |
| *** markvoelker has joined #openstack-infra | 07:41 | |
| Kennan | yes mrunge Thanks asked not got response | 07:41 |
| mrunge | Kennan, it's a bit early for most folks there, please be patient, stay in the channel | 07:42 |
| mrunge | you also might ask in #fedora-cloud | 07:42 |
| mrunge | Kennan, if you didn't got an answer within the next 2-3 hours, please ping me | 07:42 |
| openstackgerrit | Spencer Krum proposed openstack-infra/project-config: Create a puppet module for os_client_config https://review.openstack.org/188895 | 07:42 |
| *** stevemar has quit IRC | 07:43 | |
| *** mpavone has joined #openstack-infra | 07:43 | |
| Kennan | OK mrunge Thanks | 07:43 |
| *** fawadkhaliq has joined #openstack-infra | 07:44 | |
| *** Hal has joined #openstack-infra | 07:44 | |
| *** Hal is now known as Guest60269 | 07:44 | |
| *** devvesa has joined #openstack-infra | 07:45 | |
| *** markvoelker has quit IRC | 07:46 | |
| *** linkedinyou has joined #openstack-infra | 07:46 | |
| *** otter768 has joined #openstack-infra | 07:47 | |
| *** markus_z has joined #openstack-infra | 07:47 | |
| *** chlong has quit IRC | 07:48 | |
| *** claudiub has joined #openstack-infra | 07:51 | |
| *** otter768 has quit IRC | 07:51 | |
| *** masayukig has quit IRC | 07:52 | |
| *** linkedinyou has quit IRC | 07:53 | |
| *** persia has quit IRC | 07:53 | |
| *** persia has joined #openstack-infra | 07:53 | |
| *** persia has quit IRC | 07:53 | |
| *** persia has joined #openstack-infra | 07:53 | |
| *** flepied1 has quit IRC | 07:54 | |
| *** masayukig has joined #openstack-infra | 07:54 | |
| *** cjwei has quit IRC | 07:55 | |
| *** ddieterly has joined #openstack-infra | 07:55 | |
| ttx | hmm, request timeouts on review.openstack.org ? | 07:58 |
| *** salv-orl_ has quit IRC | 07:58 | |
| ttx | hmm, it's back, ignore me | 07:59 |
| *** ddieterly has quit IRC | 07:59 | |
| *** salv-orlando has joined #openstack-infra | 08:00 | |
| *** claudiub has quit IRC | 08:00 | |
| mrunge | ttx, it's painful slow right now. | 08:00 |
| *** dtantsur is now known as dtantsur|brb | 08:01 | |
| dtantsur|brb | yeah, the same for me | 08:01 |
| *** mpaolino has quit IRC | 08:01 | |
| *** nfedotov has joined #openstack-infra | 08:01 | |
| *** mpaolino has joined #openstack-infra | 08:03 | |
| *** rossella_s has joined #openstack-infra | 08:04 | |
| *** u_glide has joined #openstack-infra | 08:05 | |
| *** claudiub has joined #openstack-infra | 08:05 | |
| u_glide | Is review.openstack.org alive? :) | 08:06 |
| AJaeger | StevenK: glad to hear! | 08:06 |
| *** claudiub|2 has joined #openstack-infra | 08:07 | |
| *** sshnaidm has quit IRC | 08:07 | |
| nfedotov | I can not open https://review.openstack.org/ either | 08:08 |
| nfedotov | Oh. it works now | 08:09 |
| *** hashar has joined #openstack-infra | 08:09 | |
| AJaeger | StevenK: I was really happy to get all these patches merged yesterday. | 08:10 |
| *** eezhova has quit IRC | 08:10 | |
| *** claudiub has quit IRC | 08:10 | |
| StevenK | AJaeger: Yeah, quite! \o/ | 08:10 |
| *** claudiub has joined #openstack-infra | 08:14 | |
| *** claudiub|2 has quit IRC | 08:16 | |
| *** fhubik has joined #openstack-infra | 08:16 | |
| lifeless | hi | 08:18 |
| lifeless | we've had multiple reports now of folk missing the 12.0.0a0 tag in their nova repos, accessed over https://git.openstack.org/ | 08:18 |
| *** sergmelikyan has quit IRC | 08:19 | |
| *** sshnaidm has joined #openstack-infra | 08:19 | |
| lifeless | I'm wondering if someone could check that its present in all the mirror hosts | 08:19 |
| lifeless | since a bad copy there would propogate the missingness | 08:20 |
| clarkb | anyone can check, http://git0X.openstack.org:8080/cgit/openstack/nova looks like 01 is missing it | 08:21 |
| lifeless | clarkb: thanks! | 08:21 |
| clarkb | a force replication may resolve it but tags are likely special so that may not be the case | 08:22 |
| lifeless | clarkb: fetch --tags will fix it | 08:22 |
| *** eezhova has joined #openstack-infra | 08:22 | |
| clarkb | but I need to pass out now because twins are sleeping but ya 01 is the only off node | 08:23 |
| lifeless | jhesketh: ready to exercise some root ? | 08:23 |
| *** sshnaidm has quit IRC | 08:24 | |
| *** fhubik is now known as fhubik_afk | 08:26 | |
| *** hashar has quit IRC | 08:28 | |
| *** hashar has joined #openstack-infra | 08:29 | |
| anteaya | clarkb: night clark, happy sleep | 08:29 |
| *** ihrachyshka has joined #openstack-infra | 08:30 | |
| *** hashar has quit IRC | 08:30 | |
| *** rossella_s has quit IRC | 08:30 | |
| *** rossella_s has joined #openstack-infra | 08:30 | |
| *** e0ne has joined #openstack-infra | 08:32 | |
| *** sergmelikyan has joined #openstack-infra | 08:32 | |
| *** larainema has quit IRC | 08:33 | |
| *** larainema_ is now known as larainema | 08:33 | |
| *** madong_ has joined #openstack-infra | 08:33 | |
| *** flepied has joined #openstack-infra | 08:34 | |
| *** flepied1 has joined #openstack-infra | 08:34 | |
| *** fhubik_afk is now known as fhubik | 08:35 | |
| *** linkedinyou has joined #openstack-infra | 08:35 | |
| *** hashar has joined #openstack-infra | 08:36 | |
| *** linkedinyou has quit IRC | 08:36 | |
| *** HeOS has joined #openstack-infra | 08:37 | |
| *** e0ne is now known as e0ne_ | 08:38 | |
| *** flepied has quit IRC | 08:39 | |
| *** yfried__ is now known as yfried|afk | 08:43 | |
| *** e0ne_ has quit IRC | 08:44 | |
| *** HeOS has quit IRC | 08:44 | |
| *** HeOS has joined #openstack-infra | 08:45 | |
| *** e0ne has joined #openstack-infra | 08:48 | |
| *** dguerri` is now known as dguerri | 08:48 | |
| openstackgerrit | James Page proposed openstack/os-testr: Misc Python 3 compatibility fixes https://review.openstack.org/194551 | 08:49 |
| *** yfried|afk is now known as yfried__ | 08:49 | |
| *** fallenpegasus has quit IRC | 08:50 | |
| *** pelix has joined #openstack-infra | 08:51 | |
| openstackgerrit | Steve Kowalik proposed openstack-infra/project-config: Sprinkle in Horizon translations for Zanata https://review.openstack.org/194525 | 08:51 |
| *** dtantsur|brb is now known as dtantsur | 08:51 | |
| *** hashar has quit IRC | 08:53 | |
| *** laughterwym has quit IRC | 08:54 | |
| *** shardy_ has joined #openstack-infra | 08:54 | |
| *** shardy has quit IRC | 08:55 | |
| *** fabo has quit IRC | 08:55 | |
| *** ddieterly has joined #openstack-infra | 08:55 | |
| *** hashar has joined #openstack-infra | 08:55 | |
| *** fabo has joined #openstack-infra | 08:57 | |
| *** cdent has joined #openstack-infra | 08:58 | |
| *** shardy_ has quit IRC | 09:00 | |
| *** ddieterly has quit IRC | 09:00 | |
| *** HeOS has quit IRC | 09:01 | |
| *** shardy has joined #openstack-infra | 09:01 | |
| jhesketh | lifeless: sure, what's up | 09:01 |
| *** HeOS has joined #openstack-infra | 09:02 | |
| lifeless | jhesketh: we have some tags that weren't mirrored properly | 09:02 |
| lifeless | on git01 | 09:02 |
| lifeless | https://storyboard.openstack.org/#!/story/2000300 | 09:02 |
| *** chen12 has joined #openstack-infra | 09:03 | |
| *** mpavone has quit IRC | 09:03 | |
| *** park__heijlong has joined #openstack-infra | 09:04 | |
| lifeless | jhesketh: so needs a log into the box and mirror the tags across; separately may want investigation into how etc etc | 09:04 |
| *** e0ne is now known as e0ne_ | 09:06 | |
| *** dtantsur is now known as dtantsur|brb | 09:07 | |
| ttx | seems to be git01-specific | 09:08 |
| lifeless | yes | 09:08 |
| lifeless | already been analysed :) | 09:08 |
| ttx | is git01 actually even part of the rotation ? | 09:08 |
| lifeless | would need to check haproxy's live config to know | 09:09 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Alpha-sort modules.env https://review.openstack.org/191245 | 09:09 |
| lifeless | but I would assume so since we got onto this from missing tag reports | 09:09 |
| *** juggler has quit IRC | 09:10 | |
| *** juggler_ has joined #openstack-infra | 09:10 | |
| jhesketh | should be part of the haxproxy | 09:10 |
| ttx | weird that it still gets regular commits :) Oh well | 09:11 |
| *** yfried__ is now known as yfried|afk | 09:11 | |
| *** e0ne_ has quit IRC | 09:11 | |
| *** yfried|afk is now known as yfried__ | 09:11 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Use Puppet Stages to setup users first https://review.openstack.org/161048 | 09:11 |
| openstackgerrit | Jens Rosenboom proposed openstack-infra/system-config: Change doc link to the parsed version for gerrit https://review.openstack.org/191724 | 09:13 |
| *** sergmelikyan has quit IRC | 09:14 | |
| *** yfried has joined #openstack-infra | 09:15 | |
| *** e0ne has joined #openstack-infra | 09:15 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/nodepool: Update nodepool to use secure.conf file https://review.openstack.org/189762 | 09:16 |
| *** fhubik is now known as fhubik_afk | 09:17 | |
| *** markvoelker has joined #openstack-infra | 09:17 | |
| jhesketh | lifeless: err, so those tags all appear to be there to me | 09:18 |
| *** yamahata has joined #openstack-infra | 09:18 | |
| jhesketh | is it possible they have gotten in sync since you filed the bug? | 09:18 |
| *** u_glide has quit IRC | 09:19 | |
| *** yfried__ has quit IRC | 09:19 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-nodepool: Add creation of secure.conf file https://review.openstack.org/188325 | 09:19 |
| lifeless | jhesketh: unless clarkb decided he had time... or our friendly russian sysadmin | 09:20 |
| *** fhubik_afk is now known as fhubik | 09:20 | |
| jhesketh | would have thought they'd weigh in... | 09:21 |
| jhesketh | lifeless: can you check if the tag(s) are there for you please | 09:21 |
| *** markvoelker has quit IRC | 09:22 | |
| AJaeger | Shit, just sent internal email to openstack-infra ;( | 09:22 |
| *** afazekas has joined #openstack-infra | 09:22 | |
| *** jcoufal has joined #openstack-infra | 09:23 | |
| *** afazekas has quit IRC | 09:23 | |
| *** afazekas has joined #openstack-infra | 09:24 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-jeepyb: Separate the fetch remotes log dir and file https://review.openstack.org/192187 | 09:24 |
| lifeless | AJaeger: whups | 09:24 |
| openstackgerrit | Thomas Bechtold proposed openstack-dev/pbr: Use string for 'OS_TEST_TIMEOUT' default https://review.openstack.org/194564 | 09:24 |
| *** mancdaz has quit IRC | 09:25 | |
| *** mancdaz has joined #openstack-infra | 09:25 | |
| *** ghostpl has joined #openstack-infra | 09:26 | |
| lifeless | jhesketh: so I see it in a fresh tag | 09:27 |
| lifeless | of horizon from 01 | 09:27 |
| lifeless | chen12: how did you test for thepresence/absence of the tags? | 09:27 |
| openstackgerrit | Fabien Boucher proposed openstack-infra/puppet-openstackci: Add generic zuul manifests https://review.openstack.org/175970 | 09:28 |
| *** fhubik is now known as fhubik_afk | 09:30 | |
| *** alexpilotti has joined #openstack-infra | 09:32 | |
| *** Alexandra_ has joined #openstack-infra | 09:34 | |
| *** rguillebert has joined #openstack-infra | 09:35 | |
| *** Alexandra_ has joined #openstack-infra | 09:35 | |
| *** jasondotstar has joined #openstack-infra | 09:37 | |
| openstackgerrit | Ruslan Kamaldinov proposed openstack/requirements: Add yaql https://review.openstack.org/193180 | 09:38 |
| Kennan | mrunge: there? | 09:40 |
| *** nihilifer_ has joined #openstack-infra | 09:40 | |
| mrunge | Kennan, yupp | 09:41 |
| openstackgerrit | Fabio Porcedda proposed openstack-infra/git-review: Add "-p"/"--pull" option to merge a change on the local branch https://review.openstack.org/194094 | 09:41 |
| Kennan | I got one echo, he gave me an example https://github.com/cgwalters/fedora-atomic-work/blob/master/fedora-atomic-base.json | 09:41 |
| Kennan | but I still not know what can follow for build new image for atomic | 09:41 |
| *** fhubik_afk is now known as fhubik | 09:42 | |
| Kennan | mrunge the http://www.projectatomic.io/blog/2014/08/build-your-own-atomic-centos-or-fedora/ have old information | 09:42 |
| Kennan | which is diffcult to follow | 09:42 |
| Kennan | do you know any better guide or link for ? mrunge: | 09:42 |
| *** laughterwym has joined #openstack-infra | 09:43 | |
| mrunge | Kennan, actually, I thought, you'd be asking in #fedora-cloud | 09:45 |
| Kiall | Just me or is gerrt down again? | 09:45 |
| mrunge | as that's the working group producing the images | 09:45 |
| Kennan | ok let me try if possible to get right echo there. thanks mrunge | 09:46 |
| mrunge | Kennan, have your seen this? http://community.redhat.com/blog/2014/12/fedora-21-fedora-goes-atomic/ | 09:46 |
| openstackgerrit | yogananth subramanian proposed openstack/diskimage-builder: Allow using local image for ubuntu https://review.openstack.org/194574 | 09:46 |
| *** nihilifer_ has quit IRC | 09:46 | |
| Kiall | Yep - Gerrit UI is down again - http://paste.openstack.org/show/316268/ - pings, but UI won't load | 09:46 |
| *** nihilifer has joined #openstack-infra | 09:47 | |
| *** tosky has joined #openstack-infra | 09:47 | |
| mrunge | Kennan, which basically means, you could get an image from here: https://getfedora.org/cloud/download/ | 09:47 |
| Kennan | hi mrunge: | 09:47 |
| mrunge | Kennan, sorry: this one: https://getfedora.org/cloud/download/atomic.html | 09:47 |
| *** otter768 has joined #openstack-infra | 09:48 | |
| *** marzif has joined #openstack-infra | 09:48 | |
| ekarlso | +1 Kiall gerrit is dead :p | 09:48 |
| Kennan | right now, we built our image on atomic(as fedora 21 atomci image not updated Since Dec 2014 for long time) | 09:48 |
| *** k4n0 has quit IRC | 09:48 | |
| Kennan | I found our new image (intergrated docker verison 1.5) is old | 09:48 |
| Kennan | I want to intergated with 1.6 version | 09:48 |
| Kennan | so I need to build a new image, that;s the reason I asked about how to build atomic image | 09:49 |
| Kennan | mrunge: I think we can not directly use fedora cloud image(21) which is old | 09:49 |
| HeOS | Hello, folks. review.openstack.org is unavailable now. :( | 09:49 |
| Kiall | yea, seems none of the infra folks are online / reading at the moment | 09:50 |
| *** nihilifer_ has joined #openstack-infra | 09:50 | |
| Kiall | "Proof" - since sdague didn't believe there was an issue yesterday :P http://paste.openstack.org/show/316271/ | 09:50 |
| *** sergmelikyan has joined #openstack-infra | 09:50 | |
| *** oomichi has joined #openstack-infra | 09:51 | |
| *** kashyap has joined #openstack-infra | 09:51 | |
| mrunge | Kennan, http://www.projectatomic.io/community/ mentions an irc channel: #atomic | 09:51 |
| johnthetubaguy | +1 for gerrit being a bit dead right now | 09:51 |
| *** shardy has quit IRC | 09:52 | |
| johnthetubaguy | ah, good point, its the slight gap and aus has dinner, and the US are still sleeping | 09:52 |
| Kennan | ok mrunge: thanks | 09:52 |
| *** shardy has joined #openstack-infra | 09:52 | |
| *** otter768 has quit IRC | 09:53 | |
| kashyap | Thanks folks, Gerrit seems to be back up! | 09:53 |
| *** nihilifer has quit IRC | 09:54 | |
| *** oomichi has quit IRC | 09:54 | |
| *** vlaza has joined #openstack-infra | 09:55 | |
| *** ddieterly has joined #openstack-infra | 09:56 | |
| *** oomichi has joined #openstack-infra | 09:57 | |
| StevenK | AJaeger: Can you peer at https://review.openstack.org/#/c/194525/ ? I'm concerned that gate-infra-puppet-apply-centos6 passed in patchset 2, and failed with patchset 3 | 09:58 |
| StevenK | AJaeger: (And the difference between the two patchesets is two characters of whitespace) | 09:58 |
| *** chen12 has quit IRC | 10:00 | |
| *** nihilifer_ has quit IRC | 10:00 | |
| *** chen12 has joined #openstack-infra | 10:00 | |
| *** ddieterly has quit IRC | 10:01 | |
| *** Guest60269 has quit IRC | 10:01 | |
| *** ghostpl has quit IRC | 10:03 | |
| wznoinsk | fungi: when you're here, please let me know if I can pass your details to my infra team in regards the email delays we've spoke about shortly a couple of days ago (Too many recipients received this hour) | 10:05 |
| *** dims has joined #openstack-infra | 10:06 | |
| *** ghostpl has joined #openstack-infra | 10:07 | |
| *** e0ne is now known as e0ne_ | 10:10 | |
| *** yamamoto has quit IRC | 10:11 | |
| openstackgerrit | Serg Melikyan proposed openstack/requirements: Add python-muranoclient to requirements https://review.openstack.org/177204 | 10:12 |
| *** fawadkhaliq has quit IRC | 10:15 | |
| openstackgerrit | Thomas Bechtold proposed openstack-dev/pbr: Use string for 'OS_TEST_TIMEOUT' default https://review.openstack.org/194564 | 10:17 |
| *** cing has quit IRC | 10:20 | |
| *** e0ne_ has quit IRC | 10:20 | |
| sdague | Kiall: I was one of the people that reported the outage yesterday :) | 10:21 |
| Kiall | sdague: Oh, confused so :) | 10:23 |
| AJaeger | StevenK: WE have on the centos6 image a known git timeout issue. If there's a failure with 30mins, it is the timeout. Run "recheck" | 10:24 |
| *** yfried is now known as yfried|afk | 10:24 | |
| *** serg_melikyan has joined #openstack-infra | 10:26 | |
| *** Mmike has quit IRC | 10:28 | |
| *** Mmike has joined #openstack-infra | 10:28 | |
| StevenK | AJaeger: Ah ha! | 10:28 |
| *** dtantsur|brb is now known as dtantsur | 10:29 | |
| *** salv-orlando has quit IRC | 10:29 | |
| *** sergmelikyan has quit IRC | 10:30 | |
| AJaeger | StevenK: But better update as suggested ;) | 10:30 |
| *** oomichi has quit IRC | 10:31 | |
| openstackgerrit | Steve Kowalik proposed openstack-infra/project-config: Sprinkle in Horizon translations for Zanata https://review.openstack.org/194525 | 10:31 |
| *** yfried|afk is now known as yfried | 10:34 | |
| *** hdd has joined #openstack-infra | 10:38 | |
| *** mrmartin has joined #openstack-infra | 10:39 | |
| *** ociuhandu has joined #openstack-infra | 10:40 | |
| openstackgerrit | Witold Bedyk proposed openstack-infra/project-config: added project stackforge/monasca-log-api https://review.openstack.org/194595 | 10:42 |
| *** kashyap has left #openstack-infra | 10:45 | |
| *** serg_melikyan has quit IRC | 10:48 | |
| wznoinsk | infra - is there a gerrit group you could add my CI accounts so they don't get emails about comments on each change the comment on? I can't find such option in gerrit settings... correct me if I'm wrong | 10:49 |
| *** yamamoto has joined #openstack-infra | 10:50 | |
| *** mrunge has quit IRC | 10:53 | |
| *** kashyap has joined #openstack-infra | 10:53 | |
| *** AzherKhan has quit IRC | 10:53 | |
| *** mrunge has joined #openstack-infra | 10:53 | |
| *** yfried is now known as yfried|afk | 10:54 | |
| *** yamamoto has quit IRC | 10:55 | |
| *** coolsvap is now known as coolsvap|away | 10:55 | |
| *** yamahata has quit IRC | 10:55 | |
| *** yfried|afk is now known as yfried | 10:56 | |
| *** ddieterly has joined #openstack-infra | 10:57 | |
| kashyap | Can anyone provide a pointer to a git repo of all the Jenkins' jobs? | 11:00 |
| *** jamielennox is now known as jamielennox|away | 11:00 | |
| *** mohankumar has quit IRC | 11:01 | |
| *** sergmelikyan has joined #openstack-infra | 11:01 | |
| * kashyap scours in git.openstack.org | 11:01 | |
| *** ddieterly has quit IRC | 11:01 | |
| AJaeger | kashyap: project-config repo, directory jenkins/jobs | 11:01 |
| *** radez is now known as radez_g0n3 | 11:01 | |
| AJaeger | kashyap: see also http://docs.openstack.org/infra/ | 11:02 |
| kashyap | AJaeger: Yep, thank you. | 11:02 |
| *** fhubik is now known as fhubik_afk | 11:02 | |
| *** yamamoto has joined #openstack-infra | 11:03 | |
| AJaeger | wznoinsk: yes, see http://docs.openstack.org/infra/system-config/third_party.html#creating-a-service-account | 11:04 |
| *** markvoelker has joined #openstack-infra | 11:06 | |
| *** yfried is now known as yfried|afk | 11:09 | |
| *** e0ne has joined #openstack-infra | 11:09 | |
| *** markvoelker has quit IRC | 11:11 | |
| *** Alexandra_ has quit IRC | 11:11 | |
| *** mpavone has joined #openstack-infra | 11:11 | |
| *** ZZelle has quit IRC | 11:14 | |
| *** ZZelle has joined #openstack-infra | 11:14 | |
| * kashyap wonders if folks here use 'lp-tools' to manage Launchpad bugs from CLI. | 11:14 | |
| *** yfried|afk is now known as yfried | 11:15 | |
| samueldmq | morning | 11:17 |
| samueldmq | I've a quick question regarding shade | 11:18 |
| samueldmq | since I found this https://github.com/openstack-infra/shade/blob/18cf7c2ccbddfdf296b93f0f36a7355a0d8c1e36/shade/tests/functional/hooks/post_test_hook.sh#L18 | 11:18 |
| samueldmq | I suppose the funtional tests are supposed to be run against a devstack | 11:19 |
| *** radez_g0n3 is now known as radez | 11:19 | |
| *** baoli has joined #openstack-infra | 11:23 | |
| openstackgerrit | Merged openstack-infra/project-config: Allow Merge Commits to fuel-docs repo https://review.openstack.org/194338 | 11:23 |
| *** yamamoto has quit IRC | 11:24 | |
| *** abregman has quit IRC | 11:25 | |
| *** abregman has joined #openstack-infra | 11:25 | |
| *** shardy has quit IRC | 11:25 | |
| *** shardy has joined #openstack-infra | 11:26 | |
| wznoinsk | AJaeger: thanks, as far as I understand this group's settings tho is that 'my CI account's comments will not be emailed to others' and what I am looking for to not to get emails when someone else is adding a comment, btw. my Intel Networking CI is already is in that group | 11:26 |
| *** hdd has quit IRC | 11:26 | |
| *** yamamoto has joined #openstack-infra | 11:27 | |
| *** yamamoto_ has joined #openstack-infra | 11:28 | |
| *** HeOS has quit IRC | 11:28 | |
| *** HeOS has joined #openstack-infra | 11:28 | |
| *** jcoufal has quit IRC | 11:29 | |
| *** HeOS_ has joined #openstack-infra | 11:29 | |
| *** salv-orlando has joined #openstack-infra | 11:30 | |
| *** hdd has joined #openstack-infra | 11:30 | |
| *** radez is now known as radez_g0n3 | 11:31 | |
| *** yamamoto has quit IRC | 11:32 | |
| *** salv-orlando has quit IRC | 11:36 | |
| *** hdd has quit IRC | 11:36 | |
| *** yamamoto_ has quit IRC | 11:36 | |
| *** e0ne is now known as e0ne_ | 11:36 | |
| *** ociuhandu has quit IRC | 11:39 | |
| openstackgerrit | Merged openstack-infra/release-tools: Update milestone.sh to support new versioning https://review.openstack.org/194068 | 11:41 |
| AJaeger | wznoinsk: In that case I can't help. Others might be - or join the third-party CI meeting and ask others | 11:41 |
| *** marcusvrn has joined #openstack-infra | 11:41 | |
| mordred | samueldmq: yes - they do run against a devstack | 11:41 |
| mordred | samueldmq: however, they should also be runnable against a live cloud account too (if you don't mind the tests creating and deleting things on that account) | 11:42 |
| wznoinsk | AJaeger: sure, thanks for the try anyways, I'll speak to them yes | 11:42 |
| fungi | wznoinsk: sure, they can reach me at fungi@yuggoth.org if they have any questions about our mailserver logs | 11:42 |
| *** cburroughs has joined #openstack-infra | 11:43 | |
| samueldmq | mordred: nice thanks, I'll create a VM in our internal cloud and try it out | 11:43 |
| *** yamamoto has joined #openstack-infra | 11:43 | |
| samueldmq | mordred: just against a VM for now, need to ask people here to run against the live cloud | 11:44 |
| samueldmq | mordred: thanks | 11:44 |
| *** mrmartin has quit IRC | 11:44 | |
| *** hashar has quit IRC | 11:45 | |
| openstackgerrit | Fabio Porcedda proposed openstack-infra/git-review: Add "-p"/"--pull" option to merge a change on the local branch https://review.openstack.org/194094 | 11:46 |
| *** Hal has joined #openstack-infra | 11:46 | |
| *** sdake has joined #openstack-infra | 11:46 | |
| *** e0ne_ has quit IRC | 11:46 | |
| *** Hal is now known as Guest39912 | 11:46 | |
| fungi | wznoinsk: as for getting gerrit to not e-mail you updated for changes on which you've commented, there's a long-standing bug report/feature request asking for that capability https://code.google.com/p/gerrit/issues/detail?id=1097 | 11:47 |
| *** sdake_ has joined #openstack-infra | 11:47 | |
| *** shardy has quit IRC | 11:47 | |
| *** otter768 has joined #openstack-infra | 11:49 | |
| *** dprince has joined #openstack-infra | 11:49 | |
| *** otter768 has quit IRC | 11:50 | |
| *** otter768 has joined #openstack-infra | 11:50 | |
| openstackgerrit | Merged openstack-infra/project-config: Run sudo /w -H in akanda post_test_hook https://review.openstack.org/194282 | 11:50 |
| *** sdake has quit IRC | 11:50 | |
| wznoinsk | fungi: thanks, I was trying to get the number of emails to our gateway down as we're hitting a /h limit but it looks like the only option is to increase the limit on our side | 11:52 |
| wznoinsk | my infra would like a contact person details to contact about that, could I give your email address? | 11:52 |
| *** salv-orlando has joined #openstack-infra | 11:54 | |
| *** shardy has joined #openstack-infra | 11:54 | |
| *** sdake_ has quit IRC | 11:54 | |
| *** husanu has quit IRC | 11:56 | |
| *** fawadkhaliq has joined #openstack-infra | 11:57 | |
| *** husanu has joined #openstack-infra | 11:58 | |
| *** ddieterly has joined #openstack-infra | 11:58 | |
| *** ParsectiX has quit IRC | 11:58 | |
| *** bexelbie has quit IRC | 11:59 | |
| *** bexelbie_ has quit IRC | 11:59 | |
| *** ociuhandu has joined #openstack-infra | 11:59 | |
| wznoinsk | fungi: see your reply above, ignore pls | 11:59 |
| *** mpavone has quit IRC | 12:00 | |
| *** otter768 has quit IRC | 12:00 | |
| *** hashar has joined #openstack-infra | 12:01 | |
| *** zz_dimtruck is now known as dimtruck | 12:02 | |
| ZZelle | fungi, hi | 12:02 |
| *** ddieterly has quit IRC | 12:02 | |
| *** weshay has joined #openstack-infra | 12:03 | |
| *** bdemers has quit IRC | 12:04 | |
| *** markvoelker has joined #openstack-infra | 12:05 | |
| *** mtanino has joined #openstack-infra | 12:05 | |
| *** jasondotstar has quit IRC | 12:06 | |
| *** fhubik_afk is now known as fhubik | 12:06 | |
| fungi | ZZelle: hey there, what do you need? | 12:06 |
| *** ParsectiX has joined #openstack-infra | 12:07 | |
| *** bexelbie_ has joined #openstack-infra | 12:07 | |
| *** bexelbie has joined #openstack-infra | 12:07 | |
| ZZelle | fungi, in neutron tox.ini you define the env variable VIRTUAL_ENV (https://github.com/openstack/neutron/blob/master/tox.ini#L7) | 12:07 |
| *** Ala has quit IRC | 12:08 | |
| *** kushal has quit IRC | 12:08 | |
| fungi | i do? | 12:08 |
| ZZelle | fungi, but lots of neutron jobs overload setenv without defining VIRTUAL_ENV (for example: https://github.com/openstack/neutron/blob/master/tox.ini#L36-L41) | 12:08 |
| ZZelle | fungi, oups, i was mordred :s | 12:09 |
| *** kushal has joined #openstack-infra | 12:09 | |
| mordred | ZZelle: wow, you were me? that must be scary | 12:10 |
| Clint | i'm seeing double | 12:10 |
| *** dimtruck is now known as zz_dimtruck | 12:11 | |
| *** gordc has joined #openstack-infra | 12:12 | |
| *** pc_m has joined #openstack-infra | 12:12 | |
| *** shardy has quit IRC | 12:12 | |
| ZZelle | mordred, i am wondering if we need to ensure VIRTUAL_ENV is set for every job | 12:13 |
| ZZelle | (toxjjob) | 12:13 |
| *** sergmelikyan has quit IRC | 12:13 | |
| ZZelle | (tox job) | 12:13 |
| fungi | ZZelle: anyway, if you're referring to implications of that situation on https://review.openstack.org/193262 then yes, that probably does cause some of those tox envs to miss the pymysql dburi override. if those envs don't run things which make use of oslo.db opportunistic backend detection then it's probably not important anyway | 12:13 |
| *** Ala has joined #openstack-infra | 12:13 | |
| fungi | especially if oslo.db tags a new release very soon | 12:14 |
| *** kushal has quit IRC | 12:14 | |
| ttx | fungi: you probably already noticed that, but Gerrit seems to have... variable performance this morning. | 12:15 |
| *** claudiub has quit IRC | 12:15 | |
| mordred | fungi: yup. I was just about to say what ttx said | 12:15 |
| *** dguerri is now known as dguerri` | 12:15 | |
| *** dguerri` is now known as dguerri | 12:15 | |
| fungi | ttx: yes, the webui stopped responding a few times yesterday too | 12:15 |
| ttx | sometimes it's fast, sometimes it hangs. | 12:16 |
| fungi | we've been so far unable to find any indication in the logs of the cause. i'm starting to wonder if there's a qos issue in rackspace | 12:16 |
| ttx | current status: hanging. | 12:16 |
| fungi | yep, when this happens, apache is logging no new requests in its access log and no errors in its error log | 12:17 |
| fungi | so the https connections aren't making it to the server, i think | 12:17 |
| ttx | can't tie that to any CPU or network usage peak either | 12:17 |
| fungi | nope | 12:17 |
| *** shardy has joined #openstack-infra | 12:18 | |
| StevenK | Huh, mtr hits the machine, but nc -vz is hanging | 12:18 |
| fungi | i'll get a ticket opened with rackspace shortly | 12:18 |
| fungi | StevenK: yeah, weird thing is the ssh api is still responsive too | 12:19 |
| fungi | but connections aren't reaching apache at all | 12:19 |
| StevenK | steven@undermined:~% nc -vz review.openstack.org https | 12:19 |
| StevenK | Connection to review.openstack.org 443 port [tcp/https] succeeded! | 12:19 |
| StevenK | So it did work, but nc only does SYN / SYNACK / ACK, but it took a while | 12:19 |
| *** dizquierdo is now known as dizquierdo_afk | 12:19 | |
| fungi | and now it's logging connections again | 12:20 |
| *** bauzas has joined #openstack-infra | 12:20 | |
| fungi | so you may have simply caught it going back to normal there | 12:20 |
| StevenK | Right at the end | 12:21 |
| *** sergmelikyan has joined #openstack-infra | 12:21 | |
| StevenK | It could well be rate limiting for 443 traffic, like you say. | 12:21 |
| StevenK | I don't like it when machines act differently for ICMP versus TCP traffic. :-/ | 12:21 |
| fungi | in this case it's acting differently for ssh vs https traffic even | 12:22 |
| StevenK | Yeah, which is even stranger. | 12:23 |
| *** claudiub has joined #openstack-infra | 12:24 | |
| *** woodster_ has joined #openstack-infra | 12:25 | |
| * AJaeger managed to briefly comment on a patch using the webui. Seems I have to try gerrty soon... | 12:25 | |
| *** mpavone has joined #openstack-infra | 12:26 | |
| *** aysyanne has joined #openstack-infra | 12:26 | |
| *** agentle has joined #openstack-infra | 12:26 | |
| ttx | could be some weird filtering | 12:27 |
| *** kgiusti has joined #openstack-infra | 12:27 | |
| ttx | or ids | 12:27 |
| fungi | is it hung for everyone else again | 12:27 |
| fungi | ? | 12:27 |
| *** sergmelikyan has quit IRC | 12:27 | |
| ttx | it is hung for me | 12:28 |
| ttx | got briefly on hit | 12:28 |
| ttx | one hit 2 min ago | 12:28 |
| fungi | i've got tcpdump running and my https requests aren't reaching the interface at all | 12:28 |
| *** sergmelikyan has joined #openstack-infra | 12:28 | |
| *** bswartz has quit IRC | 12:28 | |
| Clint | fantastic | 12:28 |
| ttx | yeah, likely not Gerrit fault... this time. | 12:28 |
| fungi | okay, now it just got through | 12:28 |
| *** chlong has joined #openstack-infra | 12:31 | |
| *** kushal has joined #openstack-infra | 12:31 | |
| *** fawadkhaliq has quit IRC | 12:32 | |
| *** sergmelikyan has quit IRC | 12:32 | |
| *** yfried is now known as yfried|afk | 12:33 | |
| *** yfried|afk is now known as yfried | 12:34 | |
| *** sergmelikyan has joined #openstack-infra | 12:35 | |
| *** agentle has quit IRC | 12:35 | |
| *** bknudson has quit IRC | 12:35 | |
| *** agentle has joined #openstack-infra | 12:36 | |
| *** mrmartin has joined #openstack-infra | 12:36 | |
| *** fhubik is now known as fhubik_afk | 12:37 | |
| *** fhubik_afk is now known as fhubik | 12:37 | |
| *** dizquierdo_afk has quit IRC | 12:37 | |
| *** e0ne has joined #openstack-infra | 12:37 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/puppet-openstackci: Add generic zuul manifests https://review.openstack.org/175970 | 12:37 |
| *** ldnunes has joined #openstack-infra | 12:39 | |
| fungi | i've opened rackspace ticket 150623-ord-0000826 about this | 12:39 |
| *** dizquierdo_afk has joined #openstack-infra | 12:39 | |
| *** radez_g0n3 is now known as radez | 12:39 | |
| *** boris-42 has quit IRC | 12:42 | |
| *** mwagner_afk has joined #openstack-infra | 12:43 | |
| *** yamamoto has quit IRC | 12:45 | |
| wznoinsk | fungi: is there a set of IP's that send emails for review.openstack.org? | 12:46 |
| *** rfolco has joined #openstack-infra | 12:47 | |
| *** sshnaidm has joined #openstack-infra | 12:49 | |
| *** amotoki has joined #openstack-infra | 12:51 | |
| *** coolsvap|away is now known as coolsvap | 12:51 | |
| *** salv-orlando has quit IRC | 12:52 | |
| *** linkedinyou has joined #openstack-infra | 12:56 | |
| clarkb | wznoinsk just the A and AAAA recorded IPs in dns | 12:57 |
| * clarkb notes new traffic on gerrit list about the packfile error issue thibg | 12:57 | |
| *** ddieterly has joined #openstack-infra | 12:58 | |
| *** rlandy has joined #openstack-infra | 13:00 | |
| *** pc_m has quit IRC | 13:01 | |
| *** coolsvap is now known as coolsvap|away | 13:01 | |
| *** xyang1 has joined #openstack-infra | 13:02 | |
| *** mpavone has quit IRC | 13:02 | |
| *** u_glide has joined #openstack-infra | 13:02 | |
| *** ddieterly has quit IRC | 13:03 | |
| *** dkranz has joined #openstack-infra | 13:04 | |
| *** tlian has joined #openstack-infra | 13:06 | |
| *** shardy has quit IRC | 13:07 | |
| *** shardy has joined #openstack-infra | 13:07 | |
| *** shardy has quit IRC | 13:07 | |
| *** sergmelikyan has quit IRC | 13:07 | |
| ZZelle | mordred, could you provide some references why we have VIRTUAL_ENV in tox.ini (https://github.com/openstack/neutron/blob/master/tox.ini#L7) | 13:08 |
| *** coolsvap|away is now known as coolsvap | 13:08 | |
| *** peristeri has joined #openstack-infra | 13:08 | |
| *** sshnaidm has quit IRC | 13:08 | |
| *** sshnaidm has joined #openstack-infra | 13:09 | |
| mordred | ZZelle: I do not remember why we set that. if clarkb is still around, he might | 13:17 |
| *** changbl_ has quit IRC | 13:17 | |
| ZZelle | mordred, clarkb, it seems related to https://github.com/openstack/oslo-incubator/blob/2ca2b4b49367d6033bdd2c5e47d17392e7aba318/openstack/common/setup.py#L80-L87 | 13:17 |
| ZZelle | mordred, clarkb, which has been removed but perhaps there are other usages | 13:17 |
| *** jasondotstar has joined #openstack-infra | 13:17 | |
| *** kushal has quit IRC | 13:17 | |
| *** bswartz has joined #openstack-infra | 13:17 | |
| mordred | SO - I think it may have been working aroudn something .. normally virtualenv itself sets that env var | 13:17 |
| clarkb | I would check git log -p tox.ini | 13:17 |
| *** sergmelikyan has joined #openstack-infra | 13:17 | |
| *** deepakcs has quit IRC | 13:17 | |
| *** openstack has quit IRC | 13:17 | |
| *** openstack has joined #openstack-infra | 13:19 | |
| dstufft | more zeros == better than | 13:20 |
| dstufft | obviously | 13:20 |
| mordred | ttx: I believe this might be by design and I think I remember talking about it months ago | 13:20 |
| mordred | but I do not remember the details ... do you fungi ? | 13:20 |
| dstufft | I think it is by design, I recall it being talked about too | 13:20 |
| *** shardy has quit IRC | 13:20 | |
| ttx | well, if that's by design I would have welcomed a heads-up | 13:20 |
| fungi | ttx: pbr considers 3.0.0.0b1 to be the normalized form of that tag | 13:20 |
| mordred | ttx: I thought you were in the conversation | 13:20 |
| ttx | especially since we've been tweaking versions lately | 13:20 |
| dstufft | I think it was so the beta marker was in it's own "part" | 13:20 |
| ttx | err | 13:20 |
| *** esker has joined #openstack-infra | 13:20 | |
| *** shardy has joined #openstack-infra | 13:20 | |
| dstufft | to make it easier to parse | 13:20 |
| dstufft | or something | 13:20 |
| ttx | I don't remember pushing 2015.1.0.0rc1 things though | 13:21 |
| clarkb | its based on an interpretation of pep440 iirc | 13:21 |
| clarkb | so the normal form is more correct because 440 says so | 13:21 |
| fungi | ttx: it would only be since the pbr 0.11 release | 13:21 |
| dstufft | pep 440 is more than happy to have 3.0.0b1 | 13:21 |
| dstufft | the extra 0 is a pbr thing | 13:21 |
| clarkb | see my comment | 13:21 |
| ttx | I just don't think generating versions that are different from the one in the tag to be sane | 13:21 |
| clarkb | on the linked change it is a 440 thing | 13:21 |
| *** dizquierdo_afk is now known as dizquierdo | 13:22 | |
| ttx | what am I supposed to push as a tag there ? | 13:22 |
| mordred | ttx: I agree with you - I do not believe I fully grokked that we would _generate_ versions on tagged commits | 13:22 |
| clarkb | ttx 1.1.1.0b1 is the correct tag | 13:22 |
| ttx | because that extra 0 won't sort correctly with the version in the tag, it's not harmless | 13:22 |
| clarkb | according to pbr's interpretation of pep440 | 13:22 |
| ttx | so I should have pushed 3.0.0.0b1 ? | 13:23 |
| *** scheuran has joined #openstack-infra | 13:23 | |
| clarkb | yes | 13:23 |
| ttx | and then I would have gotten what I pushed in ? | 13:23 |
| clarkb | yes | 13:23 |
| ttx | not 3.0.0.0.0b1 | 13:23 |
| clarkb | correct | 13:24 |
| ttx | hrm. So what now ? Should we clean up the 3.0.0b1 tag ? | 13:24 |
| ttx | (from sahara repo ?) | 13:24 |
| ttx | and repush ? | 13:24 |
| fungi | ttx: yeah, the debate right now is whether we configure pbr-specific pre-release pipelines to only fire jobs on pbr-normal-form pre-release tags to avoid further confusion | 13:24 |
| ttx | fungi: ack -- because that is confusing alright | 13:24 |
| dhellmann | fungi: ++ to reducing confusion | 13:25 |
| ttx | (in addition to being dead ugly) | 13:25 |
| openstackgerrit | Andrey Pavlov proposed openstack/requirements: Add botocore to requirements https://review.openstack.org/172335 | 13:25 |
| fungi | however if we do that, we probably want the pbr-specific pre-release pipeline separate from the normal pre-release pipeline so that we aren't dictating pre-release tag semantics to non-pbr projects | 13:25 |
| ttx | should we clean up the accidental tag before it spreads out ? | 13:25 |
| fungi | we can't, really | 13:26 |
| wznoinsk | clarkb: thanks | 13:26 |
| *** sergmelikyan has quit IRC | 13:26 | |
| ttx | if I retag, will the 3.0.0.0b1 tarball in tarballs.o.o be overwritten ? | 13:26 |
| fungi | and configuring filters in the zuul layout to be more strict isn't going to prevent people from pushing any old signed tag into gerrit anyway | 13:27 |
| fungi | ttx: yes | 13:27 |
| *** eharney has joined #openstack-infra | 13:27 | |
| ttx | I guess I should retag then | 13:27 |
| *** mriedem has joined #openstack-infra | 13:27 | |
| ttx | dhellmann: thoughts ? | 13:27 |
| sdague | dstufft: question about the built in wheel cache in pip... does pip prefer content there over upstream on an install -U ? | 13:27 |
| clarkb | right so 440 says normal form is somever.XaY and pbr has taken a generic approach to normalizing that | 13:27 |
| dhellmann | ttx: yes, let's retag at least so it's consistent | 13:27 |
| ttx | I'll modify milestone.sh so it generates extra 0s | 13:27 |
| clarkb | so even if you start with that it separates the prerelease specifier onto its own dotted thing | 13:28 |
| dstufft | sdague: No, if a wheel is uploaded to PyPI it will prefer that instead of the cached wheel, and if a new version is uploaded it will prefer that | 13:28 |
| sdague | dstufft: hmmm.... | 13:28 |
| dstufft | or at least, that's how it _should_ work and is intended to work | 13:28 |
| dstufft | if it doesn't it's a bug | 13:28 |
| sdague | dstufft: even if the wheel cache would satisfy it? | 13:28 |
| dhellmann | dstufft, sdague : I think we've seen a couple of folks in the last week or so have cache-related upgrade issues (at least deleting their cache allowed them to upgrade) | 13:28 |
| dhellmann | I haven't been able to reproduce the problems locally to debug better :-/ | 13:29 |
| sdague | so, the situation I seemed to get into was that I had python-openstackclient 1.0.4 previously installed. I uninstalled it. | 13:29 |
| fungi | it's possible that when they run a job which tests, say, oslo.messaging from master branch tip, pip is caching a wheel of a dev version that's newer than what's on pypi, then later pypi reuses that because it satisfies the version constraints | 13:30 |
| sdague | but pip install -U python-openstackclient >=1.0.3 gave me 1.0.4 | 13:30 |
| sdague | not 1.6 | 13:30 |
| sdague | which causes issues | 13:30 |
| fungi | but yeah, the cache symptoms you're seeing can't be what i'm describing | 13:30 |
| dhellmann | you know, the problem we had reported late last week was the same package | 13:30 |
| *** dustins has joined #openstack-infra | 13:31 | |
| dstufft | sdague: yes, the wheel cache happens after we select a potentional file, essentially we resolve a file to download from all of the available versions (ignoring the fact that there is a wheel cache), and once we've selected a link to download and install we check if that link is a wheel, if it is already a wheel we use that, if it's a sdist we check in the cache (keyed by the full url) to see if we've already built a wheel | 13:31 |
| zaro | fungi: hi, i've been vacationing since last week so won't be in meeting today. | 13:31 |
| dhellmann | fungi, weren't you involved in helping to debug that in here last week? | 13:31 |
| clarkb | the pep pages are almost ubreadable using mobile chrome... | 13:31 |
| dstufft | sdague: hrm | 13:31 |
| *** svasheka has joined #openstack-infra | 13:31 | |
| sdague | dstufft: what happens if a permissions issue happens somewhere in that process? | 13:31 |
| clarkb | they auto scroll to the top | 13:31 |
| sdague | like ~/.pip became owned by root because sudo | 13:31 |
| fungi | zaro: okay, thanks for the heads up. also clarkb says there's been some further discussion on the jgit corrupt packfile issue | 13:32 |
| *** bdemers has joined #openstack-infra | 13:32 | |
| *** sdake_ has joined #openstack-infra | 13:32 | |
| clarkb | fungi zaro just more people affected | 13:32 |
| *** fawadkhaliq has joined #openstack-infra | 13:33 | |
| fungi | dhellmann: yeah, the person reporting the issue kept getting a version much older than what was on pypi, until they deleted their pip cache | 13:33 |
| clarkb | we should maybe write the list with a big warning to not upgrade gerrit... | 13:33 |
| *** ayoung has joined #openstack-infra | 13:33 | |
| dstufft | sdague: if it couldn't _write_ a wheel, it should fall back to installing from sdist I think (at least, if any error occurs during setup.py bdist_wheel, not sure if the actual writing to the final location is inside that try: except offhand, but if it's not then it should flat out bomb out), if it can't _read_a wheel, it should bomb out I think | 13:33 |
| dstufft | sdague: are yoju able to reproduce this right now? | 13:33 |
| *** sergmelikyan has joined #openstack-infra | 13:34 | |
| sdague | dstufft: no, I hacked past it because this was preventing me from getting any work done | 13:34 |
| zaro | great news. i was going peer into the code when i return but wasn't sure i would get far. | 13:34 |
| sdague | I can probably build a reproduce env | 13:34 |
| dstufft | my guess is something caused /simple/python-openstackclient/ to get cached for much longer than it should | 13:34 |
| wznoinsk | sdague: is that the cause .pip dir didn't exist before and it was created by root (hence owned)? would that happen if you already had .pip directory? | 13:34 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/release-tools: Pre-versions are now $VERSION.0b1 https://review.openstack.org/194659 | 13:34 |
| wznoinsk | s/cause/case* | 13:34 |
| zaro | fungi, clarkb : should be back end of next week. | 13:35 |
| sdague | wznoinsk: I'm pretty sure .pip did not exist in the stack user before I got started with these devstack vagrants | 13:35 |
| sdague | they were pretty blank boxes | 13:35 |
| dstufft | sdague: if you can reproduce that would be great | 13:35 |
| mrmartin | fungi: hi | 13:36 |
| wznoinsk | sdague: then that would be expected .pip was owned by root after sudo that created it... | 13:36 |
| *** amitgandhinz has joined #openstack-infra | 13:36 | |
| dstufft | oh | 13:36 |
| dstufft | if the cache dir is owned by someone other than the current user we disable the cache completely IIRC | 13:36 |
| mordred | yes. that is the behavior | 13:37 |
| sdague | well, I'm getting a behavior that's as if building the cache is disabled, but reading from it is not | 13:37 |
| dstufft | though we might not disable it for the wheel cache | 13:38 |
| * dstufft looks | 13:38 | |
| *** fawadkhaliq has quit IRC | 13:39 | |
| dstufft | hrm | 13:40 |
| dstufft | yes the wheel cache in particular isn't being disabled if we don't own the dir | 13:40 |
| dstufft | got missed | 13:40 |
| dstufft | though that still shouldn't have the effect you're seeing | 13:40 |
| dstufft | since the wheel cache happens _after_ pip has resolved things to a link | 13:41 |
| *** tvanderwiel has joined #openstack-infra | 13:41 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: Only use tput when we are writing to a terminal https://review.openstack.org/194661 | 13:41 |
| openstackgerrit | Merged openstack-infra/release-tools: Pre-versions are now $VERSION.0b1 https://review.openstack.org/194659 | 13:41 |
| mrmartin | fungi: this patch: https://review.openstack.org/#/c/186217/ changed the groups-core to groups-release pushSignedTag, and I'm not a member of groups-release, just groups-core so I lost the ability to deliver new releases to groups portal | 13:41 |
| sdague | dstufft: well, do you think you have a handle on the bug, or do you still need a reproduce? Just so I know if I should spend the time trying to build this env | 13:41 |
| *** ddieterly has joined #openstack-infra | 13:41 | |
| dstufft | sdague: if you can reproduce that would be useful. I'm not sure what would be causing the issue you're seeing | 13:42 |
| mrmartin | fungi: can you add me to the proper group? I like to roll-out a security fix | 13:42 |
| *** tonytan4ever has joined #openstack-infra | 13:42 | |
| fungi | mrmartin: yep, i saw you asking about that in scrollback. we should double-check with jeblair so he can officially delegate it now that we have the groups redone for our governance reorganization. i don't think it will be a problem, but i'd rather leave that as a ptl task so he has proper oversight | 13:42 |
| *** fhubik_afk is now known as fhubik | 13:43 | |
| wznoinsk | i just got 'server unavailable' from gerrit http | 13:43 |
| mrmartin | ok | 13:43 |
| mrmartin | great, thnx | 13:43 |
| wznoinsk | can anyone check? not sure whether it's just me | 13:43 |
| marcusvrn | wznoinsk: it's not working here too | 13:45 |
| mordred | wznoinsk: we are having intermittend as-of-yet unknown issues with http to gerrit | 13:45 |
| vlaza | same to me, gerrit unavailable | 13:45 |
| wznoinsk | http://www.isitdownrightnow.com/review.openstack.org.html, phew | 13:45 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/release-tools: upload_release.py should use $VERSION.0b1 too https://review.openstack.org/194662 | 13:46 |
| *** yamamoto has joined #openstack-infra | 13:46 | |
| *** coolsvap is now known as coolsvap|away | 13:46 | |
| sdague | dstufft: ok, I'll build a second vagrant and see if I can guess how I got into this state | 13:46 |
| *** bknudson has joined #openstack-infra | 13:48 | |
| *** fallenpegasus has joined #openstack-infra | 13:48 | |
| *** yfried is now known as yfried|afk | 13:48 | |
| fungi | wznoinsk: vlaza: marcusvrn: yes, i have a ticket open with rackspace support asking them to look into it. we're having intermittent periods of no https connections reaching the server | 13:50 |
| *** tosky has quit IRC | 13:51 | |
| *** yamamoto has quit IRC | 13:51 | |
| *** dkranz has quit IRC | 13:52 | |
| *** salv-orlando has joined #openstack-infra | 13:52 | |
| *** agentle has joined #openstack-infra | 13:53 | |
| *** yfried|afk is now known as yfried | 13:53 | |
| *** sergmelikyan has quit IRC | 13:53 | |
| *** bhunter71 has joined #openstack-infra | 13:54 | |
| *** bknudson has quit IRC | 13:54 | |
| *** mpavone has joined #openstack-infra | 13:54 | |
| *** sergmelikyan has joined #openstack-infra | 13:55 | |
| *** xyang1 has quit IRC | 13:56 | |
| jeblair | jhesketh, tonyb: all our software is documented :) http://docs.openstack.org/infra/jenkins-job-builder/publishers.html#publishers.scp | 13:56 |
| *** bexelbie has quit IRC | 13:56 | |
| jhesketh | jeblair: heh, jjb's documentation is better than the plugins themselves | 13:57 |
| *** bexelbie_ has quit IRC | 13:57 | |
| *** salv-orlando has quit IRC | 13:57 | |
| *** dkranz has joined #openstack-infra | 13:57 | |
| *** cdent has quit IRC | 13:58 | |
| *** cdent has joined #openstack-infra | 13:58 | |
| *** fallenpegasus has quit IRC | 13:58 | |
| *** bexelbie has joined #openstack-infra | 13:59 | |
| *** baoli has quit IRC | 13:59 | |
| marcusvrn | fungi: ok. thanks for the feedback | 14:00 |
| *** rwsu has joined #openstack-infra | 14:01 | |
| fungi | hrm, rackspace says they have no port-specific filtering or proxying | 14:01 |
| *** otter768 has joined #openstack-infra | 14:01 | |
| fungi | i'll see if i can collect some additional details the next time this happens | 14:01 |
| *** agentle has quit IRC | 14:01 | |
| *** yamamoto has joined #openstack-infra | 14:02 | |
| *** baoli has joined #openstack-infra | 14:02 | |
| openstackgerrit | Feodor Tersin proposed openstack-infra/project-config: Add Neutron vpn service for ec2api Neutron gating job https://review.openstack.org/194670 | 14:03 |
| jeblair | jhesketh: yeah, it's almost a required side effect of the way we build jjb :) | 14:03 |
| *** naggappan has quit IRC | 14:04 | |
| *** ParsectiX has quit IRC | 14:04 | |
| *** otter768 has quit IRC | 14:05 | |
| jeblair | fungi, ttx, clarkb, mordred: i feel that changing the zuul config to restrict to pbr-semver is unecessary because it will not prevent people from pushing noncompliant tags in the first place; it will only cause a tarball not to be built. we can, if we choose, delete the tarball which will have about the same effect as not having run the job. | 14:05 |
| jeblair | fungi, ttx, clarkb, mordred: meanwhile, having that restriction will confuse other people who don't use pbr-semver versions and wonder why their jobs didn't run (or don't know which pipeline to use) | 14:06 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/devstack-gate: Fix the setup_workspace to handle missing ZUUL_BRANCH https://review.openstack.org/194302 | 14:07 |
| jeblair | i will put that in the review; but i wanted to mention it here because the events of the last 2 days have brought clarity to me on the issue :) | 14:07 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:07 | |
| mtreinish | fungi, jeblair: ^^^ I think that should work now | 14:07 |
| fungi | jeblair: well, it causes the tarball/wheel to be built with a different name from the tag, and then not uploaded to pypi because of the mismatch | 14:07 |
| fungi | but it does end up on tarballs.o.o | 14:07 |
| *** ddieterly has quit IRC | 14:08 | |
| *** bknudson has joined #openstack-infra | 14:08 | |
| fungi | i'm generally not in favor of that patch either, but proposed it as a straw man to see if anyone else has better ideas about how we can solve this | 14:08 |
| jeblair | fungi: right, but not running the job would merely cause a tarball not to be created at all. we can get to the same end-point by deleting it from tarballs.o.o | 14:08 |
| jeblair | fungi: tag review :( | 14:08 |
| fungi | indeed | 14:09 |
| jeblair | i heard.... someone... was working on that.... who was it.... | 14:09 |
| *** zz_jgrimm is now known as jgrimm | 14:09 | |
| dhellmann | jeblair, fungi, clarkb : is paste.openstack.org down? I'm seeing timeouts | 14:09 |
| fungi | dhellmann: hem... mysqld is chewing up an entire cpu on the paste server | 14:10 |
| *** bexelbie has quit IRC | 14:11 | |
| *** bexelbie_ has joined #openstack-infra | 14:11 | |
| fungi | jeblair: what was the symptom you saw yesterday which caused you to restart something on the paste server? | 14:11 |
| *** Hal has joined #openstack-infra | 14:11 | |
| *** Hal is now known as Guest36150 | 14:12 | |
| jeblair | fungi, ttx: do we want to (or have we already) deleted the tag? it is a thing we can do, and the consequences are not quite as dire if we have no plans to re-issue the tag. otoh, probably won't hurt to leave it. | 14:12 |
| jeblair | fungi: similar to this. | 14:12 |
| *** sdake_ has quit IRC | 14:12 | |
| fungi | what did you restart? mysql? | 14:12 |
| jeblair | fungi: lodgeit | 14:12 |
| *** jrniemijr has joined #openstack-infra | 14:12 | |
| *** zz_dimtruck is now known as dimtruck | 14:13 | |
| *** Guest39912 has quit IRC | 14:13 | |
| *** fhubik is now known as fhubik_afk | 14:16 | |
| *** marun has joined #openstack-infra | 14:16 | |
| fungi | aha, upstart job named openstack-paste | 14:16 |
| jeblair | AJaeger: that's pretty much the most benign internal email i've ever seen accidentally leaked to a public list | 14:16 |
| fungi | okay, that seems to have terminated whatever was beating up mysqld | 14:16 |
| fungi | dhellmann: ^ | 14:16 |
| fungi | nevermind--now it's gone right back to eating an entire processor again | 14:17 |
| Clint | maybe it's a 4-octet utf-8 character | 14:18 |
| *** doug-fish has joined #openstack-infra | 14:18 | |
| fungi | we're getting a lot of http queries from a browser reporting itself as "Java/1.8.0_45" | 14:20 |
| jeblair | fungi: does it seem like the quantity is the problem, or is there perhaps a single bad paste that's being hit? | 14:21 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/release-tools: Fix version determination in corner cases https://review.openstack.org/194675 | 14:22 |
| *** marun has quit IRC | 14:22 | |
| fungi | jeblair: it's about one request a second for random pastes. like it's a crawler maybe | 14:22 |
| dhellmann | fungi: thanks! | 14:22 |
| * dhellmann keeps reading | 14:22 | |
| dhellmann | fungi: :-/ | 14:22 |
| *** spzala has joined #openstack-infra | 14:23 | |
| *** hichihara has joined #openstack-infra | 14:23 | |
| fungi | the ip address is a customer in "eunetworks" (seems to be a germany-based isp) | 14:23 |
| *** bexelbie has joined #openstack-infra | 14:24 | |
| openstackgerrit | Merged openstack-infra/release-tools: upload_release.py should use $VERSION.0b1 too https://review.openstack.org/194662 | 14:25 |
| *** dboik has joined #openstack-infra | 14:25 | |
| jeblair | fungi: what's with the base64 looking urls? | 14:26 |
| fungi | jeblair: no clue | 14:27 |
| jeblair | they're all 502 | 14:27 |
| openstackgerrit | Merged openstack-infra/release-tools: Fix version determination in corner cases https://review.openstack.org/194675 | 14:27 |
| jeblair | or is everything 502 now | 14:27 |
| jeblair | fungi: oh, i think those are all timing out, i suspect this client is behaving very poorly and is flooding us with requests | 14:28 |
| jeblair | fungi: so maybe let's block the ip? | 14:29 |
| sdague | dstufft: would the fact that we still specify --download-cache impact things? | 14:29 |
| fungi | yeah, i think it's a crawler. i'm working on an iptables rule to block it | 14:29 |
| dstufft | sdague: it's completely ignored since 6 | 14:29 |
| sdague | ok, it generates a deprecation warning that doesn't make it clear that it's ignored, but that's fine | 14:29 |
| *** lennyb_ has joined #openstack-infra | 14:29 | |
| mrmartin | jeblair: re, please add me to the groups-release group on gerrit acl. this change: https://review.openstack.org/#/c/186217/ upgraded the ACL's, and I lost my ability to do a groups portal release. | 14:30 |
| *** jasondotstar has quit IRC | 14:31 | |
| *** ghostpl has quit IRC | 14:31 | |
| *** nihilifer has joined #openstack-infra | 14:31 | |
| *** dustins_ has joined #openstack-infra | 14:32 | |
| *** fhubik_afk is now known as fhubik | 14:33 | |
| *** sergmelikyan has quit IRC | 14:33 | |
| jeblair | mrmartin: what's your gerrit username? | 14:33 |
| *** soren has joined #openstack-infra | 14:33 | |
| mrmartin | jeblair: marton-kiss | 14:33 |
| *** soren has quit IRC | 14:33 | |
| *** soren has joined #openstack-infra | 14:33 | |
| fungi | okay, paste.o.o seems to be behaving better now that the offending client has been blocked and the service restarted again | 14:33 |
| mordred | yay! | 14:34 |
| *** Guest36150 has quit IRC | 14:34 | |
| *** dustins has quit IRC | 14:35 | |
| jeblair | mrmartin: done! | 14:35 |
| jeblair | mrmartin: sorry about that | 14:35 |
| mrmartin | jeblair: thnx! | 14:35 |
| *** afazekas has quit IRC | 14:36 | |
| fungi | we've got other spiders in the access logs on paste.o.o too, and it looks like we're not serving a /robots.txt | 14:36 |
| mordred | oh. we should serve one of those | 14:37 |
| *** signed8bit has joined #openstack-infra | 14:38 | |
| jeblair | what should it say? | 14:38 |
| *** annegentle has joined #openstack-infra | 14:38 | |
| Clint | "go home, Java/1.8.0_45, you're drunk" | 14:38 |
| *** annegentle is now known as Guest20574 | 14:38 | |
| fungi | hah | 14:38 |
| fungi | yeah, i'm not convinced that we should disallow spidering of the paste site. it doesn't have a content index, so in theory only pastes referenced from somewhere else would get spidered | 14:40 |
| fungi | perhaps that same spider was indexing our newly-htmlified irc logs | 14:40 |
| Clint | you could put Crawl-delay: 5 or something | 14:40 |
| *** vlaza has quit IRC | 14:41 | |
| *** bdemers has quit IRC | 14:41 | |
| fungi | yeah, 290 hits from that same client address in the eavesdrop apache logs for today | 14:42 |
| fungi | the bot wasn't providing referrer headers, so not certain that's where it was getting them, but it's a good bet | 14:42 |
| fungi | also, if it's not a well-behaved bot (for example someone crawling looking for security vulnerabilities to exploit) then a robots.txt is unlikely to help at all | 14:43 |
| fungi | and given that this client lacked even a well-formed reverse dns entry, that seems possible | 14:44 |
| *** e0ne is now known as e0ne_ | 14:44 | |
| *** xyang1 has joined #openstack-infra | 14:44 | |
| *** ghostpl has joined #openstack-infra | 14:46 | |
| *** jasondotstar has joined #openstack-infra | 14:46 | |
| *** stevemar has joined #openstack-infra | 14:46 | |
| *** bdemers has joined #openstack-infra | 14:47 | |
| *** thedodd has joined #openstack-infra | 14:47 | |
| *** flepied1 has quit IRC | 14:47 | |
| *** Guest20574 is now known as agentle | 14:47 | |
| *** sergmelikyan has joined #openstack-infra | 14:47 | |
| *** lennyb_ has quit IRC | 14:47 | |
| *** shardy has quit IRC | 14:47 | |
| *** shardy has joined #openstack-infra | 14:48 | |
| *** e0ne_ is now known as e0ne | 14:49 | |
| *** heyongli has quit IRC | 14:49 | |
| *** tosky has joined #openstack-infra | 14:50 | |
| jeblair | fungi: they may have just been using openstack. | 14:50 |
| fungi | hah | 14:50 |
| *** heyongli has joined #openstack-infra | 14:50 | |
| *** sdake has joined #openstack-infra | 14:51 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: Add script for targeting bugs from the command line https://review.openstack.org/194688 | 14:51 |
| *** _nadya_ has quit IRC | 14:52 | |
| *** Ala has quit IRC | 14:52 | |
| *** erlon has joined #openstack-infra | 14:52 | |
| *** _nadya_ has joined #openstack-infra | 14:53 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: Add --no-clear flag to adjust_blueprints.py https://review.openstack.org/194689 | 14:55 |
| *** Hal has joined #openstack-infra | 14:55 | |
| *** Hal is now known as Guest15326 | 14:56 | |
| *** yamamoto has quit IRC | 14:56 | |
| *** _nadya_ has quit IRC | 14:58 | |
| openstackgerrit | Sean Dague proposed openstack/requirements: bump python-openstack client to 1.6.0 https://review.openstack.org/194692 | 14:58 |
| *** yamahata has joined #openstack-infra | 14:59 | |
| *** sergmelikyan has quit IRC | 15:00 | |
| *** annegentle_ has joined #openstack-infra | 15:00 | |
| *** sergmelikyan has joined #openstack-infra | 15:00 | |
| *** agentle has quit IRC | 15:00 | |
| *** unicell has joined #openstack-infra | 15:01 | |
| *** shardy has quit IRC | 15:01 | |
| *** yamamoto has joined #openstack-infra | 15:01 | |
| *** ddieterly has joined #openstack-infra | 15:02 | |
| *** unicell1 has quit IRC | 15:02 | |
| *** shardy has joined #openstack-infra | 15:02 | |
| *** sabeen1 has joined #openstack-infra | 15:03 | |
| *** sarob has joined #openstack-infra | 15:03 | |
| *** samuelBartel has quit IRC | 15:04 | |
| *** hdd has joined #openstack-infra | 15:04 | |
| *** bauzas is now known as JustinBieber | 15:04 | |
| *** JustinBieber is now known as NotJustinBieber | 15:05 | |
| *** Ala has joined #openstack-infra | 15:05 | |
| *** NotJustinBieber is now known as bauzas | 15:06 | |
| *** ghostpl has quit IRC | 15:06 | |
| *** claudiub has quit IRC | 15:07 | |
| *** fhubik is now known as fhubik_afk | 15:07 | |
| *** r-daneel has joined #openstack-infra | 15:07 | |
| *** mrunge has quit IRC | 15:08 | |
| *** fhubik_afk is now known as fhubik | 15:08 | |
| *** arxcruz has quit IRC | 15:10 | |
| *** claudiub has joined #openstack-infra | 15:10 | |
| *** sergmelikyan has quit IRC | 15:10 | |
| *** sarob has quit IRC | 15:10 | |
| *** isviridov_away is now known as isviridov | 15:10 | |
| *** ghostpl has joined #openstack-infra | 15:11 | |
| *** sshnaidm has quit IRC | 15:13 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for grenade + neutron + glance bug 1467972 https://review.openstack.org/194704 | 15:15 |
| openstack | bug 1467972 in grenade "new (liberty) side of check-grenade-dsvm-neutron fails with auth error in g-api" [Undecided,New] https://launchpad.net/bugs/1467972 | 15:15 |
| *** sabeen2 has joined #openstack-infra | 15:16 | |
| *** samuelBartel has joined #openstack-infra | 15:16 | |
| *** sshnaidm has joined #openstack-infra | 15:16 | |
| *** dannywilson has joined #openstack-infra | 15:16 | |
| *** esker has quit IRC | 15:16 | |
| *** Ala has quit IRC | 15:16 | |
| *** shardy has quit IRC | 15:18 | |
| *** shardy has joined #openstack-infra | 15:18 | |
| *** sabeen1 has quit IRC | 15:19 | |
| *** dannywil_ has joined #openstack-infra | 15:19 | |
| *** dannywilson has quit IRC | 15:20 | |
| openstackgerrit | Neil Jerram proposed openstack-infra/project-config: Add stackforge/networking-calico project https://review.openstack.org/194709 | 15:21 |
| *** erikmwilson_ has joined #openstack-infra | 15:22 | |
| *** fhubik has quit IRC | 15:23 | |
| *** sshnaidm has quit IRC | 15:25 | |
| openstackgerrit | Wayne Warren proposed openstack-infra/infra-specs: Add JJB DSL Roadmap spec. https://review.openstack.org/194497 | 15:25 |
| *** erikmwilson is now known as Guest40840 | 15:25 | |
| *** erikmwilson_ is now known as erikmwilson | 15:25 | |
| *** erikmwilson_ has joined #openstack-infra | 15:25 | |
| sdague | dstufft: well, I'm 2 hours into a reproduce, but it looks like this will be at least an all day afair. So I'm going to bail on that. If I see it again I'll try to freeze the env to look at it | 15:25 |
| *** mpaolino has quit IRC | 15:25 | |
| dstufft | sdague: thanks, and no problem | 15:25 |
| *** amotoki has quit IRC | 15:26 | |
| *** sshnaidm has joined #openstack-infra | 15:26 | |
| *** pblaho has quit IRC | 15:26 | |
| *** changbl_ has joined #openstack-infra | 15:28 | |
| *** yuikotakada has joined #openstack-infra | 15:28 | |
| *** sarob has joined #openstack-infra | 15:29 | |
| *** flepied has joined #openstack-infra | 15:29 | |
| *** yuikotakada has left #openstack-infra | 15:31 | |
| *** annegentle_ is now known as agentle | 15:31 | |
| *** yfried has quit IRC | 15:32 | |
| *** armax has joined #openstack-infra | 15:33 | |
| *** mestery has joined #openstack-infra | 15:34 | |
| *** amotoki has joined #openstack-infra | 15:35 | |
| *** mestery_ has joined #openstack-infra | 15:35 | |
| *** dimtruck is now known as zz_dimtruck | 15:36 | |
| *** shardy has quit IRC | 15:36 | |
| *** shardy has joined #openstack-infra | 15:37 | |
| *** hashar has quit IRC | 15:37 | |
| *** HeOS has quit IRC | 15:37 | |
| openstackgerrit | Aleksandra Fedorova proposed openstack-infra/project-config: Fix fuel-docs acls to allow merge commit https://review.openstack.org/194717 | 15:38 |
| *** kushal has joined #openstack-infra | 15:38 | |
| *** mestery has quit IRC | 15:39 | |
| *** mestery_ is now known as mestery | 15:40 | |
| *** ihrachyshka has quit IRC | 15:42 | |
| *** sdake has quit IRC | 15:42 | |
| *** shardy has quit IRC | 15:42 | |
| *** zz_dimtruck is now known as dimtruck | 15:42 | |
| greghaynes | mordred: For putting in a req to replace NIC's in hp1, is there info on where / how to do that somewhere? | 15:43 |
| *** marun has joined #openstack-infra | 15:43 | |
| *** shardy has joined #openstack-infra | 15:43 | |
| jeblair | greghaynes: (when you find out the answer, we should add it to the system-config documentation for infra-cloud) | 15:43 |
| scheuran | Hi, I submitted a request for a new stackforge project a week ago. Is it possible to get that approved soon? | 15:44 |
| scheuran | https://review.openstack.org/#/c/189644/ | 15:44 |
| greghaynes | jeblair: definitely | 15:44 |
| sdague | dstufft: so, another interesting thing. pip install python-openstackclient>=1.0.3 when 1.0.4 is installed is not a no op | 15:45 |
| sdague | it reinstalls all the dependencies to versions | 15:45 |
| sdague | specified in python-openstackclient package | 15:45 |
| dstufft | sdague: without a -U? | 15:45 |
| *** e0ne is now known as e0ne_ | 15:46 | |
| *** e0ne_ is now known as e0ne | 15:47 | |
| sdague | dstufft: without -U | 15:47 |
| sdague | http://logs.openstack.org/93/194193/1/check/check-grenade-dsvm/180776a/logs/grenade.sh.txt.gz#_2015-06-22_16_08_47_676 | 15:47 |
| *** ajmiller has joined #openstack-infra | 15:48 | |
| *** cdent has quit IRC | 15:49 | |
| dstufft | sdague: oh right, it's not supposed to be a no-op, it re-verifies that all of the dependencies are installed (and if they don't match the version specifier, will do something to make them match) | 15:49 |
| openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: Add datasource functionality https://review.openstack.org/194265 | 15:49 |
| *** cdent has joined #openstack-infra | 15:49 | |
| dstufft | sdague: is that the command that was failing with seeing an old python-openstackclient? | 15:49 |
| sdague | dstufft: this is actually a different issue | 15:49 |
| dstufft | because that has a manual wheel cache too | 15:49 |
| dstufft | ok | 15:49 |
| sdague | though, that's how we call things in devstack, so we probably want to address that as well | 15:50 |
| sdague | the manual wheel cache bit | 15:50 |
| sdague | but, this non "no-op" behavior is actually currently masking a requirements issue | 15:50 |
| *** bdemers has quit IRC | 15:50 | |
| *** armax has quit IRC | 15:50 | |
| sdague | or more importantly, let one slip in | 15:50 |
| *** hichihara has quit IRC | 15:51 | |
| *** marun has quit IRC | 15:51 | |
| thingee | mordred: http://lists.openstack.org/pipermail/openstack-dev/2015-June/067795.html | 15:52 |
| *** puranamr has joined #openstack-infra | 15:53 | |
| dtantsur | hey folks, if you have some time, have a look at https://review.openstack.org/#/c/193941/ please, we're really looking forward to our first devstack check job :) | 15:53 |
| *** bdemers has joined #openstack-infra | 15:53 | |
| *** fawadkhaliq has joined #openstack-infra | 15:53 | |
| greghaynes | fungi: any idea if the rax dib images worked last night? | 15:54 |
| *** abregman has quit IRC | 15:54 | |
| greghaynes | fungi: hrm, actually, we might not have updated nodepool | 15:54 |
| fungi | thingee: i'll reply on the ml, but having cinderclient stop working with existing cinder deployments (and expecting deployers to adjust their configs to accommodate it) seems problematic | 15:54 |
| *** marun has joined #openstack-infra | 15:55 | |
| fungi | thingee: even worse, expecting deployers to apply a patch to their systems to accommodate new client behavior | 15:55 |
| *** erikmwil_ has joined #openstack-infra | 15:56 | |
| *** laughterwym has quit IRC | 15:56 | |
| *** devvesa has quit IRC | 15:56 | |
| fungi | sort of the opposite of having backward-compatible clients | 15:56 |
| thingee | fungi: I agree. I was talking to ttx this morning about it and the other concern was removing version discovery after it has been released. I'm not sure how many people started adjusting their service catalogs with no versions set for cinder. | 15:56 |
| *** erikmwil_ has quit IRC | 15:56 | |
| *** erikmwil_ has joined #openstack-infra | 15:57 | |
| fungi | yeah, quite the pickle | 15:57 |
| clarkb | can turn it off by default? | 15:57 |
| jeblair | greghaynes: logs here http://nodepool.openstack.org/ | 15:57 |
| *** ghostpl has quit IRC | 15:57 | |
| *** erikmwilson has quit IRC | 15:57 | |
| *** erikmwil_ is now known as erikmwilson | 15:57 | |
| jeblair | greghaynes: and yes, i don't think anyone restarted nodepool | 15:57 |
| *** rwsu has quit IRC | 15:58 | |
| jeblair | greghaynes: running since Jun19. want me to restart now? | 15:58 |
| fungi | yeah, last started june 19 | 15:58 |
| greghaynes | actually, we might not have to - it was a glean release which is pulled in by DIB so it should have just pulled in the new version on image build | 15:58 |
| openstackgerrit | Marton Kiss proposed openstack-infra/groups: Stop importing data from groups.json https://review.openstack.org/194082 | 15:58 |
| fungi | image updates may be in process right now | 15:58 |
| *** ZZelle is now known as ZZelle-away | 15:58 | |
| fungi | not sure if nodepoold recovers sanely from a restart in the middle of image updates | 15:58 |
| jeblair | anyone want to implement the remote image builder for nodepool? :) | 15:59 |
| greghaynes | O/ | 15:59 |
| *** unicell has quit IRC | 15:59 | |
| *** dboik_ has joined #openstack-infra | 15:59 | |
| *** dboik_ has quit IRC | 15:59 | |
| jeblair | greghaynes: aren't you infra-clouding? :) | 15:59 |
| greghaynes | just give me 10mins | 15:59 |
| greghaynes | :p | 15:59 |
| *** dboik_ has joined #openstack-infra | 15:59 | |
| jeblair | oh, okay, i guess we can spare you for 10 mins :) | 15:59 |
| *** gordc_ has joined #openstack-infra | 15:59 | |
| jeblair | http://specs.openstack.org/openstack-infra/infra-specs/specs/nodepool-workers.html | 15:59 |
| *** gordc has quit IRC | 16:00 | |
| fungi | we did restart it after the gear release at least, yeah? | 16:00 |
| *** gordc_ is now known as gordc | 16:00 | |
| *** chen12 has quit IRC | 16:00 | |
| fungi | timing is close, so i'm assuming so | 16:00 |
| jeblair | fungi: not sure, but zuul is the important part of that one anyway | 16:00 |
| jeblair | bug was geard-side | 16:00 |
| fungi | ohhhh | 16:00 |
| *** chen12 has joined #openstack-infra | 16:01 | |
| *** dtantsur is now known as dtantsur|afk | 16:01 | |
| *** yamamoto has quit IRC | 16:01 | |
| fungi | for some reason i thought we were causing socket buffering issues in nodepoold while image uploads to glance were happening | 16:01 |
| *** otter768 has joined #openstack-infra | 16:02 | |
| *** juggler_ is now known as juggler | 16:02 | |
| fungi | and that was causing the gear client to not successfully submit admin requests | 16:02 |
| greghaynes | hrm, that does bring up a good point... the upload was happening from nodepool | 16:02 |
| * fungi completely misunderstood the problem there | 16:02 | |
| jeblair | fungi: first half is correct, but the full tcp windows on nodepool.o.o were causing geard to stop sending the response | 16:02 |
| fungi | aha | 16:02 |
| greghaynes | oh, windows were effecting the other side | 16:02 |
| *** bdemers has quit IRC | 16:03 | |
| jeblair | right. but then the client timed out because it never got a response | 16:03 |
| fungi | the tcp version of spooky action at a distance | 16:03 |
| greghaynes | hah | 16:03 |
| *** dboik has quit IRC | 16:03 | |
| * jeblair thinks all networking is spooky action at a distance | 16:03 | |
| *** bexelbie has quit IRC | 16:03 | |
| *** jgrimm is now known as zz_jgrimm | 16:03 | |
| *** ghostpl has joined #openstack-infra | 16:04 | |
| *** bdemers has joined #openstack-infra | 16:04 | |
| *** armax has joined #openstack-infra | 16:05 | |
| *** yfried has joined #openstack-infra | 16:05 | |
| *** sdake has joined #openstack-infra | 16:05 | |
| *** samuelBartel has quit IRC | 16:06 | |
| *** ayoung is now known as ayoung-lunch | 16:06 | |
| openstackgerrit | Sean Dague proposed openstack/requirements: bump python-openstack client to 1.5.0 https://review.openstack.org/194692 | 16:06 |
| jeblair | is there a reason that we aren't using dib for all image types on hpcloud? | 16:06 |
| *** otter768 has quit IRC | 16:07 | |
| jeblair | (or are we?) | 16:07 |
| greghaynes | I thought we were for most, not 100% sure its all | 16:07 |
| jeblair | it just looks like we have some -dib suffixes still | 16:07 |
| *** SumitNaiksatam has quit IRC | 16:08 | |
| jeblair | it looks like we have both devstack-trusty and devstack-trusty-dib in hpcloud | 16:08 |
| *** armax has quit IRC | 16:08 | |
| *** yamamoto has joined #openstack-infra | 16:08 | |
| *** SumitNaiksatam has joined #openstack-infra | 16:08 | |
| jeblair | er wait that's wrong | 16:08 |
| jeblair | the only dib images we have configured are devstack-centos7-dib and devstack-fedora21-dib | 16:09 |
| jeblair | and we have a non-dib version of centos7, but only dib of f21 | 16:10 |
| greghaynes | devstack-trusty looks like its dib | 16:10 |
| greghaynes | or you mean only *-dib images? | 16:11 |
| jeblair | greghaynes: oh you are right, we've moved that over completely on hp | 16:11 |
| fungi | the devstack variants are dib'able, the bare variants are not yet. back to working now on that bit | 16:11 |
| greghaynes | fungi: oh? Why arent the bare? | 16:11 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Bring in module to manage update-alternatives https://review.openstack.org/171556 | 16:12 |
| jeblair | fungi: ah, that's a piece i was missing, thanks. | 16:12 |
| fungi | greghaynes: database setup | 16:12 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Add puppet-community/archive module https://review.openstack.org/164569 | 16:12 |
| greghaynes | ah, I didnt realize that was required for -bare | 16:12 |
| fungi | i'm trying to follow the twisty path of dib elements to figure out when pip is getting reinstalled in cache-devstack | 16:12 |
| *** achanda has joined #openstack-infra | 16:12 | |
| greghaynes | fun | 16:12 |
| jeblair | fungi: or we could punt on that and move it to job setup. | 16:12 |
| fungi | how does http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/cache-devstack/source-repository-pip get invoked? | 16:12 |
| jeblair | which i think we wanted to do eventually anyway? | 16:12 |
| greghaynes | fungi: check out the source-repositories element README | 16:13 |
| *** nihilifer has quit IRC | 16:13 | |
| mordred | jeblair: ++ | 16:13 |
| greghaynes | fungi: all that does is download that url to that location, and allow overriding | 16:13 |
| *** RichardRaseley has joined #openstack-infra | 16:13 | |
| fungi | jeblair: that's the plan, but we need bindep installing all the distro reqs for databases et al | 16:13 |
| nibalizer | pabelanger: so I think this is actually going to fix the users/packages/uids problem https://review.openstack.org/#/c/161048/ | 16:13 |
| nibalizer | interesed in your thoughts | 16:14 |
| jeblair | fungi: oh, okay, gotcha. | 16:14 |
| fungi | so trying to make sure i create the bindep env after pip is installed, but still early enough to cache distro packages | 16:14 |
| fungi | i may need to reorder some of the extsting element install.d components | 16:14 |
| greghaynes | fungi: ah, so youll want to find the thing that exec's get-pip.py, that just does the download | 16:14 |
| openstackgerrit | Merged openstack-infra/groups: Stop importing data from groups.json https://review.openstack.org/194082 | 16:14 |
| mordred | jeblair, fungi: as a stepping stone, couldln't we just make a jjb macros that does "apt-get install mysql-server" ? - like, we don't have to have the final solution for general package install to get mysql installed | 16:14 |
| *** agentle has quit IRC | 16:15 | |
| *** bexelbie_ has quit IRC | 16:15 | |
| *** nfedotov has quit IRC | 16:16 | |
| fungi | mordred: sure, if we want to just go ahead and create bare-.* images via dib rather than moving the jobs to devstack-.* workers instead | 16:16 |
| fungi | i've basically already got the plumbing for that working as an experimental job example | 16:16 |
| *** tonytan4ever has quit IRC | 16:17 | |
| greghaynes | fungi: looks like that sticks get-pip in a place where its pre-cached for devstack/tools/install_pip to run it | 16:17 |
| *** ddieterly has quit IRC | 16:17 | |
| *** scheuran has quit IRC | 16:17 | |
| fungi | greghaynes: oh, so it's not actually used to update pip on the image | 16:18 |
| pabelanger | nibalizer, Ya, I think stages are the best. In fact, I was going to work on something related to apt-get update in a new stage | 16:18 |
| jeblair | ianw: what's the difference between devstack-f21 and devstack-fedora21-dib ? | 16:18 |
| greghaynes | fungi: I dont think so, no | 16:18 |
| *** esker has joined #openstack-infra | 16:18 | |
| pabelanger | but I can give a quick run and see how it works | 16:18 |
| greghaynes | fungi: meaning I couldnt find anything running get-pip using grep | 16:18 |
| *** maxskew has joined #openstack-infra | 16:18 | |
| fungi | greghaynes: thanks, that makes things simpler i think | 16:18 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Create grafana.o.o under -infra https://review.openstack.org/179208 | 16:18 |
| jeblair | pabelanger: ! | 16:19 |
| pabelanger | yolanda, ^ I think that should get you want you need | 16:19 |
| clarkb | I thought stages were an anti pattern in puppet | 16:19 |
| nibalizer | pabelanger: are you seeing apt-get update problems? | 16:19 |
| nibalizer | like around ppas or whatever? | 16:20 |
| clarkb | greghaynes fungi correct thats just a cache step for devstack it does not install pip, the puppet install should install pip | 16:20 |
| *** mpavone has quit IRC | 16:20 | |
| clarkb | using install_puppet.sh | 16:20 |
| greghaynes | oh fun | 16:20 |
| pabelanger | nibalizer, in the past, I did. but nothing recently. I did notice something today about apt-get update during mid run | 16:20 |
| *** ashleighfarnham has joined #openstack-infra | 16:21 | |
| *** esker has quit IRC | 16:21 | |
| pabelanger | nibalizer, what I would do in the past was create a bootstrap stage in puppet: https://github.com/kickstandproject/kickstandproject-ci-puppet/blob/master/modules/kickstandproject/manifests/node/base/bootstrap.pp | 16:21 |
| pabelanger | which ran before main | 16:21 |
| mordred | greghaynes, fungi: the dib elements are in need of a re-org - but I've been waiting until we stopped having non-dib images | 16:21 |
| pabelanger | seemed to fix all my apt issues | 16:21 |
| *** samueldmq has quit IRC | 16:21 | |
| *** yamamoto has quit IRC | 16:21 | |
| jeblair | timrc, yolanda, nibalizer, or anyone else: interested in reviewing grafyaml patches? | 16:21 |
| mordred | because there are places where we're split how we are to make maintaining two parallel implemntations of the images easier | 16:22 |
| greghaynes | yea, makes sense | 16:22 |
| greghaynes | get all moved over then start making dib-specific fixes | 16:22 |
| mordred | and once we only have _one_ area and it's the dib elements, refactoring them into nicely reusable chunks should be easier | 16:22 |
| mordred | yah | 16:22 |
| nibalizer | jeblair: sure, i've got some plane time today so ill try to look at them then | 16:22 |
| *** marun has quit IRC | 16:23 | |
| nibalizer | pabelanger: that doesn't help when one of your puppet tasks is to add an apt repo | 16:23 |
| *** salv-orlando has joined #openstack-infra | 16:23 | |
| nibalizer | another cute trick is to add a fact that runs apt-get update | 16:23 |
| nibalizer | but the modern apt module is supposed to DTRT | 16:24 |
| *** madong_ has quit IRC | 16:24 | |
| pabelanger | nibalizer, right, for me I already moved my apt tasks into bootstrap, and didn't have the puppet-module manage it. Not the best, but worked for me | 16:24 |
| *** samueldmq has joined #openstack-infra | 16:24 | |
| *** yfried has quit IRC | 16:24 | |
| clarkb | ya could the provider trap errors, update then retry? | 16:24 |
| *** madong_ has joined #openstack-infra | 16:24 | |
| *** sshnaidm has quit IRC | 16:24 | |
| pabelanger | However, I'm not seeing apt errors right now. More about getting a new stage going | 16:24 |
| *** yamahata has quit IRC | 16:24 | |
| pabelanger | either way, just brain dumping | 16:25 |
| *** yamamoto has joined #openstack-infra | 16:26 | |
| *** yfried has joined #openstack-infra | 16:28 | |
| mordred | have i mentioned that a provider that does dpkg --set-selections foo and then apt-get dselect-upgrade would be neat | 16:28 |
| *** esmute__ has quit IRC | 16:28 | |
| *** mestery has quit IRC | 16:28 | |
| mordred | because then there would be one and only one run of "please change the set of installed packages | 16:28 |
| *** e0ne has quit IRC | 16:29 | |
| mordred | and other tasks could depend on "packages up to date" | 16:29 |
| *** Swami has joined #openstack-infra | 16:29 | |
| *** krtaylor has quit IRC | 16:29 | |
| *** markus_z has quit IRC | 16:29 | |
| * mordred waits for nibalizer to go rage code that ... | 16:29 | |
| *** puranamr has quit IRC | 16:30 | |
| *** rossella_s has quit IRC | 16:30 | |
| *** dims has quit IRC | 16:30 | |
| nibalizer | haha one does not simply make puppet more efficient | 16:30 |
| *** rossella_s has joined #openstack-infra | 16:31 | |
| nibalizer | there have been millions of suggestions to make packages batch and they all eventually get shot down, it sucks | 16:31 |
| *** puranamr has joined #openstack-infra | 16:31 | |
| nibalizer | mordred: would you like to reconsider your -1 on https://review.openstack.org/#/c/177320/ ? I'm pretty sure you and clark are just reading it wrong, it already does what we want | 16:32 |
| *** dims has joined #openstack-infra | 16:33 | |
| mordred | nibalizer: done | 16:34 |
| greghaynes | mordred: hey, did you see my Q about hp server NIC's - any idea where I should look for info on where we file tickets / what info they need? | 16:34 |
| mordred | ah! let me send you an email intro | 16:34 |
| greghaynes | mordred: ok, ty | 16:35 |
| greghaynes | mordred: SpamapS ^ you should probably be on there too | 16:35 |
| jeblair | nibalizer: oh rock on with progress on that :) | 16:36 |
| *** yamamoto has quit IRC | 16:38 | |
| *** jlanoux has quit IRC | 16:38 | |
| *** chlong has quit IRC | 16:39 | |
| openstackgerrit | Geoff Arnold proposed openstack-infra/irc-meetings: Add Mercador project meeting to IRC. https://review.openstack.org/194738 | 16:40 |
| *** jerryz has joined #openstack-infra | 16:40 | |
| mordred | greghaynes: oh - oops, I just emailed you | 16:40 |
| fungi | greghaynes: i hate to keep asking dense dib questions, but can you enlighten me as to when the source repositories are cloned? is it before or after install.d stages run? | 16:40 |
| greghaynes | mordred: ill just forward replies to SpamapS / add him if I reply | 16:41 |
| mordred | greghaynes: k. I just replied all and added him | 16:41 |
| greghaynes | fungi: psh, ask away on DIB | 16:41 |
| *** mrmartin has quit IRC | 16:41 | |
| *** geoffarnold has joined #openstack-infra | 16:41 | |
| greghaynes | fungi: it happens in extra-data.d phase | 16:41 |
| fungi | greghaynes: does that run before or after install.d? | 16:41 |
| *** hdd has quit IRC | 16:41 | |
| *** fawadk has joined #openstack-infra | 16:42 | |
| fungi | or concurrent with, interleaved by priority number? | 16:42 |
| greghaynes | fungi: before, the idea is that is a phase right after you get rootfs installed where elements can copy in extra stuff to the chroot | 16:42 |
| fungi | greghaynes: okay, perfect--thanks again! | 16:42 |
| *** fawadkhaliq has quit IRC | 16:42 | |
| greghaynes | fungi: http://git.openstack.org/cgit/openstack/diskimage-builder/tree/elements/source-repositories/extra-data.d/98-source-repositories is the codes, FWIW | 16:43 |
| *** davideagnello has quit IRC | 16:43 | |
| *** jasondotstar has quit IRC | 16:43 | |
| mordred | greghaynes: http://git.openstack.org/cgit/openstack/diskimage-builder/tree/README.rst#n284 | 16:43 |
| mordred | gah | 16:43 |
| mordred | fungi: http://git.openstack.org/cgit/openstack/diskimage-builder/tree/README.rst#n284 | 16:43 |
| mordred | fungi: you may find that a useful thing to keep bookmarked | 16:43 |
| fungi | greghaynes: ahh, perfect | 16:44 |
| fungi | mordred: yep, will rtfm for a bit | 16:44 |
| greghaynes | we even have pretty docs for that part now http://docs.openstack.org/developer/diskimage-builder/ | 16:44 |
| *** davideagnello has joined #openstack-infra | 16:44 | |
| fungi | ooh! | 16:44 |
| mordred | http://docs.openstack.org/developer/diskimage-builder/developer/developing_elements.html#phase-subdirectories then | 16:45 |
| pleia2 | so, I've got this zanata review in the queue https://review.openstack.org/#/c/193677/ and when it lands I'll need to set up the infra account, do we have an infra openstackid account? or have any thoughts there? | 16:45 |
| fungi | pleia2: interesting. no afaik we don't have any service accounts for our infra yet (unless groups.o.o uses one maybe) | 16:46 |
| fungi | mrmartin isn't around at the moment | 16:46 |
| fungi | nor smarcet | 16:46 |
| *** baoli has quit IRC | 16:46 | |
| *** SumitNaiksatam has quit IRC | 16:49 | |
| *** unicell has joined #openstack-infra | 16:49 | |
| *** hdd has joined #openstack-infra | 16:50 | |
| pleia2 | fungi: hm, maybe a meeting topic? | 16:50 |
| *** marzif_ has joined #openstack-infra | 16:50 | |
| *** ayoung-lunch is now known as ayoung-burp | 16:50 | |
| fungi | pleia2: yep, good idea | 16:50 |
| pleia2 | k, adding | 16:50 |
| fungi | maybe one of them will be present for the meeting | 16:51 |
| *** baoli has joined #openstack-infra | 16:51 | |
| *** krtaylor has joined #openstack-infra | 16:51 | |
| *** AzherKhan has joined #openstack-infra | 16:51 | |
| *** ayoung-burp is now known as ayoung | 16:51 | |
| *** ildikov has quit IRC | 16:51 | |
| *** esmute__ has joined #openstack-infra | 16:52 | |
| *** shardy has quit IRC | 16:52 | |
| *** jasondotstar has joined #openstack-infra | 16:52 | |
| *** shardy has joined #openstack-infra | 16:53 | |
| *** yfried has quit IRC | 16:53 | |
| jeblair | pleia2, fungi: i guess we could make one with one of our email addresses? (is maybe one option to consider) | 16:53 |
| *** kdas_ has joined #openstack-infra | 16:54 | |
| pleia2 | could do | 16:55 |
| *** yamamoto has joined #openstack-infra | 16:55 | |
| *** marzif has quit IRC | 16:56 | |
| *** sergmelikyan has joined #openstack-infra | 16:56 | |
| SpamapS | TheJulia: finally getting around to trying your gPXE patch. | 16:56 |
| *** cdent has left #openstack-infra | 16:56 | |
| *** kushal has quit IRC | 16:58 | |
| fungi | jeblair: seems like a reasonable option if all we need is a normal user account | 16:59 |
| fungi | we can presumably change it later | 16:59 |
| *** BobBall is now known as BobBall_AWOL | 16:59 | |
| *** shardy has quit IRC | 17:00 | |
| *** shardy has joined #openstack-infra | 17:00 | |
| *** patrickeast has joined #openstack-infra | 17:00 | |
| *** esker has joined #openstack-infra | 17:00 | |
| *** zz_jgrimm is now known as jgrimm | 17:01 | |
| *** dontalton has joined #openstack-infra | 17:01 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Load in nanliu/git module https://review.openstack.org/164355 | 17:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: WIP: Create dotfiles type for testing environments https://review.openstack.org/194744 | 17:01 |
| rbradfor | could I get some help please re: jenkins gates defined in zuul/layout.yaml | 17:03 |
| *** baoli has quit IRC | 17:03 | |
| *** husanu has quit IRC | 17:03 | |
| pabelanger | jeblair, So, just added a simple patch to puppet to allow additional dotfiles to be installed when the environment is flagged as something other then production. | 17:04 |
| pabelanger | would be interested in peoples thoughts | 17:04 |
| *** esker has quit IRC | 17:04 | |
| pabelanger | eg: puppet hackers :) | 17:05 |
| *** husanu has joined #openstack-infra | 17:05 | |
| *** shardy has quit IRC | 17:05 | |
| samueldmq | /query sdague | 17:05 |
| samueldmq | oh sorry :-) | 17:05 |
| *** shardy has joined #openstack-infra | 17:06 | |
| *** fawadk has quit IRC | 17:06 | |
| mordred | nibalizer: | 17:07 |
| mordred | fail('Only RedHat family supported, and require redhat-lsb package or lsb module.') | 17:07 |
| *** rkukura has quit IRC | 17:07 | |
| jeblair | pabelanger, mordred: whenever someone says "dotfile" i think graphviz. | 17:08 |
| *** DericHorn-HP has joined #openstack-infra | 17:08 | |
| *** rkukura has joined #openstack-infra | 17:08 | |
| *** rguillebert has quit IRC | 17:08 | |
| mordred | jeblair: ++ | 17:09 |
| jeblair | pabelanger: that feels like a bit of special privilege since you happen to have root on a machine; this doesn't look like it would scale out to others... | 17:09 |
| *** dizquierdo has quit IRC | 17:10 | |
| jeblair | pabelanger: whenever i'm testing with puppet, i spin up nodes via a mechanism that already sets up my user account before puppet is run, so it installs anything my account needs prior to that | 17:11 |
| *** bdemers has quit IRC | 17:12 | |
| pabelanger | jeblair, Right, this is unique to people that are already setup in users.pp. Which, doesn't scale like you said. | 17:12 |
| *** bdemers has joined #openstack-infra | 17:13 | |
| *** fitoduarte has joined #openstack-infra | 17:13 | |
| pabelanger | jeblair, Right, actually, I'm hoping the playbook to spin up nodes could use this code | 17:13 |
| pabelanger | some ability to extend the playbook to include external things for testing mode | 17:13 |
| openstackgerrit | Arkadiy Kraminsky proposed openstack-infra/puppet-zuul: add notification for existing pidfile https://review.openstack.org/194449 | 17:14 |
| pabelanger | so, the location of it is likely wrong, but if people are open to the idea, then we can figure out how to do it | 17:14 |
| pabelanger | for me, manually copying that over every time is tiresome :) | 17:14 |
| jeblair | pabelanger: that sounds like a good use case (then i can retire my script too) | 17:14 |
| *** pelix has quit IRC | 17:15 | |
| *** esmute__ has quit IRC | 17:15 | |
| jeblair | pabelanger: but assuming you have a local.pp version of site.pp, you could add a stanza like what you propose to that, right? | 17:15 |
| pabelanger | jeblair, right. For the most part, I don't have a local.pp right now. | 17:16 |
| *** AzherKhan has quit IRC | 17:16 | |
| jeblair | pabelanger: oh, do you have a puppetmaster? | 17:16 |
| pabelanger | no, I just do 'puppet apply' and things get installed | 17:17 |
| nibalizer | i sshfs from laptop to testnode so I have my vim and my git configuration | 17:17 |
| nibalizer | but can quickly iterate | 17:17 |
| pabelanger | right now, for grafana.o.o, I realize a localuser with my sshkey | 17:17 |
| pabelanger | like you said, I have that info in system-config | 17:17 |
| nibalizer | mordred: yes thats a fail message? | 17:17 |
| *** mrmartin has joined #openstack-infra | 17:17 | |
| jeblair | pabelanger: ah, the defaults in site.pp won't actually work for a lot of servers, i think, so generally we expect people to copy them and replace with something | 17:18 |
| pabelanger | jeblair, for the most part, its been okay for me | 17:18 |
| jeblair | yeah, i could see that working for some hosts | 17:18 |
| TheJulia | SpamapS: yay | 17:18 |
| pabelanger | jeblair, however.... I am thinking we need a testing hiera.yaml included to we can mock up environments | 17:19 |
| pabelanger | need to spend some time on building that out | 17:19 |
| pabelanger | right now, I don't have hiera.yaml | 17:19 |
| jeblair | pabelanger: check with nibalizer who's working on moving more data into a public hiera file | 17:19 |
| jeblair | pabelanger: http://specs.openstack.org/openstack-infra/infra-specs/specs/public_hiera.html | 17:20 |
| *** dboik_ has quit IRC | 17:20 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Trim user specific package a bit https://review.openstack.org/194751 | 17:20 |
| pabelanger | coolio | 17:20 |
| mordred | nibalizer: that's in the gitmodule you just proposed - it only supports redhat right now | 17:20 |
| mordred | nibalizer: otherwise, it looks great! | 17:20 |
| *** AzherKhan has joined #openstack-infra | 17:20 | |
| *** dguerri is now known as dguerri` | 17:21 | |
| nibalizer | pabelanger: https://review.openstack.org/#/c/177320/ would have hiera source a directory of data | 17:21 |
| nibalizer | mordred: thats only the git class, becuase redhat is bad at installing git | 17:22 |
| nibalizer | debian doesn't suffer this ailment | 17:22 |
| nibalizer | the key is the git { 'somerepo': } resource | 17:22 |
| mordred | nibalizer: yah - but that resource autorequires the git class | 17:22 |
| mordred | nibalizer: so the git class needs to not throw an error when it's instantiated | 17:22 |
| nibalizer | i mean I use this thing on debian a lot | 17:23 |
| mordred | really? | 17:23 |
| *** bdemers has quit IRC | 17:23 | |
| nibalizer | i think autorequires just adds a require if the thing is already in the graph|catalog thing | 17:23 |
| *** esker has joined #openstack-infra | 17:23 | |
| *** esker has quit IRC | 17:23 | |
| mordred | nibalizer: AH. gotcha | 17:23 |
| mordred | that makes sense then | 17:23 |
| nibalizer | mordred++ for reivewing libraries before they go in though | 17:23 |
| *** esmute__ has joined #openstack-infra | 17:24 | |
| *** esker has joined #openstack-infra | 17:24 | |
| mordred | nibalizer: fwiw, it seems like it would be dead-simple to add support for debians though, just saying | 17:24 |
| *** dboik has joined #openstack-infra | 17:24 | |
| nibalizer | yea | 17:24 |
| *** yamamoto has quit IRC | 17:24 | |
| AJaeger | jeblair: it should have gone to SUSE's infra team but somehow thunderbird autocompletion tricked me. Seems I use openstack-infra more often ;) | 17:25 |
| pabelanger | nibalizer, will check it out | 17:25 |
| mordred | nibalizer: btw - since public hiera is on the brain today - have you looked at https://review.openstack.org/#/c/179653/3/tools/remap_manifest.py ? | 17:25 |
| *** mestery has joined #openstack-infra | 17:25 | |
| pabelanger | nibalizer, do you have public yaml files now? | 17:25 |
| nibalizer | yea, i decided since I can't see the common.yaml file I have no context for what that code does | 17:25 |
| mordred | nibalizer: it's the script I wrote to split an existing hiera file into our new dir structure | 17:25 |
| mordred | nibalizer: well, you can see the gozer one | 17:25 |
| mordred | nibalizer: and the script _Should_ work there too | 17:26 |
| geoffarnold | Quick process question: I just submitted https://review.openstack.org/#/c/194738/ to schedule an IRC meeting, and it's passed the tox-ical gate. Is the eavesdrop setup automated, or does it require further action on my part? | 17:26 |
| *** esmute__ has quit IRC | 17:26 | |
| * nibalizer ponders | 17:26 | |
| mordred | nibalizer: concept being that it should read manifests/site.pp, figure out which nodes want which keys, and split the file accordingly | 17:26 |
| *** yfried has joined #openstack-infra | 17:26 | |
| *** harlowja has joined #openstack-infra | 17:26 | |
| *** patrickeast_ has joined #openstack-infra | 17:27 | |
| *** ildikov has joined #openstack-infra | 17:27 | |
| mordred | geoffarnold: you will still have to start the meeting at meeting time | 17:27 |
| *** esker has quit IRC | 17:27 | |
| mordred | geoffarnold: btw - I am in favor of enabling the federation of services ... | 17:27 |
| geoffarnold | That I understand. Just looking at the infra setup - eavesdrop, wiki, etc. | 17:28 |
| jeblair | wow, we do have meetbot documented here: http://docs.openstack.org/infra/system-config/irc.html#id3 but we did not document the #startmeeting command | 17:28 |
| geoffarnold | oops | 17:28 |
| jeblair | meetbot is documented here https://wiki.debian.org/MeetBot | 17:28 |
| jeblair | but we added the meeting name argument, so we should mention that | 17:29 |
| mordred | jeblair: maybe we should document that :) | 17:29 |
| *** bswartz has quit IRC | 17:29 | |
| *** whitenoise has left #openstack-infra | 17:29 | |
| * jeblair documents | 17:29 | |
| mrmartin | fungi, I've fixed the solr mirror pkg deprecated issue in ask-staging.o.o patch, may I ask you to do a review here: https://review.openstack.org/#/c/172880/ ? | 17:29 |
| *** baoli has joined #openstack-infra | 17:29 | |
| * mordred considers jeblair a fountain of documentation llamas | 17:29 | |
| fungi | mrmartin: thanks! i'll give it another try shortly | 17:30 |
| mrmartin | fungi: just the solr package we used was removed from the mirrors, so it must work now | 17:30 |
| fungi | mrmartin: also while you were off-channel pleia2 had a question you might be able to answer about having a service account for zanata to authenticate users against openstackid | 17:31 |
| *** rwsu has joined #openstack-infra | 17:31 | |
| mrmartin | oh great | 17:31 |
| openstackgerrit | Merged openstack-infra/irc-meetings: Add meeting for Magnum Networking Subgroup https://review.openstack.org/193694 | 17:31 |
| fungi | you got that working with groups.o.o so presumably have a better idea of what's involved than i do | 17:31 |
| mrmartin | yeap, openid works there well | 17:31 |
| * mrmartin happy to help to finalize zanata integration | 17:32 | |
| pleia2 | mrmartin: I added it to the meeting, pretty much just looking for how we should handle service accounts WRT openstackid | 17:32 |
| *** gyee_ has quit IRC | 17:33 | |
| mrmartin | what you mean on service account? | 17:33 |
| *** rwsu has quit IRC | 17:33 | |
| SpamapS | greghaynes: looks like TheJulia found a way to make bifrost work for us. :) | 17:33 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Document startmeeting in our meetbot fork https://review.openstack.org/194756 | 17:33 |
| pleia2 | mrmartin: an openstackid user for zanata that only runs infra-controlled scripts | 17:33 |
| jeblair | geoffarnold, mordred: https://review.openstack.org/194756 | 17:33 |
| mrmartin | pleia2: I guess we need to create a fake profile entry for that in openstack.org profile | 17:34 |
| pleia2 | mrmartin: ok | 17:34 |
| mrmartin | pleia2: but it is the easy part, I guess only web authentication was implemented for actual openstackid version | 17:34 |
| pleia2 | zanata supports openstackid already | 17:35 |
| *** flepied has quit IRC | 17:35 | |
| pleia2 | so we're fine with auth, this is all about the user we create | 17:35 |
| AJaeger | pleia2: currently I create new projects in transifex. How do you want to do this with Zanata? I'm happy to pass the job on... | 17:35 |
| *** esmute__ has joined #openstack-infra | 17:35 | |
| pleia2 | AJaeger: for new ones it may still be manual, StevenK's scripts will automatically pull over the current ones | 17:35 |
| *** amitgandhinz has quit IRC | 17:35 | |
| mrmartin | ok, than someone can create the fake account in openstack.org profile, and we have a special role field, that you can assign for the account to mark somehow it is a script, not a real human | 17:36 |
| *** gyee has joined #openstack-infra | 17:36 | |
| jeblair | (eventually we want to automate creating new projects) | 17:36 |
| geoffarnold | jeblair: This name has to match the "project:" in the yaml file? | 17:36 |
| pleia2 | mrmartin: ok, great | 17:36 |
| jeblair | geoffarnold: no, but it can, and it should be consistent from week to week | 17:36 |
| *** amitgandhinz has joined #openstack-infra | 17:36 | |
| jeblair | geoffarnold: it will be the name of the directory here: http://eavesdrop.openstack.org/meetings/ | 17:36 |
| geoffarnold | OK | 17:36 |
| *** ghostpl has quit IRC | 17:36 | |
| mrmartin | pleia2: an infra-core with an access to openstack.org database can do it quickly, it is just two sql insert | 17:37 |
| AJaeger | pleia2: great to hear for the migration case! | 17:37 |
| pleia2 | mrmartin: great, we've started by aiming this at openstackid-dev | 17:37 |
| mrmartin | yeah, it is the same there | 17:38 |
| pleia2 | mrmartin: are the user databases synced between -dev and prod? | 17:38 |
| AJaeger | pleia2: for new ones we need to eventually find a work flow and responsible persons | 17:38 |
| geoffarnold | so "#startmeeting networking_advanced_services" with the underscores, case sensitive | 17:38 |
| pleia2 | AJaeger: yeah, and we have an outstanding bug in zanata because currently any user can create projects (aaahhh) | 17:38 |
| *** amitgandhinz has quit IRC | 17:38 | |
| mrmartin | pleia2: I guess it is a manual process, and two db was not synced for a while | 17:38 |
| *** esmute__ has quit IRC | 17:38 | |
| *** amitgandhinz has joined #openstack-infra | 17:39 | |
| *** flepied has joined #openstack-infra | 17:39 | |
| AJaeger | pleia2: oops ;( | 17:39 |
| pleia2 | mrmartin: ok, good to know | 17:39 |
| geoffarnold | jeblair: I'd like to see that requirement actually in the doc update | 17:39 |
| *** rwsu has joined #openstack-infra | 17:39 | |
| *** ZZelle has joined #openstack-infra | 17:39 | |
| pleia2 | mrmartin: after I have the account set up I'll give you a ping so I can make the database change, thanks for your help | 17:40 |
| mrmartin | ok. | 17:40 |
| pleia2 | AJaeger: yeah, I'm worried it may actually be a show stopper for us with this version of Zanata, they're working on the bug with different roles/admin levels but it'll be in a future version | 17:41 |
| pleia2 | but I'm sure we'll bump into more issues when we go into testing mode with the translators in a couple weeks, so I'm plowing on ahead | 17:41 |
| *** rwsu has quit IRC | 17:42 | |
| *** rwsu has joined #openstack-infra | 17:43 | |
| *** tonytan4ever has joined #openstack-infra | 17:43 | |
| jeblair | geoffarnold: it is lowercased and unusual characters translated to underscores automatically | 17:44 |
| *** ghostpl has joined #openstack-infra | 17:44 | |
| *** marun has joined #openstack-infra | 17:44 | |
| pleia2 | doesn't production nodepool need pretty much full database access? re: https://review.openstack.org/#/c/170699/3/doc/source/installation.rst | 17:44 |
| *** RichardRaseley has quit IRC | 17:44 | |
| geoffarnold | Thanks. Just trying to minimize the amount of folklore :-) | 17:44 |
| jeblair | geoffarnold: so "#startmeeting Networking Advanced Services" is fine. or "#startmeeting networking advanced services" will both log to "networking_advanced_services" | 17:45 |
| jeblair | geoffarnold: i'll update the docs | 17:45 |
| geoffarnold | Excellent | 17:45 |
| *** linkedinyou has quit IRC | 17:47 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Document startmeeting in our meetbot fork https://review.openstack.org/194756 | 17:47 |
| jeblair | geoffarnold: ^ | 17:47 |
| *** patrickeast_ has quit IRC | 17:47 | |
| *** sergmelikyan has quit IRC | 17:49 | |
| AJaeger | pleia2: yeah, let's move forward and see what else we need to get fixed.. | 17:49 |
| *** ghostpl has quit IRC | 17:49 | |
| *** bdemers has joined #openstack-infra | 17:49 | |
| *** armax has joined #openstack-infra | 17:50 | |
| mrmartin | jeblair: if I like to create a specs repo for the groups portal, am I need to get an approval from TC? or just simply create the patch that infra can approve? | 17:52 |
| *** bswartz has joined #openstack-infra | 17:52 | |
| jeblair | mrmartin: since groups is part of the infra project, you can use the infra-specs repo and run it through the infrastructure council process: http://docs.openstack.org/infra/system-config/project.html#teams | 17:54 |
| jeblair | mrmartin: and also here: http://specs.openstack.org/openstack-infra/infra-specs/readme.html | 17:54 |
| *** fawadkhaliq has joined #openstack-infra | 17:54 | |
| mrmartin | great, thnx | 17:55 |
| *** liam__ has joined #openstack-infra | 17:55 | |
| *** amitgandhinz has quit IRC | 17:56 | |
| jeblair | mordred: have you been doing ipv6 related things in nodepool? | 17:56 |
| jeblair | mordred: should you review this? https://review.openstack.org/156178 | 17:57 |
| openstackgerrit | Merged openstack-infra/nodepool: Convert to use latest statsd version https://review.openstack.org/171890 | 17:57 |
| *** juggler has quit IRC | 17:57 | |
| jeblair | mordred: do you want to clean up https://review.openstack.org/136589 or should we find a new owner? | 17:58 |
| *** amitgandhinz has joined #openstack-infra | 17:58 | |
| *** esmute__ has joined #openstack-infra | 17:58 | |
| jeblair | greghaynes: what do you think the future holds for https://review.openstack.org/177043 ? | 17:59 |
| *** mpaolino has joined #openstack-infra | 17:59 | |
| mordred | jeblair: looking | 17:59 |
| *** mtanino has quit IRC | 18:00 | |
| *** mestery has quit IRC | 18:00 | |
| mordred | jeblair: I think the approach in that patch is a fine one - I'm going to similarly make a parameter in shade that you can specify if you want ipv6 instead of ipv4 for some things | 18:00 |
| *** mestery has joined #openstack-infra | 18:01 | |
| *** bdemers has quit IRC | 18:01 | |
| mordred | jeblair: although I also want to just look in /proc/net/if_inet6 to see if there are any routable ipv6 interfaces, and if so, use ipv6 by default | 18:01 |
| mordred | but that might be too aggressive | 18:01 |
| openstackgerrit | Merged openstack-infra/shade: Convert ironicclient node.get() call to Task https://review.openstack.org/193535 | 18:02 |
| openstackgerrit | Sergey Skripnick proposed openstack-infra/project-config: Fix experimental rally-cue job https://review.openstack.org/194768 | 18:02 |
| *** mwagner_afk has quit IRC | 18:02 | |
| *** bdemers has joined #openstack-infra | 18:02 | |
| asselin | peristeri, hi...can you elaborate more on your suggestion? | 18:02 |
| *** otter768 has joined #openstack-infra | 18:02 | |
| peristeri | asselin, A document "How to get openstack CI working for you". In other words, what's in it for third parties. | 18:02 |
| openstackgerrit | Merged openstack-infra/nodepool: Remove unused 'reset' setting from images https://review.openstack.org/165136 | 18:03 |
| *** ociuhandu has quit IRC | 18:03 | |
| *** kdas_ is now known as kushal | 18:03 | |
| *** kushal has quit IRC | 18:04 | |
| *** kushal has joined #openstack-infra | 18:04 | |
| *** ericksonfgds is now known as ericksonsantos | 18:04 | |
| *** ivar-lazzaro has joined #openstack-infra | 18:04 | |
| *** enikanorov2 has quit IRC | 18:05 | |
| *** armax has quit IRC | 18:05 | |
| *** achanda_ has joined #openstack-infra | 18:06 | |
| asselin | peristeri, ok yeah..there's a lot of information documented but not that easy to find. | 18:06 |
| asselin | peristeri, what do you mean by " what's in it for third parties."? | 18:06 |
| SpamapS | greghaynes: so, good news, I can get bifrost to boot _one machine_. Bad news: our servers ignore ipmi commands to change boot order, so we'll have to be careful about that as we boot all the rest. ;) | 18:07 |
| peristeri | asselin, The document can be an overview of the current architecture and maybe point out areas of interest where interested people. Like a informal introduction documentation | 18:07 |
| *** jasondotstar has quit IRC | 18:07 | |
| *** otter768 has quit IRC | 18:07 | |
| *** esmute__ has quit IRC | 18:07 | |
| peristeri | ei: a walk-through | 18:07 |
| mordred | jeblair: I +2d the nodepool change, but did not +A in case you wanted to look | 18:08 |
| *** e0ne has joined #openstack-infra | 18:08 | |
| asselin | peristeri, this is a really good blog and what I started with:http://www.joinfu.com/2014/01/understanding-the-openstack-ci-system/ | 18:08 |
| jeblair | mordred: yeah, i have not reviewed, just skimming changes | 18:08 |
| *** achanda has quit IRC | 18:08 | |
| asselin | peristeri, some details are out of date, but the basics are still relevant | 18:09 |
| *** mestery has quit IRC | 18:10 | |
| *** tosky has quit IRC | 18:11 | |
| harlowja | could i request a infra folk to look over https://review.openstack.org/#/c/194367/ so that it can go in and merge and unblock some of those libraries gates :) | 18:11 |
| harlowja | *or even 2 infra folk(s) | 18:11 |
| harlowja | or 3! | 18:11 |
| harlowja | *but no more, lol | 18:11 |
| *** armax has joined #openstack-infra | 18:13 | |
| jeblair | harlowja: there are 2 failing non-voting jobs; do you know if they are benign? | 18:13 |
| peristeri | asselin, the post looks like a great reference document. | 18:14 |
| *** jasondotstar has joined #openstack-infra | 18:14 | |
| *** mpaolino has quit IRC | 18:14 | |
| *** esmute__ has joined #openstack-infra | 18:15 | |
| harlowja | jeblair i would assume so, since those libraries aren't used in juno | 18:15 |
| krtaylor | peristeri, have you seen http://docs.openstack.org/infra/system-config/third_party.html | 18:15 |
| mgagne | In nodepool, this part assumes the public IP address can be found in the network named public (or private): https://github.com/openstack-infra/nodepool/blob/master/nodepool/provider_manager.py#L40 | 18:15 |
| mgagne | would it be reasonable to make it configurable? | 18:15 |
| krtaylor | peristeri, and http://docs.openstack.org/infra/system-config/running-your-own.html | 18:15 |
| greghaynes | SpamapS: \O/ | 18:15 |
| mgagne | especially since you can override the network on which the nodes are spawn | 18:16 |
| jeblair | mgagne: chat with mordred or SpamapS about that; i believe that logic is moving to shade | 18:16 |
| greghaynes | SpamapS: well, you only need to boot one for now to get a clean new bm host up, right? | 18:16 |
| harlowja | jeblair and or they seem to be 'timeout: timed out' so timeout stuff talking to cirros | 18:16 |
| *** bexelbie_ has joined #openstack-infra | 18:16 | |
| mgagne | I don't know shade, I only trying to make it work | 18:16 |
| *** fawadkhaliq has quit IRC | 18:16 | |
| *** ghostpl has joined #openstack-infra | 18:17 | |
| *** achanda_ has quit IRC | 18:17 | |
| SpamapS | mgagne: yes, shade is growing smarter methods for that. | 18:17 |
| *** amotoki has quit IRC | 18:17 | |
| *** achanda has joined #openstack-infra | 18:17 | |
| peristeri | krtaylor, yes. But there's a lot of implicit knowledge required to understand. The post asselin can complement this document. | 18:18 |
| *** armax has quit IRC | 18:18 | |
| mordred | yup | 18:18 |
| jeblair | harlowja: i don't know openstack; if you're sure they are benign, leave a comment indicating that so i can point to that if things go wrong and i'll +2 it. :) | 18:18 |
| mordred | mgagne: yah - so - the logic to make it work is VERY long once you get in to it - we're just now landing it in the shade library | 18:19 |
| SpamapS | mgagne: nodepool will consume shade rather than implement this privately. | 18:19 |
| mordred | mgagne: it took us at least a good month of wrangling to finally figure out all of the ways in which clouds make finding teh ip of a server difficult | 18:19 |
| mordred | mgagne: but yes - I agree with you - the current code in nodepool is deficient | 18:19 |
| mgagne | alright, that's good stuff I guess. I'm trying to make it work today with my cloud. =) | 18:19 |
| mordred | :) | 18:19 |
| mgagne | I guess I'll just fork and wait | 18:20 |
| mordred | mgagne: does your cloud fill in the AccessIPv4 value in nova? | 18:20 |
| *** enikanorov2 has joined #openstack-infra | 18:20 | |
| jeblair | mgagne: what's the name of your cloud's network? | 18:21 |
| mgagne | no. we manage the cloud and the network name is non-deterministic | 18:21 |
| krtaylor | peristeri, ok, also see: https://www.ibm.com/developerworks/community/blogs/fe313521-2e95-46f2-817d-44a4f27eba32/entry/building_your_openstack_3rd_party_ci_system1?lang=en | 18:21 |
| mgagne | it depends on the tenant and for various reason, it cannot be renamed | 18:21 |
| mordred | mgagne: are you using neutron? and does the network in question support the router:external attribute? | 18:21 |
| peristeri | krtaylor, I'm looking at it right now. | 18:21 |
| mgagne | we don't use router | 18:22 |
| mgagne | it's pure provider networks with hardware routers | 18:22 |
| jeblair | mgagne: that makes sense for my question; but is that also an answer to mordred's question about AccessIPv4? | 18:22 |
| mordred | but you should have a neutron network object, yes? | 18:22 |
| mgagne | there is no AccessIPv4 populated | 18:22 |
| openstackgerrit | Merged openstack-infra/project-config: Create puppet-openstack-integration repo https://review.openstack.org/194287 | 18:22 |
| mordred | ok | 18:22 |
| harlowja | jeblair ok, i signed the release form (aka the review) for u | 18:22 |
| mgagne | because AFAIK Nova uses a fixed network name to populate it | 18:22 |
| mordred | mgagne: that is correct -so if you have one per-tenant, it's not going to work with that nova code | 18:23 |
| jeblair | harlowja: stamped and approved! :) | 18:23 |
| harlowja | :-P | 18:23 |
| *** esmute__ has quit IRC | 18:23 | |
| mgagne | that's why I was wondering if net-label found in nodepool.yaml could be used to fetch the IP address | 18:24 |
| mordred | mgagne: no reason it couldn't, since it's already there - that's a find idea | 18:24 |
| mtreinish | jeblair: any thoughts on https://review.openstack.org/#/c/194302/ I think I finally got the logic right | 18:24 |
| mordred | mgagne: if you neutron net-show your network, do you get something liek this: | 18:24 |
| mordred | mgagne: http://paste.openstack.org/show/317319 | 18:24 |
| mordred | ? | 18:24 |
| *** yamamoto has joined #openstack-infra | 18:25 | |
| openstackgerrit | Ryan Bourgeois proposed openstack-dev/pbr: Support git://, git+ssh://, git+https:// without -e flag. Closes-Bug: 1467683 Change-Id: I09163c8072ecbee5c1a24951511c75009511b6f8 https://review.openstack.org/194405 | 18:25 |
| openstack | bug 1467683 in PBR "PBR Ignores git://, git+ssh://, git+https:// Requirement Lines" [Wishlist,Confirmed] https://launchpad.net/bugs/1467683 - Assigned to Ryan Bourgeois (bluedragonx) | 18:25 |
| *** dangers_away is now known as dangers | 18:25 | |
| mgagne | http://paste.openstack.org/show/317320/ | 18:26 |
| mordred | hrm. ok | 18:27 |
| mordred | mgagne: well, ok then - we may have to get fancier to support you - you have successfully added a new use case | 18:27 |
| *** e0ne is now known as e0ne_ | 18:27 | |
| mordred | dguerri`: ^^ | 18:27 |
| mgagne | mordred: my use case looks to be supported when creating the node but not after when the validation is done :-/ | 18:28 |
| openstackgerrit | Merged openstack-infra/shade: Convert ironicclient node.update() call to Task https://review.openstack.org/193553 | 18:28 |
| *** dguerri` is now known as dguerri | 18:28 | |
| mordred | mgagne: I think we can't only assume net-id is the network to use for the public ip, because on the tripleo cloud and on HP, we use netid to tell it what network to boot on - but the VM still needs a floating ip | 18:28 |
| mordred | so the ip from the specified network in both of those cases would be wrong | 18:28 |
| mordred | I think we'd need another option, as you originally suggested - that is maybe "interface-network" or something - that can be configured to tell it what network to use to get the IP it should use to talk to the VM | 18:29 |
| *** dguerri is now known as dguerri` | 18:29 | |
| mordred | mgagne: I'd like to ponder that for a just a few to make sure we're not just adding cruft - but I think it's likely the only way | 18:29 |
| *** yamamoto has quit IRC | 18:30 | |
| mordred | mgagne: this may actualy want to be an os-client-config option as well | 18:30 |
| *** angela-s has joined #openstack-infra | 18:30 | |
| mgagne | it also goes to show that the accessIPv4 extension in Nova doesn't support all use cases =) | 18:30 |
| *** juggler_ has joined #openstack-infra | 18:31 | |
| *** e0ne_ has quit IRC | 18:32 | |
| *** isviridov is now known as isviridov_away | 18:32 | |
| mordred | oh golly | 18:33 |
| mordred | mgagne: http://git.openstack.org/cgit/openstack-infra/shade/tree/shade/meta.py#n73 this is what we have so far | 18:33 |
| mordred | mgagne: it does not support your use case yet | 18:34 |
| *** bexelbie_ has quit IRC | 18:34 | |
| mordred | so - I think the logic change would be "if network_name: search_networks(network_name): else: search_networks(filters={'router:external': True}) | 18:34 |
| mgagne | I think I would be happy with a config for L103 | 18:34 |
| mordred | or yeah - we could just make key_name a param that defaults to public | 18:35 |
| mordred | and not have to do more new logic | 18:35 |
| mordred | I like that | 18:35 |
| *** kushal has quit IRC | 18:35 | |
| greghaynes | mtreinish: dropped some unimportant bash-fu on that patch ;) | 18:35 |
| *** reed has quit IRC | 18:36 | |
| mgagne | mordred: get_server_external_ipv4 vs get_server_public_ip ? | 18:36 |
| *** markmcclain has quit IRC | 18:36 | |
| mtreinish | greghaynes: heh, yeah my bash-fu is weak | 18:36 |
| mtreinish | I just iterate until I find something that works | 18:36 |
| mtreinish | then I let other people tell me how I really should do it | 18:37 |
| mordred | mgagne: yah - some people have ipv6 even :) | 18:37 |
| *** puranamr has quit IRC | 18:37 | |
| *** ryanpetrello has quit IRC | 18:37 | |
| mgagne | mordred: my network is private so fallback to is_globally_routable_ipv4 would fail too | 18:37 |
| *** puranamr has joined #openstack-infra | 18:37 | |
| mordred | yup | 18:37 |
| mordred | this makes sense | 18:38 |
| mordred | mgagne: we talked some about your use case before, but we had no concrete examples, so we did not handle it (didn't want to get extra complex if we didn't need to) | 18:38 |
| mordred | but- I think it's very easy to support you | 18:38 |
| greghaynes | mtreinish: hah, well then success! | 18:38 |
| mgagne | sure, I understand | 18:38 |
| mordred | in fact... | 18:38 |
| mordred | we could start using get_server_external_ipv4 in nodepool pretty soon | 18:39 |
| mgagne | IMO, it's not an unusual case if people are running private cloud to run their CI infra | 18:39 |
| mordred | mgagne: yah - I think we were mostly thinkig that they'd still want the IP that gets them _off- of their cloud - but we were wrong | 18:39 |
| mordred | Shrews: ^^ if you missed it | 18:40 |
| Shrews | reading | 18:40 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/devstack-gate: Fix the setup_workspace to handle missing ZUUL_BRANCH https://review.openstack.org/194302 | 18:40 |
| mtreinish | greghaynes: ^^^ I had to recheck anyway | 18:41 |
| lifeless | dims: dhellmann: mordred: reviews please https://review.openstack.org/#/c/189250/ | 18:41 |
| *** e0ne has joined #openstack-infra | 18:41 | |
| *** puranamr has quit IRC | 18:41 | |
| lifeless | thats an empirical review | 18:41 |
| lifeless | e.g. I found out via trial and error | 18:41 |
| mgagne | mordred: It however looks like you *could* have multiple networks in the provider config which could make the logic a bit more difficult. | 18:42 |
| *** marzif_ has quit IRC | 18:43 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Allow specifying the name of the network for IPs https://review.openstack.org/194779 | 18:44 |
| mordred | mgagne, Shrews, SpamapS: ^^ | 18:44 |
| mgagne | mordred: unless we add an attribute to the network definition in nodepool.yaml to tell that this particular network will be used to access the instance via SSH | 18:44 |
| *** puranamr has joined #openstack-infra | 18:44 | |
| mordred | mgagne: well, I'm thinking actually adding a setting to clouds.yaml - it's an attribute of the cloud account, really. "what network should be used for ips" | 18:45 |
| mgagne | mordred: I'm just not sure how we can retrieve that info later, maybe storing it in the instance metadata | 18:45 |
| Shrews | mordred: this IP logic is getting quite complex | 18:45 |
| mgagne | it is madness | 18:46 |
| mordred | mgagne: and yes - we can totally set it in the instance metadata if need be - although all of our interactions with the server will be via things that have called get_server_public_ipv4 - so it'll always be in teh server dict we have | 18:46 |
| mordred | Shrews: yes. clouds are hard | 18:46 |
| *** puranamr has quit IRC | 18:46 | |
| mgagne | mordred: make_server_dict(server) is server a Nova "object" ? | 18:47 |
| *** puranamr has joined #openstack-infra | 18:48 | |
| mordred | mgagne: yes | 18:48 |
| *** esmute__ has joined #openstack-infra | 18:48 | |
| mordred | mgagne: well, it's one stripped down to be a dict, but yes - all the fields should be the same | 18:48 |
| mordred | mgagne: except for ones we add to the dict in shade | 18:48 |
| mgagne | thanks, I'll see what I can do | 18:49 |
| * mgagne pulls out duct tape | 18:49 | |
| *** puranamr has quit IRC | 18:50 | |
| *** rwsu has quit IRC | 18:51 | |
| *** nihilifer has joined #openstack-infra | 18:52 | |
| *** dguerri` is now known as dguerri | 18:53 | |
| jogo | would it be possible to get gdb attached to nova-compute to help debug https://bugs.launchpad.net/nova/+bug/1462305 | 18:53 |
| openstack | Launchpad bug 1462305 in OpenStack Compute (nova) "multi-node test causes nova-compute to lockup" [High,In progress] - Assigned to Joe Gordon (jogo) | 18:53 |
| *** rwsu has joined #openstack-infra | 18:53 | |
| mtreinish | jogo: just do it with devstack | 18:53 |
| jogo | will first have to find a case where that bug is happening for a job that hasn't finished yet | 18:53 |
| mtreinish | that's what launches nova | 18:53 |
| dguerri | mordred mgagne: interesting use case :) | 18:53 |
| jogo | mtreinish: well this only happens in multinode and happens infrequently | 18:54 |
| mgagne | translation: you guys are weird :D | 18:54 |
| jogo | mtreinish: I could run gdb every time I guess | 18:54 |
| mordred | mgagne: :) | 18:54 |
| jogo | just like the GMR stuff | 18:54 |
| mtreinish | jogo: just a wip, we have the multinode on experimental on devstack right? | 18:54 |
| *** dguerri is now known as dguerri` | 18:54 | |
| mtreinish | just recheck until it hits | 18:54 |
| *** baoli has quit IRC | 18:54 | |
| jogo | mtreinish: yes, but this doesn't happen that often | 18:54 |
| jogo | would have to run 10/20 jobs | 18:54 |
| mtreinish | jogo: self replicating patch? | 18:55 |
| jogo | mtreinish: hehe that is an option | 18:55 |
| mtreinish | you totally should do that for your last day | 18:55 |
| *** baoli has joined #openstack-infra | 18:56 | |
| *** puranamr has joined #openstack-infra | 18:56 | |
| *** bdemers has quit IRC | 18:56 | |
| *** bdemers has joined #openstack-infra | 18:57 | |
| jogo | I would rather get multinode working | 18:58 |
| *** shardy has quit IRC | 19:00 | |
| *** DericHorn-HP has quit IRC | 19:00 | |
| *** shardy has joined #openstack-infra | 19:00 | |
| pleia2 | meeting time | 19:01 |
| *** DericHorn-HP has joined #openstack-infra | 19:02 | |
| *** ramashri has joined #openstack-infra | 19:05 | |
| *** rwsu has quit IRC | 19:05 | |
| *** maxskew has quit IRC | 19:07 | |
| *** DericHorn-HP_ has joined #openstack-infra | 19:07 | |
| *** Longgeek_ has quit IRC | 19:07 | |
| *** DericHorn-HP has quit IRC | 19:07 | |
| *** DericHorn-HP_ is now known as DericHorn-HP | 19:07 | |
| *** esmute__ has quit IRC | 19:08 | |
| *** esmute__ has joined #openstack-infra | 19:10 | |
| *** markmcclain has joined #openstack-infra | 19:11 | |
| *** shardy has quit IRC | 19:11 | |
| *** shardy has joined #openstack-infra | 19:12 | |
| *** markmcclain has quit IRC | 19:12 | |
| *** markmcclain has joined #openstack-infra | 19:13 | |
| *** reed has joined #openstack-infra | 19:13 | |
| *** rwsu has joined #openstack-infra | 19:13 | |
| SpamapS | greghaynes: success! I have a box up now, and I can document how to repeat. | 19:16 |
| SpamapS | mordred: ^ | 19:16 |
| greghaynes | \O/ we can boot computers | 19:16 |
| mordred | SpamapS: woot! | 19:16 |
| *** tim_o has joined #openstack-infra | 19:17 | |
| greghaynes | Its sad how much effort it takes to do that | 19:17 |
| greghaynes | but yay | 19:17 |
| timrc | jeblair, I'm having mega connection issues, but yeah, I'm interested in reviewing those patches. | 19:18 |
| SpamapS | greghaynes: especially since we spent 2 years doing that.. on these specific computers. ;) | 19:18 |
| timrc | yolanda, nibalizer Congrats on infra-puppet core! | 19:19 |
| *** openstackgerrit has quit IRC | 19:21 | |
| *** dizquierdo has joined #openstack-infra | 19:22 | |
| *** openstackgerrit has joined #openstack-infra | 19:22 | |
| *** esmute__ has quit IRC | 19:23 | |
| *** esmute__ has joined #openstack-infra | 19:24 | |
| *** ryanpetrello has joined #openstack-infra | 19:24 | |
| *** yamahata has joined #openstack-infra | 19:24 | |
| *** achanda has quit IRC | 19:26 | |
| *** jtomasek has quit IRC | 19:26 | |
| davideagnello | hello, we have a change that needs to get merged for our rally job to work: https://review.openstack.org/#/c/194768/ Thank you | 19:26 |
| *** husanu has quit IRC | 19:26 | |
| *** husanu has joined #openstack-infra | 19:28 | |
| timrc | pabelanger, I'll start looking at grafyaml patches today. | 19:28 |
| pabelanger | timrc, cool. I think it is in good shape | 19:28 |
| *** sabeen2 has quit IRC | 19:29 | |
| pabelanger | well, the puppet-grafana patchset is too | 19:29 |
| *** sabeen has joined #openstack-infra | 19:29 | |
| *** EricGonczer_ has joined #openstack-infra | 19:30 | |
| *** ramashri has quit IRC | 19:30 | |
| timrc | pabelanger, I fell off the face of the earth for a minute working on internal stuff, but I'm hoping the internal stuff that was done will make doing the external stuff easier now :) | 19:30 |
| *** fifieldt_ has joined #openstack-infra | 19:31 | |
| pabelanger | timrc, Ya, I hear that | 19:32 |
| mordred | timrc: \o/ | 19:32 |
| *** lhcheng has joined #openstack-infra | 19:33 | |
| lhcheng | hi folks | 19:33 |
| *** fifieldt has quit IRC | 19:34 | |
| lhcheng | it has been reported than one of the horizon pypi packages contains .git files. Is this something infra can help with? | 19:34 |
| lhcheng | https://bugs.launchpad.net/horizon/+bug/1451567 | 19:34 |
| openstack | Launchpad bug 1451567 in OpenStack Dashboard (Horizon) "XStatic-Magic-Search pypi package has errors" [High,Confirmed] | 19:34 |
| *** SumitNaiksatam has joined #openstack-infra | 19:34 | |
| lhcheng | the author of the package is on vacation | 19:34 |
| david-lyle | lhcheng: I think we can just tag a new version of that and let the publish job post the correct parts | 19:35 |
| *** esmute__ has quit IRC | 19:35 | |
| clarkb | well bug is likely in setup.py so that needs fixing too | 19:35 |
| fungi | lhcheng: david-lyle: yeah, just make sure that you check the tarball created by running `tox -e venv python setup.py sdist` | 19:36 |
| fungi | and fix whatever needs fixing in that repo until it gives you a tarball whose contents you're satisfied with | 19:36 |
| lhcheng | fungi: thanks, let me try that out first. | 19:36 |
| fungi | lhcheng: david-lyle: since that's what our tarball job will run, and what it will ultimately upload when you push a new tag | 19:37 |
| *** esmute__ has joined #openstack-infra | 19:37 | |
| *** Longgeek has joined #openstack-infra | 19:38 | |
| *** dprince has quit IRC | 19:38 | |
| *** puranamr has quit IRC | 19:38 | |
| *** puranamr has joined #openstack-infra | 19:39 | |
| mgagne | mordred: my slaves are now added to Jenkins so I'm happy: https://github.com/mgagne/nodepool/tree/access_network | 19:39 |
| pabelanger | timrc, just created https://github.com/grafana/grafana/issues/2218 to help with api_key issue | 19:40 |
| mordred | mgagne: yay! | 19:40 |
| mgagne | pabelanger: "this is convenient" :D | 19:40 |
| *** tonytan4ever has quit IRC | 19:40 | |
| mgagne | oh misread :P | 19:41 |
| pabelanger | :0 | 19:41 |
| *** rwsu has quit IRC | 19:41 | |
| *** tonytan4ever has joined #openstack-infra | 19:41 | |
| lhcheng | fungi david-lyle: running `tox -e venv python setup.py sdist` returned an error: "ERROR: toxini file 'tox.ini' not found" | 19:42 |
| *** esmute__ has quit IRC | 19:42 | |
| lhcheng | david-lyle: maybe we don't have a publish job yet ? | 19:42 |
| lhcheng | david-lyle: and the author just manually uploaded the package to pypi | 19:42 |
| *** puranamr has quit IRC | 19:43 | |
| david-lyle | maybe that's the reason microversion aren't getting published either | 19:43 |
| *** achanda has joined #openstack-infra | 19:43 | |
| david-lyle | those horizon guys are nuts | 19:44 |
| *** jtomasek has joined #openstack-infra | 19:44 | |
| fungi | david-lyle: i've heard that too. if you know any of them, we can probably set them straight ;) | 19:45 |
| lhcheng | clarkb: setup.py seems consistent with other xstatic packages, either it is correct or all setup.py are wrong :P | 19:45 |
| *** rwsu has joined #openstack-infra | 19:45 | |
| *** tonytan4ever has quit IRC | 19:45 | |
| lhcheng | fungi: yeah, those horizon guys are trouble makers | 19:46 |
| *** tonytan4ever has joined #openstack-infra | 19:46 | |
| *** hashar has joined #openstack-infra | 19:46 | |
| lhcheng | :P | 19:46 |
| fungi | lhcheng: well, the setup.py may be fine. with no tox.ini though our tarball jobs won't run. they call tox | 19:47 |
| asselin | peristeri, fyi, use my fork of the repo since it works/actively maintained: https://github.com/rasselin/os-ext-testing. I've been slowly migrating it to use the new puppet-openstackci modules | 19:47 |
| peristeri | asselin, thanks. | 19:48 |
| lhcheng | fungi: check couple of xstatic-* packages, and all doesn't have a tox.ini file. hmm.. so we didn't have any publish jobs at all :( | 19:50 |
| *** tonytan4ever has quit IRC | 19:51 | |
| *** rwsu has quit IRC | 19:51 | |
| *** Rockyg has joined #openstack-infra | 19:51 | |
| david-lyle | that explains the my xstatic issue from yesterday | 19:51 |
| david-lyle | looks like we have some tox-ing to do | 19:51 |
| *** tonytan4ever has joined #openstack-infra | 19:52 | |
| *** sdake has quit IRC | 19:54 | |
| *** esmute__ has joined #openstack-infra | 19:56 | |
| *** _nadya_ has joined #openstack-infra | 19:57 | |
| dhellmann | have there been any issues with gerrit being very very slow today? I'm trying to figure out if the timeouts I'm seeing are related to something on my end of the connection. | 19:59 |
| openstackgerrit | Sylvain Bauza proposed openstack-infra/elastic-recheck: add query for py27 bug 1468087 https://review.openstack.org/194797 | 19:59 |
| openstack | bug 1468087 in OpenStack Compute (nova) "py27 job failing on test_save_objectfield_missing_instance_row" [High,Confirmed] https://launchpad.net/bugs/1468087 | 19:59 |
| bknudson | gerrit is a slowpoke | 20:00 |
| dansmith | dhellmann: it's not you | 20:00 |
| dansmith | well, not just you.. you might be the overall cause I guess, I dunno :P | 20:00 |
| dhellmann | dansmith: ok, good, thanks | 20:00 |
| dhellmann | dansmith: sssh, don't tell anyone | 20:01 |
| dansmith | heh | 20:01 |
| bknudson | "who smelt it dealt it" | 20:01 |
| *** mrmartin has quit IRC | 20:01 | |
| fungi | i have a sinking suspicion something is going on with the compute node where out gerrit vm is running | 20:01 |
| fungi | though rackspace didn't spot anything wrong | 20:01 |
| mtreinish | fungi: when you get a sec could you take a look at: https://review.openstack.org/194302 I'd really like to get it in before the next round of periodic jobs kick off | 20:03 |
| *** otter768 has joined #openstack-infra | 20:03 | |
| *** weshay has quit IRC | 20:03 | |
| *** annegentle has joined #openstack-infra | 20:04 | |
| *** weshay has joined #openstack-infra | 20:04 | |
| *** cburroughs has quit IRC | 20:05 | |
| *** e0ne is now known as e0ne_ | 20:05 | |
| *** e0ne_ is now known as e0ne | 20:05 | |
| *** achanda has quit IRC | 20:06 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/project-config: Add python3 jobs to os-testr https://review.openstack.org/194798 | 20:06 |
| *** reed has quit IRC | 20:07 | |
| *** jtomasek has quit IRC | 20:07 | |
| fungi | mtreinish: lgtm but should also get jeblair to weigh in since he untangled this the last time we made okay-looking changes to the branch fallbacks | 20:08 |
| *** reed has joined #openstack-infra | 20:08 | |
| *** greghaynes has quit IRC | 20:08 | |
| *** kgiusti has quit IRC | 20:08 | |
| *** otter768 has quit IRC | 20:09 | |
| *** _nadya_ has quit IRC | 20:09 | |
| *** _nadya_ has joined #openstack-infra | 20:09 | |
| mtreinish | fungi: ok, thanks. Don't worry, I'll bug jeblair about it again :) | 20:10 |
| *** ramashri has joined #openstack-infra | 20:12 | |
| *** puranamr has joined #openstack-infra | 20:12 | |
| bknudson | are there docs for how to merge a feature branch? | 20:14 |
| *** _nadya_ has quit IRC | 20:14 | |
| *** ryanpetrello has quit IRC | 20:14 | |
| *** sabeen2 has joined #openstack-infra | 20:14 | |
| bknudson | found it http://docs.openstack.org/infra/manual/drivers.html | 20:14 |
| *** ryanpetrello has joined #openstack-infra | 20:15 | |
| clarkb | lhcheng I am interested to know if setup.py makes sdists with .git | 20:16 |
| *** tonytan4ever has quit IRC | 20:16 | |
| lhcheng | clarkb: nope it doesn't. It seems like the xstatic-* directory was uploaded as tarball instead of just the tar from sdist | 20:18 |
| lhcheng | (facepalm) | 20:18 |
| *** annegentle has quit IRC | 20:18 | |
| *** sabeen has quit IRC | 20:18 | |
| *** annegentle has joined #openstack-infra | 20:18 | |
| *** SumitNaiksatam has quit IRC | 20:18 | |
| lhcheng | clarkb: the problem is just for xtatic-magic-search btw. | 20:18 |
| timrc | pabelanger, Will you be at OSCON this year? | 20:19 |
| openstackgerrit | Matthew Treinish proposed openstack/requirements: Cap oslo.il8n to allow for transition away from oslo namespace https://review.openstack.org/194800 | 20:19 |
| mtreinish | dims: ^^^ you broke the world | 20:20 |
| pabelanger | timrc, sadly no | 20:20 |
| *** Sukhdev has joined #openstack-infra | 20:20 | |
| pabelanger | timrc, sounds like a few -infra people are going | 20:20 |
| fungi | timrc: i'll be there | 20:20 |
| timrc | Yep. | 20:20 |
| timrc | fungi, Cool. Me too. | 20:20 |
| mtreinish | dhellmann, sdague, fungi, lifeless: ^^^ that g-r review should probably be fast tracked | 20:20 |
| pleia2 | I'll be around for mon-tues | 20:20 |
| timrc | pleia2, Are you presenting? | 20:21 |
| lifeless | mtreinish: please no | 20:21 |
| lifeless | mtreinish: I've finally gotten my conflicts from hell patch +A'd, don't ruin it :) | 20:21 |
| pleia2 | timrc: no, and not strictly oscon-ing either, doing community leadership summit over the weekend + beer track mon-tues | 20:21 |
| lifeless | mtreinish: unless- has that broken the world ? | 20:21 |
| mtreinish | lifeless: heh, well you won't be able to land them | 20:21 |
| mtreinish | because that broke the world | 20:21 |
| *** SumitNaiksatam has joined #openstack-infra | 20:22 | |
| lifeless | dhellmann: ^ we need to stop the namespace transition until constraints are in place I think | 20:22 |
| crinkle | beer track \o/ | 20:22 |
| openstackgerrit | Brant Knudson proposed openstack-infra/project-config: Grant keystone core pushMerge on keystoneauth feature branch https://review.openstack.org/194801 | 20:22 |
| *** jasondotstar has quit IRC | 20:22 | |
| lifeless | dhellmann: because we're going to get more such surprises, statistically speaking | 20:22 |
| pleia2 | crinkle: yes, we should gather people and beer track together! | 20:22 |
| crinkle | pleia2: ++ | 20:22 |
| lifeless | mtreinish: ok so we need a root person to unwedge the world? | 20:23 |
| mtreinish | lifeless: well maybe, hopefully not. The g-r cap should stop pulling in a version without the oslo namespace which will let us fix things | 20:23 |
| lifeless | right but everything currently queued is going to fail ? | 20:24 |
| mtreinish | assuming it's just oslo.il8n which broke things | 20:24 |
| lifeless | queued-in-the-gate I mean | 20:24 |
| mtreinish | which it isn't as jecarey just pointed out in -qa it wasn't | 20:24 |
| mtreinish | lifeless: that ship has already sailed all jobs that get the new versions from pypi that dims just pushed are hosed | 20:25 |
| mtreinish | if it launched already and pulled in the old version it'll still pass | 20:25 |
| *** jogo has quit IRC | 20:25 | |
| lifeless | messaging, db, middleware i18n are the releases I see with namespace in the changelog | 20:25 |
| *** jogo has joined #openstack-infra | 20:26 | |
| lifeless | yeah, I'm trying to figure if 189250 is in or out :) | 20:26 |
| mtreinish | lifeless: also log I think | 20:26 |
| openstackgerrit | Steve Martinelli proposed openstack/requirements: Remove marconiclient from global requirements https://review.openstack.org/194804 | 20:27 |
| lifeless | mtreinish: log only says | 20:27 |
| lifeless | 2e2100f Updated from global requirements | 20:27 |
| lifeless | c7f354d Updated from global requirements | 20:27 |
| lifeless | bf0c020 Switch badges from 'pypip.in' to 'shields.io' | 20:27 |
| lifeless | dcd480a Deprecate use-syslog-rfc-format for removal | 20:27 |
| sdague | mtreinish: well if gerrit didn't keep being "the sad" I might be able to | 20:28 |
| mtreinish | lifeless: yep going through the release notes now t | 20:28 |
| mtreinish | sdague: i need to respin anyway to add a cap to all the new oslo releases | 20:28 |
| pabelanger | review.o.o issues? | 20:28 |
| pabelanger | timing out here | 20:29 |
| sdague | mtreinish: so, is there no other way around this? because these caps have made all the integration infrastructure pretty fragile right now | 20:29 |
| dhellmann | mtreinish, lifeless : I can't get gerrit to load that page. What project is actually broken? | 20:29 |
| sdague | you basically can't run grenade outside of the gate | 20:29 |
| *** rguillebert has joined #openstack-infra | 20:29 | |
| sdague | and devstack outside of the gate is getting dicey as well | 20:29 |
| mtreinish | dhellmann: well right now oslo.il8n, because there a bunch of things still using the namespace | 20:30 |
| mtreinish | like glance_store: http://git.openstack.org/cgit/openstack/glance_store/tree/glance_store/i18n.py | 20:30 |
| dhellmann | mtreinish: right, what is still using it, because I have been doing a lot of testing | 20:30 |
| *** rossella_s has quit IRC | 20:30 | |
| mtreinish | patrickeast: said there were some other clients too | 20:30 |
| jeblair | fungi, pleia2: seem to be having another gerrit partial-outage; i can't dig in right now | 20:30 |
| mtreinish | dhellmann: I don't have the full list | 20:30 |
| dhellmann | mtreinish: ok, maybe they didn't land the patch I gave them like I thought they did | 20:30 |
| dhellmann | mtreinish: ok, I'll look again after my meetings are over, but go forth with capping for now | 20:31 |
| lifeless | dhellmann: from the message (I know you can't get it) - glance_store and a bunch of the clients usage of oslo.il8n. | 20:31 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: add query for py27 bug 1468087 https://review.openstack.org/194797 | 20:31 |
| openstack | bug 1468087 in OpenStack Compute (nova) "py27 job failing on test_save_objectfield_missing_instance_row" [High,Confirmed] https://launchpad.net/bugs/1468087 | 20:31 |
| *** rossella_s has joined #openstack-infra | 20:31 | |
| dhellmann | lifeless: I submitted patches to all those things. Maybe we just need to release them. | 20:31 |
| mtreinish | dhellmann: https://review.openstack.org/#/c/194800/ is the cap for il8n, I'm trying to figure out if I need to respin to add the other namespace removal releases | 20:31 |
| *** baoli has quit IRC | 20:31 | |
| mtreinish | I think it might be just il8n | 20:32 |
| *** dontalton has quit IRC | 20:32 | |
| fungi | jeblair: i'm looking | 20:32 |
| mtreinish | sdague: yeah we have to cap, or push a new oslo.i8ln release to add the namespace back | 20:32 |
| *** dontalton has joined #openstack-infra | 20:33 | |
| *** greghaynes has joined #openstack-infra | 20:33 | |
| dhellmann | mtreinish: cap, please | 20:33 |
| mtreinish | if it's more than 1 project that is still using the namespace | 20:33 |
| *** greghaynes has quit IRC | 20:33 | |
| fungi | we're getting tcp/syn packets destined for port 443, but not any more than usual | 20:33 |
| pleia2 | fungi: seems to be going in and out, of being accessible (I can get to it now) | 20:33 |
| pleia2 | looking at cacti to see if unusual load | 20:33 |
| *** claudiub has quit IRC | 20:34 | |
| *** greghaynes has joined #openstack-infra | 20:34 | |
| fungi | yeah, for the moment it's responding to me just fine | 20:34 |
| pleia2 | yeah, tcp seems to be the only thing that spiked, maybe some networking issues where it lives? | 20:35 |
| fungi | you know what? the same crawler i was seeing tank our paste server also looks like the main source of new https connections to gerrit | 20:35 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added ironic-webclient to OpenStack https://review.openstack.org/194424 | 20:35 |
| pleia2 | ooh | 20:35 |
| fungi | double-checking that now since i haven't memorized the ip address | 20:35 |
| fungi | yep! blocking now | 20:36 |
| pleia2 | nice work | 20:36 |
| fungi | it was varying between 15-25% of all new connections per tcpdump | 20:37 |
| mtreinish | now I'm not seeing what I was looking at before. Maybe I just misread something | 20:37 |
| mtreinish | I'm not sure we need the cap anymore | 20:37 |
| fungi | no idea if this is the cause of our recent pain, but worth blocking regardless | 20:37 |
| * pleia2 nods | 20:37 | |
| dhellmann | mtreinish: glance_store is not using the oslo namespace in the file you linked to -- do you have a link to a log with a failure? | 20:39 |
| *** esker has joined #openstack-infra | 20:39 | |
| lifeless | dhellmann: but has it been released not using it ? | 20:39 |
| *** rwsu has joined #openstack-infra | 20:39 | |
| dhellmann | lifeless: that's not clear, yet, that's why I want to see the actual traceback | 20:40 |
| lifeless | ack | 20:40 |
| mtreinish | dhellmann: yeah I just noticed that, I swear I saw from oslo import il8n somewhere in a glance_store repo, but I already marked the patch as wip | 20:40 |
| mtreinish | I might have jumped the gun | 20:40 |
| *** Rockyg has quit IRC | 20:40 | |
| mtreinish | dhellmann: all i have was this: http://paste.openstack.org/show/317614/ | 20:40 |
| mtreinish | which patrickeast reported in -qa | 20:40 |
| dhellmann | lifeless: version 0.4 should have had the fix | 20:41 |
| mtreinish | dhellmann: yeah I think it's just patrickeast's env | 20:41 |
| sdague | mtreinish: yeh, I thought we were pretty on top of this | 20:41 |
| *** Rockyg has joined #openstack-infra | 20:41 | |
| lifeless | patrickeast: do you have the full log ? | 20:41 |
| dhellmann | mtreinish: is this from a grenade job where something didn't get upgraded? | 20:41 |
| *** DericHorn-HP has quit IRC | 20:41 | |
| lifeless | it could be a downgrade | 20:41 |
| patrickeast | yea one sec | 20:41 |
| *** dustins_ has quit IRC | 20:41 | |
| lifeless | because we still have lots of caps all over the place that trigger random downgrades | 20:41 |
| dhellmann | mtreinish: are we actually seeing gate failures? | 20:41 |
| sdague | mtreinish: yeh, I expect that's probably related to the pip caching issue | 20:41 |
| lifeless | sdague: pip caching issue ? | 20:42 |
| sdague | lifeless: something is sticking in environments | 20:42 |
| *** rm_work is now known as rm_work|away | 20:42 | |
| sdague | we've had a few reports of it, it hit me, but I blew away some things to get past it | 20:42 |
| *** DericHorn-HP has joined #openstack-infra | 20:42 | |
| lifeless | ah | 20:43 |
| lifeless | I'm happy to dig in if someone can loop me in | 20:43 |
| lifeless | sdague: virtualenvs I presume you mean? | 20:43 |
| *** dkranz has quit IRC | 20:44 | |
| dhellmann | lifeless: fwiw, I've been holding oslo releases until all of the other libraries I've patched have had releases, so it's possible I missed one but I've spent hours and hours running tests over and over on these changes | 20:44 |
| ianw | jhesketh: http://i.imgur.com/4LygAIy.png <- are these weird chars in the log page my problem or remote config? | 20:44 |
| *** claudiub has joined #openstack-infra | 20:44 | |
| *** ddieterly has joined #openstack-infra | 20:45 | |
| mtreinish | dhellmann: yeah I'm pretty sure I just jumped the gun because I misread something and that pastebin | 20:45 |
| mtreinish | I don't see any gate failures | 20:45 |
| dhellmann | mtreinish: ok, good | 20:45 |
| mtreinish | so I owe dims an apology for blaming him for breaking the world when nothing is broken:) | 20:45 |
| dhellmann | mtreinish: :-) | 20:45 |
| lifeless | dhellmann: totally - I was assuming a coverage gap, not an effort gap | 20:45 |
| * dhellmann takes off his fire helmet and goes back to the tc meeting | 20:46 | |
| patrickeast | :o sry for the disruption | 20:46 |
| *** dimtruck is now known as zz_dimtruck | 20:46 | |
| patrickeast | the whole log is here if anyone is still itnerested http://ec2-54-67-51-189.us-west-1.compute.amazonaws.com/err.log | 20:46 |
| dhellmann | lifeless: I have a script that checks out all of openstack/*, figures out what uses what libs, and runs all of their unit tests. | 20:46 |
| dhellmann | lifeless: it takes forever to run :-)( | 20:46 |
| lifeless | dhellmann: yeah, you need map-reduce | 20:46 |
| lifeless | :) | 20:46 |
| lifeless | I have a thing | 20:46 |
| *** puranamr has quit IRC | 20:46 | |
| dhellmann | lifeless: yeah, I need to spin up more vms to do that or something, but I've been focusing on one lib at a time so it's mostly working -- run job, go to bed, wake up, read logs | 20:47 |
| sdague | lifeless: no, it was system level | 20:47 |
| lifeless | patrickeast: 2015-06-23 19:55:33.363 | Collecting glance-store>=0.3.0 (from glance==11.0.0.0b1) | 20:47 |
| lifeless | 2015-06-23 19:55:33.404 | Using cached glance_store-0.6.0-py2.py3-none-any.whl | 20:47 |
| *** Rockyg has quit IRC | 20:47 | |
| *** EricGonczer_ has quit IRC | 20:48 | |
| lifeless | patrickeast: https://pypi.python.org/pypi/glance_store is up to 0.6.0 | 20:48 |
| *** Rockyg has joined #openstack-infra | 20:48 | |
| lifeless | patrickeast: so you have something constraining your available versions of some bits (glance_store) but not others (oslo.i18n) | 20:48 |
| *** puranamr has joined #openstack-infra | 20:48 | |
| lifeless | patrickeast: thats a local foot-gun of some sort | 20:48 |
| bknudson | I'll need https://review.openstack.org/#/c/194801/ in order to merge up our keystoneclient feature branch | 20:49 |
| patrickeast | lifeless: thanks! | 20:49 |
| bknudson | there was a merge conflict :( | 20:50 |
| *** flepied has quit IRC | 20:50 | |
| clarkb | bknudson reviewed | 20:52 |
| *** zz_dimtruck is now known as dimtruck | 20:52 | |
| *** shardy has quit IRC | 20:52 | |
| *** shardy has joined #openstack-infra | 20:53 | |
| *** HeOS has joined #openstack-infra | 20:53 | |
| *** timothyb89 has joined #openstack-infra | 20:54 | |
| openstackgerrit | Brant Knudson proposed openstack-infra/project-config: Grant keystone core pushMerge on keystoneclient feature branches https://review.openstack.org/194801 | 20:54 |
| *** barnaby has joined #openstack-infra | 20:56 | |
| *** ddieterly has quit IRC | 20:56 | |
| bknudson | "There are 1 projects not normalized." -- wonder what that means. | 20:56 |
| *** changbl_ has quit IRC | 20:56 | |
| *** alexpilotti has quit IRC | 20:57 | |
| *** barnaby has quit IRC | 20:57 | |
| clarkb | there is a test to lint our acls | 20:58 |
| clarkb | it should tell you what specifically failes | 20:58 |
| openstackgerrit | Brant Knudson proposed openstack-infra/project-config: Grant keystone core pushMerge on keystoneclient feature branches https://review.openstack.org/194801 | 20:59 |
| *** DericHorn-HP has quit IRC | 20:59 | |
| *** ociuhandu has joined #openstack-infra | 20:59 | |
| *** peristeri has quit IRC | 21:00 | |
| fungi | bknudson: basically the sections and options get sorted, whitespace removed, et cetera | 21:00 |
| dims | mtreinish: no worries :) | 21:00 |
| fungi | bknudson: makes them easier to de-dupe and to provide mass cleanup patches across them when they follow a consistent order | 21:01 |
| *** bdemers has quit IRC | 21:01 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: WIP: Add trystack.o.o into -infra https://review.openstack.org/194816 | 21:01 |
| bknudson | fungi: I hadn't sorted correctly. I think I fixed it now since it passed locally. | 21:02 |
| pabelanger | jeblair, would be interested in your thoughts^ | 21:02 |
| *** annegentle has quit IRC | 21:03 | |
| *** chen12 has quit IRC | 21:04 | |
| *** chen12 has joined #openstack-infra | 21:04 | |
| mordred | pabelanger: I think that's a great idea - but I think the contents need to move from github to gerrit | 21:04 |
| fungi | pabelanger: hogepodge will be interested in that one | 21:04 |
| pabelanger | mordred, ya, I was thinking about that too | 21:04 |
| mordred | pabelanger: I'm +2 if we can make that happen | 21:04 |
| pabelanger | wanted to make sure current owner was cool with moving it under -infra too. then get a governance patchset up | 21:05 |
| fungi | this'll probably be similar to when i moved the devstack.org documentation out of github pages | 21:05 |
| jeblair | pabelanger: i left the same comment, and also another one (if it's static. we can host it on static.o.o as a vhost) | 21:05 |
| pabelanger | jeblair, Ya, I was initially going to do static.o.o. So, moving it there seems good to me | 21:06 |
| pabelanger | jeblair, mordred: do you think we need a spec? | 21:06 |
| mordred | pabelanger: nah | 21:07 |
| pabelanger | ack | 21:07 |
| mordred | well, ignore me though | 21:07 |
| mordred | I'm not the PTL :) | 21:07 |
| mordred | but honestly, it's a static site - spec seems overkill to me | 21:07 |
| *** tvanderwiel_ has joined #openstack-infra | 21:08 | |
| *** puranamr has quit IRC | 21:08 | |
| *** tvanderwiel_ has quit IRC | 21:08 | |
| *** eharney has quit IRC | 21:09 | |
| SergeyLukjanov | jeblair, fungi, mordred, sorry about delay with stackalytics, they said to me that they are talking directly with Jonathan Bryce on that issue | 21:09 |
| *** puranamr has joined #openstack-infra | 21:09 | |
| *** tvanderwiel has quit IRC | 21:09 | |
| *** tvanderwiel has joined #openstack-infra | 21:09 | |
| fungi | oh! fun. i guess jbryce can update us once that happens. thanks | 21:09 |
| jeblair | pabelanger: it's borderline, but if you could do a quick spec i think it'd be good. since there's a new hostname, etc. | 21:09 |
| openstackgerrit | Merged openstack-infra/devstack-gate: Add new oslo libraries https://review.openstack.org/194367 | 21:09 |
| dhellmann | mtreinish: now that the tc meeting is done, I would like to suggest that we have a general policy that we wait for a real gate job to fail before raising the alarm about releases. I *know* they do break things, but let's make sure things are really broken? | 21:10 |
| pabelanger | jeblair, okay, I can do that. | 21:10 |
| dims | dhellmann: ++ | 21:10 |
| SergeyLukjanov | jeblair, fungi, mordred, I think if we'll have written prove of the agreement to drop other tools - it would help a lot | 21:10 |
| jeblair | pabelanger: would also be good to mention that, for the moment at least, operating trystack itself is out of scope (which we can revisit after infra-cloud exists) | 21:10 |
| pabelanger | jeblair, right | 21:10 |
| openstackgerrit | Maru Newby proposed openstack-infra/project-config: Enhance run-tox.sh to support functional testing https://review.openstack.org/161456 | 21:10 |
| mordred | pabelanger, jeblair: ++ | 21:10 |
| SergeyLukjanov | I'm sorry about deplay - it's really difficult to communicate to marketing team, heh | 21:10 |
| *** aysyanne has quit IRC | 21:10 | |
| mordred | pabelanger: I actually thinking operating trystack could be _fun_ ... once we get infra-cloud going | 21:10 |
| mordred | SergeyLukjanov: no worries! I maen ... marketing people ;) | 21:10 |
| jeblair | mordred: yes, _after_. :) | 21:11 |
| pabelanger | mordred, Ya, really interested to see how the infra-cloud plays out | 21:11 |
| fungi | SergeyLukjanov: i married a marketing person. i know first hand how difficult communicating with them can be ;) | 21:11 |
| mordred | pabelanger: you and me both | 21:11 |
| SergeyLukjanov | fungi, :) | 21:11 |
| jeblair | fungi: this is also not a scalable solution to our problem | 21:13 |
| *** rlandy has quit IRC | 21:13 | |
| mordred | jeblair: marrying marketing people? | 21:13 |
| fungi | jeblair: i guess not. at least not while staying legal | 21:14 |
| mordred | yeah, I mean, last I checked DinaBelova is not a marketing person, so SergeyLukjanov can't really help any of us with that - it's all on fungi I guess | 21:14 |
| jeblair | SergeyLukjanov, pabelanger: so for the moment, we should wait to hear more from mirantis marketing/foundation? | 21:14 |
| *** ldnunes has quit IRC | 21:15 | |
| *** rm_work|away is now known as rm_work | 21:15 | |
| *** bhunter71 has quit IRC | 21:15 | |
| *** annegentle has joined #openstack-infra | 21:16 | |
| *** dannywil_ has quit IRC | 21:16 | |
| *** soren has quit IRC | 21:16 | |
| *** ramashri has quit IRC | 21:17 | |
| *** fawadkhaliq has joined #openstack-infra | 21:17 | |
| *** ramashri has joined #openstack-infra | 21:17 | |
| *** tonytan4ever has joined #openstack-infra | 21:20 | |
| *** fawadkhaliq has quit IRC | 21:21 | |
| *** erikmwilson has quit IRC | 21:22 | |
| *** esmute__ has quit IRC | 21:23 | |
| bknudson | Can I get rid of a feature branch? http://git.openstack.org/cgit/openstack/python-keystoneclient/log/?h=feature/keystone-v3 | 21:27 |
| *** esmute__ has joined #openstack-infra | 21:27 | |
| *** e0ne is now known as e0ne_ | 21:28 | |
| *** ghostpl has quit IRC | 21:28 | |
| *** abitha has joined #openstack-infra | 21:28 | |
| *** krtaylor has quit IRC | 21:29 | |
| clarkb | bknudson: ya I can take care of that | 21:29 |
| *** e0ne_ has quit IRC | 21:29 | |
| bknudson | clarkb: thanks! | 21:29 |
| clarkb | 62c55bc2f0f13630db6d9962ae0edf468f495276 is the old feature/keystone-v3 HEAD (now its logged in irc logs) | 21:30 |
| clarkb | and done | 21:30 |
| fungi | i too have been using irc logs as my official record of shas when i delete branches | 21:30 |
| fungi | it feels like the old days when i would comtinually stream important syslog facilities to a serial printer | 21:31 |
| openstackgerrit | Victor Stinner proposed openstack-infra/project-config: Make gate-nova-python34 voting and add py34 gate https://review.openstack.org/194128 | 21:31 |
| fungi | continually too | 21:31 |
| *** esmute__ has quit IRC | 21:33 | |
| *** radez is now known as radez_g0n3 | 21:33 | |
| *** annegentle has quit IRC | 21:34 | |
| jeblair | fungi: i'm just glad my dot-matrix irc printout has finally quieted down | 21:34 |
| *** annegentle has joined #openstack-infra | 21:34 | |
| *** e0ne has joined #openstack-infra | 21:34 | |
| fungi | heh | 21:35 |
| nibalizer | that would be quite a thing to see | 21:35 |
| jeblair | and hear | 21:35 |
| clarkb | oh I meant to mention that yes puppet was disabled on etherpad* to have my patch applied | 21:36 |
| nibalizer | and feed, it would be so hungry | 21:36 |
| clarkb | I need to follow up with upstream about my patch but it doesn't pass tests and from what I can tell that is because HEAD doesn't pass tests | 21:36 |
| nibalizer | jeblair: so am i core on system-config too ? | 21:36 |
| clarkb | which is :/ | 21:36 |
| jeblair | nibalizer: no, or at least, not yet | 21:36 |
| jeblair | nibalizer: think might make things interesting | 21:36 |
| nibalizer | okay, just getting clear | 21:37 |
| electrical | hiya gents | 21:37 |
| jeblair | nibalizer: this is new, let us know how it works out? :) | 21:37 |
| nibalizer | jeblair: will do o7 | 21:38 |
| *** jrniemijr has quit IRC | 21:38 | |
| *** tlian2 has joined #openstack-infra | 21:38 | |
| *** rguillebert has quit IRC | 21:38 | |
| clarkb | https://github.com/ether/etherpad-lite/pull/2675 is where we are getting my change upstreamed so we can consume it directly | 21:39 |
| openstackgerrit | Merged openstack/requirements: Mark as Python2.7 only the dependencies that are. https://review.openstack.org/189250 | 21:39 |
| *** austin81 has joined #openstack-infra | 21:40 | |
| fungi | lifeless: ^ unblocked | 21:40 |
| *** erikmwilson_ is now known as erikmwilson | 21:40 | |
| electrical | and girls obviously :-) | 21:40 |
| openstackgerrit | Merged openstack/requirements: Add convenience tox environments https://review.openstack.org/194305 | 21:41 |
| *** tlian has quit IRC | 21:41 | |
| fungi | electrical: i assumed "gents" was just short for both "gentlemen" and "gentlewomen" | 21:41 |
| electrical | fungi: hehe. | 21:42 |
| lifeless | fungi: WOOOOOO | 21:42 |
| *** hodos has joined #openstack-infra | 21:42 | |
| *** e0ne is now known as e0ne_ | 21:42 | |
| lifeless | fungi: now, I think we need an experimental job on requirements to run devstack with constraints | 21:43 |
| *** tvanderwiel has quit IRC | 21:44 | |
| fungi | lifeless: would that do something like swap out update for generate-constraints in devstack? | 21:44 |
| fungi | might be able to test that out initially by just wip-patching devstack to see what happens | 21:44 |
| clarkb | mtreinish: fungi did the stable periodic jobs get sorted out yesterday? | 21:44 |
| nibalizer | austin81: timothyb89 hello! welcome! | 21:44 |
| *** e0ne_ is now known as e0ne | 21:45 | |
| openstackgerrit | Merged openstack/requirements: Add yaql https://review.openstack.org/193180 | 21:45 |
| mtreinish | clarkb: not quite yet, I've got https://review.openstack.org/194302 up to fix the failure we're seeing | 21:45 |
| fungi | clarkb: https://review.openstack.org/194302 needs reviews | 21:45 |
| fungi | yeah, what mtreinish said | 21:45 |
| mtreinish | it should address the issue once it lands | 21:45 |
| tonyb | jeblair: Thanks for the link | 21:45 |
| clarkb | mtreinish: fungi and thats necessary because we are set -e now and need to guard against exit >0 ? | 21:45 |
| mtreinish | yep | 21:45 |
| timothyb89 | hello all! | 21:46 |
| fungi | austin81: timothyb89: new recruits! | 21:46 |
| lifeless | fungi: no, I have the constraints in the stack | 21:46 |
| openstackgerrit | lifeless proposed openstack/requirements: Teach the constraints generator about excludes. https://review.openstack.org/194314 | 21:47 |
| openstackgerrit | lifeless proposed openstack/requirements: Show not-in-global errors again. https://review.openstack.org/194349 | 21:47 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt. https://review.openstack.org/189251 | 21:47 |
| openstackgerrit | lifeless proposed openstack/requirements: Manual update run to get things aligned. https://review.openstack.org/194351 | 21:47 |
| openstackgerrit | lifeless proposed openstack/requirements: Remove unused test requirement toposort. https://review.openstack.org/194350 | 21:47 |
| lifeless | fungi: mordred: ^ all the +2's please. | 21:47 |
| lifeless | I dont' care about the A yet, once it passes check I'll pester someone to add the A, but the 2's would be nice to make that discussion easy | 21:48 |
| *** sabeen2 has quit IRC | 21:48 | |
| _ody | Is there anyplace where the status of all jobs ran across the sevenish jenkinsi are rolled up to? Trying to identify a possible way to contruct a CI status radiator for our project. | 21:50 |
| clarkb | mtreinish: fungi reviewed, please check my bash :) | 21:50 |
| clarkb | _ody: http://status.openstack.org/zuul/ | 21:51 |
| clarkb | _ody: you can also get the raw json from the zuul endpoint | 21:51 |
| clarkb | which is how that page is rendered | 21:51 |
| SergeyLukjanov | jeblair, yup, correct, should wait some more time | 21:51 |
| fungi | clarkb: oh! i believe you're right | 21:51 |
| fungi | clarkb: since test -z requires a parameter | 21:51 |
| *** esmute__ has joined #openstack-infra | 21:51 | |
| clarkb | fungi: yup and non existant var results in no param | 21:51 |
| fungi | clarkb: no, wait, it doesn't | 21:52 |
| clarkb | fungi: it doesn't? | 21:52 |
| _ody | clarkb: Isn't that only as long as it is the zuul queue? | 21:52 |
| fungi | clarkb: you can run `test -z` and the return value is 0 | 21:52 |
| clarkb | _ody: yes, you want historical data? | 21:52 |
| lifeless | fungi: https://review.openstack.org/#/c/194314/ is the next one specifically needing a +2 | 21:52 |
| _ody | clarkb: I want to be able to tell that something failed an our ago. | 21:52 |
| clarkb | _ody: for historical data you will want to look at http://graphite.openstack.org | 21:52 |
| _ody | Ah. | 21:52 |
| *** rguillebert has joined #openstack-infra | 21:53 | |
| *** thedodd has quit IRC | 21:53 | |
| * greghaynes waves to _ody | 21:53 | |
| clarkb | fungi: fun my testing says it does work as does -n | 21:53 |
| *** esker has quit IRC | 21:53 | |
| clarkb | fungi: [ too | 21:54 |
| fungi | yep. a pleasant surprise | 21:54 |
| clarkb | will flip my vote | 21:54 |
| *** reed has quit IRC | 21:54 | |
| mtreinish | clarkb: yeah I normally write bash stuff by trial and error | 21:55 |
| mtreinish | it worked so I used it :) | 21:55 |
| mtreinish | I'm sure there is a better way to do it all | 21:55 |
| greghaynes | clarkb: it doesnt matter on that patch because its using [[, not [ | 21:55 |
| mtreinish | s/better/more bash-like | 21:55 |
| _ody | Afternoon greghaynes. | 21:55 |
| clarkb | greghaynes: even [ works | 21:55 |
| *** e0ne has quit IRC | 21:55 | |
| greghaynes | clarkb: orly | 21:55 |
| clarkb | at least as a bash builtin, let me try real [ | 21:55 |
| *** DericHorn-HP has joined #openstack-infra | 21:56 | |
| clarkb | yup real [ works too | 21:56 |
| greghaynes | ah, I guess unaries DTRT | 21:56 |
| clarkb | ya I think its multi param tests that fail | 21:56 |
| greghaynes | anyhow, I definitely tested that line because I was afraid of the same ;) | 21:56 |
| *** reed has joined #openstack-infra | 21:57 | |
| yolanda | hi, sorry but i couldn't attend infra meeting today and i missed the good news | 21:58 |
| yolanda | i'm so happy to be core on puppet, thx for that | 21:58 |
| greghaynes | yolanda: congrats | 21:58 |
| pleia2 | yolanda: yay :) | 21:59 |
| *** marun has quit IRC | 21:59 | |
| yolanda | thx, will try to do a good job there and work hard on it | 21:59 |
| fungi | thank you yolanda! | 22:00 |
| clarkb | sdague: before you go on vacation next week can we make some progress on https://review.openstack.org/#/c/180552/ ? I may behind on things but I really hate to see that work continue to stall because we need to add new features to devstack | 22:00 |
| *** chen12 has quit IRC | 22:00 | |
| fungi | clarkb: what new features, specifically? | 22:02 |
| clarkb | fungi: see sdague's -1 | 22:02 |
| fungi | or what exactly is breaking with soft updates when running the loganalyze plugin | 22:02 |
| clarkb | fungi: basically allow plugins to control requirements | 22:03 |
| *** yamamoto has joined #openstack-infra | 22:03 | |
| clarkb | fungi: I have no idea | 22:03 |
| fungi | yeah, i ask this after reading his reply there | 22:03 |
| fungi | i was pretty sure other openstack plugins were working without having all their requirements enforced | 22:03 |
| clarkb | oh I see there is a new comment there since I last read the comments | 22:03 |
| fungi | but i could be wrong | 22:03 |
| clarkb | the first comment was add feature to devstack | 22:03 |
| *** doug-fish has left #openstack-infra | 22:04 | |
| *** hodos has quit IRC | 22:04 | |
| *** otter768 has joined #openstack-infra | 22:04 | |
| *** hashar has quit IRC | 22:04 | |
| *** claudiub has quit IRC | 22:05 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add a tool to update gerrit groups https://review.openstack.org/186596 | 22:05 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add a script to configure the infra group structure https://review.openstack.org/186861 | 22:05 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add infra-puppet-core and release groups https://review.openstack.org/194842 | 22:05 |
| clarkb | we would need the plugin to be able to affect the enforcement from within the plugin itself, I am not familiar enough to know if that is possible today | 22:05 |
| clarkb | maybe that is the missing mechanism mentioned in the first -1 comment? | 22:05 |
| mgagne | I see Jenkins slaves are still configured with Puppet. Any plan or change in progress to move to DIB or ansible? | 22:06 |
| jeblair | mgagne: yes, to dib; at least most of the configuration | 22:06 |
| mgagne | jeblair: any change in flight or mostly in etherpad or ideas floating around? | 22:07 |
| jeblair | mgagne: i'm not sure if we will ever completely remove puppet (we might use it to install our keys) | 22:07 |
| *** yamamoto has quit IRC | 22:07 | |
| jeblair | mgagne: right now we have some images configured partially by dib | 22:07 |
| mgagne | yes, I saw the elements | 22:08 |
| *** Rockyg has quit IRC | 22:08 | |
| jeblair | yeah, and there's a puppet element to pull in what we're doing now | 22:08 |
| mgagne | I'm mostly curious as to how it will be organized as Puppet abstract a lot of stuff already and there is some logic in there | 22:08 |
| *** annegent_ has joined #openstack-infra | 22:09 | |
| *** otter768 has quit IRC | 22:09 | |
| jeblair | i think we want to get almost all of what puppet does for those nodes into dib. maybe even all of it. we're not actively moving right now because we're still moving to dib from snapshot images. but i think the plan is: | 22:09 |
| *** bknudson has quit IRC | 22:09 | |
| jeblair | finish moving from snapshot to dib | 22:09 |
| jeblair | remove the dependency installation from puppet by using bindep | 22:10 |
| mgagne | should there only be one big element called single-use-jenkins-slave (or whatever) with a gazillion scripts in there which would mainly translate Puppet into Bash? | 22:10 |
| jeblair | mgagne: oh goodness no, the elements should get simpler, not more complex | 22:10 |
| *** radez_g0n3 is now known as radez | 22:11 | |
| *** signed8bit has quit IRC | 22:11 | |
| jeblair | mgagne: i should also say: it's dib, so you can use whatever is appropriate in there; puppet, chef, ansible, etc. | 22:11 |
| *** signed8bit has joined #openstack-infra | 22:11 | |
| *** tlian2 has quit IRC | 22:11 | |
| jeblair | mgagne: but i think what we want is a set of simple elements that set up the most basic dependencies on our build nodes, like zuul-cloner, bindep, etc. another set to pre-cache things we might need (git repos, binary packages for bindep, cirros images, etc). we may or may not have puppet run to set up our keys. | 22:12 |
| mgagne | right | 22:12 |
| jeblair | mgagne: then the jobs themselves install whatever dependencies they need using bindep (and hopefully most of them should be cached) | 22:12 |
| mgagne | I'll read more about bindep then | 22:13 |
| *** annegentle has quit IRC | 22:13 | |
| *** chen12 has joined #openstack-infra | 22:15 | |
| mgagne | jeblair: thanks! | 22:15 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Update tox environment list https://review.openstack.org/190609 | 22:16 |
| jeblair | mgagne: the really short version of how we want to use it is to allow projects to specify their binary dependencies in tree so we can install them automatically | 22:16 |
| jeblair | yolanda, nibalizer, greghaynes: you're all set up, let me know if something doesn't look right | 22:17 |
| greghaynes | jeblair: awesome, ty | 22:17 |
| fungi | yep, i'm about to upload the change that will iterate through all the branches of all the cached git repos and concatenate all the bindep other-requirements.txt lists it finds, then predownload the packages for them | 22:17 |
| fungi | though i need to finish cooking and eating dinner before the nova vulnerability management review starts in 40 minutes | 22:18 |
| jeblair | so that's the part we would run in an element | 22:18 |
| mgagne | jeblair: I agree with this vision. I'm trying to deal with what is available now =) | 22:18 |
| fungi | jeblair: i was adding it to the nodepool-base element, but can make it a separate element if desired | 22:18 |
| jeblair | mgagne: right now, we are doing _all of the things_ since just about everything is mid-transition :) | 22:18 |
| mgagne | =) | 22:19 |
| jeblair | fungi: i wonder if a separate element might make it more reusable for folks like mgagne? | 22:19 |
| jeblair | (for that matter, 'cache all the git repos' is probably another good reusable unit of work) | 22:19 |
| clarkb | it would have to depend on the nodepool element for the git repos right? | 22:19 |
| mgagne | I did partially imported nodepool-base due to nodepool requiring /etc/nodepool to exists for whatever reason | 22:19 |
| *** Sukhdev has quit IRC | 22:19 | |
| *** dontalton2 has joined #openstack-infra | 22:19 | |
| clarkb | mgagne: thats where nodepool writes things, you do need it | 22:20 |
| clarkb | (for nodepool) | 22:20 |
| mgagne | clarkb: sure, what I meant is: why can't it create it itself? | 22:20 |
| *** sabeen has joined #openstack-infra | 22:20 | |
| *** mriedem has quit IRC | 22:20 | |
| *** husanu has quit IRC | 22:20 | |
| jeblair | mgagne: it doesn't necessarily have access at that point | 22:20 |
| mgagne | clarkb: nodepool assumes that your image has /etc/nodepool precreated which forces me to add it in DIB | 22:20 |
| clarkb | mgagne: es for the reason jeblair just stated | 22:20 |
| mgagne | jeblair: what is "it" ? | 22:21 |
| clarkb | the nodepool user may not be allowed to write to /etc at VM boot time | 22:21 |
| timrc | My fingers like typing opensack-infra. Bad fingers. | 22:21 |
| jeblair | mgagne: (nodepool logging in as the test user which may or may not have sudo access) | 22:21 |
| mgagne | ohhhhh | 22:21 |
| mgagne | very good point | 22:21 |
| *** jgrimm is now known as zz_jgrimm | 22:21 | |
| *** rfolco has quit IRC | 22:21 | |
| fungi | clarkb: yep, it needs to drag in the git repo caching element. luckily the source repos caching happens in the extra-data phase before anything in the install phase where package caching runs, so priority juggling won't be an issue | 22:21 |
| *** husanu has joined #openstack-infra | 22:22 | |
| fungi | clarkb: it also needs to depend on the element which installs bindep into the iname | 22:22 |
| fungi | s/iname/image/ | 22:22 |
| *** annegent_ has quit IRC | 22:22 | |
| *** annegentle has joined #openstack-infra | 22:22 | |
| *** gyee has quit IRC | 22:23 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Add Mercador project meeting to IRC. https://review.openstack.org/194738 | 22:23 |
| *** yamahata has quit IRC | 22:23 | |
| *** puranamr has quit IRC | 22:24 | |
| fungi | but if i'm putting the distro package caching into a separate element, maybe i'll move the bindep installation into the same element | 22:24 |
| *** dizquierdo has quit IRC | 22:24 | |
| fungi | will make it easier to keep the numbers correct relative to each other | 22:24 |
| fungi | the tricky bit is that it has to happen after puppet installs pip | 22:25 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 22:26 | |
| *** xyang1 has quit IRC | 22:26 | |
| *** gyee has joined #openstack-infra | 22:27 | |
| *** puranamr has joined #openstack-infra | 22:28 | |
| *** ghostpl has joined #openstack-infra | 22:29 | |
| *** signed8bit has quit IRC | 22:30 | |
| *** austin81 has quit IRC | 22:31 | |
| *** amitgandhinz has quit IRC | 22:31 | |
| *** dboik has quit IRC | 22:32 | |
| *** puranamr has quit IRC | 22:32 | |
| *** puranamr has joined #openstack-infra | 22:32 | |
| *** esmute__ has quit IRC | 22:33 | |
| *** ghostpl has quit IRC | 22:34 | |
| *** puranamr has quit IRC | 22:36 | |
| *** puranamr has joined #openstack-infra | 22:36 | |
| _ody | clarkb: found kibana, that is the most promising for what I was looking for...except the old version of kibana. | 22:38 |
| *** esmute__ has joined #openstack-infra | 22:40 | |
| *** linkedinyou has joined #openstack-infra | 22:40 | |
| *** puranamr has quit IRC | 22:40 | |
| pleia2 | jesusaurus is doing some work to support kibana3 in our infrastructure, so I suspect an upgrade is in the future at some point | 22:40 |
| *** angela-s has quit IRC | 22:41 | |
| *** puranamr has joined #openstack-infra | 22:41 | |
| *** maxandersen has left #openstack-infra | 22:41 | |
| pleia2 | open reviews for it: https://review.openstack.org/#/q/status:open+topic:kibana3,n,z | 22:41 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/project-config: Do not run requirements check on keystonemiddleware kilo branch https://review.openstack.org/194849 | 22:42 |
| pleia2 | _ody: ^^ | 22:42 |
| rlucio | hey guys, i've starting getting CI failures from a heat update complaining about needing anew version of qpid-python, but i cant find a new version from pip | 22:42 |
| rlucio | anyone else seen this? qpid-python;python_version=='2.7' | 22:42 |
| clarkb | _ody its old because es didnt work with kibana 3 in read only mode | 22:44 |
| pleia2 | clarkb: ah, good to know | 22:44 |
| openstackgerrit | Joshua Harlow proposed openstack-infra/release-tools: Optional include pypi package url link in release notes https://review.openstack.org/194850 | 22:44 |
| clarkb | _ody that may have changed and anyone can test against http://logstash.openstack.org/elasticsearch | 22:44 |
| clarkb | if it works we can deploy new thing but wheb I checked forever ago it didnt work as it needed to write to an index | 22:45 |
| *** rwsu has quit IRC | 22:47 | |
| clarkb | apparently acls are in the paid version of es | 22:47 |
| pleia2 | sigh | 22:47 |
| *** puranamr has quit IRC | 22:49 | |
| *** puranamr has joined #openstack-infra | 22:49 | |
| *** rlucio has quit IRC | 22:49 | |
| lifeless | fungi: can has +A ? https://review.openstack.org/#/c/194314/ | 22:52 |
| fungi | wow. rlucio didn't stick around long enough to get an answer | 22:52 |
| *** tim_o has quit IRC | 22:52 | |
| fungi | lifeless: ahh, yep. i had already reviewed that but not voted on it | 22:53 |
| lifeless | https://review.openstack.org/#/c/189251/ is in the same state | 22:53 |
| fungi | yeah, i followed the needed-by link | 22:54 |
| *** weshay has quit IRC | 22:54 | |
| *** prad_ has joined #openstack-infra | 22:55 | |
| *** prad has quit IRC | 22:56 | |
| *** prad_ is now known as prad | 22:56 | |
| lifeless | fungi: if you go up the stack | 22:56 |
| lifeless | fungi: there are 5 things that I think dhellmann has +2'd all of | 22:56 |
| fungi | i just finished reviewing them. all lgtm | 22:56 |
| lifeless | fungi: if you were to +2+A, we'd be onto the iterate-on-jobs buts | 22:56 |
| lifeless | bits | 22:56 |
| fungi | and with that, i need to shift gears to nova vulnerability review meeting | 22:57 |
| lifeless | ack | 22:57 |
| lifeless | thanks! | 22:57 |
| *** puranamr has quit IRC | 22:57 | |
| fungi | and hopefully find time to get back to our nodepool bindep prep script/dib element integration | 22:57 |
| *** baoli has joined #openstack-infra | 22:58 | |
| lifeless | fungi: Can we setup an experimental job to run devtack in constraints mode first? | 22:58 |
| lifeless | fungi: because I don't think I can do that via Depends-On | 22:58 |
| lifeless | fungi: I linked the WIP devstack patch earlier | 22:59 |
| *** Guest15326 has quit IRC | 22:59 | |
| *** baoli has quit IRC | 22:59 | |
| clarkb | lifeless just have a devstack change that does constraints depend on the constraint code? | 22:59 |
| fungi | lifeless: yeah, didn't have time to look at it yet. adding an experimental job for that is likely straightforward if the feature exists | 22:59 |
| lifeless | clarkb: REQUIREMENTS_MODE is passed in from zuul AIUI | 23:00 |
| clarkb | just set it in devstack | 23:00 |
| *** baoli has joined #openstack-infra | 23:00 | |
| fungi | if devstack lacks a non-default constraints mode, then that's probably the next order of business | 23:00 |
| lifeless | clarkb: I need it to be different everywhere | 23:00 |
| *** r-daneel has quit IRC | 23:00 | |
| clarkb | right but | 23:00 |
| clarkb | to test it just set it in a chabge | 23:00 |
| lifeless | clarkb: I guess I have too vague an idea on the entry points here | 23:01 |
| lifeless | clarkb: I'll poke around | 23:01 |
| lifeless | [but I think we're ready for the jobs anyway, so I'd like to get that happening] | 23:01 |
| clarkb | I dont think you want new devstack jobs, just jobs for bumping testibg then proposing conatraints right? | 23:01 |
| lifeless | no | 23:02 |
| lifeless | we wanted a full set of parallel jobs | 23:02 |
| *** rlucio has joined #openstack-infra | 23:02 | |
| clarkb | then existing devstack jobs set the enforcemebt as appropriate | 23:02 |
| lifeless | starting experimental | 23:02 |
| *** bknudson has joined #openstack-infra | 23:02 | |
| lifeless | then nonvoting | 23:02 |
| clarkb | wat ok | 23:02 |
| lifeless | then finally a flag day | 23:02 |
| *** dimtruck is now known as zz_dimtruck | 23:02 | |
| clarkb | I would just do the chabge like I describe the flip switch when it works | 23:02 |
| clarkb | much easuer | 23:02 |
| clarkb | parallel jobs get tough to juggle when you have >1 | 23:02 |
| lifeless | so I'll happily follow guidance and variation from the spec | 23:03 |
| lifeless | OTOH, if there's a long tail here | 23:03 |
| lifeless | I don't want to be chasing regressions in one part to land a working thing in a another part | 23:03 |
| *** annegentle has quit IRC | 23:03 | |
| clarkb | the place where new jobs will be helpful is if we expect changes yo many repos to be nexessary | 23:03 |
| lifeless | so the idea was that we'd be able to move them voting step by step | 23:04 |
| lifeless | we're expecting to have to change the tox.ini on everyones project, one you and I and Nakato have figured out what a constraints-using tox.ini looks like | 23:04 |
| clarkb | is there a long tail though? | 23:04 |
| clarkb | they either work or dont | 23:04 |
| clarkb | they should not race etc | 23:04 |
| *** annegentle has joined #openstack-infra | 23:05 | |
| *** zz_dimtruck is now known as dimtruck | 23:05 | |
| *** puranamr has joined #openstack-infra | 23:05 | |
| clarkb | (since we are making the tests deterministic) | 23:05 |
| *** mriedem has joined #openstack-infra | 23:05 | |
| *** baoli has quit IRC | 23:06 | |
| lifeless | So look | 23:06 |
| lifeless | I'm piggy in the middle here | 23:06 |
| lifeless | we came up with a plan | 23:06 |
| lifeless | I'm executing. | 23:06 |
| *** sdake has joined #openstack-infra | 23:07 | |
| lifeless | I don't particularly care about the steps. If they should be different, I'm not going to argue. | 23:07 |
| clarkb | ok I am just suggesting that we take advatage of self testing gated prohects as that is why the tests exist as they do. we can do it the other way, I thibk it just complicated and works arou d the checks we already have in place | 23:07 |
| *** tonytan4ever has quit IRC | 23:08 | |
| lifeless | we don't CI changes to the zuul config though | 23:08 |
| clarkb | but many people dont frel confortable flipping switches if results come back green (eg pass the gate) | 23:08 |
| lifeless | if we did we could do this as a single switch with confidence | 23:08 |
| clarkb | lifeless we shouldnt br changing zuul config for the dwitch, its devstack and tox.ini | 23:08 |
| lifeless | but as we don't, I don't understand how we'd do that | 23:08 |
| fungi | yeah, i too balked at the idea that we're going to have a way to run every job for every repo on a single change right now. that might become easier with zuul v3, but starting with a basic set of integration jobs run on the constraints update (assuming that's what you're talking about) should be better than what we have | 23:09 |
| clarkb | devstack starts enforcing everywhere is self tested by devstack,tox.ini enforcing is self tested by project unittests | 23:09 |
| *** prometheanfire has left #openstack-infra | 23:09 | |
| Nakato | Yes, started looking at that yesterday. lifeless to confirm what I'm thinking the idea is, constraints will run in addition to the current pyXX tests for each python right? | 23:09 |
| lifeless | Nakato: the goal is to have the unit tests in the gate use the upper-constraints.txt file that is being added to global-requirements | 23:10 |
| *** lhcheng has quit IRC | 23:10 | |
| *** annegentle has quit IRC | 23:10 | |
| fungi | which our generate-constraints proposal job will attempt to keep in sync to the projects, though slightly asynchronously | 23:10 |
| lifeless | clarkb: so its devstack-vm-gate-wrap.sh that needs to change | 23:10 |
| Nakato | lifeless: Just the gate, not on developer systems? | 23:10 |
| lifeless | ./devstack-vm-gate-wrap.sh:export REQUIREMENTS_MODE=${REQUIREMENTS_MODE:-strict} | 23:10 |
| clarkb | lifeless ok, that eould be a self tested change as well | 23:11 |
| *** timothyb89 has quit IRC | 23:11 | |
| lifeless | ok, that I can do | 23:11 |
| lifeless | Nakato: we want to make it possible for developers to do that too | 23:11 |
| lifeless | Nakato: but we don't want to break developers existing workflows | 23:11 |
| clarkb | right so devstack default is old way, gate default is bew way, maybe they converge later | 23:12 |
| *** dboik has joined #openstack-infra | 23:12 | |
| clarkb | tox is trickier but can switch on flags too I think | 23:13 |
| lifeless | clarkb: we kind of handwaved a bit about tox at the summit | 23:13 |
| lifeless | but TBH since unit tests are not global wedges | 23:13 |
| clarkb | ya unittests are less of a priority | 23:13 |
| lifeless | I'm entirely happy if we bring that in more slowly or even opt-in | 23:13 |
| docaedo | Hi .. I have a question about enabling CORS for app catalog site. Make that two. | 23:13 |
| lifeless | like 'if you want this, come and get it' | 23:13 |
| *** dboik has quit IRC | 23:14 | |
| docaedo | First, are there any security concerns with adding that header (as noted in https://bugs.launchpad.net/app-catalog/+bug/1467699)? | 23:14 |
| openstack | Launchpad bug 1467699 in Community App Catalog "CORS not enabled" [Undecided,In progress] - Assigned to Christopher Aedo (docaedo) | 23:14 |
| *** Hal has joined #openstack-infra | 23:15 | |
| *** esmute__ has quit IRC | 23:15 | |
| fungi | docaedo: is there an api there currently which will benefit from cors implementation? though if it's just a tweak to the apache config we can add that to the puppet module pretty easily yeah? | 23:15 |
| *** Hal is now known as Guest74493 | 23:15 | |
| docaedo | fungi: this is to enable work we're doing on a horizon panel, to integrate catalog contents directly in horizon (hopefully for a one-click add to an environment) | 23:16 |
| *** dontalton2 has quit IRC | 23:16 | |
| *** dontalton has quit IRC | 23:16 | |
| fungi | docaedo: ok, cool. krotscheck: do you have any input on that plan? | 23:16 |
| docaedo | fungi: think it's a very easy add, but needs mod_headers module to be enabled, and I am not sure I can do that only via the app-catalog repo | 23:16 |
| * krotscheck is reading scrollback | 23:17 | |
| fungi | docaedo: yeah, the apache puppet module lets us specify mods to load | 23:17 |
| _ody | clarkb: running kibana3 from my laptop pointed at http://logstash.openstack.org/elasticsearch working so far...will hack around with it and see if it is even going to do what I want. | 23:17 |
| _ody | Thanks for the URL. | 23:17 |
| krotscheck | docaedo: Is the app catalog a python wsgi app? | 23:18 |
| fungi | docaedo: i don't recall the exact syntax off the top of my head, but it'll be just a few extra lines in the puppet-apps_site manifest | 23:18 |
| docaedo | krotscheck: um, app catalog is not right now, but kfox1111 was working on what I think was a horizon plugin that would fetch things from the catalog | 23:20 |
| *** erlon has quit IRC | 23:20 | |
| *** hichihara has joined #openstack-infra | 23:20 | |
| krotscheck | docaedo: Ah-hah. What language is it built in? | 23:20 |
| docaedo | fungi: should be as easy as "include apache::mod::headers" .. except headers is not an enabled module by default | 23:21 |
| krotscheck | docaedo: I'm just checking because we have a thing in OpenStack that does CORS now, and if you use that thing it'd be maintained for you, but if you're not using python then it doesn't really make sense. | 23:21 |
| docaedo | krotscheck: just JS, catalog contents are flat YAML files | 23:21 |
| anteaya | fungi: I don't know if I noticed it before but reading the text log of the neutron meeting has not single quotes in positions where folks seem to be making contractions | 23:21 |
| openstackgerrit | Joshua Harlow proposed openstack-infra/project-config: Remove py26 gating for automaton https://review.openstack.org/194860 | 23:21 |
| anteaya | I'm feeling confident the single quote is the intention | 23:22 |
| anteaya | http://eavesdrop.openstack.org/meetings/networking/2015/networking.2015-06-22-21.00.log.txt | 23:22 |
| docaedo | krotscheck: thanks for checking :) we're talking about best ways to integrate catalog stuff with other environments (making it as painless as possible) | 23:22 |
| krotscheck | docaedo: Nice. Yeah, that'd be a mod header thing. The only security concern I have is that using the '*' allowed_domain is a crazy security hole if you actually allow modifications to the service, but if it's all static then I don't have a problem with it. | 23:22 |
| openstackgerrit | Michael Still proposed openstack/requirements: Nova requires concurrency 2.1.0 or better https://review.openstack.org/194861 | 23:22 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Update default Fedora to 22 https://review.openstack.org/185843 | 23:23 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Work around yum/dnf differences https://review.openstack.org/185842 | 23:23 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add YUM variable to for Fedora >= 22 https://review.openstack.org/185841 | 23:23 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Cleanup yum downloading https://review.openstack.org/186620 | 23:23 |
| *** sdake_ has joined #openstack-infra | 23:23 | |
| krotscheck | docaedo: I expect you want this to work for any horizon install out there, so you'd want to wildcard the domain. | 23:23 |
| *** jasondotstar has joined #openstack-infra | 23:23 | |
| docaedo | krotscheck: yes, agree would be a security concern if it wasn't static, but I wanted to check with you folks to make sure there wasn't a bigger concern I was missing | 23:23 |
| ianw | greghaynes: ^ i think that f22 stack has addresssed all comments | 23:23 |
| docaedo | krotscheck: and exactly, would want this to work from anyones horizon | 23:23 |
| fungi | docaedo: it seems fine to me. mainly wanted to drag in krotscheck as our resident cors whipping post | 23:24 |
| krotscheck | :-P | 23:24 |
| ianw | i also think puppet 3 isn't supporting f22, which throws another spanner in the works ... need to research what's going on | 23:24 |
| jeblair | dhellmann: i think i had an epiphany all over your change here: https://review.openstack.org/191193 let me know if i now understand | 23:24 |
| pleia2 | anteaya: looks like armax is using some utf8 character or something for ' (mestery's single quotes are fine) | 23:24 |
| docaedo | fungi: more eyes and opinions is always good with me | 23:24 |
| *** yamamoto has joined #openstack-infra | 23:24 | |
| anteaya | pleia2: ah okay thanks for checking, I'll talk to armax and see what he is using | 23:25 |
| *** otter768 has joined #openstack-infra | 23:25 | |
| jeblair | docaedo: we enable cors for zuul | 23:25 |
| jeblair | docaedo: so the puppet to do that should be floating around already | 23:26 |
| jeblair | fungi: ^ | 23:26 |
| krotscheck | docaedo: I don't have security concerns as long as it's GET only. Other alternatives could include hosting a 1px iframe with javascript on the app catalog, and then using iframe messages to pass data back and forth. | 23:26 |
| docaedo | jeblair: excellent, I'll see if I can find it | 23:26 |
| *** sdake has quit IRC | 23:26 | |
| fungi | jeblair: oh, awesome. i forgot we needed that to be able to embed its status.json | 23:26 |
| openstackgerrit | Matthew Treinish proposed openstack/os-testr: Disable printing percent change on run time by default https://review.openstack.org/194865 | 23:26 |
| fungi | docaedo: puppet-zuul repo i believe | 23:26 |
| krotscheck | But that's annoying and complicated. | 23:26 |
| jeblair | yeah, it's a read-only api though, so the security review for that was pretty quick. :) | 23:27 |
| fungi | well, apps.o.o is also read-only at the moment | 23:27 |
| * krotscheck wanders off again to go beat his head against internal HP things. | 23:27 | |
| fungi | thanks krotscheck! | 23:27 |
| anteaya | pleia2: xgerman as well | 23:27 |
| jeblair | krotscheck: wear a helmet! | 23:27 |
| fungi | if only he had a holocaust cloak | 23:27 |
| pleia2 | anteaya: yeah, maybe they're using the same client? | 23:27 |
| anteaya | maybe? | 23:28 |
| mtreinish | jeblair: if you get a sec want to +A https://review.openstack.org/194302 ? It'll be good to land before the next round of periodic jobs start | 23:28 |
| pleia2 | anteaya: likely fix is we could look into adding "AddDefaultCharset utf-8" to the apache config for logs, but I haven't actually looked at our current config | 23:29 |
| *** stevemar has quit IRC | 23:29 | |
| anteaya | pleia2: I too have not looked at the current config | 23:29 |
| *** hdd has quit IRC | 23:30 | |
| anteaya | pleia2: but adding something might be worth considering | 23:30 |
| * pleia2 nods | 23:30 | |
| *** ghostpl has joined #openstack-infra | 23:30 | |
| anteaya | was going to finish reading the meeting logs for all the meetings I missed first | 23:30 |
| *** hdd has joined #openstack-infra | 23:30 | |
| openstackgerrit | Matthew Treinish proposed openstack/os-testr: Dogfood things for unit tests https://review.openstack.org/194870 | 23:34 |
| jeblair | mtreinish: the same icehouse jobs failed twice; are you sure they are benign? | 23:34 |
| *** ZZelle has quit IRC | 23:35 | |
| *** ghostpl has quit IRC | 23:35 | |
| *** rguillebert has quit IRC | 23:35 | |
| jeblair | it looks like ianw does | 23:35 |
| jeblair | it's just that we're changing branch selection and all, so when we lose an entire branch, it's worth a double check :) | 23:36 |
| mtreinish | jeblair: I assumed it was nova-api wasn't starting because of an oslo thing: http://logs.openstack.org/02/194302/4/check/check-tempest-dsvm-neutron-icehouse-nv/ca4b680/logs/screen-n-api.txt.gz | 23:36 |
| mtreinish | I didn't think my change could have caused that | 23:36 |
| *** dimtruck is now known as zz_dimtruck | 23:37 | |
| mtreinish | it also looks like icehouse is generally failing for that too: http://logs.openstack.org/24/194724/4/check/check-tempest-dsvm-full-icehouse/ee2f41a/logs/screen-n-api.txt.gz | 23:37 |
| mtreinish | we also just pushed the last icehouse release right? So we can just eol everything now | 23:38 |
| *** mriedem has quit IRC | 23:38 | |
| jeblair | mtreinish: i have an inline question | 23:38 |
| mtreinish | dhellmann, dims: btw, the il8n thing from before is hitting us, just on icehouse ^^^ | 23:38 |
| krotscheck | jeblair: Where was that page with the "Here's the structure of build things" again that I need to update for javascript things? | 23:39 |
| fungi | mtreinish: icehouse is being eol-tagged/deleted later this week, yeah | 23:39 |
| *** mriedem has joined #openstack-infra | 23:39 | |
| jeblair | krotscheck: http://governance.openstack.org/reference/project-testing-interface.html | 23:39 |
| fungi | we usually give it 7 days for emergency brown-bag releases after the last stable point release | 23:39 |
| krotscheck | jeblair: Thanks | 23:40 |
| openstackgerrit | Merged openstack-infra/project-config: Fix fuel-docs acls to allow merge commit https://review.openstack.org/194717 | 23:40 |
| openstackgerrit | Christopher Aedo proposed openstack-infra/puppet-apps_site: Enable CORS for app-catalog https://review.openstack.org/194875 | 23:40 |
| *** sdake_ has quit IRC | 23:40 | |
| *** yamamoto has quit IRC | 23:41 | |
| krotscheck | So on a related note, I'd like to create a project as a bellweather for publishing from infra to NPM. | 23:42 |
| krotscheck | And, well, I think a good target would be a hacking-like project for javascript style guidelines. | 23:42 |
| lifeless | +1 | 23:42 |
| krotscheck | What namespace should that live under? | 23:42 |
| mtreinish | jeblair: responded, but basically I just assumed using the fallback upfront was safer when the override ref was undefined | 23:42 |
| lifeless | krotscheck: so, openstack-dev hosts hacking, but AIUI we're steering things towards openstack/ these days | 23:43 |
| jeblair | mtreinish: i believe previous successful runs had both variables empty; i actually think that even with this you will be setting it to empty because fallback will be | 23:43 |
| mtreinish | fungi: is there anyway we could accelerate that? because I don't think we can land any tempest changes until we either eol it or fix the cap | 23:43 |
| jeblair | mtreinish: get_fetch_at_ref has a special case for '' | 23:44 |
| mtreinish | fungi: actually you know what I'm just going to premptively remove the tempest icehouse jobs | 23:44 |
| jeblair | mtreinish: http://logs.openstack.org/periodic-qa/periodic-tempest-dsvm-all-master/92543ab/logs/devstack-gate-setup-workspace-new.txt.gz (a previous successful run) | 23:44 |
| mtreinish | jeblair: oh, ok. I probably should have looked at the def for get_fetch_at_ref | 23:44 |
| fungi | mtreinish: yes, i think dropping the backward-compat jobs for icehouse is fine at this stage | 23:44 |
| mtreinish | jeblair: I can respin and remove that bit, one sec | 23:45 |
| fungi | oh, i didn't realize we had the null string special cased there | 23:45 |
| jeblair | mtreinish: great, thanks. i think that is worth doing so that it doesn't become voodoo when we look at it next. | 23:45 |
| *** DericHorn-HP has quit IRC | 23:45 | |
| *** ramashri has quit IRC | 23:46 | |
| dims | mtreinish: icehouse. wow | 23:46 |
| *** yamamoto has joined #openstack-infra | 23:47 | |
| openstackgerrit | Joshua Harlow proposed openstack/requirements: Enable 'python_version=='2.6' for futures and enum34 https://review.openstack.org/194877 | 23:48 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/devstack-gate: Fix the setup_workspace to handle missing ZUUL_BRANCH https://review.openstack.org/194302 | 23:49 |
| mtreinish | fungi, jeblair: ^^^ | 23:49 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/project-config: Remove icehouse compat jobs from tempest https://review.openstack.org/194878 | 23:50 |
| mtreinish | fungi, jeblair: also ^^^ | 23:50 |
| jeblair | so we _just_ released the last icehouse and now it's failing? | 23:50 |
| *** Swami has quit IRC | 23:51 | |
| mtreinish | jeblair: yep | 23:51 |
| jeblair | ah, i have read commit msg | 23:51 |
| mtreinish | it was the oslo releases from this afternoon | 23:51 |
| mtreinish | probably missing a cap on something somewhere | 23:51 |
| mtreinish | on icehouse | 23:51 |
| jeblair | i'm assuming this falls into the category of "should be fixed by ongoing requirements work" | 23:51 |
| openstackgerrit | Joshua Harlow proposed openstack-infra/project-config: Remove py26 check/gating for oslo.messaging https://review.openstack.org/194879 | 23:52 |
| mtreinish | jeblair: this is actually an improvement earlier stable releases (from feb or jan) was pushed when the gate was completely fubar and nothing could land | 23:52 |
| mtreinish | at least this one was pushed before things were broke | 23:52 |
| mtreinish | jeblair: yeah, hopefully this kinda thing will all be sorted by the requirements work | 23:53 |
| *** isq has quit IRC | 23:54 | |
| anteaya | fungi: I too am sick to death of fireworks | 23:55 |
| *** dims has quit IRC | 23:56 | |
| anteaya | no idea how some folks can think 7am on a Sunday is the right time for fireworks | 23:56 |
| Clint | that's special | 23:56 |
| anteaya | yeah | 23:56 |
| anteaya | I am hoping to figure out how it can be less special | 23:56 |
| anteaya | phoning the municipality is not the solution unfortunately | 23:57 |
| *** ajmiller has quit IRC | 23:58 | |
| ianw | jeblair: 00000aa0 6c 61 72 6d 2d 6e 6f 74 69 66 69 65 72 2e 74 78 |larm-notifier.tx| <- that "f" shows up funny in my firefox, but i can't see that it's encoded in any funny way | 23:58 |
| fungi | anteaya: here its every single night now. and i think will be until septemberish | 23:58 |
| *** chlong has joined #openstack-infra | 23:58 | |
| anteaya | fungi: you beat me then | 23:58 |
| mtreinish | anteaya: heh, I would call the mounties :) | 23:58 |
| lifeless | fireworks are illegal here except for a couple nights of the year | 23:58 |
| fungi | ianw: probably fi glyph munging | 23:58 |
| anteaya | we have the occasional monday and wednesday when it is just birds and frogs | 23:58 |
| anteaya | and loons | 23:58 |
| fungi | lifeless: here too | 23:58 |
| fungi | lifeless: doesn't stop anyone | 23:59 |
| lifeless | hah, does here :) | 23:59 |
| anteaya | mtreinish: please do, tell them to fix this | 23:59 |
| lifeless | turns out people don't like loud bangs at night | 23:59 |
| anteaya | lifeless: ensure it stays that way | 23:59 |
| anteaya | fireworks used to be illegal here too | 23:59 |
| anteaya | except by special permit | 23:59 |
| *** hdd has quit IRC | 23:59 | |
| lifeless | then a fireworks company sued? | 23:59 |
| anteaya | turns out we were standing in the way of people's fun | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
