| Shrews | well, i guess that's putting the cart before the horse. nm | 00:00 |
|---|---|---|
| mordred | Shrews: we should get a horse | 00:16 |
| Shrews | totally | 00:16 |
| * Shrews phones up olaph | 00:16 | |
| mordred | Shrews: that's a cow, man | 00:17 |
| Shrews | he's got connections | 00:18 |
| mordred | good point | 00:18 |
| mordred | Shrews: however, I was thinking that we bind-mount the source dir into the container each time - so things like log files or .testrepository dirs should just stick aroudn | 00:42 |
| chmouel | since it's 2:57AM and i am jetlagged, i have published the blog post http://blog.chmouel.com/2014/09/08/dox-a-tool-that-run-python-or-others-tests-in-a-docker-container/ here | 00:57 |
| chmouel | with some lame diagram but ppl said that blog posts look better with an image so i had to make up one | 00:58 |
| chmouel | probably should have put a horse there instead | 00:58 |
| chmouel | i may go try to go to sleep by dreaming of ponies now :) | 00:58 |
| Shrews | chmouel: awesome! | 00:59 |
| Shrews | also, go to sleep :) | 00:59 |
| chmouel | heh thanks | 00:59 |
| mordred | chmouel: thanks! tweeted | 01:02 |
| *** foobaxx2 has joined #dox | 01:33 | |
| openstackgerrit | David Shrewsbury proposed a change to stackforge/dox: Logging improvements https://review.openstack.org/119674 | 02:14 |
| Shrews | oh neat. bot is active | 02:14 |
| *** flaper87|afk is now known as flaper87 | 05:39 | |
| * flaper87 re-tweeted | 05:40 | |
| openstackgerrit | A change was merged to stackforge/dox: Logging improvements https://review.openstack.org/119674 | 06:26 |
| flaper87 | chmouel: good blog post, btw | 06:57 |
| openstackgerrit | Flavio Percoco proposed a change to stackforge/dox: Use `:20` tag in f20's DockerFile https://review.openstack.org/119704 | 07:18 |
| openstackgerrit | Flavio Percoco proposed a change to stackforge/dox: Add support for multiple images https://review.openstack.org/119705 | 07:18 |
| openstackgerrit | Flavio Percoco proposed a change to stackforge/dox: Add support for multiple images https://review.openstack.org/119705 | 07:19 |
| *** dmellado has joined #dox | 08:25 | |
| openstackgerrit | Flavio Percoco proposed a change to stackforge/dox: Add support for multiple images https://review.openstack.org/119705 | 08:33 |
| dmellado | Hi guys | 08:43 |
| dmellado | has anyone tried to run tempest tests | 08:43 |
| dmellado | using dox? | 08:43 |
| chmouel | dmellado: for the functional tests? | 11:05 |
| chmouel | dmellado: i don't think the support of devstack in docker works properly currently so this may need to be ironed out before doing this | 11:06 |
| dmellado | I see chmouel | 11:07 |
| dmellado | just visited your blog and wanted to check if we could give it a try ;P | 11:07 |
| dmellado | it looks quite promising | 11:07 |
| chmouel | hopefully down the line that would be very cool if that happen | 11:09 |
| flaper87 | chmouel: thoughts on https://review.openstack.org/#/c/119705/ ? | 11:44 |
| flaper87 | does that sound reasonable ? | 11:44 |
| * flaper87 has run glance's and zaqar's tests | 11:45 | |
| chmouel | i was just reviewing that :) | 11:46 |
| chmouel | flaper87: | 11:46 |
| chmouel | i like the idea, even if i am trying to map my head off between environements (i.e: tox env) and images | 11:47 |
| flaper87 | right. I was talking to mordred yday and ideally, developers shouldn't do "custom" things on the image except from installing the base requirements and perhaps setting some env variables if needed | 11:49 |
| flaper87 | I still think we may need som per-image-prep section later on but nothing we should worry about right now | 11:50 |
| chmouel | yeah probably for example the running tempest use case | 11:50 |
| chmouel | we may want to have a auto generated devstack image of the day | 11:50 |
| chmouel | instead of building it from scatch all the time | 11:51 |
| chmouel | but that's long term as you said | 11:51 |
| flaper87 | yeah, one idea is to have a `infra/zaqar/trusty` infra/devstack/something` | 11:51 |
| flaper87 | etc | 11:51 |
| chmouel | coool! | 11:51 |
| flaper87 | so that devs just have to point to that | 11:51 |
| chmouel | btw: some comments here http://www.reddit.com/r/python/comments/2frmpb/dox_a_tool_to_run_python_tests_into_docker_images/ | 11:51 |
| chmouel | i am in rh induction for all day so may have limited access | 11:51 |
| flaper87 | lol | 11:52 |
| flaper87 | good luck with that | 11:52 |
| openstackgerrit | Flavio Percoco proposed a change to stackforge/dox: Add support for multiple images https://review.openstack.org/119705 | 12:09 |
| Shrews | flaper87: lol. fast | 12:09 |
| flaper87 | :D | 12:09 |
| *** pgrygiel has joined #dox | 12:19 | |
| *** pgrygiel has left #dox | 12:21 | |
| Shrews | flaper87: so, thinking about 119705... not sure this makes sense. If you have a dox.yml with multiple images (say 'ubuntu' and 'fedora'), then the 'prep' commands may not be able to be applied to both | 12:37 |
| Shrews | ubuntu may want to 'apt-get install' stuff, but you'd need to use rpm on fedora | 12:37 |
| flaper87 | Shrews: hehe, yeah. So here's the thing | 12:39 |
| flaper87 | I was kinda discussing this with mordred yday | 12:39 |
| flaper87 | Ideally, developers shouldn't need to use `prep` at all | 12:40 |
| flaper87 | that is, prep should be used *just* to install project requirements and not to prepare the base test image | 12:40 |
| flaper87 | we would provide images like `infra/zaqar/trusty` etc | 12:40 |
| flaper87 | However, I still think we'll need a way to have per-image prep sections in the future | 12:40 |
| flaper87 | something like `prep-infra/f20` | 12:40 |
| flaper87 | (not sure whether that's valid yml, TBH` | 12:41 |
| flaper87 | )* | 12:41 |
| flaper87 | but I think that's a problem we should work on later | 12:41 |
| flaper87 | (YAGNI) | 12:41 |
| flaper87 | I mean, if we really face the need of having per-image prep sections, we can hack something out then | 12:41 |
| flaper87 | Shrews: does that make sense? | 12:42 |
| Shrews | that's a very openstack-centric view. for folks outside of openstack hoping to use this, it might not make sense for them to follow that model. | 12:42 |
| flaper87 | I agree | 12:42 |
| flaper87 | which is my main reason to think that we will need it | 12:43 |
| Shrews | hrm, need to think it over a bit. too early still. | 12:44 |
| * Shrews needs coffee | 12:44 | |
| * flaper87 gives Shrews a cup of coffee \_/? | 12:44 | |
| flaper87 | FWIW, I pushed that patch as a way to start the brainstorm | 12:44 |
| flaper87 | I've been using it since saturday and I felt comfortable with the API and how the images are specified | 12:45 |
| flaper87 | I did faced the need for a custom prep section right away | 12:45 |
| flaper87 | but I figured that we could probably start moving the multiple/images thing forward and brainstorm on the multi-prep section thing later | 12:45 |
| flaper87 | that patch there is already useful for testing on trusty/saucy/etc | 12:46 |
| flaper87 | with the same prep section | 12:46 |
| Shrews | we need a ML to discuss these things :) | 12:47 |
| openstackgerrit | A change was merged to stackforge/dox: Add `--fix-missing` to trusty's Dockerfile https://review.openstack.org/119640 | 14:21 |
| openstackgerrit | A change was merged to stackforge/dox: Use `:20` tag in f20's DockerFile https://review.openstack.org/119704 | 14:21 |
| *** cdent has joined #dox | 14:34 | |
| flaper87 | this just happened: https://github.com/openstack/zaqar/blob/master/dox.yml | 15:45 |
| flaper87 | :) | 15:45 |
| Shrews | flaper87: nice. i'm working on it for ironic | 15:54 |
| openstackgerrit | Mehdi Abaakouk proposed a change to stackforge/dox: Checks that docker is installed https://review.openstack.org/119814 | 16:53 |
| chmouel | super cooooll flaper87 | 16:54 |
| openstackgerrit | Chmouel Boudjnah proposed a change to stackforge/dox: Checks that docker is installed https://review.openstack.org/119814 | 16:59 |
| jroll | flaper87: neat | 17:01 |
| *** cdent_ has joined #dox | 17:54 | |
| *** cdent has quit IRC | 17:56 | |
| *** cdent_ is now known as cdent | 17:56 | |
| Shrews | flaper87: so how are you getting your test code into the test image? i don't see that happening in dox | 18:02 |
| Shrews | it's not enough to copy the requirements files :/ | 18:03 |
| Shrews | unless i'm _totally_ not seeing something | 18:03 |
| *** pcrews has joined #dox | 18:09 | |
| Shrews | mordred: oh, look who i've enticed into looking at dox. welcome mr. crews :) | 18:10 |
| mordred | pcrews: ola! | 18:10 |
| mordred | Shrews: there is a bind-mount thing .. one sec | 18:11 |
| Shrews | mordred: doh! i see it now | 18:11 |
| mordred | Shrews: http://git.openstack.org/cgit/stackforge/dox/tree/dox/runner.py#n139 | 18:11 |
| Shrews | yeah | 18:11 |
| pcrews | mordred: howdy! | 18:11 |
| mordred | pcrews: welcome to happy fun land! | 18:12 |
| * pcrews notes Shrews is a helluva salesman | 18:12 | |
| openstackgerrit | Mehdi Abaakouk proposed a change to stackforge/dox: Checks that docker is installed https://review.openstack.org/119814 | 18:13 |
| Shrews | mordred: i'm already desiring an infra/ironic/trusty image | 18:26 |
| Shrews | in the meantime, i can use shrews/ironic/trusty :) yay custom images | 18:27 |
| mordred | yay! | 18:27 |
| mordred | Shrews: I gave flaper87 access to upload images to that namespace for now until we have a more appropriate mechanism - you want I should do the same for you? | 18:29 |
| Shrews | mordred: i can just use my account for now, until we know how this is going to work | 18:29 |
| mordred | Shrews: done anyway | 18:29 |
| Shrews | coolio. thx | 18:29 |
| *** openstackgerrit has quit IRC | 18:51 | |
| chmouel | i have send a proposal for pycon us about docker python testings / dox | 18:56 |
| chmouel | (didn't have any other ideas to be honest) | 18:56 |
| Shrews | wow. we'd better make it work, then :) | 18:57 |
| chmouel | if any of you are going there, i will be happy to put you as co speaker if you want | 18:57 |
| chmouel | yeah that's in 6 month so i figured we have a bit of time | 18:57 |
| Shrews | chmouel: where is it? | 18:58 |
| chmouel | Shrews: this year again python us is in montreal | 18:59 |
| chmouel | mid april | 18:59 |
| Shrews | ah | 18:59 |
| Shrews | gah, meeting | 18:59 |
| chmouel | you have alreayd your calendar booked for april 2015? | 19:00 |
| chmouel | woo i guess you must be busy :) | 19:00 |
| Shrews | lol | 19:00 |
| Shrews | meeting NOW | 19:00 |
| Shrews | :-P | 19:00 |
| chmouel | hah :) | 19:00 |
| *** openstackgerrit has joined #dox | 19:06 | |
| *** openstackgerrit has quit IRC | 19:06 | |
| *** openstackgerrit has joined #dox | 19:07 | |
| *** Shrews has quit IRC | 20:17 | |
| *** Shrews has joined #dox | 20:17 | |
| Shrews | mordred: https://github.com/stackforge/dox/blob/master/dox/commands.py#L48 | 21:14 |
| Shrews | not sure what that's supposed to look like in the .yml file | 21:14 |
| Shrews | i need to execute more than one command, but that's not currently working. not sure it ever did | 21:15 |
| mordred | Shrews: so - that's supposed to be checking for a list | 21:15 |
| Shrews | ah | 21:16 |
| Shrews | but, it comes back as a string with the | operator. guess that's why it doesn't work | 21:16 |
| mordred | EXCELLENT | 21:16 |
| * Shrews munges the yml a bit | 21:16 | |
| mordred | Shrews: maybe we should also try to detect a multi-line | string and dtrt? | 21:19 |
| Shrews | mordred: does docker even _support_ multiple commands? | 21:19 |
| Shrews | ok, this works: docker run shrews/ironic:trusty ls && ps | 21:21 |
| Shrews | so i guess so | 21:22 |
| Shrews | think i know how to fix this | 21:23 |
| Shrews | commands: | 21:23 |
| Shrews | - pip install -e . | 21:23 |
| Shrews | - python setup.py testr --slowest | 21:23 |
| Shrews | just always make it a list | 21:24 |
| Shrews | and add && between the cmds | 21:24 |
| mordred | ah - nice | 21:25 |
| cdent | Shrews: what version of docker are you using? | 21:32 |
| Shrews | Docker version 1.0.1, build 990021a | 21:32 |
| cdent | I'm on on 1.1.2 and I can't replicate your && trick | 21:33 |
| cdent | I get the ps of the shell on the host, not the container | 21:33 |
| cdent | are you wrapping things somehow? | 21:33 |
| Shrews | no | 21:34 |
| * Shrews checks docker changelogs | 21:34 | |
| cdent | what shell do you use? | 21:35 |
| Shrews | bash | 21:35 |
| cdent | me too | 21:35 |
| Shrews | nothing in the release notes | 21:35 |
| Shrews | hmm, odd | 21:35 |
| Shrews | perhaps i should upgrade and try again | 21:36 |
| cdent | hold, just checking something | 21:36 |
| cdent | hmm, I thought perhaps it was because I was using sudo, but that's not it | 21:37 |
| Shrews | though, this is the version from trusty | 21:37 |
| Shrews | yeah, i'm not using sudo | 21:37 |
| cdent | I'm not any more | 21:37 |
| *** flaper87 is now known as flaper87|afk | 21:38 | |
| *** EmilienM has joined #dox | 21:40 | |
| EmilienM | mordred: hey | 21:41 |
| EmilienM | so here is the context: http://lists.openstack.org/pipermail/openstack-infra/2014-September/001913.html | 21:41 |
| mordred | EmilienM: biggest issue withi using dox for puppet integration tests will be cinder because iscsi doesn't work in containers | 21:41 |
| EmilienM | I want to bring advanced CI for OpenStack puppet modules. And dox could really help | 21:41 |
| mordred | EmilienM: but I'm _sure_ that there are plenty of other things that could be tested in it | 21:41 |
| EmilienM | mordred: we are far from this issue for now. | 21:42 |
| mordred | EmilienM: ++ | 21:42 |
| EmilienM | if I can run basic tests for now, I'm sure that will be good for starting. iSCSI is only one of the use cases, we could use other ones. | 21:42 |
| EmilienM | mordred: please read the mail if you have 2 min and let me know your thinking | 21:43 |
| mordred | EmilienM: it's open in my browser - I'll read through it in just a bit | 21:43 |
| EmilienM | mordred: no hurry, cool | 21:43 |
| EmilienM | mordred: I just want to be sure we are doing things good. | 21:43 |
| Shrews | cdent: try -- docker run shrews/ironic:trusty sh -c 'ls && ps' | 21:45 |
| cdent | that works Shrews | 21:46 |
| Shrews | great. so if >1 commands given, we could use that i suppose | 21:46 |
| cdent | seems reasonable starting point at least | 21:47 |
| Shrews | ugh. dinner or code.... so conflicted | 21:47 |
| Shrews | What Would Mordred Do | 21:47 |
| Shrews | probably very quickly code something that was horribly broken, leaving others to fix, then go have dinner :-P | 21:48 |
| cdent | ha! | 21:48 |
| mordred | Shrews: yes! you're learning! :) | 21:49 |
| cdent | mordred: have you met ingy? | 21:57 |
| mordred | cdent: not in person, we keep missing each other | 21:58 |
| cdent | that's his strategy too | 21:58 |
| cdent | I wondered if perhaps it was a conspiracy | 21:58 |
| mordred | cdent: it's possible that he and I are two halves of a personality disorder | 21:58 |
| EmilienM | mordred: dummy question, the dockerfiles/infra/trusty/Dockerfile in place is _really_ needed for Python testing. What if I want to do some ruby or puppet testing. Should I amend this one? or create a new one? Split in 2 files? | 21:58 |
| mordred | EmilienM: I think we're talking about having multiples - we haven't fully figure out where to put them yet though | 21:59 |
| mordred | so like we may have an infra/python27 and an infra/ruby19 or something | 21:59 |
| EmilienM | mordred: for now, I'm working on a new one | 21:59 |
| EmilienM | yeah | 21:59 |
| mordred | I think that's a good plan for now | 22:00 |
| EmilienM | that would make more sense to me | 22:00 |
| EmilienM | kk | 22:00 |
| mordred | as we try things and figure out what feels good and what feels angry :) | 22:00 |
| EmilienM | mordred: where in dox do you specify the python version? | 22:01 |
| mordred | we don't yet - so far that's in the base image description | 22:02 |
| mordred | but I want to get to the point where you can do something like in tox ... like "tox -epy27" | 22:02 |
| mordred | and have that do something sensible | 22:02 |
| mordred | and I think having a set of built-in targets like py27 or ruby19 would make things nice for folks (again, like tox does for python) | 22:03 |
| EmilienM | sure | 22:03 |
| Shrews | ugh. i'm making this too hard. quick fix is to just make that sh command my .yml command | 22:09 |
| Shrews | mordred: i think i'm going to add support for mounting a volume during test image build so we can run project setup at that time, if we desire | 22:12 |
| mordred | okie | 22:14 |
| Shrews | if possible, that is | 22:16 |
| Shrews | dunno. tired. leaving | 22:16 |
| openstackgerrit | Emilien Macchi proposed a change to stackforge/dox: First implementation of Puppet unit testing https://review.openstack.org/119943 | 22:27 |
| EmilienM | mordred: this is a very first implementation.^^^^^^ | 22:27 |
| *** cdent has quit IRC | 22:33 | |
| EmilienM | so this is an idea : http://lists.openstack.org/pipermail/openstack-infra/2014-September/001918.html | 22:39 |
| *** pcrews has quit IRC | 23:03 | |
| *** pcrews has joined #dox | 23:05 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!