| *** bnemec has quit IRC | 00:00 | |
| *** bnemec has joined #openstack-infra | 00:01 | |
| *** michchap has joined #openstack-infra | 00:01 | |
| leifmadsen | for some reason some commands were very slow trying to update a branch, and now 'git review' and 'git remote show gerrit' just seem to be hanging. Is there anything going on with the network? | 00:02 |
|---|---|---|
| clarkb | leifmadsen: not that I am aware of | 00:02 |
| * clarkb checks | 00:02 | |
| leifmadsen | ok, pabelanger told me he is having no issues | 00:02 |
| leifmadsen | so I'll re-setup locally | 00:02 |
| leifmadsen | git-review hangs too... heh | 00:02 |
| leifmadsen | huh* | 00:02 |
| leifmadsen | not sure what is up | 00:02 |
| clarkb | leifmadsen: can you strace it to see what it is doing? | 00:02 |
| clarkb | leifmadsen: git review can do quite a bit of work behind the scenes | 00:03 |
| pabelanger | leifmadsen: what version of git-review? | 00:03 |
| clarkb | leifmadsen: it checks if rebases are necessary before pushing for example | 00:03 |
| leifmadsen | fstat(3, {st_mode=S_IFIFO|0600, st_size=0, ...}) = 0 | 00:03 |
| leifmadsen | lseek(3, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) | 00:03 |
| leifmadsen | read(3, | 00:03 |
| leifmadsen | 00:03 | |
| leifmadsen | that's where it just.... stops | 00:03 |
| leifmadsen | clarkb: ya I just ran a rebase on this feature branch | 00:03 |
| *** changbl has quit IRC | 00:03 | |
| fungi | crap, that's what i get for falling behind on reviews. i thought we'd discussed https://review.openstack.org/39383 in here (before it got uploaded) and i pointed out that puppet does not default to root ownership on files, but instead defaults to copying the ownership from the source file as it exists on the filesystem | 00:03 |
| clarkb | ssh connectivity is fine from here | 00:04 |
| leifmadsen | ya, not sure what is up | 00:04 |
| clarkb | fungi: does it? --noop did not change the file | 00:04 |
| leifmadsen | odd, I think it is hanging on the ssh connection | 00:04 |
| clarkb | fungi: oh maybe it default to that when creating the file but if the file exists it leaves it be | 00:04 |
| leifmadsen | per git-review -v | 00:04 |
| fungi | at least the version we're running seems to do, last i tried it (which is why i had to chown my development puppet environment on the master so that it's root-owned) | 00:04 |
| clarkb | fungi: in that case I guess we need to change it to owner => root | 00:04 |
| * leifmadsen checks firewall for odd forwarding | 00:04 | |
| pabelanger | leifmadsen: ssh review.openstack.org -p 29418 | 00:05 |
| pabelanger | you might need to add username | 00:05 |
| clarkb | leifmadsen: ssh -p29418 user@review.openstack.org gerrit ls-projects | 00:05 |
| leifmadsen | ya, that's what it is hanging on | 00:05 |
| leifmadsen | doesn't complain, just sits there | 00:05 |
| pabelanger | dns issue? | 00:05 |
| fungi | i'm also still three hours behind on scrollback, so it'll likely take me nearly that to read it all the way this week's been going | 00:05 |
| mordred | dtroyer: I would not be opposed to one giant venv | 00:05 |
| leifmadsen | pabelanger: I'd be shocked if it were | 00:05 |
| leifmadsen | unless 8.8.8.8 is down | 00:06 |
| mordred | dtroyer: I'm also tired of dealing with it | 00:06 |
| leifmadsen | websites load fine | 00:06 |
| mordred | dtroyer: which is also weird, coming from a long-time debian guy | 00:06 |
| clarkb | leifmadsen: we do have AAAA records for it | 00:06 |
| clarkb | leifmadsen: could it be an ipv6 + ssh problem? | 00:06 |
| leifmadsen | perhaps? | 00:06 |
| mordred | oh yeah - if you don't have ipv6 firewall stuff properly | 00:06 |
| leifmadsen | I have ipv6 tunnelling setup | 00:06 |
| mordred | try ssh -4 -p29418 user@review.openstack.org gerrit ls-projects | 00:06 |
| leifmadsen | well, bitches about my key at least this time | 00:07 |
| leifmadsen | perhaps my ipv6 tunnel is down or osmething | 00:07 |
| pabelanger | leifmadsen: teksavvy right? | 00:07 |
| leifmadsen | pabelanger: no, I don't use them | 00:07 |
| leifmadsen | Rogers cable with HE | 00:07 |
| *** changbl has joined #openstack-infra | 00:08 | |
| openstackgerrit | lifeless proposed a change to openstack-dev/hacking: Revert "Add check for end of title line of commit messages" https://review.openstack.org/34601 | 00:08 |
| pabelanger | leifmadsen: Ya, I need to setup IPv6 again | 00:08 |
| morganfainberg | is there anyone who could tell me if there is an issue with pip and gerrit? I'm seeing failures on dep installs for xattr(maybe cffi related?). i didn't want to endlessly recheck nobug if it's a bigger issue or somehting i'm missing. | 00:09 |
| morganfainberg | (gate checks/pep8/etc) | 00:10 |
| clarkb | morganfainberg: I have a story to tell you | 00:10 |
| morganfainberg | clarkb: oh boy | 00:10 |
| clarkb | morganfainberg: cffi released version 0.7.1 today which xattr depends on. But 0.7.1 was broken | 00:10 |
| leifmadsen | bam fixed | 00:10 |
| leifmadsen | seems my IP changes | 00:10 |
| leifmadsen | changed* | 00:10 |
| morganfainberg | clarkb: awesome. | 00:10 |
| leifmadsen | so had to update HE | 00:10 |
| leifmadsen | thanks for the ipv6 hint | 00:10 |
| mordred | nice | 00:10 |
| leifmadsen | mordred: you get a beer | 00:10 |
| clarkb | morganfainberg: Alex_Gaynor pinned cffi in xattr to the previous version and we reran our mirror scripts and at that point things should be beter | 00:11 |
| mordred | woot! | 00:11 |
| morganfainberg | clarkb: ok. cool. | 00:11 |
| clarkb | morganfainberg: also cffi fixed their bug | 00:11 |
| clarkb | morganfainberg: tl;dr all of our dependencies should get a gearman client to trigger our jobs with their new stuff before releasing because it turns out we test a lot of stuff :) | 00:11 |
| morganfainberg | clarkb: amazing right? :) | 00:11 |
| clarkb | morganfainberg: let us know if things are still broken, but I believe everything should work at this point | 00:12 |
| morganfainberg | clarkb: thanks for the info.. maybe i should start lurking in here as well as the other openstack-* channels. | 00:12 |
| morganfainberg | clarkb: will do. just issued the recheck. | 00:12 |
| openstackgerrit | Leif Madsen proposed a change to openstack-infra/jenkins-job-builder: Add RVM (ruby version manager) support https://review.openstack.org/36386 | 00:14 |
| leifmadsen | clarkb: if you have a chance, in a few mins if 36386 passes the jenkins stuff, do you mind approving? | 00:14 |
| *** UtahDave has quit IRC | 00:15 | |
| leifmadsen | maybe get this thing merged once and for all | 00:15 |
| clarkb | sure | 00:15 |
| clarkb | I'm assuming that is a rebase? | 00:15 |
| leifmadsen | yes sir | 00:15 |
| clarkb | we should maybe start alphabetizing things to make conflicts less common | 00:16 |
| *** pcrews has quit IRC | 00:17 | |
| leifmadsen | ah perhaps | 00:17 |
| clarkb | hmm check tests are going to take forver. I am just going to approve it | 00:18 |
| leifmadsen | :D | 00:21 |
| leifmadsen | it's been through the tests a few times now :) | 00:21 |
| leifmadsen | ok, stepping away to watch some Suits and Big Brother ;) | 00:21 |
| clarkb | ya and the diffs looked clean | 00:21 |
| leifmadsen | thanks for the help | 00:21 |
| leifmadsen | clarkb: +1 | 00:21 |
| jeblair | clarkb: i rechecked 39511, but it's at the bottom of the check queue, so.... | 00:21 |
| leifmadsen | it was a simple rebase change | 00:21 |
| jeblair | clarkb, leifmadsen: yep, that's what the gate is for. :) | 00:22 |
| leifmadsen | yay gates! | 00:22 |
| * leifmadsen hops the fence | 00:22 | |
| leifmadsen | peas out yo | 00:22 |
| jeblair | clarkb: i mean, as long as you aren't in a queue with lots of changes, it doesn't really hurt to just aprv things and let the gate handle it. | 00:23 |
| clarkb | jeblair: ya | 00:23 |
| clarkb | jeblair: the one reason JJB is slightly different is we don't run the xml diff change | 00:23 |
| clarkb | s/change/test/ | 00:23 |
| clarkb | but like leifmadsen said it had been tested a few times and diffs of code were clean | 00:24 |
| jeblair | clarkb: there is that | 00:24 |
| *** emagana has quit IRC | 00:25 | |
| jeblair | clarkb: just in case you look at zuul, the keystoneclient change that is failing every test is legitimate: 38024,2 | 00:25 |
| jeblair | clarkb: apparently another change beat it to adding a test-requirement | 00:26 |
| openstackgerrit | Tom Fifield proposed a change to openstack-infra/config: Add build job for Japanese Operations Guide https://review.openstack.org/39846 | 00:27 |
| dstufft | Does Fedora not have a server version | 00:28 |
| dstufft | I don't want a desktop :[ | 00:28 |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: Add RVM (ruby version manager) support https://review.openstack.org/36386 | 00:28 |
| clarkb | dstufft: http://fedoraproject.org/en/get-fedora-options#clouds | 00:29 |
| dstufft | oh, guess I can spin up a cloud server | 00:29 |
| dstufft | <- worst openstack person ever | 00:29 |
| jeblair | dstufft: ha! | 00:29 |
| clarkb | why is weechat telling me I have one more line but cannot scroll down? | 00:30 |
| clarkb | ooh there was a line there but why wouldn't it scroll | 00:30 |
| *** Ryan_Lane has quit IRC | 00:30 | |
| clarkb | anyways time for me to head home. Should be exciting we have protests | 00:31 |
| *** bnemec has quit IRC | 00:32 | |
| *** bnemec has joined #openstack-infra | 00:32 | |
| *** michchap_ has joined #openstack-infra | 00:37 | |
| fungi | leifmadsen: worth noting, he will accept dyn-style updates for your endpoint addressing via ddclient and the like | 00:39 |
| *** michchap has quit IRC | 00:40 | |
| *** mriedem has joined #openstack-infra | 00:42 | |
| jog0 | dumb question, I revised the wrong patch set and want to go back to an old revision | 00:42 |
| jog0 | how do I do that? | 00:42 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/devstack-gate: Build a devstack-gate image with diskimage-builder https://review.openstack.org/38871 | 00:42 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/devstack-gate: Proof of concept of kexec/takeovernode https://review.openstack.org/38887 | 00:42 |
| jeblair | jog0: checkout the sha of the version you want and either (untested): | 00:42 |
| jog0 | I tried checking outthe old version and doing git-review but gerrit said nothing changed | 00:42 |
| jeblair | jog0: (a) git review it and see i... | 00:43 |
| jeblair | ok | 00:43 |
| clarkb | you must change it | 00:43 |
| jeblair | jog0: then (b) git commit --amend it to give it a new sha and git review that | 00:43 |
| jog0 | that worked, but its sorta silly. I guess I should be more careful next time | 00:44 |
| fungi | jog0: you can git review -d changenum,psnum | 00:44 |
| fungi | and then git review again | 00:44 |
| fungi | i think that's worked for me before, though it will munge your topic name so you might want to -t topicname | 00:45 |
| jog0 | good to know for next time | 00:45 |
| jeblair | clarkb: that stable/grizzly change has started devstack tests; a good mix of az3 and others | 00:46 |
| fungi | oh, i might also have done git commit -a --amend and improved the commit message while i was at it | 00:46 |
| jeblair | clarkb: checking to see if they are new-image nodes | 00:46 |
| jeblair | new image timestamp is 00:05:40.009 | 00:46 |
| *** zul has joined #openstack-infra | 00:47 | |
| mordred | clarkb, jeblair: the d-g patch above is what I've been using today for dev/test | 00:47 |
| mordred | along with the script to build the image, and the script to reboot/takeover a node with the image | 00:47 |
| mordred | I want to make an element which includes the script and the kexec/qemu packages needed for takeover so that one can just have the image be a thing that knows how to takeover itself | 00:48 |
| mordred | but the code above is totally workable and so far has been operating well | 00:48 |
| jeblair | clarkb: all the az3 nodes are newest-image | 00:49 |
| jeblair | mordred: that sounds excellent | 00:49 |
| mordred | jeblair: next time you have spare/extra time (hahahahaha) I'll step you through it :) | 00:50 |
| jeblair | mordred: did you see clark and i reverted the recent change to puppet to upgrade setuptools in pip... | 00:51 |
| jeblair | mordred: it broke stable/grizzly devstack-gate jobs | 00:51 |
| mordred | jeblair: awesome | 00:51 |
| clarkb | but not master | 00:51 |
| mordred | I did not see that | 00:51 |
| jeblair | mordred: so i think we should proceed with extracting that stuff and moving it to jeepyb/zuul/jenkins-not-bare modules | 00:52 |
| mordred | yah. | 00:52 |
| mordred | clarkb: that should basically be because devstack on stable/grizzly doesn't have the pip install -U setuptools in it | 00:52 |
| mordred | jeblair: what state are we in now? reverted the revert? | 00:53 |
| jeblair | mordred: no, HEAD is Revert "Ensure latest setuptools after installing pip." | 00:54 |
| jeblair | clarkb: at least one az3 job has passed the point were we saw problems | 00:54 |
| jeblair | clarkb: so i think the new az3 image is good | 00:54 |
| mordred | cool. so current task on hand is fix stable/grizzly? | 00:54 |
| clarkb | jeblair: awesome | 00:54 |
| clarkb | mordred: no, I think current task is refactor pip in puppet | 00:54 |
| clarkb | only use it where we need it then we can let devstack do its thing and it will test itself | 00:55 |
| jeblair | clarkb: +1 | 00:55 |
| mordred | oh ... | 00:55 |
| mordred | the upgrade setuptools change broke stable/grizzly | 00:55 |
| jeblair | this is not super-urgent because i think everything is working now | 00:55 |
| mordred | I read the sentences above in a different sequence | 00:55 |
| mordred | I thought you said the revert broke stable/grizzly | 00:55 |
| mordred | with you now | 00:56 |
| mordred | and yes to the refactor | 00:56 |
| jeblair | mordred: correct. the upgrade setuptools change from a few days ago broke stable/grizzly devstack runs when we finally built an image today | 00:56 |
| mordred | ossum | 00:56 |
| jeblair | mordred: so that change from a few days ago was reverted today, and now the images work again for stable/grizzly | 00:56 |
| mordred | w0t! | 00:56 |
| jeblair | mordred: and then what clarkb said for actually getting that change in place in a better way | 00:56 |
| jeblair | food now | 00:57 |
| mordred | yes. totally agree | 00:57 |
| mordred | back later | 00:57 |
| clarkb | ya I am probably not going to be around much tonight. feeling blah | 00:58 |
| *** pcrews has joined #openstack-infra | 00:59 | |
| *** erfanian has joined #openstack-infra | 01:10 | |
| anteaya | clarkb: hope you are feeling non-blah soon, ghost tooth | 01:11 |
| *** pcrews has quit IRC | 01:11 | |
| harlowja | qq, why are we needing cffi ?? :-/ for the ip address lookup stuffs? | 01:16 |
| dkehn | clarkb, you won't happen to have a localrc (devstack) from one of the runs handy that I could look and compare agains the one I'm using, I'm see a weird error that I haven't seen before, been using a modified devstack-vm-gate.sh forever | 01:17 |
| *** markmcclain has quit IRC | 01:17 | |
| clarkb | harlowja: xattr depends on it | 01:18 |
| harlowja | durn | 01:18 |
| clarkb | dkehn: if you open any tempet test runs logs you will see a localrc inthere | 01:18 |
| dkehn | clarkb, ok, thx | 01:19 |
| harlowja | http://paste.openstack.org/show/42913/ if anyone is interested in how anvil is running these sorts of things :), able to fire it off from simple cloud-init script | 01:19 |
| harlowja | source to rpms in no time :-P | 01:20 |
| harlowja | (and dependencies) | 01:20 |
| dkehn | clarkb, https://jenkins.openstack.org/job/gate-tempest-devstack-vm-full/ need a point to where that might be | 01:22 |
| clarkb | dkehn: its easier to start in gerrit | 01:22 |
| clarkb | dkehn: find any nova/swift/cinder/glance/etc change, click on the link to the build logs | 01:23 |
| dkehn | clarkb, ok, I'm an idoit I need a link to gerrit | 01:24 |
| clarkb | dkehn: https://review.openstack.org/#/c/35214/ | 01:25 |
| dkehn | clarkb, that's what i was expecting sorry | 01:25 |
| harlowja | more complete example (all fired off on y! cloud using cloud-init) - http://paste.openstack.org/show/42915/ hope to get that into the upstream system (like smokestack someday)... | 01:26 |
| clarkb | harlowja: there are historical reasons for not using rpms/debs | 01:27 |
| clarkb | harlowja: mordred said earlier "We used them until the distros told us to stop" at some point today | 01:27 |
| clarkb | also I think there is value in testing with builds from source. The fact that this breaks means it will break for others and is valuable for that reason | 01:27 |
| mikal | Heya, who here can explain how the MySQL db for migration testing are setup in the gate? | 01:28 |
| mikal | jhesketh: ^---- | 01:28 |
| clarkb | mikal: I can | 01:28 |
| clarkb | mikal: https://github.com/openstack/nova/blob/master/nova/tests/db/test_migrations.py#L27-L33 | 01:29 |
| mikal | jhesketh: you should talk to clarkb! | 01:29 |
| clarkb | thats basically it, we provide mysql and postgresql servers running on localhost that fit that criteria | 01:29 |
| jhesketh | clarkb: right, I'm having some trouble with running MySQL tests locally | 01:30 |
| harlowja | clarkb i was thinking more of anvil could be like a smokestack system | 01:30 |
| jhesketh | clarkb: are you in #openstack-nova per chance? | 01:30 |
| clarkb | jhesketh: no too much noise there | 01:30 |
| clarkb | I got my channel list to under 20 total channels recently :) | 01:30 |
| jhesketh | not as noisy in here, but that's okay | 01:30 |
| harlowja | since anvil checks out repos, builds dependenies as rpms and the repos as srpms/rpms automatically, validates said dependencies are valid, can then install from said rpms and start the whole system, then tear it down | 01:30 |
| clarkb | jhesketh: ya but I have to be in here :) | 01:30 |
| jhesketh | so if I run the tests with just sqlite it works fine | 01:31 |
| jhesketh | I'm just running: ./run_tests.sh db.test_migrations | 01:31 |
| clarkb | harlowja: yeah I think anvil doing like smokestack would be valuable | 01:31 |
| jhesketh | but if I change test_migrations.conf to just run MySQL tests it doesn't seem to set up the tests okay | 01:31 |
| clarkb | harlowja: second opinions are always good | 01:31 |
| harlowja | def | 01:31 |
| jhesketh | for example: ProgrammingError: (ProgrammingError) (1146, "Table 'test_migrations.instances' doesn't exist") 'CREATE INDEX project_id ON instances (project_id)' () | 01:31 |
| jhesketh | as in it doesn't create the database/tables correctly | 01:31 |
| jhesketh | but if I run the tests with test_migrations.conf with both sqlite and mysql set up, I get a different error | 01:31 |
| jhesketh | specifically: OperationalError: (OperationalError) (1242, 'Subquery returns more than 1 row') 'UPDATE services SET availability_zone=(SELECT aggregate_metadata.value \nFROM aggregate_metadata, aggregate_hosts \nWHERE aggregate_hosts.aggregate_id = aggregate_metadata.aggregate_id AND aggregate_metadata.`key` = %s AND aggregate_hosts.host = services.host AND services.`binary` = %s)' ('availability_zone', 'nova-compute | 01:31 |
| jhesketh | ') | 01:31 |
| jhesketh | (which I've lodged a bug for: https://bugs.launchpad.net/nova/+bug/1207309) | 01:31 |
| uvirtbot | Launchpad bug 1207309 in nova "Migration 147 does not downgrade on MySQL" [Undecided,In progress] | 01:32 |
| clarkb | jhesketh: we don't do anything to test_migrations.conf | 01:32 |
| harlowja | even the dependency validation is probably useful in itself | 01:32 |
| harlowja | http://paste.openstack.org/show/42916/ | 01:32 |
| clarkb | jhesketh: so its possible those tests don't run and as a result have broken | 01:32 |
| harlowja | *cross repo dependency validation | 01:32 |
| clarkb | jhesketh: instead we run the opportunistic tests that are explained in the docstring I linked to | 01:32 |
| jhesketh | ah, I didn't realise they were different | 01:32 |
| clarkb | I don't know if they are, I just know that we don't change a conf file | 01:32 |
| clarkb | instead the test suite detects the servers are available and uses them | 01:33 |
| *** sarob has joined #openstack-infra | 01:33 | |
| jhesketh | clarkb: It looks like the opportunistic tests don't snake_walk the versions | 01:34 |
| harlowja | anyways, me just rambling now, haha, gotta get someone to pony up the hardware for the smokestack like thing here | 01:35 |
| clarkb | :( thats unfortunate. I think when I fixed them for testr they did | 01:35 |
| jhesketh | most of the errors I'm encountering are downgrades on MySQL | 01:35 |
| jhesketh | clarkb: https://github.com/openstack/nova/blob/master/nova/tests/db/test_migrations.py#L320 | 01:35 |
| jhesketh | it skips the migrations.cfg | 01:35 |
| jhesketh | *test_migrations.conf | 01:36 |
| clarkb | and sets snake walk to false | 01:36 |
| clarkb | so that is probably the issue | 01:36 |
| clarkb | it did snake walk at one point i wonder why it was changed | 01:36 |
| jhesketh | so changing it now will probably block all the current gates | 01:37 |
| *** sarob has quit IRC | 01:37 | |
| *** samalba has joined #openstack-infra | 01:38 | |
| clarkb | well the change won't pass the gate so it wont merge | 01:39 |
| clarkb | you will have to fix the snakewalk to enable it | 01:39 |
| samalba | Is there a place where I can find more info about the kernel used to run jenkins tests? | 01:39 |
| jhesketh | ah good point | 01:39 |
| jhesketh | clarkb: I'll continue looking into it | 01:40 |
| *** yaguang has joined #openstack-infra | 01:43 | |
| clarkb | samalba: what do you want to know? | 01:44 |
| clarkb | samalba: it depends on the test as different tests run on different slave with different kernels | 01:44 |
| *** yaguang has quit IRC | 01:44 | |
| *** yaguang has joined #openstack-infra | 01:44 | |
| clarkb | samalba: devstack tempest tests run on an up to date precise kernel, most other tests run on a relatively up to date precise kernel and python2.6 runs on a relatively up to date centos6 kernel | 01:45 |
| samalba | clarkb: I see. Well I want to run Docker to add functional tests for Nova' docker hypervisor | 01:45 |
| samalba | and Docker needs a kernel with aufs enabled and need to run a daemon as root | 01:45 |
| samalba | basically if I add Docker's support to devstack to spawn a Docker daemon, can this daemon to be root? | 01:47 |
| samalba | I guess it should not be a problem since each test runs in a VM, right? | 01:47 |
| clarkb | all of our tests run in VMs devstack tempest tests are single use VMs and the unittests are on static slaves | 01:48 |
| clarkb | samalba: looks like precise supports aufs so you shoudl be good? | 01:48 |
| samalba | I think so, thanks | 01:48 |
| openstackgerrit | Dan Bode proposed a change to openstack-infra/config: Ensure python pip is installed before zuul https://review.openstack.org/39611 | 01:49 |
| *** yaguang has quit IRC | 01:56 | |
| openstackgerrit | Tom Fifield proposed a change to openstack-infra/config: Add build job for Japanese Operations Guide https://review.openstack.org/39846 | 01:56 |
| morganfainberg | clarkb: seems like everything is happy again. thanks for the info earlier | 01:58 |
| *** thomasm has joined #openstack-infra | 01:59 | |
| *** adalbas has quit IRC | 01:59 | |
| sdague | jhesketh: yes, we don't snake walk on opportunistic | 02:05 |
| sdague | honestly, downgrade with data is lossy | 02:05 |
| jhesketh | sdague: right, but if an upgrade goes poorly and you want to rewind going back to as close as it was as possible is a good idea | 02:06 |
| sdague | jhesketh: what models do you use then? | 02:07 |
| *** anteaya has quit IRC | 02:07 | |
| jhesketh | sdague: what do you mean? | 02:07 |
| sdague | you need sqlalchemy models that match the db | 02:07 |
| sdague | so if you are at a level of code that has new models, and the migration goes bad, how do you roll back your code to lock step? | 02:08 |
| sdague | that being said, if you can make the downgrade work, cool | 02:08 |
| sdague | but there was a reason we punted and instead worked on the data injection testing | 02:08 |
| jhesketh | sure, valid points | 02:09 |
| jhesketh | would it work if you downgraded and then git reverted the models to before the migration was brought int | 02:09 |
| jhesketh | s/int/in | 02:09 |
| sdague | probably, but there are fun corner cases | 02:10 |
| jhesketh | absolutely, and they are what I'm trying to squash | 02:10 |
| sdague | cool | 02:10 |
| jhesketh | this is to lead into a new CI tool to test against real data | 02:10 |
| sdague | more power to you :) | 02:10 |
| jhesketh | so maybe I'll lead it up to rolling back models as well | 02:10 |
| sdague | just trying to give perspective on why I punted on it :) | 02:11 |
| jhesketh | sure, makes complete sense | 02:11 |
| jhesketh | I'm still wondering about needing to make them work myself | 02:11 |
| sdague | right, my thinking is that no deployer would actually use them because they are lossy | 02:12 |
| sdague | if things went that bad, they'd go to backup tapes | 02:12 |
| sdague | and restore | 02:12 |
| *** adalbas has joined #openstack-infra | 02:12 | |
| fungi | heh... "tapes" | 02:12 |
| jhesketh | agreed, and that was my next thought | 02:12 |
| sdague | man... don't you diss tapes, they have awesome robot rooms | 02:12 |
| *** nati_ueno has quit IRC | 02:13 | |
| * fungi wonders when we all stopped backing up our sensitive data onto stacks of greenbar | 02:13 | |
| jhesketh | sdague: so if we don't care about downgrading mysql or postgres, then why do we bother writing downgrades? | 02:13 |
| sdague | jhesketh: ... for completeness? | 02:13 |
| sdague | honeslty, I have no idea, because they were there before I got here | 02:13 |
| jhesketh | they aren't particularly complete when they are broken ;-) | 02:14 |
| sdague | yeh, well they work on sqlite :) | 02:14 |
| sdague | which... you know... no one cares about | 02:14 |
| sdague | sorry... it's late, I'm punchy | 02:14 |
| jhesketh | heh | 02:15 |
| fungi | sdague: it's not so much that nobody cares about it as we simply decided as a collective not to support its use in any way whatsoever? ;) | 02:16 |
| sdague | yeh... like fungi said | 02:16 |
| clarkb | sdague: snake walk worked when testr went in | 02:16 |
| clarkb | sdague: did something change that made it not work? | 02:16 |
| sdague | clarkb: it works with no data in the tables | 02:17 |
| clarkb | ah | 02:17 |
| fungi | i got the impression zigo cared, because he didn't want to have to write database management maintainer scripts for the debian packages and had them default to sqlite... | 02:17 |
| sdague | but it's not very compatible with the data injection tests | 02:17 |
| sdague | because a lot of downgrades are lossy | 02:17 |
| sdague | like drop columns | 02:17 |
| sdague | then how do you recover after? | 02:17 |
| dkehn | clarkb, hey thx for the pointer on the localrc, an update of the file has allowed me to run again, my old localrc I think was about 10 months old | 02:18 |
| openstackgerrit | Sean Dague proposed a change to openstack/requirements: one global-requirements.txt to rule them all https://review.openstack.org/39358 | 02:18 |
| *** yaguang has joined #openstack-infra | 02:18 | |
| fungi | dkehn: that's like 20 in openstack-years! | 02:18 |
| sdague | clarkb: where's the job we use to do requirements.txt testing on the projects? | 02:19 |
| dkehn | fungi, lol, I know | 02:19 |
| sdague | as I'm sure that just broke it | 02:19 |
| clarkb | sdague: gate-$project-requirements iirc | 02:19 |
| dkehn | I'm surprised that its lasted this long | 02:19 |
| sdague | clarkb: ok, you know what script it eventually calls out to? | 02:19 |
| clarkb | sdague: looking | 02:19 |
| yaguang | it seems something wrong with static.openstack.org | 02:20 |
| clarkb | sdague: https://github.com/openstack-infra/config/blob/master/modules/jenkins/files/slave_scripts/project-requirements-change.py that I think | 02:20 |
| clarkb | yaguang: can you be more specific? | 02:20 |
| fungi | yaguang: how so? | 02:20 |
| sdague | I can't believe I went around in circles for an hour today because I forgot to add test-requires to my test file.... | 02:20 |
| yaguang | jenkins fails to upload to static.openstack.org | 02:20 |
| sdague | much thanks to mordred for unblocking me | 02:20 |
| yaguang | https://jenkins.openstack.org/job/gate-keystone-pep8/6739/console | 02:20 |
| clarkb | yaguang: the build was aborted which is why that happened | 02:20 |
| dkehn | hmm, maybe spoke too soon, I se I'm running the n-net not the neutron | 02:20 |
| yaguang | all jenkins tasks abort | 02:21 |
| clarkb | yaguang: the java there is being forcefully killed and the SCP plugin doesn't like it | 02:21 |
| clarkb | yaguang: yes, that is a zuul optimization. If something ahead in the queue fails everything behind it has its tests aborted | 02:21 |
| clarkb | yaguang: then when the thing that failed is removed from the queue tests are restarted for the changes behind it | 02:22 |
| clarkb | dkehn: neutron is broken | 02:22 |
| clarkb | dkehn: so good luck | 02:22 |
| dkehn | with firewall group? | 02:22 |
| dkehn | clarkb, ^^^^ | 02:22 |
| clarkb | sdague: https://github.com/openstack-infra/config/blob/master/modules/openstack_project/files/jenkins_job_builder/config/python-jobs.yaml#L195 that is the script | 02:22 |
| clarkb | dkehn: in general. We stopped voting on the devstack neutron tests | 02:22 |
| clarkb | so it could be in a giant state of disarray | 02:23 |
| dkehn | clarkb, ok, cuase I was see an error that I've not seen ion a couple of weeks | 02:23 |
| fungi | yaguang: it's about to get retested again as soon as pending tests on the two changes at the top of that gate queue finish | 02:23 |
| yaguang | fungi, get it, thanks | 02:24 |
| dkehn | clarkb, I'm actually running it in a VM that was my last successful run place to deal with a review | 02:24 |
| openstackgerrit | A change was merged to openstack-dev/pbr: Use the same logic everywhere for requirements files https://review.openstack.org/38540 | 02:24 |
| openstackgerrit | A change was merged to openstack-infra/devstack-gate: Copy tempest.log to logs dir after tempest run https://review.openstack.org/39583 | 02:25 |
| fungi | and those were the two | 02:25 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: support global-requirements.txt https://review.openstack.org/39853 | 02:27 |
| sdague | clarkb: that look sane? | 02:27 |
| clarkb | sdague: will the other requirements files in openstack/requirements pollute global requirements or are the subsets? | 02:29 |
| clarkb | if subsets then yes sane | 02:30 |
| sdague | hmmmmm.... right | 02:30 |
| sdague | test-requirements.txt will polute | 02:30 |
| sdague | ok, I'll circle on that | 02:30 |
| *** rcleere has joined #openstack-infra | 02:30 | |
| sdague | before that, how do I add that new tox job to it's gate? | 02:30 |
| sdague | I haven't actually added a new tox job in a while | 02:31 |
| clarkb | maybe provide the list you care about when you create the requreiemts list object | 02:31 |
| sdague | clarkb: yeh, I think that's a good call | 02:31 |
| clarkb | sdague: is it under the py27 tox env? | 02:31 |
| clarkb | in jenkins_job_builder/config/projects.yaml under openstack/requirements add gate-{name}-python27 to the job list | 02:31 |
| clarkb | the in zuul/layout.yaml add gate-requirements-python27 under check and gate for openstack/requirements | 02:32 |
| clarkb | both files rooted under modules/openstack_project/files | 02:32 |
| *** pabelanger has quit IRC | 02:34 | |
| *** adalbas has quit IRC | 02:35 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: support global-requirements.txt https://review.openstack.org/39853 | 02:35 |
| sdague | clarkb: yeh, it's a py27 | 02:35 |
| *** dims has quit IRC | 02:36 | |
| *** dims_ has quit IRC | 02:36 | |
| *** bnemec has quit IRC | 02:37 | |
| *** bnemec has joined #openstack-infra | 02:38 | |
| sdague | clarkb: so there is no requirements stub in projects.yaml yet | 02:39 |
| sdague | is there a good starting point? | 02:39 |
| clarkb | sdague: you can copy any of the openstack/* org items | 02:39 |
| clarkb | sdague: tempest should work | 02:39 |
| dkehn | clarkb, in the gerrit logs is there a place I can look at the /etc/neutron/neutron.conf I think something else is missing the firewall_driver | 02:39 |
| clarkb | dkehn: I don't think we captuer the actual conf file | 02:40 |
| *** jrex_laptop has quit IRC | 02:40 | |
| clarkb | dkehn: but if you run devstack with the same localrc you should get the same conf file as its based on the sample | 02:40 |
| sdague | dkehn: if you look at the console logs you should see all the devstack lines that write the file out | 02:41 |
| sdague | but we don't actually capture it | 02:42 |
| dkehn | clarkb, ok, thx I'll keep digging | 02:42 |
| *** nijaba has quit IRC | 02:42 | |
| *** mriedem has quit IRC | 02:42 | |
| *** pabelanger has joined #openstack-infra | 02:43 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: add unit test job for global-requirements https://review.openstack.org/39856 | 02:43 |
| dkehn | clarkb, looks correct | 02:43 |
| sdague | clarkb: ok, like that? | 02:43 |
| dkehn | clark, might do a clean pull from truck build and see | 02:44 |
| clarkb | sdague: yup | 02:45 |
| sdague | ok, well I think all the magical ponies are up for review now | 02:46 |
| sdague | I'll let mordred take a swipe at them in the morning | 02:46 |
| sdague | though it will be a funny day tomorrow and mtreinish and I need to work on a packstack cluster to figure out a networking thing so unless we nail that early, might not be able to do much code tomorrow | 02:47 |
| *** nijaba has joined #openstack-infra | 02:47 | |
| *** nijaba has quit IRC | 02:47 | |
| *** nijaba has joined #openstack-infra | 02:47 | |
| *** dkliban has joined #openstack-infra | 02:49 | |
| clarkb | jeblair: http://bugs.python.org/issue18472#msg193909 | 02:50 |
| *** nijaba has quit IRC | 02:51 | |
| *** nijaba has joined #openstack-infra | 02:51 | |
| sdague | clarkb: nice | 02:51 |
| sdague | yeh, the person I was at dinner with pointed out that new pep8 discourages lambdas | 02:55 |
| sdague | which makes me a little sad | 02:55 |
| *** bnemec has quit IRC | 02:57 | |
| *** dkliban has quit IRC | 02:57 | |
| *** bnemec has joined #openstack-infra | 02:58 | |
| *** jhesketh has quit IRC | 02:58 | |
| *** jhesketh_ has joined #openstack-infra | 02:58 | |
| clarkb | sdague: it discourages them if you name them | 02:59 |
| clarkb | sdague: in favor of using def | 02:59 |
| sdague | oh, only named lamdas | 02:59 |
| sdague | ok, I can live with that | 02:59 |
| *** nijaba has quit IRC | 03:00 | |
| *** nijaba has joined #openstack-infra | 03:01 | |
| *** krtaylor has joined #openstack-infra | 03:08 | |
| *** melwitt has quit IRC | 03:11 | |
| *** sandywalsh has quit IRC | 03:11 | |
| *** sarob has joined #openstack-infra | 03:18 | |
| *** bnemec has quit IRC | 03:20 | |
| *** erfanian has quit IRC | 03:21 | |
| *** bnemec has joined #openstack-infra | 03:21 | |
| SpamapS | 2013-07-25 22:05:43.826 | E: heat.conf.sample is not up to date, please run tools/conf/generate_sample.sh | 03:26 |
| SpamapS | where is tools/conf/generate_sample.sh ? | 03:26 |
| clarkb | SpamapS: it isn't in heat/tools/conf/ ? | 03:27 |
| SpamapS | clarkb: there is no heat/tools/conf | 03:27 |
| SpamapS | even in the branch that is introducing said change | 03:28 |
| SpamapS | guessing a step was missed | 03:28 |
| SpamapS | looks like that tool is in oslo-incubator | 03:28 |
| dstufft | mordred: dtroyer thanks to you guys I'm possibly writing a PEP to make two different places for distro isntalled packages and pip isntalled packages, so thanks for that ;P | 03:32 |
| dstufft | also whoever else, I forget :V | 03:32 |
| SpamapS | clarkb: Hrm, ok, I'm trying to debug this fail https://review.openstack.org/#/c/37979/ | 03:37 |
| SpamapS | clarkb: it is just adding help options, but for some reason the gate is kicking it out for generated configs not matching | 03:37 |
| clarkb | SpamapS: I think you need to run the tool so that it matches and include the new sample in your commit | 03:38 |
| SpamapS | clarkb: but why is the pep8 gate doing anymore than 'tox -epep8' ? | 03:39 |
| *** sandywalsh has joined #openstack-infra | 03:44 | |
| openstackgerrit | Steve Baker proposed a change to openstack-infra/config: Do not run python jobs for tripleo-image-elements https://review.openstack.org/39858 | 03:44 |
| clarkb | SpamapS: because it is running flake8 which runs hakcing | 03:46 |
| *** sarob_ has joined #openstack-infra | 03:47 | |
| *** sarob has quit IRC | 03:50 | |
| *** dkliban has joined #openstack-infra | 04:00 | |
| *** sarob_ has quit IRC | 04:04 | |
| *** SergeyLukjanov has joined #openstack-infra | 04:12 | |
| mikal | Has anyone seen "Timeout while waiting on RPC response" in tempest from conductor? I' | 04:20 |
| mikal | m having trouble seeing how it would be related to my change | 04:20 |
| mikal | http://logs.openstack.org/48/39048/2/check/gate-tempest-devstack-vm-full/d076587/logs/screen-n-cpu.txt.gz | 04:20 |
| *** dina_belova has joined #openstack-infra | 04:26 | |
| *** dkliban has quit IRC | 04:26 | |
| SpamapS | clarkb: hacking would have an H rule I could control though... | 04:33 |
| SpamapS | clarkb: seems like it is something else.. | 04:33 |
| SpamapS | 2013-07-25 22:05:26.356 | pep8 runtests: commands[0] | flake8 heat bin/heat-api bin/heat-api-cfn bin/heat-api-cloudwatch bin/heat-cfn bin/heat-engine bin/heat-manage bin/heat-watch | 04:33 |
| SpamapS | 2013-07-25 22:05:26.377 | /home/jenkins/workspace/gate-heat-pep8$ /home/jenkins/workspace/gate-heat-pep8/.tox/pep8/bin/flake8 heat bin/heat-api bin/heat-api-cfn bin/heat-api-cloudwatch bin/heat-cfn bin/heat-engine bin/heat-manage bin/heat-watch | 04:34 |
| SpamapS | 2013-07-25 22:05:41.990 | pep8 runtests: commands[1] | /home/jenkins/workspace/gate-heat-pep8/tools/conf/check_uptodate.sh | 04:34 |
| SpamapS | 2013-07-25 22:05:42.008 | /home/jenkins/workspace/gate-heat-pep8$ /home/jenkins/workspace/gate-heat-pep8/tools/conf/check_uptodate.sh | 04:34 |
| SpamapS | clarkb: tox.ini, in that branch, does not have a second command | 04:34 |
| clarkb | SpamapS: is check_uptodate.sh doing it? | 04:36 |
| clarkb | https://github.com/openstack/heat/blob/master/tools/conf/check_uptodate.sh | 04:36 |
| clarkb | I thought it was hacking, apparently not | 04:38 |
| clarkb | https://github.com/openstack/heat/blob/master/tox.ini#L15 | 04:39 |
| SpamapS | weird | 04:40 |
| *** Ryan_Lane has joined #openstack-infra | 04:41 | |
| SpamapS | Oh... rebased on master .. but.. the patch isn't..... ?? | 04:43 |
| clarkb | SpamapS: we rebase on master before testing anything | 04:43 |
| clarkb | SpamapS: s/rebase/merge/ | 04:44 |
| clarkb | which is why you get a -1 if you cannot merge | 04:44 |
| clarkb | and in the gate queue you get tested in the same manner that you would merge (this accounts for other changes belonging to the same project ahead of you in the queue) | 04:46 |
| *** boris-42 has joined #openstack-infra | 04:47 | |
| SpamapS | clarkb: ah, very unexpected. :-P | 04:48 |
| clarkb | this is one of the things that makes zuul special and different than travis saying everything is good on a pull request | 04:49 |
| *** dina_belova has quit IRC | 04:49 | |
| clarkb | a lot of care goes into dealing with a moving trunk | 04:49 |
| SpamapS | Yeah I love it.. | 04:49 |
| SpamapS | It was just unexpected. :) | 04:50 |
| *** rcleere has quit IRC | 04:52 | |
| *** bnemec has quit IRC | 04:54 | |
| *** bnemec has joined #openstack-infra | 04:55 | |
| *** michchap_ has quit IRC | 04:59 | |
| *** UtahDave has joined #openstack-infra | 05:06 | |
| *** dstufft has quit IRC | 05:17 | |
| *** dstufft has joined #openstack-infra | 05:18 | |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/jenkins-job-builder: Pathignore plugin support added https://review.openstack.org/37909 | 05:22 |
| *** hub_cap has joined #openstack-infra | 05:24 | |
| hub_cap | question. what ubuntu release should i be runnin devstack on? the reason i ask is cuz python-netaddr in 12.04 is 0.7.5 and nova's requirements.txt specify >=0.7.6 | 05:25 |
| *** pabelanger has quit IRC | 05:26 | |
| clarkb | hub_cap we use precise | 05:28 |
| hub_cap | clarkb: hmm.. i dont know how im getting this error and not the rest of openstack then lol. ill keep diggin | 05:29 |
| clarkb | I think it is related to the setuptools mess | 05:29 |
| hub_cap | seems my python-netaddr is 0.7.5 and i have to apt-get remove it in order for the pip installed 0.7.10 to be happy | 05:29 |
| hub_cap | word. is there something i can do to get around it? /me assumes you havent heard of this yet? | 05:30 |
| clarkb | mordred was tackling it. you can pip install -U setuptools before running devstack | 05:31 |
| hub_cap | perfect | 05:34 |
| *** mestery has quit IRC | 05:34 | |
| *** nicedice has quit IRC | 05:35 | |
| hub_cap | hmm clarkb no dice. | 05:39 |
| clarkb | can you pip install netaddr? | 05:40 |
| clarkb | I dont have any other ideas right now | 05:40 |
| hub_cap | thats the thing. it is pip installed | 05:42 |
| hub_cap | but devstack is apt installing python-netaddr as well :o | 05:42 |
| hub_cap | i gotta see wahts going on .... cuz its obvi not happening in gates | 05:43 |
| clarkb | are you using neutron? | 05:43 |
| clarkb | or is it nova network? because neutron tests don't vote | 05:44 |
| *** dina_belova has joined #openstack-infra | 05:46 | |
| *** michchap has joined #openstack-infra | 05:47 | |
| *** dina_belova has quit IRC | 05:48 | |
| *** UtahDave has quit IRC | 05:48 | |
| hub_cap | so im just pulling down latest devstack and running ./stack.sh | 05:49 |
| hub_cap | but let me isolate it first b4 i steal yer time | 05:49 |
| * hub_cap assumes hes not using neutron | 05:50 | |
| hub_cap | is it default setup? | 05:50 |
| hub_cap | its nova thats failing to start due to the netaddr conflict | 05:50 |
| *** zehicle has quit IRC | 05:55 | |
| *** michchap has quit IRC | 05:56 | |
| *** michchap has joined #openstack-infra | 05:57 | |
| *** SergeyLukjanov has quit IRC | 06:08 | |
| *** mkoderer has quit IRC | 06:11 | |
| *** mkoderer has joined #openstack-infra | 06:15 | |
| *** Alex_Gaynor has quit IRC | 06:17 | |
| *** michchap has quit IRC | 06:33 | |
| hub_cap | clarkb: around? im not sure if im doing something wrong but here is what i did | 06:36 |
| hub_cap | https://gist.github.com/hub-cap/6137899 | 06:36 |
| hub_cap | im on 12.04.1 could that be an issue? | 06:36 |
| *** Alex_Gaynor has joined #openstack-infra | 06:39 | |
| *** zehicle has joined #openstack-infra | 06:43 | |
| * hub_cap tries .02 | 06:44 | |
| *** boris-42 has quit IRC | 06:48 | |
| *** cody-somerville has quit IRC | 06:53 | |
| *** cthulhup has joined #openstack-infra | 06:56 | |
| *** jjmb has joined #openstack-infra | 07:04 | |
| *** cody-somerville has joined #openstack-infra | 07:05 | |
| *** SergeyLukjanov has joined #openstack-infra | 07:18 | |
| *** psedlak has joined #openstack-infra | 07:20 | |
| *** cody-somerville has quit IRC | 07:24 | |
| *** Ryan_Lane has quit IRC | 07:26 | |
| openstackgerrit | David Caro proposed a change to openstack-infra/jenkins-job-builder: Add support for the Summary Report publisher https://review.openstack.org/39264 | 07:32 |
| *** cody-somerville has joined #openstack-infra | 07:34 | |
| openstackgerrit | David Caro proposed a change to openstack-infra/jenkins-job-builder: Added some more scm options https://review.openstack.org/39298 | 07:36 |
| *** odyssey4me has joined #openstack-infra | 07:42 | |
| *** hashar has joined #openstack-infra | 07:45 | |
| *** mestery has joined #openstack-infra | 07:47 | |
| *** fifieldt has quit IRC | 07:55 | |
| *** mkoderer has quit IRC | 07:55 | |
| *** jpich has joined #openstack-infra | 07:58 | |
| *** mestery has quit IRC | 07:58 | |
| *** dina_belova has joined #openstack-infra | 07:59 | |
| *** dina_belova has quit IRC | 08:00 | |
| *** boris-42 has joined #openstack-infra | 08:02 | |
| *** derekh has joined #openstack-infra | 08:03 | |
| openstackgerrit | Tom Fifield proposed a change to openstack-infra/reviewstats: Add requirements to note that paramiko is needed https://review.openstack.org/39874 | 08:05 |
| openstackgerrit | Tom Fifield proposed a change to openstack-infra/reviewstats: Add requirements to note that paramiko is needed https://review.openstack.org/39874 | 08:07 |
| *** vsergeyev has left #openstack-infra | 08:07 | |
| *** dina_belova has joined #openstack-infra | 08:13 | |
| *** odyssey4me has quit IRC | 08:28 | |
| *** SergeyLukjanov has quit IRC | 08:28 | |
| *** odyssey4me has joined #openstack-infra | 08:35 | |
| *** jhesketh_ has quit IRC | 08:41 | |
| *** jhesketh_ has joined #openstack-infra | 08:41 | |
| *** odyssey4me has quit IRC | 08:50 | |
| *** thomasbiege has joined #openstack-infra | 08:51 | |
| *** thomasbiege has quit IRC | 08:52 | |
| *** bnemec has quit IRC | 08:53 | |
| *** bnemec has joined #openstack-infra | 08:54 | |
| openstackgerrit | Evgeny Fadeev proposed a change to openstack-infra/askbot-theme: a fix to the language switch menu https://review.openstack.org/39881 | 08:56 |
| openstackgerrit | A change was merged to openstack-infra/askbot-theme: a fix to the language switch menu https://review.openstack.org/39881 | 08:59 |
| *** odyssey4me has joined #openstack-infra | 09:00 | |
| *** odyssey4me has quit IRC | 09:06 | |
| *** dina_belova has quit IRC | 09:07 | |
| *** jjmb has quit IRC | 09:11 | |
| *** odyssey4me has joined #openstack-infra | 09:14 | |
| *** cthulhup has quit IRC | 09:26 | |
| *** jjmb has joined #openstack-infra | 09:28 | |
| *** cthulhup has joined #openstack-infra | 09:40 | |
| *** hashar has quit IRC | 09:41 | |
| *** hashar has joined #openstack-infra | 09:45 | |
| *** cthulhup has quit IRC | 09:46 | |
| *** dina_belova has joined #openstack-infra | 09:47 | |
| *** mestery has joined #openstack-infra | 09:52 | |
| *** mkoderer has joined #openstack-infra | 09:52 | |
| *** dina_belova has quit IRC | 10:00 | |
| *** fbo has quit IRC | 10:07 | |
| *** fbo has joined #openstack-infra | 10:13 | |
| *** jjmb has quit IRC | 10:17 | |
| *** jjmb has joined #openstack-infra | 10:23 | |
| *** yaguang has quit IRC | 10:29 | |
| *** cthulhup has joined #openstack-infra | 10:35 | |
| *** dina_belova has joined #openstack-infra | 10:39 | |
| *** yaguang has joined #openstack-infra | 10:42 | |
| *** luisg has joined #openstack-infra | 10:47 | |
| *** luis_ has quit IRC | 10:48 | |
| *** cthulhup has quit IRC | 10:50 | |
| EmilienM | Hi Folks, I need one more review for puppet-heat in stackforge > https://review.openstack.org/#/c/39594/ & https://review.openstack.org/#/c/39655/ | 11:02 |
| *** jjmb has quit IRC | 11:17 | |
| *** luis_ has joined #openstack-infra | 11:17 | |
| *** luisg has quit IRC | 11:18 | |
| *** michchap has joined #openstack-infra | 11:21 | |
| *** michchap has quit IRC | 11:22 | |
| *** michchap has joined #openstack-infra | 11:23 | |
| *** yaguang has quit IRC | 11:30 | |
| openstackgerrit | David Caro proposed a change to openstack-infra/jenkins-job-builder: Added pre-scm-buildstep wrapper https://review.openstack.org/39338 | 11:32 |
| *** nijaba has quit IRC | 11:43 | |
| *** bnemec has quit IRC | 11:49 | |
| *** jjmb has joined #openstack-infra | 11:49 | |
| *** bnemec has joined #openstack-infra | 11:50 | |
| *** ogelbukh has quit IRC | 11:52 | |
| *** dkranz has joined #openstack-infra | 11:58 | |
| *** ogelbukh has joined #openstack-infra | 11:58 | |
| *** CaptTofu has quit IRC | 11:58 | |
| *** zaro0508 has quit IRC | 12:05 | |
| *** weshay has joined #openstack-infra | 12:07 | |
| *** nijaba has joined #openstack-infra | 12:08 | |
| *** nijaba has quit IRC | 12:08 | |
| *** nijaba has joined #openstack-infra | 12:08 | |
| *** dina_belova has quit IRC | 12:08 | |
| *** pabelanger has joined #openstack-infra | 12:08 | |
| *** bnemec has quit IRC | 12:13 | |
| *** bnemec has joined #openstack-infra | 12:14 | |
| *** adalbas has joined #openstack-infra | 12:19 | |
| *** anteaya has joined #openstack-infra | 12:21 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add heat puppet module to stackforge https://review.openstack.org/39594 | 12:27 |
| openstackgerrit | A change was merged to openstack-infra/jeepyb: Add puppet-heat in launchpad project list https://review.openstack.org/39655 | 12:27 |
| *** woodspa has joined #openstack-infra | 12:29 | |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/gitdm: Add anteaya to hp. https://review.openstack.org/39913 | 12:30 |
| *** pabelanger has quit IRC | 12:33 | |
| *** dina_belova has joined #openstack-infra | 12:34 | |
| *** SergeyLukjanov has joined #openstack-infra | 12:35 | |
| *** lcestari has joined #openstack-infra | 12:36 | |
| *** openstackgerrit has quit IRC | 12:37 | |
| *** openstackgerrit has joined #openstack-infra | 12:37 | |
| *** pabelanger has joined #openstack-infra | 12:39 | |
| *** dkliban has joined #openstack-infra | 12:39 | |
| *** dims has joined #openstack-infra | 12:40 | |
| *** cthulhup has joined #openstack-infra | 12:41 | |
| *** pabelanger has quit IRC | 12:52 | |
| *** SergeyLukjanov has quit IRC | 12:54 | |
| *** afazekas has joined #openstack-infra | 12:55 | |
| *** burt has joined #openstack-infra | 12:59 | |
| dhellmann | good morning, any cores up yet? | 13:03 |
| anteaya | morning dhellmann haven't seen any yet | 13:04 |
| dhellmann | hi, anteaya! thanks, I'll check back after breakfast, then. | 13:04 |
| anteaya | k | 13:05 |
| fungi | dhellmann: yep | 13:05 |
| anteaya | morning fungi | 13:05 |
| dhellmann | ah, the never-sleeping-fungi ;-) | 13:06 |
| fungi | anteaya: morning! i usually just don't say anything unless i have something which needs saying | 13:06 |
| fungi | what's up, dhellmann? | 13:06 |
| dhellmann | I am hoping to get https://review.openstack.org/#/c/39225/ approved today so I can work on the basic project layout before taking off for vacation next week | 13:06 |
| anteaya | figured as much | 13:06 |
| dhellmann | I think we submitted that when there was a firestorm of other stuff going on, but it just needs one more +2 | 13:07 |
| fungi | ahh, yeah... taking a look over it real quick like | 13:07 |
| *** jjmb has quit IRC | 13:07 | |
| dhellmann | I'm about to answer clarkb's question: we don't have a repo to prepopulate from | 13:07 |
| *** dina_belova has quit IRC | 13:08 | |
| *** mriedem has joined #openstack-infra | 13:09 | |
| fungi | heh, i was about to ask the same, but now i see he did already | 13:09 |
| dhellmann | there are plans to reuse this code in other projects, so we thought we'd just start it out as a library. Also, most of ceilometer core doesn't want to "own" it right now, so we set up a separate team to include the devs who are working on it | 13:10 |
| fungi | worth noting, your first and subsequent commits to that project will have to be able to run (and pass) all the gate pipeline jobs you defined | 13:10 |
| *** prad_ has joined #openstack-infra | 13:11 | |
| dhellmann | I'm planning to either add an empty tox file, or write one dummy test for now | 13:11 |
| dhellmann | gordc will drop in the real code | 13:11 |
| dhellmann | maybe "commands = true" | 13:11 |
| fungi | aside from the initial .gitreview file, which the manage-projects script will prepopulate | 13:12 |
| fungi | yeah, that should work as a stub | 13:12 |
| dhellmann | cool | 13:12 |
| *** rfolco has joined #openstack-infra | 13:12 | |
| dhellmann | the instructions for setting up a stackforge project say to open a bug to add the initial member to the new teams, is that still the best way to handle it? | 13:13 |
| anteaya | dhellmann: depending on the tests that are run you may need to write a minimum of 4 for the tests to pass | 13:13 |
| dhellmann | ? | 13:13 |
| anteaya | one test won't pass, unless that has changed | 13:13 |
| anteaya | yeah, first rounds with storyboard failed since it only had one test | 13:13 |
| dhellmann | what's magic about 4? | 13:14 |
| anteaya | so I wrote 3 more | 13:14 |
| fungi | anteaya: i think that may already be fixed, but we'll see soon enough | 13:14 |
| anteaya | clarkb knows | 13:14 |
| anteaya | okay | 13:14 |
| anteaya | he told me but I have forgotten | 13:14 |
| dhellmann | thanks for the heads-up, then, I'll keep that in mind | 13:14 |
| anteaya | k | 13:14 |
| fungi | something to do with the script which checks that tests ran... there are some additional lines of boilerplate being counted when they shouldn't be | 13:15 |
| openstackgerrit | A change was merged to openstack-infra/config: Add pycadf project https://review.openstack.org/39225 | 13:15 |
| anteaya | as for storyboard, tests failed for random django reasons so we backed them off for now, just using pep8 currently | 13:15 |
| dhellmann | ah, interesting | 13:15 |
| dhellmann | fungi: so, next I open a bug on launchpad to ask to be added to the gerrit teams? | 13:15 |
| *** cppcabrera has joined #openstack-infra | 13:16 | |
| *** jjmb has joined #openstack-infra | 13:16 | |
| *** changbl has quit IRC | 13:16 | |
| fungi | dhellmann: i can add initial members for those groups if you just tell me what you want. the bug suggestion was just to provide some async solution for those requests so we don't forget if we're not around | 13:16 |
| dhellmann | cool, didn't want to assume you had all the spare time to do it now | 13:16 |
| fungi | it's fine | 13:16 |
| dhellmann | let me get some gerrit ids | 13:16 |
| dhellmann | do you need numbers, logins, or emails? | 13:17 |
| fungi | one gerrit id for each group should be fine, e-mail preferred. that person can add others | 13:17 |
| fungi | the groups are self-managed | 13:17 |
| dhellmann | ok, I'm doug-hellmann, so if you add me I can take care of it from there | 13:17 |
| fungi | will do. it'll be a few minutes before manage-projects runs to create the groups and then i'll pop you into them | 13:18 |
| dhellmann | I expect I'll help them out with releases until they're comfortable (the main devs are new to python, git, etc. -- where I was a year ago) | 13:18 |
| *** michchap has quit IRC | 13:18 | |
| dhellmann | perfect, thanks, fungi ! | 13:18 |
| fungi | and i'll give you a heads up in here when it's ready | 13:18 |
| dhellmann | cool, thank you | 13:19 |
| * dhellmann wanders off to find caffine | 13:19 | |
| *** prad_ has quit IRC | 13:22 | |
| *** markmcclain has joined #openstack-infra | 13:23 | |
| *** SergeyLukjanov has joined #openstack-infra | 13:28 | |
| *** dina_belova has joined #openstack-infra | 13:28 | |
| anteaya | if anyone cares I have a sneaking suspicion that the tempest.api.volume tests are not completing their teardown properly, and I am going with it isn't being caught in the test runs since it is the last round of tests to run | 13:29 |
| anteaya | I am going to see if I can find any evidence to back this up | 13:29 |
| anteaya | or more than made me suspicious | 13:29 |
| *** dolphm_ has joined #openstack-infra | 13:29 | |
| dolphm_ | wishlist item! as a core reviewer, i really want to have a Rebase button on other people's changes in gerrit | 13:31 |
| dolphm_ | (or, really any way to signal to other reviewers and the change author that this will no longer merge as-is) | 13:32 |
| dolphm_ | i guess the use case would be better served by a new jenkins job | 13:33 |
| *** krtaylor has quit IRC | 13:34 | |
| *** openstackgerrit has quit IRC | 13:36 | |
| *** openstackgerrit has joined #openstack-infra | 13:36 | |
| *** hashar has quit IRC | 13:36 | |
| sdague | man, I was hoping mordred would be around | 13:41 |
| sdague | I've got all these ponies lined up for him to make magical, that we need to land in a specific order accross projects | 13:42 |
| *** vijendar has joined #openstack-infra | 13:43 | |
| *** sandywalsh has quit IRC | 13:45 | |
| *** burt has quit IRC | 13:46 | |
| fungi | dolphm_: there may be good reasons not to add the rebase button for non-change-owners, but it looks like it's just a gerrit acl permission | 13:47 |
| fungi | so should be trivial to set for any group on a per-project basis | 13:50 |
| *** tian has quit IRC | 13:52 | |
| fungi | anteaya: are you seeing this under traditional tempest or testr tempest? | 13:52 |
| *** _TheDodd_ has joined #openstack-infra | 13:52 | |
| *** shanewang has quit IRC | 13:52 | |
| anteaya | testr tempest | 13:52 |
| fungi | ahh, fun | 13:52 |
| anteaya | I haven't been running traditional so I can't say it is or is not there as well | 13:53 |
| anteaya | w00t | 13:53 |
| anteaya | what do you consider traditional tempest, by the way | 13:53 |
| *** bnemec has quit IRC | 13:55 | |
| *** bnemec has joined #openstack-infra | 13:55 | |
| fungi | if i were awake enough i'd say something about the kind of tempest which puts candles up around the winter holidays, but instead... running without DEVSTACK_GATE_TEMPEST_TESTR_FULL=1 | 13:55 |
| *** HenryG has joined #openstack-infra | 13:56 | |
| fungi | using DEVSTACK_GATE_TEMPEST_FULL=1 instead | 13:56 |
| anteaya | ah okay | 13:56 |
| sdague | anteaya: I could believe volume teardown is racey | 13:56 |
| sdague | we've seen that before | 13:56 |
| anteaya | sdague: great glad I'm not tilting at windmills then | 13:57 |
| sdague | afazekas has been working on resource leak detection | 13:57 |
| anteaya | is it worth my time to confirm? | 13:57 |
| sdague | but it's probably post havana | 13:57 |
| sdague | anteaya: yes definitely | 13:57 |
| anteaya | ah okay | 13:57 |
| anteaya | sure | 13:57 |
| sdague | it's one of the reasons we've got the ./clean.sh script in devstack | 13:58 |
| *** mriedem has quit IRC | 13:58 | |
| fungi | also #openstack-qa may find you a more focused audience for that topic | 13:58 |
| anteaya | ah /me looks at ./clean.sh | 13:58 |
| anteaya | fungi: true that | 13:58 |
| *** prad_ has joined #openstack-infra | 13:58 | |
| *** sandywalsh has joined #openstack-infra | 13:59 | |
| *** mriedem has joined #openstack-infra | 13:59 | |
| afazekas | sdague: BTW: https://review.openstack.org/#/c/39346/ | 13:59 |
| sdague | fungi: any chance I could get you to look at https://review.openstack.org/#/c/39358/ and https://review.openstack.org/#/c/39853/ and https://review.openstack.org/#/c/39856/ ? | 13:59 |
| fungi | sdague: in about 20 minutes i can crack into those | 14:00 |
| * fungi puts them at the top of the list | 14:00 | |
| sdague | they will need to land in that order, and mordred should have final say, but they could use another +2 if they are right | 14:00 |
| fungi | you bet | 14:00 |
| sdague | I think we definitely need an icehouse summit about how to have zuul do cross project deps | 14:01 |
| *** adalbas has quit IRC | 14:01 | |
| *** prad_ has left #openstack-infra | 14:01 | |
| *** dina_belova has quit IRC | 14:02 | |
| fungi | dhellmann: https://review.openstack.org/#/admin/groups/192,members and https://review.openstack.org/#/admin/groups/193,members | 14:03 |
| dhellmann | fungi: thanks! | 14:03 |
| fungi | np | 14:03 |
| *** dina_belova has joined #openstack-infra | 14:03 | |
| *** cppcabrera has left #openstack-infra | 14:04 | |
| *** vijendar has quit IRC | 14:05 | |
| mordred | morning sdague | 14:06 |
| *** jeffa has joined #openstack-infra | 14:06 | |
| mordred | sdague: I actually think that https://review.openstack.org/#/c/39853/ should land first | 14:07 |
| mordred | sdague: so that when we land https://review.openstack.org/#/c/39358/ it will in fact verify that the gate works | 14:07 |
| mordred | sdague: or - rather - I thnk we should land that list of things in the opposite order that you have it listed | 14:09 |
| mordred | sdague: land both of the infra config jobs, then the requirements job | 14:09 |
| sdague | mordred: sure | 14:09 |
| sdague | I think the last one doesn't work though | 14:10 |
| mordred | oh no? | 14:10 |
| sdague | oh, wait | 14:10 |
| mordred | why not? | 14:10 |
| sdague | right, the last one will ensure that no other requirements change can land before the first one | 14:10 |
| mordred | yes | 14:10 |
| sdague | no, you're right | 14:10 |
| mordred | cool | 14:10 |
| mordred | I'm going to land it | 14:10 |
| sdague | cool | 14:10 |
| *** hashar has joined #openstack-infra | 14:13 | |
| openstackgerrit | A change was merged to openstack-infra/config: add unit test job for global-requirements https://review.openstack.org/39856 | 14:14 |
| *** vijendar has joined #openstack-infra | 14:15 | |
| thomasm | Hey all | 14:17 |
| *** adalbas has joined #openstack-infra | 14:17 | |
| mordred | sdague: the other one - the projects requirements check - that can land any time, can't it? | 14:18 |
| sdague | mordred: this one - https://review.openstack.org/#/c/39853/ | 14:18 |
| sdague | ? | 14:18 |
| *** krtaylor has joined #openstack-infra | 14:18 | |
| mordred | yes | 14:19 |
| sdague | that actually needs the global- change first | 14:19 |
| mordred | ok | 14:19 |
| * mordred waiting for the job change to land in jenkins | 14:19 | |
| sdague | because clarkb pointed out that if I looped all the files, which was the first attempt | 14:20 |
| *** rfolco has quit IRC | 14:20 | |
| sdague | that I'd actually pick up requirements/test-requirements.txt | 14:20 |
| sdague | which would polute global requirements | 14:20 |
| *** mkoderer has quit IRC | 14:23 | |
| *** changbl has joined #openstack-infra | 14:23 | |
| *** pabelanger has joined #openstack-infra | 14:24 | |
| *** rcleere has joined #openstack-infra | 14:28 | |
| *** burt has joined #openstack-infra | 14:33 | |
| dhellmann | mordred: pbr fails to generate an authors list for a repo without any real commits. is that intentional, or a bug? | 14:34 |
| *** russellb is now known as rustlebee | 14:35 | |
| sdague | mordred: ok, so how about this next - https://review.openstack.org/#/c/39358/ | 14:35 |
| *** anteaya is now known as anteayah | 14:36 | |
| anteayah | 'cmon ghost tooth | 14:36 |
| anteayah | s/'cmon/c'mon | 14:37 |
| *** pentameter has joined #openstack-infra | 14:38 | |
| *** dansmith is now known as Steely_Dan | 14:42 | |
| *** markmcclain has quit IRC | 14:44 | |
| *** jjmb has quit IRC | 14:46 | |
| *** SergeyLukjanov has quit IRC | 14:47 | |
| fungi | dhellmann: is the expectation that you should get an empty authors file, or are you hitting an exception? | 14:48 |
| dhellmann | I get an error because it's trying to treat None like a string | 14:48 |
| dhellmann | an empty AUTHORS file would be fine, I think | 14:48 |
| *** pabelanger has quit IRC | 14:49 | |
| dhellmann | I'll work on a fix, I just wanted to know if this was expected behavior or a known issue someone was working on already | 14:49 |
| fungi | dhellmann: i would definitely call that a bug. i'm not sure what to expect as a behavior, but i'd wager an exception is not it | 14:50 |
| dhellmann | or at least an exception with a better message :-) | 14:50 |
| fungi | either silently refuse to create an authors file or create an empty one with/without some boilerplate comments or whatever | 14:50 |
| *** jjmb has joined #openstack-infra | 14:51 | |
| *** pabelanger has joined #openstack-infra | 14:51 | |
| dhellmann | sounds good | 14:52 |
| *** mrodden has quit IRC | 14:53 | |
| mordred | dhellmann: uh - wow... I believe I have just simply never tried that case | 14:54 |
| dhellmann | mordred: that's what I figured. New pycadf repo exposed it. | 14:55 |
| dhellmann | I'm working on a fix | 14:55 |
| fungi | that was my suspicion as well. generally speaking, repos don't stay empty for long and rarely get packaged until they have a commit | 14:55 |
| mordred | fungi, clarkb: could one of you take a peek at https://review.openstack.org/#/c/39358/ ? | 14:55 |
| mordred | it's ready to land, but needs a second +@ | 14:55 |
| mordred | +2 | 14:55 |
| fungi | on it | 14:55 |
| *** hashar has quit IRC | 14:56 | |
| fungi | i have no more +@s in my bucket, but plenty of +2s | 14:56 |
| *** SergeyLukjanov has joined #openstack-infra | 14:56 | |
| *** UtahDave has joined #openstack-infra | 14:56 | |
| fungi | and also appreciate the tolkien reference | 14:57 |
| jeblair | o/ | 14:57 |
| anteayah | morning jeblair | 14:58 |
| *** dina_belova has quit IRC | 14:58 | |
| fungi | mordred: so one of the arguments against doing this early on was that we no longer give downstream packagers an indication of which requirements they need to package as run-time dependencies and which are only testing requirements. what is the current thinking on that? | 14:58 |
| mordred | fungi: the gate breakages are, I think, more important to engineer for | 14:59 |
| fungi | ahh, the comment and separate sections | 14:59 |
| *** dina_belova has joined #openstack-infra | 14:59 | |
| mordred | fungi: and honestly - I think that downstream packagers _should_ package all of our test requires too :) | 14:59 |
| fungi | i see we've kept them independent in the file, so i guess that's good enough to support that case | 14:59 |
| jeblair | was there a reason they couldn't be two files? | 15:00 |
| openstackgerrit | David Caro proposed a change to openstack-infra/jenkins-job-builder: Added Robot Framework reposts publisher https://review.openstack.org/39939 | 15:01 |
| mordred | sdague: do you remember the details of why we did hte switch? I only remember things sucking and that one-file-to-rule-them-all was the answer | 15:02 |
| jeblair | the commit msg says it 'massively simplifies' | 15:02 |
| *** dina_belova has quit IRC | 15:02 | |
| jeblair | i guess with all the scripts we have touching these files now (unit tests, update, etc) there's a lot of 'read both files and combine them'... | 15:03 |
| jeblair | (or would be otherwise) | 15:03 |
| fungi | i got the impression there were a couple of issues being addressed, one of which was that having the lists in requirements.txt and test-requirements.txt confused some of the tooling into thinking those applied directly to the requirements project | 15:03 |
| jeblair | sure, but that's addressed by moving it to global-requirements (and there could be a global-test-requirements) | 15:04 |
| *** changbl has quit IRC | 15:04 | |
| fungi | agreed | 15:04 |
| *** afazekas has quit IRC | 15:04 | |
| sdague | mordred: yes, otherwise you are running around reading both files all the time | 15:04 |
| *** dina_belova has joined #openstack-infra | 15:04 | |
| jeblair | mordred, sdague: is there a corresponding change to the mirror to read global-? | 15:04 |
| fungi | though i note that the rename issue is being quietly solved in this change without an actual mention | 15:04 |
| jeblair | mordred: also, this will probably need backporting to the stable branches of the requirements repo | 15:06 |
| mordred | jeblair: good catch... | 15:06 |
| jeblair | (which are still mostly unused, so probably nbd) | 15:06 |
| sdague | jeblair: I didnt' touch the mirror script, where is it at | 15:07 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/jeepyb: Add global-requirements.txt to the mirror list https://review.openstack.org/39941 | 15:07 |
| jeblair | sdague: ^ there :) | 15:07 |
| mordred | sdague: ^^ right there :) | 15:07 |
| jeblair | sdague: gate-tempest-devstack-vm-neutron is succeeding in master according to a quick scan of zuul status page | 15:07 |
| fungi | quick lock it down? | 15:08 |
| *** mrodden has joined #openstack-infra | 15:08 | |
| mordred | woot! | 15:08 |
| mordred | and disallow any further commits to neutron! | 15:08 |
| jeblair | in a few mins, i'll see if our new graphs can show us data on that | 15:08 |
| mordred | jeblair: I, for one, welcome our new graphs overlords | 15:09 |
| jeblair | after i make an omelette | 15:09 |
| mordred | does everyone else feel like this week was a cauldron? | 15:09 |
| fungi | omelette du fromage | 15:09 |
| fungi | mordred: yes, and the remaining bits of my flesh are still boiling off as far as i can tell | 15:10 |
| mriedem | sdague: is there still a running list somewhere (etherpad) of the neutron tests that fail in tempest? | 15:10 |
| mordred | mriedem: it's passing it's passing! | 15:10 |
| sdague | jeblair: so the reason we pulled it originally is a race | 15:10 |
| mordred | oh right | 15:10 |
| sdague | so we need a couple days of it working before we turn it back on | 15:10 |
| *** toddmorey has joined #openstack-infra | 15:10 | |
| fungi | thus, graphsgraphsgraphs | 15:10 |
| mriedem | mrodden: hmm, i can't get this one to work: tempest/api/compute/security_groups/test_security_groups.py:SecurityGroupsTestJSON.test_server_security_groups | 15:10 |
| mriedem | but i couldn't find a bug for it | 15:10 |
| mriedem | mordred: ^ - didn't mean mrodden | 15:11 |
| mordred | mriedem: there's a lot of m's and r's in these parts... | 15:11 |
| *** mordred is now known as TheRonin | 15:11 | |
| TheRonin | it is casual nick friday ... | 15:11 |
| fungi | TheRonin: i'm wearing my casual pants instead | 15:12 |
| sdague | honestly, I think the reason it broke really hard was them not having the right oslo version in there for a bit | 15:12 |
| sdague | which was fixed by oslo.config git in devstack going in | 15:12 |
| TheRonin | heck yes | 15:12 |
| sdague | well I bicycled to work, so I'm very casual today | 15:13 |
| TheRonin | sdague: have we added oslo.config into the gate yet? or just its git repo into the mix? | 15:13 |
| *** rfolco has joined #openstack-infra | 15:14 | |
| sdague | TheRonin: it's waiting +A | 15:14 |
| sdague | https://review.openstack.org/#/c/39508/ | 15:14 |
| sdague | so pull the trigger. It's got 2 +2s plus markmc's +1 | 15:14 |
| *** markmcclain has joined #openstack-infra | 15:15 | |
| anteayah | fungi: and your casual Hawaiian shirt? | 15:15 |
| TheRonin | jeblair: any reason I should hold off on pulling the trigger on the oslo.config gating change? | 15:17 |
| fungi | anteayah: my hawaiian shirts are anything but casual. causal maybe, but not casual | 15:18 |
| openstackgerrit | A change was merged to openstack-infra/gitdm: Add anteaya to hp. https://review.openstack.org/39913 | 15:19 |
| fungi | anteayah: congrats on the new patron! | 15:19 |
| *** changbl has joined #openstack-infra | 15:19 | |
| anteayah | fungi: yay, thank you | 15:19 |
| anteayah | :D | 15:19 |
| anteayah | ah the causal hawaiian shirts, they must cost extra | 15:20 |
| fungi | but they always ensure an outcome | 15:20 |
| anteayah | ha ha ha | 15:21 |
| *** boris-42 has quit IRC | 15:21 | |
| ttx | TheRonin: stable/folsom is unfucked so we can implement capping. I could do it I guess but I'd probably screw it up. Crae giving it a try ? | 15:22 |
| ttx | Care* | 15:22 |
| anteayah | ttx are you back for storyboard questions or are you gone again? | 15:24 |
| ttx | anteayah: I'm almost done for the day, but you can shoot questions in the remaining time :) | 15:24 |
| anteayah | okay let me fire it up | 15:25 |
| burt | mordred: any progress on devstack building on Precise? | 15:25 |
| jeblair | sdague, mordred: http://tinyurl.com/nto4nje | 15:25 |
| anteayah | ttx okay so currently if I have at least one project, one branch and one milestone in the db | 15:27 |
| anteayah | if I go to a project and create a new bug | 15:27 |
| openstackgerrit | A change was merged to openstack-infra/config: make oslo.config gating on devstack/tempest runs https://review.openstack.org/39508 | 15:27 |
| anteayah | I get this error: Milestone matching query does not exist. Lookup parameters were {'undefined': True, 'branch__status': 'M'} | 15:27 |
| TheRonin | jeblair: that is an excellent graph | 15:27 |
| anteayah | I don't know if this is just me and I need to do something different for configuration or if this is an actual bug and I need to edit code | 15:28 |
| anteayah | ttx are you able to confirm my findings? | 15:28 |
| *** jeffa has quit IRC | 15:28 | |
| ttx | anteayah: you need at least two branches defined, a master and release branch | 15:28 |
| ttx | See the bottom of README.rst | 15:29 |
| anteayah | okay | 15:29 |
| ttx | Master must have status='M' | 15:29 |
| anteayah | okay thanks, I will do that | 15:30 |
| ttx | milestone-proposed (the release branch) must be status=R | 15:30 |
| *** mrodden has quit IRC | 15:30 | |
| anteayah | I had both a master and a release branch already | 15:31 |
| clarkb | did neutron merge a fix? eg is this expected? | 15:31 |
| *** rfolco has quit IRC | 15:31 | |
| anteayah | I had branch_01 as master and branch_02 as release | 15:31 |
| anteayah | they are already in the db | 15:32 |
| fungi | clarkb: 0000z this morning, looks like | 15:32 |
| anteayah | do I need to rename branch_02 to milestone-proposed? | 15:32 |
| ttx | anteayah: no, but the branch_types need to be set right | 15:32 |
| anteayah | they are | 15:32 |
| anteayah | branch_01 is master and branch_02 is release | 15:33 |
| anteayah | does there need to be an additional relationship? | 15:33 |
| ttx | Ah. er. | 15:33 |
| anteayah | or does the datetime play a role? | 15:33 |
| sdague | TheRonin: ok so we're just waiting on the mirror script to land? | 15:33 |
| ttx | You'll need one milestone for the master branch | 15:33 |
| anteayah | I have just been hitting today and now to set the time and I created them yesterday | 15:33 |
| anteayah | oh | 15:33 |
| TheRonin | sdague: the jenkins job? it has landed | 15:33 |
| anteayah | umm, let me look | 15:34 |
| ttx | anteayah: think "havana-3" | 15:34 |
| ttx | we should definitely come up with initial fixture for the db to simplify | 15:34 |
| anteayah | I do, milestone_01 is on branch_01 | 15:34 |
| ttx | (release_date is just used for ordering) | 15:34 |
| jeblair | TheRonin, sdague: the mirror script will run on both global-requirements and the requirements repo's own requirements... is that ok? | 15:34 |
| anteayah | I had that | 15:34 |
| anteayah | ttx this is where my lack of knowledge about releases and branches is bringing me down, sorry about this | 15:35 |
| *** nicedice has joined #openstack-infra | 15:35 | |
| anteayah | so milestone_01 was already on branch_01, the master branch | 15:35 |
| TheRonin | jeblair: yes. I believe that the requirements repo's test-requirements.txt should be a subset of global-requirements | 15:35 |
| sdague | yes | 15:35 |
| ttx | anteayah: you need one milestone with status=M and undefined=True, although I don't remember why right now :) | 15:36 |
| jeblair | ok. should the requirements repo get a requirements check job? :) | 15:36 |
| sdague | jeblair: yes, probably :) | 15:36 |
| *** afazekas_zz has quit IRC | 15:36 | |
| jeblair | mirror change aprvd | 15:36 |
| TheRonin | woot | 15:36 |
| * ttx checks on dev instance | 15:36 | |
| sdague | ok, so I think this is next - https://review.openstack.org/#/c/39853/ | 15:37 |
| sdague | right? | 15:37 |
| openstackgerrit | A change was merged to openstack-infra/jeepyb: Add global-requirements.txt to the mirror list https://review.openstack.org/39941 | 15:37 |
| sdague | that makes sure no other requirements changes land | 15:37 |
| ttx | anteayah: ok, so you need an "Undefined" milestone on master branch with undefined=True | 15:37 |
| ttx | anteayah: and I failed to document /that/ :) | 15:38 |
| sdague | actually, it's tightly coupled with the actual requirements change | 15:38 |
| sdague | so I think they both basically need to go at the same time | 15:38 |
| sdague | we'll have a window of failing nova jobs until they do | 15:38 |
| ttx | anteayah: see doc @ https://github.com/openstack-infra/storyboard/commit/bbb154e23f1c904390c2744413e7b46b1af0584c | 15:38 |
| *** zul has quit IRC | 15:38 | |
| anteayah | ttx that was it, once I clicked the undefined box on the milestone_01 I was able to create a bug on a project without an error | 15:38 |
| anteayah | thanks | 15:39 |
| jeblair | sdague: but we don't normally run the requirements jobs unless they change | 15:39 |
| sdague | jeblair: oh, right | 15:39 |
| ttx | anteayah: "Milestones are mandatory, there is a | 15:39 |
| ttx | default 'undefined' milestone for when we don't really know when that | 15:39 |
| ttx | work will hit in the master branch." | 15:39 |
| sdague | right, so https://review.openstack.org/#/c/39853/ next | 15:39 |
| jeblair | sdague: so as long as no one changes a req, we can land 39853 safely | 15:39 |
| sdague | yep | 15:39 |
| *** zul has joined #openstack-infra | 15:39 | |
| ttx | anteayah: feel free to turn that commit message into proper doc :) | 15:39 |
| sdague | man, this feels like aircraft traffic control :) | 15:39 |
| anteayah | ttx okay thanks, I'll try to get my head around this documentation | 15:39 |
| anteayah | ttx I might actually be able to land a patch then | 15:40 |
| anteayah | :D | 15:40 |
| ttx | anteayah: yeah, sorry about that | 15:40 |
| anteayah | ha ha ha | 15:40 |
| anteayah | I have to have something to bug you about | 15:40 |
| jeblair | sdague: i think we may want: branch in ['master', 'milestone-proposed'] ? | 15:40 |
| anteayah | usually you are teflon man | 15:40 |
| anteayah | I will over use this one chink in the armour, never fear | 15:41 |
| jeblair | sdague: especially if we are going to change this to run on every change | 15:41 |
| sdague | jeblair: well it wasn't there before, can we do that as a follow on? | 15:41 |
| sdague | jeblair: so this doesn't actually make it run on every change | 15:41 |
| sdague | this just changes the source file | 15:41 |
| clarkb | https://bugs.launchpad.net/nova/+bug/1206330 is that the thing making neutron better? | 15:41 |
| uvirtbot | Launchpad bug 1206330 in nova "nova list failure when quantum_url points to HTTPS endpoint" [Undecided,New] | 15:41 |
| sdague | all the "run on every change" is phase 2 stuff, once we get this all in the gate | 15:41 |
| jeblair | sdague: yeah, you're right that doesn't impact this (yet; though it may when we start running on every change) | 15:42 |
| jeblair | actually... | 15:42 |
| clarkb | _TheDodd_: you about? https://review.openstack.org/#/c/39547/ seems to have done the correct thing to https://bugs.launchpad.net/openstack-ci/+bug/1207047 | 15:43 |
| jeblair | as currently written, if we run it on every change, then the first commit to m-p would have to be to remove anything in dev-requirements. | 15:43 |
| uvirtbot | Launchpad bug 1207047 in openstack-ci "The logstash gearman workers should properly handle gzipped files." [Low,In progress] | 15:43 |
| jeblair | sdague: that may not be wrong. :) | 15:43 |
| TheRonin | jeblair: ++ | 15:43 |
| clarkb | _TheDodd_: I think I am ready to announce the new bug awesomeness | 15:44 |
| clarkb | jeblair: TheRonin fungi ^ | 15:44 |
| TheRonin | I think we'll need to sort oslo pre-release releasing before we can do that for m-p | 15:44 |
| TheRonin | clarkb: ++ | 15:44 |
| fungi | clarkb: yes, seems to be working well from what i've seen | 15:44 |
| jeblair | clarkb: _TheDodd_: +1 | 15:44 |
| _TheDodd_ | clarkb: Well, that sounds great to me. | 15:44 |
| _TheDodd_ | I'm glad everything is in order. | 15:45 |
| fungi | thanks again for an excellent piece of work, _TheDodd_! | 15:45 |
| jeblair | _TheDodd_: you want to send the announcement out? | 15:45 |
| _TheDodd_ | We've not received any complaints about back compat? | 15:45 |
| _TheDodd_ | fungi: THX | 15:45 |
| _TheDodd_ | jeblair: sure. | 15:45 |
| _TheDodd_ | jeblair: how should I go about making the announcement? | 15:46 |
| jeblair | _TheDodd_: we usually send something to openstack-dev and tag with [Infra] | 15:46 |
| openstackgerrit | Doug Hellmann proposed a change to openstack-dev/pbr: Ensure _run_shell_command always returns same type https://review.openstack.org/39945 | 15:47 |
| sdague | ok, 3 +2s - https://review.openstack.org/#/c/39853/2 | 15:47 |
| sdague | can we land? :) | 15:48 |
| * fungi mistakenly sent his last announcement with [CI] since it was ci-specific and not just general infrastructure | 15:48 | |
| *** cthulhup has quit IRC | 15:48 | |
| _TheDodd_ | jeblair: Tell you what, I will let one of you pros do it this time. I'll watch and learn, so that when another opportunity comes up for me to make an announcement, I'll be all over it. | 15:48 |
| _TheDodd_ | Acceptable? | 15:48 |
| dhellmann | fungi, mordred: there's the fix for the "package in a new git repo" issue ^^ | 15:48 |
| jeblair | _TheDodd_: sure, no pressure. :) | 15:49 |
| jeblair | anyone remember where that etherpad is? | 15:49 |
| *** mrodden has joined #openstack-infra | 15:49 | |
| clarkb | jeblair: https://etherpad.openstack.org/Driving_Infrastructure_Automation | 15:49 |
| *** reed has joined #openstack-infra | 15:50 | |
| fungi | sdague: approved and will keep an eye on running requirements jobs if any for potental breakage (though not expecting any) | 15:51 |
| sdague | ok, cool | 15:51 |
| sdague | so as soon as that merges, then we've got the other one | 15:51 |
| openstackgerrit | A change was merged to openstack-infra/config: support global-requirements.txt https://review.openstack.org/39853 | 15:52 |
| _TheDodd_ | jeblair: https://etherpad.openstack.org/Driving_Infrastructure_Automation | 15:52 |
| clarkb | how are mail queues doing this morning? | 15:54 |
| *** cthulhup has joined #openstack-infra | 15:55 | |
| fungi | 1248 4462KB 4d 0m TOTAL | 15:55 |
| fungi | not too bad | 15:55 |
| sdague | ok, so for our next trick - https://review.openstack.org/#/c/39358/ | 15:56 |
| sdague | that's the big one | 15:56 |
| jeblair | i'm having a devil of a time getting snmpd to report that so we can graph it, btw, due to permissions nightmares. :( | 15:56 |
| clarkb | sdague: you used my LoTR reference :) | 15:56 |
| fungi | clarkb: sudo exim -bp | exiqsumm | 15:56 |
| clarkb | fungi: ty | 15:56 |
| sdague | :) | 15:56 |
| fungi | clarkb: note that most everything reported there is 0m in the queue | 15:56 |
| sdague | clarkb: yeh, honestly, last night writing that commit message, it's all I could think of | 15:56 |
| jeblair | clarkb: 'a few hundred' is probably baseline for that server. | 15:57 |
| jeblair | like 600-800 | 15:57 |
| clarkb | fungi: is that the delay? | 15:57 |
| clarkb | jeblair: what about collectd into graphite? | 15:57 |
| fungi | clarkb: it's how long the delivery has been queued | 15:57 |
| clarkb | (adds a new tool but possibly easier to fight than snmp) | 15:57 |
| fungi | clarkb: the "delay" depends to a great extent on the recipient's mta | 15:57 |
| *** burt has left #openstack-infra | 15:57 | |
| *** burt has joined #openstack-infra | 15:58 | |
| jeblair | clarkb: in the current configuration, almost everything is going to end up getting queued for at least a minute. | 15:58 |
| fungi | clarkb: so having a handful in the multiple minutes, hours or even days is expected. it's more a question of calculating the statistical mode of queue times for deliveries | 15:58 |
| *** jeffa has joined #openstack-infra | 15:59 | |
| jeblair | msg sent | 16:00 |
| clarkb | fungi: I see. | 16:00 |
| sdague | ok, I'm running off to lunch - https://review.openstack.org/#/c/39358/ still needs a +A, as no one can merge requirements changes until it lands | 16:01 |
| jeblair | sdague: gee haven't we done enough today? (aprvd) :) | 16:03 |
| clarkb | the day is just starting :) | 16:04 |
| *** _TheDodd_ is now known as TheDodd | 16:05 | |
| *** emagana has joined #openstack-infra | 16:06 | |
| TheDodd | Ditched the underscores for Casual nick Friday!!! | 16:06 |
| TheDodd | Yea! | 16:06 |
| anteayah | :D | 16:07 |
| anteayah | very sharp | 16:07 |
| jeblair | clarkb: when would you like the periodic jobs run? | 16:07 |
| *** mrodden1 has joined #openstack-infra | 16:08 | |
| *** jeffa has quit IRC | 16:08 | |
| clarkb | jeblair: I believe our "quiet" period is 11pm PDT to 2am PDT ish | 16:09 |
| clarkb | jeblair: so 0600 UTC? | 16:09 |
| *** TheDodd is now known as thedodd | 16:09 | |
| jeblair | clarkb: sure. i couldn't tell looking at our graph. :) | 16:09 |
| clarkb | jeblair: there is a slight dip on the graph around 10-11pm | 16:09 |
| * fungi is not so sure we have a "quiet period" any more | 16:09 | |
| fungi | at least not on weekdays | 16:10 |
| clarkb | fungi: we still have a dip in the middle of the night pacific time, but it isn't a full stop | 16:10 |
| fungi | friday mornings are nice and quiet because much of the world has already started its weekend | 16:10 |
| jeblair | since these are going in zuul, they'll be low gearman priority anyway | 16:10 |
| clarkb | jeblair: good point | 16:10 |
| *** mrodden has quit IRC | 16:10 | |
| fungi | ahh, yes, low priority for periodic jobs sounds ideal | 16:10 |
| clarkb | we didn't have that before so it was important to plan ahead and try to avoid starvation | 16:10 |
| jeblair | can still do that of course | 16:11 |
| jeblair | fungi: is there a python 3.3 mirror slave? | 16:15 |
| fungi | jeblair: there is a https://review.openstack.org/#/c/39561/ | 16:17 |
| *** nijaba has quit IRC | 16:17 | |
| fungi | jeblair: i'm eager to build it as soon as that gets merged | 16:18 |
| fungi | and then i'll add the jobs for it | 16:18 |
| jeblair | fungi: I'm eager to have it built! | 16:18 |
| TheRonin | jeblair, fungi, sdague: while we're gating requirements on things: https://review.openstack.org/#/c/38176/ | 16:18 |
| jeblair | TheRonin: i already reviewed that. :) | 16:19 |
| clarkb | jeblair: I intend on spinning up a new tx.slave today and fixing setuptools by hand if necessary | 16:19 |
| TheRonin | jeblair: I know | 16:19 |
| TheRonin | jeblair: I was just including you in the conversation | 16:19 |
| jeblair | TheRonin: thanks, it worked. :) | 16:19 |
| TheRonin | clarkb: should we re-name that slave? | 16:19 |
| clarkb | TheRonin: sure, what do you want to call it? | 16:19 |
| TheRonin | clarkb: weren't we talking about having it start to do something else too? | 16:19 |
| *** nijaba has joined #openstack-infra | 16:19 | |
| *** nijaba has quit IRC | 16:19 | |
| *** nijaba has joined #openstack-infra | 16:19 | |
| jeblair | TheRonin: i think you're thinking of pypi | 16:19 |
| * TheRonin trying to remember ... | 16:19 | |
| clarkb | TheRonin: that is pypi.slave | 16:20 |
| TheRonin | ah | 16:20 |
| TheRonin | yes | 16:20 |
| clarkb | because it talk maven now too | 16:20 |
| TheRonin | no - I htink I'm thinking of a new things for tx.slave | 16:20 |
| TheRonin | which is tx.slave submits the translations changes to gerrit for review, right? | 16:20 |
| fungi | clarkb: your comment on 39561... i can take a stab at that after we merge that one, if there's consensus that we don't need future differentiation which might be out of place in the site manifest | 16:20 |
| TheRonin | so wouldn't that be a good place to submit the requirements changes to gerrit for review? | 16:20 |
| clarkb | I will probably spin up elasticsearch6 at the same time so that adding it to the cluster tomorrow is as simple as merging a puppet change and kicking es6 | 16:20 |
| openstackgerrit | A change was merged to openstack-infra/config: Add a mirror33 slave node definition. https://review.openstack.org/39561 | 16:21 |
| clarkb | TheRonin: it does submit the changes for review | 16:21 |
| clarkb | TheRonin: is the act of submitting code to gerrit priveleged? | 16:21 |
| jeblair | TheRonin, clarkb: we could call it "jenkins.slave". since it interacts with gerrit as 'jenkins'. that's not at all confusing | 16:21 |
| jeblair | clarkb: most slaves do not gave jenkins' private key for gerrit installed, that's the priv part. | 16:21 |
| TheRonin | jeblair: oh - btw - in the beta version of hpcloud, they have a new super really big xtralarge machine type with 128G of RAM and a boatload of processors | 16:21 |
| TheRonin | jeblair: :) | 16:22 |
| *** pabelanger has quit IRC | 16:22 | |
| clarkb | jeblair: ah | 16:22 |
| *** mkoderer has joined #openstack-infra | 16:22 | |
| clarkb | TheRonin: ya someone mentioned that and it made me want to spin up elasticsearch over there >_> | 16:22 |
| TheRonin | ++ | 16:22 |
| clarkb | just have a two node cluster | 16:22 |
| clarkb | TheRonin: jeblair I can call it something else when I spin it up. I don't like jenkins.slave though | 16:23 |
| TheRonin | what about "steve" | 16:23 |
| jeblair | TheRonin: we would have to rename Jenkins in gerrit to "Steve". | 16:23 |
| TheRonin | jeblair: we should do that | 16:24 |
| jeblair | that would really, really, really screw with the people tracking stats | 16:24 |
| jeblair | suddenly some guy named Steve is leading in patches proposed and merged! | 16:24 |
| *** ^d has joined #openstack-infra | 16:25 | |
| *** ^d has joined #openstack-infra | 16:25 | |
| jeblair | clarkb: git.slave, gerrit.slave? | 16:26 |
| jeblair | prop.slave, review.slave | 16:27 |
| fungi | steve.slave still has a great ring to it | 16:27 |
| TheRonin | what about slave.slave | 16:27 |
| *** ladquin has quit IRC | 16:27 | |
| TheRonin | or mr.slave | 16:27 |
| anteayah | then steve would be the new guy to beat | 16:27 |
| fungi | free.slave | 16:27 |
| anteayah | mr.steve | 16:28 |
| TheRonin | the.slave | 16:28 |
| clarkb | jeblair: review.slave I like that one | 16:28 |
| jeblair | tx.slave does also have the tx creds on it. | 16:28 |
| *** odyssey4me has quit IRC | 16:28 | |
| jeblair | so it's not quite 1:1 | 16:28 |
| jeblair | i mean, these are still probably safe to stack. | 16:29 |
| fungi | that does a fairly good job of capturing its intent. i'm still not too keen on x.slave.o.o when we also have an x.o.o (purely from a confusion standpoint) | 16:29 |
| clarkb | maybe we should go with steve and use a TXT record to explain it :) | 16:29 |
| fungi | for example, i always had to tread lightly around the differences between pypi.slave.o.o and pypi.o.o (before we collapsed the latter into static.o.o) | 16:29 |
| *** comstud is now known as bearhands | 16:30 | |
| fungi | TheRonin: https://review.openstack.org/38176 kindly requests a rebase | 16:31 |
| fungi | oh, and mdehaan's presentation last night was really good. i also finally got some clarification on the relationship between ansible and rpath linux... apparently while rpath used it, he developed ansible off the clock while working there and so got to take it with him after the sas buyout | 16:34 |
| *** jjmb has quit IRC | 16:35 | |
| fungi | it's compelling from the standpoint of being agentless+ssh+yaml | 16:35 |
| clarkb | fungi: and it has "fireball" mode for when it needs salt like performance | 16:35 |
| HenryG | If I clone devstack in a freshly installed Ubuntu 12.04 server, then checkout the stable/grizzly branch of devstack, then stack.sh fails on installing keystone client. http://paste.openstack.org/show/42974/ | 16:35 |
| *** dina_belova has quit IRC | 16:36 | |
| fungi | clarkb: yep. it can also do serialized small-batch operations for grouped rolling changes and the like | 16:36 |
| fungi | HenryG: that's pretty interesting... i will try it myself and see what happens | 16:37 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Trigger periodic jobs with Zuul https://review.openstack.org/39951 | 16:37 |
| clarkb | TheRonin: that looks like more setuptools madness | 16:38 |
| clarkb | oh actually nevermind | 16:39 |
| jeblair | clarkb, TheRonin, fungi: ^ i did try to use project templates, btw, but multiple templates don't merge with each other in the way i'd expect (nor do they merge with additional jobs for a project), so i think we need to enhance that feature a bit. | 16:39 |
| clarkb | more https madness | 16:39 |
| clarkb | HenryG: are you behind a proxy? | 16:39 |
| *** ladquin has joined #openstack-infra | 16:39 | |
| *** ladquin has joined #openstack-infra | 16:39 | |
| HenryG | clarkb: yes | 16:39 |
| *** afazekas has joined #openstack-infra | 16:40 | |
| jeblair | grizzly devstack-tempest is good (a change merged to it a couple hours ago) | 16:40 |
| *** jeffa has joined #openstack-infra | 16:40 | |
| clarkb | ya, sdague had mentioned proxy issues, I thought they were specifically related to git thuogh and this doesn't appear to be related to git | 16:40 |
| clarkb | reed: https://bugs.launchpad.net/bugs/1207830 | 16:41 |
| uvirtbot | Launchpad bug 1207830 in openstack-ci "404 on some questions at ask.openstack.org" [Undecided,New] | 16:41 |
| *** SergeyLukjanov has quit IRC | 16:41 | |
| clarkb | HenryG: if you try to install d2to1 in a virtualenv does it fail with the same error? | 16:42 |
| HenryG | clarkb: lemme check ... | 16:42 |
| clarkb | I have a hunch this is related to proxy madness and not devstack | 16:42 |
| reed | clarkb, ah, interesting, thanks | 16:44 |
| clarkb | I am going to AFK for a bit to hunt down food and stuff | 16:44 |
| dstufft | proxy is flat out broken ins etuptools | 16:45 |
| dstufft | which setuptools installs setup_requires | 16:45 |
| *** derekh has quit IRC | 16:45 | |
| dstufft | FWIW | 16:45 |
| * dstufft isn't paying attention | 16:45 | |
| reed | clarkb, I think it's because we're in the middle of the installation of the new ask version, supporting multiple languages | 16:45 |
| *** afazekas has quit IRC | 16:46 | |
| HenryG | clarkb: yes | 16:48 |
| jeblair | clarkb, fungi, TheRonin: if you could review https://review.openstack.org/#/c/39951/ within the next 30 mins or so, that would be great (then i'll spin up new jenkinses) | 16:48 |
| HenryG | clarkb: wait, I tried to install keystone client. | 16:49 |
| HenryG | clarkb: in a virtualenv. It gave a similar error as d2to1, but on pbr | 16:49 |
| *** gyee has joined #openstack-infra | 16:52 | |
| *** cthulhup has quit IRC | 16:54 | |
| TheRonin | jeblair: looing | 16:54 |
| jeblair | ew | 16:54 |
| TheRonin | jeblair: I like that patch a lot | 16:55 |
| TheRonin | HenryG: are you creating the venv by hand? | 16:55 |
| HenryG | TheRonin: not when running stack.sh | 16:56 |
| TheRonin | ah. gotcha | 16:56 |
| TheRonin | well... ah. ok. I know what's giving you issues | 16:56 |
| TheRonin | and there is a change coming soon that will fix it foryou | 16:57 |
| *** jpich has quit IRC | 16:57 | |
| HenryG | TheRonin: for me? or for one of the other issues being discussed here? :) | 16:58 |
| TheRonin | HenryG: for one of the issues being discussed here. | 16:58 |
| TheRonin | HenryG: here are some underlying problems with how we're processing dependencies that are causing other work we're doing to make the pip/setuptools better to not show up immediately | 16:59 |
| TheRonin | so, as soon as we land the run-update.py change - it will allow us to better assess the root cause and a fix for any remaining issues you have | 16:59 |
| TheRonin | sdague: do you have the run update.py change done yet? or shall I do it? | 16:59 |
| * HenryG deploys some more brain cells to process the parsing of TheRonin' | 17:00 | |
| TheRonin | sdague: oh. duh. we wrote it together | 17:01 |
| *** prad_ has joined #openstack-infra | 17:03 | |
| *** prad_ has quit IRC | 17:03 | |
| HenryG | Can I run devstack latest master branch to deploy stable/grizzy of openstack? Will that work better? | 17:03 |
| TheRonin | nope. stable/grizzly of devstack should deploy stable/grizzly of openstack | 17:03 |
| HenryG | thought so | 17:04 |
| HenryG | any tips on a temp workaround? | 17:04 |
| clarkb | use tsocks and a socks proxy? (I hate that I just suggested that) | 17:05 |
| TheRonin | pip install d2to1 ; pip install setuptools-git ; pip install pbr | 17:05 |
| TheRonin | then run stack.sh | 17:05 |
| *** zaro0508 has joined #openstack-infra | 17:05 | |
| HenryG | My pip is alread tsocksified | 17:06 |
| TheRonin | yah. pip will do the right thing, it's when setuptools calls easy_install that things go bad | 17:06 |
| *** markmcclain has quit IRC | 17:06 | |
| TheRonin | so the workaround is to use pip to pre-install anything that setuptools is going to attempt to install if it's not there | 17:06 |
| clarkb | yeah so you want to enable tsocks for all the things | 17:06 |
| *** markmcclain has joined #openstack-infra | 17:07 | |
| *** burt has quit IRC | 17:08 | |
| *** markmcclain has quit IRC | 17:09 | |
| clarkb | jeblair: in the periodic jobs change, are minute and hour transposed? | 17:09 |
| *** mriedem has quit IRC | 17:11 | |
| openstackgerrit | Doug Hellmann proposed a change to openstack-dev/pbr: Ensure _run_shell_command always returns same type https://review.openstack.org/39945 | 17:11 |
| thedodd | jeblair: Was an announcement already made? | 17:11 |
| clarkb | thedodd: yes | 17:12 |
| HenryG | TheRonin: clarkb: trying with the pip preinstalls -- stack.sh is looking much better so far ... | 17:12 |
| *** mriedem has joined #openstack-infra | 17:12 | |
| sdague | TheRonin: I think it's under your id | 17:13 |
| TheRonin | sdague: yup | 17:13 |
| TheRonin | sdague: I just re-kicked it to see if the recent changes have fixed it yet | 17:13 |
| sdague | oh, merge conflict on global requirements | 17:13 |
| sdague | let me update | 17:13 |
| TheRonin | poo | 17:13 |
| thedodd | clarkb: Oh, I didn't see it. Was it broadcast on -dev? | 17:13 |
| clarkb | thedodd: it was http://lists.openstack.org/pipermail/openstack-dev/2013-August/012945.html | 17:14 |
| sdague | heh, it was my own fault, my other reqs changes landed | 17:14 |
| openstackgerrit | Sean Dague proposed a change to openstack/requirements: one global-requirements.txt to rule them all https://review.openstack.org/39358 | 17:15 |
| sdague | TheRonin: ok, if you want to send that through | 17:15 |
| *** vijendar has quit IRC | 17:17 | |
| TheRonin | sdague: done | 17:17 |
| TheRonin | sdague: that explains why I didn't see that change when I pulled | 17:17 |
| sdague | yep | 17:17 |
| TheRonin | clarkb, sdague: btw- I just realized - now that we do single-versoin-externally-managed by default | 17:17 |
| TheRonin | we could move the locale dirs out of the package again if we wanted and actualy configure things to install them to /usr/share/locale ... | 17:18 |
| TheRonin | or /usr/local/share/locale | 17:18 |
| openstackgerrit | A change was merged to openstack/requirements: one global-requirements.txt to rule them all https://review.openstack.org/39358 | 17:18 |
| clarkb | TheRonin: moving setuptools discussion here, after the giant discussion yesterday have we gotten anywhere? | 17:19 |
| TheRonin | clarkb: sort of ... | 17:19 |
| TheRonin | clarkb: right now I'm waiting to get sdague's work in | 17:20 |
| *** reed has quit IRC | 17:20 | |
| *** prad_ has joined #openstack-infra | 17:20 | |
| sdague | TheRonin: so it's in | 17:20 |
| TheRonin | awesome | 17:21 |
| TheRonin | can we land this real quick: | 17:21 |
| TheRonin | https://review.openstack.org/#/c/39206/ | 17:21 |
| TheRonin | ? | 17:21 |
| TheRonin | clarkb, fungi, jeblair ? | 17:21 |
| TheRonin | I think without it we're still going to run in to some potential weirdness with devstack and requirments because of setup_requires | 17:22 |
| TheRonin | and things are going to want to suck in d2to1 which we will not have pre-installed anywhere | 17:22 |
| sdague | TheRonin: you should make sure it passes the new unit tests :) | 17:22 |
| sdague | or write some of your own | 17:22 |
| TheRonin | sdague: yes! | 17:22 |
| sdague | I just rechecked it | 17:23 |
| TheRonin | lemme add a unittest... | 17:23 |
| *** vipul is now known as vipul-away | 17:24 | |
| *** cthulhup has joined #openstack-infra | 17:24 | |
| *** zul has quit IRC | 17:24 | |
| *** nati_ueno has joined #openstack-infra | 17:25 | |
| fungi | yeah, it's failing to merge, TheRonin | 17:25 |
| sdague | TheRonin: ok, I sent the devstack and grenade bits off to recheck | 17:26 |
| fungi | HenryG: i'm going to guess you're hitting https://bitbucket.org/pypa/setuptools/issue/52/ssl-errors-with-https-proxy | 17:26 |
| *** zul has joined #openstack-infra | 17:27 | |
| fungi | if nobody's pointed you in that direction yet (just skimmed scrollback) | 17:27 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Trigger periodic jobs with Zuul https://review.openstack.org/39951 | 17:31 |
| *** cybertron_ has joined #openstack-infra | 17:31 | |
| jeblair | i approved that ^ based on earlier feedback from clarkb and TheRonin | 17:31 |
| HenryG | fungi: thanks. she is up now | 17:31 |
| *** bnemec has quit IRC | 17:32 | |
| jeblair | i have confirmed the resize of graphite | 17:32 |
| *** cthulhup has quit IRC | 17:32 | |
| *** vipul-away is now known as vipul | 17:33 | |
| openstackgerrit | A change was merged to openstack-infra/config: Trigger periodic jobs with Zuul https://review.openstack.org/39951 | 17:33 |
| fungi | jeblair: yeah, was just leaving comments but i'll follow up with a fix for it instead | 17:33 |
| jeblair | :( | 17:33 |
| jeblair | fungi: let me respond to your comments | 17:34 |
| fungi | jeblair: oh, those weren't for the same time anyway, so i guess this is backward-compatible | 17:34 |
| jeblair | fungi: those jobs are going to to be per-jenkins-master | 17:35 |
| jeblair | fungi: so i don't want zuul to trigger them | 17:35 |
| jeblair | (that's in the commit msg) | 17:35 |
| fungi | ahh, right-o | 17:35 |
| fungi | and yes, now i see it in the commit message too, sorry! :/ | 17:35 |
| openstackgerrit | Monty Taylor proposed a change to openstack/requirements: Update ourselves to ourselves https://review.openstack.org/39963 | 17:38 |
| openstackgerrit | Monty Taylor proposed a change to openstack/requirements: Update update.py to also write a stock setup.py https://review.openstack.org/39206 | 17:38 |
| clarkb | jeblair: patchset2 lgmt | 17:38 |
| TheRonin | ok - there's the setup.py change update with a test | 17:38 |
| clarkb | TheRonin: the assert in that test seems pretty weak | 17:41 |
| clarkb | TheRonin: could you do a multiline assert like we do in JJB? | 17:41 |
| clarkb | it gives you nice diff output too | 17:41 |
| * TheRonin goes to look | 17:41 | |
| marun | so once this setuptools upgrade is working, I can haz wheel? | 17:43 |
| marun | binary python packages, how I've missed you! | 17:43 |
| TheRonin | clarkb: not without some further refactoring | 17:45 |
| TheRonin | clarkb: because I don't have a good wy to import update.py to pull the exptected string out | 17:45 |
| TheRonin | and copying it would be ugly | 17:45 |
| TheRonin | clarkb: can we take that as a note for improvement? | 17:45 |
| clarkb | sure | 17:46 |
| clarkb | the change did fail tests btw | 17:46 |
| TheRonin | what? | 17:47 |
| clarkb | TheRonin: https://review.openstack.org/#/c/39206/3 is -1 verified | 17:47 |
| TheRonin | clarkb: that makes no sense!!! | 17:48 |
| fungi | TheRonin: i find it a little odd that a script which is Copyright 2012 OpenStack, LLC is generating files which are Copyright (c) 2013 Hewlett-Packard Development Company, L.P. | 17:48 |
| TheRonin | fungi: well, the code was copied in from things that already had that header on them | 17:48 |
| TheRonin | although, honestly, the file is so small, I'd also be ok with just skipping the header | 17:48 |
| TheRonin | except I think that'll cause hacking to complain | 17:48 |
| jeblair | TheRonin: then disable the check | 17:49 |
| fungi | i am on the fence about whether generated files should be copyrighted, but it's a gray area (especially since it's a static blob) | 17:49 |
| TheRonin | jeblair: in all of the projects? | 17:49 |
| clarkb | TheRonin: jeblair fungi the check is only that the license header exists iirc | 17:49 |
| clarkb | it does not enforce (C) lines | 17:49 |
| TheRonin | that is true | 17:49 |
| TheRonin | I could remove the (c) line | 17:49 |
| clarkb | so you can remove the (C) line or cp the (C) line to the top of the script doing the generation | 17:49 |
| TheRonin | I don't understand why there is a feeling that the copyright lines need to match | 17:50 |
| jeblair | TheRonin: i do not think they need to match | 17:50 |
| TheRonin | ok | 17:50 |
| fungi | i think it's okay as-is, just feels odd | 17:50 |
| fungi | and wanted to make sure there was some thought behind that choice | 17:51 |
| jeblair | TheRonin: i was being partly facetious, in as much as i have not actually reviewed the change. what i will say is that it sounds like we may be discussing a not-copyrightable piece of code. | 17:51 |
| TheRonin | k. although I think I do take a point from clarkb ... the file contains code that is copyright something else, so that should be added to the file's header | 17:51 |
| jeblair | TheRonin: and if the hacking check is forcing us to have a header on a not-copyrightable piece of code, then hacking is wrong. | 17:51 |
| jeblair | but as i said, that's just a general comment, i haven't looked at this change. | 17:51 |
| TheRonin | the hacking check checks that all of our python files have apache license headers | 17:51 |
| * fungi quickly goes and readds copyright and license lines to all the empty __init__.py files | 17:52 | |
| jeblair | TheRonin: empty ones too? | 17:52 |
| TheRonin | I do not know - I do not believe it tries to enforce on empty files | 17:52 |
| TheRonin | jog0: ? | 17:52 |
| jeblair | sadly, deciding whether something is copyrightable is not an automatable task. in reality it requires a judge, in practice, we can safely assume that a 2-line boilerplate file is not copyrightable. | 17:53 |
| jeblair | i'm looking now. this is 4 lines of boilerplate. all bets are off. :) | 17:54 |
| fungi | jeblair: oh, well this one is four very, very short lines of code and one line of all-caps commentary | 17:54 |
| *** markmcclain has joined #openstack-infra | 17:54 | |
| jeblair | fungi: that commentary may push it over the edge. it's transformative. | 17:54 |
| *** vijendar has joined #openstack-infra | 17:55 | |
| *** vijendar has joined #openstack-infra | 17:55 | |
| *** fbo is now known as fbo_away | 17:55 | |
| clarkb | what about proposal.slave.openstack.org? | 17:55 |
| fungi | anyway, i do feel like there is something nonoptimal about having a check which is forcing us to inject license and copyright details into very small generated files, but my bigger point (similar to clarkb's) is that it'soff to have a copyright 2012 script generating copyright 2013 content | 17:55 |
| clarkb | fungi: it does not enforce copyright... | 17:56 |
| jeblair | TheRonin: i feel that the apache header and copyright is harmless, because it doesn't mean anything anyway. if our tool really probits omitting that, then it's just being silly. i will not -1 the change | 17:56 |
| clarkb | granted the apache license does not make much sense outside the scope of copyright... | 17:56 |
| jeblair | clarkb: it's a copyright license. :) | 17:56 |
| clarkb | I think the reason it ended up in the tool was to avoid discussions like this though | 17:57 |
| jeblair | whoops | 17:57 |
| clarkb | particularly in reviews | 17:57 |
| clarkb | because apparently a lot of misinformation and bad stuff had been going into some of them. Now at least we are consistently bad | 17:57 |
| fungi | though looking at it another way, the copyright line for the blob pretty clearly refers to the blob, including its representation within the containing script, so really it's probably appropriate just not all claimed in the same place in the file | 17:58 |
| * fungi feels he has painted far too much of this bikeshed now | 17:58 | |
| clarkb | (things like reviewers decrementing patches because they did not attribute copyright to the foundation for example) | 17:58 |
| jeblair | clarkb: yeah, yeah, i was there for that. | 17:59 |
| jeblair | clarkb: my point stands, though, this is wrong, but harmless. | 17:59 |
| clarkb | agreed | 17:59 |
| fungi | also, IOError: [Errno 2] No such file or directory: 'tests/files/gr-base.txt' | 17:59 |
| TheRonin | right. I'm trying to figure that out right now | 18:00 |
| *** Ryan_Lane has joined #openstack-infra | 18:01 | |
| *** pabelanger has joined #openstack-infra | 18:02 | |
| mestery | Anyone using the latest devstack with Fedora? I consistently this this bug I just opened: https://bugs.launchpad.net/devstack/+bug/1207855 | 18:03 |
| uvirtbot | Launchpad bug 1207855 in devstack "On Fedora, devstack removes pip, rendering it unusable" [Undecided,New] | 18:03 |
| mestery | Seems as if it's removing pip using yum, and then it's game over. :( | 18:04 |
| ekarlso- | has mordred disappeared ? | 18:06 |
| harlowja | so are we going to allow up to 99 char lines now ??? :) | 18:06 |
| harlowja | http://bit.ly/138gcyE :) | 18:06 |
| openstackgerrit | Monty Taylor proposed a change to openstack/requirements: Add pep8 checks https://review.openstack.org/39967 | 18:07 |
| openstackgerrit | Monty Taylor proposed a change to openstack/requirements: Update ourselves to ourselves https://review.openstack.org/39963 | 18:07 |
| openstackgerrit | Monty Taylor proposed a change to openstack/requirements: Update update.py to also write a stock setup.py https://review.openstack.org/39206 | 18:07 |
| TheRonin | ok. that should solve the test problem | 18:07 |
| clarkb | ekarlso-: TheRonin is mordred | 18:07 |
| marun | mestery: devstack is in the middle of a mess | 18:07 |
| clarkb | harlowja: not now, we bump pep8 checking rules at the beginning of cycles | 18:07 |
| TheRonin | it turns out, ading the test increased the number of tests to greater than the nubmer of runners - so we got to the point where one runner ran two tests | 18:07 |
| TheRonin | and thus the lack of cleanup was exposed | 18:08 |
| marun | mestery: there is a proposed fix for fedora/rhel | 18:08 |
| marun | mestery:https://review.openstack.org/#/c/39862/ | 18:08 |
| marun | https://review.openstack.org/#/c/39862/ | 18:08 |
| harlowja | clarkb awesome, hope that it will happen someday, 80 lchar lines and me don't get along :-P | 18:08 |
| mestery | marun: Thanks, and I agree, it's awful right now. | 18:08 |
| mestery | marun: I'll check that out, thank you! | 18:08 |
| TheRonin | mestery, marun: yeah - we're working on it :) | 18:08 |
| *** sarob has joined #openstack-infra | 18:08 | |
| clarkb | I tended to not get along with 80 character columns but then I started using a lot of vsplits in vim | 18:09 |
| mestery | TheRonin: Thank you! | 18:09 |
| TheRonin | marun: wow - that's a stellar patch | 18:09 |
| sdague | TheRonin: hacking only cares if the apache license is there, not copyright | 18:10 |
| TheRonin | sdague: that is correct | 18:10 |
| *** dims has quit IRC | 18:10 | |
| TheRonin | clarkb, fungi: added the license line from the included snippet to the top of the including file - because I do believe that the whole file should indicate the total story within itself | 18:11 |
| *** sarob_ has joined #openstack-infra | 18:11 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Rename tx slave to proposal slave. https://review.openstack.org/39969 | 18:11 |
| clarkb | jeblair: TheRonin fungi ^ with that in I can spin up the new node. Assuming the name is fine with everyone | 18:12 |
| TheRonin | sdague, clarkb, fungi, jeblair: so, if you guys could blow through the three above, (https://review.openstack.org/39206 being the most important) it would be a kindness | 18:12 |
| dstufft | harlowja: that got reverted | 18:12 |
| dstufft | :V | 18:12 |
| dstufft | PEP8 is back at 79 | 18:13 |
| harlowja | durn, ha | 18:13 |
| harlowja | noooo | 18:13 |
| harlowja | lol | 18:13 |
| clarkb | hahahahaha | 18:13 |
| dstufft | But PEP8 is techincally for the standard library and external projects are allowed to do w/e the fuck they want | 18:13 |
| clarkb | dstufft: was that because of Guido's last minute comments? | 18:13 |
| dstufft | so if openstack wants 99 they can just do it | 18:13 |
| sdague | TheRonin: actually, can I get +2 on requirements ? :) | 18:13 |
| dstufft | Personally I'm 79 for life :) | 18:14 |
| dstufft | clarkb: yea I think so | 18:14 |
| TheRonin | sdague: uhm. yeah | 18:14 |
| jeblair | dstufft: technically anyone can do anything, but pep8 bills itself as a standard for how people should write python, and standards are important so that people can write consistent tooling for them. | 18:14 |
| dstufft | http://hg.python.org/peps/rev/bd8c95ad2054 | 18:14 |
| fungi | dstufft: all my xterms are 80 characters wide ;) | 18:14 |
| dstufft | jeblair: no it doesn't | 18:14 |
| harlowja | 79-lifer | 18:14 |
| harlowja | lol | 18:14 |
| TheRonin | sdague: done | 18:14 |
| dstufft | jeblair: first life on PEP8 "This document gives coding conventions for the Python code comprising the standard library in the main Python distribution" | 18:15 |
| dstufft | line* | 18:15 |
| jeblair | dstufft: 4th line: Many projects have their own coding style guidelines. In the event of any conflicts, such project-specific guides take precedence for that project. | 18:15 |
| jeblair | dstufft: that could have said "no other projects should use this" but it did not. | 18:15 |
| *** emagana has quit IRC | 18:15 | |
| *** sarob has quit IRC | 18:15 | |
| TheRonin | I agree with jeblair. it does leave the door open to people using these in other projects | 18:15 |
| TheRonin | also, regardless of author's intent in pep8, it has become the defacto community python style guide for all python code | 18:16 |
| TheRonin | which is a good case in point that you cannot control how someone will consume a thing that you write | 18:16 |
| jeblair | dstufft: at any rate, your point is taken that the primary audience is certainly the python stdlib itself, and that should be their continued concern. | 18:16 |
| jeblair | TheRonin: yeah; ideas are crazy that way. :) | 18:17 |
| dstufft | Why would it tell other projects *not* to use it? That's pointless to do. But it doesn't bill itself as how all people should write python code :) (ALthough I do Pep8 all my code, I'm jsut being pedantic) | 18:17 |
| dstufft | Mostly because some projects don't do PEP8 and people cite the PEP8 at them and tell them they are doing it wrong | 18:17 |
| openstackgerrit | Chuck Short proposed a change to openstack-dev/hacking: python3: Fix python3 tox installation https://review.openstack.org/39970 | 18:17 |
| clarkb | to be fair the rule about spaces vs tabs should be a hard rule for all python >_> /me hides | 18:18 |
| sdague | hmmm... TheRonin http://logs.openstack.org/06/39206/3/check/gate-requirements-python27/0b1b449/console.html | 18:18 |
| sdague | any idea why that races in the test | 18:18 |
| clarkb | sdague: https://review.openstack.org/#/c/39206/3..4/tests/test_update.py fixes it | 18:19 |
| clarkb | curious that TheRonin went from print with parens to without in that diff... | 18:19 |
| sdague | ok | 18:19 |
| TheRonin | sdague: yes | 18:19 |
| TheRonin | clarkb: I fixed the pep8 in the next patch | 18:19 |
| TheRonin | sdague: it's was lack of a cleanup for the cd | 18:20 |
| dstufft | clarkb: at least Python3 makes it a hard error to mix tabs and spaces in the same file (I believe) | 18:20 |
| TheRonin | I believe you are right | 18:20 |
| jeblair | launching jenkins01 jenkins02 devstack-launch01 devstack-launch02 | 18:20 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Rename tx slave to proposal slave. https://review.openstack.org/39969 | 18:21 |
| openstackgerrit | A change was merged to openstack/requirements: Update update.py to also write a stock setup.py https://review.openstack.org/39206 | 18:21 |
| clarkb | ^ it bothers me when languages require that the file name match some internal content | 18:21 |
| uvirtbot | clarkb: Error: "it" is not a valid command. | 18:21 |
| *** rnirmal has joined #openstack-infra | 18:21 | |
| TheRonin | w00t! | 18:21 |
| sdague | clarkb: there is some value in the "explicit vs. implicit" to do that | 18:22 |
| jeblair | TheRonin: what else do you need reviewed? | 18:22 |
| TheRonin | sdague: grenade doesn't like https://review.openstack.org/#/c/35705/ | 18:22 |
| sdague | TheRonin: is that because we are running on 2 node | 18:23 |
| sdague | sorry 2 core | 18:23 |
| TheRonin | jeblair: I tihnk we're good for now | 18:23 |
| clarkb | I just realized https://review.openstack.org/#/c/39862/ has a -1 with no content. Is it possible to force gerrit to make you write something? | 18:23 |
| *** thedodd has quit IRC | 18:23 | |
| TheRonin | sdague: yeah - so, before I added the test, we had exactly as many tests as workers | 18:23 |
| sdague | I guess I was running 8 core locally, so all the tests were on separate processes | 18:23 |
| TheRonin | which meant ath setup just happened to only run once per worker | 18:23 |
| sdague | TheRonin: ok, gotcha | 18:23 |
| sdague | yep, makes perfect sense | 18:23 |
| sdague | just wanted to make sure I fully grokked it | 18:23 |
| TheRonin | clarkb: probalby with 2.6 and prolog | 18:24 |
| sdague | so I don't do it wrong again in the future | 18:24 |
| jeblair | clarkb: would it help if it said "don't merge this" or "aoeu" ? :/ | 18:24 |
| sdague | TheRonin: so that's expected | 18:24 |
| TheRonin | sdague: yes | 18:24 |
| clarkb | jeblair: no... but maybe it would prompt reviewers to think about why content is required. I am sure I have given the occasional negative feedback without actual comments | 18:24 |
| sdague | sorry, the grenade fail, expected | 18:25 |
| TheRonin | oh - it is? | 18:25 |
| sdague | now I have to get grenade right | 18:25 |
| TheRonin | gotcha | 18:25 |
| fungi | clarkb: i personally think it's reasonable to ignore or possibly delete -1 votes with no rationale provided | 18:25 |
| sdague | https://review.openstack.org/#/c/39574/ apparently wasn't quite it | 18:25 |
| *** jog0 is now known as flashgordon | 18:25 | |
| openstackgerrit | Chuck Short proposed a change to openstack-infra/config: Add python3 gate for openstack-dev/hacking https://review.openstack.org/39972 | 18:26 |
| sdague | so it looks like pbr path fail http://logs.openstack.org/74/39574/2/check/gate-grenade-devstack-vm/cad09a5/console.html.gz | 18:26 |
| fungi | clarkb: though if i deleted someone's vote i would certainly encourage them to re-add it with an explanation | 18:26 |
| *** SergeyLukjanov has joined #openstack-infra | 18:26 | |
| *** vipul is now known as vipul-away | 18:28 | |
| clarkb | fungi: it just occured to me that the ipv6 check in launch node won't play nice with hp. maybe we can set that with an env var and set the env var in the files we source? | 18:29 |
| fungi | clarkb: good point! | 18:29 |
| fungi | clarkb: i think that is precisely the right solution | 18:30 |
| flashgordon | TheRonin: we dont look for a license if file is under 10 lines https://github.com/openstack-dev/hacking/blob/master/hacking/core.py#L181 | 18:30 |
| TheRonin | flashgordon: oh great! | 18:30 |
| *** _TheDodd_ has joined #openstack-infra | 18:30 | |
| jeblair | +1 | 18:30 |
| TheRonin | then we could actually remove the header from the generated setup.py | 18:30 |
| flashgordon | also we broke the license test into two tests: 1 if has license header at all. and 2 if the header is correct | 18:31 |
| flashgordon | as in no typos etc | 18:31 |
| clarkb | if I can get eyes on https://review.openstack.org/#/c/39969/ I can start spinning up that new slave | 18:33 |
| fungi | sdague: bit of a bikeshed on the install_infra addition to devstack a couple days ago, but technically neither pbr nor requirements are in openstack-infra? | 18:33 |
| sdague | dtroyer: you about? | 18:34 |
| sdague | fungi: which program are they tracked under? | 18:34 |
| fungi | sdague: hmmm, good question. i had assumed oslo but now don't remember where that thread ended up | 18:35 |
| dtroyer | sdague: yup | 18:35 |
| sdague | dtroyer: ok, I think the last magic key to the kingdom is in grenade | 18:35 |
| sdague | dtroyer: in this - https://review.openstack.org/#/c/39574/ | 18:35 |
| *** melwitt has joined #openstack-infra | 18:36 | |
| sdague | it seems that when we get to target we don't have the PBR url | 18:36 |
| sdague | http://logs.openstack.org/74/39574/2/check/gate-grenade-devstack-vm/cad09a5/ | 18:36 |
| sdague | or requirements | 18:36 |
| sdague | is that because we don't source target's stackrc? | 18:36 |
| sdague | and where should we pull that in? | 18:36 |
| *** gyee has quit IRC | 18:37 | |
| dtroyer | we do source the target stackrc, but it is in each upgrade script so they can stand alone | 18:37 |
| dtroyer | I think that is what is missing | 18:38 |
| dtroyer | in upgrade-keystone it;s at line 60 where that sort of thing lives | 18:38 |
| sdague | dtroyer: ok | 18:38 |
| sdague | cool, let me go run at that | 18:38 |
| dtroyer | that's the stuff that stack.sh does that we can't otherwise get to | 18:39 |
| openstackgerrit | Chuck Short proposed a change to openstack-dev/hacking: python3: Use six.moves for ConfigParser https://review.openstack.org/38092 | 18:43 |
| sdague | ok, lets see how it goes - https://review.openstack.org/39574 | 18:43 |
| *** _TheDodd_ has quit IRC | 18:43 | |
| sdague | TheRonin: so grenade has to go first here, and if it works, we can land the devstack bit | 18:43 |
| TheRonin | sdague: I'm excited | 18:44 |
| *** _TheDodd_ has joined #openstack-infra | 18:44 | |
| sdague | it would be a pretty rocking way to end the week | 18:44 |
| TheRonin | sdague: then we get to backport this stuff in to devstack stable/grizzly right? | 18:44 |
| sdague | yes | 18:44 |
| TheRonin | whee! | 18:44 |
| sdague | I think | 18:44 |
| sdague | well, we should, it won't be any more broken than it currently is if we don't | 18:45 |
| sdague | I've I remember how we changed all this :) | 18:45 |
| sdague | but, you know, let me celebrate the little victories here first | 18:45 |
| *** cybertron_ has quit IRC | 18:47 | |
| *** bnemec has joined #openstack-infra | 18:47 | |
| TheRonin | yah | 18:50 |
| TheRonin | totally | 18:50 |
| TheRonin | I'm so excited | 18:51 |
| *** emagana has joined #openstack-infra | 18:51 | |
| ekarlso- | TheRonin: Pecan + WSME or Pecan + JSONSchema ? | 18:51 |
| TheRonin | ekarlso-: pecan + wsme is what dhellmann has been preaching | 18:52 |
| clarkb | doesn't JSONSchema fit a different role? | 18:52 |
| TheRonin | dhellmann: ekarlso- is working on some things and we've been telling him that he should use pecan/wsme for it - and to bug you about anything that doesn't work | 18:52 |
| dhellmann | TheRonin: ack | 18:53 |
| TheRonin | dhellmann: where did the wsme->stackforge thing ever fall? | 18:53 |
| TheRonin | dhellmann: was it the hundreds of tox envs thing? | 18:54 |
| dhellmann | TheRonin: I ran out of time this week, but plan to get back on it after my vacation. | 18:54 |
| zul | fungi: i dont think i missed anything https://review.openstack.org/#/c/39972/ | 18:54 |
| TheRonin | dhellmann: ok. cool. let me know if I can be useful | 18:54 |
| TheRonin | dhellmann: also - vacation? I'm not sure that should be allowed | 18:54 |
| fungi | zul: i'm playing with your stack of hacking fixes now just to make sure | 18:54 |
| zul | fungi: cool | 18:54 |
| TheRonin | zul: !!! | 18:54 |
| zul | fungi: there is a whole of fixes that is needed for hacking i think still | 18:54 |
| TheRonin | zul: so, when are we going to get backports of setuptools 0.9.8 and pip 1.4 into cloud-archive? | 18:55 |
| fungi | zul: oh, so not just the three out there right now? | 18:55 |
| dhellmann | also, jeblair objected to a change we'll need for that, and I need to talk about it with him. I think the commit log message gave the wrong impression. | 18:55 |
| dhellmann | https://review.openstack.org/#/c/38218/ | 18:55 |
| clarkb | fungi: are we ready to take the plunge with https://review.openstack.org/#/c/39580/1 ? | 18:55 |
| zul | TheRonin: eh? | 18:55 |
| TheRonin | zul: new setuptools and new pip. in cloud-archive. will make all the bunnyrabbits happier | 18:55 |
| TheRonin | you like bunnies don't you? | 18:55 |
| fungi | clarkb: yeah i'm willing to fix whatever 39580 breaks (i played around with it and it seemed to work, but you never know what corner cases to look for i guess) | 18:56 |
| zul | fungi: yeah i kind of just started it and some people wanted to the python3 gates before accepting python3 patches | 18:56 |
| zul | TheRonin: bunnies are fine but why again? | 18:57 |
| dhellmann | TheRonin: You can let me know if you think I'm missing anything in https://wiki.openstack.org/wiki/WSMEStackForgeTransition#Importing_WSME_to_StackForge or https://wiki.openstack.org/wiki/PecanStackForgeTransition | 18:57 |
| clarkb | fungi: you tested it with older python as well? | 18:57 |
| clarkb | fungi: my biggest concern is breaking stuff that almost works today | 18:57 |
| clarkb | fungi: but, I think the change is safe | 18:57 |
| TheRonin | zul: because old setuptools installed via distro packages on machines causes absolute living hell when one wants to install new via pip | 18:57 |
| TheRonin | because of the upgrade hell | 18:57 |
| *** pcrews has joined #openstack-infra | 18:57 | |
| fungi | clarkb: tried it on a 26 and a 27 machine | 18:57 |
| TheRonin | but, dpkg, it turns out, is good at handling the upgrade | 18:57 |
| clarkb | fungi: perfect | 18:57 |
| TheRonin | zul: so if the distro actually updates, the breaking will go away | 18:57 |
| clarkb | TheRonin: can you review https://review.openstack.org/#/c/39580/1 ? | 18:58 |
| *** zaro0508 has quit IRC | 18:58 | |
| TheRonin | clarkb: yup | 18:58 |
| zul | TheRonin: lemme think about it | 18:58 |
| *** ^d is now known as ^demon|lunch | 18:58 | |
| clarkb | TheRonin: feel free to approve if it looks good | 18:58 |
| clarkb | sounds like fungi and I can babysit | 18:58 |
| zul | TheRonin: i dont want to go down the rabbithole per say ;) | 18:58 |
| TheRonin | zul: k. just saying - it's one of those things that will be easier for you | 18:59 |
| TheRonin | zul: because you don't have to figure out how to upgrade setuptools and pip using setuptools and pip without breaking setuptools and pip | 18:59 |
| TheRonin | :) | 18:59 |
| zul | TheRonin: yes that makes me uneasy | 18:59 |
| clarkb | TheRonin: new thought on the setuptools issue | 18:59 |
| dstufft | TheRonin: FWIW I've been digging into the Fedora vs Debian thing | 19:00 |
| clarkb | TheRonin: what if we snapshot some images where the only changes we have made to the image is fixing the problem | 19:00 |
| clarkb | TheRonin: and just boot those | 19:00 |
| TheRonin | dstufft: oh god. how's that going | 19:00 |
| dstufft | TheRonin: I'm gonna be writing a PEP | 19:00 |
| dstufft | to make dual directories the standard | 19:00 |
| TheRonin | nice | 19:00 |
| TheRonin | let me know when/where I can vote on that | 19:00 |
| dstufft | Mostly becaue I hate myself and love pain | 19:00 |
| TheRonin | clarkb: what? | 19:00 |
| TheRonin | oh | 19:00 |
| TheRonin | uhm - I mean, it means that our puppet modules cease being self-contained | 19:01 |
| jeblair | clarkb: -- | 19:01 |
| TheRonin | I'd rather get things into an apt repo | 19:01 |
| jeblair | clarkb: i thought we had a plan; is this solving a problem in that plan? | 19:01 |
| clarkb | jeblair: we do have a plan, I am throwing this out there because TheRonin is throwing ideas out there for working around the plan | 19:02 |
| TheRonin | I am? | 19:02 |
| mrodden1 | dstufft: what do you mean by "dual directories" ? | 19:02 |
| clarkb | TheRonin: yes putting packages in a special PPA that work around the problem is similar to using prebaked images from a puppet perspective | 19:02 |
| TheRonin | clarkb: nono - I didn't mean zul doing that to solve our world | 19:02 |
| jeblair | dhellmann: about to run out, but i understand slightly more now that i know the context; could you leave a note about that, and what the envs are expected to look like? | 19:02 |
| TheRonin | clarkb: no. I'm asking him to put backports into cloudarchive so that people in general don't get screwed | 19:02 |
| dhellmann | jeblair: definitely | 19:03 |
| dstufft | mrodden1: using pip and apt-get together on debian more or less works because apt-get installs to one directory, and pip installs to a different directory | 19:03 |
| *** luisg has joined #openstack-infra | 19:03 | |
| dstufft | mrodden1: vs systems like Fedora, where they both install to the same directory | 19:03 |
| dhellmann | jeblair: your points about the testr stuff are valid, though, since these projects don't use it | 19:03 |
| dstufft | which means they stomp all over each other | 19:03 |
| dhellmann | jeblair: so the best solution may be a new script that does less than the current one | 19:04 |
| mrodden1 | oh site-packages vs dist-packages | 19:04 |
| mrodden1 | Fedora doesn't do that... ? | 19:04 |
| mrodden1 | thats horrible | 19:04 |
| clarkb | TheRonin: if you are using cloud archive and installing via debs you don't need setuptools right? | 19:04 |
| jeblair | dhellmann: yeah, probably so. and sadly, ideally it should be called 'run-tox'. we should move the existing one to run-testr. but that can all wait if you want. :) | 19:05 |
| dstufft | mrodden1: for instance ``apt-get install python-pip && pip install --uphtade pip && apt-get remove python-pip`` works, but ``yum install python-pip && pip install --upgrade pip && yum erase python-pip`` looks like it works, but leaves random files laying in /usr/lib/.../site-packages that nobody owns | 19:05 |
| dhellmann | jeblair: I can stage the 2 commits, no problem | 19:05 |
| dstufft | mrodden1: Well sort of, in debian both use dist-packages, deb install to /usr/lib/../dist-packages, and pip installs to /usr/local/lib/../dist-packages | 19:05 |
| clarkb | dstufft: about the upgrading pip with pip, why does pip tromp over the system install? | 19:06 |
| dstufft | clarkb: because Fedora tells it too | 19:06 |
| clarkb | dstufft: if pip goes in /usr/local when installing itself all is well | 19:06 |
| clarkb | dstufft: no on debian | 19:06 |
| clarkb | its actually not 100% clean on debian either | 19:06 |
| dstufft | clarkb: it should isntall to usr/local? | 19:06 |
| *** harlowja_ has joined #openstack-infra | 19:07 | |
| clarkb | dstufft: I think the majority of it does but pip finds the existing install and tries removing some of it | 19:07 |
| clarkb | or something | 19:07 |
| clarkb | dstufft: it made our puppet unhappy at one point | 19:07 |
| dstufft | pip --version | 19:07 |
| dstufft | pip 1.4 from /usr/local/lib/python2.7/dist-packages (python 2.7) | 19:07 |
| dstufft | clarkb: oh it probably does remove it | 19:07 |
| * dhellmann thinks someone needs to teach gerrit markdown | 19:08 | |
| dstufft | because it doesn't have any concept of what is owned by the system and what isn't | 19:08 |
| dstufft | it queries the sys.path looking for pip to be installed, and removes it | 19:08 |
| clarkb | dstufft: that implies to me it would leave existing pip alone | 19:08 |
| clarkb | and you rely on your PATH to figure out which one to use | 19:08 |
| mrodden1 | oh yeah... guess it does go into /usr/local/lib/ | 19:09 |
| dstufft | clarkb: It doesn't look at PATH at all, it looks at sys.path and queries those directories for a egg-info or dist-info directory that says "I have pip installed in this directory" | 19:09 |
| clarkb | dstufft: I meant from a user's perspective | 19:09 |
| *** mgagne1 has joined #openstack-infra | 19:10 | |
| *** mgagne1 has quit IRC | 19:10 | |
| *** mgagne1 has joined #openstack-infra | 19:10 | |
| clarkb | dstufft: pip doesn't seem to do this extra special stuff when you install something else | 19:10 |
| openstackgerrit | Chuck Short proposed a change to openstack-infra/config: Add python3 gate for openstack-dev/hacking https://review.openstack.org/39972 | 19:10 |
| dstufft | clarkb: what extra special stuff? | 19:10 |
| clarkb | dstufft: removing system pip | 19:10 |
| dstufft | --upgrade always uninstalls the existing thing | 19:10 |
| clarkb | dstufft: even if it is installed in a different root? | 19:10 |
| dstufft | clarkb: yes, because it's on the sys.path | 19:10 |
| *** samalba_ has joined #openstack-infra | 19:11 | |
| *** nati_uen_ has joined #openstack-infra | 19:11 | |
| dstufft | sys.path == the database of what's isntalled | 19:12 |
| fungi | yeah, for me the freaky is when i have a deb of python-foo installed to meet some dependency of another deb, but then need a newer version of python-foo and grab it from pip, then realize it's broken or whatever and decide to pull it back out, but pip uninstall python-foo then blows away files from the deb | 19:12 |
| dstufft | basically | 19:12 |
| *** dolphm_ has left #openstack-infra | 19:12 | |
| dstufft | fungi: techincally pip install foo is what blew it away | 19:12 |
| fungi | ahh, point | 19:12 |
| dstufft | the main problem is pip removes it, but doesn't tell apt-get (or whatever) that it did | 19:13 |
| dstufft | so apt-get thinks it's still there | 19:13 |
| clarkb | interesting I thought pip was special cased for some reason, but probably only noticed it with pip because it is gets installed with apt and everything else gets installed with pip | 19:13 |
| fungi | at any rate, the workaround is to use equivs to provide python-foo from a dummy package and then do whatever i want for it with pip, basically the same as the rpm workaround proposed to devstack | 19:13 |
| clarkb | dstufft: yup | 19:13 |
| *** cody-somerville_ has joined #openstack-infra | 19:13 | |
| *** SergeyLukjanov has quit IRC | 19:14 | |
| dstufft | clarkb: I don't have a good solution for that yet, it's possible that pip can leave the theortical "distribution owned" directory alone and just shadow the install in the "pip owned" directory… but in that case /usr/bin/pip will point to the new pip anyways unless /usr/bin/pip excludes the pip owned directory | 19:15 |
| clarkb | dstufft: because /usr/bin/pip is an entrypoint console script? | 19:15 |
| dstufft | because only one thing will be importable at ``import pip`` | 19:15 |
| clarkb | yeah | 19:16 |
| dstufft | Part of my PEP might be to include a flag that explicitly only asks for the distribution owned directory | 19:16 |
| dstufft | so it might make sense for /usr/bin/pip to use that | 19:16 |
| sdague | dtroyer: ok, new grenade fail | 19:18 |
| dstufft | so it might be ``python`` -> sys.path has /usr/../site-packages and /usr/local/../site-packages, ``python --only-distro`` -> sys.path has /usr/..site-packages/, and then the python tools become smart enough to leave the distro owned /usr one alone | 19:18 |
| clarkb | dstufft: that makes sense to me | 19:19 |
| dstufft | (totally spit balling FWIW, no idea how well it will work) | 19:19 |
| clarkb | ya, but the generally idea makes sense from a don't break apt-get perspective | 19:19 |
| clarkb | wow *general | 19:20 |
| *** _TheDodd_ has quit IRC | 19:20 | |
| *** sarob_ has quit IRC | 19:20 | |
| *** nati_ueno has quit IRC | 19:20 | |
| *** luis_ has quit IRC | 19:20 | |
| *** cody-somerville has quit IRC | 19:20 | |
| *** mgagne has quit IRC | 19:20 | |
| *** harlowja has quit IRC | 19:20 | |
| *** samalba has quit IRC | 19:20 | |
| *** _TheDodd_ has joined #openstack-infra | 19:20 | |
| *** samalba_ is now known as samalba | 19:20 | |
| dstufft | yea it keeps pip and apt/get/yum/whatever from breaking each other, the big question is how will things work with two different versions installed to sys.path, one being shadowed by something earlier in sys.path | 19:20 |
| *** sarob has joined #openstack-infra | 19:21 | |
| dstufft | if all the import paths remain the same it should work just fine, it gets tricker if there are different import paths :[ | 19:21 |
| sdague | looks like new nova isn't picking up new oslo - http://logs.openstack.org/74/39574/3/check/gate-grenade-devstack-vm/c6eaf07/console.html | 19:22 |
| sdague | dtroyer: anything thoughts on that? | 19:23 |
| clarkb | I ninja approved https://review.openstack.org/#/c/37909/ (JJB pathignore plugin) for the same reason I ninja approved rvm-env yesterday. | 19:24 |
| clarkb | same thing with https://review.openstack.org/#/c/39264/ both changes were rebases with clean diffs and happy check jobs | 19:25 |
| *** sarob has quit IRC | 19:25 | |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: Pathignore plugin support added https://review.openstack.org/37909 | 19:25 |
| sdague | TheRonin: actually, why do we install cli tools before we process requirements - http://logs.openstack.org/74/39574/3/check/gate-grenade-devstack-vm/c6eaf07/console.html | 19:26 |
| *** mrodden1 is now known as mrodden | 19:26 | |
| sdague | TheRonin: 2013-08-02 18:54:59.662 is the timestamp | 19:26 |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: Add support for the Summary Report publisher https://review.openstack.org/39264 | 19:26 |
| *** vipul-away is now known as vipul | 19:30 | |
| *** psedlak has quit IRC | 19:30 | |
| * TheRonin lookie | 19:33 | |
| TheRonin | sdague: what do you mean by "before we process requirements" ? | 19:34 |
| sdague | so before nova setup.py devel installs things, it installs the clis | 19:34 |
| sdague | and we are blowing up trying to call nova-manage | 19:35 |
| mtreinish | sdague, clarkb: no more sqlalchemy logs in glance! https://review.openstack.org/#/c/37123/ | 19:35 |
| sdague | because of wrong oslo | 19:35 |
| clarkb | mtreinish: \o/ | 19:35 |
| clarkb | hmm where did reed go | 19:35 |
| sdague | unless I'm reading the logs wrong | 19:36 |
| clarkb | we should get reed to at least glance at before we approve it https://review.openstack.org/#/c/38761/ | 19:36 |
| openstackgerrit | Chuck Short proposed a change to openstack-dev/hacking: python3: Use six.moves for ConfigParser https://review.openstack.org/38092 | 19:37 |
| mestery | marun: Thanks for pointing me at this patch to fix devstack with Fedora (https://review.openstack.org/#/c/39862/). Works great for me! | 19:37 |
| marun | mestery: cool beans | 19:37 |
| mestery | marun: Yes, very happy. | 19:38 |
| marun | mestery: I wonder if the patch shouldn't just install a good version of setuptools, though... | 19:38 |
| TheRonin | sdague: right - we've always installed the clis before the servers | 19:38 |
| marun | mestery: i.e. from rpm | 19:38 |
| TheRonin | sdague: so that git cli would be present and cause server to not attempt to install it | 19:38 |
| mestery | marun: That may make more sense, yes. | 19:38 |
| sdague | TheRonin: so is there a thing we need to do here to get past it then? | 19:38 |
| TheRonin | sdague: but we do the install in two steps - we pip install -r requirements.txt | 19:39 |
| TheRonin | then the setup.py develop | 19:39 |
| TheRonin | so that we don't cause easy_install to do things instead of pip | 19:39 |
| sdague | so why isn't it picking up the right oslo? | 19:39 |
| TheRonin | how did a _different_ oslo get installed? | 19:39 |
| sdague | on base | 19:39 |
| sdague | we install old oslo on base | 19:39 |
| sdague | run grizzly | 19:39 |
| sdague | shut it down | 19:40 |
| sdague | new oslo, from git, installs correctly | 19:40 |
| sdague | I can see that | 19:40 |
| TheRonin | but old oslo is still around? | 19:40 |
| sdague | well.... I don't know | 19:40 |
| sdague | it must be, because it's complaining about a missing option | 19:40 |
| TheRonin | sdague: perhaps instead of python setup.py develop we should just be doing pip install -U -e . | 19:40 |
| *** ruhe has joined #openstack-infra | 19:41 | |
| TheRonin | and get rid of the 'install requirements.txt first' thing | 19:41 |
| sdague | I'm going to run locally and see if I can track it down | 19:41 |
| TheRonin | k | 19:41 |
| clarkb | http://lists.openstack.org/pipermail/openstack/2013-August/000264.html is the answer https://github.com/farcepest/MySQLdb1/blob/master/INSTALL#L249 ? | 19:43 |
| clarkb | the state of that project is actually quite confusing | 19:43 |
| TheRonin | sdague: I'm trying out a pip install -e patch | 19:44 |
| *** bnemec has quit IRC | 19:45 | |
| TheRonin | sdague: oh! grendae is using an old version setup_develop | 19:45 |
| *** bnemec has joined #openstack-infra | 19:45 | |
| sdague | TheRonin: we're running the unfubar though | 19:46 |
| TheRonin | that's not it | 19:46 |
| sdague | ok | 19:46 |
| TheRonin | grenade is still parsing the output of egg_info | 19:46 |
| dtroyer | The entire functions file needs to be copied | 19:46 |
| TheRonin | which we stopped doing in devstakc a while ago | 19:46 |
| sdague | oh..... | 19:46 |
| TheRonin | but ... | 19:46 |
| *** ^demon|lunch is now known as ^d | 19:47 | |
| TheRonin | https://review.openstack.org/39990 | 19:47 |
| TheRonin | try that on for size | 19:47 |
| TheRonin | that should always work | 19:47 |
| TheRonin | and should always do the right thing | 19:47 |
| sdague | $1 is a directory | 19:47 |
| TheRonin | yes | 19:47 |
| sdague | ok | 19:47 |
| TheRonin | pip install -e ../path/to/dir | 19:48 |
| TheRonin | is like cd ../path/to/dir; python setup.py develop | 19:48 |
| TheRonin | except, it's actually more like doing _way_ more things than that :) | 19:48 |
| TheRonin | dstufft: ^^ I'm right about the above, right? | 19:49 |
| TheRonin | dstufft: https://review.openstack.org/39990 ? | 19:49 |
| TheRonin | dtroyer: I agree though - perhaps a cp of the functions file or something ... | 19:49 |
| clarkb | doesn't -e simply determine which python to install under? | 19:49 |
| TheRonin | no | 19:49 |
| TheRonin | -e means "editable" | 19:49 |
| clarkb | oh I thought it was the env selection flag | 19:49 |
| clarkb | -E is the one I am confusing with -e | 19:49 |
| sdague | dtroyer: we need all the function file updated as well/ | 19:50 |
| sdague | ? | 19:50 |
| dtroyer | yes | 19:50 |
| sdague | dtroyer: that's not going to mess up stable? | 19:50 |
| dtroyer | although…it might be better to specifically import the target devstack functions file | 19:50 |
| sdague | yeh, that's what I was wondering | 19:51 |
| dtroyer | I don't think it affects base since we run stack.sh there | 19:51 |
| dtroyer | there are some functions that the higher-level scripts want to use but inside the upgrade scripts we should use target devstack functions | 19:52 |
| sdague | ok, well trying once again | 19:54 |
| sdague | https://review.openstack.org/39574 sits on TheRonin's changes | 19:54 |
| *** hashar has joined #openstack-infra | 19:55 | |
| TheRonin | fingers crossed | 19:55 |
| sdague | wait... I lost the actual updater.... | 19:57 |
| sdague | tooo many branches | 19:58 |
| sdague | ok, another attempt | 19:58 |
| *** belliott has joined #openstack-infra | 20:03 | |
| belliott | gerrit question. this review has a successful jenkins run, but no Verified flag. how do i fix it? https://review.openstack.org/#/c/38709/ | 20:04 |
| clarkb | belliott: you need to have someon approve the change, that will rerun the gate tests and if they pass merge the change | 20:05 |
| belliott | clarkb: great, ty | 20:05 |
| clarkb | fungi: you about? I am beginning to think we should just approve https://review.openstack.org/#/c/39580/ | 20:06 |
| clarkb | fungi: because I don't want it to go in so late that we don't catch any potential issues | 20:06 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: More launch improvements https://review.openstack.org/39992 | 20:07 |
| fungi | clarkb: go for it | 20:07 |
| fungi | clarkb: also there's your ping6 fix idea ^ (i had a documentation fix i needed to add for the launch script anyway) | 20:07 |
| clarkb | cool, I will review that one first to give TheRonin a little more time to review the py3k change | 20:08 |
| clarkb | TheRonin: you did say you would review it :) | 20:08 |
| * sdague watches jenkins console log to see how grenade is doing | 20:08 | |
| flashgordon | sdague: can you review https://review.openstack.org/#/q/status:open+project:openstack-dev/hacking+branch:master+topic:bug/1206189,n,z | 20:08 |
| flashgordon | once those merge I want to cut hacking 0.7 | 20:09 |
| fungi | clarkb: also, i have a missing word in my commit message on 39992... i'll fix it if it bothers you | 20:09 |
| *** belliott is now known as weimguy | 20:09 | |
| clarkb | fungi: "to enabled"? feel free to update if it bothers you, but I was able to understand | 20:10 |
| sdague | flashgordon: ok... one sec | 20:10 |
| fungi | clarkb: yup | 20:10 |
| *** weimguy is now known as bearhandssunkmyb | 20:11 | |
| flashgordon | sdague: thanks | 20:11 |
| fungi | the documentation fix was because that just bit me on another machine (where we probably shouldn't be installing the mysql puppet module anyway, but that's another day) | 20:11 |
| clarkb | fungi: which machine? | 20:11 |
| *** bearhandssunkmyb is now known as spawnofbelliott | 20:11 | |
| sdague | flashgordon: on this one https://review.openstack.org/#/c/39140/5/hacking/tests/test_import_exceptions.py | 20:12 |
| fungi | clarkb: mirror33.slave | 20:12 |
| sdague | are we missing the merge test case? | 20:12 |
| clarkb | fungi: ok, I am approving the testr thing | 20:12 |
| flashgordon | sdague: hmm, so right now its either custom or default | 20:13 |
| *** ruhe has quit IRC | 20:13 | |
| fungi | clarkb: cool, keeping an eye out for badnez | 20:13 |
| sdague | flashgordon: seems like it should be default + custom | 20:13 |
| sdague | no? | 20:13 |
| flashgordon | sdague: yeah | 20:13 |
| flashgordon | your right | 20:13 |
| flashgordon | although merging makes things a little less obvios for the end user | 20:14 |
| flashgordon | so I can see it either way | 20:14 |
| flashgordon | the idea of explicit + implicit can be confusing | 20:15 |
| sdague | ok, I'm going to -1 it with that feedback | 20:15 |
| openstackgerrit | David Caro proposed a change to openstack-infra/jenkins-job-builder: Not sending description or disabled by default https://review.openstack.org/39995 | 20:15 |
| flashgordon | so I guess I am on the fence | 20:15 |
| sdague | flashgordon: well everyone needs to ignore those modules | 20:15 |
| *** weshay has quit IRC | 20:15 | |
| openstackgerrit | A change was merged to openstack-dev/hacking: Extract configs-related code to the configs helper https://review.openstack.org/39143 | 20:15 |
| flashgordon | sdague: right but Ithink it may be better to be explicit when possible | 20:16 |
| flashgordon | although I cannot see a case where someone would want to not ignore those two | 20:16 |
| sdague | yeh, I think because it's in requirements hacking should own it | 20:17 |
| openstackgerrit | David Caro proposed a change to openstack-infra/jenkins-job-builder: Added Robot Framework reposts publisher https://review.openstack.org/39939 | 20:17 |
| openstackgerrit | A change was merged to openstack-infra/config: Pass testr and subunit2html.py a PYTHON envvar. https://review.openstack.org/39580 | 20:17 |
| sdague | anyway, I could be argued away from that pov | 20:17 |
| sdague | but that's my first go | 20:17 |
| *** bnemec has quit IRC | 20:17 | |
| sdague | dtroyer: ok.... so I updated functions | 20:17 |
| sdague | now, the fun begins | 20:17 |
| sdague | because functions needs REQUIREMENTS_DIR | 20:18 |
| *** bnemec has joined #openstack-infra | 20:18 | |
| sdague | how do I unwind this... | 20:18 |
| dtroyer | that's in target stackrc right? or has that not landed yet? | 20:19 |
| flashgordon | sdague: there is a case where someone would not want ot ignore thsoe two | 20:19 |
| flashgordon | if they just use teh #noqa on the offending lines | 20:19 |
| sdague | it's in target stackrc | 20:19 |
| flashgordon | sdague: but we can cross that line when we get there | 20:20 |
| sdague | flashgordon: sure | 20:20 |
| sdague | dtroyer: we load functions really early in grenade though | 20:20 |
| dtroyer | that shouldn't be an issue, it isn't needed until runtime | 20:21 |
| *** jeffa has left #openstack-infra | 20:21 | |
| sdague | but it's evaled right away | 20:22 |
| flashgordon | fungi: can we add the hacking py33 test? | 20:22 |
| fungi | flashgordon: yes, i already +2'd it | 20:22 |
| fungi | if nobody else wants to review, i can go ahead and approve | 20:22 |
| *** hashar has left #openstack-infra | 20:23 | |
| flashgordon | fungi: can you share a link | 20:23 |
| sdague | dtroyer: https://review.openstack.org/#/c/39574/6/functions L1142 | 20:23 |
| sdague | that's the current issue | 20:23 |
| fungi | hacking py3k job addition https://review.openstack.org/39972 | 20:23 |
| fungi | going once, twice... | 20:23 |
| fungi | i also held off waiting for jenkins to +1 it after my vote | 20:24 |
| fungi | but looks like it was happy as well | 20:24 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Add sixth elasticsearch node. https://review.openstack.org/39997 | 20:24 |
| flashgordon | fungi: LGTM let the py33 begin | 20:24 |
| clarkb | merging ^^ and kicking the elasticsearch6 node tomorrow will add it to the cluster | 20:24 |
| fungi | bam. approved flashgordon | 20:25 |
| clarkb | (I plan on spinning up the new node this afternoon and will merge 39997 tomorrow when I am ready to add it to the cluster) | 20:25 |
| clarkb | change 40k is coming up | 20:25 |
| clarkb | I should've waited on 39997 >_> | 20:25 |
| fungi | flashgordon: as i mentioned to zul, once you land your remaining py3k fixes to hacking, you'll want to follow up with a change to take out the voting:false there | 20:25 |
| flashgordon | fungi: right | 20:26 |
| openstackgerrit | A change was merged to openstack-infra/config: Add python3 gate for openstack-dev/hacking https://review.openstack.org/39972 | 20:27 |
| fungi | flashgordon: in about 30 minutes you should be able to recheck a hacking change and see a non-voting failure for gate-hacking-python33 | 20:27 |
| flashgordon | fungi: awesome | 20:28 |
| *** boris-42 has joined #openstack-infra | 20:30 | |
| clarkb | jeblair: https://review.openstack.org/#/c/39969/ | 20:30 |
| clarkb | I feel like jeblair must have shut out the outside world to spin up his preciouses | 20:30 |
| jeblair | clarkb: approved | 20:31 |
| jeblair | er i mean +2d | 20:31 |
| jeblair | clarkb: i'll let you aprv it. | 20:31 |
| jeblair | i am going to be afk for a bit now, though. | 20:31 |
| *** bnemec has quit IRC | 20:32 | |
| clarkb | I have approved it, will spin up new node once that goes in | 20:32 |
| *** bnemec has joined #openstack-infra | 20:33 | |
| sdague | man, I've got a hard stop in 30 minutes and the magical ponies aren't quite there yet | 20:33 |
| openstackgerrit | A change was merged to openstack-infra/config: Rename tx slave to proposal slave. https://review.openstack.org/39969 | 20:34 |
| dtroyer | sdague: I think we goofed with REQUIREMENTS_DIR…it belongs in stackrc since _everything_ needs it | 20:35 |
| sdague | dtroyer: ok | 20:36 |
| dtroyer | it'll break if someone redefines DEST but I'll live with that for now | 20:36 |
| dtroyer | oh wait…grenade does that | 20:36 |
| sdague | so can I just add it in grenaderc? | 20:37 |
| sdague | sorry, my brain is kind of fried on a friday | 20:37 |
| dtroyer | i was looking at that, I think that's a better move | 20:37 |
| sdague | grenaderc still sources late | 20:37 |
| dtroyer | doesn't matter, as long as it is before setup_develop() is called | 20:38 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Add Python 3.3 PyPI mirror jobs https://review.openstack.org/39999 | 20:39 |
| fungi | ooh, SO close | 20:39 |
| fungi | quick somebody grab review (warhammer) 40k | 20:40 |
| sdague | ok | 20:40 |
| sdague | dtroyer: https://review.openstack.org/39574 - like that | 20:41 |
| clarkb | fungi: do it | 20:42 |
| dtroyer | close…use TARGET_RELEASE_DIR rather than DEST | 20:43 |
| openstackgerrit | Monty Taylor proposed a change to openstack/requirements: Remove unneeded tests dir reference https://review.openstack.org/40002 | 20:45 |
| TheRonin | dammit | 20:45 |
| TheRonin | I missed it | 20:45 |
| *** datsun180b has joined #openstack-infra | 20:46 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Branch-specific PyPI mirrors https://review.openstack.org/40003 | 20:46 |
| TheRonin | dstufft: 20:45:00 juice | it appears that devstack is using apt-get install python-netaddr which puts the package in /usr/lib/python and then later uses pip install | 20:46 |
| TheRonin | | netaddr >= 0.7.6 which puts the package in /usr/LOCAL/lib/python | 20:46 |
| TheRonin | 20:45:09 juice | when nova boots up it sees /usr/lib/python first and then fails because it cannot find the more recent version in /usr/LOCAL/lib/python | 20:46 |
| clarkb | 40k is a draft too :( | 20:47 |
| TheRonin | dstufft: we're obviously working on this in the general area | 20:47 |
| clarkb | why why would you do that to us :) | 20:47 |
| fungi | "Install os-apply-config in a virtualenv" ...the pen and paper rpg geek in me is not amused | 20:47 |
| dstufft | wat | 20:47 |
| TheRonin | dstufft: but the description I just paste-bombed... | 20:47 |
| TheRonin | dstufft: does that make any sense to you? | 20:47 |
| clarkb | oh not a draft, just stupid firefox | 20:47 |
| dstufft | TheRonin: it should see /usr/local/lib first | 20:48 |
| dstufft | at least on ubuntu that's higher in the sys.path | 20:48 |
| dstufft | And pip install should (currently) uninstall the one in /usr/lib/python/dist-packages because reasons | 20:48 |
| TheRonin | SlickNik: juice: can you guys confirm that you've got an ubuntu machine with both /usr/lib/python netaddr from apt and also a /usr/local/lib/python netaddr from pip? | 20:50 |
| juice | yes | 20:50 |
| SlickNik | yes TheRonin that's exactly it | 20:50 |
| juice | but the machine was clean of python-netaddr until the script was run | 20:50 |
| juice | the script = devstack.sh | 20:50 |
| TheRonin | so this pure precise + devstack ? | 20:50 |
| TheRonin | juice: can you check what version of pip is on the box? | 20:50 |
| juice | 1.0 | 20:51 |
| juice | sorry 1.5 | 20:51 |
| TheRonin | 1.5? | 20:51 |
| TheRonin | or 1.4? | 20:51 |
| juice | vipul ran pure devstack on a clean box and has 1.4 | 20:53 |
| juice | ignore my previous answers | 20:53 |
| TheRonin | ok. cool | 20:53 |
| dstufft | link to the script? | 20:53 |
| TheRonin | dstufft: it's devstack ... | 20:53 |
| TheRonin | https://github.com/openstack-dev/devstack/blob/master/stack.sh | 20:54 |
| dstufft | TheRonin: openstack has like 4 different repos ;P I don't know where all the stuff is tored ;P | 20:54 |
| TheRonin | dstufft: haha | 20:54 |
| dstufft | s/repos/accounts/ | 20:54 |
| TheRonin | dstufft: I'm gwanna see if'n I can get you a smaller script... | 20:55 |
| juice | vipul found that there are file in each of the projects that contain a list of apt-get python packages | 20:55 |
| fungi | clarkb: i think my run-tox change needs a revert... do you agree? https://jenkins.openstack.org/job/gate-cinder-python27/5524/console | 20:55 |
| juice | we also verified in the output of devstack/stacks.sh the installation of python-netaddr vi apt-get | 20:56 |
| fungi | clarkb: somehow i missed that it seems we're not getting subunit into the virtualenv on py27 but seem to do on py26? | 20:56 |
| dtroyer | three projects have netaddr in their prereq files: horizon, neutron and nova | 20:56 |
| juice | apt-get's latest version is 0.7.5 of netaddr just one bug fix version away from satisfying nova's requirements.txt :) | 20:56 |
| dtroyer | tat's what does the package install | 20:56 |
| clarkb | fungi: I don't follow that was the py27 test | 20:57 |
| clarkb | fungi: I think we should remove that list count check at the end of the testr post tox section | 20:57 |
| clarkb | fungi: instead of doing a full revert | 20:57 |
| fungi | clarkb: doing now | 20:57 |
| *** changbl has quit IRC | 20:57 | |
| *** thomasm has quit IRC | 20:58 | |
| dtroyer | juice: try this: remove python-netaddr with dpkg and remove it from files/apts/* (there are 4 occurrances) and try again | 20:58 |
| dtroyer | that should let it only install with pip | 20:59 |
| dstufft | would something apt-get install after the pip install? | 20:59 |
| dtroyer | not that I know of; the only place stack.sh does that is near the beginning based on what is in file/apts/* | 20:59 |
| juice | dstufft: I don't think apt-get cares about what is installed by pip | 20:59 |
| juice | it looks like they are using different repos | 21:00 |
| clarkb | spinning up proposal.slave.openstack.org now | 21:00 |
| dstufft | juice: yea that was my point ;) If something did an apt-get instlal <after> the pip install occured then i'd expect both to exist | 21:00 |
| juice | repos == directories | 21:00 |
| dstufft | but pip should uninstall the apt-get installed one first | 21:00 |
| juice | dstufft: this seems to be the case | 21:00 |
| dstufft | because the two systems fundamentally don't know about each other, but pip understands sys.path so it looks at sys.path for things to uninstall | 21:01 |
| juice | dstufft: we tried a pip uninstall of netaddr and it errors out because while it holds onto the latest version, it doesn't seem to be able to uninstall the older one installed by apt | 21:01 |
| dstufft | apt-get doesn't do that (obviously). | 21:01 |
| TheRonin | dstufft: /usr/lib/python2.7/dist-packages/netaddr | 21:02 |
| juice | so to dtroyers suggestion you need to use dpkg or apt-get remove to clear the error | 21:02 |
| TheRonin | still exists | 21:02 |
| TheRonin | dstufft: after I pip install -U netaddr | 21:02 |
| clarkb | TheRonin: fungi: tx.slave is a 2GB node. Should I stick to that size in rs nova? | 21:02 |
| TheRonin | clarkb: yah | 21:02 |
| dstufft | TheRonin: what's inside of it? | 21:02 |
| dstufft | is it the entire netaddr | 21:02 |
| dstufft | or only a few files? | 21:02 |
| TheRonin | whole thing | 21:02 |
| juice | TheRonin: what does pip freeze show as the version now | 21:02 |
| fungi | clarkb: i expect so. our mirror slaves are 2g too | 21:03 |
| juice | 0.7.5 (apt) or 0.7.10 (pip) | 21:03 |
| dstufft | TheRonin: what steps to repro, apt-get install python-netaddr && pip install netaddr ? | 21:03 |
| TheRonin | netaddr==0.7.10 | 21:03 |
| TheRonin | dstufft: yes | 21:03 |
| TheRonin | dstufft: so - that's ? #1 | 21:03 |
| dstufft | any particular ubuntu version? | 21:03 |
| juice | so now nova will work | 21:03 |
| TheRonin | dstufft: question 2 is why would pkg_resources entrypoint loading find the/usr/lib/ version? | 21:03 |
| TheRonin | dstufft: precise | 21:03 |
| TheRonin | dstufft: also - we pip install -U pip first to get pip 1.4 | 21:03 |
| TheRonin | but I do not know if that matters or not | 21:04 |
| TheRonin | juice: what did you do to make it work? | 21:04 |
| TheRonin | dtroyer: why are we installing some of the python things from apt? | 21:04 |
| juice | so after running the current devstack and waiting for the nova failure, you can do an apt-get remove python-netaddr | 21:04 |
| juice | this at least gets you to the next package with same problem | 21:05 |
| juice | which is com2 | 21:05 |
| dtroyer | we've been back and forth on this… the argument for using packages is that is likely to more closely match what is going to be deployed | 21:05 |
| juice | or something to that effect | 21:05 |
| sdague | dtroyer: https://jenkins.openstack.org/job/gate-grenade-devstack-vm/24104/console - so we're missing xslt-config | 21:05 |
| sdague | I've got to call it a week, if anyone wants to run with it, feel free | 21:05 |
| TheRonin | dtroyer: but we install a crap-ton of packages from pip - so I'm not sure it is any closer to a real deployment | 21:06 |
| TheRonin | installing some from one and some from the other seems to be the source of endless problems | 21:06 |
| dstufft | ^^ | 21:06 |
| dtroyer | TheRonin: I know, like I said this has been a see-saw | 21:06 |
| uvirtbot | dstufft: Error: "^" is not a valid command. | 21:06 |
| juice | I am relatively new to this but I would favor pip over apt | 21:06 |
| TheRonin | dtroyer: :) | 21:06 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Stop comparing tests counts https://review.openstack.org/40006 | 21:06 |
| fungi | clarkb: ^ | 21:06 |
| juice | apt often seem terribly out of date | 21:06 |
| TheRonin | dtroyer: I think there's so many of us who have backgrouds in distros and want to focus on the packages... | 21:06 |
| juice | what is the benefit of using apt for python packages? | 21:07 |
| dstufft | Installing random python stuff is far more consistent via pip across various distros; I'm of the opinion that it's the distros job to work out integrationg it into the system | 21:07 |
| TheRonin | but the reality is that we're tracking a global set of requiremnts now based on pip versions but teting on precise | 21:07 |
| dtroyer | stablility and not breaking other things on the system that use them | 21:07 |
| dstufft | that's basically their value proposition | 21:07 |
| dstufft | we integrate shit into the system for you | 21:07 |
| *** toddmorey1 has joined #openstack-infra | 21:07 | |
| *** esp has joined #openstack-infra | 21:08 | |
| clarkb | fungi: the set +e can be removed too | 21:08 |
| TheRonin | right - I think that ubuntu will likely take whatever versions of python libraries we wind up with, make sure they are in the next release of ubuntu along with the next version of openstack ... but they're never going to have the packages for the libraries we need on the old veversoin of the distro we're doing current dev on | 21:08 |
| *** UtahDave has quit IRC | 21:08 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Stop comparing tests counts https://review.openstack.org/40006 | 21:08 |
| fungi | clarkb: yeah, just realized that ^ | 21:08 |
| *** toddmorey has quit IRC | 21:08 | |
| sdague | TheRonin / dtroyer got to run, out of town guests coming in, and it's my b-day this weekend, so no computing for me. It's close, but will have to tackle on monday to get us the last mile. | 21:09 |
| flashgordon | fungi: py33 is working | 21:09 |
| sdague | unless someone else wants to run with it | 21:09 |
| dtroyer | this is mostly why other stuff just installs their complete runtime with the app…see vendor-supplied-java-runtime utilization | 21:09 |
| TheRonin | sdague: ok. is there anything I can poke at when you're out? | 21:09 |
| fungi | flashgordon: awesome! | 21:09 |
| flashgordon | sdague: happy birthday | 21:09 |
| dstufft | damn python has a bunch of shit installed by default on ubuntu | 21:09 |
| TheRonin | dstufft: yeah it does | 21:09 |
| sdague | flashgordon: thanks | 21:09 |
| clarkb | morganfainberg: it would be super duper if you could review 40006 | 21:09 |
| dtroyer | sdague: happy bitthday! time off well earned | 21:09 |
| clarkb | gah | 21:09 |
| clarkb | TheRonin: ^ | 21:09 |
| morganfainberg | clarkb: sure let me take a look | 21:10 |
| sdague | TheRonin: it's just sorting the grenade fails, that last patch is close, looks like we are actually just missing a dep somewhere | 21:10 |
| sdague | anyway, later folks, see you monday | 21:10 |
| TheRonin | sdague: have a great weekend! | 21:10 |
| clarkb | morganfainberg: thanks I meant to ping mordred and tab completion failed me | 21:10 |
| morganfainberg | clarkb: hehe sorry | 21:10 |
| morganfainberg | clarkb: i was like "weell… sure. but uh, not really my forte" | 21:11 |
| fungi | since mordred is TheRonin at the moment, it's likely to happen again ;) | 21:11 |
| morganfainberg | TheRonin: Silly name collisions | 21:11 |
| *** morganfainberg is now known as needscoffee | 21:11 | |
| needscoffee | fungi: :P solution! hehe | 21:11 |
| fungi | ha | 21:12 |
| needscoffee | it is friday, right? | 21:12 |
| fungi | in some parts of the world, for a little while still at least | 21:12 |
| needscoffee | hehe. yeah. | 21:12 |
| datsun180b | "It's Friday somewhere" would be a pretty catchy line for the Galactic Federation | 21:12 |
| datsun180b | reasons for space wayfaring: snarky t-shirts | 21:12 |
| needscoffee | datsun180b: i'm so stealing that when I make my own federation.... | 21:13 |
| fungi | it's friday happy hour somewhere, even moreso | 21:13 |
| *** needscoffee is now known as morganfainberg | 21:13 | |
| TheRonin | juice, dtroyer: https://review.openstack.org/40007 | 21:13 |
| datsun180b | python-cmd2 and one other package get caught in the blast too | 21:13 |
| dstufft | TheRonin: i see why | 21:14 |
| clarkb | fungi: I think we should approve https://review.openstack.org/#/c/40006/ soon if TheRonin doesn't review it | 21:14 |
| fungi | clarkb: i agree | 21:14 |
| dstufft | TheRonin: python-pip and python-netaddr are packaged differently | 21:14 |
| TheRonin | dstufft: oh yeah? | 21:14 |
| TheRonin | fungi, clarkb approved | 21:15 |
| fungi | TheRonin: thanks! was breaking unit tests for a lot of projects | 21:15 |
| dstufft | TheRonin: python-pip includes the python packaging specific file that tells pips what files were installed as part of that distribution, so pip knows what files to remove when it does the uninstall port of pip install --upgrade pip | 21:15 |
| dstufft | TheRonin: python-netaddr doesn't have that file, so pip sees it as an installed package with zero files installed, so it just removes the entry | 21:16 |
| clarkb | fungi: did building mirror33 take forever? | 21:16 |
| clarkb | I am still stuck on BUILD 0 with proposal.slave | 21:16 |
| openstackgerrit | A change was merged to openstack-infra/config: Stop comparing tests counts https://review.openstack.org/40006 | 21:16 |
| TheRonin | dstufft: so - specifically, we shoudl avoid python-netaddr like the plague | 21:16 |
| fungi | clarkb: not that i noticed, though i didn't time it | 21:16 |
| dstufft | look at /usr/lib/python2.7/dist-packages/pip-*.egg-info* vs vs /usr/lib/python2.7/dist-packages/netaddr-*.egg-info when installed from apt | 21:17 |
| fungi | clarkb: i'm going to fast-track that patch onto the unit test slaves | 21:17 |
| dstufft | TheRonin: yea | 21:17 |
| clarkb | fungi: go for it | 21:17 |
| fungi | since it missed the 2115 pulse | 21:17 |
| dstufft | TheRonin: the files are SOURCES.txt, top_level.txt, RECORD, (Stuff like that) inside of an egg-info or dist-info directory | 21:19 |
| dstufft | this probably explains why clarkb thought pip had special cased behavior too :) | 21:20 |
| dstufft | -> afk | 21:20 |
| clarkb | yay I am not crazy | 21:20 |
| clarkb | fungi: it is going now... I wonder if the queues just got backed up | 21:20 |
| fungi | clarkb: clogged tubes between the rack spaces | 21:20 |
| *** sandywalsh has quit IRC | 21:22 | |
| *** dhellmann is now known as dhellmann_ | 21:23 | |
| flashgordon | fungi: something is funny with the py26 and py27 hacking tests now https://review.openstack.org/#/c/38093/ | 21:25 |
| flashgordon | and https://review.openstack.org/#/c/39970/ | 21:25 |
| fungi | clarkb: also think i figured out the issue with the previous change. i had tested its effects on testr but not on subunit2html.py... and for some reason subunit2html.py using #!/usr/bin/env python failed to spot $PYTHON defined i the calling environment | 21:25 |
| fungi | flashgordon: yes, they're being fixed now | 21:25 |
| flashgordon | fungi: thanks | 21:25 |
| fungi | flashgordon: fix is being fast-tracked onto the slaves and should subside within another minute or two | 21:26 |
| clarkb | fungi: the testr stuff that was pulled out wasn't working properly bceause it is too naive | 21:26 |
| fungi | yeah, that too | 21:26 |
| fungi | okay, all centos6, precise and precisepy3k slaves have that fix updated onto them now | 21:31 |
| *** boris-42 has quit IRC | 21:32 | |
| fungi | i assume we're not doing voting testr-based jobs anywhere else at this point | 21:32 |
| clarkb | nope | 21:32 |
| *** rnirmal has quit IRC | 21:33 | |
| *** sandywalsh has joined #openstack-infra | 21:34 | |
| *** krtaylor has quit IRC | 21:34 | |
| fungi | i need to fire up the grill but will brb and keep an eye on new jobs to make sure the issues subside | 21:35 |
| *** nicedice has quit IRC | 21:35 | |
| *** nicedice has joined #openstack-infra | 21:36 | |
| TheRonin | wow | 21:36 |
| TheRonin | we still install python-m2crypto from apt | 21:36 |
| dstufft | You pretty much have too | 21:38 |
| dstufft | On ubuntu anyways | 21:38 |
| mrodden | so... every one of the jenkins slaves runs mongodb? | 21:38 |
| dstufft | M2Crypto isn't maintained anymore | 21:38 |
| dstufft | and | 21:38 |
| dstufft | it depends on SSLv2 existing or you get compile time errors | 21:38 |
| dstufft | Ubuntu removes SSLv2 from OpenSSL | 21:38 |
| dstufft | and patches M2Crypto to not need SSLv2 | 21:39 |
| dstufft | that patch doesn't exist on the unmaintained one on PyPI | 21:39 |
| dstufft | so pip install M2Crypto failes on ubuntu | 21:39 |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/storyboard: Edit README to include amended initial data instructions. https://review.openstack.org/40014 | 21:39 |
| dstufft | atleast afaik it's not maintained anymore | 21:40 |
| clarkb | mrodden: no, all of the precise and centos slaves do | 21:40 |
| dtroyer | only nova las it listed in devstack still, but not in requirements.txt | 21:40 |
| clarkb | mrodden: but the devstack slaves do not unless told by devstack to do so | 21:40 |
| dtroyer | I think I have some housekeeping to do... | 21:41 |
| mrodden | clarkb: oh its in the standard packages list | 21:41 |
| dstufft | TheRonin: https://bugzilla.osafoundation.org/show_bug.cgi?id=13024 | 21:42 |
| uvirtbot | bugzilla.osafoundation.org bug 13024 in Build/Install "Unable to use with OpenSSL 1.0+ due to missing SSL v2 support PATCH INCLUDED" [Blocker,New] | 21:42 |
| mrodden | clarkb: we aren't worried about having a mongodb instance running all time time on those slaves? | 21:42 |
| *** datsun180b has quit IRC | 21:43 | |
| mrodden | i think the debian packages start it up as soon as it installs | 21:43 |
| clarkb | mrodden: not really. Do you have a particular concern? | 21:43 |
| mrodden | idk just seems a bit insecure | 21:44 |
| mrodden | granted... they are only jenkins slaves | 21:44 |
| clarkb | mrodden: they are insecure :) | 21:44 |
| clarkb | mrodden: but you can only get to the servers there from localhost so we have some accountability through jenkins and gerrit | 21:44 |
| *** mriedem has quit IRC | 21:45 | |
| *** boris-42 has joined #openstack-infra | 21:45 | |
| mrodden | ok | 21:45 |
| dstufft | TheRonin: how extensive is the use of M2Crypto | 21:45 |
| dstufft | TheRonin: you might have a better time removing it for something that actually works in a venv | 21:46 |
| zul | dhellmann_: ping | 21:49 |
| clarkb | adding proposal.slave to jenkins now | 21:49 |
| clarkb | I will change the label on tx afterwards and next week we can delete tx | 21:49 |
| dtroyer | dstufft: I just grepped the nova sources and it's mentioned but never imported…so it appears to be unused | 21:50 |
| *** mrodden has quit IRC | 21:50 | |
| dstufft | dtroyer: oh goody | 21:50 |
| dstufft | dtroyer: that makes it easy to kill it with fire | 21:50 |
| *** ^d has quit IRC | 21:51 | |
| fungi | clarkb: i think the only project testing mongo is ceilo, and pretty sure it uses a temporary local instance rather than the daemon, so we might be able to just override it not to start | 21:52 |
| fungi | unless its use changed substantially from what i originally discussed with them | 21:53 |
| clarkb | fungi: is it any worse than mysql or postgresql? | 21:53 |
| fungi | clarkb: afaik, not really | 21:54 |
| clarkb | I think I am happy leaving it as is then | 21:54 |
| fungi | same | 21:54 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Replace tx node label with proposal in jobs. https://review.openstack.org/40018 | 21:57 |
| clarkb | and that can go in at any time | 21:57 |
| *** UtahDave has joined #openstack-infra | 22:01 | |
| *** rcleere has quit IRC | 22:01 | |
| fungi | lgtm | 22:03 |
| fungi | same story for https://review.openstack.org/39999 | 22:03 |
| nati_uen_ | Hi Infra team, it looks like 20% neutron gate fails. How do you think this number? | 22:04 |
| clarkb | nati_uen_: its getting better for sure | 22:04 |
| nati_uen_ | yeah, last week was 98% :X | 22:04 |
| nati_uen_ | so which percentage we can enable the gating? | 22:05 |
| nati_uen_ | may be I should check non-neutron gating | 22:05 |
| *** _TheDodd_ has quit IRC | 22:05 | |
| *** prad_ has quit IRC | 22:05 | |
| clarkb | nati_uen_: check is harder to depend on | 22:05 |
| clarkb | nati_uen_: because we don't expect them to pass | 22:05 |
| fungi | nati_uen_: yes, something close to the % for the equivalent non-neutron tempest jobs in the gate pipeline should be our target there | 22:06 |
| *** bnemec has quit IRC | 22:06 | |
| nati_uen_ | gotcha | 22:06 |
| nati_uen_ | http://logstash.openstack.org/#eyJzZWFyY2giOiJAdGFnczpjb25zb2xlLmh0bWwgIEFORCAoQG1lc3NhZ2U6XCJGaW5pc2hlZDogU1VDQ0VTU1wiICBPUiBAbWVzc2FnZTpcIkZpbmlzaGVkOiBGQUlMVVJFXCIpIEFORCBAZmllbGRzLmJ1aWxkX25hbWU6Z2F0ZS10ZW1wZXN0LWRldnN0YWNrLXZtLW5ldXRyb24iLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6IjQzMjAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7ImZyb20iOiIyMDEzLTA3LTMxVDIxOjUwOjAwKzAwOjAwIiwidG8iOiIyMDEzLTA4LTAxVDIyOjAyOjI3KzAwOjAwIiwidXN | 22:06 |
| nati_uen_ | lcl9pbnRlcnZhbCI6IjAifSwic3RhbXAiOjEzNzU0ODEyMjYzMTUsIm1vZGUiOiJ0cmVuZCIsImFuYWx5emVfZmllbGQiOiJAbWVzc2FnZSJ9 | 22:06 |
| nati_uen_ | I found analize page | 22:06 |
| nati_uen_ | which can show the success and failure rate using this query | 22:07 |
| nati_uen_ | BTW, I got "502 Proxy Error" in kibana many times. may be, we should increase timeout in the proxy | 22:07 |
| *** bnemec has joined #openstack-infra | 22:08 | |
| clarkb | nati_uen_: yes, that is a known problem but kibana is silly nad doesn't make it configurable by default | 22:08 |
| clarkb | nati_uen_: which is why we haven't changed it | 22:08 |
| nati_uen_ | ah I got it | 22:08 |
| clarkb | nati_uen_: also part of the problem is that query is using all of the available memory on one of the nodes which slows things down | 22:08 |
| nati_uen_ | ah @tags:console.html AND (@message:"Finished: SUCCESS" OR @message:"Finished: FAILURE") AND @fields.build_name:gate-tempest-devstack-vm-neutron This one ? | 22:09 |
| fungi | shut down ALL the trash compactors | 22:09 |
| clarkb | nati_uen_: ya, I think it has to do with the length of time you are search for | 22:09 |
| clarkb | nati_uen_: the longer the timeframe the more content it loads into memory | 22:09 |
| nati_uen_ | clarkb: gotcha | 22:10 |
| *** mrodden has joined #openstack-infra | 22:10 | |
| clarkb | nati_uen_: I have it set to evict things from cache after that happens so that the cluster doesn't die | 22:10 |
| *** bnemec has quit IRC | 22:10 | |
| clarkb | nati_uen_: in the past it would die once a week or so and it was from an expensive query that never had its cache flushed | 22:10 |
| nati_uen_ | yeah, we have fuge logs.. | 22:11 |
| clarkb | I am adding another node tomorrow, but I am happy that the cluster did die this time :) it means my changes are workign | 22:11 |
| *** bnemec has joined #openstack-infra | 22:11 | |
| nati_uen_ | clarkb: cool! | 22:11 |
| clarkb | nati_uen_: also, there is a better way to count these things now if you can figure out graphite | 22:12 |
| nati_uen_ | clarkb: What's graphite ? | 22:12 |
| clarkb | nati_uen_: zuul is keeping track of the passes and fails for each job in each pipeline | 22:12 |
| nati_uen_ | you guys adding new features as the speed of light! | 22:12 |
| clarkb | nati_uen_: its a number statistical graph system thing. http://graphite.openstack.org | 22:12 |
| clarkb | nati_uen_: it draws the graphs on the zuul status page | 22:13 |
| fungi | i can't figure out if https://launchpad.net/bugs/1207801 is supposed to be a joke | 22:13 |
| uvirtbot | Launchpad bug 1207801 in openstack-ci "gate-swift-python26 TestServer test_wait failed" [Undecided,New] | 22:13 |
| *** UtahDave has quit IRC | 22:13 | |
| nati_uen_ | clarkb: do you have manual for it? | 22:13 |
| clarkb | nati_uen_: I don't and I can never figure it out... | 22:14 |
| clarkb | fungi: :) | 22:14 |
| clarkb | fungi: I would just change it to swift and acll it good :) | 22:14 |
| nati_uen_ | clarkb: ha ha. I'll try to figure it out | 22:14 |
| clarkb | nati_uen_: when jeblair gets back you will want to ask him about graphite | 22:15 |
| clarkb | nati_uen_: but graphite is good at counting things and giving you graphs | 22:15 |
| clarkb | logstash is better for finding particular errors and the like | 22:15 |
| nati_uen_ | clarkb: gotcha | 22:15 |
| *** psedlak has joined #openstack-infra | 22:15 | |
| *** lcestari has quit IRC | 22:15 | |
| *** pcrews has quit IRC | 22:18 | |
| *** krtaylor has joined #openstack-infra | 22:20 | |
| *** psedlak has quit IRC | 22:20 | |
| *** cybertron_ has joined #openstack-infra | 22:20 | |
| clarkb | spinning up elasticsearch6 now | 22:22 |
| *** bnemec has quit IRC | 22:22 | |
| *** woodspa has quit IRC | 22:24 | |
| openstackgerrit | Chuck Short proposed a change to openstack-dev/hacking: python3: Fix python3 tox installation https://review.openstack.org/39970 | 22:24 |
| *** reed has joined #openstack-infra | 22:25 | |
| *** psedlak has joined #openstack-infra | 22:39 | |
| openstackgerrit | A change was merged to openstack-dev/hacking: python3: Fix python3 tox installation https://review.openstack.org/39970 | 22:42 |
| hub_cap | so has anyone seen issue w/ netaddr+12.04 ubuntu in devstack? | 22:43 |
| clarkb | elasticsearch6 is up, I have stopped es on it, and will approve the puppet change related to it tomorrow after which I can restart es | 22:43 |
| clarkb | hub_cap: yes there was a big discussion earlier today | 22:43 |
| hub_cap | i can pull down a fresh devstack on a fresh 12.04.2 vm and it wont run. no extra commands, just add ubuntu user to sudoers... | 22:43 |
| nati_uen_ | clarkb: Hi it looks like neutron gate failure is same level as non-neutron now. gate-tempest-devstack-vm-full 27.27% gate-tempest-devstack-vm-neutron 28% | 22:43 |
| hub_cap | clarkb: WOO YES | 22:44 |
| hub_cap | any review i can track etc? | 22:44 |
| hub_cap | clarkb: ^ ^ | 22:44 |
| nati_uen_ | clarkb: in 4 hours. (i got proxy error for 12 hour check) | 22:44 |
| clarkb | hub_cap: if you don't have it in scrollback there are logs at http://eavesdrop.openstack.org | 22:44 |
| clarkb | nati_uen_: cool good to know | 22:44 |
| hub_cap | oh i stayed in room. thx clarkb | 22:44 |
| nati_uen_ | Ah 12 hour check is also works. gate-tempest-devstack-vm-full:18.75% gate-tempest-devstack-vm-neutron:13.21% | 22:45 |
| clarkb | nati_uen_: that looks good. Was there a particular fix that went in that made it better? | 22:46 |
| nati_uen_ | so it looks like we can enable neutron gating | 22:46 |
| nati_uen_ | clarkb: yesterday, olso fixed. but this is for 98% failure one | 22:47 |
| clarkb | nati_uen_: we probably won't to get a broader opinion as the decision to make it non voting involved a few people | 22:47 |
| clarkb | nati_uen_: but I agree with you | 22:47 |
| hub_cap | lol clarkb it was a guy that works on trove (like me) | 22:47 |
| nati_uen_ | clarkb: yeah I agree | 22:47 |
| nati_uen_ | clarkb: I'll send mail for that mailing list | 22:48 |
| clarkb | nati_uen_: what was wrong with oslo? | 22:48 |
| nati_uen_ | clarkb: it changes exception type. and it brokes all neutron agent | 22:48 |
| *** vijendar has quit IRC | 22:48 | |
| nati_uen_ | clarkb: After the my first fix, I didn't compare failure late with non-neutron gating | 22:48 |
| nati_uen_ | clarkb: so I just thought it looks same gating fails with same error.. | 22:49 |
| clarkb | nati_uen_: so the first fix fixed one thing but at the same time another issues was introduced somewhere else? | 22:49 |
| nati_uen_ | clarkb: yeah,, we got two issue after the first issue | 22:49 |
| nati_uen_ | one was pbr issue | 22:50 |
| nati_uen_ | For the first issue, I may see the same issue, but failure rate looks like same level as non-neutron one | 22:50 |
| nati_uen_ | I'll keep investigation, but may be we can turn on the vorting.. | 22:51 |
| clarkb | I agree. I have been watching it over the last day and a half or so and it has gotten noticeably better | 22:51 |
| nati_uen_ | clarkb: ok let's me ask opnions | 22:51 |
| fungi | the graph jeblair linked earlier showed tempest neutron jobs near 0% failure in the gate after 0000 utc today | 22:52 |
| clarkb | oh ya jeblair made a graph | 22:53 |
| clarkb | nati_uen_: http://tinyurl.com/nto4nje | 22:53 |
| clarkb | nati_uen_: that should give you an idea of how to use graphite. basically you edit the url and it draws a different graph for you | 22:53 |
| nati_uen_ | cool! | 22:54 |
| *** esp has quit IRC | 22:55 | |
| nati_uen_ | I have created non-neutron one http://graphite.openstack.org/render/?width=586&height=308&_salt=1375457125.913&target=alias%28summarize%28stats_counts.zuul.pipeline.gate.job.gate-tempest-devstack-vm-full.FAILURE%2C%221h%22%29%2C%20%27Failure%27%29&target=alias%28summarize%28stats_counts.zuul.pipeline.gate.job.gate-tempest-devstack-vm-full.SUCCESS%2C%221h%22%29%2C%20%27Success%27%29&title=Non-Neutron%20Gate%20Results%20per%20Hour | 22:56 |
| clarkb | nati_uen_: notice the recent blip of failures is consistent across the two | 22:58 |
| *** vijendar has joined #openstack-infra | 22:58 | |
| clarkb | nati_uen_: I think it looks good to me. I would vote to make the test voting again | 22:58 |
| nati_uen_ | clarkb: yeah | 22:58 |
| nati_uen_ | clarkb: Thanks | 22:58 |
| nati_uen_ | https://github.com/openstack/oslo.config/commit/c85c8e6c4d5a921aa36a4774fe6bd8ab07d58fb3 | 22:58 |
| nati_uen_ | is may be 0000 utc | 22:58 |
| *** sarob has joined #openstack-infra | 22:59 | |
| *** zul has quit IRC | 22:59 | |
| clarkb | nati_uen_: https://review.openstack.org/#/c/39850/ it merged at 0500 UTC | 23:00 |
| clarkb | I think | 23:00 |
| nati_uen_ | hmm | 23:01 |
| clarkb | unless gerrit is showing me utc timestamps | 23:01 |
| nati_uen_ | That's wired.. Gating should fail without this fix | 23:01 |
| nati_uen_ | may be, some timezone configrations? | 23:02 |
| clarkb | nati_uen_: oh, it was 0500 august 1 | 23:02 |
| clarkb | nati_uen_: then started passing at 0000 august 2 | 23:02 |
| nati_uen_ | clarkb: ah | 23:02 |
| nati_uen_ | so another fix? | 23:02 |
| clarkb | so probably sdague's change to use oslo config master in devstack gate went in around that time | 23:02 |
| nati_uen_ | do you know reviews for it? | 23:03 |
| clarkb | nati_uen_: ya, sdague has been working to make sure we use tip of trunk across all of the projects in the devstack gate | 23:03 |
| clarkb | nati_uen_: I don't but I might be able to find them give me am inute | 23:03 |
| clarkb | nati_uen_: https://review.openstack.org/#/c/39465/2 but that merged before the oslo.config change so I am not sure if that was it | 23:04 |
| nati_uen_ | https://github.com/openstack-dev/devstack/commit/1b6b5318a05adbc049fd35ca62ed30852ea1026a ? | 23:04 |
| nati_uen_ | https://review.openstack.org/#/c/39450/ | 23:05 |
| clarkb | nati_uen_: yes that one and the one I linked they are both working towards the same thing | 23:05 |
| clarkb | but they merged well before the gate started passing | 23:05 |
| *** mgagne1 has quit IRC | 23:05 | |
| *** vijendar has quit IRC | 23:05 | |
| nati_uen_ | hm | 23:06 |
| clarkb | so I don't think that was what made the difference | 23:06 |
| nati_uen_ | clarkb: BTW, how do you checking when it merged? | 23:06 |
| clarkb | nati_uen_: on review.openstack.org look at the updated timestamp | 23:06 |
| clarkb | usually that timestamp is when it merged | 23:06 |
| clarkb | (or close enough) | 23:06 |
| nati_uen_ | Ah I din't know that :) | 23:07 |
| *** pcrews has joined #openstack-infra | 23:09 | |
| nati_uen_ | may be it is some time lag? | 23:09 |
| clarkb | nati_uen_: I have a hunch that maybe those cahnges didn't work as expected and there is a "fix" commit that went in more recently | 23:10 |
| nati_uen_ | yeah.. possible | 23:10 |
| nati_uen_ | But i can't see any of it on neutron and pbr and olso | 23:10 |
| *** sarob has quit IRC | 23:10 | |
| clarkb | nati_uen_: I think it will be in devstack or devstack-gate | 23:11 |
| *** sarob has joined #openstack-infra | 23:11 | |
| nati_uen_ | https://review.openstack.org/#/q/status:merged+project:openstack-infra/devstack-gate,n,z | 23:11 |
| nati_uen_ | https://review.openstack.org/#/q/status:merged+project:openstack-dev/devstack,n,z | 23:12 |
| nati_uen_ | hmm I can't see which one fixes.. | 23:12 |
| clarkb | yeah I don't see any either | 23:12 |
| nati_uen_ | https://review.openstack.org/#/q/status:merged+project:openstack/requirements,n,z | 23:12 |
| clarkb | maybe oslo did a release? | 23:13 |
| clarkb | and we aren't using the source installed version but a pip installed version instead? | 23:13 |
| nati_uen_ | I thinks Sean's fix is working in my local | 23:14 |
| nati_uen_ | so it looks like we are using source installed version | 23:14 |
| nati_uen_ | may be 3rd party lib update? | 23:14 |
| clarkb | could be | 23:14 |
| nati_uen_ | ah | 23:16 |
| nati_uen_ | may be the run was waiting in the queue | 23:16 |
| nati_uen_ | so it was running with old configrations | 23:16 |
| nati_uen_ | Isn't this possible to the cause of the issue? | 23:17 |
| *** changbl has joined #openstack-infra | 23:17 | |
| clarkb | nati_uen_: it shouldn't be because we stack things in the gate queue | 23:17 |
| nati_uen_ | ok | 23:17 |
| clarkb | and test in parallel optimisticly | 23:17 |
| nati_uen_ | I send the mail for the openstack-dev | 23:17 |
| nati_uen_ | http://graphite.openstack.org/render/?width=586&height=308&_salt=1375457125.913&target=alias%28summarize%28stats_counts.zuul.pipeline.gate.job.gate-tempest-devstack-vm-neutron.FAILURE%2C%221h%22%29%2C%20%27Failure%27%29&target=alias%28summarize%28stats_counts.zuul.pipeline.gate.job.gate-tempest-devstack-vm-neutron.SUCCESS%2C%221h%22%29%2C%20%27Success%27%29&title=Neutron%20Gate%20Results%20per%20Hour | 23:18 |
| nati_uen_ | is UTC? | 23:18 |
| clarkb | yes I think so | 23:18 |
| clarkb | unless, is it using the browser supplied tz? | 23:19 |
| nati_uen_ | gerrit shows me PDT | 23:19 |
| *** sarob has quit IRC | 23:19 | |
| flashgordon | morganfainberg: it works, I anyone seeing a netaddr issue? | 23:19 |
| clarkb | nati_uen_: graphite looks like PDT to me | 23:19 |
| morganfainberg | flashgordon: did you mean someone else? :P | 23:19 |
| clarkb | nati_uen_: so I think the oslo changes in devstack and devstack gate match up | 23:19 |
| flashgordon | morganfainberg: woops sorry two msgs gon munged | 23:20 |
| morganfainberg | hehe all good. | 23:20 |
| *** sarob_ has joined #openstack-infra | 23:20 | |
| morganfainberg | just don't want someone to miss an important message cause it was directed to the wrong person :) | 23:20 |
| flashgordon | anyone seeing issues with netaddr I get a 0.7.5 installed and nova needs >0.7.6 | 23:20 |
| nati_uen_ | clarkb: I'm grad to figure out it! :) | 23:20 |
| clarkb | nati_uen_: now the full test :) | 23:21 |
| nati_uen_ | clarkb: yeah. | 23:21 |
| jeblair | hi | 23:22 |
| clarkb | jeblair: hi there | 23:23 |
| flashgordon | looks like a bad env (apt installed an old version for me) | 23:26 |
| fungi | i suppose i never notice tz preference matching in apps except when it fails to show me the utc times i ask for | 23:31 |
| clarkb | jeblair: fungi: elasticsearch6 seems ready to go. I will do that tomorrow morning. shouldn't impact anything, it will just rebalance quicker with less index load | 23:33 |
| jeblair | cool | 23:33 |
| fungi | clarkb: great! | 23:33 |
| fungi | i'll probably be around, except when i go for groceries | 23:34 |
| clarkb | proposal.slave has been running jobs and they are succeeding | 23:41 |
| *** Ryan_Lane has quit IRC | 23:47 | |
| *** pentameter has quit IRC | 23:50 | |
| fungi | yay | 23:55 |
| *** pcrews has quit IRC | 23:57 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!