| clarkb | so I think if we get our images cleaned up we can have one worker for now | 00:00 |
|---|---|---|
| *** ccrouch has quit IRC | 00:00 | |
| greghaynes | jeblair: is there much benefit over just running more builders? | 00:00 |
| clarkb | more workers/threads will just be quicker turnaround | 00:00 |
| greghaynes | jeblair: the swift stuff could definitely threas | 00:00 |
| greghaynes | Thread, even | 00:00 |
| jeblair | clarkb, greghaynes: actually we could also probably use the subprocess module instead of threads for the uploads. | 00:00 |
| *** dims has quit IRC | 00:01 | |
| *** dims has joined #openstack-infra | 00:01 | |
| * greghaynes is also half afk at Dr | 00:02 | |
| jeblair | greghaynes: yeah, we could use more builders too, but since we've got two aspects -- building and uploading together, we may want to be able to tune to the right balance... | 00:02 |
| *** Sukhdev has quit IRC | 00:02 | |
| *** Sukhdev has joined #openstack-infra | 00:02 | |
| jeblair | anyone else want a crack at https://review.openstack.org/271572 or should i just aprv? | 00:02 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Added /var/www creation to mirrors https://review.openstack.org/271573 | 00:03 |
| krotscheck | jeblair: ^^ | 00:04 |
| *** Sukhdev has quit IRC | 00:04 | |
| fungi | jeblair: krotscheck: i'd like to put https://review.openstack.org/252678 (unified mirrors spec) up for council vote in the coming week if people feel it's generally in good enough shape (i assume so since it's heavily under implementation now?). any objection to putting it on the agenda for next week's meeting? i won't be around to chair the meeting, but pleia2 is guest chairing next week | 00:04 |
| *** Sukhdev has joined #openstack-infra | 00:04 | |
| * mordred afks | 00:04 | |
| jeblair | krotscheck: approved | 00:05 |
| *** Sukhdev has quit IRC | 00:06 | |
| *** Sukhdev_ has joined #openstack-infra | 00:06 | |
| jeblair | i'd love more reviews on mordred's https://review.openstack.org/271572 change but since it's fairly straightforward i'm going to approve it; it'll either work or not. | 00:06 |
| *** Thelo has quit IRC | 00:07 | |
| fungi | lgtm | 00:07 |
| *** dimtruck is now known as zz_dimtruck | 00:07 | |
| fungi | i agree. seems obvious in retrospect | 00:07 |
| *** Sukhdev_ has quit IRC | 00:08 | |
| *** Sukhdev has joined #openstack-infra | 00:08 | |
| *** Sukhdev_ has joined #openstack-infra | 00:10 | |
| *** Sukhdev has quit IRC | 00:10 | |
| *** jpr has quit IRC | 00:11 | |
| krotscheck | fungi: No objections. | 00:11 |
| krotscheck | jeblair: Looks like the bandersnatch module requires hg. | 00:11 |
| * krotscheck is on it | 00:11 | |
| jeblair | krotscheck: i think i fixed that one | 00:11 |
| openstackgerrit | Andre keedy proposed openstack-infra/project-config: Add new project(shovel) to openstack https://review.openstack.org/269411 | 00:11 |
| *** Sukhdev_ has quit IRC | 00:11 | |
| jeblair | krotscheck: but the ansible playbook bug has prevented it from getting to the host | 00:12 |
| krotscheck | jeblair: Gotcha | 00:12 |
| *** Sukhdev has joined #openstack-infra | 00:12 | |
| clarkb | woo I have successfully logged into a fedora-23 machine | 00:13 |
| clarkb | so thats all working now | 00:13 |
| *** Sukhdev has quit IRC | 00:13 | |
| jeblair | clarkb: yay! | 00:13 |
| krotscheck | clarkb: WOO | 00:14 |
| *** Sukhdev has joined #openstack-infra | 00:14 | |
| clarkb | is it time to yell PROST yet? | 00:14 |
| *** ybathia has joined #openstack-infra | 00:14 | |
| fungi | zaro: apologies, but i haven't gotten around to releasing gerritlib 0.5.0 yet and end of day on a friday before i'm about to disappear for most of the coming week seems like an irresponsible time for me to do that, so we may need another gerritlib-release (read: infra-core) member to push that if it needs doing before i get back | 00:14 |
| clarkb | I too am disappearing | 00:15 |
| clarkb | but I can give fungi a hard time in person about ^ >_> | 00:15 |
| jeblair | clarkb: yeah, you should totally rag on when you're playing beach volleyball or whatever | 00:16 |
| *** Sukhdev has quit IRC | 00:16 | |
| *** yamamoto has joined #openstack-infra | 00:17 | |
| *** yamamoto has quit IRC | 00:18 | |
| krotscheck | fungi, jeblair, clarkb: Typo fix -> https://review.openstack.org/#/c/271456/ | 00:19 |
| krotscheck | Beer? | 00:19 |
| krotscheck | Oooh someone said prost. | 00:19 |
| * krotscheck goes and gets a beer | 00:19 | |
| *** yamamoto has joined #openstack-infra | 00:19 | |
| Clint | i must succumb to peer pressure | 00:19 |
| clarkb | I only have one bottle of bad beer | 00:19 |
| clarkb | might need to make a grocery run first | 00:19 |
| Clint | the kids are drinking it all? | 00:20 |
| * krotscheck has some Deschutes. | 00:20 | |
| greghaynes | clarkb: maybe I will trade you beer for carseat installation | 00:20 |
| fungi | krotscheck: i feel like we're tracking that information in at least two places too many | 00:20 |
| fungi | but +2 | 00:20 |
| clarkb | greghaynes: I'm down | 00:20 |
| jeblair | fungi: yeah, nibalizer is going to work on yamlifying it | 00:20 |
| fungi | Clint: succumb to the *beer* pressure | 00:20 |
| krotscheck | fungi: Yeaaaaah true. | 00:20 |
| *** ybathia has quit IRC | 00:20 | |
| jeblair | then i think it gets easier | 00:20 |
| jeblair | krotscheck: +3 | 00:20 |
| krotscheck | fungi: I dunno, I kinda feel like if it's in our infra manifest, maybe it should be a trusted host? | 00:21 |
| krotscheck | fungi: i.e. I think that info is stored in 3 places too many | 00:21 |
| krotscheck | jeblair, fungi: Thanks | 00:22 |
| Clint | fungi: well played | 00:22 |
| greghaynes | fungi: wow | 00:22 |
| *** alkhodos_ has quit IRC | 00:23 | |
| jeblair | for anyone on the openstack-admins team getting the networking-sfc bugspam, i have deactivated us | 00:23 |
| nibalizer | hello | 00:23 |
| *** yamamoto has quit IRC | 00:23 | |
| jeblair | nibalizer: hello | 00:23 |
| fungi | jeblair: thanks! | 00:23 |
| jeblair | nibalizer: everyone else is going to get beer | 00:23 |
| nibalizer | jeblair: what am I yamling? | 00:23 |
| jeblair | nibalizer: the list of pypi mirrors | 00:24 |
| fungi | nibalizer: all the things | 00:24 |
| openstackgerrit | Merged openstack-infra/ansible-puppet: Don't try to make a link before the directory https://review.openstack.org/271572 | 00:24 |
| jeblair | that too | 00:24 |
| *** ashleigh_ has quit IRC | 00:24 | |
| openstackgerrit | Merged openstack-infra/ciwatch: Fix "verified" attribute assignment https://review.openstack.org/270688 | 00:24 |
| nibalizer | i think its hillarious that four of you posted the same link: https://git.openstack.org/cgit/openstack/ceilometer/tree/tox.ini?h=stable/kilo#n15 independently | 00:24 |
| fungi | hierafication | 00:24 |
| clarkb | hrm are other people getting all the networking-sfc bug emails? | 00:24 |
| * clarkb wonders why I am on that list | 00:24 | |
| anteaya | nibalizer: I question whether mordred's post was independent | 00:24 |
| jeblair | clarkb: i just deactivated us | 00:24 |
| fungi | clarkb: see scrollback | 00:24 |
| nibalizer | anteaya: it is the question | 00:24 |
| openstackgerrit | Merged openstack-infra/system-config: Added /var/www creation to mirrors https://review.openstack.org/271573 | 00:24 |
| clarkb | jeblair: woot thank you | 00:24 |
| jeblair | np | 00:24 |
| fungi | and yeah, it was rather a flood | 00:25 |
| clarkb | jeblair: was openstack admins in the bug supervisor group? | 00:25 |
| krotscheck | Ok, so now we wait for ansible/puppet to figure themselves out. | 00:25 |
| jeblair | clarkb: yep | 00:25 |
| * krotscheck beers harder | 00:25 | |
| jeblair | clarkb: we're the owner which is all we really need | 00:25 |
| openstackgerrit | Merged openstack-infra/system-config: Fixed typo in mirrors https://review.openstack.org/271456 | 00:26 |
| jeblair | clarkb: so we can sudo ourselves into the group if we need to do something | 00:26 |
| anteaya | like shut off emails apparently | 00:26 |
| fungi | hrm, my workaround for the ceilometer tarball job is failing the layout job | 00:26 |
| anteaya | :( | 00:26 |
| anteaya | I had such high hopes for it | 00:26 |
| fungi | d'oh! my bad | 00:27 |
| anteaya | nibalizer: hey you're a gerrit admin, feel like +2 +A'ing all these sandbox patches: https://review.openstack.org/#/q/topic:bug/1234567+status:open | 00:28 |
| anteaya | currently sandbox perms are not all we had hoped they would be | 00:29 |
| nibalizer | anteaya: i don't have +2 on the sandbox project | 00:29 |
| nibalizer | which is weird because i thought everyone did | 00:29 |
| anteaya | yeah that is the problem | 00:30 |
| anteaya | hence I'm asking for gerrit admin help | 00:30 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Temporarily pin pip<8 for ceilometer tarballs https://review.openstack.org/271567 | 00:30 |
| fungi | anteaya: jeblair: ^ i should have just made it a job not a job-template. a little too copy-paste | 00:30 |
| anteaya | sandbox is supposed to allow +2 to everyone, there is a bug in gerrit, khai has bug fixes up | 00:30 |
| anteaya | fungi: ah | 00:31 |
| anteaya | once you get copy/pasta'ing it is hard to stop | 00:32 |
| jeblair | fungi: and i should have spotted it :) | 00:32 |
| anteaya | I don't hold myself to such a high standard | 00:32 |
| *** Swami_ has quit IRC | 00:32 | |
| jeblair | fungi: left a comment | 00:32 |
| fungi | anteaya: nibalizer: yeah, i don't think anyone will be able to exercise those permissions on sandbox until we get the fixes applied and then probably do some manual cleanup of the imposter registered users group for all the dozens of repos which defined it (since it gets listed in all their groupfiles on gerrit's secret meta/config pseudobranch) | 00:32 |
| jeblair | fungi: i think if it's not a template, you may need to drop the print-template thing | 00:32 |
| anteaya | fungi: so even admin's don't have +2 | 00:33 |
| anteaya | sorry | 00:33 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Temporarily pin pip<8 for ceilometer tarballs https://review.openstack.org/271567 | 00:33 |
| fungi | jeblair: done. it's not really useful information for that job anyway | 00:33 |
| fungi | since it's not actually a template | 00:33 |
| *** zz_dimtruck is now known as dimtruck | 00:38 | |
| *** sdake_ has joined #openstack-infra | 00:40 | |
| *** sdake has quit IRC | 00:40 | |
| *** salv-orlando has quit IRC | 00:41 | |
| jhesketh | No. | 00:43 |
| jhesketh | (woops, wrong channel) | 00:43 |
| jeblair | jhesketh: right channel, wrong time? :) | 00:44 |
| jhesketh | Heh, I'm sure it could be applied somewhere in here | 00:45 |
| *** thorst has joined #openstack-infra | 00:49 | |
| *** Sukhdev has joined #openstack-infra | 00:50 | |
| *** Sukhdev_ has joined #openstack-infra | 00:52 | |
| *** Sukhdev has quit IRC | 00:52 | |
| jeblair | well darn | 00:54 |
| *** keedya has joined #openstack-infra | 00:55 | |
| *** Sukhdev_ has quit IRC | 00:55 | |
| *** Sukhdev has joined #openstack-infra | 00:55 | |
| openstackgerrit | James E. Blair proposed openstack-infra/ansible-puppet: Fix typo in puppet apply command https://review.openstack.org/271584 | 00:56 |
| jeblair | fungi, mordred, clarkb: ^ i'm self-approving that | 00:56 |
| *** thorst has quit IRC | 00:56 | |
| fungi | jeblair: lgtm, +3 | 00:57 |
| jeblair | i thought you were all at beer? :) | 00:57 |
| *** ajmiller has quit IRC | 00:57 | |
| fungi | jeblair: who all? i'm at home | 00:57 |
| Clint | home is where the beer is | 00:58 |
| fungi | i don't leave for the airport until almost lunch on sunday | 00:58 |
| fungi | but yes, there is beer here which will soon be had. just trying to wrap up these kilo tags | 00:58 |
| *** Sukhdev has quit IRC | 00:59 | |
| *** Sukhdev has joined #openstack-infra | 00:59 | |
| jeblair | good news is the link move worked | 00:59 |
| *** eharney has quit IRC | 01:00 | |
| fungi | unfortunately it appears that removing the constraints release jobs from neutron-vpnaas has caused it not to run the normal release jobs. i think we must have them getting blacklisted elsewhere in the layout | 01:00 |
| fungi | grar | 01:01 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/zuul: Let zuul-cloner work in post and release pipelines https://review.openstack.org/271585 | 01:01 |
| *** eil397 has quit IRC | 01:01 | |
| *** Sukhdev has quit IRC | 01:01 | |
| *** Sukhdev_ has joined #openstack-infra | 01:01 | |
| jesusaurus | fungi: for the zuul cloner thing you mentioned yesterday: the good news is that it looks like we only need to worry about ZUUL_BRANCH and it is pretty easy to fall back to ZUUL_REF; but the bad news is that it looks hard to add tests for the functionality | 01:02 |
| fungi | jeblair: i found the reason why the normal release jobs weren't getting run even though they were defined (the presumed deduplication? nope, just misconfiguration). patch coming now | 01:02 |
| keedya | hi All, how long does a new project takes before the final approval and the merge? | 01:02 |
| *** Sukhdev_ has quit IRC | 01:03 | |
| *** Sukhdev has joined #openstack-infra | 01:03 | |
| openstackgerrit | Merged openstack-infra/ansible-puppet: Fix typo in puppet apply command https://review.openstack.org/271584 | 01:03 |
| *** changzhi has joined #openstack-infra | 01:03 | |
| keedya | https://review.openstack.org/#/c/269411/ | 01:04 |
| *** changzhi has quit IRC | 01:04 | |
| *** Sukhdev has quit IRC | 01:05 | |
| *** Sukhdev has joined #openstack-infra | 01:05 | |
| *** changzhi has joined #openstack-infra | 01:05 | |
| keedya | is there a process to request reviewers? | 01:06 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Don't try to filter non-change jobs by branch https://review.openstack.org/271586 | 01:06 |
| fungi | jeblair: anteaya: mystery solved. ^ i hope i found them all, but there could be more lurking there | 01:06 |
| *** piet has joined #openstack-infra | 01:06 | |
| *** Sukhdev has quit IRC | 01:07 | |
| *** Sukhdev_ has joined #openstack-infra | 01:07 | |
| *** dimtruck is now known as zz_dimtruck | 01:07 | |
| fungi | dougwig: ^ | 01:08 |
| fungi | lifeless: Nakato: ^ also an fyi, constraints-job-related though somewhat more tangential than the previous revertish patch | 01:08 |
| openstackgerrit | Merged openstack-infra/project-config: Temporarily pin pip<8 for ceilometer tarballs https://review.openstack.org/271567 | 01:09 |
| *** Sukhdev_ has quit IRC | 01:09 | |
| *** Sukhdev has joined #openstack-infra | 01:11 | |
| fungi | Daviey: update, i'm waiting for 271567 to propagate before i retrigger the ceilometer tarball jobs. assuming 271586 is correct and gets approved/merged/propagates then i'll try the neutron-vpnaas release jobs yet again. hopefully those are the last of the blockers | 01:12 |
| *** Sukhdev has quit IRC | 01:13 | |
| *** Sukhdev_ has joined #openstack-infra | 01:14 | |
| *** changzhi has quit IRC | 01:14 | |
| *** ZZelle_ has quit IRC | 01:15 | |
| *** Sukhdev_ has quit IRC | 01:16 | |
| *** Sukhdev has joined #openstack-infra | 01:16 | |
| openstackgerrit | Andre keedy proposed openstack-infra/project-config: Add new project(shovel) to openstack https://review.openstack.org/269411 | 01:17 |
| *** davidlenwell has quit IRC | 01:17 | |
| *** Sukhdev has quit IRC | 01:18 | |
| *** Sukhdev has joined #openstack-infra | 01:18 | |
| *** davidlenwell has joined #openstack-infra | 01:18 | |
| *** Sukhdev has quit IRC | 01:19 | |
| *** Sukhdev has joined #openstack-infra | 01:20 | |
| *** piet has quit IRC | 01:20 | |
| *** fawadkhaliq has joined #openstack-infra | 01:20 | |
| *** Qiming has joined #openstack-infra | 01:22 | |
| *** Sukhdev has quit IRC | 01:22 | |
| jeblair | jesusaurus: have you looked at the tests in test_cloner.py ? | 01:24 |
| *** piet has joined #openstack-infra | 01:24 | |
| *** Sukhdev has joined #openstack-infra | 01:26 | |
| *** armax has joined #openstack-infra | 01:26 | |
| jeblair | jesusaurus: look at test_periodic for an example | 01:29 |
| jeblair | jesusaurus: except have it run in response to a post pipeline job instead of a periodic one | 01:30 |
| *** Keedya_89 has joined #openstack-infra | 01:35 | |
| fungi | jeblair: if you can confirm my interpretation in 271586 (it's a short change to layout.yaml, really just deletions) that will hopefully allow us to successfully run the tarball job for neutron-vpnaas | 01:37 |
| *** bardia has quit IRC | 01:37 | |
| jeblair | fungi: looking | 01:37 |
| jeblair | fungi: did you check the patch that added them to see what was being attempted? | 01:38 |
| jeblair | fungi: maybe they were just trying to not run constraints tarball on that branch or something | 01:38 |
| jeblair | which... worked... sort of. | 01:38 |
| fungi | jeblair: it was from the same patch that was adding the constraints versions | 01:38 |
| *** Keedya_89 has quit IRC | 01:39 | |
| jeblair | yeah, so that may have been the intent then. | 01:39 |
| fungi | the wanted to use constraints when building tarballs on liberty and later, no constraints on kilo | 01:39 |
| fungi | also docs | 01:39 |
| *** Keedya_60 has joined #openstack-infra | 01:39 | |
| fungi | (not the gate-{name}-docs jobs in change pipelines, but the {name}-docs used for publishing in the post and release pipelines) | 01:40 |
| jeblair | fungi: i think the commit message is wrong -- | 01:41 |
| jeblair | fungi: i believe the job branch filtering is expected to work on non-change pipelines | 01:41 |
| jeblair | fungi: it matches the ref | 01:41 |
| jeblair | fungi: i can not immediately reconcile that with the behavior you observed | 01:41 |
| fungi | oh, the ZUUL_REF in release is the tag ref | 01:42 |
| fungi | and it's assuming that zuul magically knows the tag maps to a specific branch | 01:42 |
| fungi | okay, so my assumption was slightly off there. i'll fix the commit message | 01:43 |
| jeblair | ah right, so the input there is refs/tags/1234 | 01:43 |
| jeblair | which does not match stable/kilo. ever. so it doesn't run. | 01:43 |
| jeblair | ever. | 01:43 |
| fungi | yeah, which while tagging a commit on stable/kilo was not actually matching stable/kilo | 01:43 |
| jesusaurus | jeblair: I was having trouble tracing where ZuulTestCase was setting self.builds, but I'll take another look on monday to see if I can mimic test_periodic to create a test_post and test_release | 01:43 |
| fungi | right, that | 01:43 |
| fungi | especially wrong for a job that only runs in pre-release/release/tag pipelines | 01:43 |
| *** ddieterly has joined #openstack-infra | 01:44 | |
| *** Keedya_60 has quit IRC | 01:44 | |
| *** wei-wang has joined #openstack-infra | 01:44 | |
| *** rajinir has quit IRC | 01:45 | |
| *** mtanino has quit IRC | 01:45 | |
| *** bpokorny has quit IRC | 01:45 | |
| jeblair | jesusaurus: self.builds is a pointer to the list of completed builds by the simulated jenkins thingy | 01:46 |
| pabelanger | jeblair: fungi: do you think we could land 229232? statsd 3.0 for zuul | 01:47 |
| *** Keedya_32 has joined #openstack-infra | 01:47 | |
| jeblair | pabelanger: i feel like we have way too many regressions in progress to risk another one at the moment | 01:47 |
| pabelanger | jeblair: sure, anything I can do to help with them? | 01:48 |
| jeblair | pabelanger: i'm sure there is, but i honestly don't know. any chance you have a zuul that exhibits the memory leak? | 01:49 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Don't try to filter release jobs by branch https://review.openstack.org/271586 | 01:50 |
| fungi | jeblair: ^ better? | 01:50 |
| jeblair | fungi: +3 | 01:50 |
| fungi | thanks! | 01:50 |
| pabelanger | jeblair: I can monitor, I've been destroying and rebuilding a lot lately. But, I can let it run for a few days to track memory usage | 01:50 |
| *** Keedya_32 has quit IRC | 01:50 | |
| *** armax has quit IRC | 01:52 | |
| jeblair | pabelanger: do you use the launch-node stuff at all? | 01:52 |
| jeblair | Jan 23 01:52:02 mirror-update puppet-user[27566]: (/Stage[main]/Openafs::Client/Service[openafs-client]/ensure) ensure changed 'stopped' to 'running' | 01:53 |
| jeblair | Jan 23 01:52:03 mirror-update puppet-user[27566]: Finished catalog run in 2.14 seconds | 01:53 |
| jeblair | and yay! | 01:53 |
| *** Keedya_21 has joined #openstack-infra | 01:54 | |
| pabelanger | jeblair: no, I have ansible playbooks I am using now | 01:54 |
| *** thorst has joined #openstack-infra | 01:54 | |
| *** apoorvad has quit IRC | 01:55 | |
| jeblair | krotscheck, mordred: http://mirror.iad.rax.openstack.org/pypi/ | 01:56 |
| jeblair | fungi: ^ | 01:56 |
| fungi | awesome! | 01:57 |
| jeblair | we have an afs mirror :) | 01:57 |
| jeblair | it's _very_ out of date | 01:57 |
| jeblair | cause it's just serving what i mirrored like 6 months ago | 01:57 |
| jeblair | actually, it might make a lot of jobs work better, we should use it. | 01:57 |
| fungi | but there is content | 01:57 |
| fungi | heh | 01:57 |
| fungi | indeed, things seem like they were much smoother 6 months ago. we can rewind! | 01:58 |
| *** Keedya_21 has quit IRC | 01:58 | |
| jeblair | krotscheck, mordred, fungi: i need to putz around with the actual mirror script on-host, so i've taken the mirror lock and will do that | 02:00 |
| *** Keedya_87 has joined #openstack-infra | 02:00 | |
| jeblair | also service/afsafdmin@OPENSTACK.ORG is not a thing | 02:00 |
| jeblair | asdfmin ... something... :) | 02:00 |
| *** thorst has quit IRC | 02:01 | |
| *** Keedya_87 has quit IRC | 02:02 | |
| krotscheck | jeblair: Ok. I've got to adjust the rewrite because it's preventing the index.html file from being served. | 02:04 |
| krotscheck | I'll do that *handwavey* *handwavey* | 02:04 |
| fungi | argh! it wasn't pip i needed to downgrade, it was virtualenv | 02:07 |
| fungi | still running the tarball job with pip 8 because virtualenv 14 is vendoring it | 02:07 |
| jeblair | fungi: i'm sorry you're stuck with me as a reviewer on these :( | 02:08 |
| *** pcaruana has quit IRC | 02:08 | |
| fungi | jeblair: i'm sorry you're stuck reviewing my stable release hackarounds on a friday night | 02:11 |
| openstackgerrit | Merged openstack-infra/project-config: Don't try to filter release jobs by branch https://review.openstack.org/271586 | 02:11 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Make the pin-pip macro also pin virtualenv https://review.openstack.org/271590 | 02:12 |
| fungi | jeblair: that ^ should solve it, if not too distasteful | 02:12 |
| nibalizer | fungi: lgtm | 02:13 |
| jeblair | i'm trying to decide if i should create pts groups for each of the mirror types too... | 02:14 |
| fungi | nibalizer: jeblair: thanks! | 02:14 |
| fungi | jeblair: is that what would allow us to isolate write access per worker? | 02:14 |
| jeblair | cause i have to recursively add accss for bandersnatch for all these directories; i'm thinking that adding a group for things that need to write to the pypi mirror might be slightly future proofing it | 02:14 |
| fungi | that sounds reasonable to me | 02:15 |
| jeblair | fungi: we can do that with separate principals... but the decision here is if we want to change acls -- do we do it with a find command, or do we do it with a couple of group add/remove commands | 02:15 |
| jeblair | fungi: yeah, i think i'm talked into it | 02:15 |
| fungi | the latter sounds easier with little additional work up-front | 02:16 |
| jeblair | i'm thinking of making a mirror pseudo-user so we can have mirror:pypi as a group | 02:17 |
| jeblair | or maybe we should be more generic and have 'service:pypi-mirror' | 02:18 |
| jeblair | oh i guess we could add it onto system | 02:19 |
| jeblair | system:pypi-mirror | 02:19 |
| jeblair | maybe i'm overthinking and i should just call it pypi-mirror :) | 02:21 |
| *** wei-wang has quit IRC | 02:22 | |
| jeblair | okay, i've got two deeply recursive command running on a huge tree; it's time for dinner | 02:24 |
| *** sdake_ has quit IRC | 02:25 | |
| *** dims_ has joined #openstack-infra | 02:26 | |
| *** dims has quit IRC | 02:28 | |
| *** armax has joined #openstack-infra | 02:29 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Fix on Auth token check https://review.openstack.org/271598 | 02:30 |
| anteaya | fungi: sorry I was talking to my parents hearing dire predictions for the east coast of the states regarding weather | 02:31 |
| anteaya | glad those two patches got approved | 02:32 |
| anteaya | and hope you can get to the beach next week | 02:32 |
| *** angdraug has quit IRC | 02:32 | |
| openstackgerrit | Merged openstack-infra/project-config: Make the pin-pip macro also pin virtualenv https://review.openstack.org/271590 | 02:33 |
| *** dims_ has quit IRC | 02:33 | |
| *** armax has quit IRC | 02:33 | |
| fungi | anteaya: thanks, i'm not too worried. for one thing, i already live at a beach! | 02:38 |
| fungi | Daviey: good news! neutron-vpnaas tarball is built now. we're just down to ceilometer, the fix for which merged above minutes ago so should be live shortly, then i'll retry | 02:40 |
| fungi | i should say, the most recent workaround for which merged minutes ago | 02:41 |
| fungi | unfortunately not the first | 02:41 |
| openstackgerrit | Merged openstack-infra/openstackid: Fix on Auth token check https://review.openstack.org/271598 | 02:43 |
| jeblair | fungi, krotscheck, mordred: before i forget -- still TODO on those mirror hosts is to add cinder volumes and increase the afs cache size | 02:45 |
| fungi | i will try to remember | 02:45 |
| jeblair | i added it to the etherpad too | 02:45 |
| fungi | excellent | 02:45 |
| jeblair | but we'll want to make sure that's done before we do any serious evaluation of it | 02:46 |
| *** yamahata has quit IRC | 02:57 | |
| *** thorst has joined #openstack-infra | 02:59 | |
| anteaya | fungi: true that | 02:59 |
| krotscheck | jeblair, fungi: Well, for what it's worth, it seems to be working really well :) | 03:00 |
| *** dims has joined #openstack-infra | 03:02 | |
| openstackgerrit | Andre keedy proposed openstack-infra/project-config: Add new project(shovel) to openstack https://review.openstack.org/269411 | 03:02 |
| *** armax has joined #openstack-infra | 03:05 | |
| *** thorst has quit IRC | 03:07 | |
| *** edmondsw has quit IRC | 03:13 | |
| *** armax has quit IRC | 03:13 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Keep going on network timeouts or service errors https://review.openstack.org/238598 | 03:17 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Fix elastic-recheck query command https://review.openstack.org/258725 | 03:19 |
| fungi | Daviey: done! the ceilometer tarball is up, so that's the last of the fixing for now i hope | 03:20 |
| *** rfolco has quit IRC | 03:20 | |
| fungi | i'll get the revert of the nasty hack proposed now so we can clean up the jobs | 03:20 |
| *** sdake has joined #openstack-infra | 03:22 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Revert "Temporarily pin pip<8 for ceilometer tarballs" https://review.openstack.org/271607 | 03:23 |
| *** boris-42 has quit IRC | 03:43 | |
| *** piet has quit IRC | 03:43 | |
| *** fawadkhaliq has quit IRC | 03:47 | |
| *** akshai has joined #openstack-infra | 03:51 | |
| *** wei-wang has joined #openstack-infra | 03:56 | |
| *** woodster_ has quit IRC | 03:56 | |
| *** rhallisey has quit IRC | 03:59 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/devstack-gate: [WIP] trying largeops with alternative NETWORK_MANAGER https://review.openstack.org/271609 | 04:00 |
| *** baoli has joined #openstack-infra | 04:02 | |
| *** thorst has joined #openstack-infra | 04:04 | |
| *** baoli has quit IRC | 04:09 | |
| *** wei-wang has quit IRC | 04:10 | |
| *** thorst has quit IRC | 04:11 | |
| *** dims has quit IRC | 04:13 | |
| mordred | jeblair, krotscheck, fungi: WOOT!!! | 04:15 |
| *** treaki_ has joined #openstack-infra | 04:15 | |
| *** fawadkhaliq has joined #openstack-infra | 04:18 | |
| *** treaki has quit IRC | 04:18 | |
| *** fawadkhaliq has quit IRC | 04:22 | |
| *** baoli has joined #openstack-infra | 04:23 | |
| *** regXboi has quit IRC | 04:27 | |
| *** baoli has quit IRC | 04:36 | |
| *** bardia has joined #openstack-infra | 04:38 | |
| *** timothyb89 has quit IRC | 04:40 | |
| *** timothyb89 has joined #openstack-infra | 04:40 | |
| *** yamamoto has joined #openstack-infra | 04:43 | |
| *** yamamoto has quit IRC | 04:44 | |
| *** bardia has quit IRC | 04:47 | |
| *** gyee_ has quit IRC | 04:49 | |
| *** baoli has joined #openstack-infra | 04:52 | |
| *** unicell has joined #openstack-infra | 04:56 | |
| *** armax has joined #openstack-infra | 04:59 | |
| *** armax has quit IRC | 05:05 | |
| *** piet has joined #openstack-infra | 05:06 | |
| *** thorst has joined #openstack-infra | 05:09 | |
| *** sabeen3 has quit IRC | 05:09 | |
| anteaya | mordred: join me in reviewing https://review.openstack.org/#/c/271607/1 to help fungi tidy up? | 05:11 |
| *** baoli has quit IRC | 05:12 | |
| anteaya | I can see the deer in the moonlight cruising around my yard pawing at the snow to get to the undergrowth | 05:14 |
| anteaya | so beautiful | 05:14 |
| anteaya | g'night | 05:14 |
| *** armax has joined #openstack-infra | 05:15 | |
| *** thorst has quit IRC | 05:17 | |
| *** rguillebert has quit IRC | 05:17 | |
| *** armax has quit IRC | 05:18 | |
| *** tlian has joined #openstack-infra | 05:30 | |
| *** megm has quit IRC | 05:37 | |
| *** megm has joined #openstack-infra | 05:39 | |
| *** zz_dimtruck is now known as dimtruck | 05:43 | |
| *** esikachev has joined #openstack-infra | 06:01 | |
| *** kzaitsev_mb has quit IRC | 06:02 | |
| *** thorst has joined #openstack-infra | 06:14 | |
| *** thorst has quit IRC | 06:22 | |
| *** armax has joined #openstack-infra | 06:23 | |
| *** armax has quit IRC | 06:24 | |
| *** armax has joined #openstack-infra | 06:24 | |
| *** armax has quit IRC | 06:26 | |
| *** sdake_ has joined #openstack-infra | 06:26 | |
| *** sdake has quit IRC | 06:29 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/267962 | 06:33 |
| *** _nadya_ has quit IRC | 06:42 | |
| *** Sukhdev has joined #openstack-infra | 06:42 | |
| *** dimtruck is now known as zz_dimtruck | 06:46 | |
| *** piet has quit IRC | 06:57 | |
| *** mrmartin has joined #openstack-infra | 07:13 | |
| *** fawadkhaliq has joined #openstack-infra | 07:18 | |
| *** thorst has joined #openstack-infra | 07:19 | |
| *** unicell1 has joined #openstack-infra | 07:21 | |
| *** unicell has quit IRC | 07:22 | |
| *** baoli has joined #openstack-infra | 07:23 | |
| *** yolanda has joined #openstack-infra | 07:24 | |
| *** HeOS has joined #openstack-infra | 07:26 | |
| *** thorst has quit IRC | 07:27 | |
| *** baoli has quit IRC | 07:27 | |
| *** salv-orlando has joined #openstack-infra | 07:28 | |
| *** salv-orlando has quit IRC | 07:31 | |
| *** salv-orlando has joined #openstack-infra | 07:31 | |
| *** hdd_ has quit IRC | 07:33 | |
| *** _nadya_ has joined #openstack-infra | 07:33 | |
| *** HeOS has quit IRC | 07:33 | |
| *** fawadkhaliq has quit IRC | 07:38 | |
| *** mrmartin has quit IRC | 07:41 | |
| *** achanda has quit IRC | 07:43 | |
| *** ildikov has quit IRC | 07:44 | |
| *** mrmartin has joined #openstack-infra | 07:47 | |
| AJaeger | infra-root, the dependend changes have merged, is https://review.openstack.org/#/c/269763/ to use again internap for 2-node labels ok to merge now? | 07:49 |
| *** akshai has quit IRC | 07:49 | |
| AJaeger | anteaya: wow, great! That's a nice way to finish the day... | 07:50 |
| *** sileht has quit IRC | 07:53 | |
| *** mrmartin has quit IRC | 07:57 | |
| *** yolanda has quit IRC | 07:58 | |
| *** sdake_ is now known as sdake | 08:00 | |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Temporarily pin pip<8 for ceilometer tarballs" https://review.openstack.org/271607 | 08:01 |
| *** tlian has quit IRC | 08:04 | |
| *** yolanda has joined #openstack-infra | 08:05 | |
| *** salv-orlando has quit IRC | 08:12 | |
| *** kzaitsev_mb has joined #openstack-infra | 08:18 | |
| AJaeger | anteaya, dhellmann : Sorry for my cryptic comments on the review. I'll add some more comments | 08:20 |
| *** ildikov has joined #openstack-infra | 08:20 | |
| *** esikachev has quit IRC | 08:21 | |
| *** mrmartin has joined #openstack-infra | 08:21 | |
| AJaeger | ... I digged in, the advice I gave would have worked but published to releases.openstack.org/doc/build/html/ ;( Let's do it *exactly* like governance publishing does and you should be fine, dhellmann. | 08:23 |
| *** sdake_ has joined #openstack-infra | 08:23 | |
| *** thorst has joined #openstack-infra | 08:24 | |
| *** sdake has quit IRC | 08:25 | |
| *** mrmartin has quit IRC | 08:26 | |
| *** yolanda has quit IRC | 08:28 | |
| *** frewtc4ke has joined #openstack-infra | 08:30 | |
| *** thorst has quit IRC | 08:32 | |
| *** mrmartin has joined #openstack-infra | 08:37 | |
| *** frewtc4ke has left #openstack-infra | 08:40 | |
| *** kzaitsev_mb has quit IRC | 08:40 | |
| *** baoli has joined #openstack-infra | 08:50 | |
| *** baoli has quit IRC | 08:54 | |
| *** sdake has joined #openstack-infra | 08:55 | |
| *** yolanda has joined #openstack-infra | 08:57 | |
| *** sdake_ has quit IRC | 08:58 | |
| *** salv-orlando has joined #openstack-infra | 09:13 | |
| *** salv-orlando has quit IRC | 09:18 | |
| *** kzaitsev_mb has joined #openstack-infra | 09:20 | |
| openstackgerrit | Merged openstack/requirements: Bump minimum python-ironicclient version to 0.9.0 https://review.openstack.org/266320 | 09:26 |
| *** thorst has joined #openstack-infra | 09:29 | |
| *** flwang1 has joined #openstack-infra | 09:36 | |
| *** thorst has quit IRC | 09:36 | |
| openstackgerrit | Merged openstack/requirements: Add "positional" package to g-r https://review.openstack.org/267270 | 09:38 |
| openstackgerrit | Merged openstack/requirements: Fix voluptuous version https://review.openstack.org/269677 | 09:38 |
| *** kzaitsev_mb has quit IRC | 09:44 | |
| *** flwang1 has quit IRC | 09:46 | |
| *** flwang1 has joined #openstack-infra | 09:49 | |
| *** mrmartin has quit IRC | 09:50 | |
| *** aspiers has quit IRC | 09:52 | |
| *** shardy has quit IRC | 09:57 | |
| *** yolanda has quit IRC | 09:57 | |
| *** Liuqing has joined #openstack-infra | 09:58 | |
| *** kushal has joined #openstack-infra | 10:02 | |
| *** kushal has quit IRC | 10:12 | |
| *** esikachev has joined #openstack-infra | 10:17 | |
| *** Sukhdev has quit IRC | 10:18 | |
| openstackgerrit | Merged openstack/requirements: Bump oslo.messaging version to 4.0.0 https://review.openstack.org/268856 | 10:20 |
| openstackgerrit | Merged openstack/requirements: Bump oslo.i18n to 2.1.0 https://review.openstack.org/257679 | 10:20 |
| *** christiana has quit IRC | 10:20 | |
| *** esikachev has quit IRC | 10:21 | |
| *** sdake has quit IRC | 10:30 | |
| *** thorst has joined #openstack-infra | 10:34 | |
| openstackgerrit | Merged openstack/requirements: Bump version of debtcollector to 1.2.0 https://review.openstack.org/267693 | 10:38 |
| *** yamamoto has joined #openstack-infra | 10:39 | |
| *** thorst has quit IRC | 10:41 | |
| *** yamamoto has quit IRC | 10:42 | |
| *** sileht has joined #openstack-infra | 10:47 | |
| *** HeOS has joined #openstack-infra | 10:51 | |
| *** sileht has quit IRC | 10:52 | |
| *** mikelk has joined #openstack-infra | 10:53 | |
| *** sileht has joined #openstack-infra | 10:57 | |
| openstackgerrit | Thomas Herve proposed openstack-infra/project-config: Add zaqarclient to Heat gate PROJECTS https://review.openstack.org/271691 | 10:57 |
| therve | If some are around, this ^^ fixes the Heat gate | 10:57 |
| *** keedya has quit IRC | 11:00 | |
| *** e0ne has joined #openstack-infra | 11:04 | |
| *** e0ne has quit IRC | 11:06 | |
| *** e0ne has joined #openstack-infra | 11:06 | |
| *** e0ne has quit IRC | 11:06 | |
| openstackgerrit | Merged openstack/requirements: Update to os-brick 0.8.0 https://review.openstack.org/267725 | 11:15 |
| *** christiana has joined #openstack-infra | 11:15 | |
| *** esikachev has joined #openstack-infra | 11:18 | |
| *** _nadya_ has quit IRC | 11:18 | |
| openstackgerrit | David Caro proposed openstack-infra/jenkins-job-builder: Small typo fix https://review.openstack.org/271694 | 11:21 |
| *** zhurong has joined #openstack-infra | 11:23 | |
| *** esikachev has quit IRC | 11:25 | |
| *** jordanP has joined #openstack-infra | 11:26 | |
| *** daemontool has joined #openstack-infra | 11:28 | |
| *** HeOS has quit IRC | 11:29 | |
| *** mikelk has quit IRC | 11:35 | |
| *** mikelk has joined #openstack-infra | 11:36 | |
| *** mikelk has quit IRC | 11:38 | |
| *** thorst has joined #openstack-infra | 11:39 | |
| *** mikelk has joined #openstack-infra | 11:39 | |
| *** yamamoto has joined #openstack-infra | 11:40 | |
| *** yamamoto has quit IRC | 11:41 | |
| *** yamamoto has joined #openstack-infra | 11:42 | |
| *** rcernin has joined #openstack-infra | 11:44 | |
| *** thorst has quit IRC | 11:46 | |
| *** yamamoto has quit IRC | 11:47 | |
| *** rcernin_ has joined #openstack-infra | 12:05 | |
| *** rcernin_ has quit IRC | 12:05 | |
| *** rcernin has quit IRC | 12:05 | |
| *** rcernin has joined #openstack-infra | 12:06 | |
| *** salv-orlando has joined #openstack-infra | 12:16 | |
| *** mrmartin has joined #openstack-infra | 12:17 | |
| *** flwang1 has quit IRC | 12:18 | |
| *** salv-orlando has quit IRC | 12:21 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add zaqarclient to Heat gate PROJECTS https://review.openstack.org/271691 | 12:22 |
| openstackgerrit | Qiming Teng proposed openstack/requirements: Bump python-senlinclient version to 0.3.0 https://review.openstack.org/263598 | 12:24 |
| *** HeOS has joined #openstack-infra | 12:28 | |
| *** zhurong has quit IRC | 12:29 | |
| *** mikelk has quit IRC | 12:34 | |
| *** sdake has joined #openstack-infra | 12:36 | |
| *** esikachev has joined #openstack-infra | 12:36 | |
| *** mrmartin has quit IRC | 12:38 | |
| *** thorst has joined #openstack-infra | 12:44 | |
| *** Liuqing has quit IRC | 12:47 | |
| *** mrmartin has joined #openstack-infra | 12:47 | |
| *** mase_x200 has joined #openstack-infra | 12:50 | |
| *** thorst has quit IRC | 12:51 | |
| *** mase_x200 has quit IRC | 12:52 | |
| *** rguillebert has joined #openstack-infra | 12:58 | |
| *** matrohon has joined #openstack-infra | 13:04 | |
| *** sdake has quit IRC | 13:07 | |
| openstackgerrit | David Caro proposed openstack-infra/git-review: Added topic field to the list output https://review.openstack.org/244083 | 13:11 |
| *** baoli has joined #openstack-infra | 13:13 | |
| *** vdrok has quit IRC | 13:13 | |
| *** hashar has joined #openstack-infra | 13:15 | |
| *** matrohon has quit IRC | 13:16 | |
| *** mrmartin has quit IRC | 13:16 | |
| *** esikachev has quit IRC | 13:17 | |
| *** baoli has quit IRC | 13:18 | |
| *** thorst has joined #openstack-infra | 13:27 | |
| *** dims has joined #openstack-infra | 13:28 | |
| *** rfolco has joined #openstack-infra | 13:28 | |
| *** _amrith_ is now known as amrith | 13:33 | |
| *** mrmartin has joined #openstack-infra | 13:42 | |
| *** rfolco has quit IRC | 13:44 | |
| openstackgerrit | David Caro proposed openstack-infra/git-review: Added topic field to the list output https://review.openstack.org/244083 | 13:45 |
| openstackgerrit | Fausto Marzi proposed openstack/requirements: Add modules for freezer mitaka m2 release https://review.openstack.org/271072 | 13:45 |
| *** vdrok has joined #openstack-infra | 13:45 | |
| *** rfolco has joined #openstack-infra | 13:45 | |
| *** fawadkhaliq has joined #openstack-infra | 13:50 | |
| *** EricGonczer_ has joined #openstack-infra | 14:02 | |
| *** baoli has joined #openstack-infra | 14:06 | |
| *** EricGonc_ has joined #openstack-infra | 14:07 | |
| *** EricGonczer_ has quit IRC | 14:07 | |
| openstackgerrit | David Caro proposed openstack-infra/git-review: Added dependency tree output https://review.openstack.org/271705 | 14:07 |
| *** jordanP has quit IRC | 14:16 | |
| *** EricGonc_ has quit IRC | 14:17 | |
| *** baoli has quit IRC | 14:17 | |
| *** salv-orlando has joined #openstack-infra | 14:18 | |
| *** rfolco has quit IRC | 14:20 | |
| *** _nadya_ has joined #openstack-infra | 14:21 | |
| *** HeOS has quit IRC | 14:21 | |
| *** salv-orlando has quit IRC | 14:23 | |
| *** EricGonczer_ has joined #openstack-infra | 14:26 | |
| *** baoli has joined #openstack-infra | 14:30 | |
| *** thorst has quit IRC | 14:33 | |
| *** thorst has joined #openstack-infra | 14:34 | |
| *** mrmartin has quit IRC | 14:40 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Small typo fix https://review.openstack.org/271694 | 14:40 |
| *** fawadkhaliq has quit IRC | 14:41 | |
| *** thorst has quit IRC | 14:42 | |
| *** Ramanjaneya has joined #openstack-infra | 14:50 | |
| *** woodster_ has joined #openstack-infra | 14:51 | |
| *** thorst has joined #openstack-infra | 14:52 | |
| *** jpr has joined #openstack-infra | 14:53 | |
| *** zeih has joined #openstack-infra | 14:56 | |
| *** Ramanjaneya has quit IRC | 14:58 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/267962 | 15:09 |
| jpr | asselin: how are the nova/openstack python clients managed on openstackci? is there a way to select their version/revision? | 15:12 |
| asselin_ | jpr, They should be pip installed based on the tools that are installed. e.g. nodepool's requirements.txt file | 15:13 |
| zeih | AJaeger: around? | 15:13 |
| *** mrmartin has joined #openstack-infra | 15:15 | |
| *** ddieterly has quit IRC | 15:18 | |
| *** salv-orlando has joined #openstack-infra | 15:19 | |
| *** ddieterly has joined #openstack-infra | 15:19 | |
| *** placko_ has joined #openstack-infra | 15:21 | |
| *** salv-orlando has quit IRC | 15:24 | |
| *** ddieterly has quit IRC | 15:24 | |
| *** EricGonczer_ has quit IRC | 15:25 | |
| *** Ramanjaneya has joined #openstack-infra | 15:29 | |
| *** abregman has joined #openstack-infra | 15:32 | |
| jpr | asselin_: would that control the build of the nodepool images? I'm looking for a way to change the python openstack tool versions on the ci node itself. eg. take nova from 3.2.0 back to 2.17.0 | 15:35 |
| asselin_ | jpr, no, nodepool images are defined by the project-config contents | 15:36 |
| *** mrmartin has quit IRC | 15:37 | |
| jpr | asselin_: ok that's what i thought. so where is the requirements.txt which controls installed versions...sorry i'm not finding it | 15:37 |
| asselin_ | jpr, honestly I don't think much of those are installed in the image itself. Did you confirm pip freeze on the image to see? | 15:38 |
| fungi | jpr: i don't think those are installed on our images. tests install them if they need them, on demand | 15:38 |
| fungi | er, well, jobs install them (test is sort of a vague term) | 15:38 |
| fungi | jpr: or do you mean you want to control the library versions that nodepool itself uses to talk to your service provider when uploading images and booting instances from them? | 15:39 |
| jpr | asselin_, fungi: yeah, i'm not trying to contol them on the images. I'm trying to debug an issue with nodepool interacting with my older openstack provider cloud. it appears slightly earlier nova/keystone tools work fine but the current releases | 15:39 |
| jpr | fungi: yes :) | 15:39 |
| asselin_ | jpr, are you building the images with dib? | 15:40 |
| fungi | i think this comes down to the requirements.txt in the version of nodepool you're running | 15:41 |
| fungi | there's a line like python-novaclient>=2.21.0 in there, you can add a maximum version specifier onto that, and make it something like python-novaclient>=2.21.0,<3 or maybe just python-novaclient==2.17.0 | 15:42 |
| jpr | asselin_: i'm assuming nodepool is. i'm not directly calling nodepool just starting the server. that appears to work better than a direct test as documented. but there's an auth error during the interaction with keystone that's cuasing a glitch due to my older provider. | 15:43 |
| *** bhunter71 has joined #openstack-infra | 15:43 | |
| fungi | though given that it's insisting on a newer novaclient than that already in master, it's probably depending on some new feature or fix in 2.21.0 | 15:43 |
| fungi | so you may need to use an older version of nodepool if you explicitly need one compatible with 2.17.0 | 15:43 |
| *** EricGonczer_ has joined #openstack-infra | 15:44 | |
| jpr | fungi: ok. at least is will narrow down the window. 2.21.0 is likely just as good. or at least worth a first try. the problem is I don't know where the requirements.txt file is. | 15:44 |
| asselin_ | jpr, yeah, there's been a lot of recent nodepool changes so docs are not in sync. I was working on that yesterday. | 15:44 |
| fungi | though also, nodepool is using shade to handle its authentication these days, i think (it's a shim library to apply business logic for behavior differences in various cloud providers) | 15:45 |
| jpr | fungi: also, i'm assuming my puppet apply will correct the python install once defined | 15:45 |
| asselin_ | jpr, you can try pinning to nodepool 0.2.0 tag and see if that works better for you. | 15:45 |
| jpr | asselin_: no worries. i'm making headway | 15:45 |
| fungi | jpr: you would need to alter it to obtain an earlier version of nodepool, or to get the nodepool source from a modified location | 15:45 |
| asselin_ | jpr, ok just for reference: http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/contrib/single_node_ci_data.yaml#n38 | 15:46 |
| jpr | asselin_: would changing the nodepool version also change my install nova python client libs? | 15:46 |
| fungi | it depends on what minimum and maximum (if any) versions it declares in its dependency list | 15:47 |
| jpr | asselin_: yes. i'll change that back to 0.2.0 as we had tested before. i reverted back to master after not seeing the cmdline nodepool image test work any better with the tagged version | 15:47 |
| jpr | fungi: so is nodepool the only component driving the nova client install? | 15:48 |
| jpr | fungi: that would make sense since that's where the provider comes into play | 15:48 |
| asselin_ | jpr, but still...image builds is independent of the cloud, so I'm still confused about what issue you have. | 15:48 |
| fungi | if the pip package resource for nodepool in that puppet module isn't explicitly calling pip with --upgrade/-U then as long as the version of novaclient you have installed falls into the acceptable range for the version of nodepool you're installing it shouldn't try to replace it | 15:48 |
| fungi | asselin_: he said something about the keystone in his cloud provider doesn't seem to work with newer novaclient, so nodepool is having trouble authenticating | 15:49 |
| asselin_ | fungi, right....but that's only needed to e.g. upload an image or build a node based on the image. | 15:50 |
| asselin_ | building the image shouldn't be using any of those clients | 15:50 |
| fungi | or to list images, or to boot instances, or... | 15:50 |
| fungi | it's also possible there are people here (mordred, notmorgan) who would be interested in the details of your keystone incompatibility with newer novaclient releases | 15:51 |
| asselin_ | jpr, what exactly is the error / issue you have? | 15:51 |
| jpr | asselin_: the problem I have is when nodepool tries to contact the provider is uses the auth creds in /etc/nodepool/nodepool.yaml . when the client connects to my keystone it is newer code that tries to do a discovery call. this causes my keystone to throw a 500 error. while the client libs do fall through to using the v2 api the error seems to cause nodepool (or some lib) to treat the initial 500 as fatal and report a pr | 15:51 |
| fungi | it may be a regression/backwards incompatibility we need to solve in openstack, or could be something worth adding to shade | 15:51 |
| asselin_ | jpr, ok, so nothing to do with image building. | 15:52 |
| jpr | asselin_: correct | 15:52 |
| fungi | this sounds vaguely like the issue we've seen in some providers filtering their api endpoints and blocking all calls/versions except those they actually think people are using (often based on testing with a very limited number of libraries/clients) | 15:53 |
| *** baoli has quit IRC | 15:53 | |
| asselin_ | jpr, which cloud are you using? | 15:53 |
| jpr | fungi: it's actually newer novaclient interaction with older (ancient) keystone. probably only worth my time to work around. | 15:53 |
| *** EricGonczer_ has quit IRC | 15:53 | |
| *** Ramanjaneya has quit IRC | 15:53 | |
| jpr | asselin_: an internal PoC cloud based on essex...yes I know | 15:54 |
| fungi | jpr: well, the clients are supposed to attempt to maintain backward compatibility even to pretty old deployments | 15:54 |
| fungi | if latest novaclient doesn't work with essex deployments, that sounds like a bug to me | 15:54 |
| *** esikachev has joined #openstack-infra | 15:55 | |
| fungi | not that it helps you immediately, but it's something we should be looking into in relation to this discussion anyway | 15:55 |
| openstackgerrit | David Caro proposed openstack-infra/git-review: Added dependency tree output https://review.openstack.org/271705 | 15:56 |
| jpr | fungi: ok. thanks i'll be happy to share details as needed. | 15:56 |
| *** piet has joined #openstack-infra | 15:56 | |
| *** baoli has joined #openstack-infra | 15:57 | |
| fungi | anyway, time for me to go run some saturday errands | 15:57 |
| *** baoli has quit IRC | 15:57 | |
| *** mrmartin has joined #openstack-infra | 15:57 | |
| *** daemontool has quit IRC | 15:59 | |
| jpr | fungi: enjoy | 15:59 |
| *** maishsk has joined #openstack-infra | 16:05 | |
| *** Ramanjaneya has joined #openstack-infra | 16:07 | |
| *** Qiming has quit IRC | 16:11 | |
| *** esikachev has quit IRC | 16:11 | |
| openstackgerrit | Andre keedy proposed openstack-infra/project-config: Add new project(shovel) to openstack - Shovel(https://github.com/keedya/shovel) is an open source project, coordinates between Openstack (Ironic, glance) and rackHD allowing users to find Baremetal Compute nodes dynamically discovered by RackHD and regis https://review.openstack.org/269411 | 16:13 |
| *** piet has quit IRC | 16:16 | |
| *** resker has joined #openstack-infra | 16:17 | |
| openstackgerrit | Andre keedy proposed openstack-infra/project-config: Add new project(shovel) to openstack - Shovel(https://github.com/keedya/shovel) is an open source project, coordinates between Openstack (Ironic, glance) and rackHD allowing users to find Baremetal Compute nodes dynamically discovered by RackHD and regis https://review.openstack.org/269411 | 16:17 |
| *** ddieterly has joined #openstack-infra | 16:20 | |
| *** esker has quit IRC | 16:20 | |
| *** ddieterly has quit IRC | 16:24 | |
| *** ddieterly has joined #openstack-infra | 16:24 | |
| openstackgerrit | Christoph Berg proposed openstack-infra/jenkins-job-builder: Fix ircbot's any-failure parameter documentation https://review.openstack.org/271707 | 16:33 |
| *** edmondsw has joined #openstack-infra | 16:35 | |
| *** edmondsw has quit IRC | 16:35 | |
| *** mrmartin has quit IRC | 16:37 | |
| *** zeih has quit IRC | 16:39 | |
| mordred | fungi: aroo? | 16:44 |
| mordred | jpr: hi! so - a) don't put auth credentials in nodepool.yaml - move to clouds.yaml for cloud auth credentials | 16:45 |
| mordred | jpr: b) we support keystone v3 and auth version discover in shade, so I'd like to see if we can isolate what your problem is | 16:45 |
| mordred | oh - wait- I read this wrong ... you're using new client with old server ... I still think we should support this (and you should use clouds.yaml) - so ping me when you're aroud and I'll try to give you some things ot try to figure it out | 16:47 |
| *** placko_ has quit IRC | 16:47 | |
| *** Kiall has quit IRC | 16:53 | |
| *** Kiall has joined #openstack-infra | 16:54 | |
| jpr | morded: thanks. on a) i tried that but the ~nodepool/.config/openstack/clouds.yaml (updated by the environments/common.yaml) doesn't appear to influence the nodepoold startup. at least when I started it as root those values were ignored and it kept picking the defaults from nodepool.yaml | 16:54 |
| *** woodster_ has quit IRC | 16:56 | |
| jpr | mordred: and on b) yes. i'm using new client against old keystone (essex). I have an ubuntu 14.04 box with the system python-novaclient 2.17.0 and python-keystone 0.7.1 installed and they seem to work fine with my keystone (no discovery and no errors) | 16:57 |
| *** larainema has quit IRC | 16:58 | |
| *** armax has joined #openstack-infra | 16:58 | |
| jpr | mordred: it's on my ci node for openstackci that i'm having authn issues (with verified working credentials). it appears the newer clients do as discovery call on keystone. it throws a 500 error. the cli clients cascade through to find a compat point with older API but the nodepool client interaction appears to take the first 500 error as permanent failure | 17:00 |
| jpr | mordred: this is the best I can tell so far because I can't get the nodepool client interaction to issue richer debug that might provide more detail, beyond the stack trace on the auth error | 17:01 |
| mordred | jpr: what is your auth url you have in nodepool.yaml ? | 17:05 |
| *** thorst has quit IRC | 17:06 | |
| nibalizer | jpr: also do you have cloud credentials loaded as enviornment variables? that takes priority over reading clouds.yaml afaict | 17:06 |
| *** thorst has joined #openstack-infra | 17:07 | |
| jpr | mordred: http://172.22.0.10:5000/v2.0 | 17:07 |
| mordred | k. that shouldn't be a discovery url for keystone - I betcha that it's the novaclient fallback | 17:07 |
| mordred | jpr: can you do a nova list with the credentials you are using in nodepool.yaml and have that work? | 17:08 |
| jpr | mordred: for the nodepoold that's generating the log file entries and errors i don't have env vars, just the nodepool.yaml file it reads (and seems to ignore the clouds.yaml). to reproduce the error i'm testing on the command line as the nodepool user with env vars down loaded from my dashboard settings ui | 17:10 |
| mordred | cool - and on the command line it _is_ working? | 17:10 |
| mordred | jpr: try this: http://paste.openstack.org/show/484762 with your env vars loaded | 17:12 |
| mordred | jpr: that'll use shade just like nodepool does, and will attempt to talk to nova | 17:12 |
| mordred | and it'll spit out debug info | 17:13 |
| jpr | mordred: in answer to the nova list question. it works along with spitting out the error 'No handlers could be found for logger "keystoneauth.identity.generic.base"' With --debug on I see that it gets the same 500 error traceback from the discovery attempt that I see in the nodepool.log but nova list appears to move on to older API compat and the returns results | 17:14 |
| jpr | " | 17:14 |
| *** thorst has quit IRC | 17:15 | |
| mordred | jpr: (also, can you pastebin the 500 traceback you're getting?) | 17:15 |
| *** piet has joined #openstack-infra | 17:16 | |
| mordred | jpr: (I also want to figure out why nodepool is ignoring your clouds.yaml - but one thing at a time :) | 17:16 |
| jpr | modred: on the pastebin code you sent. I'm still noob-ish on python. I put the code in a file shade-test.py and ran `python shade-test.py`. Is that correct? if so, i get an error "object has no attribute 'simple_logging'" | 17:17 |
| mordred | yes. that's correct ... that tells me you potentially have a _very_ old shade | 17:18 |
| mordred | jpr: can you run "pbr freeze | grep shade" ? | 17:18 |
| mordred | and- can you also try setting OS_COMPUTE_API_VERSION=2.0 and then re-running the nova list with debug and see if you still get the 500? | 17:18 |
| jpr | mordred: here's the traceback from nodepool.log. My best guess is that it's being triggered by the 500 error I see with nova --debug list http://paste.openstack.org/show/484763/ | 17:19 |
| *** unicell has joined #openstack-infra | 17:20 | |
| *** unicell1 has quit IRC | 17:21 | |
| jpr | mordred: also here is the output of nova --debug list http://paste.openstack.org/show/484764/ | 17:21 |
| *** dcentral has joined #openstack-infra | 17:21 | |
| mordred | thanks | 17:21 |
| jpr | nodepool@ci:~$ pbr freeze | grep shade | 17:21 |
| jpr | shade==1.4.0 # git sha 457ea84 | 17:21 |
| mordred | hrm | 17:22 |
| mordred | something is _strange_ - that's a plenty new enough shade | 17:22 |
| *** bhunter71 has quit IRC | 17:22 | |
| mordred | notmorgan: ^^ btw -see http://paste.openstack.org/show/484764/ | 17:23 |
| *** pcaruana has joined #openstack-infra | 17:23 | |
| mordred | notmorgan: that's current novaclient connecting to an essex cloud | 17:23 |
| mordred | notmorgan: looks like it's going through keystone version discovery - is there anyway to ask ksa to skip version discovery? | 17:23 |
| mordred | jpr: can you run this: python -c 'import shade; print shade' | 17:24 |
| jpr | mordred: setting `export OS_COMPUTE_API_VERSION=2.0` doesn't alter the behavior of nova list. same initial attempt at discovery which produces the 500 error | 17:24 |
| mordred | kk | 17:24 |
| mordred | yeah - I was originally thinking it was nova version discovery - but this is keystone version discovery | 17:25 |
| *** baoli has joined #openstack-infra | 17:25 | |
| jpr | mordred: <module 'shade' from '/usr/local/lib/python2.7/dist-packages/shade/__init__.pyc'> | 17:25 |
| mordred | jpr: k. now python -c 'import shade; print shade.simple_logging' | 17:25 |
| *** dcentral has quit IRC | 17:26 | |
| jpr | mordred: <function simple_logging at 0x7f3251d7b2a8> | 17:26 |
| *** dcentral has joined #openstack-infra | 17:26 | |
| mordred | jpr: and also try: export OS_AUTH_TYPE=v2password then the nova --debug list again and look for the 500 error | 17:27 |
| mordred | jpr: zomg. why did the script I send you go weird? :) | 17:27 |
| jpr | mordred: i'm running in the nodepool user account. should that matter? | 17:27 |
| *** daemontool has joined #openstack-infra | 17:27 | |
| mordred | nope. that's good | 17:28 |
| mordred | jpr: do this :) : python -c 'import shade; shade.simple_logging(http_debug=True); print shade.openstack_cloud().list_servers()' | 17:28 |
| jpr | mordred: the OS_AUTH_TYPE avoids the 500 error | 17:28 |
| mordred | jpr: woot | 17:28 |
| mordred | ok. so - we have a path forward | 17:28 |
| *** tlian has joined #openstack-infra | 17:30 | |
| mordred | try that python command, then if you wouldn't mind paste me your clouds.yaml and nodepool.yaml files (please XXX out the passwords) | 17:30 |
| *** daemontool has quit IRC | 17:30 | |
| *** daemontool has joined #openstack-infra | 17:31 | |
| jpr | mordred: here's the output of the .list_servers() http://paste.openstack.org/show/484763/ | 17:32 |
| jpr | mordred: here are the config files http://paste.openstack.org/show/484766/ | 17:34 |
| mordred | jpr: that first paste seems ot be the nodepool log | 17:34 |
| *** sridhar_ram has joined #openstack-infra | 17:35 | |
| *** hdd_ has joined #openstack-infra | 17:36 | |
| jpr | mordred: yes. it's where I see the only the "Problem with auth parameters" errors | 17:37 |
| *** bhunter71 has joined #openstack-infra | 17:38 | |
| mordred | jpr: kk. sso - you have profile: rcs in your clouds.yaml - did you define a vendor profile file somewhere? if not, remove that line. | 17:38 |
| mordred | in fact | 17:38 |
| mordred | try changing the clouds.yaml to look like this: http://paste.openstack.org/show/484767/ | 17:39 |
| mordred | then run | 17:39 |
| jpr | mordred: since its a bit opaque, my assumption is that this comes from the 500 error I see during the nova --debug list | 17:39 |
| mordred | python -c 'import shade; shade.simple_logging(http_debug=True); print shade.openstack_cloud(cloud="infra").list_servers()' | 17:39 |
| *** dims has quit IRC | 17:40 | |
| *** sridhar_ram1 has joined #openstack-infra | 17:41 | |
| *** sridhar_ram has quit IRC | 17:42 | |
| *** denisra_ is now known as denisra | 17:43 | |
| jpr | mordred: it doesn't seem to respond to the auth_type parameter http://paste.openstack.org/show/484768/ | 17:44 |
| mordred | jpr: nod. ok - I think there is a bug we can fix here | 17:45 |
| jeblair | krotscheck, mordred: my permissions updates are done; i'm running bandersnatch now | 17:45 |
| mordred | jeblair: woot | 17:45 |
| jpr | mordred: btw, the server list on this project is empty so that array will be empty. i'm assuming that's irrelevent | 17:45 |
| mordred | yah- more looking that it can make an API call to nova and succeed without that 500 | 17:45 |
| mordred | I believe I know where this is failing for you - thinking of how to fix it in a non-crazy way | 17:46 |
| *** placko_ has joined #openstack-infra | 17:47 | |
| *** achanda has joined #openstack-infra | 17:47 | |
| mordred | jpr: k. I know what to fix- probably won't be til tomorrow or monday - but I see the bug (or, rather, I see a bug in my ability to give you a workaround) | 17:48 |
| jpr | mordred: ok, thanks. is there a way i can wrap nodepoold in an env with OS_AUTH_TYPE set. | 17:48 |
| mordred | jpr: it will not pick it up, no | 17:48 |
| jpr | ok | 17:48 |
| mordred | before I go into coding hole ... | 17:49 |
| jpr | mordred: I'll loop back around on monday. at least now I can avoid banging my head against the wall. :) I might also try to drop to an older version of novaclient via pip requirements.txt if I can figure that out | 17:50 |
| mordred | jpr: I also made a change to the nodepool.yaml file in that paste - can you try making that change and seeing what that does for you with nodepool? | 17:50 |
| mordred | jpr: older versoin of novaclient will actually not help you | 17:50 |
| jpr | mordred: ok. thanks for confirming | 17:51 |
| mordred | shade is directly getting a keystoneauth1 Session object and it's in the keystone version negotiation that the problem is | 17:51 |
| jpr | ah, so that's all linked directly inside the nodepool code? | 17:51 |
| *** piet has quit IRC | 17:52 | |
| *** armax has quit IRC | 17:52 | |
| mordred | yah | 17:53 |
| *** _nadya_ has quit IRC | 17:54 | |
| AJaeger | zeih: If you want something, please don't just ping but ask what you want, I'll read in backscroll... | 17:58 |
| *** hdd_ has quit IRC | 18:00 | |
| jpr | mordred: changing nodepool.yaml with the cloud: infra either a) caused it to properly pick up the cloud.yaml and the auth_type correctly avoids triggering the 500 error or b) misses out on all the provider connection parameters and skipping the call to the provider (and therefore i'm not seeing the 500 error) | 18:00 |
| *** Guest38462 is now known as dansmith | 18:02 | |
| mordred | jpr: oh wow | 18:03 |
| mordred | :) | 18:03 |
| *** _nadya_ has joined #openstack-infra | 18:05 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add new project(shovel) to OpenStack https://review.openstack.org/269411 | 18:06 |
| *** thorst has joined #openstack-infra | 18:07 | |
| mordred | jpr: https://review.openstack.org/271714 should get you going | 18:07 |
| mordred | jpr: once we've got that out, you'll want to change project_name: nodepool to tenant_name: nodepool in your clouds.yaml and keep that auth_type: v2password in there | 18:08 |
| mordred | jpr: and that together should get you around the version discovery (although I'm going to poke a little bit to see if I can't get the need to change the project_name setting to go away | 18:09 |
| *** dims has joined #openstack-infra | 18:09 | |
| AJaeger | mordred: if you have time for reviews: This unblocks heat https://review.openstack.org/271691 and this unblocks ceilometer: https://review.openstack.org/271379 . The projects would appreciate a review, please | 18:09 |
| mordred | oh - piddle, I see it | 18:09 |
| *** thorst has quit IRC | 18:10 | |
| *** mrmartin has joined #openstack-infra | 18:11 | |
| *** _nadya_ has quit IRC | 18:11 | |
| *** unicell1 has joined #openstack-infra | 18:14 | |
| mordred | jpr: ok - nevermind what I said about changing project_name to tenant_name - I fixed the patch (typo on my part) | 18:15 |
| *** unicell has quit IRC | 18:15 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/devstack-gate: Largeops should use no-op nova NETWORK_MANAGER https://review.openstack.org/271609 | 18:18 |
| mordred | SpamapS: ^^ | 18:19 |
| SpamapS | Eh? | 18:22 |
| SpamapS | I'd rather see it use neutron with a neutron noop | 18:23 |
| jpr | mordred: so i'm new to pulling a patch out of gerrit. I'll get myself educated on that. in the mean time i'm retesting nodepool with the cloud: infra tag and seeing if that avoids the problem. | 18:24 |
| *** davidlenwell has quit IRC | 18:24 | |
| *** davidlenwell has joined #openstack-infra | 18:25 | |
| *** unicell has joined #openstack-infra | 18:26 | |
| *** sdake has joined #openstack-infra | 18:26 | |
| mordred | SpamapS: yes, that too | 18:27 |
| mordred | jpr: cool -don't worry about it - I'll make a new release soon | 18:27 |
| *** unicell1 has quit IRC | 18:27 | |
| *** mikelk has joined #openstack-infra | 18:28 | |
| *** achanda has quit IRC | 18:28 | |
| *** mikelk has quit IRC | 18:28 | |
| *** mikelk has joined #openstack-infra | 18:28 | |
| *** _et_ has joined #openstack-infra | 18:30 | |
| *** mmedvede has quit IRC | 18:30 | |
| *** mmedvede has joined #openstack-infra | 18:32 | |
| *** EricGonczer_ has joined #openstack-infra | 18:34 | |
| *** abregman has quit IRC | 18:35 | |
| *** mmedvede has quit IRC | 18:36 | |
| *** placko_ has quit IRC | 18:37 | |
| *** mmedvede has joined #openstack-infra | 18:38 | |
| *** thorst has joined #openstack-infra | 18:40 | |
| *** thorst has quit IRC | 18:45 | |
| *** sdake_ has joined #openstack-infra | 18:46 | |
| *** bhunter71 has quit IRC | 18:46 | |
| *** sdake has quit IRC | 18:49 | |
| *** mrmartin has quit IRC | 18:51 | |
| *** mrmartin has joined #openstack-infra | 18:52 | |
| *** jordanP has joined #openstack-infra | 18:56 | |
| *** mrmartin has quit IRC | 18:56 | |
| dims | SpamapS : +1 to add a largeops with neutron no-op i am just trying to get some sanity to the gate failures | 18:57 |
| *** sdake_ has quit IRC | 18:58 | |
| *** sdake has joined #openstack-infra | 18:58 | |
| *** thorst has joined #openstack-infra | 18:59 | |
| *** flwang1 has joined #openstack-infra | 19:00 | |
| *** dims has quit IRC | 19:00 | |
| *** EricGonczer_ has quit IRC | 19:02 | |
| *** thorst has quit IRC | 19:03 | |
| *** pcaruana has quit IRC | 19:04 | |
| *** thorst has joined #openstack-infra | 19:04 | |
| *** flwang1 has quit IRC | 19:04 | |
| *** thorst has quit IRC | 19:09 | |
| *** sdake has quit IRC | 19:10 | |
| asselin_ | jpr, FYI the simplest way to get a patch out of gerrit is: git review -d 271714 (-d is download). Otherwise there are links in gerrit, top right under "Download". | 19:12 |
| openstackgerrit | Andre keedy proposed openstack-infra/project-config: Add new project(shovel) to openstack https://review.openstack.org/269411 | 19:14 |
| *** achanda has joined #openstack-infra | 19:14 | |
| notmorgan | mordred: oh weird | 19:15 |
| notmorgan | mordred: uhmmm. | 19:15 |
| notmorgan | mordred: i don't know if we can disable version discovery easily, but essex based cloud - i mean.. hmmmmmm | 19:16 |
| notmorgan | mordred: ah just read the whole backlog | 19:17 |
| notmorgan | mordred: cool. looking at the patch for v2passwd | 19:17 |
| jpr | asselin_: thx. given this is a patch to openstack-client-config I'm assuming i need to rebuild/install for that. is there a way to do this in the context of the openstackci ci node or do I need to clone build and install from the side? | 19:18 |
| asselin_ | jpr, yeah, git clone it, git review -d, sudo -H pip install . | 19:19 |
| notmorgan | jpr: what asselin_ said. | 19:19 |
| notmorgan | mordred: fix looks ok, but... lets add a test to avoid regressing accidently | 19:19 |
| *** davidlenwell has quit IRC | 19:20 | |
| *** davidlenwell has joined #openstack-infra | 19:21 | |
| *** dims has joined #openstack-infra | 19:26 | |
| *** _nadya_ has joined #openstack-infra | 19:27 | |
| *** zaro has quit IRC | 19:30 | |
| mordred | notmorgan: yah. fo show | 19:31 |
| mordred | notmorgan: yah. fo sho | 19:31 |
| notmorgan | mordred: but not snow? | 19:32 |
| notmorgan | mordred: ;) | 19:32 |
| mordred | SO MUCH SNOW | 19:32 |
| *** sriram has joined #openstack-infra | 19:33 | |
| notmorgan | right? | 19:33 |
| notmorgan | i was looking at the news | 19:33 |
| *** sriram has quit IRC | 19:33 | |
| mordred | transit is now shut down | 19:33 |
| notmorgan | kindof happy i am in PDX right now. | 19:33 |
| mordred | that means if I wanted to get a beer with Clint I'd have to walk | 19:34 |
| *** sriram has joined #openstack-infra | 19:34 | |
| notmorgan | and that could be a rough walk. | 19:34 |
| mordred | (actually, that's not true - the subways are still running - I could take the G over to closer to him - no el-tracks involved with that) | 19:34 |
| *** Sukhdev has joined #openstack-infra | 19:34 | |
| *** maishsk has quit IRC | 19:36 | |
| *** maishsk has joined #openstack-infra | 19:40 | |
| *** pcaruana has joined #openstack-infra | 19:40 | |
| *** zaro has joined #openstack-infra | 19:41 | |
| *** dims has quit IRC | 19:47 | |
| openstackgerrit | Jay_Clark proposed openstack-infra/project-config: adding project config for openstack-salt-formulas. https://review.openstack.org/271509 | 19:47 |
| *** mikelk has quit IRC | 19:48 | |
| mordred | 16.5" at LaGuardia, 14" in Central Park - we're closer to LaGuardia | 19:53 |
| mordred | fungi: how is the flooding down there? | 19:53 |
| *** sriram has quit IRC | 19:57 | |
| *** Ramanjaneya has quit IRC | 20:03 | |
| *** zz_dimtruck is now known as dimtruck | 20:06 | |
| *** baoli has quit IRC | 20:06 | |
| Clint | mordred: i guess this is why some people keep cross-country skis in their closets | 20:07 |
| mordred | Clint: I thought that had something to do with drinking | 20:08 |
| * Clint claps. | 20:08 | |
| *** dslevin has quit IRC | 20:10 | |
| *** sridhar_ram1 has quit IRC | 20:12 | |
| *** sdake has joined #openstack-infra | 20:13 | |
| *** sdake_ has joined #openstack-infra | 20:15 | |
| *** EricGonczer_ has joined #openstack-infra | 20:16 | |
| *** daemontool has quit IRC | 20:16 | |
| *** sdake has quit IRC | 20:17 | |
| *** piet has joined #openstack-infra | 20:19 | |
| *** lucas-pto has quit IRC | 20:21 | |
| *** sabeen1 has joined #openstack-infra | 20:22 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Fix on nodejs default version https://review.openstack.org/271722 | 20:22 |
| *** lucasagomes has joined #openstack-infra | 20:29 | |
| *** Sukhdev has quit IRC | 20:45 | |
| *** Sukhdev has joined #openstack-infra | 20:45 | |
| fungi | mordred: water level's not too high in the sound yet, but it's choppy. slapping the seawall pretty hard here in the yard | 20:46 |
| fungi | also we have sideways snow | 20:46 |
| fungi | but just a trace. nothing like what points north of here are experiencing | 20:46 |
| fungi | mostly just very high winds | 20:47 |
| fungi | flying tomorrow will be hella fun if this keeps up | 20:47 |
| *** thorst has joined #openstack-infra | 20:47 | |
| *** Sukhdev has quit IRC | 20:47 | |
| *** maishsk has quit IRC | 20:47 | |
| *** sabeen1 has quit IRC | 20:48 | |
| *** armax has joined #openstack-infra | 20:48 | |
| *** piet has quit IRC | 20:49 | |
| *** dimtruck is now known as zz_dimtruck | 20:50 | |
| *** maishsk has joined #openstack-infra | 20:56 | |
| *** asselin__ has joined #openstack-infra | 20:56 | |
| *** asselin_ has quit IRC | 20:57 | |
| *** pcaruana has quit IRC | 20:58 | |
| mordred | fungi: oh jeez | 20:58 |
| mordred | fungi: where are you (theoretically) flying tomorrow? | 20:58 |
| mordred | fungi: we're getting gusts into the 40-50mph range | 20:59 |
| bkero | notmorgan: What's Portland like now? | 21:01 |
| * bkero notportland | 21:01 | |
| clarkb | overcast and warm | 21:01 |
| bkero | Huh, ok | 21:02 |
| dstufft | fungi: snow is fun! | 21:04 |
| dstufft | we have over 2 feet of it right now :| | 21:05 |
| dstufft | https://caremad.io/s/CEYIPIYpq7/ this was me a bit ago, after running the snow blower for 4 hours | 21:05 |
| *** baoli has joined #openstack-infra | 21:07 | |
| *** Sukhdev has joined #openstack-infra | 21:07 | |
| *** dims has joined #openstack-infra | 21:08 | |
| mordred | dstufft: nice! | 21:09 |
| mordred | dstufft: I have _not_ run a snow blower for any amount of time | 21:10 |
| dstufft | this was my first time, we just bought a house in dec and we couldn't find anyone to come out and plow | 21:10 |
| dstufft | so I bought a snow blower, because our drive way is somewhere between an 1/8 and a 1/4 of a mile long | 21:10 |
| dstufft | and to hell with trying to shovel that by hand | 21:10 |
| *** armax has quit IRC | 21:11 | |
| dstufft | I think I'm gonna buy the little tent thing they had for it though | 21:11 |
| dstufft | the cold isn't so bad, but when the wind blows and decides to throw all the snow you're chucking out right into your face is kinda lame | 21:12 |
| dstufft | guess IBetter head back out into it though :V | 21:13 |
| *** dcentral has quit IRC | 21:13 | |
| fungi | mordred: mexico | 21:20 |
| fungi | mordred: luckily via atl, and the flights are atl-based flights so in theory no impact as long as the norfolk airport remains in reasonably functional condition | 21:21 |
| mordred | fungi: yes. mexico is the right choice currently | 21:25 |
| mordred | fungi: I fly to Dallas Tuesday, but I'm fairly certain they're not going to keep LaGuardia closed for over 3 days | 21:25 |
| *** hdd_ has joined #openstack-infra | 21:26 | |
| notmorgan | bkero: uhm. wat clarkb said | 21:26 |
| *** sdake_ has quit IRC | 21:33 | |
| *** achanda has quit IRC | 21:37 | |
| *** sdake has joined #openstack-infra | 21:44 | |
| *** baoli has quit IRC | 21:47 | |
| bkero | I am in Quito. 20C and overcast. | 21:53 |
| bkero | Is wonderful. | 21:53 |
| bkero | 23C actually. It's on the ecuator, but elevation is 9500ft | 21:54 |
| bkero | so its not sweltering hot | 21:55 |
| bkero | equator* | 21:55 |
| *** EricGonczer_ has quit IRC | 21:57 | |
| *** maishsk has quit IRC | 21:59 | |
| mordred | mmm | 22:01 |
| *** rcernin has quit IRC | 22:05 | |
| *** maishsk has joined #openstack-infra | 22:07 | |
| openstackgerrit | Merged openstack-infra/system-config: Document adding a kerberos service principal https://review.openstack.org/270559 | 22:14 |
| openstackgerrit | Merged openstack-infra/system-config: Added extra-index-url to pip optional settings https://review.openstack.org/267751 | 22:19 |
| *** sdake has quit IRC | 22:19 | |
| openstackgerrit | Merged openstack-infra/system-config: Put wheel-mirror workers in a common group https://review.openstack.org/270495 | 22:20 |
| *** fedexo has joined #openstack-infra | 22:24 | |
| *** EricGonczer_ has joined #openstack-infra | 22:24 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Fix on nodejs default version https://review.openstack.org/271722 | 22:27 |
| *** achanda has joined #openstack-infra | 22:28 | |
| *** thorst has quit IRC | 22:29 | |
| *** EricGonczer_ has quit IRC | 22:30 | |
| *** achanda has quit IRC | 22:31 | |
| *** EricGonczer_ has joined #openstack-infra | 22:32 | |
| *** EricGonczer_ has quit IRC | 22:32 | |
| *** achanda has joined #openstack-infra | 22:46 | |
| *** _nadya_ has quit IRC | 22:48 | |
| *** maishsk has quit IRC | 22:48 | |
| *** EricGonczer_ has joined #openstack-infra | 22:48 | |
| *** Sukhdev has quit IRC | 23:01 | |
| *** jordanP has quit IRC | 23:04 | |
| *** piet has joined #openstack-infra | 23:05 | |
| *** tlian has quit IRC | 23:09 | |
| *** piet has quit IRC | 23:29 | |
| *** piet has joined #openstack-infra | 23:30 | |
| *** jsavak has joined #openstack-infra | 23:33 | |
| *** achanda has quit IRC | 23:37 | |
| *** achanda has joined #openstack-infra | 23:38 | |
| *** jsavak has quit IRC | 23:42 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!