| *** adalbas has quit IRC | 00:03 | |
| *** SergeyLukjanov is now known as _SergeyLukjanov | 00:13 | |
| *** SergeyLukjanov has joined #openstack-infra | 00:18 | |
| *** oubiwann has quit IRC | 00:21 | |
| *** oubiwann has joined #openstack-infra | 00:21 | |
| *** adalbas has joined #openstack-infra | 00:42 | |
| *** sandywalsh has quit IRC | 00:56 | |
| *** sandywalsh has joined #openstack-infra | 00:56 | |
| *** SergeyLukjanov has quit IRC | 01:01 | |
| fungi | yeah, just got back to looking--got sucked into family visity stuff and only just managed break back away | 01:04 |
|---|---|---|
| fungi | i agree it may be downloading to the wrong place... devstack-cache.py seems to download into ~/cache/files/ | 01:05 |
| fungi | which which is empty | 01:07 |
| fungi | though devstack seems to look in /opt/stack/new/devstack/files/ which i think gets populated from ~jenkins/workspace-cache/devstack/files/ (which is not empty but is also lacking the cirros images) | 01:08 |
| fungi | currently looking for the link between ~/cache/files/ and either of those locations | 01:09 |
| fungi | i would expect to see prepare_devstack.sh do something to move them over | 01:11 |
| *** yolanda has quit IRC | 01:11 | |
| fungi | ahh, devstack-vm-gate-wrap.sh looks there | 01:15 |
| clarkb | yeah it does and rsync maybe? | 01:15 |
| fungi | yep | 01:17 |
| fungi | so as best i can tell stuff isn't landing in ~jenkins/cache/files/ even though prepare_node_devstack.sh calls prepare_devstack.sh as jenkins which in turn calls devstack-cache.py which wgets into ~/cache/files/ | 01:21 |
| fungi | think i'll need to add some extra debugging statements in devstack-cache.py to find out what wget is doing | 01:21 |
| clarkb | fungi: I bet running the cirros bits by hand locally might give enough info | 01:23 |
| clarkb | perhaps a path is wrong? | 01:23 |
| fungi | i'm sorta wondering if either it's a write perms issue or a uid problem | 01:23 |
| fungi | really all i need to do is hand-patch the script to print the wget output and then regenerate the image again | 01:24 |
| fungi | so doing that now | 01:24 |
| clarkb | fungi: in cache.py image_filenames is initialized to {} and I don't see it getting udpated | 01:25 |
| *** CaptTofu has quit IRC | 01:25 | |
| fungi | it does, in that loop just after | 01:25 |
| fungi | it calls a function which fills it from processing stackrc | 01:25 |
| *** CaptTofu has joined #openstack-infra | 01:25 | |
| clarkb | which function? | 01:25 |
| fungi | and i can see in the log where it says it's downloading those things, so i know the dict has content | 01:25 |
| clarkb | fungi: the dict is used for skipping content | 01:26 |
| clarkb | I am mostly curious if there are bugs around taht | 01:26 |
| fungi | oh, wait, maybe there is actually a missing assignment in that inner loop | 01:26 |
| fungi | no, wait, i think it's right | 01:27 |
| fungi | branches = local_prep(distribution) | 01:27 |
| fungi | for branch_data in branches: | 01:27 |
| fungi | for url in branch_data['images']: | 01:27 |
| fungi | do stuff | 01:27 |
| clarkb | ya | 01:27 |
| fungi | image_filenames seems to be used for skipping the pass | 01:28 |
| clarkb | maybe ~/cache/files isn't expanded properly by run_local? | 01:28 |
| fungi | that's what i'm suspecting | 01:28 |
| fungi | may need the expanduser or whatever call wrapping it | 01:28 |
| clarkb | yup expanduser | 01:28 |
| clarkb | I will approve such a change (it can't hurt) | 01:29 |
| clarkb | even the DEVSTACK var uses expanduser | 01:29 |
| fungi | lemme double check that someone hasn't already posted a fix for this which is rotting for days in my review queue | 01:29 |
| fungi | because then i would feel even stupider | 01:29 |
| clarkb | shell defaults to false in subprocess.Popen and I think you need shell = true to expand the ~ | 01:30 |
| clarkb | so I bet that is the problem | 01:30 |
| clarkb | fungi: testing in an interactive python shell seems to indicate that is the case | 01:32 |
| fungi | yep, just confirmed | 01:33 |
| fungi | i think we need it for the pip cache too | 01:33 |
| fungi | so the question is whether we want to expanduser or shell=True | 01:33 |
| clarkb | coo, if you whip up a change I can review. That said it is saturday night so no rush :) | 01:33 |
| clarkb | fungi: I think expanduser | 01:33 |
| fungi | i'm leaning the same way. safer and fewer side effects | 01:34 |
| clarkb | as it may not always be safe for run_local to use shell | 01:34 |
| fungi | yup | 01:38 |
| fungi | that said, it's also not clear to me why update-pip-cache.sh isn't dropping anything into ~jenkins/cache/pip/ | 01:39 |
| fungi | looks like separate problem though | 01:39 |
| fungi | ahh, i think maybe that script is never actually called? | 01:40 |
| clarkb | where is update-pip-cache? | 01:41 |
| clarkb | git grep in the nodepool scripts doesn't show it getting called | 01:41 |
| fungi | it's a slave script in -infra/config and the only place i saw ~/cache/pip getting used | 01:42 |
| fungi | and yeah, i find nothing actually using it | 01:42 |
| clarkb | with our mirror that might be mostly a noop though | 01:43 |
| fungi | perhaps | 01:43 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Expand user when caching files for devstack https://review.openstack.org/52806 | 01:46 |
| fungi | anyway, ^ there's that | 01:46 |
| fungi | sdague: ^ if you're still around that seems to have been the issue | 01:48 |
| clarkb | fungi: lgtm, should I approve? | 01:54 |
| fungi | clarkb: sure thing. i'll check back in a bit and test a new image, then do the others if successful | 01:55 |
| clarkb | fungi: actually, you don't need to have the %s | 01:55 |
| clarkb | fungi: will you hate me if I ask that you fix that? | 01:55 |
| fungi | not at all. i agree--fixing | 01:55 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Expand user when caching files for devstack https://review.openstack.org/52806 | 01:57 |
| fungi | fixed one other trivial thing in there which was irking me at the same time | 01:57 |
| *** dkehn_ is now known as dkehn | 01:57 | |
| fungi | oh, actually, that no longer irks me. unfixing | 01:58 |
| clarkb | :) | 01:58 |
| clarkb | http urls for images are garunteed to have a '/' | 01:58 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Expand user when caching files for devstack https://review.openstack.org/52806 | 01:58 |
| fungi | yup ;) | 01:59 |
| * fungi got carried away os.path'ing things there | 01:59 | |
| clarkb | approved | 01:59 |
| * fungi goes away for a quick cookie break | 02:00 | |
| *** dims has quit IRC | 02:00 | |
| openstackgerrit | A change was merged to openstack-infra/config: Expand user when caching files for devstack https://review.openstack.org/52806 | 02:01 |
| *** wenlock has joined #openstack-infra | 02:02 | |
| *** steven-weston has joined #openstack-infra | 02:05 | |
| *** steven-weston has quit IRC | 02:07 | |
| *** steven-weston has joined #openstack-infra | 02:07 | |
| *** steven-weston has quit IRC | 02:09 | |
| *** steven-weston has joined #openstack-infra | 02:09 | |
| *** steven-weston has quit IRC | 02:12 | |
| fungi | images are being generated now | 02:42 |
| clarkb | fungi: I suppose the image builds take a bit of time | 02:57 |
| fungi | they do | 02:59 |
| *** dcramer_ has joined #openstack-infra | 03:00 | |
| *** dkranz has quit IRC | 03:05 | |
| fungi | still building | 03:06 |
| fungi | once they finish i'll start clearing out the old available servers so we get ones with these new images | 03:07 |
| *** nicedice has quit IRC | 03:08 | |
| fungi | hpcloud images finished building and old nodes are being deleted there now. rackspace images are still building though | 03:18 |
| clarkb | fungi: did it work then? | 03:18 |
| *** dkranz has joined #openstack-infra | 03:20 | |
| fungi | no idea yet--should know in a bit | 03:20 |
| *** senk has joined #openstack-infra | 03:22 | |
| *** senk has quit IRC | 03:28 | |
| *** senk has joined #openstack-infra | 03:29 | |
| *** senk has quit IRC | 03:36 | |
| fungi | okay, so sampling a new hpcloud-az1 node, there are cirros/ubuntu/debian images in ~jenkins/cache/files/ now | 03:42 |
| fungi | also, jenkins02 does seem to have gotten a job assigned from zuul recently so i guess it's not horked up | 03:45 |
| fungi | probably just still the nodepool imbalance at play there? | 03:46 |
| *** dcramer_ has quit IRC | 03:46 | |
| fungi | not restarted since last weekend, and i think the balance corrections merged more recently than that | 03:47 |
| fungi | so jenkins01 is still ending up with the bulk of the devstack pool | 03:51 |
| clarkb | I think jeblair got the better balancing code in place | 03:54 |
| fungi | ahh, well at any rate the remaining zones have updated images now and i've got the last of the old unused nodes deleting from them | 03:56 |
| *** dcramer_ has joined #openstack-infra | 03:59 | |
| fungi | all finished... and on that note, i'm passing out for the night | 04:05 |
| clarkb | goodnight | 04:07 |
| *** wenlock has quit IRC | 04:15 | |
| *** adalbas has quit IRC | 04:18 | |
| *** oubiwann has quit IRC | 05:42 | |
| *** oubiwann has joined #openstack-infra | 05:43 | |
| *** SergeyLukjanov has joined #openstack-infra | 06:08 | |
| *** SlickNik has quit IRC | 06:16 | |
| *** SlickNik has joined #openstack-infra | 06:16 | |
| *** SlickNik has quit IRC | 06:17 | |
| *** SlickNik has joined #openstack-infra | 06:18 | |
| *** dkliban has joined #openstack-infra | 06:19 | |
| *** dkliban has quit IRC | 06:36 | |
| *** dkliban has joined #openstack-infra | 06:44 | |
| *** dkliban has quit IRC | 06:55 | |
| *** Guest86586 is now known as Vivek | 06:58 | |
| *** Vivek has joined #openstack-infra | 06:58 | |
| *** SergeyLukjanov has quit IRC | 07:01 | |
| *** oubiwann has quit IRC | 07:51 | |
| *** oubiwann has joined #openstack-infra | 07:52 | |
| * LinuxJedi wonders why he is getting daily cron emails from "rudger-laptop" | 07:54 | |
| *** dkliban has joined #openstack-infra | 08:03 | |
| *** CaptTofu has quit IRC | 08:05 | |
| *** CaptTofu has joined #openstack-infra | 08:05 | |
| *** CaptTofu has quit IRC | 08:13 | |
| *** CaptTofu has joined #openstack-infra | 08:14 | |
| *** yamahata has quit IRC | 08:17 | |
| *** CaptTofu has quit IRC | 08:18 | |
| *** nati_ueno has joined #openstack-infra | 08:21 | |
| *** nicedice has joined #openstack-infra | 08:41 | |
| *** ben_duyujie has joined #openstack-infra | 08:51 | |
| *** Ryan_Lane has quit IRC | 08:52 | |
| *** jeblair has quit IRC | 08:58 | |
| *** nati_ueno has quit IRC | 09:01 | |
| *** nati_ueno has joined #openstack-infra | 09:02 | |
| *** jeblair has joined #openstack-infra | 09:03 | |
| *** nati_ueno has quit IRC | 09:06 | |
| *** oubiwann has quit IRC | 09:09 | |
| *** oubiwann has joined #openstack-infra | 09:10 | |
| *** marun has joined #openstack-infra | 09:17 | |
| jeblair | ~. | 09:25 |
| *** jeblair has quit IRC | 09:31 | |
| *** jeblair has joined #openstack-infra | 09:32 | |
| *** marun has quit IRC | 09:57 | |
| *** guohliu has joined #openstack-infra | 10:03 | |
| *** che-arne has quit IRC | 10:06 | |
| *** guohliu has quit IRC | 10:09 | |
| *** SlickNik has quit IRC | 10:55 | |
| *** SlickNik has joined #openstack-infra | 10:56 | |
| *** fifieldt has quit IRC | 11:00 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: refactor templates into query_builder https://review.openstack.org/52818 | 11:36 |
| *** marun has joined #openstack-infra | 11:44 | |
| *** ben_duyujie has quit IRC | 12:12 | |
| *** basha has joined #openstack-infra | 12:18 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: refactor templates into query_builder https://review.openstack.org/52818 | 12:18 |
| *** adalbas has joined #openstack-infra | 12:30 | |
| *** basha has quit IRC | 12:36 | |
| *** thomasm has joined #openstack-infra | 12:45 | |
| *** thomasm is now known as Guest25369 | 12:45 | |
| *** CaptTofu has joined #openstack-infra | 12:51 | |
| *** basha has joined #openstack-infra | 13:04 | |
| *** CaptTofu has quit IRC | 13:06 | |
| *** CaptTofu has joined #openstack-infra | 13:07 | |
| *** CaptTofu_ has joined #openstack-infra | 13:10 | |
| *** CaptTofu has quit IRC | 13:11 | |
| *** CaptTofu_ has quit IRC | 13:13 | |
| *** CaptTofu has joined #openstack-infra | 13:14 | |
| *** CaptTofu has quit IRC | 13:18 | |
| *** dirk has joined #openstack-infra | 13:19 | |
| *** basha has quit IRC | 13:25 | |
| *** basha has joined #openstack-infra | 13:32 | |
| *** basha has quit IRC | 13:35 | |
| *** w_ has joined #openstack-infra | 13:55 | |
| *** dims has joined #openstack-infra | 13:55 | |
| *** olaph has quit IRC | 13:55 | |
| *** nicedice has quit IRC | 14:02 | |
| *** dcramer_ has quit IRC | 14:10 | |
| openstackgerrit | David Kranz proposed a change to openstack-infra/elastic-recheck: Test that git review works https://review.openstack.org/52820 | 14:15 |
| mordred | LinuxJedi: because of fail | 14:45 |
| mordred | LinuxJedi: sounds like someone using a VERY old version of our puppet scripts :) | 14:45 |
| LinuxJedi | ++ | 14:47 |
| *** dcramer_ has joined #openstack-infra | 14:51 | |
| *** thomasbiege has joined #openstack-infra | 14:59 | |
| *** dirk has quit IRC | 15:06 | |
| *** cody-somerville has quit IRC | 15:09 | |
| *** nicedice has joined #openstack-infra | 15:09 | |
| *** dims has quit IRC | 15:23 | |
| *** dims has joined #openstack-infra | 15:23 | |
| *** thomasbiege has quit IRC | 15:25 | |
| *** dkliban has quit IRC | 15:26 | |
| *** dirk has joined #openstack-infra | 15:26 | |
| openstackgerrit | A change was merged to openstack/requirements: Update WSME deps to 0.5b6 https://review.openstack.org/52141 | 15:27 |
| *** SergeyLukjanov has joined #openstack-infra | 15:38 | |
| *** dirk has quit IRC | 15:43 | |
| *** dirk has joined #openstack-infra | 15:43 | |
| *** wenlock has joined #openstack-infra | 15:55 | |
| *** dcramer_ has quit IRC | 15:59 | |
| *** senk has joined #openstack-infra | 16:05 | |
| *** harlowja_at_home has joined #openstack-infra | 16:10 | |
| *** DennyZhang has joined #openstack-infra | 16:10 | |
| *** dcramer_ has joined #openstack-infra | 16:12 | |
| *** harlowja_at_home has quit IRC | 16:16 | |
| *** senk has quit IRC | 16:23 | |
| *** Ng has quit IRC | 16:29 | |
| *** DennyZhang has quit IRC | 16:29 | |
| *** Ng has joined #openstack-infra | 16:29 | |
| *** SergeyLukjanov has quit IRC | 16:30 | |
| *** dirk has quit IRC | 16:37 | |
| *** yolanda has joined #openstack-infra | 16:49 | |
| *** dkliban has joined #openstack-infra | 16:55 | |
| *** basha has joined #openstack-infra | 17:10 | |
| *** yolanda has quit IRC | 17:14 | |
| *** dcramer_ has quit IRC | 17:17 | |
| *** FallenPegasus has joined #openstack-infra | 17:26 | |
| *** dkliban has quit IRC | 17:38 | |
| *** davidhadas has joined #openstack-infra | 17:54 | |
| *** nati_ueno has joined #openstack-infra | 17:59 | |
| *** FallenPegasus has quit IRC | 18:14 | |
| *** wenlock has quit IRC | 18:20 | |
| *** sdake has quit IRC | 18:21 | |
| *** basha has quit IRC | 18:45 | |
| *** SlickNik has quit IRC | 18:57 | |
| *** SlickNik has joined #openstack-infra | 18:57 | |
| *** adalbas has quit IRC | 19:04 | |
| *** SlickNik has quit IRC | 19:08 | |
| *** SlickNik has joined #openstack-infra | 19:09 | |
| *** wenlock has joined #openstack-infra | 19:24 | |
| *** fallenpegasus has joined #openstack-infra | 19:32 | |
| *** adalbas has joined #openstack-infra | 19:49 | |
| *** fallenpegasus has quit IRC | 19:54 | |
| *** adalbas has quit IRC | 19:57 | |
| *** yamahata has joined #openstack-infra | 20:02 | |
| *** changbl has quit IRC | 20:02 | |
| *** changbl has joined #openstack-infra | 20:13 | |
| *** Ryan_Lane has joined #openstack-infra | 20:19 | |
| *** CaptTofu has joined #openstack-infra | 20:23 | |
| *** changbl has quit IRC | 20:29 | |
| *** akscram has quit IRC | 20:30 | |
| *** akscram has joined #openstack-infra | 20:31 | |
| *** weshay has quit IRC | 20:41 | |
| *** changbl has joined #openstack-infra | 20:41 | |
| *** dkehn_ has joined #openstack-infra | 20:54 | |
| *** dkehn has quit IRC | 20:57 | |
| *** dkehn__ has joined #openstack-infra | 21:04 | |
| *** dkehn__ is now known as dkehn | 21:04 | |
| *** marun has quit IRC | 21:06 | |
| *** dkehn_ has quit IRC | 21:08 | |
| *** nati_ueno has quit IRC | 21:26 | |
| *** nati_ueno has joined #openstack-infra | 21:27 | |
| *** nati_ueno has quit IRC | 21:32 | |
| *** Loquacity has joined #openstack-infra | 21:53 | |
| *** Loquacity has quit IRC | 21:58 | |
| *** Loquacious has joined #openstack-infra | 21:58 | |
| *** Loquacities has quit IRC | 21:59 | |
| *** senk has joined #openstack-infra | 22:08 | |
| *** Loquacious has quit IRC | 22:14 | |
| *** Loquacity has joined #openstack-infra | 22:14 | |
| *** slong has joined #openstack-infra | 22:43 | |
| *** zehicle has quit IRC | 22:44 | |
| *** cody-somerville has joined #openstack-infra | 22:53 | |
| *** vipul is now known as vipul-away | 22:54 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: add elasticRecheck fake pyelasticsearch testing https://review.openstack.org/52844 | 23:04 |
| *** vipul-away is now known as vipul | 23:05 | |
| *** yamahata has quit IRC | 23:08 | |
| harlowja | since u guys probably want to know what the thing i made looks like, https://github.com/harlowja/gerrit_view#curse_gerrit :) | 23:08 |
| harlowja | u guys might find it useful :) | 23:09 |
| *** senk has quit IRC | 23:14 | |
| *** yamahata has joined #openstack-infra | 23:14 | |
| *** CaptTofu has quit IRC | 23:17 | |
| *** CaptTofu has joined #openstack-infra | 23:18 | |
| *** CaptTofu has quit IRC | 23:18 | |
| *** CaptTofu has joined #openstack-infra | 23:18 | |
| *** CaptTofu has quit IRC | 23:20 | |
| *** CaptTofu has joined #openstack-infra | 23:20 | |
| *** fifieldt has joined #openstack-infra | 23:21 | |
| zaro | harlowja: hmm, looks interesting. what's the difference between using that and the gerrit web ui? | 23:28 |
| harlowja | realtimeness | 23:28 |
| harlowja | and comments automatically showup and stuff | 23:29 |
| harlowja | and statuses automatically change, basically this is a notify method, instead of a pull method (via browser) | 23:30 |
| zaro | cool. thx. | 23:35 |
| harlowja | np, if u have a big monitor (or extra monitor), neat to just use it there, ha | 23:35 |
| harlowja | or an extra terminal window | 23:36 |
| *** yolanda has joined #openstack-infra | 23:36 | |
| *** boris-42 has quit IRC | 23:37 | |
| *** davidhadas has quit IRC | 23:38 | |
| *** alexpilotti has quit IRC | 23:38 | |
| *** harlowja has quit IRC | 23:40 | |
| *** harlowja has joined #openstack-infra | 23:42 | |
| *** yamahata has quit IRC | 23:57 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!