| *** enikanorov__ has joined #openstack-infra | 00:00 | |
| clarkb | fungi: really quick before I do 01, precise15 is offline. Should I reboot it before upgrading 01? | 00:00 |
|---|---|---|
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 00:00 | |
| clarkb | fungi: worried that it will come online after reboot and be unhappy | 00:00 |
| zzelle | clarkb: better than curl -XHEAD ... git remote prune -n gerrit | 00:00 |
| zzelle | ! | 00:00 |
| zzelle | protocol independant | 00:01 |
| zzelle | :) | 00:01 |
| clarkb | oh neat | 00:01 |
| zzelle | i will propose the change tomorrow | 00:02 |
| clarkb | hrm precise15 seems hard donw | 00:02 |
| clarkb | fungi: I am going to remove it from 01 | 00:02 |
| *** enikanorov_ has quit IRC | 00:03 | |
| *** lcheng has joined #openstack-infra | 00:03 | |
| fungi | okay | 00:03 |
| clarkb | fungi: very close to doing the upgrade | 00:04 |
| *** CaptTofu_ has joined #openstack-infra | 00:05 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: only print unrecognized errors in gate https://review.openstack.org/70258 | 00:06 |
| fungi | hpcloud-az2 finally managed to get a bare-precise image to stick | 00:06 |
| fungi | took almost 24 hours of constant rebuild attempts to get there | 00:06 |
| jog0 | anyone have an idea of what ' bad DHCP host name at line 1 of /opt/stack/data/nova/networks/nova-br100.conf' means | 00:07 |
| jog0 | http://logs.openstack.org/51/63551/6/gate/gate-tempest-dsvm-postgres-full/4860441/logs/syslog.txt.gz | 00:07 |
| clarkb | jog0: going to guess a dhcp server offered a bad hostname to the host | 00:07 |
| clarkb | like it didn't follow dns rules or something | 00:07 |
| jog0 | whose dhcp server nova-network or something | 00:07 |
| *** CaptTofu has quit IRC | 00:08 | |
| clarkb | could be any that can talk to that network I expect | 00:08 |
| *** ryanpetrello has quit IRC | 00:08 | |
| clarkb | rogue dhcp servers are evil | 00:08 |
| * jog0 files yet another bug | 00:08 | |
| jog0 | clarkb: btw http://logs.openstack.org/18/70218/2/gate/gate-elastic-recheck-docs/216dabe/console.html | 00:08 |
| jog0 | why is launchpadlib coming from launchpad.net? | 00:08 |
| jog0 | and not our mirror | 00:08 |
| clarkb | jog0: because elastic-recheck isn't gated by the mirror and I bet launchpadlib isnt on our mirror | 00:09 |
| clarkb | because openstack itself does not use launchpadlib | 00:09 |
| clarkb | jog0: for infra projects and stackforge and so on we configure them to use the mirror but to fallback on pypi for things not in the mirror | 00:09 |
| jog0 | clarkb: ahh | 00:10 |
| jog0 | its not in our mirror | 00:10 |
| jog0 | can we add it? | 00:10 |
| *** virmitio has quit IRC | 00:10 | |
| clarkb | jog0: no, openstack doesn't need it | 00:10 |
| *** cody-somerville has quit IRC | 00:10 | |
| jog0 | openstack-infra | 00:10 |
| jog0 | http://pypi.openstack.org/openstack-infra/ | 00:10 |
| *** thuc has quit IRC | 00:10 | |
| clarkb | jog0: pretty sure that isn't a think anymore | 00:11 |
| *** thuc has joined #openstack-infra | 00:11 | |
| clarkb | need someway to build different mirrors on the same host | 00:11 |
| clarkb | fungi: do you know? | 00:11 |
| *** nati_ueno has quit IRC | 00:11 | |
| clarkb | slow tempest is slow, waiting on one job before 01 upgrade | 00:12 |
| fungi | i think the intent was to add a mirror for infra projects there, with a separate requirements list | 00:12 |
| fungi | but we never got that far | 00:12 |
| clarkb | fungi: there are a couple hpcloud offline nodes on 01, should I delete those from jenkins manually to be safe? | 00:13 |
| jog0 | fungi: ahh thanks | 00:14 |
| jog0 | so I will just live with a bad launchpad, thanks | 00:15 |
| *** NikitaKonovalov is now known as NikitaKonovalov_ | 00:15 | |
| *** thuc has quit IRC | 00:15 | |
| *** CaptTofu_ has quit IRC | 00:16 | |
| *** ArxCruz has joined #openstack-infra | 00:16 | |
| notmyname | sdague: I just replied to your logging format thread. I've got a suggestion at the bottom of the message (the top is responding to the specific swift question) | 00:16 |
| fungi | clarkb: yes | 00:18 |
| *** lttrl has joined #openstack-infra | 00:18 | |
| fungi | clarkb: i've been manually deleting any offline nodes from a jenkins master if i restart it | 00:18 |
| clarkb | fungi: thanks doing that now | 00:19 |
| fungi | nodepool has 4 nodes remaining on jenkns01 | 00:19 |
| fungi | i'll clear those out | 00:19 |
| *** nati_ueno has joined #openstack-infra | 00:19 | |
| clarkb | still waiting on one job | 00:19 |
| *** oanufriev has joined #openstack-infra | 00:19 | |
| fungi | okay | 00:20 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add option to elastic-recheck-graph to pick a single queue https://review.openstack.org/70218 | 00:20 |
| fungi | once it's done i'll delete the dead nodes in nodepool | 00:20 |
| fungi | looks like it's the one used node nodepool knows about there | 00:21 |
| *** nati_ueno has quit IRC | 00:22 | |
| *** zzelle has quit IRC | 00:23 | |
| *** nati_ueno has joined #openstack-infra | 00:23 | |
| *** melwitt has joined #openstack-infra | 00:23 | |
| *** matsuhashi has joined #openstack-infra | 00:24 | |
| *** dizquierdo has quit IRC | 00:25 | |
| fungi | that job failed. uploading logs now | 00:26 |
| clarkb | I think it passed | 00:26 |
| clarkb | the Failed you see there is from the log checker which is disavled right now | 00:27 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Remove extra '%' in uncategorized template https://review.openstack.org/70266 | 00:27 |
| fungi | oh, right | 00:27 |
| fungi | hurr | 00:27 |
| fungi | it does say "ok" | 00:27 |
| *** CaptTofu has joined #openstack-infra | 00:27 | |
| fungi | looks like precisepy3k-3 i marked offline too | 00:29 |
| *** thedodd has quit IRC | 00:29 | |
| lifeless | fungi: thanks :) | 00:30 |
| *** mattoliverau has quit IRC | 00:30 | |
| clarkb | fungi: it seems to unping as well. I will delete it from jenkins | 00:30 |
| fungi | yeah, i can't get a response from it | 00:30 |
| clarkb | fungi: that leaves the dfw node that just finished its job, should I wait a minute for nodepool to clean it up? | 00:30 |
| fungi | lifeless: yw | 00:30 |
| *** dims has quit IRC | 00:31 | |
| fungi | clarkb: looks like it's deleted now? | 00:31 |
| clarkb | fungi: it is, ready for upgrade? | 00:31 |
| fungi | you bet | 00:31 |
| clarkb | ok stopping jenkins | 00:31 |
| openstackgerrit | Jim Branen proposed a change to openstack/requirements: Use new hplefthandclient https://review.openstack.org/70268 | 00:32 |
| *** dims has joined #openstack-infra | 00:32 | |
| clarkb | of course jenkins didn't actually die | 00:32 |
| clarkb | jenkins is starting now | 00:33 |
| *** lttrl has quit IRC | 00:33 | |
| fungi | yeah | 00:34 |
| fungi | it's been about 50/50 for me whether i sometimes need to sigsegv it | 00:34 |
| *** sarob has joined #openstack-infra | 00:34 | |
| fungi | ignored repeated sigterm and sighup | 00:34 |
| clarkb | seems up, now we wait for jorbs | 00:35 |
| *** rnirmal has quit IRC | 00:35 | |
| *** rnirmal has joined #openstack-infra | 00:35 | |
| *** lcheng has quit IRC | 00:35 | |
| fungi | jeorrrrrb | 00:35 |
| *** rnirmal has quit IRC | 00:35 | |
| * fungi forgot about coach z | 00:36 | |
| clarkb | woot it is running jobs | 00:36 |
| clarkb | fungi: should I put jenkins.o.o in shutdown mode now? | 00:37 |
| jog0 | fungi: https://encrypted-tbn2.gstatic.com/images?q=tbn:ANd9GcTj42FKcoz64hwok05p9p5wkHSKto1IitQrTbVfDLM1f_PorEM5 ? | 00:37 |
| jog0 | homestar | 00:37 |
| clarkb | actualyl I will wait a bit as a bunch of stuff is in post now and jenkins.o.o handles about half those jobs | 00:37 |
| fungi | clarkb: sure. it should go very quickly ;) | 00:37 |
| fungi | oh? | 00:37 |
| clarkb | fungi: yeah I will let the jobs in post clear first | 00:37 |
| clarkb | but it should be a quick one | 00:38 |
| fungi | right, translation proposals | 00:38 |
| jog0 | clarkb: do we log libvirtd.txt | 00:40 |
| jog0 | err logstash it | 00:40 |
| clarkb | no that is brand new and no one wrote rulse for it | 00:40 |
| *** atiwari has quit IRC | 00:41 | |
| fungi | yeah, we only just started collecting those to the logs.o.o site in the last 24 hours or so | 00:42 |
| jog0 | clarkb fungi: ahh | 00:43 |
| jog0 | those logs may be very helpful already | 00:43 |
| jog0 | a 'qemuMonitorIORead:513 : Unable to read from monitor: Connection reset by peer' matches up with Build of instance c576c184-5fda-49ac-953c-564c2c794e83 aborted: Instance disappeared during build | 00:43 |
| jog0 | clarkb: how do I wrote rules to get that in eS | 00:44 |
| clarkb | jog0: https://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/templates/logstash/indexer.conf.erb or some such | 00:44 |
| clarkb | jog0: there is a filters section, you will want to have a libvirt tag, then have an if block that says if libvirt in tags then process this way | 00:45 |
| *** lttrl has joined #openstack-infra | 00:45 | |
| StevenK | jog0: Hai, I've updated https://review.openstack.org/#/c/69060/ , do you want a put a stamp on it? | 00:45 |
| bradm | so, if I wanted to start helping out with infra stuff, where would be a good place to start? | 00:46 |
| jog0 | StevenK: ask me again tomorrow | 00:46 |
| jog0 | stuck in debug land | 00:46 |
| clarkb | bradm: the bug tracker for openstack-ci on launchpad has bugs tagged low-hanging-fruit, those are good palces to get your feet wet | 00:46 |
| jog0 | clarkb: cool I will take a whack at it | 00:46 |
| clarkb | jog0: gl, and happy to help more as what I said above was really simple :) | 00:47 |
| jog0 | just filed a super generic bug https://bugs.launchpad.net/nova/+bug/1274772 | 00:47 |
| bradm | clarkb: cool, I'll have a look and see if there's anything there I can help out with | 00:47 |
| *** CaptTofu has quit IRC | 00:49 | |
| jog0 | whoa there is something at http://storyboard.openstack.org/#!/ | 00:49 |
| clarkb | jog0: I think it is still mostly a mock up | 00:49 |
| jog0 | purty | 00:49 |
| jog0 | clarkb: a really nice mockup | 00:49 |
| fungi | BAM! | 00:49 |
| *** mrodden has quit IRC | 00:50 | |
| fungi | oh, yeah that looks like the old mock-up still | 00:50 |
| jog0 | clarkb: where do thetags coe from? | 00:51 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Remove extra '%' in uncategorized template https://review.openstack.org/70266 | 00:52 |
| clarkb | jog0: they come from the gearman-log-client config files over in modules/openstack_project/files/logstash | 00:52 |
| clarkb | er actually they may be in modules/log_processing/files now | 00:53 |
| StevenK | jog0: Hm. Except tomorrow is Saturday. :-( | 00:53 |
| *** gokrokve has quit IRC | 00:53 | |
| clarkb | jog0: but you will need to add the libvirt file there and you can specify that the tag is libvirt or whatever | 00:53 |
| *** gokrokve has joined #openstack-infra | 00:53 | |
| clarkb | fungi: meh these jobs are taking too long, you ok for me to put jenkins.o.o in shutdown mode? | 00:54 |
| jog0 | clarkb: out_event["tags"] = [fileopts['name']] + fileopts.get('tags', []) | 00:55 |
| jog0 | so the libvirt tag should automatically appear? | 00:55 |
| clarkb | jog0: the filename will appear, I have been giving things more generic tags so that if the filename chagnes nothing breaks (eg grenade logs) | 00:55 |
| jog0 | clarkb: ahh modules/openstack_project/files/logstash/jenkins-log-client.yaml: | 00:57 |
| jog0 | StevenK: if you can fix libvirt errors I will review your patch rght now :) | 00:57 |
| jog0 | StevenK: http://logs.openstack.org/51/63551/6/gate/gate-tempest-dsvm-postgres-full/4860441/logs/libvirtd.txt.gz | 00:57 |
| *** gokrokve has quit IRC | 00:58 | |
| *** yamahata has quit IRC | 00:59 | |
| fungi | clarkb: i guess--they keep piling up | 00:59 |
| *** CaptTofu has joined #openstack-infra | 00:59 | |
| fungi | though in good news, that means we're merging a lot of changes | 01:00 |
| branen | Does anyone know how tests/files/gr-base.txt in project requirements is used? | 01:00 |
| *** dcramer_ has joined #openstack-infra | 01:00 | |
| clarkb | fungi: put it in shutdown mode | 01:00 |
| fungi | clarkb: i see that. cool | 01:01 |
| jog0 | clarkb: this is easy wow | 01:01 |
| *** markmcclain has quit IRC | 01:01 | |
| *** markmcclain has joined #openstack-infra | 01:02 | |
| *** slong has quit IRC | 01:03 | |
| *** lttrl has quit IRC | 01:03 | |
| *** harlowja is now known as harlowja_away | 01:04 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/config: Add logstash rules to parse libvirtd.txt https://review.openstack.org/70276 | 01:04 |
| jog0 | clarkb: ^ first pass | 01:04 |
| clarkb | fungi: ok jenkins.o.o is done, stopping and upgrading it now | 01:05 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/config: Add logstash rules to parse libvirtd.txt https://review.openstack.org/70276 | 01:06 |
| clarkb | fungi: starting up now | 01:07 |
| *** wenlock has quit IRC | 01:10 | |
| *** hogepodge has quit IRC | 01:11 | |
| *** nati_uen_ has joined #openstack-infra | 01:11 | |
| *** nati_ueno has quit IRC | 01:14 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/config: Add logstash rules to parse libvirtd.txt https://review.openstack.org/70276 | 01:16 |
| *** ArxCruz has quit IRC | 01:17 | |
| clarkb | fungi: it seems happy, all of jenkinses are running the same versions of stuff now | 01:17 |
| fungi | excellent | 01:18 |
| *** harlowja_away is now known as harlowja | 01:26 | |
| clarkb | I am going to switch to doing chores around the apartment now | 01:28 |
| *** oubiwann_ has joined #openstack-infra | 01:29 | |
| *** salv-orlando has quit IRC | 01:30 | |
| *** CaptTofu_ has joined #openstack-infra | 01:31 | |
| *** CaptTofu has quit IRC | 01:31 | |
| * fungi has already done so. i'm afraid i've been neglecting my living conditions for weeks now | 01:33 | |
| *** nati_uen_ has quit IRC | 01:36 | |
| *** mrodden has joined #openstack-infra | 01:37 | |
| *** mrodden1 has joined #openstack-infra | 01:39 | |
| *** markmcclain has quit IRC | 01:40 | |
| *** mrodden has quit IRC | 01:41 | |
| *** nosnos has joined #openstack-infra | 01:41 | |
| harlowja | clarkb fungi is it possible to check that zookeeper is running after that zookeeperd change? | 01:45 |
| harlowja | a test that i have that should be finding it doesn't appear to be running, so just wanted to verify | 01:45 |
| fungi | harlowja: sure, let me see when it merged | 01:46 |
| harlowja | fungi https://review.openstack.org/#/c/70022/ | 01:47 |
| *** mrodden has joined #openstack-infra | 01:47 | |
| *** mrodden1 has quit IRC | 01:47 | |
| fungi | yeah, i'm just seeing if it was long enough ago as to be before we built fresh images | 01:47 |
| harlowja | fungi ah, k, is that outside of the usual 45min cycle? | 01:48 |
| fungi | if it's configuration being applied to a single-use node type, those are built from cached images generated every day | 01:48 |
| *** luisg has quit IRC | 01:48 | |
| *** luisg has joined #openstack-infra | 01:49 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/gerritlib: add getVersion and listPlugin commands and update replicate command https://review.openstack.org/69768 | 01:50 |
| harlowja | fungi ah | 01:50 |
| fungi | harlowja: looks like it's there... http://paste.openstack.org/show/62213/ | 01:50 |
| *** melwitt has quit IRC | 01:50 | |
| harlowja | fungi k, let me check a test again | 01:51 |
| harlowja | or recheck it to make it run (since it ran earlier today) | 01:51 |
| fungi | i don't remember what socket you said it listens on, so there's a netstat for you | 01:51 |
| harlowja | ya, 2181 | 01:51 |
| fungi | it's open then | 01:52 |
| harlowja | fungi agreed, thx, let me do some further investigation | 01:52 |
| *** homeless has quit IRC | 01:54 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/gerritlib: add getVersion and listPlugin commands and update replicate command https://review.openstack.org/69768 | 01:56 |
| *** markwash has quit IRC | 02:02 | |
| *** markwash has joined #openstack-infra | 02:03 | |
| *** yamahata has joined #openstack-infra | 02:03 | |
| *** lcheng has joined #openstack-infra | 02:08 | |
| *** sarob has quit IRC | 02:12 | |
| lifeless | taking the tripleo testenvs offline temporarily | 02:12 |
| lifeless | scaling it up by 10 | 02:12 |
| *** sarob has joined #openstack-infra | 02:12 | |
| * lifeless watches the undercloud meltdown | 02:13 | |
| lifeless | I'm betting on a keystone fail | 02:14 |
| jog0 | lifeless: you should become a bookie on betting these things | 02:14 |
| jog0 | it could be fun, we are seeing libvirt in gate | 02:14 |
| lifeless | yay | 02:15 |
| clarkb | seeing libvirt in gate? | 02:15 |
| jog0 | clarkb: libvirt issues | 02:15 |
| clarkb | with 0.9.8? | 02:15 |
| jog0 | at leaast that is the hunch , that and kernel | 02:15 |
| jog0 | yup | 02:15 |
| lifeless | # nova list | 02:16 |
| lifeless | ERROR: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-56542813-88b7-47ae-a972-8aec5b79c2a7) | 02:16 |
| jog0 | clarkb: btw have you seen https://twitter.com/taturiello | 02:16 |
| lifeless | ERROR nova.api.openstack [req-56542813-88b7-47ae-a972-8aec5b79c2a7 2de96ce5da99 | 02:16 |
| lifeless | 4575a08447c93bcafd53 4956c533154c476799c688eda7ed65ab] Caught error: Connection to neutron failed: Maximum attem | 02:16 |
| lifeless | pts reached | 02:16 |
| jog0 | lifeless: clarkb: http://logs.openstack.org/51/63551/6/gate/gate-tempest-dsvm-postgres-full/4860441/logs/libvirtd.txt.gz too many errors | 02:16 |
| lifeless | 'yay' | 02:17 |
| jog0 | lifeless: whee, | 02:17 |
| jog0 | it could still be keystone underneath | 02:17 |
| lifeless | jog0: has been in the past, yeah | 02:17 |
| *** sarob has quit IRC | 02:17 | |
| lifeless | at least all the ports appear to have wired up in the deployment properly | 02:17 |
| jog0 | lifeless: you would like the solution here https://bugs.launchpad.net/neutron/+bug/1273386 | 02:18 |
| lifeless | jog0: we have WILDLY different definitions of 'like' | 02:18 |
| *** oanufriev has quit IRC | 02:18 | |
| jog0 | lifeless: use ext4? | 02:18 |
| lifeless | jog0: cause, I LOVE that one :) | 02:18 |
| *** thedodd has joined #openstack-infra | 02:18 | |
| jog0 | ^_^ | 02:18 |
| lifeless | but | 02:19 |
| jog0 | clarkb: I think that one may need a infra bug? ext3=>ext4 | 02:19 |
| clarkb | jog0: ? | 02:19 |
| clarkb | we don't do ext4 because openstack | 02:19 |
| jog0 | clarkb: read end of https://bugs.launchpad.net/neutron/+bug/1273386 | 02:19 |
| jog0 | clarkb: ohhh do tell | 02:19 |
| jog0 | the fun never ends | 02:19 |
| lifeless | https://review.openstack.org/#/c/70239/ | 02:19 |
| clarkb | that is fing hilarious | 02:19 |
| clarkb | openstack refuses to default to ext4 so our clouds give us ext3 | 02:20 |
| clarkb | if openstack wants ext4 they should change their defaults | 02:20 |
| harlowja | hmmm, fungi, ok something interesting, if u have a sec on that zookeeper machine, seeing 'Connection dropped: socket connection error: Connection refused' , is it possible to see if u can access 2181 from inside the box? | 02:20 |
| jog0 | lifeless: tried that haha | 02:20 |
| lifeless | jog0: not sure whats up with grenade in that | 02:20 |
| harlowja | fungi http://logs.openstack.org/17/70017/4/check/gate-taskflow-python33/f43a2cf/console.html | 02:20 |
| clarkb | jog0: while we could fix it in infra, I feel that on principle we souldned | 02:20 |
| jog0 | lifeless: grenade? | 02:20 |
| lifeless | jog0: you did? That should have totally disabled file injection | 02:20 |
| clarkb | *shouldn't. our clouds will catch up in about 10 days if openstack fixes it | 02:20 |
| *** crank has quit IRC | 02:20 | |
| lifeless | jog0: look at the jenkins output | 02:20 |
| harlowja | fungi i can give u a command or 2 to try, if u want | 02:21 |
| clarkb | also can you sanely ermout / anyways? | 02:21 |
| *** crank has joined #openstack-infra | 02:21 | |
| jog0 | lifeless: which jenkins output -- too much multitasking | 02:21 |
| lifeless | jog0: you said you'd tried disabling file injection, when I pointed you at my patch for that. | 02:22 |
| lifeless | jog0: I said I don't know whats up with grenade, which barfed post-upgrade on that patchset | 02:22 |
| clarkb | lifeless: did you see the ext4 thing above? I am sure you will eb entertained too | 02:22 |
| lifeless | clarkb: I am hilarity itself | 02:22 |
| jog0 | lifeless: I think we are getting converations crossed (or my brain is just crossing wires) where did I say the disable file injection | 02:23 |
| jog0 | and grenade output | 02:23 |
| jog0 | I was talking about ext4 | 02:23 |
| lifeless | ok, at least one broker seems to be back up | 02:23 |
| fungi | harlowja: i'll pop into one and try to open a socket | 02:23 |
| lifeless | jog0: ok, so I was pointing you at my patch to disable file injection by default | 02:23 |
| lifeless | jog0: which will entirely avoid the nbd question | 02:24 |
| harlowja | fungi much appreciated | 02:24 |
| clarkb | harlowja: what ip are you connecting to? | 02:24 |
| clarkb | not localhost will be firwalled | 02:24 |
| harlowja | 0.0.0.0:2181 | 02:24 |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Add support to list running jobs to zuul client https://review.openstack.org/68828 | 02:24 |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Allow workers to send back metadata https://review.openstack.org/66173 | 02:24 |
| harlowja | clarkb https://review.openstack.org/#/c/70017/5/taskflow/tests/unit/persistence/test_zk_persistence.py | 02:24 |
| clarkb | harlowja: I wonder if using localhost:2181 would make a difference (not sure how the kernel deal with wildcard dests) | 02:25 |
| harlowja | see def _zookeeper_exists(): | 02:25 |
| fungi | harlowja: http://paste.openstack.org/show/62214/ | 02:25 |
| harlowja | hmmmm | 02:25 |
| harlowja | odd, let me try localhost again | 02:25 |
| jog0 | lifeless: ohh right, I haven't looked at that too much actually -- been in bug hunter mode | 02:26 |
| lifeless | jog0: but apparently it made grenade have a hernia | 02:26 |
| lifeless | jog0: so it needs some deeper probing | 02:26 |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Add support to list running jobs to zuul client https://review.openstack.org/68828 | 02:27 |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Allow workers to send back metadata https://review.openstack.org/66173 | 02:27 |
| jog0 | lifeless: ahh https://review.openstack.org/#/c/70239/ | 02:28 |
| lifeless | jog0: yes | 02:28 |
| harlowja | fungi clarkb an idea a co-worker had, instead of doing these kind of probes for ports for mysql,postgres,zookeeper, is there anyway environment variables could be set (ZOOKEEPER_AVAILABLE_HERE) for example | 02:28 |
| *** kraman has quit IRC | 02:28 | |
| *** kraman has joined #openstack-infra | 02:29 | |
| clarkb | harlowja: you could do that, the problem with it is it adds overhead for people running tests | 02:29 |
| lifeless | harlowja: all things are possible | 02:29 |
| harlowja | :) | 02:29 |
| harlowja | sure | 02:29 |
| clarkb | fungi: I suppose we could set fstab to mount / as ext4 when we make the image | 02:29 |
| lifeless | harlowja: so in other projects I've created Fixtures to represent the running service | 02:29 |
| clarkb | then tests would run with ext3 mounted as ext4 | 02:29 |
| clarkb | but really we should push back on oepnstack being sane | 02:29 |
| lifeless | clarkb: just use glance, upload your own image | 02:30 |
| lifeless | clarkb: oh right, noone uses it :/ | 02:30 |
| harlowja | lifeless i created a microzookeeper in-memory 'server' also | 02:30 |
| harlowja | but still really nice to run against zookeeper :) | 02:30 |
| jog0 | lifeless: what happenend to you chaning the default? | 02:30 |
| jog0 | ext4 that is | 02:30 |
| lifeless | harlowja: and the fixture could look at environment variables to use an existing, or spin one up as needed | 02:30 |
| clarkb | sles happened | 02:30 |
| lifeless | harlowja: this worked very very well | 02:30 |
| lifeless | harlowja: we wrapped up postgresql, rabbitmq etc etc | 02:30 |
| jog0 | clarkb: and that is our problem? :( | 02:30 |
| fungi | clarkb: yeah, changing the fstype there will "fix" it on launch/boot | 02:31 |
| lifeless | jog0: apparently we support users running shit | 02:31 |
| clarkb | jog0: well a bunch of other people complained too | 02:31 |
| clarkb | lifeless: broken shit | 02:31 |
| harlowja | lifeless so it would actually install those services, or start them temporariliy or mock them? | 02:31 |
| lifeless | jog0: there was also an issue due to the 'default' image key not encodingnit the fs in the filename | 02:31 |
| jog0 | lifeless: ohhh right | 02:31 |
| lifeless | so things could get confused in non-greenfield setups | 02:31 |
| lifeless | harlowja: not install, start stop etc as appropriate | 02:31 |
| jog0 | sounds like we may have to push on this one to get into icehouse | 02:31 |
| harlowja | lifeless how does that work in parallel tests? | 02:32 |
| lifeless | jog0: so it needs a base logic fix, then a deprecation etc | 02:32 |
| jog0 | lifeless: right | 02:32 |
| lifeless | harlowja: so you run each one on a unique port | 02:32 |
| harlowja | lifeless ah, k, that would work | 02:32 |
| lifeless | harlowja: for instance | 02:32 |
| lifeless | https://launchpad.net/rabbitfixture | 02:32 |
| lifeless | harlowja: http://bazaar.launchpad.net/~lazr-developers/rabbitfixture/trunk/view/head:/rabbitfixture/server.py | 02:33 |
| harlowja | cool | 02:33 |
| lifeless | in your test you just do | 02:33 |
| *** kraman has quit IRC | 02:33 | |
| lifeless | with RabbitServer(): | 02:33 |
| lifeless | code here has a running rabbit | 02:33 |
| clarkb | though hpcloud is ext4 iirc | 02:34 |
| *** matsuhashi has quit IRC | 02:34 | |
| lifeless | or | 02:34 |
| clarkb | do we have trouble on hpcloud? | 02:34 |
| lifeless | rabbit = self.useFixture(RabbitServer)): | 02:34 |
| lifeless | ... | 02:34 |
| harlowja | lifeless ya, looks nice | 02:34 |
| lifeless | clarkb: hpcloud's ubuntu images will be ext4 because thats the base they import, AIUI | 02:34 |
| *** sarob has joined #openstack-infra | 02:35 | |
| lifeless | harlowja: I really like that idiom | 02:35 |
| lifeless | :> | 02:35 |
| jog0 | lifeless: so looking at the grenade blowup | 02:35 |
| harlowja | lifeless i'd imagine oslo.messaging needs something like this, taskflow maybe soon too | 02:35 |
| jog0 | http://logs.openstack.org/39/70239/1/check/check-grenade-dsvm/6f4b3bf/console.html | 02:35 |
| lifeless | harlowja: I'm happy to show people existing code/advise etc | 02:35 |
| harlowja | def | 02:35 |
| jog0 | look at this req-id req-c418c670-7669-4aeb-8d20-64422579aefe in http://logs.openstack.org/39/70239/1/check/check-grenade-dsvm/6f4b3bf/logs/new/screen-n-sch.txt.gz | 02:35 |
| lifeless | harlowja: I don't have cycles to commit to doing new ones up myself atm | 02:35 |
| harlowja | lifeless its either that or hope that the kombu in-memory approach is ok | 02:36 |
| jog0 | lifeless: ahh the compute node stopped reporting | 02:36 |
| lifeless | jog0: recheck? new bug | 02:36 |
| lifeless | ? | 02:37 |
| *** matsuhas_ has joined #openstack-infra | 02:37 | |
| jog0 | lifeless: not sure | 02:37 |
| jog0 | to the logstash | 02:37 |
| jog0 | has not been heard from in a while | 02:37 |
| jog0 | 2014-01-30 23:26:08.816 INFO nova.filters [req-c4e395ce-522e-4416-b972-2fb7210ccf33 ServersTestManualDisk-1356459449 ServersTestManualDisk-745008596] Filter ComputeFilter returned 0 hosts | 02:37 |
| lifeless | we're running with this config applied | 02:37 |
| lifeless | in ci-overcloud | 02:37 |
| jog0 | err has not been heard from in a while | 02:37 |
| lifeless | and while we have issues, its not nova-compute shutting up shop :) | 02:37 |
| lifeless | it's things like mellanox card firmware deciding it wants a holiday | 02:37 |
| openstackgerrit | A change was merged to openstack-infra/devstack-gate: Collect list of installed packages at end of run https://review.openstack.org/63551 | 02:38 |
| lifeless | 8 environments up | 02:38 |
| jog0 | lifeless: it looks like it has happend before | 02:38 |
| harlowja | ok, fungi enabled the test to make it happen, seeing that 'Connection time-out' happens, weird | 02:38 |
| clarkb | fungi: I can poke at prepare_node.sh to `sed -i 's/ext3/ext4/' /etc/fstab` | 02:39 |
| harlowja | http://logs.openstack.org/17/70017/7/check/gate-taskflow-python27/9d68cab/console.html | 02:39 |
| jog0 | message:"has not been heard from in a while" AND filename:"logs/screen-n-sch.txt" | 02:39 |
| clarkb | I shoudln't need to change anything else right? | 02:39 |
| harlowja | fungi thats to localhost:2181 | 02:39 |
| clarkb | I am not interested in doing a proper conversion | 02:39 |
| *** sarob has quit IRC | 02:39 | |
| harlowja | fungi anyway for u to create a venv on a slave, install kazoo and try to create a client using localhost? | 02:41 |
| * harlowja i am wondering if maybe not all the precise slaves have it running (could be?) | 02:41 | |
| lifeless | jog0: so, recheck ? | 02:41 |
| jog0 | lifeless: yup, looking for a bug number | 02:41 |
| jog0 | I don't see one | 02:41 |
| jog0 | so file one | 02:41 |
| lifeless | hmm 105 testenvs on one server. This is wrong :P | 02:41 |
| jog0 | don't do recehck no bug! | 02:42 |
| jog0 | lifeless: or the bug gods will smite you with rath | 02:42 |
| jog0 | wrath | 02:42 |
| fungi | clarkb: shouldn't need to, i wouldn't think, no | 02:42 |
| jog0 | lifeless: let me know the number and I will add some info | 02:42 |
| lifeless | https://bugs.launchpad.net/nova/+bug/1274798 | 02:43 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Mount ext3 filesystems as ext4 on single use slaves https://review.openstack.org/70283 | 02:43 |
| clarkb | fungi: jog0 ^ | 02:43 |
| *** sarob has joined #openstack-infra | 02:43 | |
| jog0 | clarkb: that was quick! | 02:43 |
| clarkb | I haven't tested that or anything but that should cover all of our clouds if they give us ext3 | 02:43 |
| fungi | harlowja: so of interest, the taskflow py27 unit tests seem to run on long-running slaves (not single-use), in the case of the log you linked it was precise23 | 02:43 |
| harlowja | hmmmm | 02:44 |
| fungi | harlowja: i'll see if something's "different" there | 02:44 |
| harlowja | qq, whats the diff between long-running? | 02:44 |
| *** thedodd has quit IRC | 02:44 | |
| jog0 | lifeless: haha | 02:44 |
| jog0 | nice bug report | 02:44 |
| jog0 | I can make it better | 02:44 |
| harlowja | lifeless what other fixtures exist out there on launchpad?? | 02:44 |
| *** sarob_ has joined #openstack-infra | 02:45 | |
| lifeless | harlowja: theres van.pg on pypi, which is a postgresql on | 02:45 |
| harlowja | cool | 02:45 |
| lifeless | harlowja: theres ones for selenium | 02:45 |
| harlowja | fungi i just enabled alot more logging (u can see what kazoo is doing), http://logs.openstack.org/17/70017/8/check/gate-taskflow-python27/28cc707/console.html | 02:45 |
| harlowja | search for 'ZK loop started' | 02:46 |
| lifeless | harlowja: theres my fixtures library, which is lower level plumbing http://pypi.python.org/pypi/fixtures | 02:46 |
| fungi | harlowja: http://paste.openstack.org/show/62216/ | 02:46 |
| jog0 | lifeless: so the n-cpu log just stops short | 02:46 |
| fungi | harlowja: i think it's crashing | 02:46 |
| lifeless | harlowja: theres a few wired up within the LP source, but they aren't likely to be super applicable | 02:46 |
| harlowja | ack | 02:46 |
| harlowja | u killed zookeeper | 02:46 |
| fungi | undeed | 02:46 |
| fungi | i'm looking at logs now | 02:47 |
| harlowja | k, let me know if i can help | 02:47 |
| fungi | java.io.FileNotFoundException: /var/lib/zookeeper/version-2/snapshot.0 (Permission denied) | 02:47 |
| harlowja | ah | 02:47 |
| harlowja | the zookeeper data storage area | 02:48 |
| *** sarob has quit IRC | 02:48 | |
| fungi | i assume is does need write access there... i wonder whether the package isn't setting it up correctly? | 02:48 |
| jog0 | lifeless clarkb: this looks fun http://logs.openstack.org/39/70239/1/check/check-grenade-dsvm/6f4b3bf/logs/syslog.txt.gz | 02:48 |
| jog0 | search for traceback | 02:48 |
| jog0 | swift dead | 02:48 |
| harlowja | fungi precise u said right, i am running linux mint, and didn't hit that error, wonder if that was a bug | 02:48 |
| lifeless | jog0: HTF does disabling file injection trigger that :P | 02:49 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Mount ext3 filesystems as ext4 on single use slaves https://review.openstack.org/70283 | 02:49 |
| jog0 | lifeless: it doesn't you hit a gate bug | 02:49 |
| fungi | harlowja: yeah, precise. somehow /var/lib/zookeeper/version-2 is root:root but /var/lib/zookeeper is zookeeper:zookeeper | 02:49 |
| jog0 | me thinks | 02:49 |
| *** mattoliverau has joined #openstack-infra | 02:49 | |
| harlowja | fungi arg, precise | 02:49 |
| *** sarob_ has quit IRC | 02:50 | |
| fungi | harlowja: though it didn't seem to do that on the single-use slaves | 02:50 |
| fungi | which are also precise | 02:50 |
| harlowja | weirdness | 02:50 |
| harlowja | is using single-use slaves ok? | 02:50 |
| clarkb | jog0: I have commented on the bug | 02:50 |
| jog0 | clarkb:sweet | 02:51 |
| jog0 | but your one bug behind | 02:51 |
| clarkb | ? | 02:51 |
| jog0 | http://logs.openstack.org/39/70239/1/check/check-grenade-dsvm/6f4b3bf/logs/syslog.txt.gz https://bugs.launchpad.net/nova/+bug/1274798 | 02:51 |
| harlowja | fungi the other thing is snapshots can be disabled | 02:51 |
| fungi | harlowja: should be fine. though i'm curious why this is broken... the last modified date on /var/lib/zookeeper/version-2 is december 13, fwiw | 02:51 |
| harlowja | tooooooz | 02:52 |
| *** crank has quit IRC | 02:52 | |
| harlowja | lol | 02:52 |
| openstackgerrit | Peter Portante proposed a change to openstack-infra/elastic-recheck: Add fingerprint for bug 1266616 (was bug 1273479) https://review.openstack.org/69670 | 02:52 |
| harlowja | only way for that to be that old is someone else was running zookeeper | 02:52 |
| *** crank has joined #openstack-infra | 02:52 | |
| harlowja | zookeeperd was installed yesterday | 02:52 |
| harlowja | sooo, only other user i know doing it is tooz | 02:52 |
| fungi | though the jenkins jobs don't have root access, so i suspect something with the zookeeper package setup | 02:53 |
| harlowja | ah | 02:53 |
| clarkb | clearly we should just use a thing that works | 02:53 |
| clarkb | to etcd! | 02:53 |
| fungi | i'll check the ownership being set for it on the single-use slaves, but if i reset ownership on those directories, maybe it will help | 02:54 |
| harlowja | clarkb ya, soon enough :( | 02:54 |
| harlowja | *i mean :) | 02:54 |
| harlowja | fungi sounds good, maybe it was just something that happend around december13th | 02:55 |
| harlowja | i think snapRetainCount=0 could also be done | 02:55 |
| fungi | the single-use slaves have zookeeper ownership on that dir, which seems sane. i'll just fix the long-running slaves real quick | 02:55 |
| harlowja | kk | 02:56 |
| harlowja | wonder how that happened :-/ | 02:56 |
| *** dcramer_ has quit IRC | 02:57 | |
| harlowja | thx fungi | 02:57 |
| fungi | and precise23 already has a snapshot.0 file now | 02:58 |
| *** VijayT has joined #openstack-infra | 02:58 | |
| fungi | go ahead and try again | 02:58 |
| harlowja | kk | 02:58 |
| fungi | i can telnet to the socket and not have it instadead | 02:58 |
| harlowja | woot | 02:58 |
| harlowja | are there fedora slaves that can be targeted to (like centos6)?? | 03:01 |
| clarkb | no | 03:01 |
| clarkb | you are welcome to fix the broken that is fedora though :) | 03:01 |
| harlowja | lol | 03:02 |
| clarkb | fungi: did you see that fedora now has a fedora account instead of root? I wish distros wouldn't do that | 03:02 |
| locke105 | isn't fedora broken by definition? | 03:02 |
| * clarkb waits for debian installer to give out debian accounts by default | 03:02 | |
| jog0 | gah no timestamps http://logs.openstack.org/39/70239/1/check/check-grenade-dsvm/6f4b3bf/logs/new/screen-s-proxy.txt.gz | 03:02 |
| jog0 | sigh | 03:02 |
| clarkb | jog0: check syslog | 03:02 |
| clarkb | proxy logs to syslog too | 03:03 |
| jog0 | http://logs.openstack.org/39/70239/1/check/check-grenade-dsvm/6f4b3bf/logs/syslog.txt.gz | 03:03 |
| jog0 | they rate limit | 03:03 |
| fungi | clarkb: i did not. how unfortunate | 03:03 |
| clarkb | fungi: I think you can still root but it yells at you similar to ubuntu | 03:03 |
| jog0 | and line length limit? | 03:03 |
| fungi | clarkb: you only need to connect to root once, so set up your toor account ;) | 03:04 |
| clarkb | jog0: line length limit should've been bumped | 03:04 |
| clarkb | but yes rsyslog us ugh | 03:04 |
| jog0 | clarkb: its not log enough ^_^ | 03:05 |
| clarkb | jog0: if you go too long it causes rsyslog to crash | 03:05 |
| clarkb | then everything fails | 03:05 |
| harlowja | fungi cool, i see zookeeper connections happening, woot, https://jenkins01.openstack.org/job/gate-taskflow-python27/1063/consoleText | 03:05 |
| harlowja | 'Zookeeper connection established, state: CONNECTED' | 03:05 |
| jog0 | clarkb: sigh | 03:05 |
| fungi | harlowja: good luck and happy hacking then | 03:06 |
| jog0 | portante: ping | 03:06 |
| harlowja | fungi thx much :) | 03:06 |
| fungi | np | 03:06 |
| *** matsuhashi has joined #openstack-infra | 03:07 | |
| *** dkranz has joined #openstack-infra | 03:07 | |
| *** matsuhas_ has quit IRC | 03:08 | |
| *** matsuhashi has quit IRC | 03:08 | |
| lifeless | ypu, looks like hanging on keystone to me :( | 03:08 |
| lifeless | and keystone logs -nothing at all- (not even requests...) | 03:08 |
| jog0 | lifeless: is it worse then this: http://logs.openstack.org/39/70239/1/check/check-grenade-dsvm/6f4b3bf/logs/syslog.txt.gz | 03:09 |
| jog0 | search for traceback | 03:09 |
| lifeless | jog0: at least you know the process is running :P | 03:09 |
| jog0 | not for http://logs.openstack.org/39/70239/1/check/check-grenade-dsvm/6f4b3bf/logs/new/screen-n-cpu.txt.gz | 03:10 |
| jog0 | it just stops loggingg | 03:10 |
| portante | jog0: pong | 03:12 |
| portante | jog0: does that new patch set make sense? | 03:13 |
| lifeless | erm, nova DERP | 03:13 |
| lifeless | | 6882adf7-9a5d-4c7c-9228-6859ec91eaf0 | testenv-testenv0-x6fabjotw5xp | BUILD | spawning | NOSTATE | ctlplane=10.10.16.181 | | 03:13 |
| lifeless | | d626d77f-8303-49b5-82dd-395bca6f2db7 | testenv-testenv8-vewc22gllh32 | BUILD | spawning | NOSTATE | ctlplane=10.10.16.181, 10.10.16.186 | | 03:13 |
| jog0 | portante: http://logs.openstack.org/39/70239/1/check/check-grenade-dsvm/6f4b3bf/logs/syslog.txt.gz search for stacktrace | 03:13 |
| lifeless | whats wrong with that | 03:13 |
| lifeless | ^ | 03:13 |
| jog0 | portante: what is swift doing? | 03:13 |
| * portante looks | 03:13 | |
| jog0 | portante: haven't got around to your patch yet | 03:13 |
| jog0 | thanks | 03:13 |
| *** dcramer_ has joined #openstack-infra | 03:13 | |
| lifeless | jog0: I'm smelling another cross-thread/request/something context fail in nova's use of neutronclient | 03:14 |
| * jog0 thinks he needs more beer | 03:14 | |
| lifeless | jog0: what, because nova thinks one machine has two ips, on the same network, with one owned by a different instance? | 03:15 |
| lifeless | jog0: sheese, let me get you something really bad, like the swift thing :P | 03:15 |
| *** CaptTofu_ has quit IRC | 03:15 | |
| lifeless | there's only one port with 181 on it.. | 03:15 |
| *** emagana has quit IRC | 03:16 | |
| jog0 | lifeless: happy hunting | 03:16 |
| jog0 | I am done with bug hunting for today, except to follow up with our resident swift expert | 03:17 |
| * jog0 waves at portante | 03:17 | |
| lifeless | I;m abou tto have to stop for family time | 03:17 |
| *** pcrews has quit IRC | 03:17 | |
| portante | jog0 | 03:18 |
| portante | here | 03:18 |
| *** dcramer_ has quit IRC | 03:18 | |
| portante | we have seen this before, I think this always happens | 03:18 |
| lifeless | portante: ?! | 03:19 |
| lifeless | portante: from an ops perspective, thats a terrifying concept :) | 03:19 |
| portante | I think it is a "how the upgrade proceeds thing", but have to confirm ... | 03:20 |
| *** matsuhashi has joined #openstack-infra | 03:20 | |
| jog0 | portante: yeah it happens every time in grenade http://logs.openstack.org/75/70275/1/check/check-grenade-dsvm/11bb3b8/logs/syslog.txt.gz | 03:21 |
| *** ken1ohmichi has joined #openstack-infra | 03:22 | |
| jog0 | sounds like a grenade/swift bug to fix | 03:23 |
| jog0 | portante: thanks | 03:23 |
| jog0 | until next time o/ | 03:23 |
| portante | jog0: night | 03:24 |
| jog0 | lifeless: so turns out that bug may be invalid, as the recheck hit the exact same issue | 03:26 |
| jog0 | and considering how rare it is .... | 03:26 |
| lyxus | After a dev submit a patch for review, how much time does it take to receive it on the gerrit stream ? | 03:27 |
| clarkb | lyxus: should be near immedaite | 03:27 |
| clarkb | tcp is probably the biggest delay | 03:27 |
| morganfainberg | lifeless, ping | 03:28 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Log gerrit comment when running in nocomment mode https://review.openstack.org/70287 | 03:28 |
| morganfainberg | lifeless, nvm | 03:29 |
| *** CaptTofu has joined #openstack-infra | 03:29 | |
| morganfainberg | actually... | 03:30 |
| *** CaptTofu has quit IRC | 03:30 | |
| portante | jog0: the "old" swift code would be havana in this case, right? | 03:31 |
| lyxus | clarkb, humm... ok thanks ! | 03:31 |
| jog0 | portante: correct | 03:31 |
| jog0 | and havana devstack | 03:31 |
| portante | k | 03:31 |
| jog0 | grenade does havana devstack => trunk devstack | 03:31 |
| morganfainberg | lifeless, re-ping , i think i found a bug in fixtures | 03:32 |
| *** matsuhashi has quit IRC | 03:34 | |
| *** matsuhashi has joined #openstack-infra | 03:35 | |
| morganfainberg | lifeless, ah nvm, found it. my mistake *grumble* | 03:36 |
| *** thedodd has joined #openstack-infra | 03:38 | |
| *** starmer has joined #openstack-infra | 03:39 | |
| *** CaptTofu has joined #openstack-infra | 03:40 | |
| *** markwash has quit IRC | 03:41 | |
| *** matsuhashi has quit IRC | 03:43 | |
| *** sarob has joined #openstack-infra | 03:45 | |
| *** dcramer_ has joined #openstack-infra | 03:46 | |
| *** wenlock has joined #openstack-infra | 03:47 | |
| *** wenlock has quit IRC | 03:48 | |
| *** sarob has quit IRC | 03:49 | |
| *** matsuhashi has joined #openstack-infra | 03:50 | |
| *** VijayT has quit IRC | 03:52 | |
| *** david-lyle has joined #openstack-infra | 03:52 | |
| *** gokrokve has joined #openstack-infra | 03:58 | |
| lyxus | Hi, I am trying to do a review. I think i need to add the username that was created for me in the settings page, however I have a Application error, Server error . | 04:02 |
| clarkb | lyxus: you are trying to push code or leave a review? | 04:03 |
| lyxus | clarkb, leave a review using my service account | 04:03 |
| *** AaronGr is now known as AaronGr_Zzz | 04:03 | |
| *** oubiwann_ has quit IRC | 04:03 | |
| clarkb | lyxus: and what gives you the application error? | 04:03 |
| *** oubiwann_ has joined #openstack-infra | 04:04 | |
| *** gyee has quit IRC | 04:04 | |
| clarkb | it is possible that your service account doesn't have rights to vote +/-1 yet | 04:05 |
| lyxus | clarkb,let me explain what is happening. I was trying to leave the review thourgh SSH, and I got a (Permission denied (publickey)); and I realized that the ssh username is not registered | 04:05 |
| clarkb | lyxus: it should be, that is what happens when the service account is created | 04:05 |
| clarkb | lyxus: what is the accoutn? | 04:06 |
| lyxus | clarkb, the ssh username is nuage-networks | 04:06 |
| *** changbl has joined #openstack-infra | 04:07 | |
| clarkb | lyxus: I see the username as nuage-networks it is in the DB correclty | 04:07 |
| clarkb | are you ssh'ing to port 29418? | 04:07 |
| clarkb | have the correct private key select? | 04:07 |
| lyxus | ssh -vvv -p 29418 review.openstack.org nuage-networks review -m '"test" --verified=1 If20b385b | 04:08 |
| lyxus | i believe so. That's the one that I provided | 04:09 |
| clarkb | right so that isn't hwo you should specify the username | 04:09 |
| clarkb | nuage-networks@review.openstack.org or use the -l option | 04:09 |
| *** wenlock has joined #openstack-infra | 04:09 | |
| clarkb | and it should be gerrit review blah blah. Testing with gerrit ls-projects is a good place to start | 04:11 |
| *** jamielennox is now known as jamielennox|away | 04:11 | |
| lyxus | I see, does the +1 shows right away ? | 04:11 |
| clarkb | if it is applied properly yes | 04:11 |
| *** HenryG has joined #openstack-infra | 04:13 | |
| *** dcramer_ has quit IRC | 04:15 | |
| lyxus | clarkb, thanks so much ! It worked ! I was also wondering how can I change the Display Name of the service account | 04:15 |
| clarkb | you can submit a request to do that. Is there something wrong with the existing name? | 04:15 |
| lyxus | Well, we are building third party test account which we want to name as "Nuage CI". Currently its the name of the company "Nuage Networks" :) | 04:16 |
| lyxus | Not a big deal but just to set it right | 04:16 |
| *** thedodd has quit IRC | 04:18 | |
| lyxus | I will send an email. Thanks ! | 04:18 |
| clarkb | np | 04:19 |
| *** oubiwann_ has quit IRC | 04:19 | |
| *** oubiwann_ has joined #openstack-infra | 04:21 | |
| *** kraman has joined #openstack-infra | 04:22 | |
| *** harlowja is now known as harlowja_away | 04:26 | |
| *** dcramer_ has joined #openstack-infra | 04:28 | |
| *** CaptTofu has quit IRC | 04:31 | |
| *** markwash has joined #openstack-infra | 04:32 | |
| *** amcrn has quit IRC | 04:34 | |
| *** kraman has quit IRC | 04:36 | |
| *** NithyaG has quit IRC | 04:39 | |
| *** ken1ohmichi has quit IRC | 04:39 | |
| *** blamar has quit IRC | 04:40 | |
| *** sarob has joined #openstack-infra | 04:43 | |
| *** blamar has joined #openstack-infra | 04:45 | |
| lifeless | jog0: interesting | 04:45 |
| lifeless | jog0: in a wtf way | 04:45 |
| *** kraman has joined #openstack-infra | 04:46 | |
| lifeless | morganfainberg: heh | 04:47 |
| *** sarob has quit IRC | 04:48 | |
| *** praneshp has quit IRC | 04:50 | |
| *** kraman has quit IRC | 04:51 | |
| *** Ryan_Lane has joined #openstack-infra | 04:52 | |
| *** markwash has quit IRC | 04:53 | |
| *** markwash has joined #openstack-infra | 04:56 | |
| openstackgerrit | Edward Raigosa proposed a change to openstack-infra/config: Make pip install from upstream better https://review.openstack.org/51425 | 04:56 |
| *** weshay has quit IRC | 04:57 | |
| wenlock | clarkb: you had a question on that review about if pip::python3 installs python3... i tested and verified it does | 04:57 |
| clarkb | wenlock: ok just checking because it uses `python` and not say `python3` | 04:58 |
| wenlock | oh, i see! | 04:59 |
| wenlock | you would prefer it say python2 on the 2 , and python3 on the 3 for running the script? | 04:59 |
| clarkb | if that works | 05:00 |
| *** kraman has joined #openstack-infra | 05:00 | |
| wenlock | sweet, leme make a re-do on that guy | 05:00 |
| wenlock | been testing it on a vagrant box, so shouldn't take long to verify | 05:02 |
| *** markwash has quit IRC | 05:03 | |
| *** coolsvap_away has quit IRC | 05:08 | |
| *** gokrokve has quit IRC | 05:08 | |
| *** gokrokve has joined #openstack-infra | 05:08 | |
| *** gokrokve_ has joined #openstack-infra | 05:09 | |
| openstackgerrit | Tim Landscheidt proposed a change to openstack-infra/git-review: Retrieve remote pushurl independently of user's locale https://review.openstack.org/64307 | 05:10 |
| *** blamar has quit IRC | 05:13 | |
| *** gokrokve has quit IRC | 05:13 | |
| *** gokrokve_ has quit IRC | 05:13 | |
| *** talluri has joined #openstack-infra | 05:13 | |
| *** praneshp has joined #openstack-infra | 05:15 | |
| *** oubiwann_ has quit IRC | 05:22 | |
| *** vkozhukalov has joined #openstack-infra | 05:26 | |
| *** nicedice has quit IRC | 05:27 | |
| *** mgagne1 has joined #openstack-infra | 05:28 | |
| *** mgagne has quit IRC | 05:29 | |
| openstackgerrit | Edward Raigosa proposed a change to openstack-infra/config: Make pip install from upstream better https://review.openstack.org/51425 | 05:31 |
| *** HenryG has quit IRC | 05:32 | |
| *** starmer has quit IRC | 05:36 | |
| *** amotoki has joined #openstack-infra | 05:37 | |
| wenlock | clarkb, will you be able to review that one at some point again? https://review.openstack.org/51425 | 05:37 |
| clarkb | wenlock: yup, I have just been going through reviews as much as possible this week. Hopefully will have time to do that again tomorrow | 05:38 |
| *** gokrokve has joined #openstack-infra | 05:39 | |
| wenlock | clarkb, cool, thanks! have a great night, ttyl | 05:39 |
| *** starmer has joined #openstack-infra | 05:39 | |
| clarkb | you too | 05:39 |
| *** thuc has joined #openstack-infra | 05:41 | |
| *** wenlock has quit IRC | 05:42 | |
| *** thuc_ has joined #openstack-infra | 05:42 | |
| *** sarob has joined #openstack-infra | 05:43 | |
| *** lcheng has quit IRC | 05:46 | |
| *** thuc has quit IRC | 05:46 | |
| *** sarob has quit IRC | 05:48 | |
| mordred | morning clarkb | 05:50 |
| clarkb | mordred: not yet | 05:51 |
| mordred | what? it's not? | 05:51 |
| mordred | dammit | 05:51 |
| clarkb | :) how is sprint / fosdem | 05:51 |
| mordred | clarkb: did I miss anything good yesterday? | 05:51 |
| mordred | sprint is good - I believe we all understand what the MVP is now and when infra can start using it :) | 05:52 |
| *** lcheng has joined #openstack-infra | 05:52 | |
| clarkb | sort of, you were on the list for things during the meeting | 05:52 |
| *** vogxn has joined #openstack-infra | 05:52 | |
| mordred | there was a meeting? | 05:52 |
| clarkb | you might want to check the meeting you carried over a couple actions from the previous one | 05:52 |
| clarkb | yup it was productive too | 05:52 |
| mordred | oh - I read the logs actually | 05:53 |
| clarkb | so when should infra start using it? | 05:53 |
| *** mrodden has quit IRC | 05:53 | |
| clarkb | all of our jenkinses are running the same version with working scp plugin | 05:54 |
| clarkb | https://review.openstack.org/#/c/70283/ is a thing because reasons | 05:54 |
| *** mrodden has joined #openstack-infra | 05:54 | |
| clarkb | actually you are one of my TC representatives so I think we should talk about 70283 | 05:54 |
| clarkb | if you follow that over to https://bugs.launchpad.net/neutron/+bug/1273386 you will see that neutron has trouble with the precise and saucy kernels. And it has been suggested that not using ext3 may help | 05:55 |
| clarkb | but lifeless' change got shot down and was reverted. So I think we need to make a plan for killing ext3 in a way that doesn't make people scared | 05:56 |
| *** abhishek has joined #openstack-infra | 05:57 | |
| abhishek | hi all | 05:57 |
| abhishek | I am facing issue with jenkins | 05:58 |
| abhishek | jenkins works on check but failed during gate jobs | 05:58 |
| abhishek | there are no issues in my patch https://review.openstack.org/#/c/58997/ | 05:58 |
| abhishek | currently I have added reverify bug 1209086 but nothing has happened in last two days | 05:59 |
| abhishek | can any one help me on this?? | 05:59 |
| *** rwsu has quit IRC | 05:59 | |
| clarkb | abhishek: yes hold on I am trying to untangle the comments on the change | 06:00 |
| abhishek | sure, thanks | 06:00 |
| clarkb | the reason the reverify bug XXXXX did not work is your change does not have the votes needed to go into the gate | 06:01 |
| clarkb | it is missing the +1 approved vote | 06:01 |
| clarkb | so to address all of the other stuff going on | 06:02 |
| clarkb | code always has bugs it is never perfect :) | 06:03 |
| clarkb | the glance unittests are actually quite unreliable and I don't think that has anything to do with jenkins | 06:03 |
| clarkb | and 'reverify no bug' does nothing anymore. You must supply a bug to reverify | 06:03 |
| abhishek | I have +1 approve from mark earlier, but I guess mark has given no score later when jenkins failed in gate jobs | 06:03 |
| clarkb | so to address the unittest failures there should be a bug, if there isn't one already then add one | 06:03 |
| clarkb | then recheck on that bug | 06:04 |
| abhishek | i have verified the console.html and I haven't found any error there | 06:04 |
| abhishek | so should I proceed with recheck no bug? | 06:05 |
| clarkb | FAIL: glance.tests.unit.v2.test_registry_client.TestRegistryV2Client.test_get_index_sort_status_desc | 06:05 |
| clarkb | that failed | 06:05 |
| clarkb | failing tests are bugs... | 06:05 |
| clarkb | and http://logs.openstack.org/97/58997/12/check/check-grenade-dsvm/ed634fd/logs/new/screen-s-container.txt.gz shows why the grenade test failed | 06:06 |
| *** kraman has quit IRC | 06:06 | |
| clarkb | er wait maybe not /me digs more | 06:06 |
| clarkb | http://logs.openstack.org/97/58997/12/check/check-grenade-dsvm/ed634fd/logs/new/screen-s-proxy.txt.gz shows it not the container service | 06:07 |
| clarkb | the point behind all of this is to do our best to track why things fail so that we can prioritize fixing these bugs | 06:07 |
| clarkb | if we recheck no bug where there are obvious failures we lose that data | 06:07 |
| lifeless | mordred: clarkb: oh hai | 06:08 |
| abhishek | So I need to find if there are any bugs related to this and if not then add that bug? | 06:08 |
| clarkb | abhishek: thats the idea | 06:08 |
| mordred | look, it's lifeless | 06:09 |
| lifeless | mordred: where? | 06:09 |
| abhishek | clarkb:ok, thank you | 06:10 |
| mordred | clarkb: /me goes to look at 70823 | 06:10 |
| mordred | clarkb: I have an idea for that - which is that we shoudl stop using precise and saucy kernels :) | 06:10 |
| abhishek | clarkb:one last doubt, if I added the bug, then I need to wait until that gets resolved? | 06:11 |
| clarkb | abhishek: no, we are tracking the bugs with this not necessarily fixing them | 06:11 |
| lifeless | its better that way | 06:11 |
| *** bknudson has quit IRC | 06:11 | |
| clarkb | with the goal being that we can prioritize the ones that need fixing | 06:11 |
| clarkb | mordred: well the implication to me is that neutron is broken when it comes to linux | 06:12 |
| mordred | clarkb: re: starting to use storyboard ... should be _Very_ soon - the TDL for an MVP is very small | 06:12 |
| clarkb | because seeing the same fail between 3.2 and 3.11 doesn't instill confidence | 06:12 |
| *** coolsvap has joined #openstack-infra | 06:12 | |
| mordred | that is true. | 06:12 |
| *** locke1051 has joined #openstack-infra | 06:12 | |
| *** locke105 has quit IRC | 06:12 | |
| lifeless | clarkb: 70823 - I thought that was nbd ? | 06:12 |
| mordred | otoh - the linux part is currenty out of our hands, and god knows ubuntu doesn't have good server kernel engineers working on anything | 06:13 |
| clarkb | lifeless: he got the number wrong 70283 | 06:13 |
| mordred | I bet neutron works great on TVs | 06:13 |
| clarkb | mordred: I am trying to suggest linux is fine and neutron needs fixing :) it is easy to blame the kernel | 06:13 |
| clarkb | and even if the kernel isn't fine neutron needs to run on those so something needs to be sorted | 06:13 |
| lifeless | clarkb: I am confused; thats a nova problem | 06:14 |
| clarkb | lifeless: ? | 06:14 |
| clarkb | lifeless: oh follow to the bug | 06:14 |
| lifeless | let me page it in | 06:14 |
| abhishek | clarkb:thank you for your time, I will get back if I have further doubts | 06:14 |
| clarkb | lifeless: neutron is saying they need ext4 | 06:14 |
| clarkb | why? I do not know it makes no sense but I am happy to entertain the notion | 06:14 |
| lifeless | clarkb: The kernel bug manifests when mounting of nbd devices is combined with ip namespace operations. | 06:14 |
| lifeless | </quote> | 06:14 |
| lifeless | clarkb: this is file injection breaking things | 06:15 |
| *** afazekas_ has joined #openstack-infra | 06:15 | |
| *** bknudson has joined #openstack-infra | 06:15 | |
| mordred | clarkb: I'm just saying, if a different kernel fixes it, it _might_ be a kernel issue, and being able to point that out so that our downstreams can fix their dependencies is also a choice | 06:15 |
| lifeless | clarkb: e.g. https://review.openstack.org/#/c/70239/ is aimed at the actual problem - we have a bad thing in use. | 06:15 |
| mordred | I mean, we do not make our things run with all versions of everything - we have opinions on many of them | 06:15 |
| *** afazekas_ has quit IRC | 06:15 | |
| mordred | I don't know how to qualify this on our side yet ... :) | 06:15 |
| clarkb | lifeless: wait so file injection is breaking neutron? | 06:16 |
| clarkb | it is too late at night for me to think to hard about this | 06:16 |
| lifeless | clarkb: 'neutron' here means 'the test called neutron' | 06:16 |
| mordred | clarkb: +2 of the patch from me | 06:16 |
| lifeless | clarkb: which actually means | 06:16 |
| lifeless | clarkb: neutron + use metadata-server not config-drive. | 06:17 |
| clarkb | lifeless: no it is literally neutron, nova network is fine | 06:17 |
| clarkb | and neutron isolated seems to be worse | 06:17 |
| lifeless | clarkb: it is *also* metadata server. | 06:17 |
| lifeless | clarkb: as I said, 19:17 < lifeless> clarkb: neutron + use metadata-server not config-drive. | 06:18 |
| lifeless | clarkb: now, orthogonal to all of that, nova defaults to doing file injection | 06:18 |
| lifeless | clarkb: AND | 06:18 |
| lifeless | clarkb: it defaults to doing it with nbd | 06:18 |
| lifeless | clarkb: which is frankly a POS. | 06:18 |
| *** e0ne has joined #openstack-infra | 06:19 | |
| clarkb | I see | 06:19 |
| *** sarob has joined #openstack-infra | 06:19 | |
| lifeless | clarkb: note that nbd involves the kernel talking to network devices. | 06:19 |
| lifeless | clarkb: so, when you use neutron. | 06:19 |
| lifeless | clarkb: and you run the metadata agent, you get a neutron metadata agent in a netns | 06:19 |
| lifeless | with a socket leaked out of that to escape the virtual network | 06:19 |
| lifeless | clarkb: and you also get nova doing nbd based file injection | 06:19 |
| lifeless | clarkb: and the proposed defect is that doing netns + nbd on the same kernel leads to bad. | 06:20 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/gerritlib: remove extra item from listGroups and listProjects methods https://review.openstack.org/70301 | 06:20 |
| lifeless | clarkb: I suspect in fact that your patch is pointless | 06:20 |
| clarkb | lifeless: me too | 06:20 |
| lifeless | clarkb: because its the file system within the nbd device that matters. | 06:20 |
| clarkb | but like I said I would entertain the notion | 06:20 |
| lifeless | clarkb: which is the cloud under test. | 06:20 |
| clarkb | ohhhhhhh | 06:20 |
| clarkb | even better | 06:20 |
| lifeless | clarkb: but I haven't read the kernel backtrace or anything yet. | 06:20 |
| clarkb | we really should change the default fs then | 06:21 |
| lifeless | clarkb: you think ? :) | 06:21 |
| lifeless | clarkb: other options to fix it are russelb's patch to install guestfs which will avoid nbd | 06:21 |
| lifeless | clarkb: and my patch to turn file injection off by default | 06:21 |
| clarkb | well that fixes it in the gate | 06:21 |
| clarkb | doesn't fix it for people using nbd | 06:21 |
| lifeless | q.e.d. | 06:21 |
| clarkb | ok so, guestfs I saw that go by as a thing for devstack iirc and you have 70301 | 06:23 |
| clarkb | should I WIP my change and focus on those other changes instead? | 06:23 |
| *** sarob has quit IRC | 06:24 | |
| lifeless | I think your change might be useful, but not because of this bug. But let me re-scan the bug for hints | 06:24 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/gerritlib: remove extra item from listGroups and listProjects methods https://review.openstack.org/70301 | 06:24 |
| clarkb | er your change isn't 70301 but you have a change :) | 06:25 |
| lifeless | I do | 06:25 |
| lifeless | https://review.openstack.org/#/c/70239/ | 06:26 |
| lifeless | which is omg failing on grenade | 06:26 |
| lifeless | for no apparent reason | 06:26 |
| clarkb | which was your discussion with jog0. I get it now | 06:27 |
| clarkb | clearly thinking at night after being dentisted is not a good thing | 06:27 |
| clarkb | https://review.openstack.org/#/c/70237/ is russellb's change | 06:27 |
| lifeless | yah | 06:27 |
| lifeless | so I'd do 70237 ASAP | 06:27 |
| lifeless | if it passed | 06:27 |
| chmouel | mordred: are you all in brussels today? | 06:29 |
| mordred | chmouel: we are! | 06:30 |
| clarkb | lifeless: it is weird to me that russellb's change doesn't enable guestfs | 06:30 |
| chmouel | mordred: cool, i may try to come over this arvo to say hello | 06:31 |
| clarkb | lifeless: seems like it should do that too in devstack, then you flip the bit on nova to change defauls then the world is happy | 06:31 |
| mordred | chmouel: woot | 06:31 |
| lifeless | clarkb: I think the default is guestfs with fallback to nbd on not-installed | 06:32 |
| *** CaptTofu has joined #openstack-infra | 06:32 | |
| *** odyssey4me has joined #openstack-infra | 06:32 | |
| clarkb | gotcha | 06:32 |
| clarkb | and guestfs is broken in icehouse | 06:32 |
| lifeless | is it? YAY | 06:33 |
| lifeless | cockadoodledoo | 06:33 |
| clarkb | lifeless: according to sdague's comment yes | 06:33 |
| clarkb | because it isn't tested or some such | 06:34 |
| *** CaptTofu has quit IRC | 06:36 | |
| *** DinaBelova_ is now known as DinaBelova | 06:38 | |
| clarkb | mordred: if krottabcompletenotworking is around, I think it might be good to talk about how to deploy the thing | 06:40 |
| clarkb | mordred: the python bits are git repo up to date and pip install | 06:40 |
| clarkb | mordred: the js bits are tarball unpack. Which is honestly kind of painful in puppet because how do you know if the things has changed and that you got the correct bits and so n | 06:41 |
| clarkb | mordred: the argument for tarball si then you don't have to have all the js dev tools on the server which is nice | 06:43 |
| clarkb | mordred: maybe we should https tarballs and upload sha1sums too | 06:43 |
| *** sarob has joined #openstack-infra | 06:43 | |
| mordred | clarkb: yeah - that's the whole thing with the tarballs - and I believe that there was a curl thing they were looking at to only download the tarball when it's changed | 06:45 |
| mordred | but YES we should put https on tarballs for the love of god | 06:45 |
| *** kraman has joined #openstack-infra | 06:46 | |
| clarkb | the curl thing didn't pan out because you get an HTTP 200 regardless so curl exits 0 | 06:46 |
| mordred | ah | 06:46 |
| mordred | spectacular | 06:46 |
| clarkb | I mean it is technically correct but not useful for scripting. I think wget spits out stdout that can be parsed to make decisions though | 06:47 |
| mordred | yuck | 06:47 |
| mordred | well, we COULD use more salt | 06:47 |
| *** thuc_ has quit IRC | 06:47 | |
| mordred | and just tell puppet to run on the host when and only when we update puppet | 06:47 |
| *** thuc has joined #openstack-infra | 06:47 | |
| mordred | or, rather, when we update the storyboard repos | 06:48 |
| *** sarob has quit IRC | 06:48 | |
| *** emagana has joined #openstack-infra | 06:48 | |
| mordred | (when we start fighting the tools to get them to understand "install these files from this tarball" I want to shoot someone) | 06:48 |
| *** kraman has quit IRC | 06:50 | |
| *** hdd_ has quit IRC | 06:50 | |
| *** vkozhukalov has quit IRC | 06:51 | |
| *** thuc has quit IRC | 06:52 | |
| *** lcheng has quit IRC | 06:53 | |
| clarkb | ++ | 07:05 |
| mordred | clarkb: zomg. I just had a ridiculous hacky idea | 07:06 |
| mordred | clarkb: what if ... | 07:06 |
| mordred | we add the storyboard-webclient git repo as a thing in puppet - but we don't install from it | 07:06 |
| mordred | instead, we have it listed as "lastest" | 07:06 |
| *** dkliban has quit IRC | 07:06 | |
| clarkb | oh man I see where this is going | 07:06 |
| mordred | and we subscribe to it with the download tarball puppet resource | 07:07 |
| clarkb | ++ yup that is where I thought it would go | 07:07 |
| clarkb | I think it is a hack but it would be relatively sane | 07:07 |
| mordred | I'll suggest it in the room in just a little bit | 07:07 |
| mordred | it's not even an evil hack, really | 07:07 |
| clarkb | nope just a hack | 07:07 |
| mordred | it's a way for us to tell puppet "update from this tarball when something merges to this git repo" | 07:07 |
| clarkb | mordred: though there is a delay between merge and tarball upload | 07:08 |
| mordred | hrm | 07:11 |
| mordred | k. we have a puppet resource that deletes the tarball. that only runs when the gitrepo is updated | 07:11 |
| mordred | then we have a resource that, if the tarball isnt' there, tries to download it ... | 07:11 |
| mordred | now it's starting to get bonghits | 07:11 |
| mordred | well.... | 07:12 |
| *** praneshp has quit IRC | 07:12 | |
| mordred | we could put in a script which tries to download a storyboard-webclient-$sha.tar.gz that we could run in the context of the git repo | 07:12 |
| clarkb | could do that | 07:12 |
| clarkb | honestly you know your dev env is bonghits when it is scary to put it on the server | 07:13 |
| mordred | well, I'm not sure I agree | 07:13 |
| mordred | I'm not scared to put it on the server | 07:13 |
| mordred | I think it's a waste to put it on the server | 07:13 |
| mordred | because the server does not need to run it | 07:13 |
| clarkb | mordred: right but going from git to tarball should be a fundametal thing | 07:13 |
| clarkb | mordred: also I finally got around to reading http://www.python.org/dev/peps/pep-0462/ (well skimmed) and that is exciting | 07:14 |
| mordred | we could TOTALLY just build a new tarball on the server - it all works via tox | 07:14 |
| mordred | in venvs | 07:14 |
| mordred | but honestly, I think it's pretty bonghits that puppet cant do the right thing here | 07:14 |
| clarkb | I agree on that as well | 07:15 |
| mordred | where's bodepd when you need him? | 07:15 |
| mordred | I mean, this: http://stackoverflow.com/questions/11327582/puppet-recipe-installing-tarball is an inication that puppet is missing a fundamental feature | 07:16 |
| clarkb | yup, there is actually a half decent puppet forge thing I saw way back when | 07:17 |
| clarkb | we might look at that, not sure how it handles remote file updates though | 07:17 |
| *** kraman has joined #openstack-infra | 07:27 | |
| *** vogxn has quit IRC | 07:33 | |
| *** kraman has quit IRC | 07:38 | |
| *** sarob has joined #openstack-infra | 07:43 | |
| *** markwash has joined #openstack-infra | 07:46 | |
| *** sarob has quit IRC | 07:47 | |
| *** shardy_afk is now known as shardy | 07:48 | |
| *** DinaBelova is now known as DinaBelova_ | 07:50 | |
| *** yolanda has joined #openstack-infra | 07:52 | |
| *** markwash has quit IRC | 07:59 | |
| *** denis_makogon has joined #openstack-infra | 08:01 | |
| *** markwash has joined #openstack-infra | 08:04 | |
| *** DinaBelova_ is now known as DinaBelova | 08:07 | |
| *** amotoki_ has joined #openstack-infra | 08:07 | |
| *** kraman has joined #openstack-infra | 08:09 | |
| *** markmc has joined #openstack-infra | 08:10 | |
| *** markwash has quit IRC | 08:11 | |
| *** kraman1 has joined #openstack-infra | 08:11 | |
| *** kraman has quit IRC | 08:11 | |
| *** e0ne has quit IRC | 08:15 | |
| *** kraman1 has quit IRC | 08:15 | |
| *** ttx has quit IRC | 08:15 | |
| *** e0ne has joined #openstack-infra | 08:16 | |
| *** hashar has joined #openstack-infra | 08:16 | |
| *** ttx has joined #openstack-infra | 08:16 | |
| *** ttx has quit IRC | 08:16 | |
| *** ttx has joined #openstack-infra | 08:16 | |
| *** ttx has quit IRC | 08:17 | |
| *** ttx has joined #openstack-infra | 08:17 | |
| *** ttx has quit IRC | 08:17 | |
| *** ttx has joined #openstack-infra | 08:17 | |
| *** e0ne has quit IRC | 08:18 | |
| *** e0ne has joined #openstack-infra | 08:18 | |
| *** Ryan_Lane has quit IRC | 08:21 | |
| *** e0ne has quit IRC | 08:23 | |
| *** jcoufal has joined #openstack-infra | 08:26 | |
| *** kraman has joined #openstack-infra | 08:28 | |
| *** vkozhukalov has joined #openstack-infra | 08:29 | |
| *** CaptTofu has joined #openstack-infra | 08:33 | |
| *** kraman has quit IRC | 08:33 | |
| *** dizquierdo has joined #openstack-infra | 08:33 | |
| *** reed has joined #openstack-infra | 08:35 | |
| *** matsuhashi has quit IRC | 08:37 | |
| *** CaptTofu has quit IRC | 08:37 | |
| *** amotoki_ has quit IRC | 08:37 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/zuul: Remove Zuul ref replication. https://review.openstack.org/70309 | 08:37 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/zuul: Move the merger to a JSON-compatible API https://review.openstack.org/70310 | 08:37 |
| *** sileht has quit IRC | 08:42 | |
| *** sarob has joined #openstack-infra | 08:43 | |
| *** sileht has joined #openstack-infra | 08:47 | |
| *** AlexF_ has joined #openstack-infra | 08:47 | |
| *** alexpilotti has joined #openstack-infra | 08:47 | |
| *** sarob has quit IRC | 08:48 | |
| *** jpich has joined #openstack-infra | 08:50 | |
| *** alexpilotti has quit IRC | 08:52 | |
| hashar | good morning | 08:56 |
| *** fbo_away is now known as fbo | 08:57 | |
| *** NikitaKonovalov_ is now known as NikitaKonovalov | 08:58 | |
| jeblair | hashar: good morning; we're waiting on several people to show up before we resume the storyboard meetup | 08:58 |
| *** jcoufal has quit IRC | 09:00 | |
| hashar | I wish I was there :( | 09:02 |
| hashar | I was in SF last week so I am staying home this week + week-end to take care of my familly | 09:03 |
| hashar | :( | 09:03 |
| *** abhishek has quit IRC | 09:04 | |
| hashar | I have started a tiny Zuul script to fetch repositories with the proper Zuul ref / branch. Aka a reimplementation in python of your devstack-wrap shell script | 09:05 |
| hashar | it is horrible though | 09:05 |
| *** NikitaKonovalov is now known as NikitaKonovalov_ | 09:07 | |
| *** johnthetubaguy has joined #openstack-infra | 09:09 | |
| *** johnthetubaguy1 has joined #openstack-infra | 09:11 | |
| *** yassine has joined #openstack-infra | 09:12 | |
| *** johnthetubaguy has quit IRC | 09:14 | |
| *** AlexF_ has quit IRC | 09:17 | |
| *** ociuhandu has joined #openstack-infra | 09:23 | |
| *** kraman has joined #openstack-infra | 09:28 | |
| *** jcoufal has joined #openstack-infra | 09:28 | |
| *** ociuhandu has quit IRC | 09:29 | |
| *** kraman has quit IRC | 09:32 | |
| *** flaper87|afk is now known as flaper87 | 09:35 | |
| *** vogxn has joined #openstack-infra | 09:37 | |
| *** e0ne has joined #openstack-infra | 09:38 | |
| *** BobBallAway is now known as BobBall | 09:41 | |
| *** vogxn has joined #openstack-infra | 09:41 | |
| *** NikitaKonovalov_ is now known as NikitaKonovalov | 09:42 | |
| *** e0ne has quit IRC | 09:42 | |
| *** e0ne_ has joined #openstack-infra | 09:42 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 09:43 | |
| *** sarob has joined #openstack-infra | 09:43 | |
| *** matsuhashi has joined #openstack-infra | 09:44 | |
| *** jooools has joined #openstack-infra | 09:44 | |
| *** sarob has quit IRC | 09:48 | |
| *** markmc has quit IRC | 09:48 | |
| *** changbl has quit IRC | 09:49 | |
| *** hashar has quit IRC | 09:49 | |
| *** cody-somerville has joined #openstack-infra | 09:49 | |
| *** hashar has joined #openstack-infra | 09:50 | |
| *** dstanek has quit IRC | 09:51 | |
| *** yolanda has quit IRC | 09:54 | |
| *** jp_at_hp has joined #openstack-infra | 09:55 | |
| *** yolanda has joined #openstack-infra | 09:55 | |
| *** yolanda has quit IRC | 09:55 | |
| chmouel | how hard would be to implement line numbering hash thing on console.thml ? | 09:57 |
| chmouel | so people can point to it in link | 09:57 |
| *** yolanda has joined #openstack-infra | 09:57 | |
| jeblair | chmouel: i think it already exists: http://logs.openstack.org/10/70310/1/check/gate-zuul-pep8/c8791c4/console.html#_2014-01-31_08_37_41_502 | 10:00 |
| jeblair | chmouel: the date-time is the link | 10:00 |
| chmouel | jeblair: oh nice | 10:01 |
| *** reed_ has joined #openstack-infra | 10:03 | |
| chmouel | jeblair: will jump in a train after lunch and will see you guys out there | 10:03 |
| *** reed has quit IRC | 10:04 | |
| *** rossella_s has joined #openstack-infra | 10:04 | |
| jeblair | chmouel: great! | 10:04 |
| *** matsuhashi has quit IRC | 10:05 | |
| *** e0ne_ has quit IRC | 10:05 | |
| *** e0ne has joined #openstack-infra | 10:05 | |
| chmouel | mordred: do you have a mobile number to find where you guys at? | 10:05 |
| chmouel | or jeblair ^ | 10:06 |
| jeblair | chmouel: ttx would probably be best | 10:06 |
| *** denis_makogon has quit IRC | 10:07 | |
| chmouel | jeblair: cool but seems I am all fine to find the place with the wiki page directions: https://wiki.openstack.org/wiki/StoryBoard/Brussels_Sprint | 10:10 |
| *** rossella_s has quit IRC | 10:10 | |
| ttx | chmouel: yep, that should get you sorted. See m yphone number in PM if you get lost | 10:12 |
| *** DinaBelova is now known as DinaBelova_ | 10:15 | |
| *** matsuhashi has joined #openstack-infra | 10:16 | |
| openstackgerrit | Lukas Bednar proposed a change to openstack-infra/jenkins-job-builder: scms: MultiSCM is generated for scms hidden in macro https://review.openstack.org/69827 | 10:18 |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 10:20 | |
| *** yassine has quit IRC | 10:22 | |
| *** yassine has joined #openstack-infra | 10:22 | |
| *** andreaf has joined #openstack-infra | 10:28 | |
| *** kraman has joined #openstack-infra | 10:28 | |
| *** dizquierdo is now known as dizquierdo_afk | 10:31 | |
| *** mrmartin has joined #openstack-infra | 10:32 | |
| *** kraman has quit IRC | 10:32 | |
| *** CaptTofu has joined #openstack-infra | 10:33 | |
| *** CaptTofu has quit IRC | 10:38 | |
| *** max_lobur_afk is now known as max_lobur | 10:39 | |
| *** sarob has joined #openstack-infra | 10:43 | |
| *** david-lyle has quit IRC | 10:46 | |
| *** sarob has quit IRC | 10:48 | |
| *** e0ne has quit IRC | 10:50 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 10:50 | |
| *** e0ne has joined #openstack-infra | 10:51 | |
| *** DinaBelova_ is now known as DinaBelova | 10:51 | |
| *** flaper87 is now known as flaper87|afk | 10:52 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 10:53 | |
| *** markmc has joined #openstack-infra | 10:53 | |
| *** lcestari has joined #openstack-infra | 10:53 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov_ | 10:54 | |
| *** e0ne has quit IRC | 10:55 | |
| *** flaper87|afk is now known as flaper87 | 10:55 | |
| *** rossella_s has joined #openstack-infra | 10:56 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 10:59 | |
| *** yolanda has quit IRC | 11:00 | |
| *** mrmartin has quit IRC | 11:01 | |
| *** che-arne has joined #openstack-infra | 11:01 | |
| *** SnowDust has joined #openstack-infra | 11:01 | |
| *** andreaf has quit IRC | 11:03 | |
| *** reed_ has quit IRC | 11:08 | |
| *** yolanda has joined #openstack-infra | 11:10 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 11:11 | |
| *** NikitaKonovalov is now known as NikitaKonovalov_ | 11:12 | |
| *** yolanda has quit IRC | 11:13 | |
| *** yolanda has joined #openstack-infra | 11:13 | |
| *** sarob has joined #openstack-infra | 11:16 | |
| *** yolanda has quit IRC | 11:16 | |
| *** yolanda has joined #openstack-infra | 11:17 | |
| *** cody-somerville has quit IRC | 11:17 | |
| *** jcoufal has quit IRC | 11:17 | |
| *** yolanda has quit IRC | 11:18 | |
| *** yolanda has joined #openstack-infra | 11:18 | |
| *** DinaBelova is now known as DinaBelova_ | 11:19 | |
| *** sarob has quit IRC | 11:21 | |
| *** markmc has quit IRC | 11:24 | |
| *** kraman has joined #openstack-infra | 11:28 | |
| *** mrmartin has joined #openstack-infra | 11:29 | |
| *** kraman has quit IRC | 11:32 | |
| *** ArxCruz has joined #openstack-infra | 11:33 | |
| *** DinaBelova_ is now known as DinaBelova | 11:35 | |
| *** dstanek has joined #openstack-infra | 11:40 | |
| *** sarob has joined #openstack-infra | 11:43 | |
| *** dstanek has quit IRC | 11:45 | |
| *** rfolco has joined #openstack-infra | 11:46 | |
| *** sarob has quit IRC | 11:48 | |
| *** emagana has quit IRC | 11:48 | |
| *** DinaBelova is now known as DinaBelova_ | 11:49 | |
| *** morganfainberg is now known as morganfainberg|z | 11:53 | |
| *** tian has quit IRC | 11:58 | |
| *** tian has joined #openstack-infra | 11:58 | |
| *** mrmartin has quit IRC | 12:05 | |
| sdague | ttx: so storyboard all done yet? | 12:06 |
| *** e0ne has joined #openstack-infra | 12:13 | |
| *** HenryG has joined #openstack-infra | 12:14 | |
| sdague | jeblair: the nodepool graph is dead, looks like a graphite error on collectors | 12:15 |
| *** vogxn has quit IRC | 12:16 | |
| *** coolsvap has quit IRC | 12:24 | |
| *** hashar has quit IRC | 12:24 | |
| *** kraman has joined #openstack-infra | 12:28 | |
| openstackgerrit | João Vale proposed a change to openstack-infra/jenkins-job-builder: Add attachment pattern expression and matrix trigger mode to email-ext. https://review.openstack.org/70148 | 12:28 |
| *** vogxn has joined #openstack-infra | 12:29 | |
| *** kraman has quit IRC | 12:33 | |
| *** CaptTofu has joined #openstack-infra | 12:34 | |
| *** DinaBelova_ is now known as DinaBelova | 12:37 | |
| *** CaptTofu has quit IRC | 12:39 | |
| *** bogdando has quit IRC | 12:39 | |
| *** andre__ has joined #openstack-infra | 12:42 | |
| *** bogdando has joined #openstack-infra | 12:42 | |
| *** sarob has joined #openstack-infra | 12:43 | |
| openstackgerrit | João Vale proposed a change to openstack-infra/jenkins-job-builder: Add support for TestNG publisher. https://review.openstack.org/70157 | 12:45 |
| *** talluri has quit IRC | 12:47 | |
| *** talluri has joined #openstack-infra | 12:48 | |
| *** sarob has quit IRC | 12:48 | |
| *** emagana has joined #openstack-infra | 12:49 | |
| *** mriedem has joined #openstack-infra | 12:49 | |
| *** yamahata has quit IRC | 12:54 | |
| *** ryanpetrello has joined #openstack-infra | 12:54 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 12:54 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 12:54 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov | 12:54 | |
| *** CaptTofu has joined #openstack-infra | 12:55 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 12:55 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov | 12:56 | |
| *** e0ne has quit IRC | 12:57 | |
| *** emagana has quit IRC | 12:58 | |
| *** masayukig has joined #openstack-infra | 12:59 | |
| *** julim has joined #openstack-infra | 13:00 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 13:00 | |
| *** smarcet has joined #openstack-infra | 13:03 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 13:03 | |
| *** ruhe_ has joined #openstack-infra | 13:09 | |
| *** jdurgin has quit IRC | 13:09 | |
| *** NikitaKonovalov_ is now known as NikitaKonovalov | 13:10 | |
| *** dcramer_ has quit IRC | 13:11 | |
| *** dstanek has joined #openstack-infra | 13:11 | |
| *** ProfFalken has quit IRC | 13:12 | |
| jeblair | sdague: graphite filesystem is full | 13:13 |
| *** dstanek has quit IRC | 13:16 | |
| *** odyssey4me has quit IRC | 13:19 | |
| *** jdurgin has joined #openstack-infra | 13:22 | |
| sdague | jeblair: awesome. | 13:22 |
| jeblair | we added a bunch of metrics with the jenkins servers i guess | 13:24 |
| *** dstanek has joined #openstack-infra | 13:25 | |
| *** kraman has joined #openstack-infra | 13:28 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 13:28 | |
| *** dkliban has joined #openstack-infra | 13:34 | |
| *** dizquierdo_afk has quit IRC | 13:34 | |
| *** kraman has quit IRC | 13:35 | |
| *** FallenPegasus has joined #openstack-infra | 13:40 | |
| *** matsuhashi has quit IRC | 13:41 | |
| *** sarob has joined #openstack-infra | 13:43 | |
| jeblair | i'm slowly working on adding a cinder volume | 13:47 |
| *** sarob has quit IRC | 13:48 | |
| *** max_lobur is now known as max_lobur_afk | 13:49 | |
| *** DinaBelova is now known as DinaBelova_ | 13:49 | |
| *** matsuhashi has joined #openstack-infra | 13:50 | |
| *** e0ne has joined #openstack-infra | 13:50 | |
| *** eharney has quit IRC | 13:52 | |
| chmouel | ttx: i think i am going to have to cancel | 13:53 |
| ttx | cancel fosdem ? or seeing us ? | 13:54 |
| ttx | chmouel: reed wanted to see you at some point | 13:54 |
| chmouel | ttx: yeah fosdem since I have the kid birthday | 13:55 |
| ttx | hah | 13:55 |
| chmouel | I got him in touch with fred lepeid who's coming | 13:55 |
| ttx | ok | 13:55 |
| *** thuc has joined #openstack-infra | 13:56 | |
| *** thuc_ has joined #openstack-infra | 13:56 | |
| *** matsuhashi has quit IRC | 13:57 | |
| *** FallenPegasus has quit IRC | 13:59 | |
| *** DinaBelova_ is now known as DinaBelova | 13:59 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 14:00 | |
| *** thuc has quit IRC | 14:00 | |
| *** matsuhashi has joined #openstack-infra | 14:04 | |
| *** leifmadsen is now known as blitzrage | 14:05 | |
| *** vogxn has quit IRC | 14:06 | |
| *** leifmadsen has joined #openstack-infra | 14:07 | |
| *** blitzrage has quit IRC | 14:08 | |
| *** leifmadsen is now known as blitzrage | 14:08 | |
| *** hashar has joined #openstack-infra | 14:10 | |
| *** jnoller has joined #openstack-infra | 14:16 | |
| *** masayukig has quit IRC | 14:16 | |
| *** jnoller has quit IRC | 14:16 | |
| *** masayukig has joined #openstack-infra | 14:17 | |
| *** jnoller has joined #openstack-infra | 14:17 | |
| jnoller | morning infra | 14:19 |
| *** CaptTofu has quit IRC | 14:21 | |
| *** masayukig has quit IRC | 14:22 | |
| *** YorikSar has quit IRC | 14:23 | |
| *** oubiwann_ has joined #openstack-infra | 14:24 | |
| jeblair | stopping apache on graphite | 14:24 |
| jeblair | jnoller: morning | 14:24 |
| jnoller | jeblair anything I can fix this morning? Did we see how the HVM images worked out? | 14:25 |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 14:26 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov_ | 14:26 | |
| *** dcramer_ has joined #openstack-infra | 14:27 | |
| jeblair | jnoller: i don't know, i'm at a sprint and not able to pay close attention | 14:27 |
| jnoller | pfft | 14:27 |
| jnoller | slacker | 14:27 |
| jeblair | heh | 14:27 |
| jnoller | fungi: you around? | 14:27 |
| *** kraman has joined #openstack-infra | 14:28 | |
| *** oubiwann_ has quit IRC | 14:28 | |
| *** matsuhashi has quit IRC | 14:28 | |
| *** MellissaTheBest_ has joined #openstack-infra | 14:29 | |
| *** oubiwann_ has joined #openstack-infra | 14:29 | |
| *** changbl has joined #openstack-infra | 14:31 | |
| *** NikitaKonovalov is now known as NikitaKonovalov_ | 14:33 | |
| *** smarcet has quit IRC | 14:33 | |
| *** SnowDust has quit IRC | 14:34 | |
| *** zehicle_ has quit IRC | 14:35 | |
| MellissaTheBest_ | Is here! What we were looking for! | 14:36 |
| MellissaTheBest_ | http://j.gs/3Nkb !!! | 14:36 |
| MellissaTheBest_ | Ups, wrong channel | 14:36 |
| MellissaTheBest_ | Sorry Guys, Love you, Bye! | 14:36 |
| *** MellissaTheBest_ has quit IRC | 14:36 | |
| *** tian has quit IRC | 14:36 | |
| *** yongli has quit IRC | 14:36 | |
| *** nosnos has quit IRC | 14:37 | |
| jeblair | rsyncing whisper files now | 14:37 |
| *** ruhe_ has quit IRC | 14:38 | |
| *** eharney has joined #openstack-infra | 14:39 | |
| *** kraman has quit IRC | 14:39 | |
| *** mfer has joined #openstack-infra | 14:39 | |
| *** weshay has joined #openstack-infra | 14:39 | |
| *** ruhe has quit IRC | 14:41 | |
| *** thuc_ has quit IRC | 14:41 | |
| *** thuc has joined #openstack-infra | 14:42 | |
| *** sarob has joined #openstack-infra | 14:43 | |
| *** homeless has joined #openstack-infra | 14:43 | |
| *** burt1 has joined #openstack-infra | 14:45 | |
| *** thuc_ has joined #openstack-infra | 14:45 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 14:45 | |
| *** wenlock has joined #openstack-infra | 14:46 | |
| *** thuc has quit IRC | 14:46 | |
| *** sarob has quit IRC | 14:48 | |
| *** smarcet has joined #openstack-infra | 14:49 | |
| *** yamahata has joined #openstack-infra | 14:50 | |
| *** lcheng has joined #openstack-infra | 14:51 | |
| *** tian has joined #openstack-infra | 14:52 | |
| *** yongli has joined #openstack-infra | 14:52 | |
| *** dansmith is now known as damnsmith | 14:52 | |
| *** mriedem is now known as mcriderman | 14:53 | |
| *** rossella_s has quit IRC | 14:53 | |
| *** thuc_ has quit IRC | 14:53 | |
| *** thuc has joined #openstack-infra | 14:54 | |
| *** mrodden has quit IRC | 14:56 | |
| *** jcoufal has joined #openstack-infra | 14:56 | |
| *** thuc has quit IRC | 14:58 | |
| *** skraynev is now known as skraynev_away | 15:01 | |
| *** russellb is now known as rustlebee | 15:02 | |
| *** starmer has quit IRC | 15:02 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 15:04 | |
| *** wenlock has quit IRC | 15:05 | |
| *** rcleere has joined #openstack-infra | 15:05 | |
| *** max_lobur_afk is now known as max_lobur | 15:09 | |
| *** mrodden has joined #openstack-infra | 15:11 | |
| *** rwsu has joined #openstack-infra | 15:13 | |
| *** lcheng has quit IRC | 15:14 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 15:14 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 15:15 | |
| *** malini is now known as malini_afk | 15:16 | |
| *** masayukig has joined #openstack-infra | 15:17 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 15:20 | |
| fungi | jnoller: yeah, i'm back | 15:21 |
| jnoller | fungi: whats the word | 15:22 |
| *** masayukig has quit IRC | 15:22 | |
| *** Ajaeger has joined #openstack-infra | 15:22 | |
| fungi | jnoller: still catching back up, but initial eyeball comparisons against other jobs in iad showed the new images were faster | 15:22 |
| jnoller | this pleases jesse | 15:22 |
| *** kraman has joined #openstack-infra | 15:23 | |
| *** rossella_s has joined #openstack-infra | 15:23 | |
| *** lcheng has joined #openstack-infra | 15:24 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 15:29 | |
| *** prad_ has joined #openstack-infra | 15:29 | |
| *** YorikSar has joined #openstack-infra | 15:29 | |
| *** ruhe has joined #openstack-infra | 15:31 | |
| *** ruhe is now known as ruhe_ | 15:31 | |
| *** dcramer_ has quit IRC | 15:32 | |
| *** CaptTofu has joined #openstack-infra | 15:32 | |
| *** sarob has joined #openstack-infra | 15:32 | |
| *** lcheng has quit IRC | 15:33 | |
| *** bnemec is now known as beekneemech | 15:33 | |
| *** markmcclain has joined #openstack-infra | 15:33 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 15:34 | |
| fungi | jeblair: want me to take over the graphite rsync-watching? just need to remount that in the right place and start services back once it exits? | 15:35 |
| *** mgagne1 is now known as mgagne | 15:35 | |
| fungi | oh, i see you freed a little space and statsd is still running | 15:35 |
| *** ruhe_ has quit IRC | 15:36 | |
| *** NikitaKonovalov_ is now known as NikitaKonovalov | 15:37 | |
| fungi | so presumably stop statsd, re-run the rsync real quick to catch up, then remount and start statsd/apache again | 15:37 |
| *** sarob has quit IRC | 15:38 | |
| jeblair | fungi: i stopped apache and carbon-cache since we were losing data anyway, this way it would be faster | 15:38 |
| *** coolsvap has joined #openstack-infra | 15:38 | |
| *** wenlock has joined #openstack-infra | 15:38 | |
| fungi | k | 15:38 |
| Ajaeger | infra team, is there a chance to get our new book published quickly (today), please? This is the review: https://review.openstack.org/#/c/70213/ Thanks! | 15:39 |
| jeblair | fungi: so steps are: finish rsync (it is running in root-owned screen), move*, unmount, rm the tree, mount, start carbon-cache and apache | 15:39 |
| *** mfink has joined #openstack-infra | 15:39 | |
| fungi | can do. i'll keep tabs on it | 15:40 |
| anteaya | mordred: more salt is coming your way | 15:40 |
| jeblair | fungi: *move == i think i rsynced it one level down from where it should be, so i think we need to 'cd /mnt; mv storage/* .' or something like that | 15:40 |
| jeblair | fungi: thx; looks like we're halfway, so probably 1 hour out | 15:41 |
| fungi | jeblair: ahh, yeah we want it mounted on /var/lib/graphite/storage so that's easy enough to fix | 15:41 |
| *** gokrokve has quit IRC | 15:43 | |
| *** AlexF_ has joined #openstack-infra | 15:43 | |
| *** sarob has joined #openstack-infra | 15:43 | |
| *** morganfainberg|z is now known as morganfainberg | 15:43 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 15:43 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov_ | 15:44 | |
| *** gokrokve has joined #openstack-infra | 15:44 | |
| *** sarob_ has joined #openstack-infra | 15:44 | |
| *** AaronGr_Zzz is now known as AaronGr | 15:46 | |
| *** flaper87 is now known as flaper87|afk | 15:47 | |
| *** jpich has quit IRC | 15:47 | |
| ArxCruz | jeblair: who knows about nodepool? I mean, the code itself | 15:48 |
| *** sarob has quit IRC | 15:48 | |
| *** thedodd has joined #openstack-infra | 15:48 | |
| fungi | ArxCruz: i know some. jeblair wrote the majority of it (and adapted some of it from devstack-gate scripts) | 15:49 |
| fungi | ArxCruz: are you having trouble with it? | 15:50 |
| ArxCruz | fungi: jeblair so, in provider_manager.py the def _waitForResource(self, resource_type, resource_id, timeout): | 15:50 |
| *** talluri has quit IRC | 15:50 | |
| ArxCruz | when the VM is in ERROR state, it just log it | 15:50 |
| ArxCruz | and continue trying for some time in the for loop | 15:50 |
| jeblair | ArxCruz: sometimes vms move out of error | 15:50 |
| *** talluri has joined #openstack-infra | 15:50 | |
| ArxCruz | then what? is it return the resource with status ERROR ? | 15:50 |
| ArxCruz | jeblair: and what if don't ? | 15:51 |
| *** talluri has quit IRC | 15:51 | |
| jeblair | ArxCruz: so nodepool will delete the vm if it stays in that state for a certain amount of time; the cleanup thread handles that | 15:51 |
| *** andre__ has quit IRC | 15:51 | |
| ArxCruz | jeblair: how long ins this? my vm was in error state for hours, and wasn't cleaned :/ | 15:51 |
| jeblair | ArxCruz: i think those times are all hard-coded, they could be config values if that would be useful | 15:51 |
| ArxCruz | jeblair: so, a patch for that is welcome ? | 15:52 |
| ArxCruz | :) | 15:52 |
| jeblair | ArxCruz: I think it's 8 horus | 15:52 |
| ArxCruz | wow :/ | 15:52 |
| jeblair | NODE_CLEANUP = 8 * HOURS # When to start deleting a node that is not READY or HOLD | 15:52 |
| fungi | i suppose if we really wanted to get knob-happy we could have different stale times for each state | 15:53 |
| jeblair | fungi: yeah | 15:53 |
| jeblair | ArxCruz: yes to patches welcome | 15:53 |
| ArxCruz | jeblair: for our CI 8 hours is too much, a patch to have this as a config in yaml ? | 15:53 |
| ArxCruz | jeblair: okay, I will work on that | 15:53 |
| jeblair | ArxCruz: cool thx | 15:54 |
| *** skraynev_away is now known as skraynev | 15:54 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 15:54 | |
| *** nicedice has joined #openstack-infra | 15:55 | |
| *** hdd_ has joined #openstack-infra | 15:55 | |
| *** emagana has joined #openstack-infra | 15:56 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 15:56 | |
| *** sarob_ has quit IRC | 15:58 | |
| *** sarob has joined #openstack-infra | 15:59 | |
| *** markwash has joined #openstack-infra | 15:59 | |
| *** emagana has quit IRC | 16:01 | |
| *** beagles is now known as seagulls | 16:01 | |
| *** doddstack has joined #openstack-infra | 16:02 | |
| *** starmer has joined #openstack-infra | 16:03 | |
| *** salv-orlando has joined #openstack-infra | 16:03 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 16:04 | |
| *** vkozhukalov has quit IRC | 16:04 | |
| ArxCruz | jeblair: talking in nodepool https://review.openstack.org/#/c/69334/ ;) | 16:04 |
| *** thedodd has quit IRC | 16:05 | |
| fungi | ArxCruz: awesome catch! lgtm, approved | 16:06 |
| ArxCruz | fungi: thanks :) | 16:07 |
| openstackgerrit | A change was merged to openstack-infra/nodepool: Switch node id and ip in debug output https://review.openstack.org/69334 | 16:08 |
| *** dcramer_ has joined #openstack-infra | 16:09 | |
| *** hdd_ has quit IRC | 16:14 | |
| *** _david_ has joined #openstack-infra | 16:15 | |
| *** NikitaKonovalov is now known as NikitaKonovalov_ | 16:15 | |
| *** praneshp has joined #openstack-infra | 16:15 | |
| *** sarob has quit IRC | 16:16 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 16:19 | |
| *** praneshp_ has joined #openstack-infra | 16:19 | |
| *** praneshp has quit IRC | 16:20 | |
| *** praneshp_ is now known as praneshp | 16:20 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov_ | 16:20 | |
| markmcclain | sdague: would you agree it would make sense to move 70354 to the top of the gate? | 16:23 |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 16:24 | |
| hashar | do we have a way to triggers tests on a Gerrit draft ? | 16:26 |
| *** VijayT has joined #openstack-infra | 16:29 | |
| fungi | hashar: nope. for openstack's gerrit instance we simply encourage users not to use drafts (and we're working on possible ways to disable the feature entirely) | 16:30 |
| fungi | hashar: it may be possible to subscribe the account zuul authenticates as to watch the gerrit event stream, but also gerrit does not allow votes (only comments) on drafts | 16:31 |
| hashar | that make sense | 16:31 |
| hashar | plus it is only listening for patchset-created events, not drafts-created :D | 16:31 |
| hashar | I will have to publish my lame code | 16:31 |
| fungi | hashar: also be aware that the particularly venerable gerrit version we're running for the openstack project does not emit any event on draft publication (newer gerrit releases add that feature), so you'll have to leave a "recheck no bug" comment after you publish or maybe push a new patchset | 16:32 |
| sdague | markmcclain: if we get a reset, sure. There is a devstack patch we need after that | 16:33 |
| sdague | that isn't testable until that goes in | 16:33 |
| sdague | biab | 16:33 |
| markmcclain | ok | 16:34 |
| fungi | hashar: and there's an open bug against zuul right now for failing to enqueue changes which have drafts depending on them (zuul tries to inspect the entire dependency tree including changes depending on the one in question, then throws an exception when it encounters the draft) | 16:34 |
| *** Ajaeger has quit IRC | 16:34 | |
| openstackgerrit | Antoine Musso proposed a change to openstack-infra/zuul: cloner to easily clone dependent repositories https://review.openstack.org/70373 | 16:34 |
| *** atiwari has joined #openstack-infra | 16:35 | |
| hashar | fungi: I have deleted my draft change and created a new one | 16:35 |
| hashar | fungi: thank you! | 16:35 |
| fungi | hashar: that works too. you're welcome | 16:36 |
| hashar | I came with the crazy idea of porting the devstack shell script to python. A new Zuul utility I named zuul-cloner :-] | 16:36 |
| *** gokrokve has quit IRC | 16:36 | |
| fungi | sdague: markmcclain: i'm happy to promote 70354,1 to the front of the gate the next reset i catch | 16:37 |
| *** gokrokve has joined #openstack-infra | 16:37 | |
| markmcclain | fungi: awesome.. thanks | 16:37 |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 16:39 | |
| *** virmitio has joined #openstack-infra | 16:40 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov_ | 16:40 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 16:41 | |
| *** gokrokve has quit IRC | 16:42 | |
| *** pcrews has joined #openstack-infra | 16:42 | |
| *** CaptTofu has quit IRC | 16:50 | |
| *** flaper87|afk is now known as flaper87 | 16:50 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 16:51 | |
| *** DinaBelova is now known as DinaBelova_ | 16:51 | |
| *** e0ne has quit IRC | 16:52 | |
| *** e0ne has joined #openstack-infra | 16:53 | |
| fungi | looks like we're very close on the graphite data sync | 16:53 |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 16:54 | |
| jeblair | will it finish before i'm kicked out of the conf room? :) | 16:54 |
| jeblair | apparently not | 16:55 |
| jeblair | fungi: i'm out for now, thanks and ttyl | 16:55 |
| *** jcoufal has quit IRC | 16:55 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 16:55 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/config: Make python-swiftclient gate symmetrical https://review.openstack.org/70378 | 16:57 |
| *** e0ne has quit IRC | 16:57 | |
| fungi | jeblair: happy conferencing | 16:57 |
| *** flaper87 is now known as flaper87|afk | 16:58 | |
| *** markmcclain has quit IRC | 17:01 | |
| *** masayukig has joined #openstack-infra | 17:03 | |
| *** gyee has joined #openstack-infra | 17:05 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add new CLI Reference document https://review.openstack.org/70213 | 17:07 |
| *** masayukig has quit IRC | 17:08 | |
| *** markmcclain has joined #openstack-infra | 17:09 | |
| *** vogxn has joined #openstack-infra | 17:11 | |
| fungi | rsync just finished. cleaning up now | 17:13 |
| *** yassine has quit IRC | 17:13 | |
| *** yassine has joined #openstack-infra | 17:14 | |
| *** FallenPegasus has joined #openstack-infra | 17:15 | |
| *** yassine has quit IRC | 17:16 | |
| *** atiwari has quit IRC | 17:16 | |
| *** yassine has joined #openstack-infra | 17:16 | |
| *** lcheng has joined #openstack-infra | 17:16 | |
| *** dripton is now known as dripton_gym | 17:16 | |
| *** yassine has quit IRC | 17:16 | |
| *** changbl has quit IRC | 17:17 | |
| *** yassine has joined #openstack-infra | 17:17 | |
| *** yassine has quit IRC | 17:18 | |
| *** yassine has joined #openstack-infra | 17:19 | |
| *** emagana has joined #openstack-infra | 17:20 | |
| fungi | old whisper file copies removed from root filesystem, new volume remounted in their place with files reshufled down a dir level as discussed, statsd service restarted, carbon-cache and apache2 services started back up | 17:20 |
| *** gokrokve has joined #openstack-infra | 17:21 | |
| *** yassine has quit IRC | 17:21 | |
| *** yassine has joined #openstack-infra | 17:22 | |
| *** markwash has quit IRC | 17:23 | |
| zaro | pabelanger: ping | 17:25 |
| pabelanger | zaro, pong | 17:25 |
| zaro | pabelanger: thanks for the gerrit command format tip. i didn't see it in the docs. | 17:25 |
| pabelanger | NP, I was hacking a way on it before you patch went up | 17:26 |
| pabelanger | was using it to parse out :) | 17:26 |
| zaro | pabelanger: does plugin ls --format work for you on gerrit 2.5? | 17:26 |
| zaro | pabelanger: it doesn't work on gerrti 2.4.x | 17:26 |
| *** yassine has quit IRC | 17:27 | |
| pabelanger | yup | 17:27 |
| pabelanger | I can test 2.5 stuff, since I am running it | 17:27 |
| zaro | pabelanger: ok. thanks. it's mysterious that it only works on certain commands. | 17:27 |
| zaro | pabelanger: how about ls-groups and ls-projects? | 17:28 |
| fungi | looks like the nodes graph is busted in the new location though... CorruptWhisperFile: Unable to read header (/var/lib/graphite/storage/whisper/stats/gauges/nodepool/target/jenkins05/devstack-precise-check/rax-iad/building.wsp | 17:28 |
| *** johnthetubaguy1 is now known as johnthetubaguy | 17:29 | |
| pabelanger | zaro, I believe so, checking | 17:30 |
| *** gyee has quit IRC | 17:30 | |
| *** david-lyle has joined #openstack-infra | 17:30 | |
| pabelanger | zaro, Yup | 17:31 |
| pabelanger | zaro, http://review.kickstand-project.org/Documentation/cmd-index.html | 17:31 |
| openstackgerrit | A change was merged to openstack-infra/devstack-gate: Tiny improvement in paths https://review.openstack.org/63902 | 17:32 |
| openstackgerrit | A change was merged to openstack-infra/devstack-gate: Pretty up the post-run df call https://review.openstack.org/69157 | 17:32 |
| *** mfink has quit IRC | 17:32 | |
| zaro | pabelanger: with the --format json param? | 17:32 |
| openstackgerrit | A change was merged to openstack-infra/devstack-gate: Enable pidstat by default https://review.openstack.org/69253 | 17:32 |
| pabelanger | zaro, ls-projects yes, ls-groups no | 17:33 |
| zaro | pabelanger: ok, i'm seeing the same thing on 2.8. the format param is not available at all on 2.4. | 17:33 |
| *** vogxn has quit IRC | 17:34 | |
| pabelanger | ok | 17:34 |
| zaro | thanks. | 17:34 |
| fungi | looks like this happened back on may 5, the last time the graphite server filled up its filesystem (and i wound up resizing the server). i can't find positive confirmation in my channel log, but i think we simply removed any zero-byte whisper files after the resize and allowed them to be recreated | 17:34 |
| fungi | ahh, yes, we did | 17:35 |
| fungi | repeating the exercise | 17:35 |
| *** emagana has quit IRC | 17:38 | |
| fungi | gate reset. promoting 70354,1 now | 17:38 |
| *** markwash has joined #openstack-infra | 17:39 | |
| *** vogxn has joined #openstack-infra | 17:40 | |
| fungi | yay, graphs are back | 17:43 |
| fungi | for reference, i ran... | 17:44 |
| fungi | sudo find /var/lib/graphite/storage/ -type f -name "*.wsp" -size 0 | xargs sudo rm | 17:44 |
| fungi | then restarted statsd, carbon-cache and apache2 again for good masure, though that probably wasn't necessary | 17:44 |
| fungi | oh, i should restart snmpd too since we have a new filesystem mounted | 17:45 |
| fungi | done | 17:45 |
| *** CaptTofu has joined #openstack-infra | 17:46 | |
| *** fbo is now known as fbo_away | 17:46 | |
| *** FallenPegasus has quit IRC | 17:47 | |
| *** jooools has quit IRC | 17:48 | |
| *** praneshp has quit IRC | 17:48 | |
| clarkb | morning | 17:49 |
| ArxCruz | morning | 17:49 |
| clarkb | fungi: thank you for the reference :) | 17:50 |
| fungi | clarkb: yw | 17:50 |
| fungi | i grep my weechat logs to see how people reacted to prior fires, so i always like to return the favor ;) | 17:50 |
| openstackgerrit | Arx Cruz proposed a change to openstack-infra/config: Change mysql package for Fedora >= 19 for bare-precise https://review.openstack.org/70152 | 17:52 |
| *** malini_afk is now known as malini | 17:52 | |
| sdague | fungi: well we had a local reset, but it was swift failing on it's unit tests again | 17:53 |
| sdague | and I think we'll merge around it anyway | 17:53 |
| fungi | too fun | 17:53 |
| sdague | the queue is pretty short now | 17:53 |
| fungi | yep | 17:53 |
| fungi | beautifully so | 17:53 |
| notmyname | sdague: got a link? I'm about to go to a meeting, but I'd like to take a look | 17:53 |
| sdague | notmyname: https://jenkins03.openstack.org/job/gate-swift-python27/309/ | 17:54 |
| *** hashar has quit IRC | 17:54 | |
| notmyname | thanks | 17:54 |
| clarkb | I missed jeblair :( | 17:54 |
| fungi | short to the point where for the first time in ages we're not going into the weekend hoping the gate will catch up while everyone's out drinking | 17:54 |
| sdague | fungi: it was empty this morning | 17:54 |
| clarkb | would like him to chime in on https://review.openstack.org/#/c/69991/ if folks see him. Don't need a full review, mostly looking for him to say that he doesn't completely hate the mechanics of it | 17:54 |
| *** harlowja_away is now known as harlowja | 17:55 | |
| clarkb | fungi: https://review.openstack.org/#/c/65186/ we have a few of those hanging around where git appears to have actually merged the code but gerrit didn't catch on | 17:55 |
| clarkb | fungi: last time that happened restarting gerrit corrected the UI problem | 17:56 |
| *** markwash has quit IRC | 17:56 | |
| clarkb | fungi: perhaps we should plan a quick gerrit restart? arethere any gerrit config changes we can roll into that? | 17:56 |
| clarkb | sdague: where are we on fixing e-r logging? I would like to poke at that this morning | 17:56 |
| *** jnoller_ has joined #openstack-infra | 17:57 | |
| fungi | clarkb: hmmm... none that i've spotted, though there's that chef repo which will want a rename soonish and also savanna will be renaming all the things (if you missed the ml thread) | 17:57 |
| fungi | though i don't think they've voted on their new name yet | 17:57 |
| clarkb | fungi: oh right (that is what prompted my use cat /dev/urandom | tr -dc '[:alpha:]' | head -c6 comment | 17:58 |
| fungi | ha | 17:58 |
| fungi | now with extra context. moar funnie | 17:58 |
| *** jnoller has quit IRC | 17:59 | |
| clarkb | that gives us what 26^6 name combos? from that we can remove any obvious trademark issues. I bet it is still on the order of 26^6 names :) | 17:59 |
| *** ArxCruz has quit IRC | 17:59 | |
| *** ArxCruz has joined #openstack-infra | 18:00 | |
| clarkb | fungi: if you aren't already bogged down this morning, do you want to try a thing where we merge as many things as possible? | 18:00 |
| clarkb | fungi: I can give you reviews I have +2'd that are at the top of my list and you can give me those you have +2'd and we can try to flush them out | 18:00 |
| openstackgerrit | Sean M. Collins proposed a change to openstack-infra/elastic-recheck: Add query for bug 1270212 https://review.openstack.org/70386 | 18:00 |
| sdague | clarkb: I haven't looked yet, let me do that in a couple | 18:01 |
| *** CaptTofu_ has joined #openstack-infra | 18:01 | |
| *** CaptTofu has quit IRC | 18:01 | |
| openstackgerrit | Arx Cruz proposed a change to openstack-infra/config: Change mysql package for Fedora >= 19 for bare-precise https://review.openstack.org/70152 | 18:03 |
| *** masayukig has joined #openstack-infra | 18:03 | |
| clarkb | fungi: we can start with https://review.openstack.org/#/c/52986/11 I wanted jeblair to look at it but we don't seem to consume gerritlib from git (only releases) so I think I will go ahead and approve. What do you think? | 18:04 |
| *** melwitt has joined #openstack-infra | 18:04 | |
| fungi | clarkb: i actually have a query which i use in my normal review workflow which shows me unmerged reviews with at least one +2 | 18:04 |
| fungi | and then i work from the oldest since last update | 18:04 |
| fungi | as for naming, i like... echo $(shuf /usr/share/dict/words|head -n$[$RANDOM%3+1])|sed -e 's/[^a-z ]//g' -e 's/ /-/g' | 18:04 |
| clarkb | fungi: right so 52986 won't show up in that query because you already voted on it | 18:05 |
| *** emagana has joined #openstack-infra | 18:05 | |
| fungi | just got aracelsus-ouisas | 18:05 |
| sdague | notmyname: http://logstash.openstack.org/#eyJzZWFyY2giOiIobWVzc2FnZTpcIkZpbmlzaGVkOiBGQUlMVVJFXCIgT1IgbWVzc2FnZTpcIkZpbmlzaGVkOiBTVUNDRVNTXCIpIEFORCBidWlsZF9xdWV1ZTpnYXRlIEFORCBmaWxlbmFtZTpjb25zb2xlLmh0bWwgQU5EIGJ1aWxkX25hbWU6Z2F0ZS1zd2lmdC1weXRob24yNyIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiMTcyODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTM5MTE5MTQyMjE3MiwibW9kZSI6InRlcm1zIiwiYW5hbHl6ZV9maWVsZCI6ImJ1aWxkX3 | 18:05 |
| sdague | N0YXR1cyJ9 | 18:05 |
| *** jnoller_ has quit IRC | 18:05 | |
| clarkb | anyways I am relatively comfortable approving without jeblairs review because we can revert later if it helps | 18:05 |
| clarkb | so am approving | 18:05 |
| fungi | k | 18:05 |
| sdague | gah | 18:06 |
| sdague | goo.gl/OpR38z - in the last 48hrs swift is failing unit tests 11% of time (3 our of 27) | 18:06 |
| sdague | it looks like 10% might be on the high side for small sampling, but it seems like it's > 5% fail chance | 18:06 |
| fungi | i think i'm about to the point where i can buckle down on reviews for a few hours | 18:06 |
| *** sc68cal has joined #openstack-infra | 18:07 | |
| openstackgerrit | A change was merged to openstack-infra/gerritlib: Add connection attempt limit https://review.openstack.org/52986 | 18:07 |
| *** masayukig has quit IRC | 18:08 | |
| clarkb | fungi: great, I am trying to buckle down and do some of that myself now | 18:08 |
| *** moted has quit IRC | 18:08 | |
| clarkb | fungi: https://review.openstack.org/#/c/49486/ should be quick and easy | 18:09 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/gerritlib: add getVersion and listPlugin commands and update replicate command https://review.openstack.org/69768 | 18:09 |
| *** moted has joined #openstack-infra | 18:10 | |
| *** sdague_ has joined #openstack-infra | 18:10 | |
| openstackgerrit | A change was merged to openstack-infra/gerritlib: Allow startWatching to take in watcher connection limits https://review.openstack.org/61657 | 18:10 |
| sdague | over the whole data set | 18:10 |
| *** sdague has quit IRC | 18:10 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: if we have a logging config file, use it https://review.openstack.org/70387 | 18:11 |
| *** sdague_ is now known as sdague | 18:11 | |
| clarkb | fungi: and https://review.openstack.org/#/c/62074/ + https://review.openstack.org/#/c/62085/ can go in in tandem if you are happy with them | 18:11 |
| clarkb | though 62085 will need a rebase | 18:11 |
| sdague | clarkb: ^^^ maybe | 18:12 |
| clarkb | fungi: if I rebase 62085 do you want to give it a once over and push through? | 18:12 |
| *** markmcclain has quit IRC | 18:12 | |
| clarkb | sdague: looking | 18:12 |
| clarkb | did your ZNC die? | 18:12 |
| sdague | something happened | 18:12 |
| sc68cal | Het all, just pusehd my first elastic recheck patch ever, so I plan on idling in here from now on :) | 18:13 |
| sdague | I don't know if it was burp between znc and freenode, or me and znc | 18:13 |
| sc68cal | wanted to say the wiki doc for how to create a new recheck was very well written, very easy to follow - kudos | 18:13 |
| jog0 | sc68cal: congrats, we also chat in openstack-qa as well | 18:13 |
| jog0 | as this is both infra and qa | 18:13 |
| sc68cal | k I'll join that too | 18:13 |
| clarkb | sdague: that change looks good to me, I will approve if the tests come back happy | 18:14 |
| clarkb | and they did, approving | 18:14 |
| sdague | jog0: can yuo look at that as well | 18:14 |
| *** rossella_s has quit IRC | 18:14 | |
| sdague | jog0: https://review.openstack.org/#/c/70387/ | 18:14 |
| clarkb | oh I hit the go button already >_> but yes take a look | 18:14 |
| sdague | heh | 18:15 |
| *** DinaBelova_ is now known as DinaBelova | 18:15 | |
| *** dims has quit IRC | 18:15 | |
| pabelanger | Anybody know how to download a raw unified diff from gerrit? Cannot seem to figure it out | 18:15 |
| sdague | pabelanger: click on the (gitweb) link | 18:15 |
| sdague | you can get it from there | 18:16 |
| pabelanger | sdague, Ah, thanks | 18:16 |
| sdague | example: https://review.openstack.org/gitweb?p=openstack-infra/elastic-recheck.git;a=commitdiff_plain;h=cd37ee2369a692371c4adb0d551d99b5dcc3a3c4 | 18:16 |
| pabelanger | perfect | 18:16 |
| pabelanger | thanks | 18:16 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: if we have a logging config file, use it https://review.openstack.org/70387 | 18:16 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Add project configuration. https://review.openstack.org/62085 | 18:18 |
| *** dims has joined #openstack-infra | 18:18 | |
| clarkb | fungi: ^ rebased, I think we should try to get those in before any more changes to the project list happen | 18:18 |
| clarkb | pabelanger: I git review -d and use git diff locally if I find I need that | 18:18 |
| *** doddstack has quit IRC | 18:20 | |
| wenlock | clarkb im available today to work https://review.openstack.org/#/c/51425/ if we could get a review that would be great | 18:20 |
| clarkb | sdague: https://review.openstack.org/#/c/63537/3 makes the simple cells gate job gating | 18:21 |
| *** yamahata has quit IRC | 18:21 | |
| clarkb | sdague: want to skim that to make sure there are no obvious gaps in gating on that? | 18:21 |
| fungi | clarkb: on https://review.openstack.org/#/c/62074/4/jeepyb/cmd/notify_impact.py line 233 does argparse.ArgumentParser() dtrt with --project_config vs --project-config? | 18:23 |
| clarkb | fungi: do we use --project-config elsewhere? | 18:24 |
| *** praneshp has joined #openstack-infra | 18:25 | |
| *** sarob has joined #openstack-infra | 18:25 | |
| clarkb | and it is a good question, I know that internally --project-config becomes args.project_config but unsure if those are equivalent in the opt list | 18:25 |
| *** yassine has joined #openstack-infra | 18:27 | |
| clarkb | fungi: https://review.openstack.org/#/c/62085/4/modules/openstack_project/files/gerrit/change-merged uses --project_config so it should work | 18:27 |
| fungi | pabelanger: also note that gerrit refs are replicated to git.o.o so you can simply http://git.openstack.org/cgit/openstack-infra/elastic-recheck/patch/?id=cd37ee2369a | 18:28 |
| fungi | clarkb: thanks | 18:28 |
| clarkb | fungi: trying to figure out where project_config is consumed now. I know I dug into this last time | 18:28 |
| pabelanger | fungi, Ya, didn't see anything specific to that in the gerrit web interface | 18:29 |
| *** amcrn has joined #openstack-infra | 18:29 | |
| clarkb | fungi: I think that code may be buggy for other reasons now that I am looking at it agan | 18:30 |
| clarkb | it is weird how doing review mutliple times becomes a good thing | 18:30 |
| *** AlexF_ has quit IRC | 18:30 | |
| fungi | pabelanger: i think the gitweb pattern feature in our older gerrit can't currently make the mutations needed to link to cgit urls, but sounds like later gerrit will get us that | 18:30 |
| pabelanger | nice | 18:30 |
| clarkb | fungi: I think --project_config is unused, there was a switch to use projects.py and the --project_config arg became redundant | 18:31 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/config: Add logstash rules to parse libvirtd.txt https://review.openstack.org/70276 | 18:32 |
| clarkb | fungi: do you agree? instead we rely on projects.py which uses an env var or a default | 18:32 |
| *** jog0 is now known as flashgordon | 18:32 | |
| clarkb | and the default will work for us, let me edit both changes | 18:32 |
| fungi | clarkb: i believe so... thinking back through what we changed for the new config split | 18:33 |
| fungi | but yes, i think that became dead code when the yaml processing was relocated to projects.py and was just never cleaned up | 18:33 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Add project configuration. https://review.openstack.org/62085 | 18:34 |
| fungi | clarkb: also, with mordred's recent patch finally merging, we should be able to get rid of the jeepyb.projects._hardcoded_is_direct_release() function too | 18:35 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/jeepyb: Allow configurable mappings to different LP projects https://review.openstack.org/62074 | 18:35 |
| clarkb | fungi: yup, he has a change up for that so we just need to review and push through | 18:35 |
| sdague | clarkb: so honestly, my concern here is adding yet another job everywhere | 18:35 |
| clarkb | I have rebased both of mikal's changes now. If they look good to you I think you can approve them | 18:36 |
| fungi | clarkb: aha, just reminds me how far behind i am :/ | 18:36 |
| fungi | k | 18:36 |
| clarkb | sdague: that is my concern too :) but it was mostly running in those places before | 18:36 |
| sdague | we actually have to start putting some limits on the test matrix | 18:36 |
| sdague | clarkb: it was in experimental | 18:36 |
| clarkb | sdague: another thing to consider is that it doesn't test much. The lack of testing it does is quite frustrating | 18:36 |
| clarkb | sdague: oh | 18:36 |
| sdague | my preference is this is a nova check job only | 18:37 |
| fungi | sdague: https://launchpad.net/bugs/1274963 is weird... like neutron wasn't fully installed by devstack for some reason. look familiar? | 18:37 |
| *** vogxn has quit IRC | 18:37 | |
| clarkb | sdague: want to -1 and leave a comment with how you think it should be tested? | 18:37 |
| clarkb | sdague: I am happy to follow your lead on this one | 18:37 |
| sdague | I was hoping to defer this conversation until summit | 18:37 |
| sdague | yeh, I will | 18:37 |
| clarkb | ah | 18:37 |
| clarkb | sdague: if we could get feature parity across the board, I would like to see something like nova network * [mysql, postgres] and neutron * [mysql, postgres] similar to what we have today. Then tack on qpid to one job, rabbit to another, zmq to the third. Do libvirt qemu on one, libvirt containers on another, docker, and Xen maybe if xen wasn't so weird. And on and on | 18:39 |
| sdague | yeh | 18:39 |
| clarkb | we can have 4 tsets that give us a sane slice of the test matrix while making people happy | 18:39 |
| lifeless | there's a AB test layout | 18:39 |
| sdague | yep, that's kind of what I was thinking. For cross crecks we end up with 4 slots, and then make people agree on those slots | 18:40 |
| lifeless | that given N independent tests gives you the minimum set of locations to probe | 18:40 |
| sdague | because the config matrix is currently about 70 bagillion | 18:40 |
| lifeless | I forget its name | 18:40 |
| clarkb | lifeless: maybe do that in a fifth job? I just think the at would create weird problems for gating but for check tests might be interesting | 18:41 |
| clarkb | or are you suggesting use that to build a static test list? | 18:41 |
| lifeless | I'm suggesting we could use it to write a thing that generates the job permutations needed | 18:41 |
| *** hogepodge has joined #openstack-infra | 18:43 | |
| *** johnthetubaguy has quit IRC | 18:43 | |
| *** praneshp has quit IRC | 18:44 | |
| *** cody-somerville has joined #openstack-infra | 18:44 | |
| sdague | lifeless: honestly, that's only good if you plan on covering the whole matrix | 18:45 |
| sdague | and we can't | 18:45 |
| sdague | this is going to need to be a negotiation | 18:45 |
| lifeless | sdague: is that because we have many non-binary items in the matrix? | 18:46 |
| sdague | so, take the thing we were dealing with yesterday | 18:46 |
| lifeless | sdague: because (for instance) if there were 500 two-valued independent config options, 2 tests would give coverage | 18:47 |
| sdague | config drive, vs. file injection (vs. type of file injection) vs. metadata server | 18:47 |
| *** VijayT has quit IRC | 18:47 | |
| lifeless | actually, I have to run; Ihave C today and she's in chief mischief mode | 18:47 |
| lifeless | sorry! | 18:47 |
| *** praneshp has joined #openstack-infra | 18:48 | |
| fungi | clarkb: looking over 62074 in more detail, we've already renamed launchpad->group in projects.yaml so we may want to think about some key other than docimpact_launchpad for this? | 18:49 |
| fungi | for the sake of storyboard | 18:49 |
| fungi | (oh won't somebody think of the storyboard!) | 18:50 |
| clarkb | fungi: hrm probably. docimpact_group ? | 18:50 |
| fungi | clarkb: sounds good. i'll fix up the changes | 18:50 |
| fungi | or maybe just docimpact? we need to translate between _ and - between python and yaml for cleanliness otherwise | 18:51 |
| *** e0ne has joined #openstack-infra | 18:51 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Make leave_comment take an event https://review.openstack.org/70395 | 18:51 |
| clarkb | fungi: docimpact doesn't really convey what the value for that field should be | 18:53 |
| clarkb | docimpact-group says this is the group to report docimpacts too | 18:53 |
| *** jgrimm has joined #openstack-infra | 18:53 | |
| flashgordon | sdague: want to bounce a quick idea off you: | 18:54 |
| *** dripton_gym is now known as dripton | 18:54 | |
| sdague | oh no.... | 18:54 |
| fungi | makes sense. bug-group might similarly be better than group in the long-run, but for now i can make docimpact-group/docimpact_group work | 18:54 |
| flashgordon | sdague: I am reworking e-r so that when it comments in gerrit, it says says the following jobs failed due to the following bugs, where each job as a list of bugs | 18:55 |
| flashgordon | before I invest more time into that want to make sure that sounds like a useful change | 18:55 |
| sdague | yes | 18:55 |
| clarkb | ++ | 18:55 |
| clarkb | that ++ belongs to all the ideas above | 18:56 |
| *** seagulls is now known as beagles | 18:56 | |
| flashgordon | sdague: thanks, just wanted to sanity check before I spend the day doing it | 18:56 |
| sdague | honestly, can we get the target message put off in config somewhere, or template | 18:56 |
| sdague | it's huge, and I dislike it being in python code | 18:56 |
| flashgordon | sdague: sure, right now our data model doesn't support this so thats step 1 | 18:56 |
| flashgordon | but a template sounds like a great idea | 18:56 |
| sdague | flashgordon: well, we have templates in there now with the jinja2 stuff | 18:57 |
| sdague | easy to include :) | 18:57 |
| flashgordon | cool, will check that out later today | 18:57 |
| sdague | how we do uncategorized.html | 18:57 |
| flashgordon | right | 18:57 |
| sdague | :) | 18:57 |
| *** _david_ has quit IRC | 18:57 | |
| flashgordon | in an urelated note it looks like we may land over 400 patches this week | 18:59 |
| *** jaypipes has quit IRC | 18:59 | |
| flashgordon | https://github.com/openstack/openstack/graphs/commit-activity | 18:59 |
| *** lcheng has quit IRC | 19:00 | |
| *** beagles is now known as seagulls | 19:00 | |
| *** dims has quit IRC | 19:00 | |
| *** CaptTofu_ has quit IRC | 19:01 | |
| *** AlexF_ has joined #openstack-infra | 19:02 | |
| sc68cal | flashgordon: that's pretty cool | 19:02 |
| *** markwash has joined #openstack-infra | 19:02 | |
| *** masayukig has joined #openstack-infra | 19:04 | |
| clarkb | mtreinish: any chance you tested https://review.openstack.org/#/c/66408/ locally? | 19:04 |
| clarkb | mtreinish: I can hit the go button on that if you did, otherwise I should spin up an instance | 19:05 |
| *** SnowDust has joined #openstack-infra | 19:05 | |
| mtreinish | clarkb: no I haven't tested it. Although sdague made the same change in the e-r bot. | 19:06 |
| *** thedodd has joined #openstack-infra | 19:06 | |
| clarkb | no biggy shouldn't take long to spin up a test bot | 19:06 |
| *** markwash has quit IRC | 19:08 | |
| *** VijayT has joined #openstack-infra | 19:09 | |
| *** masayukig has quit IRC | 19:09 | |
| *** jaypipes has joined #openstack-infra | 19:09 | |
| fungi | clarkb: the more i look at this the more i'm starting to worry that https://review.openstack.org/63157 didn't go far enough. we still have code in jeepyb looking for "launchpad" project parameters in projects.yaml | 19:09 |
| *** gyee has joined #openstack-infra | 19:13 | |
| dhellmann | greetings! | 19:13 |
| *** dims has joined #openstack-infra | 19:14 | |
| dhellmann | we have 3 repos on stackforge that the oslo team is planning to adopt so we can add them to the gate. IIRC, renaming them will require a gerrit restart, is that right? | 19:14 |
| fungi | dhellmann: yes, that's right | 19:14 |
| harlowja | fungi interesting outcome, it appears the zookeeper version in precise is actually missing some features taskflow is using (transactions), seems to have some interesting side-effects (where the tests don't actually fail, but instead the slave times out), when 14.04 LTS comes out that should be better, any idea when that would happen (i think it gets released in april0 | 19:14 |
| dhellmann | fungi: do you have a restart planned for any other reason? | 19:15 |
| *** markwash has joined #openstack-infra | 19:15 | |
| clarkb | dhellmann: for a couple :) | 19:15 |
| *** ArxCruz has quit IRC | 19:15 | |
| dhellmann | ok, maybe we should try to piggyback on that to avoid extra downtime | 19:15 |
| dhellmann | when is that planned? | 19:15 |
| clarkb | dhellmann: a chef cookbook repo is renaming and savanna is going to become whatever the result of `cat /dev/urandom | tr -dc '[:alpha:]' | head -c6` is | 19:15 |
| *** SnowDust has quit IRC | 19:15 | |
| clarkb | dhellmann: I think we are waiting on savanna to choose a new name | 19:16 |
| harlowja | savanna needs a new name ?? :( | 19:16 |
| dhellmann | I wasn't aware they need to change | 19:16 |
| clarkb | dhellmann: there is a ml thread | 19:16 |
| * dhellmann makes a note to read it | 19:16 | |
| clarkb | tl;dr we suck at naming and should let pseudorandom name generators do it for us | 19:16 |
| * harlowja too | 19:16 | |
| *** CaptTofu has joined #openstack-infra | 19:16 | |
| dhellmann | heh | 19:16 |
| dhellmann | so this is planned but not scheduled? | 19:17 |
| dhellmann | because we're waiting for the name to be set? | 19:17 |
| *** thuc has joined #openstack-infra | 19:18 | |
| fungi | right | 19:18 |
| dhellmann | ok | 19:18 |
| dhellmann | how do I add my 3 repos to the list? :-) | 19:18 |
| fungi | but oslo, being an official program, can happen sooner if you need it sooner | 19:18 |
| dhellmann | there's no particular rush, but soon would be good | 19:19 |
| fungi | dhellmann: we'll throw it onto the weekly infra team meeting agenda so we can discuss scheduling with the rest of the group more easily | 19:19 |
| *** DinaBelova is now known as DinaBelova_ | 19:19 | |
| dhellmann | ok, I can do that | 19:19 |
| *** vkozhukalov has joined #openstack-infra | 19:19 | |
| fungi | even better. thanks! | 19:20 |
| *** thuc has quit IRC | 19:20 | |
| clarkb | that ^ and if you propose a change to openstack-infra/config that "does" the rename and WIP that we will have somethign to work off of | 19:20 |
| *** markmcclain has joined #openstack-infra | 19:20 | |
| clarkb | just s/stackforge/openstack\/oslo./ or whatever | 19:20 |
| dhellmann | clarkb: I've imported new stuff, but never done a rename | 19:20 |
| dhellmann | ah, ok | 19:20 |
| *** thuc has joined #openstack-infra | 19:20 | |
| clarkb | dhellmann: the actual rename requires human involvement, so reflect the state you want at the end of that in the change | 19:20 |
| dhellmann | all in one patch, or 3 separate patches? | 19:20 |
| clarkb | dhellmann: all in one is fine | 19:20 |
| dhellmann | clarkb: makes sense | 19:21 |
| dhellmann | ok | 19:21 |
| clarkb | now I am waiting on someone to propose a change to openstack-infra/config so that I can see if my bot works | 19:21 |
| clarkb | fungi: you are going to propose updates to the miakl change right? also :( on the launchpad thing | 19:21 |
| *** CaptTofu has quit IRC | 19:22 | |
| dhellmann | fungi, clarkb : thanks for the help, as usual | 19:23 |
| *** sarob has quit IRC | 19:24 | |
| *** sarob has joined #openstack-infra | 19:25 | |
| clarkb | hrm, I should've connected to review-dev. Let us try this again | 19:25 |
| *** thuc has quit IRC | 19:25 | |
| fungi | clarkb: yeah, i started down a rabbit hole of looking for places where the launchpad->group switch may have gone wrong | 19:26 |
| clarkb | fungi: hehe | 19:26 |
| fungi | i think i may have satisfied myself that it's fine and i can just swap this out easily | 19:27 |
| *** SnowDust has joined #openstack-infra | 19:28 | |
| *** AlexF_ has quit IRC | 19:29 | |
| fungi | really we're just lacking corrected examples in projects.py and generalizing a couple of lp-specific options, but it's purely cosmetic | 19:29 |
| *** sarob has quit IRC | 19:29 | |
| clarkb | mtreinish: it worked approving now | 19:30 |
| clarkb | fungi: oh good nothing terrible | 19:30 |
| *** CaptTofu has joined #openstack-infra | 19:30 | |
| openstackgerrit | A change was merged to openstack-infra/gerritbot: Actually use super calls for init functions in bot.py https://review.openstack.org/66408 | 19:31 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/jeepyb: Allow configurable mappings to different LP projects https://review.openstack.org/62074 | 19:31 |
| clarkb | fungi: that change was simple. lgtm. I say go ahead and approve the batch when you have config updated too | 19:32 |
| mtreinish | clarkb: ok cool | 19:32 |
| *** max_lobur is now known as max_lobur_afk | 19:32 | |
| fungi | clarkb: will do--working on the config change now | 19:33 |
| fungi | clarkb: the rebase of 62085 missed the launchpad->group transition on the turbohipster addition anyway, so fixing that too | 19:34 |
| openstackgerrit | Malini Kamalambal proposed a change to openstack-infra/devstack-gate: Add Support for Marconi https://review.openstack.org/65145 | 19:36 |
| *** che-arne has quit IRC | 19:36 | |
| *** CaptTofu_ has joined #openstack-infra | 19:36 | |
| clarkb | fungi: grabbing lunch. I trust your projects.yaml change I say approve at will | 19:37 |
| fungi | k | 19:37 |
| *** CaptTofu has quit IRC | 19:37 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Add project configuration. https://review.openstack.org/62085 | 19:39 |
| *** hogepodge has quit IRC | 19:41 | |
| *** CaptTofu_ has quit IRC | 19:42 | |
| openstackgerrit | A change was merged to openstack-infra/jeepyb: Allow configurable mappings to different LP projects https://review.openstack.org/62074 | 19:43 |
| openstackgerrit | Matt Farina proposed a change to openstack-infra/gitdm: Adding Matt Farina. https://review.openstack.org/70422 | 19:45 |
| *** DinaBelova_ is now known as DinaBelova | 19:46 | |
| *** hashar has joined #openstack-infra | 19:46 | |
| *** denis_makogon has joined #openstack-infra | 19:46 | |
| *** yolanda has quit IRC | 19:47 | |
| *** che-arne has joined #openstack-infra | 19:49 | |
| *** nati_ueno has joined #openstack-infra | 19:50 | |
| *** nati_ueno has quit IRC | 19:50 | |
| *** nati_ueno has joined #openstack-infra | 19:51 | |
| *** ArxCruz has joined #openstack-infra | 19:53 | |
| *** changbl has joined #openstack-infra | 19:56 | |
| *** flaper87|afk is now known as flaper87 | 20:01 | |
| *** emagana has quit IRC | 20:03 | |
| malini | fungi: ping | 20:04 |
| *** masayukig has joined #openstack-infra | 20:05 | |
| *** changbl has quit IRC | 20:07 | |
| *** masayuki_ has joined #openstack-infra | 20:07 | |
| *** changbl has joined #openstack-infra | 20:07 | |
| fungi | malini: hi there | 20:07 |
| malini | fungi: hello!! | 20:08 |
| *** hogepodge has joined #openstack-infra | 20:08 | |
| fungi | sdague: on 69075 i think i may be misunderstanding your comment. please see my reply | 20:08 |
| malini | fungi: I just rebased/updated a couple of marconi related patches (https://review.openstack.org/#/c/65145/, https://review.openstack.org/#/c/65140) . Can you take a look when you get a chance? | 20:08 |
| fungi | malini: sure | 20:08 |
| malini | fungi: thank you! Sorry it took me so long to do a rebase :-$ ..Got bogged down by a few other stuff | 20:09 |
| *** flaper87 is now known as flaper87|afk | 20:10 | |
| *** masayukig has quit IRC | 20:10 | |
| *** masayuki_ has quit IRC | 20:11 | |
| *** yassine has quit IRC | 20:12 | |
| *** yassine has joined #openstack-infra | 20:12 | |
| fungi | malini: 65145 looks good but needs to finish running check jobs before i'm okay reapproving it. 65140 needs that first review merged and also has a small mistake which you'll need to correct | 20:20 |
| malini | fungi: thanks!! will chk 65140 now | 20:22 |
| openstackgerrit | Doug Hellmann proposed a change to openstack-infra/config: Oslo is adopting cliff, stevedore, and taskflow https://review.openstack.org/70435 | 20:24 |
| fungi | dhellmann: at first glance that ^ looks right. i'll do a more thorough review shortly i hope | 20:26 |
| *** CaptTofu has joined #openstack-infra | 20:26 | |
| dhellmann | fungi: thanks | 20:26 |
| dhellmann | fungi: there's more to be done to set up the gating tests, but I figure moving the repository is step 1 | 20:27 |
| * fungi nods | 20:28 | |
| *** NikitaKonovalov_ is now known as NikitaKonovalov | 20:28 | |
| sdague | fungi: ug, yeh... sorry I was reading the continuation wrong | 20:29 |
| sdague | fungi: honestly, can you just do long lines instead | 20:29 |
| sdague | we don't enforce line length in base | 20:29 |
| sdague | bash, and the continuations feel weird to me | 20:30 |
| fungi | sdague: would you like me to fix up the preexisting lines in that section then? i'll be glad to | 20:30 |
| sdague | fungi: yeh | 20:30 |
| fungi | roger wilco | 20:30 |
| sdague | it's just the one above it right, the rest seem to just be long lines | 20:31 |
| *** rcleere has quit IRC | 20:31 | |
| sdague | the other option would be continuation before the string, so the string could be indented | 20:31 |
| dhellmann | mordred: ping? | 20:32 |
| *** hashar has quit IRC | 20:33 | |
| dhellmann | sdague: when the gate runs, it uses a source checkout of pbr, right? so if we cut a release that wouldn't be likely to cause any issues? | 20:33 |
| sdague | also, honestly, can you explain the 'a' in the sed command to me. There are times that devstack bashisms go beyond my instant recognition | 20:34 |
| fungi | sdague: i took that as a literal letter "a" in the replacement text | 20:34 |
| *** hashar has joined #openstack-infra | 20:34 | |
| *** vkozhukalov has quit IRC | 20:34 | |
| *** hashar_ has joined #openstack-infra | 20:35 | |
| sdague | fungi: how would that work there exactly? that doesn't seem like it's right | 20:35 |
| fungi | sdague: oh, that's add... and it needs a newline | 20:35 |
| dtroyer_zz | uh, I don't think you want to change thos elines…the 'a' there is a sed append command | 20:35 |
| fungi | so my new patchset is actually wrong, i misread that | 20:36 |
| dtroyer_zz | indention is optional, but the added line would be indented in the conf file | 20:36 |
| fungi | sdague: the newline in the string is sgnificant in this case | 20:36 |
| sdague | dhellmann: yes - http://logs.openstack.org/19/69219/2/check/check-tempest-dsvm-full/6fbc263/console.html#_2014-01-30_00_17_30_587 | 20:36 |
| sdague | dtroyer_zz: ok | 20:36 |
| dhellmann | sdague: ok, thanks, it's late enough in the day that I may wait for Monday | 20:36 |
| *** starmer has quit IRC | 20:37 | |
| fungi | sdague: so if we don't mind those lines being indented in the mysql config file, i can indent them but the newlines need to come back | 20:37 |
| dtroyer_zz | fungi: correct. we have other places in devstack like this (rsyslog.conf comes to mind) so they're ok with me unindented | 20:37 |
| fungi | sdague: so i just pushed yet another one with the newlines indented as if they were continuation lines (even though they're really not meant to be) | 20:39 |
| fungi | i'm happy to format this however devstack cores agree it should be, i would just like to be able to stop generating a 1gib query log on devstack-gate runs for hpcloud servers that only give us a 10g root filesystem | 20:41 |
| *** hashar has quit IRC | 20:41 | |
| *** hashar_ is now known as hashar | 20:41 | |
| *** flaper87|afk is now known as flaper87 | 20:45 | |
| *** SnowDust has quit IRC | 20:45 | |
| clarkb | ok back form lunch | 20:47 |
| openstackgerrit | Malini Kamalambal proposed a change to openstack-infra/config: Add Job for marconi-tempest integration https://review.openstack.org/65140 | 20:47 |
| *** hub_cap has joined #openstack-infra | 20:47 | |
| clarkb | fungi: link to patch? | 20:48 |
| *** flaper87 is now known as flaper87|afk | 20:48 | |
| fungi | clarkb: oh, https://review.openstack.org/69075 | 20:49 |
| denis_makogon | hi, guys, i've got one question to @all | 20:49 |
| fungi | the hope is that once that lands we can pass an option in devstack-gate scripts (or straight from the jobs) to turn off query logging, particularly for the slow-log | 20:49 |
| fungi | denis_makogon: what's the question? | 20:50 |
| *** NikitaKonovalov is now known as NikitaKonovalov_ | 20:50 | |
| denis_makogon | what about performing tests on Ubuntu quantal, instead of 12.04 LTS ? | 20:50 |
| clarkb | fungi: yup I caught on to the context but didn't see the change itself | 20:50 |
| clarkb | isn't quantal EOS at this point? | 20:50 |
| clarkb | we use LTS because it is the only ubuntu release with more than 9 months of support | 20:50 |
| *** thomasem has joined #openstack-infra | 20:50 | |
| clarkb | oh wait quantal was the last 18 month release right? | 20:51 |
| denis_makogon | yes | 20:51 |
| clarkb | in any case quantal was undone due to change in support from ubuntu | 20:51 |
| hub_cap | 12.10 | 20:51 |
| fungi | denis_makogon: with the change in ubuntu support schedules, if we don't standardize on lts then by the time our cloud providers have images and we overcome the various changes needed to go from one release to the next, the support period for us would only be a few months before starting over again | 20:52 |
| denis_makogon | here fig. with ubuntu releases and lts'ses https://wiki.ubuntu.com/ServerTeam/CloudArchive?action=AttachFile&do=get&target=plan-revised.png | 20:53 |
| fungi | though admittedly rackspace and hpcloud have gotten better about adding images for new ubuntu releases sooner than they used to | 20:53 |
| fungi | previously it was taking months from ubuntu release date until there were images available for us to use | 20:53 |
| denis_makogon | hm, i see | 20:54 |
| *** mrodden1 has joined #openstack-infra | 20:54 | |
| fungi | and since neither provider offered a glance endpoint (or alternative means of uploading our own images) we had to either wait or do very hacky things | 20:54 |
| clarkb | and quantal doesn't buy us much over the LTS. zul is kind enough to manage that cloud archive thing and we have access ot new kernels if we need them | 20:54 |
| fungi | so for a variety of reasons, we decided to stick with lts releases | 20:54 |
| fungi | yeah, there's that too. ubuntu cloud archive is only for lts releases | 20:55 |
| clarkb | and we would still get root ext3 I think so meh :P | 20:55 |
| fungi | heh | 20:55 |
| *** bknudson has left #openstack-infra | 20:55 | |
| openstackgerrit | Eli Klein proposed a change to openstack-infra/jenkins-job-builder: Added clone-workspace publisher https://review.openstack.org/69532 | 20:55 |
| *** mrodden has quit IRC | 20:56 | |
| denis_makogon | thanks, i think i've got the answer | 20:56 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/jenkins-job-builder: make scm test as the example https://review.openstack.org/65186 | 20:56 |
| *** smarcet has left #openstack-infra | 20:57 | |
| clarkb | fungi: ready to approve https://review.openstack.org/#/c/62085/6 ? | 20:58 |
| fungi | clarkb: no, jeepyb isn't updating on review.o.o for some reason (head is weeks old). puppet may be having problems there so i'm investigating | 20:59 |
| clarkb | ok holding off the approval | 20:59 |
| fungi | once i'm sure that change is in place, we can approve the config update | 20:59 |
| fungi | but for example mordred's jeepyb patches we merged in the past few weeks aren't active there either | 21:00 |
| *** mrodden1 has quit IRC | 21:01 | |
| fungi | Jan 31 20:58:43 review puppet-agent[7911]: Could not retrieve catalog from remote server: Error 400 on SERVER: Failed to parse template openstack_project/gerrit_patchset-created.erb:#012 Filepath: /usr/lib/ruby/1.8/puppet/parser/templatewrapper.rb#012 Line: 67#012 Detail: Could not find value for 'welcome' at | 21:01 |
| fungi | 13:/opt/config/production/modules/openstack_project/templates/gerrit_patchset-created.erb#012 at /opt/config/production/modules/openstack_project/manifests/gerrit.pp:290 on node review.openstack.org | 21:01 |
| fungi | fixing | 21:01 |
| clarkb | fungi: when you are done https://review.openstack.org/#/c/64582/ seems like a really good thing to have | 21:06 |
| *** afazekas has quit IRC | 21:06 | |
| fungi | k | 21:06 |
| openstackgerrit | Eli Klein proposed a change to openstack-infra/jenkins-job-builder: Added clone-workspace publisher https://review.openstack.org/69532 | 21:11 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Only run cells jobs that d-g can run successfully https://review.openstack.org/70441 | 21:13 |
| *** lcestari has quit IRC | 21:13 | |
| *** rcleere has joined #openstack-infra | 21:13 | |
| *** masayukig has joined #openstack-infra | 21:14 | |
| fungi | yeah, this is going to be a few minutes | 21:16 |
| *** masayukig has quit IRC | 21:16 | |
| *** masayuki_ has joined #openstack-infra | 21:16 | |
| *** DinaBelova is now known as DinaBelova_ | 21:17 | |
| fungi | somehow the change to add the keyfiles for the welcome message account never materialized in the config repo, but we (i?) merged the change that tries to use them. i did add them to hiera at least (because there was a bug requesting it) | 21:17 |
| *** malini is now known as malini_afk | 21:18 | |
| clarkb | fungi: do you have a link to that change handy? | 21:18 |
| *** _david_ has joined #openstack-infra | 21:18 | |
| clarkb | maybe it got auto abandoned and forgotten? | 21:18 |
| fungi | i don't even know whether it existed at all | 21:18 |
| clarkb | oh | 21:18 |
| clarkb | even better | 21:18 |
| fungi | so i'm just writing it real quick | 21:19 |
| fungi | rather than revert the other bits | 21:19 |
| clarkb | wfm | 21:19 |
| *** masayuki_ has quit IRC | 21:20 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/config: Don't run large-ops on cinder, heat, horizon https://review.openstack.org/70443 | 21:23 |
| *** lcheng has joined #openstack-infra | 21:24 | |
| jeblair | fungi: graphite ok? | 21:25 |
| fungi | jeblair: seems to be | 21:25 |
| clarkb | oh hey a jeblair | 21:25 |
| jeblair | clarkb: o/ | 21:25 |
| fungi | jeblair: i cleared some zero-byte whisper files which were causing graph rendering errors, but otherwise everything worked as hoped | 21:26 |
| clarkb | jeblair: if you get a chance an opinion on https://review.openstack.org/#/c/69991/ would be great. Don't really need full review, just looking for more of a hate it or not | 21:26 |
| clarkb | jeblair: I know in the past you didn't like fitlering based on job names but I think for a start with grenade logs it iwll be useful | 21:26 |
| jeblair | clarkb: not opposed; after all, zuul basically does that too. my only thought is "are http gets that bad?" | 21:27 |
| clarkb | jeblair: I don't think they are *that* bad, but the RTT is non trivial when talking millions of log events | 21:28 |
| jeblair | fungi: makes sense, i think we've had to do that before. did you by chance do a find for 0 byte files? | 21:28 |
| jeblair | clarkb: wfm now. maybe a back-of-head thing to think about other ways to solve that... | 21:29 |
| clarkb | ++ | 21:29 |
| clarkb | thanks | 21:29 |
| fungi | jeblair: i did. there were a total of 92 and i removed them all | 21:29 |
| jeblair | fungi: cool. fwiw i basically did the same thing we have with static on graphite (lvm, etc) | 21:30 |
| jeblair | (i just followed the static docs and replaced the names) | 21:30 |
| flashgordon | clarkb: I think you mah have approved https://review.openstack.org/#/c/68304/ i the wrong order | 21:31 |
| jeblair | so remind me to update the docs at some point if i forget. :) | 21:31 |
| flashgordon | clarkb: err sub-optimal based on https://review.openstack.org/#/c/68305/ | 21:31 |
| clarkb | flashgordon: oh shit ya | 21:31 |
| clarkb | flashgordon: I left a comment saying how e should do it too iirc | 21:31 |
| flashgordon | if I don't have to trust myself I prefer not to ;) | 21:31 |
| fungi | jeblair: yeah, it looked identical (lvm with cinder volume as a pv) | 21:31 |
| clarkb | but I got trigger happy on friday. flashgordon want ot push another patchset t okick it out of gate or I can just remove my +A | 21:32 |
| *** mrodden has joined #openstack-infra | 21:32 | |
| clarkb | flashgordon: which would you prefer? | 21:32 |
| flashgordon | clarkb: if you can just remove the +A that works | 21:33 |
| clarkb | done | 21:33 |
| flashgordon | clarkb: thanks | 21:33 |
| *** david-lyle has quit IRC | 21:33 | |
| clarkb | and sorry for that | 21:33 |
| flashgordon | clarkb: haha np, this is the first time I have asked someone to stop approving my patch | 21:34 |
| *** e0ne has quit IRC | 21:37 | |
| *** hogepodge has quit IRC | 21:37 | |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: make scm test as the example https://review.openstack.org/65186 | 21:38 |
| clarkb | sdague: flashgordon https://review.openstack.org/#/c/69991/1 can I get reviews on that and if you think it is good mabe we can index grenade logs today | 21:39 |
| *** thomasem has quit IRC | 21:39 | |
| *** masayukig has joined #openstack-infra | 21:39 | |
| flashgordon | clarkb: nice | 21:40 |
| flashgordon | clarkb: I have the libvirt logs patch up too | 21:40 |
| clarkb | I will babysit and all that. Just looking for extra eyes | 21:40 |
| clarkb | flashgordon: oh I will review that | 21:40 |
| zaro | jeblair: would you be able to take a look so i can start testing zuul against review-dev? https://review.openstack.org/#/c/68271 | 21:41 |
| flashgordon | clarkb: so that patch looks good one gotcha though: | 21:41 |
| flashgordon | we have to update our e-r fingerprints to say file:x or file:new/x or file:old/x | 21:41 |
| flashgordon | etc | 21:42 |
| flashgordon | which is fine | 21:42 |
| clarkb | flashgordon: file*screen-n-cpu.txt should work I think | 21:42 |
| clarkb | er file:logs*screen-n-cpu.txt | 21:42 |
| openstackgerrit | Antoine Musso proposed a change to openstack-infra/zuul: webapp: set cache-control headers to prevent caching https://review.openstack.org/66583 | 21:42 |
| * clarkb tries that with existing logs names | 21:43 | |
| flashgordon | clarkb: oh right, | 21:43 |
| *** masayukig has quit IRC | 21:43 | |
| clarkb | yup seems to work | 21:43 |
| *** masayukig has joined #openstack-infra | 21:44 | |
| clarkb | fungi: should we also consider switching all rax nodes to pvhvm base images? | 21:45 |
| clarkb | performance did seem noticeably better | 21:45 |
| *** masayuki_ has joined #openstack-infra | 21:45 | |
| fungi | clarkb: if the numbers look good, then i say yet | 21:46 |
| fungi | yes | 21:46 |
| *** dcramer_ has quit IRC | 21:46 | |
| fungi | fixed the welcome message puppetry only to find a new issue! | 21:46 |
| fungi | err: Could not retrieve catalog from remote server: Error 400 on SERVER: Could not find template 'openstack_project/review.projects.ini' at /opt/config/fungi/modules/openstack_project/manifests/gerrit.pp:353 on node review.openstack.org | 21:47 |
| clarkb | flashgordon: reviewed the libvirt log thing, one small change then its good | 21:47 |
| *** banix has joined #openstack-infra | 21:47 | |
| flashgordon | clarkb: cool, thanks | 21:48 |
| *** masayukig has quit IRC | 21:48 | |
| banix | Had a question regarding Gerrit plugin for Jenkins. When the build is triggered due to a "Comment Added" event, how do I check the content of the comment. I need to look for "recheck" and possibly a bug number. | 21:49 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/config: Add logstash rules to parse libvirtd.txt https://review.openstack.org/70276 | 21:49 |
| clarkb | banix: no idea, we use zuul for that | 21:49 |
| flashgordon | clarkb: hopefully I got it all right this time ^ | 21:49 |
| clarkb | I am not sure if parsing the comment for strings is something that plguin supports | 21:49 |
| *** masayuki_ has quit IRC | 21:50 | |
| banix | Yeah I do not see anything in the environment variables. | 21:50 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Install and use the Gerrit welcome-message keypair https://review.openstack.org/70449 | 21:50 |
| banix | I see how this can be specified in Zull with comment-filter ... | 21:51 |
| *** hashar has quit IRC | 21:51 | |
| *** lcheng has quit IRC | 21:52 | |
| *** emagana has joined #openstack-infra | 21:52 | |
| banix | We are using the primitive approach for now though (using the Gerrit plugin) :) | 21:52 |
| *** openstackgerrit has quit IRC | 21:53 | |
| *** openstackgerrit has joined #openstack-infra | 21:53 | |
| *** rfolco has quit IRC | 21:54 | |
| clarkb | banix: I am not sure if that is possible. Havne't looked at the plugin in about a year and a half | 21:54 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Correct projects_config template file name https://review.openstack.org/70450 | 21:54 |
| clarkb | fungi: that isn't correct we moved the file | 21:55 |
| *** hashar has joined #openstack-infra | 21:55 | |
| fungi | clarkb: huh? | 21:55 |
| clarkb | oh wait that is the ini file | 21:55 |
| clarkb | ignore me | 21:55 |
| fungi | yeah | 21:55 |
| fungi | with those two config patches, puppet agent is happy again on review.o.o | 21:55 |
| banix | clarkb: ok thanks. You think asking on infra mailing list would be ok? | 21:55 |
| clarkb | +2 from me on the second, looking at first now | 21:55 |
| clarkb | banix: sure | 21:55 |
| fungi | and jeepyb is now up to date on review.o.o as a result | 21:56 |
| fungi | so i'm approving 62085 | 21:56 |
| clarkb | fungi: for the keys change, do we need that on review-dev too? | 21:56 |
| clarkb | I suppose we can swing around on that | 21:56 |
| fungi | review-dev should get those ignored since they default to empty | 21:57 |
| fungi | and there are if statements wrapping the file objects and the hook line | 21:57 |
| fungi | anyway, until those or something like them merge (i'm sure there are still style errors, but they at least seemed to work when applied to review.o.o) 62085 isn't going to get applied anyway | 21:58 |
| clarkb | fungi: small nit on 70449 | 21:59 |
| *** sarob has joined #openstack-infra | 22:00 | |
| fungi | i started out doing that actually, but we also need those file objects to depend on their parent directory objects | 22:00 |
| fungi | so we can't *really* generalize them anyway | 22:01 |
| openstackgerrit | A change was merged to openstack-infra/config: Add project configuration. https://review.openstack.org/62085 | 22:01 |
| fungi | unless i'm overlooking an option | 22:01 |
| clarkb | fungi: in that case you should remove the private key location var and hardcode in the erb as well | 22:01 |
| clarkb | or make it a local var and not a parameter | 22:01 |
| openstackgerrit | Russell Bryant proposed a change to openstack-infra/config: Make cells job gating https://review.openstack.org/63537 | 22:01 |
| fungi | yeah, probably true | 22:01 |
| clarkb | so that it isn't implied to be configurable | 22:01 |
| fungi | fixing | 22:01 |
| openstackgerrit | A change was merged to openstack-infra/config: Correct projects_config template file name https://review.openstack.org/70450 | 22:02 |
| clarkb | sdague: any chance for review on https://review.openstack.org/#/c/69991/1? | 22:03 |
| clarkb | I am about to go apply it by hand to the srever and babysit it | 22:03 |
| *** lcheng has joined #openstack-infra | 22:03 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Install and use the Gerrit welcome-message keypair https://review.openstack.org/70449 | 22:04 |
| fungi | clarkb: ^ | 22:04 |
| clarkb | looking | 22:05 |
| openstackgerrit | Joe Gordon proposed a change to openstack-dev/hacking: Clarify H403 message https://review.openstack.org/70453 | 22:05 |
| clarkb | +2 from me I think you should approve at will | 22:05 |
| fungi | done | 22:06 |
| fungi | i've got to dash out to dinner before the friday-night crowds get bad, but i'll check back in when i return | 22:06 |
| clarkb | have fun | 22:06 |
| openstackgerrit | A change was merged to openstack-infra/devstack-gate: Add ZUUL_PROJECT to periodic test https://review.openstack.org/64163 | 22:06 |
| clarkb | applying grenade logs change now | 22:07 |
| openstackgerrit | A change was merged to openstack-infra/config: Install and use the Gerrit welcome-message keypair https://review.openstack.org/70449 | 22:11 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Add grenade logs to logstash. https://review.openstack.org/69991 | 22:14 |
| clarkb | found at least one problem with it >_> | 22:14 |
| clarkb | now we wait for a grenade job to finish | 22:19 |
| *** mfer has quit IRC | 22:22 | |
| *** yassine has quit IRC | 22:26 | |
| clarkb | flashgordon: sdague: you have grenade logs. if you do filename:logs*screen-n-cpu.txt for example that works | 22:27 |
| clarkb | have fun | 22:27 |
| clarkb | flashgordon: you will need to rebase your libvirt change because it iwll conflict with mine | 22:28 |
| clarkb | fungi: I will also try testing your libvirt change locally so that we can make sure the filter is happy | 22:28 |
| *** pcrews has quit IRC | 22:28 | |
| clarkb | er flashgordon ^ | 22:28 |
| *** oubiwann_ has quit IRC | 22:28 | |
| *** hashar has quit IRC | 22:30 | |
| openstackgerrit | Doug Hellmann proposed a change to openstack-infra/config: Oslo is adopting cliff, stevedore, and taskflow https://review.openstack.org/70435 | 22:31 |
| clarkb | I think everyone + fungi disappeared. I am not just tlaking to myself | 22:32 |
| *** hogepodge has joined #openstack-infra | 22:34 | |
| Shrews | clarkb: you have been shunned. shuuuuuuuuuned | 22:34 |
| openstackgerrit | A change was merged to openstack-infra/config: Add grenade logs to logstash. https://review.openstack.org/69991 | 22:40 |
| *** lcheng has quit IRC | 22:40 | |
| clarkb | Shrews: beer thirty happeend everywhere but here apaprently | 22:42 |
| openstackgerrit | A change was merged to openstack-infra/config: point zuul-dev to review-dev https://review.openstack.org/68271 | 22:44 |
| *** lcheng has joined #openstack-infra | 22:44 | |
| _david_ | clarkb, fungi am i right in assuming that we don't need Gerrit DRAFT workflow? | 22:45 |
| clarkb | _david_: yes, I think we would like to disable it | 22:45 |
| clarkb | as it leads to confusion and problems around CI | 22:45 |
| _david_ | Shrews, clarkb, jeblair Cool ! then i think, that today is the day where WIP workflow is going to be merged upstream | 22:46 |
| clarkb | woot | 22:48 |
| clarkb | I self approved a change >_> it removes cell jobs from d-g that do not pass | 22:48 |
| clarkb | pleia2: still around? where are we on fedora + nodepool? | 22:49 |
| clarkb | I see one change to remove deprecated vars | 22:49 |
| clarkb | anything else I can do to help move that along? | 22:49 |
| openstackgerrit | A change was merged to openstack-infra/config: Make cells job gating https://review.openstack.org/63537 | 22:50 |
| openstackgerrit | A change was merged to openstack-infra/config: Only run cells jobs that d-g can run successfully https://review.openstack.org/70441 | 22:50 |
| clarkb | sdague: I did approve ^ based on the discussion, the commit message update and the blueprint targetted to juno | 22:51 |
| clarkb | tl;dr I believe everyone is happy with it now so I hit the go button | 22:51 |
| pleia2 | clarkb: I've been keeping this etherpad up to date https://etherpad.openstack.org/p/fedora-on-gate | 22:52 |
| flashgordon | clarkb: ack | 22:52 |
| clarkb | flashgordon: note the cells job approval too. I went ahead and put that in as there was consensus | 22:53 |
| flashgordon | cool | 22:53 |
| pleia2 | clarkb: I can't get https://review.openstack.org/#/c/69715/ to work (may be my own ssh auth issues though, my keys do work, going to test with ubuntu next with my tripleo cd account) | 22:53 |
| clarkb | :/ hopefully we can figure that out | 22:54 |
| *** eharney has quit IRC | 22:54 | |
| clarkb | pleia2: I love that there is an upstream fedora bug about the sudo thing | 22:55 |
| *** lcheng has quit IRC | 22:56 | |
| *** masayukig has joined #openstack-infra | 22:56 | |
| clarkb | pleia2: I have reviewed both outstanding changes at this point. When it is not friday afternoon ping me and I can make sure the iptables changes don't bork our firewalls in any weird ways | 22:56 |
| pleia2 | clarkb: if only it had a status other than NEW :) | 22:56 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/config: Add logstash rules to parse libvirtd.txt https://review.openstack.org/70276 | 22:57 |
| *** masayukig has quit IRC | 23:01 | |
| *** jgrimm has quit IRC | 23:06 | |
| *** burt1 has quit IRC | 23:07 | |
| *** CaptTofu has quit IRC | 23:07 | |
| *** dims has quit IRC | 23:08 | |
| *** ktbenton has joined #openstack-infra | 23:12 | |
| clarkb | flashgordon: couple more things for your libvirtd log parsing change. I am testing it locally. Just about have it working | 23:14 |
| ktbenton | Hello, I have a question about review.openstack.org and the openid connection to launchpad.net. I'm thinking of changing my launchpad id so the openid endpoint will change. Will it correctly connect associate back to my review.openstack.org account since the emails will match? | 23:14 |
| *** kmartin has joined #openstack-infra | 23:15 | |
| *** oubiwann_ has joined #openstack-infra | 23:15 | |
| clarkb | ktbenton: I want to say it may create a second account in gerrit for you but I don't remember for sure | 23:16 |
| *** masayukig has joined #openstack-infra | 23:16 | |
| ktbenton | clarkb: is there someone that would be able to update the account manually for me so i don't lose my reviews/patches? | 23:18 |
| clarkb | ktbenton: yes, we had to do that quite a bit way back when. Fungi is like a wizard when it comes to account updates in gerrit | 23:19 |
| clarkb | ktbenton: in fact I bet fungi would have a definite answer for you when he gets back | 23:19 |
| ktbenton | clarkb: i will test with a dummy account to see what happens | 23:19 |
| clarkb | ktbenton: you can use review-dev to test it too | 23:20 |
| clarkb | rather than adding accounts to review.o.o | 23:20 |
| clarkb | though that is a different version of gerrit right now... | 23:20 |
| ktbenton | clarkb: the test is mainly on the launchpad side. i need to see the effect when i use a different openid endpoint | 23:21 |
| *** pcrews has joined #openstack-infra | 23:21 | |
| *** dims has joined #openstack-infra | 23:26 | |
| flashgordon | clarkb: thanks | 23:26 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/config: Add logstash rules to parse libvirtd.txt https://review.openstack.org/70276 | 23:28 |
| flashgordon | clarkb: btw even though that is revision 7 for something easy, I am amazed on how few revisions it took for me to write a patch for something I can't test well and know very little about | 23:29 |
| *** banix has quit IRC | 23:29 | |
| clarkb | flashgordon: it is actually not too hard to test, but you do have to mock up all of the pieces. I should probably try doing that in an actual test at some point | 23:30 |
| ktbenton | clarkb: looks like it worked. It must associate with the email address. Thanks | 23:30 |
| clarkb | flashgordon: basically you setup a logstash that talks to stdout instead of elasticsearch and point a loggearmanworker at that then add a job to gearman | 23:30 |
| flashgordon | clarkb: ahh cool, next time | 23:30 |
| Shrews | _david_: srsly? wow, awesome | 23:30 |
| clarkb | flashgordon: I already have that stuff locally so went ahead and did it | 23:30 |
| *** prad_ has quit IRC | 23:31 | |
| _david_ | Shrews, yeah. your original change more or less ,-) | 23:31 |
| dtroyer_zz | Are there any gate jobs anywhere that still run the DevStack exercises? | 23:31 |
| clarkb | dtroyer_zz: yes, the cells jobs. Just added them back in. also grenade | 23:32 |
| dtroyer_zz | clarkb: ok, thanks. Grenade only does it for 'old' devstack, correct? | 23:33 |
| dtroyer_zz | clarkb: ah, I typed too soon, it does both | 23:34 |
| *** mrodden has quit IRC | 23:36 | |
| *** zehicle_at_dell has joined #openstack-infra | 23:36 | |
| *** thedodd has quit IRC | 23:37 | |
| *** ktbenton has quit IRC | 23:38 | |
| *** oubiwann_ has quit IRC | 23:39 | |
| *** ktbenton has joined #openstack-infra | 23:40 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add logstash rules to parse libvirtd.txt https://review.openstack.org/70276 | 23:45 |
| *** gokrokve_ has joined #openstack-infra | 23:45 | |
| *** dkliban has quit IRC | 23:47 | |
| *** CaptTofu has joined #openstack-infra | 23:48 | |
| *** kraman has quit IRC | 23:48 | |
| *** gokrokve has quit IRC | 23:49 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Remove unused main in elasticRecheck.py https://review.openstack.org/70471 | 23:51 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Make leave_comment take an event https://review.openstack.org/70395 | 23:51 |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Log gerrit comment when running in nocomment mode https://review.openstack.org/70287 | 23:51 |
| clarkb | zaro: the current problem is zuul-dev cannot get stream events. I believe it is a new permission that needs to be grated | 23:55 |
| *** rcleere has quit IRC | 23:56 | |
| fungi | ktbenton: go to your gerrit account settings and make a note of the numeric account id you have. then after you update your lp account and log into gerrit again, see what the new numeric account id is. let me know those two things and i should be able to blank out the new account in gerrit and associate its new openid with your old account instead. also we're rather annoyed that lp doesn't preserve | 23:56 |
| fungi | your openid url when you make account changes in it... wtf? | 23:56 |
| *** denis_makogon has quit IRC | 23:57 | |
| *** atiwari has joined #openstack-infra | 23:57 | |
| fungi | clarkb: zaro: yeah i recall seeing the new stream event acl permission mentioned in one of the gerrit release notes | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
