| *** gokrokve has joined #openstack-infra | 00:00 | |
| *** ociuhandu has quit IRC | 00:02 | |
| *** oubiwan__ has quit IRC | 00:03 | |
| *** e0ne has quit IRC | 00:04 | |
| *** jcooley_ has joined #openstack-infra | 00:15 | |
| *** jcooley_ has quit IRC | 00:19 | |
| *** jhesketh has quit IRC | 00:21 | |
| ekarlso | why is the voting for the summit just awful ? | 00:25 |
|---|---|---|
| ekarlso | I can't see a list of all talks | 00:25 |
| *** oubiwan__ has joined #openstack-infra | 00:32 | |
| *** oubiwan__ has quit IRC | 00:36 | |
| *** dolphm_503 is now known as dolphm | 00:37 | |
| sdague | I'm sort of surprised no one wrote a scraper yet to do that | 00:44 |
| clarkb | its another piece of thing that isn't open right? | 00:45 |
| clarkb | the summit summit stuff is open | 00:45 |
| clarkb | the conference summit stuff isn't | 00:45 |
| *** dolphm is now known as dolphm_503 | 00:47 | |
| *** oubiwan__ has joined #openstack-infra | 00:48 | |
| ekarlso | sdague: scraper to do what ? | 00:51 |
| *** zns has quit IRC | 00:51 | |
| *** ryanpetrello has joined #openstack-infra | 00:54 | |
| *** yamahata has quit IRC | 00:58 | |
| *** e0ne has joined #openstack-infra | 00:59 | |
| *** yongli has joined #openstack-infra | 01:02 | |
| *** oubiwan__ has quit IRC | 01:04 | |
| *** e0ne has quit IRC | 01:04 | |
| *** oubiwan__ has joined #openstack-infra | 01:05 | |
| *** CaptTofu has joined #openstack-infra | 01:07 | |
| *** Hefeweizen has quit IRC | 01:07 | |
| *** Hefeweizen has joined #openstack-infra | 01:08 | |
| *** CaptTofu has quit IRC | 01:10 | |
| *** CaptTofu has joined #openstack-infra | 01:11 | |
| clarkb | ekarlso: to make a list of the talks | 01:12 |
| *** CaptTofu has quit IRC | 01:15 | |
| *** CaptTofu has joined #openstack-infra | 01:16 | |
| *** CaptTofu has quit IRC | 01:20 | |
| *** ryanpetrello has quit IRC | 01:23 | |
| *** CaptTofu has joined #openstack-infra | 01:24 | |
| *** jhesketh has joined #openstack-infra | 01:28 | |
| *** Alexandra has joined #openstack-infra | 01:28 | |
| *** jhesketh__ has joined #openstack-infra | 01:28 | |
| *** nosnos has joined #openstack-infra | 01:28 | |
| *** yamahata_ has quit IRC | 01:37 | |
| *** yamahata_ has joined #openstack-infra | 01:38 | |
| *** gokrokve has quit IRC | 01:39 | |
| *** zns has joined #openstack-infra | 01:40 | |
| *** gokrokve has joined #openstack-infra | 01:41 | |
| *** weshay has quit IRC | 01:55 | |
| *** e0ne has joined #openstack-infra | 01:58 | |
| *** dolphm_503 is now known as dolphm | 01:59 | |
| *** yamahata has joined #openstack-infra | 02:01 | |
| *** wenlock has joined #openstack-infra | 02:03 | |
| *** e0ne has quit IRC | 02:03 | |
| *** amcrn has joined #openstack-infra | 02:03 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: add bug for centos6 dns fails https://review.openstack.org/77474 | 02:09 |
| *** Alexandra is now known as alex-lunch | 02:25 | |
| *** ryanpetrello has joined #openstack-infra | 02:25 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: add bug for centos6 dns fails https://review.openstack.org/77474 | 02:27 |
| *** dolphm is now known as dolphm_503 | 02:34 | |
| *** ryanpetrello has quit IRC | 02:36 | |
| *** oubiwan__ has quit IRC | 02:45 | |
| *** Will has joined #openstack-infra | 02:46 | |
| *** Will is now known as Guest11469 | 02:46 | |
| *** CaptTofu has quit IRC | 02:47 | |
| Guest11469 | I sent an e-mail a week ago to request a CI service account, but no reply. Any body could tell me what to do? | 02:50 |
| clarkb | Guest11469: where did you send it? I can pull it up now and mark it for creation when I get back to work tomorrow | 02:51 |
| *** ken1ohmichi has joined #openstack-infra | 02:51 | |
| Guest11469 | Feb 24 | 02:51 |
| clarkb | we have been quite busy with the ramp up to feature freeze with that taking priority | 02:51 |
| *** thuc has joined #openstack-infra | 02:51 | |
| *** dolphm_503 is now known as dolphm | 02:52 | |
| Guest11469 | openstack-infra@lists.openstack.org | 02:52 |
| anteaya | Guest11469: which one is yours? http://lists.openstack.org/pipermail/openstack-infra/2014-February/date.html | 02:52 |
| clarkb | the only one I see from the 24th was requested to be cancelled | 02:53 |
| clarkb | is there another that got stuck in a queue somewhere? | 02:53 |
| anteaya | clarkb: there are three: http://lists.openstack.org/pipermail/openstack-infra/2014-February/000895.html | 02:54 |
| Guest11469 | [OpenStack-Infra] Requesting a Service Account qsong | 02:54 |
| anteaya | http://lists.openstack.org/pipermail/openstack-infra/2014-February/000896.html | 02:54 |
| anteaya | http://lists.openstack.org/pipermail/openstack-infra/2014-February/000889.html | 02:54 |
| anteaya | this one is qsong: http://lists.openstack.org/pipermail/openstack-infra/2014-February/000896.html | 02:54 |
| clarkb | ah 'service account' I was searching for other terms | 02:55 |
| anteaya | they all call them something different | 02:55 |
| anteaya | makes them hard to search | 02:55 |
| clarkb | I have them starred now | 02:55 |
| *** thuc has quit IRC | 02:56 | |
| Guest11469 | Thx | 02:56 |
| fungi | ahh, yeah i haven't done any since last weekend. i can try to catch up on any pending requests tomorrow | 02:56 |
| clarkb | fungi: I can take a stab at them too | 02:57 |
| fungi | last week was definitely a bit crazy | 02:57 |
| clarkb | since you have been doing the vast bulk of them | 02:57 |
| fungi | clarkb: feel free | 02:57 |
| * anteaya nods | 02:57 | |
| *** e0ne has joined #openstack-infra | 02:58 | |
| fungi | and thanks! | 02:58 |
| clarkb | currently flipping through the summit cfp stuff | 02:59 |
| clarkb | since that appears to be what all the cool kids are doing | 02:59 |
| fungi | i did *not* get around to replacing any of the first four git servers this weekend, but have been comparing the cpu/load from those and the new one (05) and there doesn't seem to be a lot of difference | 02:59 |
| *** amotoki_ has quit IRC | 03:00 | |
| clarkb | there was a difference on thursday | 03:00 |
| clarkb | or was it friday? | 03:00 |
| clarkb | whenever we first got the new node in | 03:00 |
| anteaya | I don't think it was friday | 03:00 |
| fungi | 05 has been under less load, but the haproxy seems to still be sending more traffic to the first four | 03:00 |
| clarkb | fungi: really? it should be evenly weighted | 03:00 |
| clarkb | it is possible the hash is doing a bad job | 03:00 |
| fungi | so normalizing load average and cpu against traffic levels it seems fairly proportional | 03:01 |
| anteaya | http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2014-02-26.log | 03:01 |
| fungi | but yeah, not sure why the traffic seems imbalanced | 03:01 |
| anteaya | 2014-02-26T20:42:39 | 03:01 |
| clarkb | huh it is, is it possibly related to the repo packing cron? | 03:01 |
| anteaya | wednesday | 03:01 |
| Guest11469 | It was my Friday, Beijing time | 03:01 |
| clarkb | eg those other nodes have more data to give? | 03:01 |
| fungi | ahh, perhaps so | 03:02 |
| anteaya | Guest11469: we added git05 on Friday, Beijing time? | 03:02 |
| fungi | might be a similar number of requests, thus haproxy doing nothing wrond | 03:02 |
| fungi | wrong | 03:02 |
| fungi | i do wonder if we should perhaps be repacking daily instead of weekly | 03:03 |
| *** e0ne has quit IRC | 03:03 | |
| anteaya | Guest11469: hi yes, clarkb found your request | 03:10 |
| anteaya | he has it starred, he will address it when he is able | 03:10 |
| anteaya | we have moved on in our discussion and were talking about something else | 03:10 |
| anteaya | we had added an additional git server, git05 to our server farm and we were talking about what day that happened | 03:11 |
| anteaya | I had posted a link to our channel logs which mentioned git05 on Wednesday at 20:42 utc | 03:12 |
| Guest11469 | Thx a lt | 03:12 |
| *** gokrokve has quit IRC | 03:13 | |
| anteaya | no problem | 03:13 |
| *** gokrokve has joined #openstack-infra | 03:13 | |
| anteaya | been a long time since the twitter busted | 03:13 |
| Guest11469 | Thx a lt | 03:13 |
| anteaya | yes, Guest11469 no problem | 03:13 |
| *** dcramer__ has quit IRC | 03:14 | |
| anteaya | I miss the fail whale though | 03:14 |
| anteaya | just a fail bot | 03:14 |
| *** Guest11469 has quit IRC | 03:15 | |
| *** gokrokve has quit IRC | 03:17 | |
| openstackgerrit | A change was merged to openstack/requirements: Require openstack-doc-tools 0.8.2 https://review.openstack.org/76351 | 03:26 |
| *** dcramer__ has joined #openstack-infra | 03:26 | |
| *** Ryan_Lane has joined #openstack-infra | 03:39 | |
| *** dcramer__ has quit IRC | 03:40 | |
| *** jcooley_ has joined #openstack-infra | 03:49 | |
| *** dcramer__ has joined #openstack-infra | 03:54 | |
| *** e0ne has joined #openstack-infra | 03:58 | |
| *** e0ne has quit IRC | 04:03 | |
| *** dolphm is now known as dolphm_503 | 04:04 | |
| *** miqui has joined #openstack-infra | 04:12 | |
| *** fifieldt has joined #openstack-infra | 04:18 | |
| *** Ryan_Lane has quit IRC | 04:20 | |
| *** oubiwan__ has joined #openstack-infra | 04:21 | |
| *** oubiwan__ has quit IRC | 04:26 | |
| *** nosnos has quit IRC | 04:28 | |
| *** alex-lunch is now known as Alexandra | 04:33 | |
| *** nosnos has joined #openstack-infra | 04:34 | |
| *** Ryan_Lane has joined #openstack-infra | 04:34 | |
| *** miqui has quit IRC | 04:36 | |
| *** Ryan_Lane has quit IRC | 04:39 | |
| *** fifieldt has quit IRC | 04:43 | |
| *** CaptTofu has joined #openstack-infra | 04:48 | |
| sdake_ | hey all, my check job for oslo.messaging for heat is failing in tempest: http://logs.openstack.org/98/72798/42/check/check-tempest-dsvm-full/c5441a1/logs/screen-h-api.txt.gz | 04:52 |
| sdake_ | it is attempting to load a rpc backend that doesn't exist in the source base | 04:52 |
| sdake_ | how would I go about fixing that? | 04:52 |
| *** CaptTofu has quit IRC | 04:52 | |
| clarkb | sdake_: sync it into the code base? | 04:53 |
| clarkb | looks like it comes from oslo someplace | 04:53 |
| sdake_ | oslo-incubator has the rpc backend | 04:53 |
| sdake_ | the change moves to oslo.messaging from oslo-incubator | 04:53 |
| sdake_ | the plugin is not compatible | 04:53 |
| sdake_ | whatever is configuring tempest is wrong for htis patch | 04:53 |
| clarkb | that isn't tempest though, that is heat | 04:53 |
| clarkb | tempest runs in a virtualenv | 04:53 |
| *** thuc_ has joined #openstack-infra | 04:54 | |
| sdake_ | clarkb where does /etc/heat/heat.conf come from? | 04:54 |
| clarkb | from heat as copied by devstack | 04:54 |
| clarkb | probably in devstack/lib/heat | 04:54 |
| sdake_ | so devstack needs to be changed first? | 04:55 |
| clarkb | its probably sufficient to chagne the example file in heat | 04:55 |
| clarkb | but I don't know enough about how devstack deploys heat to have a proper answer | 04:55 |
| sdake_ | so just to be clear, its devstack that is deploying the tempest runs? | 04:56 |
| clarkb | yes | 04:56 |
| sdake_ | thanks, I'll look at the nova lib see how they handled it | 04:56 |
| clarkb | there is a configure_heat() function in lib/heat it copies heat/etc/heat/api-paste.ini,policy.json,heat.conf.sample then runs a few inisets | 04:57 |
| sdake_ | i dont update devstack often - breaks too much :( | 04:57 |
| *** e0ne has joined #openstack-infra | 04:58 | |
| jogo | http://logs.openstack.org/98/72798/42/check/check-tempest-dsvm-full/c5441a1/logs/devstacklog.txt.gz#_2014-03-03_03_43_53_330 | 04:59 |
| clarkb | sdake_: http://git.openstack.org/cgit/openstack/heat/tree/etc/heat/heat.conf.sample#n329 is the problem | 04:59 |
| jogo | clarkb: sdake_: devstack overwrites that | 05:00 |
| clarkb | oh it does, in iniset_rpc_backend | 05:00 |
| jogo | sdake_: also your sample config is wrong, it doesn't include the oslo.messaging options | 05:01 |
| jogo | like nova https://github.com/openstack/nova/blob/master/etc/nova/nova.conf.sample | 05:01 |
| clarkb | jogo: did you see we merged the most openstack commits in a week since we started counting last week? | 05:02 |
| jogo | clarkb: I did! | 05:02 |
| jogo | pretty impressive, go team | 05:02 |
| sdake_ | jogo the sample is changed in the changeset with generate_sample.sh | 05:02 |
| *** e0ne has quit IRC | 05:03 | |
| sdake_ | I dont see how iniset_rpc_backend actually changes it to oslo.messaging | 05:03 |
| *** zns has quit IRC | 05:03 | |
| jogo | sdake_: your new sample is still wrong,see nova | 05:04 |
| jogo | sdake_: yeah not sure, nova has the same issue http://logs.openstack.org/98/72798/42/check/check-tempest-dsvm-full/c5441a1/logs/devstacklog.txt.gz#_2014-03-03_03_43_09_322 | 05:04 |
| clarkb | sdake_: I don't think it does, so you may be right. devstack needs an update | 05:04 |
| *** dolphm_503 is now known as dolphm | 05:05 | |
| sdake_ | what I dont get is how nova's oslo.messaging got into the gate | 05:05 |
| sdake_ | rather past the gate | 05:05 |
| jogo | sdake_: https://github.com/openstack/nova/blob/master/tools/config/oslo.config.generator.rc | 05:05 |
| jogo | sdake_: 2014-03-03 03:44:58.933 27408 DEBUG nova.openstack.common.service [-] rpc_backend = nova.openstack.common.rpc.impl_kombu log_opt_values /opt/stack/new/oslo.config/oslo/config/cfg.py:1913 | 05:06 |
| jogo | haha | 05:06 |
| jogo | sdake_: I don't know either | 05:06 |
| jogo | http://logs.openstack.org/98/72798/42/check/check-tempest-dsvm-full/c5441a1/logs/screen-n-api.txt.gz? | 05:06 |
| jogo | sdake_: see nova/rpc.py | 05:07 |
| jogo | https://review.openstack.org/#/c/39929/78/nova/rpc.py | 05:07 |
| jogo | sdake_: line 53 | 05:08 |
| *** Alexandra has quit IRC | 05:08 | |
| *** skraynev_afk is now known as skraynev | 05:09 | |
| sdake_ | thanks transport_aliases | 05:09 |
| sdake_ | missed that | 05:10 |
| *** homeless has quit IRC | 05:10 | |
| jogo | make sense, with backwards compat and all | 05:10 |
| *** homeless has joined #openstack-infra | 05:11 | |
| *** homeless has quit IRC | 05:13 | |
| *** thuc has joined #openstack-infra | 05:13 | |
| *** homeless has joined #openstack-infra | 05:14 | |
| *** dolphm is now known as dolphm_503 | 05:14 | |
| *** thuc_ has quit IRC | 05:16 | |
| openstackgerrit | Tushar Gohad proposed a change to openstack/requirements: Add PyECLib as a requirement https://review.openstack.org/76068 | 05:24 |
| *** thuc has quit IRC | 05:26 | |
| *** rcleere has quit IRC | 05:26 | |
| *** thuc has joined #openstack-infra | 05:27 | |
| *** thuc has quit IRC | 05:31 | |
| *** Ryan_Lane has joined #openstack-infra | 05:36 | |
| *** SumitNaiksatam has quit IRC | 05:40 | |
| *** Ryan_Lane has quit IRC | 05:40 | |
| *** Ryan_Lane has joined #openstack-infra | 05:41 | |
| *** SumitNaiksatam has joined #openstack-infra | 05:44 | |
| *** talluri has joined #openstack-infra | 05:46 | |
| *** SumitNaiksatam has quit IRC | 05:55 | |
| *** gokrokve has joined #openstack-infra | 05:55 | |
| *** SumitNaiksatam has joined #openstack-infra | 05:57 | |
| *** e0ne has joined #openstack-infra | 05:58 | |
| *** nosnos has quit IRC | 06:01 | |
| *** e0ne has quit IRC | 06:03 | |
| *** nosnos has joined #openstack-infra | 06:06 | |
| *** saju_m has joined #openstack-infra | 06:31 | |
| *** e0ne has joined #openstack-infra | 06:35 | |
| *** Ryan_Lane1 has joined #openstack-infra | 06:36 | |
| *** thuc has joined #openstack-infra | 06:37 | |
| *** rlandy has joined #openstack-infra | 06:38 | |
| *** nosnos has quit IRC | 06:40 | |
| *** Ryan_Lane1 has quit IRC | 06:41 | |
| *** thuc has quit IRC | 06:42 | |
| *** SumitNaiksatam has quit IRC | 06:43 | |
| *** SumitNaiksatam has joined #openstack-infra | 06:44 | |
| *** chandankumar_ has quit IRC | 06:45 | |
| *** CaptTofu has joined #openstack-infra | 06:49 | |
| *** banix has quit IRC | 06:49 | |
| *** kashyap has quit IRC | 06:50 | |
| *** kashyap has joined #openstack-infra | 06:50 | |
| *** chandan_kumar has joined #openstack-infra | 06:51 | |
| *** wenlock has quit IRC | 06:53 | |
| *** CaptTofu has quit IRC | 06:54 | |
| *** chandan_kumar has quit IRC | 06:55 | |
| *** kashyap has quit IRC | 06:59 | |
| *** kashyap has joined #openstack-infra | 07:00 | |
| *** nosnos has joined #openstack-infra | 07:04 | |
| *** e0ne has quit IRC | 07:09 | |
| *** kashyap has quit IRC | 07:15 | |
| *** kashyap has joined #openstack-infra | 07:20 | |
| *** kashyap has quit IRC | 07:24 | |
| *** ildikov_ has quit IRC | 07:25 | |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/config: Add track chairs mailing list https://review.openstack.org/77458 | 07:26 |
| *** jhesketh has quit IRC | 07:30 | |
| *** jhesketh__ has quit IRC | 07:31 | |
| *** davidhadas has quit IRC | 07:35 | |
| *** skraynev has quit IRC | 07:36 | |
| *** ilyashakhat has quit IRC | 07:36 | |
| *** skraynev has joined #openstack-infra | 07:37 | |
| *** ilyashakhat has joined #openstack-infra | 07:37 | |
| *** Ryan_Lane1 has joined #openstack-infra | 07:37 | |
| *** skraynev has quit IRC | 07:41 | |
| *** skraynev has joined #openstack-infra | 07:42 | |
| *** Ryan_Lane1 has quit IRC | 07:42 | |
| *** jhesketh__ has joined #openstack-infra | 07:43 | |
| *** jhesketh has joined #openstack-infra | 07:43 | |
| *** jlibosva has joined #openstack-infra | 07:44 | |
| *** gokrokve has quit IRC | 07:45 | |
| *** yamahata has quit IRC | 07:57 | |
| *** SumitNaiksatam has quit IRC | 07:59 | |
| *** flaper87|afk is now known as flaper87 | 08:00 | |
| *** SumitNaiksatam has joined #openstack-infra | 08:02 | |
| *** e0ne has joined #openstack-infra | 08:06 | |
| *** SumitNaiksatam has quit IRC | 08:09 | |
| *** yamahata has joined #openstack-infra | 08:11 | |
| *** e0ne has quit IRC | 08:13 | |
| *** ihrachys is now known as ihrachys|sick | 08:15 | |
| *** gokrokve has joined #openstack-infra | 08:16 | |
| *** yolanda_ has joined #openstack-infra | 08:19 | |
| *** amotoki has quit IRC | 08:20 | |
| *** dizquierdo has joined #openstack-infra | 08:22 | |
| *** Ryan_Lane has quit IRC | 08:26 | |
| *** Ryan_Lane has joined #openstack-infra | 08:26 | |
| *** davidhadas has joined #openstack-infra | 08:27 | |
| *** jgallard has joined #openstack-infra | 08:31 | |
| *** therve_ has joined #openstack-infra | 08:33 | |
| *** rossella_s has joined #openstack-infra | 08:35 | |
| *** ildikov_ has joined #openstack-infra | 08:36 | |
| *** Ryan_Lane has quit IRC | 08:36 | |
| *** davidhadas_ has joined #openstack-infra | 08:36 | |
| *** Ryan_Lane has joined #openstack-infra | 08:36 | |
| *** luqas has joined #openstack-infra | 08:38 | |
| *** gokrokve has quit IRC | 08:38 | |
| *** jpich has joined #openstack-infra | 08:38 | |
| *** davidhadas has quit IRC | 08:39 | |
| *** saju_m has quit IRC | 08:40 | |
| *** luqas has quit IRC | 08:42 | |
| *** saju_m has joined #openstack-infra | 08:42 | |
| *** luqas has joined #openstack-infra | 08:45 | |
| *** therve_ has quit IRC | 08:45 | |
| openstackgerrit | ChangBo Guo(gcb) proposed a change to openstack-dev/pbr: Remove copyright from empty files https://review.openstack.org/75876 | 08:46 |
| *** rossella_s has quit IRC | 08:48 | |
| *** rossella_s has joined #openstack-infra | 08:49 | |
| *** CaptTofu has joined #openstack-infra | 08:50 | |
| *** Ryan_Lane has quit IRC | 08:54 | |
| *** CaptTofu has quit IRC | 08:54 | |
| *** e0ne has joined #openstack-infra | 08:55 | |
| *** saju_m has quit IRC | 09:02 | |
| *** chandan_kumar has joined #openstack-infra | 09:03 | |
| *** hashar_ has joined #openstack-infra | 09:07 | |
| *** yassine has joined #openstack-infra | 09:07 | |
| *** jcooley_ has quit IRC | 09:10 | |
| *** jgallard has quit IRC | 09:13 | |
| *** jgallard has joined #openstack-infra | 09:13 | |
| *** vponomaryov has joined #openstack-infra | 09:14 | |
| *** gokrokve has joined #openstack-infra | 09:16 | |
| *** pblaho has joined #openstack-infra | 09:21 | |
| *** gokrokve has quit IRC | 09:21 | |
| *** che-arne has joined #openstack-infra | 09:22 | |
| *** che-arne has quit IRC | 09:24 | |
| *** jd__ has left #openstack-infra | 09:27 | |
| *** coolsvap has joined #openstack-infra | 09:30 | |
| *** saju_m has joined #openstack-infra | 09:34 | |
| *** mrda is now known as mrda_away | 09:36 | |
| *** dizquierdo has quit IRC | 09:43 | |
| *** e0ne_ has joined #openstack-infra | 09:47 | |
| *** julienvey1 is now known as julienvey | 09:49 | |
| *** e0ne has quit IRC | 09:50 | |
| *** kashyap has joined #openstack-infra | 09:54 | |
| *** luqas has quit IRC | 09:55 | |
| *** jp_at_hp has joined #openstack-infra | 09:56 | |
| *** ken1ohmichi has quit IRC | 09:56 | |
| openstackgerrit | Sergey Kolekonov proposed a change to openstack-infra/jenkins-job-builder: Ruby metrics plugin support added https://review.openstack.org/73528 | 09:58 |
| *** luqas has joined #openstack-infra | 09:58 | |
| *** amotoki has joined #openstack-infra | 10:02 | |
| *** luqas has left #openstack-infra | 10:02 | |
| *** hashar_ is now known as hashar | 10:09 | |
| *** sahumada has joined #openstack-infra | 10:10 | |
| *** johnthetubaguy has joined #openstack-infra | 10:15 | |
| *** dizquierdo has joined #openstack-infra | 10:16 | |
| *** gokrokve has joined #openstack-infra | 10:17 | |
| *** jlibosva has quit IRC | 10:21 | |
| *** gokrokve has quit IRC | 10:22 | |
| *** jlibosva has joined #openstack-infra | 10:22 | |
| *** saju_m has quit IRC | 10:25 | |
| *** mkoderer has joined #openstack-infra | 10:28 | |
| *** talluri has quit IRC | 10:28 | |
| *** talluri has joined #openstack-infra | 10:28 | |
| *** saju_m has joined #openstack-infra | 10:41 | |
| *** e0ne has joined #openstack-infra | 10:45 | |
| *** david-lyle has quit IRC | 10:45 | |
| openstackgerrit | Sergey Kolekonov proposed a change to openstack-infra/jenkins-job-builder: ZMQ Event Publisher plugin support added https://review.openstack.org/77561 | 10:46 |
| *** coolsvap has quit IRC | 10:47 | |
| *** e0ne_ has quit IRC | 10:49 | |
| *** CaptTofu has joined #openstack-infra | 10:51 | |
| *** yassine has quit IRC | 10:53 | |
| *** yamahata has quit IRC | 10:54 | |
| *** CaptTofu has quit IRC | 10:55 | |
| *** andreaf has joined #openstack-infra | 10:58 | |
| *** jgallard has quit IRC | 11:02 | |
| *** saju_m has quit IRC | 11:11 | |
| *** gokrokve has joined #openstack-infra | 11:17 | |
| *** alexpilotti has joined #openstack-infra | 11:18 | |
| *** nosnos has quit IRC | 11:21 | |
| *** xchu has joined #openstack-infra | 11:21 | |
| *** gokrokve has quit IRC | 11:21 | |
| *** alexpilotti has quit IRC | 11:23 | |
| *** rossella_s has quit IRC | 11:25 | |
| *** rossella_s has joined #openstack-infra | 11:25 | |
| *** saju_m has joined #openstack-infra | 11:25 | |
| *** bogdando has quit IRC | 11:38 | |
| *** jhesketh has quit IRC | 11:46 | |
| *** jhesketh__ has quit IRC | 11:47 | |
| *** afazekas has joined #openstack-infra | 11:53 | |
| *** jgallard has joined #openstack-infra | 11:54 | |
| *** xchu has quit IRC | 11:55 | |
| *** yamahata has joined #openstack-infra | 12:02 | |
| *** aysyanne has joined #openstack-infra | 12:03 | |
| *** homeless has quit IRC | 12:09 | |
| *** homeless has joined #openstack-infra | 12:09 | |
| *** alexpilotti has joined #openstack-infra | 12:10 | |
| *** alexpilotti_ has joined #openstack-infra | 12:13 | |
| *** alexpilotti has quit IRC | 12:15 | |
| *** alexpilotti_ is now known as alexpilotti | 12:15 | |
| *** gokrokve has joined #openstack-infra | 12:17 | |
| *** yamahata has quit IRC | 12:17 | |
| *** yamahata has joined #openstack-infra | 12:18 | |
| *** gokrokve has quit IRC | 12:22 | |
| *** ArxCruz has joined #openstack-infra | 12:24 | |
| *** hashar has quit IRC | 12:25 | |
| *** bookwar has joined #openstack-infra | 12:32 | |
| *** yassine has joined #openstack-infra | 12:33 | |
| *** e0ne has quit IRC | 12:36 | |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Auth Token Middleware https://review.openstack.org/74735 | 12:38 |
| *** rossella_s has quit IRC | 12:39 | |
| *** rossella_s has joined #openstack-infra | 12:41 | |
| *** talluri has quit IRC | 12:41 | |
| *** ociuhandu has joined #openstack-infra | 12:45 | |
| *** e0ne has joined #openstack-infra | 12:46 | |
| *** rfolco has joined #openstack-infra | 12:47 | |
| *** dcramer__ has quit IRC | 12:48 | |
| *** chandan_kumar has quit IRC | 12:48 | |
| *** chandan_kumar has joined #openstack-infra | 12:49 | |
| *** beagles has joined #openstack-infra | 12:51 | |
| *** mburned_out is now known as mburned | 12:52 | |
| *** CaptTofu has joined #openstack-infra | 12:52 | |
| *** saju_m has quit IRC | 12:52 | |
| openstackgerrit | A change was merged to openstack-infra/config: Install libffi-dev needed for python-glanceclient https://review.openstack.org/75738 | 12:53 |
| *** yamahata has quit IRC | 12:54 | |
| *** chandankumar_ has joined #openstack-infra | 12:54 | |
| *** CaptTofu has quit IRC | 12:56 | |
| *** chandan_kumar has quit IRC | 12:57 | |
| *** yamahata has joined #openstack-infra | 12:58 | |
| *** hashar has joined #openstack-infra | 12:59 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add python jobs for compass-core project https://review.openstack.org/75198 | 13:01 |
| *** CaptTofu has joined #openstack-infra | 13:04 | |
| *** dolphm_503 is now known as dolphm | 13:07 | |
| *** sandywalsh has joined #openstack-infra | 13:14 | |
| *** pdmars has joined #openstack-infra | 13:15 | |
| *** dims_ has quit IRC | 13:18 | |
| *** gokrokve has joined #openstack-infra | 13:19 | |
| *** eharney has quit IRC | 13:20 | |
| *** pdmars has quit IRC | 13:21 | |
| *** gokrokve has quit IRC | 13:23 | |
| *** yamahata has quit IRC | 13:23 | |
| *** e0ne_ has joined #openstack-infra | 13:24 | |
| *** mbacchi has joined #openstack-infra | 13:25 | |
| *** smarcet has joined #openstack-infra | 13:25 | |
| *** oubiwan__ has joined #openstack-infra | 13:26 | |
| *** e0ne has quit IRC | 13:27 | |
| *** soren has quit IRC | 13:29 | |
| *** Shrews_ has joined #openstack-infra | 13:29 | |
| *** soren has joined #openstack-infra | 13:30 | |
| *** Shrews has quit IRC | 13:30 | |
| *** tristanC has quit IRC | 13:30 | |
| *** tristanC has joined #openstack-infra | 13:30 | |
| *** oubiwan__ has quit IRC | 13:30 | |
| *** dims_ has joined #openstack-infra | 13:30 | |
| openstackgerrit | Cyril Roelandt proposed a change to openstack-dev/hacking: Port to Python 3 https://review.openstack.org/77585 | 13:33 |
| *** juice has quit IRC | 13:33 | |
| *** juice has joined #openstack-infra | 13:34 | |
| *** pdmars has joined #openstack-infra | 13:35 | |
| *** kevinbenton has quit IRC | 13:35 | |
| *** kevinbenton has joined #openstack-infra | 13:35 | |
| openstackgerrit | Arx Cruz proposed a change to openstack-infra/config: Initial support to a custom puppet master server https://review.openstack.org/77587 | 13:36 |
| *** e0ne has joined #openstack-infra | 13:36 | |
| *** wchrisj has joined #openstack-infra | 13:37 | |
| *** westmaas has quit IRC | 13:38 | |
| *** westmaas has joined #openstack-infra | 13:39 | |
| *** e0ne has quit IRC | 13:39 | |
| *** e0ne has joined #openstack-infra | 13:39 | |
| *** dragondm has quit IRC | 13:40 | |
| *** e0ne_ has quit IRC | 13:40 | |
| *** dragondm has joined #openstack-infra | 13:40 | |
| *** wchrisj has quit IRC | 13:42 | |
| *** prad_ has joined #openstack-infra | 13:43 | |
| *** lascii has quit IRC | 13:44 | |
| *** weshay has joined #openstack-infra | 13:44 | |
| *** clarkb has quit IRC | 13:44 | |
| *** lascii has joined #openstack-infra | 13:44 | |
| *** lascii is now known as alaski | 13:45 | |
| *** mfer has joined #openstack-infra | 13:48 | |
| *** jp_at_hp has quit IRC | 13:49 | |
| *** jp_at_hp has joined #openstack-infra | 13:50 | |
| *** fifieldt has joined #openstack-infra | 13:51 | |
| *** thuc has joined #openstack-infra | 13:51 | |
| *** maurosr has quit IRC | 13:53 | |
| *** maurosr has joined #openstack-infra | 13:54 | |
| *** rustlebee is now known as russellb | 13:56 | |
| *** koolhead17 has quit IRC | 13:57 | |
| *** tteggel has quit IRC | 13:58 | |
| *** viktors has joined #openstack-infra | 13:58 | |
| ttx | SergeyLukjanov, fungi, jeblair: https://review.openstack.org/#/c/74530/ is the thing blocking Barbican incubation request, so would be cool if you could review it in priority | 13:59 |
| fungi | lookin | 13:59 |
| *** tteggel has joined #openstack-infra | 13:59 | |
| sdague | should be pretty straight forward | 13:59 |
| *** thuc_ has joined #openstack-infra | 13:59 | |
| *** thomasem has joined #openstack-infra | 14:02 | |
| *** thuc has quit IRC | 14:03 | |
| *** koolhead17 has joined #openstack-infra | 14:03 | |
| sdague | it's nice to be monday before i3 and the gate isn't 100 items and 60 hrs deep | 14:03 |
| ttx | sdague: something is wrong :) | 14:04 |
| ttx | sdague: I find the top-of-queue time (remaining time + time in queue) to be a relatively good metric for queue health. Queue depth is actually less interesting. | 14:05 |
| sdague | agreed | 14:06 |
| ttx | Dunno how to graph it though | 14:06 |
| *** jeckersb_gone is now known as jeckersb | 14:06 | |
| sdague | well you'd have to feed that back into something | 14:06 |
| *** miqui has joined #openstack-infra | 14:06 | |
| sdague | you can get the json | 14:06 |
| SergeyLukjanov | ttx, looking on https://review.openstack.org/#/c/74530/ too | 14:06 |
| sdague | honestly, the combination helps figure things out though | 14:06 |
| fungi | SergeyLukjanov: oh,i just approved because there was already a core +2 on the previous patchset and the new patchset seemed to address the concerns you pointed out | 14:07 |
| sdague | time in queue for head (in hrs) > queue length / 10 ... things aren't great | 14:07 |
| SergeyLukjanov | fungi, I've already +2'd it ;) | 14:08 |
| ttx | sdague: yes, and currently you're 9 deep, but with time at 53min you're as good as it gets | 14:08 |
| sdague | yep | 14:08 |
| sdague | actually, right now, I'd define us a very good. Even the neutron failure on the devstack change has heat in the mix | 14:09 |
| openstackgerrit | Cyril Roelandt proposed a change to openstack-dev/hacking: Port to Python 3 https://review.openstack.org/77585 | 14:09 |
| ttx | sdague: we broke a new record in the integrated gate last week: https://github.com/openstack/openstack/graphs/commit-activity | 14:10 |
| ttx | 532 commit in a week | 14:10 |
| sdague | cool | 14:10 |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard-webclient: Auth support https://review.openstack.org/73219 | 14:10 |
| sdague | though we didn't have any days > 100 | 14:11 |
| sdague | which is interesting | 14:11 |
| fungi | slow and steady wins the race | 14:11 |
| sdague | yep | 14:12 |
| openstackgerrit | A change was merged to openstack-infra/config: Add DevStack job for Barbican https://review.openstack.org/74530 | 14:12 |
| *** gokrokve has joined #openstack-infra | 14:17 | |
| *** julim has joined #openstack-infra | 14:18 | |
| *** fifieldt has quit IRC | 14:19 | |
| *** wchrisj has joined #openstack-infra | 14:20 | |
| *** oubiwan__ has joined #openstack-infra | 14:20 | |
| *** banix has joined #openstack-infra | 14:21 | |
| *** mriedem has joined #openstack-infra | 14:21 | |
| *** gokrokve has quit IRC | 14:22 | |
| *** e0ne has quit IRC | 14:22 | |
| *** e0ne has joined #openstack-infra | 14:22 | |
| *** oubiwan__ has quit IRC | 14:26 | |
| *** vkozhukalov has joined #openstack-infra | 14:28 | |
| *** thuc has joined #openstack-infra | 14:32 | |
| SergeyLukjanov | fungi, could you please take a look at https://review.openstack.org/#/c/76634/? (it was approved, but it's still not working - http://logs.openstack.org/63/74963/4/check/gate-oslo-incubator-python27/3c7822f/console.html#_2014-03-03_10_08_31_987 | 14:32 |
| *** thuc_ has quit IRC | 14:35 | |
| fungi | SergeyLukjanov: | 14:35 |
| fungi | SergeyLukjanov: "Building remotely on bare-precise-hpcloud-az2-1983455" | 14:35 |
| fungi | SergeyLukjanov: | 164485 | hpcloud-az2 | bare-precise | bare-precise-1392916435.template.openstack.org | 1392916435 | 370156 | 4649455 | ready | 260.73 | | 14:35 |
| *** thuc has quit IRC | 14:36 | |
| fungi | so the image being used in az2 is over 10 days old | 14:36 |
| SergeyLukjanov | oh | 14:36 |
| SergeyLukjanov | fungi, where can I find this output? | 14:36 |
| *** amotoki has quit IRC | 14:37 | |
| fungi | well, i had to check the nodepool cli to get the image list (we should have prep scripts add a mintern-on date in a file somewhere our jobs can cat out to logs) | 14:37 |
| fungi | er, minted-on | 14:37 |
| SergeyLukjanov | oh, got it, so, just images should be updated | 14:38 |
| fungi | but anyway, this is that ongoing ticket we have open with hpcloud support about getting connection resets during template server builds in that az | 14:38 |
| fungi | normally we rebuild all images nightly | 14:38 |
| fungi | but it works so infrequently in hpcloud-az2 that we end up with images which are weeks old | 14:38 |
| fungi | i'll try to whip up a loop to retry for now until we get an actual working one | 14:38 |
| banix | Hi; I noticed my devstack patch fails the bash8 check with errors like this: "E020: Function declaration not in format "^function name {$": 'function _neutron_interface_setup() {'" for all function declaration in my script. I do not seem to find a related entry in http://status.openstack.org/rechecks/ What am I missing here? Haven't change the script for a while and it used to pass the check tests. | 14:41 |
| *** dcramer__ has joined #openstack-infra | 14:42 | |
| banix | I see other patches failing with similar errors and then passing later on; don't want to do a recheck no bug unnecessarily; so want to make sure I understand what is happening. Thanks. | 14:42 |
| fungi | banix: it looks like the latest version of bash8 wants you to drop the () from the end of your function name | 14:43 |
| fungi | sdague: ^ ? | 14:44 |
| banix | fungi: Oh. I see. thanks! | 14:44 |
| sdague | fungi: yes | 14:44 |
| sdague | thought that was pretty self explanatory | 14:44 |
| *** dripton__ is now known as dripton | 14:45 | |
| *** eharney has joined #openstack-infra | 14:45 | |
| banix | Thanks; will make the changes. | 14:45 |
| *** wchrisj has quit IRC | 14:45 | |
| dripton | I pushed a tag for sqlalchemy-migrate-0.8.3 on Friday, to kick off a new release, but pip is still giving me 0.8.2. How do I check on the release process? | 14:45 |
| *** homeless has quit IRC | 14:46 | |
| dripton | (I can see the new tag on github so I know the tagging and pushing of the tag worked, but nothing beyond that.) | 14:46 |
| fungi | dripton: was it a signed tag? | 14:46 |
| *** homeless has joined #openstack-infra | 14:46 | |
| dripton | fungi: It was not signed. Is that the problem? (I don't think the one for 0.8.2 was signed either.) | 14:47 |
| fungi | dripton: just a reminder, the specific workflow for release tagging is https://wiki.openstack.org/wiki/GerritJenkinsGit#Tagging_a_Release | 14:47 |
| *** oubiwan__ has joined #openstack-infra | 14:47 | |
| fungi | dripton: and yes, we do not trigger any activity on tags which aren't signed | 14:47 |
| dripton | thanks fungi. I will retry. | 14:48 |
| fungi | dripton: you'll probably want to create a signed tag named 0.8.4 since the old unsigned tag can quite easily be cached in a number of places (git clients don't normally check for tags being deleted and replaced) | 14:48 |
| *** mrmartin has joined #openstack-infra | 14:49 | |
| fungi | in general we recommend against deletion of tags | 14:49 |
| dripton | fungi: agreed. 0.8.4 | 14:49 |
| *** jergerber has joined #openstack-infra | 14:49 | |
| *** zns has joined #openstack-infra | 14:50 | |
| fungi | dripton: the good news is that soon i hope to have our build infrastructure validating tags on git repositories and checking them against lists of release managers registered for each project, comparing the built tarballs to the repository state for corresponding tags before upload, and adding an infrastructure server signature for each upload to pypi | 14:52 |
| dripton | fungi: awesome | 14:52 |
| fungi | so the signed tags part becomes even more important at that point | 14:52 |
| *** wchrisj has joined #openstack-infra | 14:53 | |
| *** jpeeler has quit IRC | 14:54 | |
| *** jpeeler has joined #openstack-infra | 14:54 | |
| *** jpeeler has quit IRC | 14:54 | |
| *** jpeeler has joined #openstack-infra | 14:54 | |
| *** oubiwan__ has quit IRC | 14:59 | |
| *** bada has joined #openstack-infra | 15:03 | |
| openstackgerrit | A change was merged to openstack-infra/storyboard-webclient: Fix NPM CA Chain issue and port conflict. https://review.openstack.org/77250 | 15:05 |
| openstackgerrit | A change was merged to openstack-infra/storyboard-webclient: Fix project page. https://review.openstack.org/77001 | 15:05 |
| openstackgerrit | A change was merged to openstack-infra/storyboard-webclient: Updated about page. https://review.openstack.org/77002 | 15:05 |
| jeblair | sdague, fungi: any urgent issues? | 15:15 |
| sdague | not that I know of | 15:15 |
| fungi | jeblair: not that i've seen so far | 15:15 |
| *** jgrimm has joined #openstack-infra | 15:15 | |
| *** rcleere has joined #openstack-infra | 15:16 | |
| sdague | actually, something just went bonkers - http://logs.openstack.org/03/71803/4/gate/gate-devstack-dsvm-cells/7a31981/logs/devstacklog.txt.gz | 15:17 |
| *** gokrokve has joined #openstack-infra | 15:17 | |
| jeblair | too late | 15:17 |
| jeblair | no takebacks | 15:17 |
| sdague | new sqlalchemy migrate is requiring db2 unconditionally | 15:17 |
| *** vkozhukalov has quit IRC | 15:18 | |
| jeblair | that's fantastic | 15:18 |
| sdague | dripton: hey, so can you look at that? | 15:18 |
| sdague | I expect it's a reaction to your tag going out there | 15:18 |
| fungi | dripton: ^ | 15:18 |
| dripton | sdague: will look in a sec | 15:18 |
| fungi | jinx | 15:18 |
| sdague | dripton: we're now 100% reseting everything | 15:18 |
| sdague | fungi: can you delete the new rev from the mirror? | 15:19 |
| jeblair | sdague: we don't devstack-gate sqlalchemy-migrate? | 15:19 |
| sdague | no | 15:19 |
| jeblair | i don't like the "delete from the mirror" fix | 15:19 |
| fungi | any mirror update will just put it back | 15:20 |
| sdague | well, delete from mirror means we don't loose 40 jobs | 15:20 |
| dripton | sdague fungi: I see 'ImportError: No module named ibm_db_sa' though ibm_db_sa is in test-requirements.txt | 15:20 |
| sdague | dripton: we don't install test-requirements in devstack | 15:21 |
| *** vkozhukalov has joined #openstack-infra | 15:21 | |
| *** gokrokve has quit IRC | 15:21 | |
| sdague | dripton: so what's the last good version of migrate? | 15:22 |
| dripton | sdague: that explains it. What do you think of adding ibm_db_sa to requirements.txt | 15:22 |
| fungi | dripton: http://logs.openstack.org/03/71803/4/gate/gate-tempest-dsvm-full/aafaee9/logs/devstacklog.txt.gz | 15:22 |
| sdague | dripton: we don't put db drivers in requirements.txt | 15:22 |
| dripton | sdague: 0.8.2 was good. 0.8.3 didn't push because I didn't sign the tag. And 0.8.4 is what's on fire now. | 15:22 |
| sdague | so, we need to back this out | 15:22 |
| sdague | and put a devstack job on migrate | 15:23 |
| sdague | and come up with a solution | 15:23 |
| fungi | can that requirement be reverted in sqlalchemy-migrate and 0.8.5 tagged? | 15:23 |
| fungi | to fix the rest of the world too while we come up with safer solutions? | 15:23 |
| jeblair | that ^ is the fastest; global-requirements pinning is the next best | 15:23 |
| dripton | fungi: yes, I can make a brown-bag 0.8.5 without the DB2 patch | 15:24 |
| sdague | it's a non conditional import | 15:24 |
| sdague | which means it's a fundamentally broken bit of code | 15:24 |
| *** jaypipes has joined #openstack-infra | 15:24 | |
| sdague | migrate can't require that all database drivers that it supports are installed | 15:24 |
| dripton | sdague: you're right, sorry | 15:25 |
| sdague | no prob | 15:25 |
| dripton | I will tag a 0.8.5 and then we can talk to the IBM folks about the right fix | 15:25 |
| sdague | cool | 15:25 |
| *** yamahata has joined #openstack-infra | 15:25 | |
| *** gokrokve has joined #openstack-infra | 15:26 | |
| jeblair | once 0.8.5 is tagged, i'm okay with removing 0.8.4 from the mirror to get things moving again | 15:26 |
| *** jnoller has joined #openstack-infra | 15:26 | |
| openstackgerrit | Sean Dague proposed a change to openstack/requirements: migrate 0.8.4 is bad, block it https://review.openstack.org/77614 | 15:27 |
| sdague | jeblair: so we could just do that | 15:27 |
| jeblair | or that | 15:27 |
| sdague | which just block 0.8.4 | 15:27 |
| sdague | honestly, I think we should do that anyway | 15:27 |
| jeblair | no argument here | 15:27 |
| jeblair | +2 | 15:27 |
| dripton | sdague: I just pushed 0.8.5 | 15:27 |
| sdague | dripton: thanks | 15:28 |
| sdague | so next up, we should add the tempest job to migrate, so we try migrate in a real environment | 15:28 |
| jeblair | ++ | 15:28 |
| fungi | approved | 15:29 |
| jeblair | fungi: want to gate-enqueue and promote it? | 15:29 |
| *** vkozhukalov has quit IRC | 15:29 | |
| fungi | once 77614 gets into the gate (unless it fails out on something) there shouldn't be anything else which can update the mirror besides releases | 15:30 |
| fungi | yes, enqueuing now | 15:30 |
| jeblair | i think that will work (as a 2 step: zuul enqueue and zuul promote) | 15:30 |
| sdague | sure, that will still fail the next hour on the check queue though right? | 15:30 |
| jeblair | sdague: yes | 15:30 |
| anteaya | I filed a bug report: https://bugs.launchpad.net/openstack-ci/+bug/1287226 | 15:31 |
| fungi | 77614,1 is now at the head of the gate | 15:31 |
| fungi | i'll clean up the mirror | 15:32 |
| fungi | it's out of the mirror now too | 15:32 |
| *** pcrews has joined #openstack-infra | 15:32 | |
| anteaya | with a spelling error in the title | 15:32 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: add query for migrate db2 error https://review.openstack.org/77618 | 15:36 |
| sdague | anteaya: oh, I filed a bug as well | 15:36 |
| jeblair | fungi: logs and docs-draft are both around 90% full | 15:36 |
| anteaya | sdague: good | 15:36 |
| jeblair | fungi: docs-draft is at 90% inodes | 15:36 |
| anteaya | I can mark mine as dupe | 15:36 |
| *** david-lyle has joined #openstack-infra | 15:37 | |
| *** mrodden has joined #openstack-infra | 15:37 | |
| fungi | jeblair: i'll add a new couple of pvs and recreate docs-draft with larger inode capacity first before expanding them both | 15:37 |
| jeblair | fungi: fyi: lvs says we have a mit of unallocated space ready to go already too | 15:38 |
| jeblair | a bit | 15:38 |
| *** ryanpetrello has joined #openstack-infra | 15:38 | |
| jeblair | fungi: maybe 10x #inodes on docs-draft? to put it more in line with logs? | 15:38 |
| fungi | cool--probably not enough to do a side-by-side rebuild of docs-draft though | 15:38 |
| fungi | and yes, definitely | 15:39 |
| jeblair | fungi: actually, barely; dd is 15:39 < jeblair> fungi: logs and docs-draft are both around 90% full | 15:39 |
| jeblair | 15:39 < anteaya> sdague: good | 15:39 |
| jeblair | 15:39 < jeblair> fungi: docs-draft is at 90% inodes | 15:39 |
| jeblair | 15:39 < anteaya> I can mark mine as dupe | 15:39 |
| jeblair | oh dear | 15:39 |
| fungi | the problem is that while you can grow blocks on ext4, you can't grow inode tables | 15:39 |
| fungi | so i'll need to mkfs a new one to do that | 15:39 |
| *** mrodden1 has joined #openstack-infra | 15:39 | |
| fungi | which is why i hadn't previously | 15:39 |
| jeblair | fungi: dd is 815g and there's 824g of free space | 15:39 |
| fungi | oh! then i can | 15:39 |
| fungi | i'll do that first | 15:39 |
| jeblair | fungi: cool, thanks! | 15:40 |
| *** coolsvap has joined #openstack-infra | 15:40 | |
| *** wenlock has joined #openstack-infra | 15:40 | |
| *** clarkb has joined #openstack-infra | 15:40 | |
| *** chandan_kumar has joined #openstack-infra | 15:41 | |
| *** mrodden has quit IRC | 15:42 | |
| jeblair | fungi: anything i can do with server moves? | 15:42 |
| jeblair | git0x servers | 15:42 |
| fungi | jeblair: https://etherpad.openstack.org/p/git-server-rebuild | 15:43 |
| *** jgrimm has quit IRC | 15:43 | |
| fungi | jeblair: i've got git04 up through step #6 there | 15:43 |
| *** beekneemech is now known as bnemec | 15:43 | |
| fungi | at least some quick eyes on the plan before i press forward with the potentially disrupting bit would be appreciated | 15:43 |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Auth Token Middleware https://review.openstack.org/74735 | 15:44 |
| openstackgerrit | Marton Kiss proposed a change to openstack-infra/config: Add OpenstackID SSL Certs https://review.openstack.org/77621 | 15:44 |
| jeblair | fungi: wow look at the cpu usage on git05 compared to the others | 15:44 |
| jeblair | http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=2 | 15:44 |
| *** mrmartin has quit IRC | 15:45 | |
| fungi | jeblair: i was talking to clarkb about that yesterday... compare the network utilization | 15:46 |
| fungi | i wonder whether we should be repacking refs daily instead of weekly | 15:46 |
| fungi | suspecting that haproxy is evenly distributing requests, but git05 seems to be dealing with much less network traffic volume | 15:46 |
| fungi | easiest explanation is better packed repositories on 05 | 15:47 |
| fungi | though i haven't looked again today to see if the situation has changed | 15:47 |
| *** oubiwan__ has joined #openstack-infra | 15:47 | |
| sdague | fungi: can you check on the er bot? | 15:48 |
| jeblair | sdague: i'll get it | 15:48 |
| sdague | I haven't seen it say anything in a while, and I wonder if gerrit restart made it wonky | 15:48 |
| sdague | jeblair: thanks | 15:48 |
| sdague | I want to make sure it's reporting on the db2 bug, as that will save everyone here a ton of time | 15:48 |
| *** mrmartin has joined #openstack-infra | 15:50 | |
| jeblair | it is receiving gerrit events | 15:51 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: add query for migrate db2 error https://review.openstack.org/77618 | 15:51 |
| jeblair | sdague: do you see a problem? | 15:52 |
| jeblair | it seems to be receiving irc messages as well | 15:52 |
| sdague | I haven't seen it say anything in channel in > 24 hrs | 15:53 |
| sdague | anyway, stepping away for a bit, biab | 15:54 |
| fungi | it seems to be in the qa channel at least | 15:55 |
| *** rlandy has quit IRC | 15:55 | |
| fungi | so it's not just on the other side of a netsplit | 15:55 |
| jeblair | 2014-03-03 15:55:03,271 DEBUG irc.client: TO SERVER: JOIN #openstack-qa | 15:55 |
| jeblair | i think it might just have returned from the other side of a netsplit | 15:55 |
| fungi | that could explain it | 15:56 |
| fungi | i didn't look for joinspam from it | 15:56 |
| jeblair | so it was on orwell before, now it's on barjavel | 15:57 |
| jeblair | there _was_ activity on orwell | 15:57 |
| jeblair | including sdague | 15:57 |
| jeblair | sdague: the last message it sent to channel was 2014-03-01 19:23:47,774 DEBUG irc.client: TO SERVER: PRIVMSG #openstack-qa :Console logs not available after 13:39s for check-tempest-dsvm-neutron-full 77358,1,5a9df85 | 15:58 |
| *** damnsmith is now known as dansmith | 15:58 | |
| jeblair | after that, it seems to be receiving data from gerrit, rx and tx to irc, and interacting with es | 15:59 |
| jeblair | so i don't know why it hasn't decided to say anything; the logs aren't illuminating there | 15:59 |
| *** jcooley_ has joined #openstack-infra | 16:00 | |
| openstackgerrit | Antoine Musso proposed a change to openstack-infra/jenkins-job-builder: Support the Post Build Script plugin https://review.openstack.org/77628 | 16:02 |
| *** chandan_kumar has quit IRC | 16:03 | |
| *** bada has quit IRC | 16:03 | |
| *** jcooley_ has quit IRC | 16:05 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Log recheckwatchbot messages https://review.openstack.org/77629 | 16:08 |
| jeblair | sdague, fungi: ^ that might actually let us see recheckwatchbot's log messages. | 16:08 |
| fungi | jeblair: change of plans. apparently the 10x inode table reduces the usable space in the new filesystem to less than the contents of the old, so i'll need to add cinder volumes first | 16:10 |
| *** thedodd has joined #openstack-infra | 16:10 | |
| *** Shrews_ is now known as Shrews | 16:10 | |
| *** reed has quit IRC | 16:11 | |
| fungi | 824.00g lv formatted ext4 w/ room for 600m inodes leaves 680g of usable blocks | 16:12 |
| jeblair | ah well | 16:13 |
| fungi | ~240 bytes per inode table slot | 16:13 |
| fungi | er, 256 in fact | 16:14 |
| jeblair | nice round number | 16:14 |
| *** mrodden1 is now known as mrodden | 16:14 | |
| *** chandan_kumar has joined #openstack-infra | 16:16 | |
| fungi | indeed | 16:17 |
| *** atiwari has joined #openstack-infra | 16:19 | |
| *** thuc has joined #openstack-infra | 16:20 | |
| *** beagles has left #openstack-infra | 16:23 | |
| *** dangers_away is now known as dangers | 16:26 | |
| *** andreaf has quit IRC | 16:26 | |
| openstackgerrit | A change was merged to openstack-infra/storyboard-webclient: Update README https://review.openstack.org/74714 | 16:28 |
| *** markmcclain has joined #openstack-infra | 16:29 | |
| *** bknudson has quit IRC | 16:31 | |
| *** pmathews has joined #openstack-infra | 16:32 | |
| jeblair | fungi: https://etherpad.openstack.org/p/git-server-rebuild lgtm | 16:33 |
| fungi | jeblair: thanks. i've nearly got the docs-draft rsync going, and then i'll press forward with git04 replacement | 16:35 |
| fungi | jeblair: also, i rechecked on friday and the issue we used to have with pypy jobs on py3k-precise nodepool nodes is no longer happening, so i'll throw up a quick change to move those remaining jobs off the old precisepy3k static slaves | 16:35 |
| *** mgagne has joined #openstack-infra | 16:36 | |
| jeblair | fungi: cool | 16:36 |
| fungi | i still think mordred's proposed change is a useful improvement, even if it's no longer needed to fix this particular thing | 16:36 |
| jeblair | fungi: which is that? | 16:37 |
| *** jaypipes has quit IRC | 16:38 | |
| *** mfink has joined #openstack-infra | 16:39 | |
| fungi | jeblair: https://review.openstack.org/75213 | 16:39 |
| *** gokrokve has quit IRC | 16:39 | |
| fungi | though it might be a good idea to broaden it to apply to all nodepool nodes | 16:39 |
| *** bknudson has joined #openstack-infra | 16:39 | |
| fungi | it's basically the same thing we do in install_puppet.sh | 16:40 |
| jeblair | yeah | 16:40 |
| openstackgerrit | A change was merged to openstack/requirements: migrate 0.8.4 is bad, block it https://review.openstack.org/77614 | 16:42 |
| sdague | jeblair: ok cool | 16:43 |
| sdague | +1 on the log change | 16:44 |
| jeblair | mattoliverau: oh good morning. :) | 16:44 |
| *** oubiwan__ has quit IRC | 16:46 | |
| jeblair | mattoliverau: i think the cacti change didn't work | 16:46 |
| jeblair | Mar 3 06:53:51 cacti puppet-agent[24168]: (/Stage[main]/Openstack_project::Cacti/File[/etc/apache2/conf-available/cacti.conf]/ensure) change from absent to file failed: Could not set 'file on ensure: cannot generate tempfile `/etc/apache2/conf-available/cacti.conf20140303-24168-11d00ng-9' at /opt/config/production/modules/openstack_project/manifests/cacti.pp:29 | 16:46 |
| banix | Is there a bug related to the 'DB sync error' i see in check-grenade-dsvm log for a devstack patch check? http://paste.openstack.org/show/71801/ I can't find any but can be mistaken… | 16:47 |
| anteaya | banix: https://bugs.launchpad.net/openstack-ci/+bug/1287229 | 16:47 |
| banix | anteaya: Thanks as always! How come I cannot find these myself?!…. See the fix has merged. do i do a recheck no bug here? | 16:50 |
| anteaya | recheck bug 1287229 | 16:51 |
| banix | anteaya: thanks | 16:51 |
| anteaya | "How come I cannot find these myself?" what do you do when you look for the bug? | 16:51 |
| anteaya | where did you look and how did you search? | 16:51 |
| openstackgerrit | Thierry Carrez proposed a change to openstack-infra/storyboard: Remove Branch and Milestone legacy tables https://review.openstack.org/77187 | 16:51 |
| *** davidhadas_ has quit IRC | 16:52 | |
| banix | anteaya: Just for my understanding, i have a question; please ignore if busy. When you specify a bug for a recheck, does that affect the check itself at all or it is simply for tracking that the recheck was related to a given bug? | 16:52 |
| jeblair | so one thing we can do to help people find these bugs is to tag them 'gate-bug' | 16:53 |
| jeblair | sorry | 16:53 |
| jeblair | 'gate-failure' | 16:53 |
| anteaya | for tracking that the recheck was related to a given bug | 16:53 |
| banix | anteaya: I looked at the rechecks page and also the devstack bugs which was probably not the right place | 16:53 |
| anteaya | banix: no effect on the check itself, it is just a trigger to say "run the tests again" | 16:53 |
| anteaya | banix: it is a good start | 16:53 |
| anteaya | well done | 16:53 |
| jeblair | i also removed openstack-ci from that bug | 16:54 |
| anteaya | jeblair: good point | 16:54 |
| anteaya | jeblair: is there a way to check all of launchpad for an error? | 16:54 |
| *** jcooley_ has joined #openstack-infra | 16:54 | |
| openstackgerrit | Thierry Carrez proposed a change to openstack-infra/storyboard: Remove Branch and Milestone legacy tables https://review.openstack.org/77187 | 16:54 |
| anteaya | I usually select a project and search one project at a time | 16:55 |
| jeblair | anteaya: i'm not sure i understand the question. but launchpad bugs has some fairly advanced search criteria | 16:55 |
| jeblair | anteaya: you might want to search all openstack bugs: https://bugs.launchpad.net/openstack/ | 16:55 |
| *** zns has quit IRC | 16:56 | |
| anteaya | jeblair: thanks | 16:56 |
| anteaya | you gave me what I was looking for | 16:56 |
| anteaya | so banix in the future the link jeblair just posted will be handy for you | 16:56 |
| fungi | has anybody looked into why we haven't been able to build new bare-centos6 images for over a week? if no, i'll dig into it (rax may have changed the base image name or something) | 16:56 |
| jeblair | pleia2: you mentioned you knew a freenode op; i still haven't heard anything about the group contact registration change... do you think we could start bugging them? | 16:57 |
| jeblair | fungi: i have not | 16:57 |
| banix | anteaya, jeblair: thanks. | 16:58 |
| *** e0ne has quit IRC | 16:58 | |
| *** gokrokve has joined #openstack-infra | 16:58 | |
| pleia2 | jeblair: I casually spoke with Corey of freenode last week when he was in town, he said he'd "work his magic" but I should formally follow up in a few days | 16:59 |
| *** che-arne has joined #openstack-infra | 16:59 | |
| jeblair | pleia2: cool, thanks. | 16:59 |
| *** jcooley_ has quit IRC | 16:59 | |
| fungi | um, nodepoold hasn't updated its image.log since feb 20... | 17:00 |
| jeblair | fungi: it moved | 17:00 |
| fungi | aha | 17:00 |
| jeblair | fungi: to its own subdir so it can be httpd served | 17:00 |
| fungi | thanks--found it | 17:00 |
| fungi | yay puppet broken | 17:01 |
| fungi | 2014-03-03 02:20:05,892 INFO nodepool.image.build.rax-iad.bare-centos6: Could not find dependent Exec[update-java-alternatives] for Package[ant] at /root/config/modules/jenkins/manifests/slave.pp:86 | 17:01 |
| jeblair | zaro: ^ | 17:01 |
| *** viktors is now known as viktors_away | 17:01 | |
| *** jcooley_ has joined #openstack-infra | 17:01 | |
| jeblair | that might be related to the buck changes zaro was working on | 17:02 |
| fungi | it would be something we merged ~9 days ago, at any rate | 17:03 |
| jeblair | fungi: you know, once we get the 'sudo on bare nodes' changes merged -- i bet we can make some simple jobs that run "puppet apply" on proposed config changes on each node type | 17:03 |
| fungi | ooh, i bet you are right | 17:03 |
| openstackgerrit | Thierry Carrez proposed a change to openstack-infra/storyboard: migrate 0.8.4 is bad, block it https://review.openstack.org/77648 | 17:04 |
| *** gyee has joined #openstack-infra | 17:05 | |
| fungi | jeblair: i assume at this point they're just not approved because slush? | 17:05 |
| jeblair | fungi: ETOOBUSY and then slush i think. they can probably wait till after i3. | 17:07 |
| fungi | i'm all for rebasing/polishing and punching +a on that stack come friday | 17:08 |
| jeblair | cool | 17:08 |
| *** jgrimm has joined #openstack-infra | 17:10 | |
| *** coolsvap has quit IRC | 17:10 | |
| *** thedodd has quit IRC | 17:10 | |
| *** coolsvap has joined #openstack-infra | 17:11 | |
| jpich | Hello. Is the trivial rebase script still working? Usually when I click the 'rebase' button and there is no conflict the votes are also carried over, I'm not sure what I did differently this time ( https://review.openstack.org/#/c/70149/ ) | 17:13 |
| jeblair | jpich: i'll check | 17:13 |
| jpich | Thanks | 17:13 |
| *** gokrokve has quit IRC | 17:14 | |
| *** thedodd has joined #openstack-infra | 17:14 | |
| *** mrmartin has joined #openstack-infra | 17:15 | |
| *** mrmartin has quit IRC | 17:16 | |
| *** gokrokve has joined #openstack-infra | 17:17 | |
| fungi | jpich: there's a chance that since the rebase included changes to openstack_dashboard/test/test_data/keystone_data.py within the context of your change (lines 200-209 changed) it couldn't tell they were the same patch | 17:17 |
| jeblair | jpich: i don't see any errors in the logs related to this, so i think it's working; fungi's suggestion sounds reasonable | 17:18 |
| fungi | specifically alterations to lines 208 and 209 would have fallen within the 3-line context of your change on line 211 | 17:18 |
| jpich | jeblair, fungi: I see, darn! Thank you for the explanation, I appreciate it | 17:19 |
| *** gokrokve has quit IRC | 17:20 | |
| *** julienvey has left #openstack-infra | 17:21 | |
| *** pblaho has quit IRC | 17:24 | |
| zaro | fungi: does that error mean that update-java-alternatives ran on a bare-centos machine? | 17:25 |
| *** chandan_kumar has quit IRC | 17:25 | |
| fungi | zaro: i thin it means we tried to install ant on centos, and the ant package is configured with a notify for update-java-alternatives | 17:26 |
| fungi | think | 17:26 |
| *** mrodden has quit IRC | 17:26 | |
| sdague | so something I've realized in trying to do a local multinode devstack. Getting some of the services running that way is going to be interesting (and incredibly useful). Like ceilometer couldn't actually setup multinode before the weekend. | 17:27 |
| fungi | zaro: so if we want to install ant on centos but not run update-java-alternatives then we either need to use a subscribe (i think that will work?) or have separate package definitions depending on target platform | 17:27 |
| zaro | i see. i think ant should be on both flavors. i'll try to propose something using subscribe. | 17:29 |
| openstackgerrit | A change was merged to openstack-infra/storyboard: migrate 0.8.4 is bad, block it https://review.openstack.org/77648 | 17:29 |
| *** davidhadas has joined #openstack-infra | 17:29 | |
| *** amcrn has quit IRC | 17:29 | |
| banix | anteaya: interestingly, bug 1287229 does not show up on https://bugs.launchpad.net/openstack/ If I search I can find it but when i sort by debug number and also after using advanced search and marking all types of bugs including those with releases fixes, i still do not see it. | 17:30 |
| *** afazekas has quit IRC | 17:31 | |
| *** melwitt has joined #openstack-infra | 17:31 | |
| zaro | fungi: doesn't debian include centos or is it only ubuntu? | 17:32 |
| fungi | zaro: centos is in teh red hat family | 17:32 |
| fungi | not the debian family | 17:33 |
| *** bhuvan has joined #openstack-infra | 17:33 | |
| *** bhuvan_ has joined #openstack-infra | 17:33 | |
| zaro | fungi: ahh i see. | 17:33 |
| clarkb | morning | 17:34 |
| jeblair | fungi: here's a draft email of a proposal to move to oftc based on your plan: https://etherpad.openstack.org/p/oftc | 17:34 |
| jeblair | clarkb, mordred, fungi, SergeyLukjanov, pleia2: ^ thoughts? | 17:35 |
| SergeyLukjanov | jeblair, looking | 17:35 |
| jeblair | we can send that to the dev list and then propose a motion to the tc -- probably with similar text but with actual dates | 17:35 |
| zaro | clarkb: morning | 17:36 |
| fungi | jeblair: looks great | 17:36 |
| fungi | summarizes what we discussed very well | 17:37 |
| zaro | fungi: do you know which version of centos we are spinning up? 5.8 or 6.3? | 17:37 |
| anteaya | banix: what are you searching for? when I put 1287229 in the search input box I get the bug, also if I search for ImportError: No module named ibm_db_sa I get https://bugs.launchpad.net/tempest/+bug/1287235 which I about to mark as a duplicate | 17:37 |
| *** lcestari has joined #openstack-infra | 17:37 | |
| clarkb | jeblair: I agree makes it seem simple too | 17:37 |
| pleia2 | I think the plan is good, but perhaps add more rationale? | 17:37 |
| fungi | zaro: 6.5 | 17:37 |
| pleia2 | I fear oftc is only more stable because it's much smaller, it does still have netsplits | 17:37 |
| jeblair | fungi: i was entertaining the idea of switching channels to moderated before/after the move, but it probably would make more sense to not do that and just let people talk instead | 17:37 |
| SergeyLukjanov | jeblair, look great IMO | 17:38 |
| fungi | it seems to (currently and for the recent decade) experience far fewer denial of service attacks | 17:38 |
| sdague | jeblair: yeh, is this just having a smaller target? | 17:38 |
| *** bhuvan__ has joined #openstack-infra | 17:38 | |
| *** bhuvan___ has joined #openstack-infra | 17:38 | |
| clarkb | pleia2: yes, not being subject to as much attention can't hurt either | 17:38 |
| jeblair | pleia2: it's definitely smaller; about 1/7 the # of online users | 17:38 |
| pleia2 | yep | 17:38 |
| sdague | I guess is there a belief that under the same level of attack oftc would respond better? | 17:38 |
| *** bhuvan_ has quit IRC | 17:39 | |
| *** bhuvan has quit IRC | 17:39 | |
| pleia2 | sdague: that's the kind of rationale I'd like to see in the etherpad (if that is the case) | 17:39 |
| fungi | sdague: i think there's the belief that oftc is far less attractive of a target since their mission statement is much less general than freenode's | 17:39 |
| banix | anteaya: I can find it through search but i do not see it listed. I thought if I listed all bugs by the bug number I would easily find this one in the list as well. | 17:39 |
| anteaya | jeblair: how will channel logging be handled? | 17:40 |
| *** sweston has joined #openstack-infra | 17:40 | |
| jeblair | anteaya: same as ever | 17:40 |
| anteaya | in terms of timing when logging starts on oftc and ends on freenode? | 17:41 |
| jeblair | anteaya: ah, i imagine we'd switch the bots at the cutover time | 17:41 |
| fungi | also, lacks the stigma of opn, though that memory has probably faded in the past 11 years | 17:41 |
| anteaya | so no buffer period for logging? | 17:41 |
| jeblair | anteaya: no; i think it's better to do a decisive cut | 17:42 |
| jeblair | anteaya: less chance of confusion | 17:42 |
| jeblair | anteaya: and we can do it on a weekend so there would be little activity during the change itself | 17:42 |
| jeblair | (say 0000 utc on a sunday) | 17:42 |
| anteaya | okay, was that addressed in the etherpad and I missed it? | 17:42 |
| jeblair | anteaya: i think it was implied but we can make it explicit. | 17:43 |
| anteaya | okay, I will look again | 17:43 |
| anteaya | yeah, explicit would be great | 17:44 |
| *** mrodden has joined #openstack-infra | 17:44 | |
| clarkb | fungi: whats with the inode thing in scrollback? that pops up with little context (I assume because I was on a different side of a netsplit) | 17:44 |
| anteaya | banix: oh, I used search, I didn't go through the bug list | 17:44 |
| davidlenwell | Hey guys .. so on new project friday .. I don't think I ended up as a core reviewer to my project | 17:44 |
| anteaya | banix: I don't know what criteria launchpad uses for selecting what bugs to list at https://bugs.launchpad.net/openstack/ | 17:45 |
| anteaya | davidlenwell: what irc name do you want as core-reviewer on refstack? | 17:45 |
| fungi | davidlenwell: we have to manually add members to the groups which get created for each new acl, so we usually wait for people to tell us who to add as the initial member of each group | 17:46 |
| zaro | clarkb: i just spun up a centos 6.3 vm on HP cloud, no yum? | 17:46 |
| fungi | davidlenwell: this is for stackforge/refstack right? | 17:46 |
| davidlenwell | fungi: yes | 17:46 |
| zaro | clarkb: have you tried that? | 17:46 |
| *** harlowja_away is now known as harlowja | 17:46 | |
| davidlenwell | my irc name isn't exactly what my lp git review user name is | 17:46 |
| *** harlowja is now known as harlowja_away | 17:47 | |
| davidlenwell | git review name is dlenwell | 17:47 |
| clarkb | zaro: I haven't tried it in a long time, but I seem to remember yum existing | 17:47 |
| fungi | davidlenwell: done https://review.openstack.org/#/admin/groups/281,members https://review.openstack.org/#/admin/groups/282,members | 17:47 |
| davidlenwell | fungi: .. thank you | 17:47 |
| davidlenwell | now I can +2 | 17:48 |
| fungi | davidlenwell: you're welcome! | 17:48 |
| jeblair | clarkb, zaro: you may need to "up2date yum" or something to install it. probably our base puppet modules do that. | 17:49 |
| *** harlowja_away is now known as harlowja | 17:50 | |
| *** jaypipes has joined #openstack-infra | 17:50 | |
| *** miqui has quit IRC | 17:51 | |
| kashyap | harlowja, Heya, python-gerrit-view is packaged for Fedora -- https://bugzilla.redhat.com/show_bug.cgi?id=1069566 | 17:51 |
| *** miqui has joined #openstack-infra | 17:52 | |
| kashyap | (I mean, should be in Rawhide soon, but I know this is not breaking news :-) ) | 17:52 |
| anteaya | 8 minutes to jaypipes 3rd party ci workshop in -meeting | 17:52 |
| zaro | clarkb, jeblair : sorry, i was mistaken. it's there. i thought i was logged in but i was not. | 17:52 |
| harlowja | kashyap cool | 17:52 |
| fungi | jeblair: clarkb: zaro: it's also worth pointing out that we don't currently have jenkins slaves running centos in hpcloud, just rackspace. though once upon a time some centos-based pbx servers were installed in hpcloud so i expect it's still usable there | 17:52 |
| jeblair | ya | 17:53 |
| *** hashar has quit IRC | 17:53 | |
| kashyap | harlowja, Thanks, I see there's more fixes in there, you plan to make a new release on PyPI soon? | 17:53 |
| *** yassine has quit IRC | 17:53 | |
| *** zns has joined #openstack-infra | 17:53 | |
| harlowja | kashyap sure can press the button or 2 it takes to do that | 17:53 |
| *** sabari_ has joined #openstack-infra | 17:54 | |
| *** sabari__ has joined #openstack-infra | 17:54 | |
| jaypipes | anteaya: ty ma'am! :) | 17:54 |
| kashyap | harlowja, Thanks. | 17:54 |
| *** sabari__ is now known as sabari | 17:54 | |
| *** rwsu has joined #openstack-infra | 17:55 | |
| anteaya | jaypipes: np | 17:55 |
| fungi | clarkb: are we satisfied enough with the new elasticsearch cluster members that it's time to delete the old ones and clean up their dns entries? | 17:55 |
| fungi | or are there files on any of them you need to retrieve first? | 17:55 |
| clarkb | fungi: I am satisfied. need to fix index deletion but that doesn't require keeping the old nodes around | 17:56 |
| *** vkozhukalov has joined #openstack-infra | 17:57 | |
| jeblair | pleia2, sdague, anteaya: i updated the etherpad; any other thoughts? | 17:59 |
| davidlenwell | So getting jenkins -1's on a review that aren't making sense to me.. https://review.openstack.org/#/c/77655/ , http://logs.openstack.org/55/77655/2/check/gate-refstack-pep8/8ce908d/console.html | 17:59 |
| clarkb | the third part ci meeting is starting | 18:00 |
| * clarkb follows that | 18:00 | |
| jeblair | btw, i didn't go into this in the etherpad, and don't think i need to, but fyi i did all the channel/bot registrations on a recent saturday when i could not connect to freenode at all | 18:00 |
| clarkb | davidlenwell: you need a tox.ini file | 18:00 |
| anteaya | jeblair: lgtm, thanks | 18:00 |
| *** krotscheck has joined #openstack-infra | 18:01 | |
| anteaya | jeblair: a good justification for the move | 18:01 |
| *** luqas has joined #openstack-infra | 18:01 | |
| pleia2 | jeblair: it's fine, my rationale comments were mostly so we're prepared for potential objections (moving is a huge pain, "freenode" is hard coded a lot of places and a lot of people still assume Debian lives here even though they moved, need to make sure it's worth it) | 18:01 |
| harlowja | kashyap https://pypi.python.org/pypi/gerrit-view uploaded | 18:02 |
| StevenK | pleia2: But, but, irc.debian.org is a CNAME to irc6.geo.oftc.net | 18:02 |
| pleia2 | StevenK: careful, I can throw things at you | 18:03 |
| StevenK | pleia2: I'm not actually trolling? | 18:03 |
| *** gyee has quit IRC | 18:03 | |
| pleia2 | oh :) | 18:03 |
| kashyap | harlowja, Thank you. I'll make a new Fedora release, once the initial package lands in Rawhide | 18:03 |
| *** derekh has joined #openstack-infra | 18:03 | |
| harlowja | k | 18:03 |
| pleia2 | irc.ubuntu.com is also a cname, but sadly people just don't use these cnames all that much, even if they are a lovely idea | 18:04 |
| *** jerryz has joined #openstack-infra | 18:04 | |
| clarkb | I just connect to all the servers | 18:04 |
| pleia2 | clarkb: well, me too :) | 18:04 |
| jeblair | pleia2: definitely; i mean, my habit is to '/j #software' on freenode for any new piece of software i'm interested in. so there's a certain network effect here. i think we're probably large enough that we can swing this kind of a move though... | 18:04 |
| jeblair | pleia2: we're also somewhat self-contained on man of the channels | 18:05 |
| StevenK | pleia2: Right. But it's handy to just point new people at | 18:05 |
| *** dprince has joined #openstack-infra | 18:05 | |
| pleia2 | jeblair: fair enough | 18:05 |
| pleia2 | StevenK: yeah, it is | 18:05 |
| jeblair | pleia2: but #openstack-infra and #openstack might see some dropoff from casual visitors | 18:05 |
| pleia2 | not such a bad thing | 18:06 |
| harlowja | kashyap great, i'll try it out on my fedora box once that lands | 18:06 |
| jeblair | i think we'd want to maintain some kind of a presense in the channels indefitintely, even if it's just having a topic set and bots | 18:06 |
| greghaynes | dd~. | 18:06 |
| *** dprince has quit IRC | 18:06 | |
| pleia2 | yeah, I think part of why people get confused about debian is that there is actually an active #debian here that people just end up in | 18:06 |
| pleia2 | and it's bigger than the oftc one, heh | 18:07 |
| fungi | it's the decoy ;) | 18:07 |
| jeblair | haha | 18:07 |
| fungi | (tarpit, honeypot, pick your term) | 18:08 |
| *** dprince has joined #openstack-infra | 18:08 | |
| *** odyssey4me has joined #openstack-infra | 18:08 | |
| jeblair | so perhaps after a time, we should actually moderate the channels to prevent that from happening | 18:08 |
| *** dripton is now known as dripton_shovelin | 18:08 | |
| *** luqas has left #openstack-infra | 18:09 | |
| StevenK | pleia2: There were a bunch of people who were against moving for Debian | 18:09 |
| pleia2 | StevenK: yeah, I remember | 18:09 |
| *** mrmartin has joined #openstack-infra | 18:10 | |
| *** arborism has joined #openstack-infra | 18:10 | |
| *** arborism is now known as amcrn | 18:10 | |
| StevenK | pleia2: So I'm wondering if they're the core of #debian here, but I don't recall who were the most vocal holdouts | 18:10 |
| *** nati_ueno has joined #openstack-infra | 18:13 | |
| zaro | would anyone be opposed to adding the multiple scm plugin to infra jenkins slaves? | 18:14 |
| clarkb | zaro: what do we need it for? | 18:15 |
| jeblair | zaro: why? | 18:15 |
| *** jcoufal has joined #openstack-infra | 18:15 | |
| mordred | I'm going to ask the same question - why? | 18:15 |
| *** dizquierdo has quit IRC | 18:16 | |
| fungi | zaro: we already avoid using the git plugin, and almost everything we interact with is in git. if we need to retrieve and build things from another scm, we probably want something like gerrit-git-prep.sh and a builder macro for it? | 18:16 |
| zaro | so obviously the same thing can be done using shell, but using scm plugin seems more in line with how we use the other plugins ? | 18:17 |
| fungi | also, every new jenkins plugin we start using is technical debt we have to repay as we move off jenkins | 18:18 |
| *** zul has quit IRC | 18:18 | |
| zaro | ok. not sure why we use any plugins at all because just about everything can be done in shell. | 18:19 |
| jeblair | zaro: we use almost no plugins | 18:19 |
| fungi | that's the plan | 18:19 |
| jeblair | zaro: and fewer all the time | 18:19 |
| nibalizer | fungi: what are you moving off jenkins to? | 18:20 |
| *** johnthetubaguy has quit IRC | 18:20 | |
| mordred | nibalizer: direct build workers attached to zuul | 18:20 |
| fungi | nibalizer: our infrastructure has been growing new features over time to supplant the pieces we use | 18:20 |
| *** zul has joined #openstack-infra | 18:21 | |
| zaro | got it. i'll stick to shell then. my use case is to scm two git repos to build the gerrit plugins. | 18:21 |
| *** khyati has joined #openstack-infra | 18:21 | |
| *** freyes has quit IRC | 18:21 | |
| nibalizer | okay sweet | 18:21 |
| mordred | zaro: we probably could go back through the plugins we have installed in our jenkins and uninstall/remove the ones we don't use | 18:21 |
| *** davidhadas has quit IRC | 18:21 | |
| fungi | zaro: in that case it might make more sense to extend gerrit-git-prep.sh to be able to handle multiple repositories | 18:21 |
| *** davidhadas has joined #openstack-infra | 18:22 | |
| zaro | fungi: yes, that's another option. however it's periodic job so it's not triggering on any repos. | 18:22 |
| clarkb | fungi: zaro: if we allow g-g-p to cloen into a dir we can just call it more than once | 18:22 |
| jeblair | or you can do what we already do in this case and cd into a dir, then call ggp. | 18:23 |
| fungi | as for how we use other plugins, the only ones i remember adding (gearman, zeromq, scp) are there to help wean our current use cases off of jenkins | 18:23 |
| *** UtahDave has joined #openstack-infra | 18:24 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/devstack-gate: Add support for running with a custom regex filter https://review.openstack.org/77664 | 18:24 |
| mtreinish | jaypipes, jeblair: ^^^ | 18:24 |
| *** rainya has joined #openstack-infra | 18:24 | |
| jaypipes | that was quick, thx mtreinish | 18:25 |
| *** lcestari has quit IRC | 18:26 | |
| mtreinish | jaypipes: well hopefully it works I just kinda typed and then pushed it for review :) | 18:26 |
| zaro | i don't think i can do this job with g-g-p https://review.openstack.org/#/c/70014/9/modules/openstack_project/files/jenkins_job_builder/config/gerrit-plugin-jobs.yaml | 18:27 |
| *** jgallard has quit IRC | 18:29 | |
| jeblair | zaro: yeah, you don't need ggp for that. what you have looks like the way to do it | 18:29 |
| jeblair | zaro: one thing though -- you could clone gerrit from /opt/git/gerrit, and then update the repo | 18:30 |
| jeblair | zaro: would be faster and more reliable | 18:30 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Install curl on elasticsearch nodes. https://review.openstack.org/77666 | 18:31 |
| *** weshay has quit IRC | 18:31 | |
| clarkb | fungi: ^ should fix index deletion | 18:31 |
| mtreinish | sdague: is there a reason we don't run bash8 on devstack-gate? | 18:31 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Decoupled API story and task creation. https://review.openstack.org/77668 | 18:31 |
| clarkb | I was going to try and make sure curl was installed everywhere but that is a bit of a chore | 18:31 |
| *** davidhadas has quit IRC | 18:31 | |
| sdague | mtreinish: because it hasn't been extracted yet | 18:32 |
| *** ildikov_ has quit IRC | 18:32 | |
| sdague | and I mostly wanted to make sure it was welcome there before I went through the effort | 18:32 |
| mtreinish | sdague: well, I'd have no complaints about it being run there | 18:33 |
| zul | hey guys 1.2.2 should hit the cloud archive this week before i go on vacation at least | 18:33 |
| sdague | mtreinish: sure, the core review team should ack it though | 18:33 |
| anteaya | zul hey thanks | 18:33 |
| fungi | clarkb: lgtm. are you sure you don't want to futureproof it with an ifndef block though, since we're entirely likely to add it somewhere deeper down the tree eventually as we add more pvhvm nodes? | 18:35 |
| *** sabari_ has quit IRC | 18:35 | |
| clarkb | fungi: not now, there are a bunch of other places that need ifndefs too | 18:35 |
| clarkb | we can fix them together | 18:35 |
| *** sabari has quit IRC | 18:35 | |
| *** mgagne has quit IRC | 18:35 | |
| clarkb | zul: woot, though with feature freeze this week I wonder if we can update to that | 18:36 |
| * clarkb leaves that decision up to others | 18:36 | |
| zul | clarkb: ill be unavailable next week so you might want to bug jamespage, hallyn, or smoser about it next week (ill be off the grid) | 18:36 |
| * jamespage takes the pass from zul | 18:37 | |
| anteaya | zul: what country will you be off the grid in? | 18:38 |
| zul | anteaya: florida | 18:38 |
| anteaya | nice | 18:38 |
| zul | must escape the cold | 18:38 |
| anteaya | hopefully no snowstorms down there | 18:38 |
| *** gyee has joined #openstack-infra | 18:38 | |
| anteaya | yeah she has been a bit stiff this winter | 18:38 |
| zaro | jeblair: hmm. i don't understand how it's possible to clone from /opt/git/gerrit. does that mean that git repos are mirrored on every jenkins slave? | 18:38 |
| jeblair | zaro: yes | 18:39 |
| *** lcestari has joined #openstack-infra | 18:39 | |
| zaro | jeblair: ohh, didn't know that. | 18:39 |
| jeblair | zaro: but they are only updated once a day (at most, sometimes longer), so you need to update from git.o.o after cloning. | 18:39 |
| *** mgagne has joined #openstack-infra | 18:41 | |
| *** hogepodge has joined #openstack-infra | 18:42 | |
| *** mrmartin has quit IRC | 18:42 | |
| *** zehicle_at_dell has joined #openstack-infra | 18:45 | |
| alexpilotti | jeblair: hi | 18:46 |
| alexpilotti | jeblair: by looking at this link http://www.rcbops.com/gerrit/reports/neutron-cireport.html, Hyper-V is not included | 18:47 |
| *** morganfainberg_Z is now known as morganfainberg | 18:47 | |
| alexpilotti | jeblair: we're currently providing CI for Neutron as well, beside Nova | 18:48 |
| mriedem | sdague: ping on migrate tempest job when you're back | 18:48 |
| alexpilotti | jeblair: and I was wondering if are missing something :-) | 18:48 |
| jeblair | alexpilotti: i have no idea what that is | 18:49 |
| alexpilotti | jeblair: ok tx :-) | 18:49 |
| jeblair | alexpilotti: it looks like a rackspace thing | 18:49 |
| alexpilotti | jeblair: generally speaking, do you know if we need to do anything specific to be "enlisted" as Neutron CI? | 18:50 |
| jeblair | alexpilotti: we don't keep track of ci systems by project at the moment, so once you have an account you can vote on anything | 18:51 |
| alexpilotti | jeblair: ok perfect, I was supposing that, but I preferred to ask for confirmation | 18:51 |
| openstackgerrit | A change was merged to openstack-infra/config: Install curl on elasticsearch nodes. https://review.openstack.org/77666 | 18:51 |
| sdague | mriedem: so I think you just want a new job template - https://github.com/openstack-infra/config/blob/master/modules/openstack_project/files/jenkins_job_builder/config/devstack-gate.yaml | 18:52 |
| sdague | which is named name: '{pipeline}-tempest-dsvm-full-sqla-migrate' | 18:52 |
| sdague | or something, basically a unique name | 18:52 |
| sdague | then set up the tempest params in there, probably the tempest-dsvm-full job is fine to copy | 18:53 |
| *** cody-somerville has joined #openstack-infra | 18:53 | |
| *** cody-somerville has quit IRC | 18:53 | |
| *** cody-somerville has joined #openstack-infra | 18:53 | |
| openstackgerrit | A change was merged to openstack-infra/reviewday: Add JSON link and fix header https://review.openstack.org/76065 | 18:53 |
| sdague | if you want to go hard core, it would be nice to have a version which installs a specific version of sqla up front, to have a 0.7, 0.8, and 0.9 job | 18:54 |
| fungi | alexpilotti: you're looking for mikal | 18:54 |
| mriedem | sdague: i'm hoping to be softcore on the initial attempt | 18:54 |
| sdague | yeh | 18:54 |
| fungi | mikal: would be nice if those third-party ci reports included a contact link for the responsible party | 18:55 |
| fungi | mikal: e.g. you | 18:55 |
| jeblair | mikal: or if they are useful and people are making desicions based on them, maybe run them in infra, with a configuration file that anyone can update | 18:55 |
| mriedem | sdague: definitely < 0.9 for now given global-requiremnets https://github.com/openstack/requirements/blob/master/global-requirements.txt#L110 | 18:55 |
| fungi | mikal: otherwise people just seem to assume we control the entire universe ;) | 18:55 |
| sdague | so copy the tempest-dsvm-full job to and sqla specific one | 18:55 |
| sdague | add it to they layout.yaml | 18:55 |
| alexpilotti | fungi: tx, tried to ping mikal on -dev, afaik he lives in oz, possible? | 18:55 |
| sdague | and then we also need to sort getting migrate there in git format | 18:56 |
| fungi | alexpilotti: it may be sleepy-time for mikal at this point, but try later when he wakes up | 18:56 |
| fungi | alexpilotti: also, mattoliverau and jhesketh may be able to throw things at him... not sure | 18:56 |
| alexpilotti | fungi: tx, I'll try later! | 18:57 |
| sdague | fungi: how do we handled that for stackforge projects? | 18:57 |
| *** mrda_away is now known as mrda | 18:58 | |
| clarkb | sdague: ideally we don't copy jobs, if you need a 1:1 copy with a different name you just change the branch designator | 18:58 |
| clarkb | which is probably poorly named at this point | 18:58 |
| sdague | clarkb: ok | 18:58 |
| sdague | that's news to me | 18:58 |
| clarkb | that is what the wsme pecan jobs do | 18:58 |
| clarkb | but if you need to do something special like install different version of sqlalchmey you may need a new job | 18:58 |
| clarkb | sdague: it was a big part of the job refactor over the holidays | 18:58 |
| sdague | clarkb: that works with tempest jobs? | 18:59 |
| clarkb | sdague: yeah | 18:59 |
| *** e0ne has joined #openstack-infra | 18:59 | |
| sdague | I'm actually trying to find an instance as an example | 18:59 |
| clarkb | sdague: wsme/pecan | 18:59 |
| mriedem | sdague: clarkb: so i'm looking at '{pipeline}-tempest-dsvm-full{branch-designator}' | 18:59 |
| clarkb | pretty sure they are doing it | 18:59 |
| sdague | clarkb: doesn't look like | 19:00 |
| sdague | only tox jobs | 19:00 |
| clarkb | hmm maybe we never got that far with them | 19:00 |
| clarkb | sdague: ironic does it to have different names for voting and non voting | 19:00 |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: Test for email-ext publisher https://review.openstack.org/75872 | 19:00 |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: Add attachment pattern expression to email-ext. https://review.openstack.org/70148 | 19:01 |
| mriedem | i see two ironic jobs in devstack-gate.yaml, one for postgres and one that isn't | 19:01 |
| mriedem | assuming defaults to mysql? | 19:01 |
| sdague | mriedem: yeh, we consider mysql default | 19:02 |
| *** dripton_shovelin is now known as dripton | 19:02 | |
| jaypipes | fungi, jeblair, sdague, mtreinish, anteaya: ty all for the help in the 3rd party testing meeting! much appreciated :) | 19:03 |
| sdague | yep, no problem | 19:03 |
| anteaya | jaypipes: it went very well | 19:03 |
| mriedem | sdague: ok so just go back to looking at '{pipeline}-tempest-dsvm-full{branch-designator}' ? for example i see a marconi one: '{pipeline}-tempest-dsvm-marconi{branch-designator}' | 19:03 |
| anteaya | and now some have moved to -dev, even better | 19:03 |
| jeblair | jaypipes: np; it looked like it was (and will continue to be) really useful | 19:04 |
| *** akerr has joined #openstack-infra | 19:04 | |
| fungi | jaypipes: thank you for organizing it! | 19:04 |
| akerr | Hey guys, trying to get a service account set up for the 3rd party testing. Could someone pls review https://bugs.launchpad.net/openstack-ci/+bug/1284808 ? thx :) | 19:04 |
| sdague | clarkb: so where do you specify branch-designator ? | 19:04 |
| sdague | because I assume the point is to be able to just reuse those jobs in layout.yaml | 19:05 |
| clarkb | sdague: in projects.yaml where you instantiate the template | 19:05 |
| clarkb | fungi: is http://ci.openstack.org/gerrit.html#third-party-testing-access up to date with the access levels we are giving third party testing accounts? | 19:05 |
| sdague | clarkb: got a pointer? I'm failing on grep | 19:05 |
| fungi | clarkb: it is | 19:05 |
| *** rcarrillocruz has joined #openstack-infra | 19:06 | |
| fungi | akerr: i believe clarkb is planning to catch up the third-party ci service account requests soon | 19:06 |
| akerr | fungi: cool. thx | 19:06 |
| clarkb | sdague: ironic http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/projects.yaml#n1716 | 19:06 |
| sdague | oh, it's in projects | 19:07 |
| fungi | akerr: sorry about the delay. it's been about a week since we've added any, and we tend to go through the requests in batches | 19:07 |
| akerr | got ya | 19:07 |
| kevinbenton | Hi. Is there a known bug for not being able to install setuptools-git for py26? ( http://logs.openstack.org/86/76386/1/check/gate-neutron-python26/401d754/console.html) | 19:07 |
| *** weshay has joined #openstack-infra | 19:07 | |
| *** rcarrillocruz1 has quit IRC | 19:07 | |
| kevinbenton | I didn't see anything obvious on the rechecks pags | 19:08 |
| *** beagles has joined #openstack-infra | 19:08 | |
| fungi | kevinbenton: the real error there is "Cannot fetch index base URL http://pypi.openstack.org/openstack/ | 19:08 |
| *** eharney has quit IRC | 19:08 | |
| fungi | " | 19:08 |
| jgriffith | fungi: This everything you need: http://lists.openstack.org/pipermail/openstack-infra/2014-March/000934.html | 19:08 |
| jgriffith | minus the funky scrubbing it did | 19:09 |
| kevinbenton | fungi: oh okay. i see it now. thanks | 19:09 |
| *** mrda is now known as mrda_away | 19:09 | |
| *** akerr has left #openstack-infra | 19:09 | |
| fungi | jgriffith: looks fine, though if i were processing it i's probably request a full name of "SolidFire CI" | 19:09 |
| *** akerr has joined #openstack-infra | 19:09 | |
| clarkb | do we use setuptools git anymore? | 19:10 |
| clarkb | mordred: ^ | 19:10 |
| fungi | jgriffith: it can (and usually does) include spaces, and the "OpenStack" there is pretty redundant since this is an account on the openstack gerrit | 19:10 |
| jgriffith | fungi: good point | 19:10 |
| akerr | just a general question, I've noticed that jenkins seems to be kicking off check tests for any update to a code review, not just "recheck xyz" updates. Is this a known issue? | 19:10 |
| sdague | akerr: that's working as designed | 19:11 |
| jgriffith | fungi: I'll just reply to the original message tehn assuming it hasn't been acted on yet | 19:11 |
| sdague | so that we have fresh test results | 19:11 |
| akerr | sdague: is that new? | 19:11 |
| fungi | akerr: it's intentional if the change has gone more than 72 hours without a check, or if the change has gone less than 24 hours without a check and has just gotten approved | 19:11 |
| sdague | it's not every change, it's if the test results are 3 days old | 19:11 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: add tempest job to sqla-migrate https://review.openstack.org/77674 | 19:11 |
| sdague | clarkb: like that ^^^^ | 19:11 |
| akerr | ok, maybe I just never noticed it before | 19:12 |
| clarkb | sdague: yup, then add it to zuul's layout.yaml under sqlalchemy and whatever else | 19:12 |
| fungi | akerr: grr... "or if the change has gone MORE than 24 hours without a check and has just gotten approved" | 19:12 |
| fungi | akerr: we just started doing that a few weeks ago, so fairly new behavior | 19:12 |
| clarkb | akerr: ok you are first up since you are in channel | 19:12 |
| sdague | clarkb: so lastly, strategy for getting migrate on the disk? | 19:12 |
| sdague | should we be using a gate hook to get the git tree there? | 19:12 |
| *** rcleere has quit IRC | 19:12 | |
| fungi | clarkb: well, jgriffith's in channel too, but akerr spoke up first ;) | 19:13 |
| clarkb | sdague: it should already be on disk since it is a gerrit project. Trick is making devstack use it | 19:13 |
| jeblair | add it to PROJECTS var? | 19:13 |
| sdague | jeblair: sure, I wasn't sure if that was kosher for stuff in stackforge | 19:13 |
| jeblair | sdague: not in devstack-gate, but yes in the jjb definition for the job | 19:14 |
| sdague | ok, then we can't just use the full job | 19:14 |
| akerr | clarkb: sorry first up for? | 19:14 |
| *** mrmartin has joined #openstack-infra | 19:15 | |
| jeblair | clarkb: but then, yeah, something needs to actually install it from the git repo -- that could be a pre-gate-hook or a devstack hook (like the other stackforge projects use to get themselves installed) | 19:15 |
| *** pblaho has joined #openstack-infra | 19:15 | |
| *** rcleere has joined #openstack-infra | 19:15 | |
| jeblair | sdague: that implication sounds correct to me | 19:15 |
| mriedem | sdague: for example i'm looking at barbican.yaml for the job template there | 19:16 |
| mriedem | sdague: export PROJECTS="stackforge/barbican $PROJECTS" | 19:16 |
| mriedem | i'm kind of lost, but that's what i was looking at duplicating | 19:16 |
| clarkb | akerr: for account creation. You have a third party test account now | 19:17 |
| fungi | akerr: first in line for getting your service account request... services | 19:17 |
| akerr | clarkb, fungi: ahh, thanks! | 19:17 |
| *** jpich has quit IRC | 19:17 | |
| anteaya | akerr: https://review.openstack.org/#/admin/groups/270,members | 19:18 |
| kevinbenton | i have one more quick question, i ran reverify on https://review.openstack.org/#/c/76386/ and now it's showing up in 'check' instead of 'gate' | 19:18 |
| kevinbenton | shouldn't it be in gate? | 19:18 |
| fungi | the docs-draft rsync is slow... so many inodes in there. a little over 10% completed at this point, i think | 19:18 |
| anteaya | kevinbenton: yes it does that autmatically | 19:18 |
| anteaya | kevinbenton: if it passes check it will move to gate | 19:18 |
| fungi | kevinbenton: it will get put back through check and if it gets a +1 there then it gets moved into the gate automatically | 19:18 |
| kevinbenton | oh i see. is that to prevent a flaky job from wrecking the chain in gate? | 19:19 |
| fungi | kevinbenton: yes, and also may allow us to enforce different sets of jobs in check and gate if we like | 19:19 |
| sdague | mriedem: so copy barbican, but delete the enabled services lines, and copy the env variables that tempest-full creates | 19:19 |
| sdague | I think that gives us the right thing | 19:19 |
| *** jcoufal has quit IRC | 19:20 | |
| kevinbenton | thanks | 19:20 |
| mriedem | sdague: ok you going to drop this? https://review.openstack.org/#/c/77674/ | 19:20 |
| sdague | yeh | 19:20 |
| fungi | kevinbenton: the idea being that we may have some jobs which are fairly independent of the rest of the openstack components (like style and static analysis, maybe also unit tests and doc builds) and others which are not (like devstack integration tests and functional testing) | 19:21 |
| sdague | abandoning now | 19:21 |
| *** jcoufal has joined #openstack-infra | 19:21 | |
| fungi | kevinbenton: so the first set could be enforced entirely in the check pipeline that way, if we wanted | 19:21 |
| sdague | also, reviewers were not paying attention to code having very old test results before approving, so this is added protection | 19:22 |
| clarkb | fungi: for requests that want spaces in usernames and the like are you just using something sane instead like s/ /-/ ? | 19:22 |
| * clarkb wants to be consistent | 19:22 | |
| jgriffith | clarkb: I updated req | 19:22 |
| jgriffith | clarkb: just made it "SolidFire CI" | 19:22 |
| clarkb | jgriffith: ok | 19:23 |
| jgriffith | clarkb: if that helps | 19:23 |
| kevinbenton | i see. but the check job still isn't rebased against master, right? | 19:23 |
| jgriffith | clarkb: oh... username... OK, ignore me | 19:23 |
| anteaya | kevinbenton: the check job isn't rebased against anything | 19:23 |
| clarkb | jgriffith: yeah your username is fine :) | 19:23 |
| fungi | clarkb: usually yes, and lowercasing them and shortening them if they've picked something crazy long (like leaving out the word openstack if they included it) | 19:23 |
| jgriffith | :) | 19:23 |
| clarkb | jgriffith: I am taking stock of others, just about to do yours | 19:23 |
| anteaya | kevinbenton: the check job runs, jenkins votes -1 or +1 | 19:24 |
| anteaya | kevinbenton: if +1, the job moves to the gate, if it has a +A | 19:24 |
| fungi | kevinbenton: check jobs are in fact cherry-picked onto the tip of their target branch, or onto a dependent change if they have one | 19:24 |
| clarkb | jgriffith: done | 19:24 |
| fungi | kevinbenton: well, not cherry-picked but merged. which is why you may sometimes get check failures about being unable to merge | 19:25 |
| *** mrodden has quit IRC | 19:25 | |
| *** Sukhdev has joined #openstack-infra | 19:25 | |
| kevinbenton | fungi: ok. makes sense | 19:25 |
| fungi | basically indicates a merge conflict, in which case you may need to do some conflict resolution to rebase it manually | 19:25 |
| *** jcoufal has quit IRC | 19:26 | |
| *** mrodden has joined #openstack-infra | 19:26 | |
| *** cody-somerville has quit IRC | 19:27 | |
| *** markwash has joined #openstack-infra | 19:28 | |
| akerr | clarkb: these service accounts are not full fledged launchpad accounts, correct? So I could not for example log in as NetApp CI? | 19:28 |
| clarkb | akerr: they are gerrit service accounts so only exist on gerrit. You will not be able to login to the web ui via launchpad openid | 19:29 |
| fungi | akerr: you will be unable to use them for anything except interaction via the ssh api | 19:29 |
| *** coolsvap has quit IRC | 19:29 | |
| akerr | clarkb, fungi: got it, thanks | 19:29 |
| *** sabari_ has joined #openstack-infra | 19:29 | |
| *** sabari has joined #openstack-infra | 19:29 | |
| mriedem | sdague: i see that gate-barbican-devstack-dsvm only runs in the check queue? | 19:30 |
| mriedem | sdague: wouldn't i want gate-sqlalchemy-migrate-devstack-dsvm to run in check and gate? | 19:30 |
| fungi | akerr: which is also why you won't be able to update things like e-mail address and ssh key on them yourself, so if that ends up being needed (try to do what you need to so you can make sure it isn't needed), let us know and we can change it for you | 19:30 |
| akerr | fungi: noted, thanks | 19:31 |
| mordred | clarkb: no | 19:31 |
| mordred | clarkb: we do not use setuptools-git anymore. it's possible that something in grizzly still uses it | 19:31 |
| fungi | akerr: in particular, please back up the corresponding private half of your ssh key | 19:31 |
| mgagne | thanks to whoever cleaned up the JJB changes queue | 19:31 |
| mgagne | (JJB, the project) | 19:32 |
| clarkb | fungi: for http://lists.openstack.org/pipermail/openstack-infra/2014-February/000903.html would you change the username to brocade-ci? | 19:32 |
| clarkb | fungi: also, do we want to request people not use personal email addresses? | 19:33 |
| fungi | clarkb: i probably would have just used that ssh username as is. and i don't usually push back on personal e-mail addresses unless they're already in use for another account in gerrit | 19:34 |
| clarkb | fungi: wfm thanks | 19:34 |
| openstackgerrit | Matt Riedemann proposed a change to openstack-infra/config: Add tempest full job to sqlalchemy-migrate https://review.openstack.org/77679 | 19:35 |
| fungi | since some of these people may be unable to get dedicated ssh aliases from their employers for it... but then again that's usually an easier hurdle to jump than web hosting for their logs :/ | 19:35 |
| mriedem | sdague: clarkb: ^ first draft | 19:35 |
| *** e0ne has quit IRC | 19:35 | |
| fungi | er, dedicated e-mail aliases | 19:35 |
| *** rlandy has joined #openstack-infra | 19:35 | |
| fungi | okay, i'm downing git04 through the haproxy control socket, preparing to replace it shortly | 19:36 |
| clarkb | fungi: I think my concern is $person leaves company now all lines of communication are severed | 19:36 |
| clarkb | but we can deal with that if/when it happens since the alias problem you point out is a thing | 19:36 |
| *** e0ne has joined #openstack-infra | 19:36 | |
| StevenK | fungi: So git04 is broken? | 19:36 |
| pleia2 | hmm, is slave.pp used for the python slaves too, or just nodepool stuff? | 19:36 |
| fungi | clarkb: yeah, but we have another, heavier cudgel to wield there. we turn off the account | 19:36 |
| pleia2 | asking because https://review.openstack.org/#/c/75538/ broke redhat/fedora | 19:36 |
| fungi | clarkb: and then let the new responsible party come asking | 19:37 |
| pleia2 | I'm working on a patch now | 19:37 |
| *** akerr has left #openstack-infra | 19:37 | |
| fungi | StevenK: no, we're systematically swapping out all the existing git pool members for performance pvhvm servers | 19:37 |
| clarkb | pleia2: it is used by all slaves | 19:37 |
| clarkb | pleia2: also :( | 19:37 |
| StevenK | fungi: Ahh, nice. | 19:37 |
| fungi | StevenK: we added a fifth one first to help carry the drops in capacity | 19:38 |
| pleia2 | clarkb: so we might have a problem next time we try to bring up a centos slave, I'll make sure my match works with centos as well | 19:38 |
| pleia2 | s/match/patch | 19:38 |
| fungi | clarkb: btw, load averages for the git server farm, all lined up for comparison... http://fungi.yuggoth.org/tmp/git-cacti.html | 19:39 |
| *** cody-somerville has joined #openstack-infra | 19:39 | |
| anteaya | clarkb: brocade tempest exists: https://review.openstack.org/#/admin/groups/91,members | 19:39 |
| fungi | git05 does still look to be consistently less loaded | 19:39 |
| *** mrda_away is now known as mrda | 19:41 | |
| clarkb | anteaya: this is a different account | 19:41 |
| anteaya | ah okay | 19:41 |
| fungi | anteaya: clarkb: agreed, it might make sense to follow up to that request getting confirmation that they know they each exist (so that we can turn off the other one of it's defunct) | 19:41 |
| fungi | if it's defunct | 19:42 |
| clarkb | anteaya: did you want to do ^ ? I can if you don't have time | 19:42 |
| fungi | or reassign it or whatever | 19:42 |
| sdague | mriedem: so the last thing we need is to get it to run setup.py install | 19:42 |
| *** jcoufal has joined #openstack-infra | 19:42 | |
| anteaya | clarkb: I will start by asking in -neutron | 19:43 |
| clarkb | anteaya: sounds good, thanks | 19:43 |
| *** pblaho has quit IRC | 19:43 | |
| mriedem | sdague: i see some of the stackforge projects have pre/post test hook scripts in their job template | 19:43 |
| mriedem | is that where the migrate code would be installed? | 19:43 |
| sdague | yeh pre_test_hook | 19:44 |
| sdague | that happens at the right time | 19:44 |
| mriedem | ok | 19:44 |
| *** markmc has joined #openstack-infra | 19:44 | |
| mriedem | cd /opt/stack/new/sqlalchemy-migrate/ | 19:44 |
| mriedem | python setup.py install | 19:44 |
| sdague | sudo python setup.py install | 19:44 |
| mriedem | ah right | 19:44 |
| mordred | sudo pip install . | 19:44 |
| mordred | but yeah | 19:44 |
| sdague | or what mordred says | 19:44 |
| mriedem | ok | 19:44 |
| mordred | (it SHOULD be the same, but better safe than sorry) | 19:44 |
| clarkb | sdague++ "Telling everyone they have silent data corruption is not a good default" | 19:45 |
| openstackgerrit | Matt Riedemann proposed a change to openstack-infra/config: Add tempest full job to sqlalchemy-migrate https://review.openstack.org/77679 | 19:46 |
| anteaya | clarkb: I might not hear back until closer to neutron meeting but I think someone should be around then, might be an hour | 19:47 |
| clarkb | anteaya: no rush | 19:47 |
| anteaya | thanks | 19:47 |
| anteaya | I think I will go for a walk now | 19:47 |
| anteaya | back later | 19:48 |
| *** mrodden1 has joined #openstack-infra | 19:51 | |
| *** zns has quit IRC | 19:52 | |
| *** mrodden has quit IRC | 19:53 | |
| *** thuc has quit IRC | 19:53 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Fix update java alternatives on redhat systems https://review.openstack.org/77683 | 19:54 |
| zaro | fungi: ^ | 19:54 |
| pleia2 | zaro: ah, I was just working on the same thing :) | 19:55 |
| *** jp_at_hp has quit IRC | 19:55 | |
| pleia2 | zaro: we'll need a conditional for fedora too, I'll make a comment | 19:55 |
| fungi | zaro: pleia2: do centos/fedora use that /etc/alternatives/java link? that's not just a debianism? | 19:56 |
| zaro | pleia2: isn't already there? slave.pp line 96? | 19:56 |
| sdague | clarkb: can you give this a look - https://review.openstack.org/#/c/77679/ | 19:56 |
| pleia2 | fungi: it does | 19:57 |
| fungi | neat! | 19:57 |
| pleia2 | zaro: yes, there is a conditional but we'll need a different alternatives line, fedora and centos differ | 19:57 |
| clarkb | fungi: btw I deleted two more indexes by hand. Once we have the curl change in this will happen automagically | 19:57 |
| fungi | clarkb: i thought i approved it? | 19:57 |
| *** e0ne has quit IRC | 19:58 | |
| clarkb | fungi: oh did you? I have been multiplexing too much stuff this morning to keep up | 19:58 |
| clarkb | in that case we should be good going forward now :) | 19:58 |
| fungi | clarkb: yeah, scrollback says gerritbot commented on it merging at 18:51 utc, so it's been installed for right at one hour now | 19:59 |
| *** unicell has quit IRC | 19:59 | |
| * fungi checked because he doesn't trust his own memory | 20:00 | |
| *** unicell has joined #openstack-infra | 20:00 | |
| kashyap | harlowja, When you have a moment, and if you're feeling adventurous, I just pushed a build here -- http://koji.fedoraproject.org/koji/buildinfo?buildID=501948 | 20:01 |
| clarkb | sdague: mriedem reviewed | 20:01 |
| fungi | outbound traffic for git04 is flatlined now, so i'm updating dns records in rackspace | 20:01 |
| kashyap | harlowja, (If it asks for gerritlib -- http://koji.fedoraproject.org/koji/buildinfo?buildID=501940). They all should show up in regular Rawhide repos, but just noting them here. | 20:01 |
| harlowja | kashyap k, i can try that out on fedora box, see what happens :-P | 20:01 |
| kashyap | harlowja, The earth stops spinning :-) | 20:02 |
| sdague | clarkb: cool | 20:02 |
| sdague | mriedem: so just pull the gate line, then we should be good | 20:02 |
| harlowja | kashyap it might! | 20:02 |
| kashyap | harlowja, I'm hitting the hay. You can leave feedback here, I'll pick it up async tomm. Thanks, again. | 20:03 |
| harlowja | k | 20:03 |
| *** mrodden1 is now known as mrodden | 20:03 | |
| *** thuc has joined #openstack-infra | 20:03 | |
| mriedem | sdague: clarkb: ok thanks | 20:05 |
| *** markmcclain has quit IRC | 20:05 | |
| clarkb | fungi: re https://review.openstack.org/#/c/77314/ did you happen to run that during any of the project creation friday runs? | 20:15 |
| openstackgerrit | Matt Riedemann proposed a change to openstack-infra/config: Add tempest full job to sqlalchemy-migrate https://review.openstack.org/77679 | 20:15 |
| clarkb | fungi: if that fixes an actual problem I have a hunch that it will fix the non orchestration bits around manage-projects that have been bugging us | 20:15 |
| *** e0ne has joined #openstack-infra | 20:15 | |
| fungi | clarkb: not that one... it showed up after i'd fired off the last batch | 20:15 |
| fungi | clarkb: figure we can give it a spin in a few days if you want to take a turn at it | 20:16 |
| clarkb | fungi: thats what I thought, thanks | 20:16 |
| clarkb | sounds good | 20:16 |
| fungi | man... nova delete of those old elasticsearch nodes sure is taking a while | 20:16 |
| fungi | must be those huge root filesystems | 20:17 |
| *** eharney has joined #openstack-infra | 20:17 | |
| zaro | pleia2: what is the javac path in fedora? | 20:19 |
| zaro | pleia2: ohh, i'm gonna guess it's just /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.60-2.4.5.1.fc20.x86_64/jre/bin/javac | 20:21 |
| pleia2 | zaro: there is no javac, just java | 20:21 |
| pleia2 | and that is at /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.60-2.4.5.1.fc20.x86_64/jre/bin/java | 20:22 |
| pleia2 | I'm not seeing javac in centos either though | 20:22 |
| *** esmute has quit IRC | 20:23 | |
| zaro | you need to yum install java-1.7.0-openjdk-devel to get javac | 20:24 |
| pleia2 | ah, ok, let me check that | 20:24 |
| *** yolanda_ has quit IRC | 20:24 | |
| *** dprince has quit IRC | 20:25 | |
| pleia2 | zaro: ok right, you want /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.60-2.4.5.1.fc20.x86_64/bin/javac | 20:25 |
| zaro | thanks! | 20:25 |
| *** hashar has joined #openstack-infra | 20:25 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Fix update java alternatives on redhat systems https://review.openstack.org/77683 | 20:27 |
| *** esmute has joined #openstack-infra | 20:30 | |
| *** sparkycollier has joined #openstack-infra | 20:30 | |
| *** esmute has quit IRC | 20:33 | |
| *** SumitNaiksatam has joined #openstack-infra | 20:33 | |
| *** zns has joined #openstack-infra | 20:33 | |
| *** esmute has joined #openstack-infra | 20:33 | |
| *** melwitt has quit IRC | 20:37 | |
| *** sandywalsh has quit IRC | 20:38 | |
| *** jaypipes has quit IRC | 20:38 | |
| *** bhuvan___ has quit IRC | 20:39 | |
| *** bhuvan__ has quit IRC | 20:39 | |
| *** sparkycollier has quit IRC | 20:40 | |
| *** sparkycollier has joined #openstack-infra | 20:40 | |
| *** ociuhandu has quit IRC | 20:41 | |
| *** jcoufal has quit IRC | 20:42 | |
| *** bhuvan has joined #openstack-infra | 20:43 | |
| *** bhuvan_ has joined #openstack-infra | 20:43 | |
| *** rossella_s has quit IRC | 20:44 | |
| mikal | fungi / jeblair: the plan is to move turbo hipster over to you, but it needs some unfinished nodepool work first. | 20:44 |
| mikal | I'm not sure in zuul how I append a message to the end of every vote? Do you have an example of that somewhere? | 20:44 |
| mikal | Happy to do it if I can figure out how | 20:45 |
| fungi | mikal: that may not (yet) be configurable. i'm looking | 20:46 |
| fungi | clarkb: something just sent the logstash job queue through the roof... | 20:46 |
| anteaya | clarkb: brocade wants to have 2 separate accounts | 20:47 |
| *** wchrisj has quit IRC | 20:47 | |
| *** bhuvan__ has joined #openstack-infra | 20:48 | |
| *** bhuvan___ has joined #openstack-infra | 20:48 | |
| *** markwash has quit IRC | 20:48 | |
| *** bhuvan_ has quit IRC | 20:49 | |
| *** bhuvan has quit IRC | 20:49 | |
| *** mkoderer has quit IRC | 20:51 | |
| sdague | clarkb: so logstash queue is getting to 25k now | 20:51 |
| *** sandywalsh has joined #openstack-infra | 20:51 | |
| *** vkozhukalov has quit IRC | 20:51 | |
| fungi | bigdesk says the cluster is green | 20:53 |
| fungi | and i don't see any missing logstash workers | 20:53 |
| *** bhuvan___ has quit IRC | 20:54 | |
| *** bhuvan__ has quit IRC | 20:54 | |
| *** rcarrillocruz has quit IRC | 20:54 | |
| *** rcarrillocruz has joined #openstack-infra | 20:54 | |
| fungi | clarkb: is it possible there's some lingering reference on the logstash workers to the old es cluster members i deleted? | 20:55 |
| *** markmcclain has joined #openstack-infra | 20:55 | |
| sdague | it started a near linear growth path a little before noon est | 20:55 |
| fungi | though this looks from the graph like it started before i deleted the dns entries and servers | 20:55 |
| fungi | maybe more like around the time you cleaned up the old indexes? | 20:56 |
| anteaya | would that be the curl change? | 20:56 |
| fungi | related | 20:57 |
| fungi | though really, this looks mostly like it started picking up shortly on the heels of an increase in zuul jobs launched | 20:57 |
| fungi | so it could just be that we're chewing through that | 20:58 |
| *** sweston has quit IRC | 20:58 | |
| *** rossella_s has joined #openstack-infra | 20:59 | |
| *** rcarrillocruz has quit IRC | 20:59 | |
| *** amotoki has joined #openstack-infra | 20:59 | |
| mikal | fungi: yeah, I think we haven't done it because I couldn't figure out how to with zuul | 21:00 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Auth support https://review.openstack.org/73219 | 21:01 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Auth controller https://review.openstack.org/68642 | 21:04 |
| *** sweston has joined #openstack-infra | 21:05 | |
| zaro | pleia2: commented on https://review.openstack.org/#/c/77683 | 21:07 |
| fungi | mikal: you may be looking for zuul.scheduler.BasePipelineManager.formatReport() | 21:08 |
| *** zns has quit IRC | 21:08 | |
| fungi | mikal: likely want to add a configurable option at the end of that method which can be used to append an optional footer message? | 21:08 |
| *** dkranz has joined #openstack-infra | 21:09 | |
| *** denis_makogon_ has joined #openstack-infra | 21:09 | |
| mikal | fungi: I suspect so. I will try and trick jhesketh into doing that I think. | 21:10 |
| mikal | I'm in a two hour teleconf this morning, so I don't think I'll get to it | 21:10 |
| *** denis_makogon_ is now known as denis_makogon | 21:11 | |
| fungi | mikal: whitewashing this fence sure is fun! | 21:11 |
| *** ArxCruz has quit IRC | 21:11 | |
| *** nicedice has joined #openstack-infra | 21:12 | |
| *** jaypipes has joined #openstack-infra | 21:12 | |
| *** rcarrillocruz has joined #openstack-infra | 21:13 | |
| *** ArxCruz has joined #openstack-infra | 21:15 | |
| *** sabari_ has quit IRC | 21:15 | |
| *** sabari has quit IRC | 21:15 | |
| *** sabari has joined #openstack-infra | 21:15 | |
| clarkb | anteaya: they just requiested a third too | 21:15 |
| *** sabari_ has joined #openstack-infra | 21:15 | |
| anteaya | clarkb: did they? | 21:16 |
| anteaya | do you have a link? | 21:16 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Decoupled API story and task creation. https://review.openstack.org/77668 | 21:16 |
| clarkb | anteaya: ya give me a minute | 21:17 |
| clarkb | fungi: sdague: I think we simply don't have enough worker nodes to keep up at this point | 21:17 |
| clarkb | fungi: sdague: now that we have everything else stable they are able to keep running but don't have enough cycles | 21:17 |
| fungi | clarkb: yeah, that seems like the most probable answer | 21:17 |
| jeblair | clarkb: logstash-worker nodes? | 21:17 |
| clarkb | jeblair: yeah | 21:18 |
| jeblair | clarkb: is logstash the bottleneck or the pusher (crm114?) | 21:18 |
| anteaya | k | 21:18 |
| sdague | this doesnt' seem like an incredibly heavy day, so that's concerning | 21:18 |
| clarkb | jeblair: I am not sure yet. I did have to bump the logstash heap size to 2gb to get them mostly stable | 21:18 |
| * clarkb just got back from lunch and am trying to catch up | 21:19 | |
| jeblair | clarkb: me too, i'm not exactly ahead of you | 21:19 |
| clarkb | anteaya: https://bugs.launchpad.net/bugs/1287348 | 21:19 |
| sdague | well, before I loose folks to diving in there - https://review.openstack.org/#/c/77679/ | 21:20 |
| sdague | that's the migrate tempest job add | 21:20 |
| *** markmc has quit IRC | 21:20 | |
| sdague | which I think we should land as soon as people are happy with it, so the migrate folks can work on building a functioning 0.8.6 | 21:20 |
| anteaya | clarkb: thanks, asking | 21:21 |
| *** e0ne has quit IRC | 21:21 | |
| jeblair | sdague: will we want to support multiple openstack branches? (eg, test sqla-m against stable/*) | 21:22 |
| *** oubiwan__ has joined #openstack-infra | 21:22 | |
| sdague | jeblair: eventually, sure | 21:23 |
| sdague | right now I'd like to see if we get anything working :) | 21:23 |
| *** zns has joined #openstack-infra | 21:23 | |
| jeblair | k, there's a half-in half-out thing in there, so i wanted to know whether to suggest to remove or add; will suggest add | 21:24 |
| clarkb | jeblair: fungi: I can try starting a third jenkins-log-worker on each logstash-worker host, but I think that will be getting into fun memory contrainment territory | 21:24 |
| clarkb | I guess I can go node by node and only turn it on if the memory use isn't terrible | 21:24 |
| jeblair | clarkb: are we at 2/per now? | 21:25 |
| clarkb | jeblair: yes | 21:25 |
| fungi | clarkb: seems worth a shot | 21:25 |
| anteaya | clarkb: my brocade contact will investigate the account request in the bug report and I have asked that the bug report be updated and then you or I are pinged | 21:25 |
| anteaya | shivharis is my contact | 21:25 |
| clarkb | anteaya: perfect, thanks | 21:25 |
| anteaya | np | 21:25 |
| *** Sukhdev has quit IRC | 21:25 | |
| anteaya | any other requests seem odd or you need more info, let me know | 21:25 |
| fungi | anteaya: cool. shivharis was also the one who requested that very first service account, so hopefully has some insight/history there | 21:25 |
| anteaya | fungi: yes, I to have the same hope | 21:26 |
| *** bhuvan has joined #openstack-infra | 21:26 | |
| *** bhuvan_ has joined #openstack-infra | 21:26 | |
| anteaya | too | 21:26 |
| dolphm | so, i'd like to create a feature branch from keystone's current master -- i assume i need to push directly to git.openstack.org? do i have permission to do that? | 21:26 |
| *** mrmartin has quit IRC | 21:27 | |
| jeblair | dolphm: have you used a feature branch with keystone before? | 21:27 |
| dolphm | jeblair: i don't believe so | 21:27 |
| dolphm | definitely not recently | 21:27 |
| *** dkranz has quit IRC | 21:27 | |
| morganfainberg | jeblair, we have v3 as a feature branch lingering around (we should clean that up?) | 21:28 |
| jeblair | morganfainberg: ah, yeah, if you're done with it we should | 21:28 |
| openstackgerrit | A change was merged to openstack-infra/storyboard-webclient: Fix API launch https://review.openstack.org/76467 | 21:28 |
| jeblair | dolphm: so read this strangely named section: https://wiki.openstack.org/wiki/GerritJenkinsGit#Merge_Commits | 21:28 |
| jeblair | dolphm: which basically covers how to keep feature branches in gerrit up to date with master (via proposing merge commits to gerrit) | 21:29 |
| dolphm | jeblair: thanks -- i definitely glossed over that section when googling for existing docs... | 21:29 |
| jeblair | dolphm: as well as how to finally merge the feature into master when you are done | 21:29 |
| jeblair | dolphm: basically it's just that, and i push a button in gerrit to actually make the branch | 21:30 |
| *** hashar has quit IRC | 21:30 | |
| *** Sukhdev has joined #openstack-infra | 21:30 | |
| dolphm | jeblair: ah, let's start with that then | 21:30 |
| jeblair | dolphm: if any other openstack projects need to evolve with this, if they have an identically named feature branch zuul will test them together | 21:31 |
| jeblair | dolphm: what should the name be? | 21:31 |
| dolphm | jeblair: i was running with "key-dist" | 21:31 |
| dolphm | jeblair: (key distribution service) | 21:32 |
| *** dizquierdo has joined #openstack-infra | 21:32 | |
| jeblair | morganfainberg, dolphm: it looks like feature/keystone-v3 tip is merged into master, so i'll just delete the branch. sound good? | 21:32 |
| dolphm | jeblair: yes! | 21:33 |
| jeblair | dolphm: done and done | 21:33 |
| *** bhuvan_ has quit IRC | 21:33 | |
| *** bhuvan has quit IRC | 21:33 | |
| jeblair | http://git.openstack.org/cgit/openstack/keystone/ | 21:33 |
| openstackgerrit | A change was merged to openstack-infra/config: Move git04.openstack.org to a new server https://review.openstack.org/76908 | 21:33 |
| clarkb | fungi: jeblair: I started C proceses on all nodes except 8,11, and 15. Those three looked quite constrained | 21:34 |
| dolphm | jeblair: perfect! i've got it tracked locally | 21:34 |
| *** julim has quit IRC | 21:35 | |
| clarkb | 12 extra processes should help us determine if the bottlneck is in those proceses or logstash | 21:35 |
| anteaya | clarkb: thanks for creating those accounts, so latest batch of accounts finished for now? | 21:36 |
| clarkb | anteaya: except for that brocade one in the bug above I think I got all of them | 21:36 |
| clarkb | I searched for service account and thirdparty in my mail | 21:37 |
| clarkb | there was another but they sent a second message cancelling it | 21:37 |
| anteaya | clarkb: awesome thank you | 21:37 |
| *** hashar has joined #openstack-infra | 21:38 | |
| anteaya | I feel so much better that they are non-voting by default | 21:38 |
| fungi | as soon as 76908 makes it to the haproxy server i'll enable git04 in the pool | 21:39 |
| fungi | also, we're about 20% done on the docs-draft rsync | 21:40 |
| *** fcarpenter has joined #openstack-infra | 21:40 | |
| *** melwitt has joined #openstack-infra | 21:40 | |
| *** Ryan_Lane has joined #openstack-infra | 21:41 | |
| clarkb | jeblair: is your add against https://review.openstack.org/#/c/77679/3 going to carry a -1? I wont approve it if so | 21:42 |
| jeblair | clarkb: i'm just going to push a new patchset | 21:42 |
| *** melwitt1 has joined #openstack-infra | 21:42 | |
| clarkb | jeblair: wfm | 21:42 |
| *** lcestari_ has joined #openstack-infra | 21:42 | |
| jeblair | because i have to type pretty much the same thing anyway | 21:42 |
| *** david-lyle has quit IRC | 21:43 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Add tempest full job to sqlalchemy-migrate https://review.openstack.org/77679 | 21:44 |
| *** aysyanne has quit IRC | 21:44 | |
| *** melwitt has quit IRC | 21:44 | |
| *** jhesketh_ has joined #openstack-infra | 21:45 | |
| jeblair | mriedem, sdague: ^ take a look at that | 21:45 |
| jhesketh_ | Morning | 21:45 |
| anteaya | morning jhesketh_ | 21:47 |
| anteaya | mikal: might let you watch him whitewash a fence | 21:47 |
| anteaya | if you are lucky | 21:47 |
| fungi | it's too fun to just watch. i bet mikal would even let him take over | 21:48 |
| anteaya | he might have to pay to actually take over | 21:48 |
| fungi | well, sure | 21:48 |
| anteaya | I had to give him an apple and my best fishing lure for my turn | 21:48 |
| mikal | Heh | 21:49 |
| mikal | jhesketh_: so... I have a plan! And I need to trick you into doing it. | 21:49 |
| jhesketh_ | uh oh | 21:49 |
| mikal | jhesketh_: we need to append to the end of the reports that zuul makes our contact details. So I think we need a new config file thingie, and a tweak to the reporter. | 21:50 |
| mikal | jhesketh_: Luckily, jeblair and fungi have promised to code review with extreme vigor your patch | 21:50 |
| anteaya | mikal: visited yoda lately you have? | 21:50 |
| fungi | the same extreme vigor with which we review all patches, i'm sure | 21:51 |
| jhesketh_ | that's sensible | 21:51 |
| *** fcarpenter has left #openstack-infra | 21:51 | |
| jhesketh_ | anteaya: I'm guessing this is related to the CI requirements I've seen go past | 21:51 |
| mikal | fungi: well, everytime someone complains, I'm just pointing at you... | 21:52 |
| jhesketh_ | has there been any suggestion of format? | 21:52 |
| anteaya | I think this is related to the long term view of jenkinless infra | 21:52 |
| mikal | jhesketh_: Just a strign I think | 21:52 |
| *** dkranz has joined #openstack-infra | 21:52 | |
| anteaya | when zuul rules the world with trusty turbo-hipster at it's side | 21:52 |
| *** rlandy has quit IRC | 21:53 | |
| anteaya | mikal: if this a response to a complaint then I missed the complaint | 21:53 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Decoupled API story and task creation. https://review.openstack.org/77668 | 21:53 |
| jhesketh_ | mikal: Just a configurable string at the end of each report? | 21:53 |
| mikal | anteaya: fungi called me on turbo-hipser not having contact details in its comments, so I asked how to do that in zuul, and it turns out to not currently be possible. | 21:53 |
| mikal | jhesketh_: yep | 21:53 |
| anteaya | ah | 21:53 |
| *** CaptTofu has quit IRC | 21:54 | |
| anteaya | mostly I wanted in on the tom sawyer reference | 21:54 |
| anteaya | fungi's set up was too good to miss out on | 21:54 |
| openstackgerrit | Antoine Musso proposed a change to openstack-infra/zuul: dequeue abandoned changes https://review.openstack.org/65467 | 21:54 |
| anteaya | and now I know more than I did before | 21:55 |
| anteaya | thank you | 21:55 |
| fungi | anteaya: in this case it's more related to third-party ci being able to add boilerplate commentary besides what success-message and failure-message allow | 21:55 |
| anteaya | *nod | 21:55 |
| anteaya | and yes if we can get some good boilerplate rather than everyone mixing their own it will be easier to parse their offerings | 21:56 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Auth support https://review.openstack.org/73219 | 21:56 |
| *** mfer has quit IRC | 21:56 | |
| *** mbacchi has quit IRC | 21:56 | |
| fungi | mikal: jhesketh_: though before you spend too mych time on it, first make doubly-sure that you can't already accomplish what you need with the pipeline level failure-message and success-message options | 21:57 |
| fungi | that appears before the detailed result report rather than after, which is the main difference from what you were discussing i think | 21:58 |
| mikal | Yeah, I think this needs to be after | 21:59 |
| mikal | So its more obvious | 21:59 |
| fungi | i can still see some potential benefit to a system wide or pipeline wide report-footer option | 21:59 |
| fungi | which is irrespective of the actual test result, so less duplication needed too | 21:59 |
| *** bhuvan has joined #openstack-infra | 22:00 | |
| *** bhuvan_ has joined #openstack-infra | 22:00 | |
| fungi | or perhaps a configurable report-format wrapper which would then let you tackle header and footer in one shot | 22:00 |
| clarkb | sdague: mriedem I have approved the sqlalchemy migrate test change | 22:00 |
| jhesketh_ | is it over complicating the matter to make the success/failure messages formattable | 22:01 |
| jhesketh_ | fungi: yeah, that's what I was thinking | 22:01 |
| clarkb | sdague: mriedem please do give that a spin in about half an hour | 22:01 |
| *** dkranz has quit IRC | 22:01 | |
| mriedem | clarkb: ok, i can just recheck no bug right? | 22:01 |
| jhesketh_ | so something like: "Success! See {results}, or contact us..." | 22:01 |
| mriedem | btw, thanks clarkb and jeblair | 22:01 |
| clarkb | mriedem: yup recheck no bug once we let that percolate into zuul and jenkins | 22:02 |
| clarkb | half an hour should be pletny of time | 22:02 |
| *** dripton has quit IRC | 22:02 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add tempest full job to sqlalchemy-migrate https://review.openstack.org/77679 | 22:02 |
| openstackgerrit | Antoine Musso proposed a change to openstack-infra/zuul: dequeue abandoned changes https://review.openstack.org/65467 | 22:02 |
| *** dripton has joined #openstack-infra | 22:03 | |
| openstackgerrit | Logan Paschke proposed a change to openstack-infra/config: Create gerrit-powered-agenda Stackforge Repo https://review.openstack.org/76270 | 22:04 |
| *** bhuvan_ has quit IRC | 22:05 | |
| *** bhuvan has quit IRC | 22:05 | |
| *** harlowja is now known as harlowja_away | 22:05 | |
| *** harlowja_away is now known as harlowja | 22:05 | |
| clarkb | zaro: can you address pleia2's comments in the alternatives update change for rhel/fedora? Would like to see that get fixed today | 22:05 |
| *** pdmars has quit IRC | 22:06 | |
| *** jamielennox is now known as jamielennox|away | 22:07 | |
| zaro | pleia2: still -1 on https://review.openstack.org/#/c/77683 ? | 22:08 |
| *** gokrokve has joined #openstack-infra | 22:08 | |
| pleia2 | zaro: yeah, I commented on the wrong line (my issue was on Fedora, not centos) | 22:09 |
| fungi | clarkb: as i suspected, when puppet makes haproxy reload its config, pool members previously in maint status end up enabled again | 22:10 |
| *** smarcet has left #openstack-infra | 22:11 | |
| zaro | pleia2: so unless is only checking the setting for java, not javac. can we have multiple unless checks? | 22:11 |
| *** _sweston_ has joined #openstack-infra | 22:11 | |
| clarkb | fungi: yeah, I think if puppet did a reload instead it would be fine | 22:11 |
| pleia2 | zaro: the grep as it stands right now will never match | 22:12 |
| clarkb | fungi: let me see if there is a newer version of that module that does reload instead of restart. I know mgagne looked at it once upon a time | 22:12 |
| mgagne | clarkb: I didn't find anything yet, "bug" is still in our own backlog too. | 22:12 |
| fungi | clarkb: though in this case i planned for it, so it was fine... just saved me a step | 22:12 |
| *** jcoufal has joined #openstack-infra | 22:12 | |
| pleia2 | since "/usr/lib/jvm/jre" doesn't exist, it's all subdirs of /java | 22:12 |
| clarkb | mgagne: fungi: ya doesn't look like there has been a new release. /me looks at commits and change log | 22:13 |
| *** hogepodge has quit IRC | 22:13 | |
| zaro | pleia2: ohh i see. | 22:13 |
| clarkb | pleia2: zaro: I think you can grep for 1.7.0-openjdk in all of he grep | 22:13 |
| clarkb | if you want ot be consistent | 22:13 |
| *** mgagne has left #openstack-infra | 22:13 | |
| *** mgagne has joined #openstack-infra | 22:13 | |
| pleia2 | clarkb: yeah | 22:13 |
| mgagne | oops | 22:13 |
| mgagne | clarkb: https://tickets.puppetlabs.com/browse/PUP-1054 | 22:14 |
| *** markwash has joined #openstack-infra | 22:14 | |
| clarkb | mgagne: thanks | 22:14 |
| *** sweston has quit IRC | 22:14 | |
| mgagne | clarkb: puppet doesn't know the diff between reload/restart. Some configs might require a restart and others not. Until it's fixed, vanilla service resource won't support it. You could create a custom exec and notify it instead. | 22:15 |
| *** dprince has joined #openstack-infra | 22:15 | |
| clarkb | mgagne: fungi: it does look like we can rewrite things on our end to have puppetlabs-haproxy not manage the service then do a service enable on our side without notifications and do reloads by hand | 22:15 |
| clarkb | mgagne: ya :( | 22:15 |
| mgagne | clarkb: that's what I would do if I had to do it =) | 22:16 |
| *** thomasem has quit IRC | 22:18 | |
| *** jcooley_ has quit IRC | 22:19 | |
| *** markmc has joined #openstack-infra | 22:21 | |
| sdague | clarkb: thank you | 22:21 |
| *** _sweston_ has quit IRC | 22:22 | |
| *** zns has quit IRC | 22:23 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Fix update java alternatives on redhat systems https://review.openstack.org/77683 | 22:23 |
| zaro | clarkb, pleia2 : hopefully ready now ^ | 22:24 |
| * clarkb is looking | 22:24 | |
| pleia2 | zaro: thanks, lgtm | 22:25 |
| clarkb | zaro: pleia2: do you guys know if the fedora command will need to change for every fedora release or javaupdate? | 22:26 |
| clarkb | zaro: pleia2: is there any way to make that not the case? | 22:26 |
| fungi | traffic levels are picking up nicely on the new git04, so i'll start in on git03 after a quick dinner | 22:27 |
| pleia2 | clarkb: it will change :( I don't know how to prevent that | 22:27 |
| fungi | let me know if there's any sign of gate-related git access issues with git.openstack.org | 22:27 |
| zaro | clarkb: we can probably query for the reference before setting | 22:28 |
| pleia2 | clarkb: not sure how often | 22:28 |
| clarkb | :( I find it weird that the centos/rhel install location is sane but not fedoras | 22:28 |
| zaro | alternatives --config to find the path before setting the path. | 22:28 |
| clarkb | it doesn't set a symlink or anything like that we can rely on? | 22:29 |
| pleia2 | the trouble with symlinks is they aren't registered with alternatives | 22:29 |
| *** flaper87 is now known as flaper87|afk | 22:30 | |
| pleia2 | http://paste.openstack.org/show/71920/ | 22:30 |
| pleia2 | not helpful | 22:30 |
| clarkb | actually in this case do we need to update alternatives at all? | 22:31 |
| clarkb | since fedora > 18 or so probably doesnt' even have java6 pacakges | 22:31 |
| pleia2 | maybe not! if we don't need java6 in redhat slaves | 22:32 |
| clarkb | pleia2: in the case of precise we get java6 via ant despite all attempts at avoiding it | 22:32 |
| clarkb | zaro: pleia2 I think we should maybe ignore it on fedora | 22:33 |
| clarkb | since fedora should be in the future already | 22:33 |
| *** bhuvan has joined #openstack-infra | 22:33 | |
| *** bhuvan_ has joined #openstack-infra | 22:34 | |
| *** jnoller has quit IRC | 22:34 | |
| pleia2 | clarkb: in progress of getting fedora to work in nodepool so we can't entirely ignore it, we have to return something | 22:35 |
| *** dangers is now known as dangers_away | 22:35 | |
| clarkb | pleia2: we can remove the exec completely I think | 22:35 |
| pleia2 | clarkb: then line 85 fails and everything dies (the problem we're trying to solve here) | 22:36 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: add tests for gerrit builds https://review.openstack.org/77715 | 22:36 |
| pleia2 | and we don't want it to run the generic redhat exec for it, because that won't work | 22:37 |
| clarkb | oh right, so we need an exec resource but on fedora it can just say unless => 'true' | 22:37 |
| pleia2 | yeah | 22:37 |
| pleia2 | let's do that :) | 22:37 |
| zaro | clarkb, pleia2 : it depends on order that the packages get installed. | 22:37 |
| clarkb | that should come with a comment though because it will confuse me in 6 months | 22:37 |
| clarkb | zaro: but only on precise | 22:38 |
| zaro | on centos as well. | 22:38 |
| pleia2 | well, centos too, since centos has both | 22:38 |
| zaro | i have verified that. | 22:38 |
| pleia2 | pulls 7 from epel | 22:38 |
| dhellmann | sdague: an interesting gate issue to think about: https://bugs.launchpad.net/nova/+bug/1282250 | 22:38 |
| zaro | have not verified on fedora though. | 22:38 |
| pleia2 | fedora just has 7, no 6 | 22:38 |
| clarkb | zaro: pleia2: right but centos doesn't have the fedora problem | 22:38 |
| *** lcestari_ has quit IRC | 22:38 | |
| *** bhuvan_ has quit IRC | 22:38 | |
| *** bhuvan has quit IRC | 22:38 | |
| clarkb | so fedora can be special here | 22:38 |
| pleia2 | yeah, centos is sane | 22:39 |
| zaro | so noop on fedora? | 22:40 |
| *** zns has joined #openstack-infra | 22:40 | |
| sdague | dhellmann: yeh, site-packages remains kind of an issue | 22:40 |
| clarkb | zaro: ya I think that is best | 22:40 |
| clarkb | zaro: please add a comment too describing why it is a noop | 22:40 |
| clarkb | sdague: assuming zul's cloud archive libvirt works we can kill site packages | 22:41 |
| clarkb | Iguess that assumes the rest of cloud archive works too | 22:41 |
| sdague | do we have data there? | 22:41 |
| dhellmann | sdague: well, I think the real issue is that trunk oslo.config doesn't work | 22:41 |
| clarkb | sdague: not yet, I don't think the new package is available. But once it is dims can kick his change that tests cloud archive | 22:41 |
| dhellmann | sdague: I'm trying to decide if there's a way to expose that sort of problem without cutting new releases way more frequently | 22:41 |
| clarkb | sdague: with that we can install python-libvirt via pypi and remove nova's site packages | 22:42 |
| dhellmann | sdague: maybe the same sort of cross-testing that we're doing with oslotest, for example | 22:42 |
| sdague | dhellmann: so why doesn't this show up in an actual devstack run? | 22:42 |
| sdague | we never use that functionality? | 22:42 |
| sdague | because there, we're using master | 22:42 |
| dhellmann | sdague: great question | 22:43 |
| dhellmann | sdague: apparently that particular feature of oslo.config isn't being used in the devstack runs | 22:43 |
| sdague | so is this feature something that would be expected to be used in a real environment, and devstack isn't doing that | 22:44 |
| sdague | or is it something which only gets used in unit tests | 22:44 |
| dhellmann | sdague: the feature is value substitution within the config overrides and defaults | 22:45 |
| *** mriedem has quit IRC | 22:46 | |
| *** jlibosva has quit IRC | 22:46 | |
| dhellmann | I'm looking at the tests now to see where it is being used | 22:46 |
| *** pmoosh_ has joined #openstack-infra | 22:47 | |
| *** jamielennox|away is now known as jamielennox | 22:47 | |
| *** denis_makogon has quit IRC | 22:47 | |
| *** banix has quit IRC | 22:48 | |
| dhellmann | sdague: it looks like the '$state_path' value is used in some of nova's config default | 22:49 |
| *** jeckersb is now known as jeckersb_gone | 22:49 | |
| *** jcooley_ has joined #openstack-infra | 22:51 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Fix update java alternatives on redhat systems https://review.openstack.org/77683 | 22:51 |
| sdague | dhellmann: it's in one vendor variable as far as I can see | 22:52 |
| *** thuc has quit IRC | 22:52 | |
| sdague | and that's it | 22:52 |
| *** dims_ has quit IRC | 22:52 | |
| *** thuc has joined #openstack-infra | 22:52 | |
| openstackgerrit | Cyril Roelandt proposed a change to openstack-dev/hacking: Make hacking Python 3 compatible https://review.openstack.org/77585 | 22:52 |
| *** thuc has quit IRC | 22:53 | |
| *** jcooley_ has quit IRC | 22:53 | |
| *** thuc has joined #openstack-infra | 22:53 | |
| dhellmann | sdague: I ran "ack state_path nova" and got a lot more hits, some of them calling state_path_def() which builds a path relative to '$state_path' without expanding it | 22:53 |
| dhellmann | sdague, including 2 hits in nova/virt/libvirt/volume.py one in nova/compute/manager.py, etc. | 22:54 |
| *** sparkycollier has quit IRC | 22:56 | |
| *** thuc has quit IRC | 22:57 | |
| *** nati_uen_ has joined #openstack-infra | 22:58 | |
| morganfainberg | hey, uhm i have a (possibly) touchy question about approval of patches based upon new zuul functionality. -- specifically about, an early +A since it looks like check queue needs to pass before it hits gate now. or is it still preferred to just wait for check to complete? | 23:00 |
| *** markmcclain has quit IRC | 23:00 | |
| *** nati_ueno has quit IRC | 23:00 | |
| morganfainberg | clarkb, fungi, jeblair, ^ | 23:00 |
| *** pmoosh_ has quit IRC | 23:00 | |
| *** jcooley_ has joined #openstack-infra | 23:00 | |
| *** dcramer__ has quit IRC | 23:00 | |
| fungi | morganfainberg: well, if you do +a before check returns a result, just be aware that you may not notice it failed | 23:01 |
| morganfainberg | fungi, sure. | 23:01 |
| clarkb | zaro: reviewed the change, close but we need to keep the exec on fedora we just need it to do nothing | 23:01 |
| morganfainberg | fungi, and that is a completely fair point. so might need to circle back and really keep an eye on it. | 23:01 |
| jeblair | morganfainberg: i think since it won't end up in gate anyway without a passing check, it should be okay to +a it... actually safer now than before | 23:01 |
| fungi | but the "ensure a recent positive check result" behavior change was mostly to guard against core reviewers approving changes with old (or no!) check results | 23:01 |
| clarkb | I agree with jeblair | 23:02 |
| *** mwagner_lap has joined #openstack-infra | 23:02 | |
| morganfainberg | fungi, jeblair , the general thought is something needed a trivial rebase(ish) and we know it'll pass but if it can start gating (say middle of the night) awesome | 23:02 |
| *** Ryan_Lane has quit IRC | 23:02 | |
| *** jergerber has quit IRC | 23:02 | |
| morganfainberg | fungi, jeblair, clarkb, not that i want to +a all the things :) | 23:02 |
| *** dizquierdo has quit IRC | 23:03 | |
| jeblair | morganfainberg: probably the main downside is not seeing the non-voting jobs (or third-party jobs) | 23:03 |
| sdague | morganfainberg: so basically, it's save now. but I didn't spread that around until we made sure things were bullet proof | 23:03 |
| jeblair | morganfainberg: that sounds very reasonable. :) | 23:03 |
| morganfainberg | sdague, ++ | 23:03 |
| morganfainberg | jeblair, cool | 23:03 |
| morganfainberg | jeblair, thanks guys :) | 23:03 |
| fungi | morganfainberg: yes, seems like a benefit to me. work smarter not harder | 23:03 |
| morganfainberg | fungi :) awesome | 23:04 |
| morganfainberg | that was my feeling but i didn't want to do it if there was a good reason not to. | 23:04 |
| *** bhuvan has joined #openstack-infra | 23:04 | |
| *** bhuvan_ has joined #openstack-infra | 23:04 | |
| fungi | the lack of noticing 3rd-party failure reports is a fair point | 23:05 |
| *** miqui has quit IRC | 23:05 | |
| *** julim has joined #openstack-infra | 23:07 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Fix update java alternatives on redhat systems https://review.openstack.org/77683 | 23:07 |
| jeblair | i sent the oftc email to openstack-dev | 23:07 |
| *** dims_ has joined #openstack-infra | 23:08 | |
| clarkb | fungi: https://review.openstack.org/#/c/71743/1 I think you have restarted gerrit a couple times to address similar failures. is that issue familiar to you? I don't see a problem with the regex yet. Still tring to understand what that [^\"] is meant to match | 23:08 |
| clarkb | oh its teh closing quote | 23:08 |
| zaro | clarkb, pleia2 : ok. i think it's good now. | 23:09 |
| StevenK | jeblair: I don't know if I can take another thread like that, debian-project and others are still getting smashed due to the whole systemd train wreck | 23:09 |
| *** wchrisj has joined #openstack-infra | 23:09 | |
| clarkb | StevenK: just ignore it then :P | 23:09 |
| clarkb | StevenK: presumably you are on both servers because debian | 23:09 |
| pleia2 | zaro: thanks, testing | 23:09 |
| *** CaptTofu has joined #openstack-infra | 23:09 | |
| jeblair | StevenK: democracy is messy :) | 23:10 |
| fungi | clarkb: it's the + vs * (the former is insisting on gobbling the final non-quote character regardless of whether it's part of the bug number digit series) | 23:10 |
| clarkb | fungi: oh gotcha. if ther eisn't anything after the url which there won't be it will greedy match the last character as part of the + | 23:11 |
| clarkb | fungi: I am going to approve that patch now and we can deal with gerrit restart post feature freeze | 23:11 |
| StevenK | clarkb: I no longer frequent the Debian channels, and haven't for a *long* time, but I'm currently connected to OFTC -- I don't think I'm on any OFTC channels, though | 23:11 |
| fungi | clarkb: sounds good | 23:12 |
| fungi | StevenK: feel free to lurk in #openstack-infra there too! ;) | 23:12 |
| *** bhuvan_ has quit IRC | 23:12 | |
| *** bhuvan has quit IRC | 23:13 | |
| StevenK | jeblair: May I suggest fix eavesdrop before the cutover to log both? | 23:14 |
| pleia2 | zaro: so exec isn't happy without a command => | 23:14 |
| jeblair | StevenK: i was thinking it would be better to have eavesdrop follow the strict cutover time to reduce confusion, but have the cutover time during a quiet period (over a wknd) | 23:14 |
| *** thedodd has quit IRC | 23:15 | |
| StevenK | jeblair: Seperate log files for a few days before, to catch ramp up? | 23:15 |
| StevenK | #openstack-infra-oftc.log for a few days, and then drop the suffix? | 23:15 |
| jeblair | StevenK: basically, anything we can do to strictly indicate that one network or the other is the active one would be preferable so we try to do it without splitting the community | 23:16 |
| pleia2 | clarkb: could use your eyes on https://review.openstack.org/77683 again | 23:18 |
| clarkb | pleia2: good catch since puppet won't run the exec in a shell we need to set a path for true | 23:18 |
| clarkb | zaro: ^ | 23:18 |
| *** david-lyle has joined #openstack-infra | 23:19 | |
| *** Ryan_Lane has joined #openstack-infra | 23:20 | |
| *** jgrimm has quit IRC | 23:24 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Fix update java alternatives on redhat systems https://review.openstack.org/77683 | 23:26 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/devstack-gate: fix incorrect use of local https://review.openstack.org/77726 | 23:28 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/devstack-gate: add some helpfulness to our log output https://review.openstack.org/76349 | 23:28 |
| sdague | umm... so 77726 needs some eyes on kind of soon | 23:28 |
| jeblair | sdague: why? | 23:29 |
| sdague | because apparently all pre_test_hook and post_test_hook jobs are broken at the moment | 23:29 |
| jeblair | oh | 23:29 |
| sdague | which I only discovered when we tried to use that in migrate | 23:29 |
| sdague | http://logs.openstack.org/96/77396/3/check/check-sqlalchemy-migrate-devstack-dsvm/5182d87/console.html | 23:29 |
| zaro | pleia2: i believe you, looks like their docs needs to be updated because it says command defaults to title. | 23:29 |
| clarkb | zaro: pleia2: you can also set command to true for completeness | 23:29 |
| sdague | http://logs.openstack.org/96/77396/3/check/check-sqlalchemy-migrate-devstack-dsvm/5182d87/console.html#_2014-03-03_23_11_35_373 | 23:29 |
| clarkb | zaro: pleia2: maybe we should do that too just because? | 23:29 |
| jeblair | sdague: we should add a devstack-gate check job for that; maybe just does some 'echo "ok"' kind of thing in the hooks | 23:29 |
| pleia2 | clarkb: we've come this far :) | 23:30 |
| sdague | yeh, probably | 23:30 |
| *** Sukhdev has quit IRC | 23:30 | |
| *** hashar has quit IRC | 23:30 | |
| *** homeless has quit IRC | 23:31 | |
| zaro | just set command to 'true'? | 23:32 |
| pleia2 | zaro: test, yeah | 23:32 |
| pleia2 | er, tested | 23:32 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Fix update java alternatives on redhat systems https://review.openstack.org/77683 | 23:33 |
| zaro | ok, all set ^^ | 23:33 |
| *** rcleere has quit IRC | 23:35 | |
| fungi | sdague: i'm inclined not to deem 77726 in need of gate promotion, unless we're using pre_test_hook post_test_hook in jobs i'm unaware of which impact projects for official programs | 23:37 |
| *** mfink has quit IRC | 23:38 | |
| *** jcooley_ has quit IRC | 23:38 | |
| *** jcooley_ has joined #openstack-infra | 23:38 | |
| *** markwash has quit IRC | 23:39 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: add job for testing that hooks work https://review.openstack.org/77728 | 23:39 |
| sdague | fungi: it's not in need of promotion | 23:40 |
| *** ArxCruz_ has joined #openstack-infra | 23:40 | |
| sdague | it just needed to not wait a bunch of days for review | 23:40 |
| sdague | because solum, barbican, can't land code until it lands | 23:40 |
| *** prad_ has quit IRC | 23:40 | |
| sdague | though, I'm seriously confused no one complained | 23:41 |
| jeblair | fungi: do you recall why max-servers for ord is 92 instead of 192? | 23:41 |
| sdague | jeblair: https://review.openstack.org/77728 is an attempt at a test for this | 23:41 |
| jeblair | fungi: is our quota lower there? | 23:41 |
| fungi | jeblair: i do not... seeing if i can confirm. we may have only 100 quota in ord | 23:41 |
| sdague | and with that, my wife just got home, so it's a day here. See you all in the morning | 23:41 |
| jeblair | sdague: good night! thanks | 23:41 |
| openstackgerrit | A change was merged to openstack-infra/config: Fix launchpadbug comment linking in Gerrit https://review.openstack.org/71743 | 23:41 |
| *** jcooley_ has quit IRC | 23:43 | |
| * clarkb reviewd that d-g change too | 23:43 | |
| *** jcooley_ has joined #openstack-infra | 23:43 | |
| clarkb | it has been approved though | 23:43 |
| *** ArxCruz has quit IRC | 23:44 | |
| fungi | jeblair: yeah, maxTotalInstances | 100 | 23:44 |
| *** jcooley_ has quit IRC | 23:45 | |
| *** mfink has joined #openstack-infra | 23:45 | |
| jeblair | fungi: k thx. | 23:45 |
| jeblair | fungi, clarkb: btw, i'm on an email thread with someone at rax about the 5000/day limit | 23:46 |
| *** dims_ has quit IRC | 23:46 | |
| jeblair | wants to know what would be a good value to have that should take care of us for the next 4 months or so | 23:46 |
| jeblair | i think if we ran 20 minute jobs continuously and maxed out our rax quota, that would be ~35k servers/day | 23:47 |
| clarkb | jeblair: fungi pleia2 https://review.openstack.org/#/c/77683/ would be good to get eyes on that last revision | 23:47 |
| fungi | jeblair: double-checked iad and dfw and they definitely correctly report 192, while ord says 100 | 23:47 |
| clarkb | jeblair: wow | 23:47 |
| jeblair | so that's probably an upper limit for what we could possibly use at our current quota | 23:47 |
| *** jhesketh__ has joined #openstack-infra | 23:48 | |
| *** andreaf has joined #openstack-infra | 23:48 | |
| openstackgerrit | Antoine Musso proposed a change to openstack-infra/config: Doc: oslo.sphinx -> oslosphinx https://review.openstack.org/77731 | 23:49 |
| *** hogepodge has joined #openstack-infra | 23:49 | |
| *** jhesketh__ has quit IRC | 23:49 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Run PyPy jobs on py3k-precise single-use slaves https://review.openstack.org/77732 | 23:49 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Remove precisepy3k static slaves https://review.openstack.org/77733 | 23:49 |
| *** jhesketh__ has joined #openstack-infra | 23:50 | |
| openstackgerrit | Antoine Musso proposed a change to openstack-infra/zuul: Use OpenStack sphinx theme https://review.openstack.org/77735 | 23:50 |
| *** jcooley_ has joined #openstack-infra | 23:51 | |
| *** bhuvan has joined #openstack-infra | 23:51 | |
| *** bhuvan_ has joined #openstack-infra | 23:51 | |
| *** UtahDave has quit IRC | 23:53 | |
| *** SumitNaiksatam has quit IRC | 23:53 | |
| *** pmathews has quit IRC | 23:55 | |
| *** UtahDave has joined #openstack-infra | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!