| patrickeast | oda-g_: i’ve been searching around and so far havn’t found anything useful | 00:00 |
|---|---|---|
| *** mmaglana has quit IRC | 00:00 | |
| *** zns has joined #openstack-infra | 00:00 | |
| *** mmaglana has joined #openstack-infra | 00:01 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Launchpad Import now imports multi-project bugs. https://review.openstack.org/134084 | 00:01 |
| *** shakamunyi has quit IRC | 00:01 | |
| *** shakamunyi has joined #openstack-infra | 00:03 | |
| *** dannywilson has quit IRC | 00:03 | |
| *** baoli has quit IRC | 00:03 | |
| *** david-lyle_afk is now known as david-lyle | 00:10 | |
| *** SumitNaiksatam has quit IRC | 00:14 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/devstack-gate: Remove nosetest*.xml copy https://review.openstack.org/134086 | 00:16 |
| *** Viswanath has joined #openstack-infra | 00:17 | |
| *** SumitNaiksatam has joined #openstack-infra | 00:18 | |
| *** Viswanath has quit IRC | 00:20 | |
| *** zns has quit IRC | 00:21 | |
| *** amitgandhinz has joined #openstack-infra | 00:22 | |
| *** dannywilson has joined #openstack-infra | 00:24 | |
| *** rainya has quit IRC | 00:25 | |
| *** amitgandhinz has quit IRC | 00:26 | |
| *** rainya has joined #openstack-infra | 00:27 | |
| *** reed has quit IRC | 00:31 | |
| *** zz_dimtruck is now known as dimtruck | 00:31 | |
| dims_ | fungi: gerritbot still holding up? | 00:32 |
| *** armax has joined #openstack-infra | 00:35 | |
| *** armax has quit IRC | 00:35 | |
| *** rlandy has quit IRC | 00:36 | |
| *** dmsimard_away is now known as dmsimard | 00:40 | |
| *** signed8b_ has quit IRC | 00:43 | |
| *** yamahata has joined #openstack-infra | 00:47 | |
| *** gokrokve has quit IRC | 00:49 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: doc change: remove duplicate general job parameters https://review.openstack.org/132079 | 00:51 |
| *** achanda has quit IRC | 00:53 | |
| *** adalbas has quit IRC | 00:53 | |
| *** mmaglana has quit IRC | 00:54 | |
| *** wenlock has quit IRC | 00:57 | |
| *** achanda has joined #openstack-infra | 01:00 | |
| *** mmaglana has joined #openstack-infra | 01:02 | |
| *** otherwiseguy has joined #openstack-infra | 01:03 | |
| *** amcrn has quit IRC | 01:04 | |
| *** SumitNaiksatam has quit IRC | 01:05 | |
| *** dims_ has quit IRC | 01:05 | |
| *** dims has joined #openstack-infra | 01:06 | |
| patrickeast | oda-g_: i think i might have found something related, https://github.com/openstack-dev/devstack/commit/8f8e2d1fbfa4c51f6b68a6967e330cd478f979ee went in about the time my CI started to fail and comparing my logs, EMC’s logs, and offical jenkins ci logs the ones that are failing all have use_library_from_git keystoneclient which do seem to be very much related to the error our CI’s are showing | 01:11 |
| patrickeast | and use_library_from_git openstackclient | 01:11 |
| *** otherwiseguy has quit IRC | 01:14 | |
| *** shakamunyi has quit IRC | 01:14 | |
| *** mmaglana has quit IRC | 01:16 | |
| arosen1 | ianw: does this trace familar? http://paste.openstack.org/show/132581/ | 01:16 |
| *** dannywilson has quit IRC | 01:16 | |
| *** otherwiseguy has joined #openstack-infra | 01:16 | |
| openstackgerrit | Aaron Rosen proposed openstack-infra/nodepool: libffi-dev/libssl-dev/qemu-utils/python-yaml are required https://review.openstack.org/125515 | 01:17 |
| *** dmsimard is now known as dmsimard_away | 01:20 | |
| openstackgerrit | Merged openstack/requirements: suds-jurko - Alternative to suds library for py 3.x support https://review.openstack.org/127864 | 01:22 |
| *** gyee has quit IRC | 01:25 | |
| *** gokrokve has joined #openstack-infra | 01:28 | |
| *** armax has joined #openstack-infra | 01:29 | |
| *** armax has quit IRC | 01:31 | |
| *** armax has joined #openstack-infra | 01:31 | |
| *** teran has quit IRC | 01:35 | |
| *** yamamoto_ has quit IRC | 01:35 | |
| *** groknix has quit IRC | 01:35 | |
| fungi | dims: so far so good! | 01:35 |
| * dims cross my fingers | 01:36 | |
| fungi | dims: when i wake up tomorrow i'll dig in its logs looking for evidence of a successful reconnect | 01:36 |
| fungi | since it's been dying roughly daily for some time now | 01:36 |
| dims | sounds good | 01:36 |
| *** bdpayne has quit IRC | 01:47 | |
| *** bhuvan has quit IRC | 01:51 | |
| *** ChuckC has quit IRC | 01:53 | |
| ianw | arosen1: no, sorry, haven't seen that before | 01:53 |
| *** gokrokve has quit IRC | 01:56 | |
| *** gokrokve has joined #openstack-infra | 01:56 | |
| *** gokrokve has quit IRC | 02:01 | |
| oda-g_ | patrickeast: maybe you are right. CI begins to use pip-install instead of git clone. maybe our CI need to fix pip.conf to use a right site (it is mestery for me). | 02:02 |
| *** yamamoto_ has joined #openstack-infra | 02:04 | |
| *** ayoung has quit IRC | 02:04 | |
| *** ChuckC has joined #openstack-infra | 02:04 | |
| *** Daisy has joined #openstack-infra | 02:05 | |
| *** ayoung has joined #openstack-infra | 02:05 | |
| *** nosnos has joined #openstack-infra | 02:06 | |
| *** mberlin1 has quit IRC | 02:07 | |
| *** david-lyle is now known as david-lyle_afk | 02:08 | |
| *** shashankhegde has quit IRC | 02:12 | |
| *** jerryz has joined #openstack-infra | 02:13 | |
| *** rfolco has joined #openstack-infra | 02:15 | |
| *** otherwiseguy has quit IRC | 02:15 | |
| *** asselin_ has joined #openstack-infra | 02:16 | |
| *** achanda has quit IRC | 02:17 | |
| *** asselin__ has joined #openstack-infra | 02:18 | |
| *** asselin__ has quit IRC | 02:19 | |
| *** asselin_ has quit IRC | 02:22 | |
| *** rfolco has quit IRC | 02:27 | |
| *** otherwiseguy has joined #openstack-infra | 02:28 | |
| *** tswanson_ has joined #openstack-infra | 02:32 | |
| *** AlexF has joined #openstack-infra | 02:33 | |
| *** Ryan_Lane has quit IRC | 02:33 | |
| *** katyafervent_ has joined #openstack-infra | 02:33 | |
| *** jerryz has quit IRC | 02:36 | |
| *** Swanson has quit IRC | 02:36 | |
| *** katyafervent has quit IRC | 02:36 | |
| *** doug-fish has joined #openstack-infra | 02:42 | |
| *** yamahata has quit IRC | 02:47 | |
| *** yamahata has joined #openstack-infra | 02:48 | |
| *** dims has quit IRC | 02:49 | |
| *** dims has joined #openstack-infra | 02:50 | |
| *** dimtruck is now known as zz_dimtruck | 02:54 | |
| *** koolhead17 has joined #openstack-infra | 02:54 | |
| *** koolhead17 has joined #openstack-infra | 02:54 | |
| *** jerryz has joined #openstack-infra | 02:55 | |
| *** patrickeast has quit IRC | 02:56 | |
| *** salv-orlando has quit IRC | 02:56 | |
| *** arosen has joined #openstack-infra | 02:58 | |
| arosen | Hi, does anyone know how the key injection into the instance when you're using dib? | 02:58 |
| *** zns has joined #openstack-infra | 03:03 | |
| *** sdake has quit IRC | 03:06 | |
| *** melwitt has quit IRC | 03:07 | |
| *** jyuso838 has joined #openstack-infra | 03:07 | |
| *** erikmwilson has quit IRC | 03:07 | |
| kevinbenton | fungi: ping | 03:15 |
| *** Longgeek has joined #openstack-infra | 03:19 | |
| *** arosen has quit IRC | 03:19 | |
| *** ivar-laz_ has joined #openstack-infra | 03:20 | |
| *** ivar-lazzaro has quit IRC | 03:23 | |
| *** ivar-laz_ has quit IRC | 03:24 | |
| *** nosnos has quit IRC | 03:25 | |
| *** Longgeek has quit IRC | 03:26 | |
| *** SumitNaiksatam has joined #openstack-infra | 03:26 | |
| *** asettle has quit IRC | 03:29 | |
| *** SumitNaiksatam has quit IRC | 03:34 | |
| *** Ryan_Lane has joined #openstack-infra | 03:35 | |
| *** Ryan_Lane has joined #openstack-infra | 03:35 | |
| *** mmaglana has joined #openstack-infra | 03:36 | |
| *** arosen has joined #openstack-infra | 03:39 | |
| *** katyafervent_ is now known as katyafervent_awa | 03:50 | |
| *** otter768 has joined #openstack-infra | 03:53 | |
| *** marun has joined #openstack-infra | 03:55 | |
| *** yaguang has joined #openstack-infra | 03:57 | |
| bhunter71 | arosen: my understanding is most frequently cloud-init configuration is done outside of DIB. I think the common case is that the vendor's cloud images have cloud-init already reasonably configured, and DIB needn't do anything special. | 03:57 |
| *** nosnos has joined #openstack-infra | 03:57 | |
| *** AlexF has quit IRC | 03:58 | |
| *** funzo_ has joined #openstack-infra | 03:58 | |
| *** funzo has quit IRC | 03:59 | |
| *** dannywilson has joined #openstack-infra | 04:03 | |
| *** sabeen2 has quit IRC | 04:05 | |
| *** sabeen has joined #openstack-infra | 04:05 | |
| *** tchaypo has quit IRC | 04:05 | |
| *** j^2 has quit IRC | 04:05 | |
| *** ctracey has quit IRC | 04:05 | |
| *** Ng has quit IRC | 04:06 | |
| *** ctracey has joined #openstack-infra | 04:06 | |
| *** Ng has joined #openstack-infra | 04:06 | |
| *** j^2 has joined #openstack-infra | 04:06 | |
| *** tchaypo has joined #openstack-infra | 04:07 | |
| *** otter768 has quit IRC | 04:08 | |
| *** Adri2000_ has joined #openstack-infra | 04:08 | |
| *** sweston_ has joined #openstack-infra | 04:08 | |
| *** apmelton_ has joined #openstack-infra | 04:09 | |
| *** ameade_ has joined #openstack-infra | 04:09 | |
| *** slagle_ has joined #openstack-infra | 04:09 | |
| *** fabo_ has joined #openstack-infra | 04:10 | |
| *** shashankhegde has joined #openstack-infra | 04:10 | |
| *** simonmcc_ has joined #openstack-infra | 04:10 | |
| *** Ryan_Lane has quit IRC | 04:10 | |
| *** gus_ has joined #openstack-infra | 04:11 | |
| *** clarkb1 has joined #openstack-infra | 04:11 | |
| *** jd__` has joined #openstack-infra | 04:11 | |
| *** tristanC_ has joined #openstack-infra | 04:12 | |
| *** hamzy_ has joined #openstack-infra | 04:12 | |
| *** mordred_ has joined #openstack-infra | 04:12 | |
| *** darvon_ has joined #openstack-infra | 04:12 | |
| *** colettecello has joined #openstack-infra | 04:12 | |
| *** vipul has quit IRC | 04:12 | |
| *** JayF has quit IRC | 04:12 | |
| *** Adri2000 has quit IRC | 04:12 | |
| *** apmelton has quit IRC | 04:12 | |
| *** ameade has quit IRC | 04:12 | |
| *** simonmcc has quit IRC | 04:12 | |
| *** jbryce has quit IRC | 04:12 | |
| *** EmilienM has quit IRC | 04:12 | |
| *** vishy has quit IRC | 04:12 | |
| *** slagle has quit IRC | 04:12 | |
| *** sweston has quit IRC | 04:12 | |
| *** cyeoh has quit IRC | 04:12 | |
| *** marcusvrn_ has quit IRC | 04:12 | |
| *** Svedrin has quit IRC | 04:12 | |
| *** fabo has quit IRC | 04:12 | |
| *** redrobot has quit IRC | 04:12 | |
| *** rainya has quit IRC | 04:12 | |
| *** roaet- has quit IRC | 04:12 | |
| *** clarkb has quit IRC | 04:12 | |
| *** sileht has quit IRC | 04:12 | |
| *** zz_dimtruck has quit IRC | 04:12 | |
| *** gus has quit IRC | 04:12 | |
| *** camunoz has quit IRC | 04:12 | |
| *** mordred has quit IRC | 04:12 | |
| *** darvon has quit IRC | 04:12 | |
| *** hamzy has quit IRC | 04:12 | |
| *** rakhmerov has quit IRC | 04:12 | |
| *** tristanC has quit IRC | 04:12 | |
| *** jd__ has quit IRC | 04:12 | |
| *** gothicmindfood has quit IRC | 04:12 | |
| *** tsufiev has quit IRC | 04:12 | |
| *** vipul has joined #openstack-infra | 04:12 | |
| *** jd__` is now known as jd__ | 04:12 | |
| *** mordred_ is now known as mordred | 04:12 | |
| *** tsufiev has joined #openstack-infra | 04:12 | |
| *** ameade_ is now known as ameade | 04:12 | |
| *** bswartz has quit IRC | 04:12 | |
| *** sweston_ is now known as sweston | 04:13 | |
| *** chandankumar has joined #openstack-infra | 04:13 | |
| *** subscope has joined #openstack-infra | 04:13 | |
| *** marcusvrn has joined #openstack-infra | 04:13 | |
| *** simonmcc_ is now known as simonmcc | 04:14 | |
| *** redrobot has joined #openstack-infra | 04:14 | |
| *** bswartz has joined #openstack-infra | 04:14 | |
| *** zz_dimtruck has joined #openstack-infra | 04:14 | |
| *** redrobot is now known as Guest17627 | 04:14 | |
| *** darvon_ is now known as darvon | 04:14 | |
| *** roaet_ has joined #openstack-infra | 04:14 | |
| *** EmilienM has joined #openstack-infra | 04:14 | |
| *** rakhmerov has joined #openstack-infra | 04:14 | |
| *** jbryce has joined #openstack-infra | 04:14 | |
| *** zz_dimtruck is now known as dimtruck | 04:14 | |
| *** cyeoh has joined #openstack-infra | 04:14 | |
| *** Svedrin has joined #openstack-infra | 04:15 | |
| *** pcrews has quit IRC | 04:15 | |
| *** rainya has joined #openstack-infra | 04:15 | |
| *** vishy has joined #openstack-infra | 04:15 | |
| *** camunoz has joined #openstack-infra | 04:17 | |
| *** chandankumar has quit IRC | 04:19 | |
| openstackgerrit | James Carey proposed openstack-dev/hacking: WIP: Add optional hacking checks https://review.openstack.org/134052 | 04:19 |
| *** pcrews has joined #openstack-infra | 04:19 | |
| JaDonG | hi, does anybody would like code review for https://review.openstack.org/#/c/133584/ ? thanks. | 04:20 |
| *** JayF has joined #openstack-infra | 04:20 | |
| arosen | bhunter71: i don't see key-name being passed in for the nodepool images. | 04:21 |
| *** Ryan_Lane has joined #openstack-infra | 04:22 | |
| *** sileht has joined #openstack-infra | 04:22 | |
| *** achanda has joined #openstack-infra | 04:24 | |
| *** Ryan_Lane has quit IRC | 04:24 | |
| *** pcrews has quit IRC | 04:25 | |
| *** ayoung is now known as ayoung-mia | 04:27 | |
| *** rushiagr_away is now known as rushiagr | 04:27 | |
| *** achanda has quit IRC | 04:29 | |
| openstackgerrit | Merged stackforge/python-jenkins: fix auth with long username or password https://review.openstack.org/132433 | 04:31 |
| openstackgerrit | James Carey proposed openstack-dev/hacking: WIP: Add optional hacking checks https://review.openstack.org/134052 | 04:32 |
| *** achanda has joined #openstack-infra | 04:32 | |
| *** Daisy has quit IRC | 04:33 | |
| *** koolhead17 has quit IRC | 04:35 | |
| *** koolhead17 has joined #openstack-infra | 04:35 | |
| *** tsg has joined #openstack-infra | 04:39 | |
| *** koolhead17 has quit IRC | 04:39 | |
| *** tsg_ has joined #openstack-infra | 04:39 | |
| *** tsg_ has quit IRC | 04:39 | |
| *** fandi has joined #openstack-infra | 04:46 | |
| *** radez is now known as radez_g0n3 | 04:47 | |
| *** ildikov has quit IRC | 04:55 | |
| *** bhunter71 has quit IRC | 04:57 | |
| *** ildikov has joined #openstack-infra | 04:58 | |
| *** AlexF has joined #openstack-infra | 04:59 | |
| *** otherwiseguy has quit IRC | 05:03 | |
| *** terryw has joined #openstack-infra | 05:03 | |
| *** Longgeek has joined #openstack-infra | 05:10 | |
| *** marun has quit IRC | 05:14 | |
| *** Longgeek has quit IRC | 05:15 | |
| *** jerryz has quit IRC | 05:15 | |
| *** chandankumar has joined #openstack-infra | 05:17 | |
| *** p5ntangle has joined #openstack-infra | 05:17 | |
| *** yfried_ has quit IRC | 05:18 | |
| *** p5ntangle has quit IRC | 05:20 | |
| *** p5ntangle has joined #openstack-infra | 05:20 | |
| *** Daisy has joined #openstack-infra | 05:22 | |
| *** BharatK has joined #openstack-infra | 05:31 | |
| *** subscope has quit IRC | 05:33 | |
| *** p5ntangle has quit IRC | 05:34 | |
| *** p5ntangle has joined #openstack-infra | 05:34 | |
| *** otter768 has joined #openstack-infra | 05:39 | |
| *** p5ntangle has quit IRC | 05:39 | |
| *** p5ntangle has joined #openstack-infra | 05:40 | |
| *** AlexF has quit IRC | 05:44 | |
| *** Longgeek has joined #openstack-infra | 05:46 | |
| *** dkehnm has quit IRC | 05:56 | |
| *** talluri has joined #openstack-infra | 05:58 | |
| *** KanagarajM has joined #openstack-infra | 05:59 | |
| *** mmaglana_ has joined #openstack-infra | 05:59 | |
| *** achanda has quit IRC | 06:01 | |
| *** mmaglana has quit IRC | 06:01 | |
| *** achanda has joined #openstack-infra | 06:04 | |
| *** koolhead17 has joined #openstack-infra | 06:08 | |
| *** shashankhegde has quit IRC | 06:08 | |
| *** mmaglana_ has quit IRC | 06:08 | |
| *** k4n0 has joined #openstack-infra | 06:09 | |
| *** chandankumar has quit IRC | 06:12 | |
| *** vigneshvar has joined #openstack-infra | 06:23 | |
| *** chandankumar has joined #openstack-infra | 06:27 | |
| *** nelsnelson has quit IRC | 06:28 | |
| *** Longgeek has quit IRC | 06:31 | |
| *** Longgeek has joined #openstack-infra | 06:33 | |
| *** p5ntangle has quit IRC | 06:34 | |
| *** p5ntangle has joined #openstack-infra | 06:35 | |
| *** armax has quit IRC | 06:36 | |
| *** mrmartin has joined #openstack-infra | 06:37 | |
| *** peddamat has quit IRC | 06:41 | |
| *** terryw has quit IRC | 06:44 | |
| *** ChuckC has quit IRC | 06:45 | |
| openstackgerrit | James Polley proposed openstack-infra/zuul: Remove "properly" from error message for clarity https://review.openstack.org/134122 | 06:49 |
| *** reed has joined #openstack-infra | 06:50 | |
| *** yfried has joined #openstack-infra | 06:51 | |
| openstackgerrit | Nikhil Manchanda proposed openstack-infra/project-config: Promote the gate-trove-functional-dsvm-mysql job https://review.openstack.org/134123 | 06:52 |
| *** vigneshvar has quit IRC | 06:54 | |
| *** otter768 has quit IRC | 06:58 | |
| openstackgerrit | Nikhil Manchanda proposed openstack-infra/project-config: Promote the gate-trove-functional-dsvm-mysql job https://review.openstack.org/134123 | 07:02 |
| *** bo_sh has joined #openstack-infra | 07:03 | |
| *** achanda has quit IRC | 07:07 | |
| *** vigneshvar has joined #openstack-infra | 07:07 | |
| *** doug-fish has quit IRC | 07:11 | |
| SlickNik | Please can I get some eyeballs on https://review.openstack.org/#/c/134123/ when folks get a chance? Thanks! | 07:12 |
| *** doug-fish has joined #openstack-infra | 07:12 | |
| *** hdd has joined #openstack-infra | 07:15 | |
| *** ChuckC has joined #openstack-infra | 07:18 | |
| *** ildikov has quit IRC | 07:19 | |
| AJaeger | SlickNik, will do | 07:20 |
| *** bo_sh has quit IRC | 07:21 | |
| *** camunoz has quit IRC | 07:22 | |
| *** bo_sh has joined #openstack-infra | 07:22 | |
| *** dannywilson has quit IRC | 07:26 | |
| *** arosen has quit IRC | 07:26 | |
| *** stevemar has quit IRC | 07:29 | |
| *** dannywilson has joined #openstack-infra | 07:33 | |
| *** asalkeld has joined #openstack-infra | 07:35 | |
| *** __afazekas has quit IRC | 07:36 | |
| asalkeld | hi, I'd like to move a repo that holds pacemaker OCF resources for openstack services into either stackforge or openstack | 07:36 |
| asalkeld | http://github.com/madkiss/openstack-resource-agents | 07:36 |
| asalkeld | it is referenced from our offical HA guide | 07:36 |
| asalkeld | any suggestion which one is should go into? | 07:37 |
| *** bo_sh has quit IRC | 07:38 | |
| asalkeld | no worries I'll email the dev ML | 07:38 |
| *** harlowja has joined #openstack-infra | 07:41 | |
| *** ashaeron has joined #openstack-infra | 07:41 | |
| *** yamamoto_ has quit IRC | 07:42 | |
| *** IvanBerezovskiy has joined #openstack-infra | 07:45 | |
| *** jlibosva has joined #openstack-infra | 07:46 | |
| *** berendt has joined #openstack-infra | 07:48 | |
| AJaeger | asalkeld, one option is to create a complete new repository for this | 07:50 |
| AJaeger | asalkeld, if you do this, see http://ci.openstack.org/stackforge.html for instructions | 07:50 |
| asalkeld | ok, I am also chatting to the author and he suggested they could be merged in to the projects themselves | 07:51 |
| *** salv-orlando has joined #openstack-infra | 07:51 | |
| asalkeld | which is maybe a good idea | 07:51 |
| *** talluri has quit IRC | 07:52 | |
| *** harlowja has quit IRC | 07:53 | |
| AJaeger | asalkeld, yeah, an option as well. Raise it on the mailing list, please | 07:54 |
| *** asettle has joined #openstack-infra | 07:54 | |
| *** koolhead17 has quit IRC | 07:57 | |
| *** dannywilson has quit IRC | 07:58 | |
| *** koolhead17 has joined #openstack-infra | 07:58 | |
| *** bo_sh has joined #openstack-infra | 07:59 | |
| *** tsg has quit IRC | 07:59 | |
| *** koolhead17 has quit IRC | 07:59 | |
| *** koolhead17 has joined #openstack-infra | 08:00 | |
| *** ildikov has joined #openstack-infra | 08:00 | |
| *** arxcruz has joined #openstack-infra | 08:00 | |
| *** afazekas has joined #openstack-infra | 08:01 | |
| *** bo_sh has quit IRC | 08:02 | |
| *** bo_sh has joined #openstack-infra | 08:03 | |
| *** zns has quit IRC | 08:04 | |
| *** koolhead17 has quit IRC | 08:04 | |
| *** fandi has quit IRC | 08:04 | |
| *** harlowja has joined #openstack-infra | 08:06 | |
| *** achanda has joined #openstack-infra | 08:07 | |
| *** asettle has quit IRC | 08:09 | |
| *** e0ne has joined #openstack-infra | 08:09 | |
| *** luqas has joined #openstack-infra | 08:10 | |
| *** achanda has quit IRC | 08:12 | |
| *** enikanorov__ has joined #openstack-infra | 08:14 | |
| *** enikanorov has quit IRC | 08:14 | |
| * tchaypo writes a novel on https://review.openstack.org/#/c/129533/ | 08:16 | |
| *** p5ntangle has quit IRC | 08:17 | |
| *** p5ntangle has joined #openstack-infra | 08:18 | |
| *** rlandy has joined #openstack-infra | 08:19 | |
| * AJaeger was shocked when he saw that lengthy email coming in ;) | 08:19 | |
| *** yamahata has quit IRC | 08:22 | |
| *** harlowja has quit IRC | 08:23 | |
| *** vigneshvar has quit IRC | 08:27 | |
| *** ildikov has quit IRC | 08:29 | |
| *** skolekonov has joined #openstack-infra | 08:31 | |
| *** AlexF has joined #openstack-infra | 08:31 | |
| *** fabo_ is now known as fabo | 08:32 | |
| *** talluri has joined #openstack-infra | 08:36 | |
| *** fandi has joined #openstack-infra | 08:37 | |
| *** dtantsur|afk is now known as dtantsur | 08:38 | |
| *** yfried is now known as yfried|afk | 08:40 | |
| *** MaxV has joined #openstack-infra | 08:41 | |
| *** pblaho has joined #openstack-infra | 08:41 | |
| *** jcoufal has joined #openstack-infra | 08:46 | |
| *** yfried|afk is now known as yfried | 08:47 | |
| *** _nadya_ has joined #openstack-infra | 08:48 | |
| *** talluri has quit IRC | 08:48 | |
| *** vigneshvar has joined #openstack-infra | 08:48 | |
| *** mpaolino has joined #openstack-infra | 08:51 | |
| *** mpaolino has quit IRC | 08:51 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/devstack-gate: Add manila and python-manilaclient to the projects list https://review.openstack.org/134135 | 08:56 |
| *** dizquierdo has joined #openstack-infra | 08:56 | |
| *** _nadya_ has quit IRC | 08:58 | |
| *** koolhead17 has joined #openstack-infra | 08:58 | |
| *** ildikov has joined #openstack-infra | 08:59 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Add funtional tests job for python-manilaclient https://review.openstack.org/134137 | 09:01 |
| *** AlexF has quit IRC | 09:02 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Fix typo for manila tempest job https://review.openstack.org/134138 | 09:04 |
| *** yfried is now known as yfried|afk | 09:09 | |
| *** jyuso has joined #openstack-infra | 09:11 | |
| *** jyuso838 has quit IRC | 09:11 | |
| *** jpich has joined #openstack-infra | 09:13 | |
| *** vigneshvar has quit IRC | 09:14 | |
| *** ihrachyshka has joined #openstack-infra | 09:14 | |
| *** amuller has joined #openstack-infra | 09:14 | |
| *** teran has joined #openstack-infra | 09:20 | |
| *** Daisy has quit IRC | 09:20 | |
| *** derekh has joined #openstack-infra | 09:20 | |
| *** yfried|afk is now known as yfried | 09:21 | |
| *** ildikov has quit IRC | 09:22 | |
| *** teran has quit IRC | 09:23 | |
| *** hdd has quit IRC | 09:26 | |
| *** mpaolino has joined #openstack-infra | 09:28 | |
| *** gpocentek has quit IRC | 09:28 | |
| *** salv-orlando has quit IRC | 09:28 | |
| *** vigneshvar has joined #openstack-infra | 09:29 | |
| *** gpocentek has joined #openstack-infra | 09:29 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: report exactly which jobs will be deleted. https://review.openstack.org/133842 | 09:33 |
| *** jistr has joined #openstack-infra | 09:34 | |
| *** tteggel has quit IRC | 09:35 | |
| *** tteggel has joined #openstack-infra | 09:35 | |
| *** ildikov has joined #openstack-infra | 09:36 | |
| *** AlexF has joined #openstack-infra | 09:38 | |
| *** tteggel has quit IRC | 09:39 | |
| *** tteggel has joined #openstack-infra | 09:40 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Add support for the S3 Publisher plugin https://review.openstack.org/128167 | 09:44 |
| *** amotoki has quit IRC | 09:46 | |
| *** dtantsur is now known as dtantsur|brb | 09:47 | |
| *** talluri has joined #openstack-infra | 09:48 | |
| *** koolhead17 has quit IRC | 09:49 | |
| *** koolhead17 has joined #openstack-infra | 09:50 | |
| *** reed has quit IRC | 09:50 | |
| *** vigneshvar has quit IRC | 09:50 | |
| *** fandi has quit IRC | 09:52 | |
| *** dizquierdo has quit IRC | 09:53 | |
| *** talluri has quit IRC | 09:54 | |
| *** koolhead17 has quit IRC | 09:54 | |
| *** yfried is now known as yfried|afk | 09:57 | |
| *** yfried|afk is now known as yfried | 09:57 | |
| *** vrutkovs has joined #openstack-infra | 09:59 | |
| *** vrutkovs is now known as vrutkovs_ | 09:59 | |
| *** hdd has joined #openstack-infra | 10:01 | |
| *** reed has joined #openstack-infra | 10:02 | |
| *** Hal has joined #openstack-infra | 10:04 | |
| *** Hal is now known as Guest54421 | 10:04 | |
| *** vigneshvar has joined #openstack-infra | 10:09 | |
| *** AlexF has quit IRC | 10:11 | |
| *** yfried is now known as yfried|afk | 10:14 | |
| *** Longgeek has quit IRC | 10:15 | |
| *** Longgeek has joined #openstack-infra | 10:16 | |
| *** vigneshvar has quit IRC | 10:16 | |
| *** Longgeek_ has joined #openstack-infra | 10:17 | |
| *** koolhead17 has joined #openstack-infra | 10:17 | |
| *** koolhead17 has joined #openstack-infra | 10:17 | |
| *** Longgeek has quit IRC | 10:20 | |
| *** katyafervent_awa is now known as katyafervent | 10:26 | |
| *** pelix has joined #openstack-infra | 10:27 | |
| *** vigneshvar has joined #openstack-infra | 10:28 | |
| *** HeOS has joined #openstack-infra | 10:30 | |
| *** yaguang has quit IRC | 10:30 | |
| *** yfried|afk is now known as yfried | 10:34 | |
| *** dkehnm has joined #openstack-infra | 10:38 | |
| *** adalbas has joined #openstack-infra | 10:40 | |
| *** AlexF has joined #openstack-infra | 10:47 | |
| *** talluri has joined #openstack-infra | 10:49 | |
| *** mwagner_lap has quit IRC | 10:51 | |
| *** AlexF has quit IRC | 10:52 | |
| *** jp_at_hp has joined #openstack-infra | 10:52 | |
| *** talluri has quit IRC | 10:53 | |
| *** AlexF has joined #openstack-infra | 10:57 | |
| *** cnesa has joined #openstack-infra | 10:57 | |
| *** doug-fish has quit IRC | 10:59 | |
| *** doug-fish has joined #openstack-infra | 11:01 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/system-config: Switch release status tracking to Kilo https://review.openstack.org/134163 | 11:01 |
| *** michchap has quit IRC | 11:01 | |
| *** michchap_ has joined #openstack-infra | 11:01 | |
| *** hashar has joined #openstack-infra | 11:01 | |
| *** Mmike has quit IRC | 11:04 | |
| *** Mmike has joined #openstack-infra | 11:04 | |
| *** yamahata has joined #openstack-infra | 11:06 | |
| *** yfried is now known as yfried|afk | 11:12 | |
| *** hashar has quit IRC | 11:15 | |
| *** yfried|afk is now known as yfried | 11:17 | |
| *** rfolco has joined #openstack-infra | 11:17 | |
| *** asselin has quit IRC | 11:20 | |
| *** links has joined #openstack-infra | 11:22 | |
| *** aysyd has joined #openstack-infra | 11:25 | |
| *** KanagarajM has quit IRC | 11:27 | |
| *** asalkeld has left #openstack-infra | 11:29 | |
| *** jp_at_hp has quit IRC | 11:33 | |
| *** nosnos has quit IRC | 11:34 | |
| *** nosnos has joined #openstack-infra | 11:34 | |
| sdague | AJaeger: can I get you to nudge this one through - https://review.openstack.org/#/c/134028/ | 11:38 |
| *** vdo has joined #openstack-infra | 11:39 | |
| *** nosnos has quit IRC | 11:39 | |
| *** luqas has quit IRC | 11:41 | |
| *** koolhead17 has quit IRC | 11:44 | |
| *** koolhead17 has joined #openstack-infra | 11:45 | |
| *** koolhead17 has quit IRC | 11:45 | |
| *** koolhead17 has joined #openstack-infra | 11:46 | |
| *** koolhead17 has joined #openstack-infra | 11:46 | |
| *** fandi has joined #openstack-infra | 11:50 | |
| *** mpaolino has quit IRC | 11:53 | |
| *** cdent has joined #openstack-infra | 11:53 | |
| *** fandi has quit IRC | 11:55 | |
| *** dmsimard_away is now known as dmsimard | 11:57 | |
| *** salv-orlando has joined #openstack-infra | 11:58 | |
| *** ZZelle has quit IRC | 12:04 | |
| *** ZZelle has joined #openstack-infra | 12:04 | |
| *** bo_sh has left #openstack-infra | 12:06 | |
| *** dims has quit IRC | 12:07 | |
| *** dims has joined #openstack-infra | 12:08 | |
| *** bookwar has left #openstack-infra | 12:10 | |
| *** fabo has quit IRC | 12:12 | |
| *** fabo has joined #openstack-infra | 12:12 | |
| *** BharatK has left #openstack-infra | 12:12 | |
| *** talluri has joined #openstack-infra | 12:14 | |
| *** pc_m has joined #openstack-infra | 12:17 | |
| *** jerryz has joined #openstack-infra | 12:24 | |
| *** jp_at_hp has joined #openstack-infra | 12:28 | |
| *** AlexF has quit IRC | 12:29 | |
| *** mwagner_lap has joined #openstack-infra | 12:34 | |
| *** lttrl has quit IRC | 12:37 | |
| *** lttrl has joined #openstack-infra | 12:37 | |
| *** yamahata has quit IRC | 12:37 | |
| *** yamahata has joined #openstack-infra | 12:37 | |
| *** salv-orlando has quit IRC | 12:38 | |
| *** AlexF has joined #openstack-infra | 12:38 | |
| *** dprince has joined #openstack-infra | 12:38 | |
| *** dmellado has quit IRC | 12:39 | |
| *** erlon has quit IRC | 12:39 | |
| *** jp_at_hp has quit IRC | 12:42 | |
| *** dmellado has joined #openstack-infra | 12:42 | |
| *** doug-fish1 has joined #openstack-infra | 12:43 | |
| mkoderer | do we have an issue with git.openstack.org? | 12:45 |
| *** talluri has quit IRC | 12:45 | |
| *** talluri has joined #openstack-infra | 12:45 | |
| mkoderer | I get an "fatal: Could not read from remote repository" sporadically | 12:45 |
| *** doug-fish has quit IRC | 12:46 | |
| mkoderer | ok look like it's my connection :) | 12:48 |
| *** salv-orlando has joined #openstack-infra | 12:49 | |
| cdent | mkoderer: I've just seen that in some gate runs | 12:49 |
| cdent | https://jenkins03.openstack.org/job/check-tempest-dsvm-full-juno/132/console | 12:49 |
| mkoderer | cdent: oh ok... | 12:50 |
| cdent | which I guess means it's not you :) | 12:50 |
| *** baoli has joined #openstack-infra | 12:53 | |
| *** dtantsur|brb is now known as dtantsur | 12:55 | |
| *** asselin has joined #openstack-infra | 12:57 | |
| *** salv-orlando has quit IRC | 12:59 | |
| *** weshay has joined #openstack-infra | 13:01 | |
| *** mbacchi has joined #openstack-infra | 13:02 | |
| kashyap | Heya, something seems to be wrong on infra -- http://logs.openstack.org/65/134165/1/check/check-devstack-dsvm-cells/6235154/console.html | 13:02 |
| kashyap | "2014-11-13 12:00:19.045 | Cloning into 'devstack-gate'... | 13:03 |
| kashyap | 2014-11-13 12:00:20.217 | fatal: Could not read from remote repository." | 13:03 |
| *** talluri has quit IRC | 13:03 | |
| *** cnesa has quit IRC | 13:03 | |
| *** Longgeek_ has quit IRC | 13:03 | |
| kashyap | Oh, it's already being discussed above by cdent. . .Hmm | 13:03 |
| cdent | yes, something has gone a bit wrong | 13:04 |
| sdague | yeh, that needs fungi or SergeyLukjanov to look into | 13:04 |
| kashyap | Uh, yeah. Can't help but feel that sometimes, so much of yak-shaving is needed to get simple patches merged :) | 13:04 |
| AJaeger | sdague, ah, that one... I wanted to wait until you're awake, I'll approve now ;) | 13:05 |
| kashyap | sdague, Thanks for confirming! Should a bug be filed? | 13:05 |
| sdague | kashyap: a service outage like this doesn't usually get helped by a bug, though if you wanted to build and elastic recheck signature for it, that might be a reason to file a bug | 13:05 |
| sdague | then at least people would know that the failure was understood | 13:06 |
| kashyap | sdague, You read minds! ER is what I meant :) | 13:06 |
| kashyap | (My poor wording.) | 13:06 |
| sdague | kashyap: yes, that would be great | 13:06 |
| *** afazekas has quit IRC | 13:07 | |
| *** dkranz has joined #openstack-infra | 13:07 | |
| *** Longgeek has joined #openstack-infra | 13:10 | |
| *** isviridov_away is now known as isviridov | 13:10 | |
| *** eharney has joined #openstack-infra | 13:13 | |
| cdent | It does often feel like sdague reads minds | 13:15 |
| openstackgerrit | Merged openstack-infra/project-config: remove the dsvm-cells job from libraries https://review.openstack.org/134028 | 13:16 |
| *** fandi has joined #openstack-infra | 13:16 | |
| kashyap | Oh, there exists a signature from last month -- https://review.openstack.org/#/c/130305/ | 13:19 |
| kashyap | Good that I grepped for the message before doing any such. | 13:19 |
| sdague | dims: ... the lock fixture, do we know that resets correctly on teardown? | 13:19 |
| dims | sdague: i can see addCleanup's so yes, i believe so. do you see an issue? | 13:21 |
| kashyap | sdague, The above existing signature should suffice, right? It already surfaces on the status page - http://status.openstack.org/elastic-recheck/ | 13:22 |
| *** bswartz has quit IRC | 13:22 | |
| *** afazekas has joined #openstack-infra | 13:23 | |
| sdague | dims: no, I just didn't realize it pulled the cleanups out of the test case itself, so now it's not clear that it does the right thing, like reset the config var | 13:23 |
| sdague | is there a test for the negative case in the fixture itself? | 13:24 |
| openstackgerrit | Lucas Dutra Nunes proposed openstack-infra/jenkins-job-builder: builders: add Hudson cmakebuilder plugin support https://review.openstack.org/134199 | 13:25 |
| dims | sdague: there's a TestLockFixture which checks "Setup lock fixture to test that teardown is inside the lock" | 13:25 |
| sdague | so.... here is my question | 13:28 |
| sdague | dims: https://github.com/openstack/nova/blob/master/nova/test.py#L304 when I did something like that before, the result was that the config change was sticky for all future tests | 13:29 |
| sdague | because of global conf | 13:29 |
| sdague | which means while it passes tests, it's actually quite wrong | 13:30 |
| *** kgiusti has joined #openstack-infra | 13:31 | |
| *** miqui has joined #openstack-infra | 13:31 | |
| dims | sdague: so the REQUIRES_LOCKING behavior persists? | 13:32 |
| sdague | yes | 13:32 |
| *** afazekas has quit IRC | 13:32 | |
| * dims looking | 13:33 | |
| *** cnesa has joined #openstack-infra | 13:33 | |
| *** jp_at_hp has joined #openstack-infra | 13:33 | |
| *** jp_at_hp has quit IRC | 13:34 | |
| *** jp_at_hp has joined #openstack-infra | 13:34 | |
| *** jp_at_hp has quit IRC | 13:34 | |
| *** jp_at_hp has joined #openstack-infra | 13:34 | |
| *** alexpilotti has joined #openstack-infra | 13:34 | |
| *** mpaolino has joined #openstack-infra | 13:36 | |
| dims | sdague: the config fixture seems to do the right thing | 13:39 |
| dims | and has test cases for the fixture | 13:39 |
| *** mattfarina has joined #openstack-infra | 13:40 | |
| *** koolhead17 has quit IRC | 13:40 | |
| *** AJaeger has quit IRC | 13:41 | |
| dims | sdague: asking dhellmann to see scrollback here. i'll be back in 10 mins | 13:42 |
| *** xyang0 has joined #openstack-infra | 13:42 | |
| * dhellmann reads | 13:43 | |
| sdague | ok, let me see if I can reproduce what I saw before | 13:43 |
| *** ldnunes has joined #openstack-infra | 13:43 | |
| dhellmann | I thought the config fixture reset the global config object? Let me look at it | 13:44 |
| sdague | dhellmann: maybe, I might have been calling a thing incorrectly before | 13:44 |
| dhellmann | sdague: http://git.openstack.org/cgit/openstack/oslo.config/tree/oslo/config/fixture.py#n40 | 13:44 |
| dhellmann | sdague: could be that it *used* to break the way you remember | 13:44 |
| dhellmann | or, you know, maybe that call doesn't work or something | 13:44 |
| dhellmann | so you could be right, but it looks like we're trying :-) | 13:45 |
| fungi | looking | 13:45 |
| *** yfried has quit IRC | 13:45 | |
| *** afazekas has joined #openstack-infra | 13:45 | |
| *** mase_x200 has joined #openstack-infra | 13:48 | |
| *** radez_g0n3 is now known as radez | 13:48 | |
| sdague | so my test case is to turn off REQUIRES_LOCKING on some of the test cases in nova, if they all fail, then it's right, if they pass we're masking a thing. I should have results in about 5 minutes. | 13:48 |
| *** mpaolino has quit IRC | 13:48 | |
| sdague | ok, it looks like it is exploding correctly | 13:48 |
| *** ryanpetrello has joined #openstack-infra | 13:49 | |
| *** xyang0 has quit IRC | 13:49 | |
| *** mpaolino has joined #openstack-infra | 13:49 | |
| fungi | looks like someone/something was beating the crap out of git04... http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=2 | 13:50 |
| *** achuprin_ has joined #openstack-infra | 13:51 | |
| *** rushiagr is now known as rushiagr_away | 13:51 | |
| *** xyang0 has joined #openstack-infra | 13:51 | |
| fungi | i wonder if there's any harm in having haproxy round-robin all requests instead of load balancing by source hash | 13:52 |
| *** pblaho has quit IRC | 13:52 | |
| fungi | i suspect we're ending up with some higher-volume third party ci environments behind a single address nat | 13:53 |
| *** bswartz has joined #openstack-infra | 13:53 | |
| *** luqas has joined #openstack-infra | 13:53 | |
| *** jistr has quit IRC | 13:53 | |
| clarkb1 | fungi replication is not synchonous | 13:53 |
| fungi | and then haproxy sends all their clone requests (because most of them likely aren't caching repos at all on their workers) to the same member of the pool | 13:54 |
| clarkb1 | so potentially very harmful | 13:54 |
| openstackgerrit | Merged openstack-infra/project-config: Promote the gate-trove-functional-dsvm-mysql job https://review.openstack.org/134123 | 13:54 |
| fungi | yeah, agreed | 13:54 |
| *** ryanpetrello has quit IRC | 13:54 | |
| fungi | afs-backed git server farm? ;) | 13:54 |
| *** jistr has joined #openstack-infra | 13:54 | |
| fungi | looks like we're hitting extended periods of load where an entire cpu is swamped by interrupt handling | 13:56 |
| mase_x200 | I have a freshly cloned version of zuul from git. Tox tests all pass. If i wanted to crank it up manually how do I do this ? | 13:56 |
| * dims back now | 13:56 | |
| dims | sdague: so lock and config fixtures are working ok? | 13:57 |
| sdague | dims: yeh, I think so | 13:57 |
| dims | whew | 13:57 |
| *** dustins has joined #openstack-infra | 13:57 | |
| fungi | mase_x200: i believe arosen1 is in the process of writing an install guide for it. we use http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/zuul/ | 13:57 |
| sdague | dims: do you have the respin of your oslo module that you want to release for project-config? | 13:58 |
| *** andymaier has joined #openstack-infra | 13:58 | |
| fungi | mase_x200: though really, zuul is often just one piece in the big picture... maybe a read through http://ci.openstack.org/running-your-own.html would help | 13:58 |
| dims | sdague: yes, one sec | 13:59 |
| mase_x200 | fungi: brilliant thanks. I am just trying to get my head around the codebase but only getting a few mins here an there so slow going :) | 14:00 |
| dims | sdague: here, https://review.openstack.org/#/c/132877/ has +2 from Andreas | 14:00 |
| *** gokrokve has joined #openstack-infra | 14:00 | |
| fungi | mase_x200: the admin sheet for how we deploy and operate zuul in production is http://ci.openstack.org/zuul.html and the zuul reference manual linked from the top of that is also very detailed | 14:01 |
| mase_x200 | thank you | 14:02 |
| fungi | looks like that sheet could also stand updating to mention that we've separated the mergers out to additional servers now. i'll try to remember to get a patch up to correct that later today | 14:03 |
| mase_x200 | fungi: so this might be a stupid question, but does / can zuul run standalone from the git repo without having to install it first. For development purposes ? | 14:04 |
| *** AlexF has quit IRC | 14:04 | |
| fungi | mase_x200: sort of? in reality you'll need its python dependencies, so easier if you install it in a virtualenv... something like 'virtualenv foo; foo/bin/pip install -e .' | 14:05 |
| mase_x200 | i used tox to set up the environment i blieve | 14:05 |
| mase_x200 | believe* | 14:05 |
| fungi | mase_x200: that will get you a zuul installed in develop mode so that you don't have to keep reinstalling between edits to its files | 14:06 |
| mase_x200 | ah ok. | 14:06 |
| fungi | mase_x200: yeah, you could use the env tox created for it too | 14:06 |
| mase_x200 | is that the .tox/python2.7 etc.. ? | 14:07 |
| fungi | mase_x200: yep | 14:07 |
| mase_x200 | ahh ok cool | 14:07 |
| mase_x200 | starting to understand | 14:07 |
| *** cpowell has joined #openstack-infra | 14:07 | |
| mase_x200 | so if i make a change to some files, would i run tox again ? | 14:08 |
| fungi | mase_x200: though i would warn against hacking on it much before you stand up a working environment with it. zuul's operation is complex with multiple moving parts and network interactions and it's hard enough to understand even with a working deployment to play with | 14:08 |
| *** packet has joined #openstack-infra | 14:08 | |
| mase_x200 | ok that's fair enough. I have some simple changes and was hoping to make them without getting everything up and running, just use the test cases | 14:09 |
| fungi | mase_x200: oh, sure for bug fixes the test cases are probably plenty | 14:09 |
| fungi | mase_x200: for new features, it becomes a grey area | 14:10 |
| *** dims has quit IRC | 14:10 | |
| *** k4n0 has quit IRC | 14:10 | |
| mase_x200 | well its small features but i probably should get it running anyhow | 14:10 |
| *** dims has joined #openstack-infra | 14:10 | |
| fungi | ideally adding well-thought-out test cases to cover new features should be fine, but there's no substitute for confirming it works in an actual deployment | 14:11 |
| zaro | morning | 14:11 |
| mase_x200 | i guess i was just trying to get a small win first before attempting to get hte whole tihng set up. | 14:11 |
| *** AlexF has joined #openstack-infra | 14:11 | |
| mase_x200 | but it probably would give me a better understanding. | 14:12 |
| mase_x200 | which is ultimately what i'm trying to gain. | 14:12 |
| fungi | mase_x200: don't hesitate to push up starter patches and see how far we can go, even if they're work in progress | 14:12 |
| dtantsur | hey folks! could someone give a final +2 for inclusion of the new project into stackforge? https://review.openstack.org/#/c/133473 | 14:12 |
| mase_x200 | fungi: well right now I'm just trying to get it running un-modified :) so i have a ways to go. Back to the question though, say i get it all up and running, if i make a change to the src code, what is the mechanism to get this into my tox env ? | 14:13 |
| zaro | pelix: regarding https://review.openstack.org/#/c/132585/ | 14:13 |
| fungi | mase_x200: i would start with: . .tox/py27/activate ; pip install -e . | 14:14 |
| zaro | pelix: wasn't there another change, possibily already merged, that did the same thing? i can't seem to find it. but i think it was using next release 1.0.0 as a reference for deprecation as well. | 14:14 |
| *** yamamoto has joined #openstack-infra | 14:15 | |
| fungi | mase_x200: assuming you want to be able to import zuul modules in that virtualenv with your changes active | 14:15 |
| fungi | mase_x200: on the other hand, if you're just wanting to rerun unit tests, you can simply reinvoke tox after making edits | 14:16 |
| *** tsg has joined #openstack-infra | 14:16 | |
| fungi | mase_x200: no need for an editable install nor activating the virtualenv manually | 14:17 |
| openstackgerrit | Merged openstack-infra/reviewstats: Switched documentation to point to storyboard. https://review.openstack.org/133860 | 14:17 |
| pelix | zaro: yes, there was, which is why I picked that as the number, but really we can pick anything we want, depends on whether we feel we should use semantic versioning to reflect when removing backwards compatibility? | 14:17 |
| *** vigneshvar has quit IRC | 14:17 | |
| kragniz | is launchpad having problems for anyone else right now? | 14:18 |
| openstackgerrit | Barnaby Court proposed openstack-infra/jenkins-job-builder: Add support for the matrix-combinations plugin https://review.openstack.org/133698 | 14:18 |
| mase_x200 | fungi: i need to get it to log so prob need to use the virtualenv with changes | 14:18 |
| kragniz | okay, it seems to be back up now | 14:18 |
| zaro | pelix: yeah, we should probably stick with semantic versioning, don't want to make up something new. | 14:18 |
| *** mwhudson has quit IRC | 14:19 | |
| fungi | mase_x200: well, zuul's unit tests do actually run the daemon process and attach its logs to the subunit stream | 14:19 |
| *** wolsen has quit IRC | 14:19 | |
| zaro | pelix: should also go back and fix that other change that referenced 1.0.0 but i can't for the life of me find it. you happen to know which change that was? | 14:19 |
| *** wolsen has joined #openstack-infra | 14:19 | |
| mase_x200 | fungi: iam trying to add a compress / rotate handler | 14:19 |
| mase_x200 | so need to generate a decent no of logs | 14:20 |
| fungi | mase_x200: aha, yes then that's probably another story unless you want to artificially crank down the max size/min duration for the sake of testing | 14:20 |
| *** erikmwilson has joined #openstack-infra | 14:21 | |
| *** mriedem has joined #openstack-infra | 14:21 | |
| *** mwhudson has joined #openstack-infra | 14:21 | |
| mase_x200 | fungi: this is going to be fun, i can tell :) ; Thanks heaps for your help. I've made some notes and I'll read through those install pages you linked to and try again tomorrow. | 14:22 |
| fungi | also, i think the current tests stream the logs, so file handling of logs wouldn't come into play there, you're right | 14:22 |
| *** erikmwilson has quit IRC | 14:22 | |
| mase_x200 | fungi: you are correct, that was the first / only thing i really noticed | 14:23 |
| fungi | mase_x200: sure thing! let us know if we can help further. we have quite a few zuul authors and sysadmins in this channel (though many of them a re travelling this week) | 14:23 |
| *** erikmwilson_ has joined #openstack-infra | 14:24 | |
| *** signed8bit has joined #openstack-infra | 14:25 | |
| *** erikmwilson_ has quit IRC | 14:26 | |
| mase_x200 | no worries. it might take me a while as the time i can dedicate is limited at the moment and my job is completely unrelated to zuul / openstack; but I was encouraged to contribute to zuul as a way to get to know openstack and the ci stack and i figure it's going to be there for a while :) | 14:26 |
| *** cpowell has quit IRC | 14:27 | |
| fungi | mase_x200: yes, i think zuul and nodepool, of all our projects, will likely be around for a very long time | 14:27 |
| marcusvrn | Hey guys...about CI, Should I really keep all default devstack-gate project enabled? I'm trying to optimize my CI... any suggestions? | 14:27 |
| *** hdd has quit IRC | 14:28 | |
| mase_x200 | night all. | 14:28 |
| fungi | marcusvrn: it depends entirely on what you're trying to test | 14:28 |
| *** chandankumar has quit IRC | 14:29 | |
| marcusvrn | fungi: my CI is only for Cinder | 14:29 |
| *** hdd has joined #openstack-infra | 14:29 | |
| sdague | zaro: is it possible to rebuild our gerrit with the better gwt css styling? | 14:29 |
| fungi | marcusvrn: so perhaps you could limit the list of projects/services to only those needed to test cinder | 14:29 |
| *** cnesa has quit IRC | 14:29 | |
| sdague | zaro: mostly, do we build our gerrit from source, or are we pulling a war file? | 14:30 |
| pelix | zaro: if we use semantic versioning does that mean that we should wait until 1.0.0 before removing anything deprecated during the 0.x cycle? | 14:30 |
| *** cnesa has joined #openstack-infra | 14:31 | |
| fungi | sdague: we roll our own at the moment so we can backport patches. it's pulled from tarballs.o.o via... http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/review.pp#n115 | 14:31 |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: Use python-jobs for Gnocchi https://review.openstack.org/133354 | 14:32 |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: Enable RTFD hooks for Gnocchi https://review.openstack.org/134227 | 14:32 |
| zaro | sdague: we build from source but are only pulling in changes that have merged on master. | 14:32 |
| dims | sdague: here, https://review.openstack.org/#/c/132877/ has +2 from Andreas (re-posting as i switched networks) | 14:32 |
| zaro | *master/upstream | 14:32 |
| dims | fungi: gerritbot still good? | 14:32 |
| *** mase_x200 has quit IRC | 14:32 | |
| miqui | hi folks.. quick one..if i wanted to see that zuul gates are setup for a project..i just clone the infra code and take a look at the project.yaml ? | 14:33 |
| fungi | sdague: the build script is in the gerrit-package-buck job at http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/gerrit.yaml#n152 | 14:33 |
| marcusvrn | fungi: hmmm ok! any other suggestion about optimize the cinder CI? | 14:33 |
| fungi | dims: yep, so far. i've dug around in its logs a little to see whether i can tell if we've hit that code path yet. no sign of that exception getting raised, so not sure yet | 14:33 |
| zaro | sdague: also it's done with buck build system. i'm not too familiar with it :( | 14:33 |
| dims | fungi: k will check back tomorrow :) | 14:33 |
| sdague | fungi: yeh, so it turns out that sane css is basically a gwt build config var | 14:33 |
| sdague | that defaults to obfuscated | 14:34 |
| sdague | because... craziness | 14:34 |
| mordred | sdague: that is sad | 14:34 |
| sdague | mordred: agreed | 14:34 |
| mordred | we should set it to sane | 14:34 |
| *** jerryz has left #openstack-infra | 14:35 | |
| *** cpowell has joined #openstack-infra | 14:35 | |
| sdague | http://michael.laffargue.fr/blog/2013/11/29/gwt-cssresource-style-possible-values-class-names/ | 14:35 |
| zaro | pelix: hmm, so i guess maybe that change is ok as-is, just make next release 1.0.0 then? | 14:35 |
| sdague | upstream set it to stable in new releases | 14:35 |
| fungi | sdague: i would argue that step #1 is to test flipping that and deploying to review-dev, step #2 is to get that default changed upstream for less crazy, step #3 is to decide whether we're okay continuing to build our own warfile indefinitely or want to wait for them to accept that as a default build setting | 14:35 |
| sdague | however, I think stable-notype is probably sane | 14:35 |
| sdague | yeh, their upstream default is kind of slightly less crazy in another direction | 14:36 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Support copyartifact build selector param https://review.openstack.org/133774 | 14:36 |
| sdague | fungi / mordred - stable (new upstream default) produces the following kinds of classes | 14:37 |
| sdague | class="com-google-gerrit-client-change-ChangeScreen2_BinderImpl_GenCss_style-label_user" | 14:37 |
| *** koolhead17 has joined #openstack-infra | 14:37 | |
| mordred | long ... but maybe less fail to work with | 14:38 |
| sdague | mordred: sure | 14:38 |
| sdague | however label_user would be sufficient | 14:38 |
| sdague | and when it comes to writing the css by hand, giant strings that you can typo are... no fun | 14:39 |
| *** mjturek has joined #openstack-infra | 14:39 | |
| pelix | zaro: I'm happy with either 1.0.0 or 0.10.0, as I see it, just need to be able to have a clear story to follow each time we want to deprecate stuff. | 14:39 |
| sdague | fungi: where is the gerrit build process in system-config? | 14:39 |
| fungi | sdague: see above | 14:40 |
| fungi | i linked it | 14:40 |
| sdague | ah, oops | 14:40 |
| zaro | pelix: i'll do the 1.0.0, that way we don't have to go back and fix up that other one that was referencing 1.0.0 as well. | 14:41 |
| fungi | clarkb1: feel free to ignore me since you should be enjoying your vacation, but what do you think about perhaps throttling/capping requests per source address at the haproxy node? that could help avoid a "single source swamps single pool member" situation | 14:41 |
| fungi | comparing the traffic graphs of the server farm, it's got to be massive bursts of requests from a single source when we see this happen | 14:42 |
| fungi | given that the load isn't even remotely distributed across the farm | 14:43 |
| sdague | fungi: rate limitting per source sounds very reasonable | 14:44 |
| *** mikeit has joined #openstack-infra | 14:44 | |
| zaro | pelix: my concern is that jj modules (note core jenkins) deprecate often. you think we should increase major version for each one? | 14:44 |
| *** afazekas has quit IRC | 14:44 | |
| sdague | fungi: any idea where the traffic is coming from? | 14:44 |
| fungi | sdague: i can try to isolate the most recent one from the haproxy logs, but it varies over time and is not something i'm keen to play "please stop that" whack-a-mole with | 14:45 |
| *** otherwiseguy has joined #openstack-infra | 14:46 | |
| sdague | fungi: yeh, agreed, would be interesting just to know if it was mostly a few actors, or spread all over | 14:46 |
| *** IvanBerezovskiy has quit IRC | 14:47 | |
| sdague | zaro: so openstack/2.8.4 is the gerrit branch of ours that's a direct import? | 14:47 |
| zaro | sdague: yes, that should be it. | 14:48 |
| *** mikeit has quit IRC | 14:48 | |
| *** amitgandhinz has joined #openstack-infra | 14:49 | |
| *** zns has joined #openstack-infra | 14:49 | |
| sdague | so if I make the gwt change there, it will build a war? | 14:49 |
| zaro | sdague: ohh not sure what direct import means, but it's a fork of gerrit | 14:49 |
| sdague | zaro: yeh, sure | 14:49 |
| sdague | but that's what we build for gerrit and gerrit-dev, right? | 14:50 |
| zaro | sdague: yes. | 14:50 |
| *** arosen has joined #openstack-infra | 14:50 | |
| clarkb1 | fungi its image builds most likely | 14:51 |
| fungi | clarkb1: interestingly, comparing graphs, the spikes we see in cpu/load/disk activity correlate to a large spike in open connections, a medium spike in packet rate but a small (effectively nominal) spike in bandwidth consumption... that could indeed be a lot of parallel image builds coming from a single nodepool server i suppose | 14:52 |
| *** zns has quit IRC | 14:52 | |
| zaro | pelix: clearing up last msg... my concern is that jjb modules (note jjb core) deprecate often. you think we should increase major version for each deprecation that happens in a jjb module? | 14:52 |
| fungi | clarkb1: also, while they very well may be image builds, i don't think they're _our_ image builds (they happen at various times which are not coincident with our daily image update schedule) | 14:53 |
| *** mpaolino has quit IRC | 14:53 | |
| sdague | zaro: https://review.openstack.org/134238 | 14:54 |
| fungi | oh, worth noting, used memory spikes up to the capacity of the git server being hit | 14:56 |
| fungi | not buffers/cache (according to snmp anyway) but active ram | 14:57 |
| fungi | so likely the cgi | 14:57 |
| *** zns has joined #openstack-infra | 14:57 | |
| pelix | zaro: don't think it's necessary every time, just that we do it more frequently ;-) so we can clean up the code to remove the extra backwards compatible stuff | 14:57 |
| pelix | zaro: just re-read the semantic versioning doc http://semver.org/, seems like if we are to bump to a 1.0.0 release, we should be stripping everything marked deprecated just before that release? Does that seem right to you? | 14:58 |
| fungi | clarkb1: and the oom-killer kicks in because those servers have no swap | 14:59 |
| fungi | and yeah, it's "git" processes being sacrificed | 14:59 |
| *** afazekas has joined #openstack-infra | 15:00 | |
| fungi | not receive/upload pack nor the http backend | 15:00 |
| fungi | though i'm guessing all those for git anyway | 15:01 |
| *** yfried has joined #openstack-infra | 15:01 | |
| fungi | er, fork | 15:01 |
| zaro | pelix: need to take off for now. if true, i probably forgot about that. if that's that case it wouldn't make sense to do 1.0.0 right now. | 15:01 |
| sdague | fungi: if we protected git from that would it be better? | 15:02 |
| fungi | oh, they fork _from_ git, right. but it's the git parent which the oom killer snipes | 15:02 |
| *** aalekov has joined #openstack-infra | 15:02 | |
| zaro | pelix: actually if that's the case we would probably never do 1.0.0 :) we don't really have a history of when things were deprecated to know when to strip things marked deprecated. | 15:03 |
| fungi | sdague: no, i think this is probably a symptom... i suspect it's processing too many parallel requests and lacks sufficient memory for all of them, so some get prematurely terminated (which likely explains the specific error condition we see manifest in jobs) | 15:04 |
| *** ryanpetrello has joined #openstack-infra | 15:04 | |
| *** markmcclain has joined #openstack-infra | 15:05 | |
| *** otherwiseguy has quit IRC | 15:05 | |
| *** markmcclain has quit IRC | 15:05 | |
| fungi | sdague: so i'm still feeling like some sort of limit or throttle per source address is going to be needed as a stop-gap | 15:05 |
| *** jistr has quit IRC | 15:06 | |
| fungi | sdague: or, and i wasn't joking earlier, investigate an afs backend so we can potentially avoid the async replication problem with round-robin load balancing | 15:06 |
| fungi | that could still potentially allow us to spread request load evenly across the whole farm if it works | 15:07 |
| *** jistr has joined #openstack-infra | 15:07 | |
| *** markmcclain has joined #openstack-infra | 15:07 | |
| *** arosen has quit IRC | 15:07 | |
| *** isviridov is now known as isviridov_away | 15:07 | |
| *** nelsnelson has joined #openstack-infra | 15:08 | |
| fungi | which then opens us up to being able to linearly scale the farm to abosrb these spikes. right now adding more git servers wouldn't do any good because we'd still end up with one at random getting broken by these spikes | 15:08 |
| *** sdake has joined #openstack-infra | 15:08 | |
| clarkb1 | fungi are we hitting bandwidth limits on git.o.o again? | 15:09 |
| *** mpaolino has joined #openstack-infra | 15:09 | |
| clarkb1 | should be 800mbps for eth0 now | 15:09 |
| *** clarkb1 is now known as clarkb | 15:10 | |
| fungi | clarkb: nope. during the incident this morning we were between 200-300mbps | 15:11 |
| openstackgerrit | Sean Dague proposed openstack/requirements: Upgrade to pylint >=1.3.0 https://review.openstack.org/131310 | 15:11 |
| *** armax has joined #openstack-infra | 15:11 | |
| fungi | clarkb: and as i said, the spikes weren't spikes in bandwidth utilization at all, they were spikes in outbount packet rate and open sockets (but not in new connections). so like some single source tried to clone nova 80 times in parallel | 15:12 |
| fungi | or maybe not even clone. something long-running but which transfers little actual data/uses small packets | 15:13 |
| fungi | and generates lots of local disk i/o and eats memory | 15:13 |
| *** dizquierdo has joined #openstack-infra | 15:13 | |
| clarkb | the haproxy logs should capture that | 15:14 |
| fungi | i'm having trouble figuring out how to profile that from the logs though | 15:14 |
| clarkb | perhaps sort by bytes transfered? | 15:14 |
| fungi | well, it wasn't really a noticeable spike in bandwidth though | 15:15 |
| *** vigneshvar has joined #openstack-infra | 15:15 | |
| *** gokrokve_ has joined #openstack-infra | 15:15 | |
| *** fandi has quit IRC | 15:16 | |
| *** zz_gondoi is now known as gondoi | 15:16 | |
| *** tsg has quit IRC | 15:16 | |
| openstackgerrit | Sean Dague proposed openstack-infra/system-config: deploy the non obfuscated css version of gerrit to review-dev https://review.openstack.org/134246 | 15:16 |
| sdague | fungi: like that ^^^^ | 15:17 |
| ttx | fungi: hey! Looking into separating the meetings YAML from the gerrit-powered-agenda codebase | 15:18 |
| *** berendt has quit IRC | 15:18 | |
| ttx | there would be openstack/meetings on one side and openstack-infra/gerrit-powered-agenda on the other | 15:18 |
| *** gokrokve has quit IRC | 15:19 | |
| fungi | ttx: sounds straightforward | 15:19 |
| *** lxsli has left #openstack-infra | 15:19 | |
| ttx | was wondering what would be the best way to do this... Set up some cleaned-up repo on github for you to import ? | 15:19 |
| openstackgerrit | Oleksii Chuprykov proposed openstack-infra/project-config: Check requirements correctly https://review.openstack.org/134247 | 15:19 |
| ttx | should it be openstack-infra/meetings ? | 15:20 |
| fungi | ttx: yeah, that's what we usually do... git filter-branch out a meetings repo and stick it somewhere we can clone, then propose a new project importing that, and submit a change to gerrit-powered-agenda which deletes those files | 15:20 |
| ttx | ok, makes sense | 15:20 |
| ttx | planet is openstack-infra/planet so I guess meetings should be under -infra as well | 15:21 |
| fungi | ttx: i guess the openstack vs openstack-infra for the meetings repo depends on where you'd stick that in the programs.yaml in governance | 15:21 |
| *** hdd has quit IRC | 15:21 | |
| *** skolekonov has quit IRC | 15:21 | |
| fungi | not entirely sure i'd use planet as precedent since it's been around for so long it likely predates our thinking about these sorts of concerns | 15:22 |
| *** hdd has joined #openstack-infra | 15:23 | |
| ttx | hmm, yeah. I'm fine with either | 15:23 |
| fungi | also, planet is actually openstack/openstack-planet but adopted by the infra program, according to governance | 15:23 |
| fungi | i'm sure we'd be fine with openstack-infra/meetings regardless | 15:23 |
| ttx | maybe openstack/openstack-meetings | 15:23 |
| fungi | i'm going to try to stop bikeshedding on names now ;) | 15:24 |
| *** marun has joined #openstack-infra | 15:25 | |
| *** stevemar has joined #openstack-infra | 15:26 | |
| *** tonytan4ever has joined #openstack-infra | 15:26 | |
| aalekov | Hi all, Does anybody can explain me in which jenkins jobs we run all tempest tests? | 15:28 |
| *** hdd has quit IRC | 15:28 | |
| fungi | aalekov: i don't think any one single job can run all tempest tests because some tests depend on mutually-exclusive deployment configurations, but #openstack-qa is probably a better place to ask | 15:29 |
| *** pcrews has joined #openstack-infra | 15:29 | |
| openstackgerrit | Merged openstack-dev/hacking: Include example of multiple imports using from syntax https://review.openstack.org/133693 | 15:31 |
| *** otherwiseguy has joined #openstack-infra | 15:33 | |
| fungi | woohoo! https://bitbucket.org/pypa/wheel/pull-request/45 merged!!! | 15:34 |
| fungi | SpamapS: ^ that has been blocking wheelification of tripleo-image-elements | 15:35 |
| pelix | zaro: with adding the folder support to JJB, jenkins has a concept of 'getfullname()', which for each job will return [<folder>/]<name>. think it's better to replace the XmlJob 'name' attribute with the fullname, or add a new attribute? | 15:35 |
| *** wenlock has joined #openstack-infra | 15:35 | |
| sdague | fungi: are the merge check jobs actually still running? | 15:35 |
| *** annegent_ has joined #openstack-infra | 15:35 | |
| sdague | because.... most of the nova changes should all have been borked by what I merged last night | 15:35 |
| pelix | zaro: for the moment I've added a new attribute, but it seems like then end up never using name directly again | 15:35 |
| fungi | sdague: the sparkline says they are, but... | 15:36 |
| *** arxcruz has quit IRC | 15:36 | |
| SpamapS | fungi: VERY NICE | 15:36 |
| pelix | zaro: but that may be because I've also changed all the filtering/matching globs to check against the fullname at all times. | 15:37 |
| fungi | sdague: i'll see if i can find some confirmation | 15:37 |
| *** rushiagr_away is now known as rushiagr | 15:38 | |
| *** armax has quit IRC | 15:39 | |
| *** dizquierdo has quit IRC | 15:41 | |
| fungi | sdague: https://review.openstack.org/133125 merged at ~15:11 and at 15:14 zuul added 500 nova changes to the merge-check pipeline according to its logs | 15:43 |
| sdague | fungi: ok | 15:44 |
| sdague | maybe it missed the one I just reviewed | 15:44 |
| fungi | sdague: can you point me to the change which has a merge conflict we didn't report? | 15:45 |
| sdague | fungi: https://review.openstack.org/#/c/116502/ | 15:45 |
| fungi | sdague: that's at least something specific i can trace in the logs | 15:45 |
| sdague | when it entered the gate pipeline, it correctly flagged as merge conflict | 15:45 |
| fungi | sdague: that one was not added to the merge-check pipeline | 15:47 |
| fungi | sdague: very strange | 15:47 |
| fungi | sdague: also the 500 changes i counted was an exact number... suspiciously round | 15:48 |
| sdague | yeh | 15:50 |
| sdague | I wonder if there is a limit we are hitting? | 15:50 |
| sdague | 500 I think is the default page limit with the gerrit cli | 15:50 |
| fungi | i don't find a 500 hard-coded in zuul's source at any rate, not that i expected to | 15:50 |
| fungi | ohhhhh | 15:50 |
| fungi | maybe we're not handling pagination | 15:50 |
| *** armax has joined #openstack-infra | 15:51 | |
| sdague | yeh, probably not | 15:51 |
| fungi | okay, i'll file a story | 15:51 |
| sdague | fungi: where is the script that grabs that? I might be able to hack off a quick change | 15:51 |
| *** Sincler has joined #openstack-infra | 15:51 | |
| fungi | i think zuul/trigger/zuultrigger.py but i'm diving to confirm | 15:53 |
| *** jistr has quit IRC | 15:53 | |
| *** gokrokve_ has quit IRC | 15:53 | |
| *** gokrokve has joined #openstack-infra | 15:54 | |
| fungi | sdague: yeah, it's the project-change-merged trigger added in https://review.openstack.org/112411 | 15:55 |
| *** cnesa has quit IRC | 15:56 | |
| *** bhunter71 has joined #openstack-infra | 15:57 | |
| fungi | sdague: aha, it's getProjectOpenChanges() in zuul/trigger/gerrit.py | 15:57 |
| *** dizquierdo has joined #openstack-infra | 15:57 | |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config: Add magnum to the irc channel output https://review.openstack.org/134260 | 15:57 |
| *** groknix has joined #openstack-infra | 15:59 | |
| *** zns has quit IRC | 15:59 | |
| *** jlibosva has quit IRC | 15:59 | |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config: Add magnum to the irc channel output https://review.openstack.org/134260 | 16:00 |
| *** MaxV has quit IRC | 16:00 | |
| *** jlibosva has joined #openstack-infra | 16:01 | |
| *** bdpayne has joined #openstack-infra | 16:02 | |
| *** MaxV has joined #openstack-infra | 16:03 | |
| *** gondoi is now known as zz_gondoi | 16:03 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: Allow spec2bp.py to work for Oslo projects https://review.openstack.org/134274 | 16:04 |
| *** vrutkovs has joined #openstack-infra | 16:04 | |
| *** vrutkovs_ has quit IRC | 16:06 | |
| openstackgerrit | Lukas Bednar proposed openstack-infra/jenkins-job-builder: publishers: groovy-postbuild changes between 1.x & 2.x https://review.openstack.org/134276 | 16:06 |
| *** eharney has quit IRC | 16:06 | |
| *** bhuvan has joined #openstack-infra | 16:07 | |
| fungi | also, just after a neutron change merged, i watched merge-check bloat up with 253 changes | 16:08 |
| fungi | so it at least seems to be working normally otherwise | 16:09 |
| sdague | fungi: yeh, so there are 788 open nova changes | 16:11 |
| fungi | sdague: almost positive that's it then | 16:11 |
| sdague | yep | 16:11 |
| sdague | I also tested that the default behavior is 500 changes | 16:11 |
| sdague | ok, I'll implement pagination | 16:11 |
| fungi | so presumably extending getProjectOpenChanges() to handle paginated results ought to solve this | 16:12 |
| *** hamzy_ is now known as hamzy | 16:12 | |
| fungi | might need to be tackled in the simple query method that's calling | 16:12 |
| *** sergsh has joined #openstack-infra | 16:12 | |
| *** kirshil has joined #openstack-infra | 16:13 | |
| *** kashyap has quit IRC | 16:13 | |
| *** links has quit IRC | 16:14 | |
| *** xyang0 has quit IRC | 16:14 | |
| openstackgerrit | mark mcclain proposed openstack/requirements: bump pecan minimum version number to 0.8.8 https://review.openstack.org/134280 | 16:17 |
| openstackgerrit | mark mcclain proposed openstack/requirements: bump pecan minimum version number to 0.8.0 https://review.openstack.org/134280 | 16:18 |
| *** dizquierdo has quit IRC | 16:18 | |
| *** kashyap_afk has joined #openstack-infra | 16:18 | |
| *** kashyap_afk is now known as kashyap | 16:19 | |
| *** ildikov has quit IRC | 16:19 | |
| *** amuller has quit IRC | 16:19 | |
| *** p5ntangle has quit IRC | 16:19 | |
| *** thedodd has joined #openstack-infra | 16:20 | |
| *** p5ntangle has joined #openstack-infra | 16:20 | |
| *** yamahata has quit IRC | 16:20 | |
| sdague | fungi: also I think we're excluding the last element in the array twice | 16:21 |
| *** p5ntangle has quit IRC | 16:21 | |
| fungi | oh? | 16:22 |
| fungi | off-by-one error? | 16:22 |
| *** mrmartin has quit IRC | 16:22 | |
| *** p5ntangle has joined #openstack-infra | 16:22 | |
| *** bhuvan has quit IRC | 16:23 | |
| sdague | yeh | 16:25 |
| sdague | simple query seems to get rid of the end token already | 16:25 |
| sdague | then we do it again in getProjectOpenChanges | 16:26 |
| sdague | anyway, first pass change nearly ready | 16:26 |
| sdague | running tests | 16:26 |
| *** dmsimard is now known as dmsimard_away | 16:26 | |
| *** links has joined #openstack-infra | 16:27 | |
| *** Longgeek has quit IRC | 16:28 | |
| *** HeOS has quit IRC | 16:29 | |
| *** markmcclain has quit IRC | 16:30 | |
| openstackgerrit | Sean Dague proposed openstack-infra/zuul: implement gerrit pagination in simplequery https://review.openstack.org/134283 | 16:31 |
| sdague | fungi: ok, first pass. I'm slightly under the weather, so careful eyes probably appropriate | 16:31 |
| *** lttrl has quit IRC | 16:31 | |
| fungi | sdague: understood. le malaise du conférence is persisting for me as well | 16:31 |
| sdague | yeh, fortunately it seems like just a cold. But it is annoying | 16:32 |
| fungi | same | 16:32 |
| *** salv-orlando has joined #openstack-infra | 16:32 | |
| clarkb | I am trying to cure it with lots of kolsch | 16:32 |
| fungi | i have taken to rum. beer wasn't cutting it | 16:32 |
| clarkb | I need to wander shortly to find $meat to go with kolsch | 16:33 |
| clarkb | turns out you can eat all the meats here | 16:33 |
| *** vigneshvar has quit IRC | 16:33 | |
| *** cnesa has joined #openstack-infra | 16:33 | |
| fungi | indeed. particularly those in casings | 16:33 |
| * fungi needs to get back there | 16:33 | |
| *** Guest17627 is now known as redrobot | 16:34 | |
| *** dmsimard_away is now known as dmsimard | 16:34 | |
| *** talluri has joined #openstack-infra | 16:34 | |
| greghaynes | clarkb: yes, kolsch + meat | 16:35 |
| fungi | sdague: lgtm, but since it's not entirely urgent i'll leave it to collect more reviews | 16:35 |
| sdague | fungi: agreed | 16:35 |
| *** bhuvan has joined #openstack-infra | 16:36 | |
| arosen1 | hiya fungi I got another nodepool dib question :/ | 16:36 |
| *** berendt has joined #openstack-infra | 16:37 | |
| arosen1 | It seems my nodepool dib images are getting created and deployed fine but nodepool isn't able to login to them. | 16:37 |
| arosen1 | I'm wondering what the role of passing privatekey here is? https://github.com/openstack-infra/system-config/blob/master/modules/openstack_project/templates/nodepool/nodepool.yaml.erb#L553 | 16:37 |
| *** rfolco has quit IRC | 16:37 | |
| *** annegent_ has quit IRC | 16:37 | |
| *** dizquierdo has joined #openstack-infra | 16:38 | |
| *** salv-orlando has quit IRC | 16:38 | |
| arosen1 | in my non dib setup i pass keypair as part of the provider section and that seems to inject the key into the instance for me to allow nodepool to access it i believe. | 16:38 |
| *** annegent_ has joined #openstack-infra | 16:38 | |
| fungi | arosen1: that's telling nodepool what key to use to log in, but since nodepool isn't directly responsible for the _content_ of your images you still need some mechanism to add the public key to authorized keys for the account you're logging into | 16:38 |
| fungi | arosen1: we do that in our images via a puppet manifest | 16:39 |
| *** ashaeron has quit IRC | 16:39 | |
| *** dangers_away is now known as dangers | 16:39 | |
| *** tswanson_ has left #openstack-infra | 16:39 | |
| fungi | arosen1: but if your image configuration is not puppet-based, you'd need to adapt some other mechanism | 16:39 |
| arosen1 | fungi: Sorry i'm confused by, "if your image configuration is not puppet-based" I thought nodepool builds the images? | 16:41 |
| arosen1 | where is the puppet based part? | 16:41 |
| fungi | arosen1: for us, it's puppet apply being called in node prep scripts or from dib elements | 16:42 |
| fungi | arosen1: applying our openstack_project::slave class | 16:42 |
| *** mwagner_lap has quit IRC | 16:42 | |
| fungi | arosen1: that sets up the keys we want in the images | 16:43 |
| arosen1 | fungi: by prep script you mean the setup: section here? https://github.com/openstack-infra/system-config/blob/master/modules/openstack_project/templates/nodepool/nodepool.yaml.erb#L523 | 16:43 |
| *** mmaglana has joined #openstack-infra | 16:44 | |
| openstackgerrit | Darragh Bailey proposed openstack-dev/hacking: Add import check for try/except wrapped imports https://review.openstack.org/134288 | 16:44 |
| *** lttrl has joined #openstack-infra | 16:45 | |
| fungi | arosen1: for us it's http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/scripts/prepare_node.sh#n61 or http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/puppet/bin/prepare-node#n34 depending on the image creation mode | 16:46 |
| *** armax has quit IRC | 16:46 | |
| fungi | arosen1: those are applying the http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/single_use_slave.pp manifest | 16:47 |
| arosen1 | http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/puppet/bin/prepare-node#n34 <-- is being used in the dib case? | 16:47 |
| fungi | arosen1: and you can see that then $openstack_project::jenkins_ssh_key is passed down into the jenkins::slave class | 16:47 |
| fungi | arosen1: yep, elements implies dib | 16:48 |
| *** otherwiseguy has quit IRC | 16:48 | |
| fungi | arosen1: and then in http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/jenkins/manifests/slave.pp you can see it trickling into the jenkins::jenkinsuser class | 16:49 |
| arosen1 | fungi: so in the dib case should this script be reference in the nodepool.yaml file anywhere? I see that for all the dib images there is no setup: section | 16:49 |
| *** MaxV has quit IRC | 16:50 | |
| fungi | arosen1: it's referenced in the elements list of a diskimages entry, for example http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/nodepool/nodepool.yaml.erb#n1094 | 16:50 |
| *** rfolco has joined #openstack-infra | 16:51 | |
| *** jistr has joined #openstack-infra | 16:51 | |
| arosen1 | fungi: ah okay so i have that too in mine: http://paste.openstack.org/show/132872/ | 16:51 |
| arosen1 | fungi: i guess there is some additional configuration i need to do besides configure nodepool to get this puppet element working? | 16:52 |
| *** vigneshvar has joined #openstack-infra | 16:52 | |
| *** mwhudson has quit IRC | 16:52 | |
| *** mwhudson has joined #openstack-infra | 16:52 | |
| *** vrutkovs has quit IRC | 16:53 | |
| fungi | arosen1: so for us, openstack_project::single_use_slave is pulling in $openstack_project::jenkins_ssh_key from http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/init.pp | 16:53 |
| *** vrutkovs has joined #openstack-infra | 16:53 | |
| *** dangers is now known as dangers_away | 16:54 | |
| *** otherwiseguy has joined #openstack-infra | 16:55 | |
| arosen1 | fungi: so the line: elements: - puppet; has some assumption that puppet is already installed on the nodepool box? | 16:55 |
| fungi | arosen1: but you could just override your puppet element to pass something similar as an $ssh_key value in http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/puppet/bin/prepare-node#n34 which would override it | 16:55 |
| *** vrutkovs has quit IRC | 16:55 | |
| krotscheck | fungi: Did you see my comments about the missing stories yesterday? | 16:56 |
| fungi | krotscheck: yep | 16:57 |
| fungi | krotscheck: do they not automatically get associated with additional projects? | 16:57 |
| pleia2 | good morning | 16:57 |
| *** tsg has joined #openstack-infra | 16:57 | |
| fungi | krotscheck: we're likely to end up with a lot of multi-project bugs to import | 16:57 |
| *** derekh has quit IRC | 16:58 | |
| *** david-lyle_afk is now known as david-lyle | 16:58 | |
| *** ildikov has joined #openstack-infra | 16:58 | |
| krotscheck | fungi: No they don’t because we can’t assume that the other projects exist in storyboard | 16:59 |
| fungi | arosen1: puppet gets installed first by http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/puppet/install.d/05-puppet | 16:59 |
| krotscheck | So if we import something that depends on horizon and nova, and nova hasn’t migrated yet, then there’s no project to associate it to. | 16:59 |
| arosen1 | fungi: and that is done in the disk image? I don't actually need puppet installed on my nodepool box right? | 17:00 |
| krotscheck | fungi: So instead we doublecheck for preexisting records and add tasks for when there’s missing projects (https://review.openstack.org/#/c/134084/) | 17:00 |
| *** salv-orlando has joined #openstack-infra | 17:00 | |
| fungi | krotscheck: right, but then when we import nova, is there any way for the import script to see that while the story is in the db it isn't yet associated with nova and then add that task? | 17:00 |
| *** berendt has quit IRC | 17:00 | |
| *** e0ne has quit IRC | 17:01 | |
| *** e0ne_ has joined #openstack-infra | 17:01 | |
| fungi | arosen1: right | 17:01 |
| fungi | krotscheck: aha, that's what your proposed change does. excellent | 17:01 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/gearman-plugin: Switched documentation to point to storyboard. https://review.openstack.org/133844 | 17:01 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/gearman-plugin: Switched documentation to point to storyboard. https://review.openstack.org/133844 | 17:02 |
| fungi | krotscheck: i think we'll probably want to run a second pass import of all those infra projects anyway before we lock down bugs in lp for them | 17:02 |
| arosen1 | fungi: hrm so I guess everything is working except that the jenkins_ssh_key here: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/init.pp#n5 doesn't match up to my private key? | 17:02 |
| *** amuller has joined #openstack-infra | 17:02 | |
| *** eharney has joined #openstack-infra | 17:02 | |
| fungi | arosen1: right, and as i said you could just pass in an ssk_key override in the puppet element | 17:03 |
| fungi | arosen1: rather than modifying the manifest | 17:03 |
| *** eharney is now known as Guest74299 | 17:03 | |
| *** sdake has quit IRC | 17:03 | |
| *** salv-orlando has quit IRC | 17:04 | |
| *** Mmike has quit IRC | 17:05 | |
| *** Mmike has joined #openstack-infra | 17:05 | |
| openstackgerrit | Merged openstack/requirements: Bump glance_store to 0.1.9 https://review.openstack.org/133653 | 17:05 |
| morganfainberg | ok because i don't have a good answer for this... what is the best way of handling "optional" deps in OpenStack projects. | 17:05 |
| morganfainberg | e.g. pycrypto/memcache in keystonemiddleware | 17:05 |
| *** Guest74299 has quit IRC | 17:06 | |
| morganfainberg | i'm guessing a better pluggable design that allows us to do pip install <plugin> | 17:06 |
| *** nikhil_k is now known as nikhil_k|afk | 17:06 | |
| *** dannywilson has joined #openstack-infra | 17:06 | |
| arosen1 | fungi: though isn't: http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/puppet/bin/prepare-node#n34 <-- this file pulled down from git via nodepool to build the image? | 17:06 |
| morganfainberg | rather than core functionality being in place assuming you need a lib if you don't have it. | 17:07 |
| krotscheck | fungi: I agree | 17:07 |
| *** rushiagr is now known as rushiagr_away | 17:07 | |
| krotscheck | Are all the git-review tests just bad? | 17:08 |
| *** miqui has quit IRC | 17:08 | |
| * krotscheck is trying to figure out why his build died. | 17:08 | |
| *** _nadya_ has joined #openstack-infra | 17:08 | |
| fungi | arosen1: nope, we install the dib element tree on the nodepool server and it uses the local copy it has to build images, same for the prep scripts using the traditional (pre-dib) method. we designed it with the assumption downstream consumers would supply their own dib elements or prep scripts | 17:09 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/git-review: Switched documentation to point to storyboard https://review.openstack.org/133847 | 17:10 |
| sdague | dims: approved - https://review.openstack.org/#/c/132877/6 | 17:10 |
| dims | thanks | 17:10 |
| dims | thanks sdague | 17:10 |
| fungi | morganfainberg: at the moment there's no "good" way. the closest thing we have is to use separate requirements lists like some libs are doing when they need different dependencies for various interpreter versions. it's an ugly hack | 17:10 |
| morganfainberg | fungi, ugh. | 17:10 |
| *** miqui has joined #openstack-infra | 17:11 | |
| fungi | morganfainberg: in general, the python packaging ecosystem hasn't provided a great default mechanism to support that | 17:11 |
| *** dannywilson has quit IRC | 17:11 | |
| morganfainberg | fungi, i asked because we had a bug opened against middleware because we don't have pycrypto in the reqs -- which causes ick in some cases | 17:11 |
| morganfainberg | fungi, that is truely unfortunate. | 17:11 |
| *** dannywilson has joined #openstack-infra | 17:11 | |
| morganfainberg | fungi, at least i know we can doc better and guard against complete failure (or make it go "OMG INSTALL XXX IF YOU WANT FEATURE" | 17:12 |
| fungi | morganfainberg: right, the current best options are to either include pycrypto by default in your requirements, or put a very loud note in the readme/docs recommending it for specific deployment choices | 17:12 |
| morganfainberg | fungi, thanks! | 17:12 |
| *** afazekas has quit IRC | 17:12 | |
| *** shashankhegde has joined #openstack-infra | 17:12 | |
| fungi | krotscheck: yes, broken. some time between october 10 and october 20 the rebase-oriented tests ceased rebasing anything. i started to pick it apart, but am sort of buried so any help is welcome | 17:13 |
| *** Guest54421 has quit IRC | 17:13 | |
| fungi | krotscheck: as best i can tell, it neither corresponds to any change merged to git-review nor to any changes in its dependencies (i can reproduce with a commit which used to pass and with the same packages as listed by pip freeze from a successful run) | 17:14 |
| krotscheck | fungi: That’s a bit outside of my area of expertise, but I can take a look. | 17:15 |
| fungi | krotscheck: also it doesn't look like any system packages i would have expected to be involved in the chain received updates from distros | 17:15 |
| arosen1 | fungi: ah so can't i just change the jenkin_ssh_key here: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/init.pp | 17:15 |
| fungi | so sort of stumped | 17:15 |
| arosen1 | fungi: whoops * sorry ignore that. | 17:15 |
| fungi | krotscheck: further, it seems to happen on multiple platforms/different distros/releases | 17:16 |
| fungi | i'll pick it back up again in a bit | 17:16 |
| openstackgerrit | Merged openstack-infra/project-config: Add funtional tests job for python-manilaclient https://review.openstack.org/134137 | 17:16 |
| openstackgerrit | Darragh Bailey proposed stackforge/python-jenkins: basic support for folder plugin https://review.openstack.org/133300 | 17:17 |
| *** kashyap_afk has joined #openstack-infra | 17:17 | |
| *** melwitt has joined #openstack-infra | 17:17 | |
| *** dtantsur is now known as dtantsur|afk | 17:18 | |
| krotscheck | fungi: These error logs suggest either a key expired, or the client doesn’t talk the same SSL protocol. | 17:18 |
| krotscheck | Did we update gerrit to use TLS and disable SSL-all-the-other-ones? | 17:19 |
| arosen1 | fungi: so you're saying i should make this change: http://paste.openstack.org/show/132889/ | 17:19 |
| openstackgerrit | Merged openstack-infra/project-config: Fix typo for manila tempest job https://review.openstack.org/134138 | 17:19 |
| *** mtreinish has quit IRC | 17:19 | |
| *** Guest54421 has joined #openstack-infra | 17:19 | |
| fungi | krotscheck: er, it's possible this is some poodle fallout from one of the system-level libs | 17:19 |
| krotscheck | I feel this line is relevant: | 17:19 |
| krotscheck | (client: ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521 / server: ssh-rsa) | 17:19 |
| fungi | krotscheck: just odd that i only saw it impact the rebase-oriented tests | 17:19 |
| openstackgerrit | Merged openstack-infra/project-config: Add the prep-source-repos project https://review.openstack.org/129533 | 17:19 |
| openstackgerrit | Merged openstack-infra/project-config: Create repo for oslo.context https://review.openstack.org/132877 | 17:20 |
| openstackgerrit | Merged openstack-infra/project-config: Turn on python build jobs for monasca-api https://review.openstack.org/133995 | 17:20 |
| *** kashyap has quit IRC | 17:20 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Basic folder support https://review.openstack.org/134307 | 17:20 |
| *** links has quit IRC | 17:20 | |
| fungi | krotscheck: and it affected both ssh and https based tests which would be doubly-weird to seem impacted together in the same fashion | 17:20 |
| krotscheck | Well, it might be that the process to resolve the HEAD revision from gerrit for the various pre-submit sanity checks and rebase checks requires additional steps that go through a different api flow | 17:21 |
| * krotscheck digs more. | 17:21 | |
| *** _nadya_ has quit IRC | 17:21 | |
| *** links has joined #openstack-infra | 17:21 | |
| pelix | zaro: combination of https://review.openstack.org/133300 and https://review.openstack.org/134307 shows a POC for support for the folder plugin in JJB. Still needs a fair bit of work, especially around tests and also to decide whether it might be easier to switch to jenkinsapi instead of trying to hack in correct support in all cases. | 17:22 |
| krotscheck | fungi: Hrm. A couple of questions on these tests: Do they hit a test-instance of gerrit to run, or is this hitting prod? | 17:24 |
| *** e0ne_ has quit IRC | 17:24 | |
| fungi | krotscheck: they configure and start up a test gerrit at the user running the test | 17:24 |
| pelix | zaro: also have yet to look at what would be required to control the base folder pre-pended to all jobs from the JJB command line beyond switching the server url from http://jenkins/ to http://jenkins/<folder>/job/ which works but means that you end up managing each folder as a separate server. | 17:24 |
| krotscheck | ok | 17:24 |
| krotscheck | So it’s not the test instance running out of file descriptors | 17:24 |
| * krotscheck found a quote of “no hostkey alg”, for which there appear to me multiple solutions | 17:25 | |
| fungi | krotscheck: hopefully not. they download the gerrit warfile and launch it locally, then create some "very small projects" to interact with as a test ficxture | 17:25 |
| fungi | er, fixture | 17:25 |
| *** e0ne has joined #openstack-infra | 17:26 | |
| krotscheck | fungi: Well, if the connection fails I feel it’s a problem with the server. | 17:26 |
| *** andymaier has quit IRC | 17:26 | |
| krotscheck | fungi: I’m going to try to spin up that instance and see whether I can do SSH connections myself. | 17:26 |
| * krotscheck may have limited success running on OSX. | 17:26 | |
| fungi | krotscheck: possibly, though a connection problem over loopback obviously | 17:26 |
| fungi | krotscheck: also while i did compare the gerrit warfile version was the same in earlier passing jobs, it's _possible_ they rereleased the same version with modifications $because_poodle or some such (we don't spit out a checksum of the download in the log unfortunately) | 17:27 |
| *** tonytan4ever has quit IRC | 17:27 | |
| *** baoli has quit IRC | 17:27 | |
| fungi | i sincerely hope they wouldn't do something silly like that though | 17:28 |
| *** markmcclain has joined #openstack-infra | 17:28 | |
| *** dannywilson has quit IRC | 17:28 | |
| *** dannywilson has joined #openstack-infra | 17:29 | |
| *** bhuvan has quit IRC | 17:30 | |
| *** markmcclain1 has joined #openstack-infra | 17:30 | |
| zaro | pelix: is there folder support in jenkinsapi? | 17:30 |
| *** jpich has quit IRC | 17:31 | |
| *** jistr has quit IRC | 17:32 | |
| *** dimtruck is now known as zz_dimtruck | 17:32 | |
| *** baoli has joined #openstack-infra | 17:32 | |
| *** mrmartin has joined #openstack-infra | 17:32 | |
| *** markmcclain has quit IRC | 17:32 | |
| *** beekneemech is now known as bnemec | 17:33 | |
| krotscheck | fungi: It doesn’t _look_ rereleased, though I’m going off the header. | 17:33 |
| *** openstackgerrit has quit IRC | 17:34 | |
| pelix | zaro: there seems to be the appearance of such, but I haven't quite established just exactly what is there. Believe the POC there for JJB is something that could be used to determine if jenkinsapi does what's needed, but certainly needs more tests. | 17:34 |
| *** openstackgerrit has joined #openstack-infra | 17:34 | |
| fungi | krotscheck: yeah, it was a fleeting thought but i pretty quickly ruled it way down the list of possible causes | 17:34 |
| sdague | what is tricircle ? | 17:35 |
| sdague | oh, it's the cascading folks | 17:35 |
| *** bdpayne has quit IRC | 17:37 | |
| *** achanda has joined #openstack-infra | 17:37 | |
| pelix | zaro: the one thing that jenkinsapi does do that probably makes things much easier, is to use the 'url' data returned to perform operations instead of needing to convert between job names when resolving | 17:37 |
| pelix | but it's not clear yet if it can support creating jobs easily in folders. | 17:37 |
| *** kashyap_afk is now known as kashyap | 17:38 | |
| *** links has quit IRC | 17:38 | |
| *** vdo has quit IRC | 17:39 | |
| openstackgerrit | Khai Do proposed stackforge/python-jenkins: Yield HTTPError reason on open error https://review.openstack.org/106314 | 17:41 |
| *** Sincler has quit IRC | 17:41 | |
| *** Sincler has joined #openstack-infra | 17:41 | |
| zaro | pelix: ^ ready to go? | 17:42 |
| sdague | zaro: do you have a timeline for a gerrit 2.9 upgrade in infra? | 17:42 |
| sdague | I *really* want the conflicts with bit | 17:42 |
| *** vigneshvar has quit IRC | 17:43 | |
| zaro | sdague: not discussed yet but let me add a topic to infra meeting to discuss gerrit upgrade. | 17:44 |
| zaro | pelix: i'll have to take a look at it when i do the review. | 17:45 |
| sdague | fungi: ... so... regarding git falling over | 17:45 |
| sdague | I just noticed this patch - https://review.openstack.org/#/c/131784/2/nodepool/scripts/cache_git_repos.py,cm | 17:45 |
| sdague | I wonder if redhat testing that patch is part of the challenge | 17:46 |
| fungi | sdague: oh... maybe! afazekas would know if it's being tested out there and at what times? | 17:48 |
| sdague | because don't we also have the issue that all nodepool images are built in parallel | 17:48 |
| fungi | sdague: yep | 17:48 |
| sdague | ok, so I -1ed that change until there are more answers there | 17:48 |
| fungi | sdague: so that's 16 parallel clones x the number of images being built | 17:48 |
| *** lttrl has quit IRC | 17:49 | |
| sdague | yeh | 17:49 |
| fungi | sdague: and we already sort of dos ourselves when doing serial cloning since we build a few dozen images at the same time | 17:49 |
| *** colettecello is now known as gothicmindfood | 17:50 | |
| fungi | sdague: though right now the load for us is spread across the farm for traditional nodepool images, however dib images are all built from the nodepool server directly and would therefore get shunted to one git server in the farm (thankfully dib also means fewer images to build at the same time) | 17:50 |
| openstackgerrit | Merged openstack-infra/project-config: ironic-discoverd - hardware properties discovery for Ironic https://review.openstack.org/133473 | 17:51 |
| sdague | well, I've heard that dib will bring world peace for a while :) | 17:51 |
| *** ivar-lazzaro has joined #openstack-infra | 17:51 | |
| fungi | also, if dib doesn't keep a local cache of the git repos to seed the images, it should be fixed | 17:51 |
| *** ivar-lazzaro has quit IRC | 17:52 | |
| zaro | sdague: how do you plan to test https://review.openstack.org/#/c/134238 ? | 17:52 |
| *** gokrokve_ has joined #openstack-infra | 17:52 | |
| fungi | and i'm pretty sure cache_git_repos.py isn't used by dib anyway. we have a dib element which performs a similar task | 17:52 |
| *** achanda has quit IRC | 17:52 | |
| *** ivar-lazzaro has joined #openstack-infra | 17:53 | |
| zaro | sdague: should we manually update review-dev? or make a change to system-config | 17:53 |
| zaro | ? | 17:53 |
| *** SumitNaiksatam has joined #openstack-infra | 17:54 | |
| fungi | zaro: it's already proposed in https://review.openstack.org/134246 | 17:54 |
| zaro | cool, i didn't notice that. | 17:55 |
| *** tonytan4ever has joined #openstack-infra | 17:55 | |
| openstackgerrit | Merged openstack-infra/project-config: We have a stable/icehouse branch https://review.openstack.org/133235 | 17:55 |
| *** gokrokve has quit IRC | 17:55 | |
| *** gokrokve_ has quit IRC | 17:56 | |
| *** achanda has joined #openstack-infra | 17:56 | |
| openstackgerrit | Merged openstack-infra/project-config: Removes docimpactgroup: openstack-manuals for select Oslo repos https://review.openstack.org/125465 | 17:58 |
| *** patrickeast has joined #openstack-infra | 17:58 | |
| fungi | sdague: yeah, after some hunting, it's this dib element which is responsible for retrieving our source repos... https://git.openstack.org/cgit/openstack/diskimage-builder/tree/elements/source-repositories/extra-data.d/98-source-repositories and it seems to do some aggressive caching locally | 17:58 |
| pelix | zaro: seems that it's not straight forward to create jobs in folders with jenkinsapi either | 17:59 |
| *** tonytan4ever has quit IRC | 18:00 | |
| *** Ryan_Lane has joined #openstack-infra | 18:01 | |
| *** vponomaryov has left #openstack-infra | 18:01 | |
| *** vponomaryov has joined #openstack-infra | 18:02 | |
| sdague | fungi: you know, the thing about zuul gerrit queries capping at 500 | 18:02 |
| sdague | is that the most likely to merge conflict changes in nova... i.e. the oldest ones, are the ones not checked | 18:02 |
| fungi | sdague: yep | 18:03 |
| *** gokrokve has joined #openstack-infra | 18:03 | |
| fungi | sdague: definitely not optimal | 18:03 |
| sdague | ok, just went through the entire project-config backlog of reviews for me. Lots of repo building in the gate now | 18:03 |
| fungi | sdague: clearly the answer is to have fewer than 500 open changes in nova ;) | 18:03 |
| *** openstackgerrit has quit IRC | 18:03 | |
| sdague | yeh... that would be nice | 18:03 |
| *** openstackgerrit has joined #openstack-infra | 18:04 | |
| *** amuller has quit IRC | 18:05 | |
| *** bdpayne has joined #openstack-infra | 18:06 | |
| pelix | zaro: looks like jenkinsapi anchor the create calls to the top level, which is wrong for creating jobs under folders. So either will need further work on python-jenkins to support <folder>/<job> syntax fully, or to use jenkinsapi the JJB Jenkins class will have to be extended to abstract all the details. | 18:06 |
| *** mmaglana has quit IRC | 18:06 | |
| *** jlibosva has quit IRC | 18:07 | |
| *** mmaglana has joined #openstack-infra | 18:07 | |
| *** jlibosva has joined #openstack-infra | 18:07 | |
| *** dizquierdo has quit IRC | 18:07 | |
| *** jlibosva has quit IRC | 18:07 | |
| *** mpaolino has quit IRC | 18:08 | |
| *** mmaglana has quit IRC | 18:08 | |
| pelix | zaro: likely this means we could probably also do all the abstracting in the jenkins_jobs.builder.Jenkins class to avoid needing to modify python-jenkins as well. | 18:08 |
| *** mmaglana has joined #openstack-infra | 18:08 | |
| *** ihrachyshka has quit IRC | 18:08 | |
| *** luqas has quit IRC | 18:09 | |
| *** dustins_ has joined #openstack-infra | 18:09 | |
| *** dustins has quit IRC | 18:11 | |
| *** annegent_ has quit IRC | 18:12 | |
| *** armax has joined #openstack-infra | 18:13 | |
| *** annegent_ has joined #openstack-infra | 18:13 | |
| kevinbenton | fungi: hey, are you around? i’m discussing options for the vendor code issue in Neutron and we have some questions about the possibility of using git submodules for the plugins | 18:15 |
| *** Guest54421 has quit IRC | 18:15 | |
| *** bhuvan has joined #openstack-infra | 18:16 | |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Add plugins_info to module registry object. https://review.openstack.org/132927 | 18:16 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Reorganize tests/cmd https://review.openstack.org/134055 | 18:16 |
| *** gokrokve has quit IRC | 18:17 | |
| *** gokrokve has joined #openstack-infra | 18:18 | |
| *** Sincler has quit IRC | 18:18 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: Add links to RSS feeds https://review.openstack.org/131256 | 18:18 |
| fungi | kevinbenton: we've so far recommended strongly against git submodules. first, they confuse a lot of developers who already often times have a tenuous grasp on the intricacies of git; and second, a lot of our tooling would need to be updated to support using them | 18:18 |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/infra-specs: Add Migrate to Zanata spec https://review.openstack.org/133222 | 18:18 |
| openstackgerrit | Aaron Rosen proposed openstack-infra/os-loganalyze: Add tr to filter for trove logs https://review.openstack.org/133981 | 18:19 |
| kevinbenton | fungi: that sounds promising :-) | 18:19 |
| *** links has joined #openstack-infra | 18:19 | |
| *** stevemar2 has joined #openstack-infra | 18:20 | |
| *** mwagner_lap has joined #openstack-infra | 18:20 | |
| kevinbenton | fungi: how strong is ‘strongly’ on a scale of 1 to 10 | 18:21 |
| kevinbenton | fungi: it seems a full separation is too big of a change at this point to garner support | 18:21 |
| *** gokrokve has quit IRC | 18:22 | |
| kevinbenton | fungi: and subtree delegation of +2’s will lead to an overwhelming amount of code churn if we have 30 vendors submitting tons of stuff | 18:22 |
| krotscheck | Is there a place where I can see the package release schedule for various things? | 18:22 |
| fungi | kevinbenton: for me it's a 10 out of 10, though other infra cores may disagree. also submodules are still separate git repositories and there are very few cases where using them provides any reduction in complexity over using separate repositories | 18:22 |
| * krotscheck needs to see if git was updated on debian in late october. | 18:22 | |
| *** stevemar has quit IRC | 18:22 | |
| kevinbenton | fungi: ok, thanks for your feedback | 18:24 |
| *** e0ne has quit IRC | 18:24 | |
| fungi | krotscheck: i checked (well, checked in ubuntu trusty where our python27 jobs run). http://packages.ubuntu.com/search?keywords=git | 18:24 |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/infra-specs: Add Migrate to Zanata spec https://review.openstack.org/133222 | 18:24 |
| fungi | krotscheck: browsing from there to the ubuntu changelog shows the most recent update to the package was march | 18:25 |
| krotscheck | Hrmph | 18:25 |
| krotscheck | fungi: Ok, thanks. | 18:25 |
| fungi | krotscheck: also looked at most of the relevant dependencies of git to see if they changed as well | 18:25 |
| fungi | but it's certainly worth double-checking | 18:25 |
| krotscheck | fungi: I was able to reproduce the error, however my output had additional bits in it that were all .gitconfig related. | 18:25 |
| kevinbenton | fungi: what about doing a periodic sync from other completely separate repos like we do with openstack/common | 18:25 |
| krotscheck | fungi: And then when I configured my username and email, they went away. | 18:25 |
| kevinbenton | fungi: is it easy to add many of those? | 18:25 |
| fungi | kevinbenton: code copying is pretty horrendous. that's why oslo is burning the candle at both ends to try to reduce it ever\ywhere they can | 18:26 |
| * krotscheck is going to try that without a random user name and instead use the one configuredin the tests to see if that unbreaks things. | 18:26 | |
| *** mmaglana has quit IRC | 18:26 | |
| kevinbenton | fungi: ok | 18:26 |
| fungi | kevinbenton: also those aren't a periodic sync. they're manual. someone has to generate and propose them | 18:26 |
| *** rfolco has quit IRC | 18:27 | |
| fungi | kevinbenton: the only automatic patch proposals we have right now are requirements list sync and translations imports | 18:27 |
| kevinbenton | fungi: makes sense | 18:27 |
| *** yjiang5_away is now known as yjiang5 | 18:27 | |
| fungi | kevinbenton: what's the concern about having a git repository per backend/driver/plugin? is it just an image issue or are there technical challenges which are simplified by these alternative proposals? | 18:28 |
| kevinbenton | fungi: it’s an image issue | 18:29 |
| kevinbenton | fungi: we got concerns that we would be fragmenting the community | 18:29 |
| fungi | kevinbenton: openstack-infra has >50 git repositories and i don't feel our community is fragmented in the least, if that helps alleviate concerns | 18:29 |
| *** salv-orlando has joined #openstack-infra | 18:29 | |
| *** amcrn has joined #openstack-infra | 18:30 | |
| kevinbenton | fungi: yeah, it seems like our way forward here is to try to push the full separation | 18:30 |
| kevinbenton | anteaya: are you around? you mentioned the possibility of a new namespace for vendor code, so they didn’t have to be in stackforge projects | 18:30 |
| *** AlexF has quit IRC | 18:30 | |
| fungi | kevinbenton: however, if there are driver vendors who are opposed to this solution because they're concerned their customers won't take them seriously any longer when their code isn't in a repository called "neutron" i'm not sure those are the sorts of places our project needs to be taking contributions from anyway | 18:30 |
| sdague | fungi: there is still and integration challenge if the interfaces aren't well defined | 18:31 |
| fungi | sdague: yep, but code copying and git submodules don't solve that either | 18:31 |
| sdague | fungi: oh, agreed | 18:31 |
| fungi | they only serve to solve the "image" issue of "look, my code really is part of neutron, i promise" | 18:32 |
| kevinbenton | fungi: yeah | 18:32 |
| *** markmcclain1 has quit IRC | 18:32 | |
| openstackgerrit | Merged openstack-infra/project-config: Adjust python 2.6 jobs for oslo libraries https://review.openstack.org/130444 | 18:34 |
| *** yfried has quit IRC | 18:35 | |
| fungi | also, on the submodule front, if we decide later that submodules are really groovy and we want to use them everywhere, it's relatively trivial to switch from separate distinct repositories to submodules (they're basically the same thing, it's just that you stick a .gitmodules file in your top-level repo to point at them) | 18:35 |
| openstackgerrit | Merged openstack-infra/project-config: Add new Distil project https://review.openstack.org/131885 | 18:35 |
| openstackgerrit | Merged openstack-infra/project-config: Add stackforge/cerberus project https://review.openstack.org/131989 | 18:35 |
| openstackgerrit | Merged openstack-infra/project-config: Add puppet-jenkins as split out module https://review.openstack.org/131302 | 18:35 |
| *** jp_at_hp has quit IRC | 18:35 | |
| openstackgerrit | Merged openstack-infra/project-config: Adds admin permissions to #openstack-sprint https://review.openstack.org/133256 | 18:36 |
| kevinbenton | fungi: yeah, so we could have opentstack be a main repo with a ton of submodules? | 18:36 |
| *** gokrokve has joined #openstack-infra | 18:36 | |
| kevinbenton | fungi: like this? :-) https://github.com/openstack/openstack | 18:37 |
| fungi | kevinbenton: yep ;) | 18:37 |
| fungi | kevinbenton: note that we don't code review changes into that repo. it's basically a static fixture | 18:38 |
| kevinbenton | fungi: yeah | 18:38 |
| openstackgerrit | Merged stackforge/python-jenkins: Yield HTTPError reason on open error https://review.openstack.org/106314 | 18:39 |
| *** lttrl has joined #openstack-infra | 18:39 | |
| *** gokrokve has quit IRC | 18:39 | |
| openstackgerrit | Merged openstack-infra/project-config: Allow to use custom mirror https://review.openstack.org/131878 | 18:39 |
| *** gokrokve has joined #openstack-infra | 18:39 | |
| *** gokrokve has quit IRC | 18:39 | |
| *** gokrokve has joined #openstack-infra | 18:40 | |
| openstackgerrit | Merged openstack-infra/project-config: Create specs project for Compass https://review.openstack.org/133635 | 18:40 |
| *** rfolco has joined #openstack-infra | 18:40 | |
| *** vigneshvar has joined #openstack-infra | 18:41 | |
| *** chandankumar has joined #openstack-infra | 18:42 | |
| *** tonytan4ever has joined #openstack-infra | 18:42 | |
| * krotscheck punches OSX in its lack of loopback alias. | 18:43 | |
| *** vhoward has left #openstack-infra | 18:43 | |
| *** bdpayne_ has joined #openstack-infra | 18:44 | |
| *** mpaolino has joined #openstack-infra | 18:44 | |
| *** thedodd has quit IRC | 18:44 | |
| fungi | krotscheck: it's too bad you don't work for a public cloud provider who will let you spin up arbitrary linux virtual machines to test stuff like this | 18:45 |
| krotscheck | fungi: Yeah. It’s also a pity that desktop virtualization software doesn’t exist. | 18:45 |
| fungi | touché | 18:46 |
| *** bdpayne has quit IRC | 18:46 | |
| *** zns has joined #openstack-infra | 18:47 | |
| *** pelix has quit IRC | 18:47 | |
| *** annegent_ has quit IRC | 18:49 | |
| *** openstackgerrit has quit IRC | 18:49 | |
| *** lttrl has quit IRC | 18:49 | |
| *** openstackgerrit has joined #openstack-infra | 18:49 | |
| *** armax has quit IRC | 18:50 | |
| *** armax has joined #openstack-infra | 18:50 | |
| *** AJaeger has joined #openstack-infra | 18:53 | |
| AJaeger | sdague: you've been busy with project-config - thanks! | 18:56 |
| *** rfolco has quit IRC | 18:56 | |
| *** rcarrill` has joined #openstack-infra | 18:58 | |
| *** achanda has quit IRC | 18:58 | |
| *** achanda has joined #openstack-infra | 18:59 | |
| openstackgerrit | Merged openstack/requirements: Add os-net-config dependency https://review.openstack.org/131841 | 18:59 |
| asselin | how do you limit zuul jobs to just run on master? I did this, but it still ran on icehouse. http://paste.openstack.org/show/132908/ | 18:59 |
| openstackgerrit | Merged openstack/requirements: Upgrade to pylint >=1.3.0 https://review.openstack.org/131310 | 18:59 |
| asselin | https://review.openstack.org/#/c/132336/ | 19:00 |
| *** skata_ has quit IRC | 19:00 | |
| fungi | asselin: we haven't done it for a very long time, but i believe your job needs to set the node label to "master" (it's a special node label which is provided by your jenkins master) | 19:00 |
| *** rcarrillocruz has quit IRC | 19:00 | |
| asselin | I mean, master branch, not node :) | 19:01 |
| fungi | asselin: oh, nevermind. you mean master branch, not the jenkins master | 19:01 |
| fungi | asselin: yeah, that should work... | 19:01 |
| *** amcrn_ has joined #openstack-infra | 19:01 | |
| asselin | fungi, so no jobs were actually run....it showed up in zuul ui & posted success after a few secs with nothing else... | 19:02 |
| fungi | asselin: oh, assuming you're "HP Storage CI" there, i think you misunderstand what that parameter does | 19:02 |
| asselin | Yes, that's me | 19:02 |
| fungi | asselin: it's working as designed. you configured zuul to not run that job on stable branch changes, so it didn't | 19:02 |
| *** mpaolino has quit IRC | 19:03 | |
| fungi | asselin: if you had multiple jobs some of which were limited to master and some of which weren't, you'd see just the non-limited jobs reporting there | 19:03 |
| fungi | asselin: but since you have no jobs being run, zuul as configured successfully runs nothing and then reports that it did so | 19:03 |
| patrickeast | asselin: for my ci i had to put “branch: master” for each trigger of my check | 19:03 |
| asselin | ok, so if there are no jobs, it just says so. -infra won't complain for such posts | 19:04 |
| asselin | patrickeast, can you paste what you have? | 19:04 |
| *** amcrn has quit IRC | 19:04 | |
| *** amcrn_ is now known as amcrn | 19:04 | |
| fungi | asselin: what patrickeast says is what you want. you need to limit your check pipeline to only trigger on master branch changes instead of limiting jobs to run only on master branch changes | 19:04 |
| patrickeast | asselin: not very pretty, but its working http://paste.openstack.org/show/132909/ | 19:04 |
| arosen1 | fungi: i'm now seeing: | 19:05 |
| arosen1 | 2014-11-13 10:35:38,092 INFO nodepool.image.build.devstack-trusty-dib: dib-run-parts Thu Nov 13 18:35:38 UTC 2014 Running /tmp/in_target.d/install.d/95-chown-jenkins^M | 19:05 |
| arosen1 | 2014-11-13 10:35:38,105 INFO nodepool.image.build.devstack-trusty-dib: chown: invalid user: 'jenkins:jenkins'^M | 19:05 |
| asselin | fungi, patrickeast thanks, that what I'll use | 19:05 |
| arosen1 | I guess there is an assumption this is running as a user named jenkins? | 19:05 |
| fungi | asselin: http://ci.openstack.org/zuul/zuul.html#pipelines (see the branch option under the gerrit trigger for the relevant documentation) | 19:06 |
| *** marun has quit IRC | 19:06 | |
| arosen1 | i figured this jenkins user would be inside the image being built not on the nodepool node it self? | 19:07 |
| fungi | arosen1: no, but there is an assumption that a jenkins user and group are created by your puppet manifest so that they can own some files | 19:07 |
| sdague | AJaeger: yeh, I figured I'd be slack for a while, so I did a bulk review | 19:07 |
| sdague | honestly, most of the stuff is pretty straight forward at this point | 19:07 |
| fungi | arosen1: it's happening inside a chroot | 19:07 |
| *** achanda has quit IRC | 19:07 | |
| AJaeger | sdague: yeah... With you and anteaya gone, there wasn't enough review love... | 19:08 |
| sdague | what's kind of amazing, is it means for the first time ever there is now a substantial backup in the project-config gate waiting for nodes :) | 19:09 |
| *** aalekov has quit IRC | 19:09 | |
| *** aalekov has joined #openstack-infra | 19:10 | |
| fungi | heh | 19:10 |
| *** AlexF has joined #openstack-infra | 19:10 | |
| AJaeger | wow, impressive... | 19:11 |
| AJaeger | let's feed it some more ;) | 19:11 |
| *** p5ntangle has quit IRC | 19:13 | |
| openstackgerrit | Stefano Maffulli proposed openstack-infra/project-config: Grouping the two projects Groups portal in storyboard https://review.openstack.org/134330 | 19:14 |
| *** p5ntangle has joined #openstack-infra | 19:14 | |
| *** rfolco has joined #openstack-infra | 19:15 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Ignore playground directories for translation https://review.openstack.org/133368 | 19:16 |
| openstackgerrit | Merged openstack-infra/project-config: Add murano-specs https://review.openstack.org/133819 | 19:17 |
| *** hdd has joined #openstack-infra | 19:18 | |
| *** openstackgerrit has quit IRC | 19:18 | |
| *** openstackgerrit has joined #openstack-infra | 19:18 | |
| *** baoli has quit IRC | 19:19 | |
| *** stevemar2 has quit IRC | 19:19 | |
| *** dprince has quit IRC | 19:20 | |
| arosen1 | fungi: I pulled in the last nodepool code on my previously working non dib machine but i'm seeing a weird thing now where it only ever spins up one node at a time? the logs say: Deficit: d-p-c: 0 (start: 0 min: 0 ready: 0 capacity: 19) http://paste.openstack.org/show/132920/ | 19:21 |
| arosen1 | previously it would spin up 20 nodes at a time. | 19:21 |
| * arosen1 Deficit: d-p-c: 0 (start: 0 min: 0 ready: 1 capacity: 19) | 19:22 | |
| fungi | arosen1: are you using the same node label name for your dib and non-dib images, or did you unconfigure the non-dib? | 19:22 |
| fungi | arosen1: can you post a sanitized copy of your nodepool.yaml on paste.o.o or somewhere? | 19:22 |
| arosen1 | fungi: http://paste.openstack.org/show/132922/ | 19:23 |
| *** imcsk8 has quit IRC | 19:24 | |
| *** imcsk8 has joined #openstack-infra | 19:24 | |
| *** chandankumar has quit IRC | 19:24 | |
| fungi | arosen1: is that the entire file? i don't see the diskimages list | 19:24 |
| *** annegent_ has joined #openstack-infra | 19:24 | |
| arosen1 | fungi: i have the dib stuff going on another node running nodepool | 19:25 |
| arosen1 | i wanted to keep things working while i figure out the dib stuff. | 19:25 |
| *** ayoung-mia is now known as ayoung | 19:25 | |
| *** e0ne has joined #openstack-infra | 19:25 | |
| fungi | arosen1: aha, i misunderstood. you're saying newer nodepool isn't building as many of your non-dib nodes as you expected | 19:25 |
| arosen1 | fungi: yup | 19:25 |
| *** otherwiseguy has quit IRC | 19:26 | |
| *** achanda has joined #openstack-infra | 19:26 | |
| openstackgerrit | Sahdev Zala proposed openstack-infra/project-config: Rename the heat-translator project repo https://review.openstack.org/131558 | 19:26 |
| arosen1 | fungi: it only ever is doing one at a time after pulling in the latest code | 19:27 |
| arosen1 | i can nodepool delete it and it will respawn a new one. | 19:27 |
| *** ihrachyshka has joined #openstack-infra | 19:27 | |
| fungi | arosen1: yeah, it looks from your debug log snippet that it thinks min is 0 | 19:28 |
| *** stevemar has joined #openstack-infra | 19:28 | |
| arosen1 | fungi: okay i see I can debug from that. Thanks | 19:29 |
| *** ivar-laz_ has joined #openstack-infra | 19:29 | |
| fungi | arosen1: yeah, it's not immediately obvious to me what's wrong with your config, comparing it against ours | 19:29 |
| *** marun has joined #openstack-infra | 19:30 | |
| *** MaxV has joined #openstack-infra | 19:30 | |
| *** ivar-laz_ has quit IRC | 19:30 | |
| *** ivar-laz_ has joined #openstack-infra | 19:31 | |
| *** ivar-lazzaro has quit IRC | 19:31 | |
| *** ivar-laz_ has quit IRC | 19:31 | |
| arosen1 | fungi: i changed min-ready -> 10 and it nodepool fired this off: 2014-11-13 11:30:24,746 DEBUG nodepool.NodePool: Deficit: d-p-c: 0 (start: 0 min: 0 ready: 10 capacity: 9) | 19:31 |
| *** salv-orlando has quit IRC | 19:31 | |
| arosen1 | and booted more instances idk. I'll keep an eye on it and debug it if it stops again. | 19:31 |
| *** ivar-lazzaro has joined #openstack-infra | 19:32 | |
| fungi | arosen1: it's possible there's a bug in nodepool when sum(min-ready) == max-servers | 19:32 |
| fungi | arosen1: i don't believe we test that, and we definitely don't run that way in production | 19:33 |
| arosen1 | fungi: is there a reason why you wouldn't want those two to match up? | 19:33 |
| fungi | arosen1: in our case we run in public cloud providers and there's no need to operate at our maximum quota all the time | 19:34 |
| fungi | arosen1: the gearman integration with zuul makes it possible for nodepool to fairly effectively figure out when it needs to burst upward | 19:34 |
| arosen1 | fungi: gotcha thanks | 19:36 |
| fungi | arosen1: so that way we boot ~900 instances (at the moment) when there are more pending jobs than we can run concurrently, but when we're idle we have only about 100 instances sitting around waiting to run jobs as needed | 19:36 |
| arosen1 | gotcha, nice feature to save resources. | 19:36 |
| fungi | arosen1: there are some nodepool users who, to save on cost since they pay for virtual machines by the minute and have an intermitted job load, run with a min-ready of 0 so nodepool only creates instances when there are jobs to run (that adds some latency to getting job results, but minimizes cost) | 19:37 |
| *** dprince has joined #openstack-infra | 19:38 | |
| arosen1 | fungi: speaking of paying by the minute i think this would be a cool trick. | 19:38 |
| arosen1 | fungi: HP and RAX both charge by the hour so even if you use 1 min you pay for the full hour. | 19:38 |
| *** _nadya_ has joined #openstack-infra | 19:39 | |
| arosen1 | instead of doing a nova delete/boot; nodepool could avoid this by doing ; nova rebuild ;) | 19:39 |
| fungi | arosen1: yep, it's been suggested. i think mordred was looking into what we might need to be able to support that | 19:39 |
| arosen1 | ah cool | 19:40 |
| fungi | arosen1: similarly, floating-ip reuse | 19:40 |
| arosen1 | i booted a bunch of instances on hp cloud to test something and was disappointed i had to pay for the full hour X.x | 19:40 |
| fungi | arosen1: yeah, it can get 'spensive | 19:40 |
| *** erikmwilson has joined #openstack-infra | 19:41 | |
| *** e0ne has quit IRC | 19:41 | |
| *** erikmwilson has quit IRC | 19:41 | |
| *** erikmwilson has joined #openstack-infra | 19:41 | |
| fungi | krotscheck: okay, want me to go ahead and retry the system-config story import with 134084 applied? | 19:43 |
| krotscheck | fungi: Sure | 19:43 |
| krotscheck | fungi: It should import 9 additional stories, and then exit | 19:44 |
| fungi | it's running | 19:45 |
| *** zz_dimtruck is now known as dimtruck | 19:47 | |
| *** _nadya_ has quit IRC | 19:47 | |
| *** links has quit IRC | 19:48 | |
| krotscheck | fungi: I’ve got nothing on the git-review thing. | 19:48 |
| fungi | krotscheck: i was afraid of that. i poked at it a bit more and came up dry too | 19:49 |
| krotscheck | What’s weird is that setting the git config user.name and git config user.email globally made the tests not fail, but they seem to lock up when I do that. | 19:49 |
| krotscheck | I found a reference that gerrit uses a combination of ~/.ssh/config and its own ssh keys to determine user identity, but even that feels like a red herring. | 19:50 |
| fungi | krotscheck: yeah, in the initialization module for the functional tests in git-review you can also see where we set up dummy user configuration and so on | 19:53 |
| AJaeger | fungi, jeblair: Could you review sdague's patch for requirements check, please? https://review.openstack.org/#/c/125095 | 19:53 |
| *** e0ne has joined #openstack-infra | 19:53 | |
| openstackgerrit | Nels proposed openstack-infra/devstack-gate: Adding support for DEVSTACK_GATE_LIBVIRT_TYPE https://review.openstack.org/134348 | 19:54 |
| *** e0ne has quit IRC | 19:55 | |
| *** salv-orlando has joined #openstack-infra | 19:55 | |
| openstackgerrit | Merged openstack-infra/project-config: Add magnum to the irc channel output https://review.openstack.org/134260 | 19:55 |
| *** thedodd has joined #openstack-infra | 19:56 | |
| openstackgerrit | Merged openstack-infra/project-config: Enable RTFD hooks for Gnocchi https://review.openstack.org/134227 | 19:57 |
| *** ldnunes has quit IRC | 19:57 | |
| krotscheck | fungi: How’s that script going? | 19:58 |
| fungi | krotscheck: still running | 19:58 |
| krotscheck | fungi: It should be giving you a lot of output along the lines of “Oh I found existing things" | 19:58 |
| openstackgerrit | Merged openstack-infra/project-config: Use python-jobs for Gnocchi https://review.openstack.org/133354 | 19:58 |
| fungi | enumerating lots of existing stories, no errors yet | 19:58 |
| krotscheck | fungi: Cool | 19:58 |
| fungi | yep, 'zactly | 19:58 |
| openstackgerrit | Merged openstack-infra/devstack-gate: Switched documentation to point to storyboard. https://review.openstack.org/133841 | 19:59 |
| openstackgerrit | Merged openstack-infra/devstack-gate: Use $((EXPRESSION)) instead of $[EXPRESSION] https://review.openstack.org/125038 | 19:59 |
| krotscheck | fungi: Ok, I’m going to get lunch. back in ~ an hour. | 19:59 |
| openstackgerrit | Merged openstack-infra/project-config: Run puppet unit tests on newer 3.x series versions https://review.openstack.org/126264 | 19:59 |
| *** ldnunes has joined #openstack-infra | 20:00 | |
| *** yamamoto has quit IRC | 20:01 | |
| *** funzo_ is now known as funzo | 20:01 | |
| *** marun has quit IRC | 20:02 | |
| *** nikhil_k|afk is now known as nikhil_k | 20:03 | |
| *** marun has joined #openstack-infra | 20:04 | |
| *** rfolco has quit IRC | 20:04 | |
| *** openstackgerrit has quit IRC | 20:04 | |
| *** openstackgerrit has joined #openstack-infra | 20:05 | |
| *** mrmartin has quit IRC | 20:06 | |
| *** kgiusti1 has joined #openstack-infra | 20:12 | |
| *** kgiusti has quit IRC | 20:14 | |
| *** aalekov has quit IRC | 20:15 | |
| *** aalekov has joined #openstack-infra | 20:15 | |
| openstackgerrit | Christian Fetzer proposed openstack-infra/jenkins-job-builder: Add fingerprint parameter to archive publisher. https://review.openstack.org/133355 | 20:16 |
| *** otherwiseguy has joined #openstack-infra | 20:18 | |
| *** kashyap is now known as || | 20:18 | |
| *** || is now known as kashyap | 20:18 | |
| *** sdake has joined #openstack-infra | 20:20 | |
| *** sdake has quit IRC | 20:20 | |
| *** sdake has joined #openstack-infra | 20:20 | |
| *** sdake has quit IRC | 20:20 | |
| *** sdake has joined #openstack-infra | 20:20 | |
| nibalizer | arosen1: in theory hp cloud has a lot of free for the first X dollars promos | 20:21 |
| *** bookwar has joined #openstack-infra | 20:21 | |
| arosen1 | nibalizer: i this was 6 months back i believe. Not a big deal though :p | 20:22 |
| nibalizer | ah okay | 20:22 |
| *** aalekov has quit IRC | 20:23 | |
| *** talluri has quit IRC | 20:23 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Clean up openstack_project::lists class https://review.openstack.org/134354 | 20:23 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Add a Women of OpenStack mailing list https://review.openstack.org/134355 | 20:23 |
| *** kirshil has quit IRC | 20:24 | |
| *** aalekov has joined #openstack-infra | 20:25 | |
| *** kirshil has joined #openstack-infra | 20:25 | |
| *** dustins_ has quit IRC | 20:26 | |
| *** dustins has joined #openstack-infra | 20:26 | |
| *** shashankhegde has quit IRC | 20:27 | |
| *** dustins has quit IRC | 20:28 | |
| fungi | krotscheck: so far it's mentioned 823 existing stories | 20:28 |
| *** tonytan4ever has quit IRC | 20:29 | |
| fungi | krotscheck: and has added 7 new tasks | 20:29 |
| *** dustins has joined #openstack-infra | 20:29 | |
| fungi | seems right so far | 20:29 |
| *** ZZelle_ has joined #openstack-infra | 20:30 | |
| *** MaxV has quit IRC | 20:30 | |
| *** yamamoto has joined #openstack-infra | 20:32 | |
| openstackgerrit | Christian Fetzer proposed openstack-infra/jenkins-job-builder: Add support for the Jenkins Clang Scan-Build publisher plugin. https://review.openstack.org/117958 | 20:33 |
| *** yamamoto has quit IRC | 20:34 | |
| *** kirshil has quit IRC | 20:34 | |
| *** yamamoto has joined #openstack-infra | 20:34 | |
| *** kirshil has joined #openstack-infra | 20:34 | |
| *** annegent_ has quit IRC | 20:36 | |
| *** annegent_ has joined #openstack-infra | 20:37 | |
| *** MaxV has joined #openstack-infra | 20:37 | |
| *** MaxV has quit IRC | 20:38 | |
| *** MaxV has joined #openstack-infra | 20:38 | |
| *** yamamoto has quit IRC | 20:39 | |
| fungi | krotscheck: 1079 existing stories, 8 new tasks and still running | 20:40 |
| mordred | fungi: what things did we miss last time/ | 20:41 |
| mordred | ? | 20:41 |
| fungi | mordred: already existing stories for multi-project bugs | 20:42 |
| mordred | nice | 20:42 |
| openstackgerrit | Merged openstack-infra/project-config: Enable core devs to create branches to stackforge/ospurge https://review.openstack.org/133487 | 20:42 |
| fungi | mordred: the import routine was skipping over them because it saw they already existed, and didn't consider it might need to associate new tasks for the project being imported | 20:42 |
| *** dimtruck is now known as zz_dimtruck | 20:44 | |
| *** achanda has quit IRC | 20:47 | |
| *** e0ne has joined #openstack-infra | 20:48 | |
| openstackgerrit | Merged openstack-infra/project-config: Change the periodic tempest "all" job to use neutron https://review.openstack.org/133818 | 20:49 |
| openstackgerrit | Merged openstack-infra/project-config: Do gerrit git prep before ssh keygen https://review.openstack.org/133291 | 20:49 |
| anteaya | kevinbenton: I'm officially on vacation but I vaction poorly, if you still need input on this next week I'll be officially back on Monday | 20:49 |
| openstackgerrit | Merged openstack-infra/project-config: Modify ACL rule for create branch https://review.openstack.org/133584 | 20:49 |
| openstackgerrit | Merged openstack-infra/project-config: Add a job to publish governance documents https://review.openstack.org/132467 | 20:49 |
| *** dprince has quit IRC | 20:49 | |
| *** SumitNaiksatam has quit IRC | 20:50 | |
| *** rlandy has quit IRC | 20:50 | |
| *** vhoward has joined #openstack-infra | 20:51 | |
| *** annegent_ has quit IRC | 20:51 | |
| nibalizer | anteaya: go vacation! | 20:52 |
| fungi | krotscheck: completed just now. it logged 1325 existing stories and 11 new tasks | 20:52 |
| fungi | krotscheck: the increase seems to be because it imported two new stories for bugs created since yesterday, so that all checks out | 20:53 |
| *** shashankhegde has joined #openstack-infra | 20:53 | |
| *** kirshil has quit IRC | 20:53 | |
| *** kirshil has joined #openstack-infra | 20:54 | |
| *** aalekov has quit IRC | 20:54 | |
| anteaya | nibalizer: trying, I find museums a good way to practice my tourist skills | 20:55 |
| anteaya | enjoyed the van gogh today | 20:55 |
| nibalizer | anteaya: where are you? | 20:56 |
| *** tonytan4ever has joined #openstack-infra | 20:56 | |
| kevinbenton | anteaya: ok thanks. I think we are going a different path for now anyway due to other integration issues | 20:57 |
| *** baoli has joined #openstack-infra | 20:57 | |
| anteaya | amsterdam | 20:57 |
| *** baoli has quit IRC | 20:57 | |
| anteaya | kevinbenton: as you see fit, I will ask you for an update on Monday and I will listen to details then | 20:58 |
| *** kirshil has quit IRC | 20:58 | |
| *** zz_gondoi is now known as gondoi | 20:58 | |
| *** baoli has joined #openstack-infra | 20:58 | |
| kevinbenton | anteaya: sounds good. we will be proposing a spec soon so we will have some feedback by then | 20:58 |
| *** kirshil has joined #openstack-infra | 20:58 | |
| krotscheck | fungi: Sounds like it’s all working | 20:58 |
| *** aalekov has joined #openstack-infra | 20:58 | |
| anteaya | kevinbenton: good choice, yay feedback | 20:59 |
| *** kirshil has quit IRC | 21:01 | |
| *** hdd has quit IRC | 21:01 | |
| *** e0ne has quit IRC | 21:01 | |
| *** sdake has quit IRC | 21:01 | |
| *** kirshil has joined #openstack-infra | 21:01 | |
| *** zns has quit IRC | 21:02 | |
| *** thedodd has quit IRC | 21:02 | |
| *** annegent_ has joined #openstack-infra | 21:03 | |
| *** koolhead17 has quit IRC | 21:03 | |
| *** zns has joined #openstack-infra | 21:03 | |
| *** koolhead17 has joined #openstack-infra | 21:03 | |
| *** daneleblanc has joined #openstack-infra | 21:03 | |
| openstackgerrit | Merged openstack-infra/project-config: add a new pacemaker cookbook https://review.openstack.org/133194 | 21:04 |
| *** aalekov has quit IRC | 21:04 | |
| *** aalekov has joined #openstack-infra | 21:05 | |
| *** dane_leblanc has joined #openstack-infra | 21:06 | |
| *** daneleblanc has quit IRC | 21:06 | |
| *** otherwiseguy has quit IRC | 21:06 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Removing uneeded variables from puppet.conf https://review.openstack.org/134362 | 21:07 |
| *** dane_leblanc has quit IRC | 21:07 | |
| *** talluri has joined #openstack-infra | 21:07 | |
| *** pc_m has quit IRC | 21:07 | |
| *** koolhead17 has quit IRC | 21:08 | |
| *** talluri has quit IRC | 21:09 | |
| *** thedodd has joined #openstack-infra | 21:10 | |
| *** talluri has joined #openstack-infra | 21:10 | |
| *** cdent has quit IRC | 21:13 | |
| *** otherwiseguy has joined #openstack-infra | 21:13 | |
| asselin | fungi, sdague merged this one. shall we progress to the others? https://review.openstack.org/#/c/131302/ | 21:13 |
| *** nolafleur has joined #openstack-infra | 21:14 | |
| *** nolafleur has joined #openstack-infra | 21:15 | |
| *** hdd has joined #openstack-infra | 21:16 | |
| *** talluri has quit IRC | 21:17 | |
| *** talluri has joined #openstack-infra | 21:17 | |
| *** otherwiseguy has quit IRC | 21:18 | |
| *** openstackgerrit has quit IRC | 21:19 | |
| *** openstackgerrit has joined #openstack-infra | 21:19 | |
| *** AJaeger has quit IRC | 21:22 | |
| *** SumitNaiksatam has joined #openstack-infra | 21:22 | |
| *** talluri has quit IRC | 21:22 | |
| * nibalizer promises zuul a cookie if it runs my tests | 21:23 | |
| *** baoli has quit IRC | 21:23 | |
| *** baoli has joined #openstack-infra | 21:25 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/system-config: Split out jenkins module https://review.openstack.org/131305 | 21:27 |
| *** kgiusti1 has quit IRC | 21:30 | |
| *** nikhil_k is now known as nikhil_k|afk | 21:31 | |
| *** kgiusti has joined #openstack-infra | 21:32 | |
| *** yamamoto has joined #openstack-infra | 21:32 | |
| *** dkranz has quit IRC | 21:34 | |
| *** platoscave has joined #openstack-infra | 21:34 | |
| *** MarkAtwood has joined #openstack-infra | 21:35 | |
| openstackgerrit | Merged openstack-infra/project-config: Move yaql to stackforge https://review.openstack.org/133545 | 21:36 |
| *** yamamoto has quit IRC | 21:37 | |
| fungi | asselin: checking to see if it's all set up first | 21:38 |
| *** otherwiseguy has joined #openstack-infra | 21:38 | |
| fungi | asselin: yep, looks like the project was created and imported correctly | 21:40 |
| *** gokrokve has quit IRC | 21:42 | |
| fungi | asselin: looks like the puppet-apply jobs are succeeding for 131305 now, so if we can get a second +2 i'm happy to approve and help keep an eye on everything | 21:43 |
| *** platoscave has quit IRC | 21:45 | |
| asselin | fungi hi | 21:45 |
| asselin | fungi, ok cool. I make sure the jenkins module in my git repo is resynced with system-config. | 21:45 |
| *** amitgandhinz has quit IRC | 21:46 | |
| asselin | fungi, how do you see the project was imported? | 21:46 |
| fungi | asselin: yes, please make sure that what we imported matches what's in system-config for those files right now. if it doesn't, we need commits ported in as new reviews | 21:46 |
| fungi | asselin: by looking at git.openstack.org | 21:47 |
| *** thedodd has quit IRC | 21:47 | |
| *** aysyd has quit IRC | 21:47 | |
| asselin | fungi, no....it's out of date :( | 21:47 |
| *** achanda has joined #openstack-infra | 21:48 | |
| *** dkranz has joined #openstack-infra | 21:48 | |
| *** platoscave has joined #openstack-infra | 21:49 | |
| *** platoscave has quit IRC | 21:49 | |
| asselin | fungi, https://github.com/rasselin/puppet-jenkins has the latest now, but not at the time 131302 was merged.... | 21:49 |
| fungi | asselin: i just diffed them and the divergence is smallish. do you think you can repropose that change to the new repo? | 21:49 |
| asselin | fungi, let me try | 21:50 |
| fungi | asselin: it's 2 lines in memorytotalbytes.rb and 6 in params.pp | 21:50 |
| *** Adri2000_ is now known as Adri2000 | 21:50 | |
| *** yjiang5 is now known as yjiang5_away | 21:50 | |
| fungi | asselin: actually, i can force-push your updated repo in on top of that. let me look real fast | 21:50 |
| asselin | fungi, ok, try that. otherwise I can do a 'simple' review | 21:51 |
| asselin | and give 'credit' in the commit message | 21:51 |
| *** mmaglana has joined #openstack-infra | 21:52 | |
| *** achanda has quit IRC | 21:52 | |
| *** achanda has joined #openstack-infra | 21:52 | |
| *** hdd has quit IRC | 21:54 | |
| *** ihrachyshka has quit IRC | 21:55 | |
| *** thedodd has joined #openstack-infra | 21:56 | |
| *** amitgandhinz has joined #openstack-infra | 21:57 | |
| fungi | asselin: does http://git.openstack.org/cgit/openstack-infra/puppet-jenkins/ look better now? | 21:57 |
| *** cpowell has quit IRC | 21:57 | |
| asselin | fungi, yes | 21:57 |
| fungi | asselin: okay, should be safe to proceed now | 21:58 |
| asselin | fungi, I'll update the spec saying to double-check the repos before merging that 1st patch. | 21:58 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-jenkins: Add a .gitreview file https://review.openstack.org/134370 | 21:58 |
| fungi | asselin: also ^ | 21:58 |
| asselin | I think that'sin the instructions | 21:59 |
| fungi | coolz | 21:59 |
| asselin | but if not, i'll make sure it is :) | 21:59 |
| * fungi follows instructions without reading them, just like when assembling mail-order furniture | 22:00 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/project-config: Restart ssh after configuring sshd_config https://review.openstack.org/134371 | 22:00 |
| * nibalizer begs reviews on ^^ (so close!) | 22:01 | |
| *** bswartz has quit IRC | 22:01 | |
| *** zz_dimtruck is now known as dimtruck | 22:03 | |
| *** vigneshvar has quit IRC | 22:04 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/puppet-jenkins: Add required puppet module files and .gitreview https://review.openstack.org/134373 | 22:07 |
| asselin | fungi, let's use this one ^^ I had it ready to go & has more stuff needed | 22:07 |
| *** gokrokve has joined #openstack-infra | 22:08 | |
| *** achanda_ has joined #openstack-infra | 22:08 | |
| *** annegent_ has quit IRC | 22:08 | |
| openstackgerrit | Joe Gordon proposed openstack-dev/hacking: Don't change log level as import side effect https://review.openstack.org/134374 | 22:08 |
| mordred | fungi, anteaya: so, I was just working with nolafleur on trying to get set up with git and stuff ... turns out, there is no valid walkthrough that covers "so, I'm on OSX and don't already have git installed" | 22:09 |
| mordred | fungi, anteaya: also, it turns out that installing git on osx is ludicrously hard | 22:09 |
| Shrews | mordred: not really. just install xcode. done | 22:09 |
| mordred | Shrews: what's an xcode | 22:09 |
| fungi | mordred: step 1, get a cloud account. step 2, ssh to a vm? | 22:10 |
| Shrews | mordred: equivalent of build-essentials | 22:10 |
| mordred | Shrews: (I mean, there is no instructions on the internet anywhere that covers this for someone who doesn't alraedy know) | 22:10 |
| fungi | mordred: xcode used to be shipped as an additional cd which installed a developer environment to go with osx | 22:10 |
| Shrews | mordred: it's your fault for trying to do development on osx | 22:10 |
| nibalizer | asselin: nitpicking ou a bit | 22:10 |
| Shrews | :-P | 22:10 |
| fungi | mordred: now i think it's just a free download from the apple store or something along those lines | 22:11 |
| mordred | it apparently comes from the app store now for free | 22:11 |
| mordred | yesyes. my main point is | 22:11 |
| Shrews | fungi: yup | 22:11 |
| mordred | if someone is not sitting next to me | 22:11 |
| mordred | and I'm not in IRC with you people | 22:11 |
| mordred | our "getting started" guide | 22:11 |
| mordred | leaves a bit to be desired here | 22:11 |
| *** annegent_ has joined #openstack-infra | 22:11 | |
| fungi | osx is not unix (and i don't mean that in a stallmanesque gnu way either) | 22:11 |
| *** achanda has quit IRC | 22:12 | |
| asselin | nibalizer, please do. The others will likely copy :) | 22:12 |
| fungi | mordred: but yes, i get your point | 22:12 |
| nibalizer | mordred: a thing to be cautious of is that every osx version has a different xcode dance... | 22:12 |
| nibalizer | so you dont want to be documenting how to do it on 10.4 tiger for instance | 22:12 |
| mordred | nibalizer: indeed | 22:13 |
| openstackgerrit | Khai Do proposed openstack-infra/jenkins-job-builder: add test for globbed parameters feature https://review.openstack.org/131882 | 22:13 |
| * mordred may try to fix the getting started guide | 22:13 | |
| fungi | just mentioning that osx provides that sort of stuff in xcode though does give the new contributor something to search on, even if it's unpleasant to document things which mention non-free software/operating systems | 22:13 |
| nelsnelson | Hmmm... any idea what could be going wrong with the tests for this devstack-gate change I submitted to gerrit? | 22:13 |
| *** thedodd has quit IRC | 22:13 | |
| *** radez is now known as radez_g0n3 | 22:14 | |
| nelsnelson | It looks like there's some kinda database test failing around volumes. I can't imagine my single line commit could have affected the tests in this way. | 22:14 |
| mordred | Shrews: are you telling me that after installing recent xcode git should just exist? | 22:14 |
| Shrews | mordred: yes. it's not the latest greatest iirc, but it will be there | 22:14 |
| mordred | Shrews: also, apparently the apple app store is not smart enough to show you software for the version of osx you run | 22:15 |
| mordred | which is a feature I think debian has had since, whaat, 97? | 22:15 |
| Shrews | mordred: umm, eh? | 22:15 |
| nelsnelson | check-tempest-dsvm-postgres-full is the failing test, apparently, which got kicked off for https://review.openstack.org/#/c/134348/ | 22:15 |
| nelsnelson | I guess. | 22:15 |
| openstackgerrit | Joe Gordon proposed openstack-dev/hacking: Add H237 to HACKING.rst https://review.openstack.org/134377 | 22:15 |
| mordred | Shrews: nolafleur is running 10.7 something - and if you try to install xcode, it starts, then errors with "you need osx 10.9.2" | 22:15 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/puppet-jenkins: Add required puppet module files and .gitreview https://review.openstack.org/134373 | 22:16 |
| mordred | Shrews: so this is mainly me picking on osx | 22:16 |
| nolafleur | I need to update, but mordred thinks I should wait until we're not in Argentina :) | 22:16 |
| Shrews | mordred: i'm not defending apple. just trying to help you get git installed | 22:16 |
| *** ryanpetrello has quit IRC | 22:16 | |
| kragniz | mordred: osx seems to suck :/ | 22:16 |
| fungi | nolafleur: that sounds pragmatic | 22:16 |
| mordred | kragniz: right? | 22:17 |
| nolafleur | but delayed | 22:17 |
| fungi | nolafleur: also, welcome to the ranks--thrilled to see you getting involved | 22:17 |
| mordred | Shrews: yes. and I heartily appreciate it | 22:17 |
| nolafleur | :))) | 22:17 |
| mordred | Shrews: I'm going to try to channel my rage in to cleaning up the getting started guide | 22:17 |
| Shrews | i have no idea what to do with 10.7. install from disc? | 22:17 |
| mordred | Shrews: genius bar? | 22:17 |
| nolafleur | it's an air, I didn't get any disks years ago when I got this machine | 22:18 |
| patrickeast | http://git-scm.com/book/en/v2/Getting-Started-Installing-Git has some options | 22:18 |
| Shrews | mordred: that's a bastardized use of the word "genius" | 22:18 |
| fungi | mordred: contrary to the name, they do _not_ offer you booze there. i was most disappointed | 22:18 |
| SergeyLukjanov | fungi, clarkb, jeblair, mordred, jhesketh, sdague, I see many messages addressed to me, but unfortunately I'm on a vacation this and next week and completely unavailable this time | 22:18 |
| *** dmellado has quit IRC | 22:18 | |
| sdague | SergeyLukjanov: no worries | 22:18 |
| mordred | SergeyLukjanov: more people are :) | 22:18 |
| openstackgerrit | Merged openstack/requirements: bump pecan minimum version number to 0.8.0 https://review.openstack.org/134280 | 22:19 |
| fungi | nolafleur: anyway, it was great seeing you again last week. good luck with the apple madness. i'm going to go find some sushi | 22:20 |
| * fungi wanders off | 22:20 | |
| mordred | patrickeast: they are apparently wrong | 22:20 |
| nolafleur | fungi: enjoy your sushi! | 22:20 |
| mordred | patrickeast: and leave you with a git that segfaults :) | 22:20 |
| patrickeast | lol | 22:21 |
| Shrews | nolafleur: you are likely to encounter other issues if you stick with 10.7. i'm not sure py27 is available on that version | 22:21 |
| sdague | so... apparently I messed up the python-*client from git part... so I don't think we're testing those at all right now | 22:21 |
| nolafleur | fungi: and it was great seeing you too! Tell Chris I said hello! | 22:21 |
| sdague | new patches up | 22:21 |
| sdague | https://review.openstack.org/#/c/134378 | 22:21 |
| mordred | sdague: AWESOME | 22:21 |
| nolafleur | Shrews: I have no problem with updating, I just tend to procrastinate on doing it :) | 22:22 |
| sdague | well, at least it only merged yesterday :) | 22:22 |
| sdague | patrickeast pointed it out, so that was goodness | 22:22 |
| dhellmann | anteaya: if you're around, I'd like to see if we can land https://review.openstack.org/#/c/131256/ soon-ish so I can announce the RSS feeds of specs before we get too far into spec-approval season. Maybe by Monday, if you have time? | 22:23 |
| sdague | there is also a tail patch on there that should show we are actually testing these things correctly | 22:23 |
| Shrews | nolafleur: also, iirc, git was not packaged with the xcode from 10.7 | 22:24 |
| sdague | is zuul down? | 22:24 |
| sdague | I just submitted 3 patches, and they don't seem to be enqueing anywhere | 22:25 |
| *** mmaglana has quit IRC | 22:26 | |
| *** dkranz has quit IRC | 22:26 | |
| sdague | oh, there they go, just slow | 22:27 |
| Shrews | mordred: nolafleur: fwiw, if you create a free developer account, you can get various xcode versions (should only need the command line tools) from here: https://developer.apple.com/downloads/index.action?name=Xcode | 22:27 |
| anteaya | dhellmann: it is done | 22:28 |
| *** tonytan4ever has quit IRC | 22:28 | |
| anteaya | pleia2: thanks for checking those links | 22:28 |
| * Shrews goes way now | 22:28 | |
| mordred | Shrews: hrm. although if git doesn't come with old xcode, we'd still need to do somethign like brew install git right? | 22:28 |
| *** mmaglana has joined #openstack-infra | 22:28 | |
| mordred | Shrews: if we do that, will it break when we update to latest? | 22:28 |
| dhellmann | anteaya: awesome, thanks | 22:28 |
| Shrews | mordred: _if_ it doesn't, yeah. then just use homebrew to get it | 22:28 |
| dhellmann | pleia2: ++ | 22:29 |
| sdague | mordred: aren't you supposed to be off drinking fine wine somewhere? :) | 22:29 |
| * anteaya looks around and realizes she should be going to bed about now | 22:29 | |
| mordred | sdague: any minute now | 22:29 |
| pleia2 | anteaya: sure thing | 22:29 |
| anteaya | we aren't doing the things we are supposed to be doing | 22:29 |
| Shrews | mordred: i have exhausted my limited knowledge on the subject. what you are trying to do has never been done by anyone, ever :) | 22:29 |
| mordred | Shrews: :) | 22:30 |
| anteaya | Shrews: and fine wine | 22:30 |
| * mordred prepares himself for the en-dirtying of writing an OSX howto on the openstack wiki | 22:30 | |
| * anteaya recognizes her cue to go offline | 22:31 | |
| *** ivar-laz_ has joined #openstack-infra | 22:31 | |
| * sdague as well | 22:31 | |
| pleia2 | anteaya: have a wonderful evening! | 22:31 |
| anteaya | exeunt | 22:31 |
| *** ivar-laz_ has quit IRC | 22:31 | |
| anteaya | pleia2: thanks | 22:31 |
| pleia2 | sdague: you too :) | 22:31 |
| anteaya | I never get to use exeunt in everyday languange | 22:31 |
| *** ivar-laz_ has joined #openstack-infra | 22:32 | |
| *** yamamoto has joined #openstack-infra | 22:32 | |
| *** kgiusti has quit IRC | 22:32 | |
| *** ivar-lazzaro has quit IRC | 22:34 | |
| *** AlexF has quit IRC | 22:36 | |
| *** yamamoto has quit IRC | 22:37 | |
| *** amitgandhinz has quit IRC | 22:37 | |
| openstackgerrit | Merged openstack-infra/project-config: Add links to RSS feeds https://review.openstack.org/131256 | 22:37 |
| *** gyee has joined #openstack-infra | 22:37 | |
| *** dustins has quit IRC | 22:37 | |
| oda-g_ | patriceast: Hi, did you solve the problem ? | 22:39 |
| mordred | Shrews, anteaya: https://wiki.openstack.org/wiki/InstallingGit | 22:40 |
| mordred | I added basic instructions here for both linux and osx based on what I've understood, and I linked them from https://wiki.openstack.org/wiki/Getting_The_Code#Getting_the_source_code | 22:40 |
| *** ociuhandu has quit IRC | 22:41 | |
| *** doude_ has quit IRC | 22:42 | |
| *** ldnunes has quit IRC | 22:42 | |
| *** gus_ is now known as gus | 22:43 | |
| *** gus has quit IRC | 22:44 | |
| *** gus has joined #openstack-infra | 22:45 | |
| *** mmaglana has quit IRC | 22:45 | |
| *** gus is now known as gus_ | 22:46 | |
| *** gus_ is now known as gus | 22:46 | |
| *** armax has quit IRC | 22:47 | |
| *** marun has quit IRC | 22:47 | |
| *** zns has quit IRC | 22:48 | |
| *** _nadya_ has joined #openstack-infra | 22:48 | |
| patrickeast | oda-g_: not yet, although i think we might have found something, that change for the git install vs pip install had some problems | 22:48 |
| *** stevemar has quit IRC | 22:49 | |
| patrickeast | oda-g_: https://review.openstack.org/134378 fixes them, hopefully with that we can get the latest keystoneclient and openstackclient and assuming they work correctly it might fix things | 22:49 |
| *** mriedem has quit IRC | 22:50 | |
| *** jcoufal has quit IRC | 22:51 | |
| *** MaxV has quit IRC | 22:51 | |
| *** asettle has joined #openstack-infra | 22:52 | |
| *** MaxV has joined #openstack-infra | 22:52 | |
| *** _nadya_ has quit IRC | 22:52 | |
| oda-g_ | patriceast: I think so too. I don't solve the problem too. Now my CI uses devstack which commit is before the change you mentioned, and it works normaly. | 22:52 |
| patrickeast | oda-g_: ahh nice, the part that i don’t understand is why it only broke our CI’s and not the official jenkins or some of the other 3rd party CI’s | 22:53 |
| oda-g_ | patriceast: It is just a workaround. Yes, me too, I don't understand why there are success CIs and failed CIs. | 22:55 |
| nelsnelson | I'm trying to figure out why the test run for https://review.openstack.org/#/c/134348/ is failing. Does anybody happen to know hy the check-tempest-dsvm-postgres-full test portion is borking like this? http://logs.openstack.org/48/134348/1/check/check-tempest-dsvm-postgres-full/7380d54/console.html | 22:56 |
| patrickeast | nelsnelson: looks like the elastic recheck bot posted on the review, does the bug it linked to relate to the errors? if so just comment for a recheck | 23:01 |
| nelsnelson | Yeah, doesn't appear to be related. | 23:01 |
| nelsnelson | How does one comment for a recheck? Through git review? | 23:01 |
| patrickeast | nelsnelson: yea its just a comment on the review, see http://docs.openstack.org/infra/manual/developers.html#automated-testing for the instructions for the string format | 23:03 |
| nelsnelson | k, thanks patrickeast | 23:03 |
| ekarlso | hey guys, in a stackforge project how can one have pip / tox install stuff directly from github? | 23:04 |
| ekarlso | or tarballs | 23:04 |
| *** mattfarina has quit IRC | 23:04 | |
| mordred | ekarlso: in a stackforge project you can do anything you want | 23:05 |
| mordred | ekarlso: but I recommend against doing that, based on past experience we've had here | 23:05 |
| mordred | ekarlso: what do you want to do? | 23:05 |
| *** alexpilotti has quit IRC | 23:05 | |
| ekarlso | mordred: pulling in oslo.log atm | 23:07 |
| *** ddieterly has joined #openstack-infra | 23:09 | |
| *** mmaglana has joined #openstack-infra | 23:09 | |
| mordred | ekarlso: and you want to pull in a version that isn't released yet? | 23:10 |
| ekarlso | mordred: oslo.log isn't released at all yet ;) | 23:10 |
| *** ivar-laz_ has quit IRC | 23:10 | |
| JayF | Ah, there's a whole thing for pulling in incubating oslo modules | 23:10 |
| JayF | and it works reasonably well | 23:10 |
| *** ivar-lazzaro has joined #openstack-infra | 23:10 | |
| ekarlso | JayF: uhm well this is actually a seperate repo | 23:11 |
| ekarlso | not the incubator thing | 23:11 |
| JayF | https://wiki.openstack.org/wiki/Oslo#Syncing_Code_from_Incubator that is what I'm talking about | 23:11 |
| ekarlso | https://github.com/openstack/oslo.log | 23:11 |
| JayF | Then IDK what the right thing to do in that case. | 23:11 |
| mordred | if you need to do it, I'd reference http://tarballs.openstack.org/oslo.log/oslo.log-master.tar.gz - but honestly I'd probably just ask dhellmann what he thinks | 23:12 |
| *** asettle has quit IRC | 23:13 | |
| *** mmaglana has quit IRC | 23:13 | |
| *** ddieterly has quit IRC | 23:13 | |
| ekarlso | dhellmann: u got a clue on ^? | 23:13 |
| *** mmaglana has joined #openstack-infra | 23:14 | |
| *** armax has joined #openstack-infra | 23:20 | |
| *** baoli has quit IRC | 23:20 | |
| *** armax has quit IRC | 23:21 | |
| *** baoli has joined #openstack-infra | 23:21 | |
| *** dmsimard is now known as dmsimard_away | 23:22 | |
| *** armax has joined #openstack-infra | 23:23 | |
| *** shashankhegde has quit IRC | 23:24 | |
| *** MaxV has quit IRC | 23:24 | |
| *** Sukhdev has joined #openstack-infra | 23:26 | |
| JayF | Any non-client project should have the python 2.6 targets removed from it's tox config at this point, right? Because we're retiring py26 support? | 23:26 |
| * JayF just noticed ironic still has py26 setup | 23:27 | |
| * dhellmann reads scrollback | 23:27 | |
| *** mmaglana has quit IRC | 23:27 | |
| dhellmann | ekarlso: you want to use oslo.log, even though we haven't released it? | 23:27 |
| dhellmann | ekarlso: can you give me a week or two? seriously, you'll save yourself a ton of pain. | 23:27 |
| dhellmann | ekarlso: in no small part because we haven't finalized the API yet, so whatever you see there is not going to be what we put in 0.1.0 and start supporting | 23:28 |
| *** mmaglana has joined #openstack-infra | 23:28 | |
| openstackgerrit | Boris Pavlovic proposed openstack-infra/project-config: Add non voting rally performance job to designate project https://review.openstack.org/134392 | 23:30 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/infra-specs: Clarify changes needed for new puppet repo https://review.openstack.org/134393 | 23:31 |
| *** kirshil has quit IRC | 23:31 | |
| *** aalekov has quit IRC | 23:31 | |
| ekarlso | dhellmann: oook | 23:31 |
| *** kirshil has joined #openstack-infra | 23:31 | |
| *** melwitt has quit IRC | 23:32 | |
| *** yamamoto has joined #openstack-infra | 23:32 | |
| *** melwitt has joined #openstack-infra | 23:32 | |
| *** mmaglana_ has joined #openstack-infra | 23:33 | |
| *** melwitt has quit IRC | 23:33 | |
| *** melwitt has joined #openstack-infra | 23:33 | |
| *** gondoi is now known as zz_gondoi | 23:33 | |
| *** mmaglana has quit IRC | 23:33 | |
| *** aalekov has joined #openstack-infra | 23:34 | |
| *** kirshil has quit IRC | 23:37 | |
| *** kirshil has joined #openstack-infra | 23:37 | |
| *** yamamoto has quit IRC | 23:37 | |
| *** shashankhegde has joined #openstack-infra | 23:40 | |
| cody-somerville | So Firefox hanging for a few moments while loading large log files has to be the most annoying thing eva. :) | 23:40 |
| *** baoli has quit IRC | 23:41 | |
| *** otherwiseguy has quit IRC | 23:41 | |
| *** gokrokve has quit IRC | 23:42 | |
| nibalizer | yup | 23:42 |
| *** stevemar has joined #openstack-infra | 23:42 | |
| nibalizer | my mozilla friends say nigtly has a chrome-alike thing where each tab is a uniqe process so you can do other stuff while ff churns on the log file | 23:42 |
| *** melwitt has quit IRC | 23:43 | |
| *** mmaglana_ has quit IRC | 23:46 | |
| *** denis_makogon has quit IRC | 23:47 | |
| *** denis_makogon has joined #openstack-infra | 23:47 | |
| *** amitgandhinz has joined #openstack-infra | 23:48 | |
| *** wenlock has quit IRC | 23:49 | |
| *** wenlock has joined #openstack-infra | 23:51 | |
| *** amitgandhinz has quit IRC | 23:52 | |
| *** ChuckC has quit IRC | 23:52 | |
| *** Sukhdev has quit IRC | 23:53 | |
| *** bhunter71 has quit IRC | 23:53 | |
| *** stevemar has quit IRC | 23:53 | |
| *** annegent_ has quit IRC | 23:56 | |
| *** annegent_ has joined #openstack-infra | 23:58 | |
| *** annegent_ has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!