*** dboik has quit IRC | 00:00 | |
*** asettle has joined #openstack-infra | 00:01 | |
*** claudiub_ has quit IRC | 00:02 | |
*** laughterwym has joined #openstack-infra | 00:03 | |
*** wenlock has quit IRC | 00:06 | |
*** thorst has joined #openstack-infra | 00:07 | |
*** thorst has quit IRC | 00:11 | |
clarkb | https://github.com/ether/etherpad-lite/issues/2522 updated with what we see on etherpad-dev | 00:11 |
---|---|---|
*** larainema has joined #openstack-infra | 00:14 | |
*** DericHorn-HP has joined #openstack-infra | 00:15 | |
*** mwagner_lap has joined #openstack-infra | 00:15 | |
*** mtanino has quit IRC | 00:15 | |
*** DericHorn-HP has quit IRC | 00:16 | |
*** otter768 has quit IRC | 00:20 | |
*** sputnik1_ has quit IRC | 00:21 | |
*** chlong has joined #openstack-infra | 00:21 | |
*** Qiming has quit IRC | 00:23 | |
*** cindyo has quit IRC | 00:23 | |
*** julim has quit IRC | 00:24 | |
*** cebruns has quit IRC | 00:27 | |
*** schang has quit IRC | 00:27 | |
*** peterstac has quit IRC | 00:27 | |
*** sirushti has quit IRC | 00:28 | |
*** cebruns has joined #openstack-infra | 00:28 | |
*** timfreund has quit IRC | 00:29 | |
*** sdake has quit IRC | 00:29 | |
*** dougshelley66 has quit IRC | 00:30 | |
*** timfreund has joined #openstack-infra | 00:30 | |
*** jasondotstar has joined #openstack-infra | 00:30 | |
*** dims has joined #openstack-infra | 00:32 | |
*** sirushti has joined #openstack-infra | 00:33 | |
*** peterstac has joined #openstack-infra | 00:34 | |
*** otter768 has joined #openstack-infra | 00:34 | |
*** dougshelley66 has joined #openstack-infra | 00:35 | |
*** dims_ has joined #openstack-infra | 00:35 | |
*** olaph has joined #openstack-infra | 00:37 | |
*** schang has joined #openstack-infra | 00:37 | |
*** puranamr has quit IRC | 00:38 | |
*** dprince has joined #openstack-infra | 00:39 | |
*** dims has quit IRC | 00:39 | |
*** ddieterly has joined #openstack-infra | 00:39 | |
*** puranamr has joined #openstack-infra | 00:39 | |
*** geoffarnold has quit IRC | 00:40 | |
*** asettle has quit IRC | 00:40 | |
*** ddieterl_ has joined #openstack-infra | 00:43 | |
*** ddieterly has quit IRC | 00:44 | |
*** Swami has quit IRC | 00:44 | |
krotscheck | Ok, so I've been having significant problems with builds failing for random intermittent reasons. Given the same exact patch, I've had it pass, fail in grenade, unstable in tempest, fail in devstack, fail in docs, all at different times and in different rechecks. The build itself takes up to 2 hours, so it's more than a little frustrating when I have +2A on a thing I've been pushing for weeks. What's going on? | 00:45 |
*** teran has joined #openstack-infra | 00:49 | |
*** teran has quit IRC | 00:54 | |
pabelanger | zaro, yes, the team is aware of it. | 00:54 |
*** crc32 has quit IRC | 00:55 | |
pabelanger | zaro, not sure if they sent out a message or not. However, I can find out | 00:55 |
*** dannywilson has quit IRC | 00:55 | |
*** sigmavirus24 is now known as sigmavirus24_awa | 00:58 | |
*** annegentle has joined #openstack-infra | 01:01 | |
*** boris-42 has quit IRC | 01:02 | |
*** Rockyg has joined #openstack-infra | 01:03 | |
openstackgerrit | Merged openstack-infra/irc-meetings: Add agenda page URL to Refstack team meeting. https://review.openstack.org/197365 | 01:07 |
*** kiran-r has joined #openstack-infra | 01:10 | |
*** dprince has quit IRC | 01:10 | |
*** r-daneel has quit IRC | 01:11 | |
*** armax has quit IRC | 01:12 | |
*** esmute__ has quit IRC | 01:13 | |
*** bswartz has quit IRC | 01:14 | |
*** heyongli has quit IRC | 01:14 | |
*** heyongli has joined #openstack-infra | 01:15 | |
*** armax has joined #openstack-infra | 01:18 | |
*** changbl has joined #openstack-infra | 01:18 | |
*** Qiming_ has joined #openstack-infra | 01:19 | |
*** armax has quit IRC | 01:22 | |
*** dannywilson has joined #openstack-infra | 01:23 | |
*** yamamoto has joined #openstack-infra | 01:24 | |
*** patrickeast has quit IRC | 01:24 | |
*** Rockyg has quit IRC | 01:28 | |
*** sputnik13 has joined #openstack-infra | 01:30 | |
*** sputnik13 has quit IRC | 01:31 | |
*** sputnik13 has joined #openstack-infra | 01:32 | |
*** asselin_ has joined #openstack-infra | 01:33 | |
*** sputnik13 has quit IRC | 01:33 | |
*** otter768 has quit IRC | 01:36 | |
*** yamamoto has quit IRC | 01:37 | |
*** hdd has joined #openstack-infra | 01:40 | |
*** annegentle has quit IRC | 01:42 | |
*** enikanorov2 has quit IRC | 01:46 | |
*** esmute__ has joined #openstack-infra | 01:47 | |
*** Qiming_ is now known as Qiming | 01:49 | |
*** teran has joined #openstack-infra | 01:50 | |
*** puranamr has quit IRC | 01:51 | |
*** teran has quit IRC | 01:56 | |
*** sdake has joined #openstack-infra | 01:57 | |
ianw | i think i figured out why centos6 era git is so slow over https -> https://bugzilla.redhat.com/show_bug.cgi?id=1237395 | 01:58 |
openstack | bugzilla.redhat.com bug 1237395 in git "extremley slow https clone performance" [Unspecified,New] - Assigned to pstodulk | 01:59 |
*** sdake_ has joined #openstack-infra | 01:59 | |
ianw | so hopefully the way forward on that is to fix the package (from today's meeting) | 01:59 |
*** homeless has quit IRC | 02:00 | |
*** enikanorov2 has joined #openstack-infra | 02:01 | |
*** camunoz has quit IRC | 02:02 | |
*** sdake has quit IRC | 02:02 | |
*** camunoz has joined #openstack-infra | 02:02 | |
*** yamahata has quit IRC | 02:05 | |
*** jasondotstar has quit IRC | 02:07 | |
*** annegentle has joined #openstack-infra | 02:08 | |
*** esmute__ has quit IRC | 02:08 | |
*** ajo has quit IRC | 02:08 | |
*** pabelanger has quit IRC | 02:09 | |
*** Longgeek_ has joined #openstack-infra | 02:10 | |
*** pabelanger has joined #openstack-infra | 02:10 | |
*** sdake_ has quit IRC | 02:10 | |
*** sdake has joined #openstack-infra | 02:10 | |
*** ajo has joined #openstack-infra | 02:11 | |
*** Longgeek has quit IRC | 02:12 | |
*** coolsvap|away has quit IRC | 02:13 | |
*** yamamoto has joined #openstack-infra | 02:13 | |
*** esmute__ has joined #openstack-infra | 02:13 | |
*** kiran-r has quit IRC | 02:14 | |
*** coolsvap|away has joined #openstack-infra | 02:15 | |
*** ivar-laz_ has joined #openstack-infra | 02:15 | |
*** ivar-laz_ has quit IRC | 02:15 | |
*** mriedem has quit IRC | 02:16 | |
*** ivar-lazzaro has quit IRC | 02:17 | |
*** xyang1 has quit IRC | 02:23 | |
*** pabelanger has quit IRC | 02:27 | |
*** pabelanger has joined #openstack-infra | 02:28 | |
*** tqtran has quit IRC | 02:28 | |
*** unicell has quit IRC | 02:29 | |
openstackgerrit | lifeless proposed openstack-infra/project-config: Be clear about when a failure occurs. https://review.openstack.org/197399 | 02:30 |
openstackgerrit | lifeless proposed openstack-infra/project-config: Really fix requirement checking. https://review.openstack.org/197400 | 02:30 |
openstackgerrit | lifeless proposed openstack-infra/project-config: Really fix requirement checking. https://review.openstack.org/197400 | 02:31 |
lifeless | mordred: fungi: jhesketh: AJaeger: - https://review.openstack.org/#/c/197400/ <- really fix things. | 02:32 |
lifeless | this time with lots of manual testing | 02:32 |
*** baoli has joined #openstack-infra | 02:34 | |
jhesketh | lifeless: little nit | 02:35 |
lifeless | jhesketh: btw flaper87 is putting in a talk proposal for us | 02:36 |
jhesketh | oh cool :-) | 02:36 |
lifeless | jhesketh: replied in the review | 02:37 |
*** Kennan has quit IRC | 02:38 | |
*** Kennan has joined #openstack-infra | 02:38 | |
*** Longgeek_ has quit IRC | 02:39 | |
jhesketh | lifeless: ah thanks, lgtm | 02:40 |
jhesketh | lifeless: although why was the head reqs not strict previously? will this break anything | 02:40 |
lifeless | jhesketh: I think I inverted it in a prior patch | 02:40 |
lifeless | jhesketh: the idea is that whats in master / stable/kilo etc should not be allowed to cause a failure | 02:41 |
*** Longgeek has joined #openstack-infra | 02:41 | |
jhesketh | yep, I agree this new one looks right | 02:41 |
jhesketh | just curious | 02:41 |
*** marun has joined #openstack-infra | 02:43 | |
*** weshay has quit IRC | 02:43 | |
*** baoli has quit IRC | 02:47 | |
*** binbincong has quit IRC | 02:47 | |
*** binbincong has joined #openstack-infra | 02:49 | |
*** baoli has joined #openstack-infra | 02:49 | |
*** unicell has joined #openstack-infra | 02:52 | |
*** teran has joined #openstack-infra | 02:52 | |
*** gyee has quit IRC | 02:52 | |
*** annegentle has quit IRC | 02:53 | |
*** teran has quit IRC | 02:57 | |
*** fallenpegasus has quit IRC | 03:03 | |
*** annegentle has joined #openstack-infra | 03:04 | |
*** Longgeek has quit IRC | 03:14 | |
openstackgerrit | Merged openstack-infra/irc-meetings: Update the TripleO meeting schedule https://review.openstack.org/197202 | 03:16 |
*** unicell has quit IRC | 03:22 | |
*** unicell has joined #openstack-infra | 03:23 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/irc-meetings: Update Puppet OpenStack meeting informations https://review.openstack.org/197407 | 03:24 |
*** baoli has quit IRC | 03:26 | |
lifeless | holy cow | 03:31 |
*** annegentle has quit IRC | 03:31 | |
lifeless | its green | 03:31 |
lifeless | SHIP IT | 03:31 |
lifeless | (constraints) | 03:33 |
*** esmute__ has quit IRC | 03:33 | |
*** yamada-h has joined #openstack-infra | 03:36 | |
*** otter768 has joined #openstack-infra | 03:37 | |
*** annegentle has joined #openstack-infra | 03:38 | |
*** harlowja_at_home has joined #openstack-infra | 03:40 | |
*** jyuso1 has joined #openstack-infra | 03:41 | |
*** otter768 has quit IRC | 03:42 | |
*** Longgeek has joined #openstack-infra | 03:45 | |
*** BharatK has joined #openstack-infra | 03:46 | |
*** ildikov has quit IRC | 03:47 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: refactorize puppet-syntax job https://review.openstack.org/197216 | 03:47 |
*** annegentle has quit IRC | 03:48 | |
*** Longgeek has quit IRC | 03:49 | |
*** jogo has joined #openstack-infra | 03:50 | |
*** teran has joined #openstack-infra | 03:52 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: add puppet-unit-latest job https://review.openstack.org/197218 | 03:54 |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: do not run beaker/upgrade jobs on old branches https://review.openstack.org/197219 | 03:54 |
*** soren has joined #openstack-infra | 03:55 | |
*** teran has quit IRC | 03:57 | |
*** heyongli has quit IRC | 03:57 | |
*** ddieterl_ has quit IRC | 03:58 | |
*** heyongli has joined #openstack-infra | 03:58 | |
*** dims_ has quit IRC | 04:03 | |
*** acruz has quit IRC | 04:05 | |
*** asettle has joined #openstack-infra | 04:06 | |
openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image builds using gearman https://review.openstack.org/195175 | 04:06 |
openstackgerrit | greghaynes proposed openstack-infra/nodepool: Run geard for nodepool tests https://review.openstack.org/194928 | 04:06 |
*** heyongli has quit IRC | 04:07 | |
*** heyongli has joined #openstack-infra | 04:08 | |
*** yfried has quit IRC | 04:08 | |
*** Alexandra_ has joined #openstack-infra | 04:08 | |
*** armax has joined #openstack-infra | 04:10 | |
*** asettle has quit IRC | 04:10 | |
*** coolsvap|away is now known as coolsvap | 04:14 | |
*** Alexandra_ has quit IRC | 04:14 | |
openstackgerrit | Don Dugger proposed openstack-infra/irc-meetings: New meeting time https://review.openstack.org/197412 | 04:15 |
*** harlowja_at_home has quit IRC | 04:15 | |
*** koolhead17 has joined #openstack-infra | 04:17 | |
*** achanda has joined #openstack-infra | 04:19 | |
*** dannywilson has quit IRC | 04:21 | |
*** dannywilson has joined #openstack-infra | 04:21 | |
*** morganfainberg is now known as caerbannograbbit | 04:24 | |
*** caerbannograbbit is now known as CaerbannogRabbit | 04:24 | |
*** MarkAtwood has joined #openstack-infra | 04:26 | |
*** Qiming has quit IRC | 04:26 | |
openstackgerrit | Merged openstack-infra/irc-meetings: New meeting time https://review.openstack.org/197412 | 04:28 |
*** puranamr has joined #openstack-infra | 04:28 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/irc-meetings: Update Puppet OpenStack meeting informations https://review.openstack.org/197407 | 04:31 |
*** deepakcs has joined #openstack-infra | 04:33 | |
*** Longgeek has joined #openstack-infra | 04:34 | |
*** achanda has quit IRC | 04:38 | |
*** kiran-r has joined #openstack-infra | 04:41 | |
*** fawadkhaliq has joined #openstack-infra | 04:43 | |
openstackgerrit | Anand Shanmugam proposed openstack/requirements: Adding cloudpulse and cloudpulseclient to projects https://review.openstack.org/196004 | 04:43 |
openstackgerrit | Merged openstack-infra/irc-meetings: Update Puppet OpenStack meeting informations https://review.openstack.org/197407 | 04:44 |
*** hdd has quit IRC | 04:46 | |
*** yfried has joined #openstack-infra | 04:49 | |
*** annegentle has joined #openstack-infra | 04:49 | |
*** yfried_ has joined #openstack-infra | 04:52 | |
*** teran has joined #openstack-infra | 04:53 | |
*** yfried has quit IRC | 04:53 | |
*** annegentle has quit IRC | 04:55 | |
*** kiran-r has quit IRC | 04:56 | |
*** kiran-r has joined #openstack-infra | 04:56 | |
*** esmute__ has joined #openstack-infra | 04:57 | |
*** teran has quit IRC | 04:58 | |
*** ddieterly has joined #openstack-infra | 04:59 | |
*** skraynev has joined #openstack-infra | 05:02 | |
*** ilyashakhat has joined #openstack-infra | 05:02 | |
*** ddieterly has quit IRC | 05:03 | |
*** chlong has quit IRC | 05:03 | |
*** dims has joined #openstack-infra | 05:07 | |
*** esmute__ has quit IRC | 05:09 | |
*** fallenpegasus has joined #openstack-infra | 05:09 | |
*** dims has quit IRC | 05:12 | |
*** chlong has joined #openstack-infra | 05:21 | |
*** esmute__ has joined #openstack-infra | 05:22 | |
*** marun has quit IRC | 05:23 | |
*** heyongli has quit IRC | 05:30 | |
openstackgerrit | Jens Rosenboom proposed openstack-infra/nodepool: Be more careful when config options are not set https://review.openstack.org/190526 | 05:31 |
*** abregman has joined #openstack-infra | 05:33 | |
*** yfried_ is now known as yfried|afk | 05:33 | |
*** heyongli has joined #openstack-infra | 05:37 | |
*** yfried|afk is now known as yfried_ | 05:37 | |
*** otter768 has joined #openstack-infra | 05:38 | |
*** mmedvede has quit IRC | 05:40 | |
*** kaisers1 has quit IRC | 05:43 | |
*** otter768 has quit IRC | 05:43 | |
*** jtomasek has joined #openstack-infra | 05:45 | |
*** dannywilson has quit IRC | 05:53 | |
*** puranamr has quit IRC | 05:53 | |
*** teran has joined #openstack-infra | 05:54 | |
*** jgrimm is now known as zz_jgrimm | 05:55 | |
lifeless | ok so constraints are ready | 05:57 |
lifeless | oh gnarg. a failure I missed. | 05:58 |
lifeless | in 1 hr we'll know | 05:58 |
*** teran has quit IRC | 05:59 | |
*** e0ne has joined #openstack-infra | 05:59 | |
*** ddieterly has joined #openstack-infra | 06:00 | |
*** davideag_ has quit IRC | 06:00 | |
*** chlong has quit IRC | 06:01 | |
*** chlong has joined #openstack-infra | 06:01 | |
*** BharatK has quit IRC | 06:02 | |
*** ddieterly has quit IRC | 06:04 | |
*** fawadkhaliq has quit IRC | 06:04 | |
*** e0ne has quit IRC | 06:11 | |
*** john-davidge has joined #openstack-infra | 06:12 | |
*** puranamr has joined #openstack-infra | 06:13 | |
*** gokrokve has joined #openstack-infra | 06:16 | |
*** mrunge has joined #openstack-infra | 06:16 | |
*** spredzy|afk is now known as spredzy | 06:16 | |
*** BharatK has joined #openstack-infra | 06:17 | |
*** gokrokve has quit IRC | 06:18 | |
*** puranamr has quit IRC | 06:18 | |
*** chlong has quit IRC | 06:19 | |
*** marun has joined #openstack-infra | 06:20 | |
*** MarkAtwood has quit IRC | 06:20 | |
*** scheuran has joined #openstack-infra | 06:20 | |
openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: Create automated job for sample configuration files https://review.openstack.org/177620 | 06:21 |
*** fawadkhaliq has joined #openstack-infra | 06:25 | |
*** marun has quit IRC | 06:25 | |
*** fawadkhaliq has quit IRC | 06:31 | |
*** chlong has joined #openstack-infra | 06:34 | |
*** _nadya_ has joined #openstack-infra | 06:34 | |
*** nikil89_ has joined #openstack-infra | 06:35 | |
*** nikil89_ is now known as naggappan | 06:35 | |
*** skraynev has quit IRC | 06:35 | |
*** mrunge has quit IRC | 06:35 | |
*** yamahata has joined #openstack-infra | 06:39 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Fix Normalize projects.yaml proposal https://review.openstack.org/197443 | 06:40 |
blaedd | lifeless, tests take an hour to run? eww. | 06:42 |
*** asettle has joined #openstack-infra | 06:43 | |
*** mrunge has joined #openstack-infra | 06:45 | |
*** Murad has joined #openstack-infra | 06:45 | |
Murad | does anybody have any idea how in install devstack with infiniband interface? | 06:46 |
*** ildikov has joined #openstack-infra | 06:49 | |
*** Ala has joined #openstack-infra | 06:50 | |
*** k4n0 has joined #openstack-infra | 06:51 | |
*** annegentle has joined #openstack-infra | 06:51 | |
*** yfried_ is now known as yfried|afk | 06:52 | |
*** teran has joined #openstack-infra | 06:55 | |
*** skraynev has joined #openstack-infra | 06:56 | |
*** annegentle has quit IRC | 06:56 | |
*** esmute__ has quit IRC | 06:58 | |
*** teran has quit IRC | 06:59 | |
*** yfried|afk is now known as yfried_ | 06:59 | |
*** ddieterly has joined #openstack-infra | 07:00 | |
*** otter768 has joined #openstack-infra | 07:00 | |
*** hichihara has quit IRC | 07:01 | |
*** frobware_ has joined #openstack-infra | 07:01 | |
*** isviridov_away is now known as isviridov | 07:01 | |
clarkb | Murad I am not aware of any direct support. IPoIB is likely your best bet with devstack | 07:01 |
clarkb | for not devstacj I believe there is a neutron plugin for mellanox | 07:02 |
*** doude has joined #openstack-infra | 07:03 | |
*** leanderthal has quit IRC | 07:03 | |
*** asettle has quit IRC | 07:04 | |
*** ddieterly has quit IRC | 07:05 | |
*** otter768 has quit IRC | 07:06 | |
AJaeger | clarkb, fungi, pleia2: The change we did for the proposal jobs works fine and is needed as well here: https://review.openstack.org/197443 - please review to unbreak that job | 07:06 |
*** yamamoto has quit IRC | 07:08 | |
clarkb | AJaeger does that work if the branch already exists? | 07:09 |
AJaeger | the -B ensures that | 07:09 |
clarkb | or does checkout -B fail on the second run? these are not single use nodes so this may break | 07:09 |
AJaeger | " If -B is given, <new_branch> is created if it doesn’t exist; otherwise, it is reset" | 07:10 |
clarkb | oh -B is dont dail if exists on top of -b? | 07:10 |
clarkb | cool thanks | 07:10 |
openstackgerrit | Merged openstack-infra/project-config: Really fix requirement checking. https://review.openstack.org/197400 | 07:10 |
*** fallenpegasus has quit IRC | 07:12 | |
openstackgerrit | Peng Wu proposed openstack-infra/project-config: This draft patch is created for more-gettext-support jenkins jobs. https://review.openstack.org/197448 | 07:12 |
*** mpavone has joined #openstack-infra | 07:12 | |
*** sshnaidm has joined #openstack-infra | 07:13 | |
*** yamamoto has joined #openstack-infra | 07:15 | |
*** HeOS has quit IRC | 07:15 | |
*** leanderthal has joined #openstack-infra | 07:16 | |
*** armax has quit IRC | 07:18 | |
*** devvesa has joined #openstack-infra | 07:21 | |
*** chlong has quit IRC | 07:24 | |
*** ParsectiX has joined #openstack-infra | 07:24 | |
*** dizquierdo has joined #openstack-infra | 07:27 | |
*** Jeffrey4l has joined #openstack-infra | 07:28 | |
*** ihrachyshka has joined #openstack-infra | 07:28 | |
*** puranamr has joined #openstack-infra | 07:28 | |
*** dtantsur|afk is now known as dtantsur | 07:28 | |
*** JayF has quit IRC | 07:29 | |
*** JayF has joined #openstack-infra | 07:29 | |
*** mjturek1 has joined #openstack-infra | 07:30 | |
*** Jeffrey4l has quit IRC | 07:31 | |
*** rbradfor_ has quit IRC | 07:31 | |
*** zz_jgrimm has quit IRC | 07:31 | |
*** rbradfor_ has joined #openstack-infra | 07:31 | |
*** mpaolino has joined #openstack-infra | 07:32 | |
*** Jeffrey4l has joined #openstack-infra | 07:33 | |
*** zz_jgrimm has joined #openstack-infra | 07:33 | |
*** puranamr has quit IRC | 07:33 | |
*** hashar has joined #openstack-infra | 07:33 | |
Jeffrey4l | is there any block rules exist in review.openstack.org? | 07:34 |
Jeffrey4l | I can not connect the gerrit server | 07:34 |
mrunge | Jeffrey4l, are you located in China? | 07:35 |
Jeffrey4l | yup | 07:35 |
mrunge | congrats. Great wall of china blocks it | 07:35 |
*** unicell has quit IRC | 07:35 | |
mrunge | Jeffrey4l, this question was asked several times in the past. Recommendation was, to use a tunnel | 07:35 |
Jeffrey4l | holly shit | 07:36 |
Jeffrey4l | mrunge, thanks you. | 07:36 |
mrunge | Jeffrey4l, good luck | 07:36 |
mrunge | this block doesn't make any sense | 07:36 |
mrunge | I hope it gets fixed | 07:36 |
*** sshnaidm has quit IRC | 07:38 | |
Jeffrey4l | mrunge, yup. But u know, there is no way to request the fix. | 07:38 |
*** sshnaidm has joined #openstack-infra | 07:38 | |
mrunge | Jeffrey4l, yes. That's like government agencies work, everywhere | 07:39 |
*** dizquierdo has quit IRC | 07:42 | |
openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Fix script file name for Inspector dsvm job https://review.openstack.org/197453 | 07:43 |
*** jlanoux has joined #openstack-infra | 07:43 | |
lifeless | blaedd: devstack etc | 07:43 |
lifeless | blaedd: unit tests are much faster | 07:44 |
clarkb | Jeffrey4l https should work | 07:44 |
lifeless | blaedd: but the integration tests for the system install a full cloud | 07:44 |
lifeless | blaedd: and then exercise it | 07:44 |
lifeless | blaedd: (on multiple nodes) - and they're full VM's not containers | 07:44 |
*** Guest21021 has quit IRC | 07:44 | |
clarkb | Jeffrey4l http://lists.openstack.org/pipermail/openstack-dev/2014-September/045385.html | 07:45 |
*** jistr has joined #openstack-infra | 07:45 | |
Jeffrey4l | clarkb, thanks a lot. u save lots of time for me. I will try that. | 07:46 |
*** jtomasek has quit IRC | 07:48 | |
*** jcoufal has joined #openstack-infra | 07:49 | |
*** hashar has quit IRC | 07:50 | |
*** shardy has joined #openstack-infra | 07:50 | |
*** hashar has joined #openstack-infra | 07:50 | |
*** arxcruz has joined #openstack-infra | 07:52 | |
lifeless | AHAHAHAHAAH | 07:52 |
lifeless | killed by my own cleverness: virtualenv was held back by upper-constraints.txt | 07:52 |
*** kiran-r has quit IRC | 07:52 | |
*** yfried_ is now known as yfried | 07:53 | |
lifeless | fungi: / mordred: ^ you may appreciate the irony | 07:55 |
*** teran has joined #openstack-infra | 07:55 | |
lifeless | The changeset to test constraints working failed because constraints worked | 07:56 |
*** mpaolino has quit IRC | 07:56 | |
*** hashar has quit IRC | 07:56 | |
*** e0ne has joined #openstack-infra | 07:56 | |
AJaeger | lifeless: ;) | 07:58 |
*** afazekas is now known as __afazekas | 07:59 | |
*** shardy has quit IRC | 08:00 | |
*** shardy has joined #openstack-infra | 08:00 | |
*** ddieterly has joined #openstack-infra | 08:01 | |
*** Hal has joined #openstack-infra | 08:01 | |
*** teran has quit IRC | 08:01 | |
*** Hal is now known as Guest29517 | 08:02 | |
openstackgerrit | lifeless proposed openstack/requirements: Update upper-constraints.txt https://review.openstack.org/197461 | 08:02 |
openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Fix script file name for Inspector dsvm job https://review.openstack.org/197453 | 08:02 |
lifeless | so https://review.openstack.org/197461 should fix it | 08:02 |
*** hashar has joined #openstack-infra | 08:03 | |
*** mrunge has quit IRC | 08:04 | |
*** koolhead17 has quit IRC | 08:05 | |
*** ddieterly has quit IRC | 08:06 | |
clarkb | so does everythibg break until we bumo that whenwver virtualenv releases? | 08:07 |
clarkb | *bump | 08:07 |
* blaedd runs the tripleo devtest inside a vm on his home machine, and waits for things to explode | 08:07 | |
clarkb | because that represents a flaw in the system if so | 08:09 |
*** marun has joined #openstack-infra | 08:09 | |
*** mrunge has joined #openstack-infra | 08:09 | |
lifeless | clarkb: huh? no, its the pip vendoring | 08:10 |
*** teran has joined #openstack-infra | 08:10 | |
*** fhubik has joined #openstack-infra | 08:11 | |
lifeless | clarkb: new virtualenv is needed *in constraints mode* because it has the new pip vendored in it | 08:11 |
clarkb | gotcha so going forwar is not an issue | 08:12 |
lifeless | right | 08:12 |
openstackgerrit | lifeless proposed openstack-infra/devstack-gate: Switch to using constraints files. https://review.openstack.org/194886 | 08:13 |
*** isviridov is now known as isviridov_away | 08:13 | |
*** BobBall_AWOL is now known as BobBall | 08:14 | |
*** marun has quit IRC | 08:14 | |
lifeless | AJaeger: care to +2+A on https://review.openstack.org/197461 :) | 08:14 |
lifeless | AJaeger: it only changes upper-constraints.txt which isn't in use yet, so tis a no-brainer | 08:15 |
AJaeger | lifeless: I don't have +2 permissions there... | 08:15 |
lifeless | AJaeger: oh, I thought you were infra +2 capable | 08:15 |
*** __afazekas is now known as afazekas | 08:20 | |
*** bmwiedemann has joined #openstack-infra | 08:24 | |
*** yamahata has quit IRC | 08:26 | |
AJaeger | lifeless: only project-config | 08:27 |
lifeless | AJaeger: ah, sadness. | 08:27 |
lifeless | jhesketh: still around ? | 08:27 |
jhesketh | lifeless: roger | 08:28 |
AJaeger | no: Focus and thus sanity ;) | 08:28 |
lifeless | jhesketh: https://review.openstack.org/197461 please :) | 08:28 |
*** dguerri` is now known as dguerri | 08:29 | |
*** HeOS has joined #openstack-infra | 08:29 | |
*** yamamoto has quit IRC | 08:31 | |
GheRivero | lifeless: should we wait for tests to pass? ^^ | 08:32 |
jhesketh | lifeless: lgtm | 08:32 |
jhesketh | GheRivero: yes | 08:32 |
GheRivero | :) | 08:33 |
openstackgerrit | Victor Stinner proposed openstack-infra/jenkins-job-builder: Fix Builder.update_job() on Python 3 https://review.openstack.org/172238 | 08:35 |
openstackgerrit | Victor Stinner proposed openstack-infra/jenkins-job-builder: Replace open() with codecs.open() https://review.openstack.org/183488 | 08:35 |
*** e0ne is now known as e0ne_ | 08:36 | |
AJaeger | GheRivero, jhesketh: Jenkins will not allow a merge without tests to pass, so you could approve IMHO unless there are non-voting changes taht you like to review... | 08:37 |
*** yamamoto has joined #openstack-infra | 08:37 | |
* AJaeger normally also waits for the results to double check ;) | 08:37 | |
jhesketh | AJaeger: yeah it's just a double check | 08:38 |
*** e0ne_ is now known as e0ne | 08:38 | |
jhesketh | mostly because without reviewing every tiny increment/release of all the updated packages it's hard to know what that change will actually do | 08:39 |
*** dizquierdo has joined #openstack-infra | 08:39 | |
*** dizquierdo has quit IRC | 08:39 | |
*** dizquierdo has joined #openstack-infra | 08:39 | |
*** pelix has joined #openstack-infra | 08:39 | |
*** dguitarbite has quit IRC | 08:40 | |
*** notnownikki has joined #openstack-infra | 08:40 | |
*** dguerri is now known as dguerri` | 08:41 | |
*** e0ne has quit IRC | 08:41 | |
lifeless | GheRivero: no :) | 08:43 |
lifeless | GheRivero: upper-constraints isn't used by anything landed, so it can't possibly affect tests | 08:43 |
lifeless | jhesketh: GheRivero: ^ - so +A :) | 08:43 |
*** laughterwym has quit IRC | 08:47 | |
*** jasondotstar has joined #openstack-infra | 08:48 | |
*** ParsectiX has quit IRC | 08:49 | |
*** afazekas is now known as __afazekas | 08:50 | |
*** ParsectiX has joined #openstack-infra | 08:50 | |
*** mase_x200 has joined #openstack-infra | 08:50 | |
GheRivero | lifeless: done | 08:51 |
*** pblaho has joined #openstack-infra | 08:51 | |
*** dtantsur is now known as dtantsur|brb | 08:58 | |
openstackgerrit | Merged openstack-infra/zuul: Status: Fix JSHint violations and commit settings https://review.openstack.org/169957 | 09:00 |
*** mpavlase has joined #openstack-infra | 09:00 | |
*** mase_x200 has quit IRC | 09:01 | |
*** hashar has quit IRC | 09:01 | |
*** naggappan has quit IRC | 09:01 | |
*** ddieterly has joined #openstack-infra | 09:02 | |
*** otter768 has joined #openstack-infra | 09:02 | |
*** dizquierdo has quit IRC | 09:05 | |
*** ddieterly has quit IRC | 09:06 | |
*** Guest29517 has quit IRC | 09:06 | |
*** hashar has joined #openstack-infra | 09:06 | |
*** Hal has joined #openstack-infra | 09:06 | |
*** Hal is now known as Guest60452 | 09:07 | |
*** otter768 has quit IRC | 09:07 | |
lifeless | GheRivero: \o/ thanks | 09:08 |
*** dims has joined #openstack-infra | 09:08 | |
*** teran has quit IRC | 09:11 | |
*** abregman is now known as abregman|lunch | 09:12 | |
*** dims has quit IRC | 09:14 | |
*** katyafervent is now known as katyafervent_awa | 09:19 | |
hashar | good morning | 09:19 |
*** katyafervent_awa is now known as katyafervent | 09:20 | |
*** afazekas has joined #openstack-infra | 09:24 | |
*** KanagarajM has joined #openstack-infra | 09:24 | |
*** dizquierdo has joined #openstack-infra | 09:24 | |
KanagarajM | AJaeger: Hi, could you review https://review.openstack.org/#/c/195531/ (for heat project) | 09:24 |
ekarlso | http://pastebin.com/BvGA8t6H < anyone know what's wrong here ? | 09:26 |
AJaeger | KanagarajM: +2 | 09:27 |
KanagarajM | AJaeger: thanks | 09:27 |
*** samuelBartel has joined #openstack-infra | 09:27 | |
AJaeger | lifeless: could you look at ekarlso's pastebein ^, please? Looks requirements related | 09:27 |
KanagarajM | SergeyLukjanov: Hi, could you review https://review.openstack.org/#/c/195531/ (for heat project) | 09:29 |
*** ihrachyshka has quit IRC | 09:30 | |
*** yamada-h has quit IRC | 09:31 | |
*** fhubik is now known as fhubik_afk | 09:32 | |
*** Guest60452 has quit IRC | 09:33 | |
SergeyLukjanov | KanagarajM, approved | 09:34 |
*** e0ne has joined #openstack-infra | 09:35 | |
*** fhubik_afk is now known as fhubik | 09:35 | |
KanagarajM | SergeyLukjanov: thanks | 09:36 |
*** laughterwym has joined #openstack-infra | 09:37 | |
kashyap | For some reason, some of the repos in `gertty` doesn't sync and Error out after some amount of trying. | 09:38 |
*** Sherif has joined #openstack-infra | 09:39 | |
*** ociuhandu has quit IRC | 09:39 | |
lifeless | AJaeger: http://lists.openstack.org/pipermail/openstack-dev/2015-June/068031.html | 09:39 |
openstackgerrit | Merged openstack-infra/project-config: Enables job for heat convergence functional test https://review.openstack.org/195531 | 09:40 |
kashyap | Any clues about this? Also, strangely ~/.gertty.log ends up being a data file. (/me is using the newest upstream release.) | 09:40 |
*** Sherif has quit IRC | 09:40 | |
lifeless | ekarlso: ^ | 09:40 |
* kashyap enables debug logging and checks | 09:41 | |
AJaeger | lifeless: thanks. Seems really to address ekarlso's problem | 09:42 |
*** bradjones has quit IRC | 09:44 | |
ekarlso | lifeless: thnx! | 09:44 |
*** Hal has joined #openstack-infra | 09:44 | |
*** Hal is now known as Guest75407 | 09:45 | |
*** sdake has quit IRC | 09:46 | |
*** bradjones has joined #openstack-infra | 09:46 | |
*** bradjones has quit IRC | 09:46 | |
*** bradjones has joined #openstack-infra | 09:46 | |
*** mikeit has joined #openstack-infra | 09:47 | |
openstackgerrit | Merged openstack/requirements: Update upper-constraints.txt https://review.openstack.org/197461 | 09:52 |
*** soren has quit IRC | 09:54 | |
*** marun has joined #openstack-infra | 09:58 | |
*** dims has joined #openstack-infra | 09:59 | |
*** ihrachyshka has joined #openstack-infra | 09:59 | |
*** BharatK has quit IRC | 10:01 | |
*** yamada-h has joined #openstack-infra | 10:01 | |
openstackgerrit | Sergey Reshetnyak proposed openstack-infra/project-config: Make Sahara python3 job voting https://review.openstack.org/197498 | 10:02 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from global requirements https://review.openstack.org/196504 | 10:02 |
*** marun has quit IRC | 10:02 | |
*** ddieterly has joined #openstack-infra | 10:02 | |
*** andrey-mp has joined #openstack-infra | 10:04 | |
*** Guest75407 has quit IRC | 10:05 | |
*** andrey-mp has quit IRC | 10:05 | |
*** andrey-mp has joined #openstack-infra | 10:05 | |
andrey-mp | Hi! Who can help me to understand how to merge this - https://review.openstack.org/#/c/172335/ ? | 10:06 |
*** yamada-h has quit IRC | 10:06 | |
openstackgerrit | Gorka Eguileor proposed openstack-infra/elastic-recheck: Add fingerprint for Glance upload disconnect https://review.openstack.org/197500 | 10:07 |
openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder: openSUSE: Fix link to the images download folder https://review.openstack.org/197501 | 10:07 |
*** ddieterly has quit IRC | 10:07 | |
*** dtantsur|brb is now known as dtantsur | 10:08 | |
*** soren has joined #openstack-infra | 10:09 | |
openstackgerrit | Antoine Musso proposed openstack-infra/gearman-plugin: Fix deadlock from a WORK_FAIL event https://review.openstack.org/192429 | 10:17 |
*** abregman|lunch is now known as abregman | 10:20 | |
*** john-davidge has quit IRC | 10:21 | |
*** hafe has joined #openstack-infra | 10:22 | |
hafe | when I try to submit the ICLA I get server error - "Cannot store contact information", any ideas? | 10:23 |
frickler | hafe: the usual response would be to look at https://ask.openstack.org/en/question/56720/cannot-store-contact-information-when-updating-info-in-openstack-gerrit/ | 10:26 |
hafe | frickler: thanks | 10:27 |
*** john-davidge has joined #openstack-infra | 10:27 | |
*** yamamoto has quit IRC | 10:28 | |
andrey-mp | ok, Who can set review on this - https://review.openstack.org/#/c/172335/ ? | 10:28 |
*** samuelBartel has quit IRC | 10:29 | |
*** pc_m has joined #openstack-infra | 10:31 | |
openstackgerrit | Bob Ball proposed openstack-infra/irc-meetings: Update XenAPI team meeting https://review.openstack.org/197507 | 10:32 |
*** BharatK has joined #openstack-infra | 10:32 | |
openstackgerrit | Florian Wilhelm proposed openstack-dev/pbr: Fix retrieval of commit data and most recent tag. https://review.openstack.org/197508 | 10:34 |
*** john-davidge has quit IRC | 10:34 | |
*** fhubik is now known as fhubik_afk | 10:34 | |
*** binbincong has quit IRC | 10:34 | |
openstackgerrit | Florian Wilhelm proposed openstack-dev/pbr: Fix retrieval of commit data and most recent tag. https://review.openstack.org/194954 | 10:38 |
*** e0ne is now known as e0ne_ | 10:39 | |
*** e0ne_ is now known as e0ne | 10:39 | |
*** yfried is now known as yfried|afk | 10:40 | |
*** DericHorn-HP has joined #openstack-infra | 10:42 | |
*** claudiub has joined #openstack-infra | 10:46 | |
*** yfried|afk is now known as yfried | 10:46 | |
*** sergmelikyan has joined #openstack-infra | 10:49 | |
*** nfedotov has joined #openstack-infra | 10:50 | |
*** hashar has quit IRC | 10:50 | |
*** KanagarajM has left #openstack-infra | 10:53 | |
*** hafe has left #openstack-infra | 10:55 | |
openstackgerrit | Bob Ball proposed openstack-infra/irc-meetings: Update XenAPI team meeting https://review.openstack.org/197507 | 10:55 |
*** BharatK has quit IRC | 10:57 | |
*** Hal has joined #openstack-infra | 10:58 | |
*** Hal is now known as Guest22716 | 10:59 | |
openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Update XenAPI team meeting https://review.openstack.org/197507 | 11:00 |
*** dprince has joined #openstack-infra | 11:01 | |
*** ociuhandu has joined #openstack-infra | 11:03 | |
*** ddieterly has joined #openstack-infra | 11:03 | |
openstackgerrit | Sergey Skripnick proposed openstack-infra/project-config: Switch rally-heat job to neutron from nova-network https://review.openstack.org/197515 | 11:05 |
*** ddieterly has quit IRC | 11:08 | |
*** weshay has joined #openstack-infra | 11:08 | |
*** BharatK has joined #openstack-infra | 11:10 | |
openstackgerrit | Merged openstack-infra/irc-meetings: Update XenAPI team meeting https://review.openstack.org/197507 | 11:11 |
*** mikeit has quit IRC | 11:14 | |
*** teran has joined #openstack-infra | 11:15 | |
*** sergmelikyan has quit IRC | 11:17 | |
*** fhubik_afk is now known as fhubik | 11:17 | |
*** fhubik is now known as fhubik_afk | 11:18 | |
*** teran_ has joined #openstack-infra | 11:18 | |
*** teran has quit IRC | 11:20 | |
BobBall | tonyb: How long does it take for the main page @eavesdrop.openstack.org to be updated with the new meeting time? | 11:20 |
*** yamamoto has joined #openstack-infra | 11:20 | |
*** e0ne is now known as e0ne_ | 11:24 | |
*** e0ne_ is now known as e0ne | 11:24 | |
*** DericHorn-HP has quit IRC | 11:25 | |
*** sergmelikyan has joined #openstack-infra | 11:25 | |
*** sergmelikyan has quit IRC | 11:29 | |
*** sergmelikyan has joined #openstack-infra | 11:29 | |
openstackgerrit | Sergey Lukjanov proposed openstack-infra/project-config: Start using in-tree Sahara Devstack plugin https://review.openstack.org/197524 | 11:29 |
openstackgerrit | Andrey Kurilin proposed openstack-infra/project-config: Switch rally-heat job to neutron from nova-network https://review.openstack.org/197515 | 11:30 |
AJaeger | BobBall: this is done via a postjob, see http://status.openstack.org/zuul/ whether yours is run already. Currently it's not. post jobs are run with low priority... | 11:30 |
Kiall | Hey infra folks - could I get a quick review on a small DSVM job change? https://review.openstack.org/#/c/196961/ Thanks :) | 11:30 |
BobBall | Fair enough! | 11:31 |
*** sergmelikyan has quit IRC | 11:31 | |
* BobBall will occasionally check then :) | 11:31 | |
*** ldnunes has joined #openstack-infra | 11:31 | |
*** sergmelikyan has joined #openstack-infra | 11:32 | |
*** pradk has joined #openstack-infra | 11:34 | |
SergeyLukjanov | Kiall, +2d | 11:34 |
Kiall | SergeyLukjanov: thanks :) | 11:35 |
*** jasondotstar has quit IRC | 11:35 | |
*** prad has quit IRC | 11:36 | |
*** jasondotstar has joined #openstack-infra | 11:36 | |
*** sergmelikyan has quit IRC | 11:36 | |
*** yamamoto has quit IRC | 11:38 | |
*** yamamoto has joined #openstack-infra | 11:39 | |
*** pradk has quit IRC | 11:40 | |
*** hashar has joined #openstack-infra | 11:41 | |
*** jasondotstar has quit IRC | 11:41 | |
*** fhubik_afk is now known as fhubik | 11:41 | |
openstackgerrit | Kiall Mac Innes proposed openstack/requirements: Add openstack/designate-dashboard to projects https://review.openstack.org/197530 | 11:42 |
*** jcoufal has quit IRC | 11:42 | |
AJaeger | Kiall, no need to add the whole team to the review... | 11:44 |
AJaeger | Kiall: +2A | 11:45 |
Kiall | AJaeger: awesome, and.. I actually only thought the team was like 4 of you :) I added the group and got a surpise! Sorry | 11:45 |
AJaeger | Kiall: https://review.openstack.org/#/admin/groups/459,members - 3 plus all infra cores ;) | 11:46 |
*** marun has joined #openstack-infra | 11:46 | |
Kiall | Heh - I didn't know the infra-core group was included ;) Sorry | 11:46 |
*** yamamoto has quit IRC | 11:47 | |
andrey-mp | AJaeger, where I can find channel for openstack/requirements ? ) | 11:47 |
andrey-mp | I'm triyng to find someone who can review my change https://review.openstack.org/#/c/172335/ :( | 11:48 |
openstackgerrit | Merged openstack-infra/project-config: Add openstack/designate-dashboard to designate DSVM gates https://review.openstack.org/196961 | 11:48 |
*** Jeffrey4l has quit IRC | 11:49 | |
*** jcoufal has joined #openstack-infra | 11:49 | |
AJaeger | andrey-mp: channel here is fine and to check the list of people that are core, open https://review.openstack.org/#/c/172335/, click on the text "openstack/requirements", click on "Access" and then on "requirements-core" | 11:49 |
*** jcoufal is now known as Guest52168 | 11:50 | |
AJaeger | andrey-mp: GheRivero was around this morning (European time), others migth be in the US. | 11:50 |
*** Guest52168 has quit IRC | 11:50 | |
andrey-mp | I added all people from both lists several weeks ago :( | 11:50 |
*** jcoufal_ has joined #openstack-infra | 11:50 | |
AJaeger | andrey-mp: Seems you added too many ;) Better ask them directly - and if you ask here, tell us what it is. | 11:51 |
andrey-mp | AJaeger, thanks. will do. | 11:51 |
*** marun has quit IRC | 11:52 | |
*** sergmelikyan has joined #openstack-infra | 11:52 | |
*** sergmelikyan has quit IRC | 11:52 | |
AJaeger | andrey-mp: So, instead of asking for a review of X, ask for "review of change X that adds Y to requirements repo to allow us to...". That way the right people will look at it. In this channel, we have dozens of repos and thus many ignore unqualified requests | 11:52 |
*** sergmelikyan has joined #openstack-infra | 11:52 | |
andrey-mp | ok, thanks for information :) | 11:53 |
openstackgerrit | Merged openstack-infra/grafyaml: Initial unit tests for CLI https://review.openstack.org/189770 | 11:53 |
openstackgerrit | Merged openstack-infra/grafyaml: Fix --version CLI output https://review.openstack.org/189788 | 11:53 |
openstackgerrit | Merged openstack-infra/puppet-jenkins: Always install latest git-review https://review.openstack.org/197203 | 11:57 |
*** _nadya_ has quit IRC | 11:58 | |
*** Longgeek has quit IRC | 11:59 | |
andrey-mp | GheRivero, are you here? could you review of change https://review.openstack.org/#/c/172335/ that adds 'botocore' to requirements repo to allow us to use it in stackforge/ec2-api project. this library is needed for functional tests of ec2 project. | 11:59 |
*** sergmelikyan has quit IRC | 11:59 | |
openstackgerrit | Merged openstack-infra/project-config: Run diskimage-builder-install macro for akanda image build https://review.openstack.org/196946 | 12:01 |
openstackgerrit | Merged openstack-infra/project-config: Fix script file name for Inspector dsvm job https://review.openstack.org/197453 | 12:02 |
*** _diana_ has joined #openstack-infra | 12:02 | |
*** dizquierdo has quit IRC | 12:03 | |
*** Jeffrey4l has joined #openstack-infra | 12:03 | |
*** sergmelikyan has joined #openstack-infra | 12:04 | |
*** ddieterly has joined #openstack-infra | 12:04 | |
*** hashar is now known as hasharConfcall | 12:04 | |
andrey-mp | SergeyLukjanov, could you review of change https://review.openstack.org/#/c/172335/ that adds 'botocore' to requirements repo to allow us to use it in stackforge/ec2-api project. this library is needed for functional tests of ec2 project. | 12:07 |
openstackgerrit | Merged openstack-infra/system-config: Alpha-sort the cacti host list https://review.openstack.org/191989 | 12:07 |
*** yamamoto has joined #openstack-infra | 12:08 | |
*** yamamoto has quit IRC | 12:08 | |
openstackgerrit | Merged openstack-infra/system-config: Add apps.openstack.org to cacti https://review.openstack.org/191990 | 12:09 |
*** thorst has joined #openstack-infra | 12:09 | |
*** ociuhandu has quit IRC | 12:09 | |
*** samuelBartel has joined #openstack-infra | 12:10 | |
flaper87 | AJaeger: ping, I forgot what the process to request a new branch is. We need a stable/juno branch for glanceclient to be created out of this tag: https://github.com/openstack/python-glanceclient/commits/0.14.2 | 12:11 |
*** fhubik is now known as fhubik_afk | 12:11 | |
flaper87 | AJaeger: mind refreshing my mind with what the process is ? | 12:11 |
flaper87 | :D | 12:11 |
flaper87 | fungi: ^ in case you're around already | 12:11 |
flaper87 | :) | 12:11 |
*** sergmelikyan has quit IRC | 12:13 | |
*** markvoelker has quit IRC | 12:14 | |
*** markvoelker has joined #openstack-infra | 12:14 | |
*** eharney has joined #openstack-infra | 12:14 | |
openstackgerrit | Merged openstack-infra/system-config: Set proper permissions on login.def https://review.openstack.org/190777 | 12:15 |
*** sergmelikyan has joined #openstack-infra | 12:15 | |
*** sergmelikyan has quit IRC | 12:15 | |
*** sergmelikyan has joined #openstack-infra | 12:15 | |
*** sergmelikyan has quit IRC | 12:16 | |
*** mpavone has quit IRC | 12:16 | |
*** sergmelikyan has joined #openstack-infra | 12:16 | |
*** sergmelikyan has quit IRC | 12:16 | |
*** raginbajin has quit IRC | 12:18 | |
*** _diana_ has quit IRC | 12:18 | |
*** kiran-r has joined #openstack-infra | 12:18 | |
frickler | flaper87: I don't know how to create the branch, but I'm curious: you intend to cut a 0.14.3 including a backport of https://review.openstack.org/#/c/156975/? | 12:19 |
*** _diana_ has joined #openstack-infra | 12:19 | |
*** raginbajin has joined #openstack-infra | 12:19 | |
flaper87 | frickler: that was not the plan but I guess we could consider it :) | 12:20 |
*** radez_g0n3 is now known as radez | 12:21 | |
*** ociuhandu has joined #openstack-infra | 12:21 | |
openstackgerrit | Merged openstack/requirements: Cap Routes at below 2.0 as 2.1 breaks Nova https://review.openstack.org/196867 | 12:21 |
*** john-davidge has joined #openstack-infra | 12:23 | |
*** jcoufal_ has quit IRC | 12:23 | |
*** sergmelikyan has joined #openstack-infra | 12:24 | |
*** sshnaidm has quit IRC | 12:24 | |
*** sergmelikyan has quit IRC | 12:24 | |
*** heyongli has quit IRC | 12:24 | |
*** sshnaidm has joined #openstack-infra | 12:25 | |
*** Longgeek has joined #openstack-infra | 12:25 | |
*** john-davidge_ has joined #openstack-infra | 12:25 | |
*** deepakcs has quit IRC | 12:26 | |
*** doug-fish has joined #openstack-infra | 12:26 | |
openstackgerrit | Merged openstack-infra/project-config: Fix Normalize projects.yaml proposal https://review.openstack.org/197443 | 12:26 |
*** heyongli has joined #openstack-infra | 12:27 | |
*** shardy has quit IRC | 12:27 | |
*** sergmelikyan has joined #openstack-infra | 12:27 | |
*** john-davidge has quit IRC | 12:28 | |
*** john-davidge_ is now known as john-davidge | 12:28 | |
*** zigo has quit IRC | 12:28 | |
*** sergmelikyan has quit IRC | 12:28 | |
*** zigo has joined #openstack-infra | 12:29 | |
*** sergmelikyan has joined #openstack-infra | 12:29 | |
*** BharatK has quit IRC | 12:29 | |
*** rfolco has joined #openstack-infra | 12:30 | |
*** dizquierdo has joined #openstack-infra | 12:30 | |
*** aysyd has joined #openstack-infra | 12:30 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from global requirements https://review.openstack.org/196504 | 12:30 |
*** mpavone has joined #openstack-infra | 12:31 | |
*** shardy has joined #openstack-infra | 12:31 | |
*** Longgeek has quit IRC | 12:31 | |
*** kiran-r has quit IRC | 12:32 | |
*** sergmelikyan has quit IRC | 12:32 | |
fungi | flaper87: ask the library release managers to handle it, i believe https://review.openstack.org/#/admin/groups/967,members | 12:32 |
flaper87 | fungi: alright, I can do that. Thank you :) | 12:33 |
fungi | flaper87: though they may end up involving the release management team to do the actual branch creation after they confirm that's a feasible choice https://review.openstack.org/#/admin/groups/11,members | 12:33 |
andrey-mp | fungi, could you review of change https://review.openstack.org/#/c/172335/ that adds 'botocore' to requirements repo to allow us to use it in stackforge/ec2-api project. this library is needed for functional tests of ec2 project. | 12:34 |
*** sergmelikyan has joined #openstack-infra | 12:35 | |
fungi | andrey-mp: the infrastructure team generally doesn't vet changes to the global requirements list unless it's to fix infrastructure problems or multi-project gating breakage | 12:35 |
*** BharatK has joined #openstack-infra | 12:35 | |
*** sergmelikyan has quit IRC | 12:35 | |
*** sergmelikyan has joined #openstack-infra | 12:35 | |
*** sergmelikyan has quit IRC | 12:35 | |
*** sergmelikyan has joined #openstack-infra | 12:35 | |
fungi | andrey-mp: also i'm not sure what the current criteria are for adding requirements needed only by non-openstack repos | 12:35 |
andrey-mp | ok, thanks. I will as to requirements-core group | 12:36 |
andrey-mp | ask | 12:36 |
*** _diana_ has quit IRC | 12:36 | |
*** fallenpegasus has joined #openstack-infra | 12:36 | |
*** annegentle has joined #openstack-infra | 12:37 | |
*** sergmelikyan has quit IRC | 12:37 | |
*** yamamoto has joined #openstack-infra | 12:41 | |
*** e0ne is now known as e0ne_ | 12:41 | |
*** e0ne_ is now known as e0ne | 12:42 | |
*** binbincong has joined #openstack-infra | 12:42 | |
*** yamamoto has quit IRC | 12:42 | |
*** _diana_ has joined #openstack-infra | 12:43 | |
*** baoli has joined #openstack-infra | 12:44 | |
*** bknudson has joined #openstack-infra | 12:45 | |
*** pelix has quit IRC | 12:48 | |
openstackgerrit | Merged openstack/requirements: Bump python-ironicclient minimal version to 0.6.0 https://review.openstack.org/196618 | 12:48 |
*** baoli_ has joined #openstack-infra | 12:48 | |
*** annegentle has quit IRC | 12:48 | |
*** sergmelikyan has joined #openstack-infra | 12:48 | |
GheRivero | andrey-mp: pong. | 12:48 |
*** annegentle has joined #openstack-infra | 12:49 | |
andrey-mp | GheRivero, ping ) | 12:49 |
*** Longgeek has joined #openstack-infra | 12:49 | |
*** yamamoto has joined #openstack-infra | 12:49 | |
fungi | oh wow, yesterday's block storage interruptions in rackspace were leapsecond-related! https://status.rackspace.com/index/viewincidents?group=11&start=1435636800 | 12:50 |
*** jasondotstar has joined #openstack-infra | 12:51 | |
openstackgerrit | Merged openstack/requirements: Add oslo.cache and oslo.reports to global requirements https://review.openstack.org/195058 | 12:51 |
*** baoli has quit IRC | 12:51 | |
andrey-mp | GheRivero, I'm hope to merge this review https://review.openstack.org/#/c/172335/ before code freeze as I got in Kilo... | 12:52 |
andrey-mp | We need it for stackforge/ec2-api project | 12:52 |
*** e0ne is now known as e0ne_ | 12:53 | |
*** rlandy has joined #openstack-infra | 12:54 | |
openstackgerrit | Szymon Wróblewski proposed openstack/requirements: tooz 0.16.0 or better required https://review.openstack.org/197021 | 12:55 |
*** e0ne_ is now known as e0ne | 12:57 | |
*** annegentle has quit IRC | 12:57 | |
*** jsavak has joined #openstack-infra | 12:57 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from global requirements https://review.openstack.org/196504 | 12:58 |
*** annegentle has joined #openstack-infra | 12:58 | |
fungi | AJaeger: i hope i've answered what i think was a question from you on 196907 | 12:59 |
GheRivero | andrey-mp: We are still in time before code freeze :) | 12:59 |
fungi | AJaeger: i can't tell if you're still asking (since you didn't vote on the change) or managed to answer it for yourself | 12:59 |
*** flip214 has quit IRC | 13:00 | |
fungi | AJaeger: er, sorry, i mean 196906 | 13:00 |
*** shardy has quit IRC | 13:01 | |
fungi | GheRivero: out of curiosity, have we started as policy adding global requirements for non-openstack repos? i haven't been following along on those discussions since the big tent shift | 13:01 |
*** shardy has joined #openstack-infra | 13:01 | |
andrey-mp | @GheRivero, thank you very much :) | 13:02 |
*** olaph has quit IRC | 13:03 | |
fungi | just wondering whether this is setting a precedent for every repo in stackforge to start asking to have their requirements added | 13:04 |
*** yamada-h has joined #openstack-infra | 13:04 | |
*** otter768 has joined #openstack-infra | 13:04 | |
*** olaph has joined #openstack-infra | 13:05 | |
*** radez is now known as radez_g0n3 | 13:06 | |
*** yfried has quit IRC | 13:06 | |
*** ihrachyshka_ has joined #openstack-infra | 13:07 | |
*** ddieterly has quit IRC | 13:07 | |
*** ihrachyshka has quit IRC | 13:08 | |
*** yamada-h has quit IRC | 13:08 | |
*** otter768 has quit IRC | 13:09 | |
*** heyongli has quit IRC | 13:09 | |
*** homeless has joined #openstack-infra | 13:09 | |
*** woodster_ has joined #openstack-infra | 13:11 | |
GheRivero | fungi: Me neither (my bad for approving it withput checking) , but I guess, under the big tent, stackforge should be just a temporary step | 13:11 |
*** amitgandhinz has joined #openstack-infra | 13:11 | |
*** spzala has joined #openstack-infra | 13:11 | |
fungi | GheRivero: yeah, no idea if we should be encouraging projects to apply for formal recognition by the tc before we start including their requirements in the global requirements list enforcing version constraints on official repos | 13:12 |
fungi | but i'm happy to leave that decision to the requirements reviewers and the tc | 13:12 |
*** heyongli has joined #openstack-infra | 13:13 | |
fungi | as a counterexample, i think we've not been letting arbitrary repos publish their documentation on docs.openstack.org until they apply and get their project-team recognized by the tc | 13:14 |
andrey-mp | fungi - GheRivero is right, we hope that stackforge is temporary step and our project will be moved to openstack in one of next releases. | 13:14 |
*** trey has joined #openstack-infra | 13:14 | |
*** Longgeek has quit IRC | 13:14 | |
*** Longgeek has joined #openstack-infra | 13:15 | |
fungi | andrey-mp: why wait? just propose the addition to the governance repo and ask the tc to add you | 13:15 |
andrey-mp | we agreed at last summit that our project should be checked by operators and then we will move further | 13:16 |
*** hdd has joined #openstack-infra | 13:16 | |
fungi | there's no requirement for project teams or their software to reach any particular "maturity" before applying, and we don't want people to see stackforge as a "stepping stone" (there's a resolution currently being worked through the tc to make it more obvious we don't want people to think they need to "incubate" things in stackforge before applying to be a part of the openstack community) | 13:16 |
*** mmedvede has joined #openstack-infra | 13:17 | |
openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Add functional test job to python-ironic-inspector-client https://review.openstack.org/197577 | 13:18 |
*** hasharConfcall is now known as hashar | 13:18 | |
*** bhunter71 has joined #openstack-infra | 13:18 | |
*** heyongli has quit IRC | 13:18 | |
*** ociuhandu has quit IRC | 13:19 | |
*** ociuhandu has joined #openstack-infra | 13:20 | |
*** mattt has left #openstack-infra | 13:20 | |
*** jsavak has quit IRC | 13:20 | |
SpamapS | heh.. update on infra-cloud baremetaling.. current wedge is that ironicclient is way too old in Ubuntu cloud archive. | 13:20 |
*** heyongli has joined #openstack-infra | 13:21 | |
*** jsavak has joined #openstack-infra | 13:22 | |
*** nihilifer has joined #openstack-infra | 13:24 | |
*** isviridov_away is now known as isviridov | 13:24 | |
*** coolsvap is now known as coolsvap|away | 13:26 | |
*** ociuhandu has quit IRC | 13:27 | |
*** mriedem has joined #openstack-infra | 13:27 | |
GheRivero | SpamapS: ubuntu? old? I would expect that about Debian | 13:28 |
*** jcoufal has joined #openstack-infra | 13:30 | |
*** ociuhandu has joined #openstack-infra | 13:30 | |
*** fallenpegasus has quit IRC | 13:31 | |
jeblair | fungi: know anything about an ask-staging server? i think it lacks rdns records but is sending me email | 13:31 |
andrey-mp | fungi, thanks for information. | 13:32 |
AJaeger | fungi: Regarding 196906: Thanks! I was confused first but then saw the follow up cahnge and your comments... | 13:32 |
fungi | jeblair: yes, sorry, i'm testing https://review.openstack.org/172880 | 13:33 |
*** jcoufal has quit IRC | 13:33 | |
jeblair | fungi: no problem | 13:33 |
*** marun has joined #openstack-infra | 13:35 | |
*** jcoufal has joined #openstack-infra | 13:35 | |
*** alivigni has joined #openstack-infra | 13:36 | |
fungi | ihrachyshka_: i finally got around to taking a look at https://review.openstack.org/195923 and left you some comments. i also updated bug 1469067 with some clarification | 13:36 |
openstack | bug 1469067 in devstack "Devstack always uses soft requirements updates" [Undecided,In progress] https://launchpad.net/bugs/1469067 - Assigned to Ihar Hrachyshka (ihar-hrachyshka) | 13:36 |
*** jsavak has quit IRC | 13:36 | |
*** Jeffrey4l has quit IRC | 13:36 | |
*** jsavak has joined #openstack-infra | 13:36 | |
*** heyongli has quit IRC | 13:37 | |
fungi | ihrachyshka_: your fix isn't wrong, but it's adding complexity when you could solve it completely by removing code instead | 13:38 |
openstackgerrit | Merged openstack-infra/project-config: Add a zuul-git-prep builder macro https://review.openstack.org/196906 | 13:39 |
openstackgerrit | Merged openstack-infra/project-config: Add a zuul-git-prep builder macro https://review.openstack.org/196906 | 13:39 |
ihrachyshka_ | fungi, ack, thanks, yeah, I get your comment, will update next week | 13:40 |
*** mpavone has quit IRC | 13:40 | |
*** _nadya_ has joined #openstack-infra | 13:40 | |
*** baoli_ has quit IRC | 13:40 | |
fungi | ihrachyshka_: i'm happy to update it for you now as long as you don't mind | 13:40 |
*** marun has quit IRC | 13:40 | |
*** ParsectiX has quit IRC | 13:40 | |
*** heyongli has joined #openstack-infra | 13:40 | |
AJaeger | flaper87: you can reach them on #openstack-rel-mgr or so... | 13:41 |
*** mrmartin has joined #openstack-infra | 13:41 | |
*** _nadya_ has quit IRC | 13:42 | |
ihrachyshka_ | fungi, ok, please do. I'm busy at neutron code sprint this week | 13:42 |
*** ZZelle has quit IRC | 13:42 | |
flaper87 | AJaeger: yeah, it's done | 13:42 |
*** julim has joined #openstack-infra | 13:42 | |
*** ZZelle has joined #openstack-infra | 13:42 | |
fungi | ihrachyshka_: done | 13:42 |
*** trey has quit IRC | 13:43 | |
*** baoli has joined #openstack-infra | 13:44 | |
*** mpavone has joined #openstack-infra | 13:45 | |
*** dbite has quit IRC | 13:46 | |
*** pradk has joined #openstack-infra | 13:46 | |
*** tvanderwiel has joined #openstack-infra | 13:48 | |
*** Jeffrey4l has joined #openstack-infra | 13:49 | |
*** radez_g0n3 is now known as radez | 13:50 | |
*** ociuhandu has quit IRC | 13:51 | |
*** sergmelikyan has quit IRC | 13:53 | |
*** ociuhandu has joined #openstack-infra | 13:53 | |
*** dboik has joined #openstack-infra | 13:54 | |
*** dboik has quit IRC | 13:55 | |
*** dboik has joined #openstack-infra | 13:55 | |
*** gokrokve has joined #openstack-infra | 13:56 | |
*** jcoufal has quit IRC | 13:56 | |
*** jsavak has quit IRC | 13:56 | |
*** kir_ has quit IRC | 13:57 | |
*** jcoufal has joined #openstack-infra | 13:57 | |
*** devvesa has quit IRC | 13:57 | |
*** fhubik_afk is now known as fhubik | 13:57 | |
openstackgerrit | Merged openstack-infra/project-config: Switch constraints proposal to use zuul-git-prep https://review.openstack.org/196907 | 13:57 |
*** kiran-r has joined #openstack-infra | 13:58 | |
*** jcoufal has quit IRC | 13:58 | |
*** devvesa has joined #openstack-infra | 13:58 | |
*** dims has quit IRC | 13:59 | |
openstackgerrit | Merged openstack/requirements: Add botocore to requirements https://review.openstack.org/172335 | 13:59 |
openstackgerrit | Merged openstack/requirements: Bump oslo.db to 1.12 https://review.openstack.org/195525 | 13:59 |
*** jcoufal has joined #openstack-infra | 14:00 | |
*** _diana_ has quit IRC | 14:00 | |
*** dims has joined #openstack-infra | 14:00 | |
*** jsavak has joined #openstack-infra | 14:01 | |
*** andrey-mp has quit IRC | 14:01 | |
*** sshnaidm has quit IRC | 14:01 | |
*** mtanino has joined #openstack-infra | 14:02 | |
*** sshnaidm has joined #openstack-infra | 14:02 | |
*** jsavak has quit IRC | 14:02 | |
*** zz_dimtruck is now known as dimtruck | 14:02 | |
mordred | SpamapS: hrm | 14:02 |
*** amitgandhinz has quit IRC | 14:05 | |
*** dalgaaf has joined #openstack-infra | 14:06 | |
*** amitgandhinz has joined #openstack-infra | 14:06 | |
*** kiran-r has quit IRC | 14:07 | |
*** e0ne is now known as e0ne_ | 14:08 | |
*** EricGonczer_ has joined #openstack-infra | 14:09 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from global requirements https://review.openstack.org/196504 | 14:09 |
*** yfried has joined #openstack-infra | 14:09 | |
*** jcoufal has quit IRC | 14:11 | |
*** sigmavirus24_awa is now known as sigmavirus24 | 14:12 | |
*** sshnaidm has quit IRC | 14:12 | |
mordred | SpamapS: python-ironicclient in UCA is too old to work with ironic in UCA? | 14:13 |
mordred | SpamapS: that's strange | 14:13 |
*** sshnaidm has joined #openstack-infra | 14:13 | |
*** jcoufal has joined #openstack-infra | 14:13 | |
*** _nadya_ has joined #openstack-infra | 14:13 | |
*** amitgandhinz has quit IRC | 14:13 | |
*** amitgandhinz has joined #openstack-infra | 14:14 | |
*** tjones1 has joined #openstack-infra | 14:14 | |
*** kiran-r has joined #openstack-infra | 14:14 | |
openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for nova infinite recursion bug 1470302 https://review.openstack.org/197602 | 14:15 |
openstack | bug 1470302 in OpenStack Compute (nova) "gate-nova-python27 fails with "RuntimeError: maximum recursion depth exceeded"" [High,Confirmed] https://launchpad.net/bugs/1470302 | 14:15 |
*** wenlock has joined #openstack-infra | 14:15 | |
*** sergmelikyan has joined #openstack-infra | 14:16 | |
*** sergmelikyan has quit IRC | 14:17 | |
mriedem | is it just me, or is latest tox/pip much faster at recreates than it used to be? | 14:18 |
mriedem | pip > 7, tox > 2 | 14:18 |
*** ddieterly has joined #openstack-infra | 14:21 | |
*** Jeffrey4l has quit IRC | 14:22 | |
*** dguerri` is now known as dguerri | 14:22 | |
*** heyongli has quit IRC | 14:22 | |
*** ddieterly has quit IRC | 14:22 | |
*** smarcet has joined #openstack-infra | 14:24 | |
*** shardy has quit IRC | 14:24 | |
*** jcoufal has quit IRC | 14:24 | |
*** shardy has joined #openstack-infra | 14:24 | |
*** heyongli has joined #openstack-infra | 14:24 | |
*** sergmelikyan has joined #openstack-infra | 14:25 | |
*** jcoufal has joined #openstack-infra | 14:25 | |
*** sshnaidm has quit IRC | 14:29 | |
*** sshnaidm has joined #openstack-infra | 14:29 | |
asselin_ | fbo, ping | 14:29 |
*** tonytan4ever has joined #openstack-infra | 14:30 | |
*** weshay has quit IRC | 14:31 | |
*** zz_jgrimm is now known as jgrimm | 14:32 | |
fbo | asselin_, pong | 14:33 |
*** dizquierdo has quit IRC | 14:33 | |
asselin_ | fbo, hi, did you see my comments on the common-zuul patches? Id like to knoe your thoughts | 14:34 |
asselin_ | know* | 14:34 |
*** pblaho has quit IRC | 14:34 | |
*** pblaho has joined #openstack-infra | 14:34 | |
*** heyongli has quit IRC | 14:35 | |
*** weshay has joined #openstack-infra | 14:36 | |
*** rossella_s has quit IRC | 14:36 | |
*** SlickN1k has joined #openstack-infra | 14:36 | |
*** rossella_s has joined #openstack-infra | 14:37 | |
*** ociuhandu_ has joined #openstack-infra | 14:37 | |
*** yamahata has joined #openstack-infra | 14:37 | |
*** heyongli has joined #openstack-infra | 14:37 | |
*** nagyz_ has joined #openstack-infra | 14:37 | |
*** enikanorov2_ has joined #openstack-infra | 14:37 | |
*** mescanef_ has joined #openstack-infra | 14:38 | |
*** vahidh has quit IRC | 14:38 | |
*** madong_ has joined #openstack-infra | 14:39 | |
*** mgkwill_ has joined #openstack-infra | 14:39 | |
*** matt____ has joined #openstack-infra | 14:39 | |
*** kiran-r has quit IRC | 14:40 | |
*** Longgeek has quit IRC | 14:40 | |
*** megm_ has joined #openstack-infra | 14:40 | |
openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for nova infinite recursion bug 1470302 https://review.openstack.org/197602 | 14:41 |
*** kgiusti has joined #openstack-infra | 14:41 | |
openstack | bug 1470302 in OpenStack Compute (nova) "gate-nova-python27 fails with "RuntimeError: maximum recursion depth exceeded"" [High,In progress] https://launchpad.net/bugs/1470302 - Assigned to Dan Smith (danms) | 14:41 |
*** notnown29 has joined #openstack-infra | 14:41 | |
openstackgerrit | Merged openstack-dev/pbr: Updated from global requirements https://review.openstack.org/197249 | 14:41 |
*** devanand1 has joined #openstack-infra | 14:41 | |
*** notnown29 has quit IRC | 14:41 | |
*** gordc_af1 has joined #openstack-infra | 14:41 | |
*** Nakato_ has joined #openstack-infra | 14:41 | |
*** doude_ has joined #openstack-infra | 14:41 | |
*** jkt_ has joined #openstack-infra | 14:42 | |
*** reazem_ has joined #openstack-infra | 14:42 | |
*** nikhil_k1away has joined #openstack-infra | 14:42 | |
*** mpavone has quit IRC | 14:42 | |
*** sergmelikyan has quit IRC | 14:42 | |
clarkb | because its a fun bug, gerrit 2.10 will corrupt repos if you push to a repo whileGerrit is doing a GC on it | 14:42 |
*** thingee_ has joined #openstack-infra | 14:43 | |
*** edwarnicke_ has joined #openstack-infra | 14:44 | |
*** sergmelikyan has joined #openstack-infra | 14:45 | |
*** rackertom_ has joined #openstack-infra | 14:45 | |
jeblair | i like gerrit 2.10 more and more | 14:45 |
*** radez` has joined #openstack-infra | 14:45 | |
*** adreznec has joined #openstack-infra | 14:45 | |
*** mtreinish_ has joined #openstack-infra | 14:45 | |
*** AJaeger_ has joined #openstack-infra | 14:45 | |
*** AJaeger_ has quit IRC | 14:45 | |
*** AJaeger_ has joined #openstack-infra | 14:45 | |
*** fbo- has joined #openstack-infra | 14:45 | |
*** mmmpork_ has joined #openstack-infra | 14:45 | |
*** EmilienM_ has joined #openstack-infra | 14:45 | |
*** NikitaKonovalov2 has joined #openstack-infra | 14:45 | |
*** dguerri_ has joined #openstack-infra | 14:45 | |
*** mrodden_ has joined #openstack-infra | 14:45 | |
*** dgonzalez_ has joined #openstack-infra | 14:45 | |
*** f1ller has joined #openstack-infra | 14:45 | |
*** katyafervent_ has joined #openstack-infra | 14:46 | |
*** melwitt_ has joined #openstack-infra | 14:46 | |
*** tjones1 has quit IRC | 14:46 | |
*** ociuhandu has quit IRC | 14:46 | |
*** alivigni has quit IRC | 14:46 | |
*** aysyd has quit IRC | 14:46 | |
*** notnownikki has quit IRC | 14:46 | |
*** bmwiedemann has quit IRC | 14:46 | |
*** doude has quit IRC | 14:46 | |
*** camunoz has quit IRC | 14:46 | |
*** enikanorov2 has quit IRC | 14:46 | |
*** larainema has quit IRC | 14:46 | |
*** SlickNik_ has quit IRC | 14:46 | |
*** asadoughi has quit IRC | 14:46 | |
*** marcusvrn has quit IRC | 14:46 | |
*** fbo has quit IRC | 14:46 | |
*** mtreinish has quit IRC | 14:46 | |
*** AJaeger has quit IRC | 14:46 | |
*** megm has quit IRC | 14:46 | |
*** gordc_afk has quit IRC | 14:46 | |
*** mancdaz has quit IRC | 14:46 | |
*** melwitt has quit IRC | 14:46 | |
*** EmilienM has quit IRC | 14:46 | |
*** antonym has quit IRC | 14:46 | |
*** radez has quit IRC | 14:46 | |
*** adreznec_ has quit IRC | 14:46 | |
*** edwarnicke has quit IRC | 14:46 | |
*** nagyz has quit IRC | 14:46 | |
*** ctlaugh_ has quit IRC | 14:46 | |
*** dguerri has quit IRC | 14:46 | |
*** reazem has quit IRC | 14:46 | |
*** NikitaKonovalov has quit IRC | 14:46 | |
*** tchaypo has quit IRC | 14:46 | |
*** mgkwill has quit IRC | 14:46 | |
*** kun_huang has quit IRC | 14:46 | |
*** thingee has quit IRC | 14:46 | |
*** rackertom has quit IRC | 14:46 | |
*** devananda has quit IRC | 14:46 | |
*** flaper87 has quit IRC | 14:46 | |
*** lxsli has quit IRC | 14:46 | |
*** mrodden has quit IRC | 14:46 | |
*** Nakato has quit IRC | 14:46 | |
*** katyafervent has quit IRC | 14:46 | |
*** asilenkov has quit IRC | 14:46 | |
*** jkt has quit IRC | 14:46 | |
*** mescanef has quit IRC | 14:46 | |
*** mmmpork has quit IRC | 14:46 | |
*** fungi has quit IRC | 14:46 | |
*** dgonzalez has quit IRC | 14:46 | |
*** mattoliverau has quit IRC | 14:46 | |
*** filler has quit IRC | 14:46 | |
*** nikhil_k-away has quit IRC | 14:46 | |
*** timburke has quit IRC | 14:46 | |
*** dteselkin has quit IRC | 14:46 | |
*** EmilienM_ is now known as EmilienM | 14:46 | |
*** dguerri_ is now known as dguerri | 14:46 | |
*** mmmpork_ is now known as mmmpork | 14:46 | |
*** dguerri has quit IRC | 14:46 | |
*** dguerri has joined #openstack-infra | 14:46 | |
*** dizquierdo has joined #openstack-infra | 14:46 | |
*** ociuhandu_ is now known as ociuhandu | 14:46 | |
*** mtreinish_ is now known as mtreinish | 14:46 | |
*** mrodden_ is now known as mrodden | 14:46 | |
*** dgonzalez_ is now known as dgonzalez | 14:46 | |
*** mpavlase has quit IRC | 14:46 | |
*** annegentle has quit IRC | 14:47 | |
*** NikitaKonovalov2 is now known as NikitaKonovalov | 14:47 | |
openstackgerrit | Marton Kiss proposed openstack-infra/system-config: Upgrade openstackid to 1.0.7 https://review.openstack.org/197614 | 14:47 |
*** asilenkov has joined #openstack-infra | 14:47 | |
*** madong_ is now known as larainema | 14:47 | |
*** ayoung has joined #openstack-infra | 14:47 | |
*** sergmelikyan has quit IRC | 14:47 | |
*** dteselkin has joined #openstack-infra | 14:48 | |
*** mgkwill_ is now known as mgkwill | 14:48 | |
*** Ala has quit IRC | 14:48 | |
*** thingee_ is now known as thingee | 14:48 | |
*** DericHorn-HP has joined #openstack-infra | 14:48 | |
*** timburke has joined #openstack-infra | 14:48 | |
*** nelsnels_ has quit IRC | 14:49 | |
*** fhubik is now known as fhubik_afk | 14:49 | |
clarkb | jeblair: and it isn't temporary in memory jgit trouble, appears to affect the repo on disk and require a restore from backup | 14:49 |
*** flaper87 has joined #openstack-infra | 14:49 | |
*** flaper87 has quit IRC | 14:49 | |
*** flaper87 has joined #openstack-infra | 14:49 | |
*** nelsnelson has joined #openstack-infra | 14:49 | |
*** shardy has quit IRC | 14:49 | |
*** heyongli has quit IRC | 14:49 | |
*** _diana_ has joined #openstack-infra | 14:50 | |
jeblair | clarkb: that's really weird because apparently jgit's locking is sufficient for running an _external_ gc | 14:50 |
*** kiran-r has joined #openstack-infra | 14:51 | |
*** rackertom_ is now known as rackertom | 14:51 | |
fbo- | asselin_, yep I just tested a stuff and I guess you provide $gerrit_ssh_host_identity as a string and not an array. isn't it ? | 14:51 |
clarkb | jeblair: aiui the issue is what jgit does with the new refs that are being pushed | 14:52 |
*** rackertom has quit IRC | 14:52 | |
clarkb | they visit never never land and captain hook holds them hostage | 14:52 |
asselin_ | fbo-, yes perhaps | 14:52 |
*** aysyd has joined #openstack-infra | 14:52 | |
*** heyongli has joined #openstack-infra | 14:52 | |
asselin_ | fbo-, I guess I ran into issues passing in an array? | 14:52 |
*** camunoz has joined #openstack-infra | 14:52 | |
jeblair | clarkb: captain githook? | 14:53 |
mordred | clarkb: that'll teach you for installing the "captain" git hook | 14:53 |
fbo- | got the same error with this snippet http://paste.openstack.org/show/uQ2To8KjlAPXiLA0V6ex/ if I set gerrit_ssh_host_identity as string. | 14:53 |
fbo- | asselin_, | 14:53 |
mordred | damn. jeblair beat me to it | 14:53 |
*** lxsli has joined #openstack-infra | 14:53 | |
fbo- | if it an array it works for me | 14:53 |
* jeblair high-fives mordred | 14:53 | |
*** alivigni has joined #openstack-infra | 14:53 | |
asselin_ | fbo-, so I was thinking to move that logic out to site.pp | 14:53 |
*** asadoughi has joined #openstack-infra | 14:53 | |
*** ctlaugh_ has joined #openstack-infra | 14:53 | |
*** marcusvrn has joined #openstack-infra | 14:54 | |
*** teran_ has quit IRC | 14:54 | |
*** fungi has joined #openstack-infra | 14:54 | |
asselin_ | fbo-, and use a string in openstackci | 14:54 |
*** antonym has joined #openstack-infra | 14:54 | |
*** sergmelikyan has joined #openstack-infra | 14:54 | |
*** geoffarnold has joined #openstack-infra | 14:55 | |
fungi | wow. that irc server went down _hard_ | 14:55 |
fungi | mriedem: pip 6 added an optional wheel cache, and pip 7 turned it on by default | 14:55 |
fungi | mriedem: that speeds up anything which was doing compilation of c extensions in particular, though brings a new liability: if the libraries/headers against which those wheels were built change later, pip won't know those cached wheels need to be rebuilt | 14:55 |
asselin_ | fbo-, and the string in openstackci is whatever should be put into the ssh known hosts sections w/o any manipulation | 14:56 |
openstackgerrit | Cody Littley proposed openstack-infra/nodepool: Fixed crash in exception handler https://review.openstack.org/195172 | 14:56 |
mriedem | fungi: ok, i figured wheels was being used now | 14:56 |
*** shardy has joined #openstack-infra | 14:56 | |
*** edwarnicke_ is now known as edwarnicke | 14:56 | |
clarkb | fungi: we can probably remove the explicit wheel caching from our scripts then? | 14:57 |
clarkb | thinking of the requirements check job and devstack | 14:57 |
*** yfried has quit IRC | 14:57 | |
fungi | clarkb: probably, yes | 14:57 |
*** heyongli has quit IRC | 14:57 | |
*** sergmelikyan has quit IRC | 14:57 | |
*** geoffarnold has quit IRC | 14:57 | |
fungi | clarkb: for any that are self-testing, easy enough to see if ripping out that machinery slows anything down | 14:57 |
clarkb | yup | 14:58 |
*** sergmelikyan has joined #openstack-infra | 14:58 | |
*** geoffarnold has joined #openstack-infra | 14:58 | |
clarkb | fungi: did you see that the 4 byte utf8 chars broke that etherpad but did not break the service? I have updated the upstream bug with js tracebacks | 14:58 |
fungi | pleia2: you probably will be interested in reviewing https://review.openstack.org/197614 | 14:58 |
clarkb | fungi: I think we should go ahead with the DB move friday but not with the utf8 set conversion unless we can test something that works on -dev | 14:58 |
fungi | clarkb: yep, saw your updates | 14:58 |
clarkb | kk | 14:58 |
*** heyongli has joined #openstack-infra | 14:59 | |
fungi | clarkb: and i agree moving forward as planned is still better than not | 14:59 |
*** kun_huang has joined #openstack-infra | 14:59 | |
fungi | clarkb: i don't know that skipping the conversion is necessarily warranted. breaking a specific pad is still preferable to taking down the entire service until someone edits the database | 15:00 |
*** rackertom has joined #openstack-infra | 15:00 | |
*** sshnaidm has quit IRC | 15:00 | |
*** fhubik_afk is now known as fhubik | 15:01 | |
clarkb | fungi: thats true my only concern there was the conversion would be lossy but thinking about that a bit more I don't think it can be | 15:01 |
clarkb | we are going from a smaller representation space to a larger one that is a superset so should not be lossy at all | 15:01 |
*** devanand1 is now known as devananda | 15:01 | |
*** xyang1 has joined #openstack-infra | 15:02 | |
*** sshnaidm has joined #openstack-infra | 15:02 | |
*** MarkAtwood has joined #openstack-infra | 15:02 | |
*** cindyo has joined #openstack-infra | 15:03 | |
*** derekh has joined #openstack-infra | 15:03 | |
fbo- | asselin_, so as you want, we just need to rework again that patch. I'm not against it but other reviewers was ok with it | 15:04 |
*** otter768 has joined #openstack-infra | 15:05 | |
*** sergmelikyan has quit IRC | 15:05 | |
*** tchaypo has joined #openstack-infra | 15:06 | |
*** dimtruck is now known as zz_dimtruck | 15:07 | |
*** Longgeek has joined #openstack-infra | 15:07 | |
*** e0ne_ is now known as e0ne | 15:07 | |
*** sshnaidm has quit IRC | 15:07 | |
*** mancdaz has joined #openstack-infra | 15:07 | |
*** Longgeek has quit IRC | 15:07 | |
*** sshnaidm has joined #openstack-infra | 15:07 | |
*** mmedvede has quit IRC | 15:08 | |
*** Longgeek has joined #openstack-infra | 15:08 | |
*** jlanoux_ has joined #openstack-infra | 15:08 | |
*** bmwiedemann has joined #openstack-infra | 15:09 | |
*** jlanoux has quit IRC | 15:09 | |
frickler | nibalizer: would you also +A https://review.openstack.org/#/c/189141/? (yours is the second +2) otherwise whom else should I bug about this? | 15:09 |
*** arxcruz has quit IRC | 15:09 | |
*** otter768 has quit IRC | 15:10 | |
*** Longgeek has quit IRC | 15:12 | |
*** Longgeek has joined #openstack-infra | 15:14 | |
*** enikanorov2_ has quit IRC | 15:15 | |
eantyshev | asselin_, jeblair: hello I think I know approximately why zuul hangups occasionally, and have the proposals, described here https://storyboard.openstack.org/#!/story/2000309 | 15:17 |
eantyshev | asselin_, jeblair: hello I think I know approximately why zuul hangups occasionally, and have the proposals, described here https://storyboard.openstack.org/#!/story/2000309 | 15:17 |
ttx | mordred: damn you and your PHP, I won't see those last 7 hours of my life again | 15:18 |
ttx | context: http://lists.openstack.org/pipermail/openstack-infra/2015-July/002885.html | 15:19 |
*** e0ne is now known as e0ne_ | 15:19 | |
*** e0ne_ is now known as e0ne | 15:20 | |
*** jkt_ is now known as jkt | 15:20 | |
asselin_ | fbo-, yea I was also ok...I pinged nibalizer yesterday to get his opinion. | 15:21 |
*** notnownikki has joined #openstack-infra | 15:21 | |
*** armax has joined #openstack-infra | 15:22 | |
*** wenlock_ has joined #openstack-infra | 15:23 | |
*** unicell has joined #openstack-infra | 15:23 | |
asselin_ | eantyshev, what to you mean by pickle? | 15:24 |
*** Sukhdev has joined #openstack-infra | 15:24 | |
*** enikanorov2 has joined #openstack-infra | 15:25 | |
*** afazekas has quit IRC | 15:26 | |
*** scheuran has quit IRC | 15:26 | |
fbo- | if you both asselin_ and nibalizer are ok to move the inline_template elsewhere I can rework the patch then | 15:26 |
*** jsavak has joined #openstack-infra | 15:26 | |
fbo- | but I need I guess some guidance to target what you expect within one patchset | 15:27 |
asselin_ | fbo-, so the changes are small to rework it. | 15:27 |
*** dtantsur is now known as dtantsur|afk | 15:28 | |
asselin_ | fbo-, in the openstack-ci, let the host key be the full identity string to pass into the config, so no inline template. | 15:28 |
*** olaph has quit IRC | 15:28 | |
fbo- | asselin_, ok | 15:28 |
openstackgerrit | Lianhao Lu proposed openstack-dev/pbr: Use io.open() to open metadata files https://review.openstack.org/197626 | 15:29 |
eantyshev | asselin_: that was first false impression, last comment more reasonable:) | 15:29 |
asselin_ | fbo-, then in the system-config patch you concat the identity and key and pass that in as one string | 15:29 |
*** sergmelikyan has joined #openstack-infra | 15:29 | |
*** CaerbannogRabbit is now known as morganfainberg | 15:30 | |
asselin_ | fbo-, b/c at the infra level the ips are static in the puppet file and the host key is in heira, so this is where they should be joined together. | 15:30 |
*** sergmelikyan has quit IRC | 15:31 | |
*** sergmelikyan has joined #openstack-infra | 15:31 | |
*** olaph has joined #openstack-infra | 15:31 | |
*** austin81 has joined #openstack-infra | 15:31 | |
eantyshev | asselin_: and I cannot tell why reconfiguration failed, since that information is lost every time, which is a part of the problem | 15:31 |
fbo- | asselin_, ok so zuul_merger, zuul_dev, and zuul_prod still take an array as argument ? and I use the inline_template here ? | 15:31 |
*** austin81 has left #openstack-infra | 15:31 | |
asselin_ | fbo-, let me look again | 15:31 |
*** austin81 has joined #openstack-infra | 15:32 | |
asselin_ | eantyshev, oh I see...so that error only occurs after running a zuul reload with updated layout.yaml? | 15:32 |
*** marun has joined #openstack-infra | 15:32 | |
eantyshev | asselin_: yes | 15:32 |
*** coolsvap|away is now known as coolsvap | 15:33 | |
fbo- | hum before it was hardcoded and not passed as argument in zuul_*.pp | 15:33 |
eantyshev | asselin_: sorry, have to go right now | 15:33 |
*** sergmelikyan has quit IRC | 15:33 | |
fbo- | I can remove that gerrit_ssh_host_identity argument and make it a variable inside the class ? | 15:34 |
*** k4n0 has quit IRC | 15:34 | |
*** mmedvede has joined #openstack-infra | 15:34 | |
asselin_ | fbo-, variable inside which class? | 15:34 |
*** dangers_away is now known as dangers | 15:35 | |
*** signed8bit has joined #openstack-infra | 15:35 | |
fbo- | asselin_, yes | 15:35 |
fbo- | ? | 15:35 |
asselin_ | fbo-, honestly I thought it should be moved to here: http://git.openstack.org/cgit/openstack-infra/system-config/tree/manifests/site.pp#n554 | 15:36 |
fbo- | sorry zuul_*.pp in system-config | 15:36 |
asselin_ | right at the source | 15:36 |
asselin_ | so this line would have the full identity & key: http://git.openstack.org/cgit/openstack-infra/system-config/tree/manifests/site.pp#n558 | 15:37 |
*** jaypipes has quit IRC | 15:37 | |
*** pblaho has quit IRC | 15:39 | |
fbo- | asselin_, ok so after line 558 I add the identities and pass them via gerrit_ssh_host_identity argument. Ok got it i'll do that | 15:39 |
*** unicell has quit IRC | 15:39 | |
*** jasondotstar has quit IRC | 15:39 | |
*** pblaho has joined #openstack-infra | 15:39 | |
asselin_ | fbo-, first, do you agree this is better? | 15:40 |
*** ashleighfarnham has joined #openstack-infra | 15:42 | |
*** sshnaidm has quit IRC | 15:42 | |
SergeyLukjanov | jeblair, hi, I've seen that you helped trove with moving devstack from devstack itself to their repo, could you help me with some tips to do the same for sahara? | 15:43 |
SergeyLukjanov | jeblair, I've done a few patches already - https://review.openstack.org/#/q/topic:bp/sahara-devstack-intree,n,z | 15:43 |
*** sergmelikyan has joined #openstack-infra | 15:43 | |
jeblair | SergeyLukjanov: yep! let me look | 15:43 |
SergeyLukjanov | jeblair, great! thx | 15:44 |
*** sergmelikyan has quit IRC | 15:44 | |
fbo- | asselin_, to be honest that sounds like a bit the same :) to me. At least the diff is not obvious to me but no matter the most important is it fit all usages and everybody are ok with the change. So I'm ok to implement that request :) | 15:44 |
*** coolsvap is now known as coolsvap|away | 15:44 | |
asselin_ | jeblair, if you have a moment, your feedback on the above discussion would be valuable ^^ | 15:45 |
asselin_ | jeblair, re common zuul patches: https://review.openstack.org/#/c/176010/8 | 15:46 |
asselin_ | fbo-, jeblair need to step away for a few minutes | 15:47 |
*** kiran-r has quit IRC | 15:48 | |
*** laughterwym has quit IRC | 15:48 | |
fbo- | nibalizer, I'm not sure to understand your comment here https://review.openstack.org/#/c/175970/17/metadata.json because puppet-project_config will be really handy to use for future users of openstackci to target there own "project_config" repo | 15:49 |
fbo- | asselin_, ok | 15:49 |
*** pblaho has quit IRC | 15:50 | |
jeblair | fbo-: asselin_'s idea seems like a good one. i think that eventually that information will end up in a public hiera file when nibalizer finishes his work | 15:50 |
*** pblaho has joined #openstack-infra | 15:50 | |
*** sergmelikyan has joined #openstack-infra | 15:50 | |
*** jasondotstar has joined #openstack-infra | 15:50 | |
*** ashleighfarnham has quit IRC | 15:51 | |
jeblair | fbo-: i agree, perhaps nibalizer misread that as referring to our actual project-config repo and not puppet-project_config? | 15:52 |
*** dannywilson has joined #openstack-infra | 15:52 | |
*** ivar-lazzaro has joined #openstack-infra | 15:53 | |
*** ivar-lazzaro has quit IRC | 15:53 | |
fbo- | jeblair, yes I think the same. | 15:53 |
*** sergmelikyan has quit IRC | 15:54 | |
*** ivar-lazzaro has joined #openstack-infra | 15:54 | |
zaro | hashar: hi | 15:55 |
*** patrickeast has joined #openstack-infra | 15:55 | |
zaro | morning | 15:56 |
*** fallenpegasus has joined #openstack-infra | 15:56 | |
*** pblaho has quit IRC | 15:56 | |
zaro | hashar: replied to your comment in https://issues.jenkins-ci.org/browse/JENKINS-25867 | 15:57 |
*** erlon has joined #openstack-infra | 15:57 | |
zaro | hashar: i'm curious whether the changes you picked up made it work for that matrix job? | 15:58 |
hashar | zaro: hey :) | 15:58 |
*** pblaho has joined #openstack-infra | 15:58 | |
hashar | zaro: well I have no idea because I can't reproduce the issue | 15:58 |
*** deepakcs has joined #openstack-infra | 15:58 | |
zaro | hashar: occurs randomly? | 15:59 |
hashar | kind of yeah :) | 16:00 |
zaro | but only with matrix job? | 16:00 |
hashar | zaro: it must have a root cause but I haven't managed to track it down | 16:00 |
hashar | just that at some point a computer object returns NULL instead of the actual node | 16:00 |
hashar | and that seems to keep some lock in position | 16:00 |
*** armax has quit IRC | 16:00 | |
hashar | then the executors refuse to accept new jobs because they are locked | 16:01 |
hashar | interestingly, the matrix job has a parent process, that still is allocated on an executor :-D | 16:01 |
hashar | and yeah apparently only on matrix job | 16:01 |
hashar | I had the issue previously with nodes having multiple executors, but that seems to have been fixed when upgrading the gearman-plugin. That was ages ago | 16:01 |
hashar | zaro: oh note the matrix job is triggered by the Jenkins scheduler. Not by Zuul | 16:02 |
zaro | is the jenkins scheduler one of the jenkins plugins? | 16:03 |
zaro | trigger plugin? | 16:03 |
hashar | I will have to look at the jobs configuration and write you a summary :-D | 16:04 |
zaro | so i guess that means jenkins itself can't run builds on the nodes. | 16:04 |
hashar | there is probably a race condition between the Jenkins scheduler / Gearman build queue / trigger plugin / throttle plugin or owhatever | 16:04 |
*** zz_dimtruck is now known as dimtruck | 16:04 | |
zaro | regardless of gearman. | 16:04 |
zaro | so once you get into that state your saying that if you click on the 'run build' icon on the jenkins UI a build doesn't get scheduled? | 16:05 |
hashar | yeah | 16:05 |
hashar | but it shows up in Jenkins build queue | 16:05 |
hashar | with a status of "waiting for next executors on xxx label" | 16:05 |
*** devvesa has quit IRC | 16:06 | |
*** olaph has quit IRC | 16:06 | |
zaro | ahh, ok so that's fixed by https://review.openstack.org/#/c/192429/ | 16:06 |
*** _diana_ has quit IRC | 16:06 | |
hashar | potentially :-} | 16:06 |
*** Longgeek has quit IRC | 16:06 | |
zaro | or at least i believe so | 16:06 |
hashar | I have deployed it this morning (europe) so we will see what happens! | 16:07 |
zaro | because that's the exact same thing i ran into. | 16:07 |
*** _diana_ has joined #openstack-infra | 16:07 | |
hashar | the problem is that I can't reproduce the issue. Have to wait for it to occurs :-/ | 16:07 |
*** _diana_ has quit IRC | 16:07 | |
*** asselin_ has quit IRC | 16:07 | |
*** jsavak has quit IRC | 16:07 | |
*** dkazhdan has joined #openstack-infra | 16:07 | |
zaro | it's when a gearman responds with WORK_FAIL. | 16:07 |
*** Longgeek has joined #openstack-infra | 16:08 | |
*** jistr has quit IRC | 16:08 | |
hashar | ah I found an hold thread dump at https://phabricator.wikimedia.org/T72597#748059 | 16:08 |
*** jcoufal has quit IRC | 16:08 | |
hashar | the slave being deadlocked is deployment-bastion.eqiad_exec | 16:08 |
hashar | all the executors are locked by hudson.plugins.gearman.NodeAvailabilityMonitor.lock | 16:09 |
hashar | within src/main/java/hudson/plugins/gearman/NodeAvailabilityMonitor.java lock() function. It takes a worker as parameter and has a wait(5000). | 16:09 |
hashar | but the worker yields a 'null' which causes the code to not release the lock | 16:09 |
hashar | (sorry that looks confusing) | 16:09 |
zaro | Yep, NodeAvailabilityMonitor was the culprit. if you look at the commit message there's an explanation. | 16:10 |
*** sergmelikyan has joined #openstack-infra | 16:11 | |
hashar | I am not sure why it would be given a null worker though :D | 16:11 |
*** fallenpegasus has quit IRC | 16:11 | |
zaro | not sure if it's real clear, but the fix is to the NodeAvailabilityMonitor could not get the node because it's locked due to WORK_FAIL event. | 16:11 |
*** sergmelikyan has quit IRC | 16:12 | |
*** unicell has joined #openstack-infra | 16:12 | |
hashar | yeah I got that. But that might not be related to the bug I faced :/ | 16:12 |
hashar | we will see :-} | 16:12 |
*** Longgeek has quit IRC | 16:12 | |
hashar | at least for today, I haven't noticed any issue | 16:12 |
*** jsavak has joined #openstack-infra | 16:13 | |
zaro | agreed. | 16:13 |
*** sergmelikyan has joined #openstack-infra | 16:13 | |
*** dkazhdan has quit IRC | 16:14 | |
*** puranamr has joined #openstack-infra | 16:14 | |
*** jsavak has quit IRC | 16:14 | |
asselin | fbo-, ok i'm back....seems you have your answer. thank you | 16:14 |
*** DericHorn-HP has quit IRC | 16:15 | |
*** romcheg has joined #openstack-infra | 16:15 | |
romcheg | Hi folks! | 16:15 |
hashar | zaro: heading back home. Thanks a ton for the patch and for moving to Jira (so we get mail notifications : D ) | 16:16 |
*** hashar has quit IRC | 16:16 | |
romcheg | I'm here with the same question I had yesterday. I pushed a tag to stackforge/python-fuelclient but it looks the new version didn't go to PyPi | 16:16 |
*** DericHorn-HP has joined #openstack-infra | 16:17 | |
romcheg | I can see the tarball here http://tarballs.openstack.org/python-fuelclient/ | 16:17 |
*** sergmelikyan has quit IRC | 16:18 | |
*** whoops has joined #openstack-infra | 16:18 | |
*** kiran-r has joined #openstack-infra | 16:19 | |
*** _kiran_ has joined #openstack-infra | 16:19 | |
*** harlowja_at_home has joined #openstack-infra | 16:20 | |
fungi | romcheg: let's have a look at the log... | 16:20 |
openstackgerrit | Sergey Reshetnyak proposed openstack-infra/project-config: Make Sahara python3 job voting https://review.openstack.org/197498 | 16:20 |
romcheg | fungi: sorry if it's obvious, I couldn't look at the log because unlike logs for patch sets I don't know where to look for one | 16:21 |
fungi | romcheg: yep, digging it up now. it's based on the hash of the tag | 16:21 |
*** jlanoux_ has quit IRC | 16:21 | |
*** larainema has quit IRC | 16:22 | |
*** _nadya_ has quit IRC | 16:23 | |
*** larainema has joined #openstack-infra | 16:23 | |
fungi | romcheg: it's possible you pushed a tag yesterday while everything was completely broken | 16:23 |
*** cindyo has quit IRC | 16:24 | |
fungi | i didn't get the logserver brought back into order until 14:00 utc | 16:24 |
*** sdake has joined #openstack-infra | 16:24 | |
romcheg | fungi: I pushed the tag 20 minutes ago :) | 16:24 |
*** gyee has joined #openstack-infra | 16:24 | |
jeblair | http://logs.openstack.org/2f/2f5a9c37d0c528647de7ef20ebb6cb14ac2f8a25/release/python-fuelclient-pypi-both-upload/console.html | 16:24 |
fungi | romcheg: oh, i thought you said yesterday | 16:24 |
jeblair | fungi: i would have expected it to be there ^ | 16:24 |
romcheg | fungi: I indeed pushed a 6.1.1 tag yesterday, but it is broken, so we decided to make another 6.1.2 | 16:24 |
*** esmute__ has joined #openstack-infra | 16:25 | |
romcheg | sorry for the confusion :) | 16:25 |
fungi | jeblair: yeah, i went digging in the zuul log since we're missing logfiles from that time period and also because i think the pypi uploads log to swift now | 16:25 |
jeblair | https://jenkins.openstack.org/job/python-fuelclient-pypi-both-upload/3/console | 16:26 |
jeblair | that's the failure from the new tag today | 16:26 |
*** fallenpegasus has joined #openstack-infra | 16:26 | |
*** sergmelikyan has joined #openstack-infra | 16:28 | |
*** sergmelikyan has quit IRC | 16:28 | |
*** _diana_ has joined #openstack-infra | 16:29 | |
romcheg | So it fails if the wheel is Py2 or Py3 only? | 16:29 |
*** Guest89865 is now known as spiffxp | 16:29 | |
fungi | looks that way | 16:29 |
fungi | i think when dhellmann wrote that he was expecting not to publish non-universal wheels? | 16:29 |
romcheg | That's strange… | 16:30 |
fungi | no, that looks like a bug actually. i think it's supposed to be identifying whether it's a universal wheel | 16:30 |
*** john-davidge has quit IRC | 16:30 | |
fungi | aha, it assumes that if there's a wheel section then there will be a universal option | 16:31 |
*** sarob_ has joined #openstack-infra | 16:31 | |
fungi | fuelclient's setup.cfg has a wheel section with no universal option, and the extract script doesn't safeguard against that possibility | 16:32 |
fungi | patch on the way | 16:32 |
romcheg | fungi: thanks! Could you please push this patch trough the tag queue when the patch is merged? | 16:33 |
*** tqtran has joined #openstack-infra | 16:33 | |
*** sarob_ has quit IRC | 16:33 | |
romcheg | *the tag | 16:33 |
pleia2 | fungi, mrmartin - all ok for me to +A 197614 to get the new openstackid out there? | 16:33 |
fungi | romcheg: i can retrigger the job, once it merges, yes | 16:33 |
fungi | pleia2: i believe so, yes | 16:33 |
mrmartin | hi pleia2 | 16:34 |
mrmartin | approve that: https://review.openstack.org/#/c/197614/ | 16:34 |
mrmartin | :) | 16:34 |
openstackgerrit | Fabien Boucher proposed openstack-infra/puppet-openstackci: Add generic zuul manifests https://review.openstack.org/175970 | 16:34 |
*** _diana_ has quit IRC | 16:34 | |
openstackgerrit | Fabien Boucher proposed openstack-infra/system-config: Use openstackci module for zuul_merger zuul_prod and zuul_dev https://review.openstack.org/176010 | 16:34 |
*** cindyo has joined #openstack-infra | 16:34 | |
*** BharatK has quit IRC | 16:34 | |
pleia2 | mrmartin: great, on the way! | 16:34 |
mrmartin | pleia2: http://tarballs.openstack.org/openstackid/ 1.0.7 is there, and I did an auth test with groups + a vagrant master branch in my dev env, and everything was looking nice | 16:35 |
* pleia2 nods | 16:35 | |
pleia2 | perfect, thanks | 16:35 |
mrmartin | so let's go, I guess we need to wait a while until the puppet script is picking up the changes on openstackid.org | 16:35 |
*** geoffarnold has quit IRC | 16:35 | |
pleia2 | yeah | 16:35 |
*** Swami has joined #openstack-infra | 16:36 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Fix universal extraction in non-universal wheel https://review.openstack.org/197654 | 16:37 |
fungi | romcheg: jeblair: dhellmann: ^ | 16:37 |
*** harlowja_at_home has quit IRC | 16:37 | |
*** samuelBartel has quit IRC | 16:37 | |
*** yamada-h has joined #openstack-infra | 16:37 | |
*** ociuhandu has quit IRC | 16:38 | |
nibalizer | jeblair: fungi ah yes, puppet-project_config always trips me up | 16:38 |
fungi | nibalizer: that's the glue that holds our glue factory together | 16:39 |
*** derekh has quit IRC | 16:39 | |
dhellmann | fungi: does has_option() fail cleanly if the section isn't there? I think I've seen that throw an error on the missing section instead of just returning false | 16:39 |
fungi | dhellmann: it does. i even tested it to be certain | 16:40 |
dhellmann | fungi: cool, maybe I'm remembering an old version or something | 16:40 |
fungi | dhellmann: maybe that was on some !=2.7 version | 16:40 |
fungi | yeah | 16:41 |
dhellmann | yeah, could have been ages ago #deepscars | 16:41 |
fungi | we're running that script exclusively on python 2.7 so should be safe | 16:41 |
dhellmann | +1 | 16:41 |
fungi | heh. python 1.x!!! | 16:41 |
romcheg | fungi: perhaps there should be a note left for times when it's on Py3? | 16:42 |
*** yamada-h has quit IRC | 16:42 | |
openstackgerrit | Matt Riedemann proposed openstack-infra/devstack-gate: Set ATTACH_ENCRYPTED_VOLUME_AVAILABLE=False if testing with Ceph https://review.openstack.org/193835 | 16:43 |
fungi | romcheg: it works the same on 3.4. just tested | 16:43 |
fbo- | asselin, I've done the refactoring. let me know if this what you expected. Also I haven't tested it yet. | 16:43 |
*** geoffarnold has joined #openstack-infra | 16:44 | |
romcheg | I mean, if someone's wheel is py3 only | 16:44 |
fungi | romcheg: oh, that's likely going to need a rethinking of the script | 16:44 |
fungi | romcheg: or deeper parsing to detect when it's a py3-only wheel | 16:45 |
asselin | fbo-, ok will take a look & test it today | 16:45 |
romcheg | fungi: Perhaps it makes sense to unlock in now | 16:45 |
romcheg | fungi: and file a bug for py3 only wheels | 16:45 |
*** Longgeek has joined #openstack-infra | 16:45 | |
fbo- | asselin, thanks | 16:46 |
*** deepakcs has quit IRC | 16:46 | |
greghaynes | fungi: mordred did either of you try out performing the nodepool image upload to rax via command? | 16:46 |
openstackgerrit | Merged openstack-infra/system-config: Upgrade openstackid to 1.0.7 https://review.openstack.org/197614 | 16:46 |
fungi | greghaynes: i have not. just observing the nodepool scheduler do it | 16:46 |
*** marun has left #openstack-infra | 16:47 | |
greghaynes | hrm, the way the command works it should be equivilentish of restarting nodepool in terms of getting new deps, so might be a good way to test that theory | 16:47 |
greghaynes | the theory that were just running nodepool with a stale dep | 16:47 |
*** BharatK has joined #openstack-infra | 16:48 | |
*** samuelBartel has joined #openstack-infra | 16:48 | |
krotscheck | Anyone around who can help me set up ACL's on https://review.openstack.org/#/admin/projects/openstack/ironic-webclient | 16:48 |
krotscheck | ? | 16:48 |
*** flip214 has joined #openstack-infra | 16:49 | |
flip214 | Hi. Is there some "secret" repository for devstack that works? I'm looking through my logs right now and find quite a lot of things that don't work - and are not even noticed to be wrong... | 16:50 |
romcheg | fungi: for non-universal wheels it's possible to read wheel/python-tag option. With that no deeper re-thinking would be required :) | 16:50 |
*** koolhead17 has joined #openstack-infra | 16:50 | |
flip214 | things like this: | 16:50 |
flip214 | + return grep '/nova$' /opt/stack/requirements/projects.txt | 16:50 |
flip214 | /home/stack/devstack/inc/python: line 198: return: grep: numeric argument required | 16:50 |
fungi | flip214: no idea, but you probably want to talk to the devstack developers. they hang out in #openstack-qa | 16:50 |
fungi | flip214: that's bug 1469067 and there's a fix being reviewed for it now | 16:51 |
openstack | bug 1469067 in devstack "Devstack always uses soft requirements updates" [Undecided,In progress] https://launchpad.net/bugs/1469067 - Assigned to Ihar Hrachyshka (ihar-hrachyshka) | 16:51 |
*** armax has joined #openstack-infra | 16:52 | |
fungi | flip214: it's generally more helpful to pitch in with bugs you find than to imply that the developers of the software intentionally withhold bug fixes from you | 16:53 |
greghaynes | crinkle: I think https://review.openstack.org/#/c/196252/ is probably what you were hitting during your nodepool testing | 16:53 |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: argparse in requirements.txt should be 2.6 dependent https://review.openstack.org/197660 | 16:53 |
*** nfedotov has quit IRC | 16:53 | |
flip214 | fungi: I'd just like to have the same (working!) devstack that is used in the openstack CI systems ;) | 16:54 |
fungi | flip214: yep. it's not working for us either! ;) | 16:54 |
crinkle | greghaynes: yep probably | 16:54 |
flip214 | ah, okay. | 16:54 |
*** sergmelikyan has joined #openstack-infra | 16:54 | |
flip214 | I didn't want to imply intentionality... I just hoped for some repo that has all that *fixed* already! | 16:54 |
fungi | flip214: you can grab that fix from https://review.openstack.org/195923 if you want it before the devstack devs have finished reviewing it | 16:55 |
*** melwitt_ is now known as melwitt | 16:55 | |
*** bswartz has joined #openstack-infra | 16:56 | |
*** sergmelikyan has quit IRC | 16:56 | |
*** hdd has quit IRC | 16:56 | |
krotscheck | Anyone around who can help me set up ACL's on https://review.openstack.org/#/admin/projects/openstack/ironic-webclient ? | 16:57 |
fungi | krotscheck: yep, i was just pulling that up | 16:57 |
krotscheck | fungi: Thanks! | 16:57 |
fungi | krotscheck: yeah, looks like it didn't apply. chances are we've got a typo in the change that added it. do you have a link to that handy? | 16:58 |
fungi | if not i'll dig it out of the git log | 16:58 |
krotscheck | fungi: https://review.openstack.org/#/c/194424/ | 16:58 |
*** baoli has quit IRC | 16:58 | |
fungi | krotscheck: aha! fix on the way | 16:59 |
krotscheck | fungi: And by typo, you mean "ACL's didn't appear to have been added" | 16:59 |
mrmartin | pleia2: http://puppetboard.openstack.org/node/openstackid.org is that info valid for the openstackid.org puppet runs? | 16:59 |
*** ashleighfarnham has joined #openstack-infra | 16:59 | |
fungi | krotscheck: yep | 17:00 |
flip214 | fungi: thank you very much ... | 17:00 |
fungi | krotscheck: is there an existing acl you want reused by ironic-webclient or is it going to have some unique needs (separate review team, different release model, et cetera)> | 17:00 |
*** davideagnello has joined #openstack-infra | 17:01 | |
krotscheck | fungi: For the time being we'll just use the ironic ACL's, and I'll come back when the team decides what to do. | 17:01 |
*** sergmelikyan has joined #openstack-infra | 17:01 | |
*** Longgeek has quit IRC | 17:02 | |
*** ashleighfarnham has quit IRC | 17:02 | |
*** patrickeast_ has joined #openstack-infra | 17:02 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Reuse ironic ACLs for ironic-webclient https://review.openstack.org/197662 | 17:03 |
*** patrickeast has quit IRC | 17:03 | |
fungi | krotscheck: that's ^ what you'll want | 17:03 |
*** baoli has joined #openstack-infra | 17:03 | |
*** sigmavirus24 is now known as sigmavirus24_awa | 17:04 | |
*** sergmelikyan has quit IRC | 17:04 | |
pleia2 | mrmartin: yes, looks like it hasn't run yet with the change | 17:04 |
pleia2 | mrmartin: likely will wait for the next run, things aren't perfectly timed to always get updated immediately after merge | 17:04 |
mrmartin | pleia2: Wednesday, July 1 2015 1:59 PM shows me this run. what is the time zone for this entry? | 17:05 |
mrmartin | this run / last run | 17:05 |
mrmartin | Catalog compiled at: Unknown | 17:05 |
fungi | mrmartin: unfortunately it's the timezone of the author of the puppetboard software i think :/ they assumed nobody runs software outside their 1/24th of the planet | 17:06 |
*** otter768 has joined #openstack-infra | 17:06 | |
*** patrickeast has joined #openstack-infra | 17:06 | |
SpamapS | mordred: its not that strange to think that Canonical would not take care to make Ironic work well. Also, because ironicclient is not in requirements.txt, it's not entirely clear that the virt driver would require later versions (which is actually what is broken) | 17:06 |
mrmartin | oh ok, and where this guy was living ? | 17:06 |
pleia2 | shows 4:59AM for me | 17:06 |
fungi | mrmartin: i believe that last run was 16:59... so probably incorporating changes that merged before 16:30 or maybe 16:45 | 17:06 |
pleia2 | but I was reading that as PM, so 7 minutes ago | 17:06 |
greghaynes | SpamapS: You discovered some packaging badness in ubuntu? | 17:07 |
*** kiran-r has quit IRC | 17:07 | |
pleia2 | fungi: that was my read as well | 17:07 |
*** patrickeast_ has quit IRC | 17:07 | |
fungi | pleia2: amusing. for me it says the last run was 11:59 am | 17:07 |
pleia2 | our merge happened at 16:46, so kind of on the cusp of being picked up | 17:07 |
fungi | and my clock is set to utc | 17:07 |
*** yamahata has quit IRC | 17:07 | |
pleia2 | clocks are hard | 17:07 |
mrmartin | pleia2: ok, /me is excited | 17:07 |
SpamapS | greghaynes: just oldness | 17:08 |
*** ashleighfarnham has joined #openstack-infra | 17:08 | |
SpamapS | greghaynes: we just need to get a not-18months-old version of ironicclient into Ubuntu | 17:08 |
greghaynes | ah :/ | 17:08 |
SpamapS | also when I tried pip installing.. zomg that pissed off puppet | 17:08 |
greghaynes | hahaha | 17:08 |
fungi | mrmartin: anyway, judging from the current cadence of puppet updates there, i'd assume you shouldn't expect anything exciting for about another 40 minutes | 17:09 |
*** dboik has quit IRC | 17:09 | |
mrmartin | puppet apply by hand to speed up things ? | 17:09 |
greghaynes | SpamapS: so, there are some hacks infra does to disable package installs while they build images... maybe the similar hack can be done for just a single pacakge | 17:09 |
fungi | mrmartin: i can if it's urgent | 17:09 |
pleia2 | mrmartin: it's not an emergency, I'd rather not | 17:09 |
mrmartin | pleia2: it's not urgent | 17:10 |
SpamapS | greghaynes: no the issue is that my pip installed current ironicclient installed a version of pbr that breaks the package installed neutronclient. | 17:10 |
fungi | we'd like to streamline our puppet updates to be a lot faster. i think they'll be nice and speedy once we switch to masterless | 17:10 |
fungi | right now they're mostly serialized | 17:10 |
greghaynes | wooow | 17:10 |
SpamapS | 2015-07-01 13:17:49 +0000 Puppet (err): Could not prefetch keystone_service provider 'openstack': Execution of '/usr/bin/openstack service list --quiet --format csv --long' returned 1: ERROR: openstackclient.shell Exception raised: (pbr 1.2.0 (/usr/local/lib/python2.7/dist-packages), Requirement.parse('pbr!=0.7,<1.0,>=0.6'), set(['python-neutronclient', 'cliff', 'python-glanceclient', 'python-cinderclient', 'python-novaclient'])) | 17:10 |
*** otter768 has quit IRC | 17:11 | |
SpamapS | greghaynes: so basically I suspect there's a rather large dependency chain of fail in UCA that needs to be fixed. | 17:11 |
fungi | okay, time to work on surgically extracting stable/icehouse from all our jobs | 17:11 |
*** dguerri is now known as dguerri` | 17:11 | |
*** yamamoto has quit IRC | 17:12 | |
*** geoffarnold has quit IRC | 17:13 | |
*** geoffarnold has joined #openstack-infra | 17:14 | |
*** wshao has joined #openstack-infra | 17:16 | |
*** SumitNaiksatam has joined #openstack-infra | 17:16 | |
*** sabeen1 has joined #openstack-infra | 17:17 | |
*** cindyo has quit IRC | 17:17 | |
*** sdake_ has joined #openstack-infra | 17:18 | |
*** e0ne is now known as e0ne_ | 17:19 | |
*** koolhead_ has joined #openstack-infra | 17:19 | |
*** patrickeast has quit IRC | 17:19 | |
*** koolhead17 has quit IRC | 17:19 | |
*** e0ne_ is now known as e0ne | 17:20 | |
*** sabeen2 has joined #openstack-infra | 17:21 | |
*** yamamoto has joined #openstack-infra | 17:21 | |
*** dboik has joined #openstack-infra | 17:21 | |
*** sdake has quit IRC | 17:21 | |
*** patrickeast has joined #openstack-infra | 17:21 | |
*** ihrachyshka_ has quit IRC | 17:22 | |
*** jaypipes has joined #openstack-infra | 17:22 | |
*** dboik_ has joined #openstack-infra | 17:23 | |
*** SumitNaiksatam has quit IRC | 17:23 | |
*** achanda has joined #openstack-infra | 17:23 | |
*** SumitNaiksatam has joined #openstack-infra | 17:23 | |
*** sabeen1 has quit IRC | 17:24 | |
*** dannywilson has quit IRC | 17:24 | |
*** Sukhdev has quit IRC | 17:24 | |
sdake_ | mordred happen to be around fine sir re temporary relicense of shade to asl | 17:25 |
*** ajmiller_ has joined #openstack-infra | 17:25 | |
*** Sukhdev has joined #openstack-infra | 17:25 | |
*** jsavak has joined #openstack-infra | 17:25 | |
*** dboik has quit IRC | 17:26 | |
*** gokrokve_ has joined #openstack-infra | 17:26 | |
*** trey has joined #openstack-infra | 17:26 | |
*** wshao has quit IRC | 17:26 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: stackforge/{anchor,bandit} -> openstack/{anchor,bandit} https://review.openstack.org/197673 | 17:27 |
*** gokrokve has quit IRC | 17:27 | |
*** wshao has joined #openstack-infra | 17:27 | |
*** yfried has joined #openstack-infra | 17:27 | |
SpamapS | so.. this is a really sticky problem I'm running into... | 17:28 |
SpamapS | packaged versions of client libraries are basically all "really old" in ubuntu cloud archive | 17:28 |
*** hdd has joined #openstack-infra | 17:28 | |
greghaynes | SpamapS: Why do you need the client libs? they are working fine as deps for the services as is right? | 17:29 |
*** e0ne is now known as e0ne_ | 17:29 | |
*** abregman has quit IRC | 17:29 | |
greghaynes | asking because why not venv | 17:29 |
SpamapS | greghaynes: well it's a dependency graph problem | 17:29 |
SpamapS | greghaynes: so the puppet modules are built around packages | 17:30 |
SpamapS | greghaynes: so venv would be a massive departure. | 17:30 |
greghaynes | SpamapS: I think it depends on where they are being used, which is what im trying to figure out | 17:31 |
krotscheck | fungi: Thanks! | 17:31 |
greghaynes | SpamapS: are the services themselves failing because old client libs? | 17:31 |
SpamapS | greghaynes: and for instance, ironicclient needs pbr >=0.11 ... Ubuntu cloud archive has 0.10 | 17:31 |
SpamapS | looks like I could maybe compromise with ironicclient 0.5.1 | 17:32 |
*** e0ne_ is now known as e0ne | 17:32 | |
SpamapS | hrm... 0.7.0 only _says_ it wants >=0.11 | 17:33 |
SpamapS | seems to work fine with 0.10 | 17:33 |
greghaynes | oh, this is puppet trying to set up the openstack using the client libs | 17:33 |
SpamapS | greghaynes: yes | 17:33 |
greghaynes | hrm | 17:33 |
greghaynes | yea, that is a bad spot :p | 17:33 |
SpamapS | greghaynes: just in general, it's the model of having everything in system python | 17:33 |
*** BharatK has quit IRC | 17:33 | |
SpamapS | which I am pretty sure is a model that is _heavily_ flawed. | 17:34 |
SpamapS | and is a great way to get stuck on an old release of OpenStack | 17:34 |
greghaynes | Yea, I was trying to figure out if theres a way you could maybe make this one use case use a venv, but that would probably be a lot of puppet change | 17:34 |
SpamapS | well it might be worthwhile puppet change | 17:35 |
SpamapS | I've always believed very strongly that "how you get your software" and "how you configure your software" should be thought of separately. | 17:35 |
*** e0ne has quit IRC | 17:35 | |
*** doude_ has quit IRC | 17:36 | |
greghaynes | also crinkle ^ I think this is your exact area of expertise - client libs + puppet | 17:36 |
*** trey has quit IRC | 17:37 | |
crinkle | ha | 17:37 |
*** armax has quit IRC | 17:37 | |
greghaynes | :) | 17:37 |
SpamapS | I'm actually about 5 minutes from uploading python-ironicclient 0.7.0 to Ubuntu "wily" | 17:38 |
SpamapS | which would I think make it fairly simple for UCA to sync that. | 17:38 |
*** fhubik has quit IRC | 17:38 | |
crinkle | so the puppet modules should be working with what's in uca | 17:38 |
greghaynes | SpamapS: Yea, for ironic that shouldnt be a big issue - theres not going to be any other services that use python-ironicclient | 17:38 |
SpamapS | crinkle: nova ironic driver does not | 17:39 |
SpamapS | crinkle: which is likely a corner case not covered in any integration test | 17:39 |
*** trey has joined #openstack-infra | 17:39 | |
SpamapS | one I'd like to cover once I get this sorted | 17:39 |
*** ildikov has quit IRC | 17:39 | |
*** sdake_ is now known as sdake | 17:39 | |
SpamapS | since we'll be relying on that. | 17:39 |
SpamapS | W: Failed to fetch http://security.ubuntu.com/ubuntu/dists/trusty-security/universe/binary-amd64/Packages Hash Sum mismatch | 17:41 |
SpamapS | oh joy | 17:41 |
SpamapS | apt.. seriously.. get your act together | 17:41 |
greghaynes | \O/ | 17:41 |
*** jsavak has quit IRC | 17:42 | |
Clint | silly ubuntu | 17:42 |
*** marcusvrn1 has joined #openstack-infra | 17:43 | |
*** armax has joined #openstack-infra | 17:43 | |
openstackgerrit | Merged openstack-infra/project-config: Fix universal extraction in non-universal wheel https://review.openstack.org/197654 | 17:44 |
SpamapS | Clint: I know right? pdiffs are like 10 years old now | 17:44 |
*** sdake has quit IRC | 17:44 | |
SpamapS | Clint: note that it's really "silly launchpad" for that one. :-/ | 17:44 |
*** mestery_ has joined #openstack-infra | 17:46 | |
*** sdake has joined #openstack-infra | 17:46 | |
*** notnownikki has quit IRC | 17:46 | |
*** marcusvrn has quit IRC | 17:46 | |
*** yamamoto has quit IRC | 17:48 | |
*** sdake has quit IRC | 17:48 | |
*** liam_ has joined #openstack-infra | 17:49 | |
*** mrunge has quit IRC | 17:49 | |
*** mestery has quit IRC | 17:49 | |
*** liam_ is now known as Guest12050 | 17:49 | |
*** sdake has joined #openstack-infra | 17:49 | |
*** rwsu has quit IRC | 17:50 | |
mordred | SpamapS: *headdesk* | 17:50 |
*** frobware_ has quit IRC | 17:52 | |
openstackgerrit | Merged openstack-infra/project-config: Make Sahara python3 job voting https://review.openstack.org/197498 | 17:52 |
*** SumitNaiksatam has quit IRC | 17:52 | |
*** Guest12050 has quit IRC | 17:53 | |
*** shardy has quit IRC | 17:53 | |
SpamapS | and now the fun begins | 17:53 |
SpamapS | wily has old'n'busted oslo.i18n still... so old it doesn't have de-namespaced modules | 17:54 |
*** shardy has joined #openstack-infra | 17:54 | |
*** rwsu has joined #openstack-infra | 17:54 | |
mordred | SpamapS: wow | 17:54 |
SpamapS | wait no.. | 17:55 |
SpamapS | this was trusty | 17:55 |
SpamapS | n/m | 17:55 |
*** DericHorn-HP has quit IRC | 17:55 | |
SpamapS | wily's good on that one | 17:55 |
*** wshao has quit IRC | 17:55 | |
* SpamapS doing too many things in parallel | 17:55 | |
SpamapS | need to enable UCA in my trusty test chroot | 17:55 |
clarkb | you kbow if this constraints stuff works wellall we need next is to sign our python packages then you can/should just pip + venv everythibg | 17:56 |
clarkb | (granted we cant sign our deps) | 17:56 |
*** isviridov is now known as isviridov_away | 17:56 | |
*** thorst has quit IRC | 17:57 | |
SpamapS | clarkb: I'm lacking context. Constraints stuff? | 17:57 |
openstackgerrit | Doug Hellmann proposed openstack-infra/infra-specs: Centralize Release Tagging https://review.openstack.org/191193 | 17:57 |
*** dizquierdo has quit IRC | 17:57 | |
clarkb | SpamapS the work lifeless is doing to make pip installs deterministic | 17:58 |
greghaynes | requirements constraints | 17:58 |
dhellmann | jeblair: I updated ^^ after discussing it with ttx this week when we realized your "keep all the history" approach would help us solve another problem we have | 17:58 |
greghaynes | clarkb: thers still the system dep problem too | 17:58 |
greghaynes | but were solving that in theory | 17:58 |
clarkb | greghaynes ya so need bindep too | 17:58 |
*** jogo has quit IRC | 17:58 | |
SpamapS | clarkb: what would happen if we didn't have that and just used signed git tags with pip+venv? | 17:59 |
*** mayurig has joined #openstack-infra | 17:59 | |
fungi | wow. i started writing the icehouse testing removal change less than an hour ago, based on project-config branch tip, and it's already in merge conflict before i've even pushed it into gerrit | 17:59 |
pleia2 | fungi: hm, I think something might actually be wrong with puppet | 17:59 |
pleia2 | about 6 hours since anything has changed | 17:59 |
*** puranamr has quit IRC | 17:59 | |
*** ivar-lazzaro has quit IRC | 17:59 | |
dhellmann | AJaeger_, is the change to add openstack/releases ok now? https://review.openstack.org/#/c/196704/ | 18:00 |
nibalizer | pleia2: what are you seeing? | 18:01 |
pleia2 | nibalizer: just looking at puppetboard.openstack.org | 18:01 |
fungi | pleia2: on the puppetmaster i see a bash /opt/system-config/production/run_all.sh process running since 12:15 utc | 18:01 |
fungi | pleia2: so i agree | 18:01 |
clarkb | SpamapS: you would have no control over your deps | 18:01 |
clarkb | SpamapS: so when you deploy a new compute node for example it could be runnign very different software than the existing compute nodes | 18:01 |
fungi | pleia2: and no updates to /var/log/puppet_run_all.log since 12:09 utc | 18:02 |
pleia2 | fungi: nods | 18:02 |
SpamapS | clarkb: I would, if I did pip install on each compute node. But instead I'd probably just copy the venv that passed testing. No? | 18:02 |
clarkb | SpamapS: virtualenvs are not portable, while that may work in a very specific use case generally it wont | 18:03 |
openstackgerrit | Merged openstack/requirements: Updated from global requirements https://review.openstack.org/196504 | 18:03 |
*** DericHorn-HP has joined #openstack-infra | 18:03 | |
fungi | pleia2: if you look at ps afuxww you'll see there's git fetch-pack hung for the past 6 hours | 18:03 |
SpamapS | clarkb: it works very reliably if you have the same path, and put it on hosts that are the same arch+os+libs .. which is not a hard thing to achieve. But I agree, we're two "what ifs" in and I'm already feeling icky. ;) | 18:03 |
pleia2 | fungi: oof | 18:04 |
*** mestery_ is now known as mestery | 18:04 | |
*** Kennan has quit IRC | 18:04 | |
SpamapS | clarkb: though this is really why things like snappy and docker are gaining popularity. | 18:04 |
fungi | pleia2: strace shows it's idling in the middle of a read | 18:04 |
fungi | pleia2: presumably on the network socket for that | 18:04 |
SpamapS | because those _are_ portable and they don't have all the insanity of system level packaging. | 18:04 |
clarkb | SpamapS: sure, but they have the problem where something like 60% of images on dockers image hub are found to have major security vulnerabilities | 18:04 |
*** Kennan has joined #openstack-infra | 18:05 | |
clarkb | it would be really neat if we could have aworking packaging system for python | 18:05 |
mordred | clarkb: sure. but if you build your own, it's easy, and you can track the security yourself | 18:05 |
fungi | pleia2: i'm willing to chalk this up to git^Wnetworks^Wcloud sucks, kill that pid and move on with our lives | 18:05 |
clarkb | SpamapS: also they are not necessarily portable because systemd and friends | 18:05 |
mordred | fungi: ++ | 18:05 |
SpamapS | clarkb: I don't understand how systemd affects the portability? | 18:05 |
clarkb | fungi: pleia2 ianw did appear to debug the git issue on centos | 18:05 |
pleia2 | fungi: wfm | 18:06 |
fungi | clarkb: yep, i saw | 18:06 |
clarkb | SpamapS: systemd is picky about its kernel | 18:06 |
SpamapS | it is? | 18:06 |
fungi | clarkb: though what's fun is this is ubuntu trusty on the client end | 18:06 |
*** thorst has joined #openstack-infra | 18:06 | |
mordred | clarkb: but you don't need to run systemd inside of a docker container | 18:06 |
clarkb | SpamapS: yes they explicitly have min kernel versions that are arbitrary based on whatever new feature they decide they need | 18:06 |
mordred | if you are doing that, you are doing it wrong | 18:06 |
*** sigmavirus24_awa is now known as sigmavirus24 | 18:06 | |
mordred | also - distro pacakges are ALSO not portable across different hosts | 18:07 |
clarkb | mordred: I take some issue with that, not running init in docker has resulted in many broken docker containers | 18:07 |
clarkb | mordred: because you have nothing reaping zombies | 18:07 |
clarkb | if you do it correctly its fine but it turns out that is hard to do when running $randomservice | 18:07 |
SpamapS | I think your kernel argument is true, but I'm not sure it is actually relevant to what we're discussing. | 18:08 |
SpamapS | and for the record, I also believe you need something reaping zombies in a container. | 18:08 |
mordred | you need suse packages for suse, and debian packages for debian | 18:09 |
mordred | also | 18:09 |
mordred | https://github.com/ewindisch/container-shpid1 | 18:09 |
clarkb | mordred: it doesn't have to be systemd but it does need to be something | 18:09 |
mordred | that ^^ | 18:09 |
clarkb | mordred: and most docker images have nothing | 18:09 |
clarkb | mordred: including the official ones | 18:09 |
mordred | yah | 18:09 |
mordred | because most of them are single-process application containers | 18:09 |
mordred | not containers-that-behave-like-vms | 18:09 |
clarkb | mordred: until that single process forks | 18:09 |
clarkb | mordred: which they do because unix | 18:09 |
mordred | clarkb: right. you have to use them for purposes | 18:10 |
mordred | they AREN'T a magic bullet | 18:10 |
mordred | but they ARE easier to deal with than distro packaging for most humans | 18:10 |
SpamapS | mordred: thats not handling zombies. | 18:10 |
mordred | so whether they are perfect or not - they are going to be used more and more | 18:10 |
clarkb | mordred: yes use them, I think I am more arguing that the docker conventions are terrible and need to be rethought | 18:11 |
clarkb | because hand waving around single process isn't practical | 18:11 |
SpamapS | but I think it _could_ handle them with a SIGCHLD handler. Also one could just run sysvinit as the pid1 for the container .. ;) | 18:11 |
jeblair | are we actually discussing using containers in infra? if so, great, otherwise, maybe this is a good conversation for #openstack-rainbow-unicorn-pals | 18:11 |
mordred | SpamapS: haha. nice | 18:12 |
*** HeOS has quit IRC | 18:12 | |
*** ZZelle_ has joined #openstack-infra | 18:12 | |
SpamapS | anyway, my point is not to disect docker. It is to suggest that I'm really not looking forward to jumping down the package rabbit hole just to fix nova+ironic in UCA. | 18:12 |
clarkb | jeblair: we probably do need to have the discussion about how to better test with containers and docker but thats orthogonal to this discussion | 18:12 |
mordred | SpamapS: yah | 18:12 |
persia | clarkb: Theoretically https://github.com/opencontainers/specs contains the results of such rethinking of conventions. | 18:12 |
*** ajmiller_ has quit IRC | 18:12 | |
EmilienM | greetings Infra! asking for review on 3 patches for Puppet CI > https://goo.gl/3Cn1HA | 18:12 |
SpamapS | jeblair: there is a legitimate problem right now, and we are actually discussing solutions. I know right? ;) | 18:12 |
clarkb | jeblair: because a lot of jobs are using docker and they essenentially break all the caching we do for jobs | 18:12 |
clarkb | they also break dns and use different package mirrors and don't use our pypi mirrors etc | 18:13 |
clarkb | mordred: ^ this is another issue with "its just single process isolation" if it was this wouldn't be a problem | 18:13 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Remove managed stable/icehouse branch testing https://review.openstack.org/197687 | 18:13 |
fungi | that ^ has already merge-conflicted with master once just in the hour it took me to write it, so i feel like we should fast-track reviewing it otherwise it will likely take forever to land | 18:14 |
*** MarkAtwood has quit IRC | 18:14 | |
mordred | fungi: reviewing | 18:14 |
jeblair | clarkb: okay, do we want to talk about that now? because seriously this just seems like people saying random things about containers in general. | 18:14 |
clarkb | jeblair: I don't need to have that discussion now. Its probably best to have the groups using containers come to us with their needs and go from there (kolla, solum, ansible openstack deployment, etc) | 18:14 |
jeblair | if there are legitimate problems that we want to solve, i'm happy to engage in a conversation, but i'd love it if we could avoid conflating that with general opining on systemd and containers | 18:15 |
jeblair | clarkb: agreed | 18:15 |
*** mrmartin has quit IRC | 18:15 | |
clarkb | jeblair: but they do have jobs fail at a fairly reasonable rate due to things that would be mostly non issues if not run in containers | 18:15 |
mordred | fungi: +2 | 18:15 |
*** jogo has joined #openstack-infra | 18:15 | |
fungi | i need to write a filter which replaces "container" with "tractor" in irc conversations and see if it makes about as much sense | 18:15 |
sdake | clarkb my kolla beeper went off | 18:15 |
sdake | anythingI can help answer? | 18:15 |
clarkb | sdake: just mentioning that the container based testing circumvents much of our node setup to make tests as reliable as possible | 18:16 |
jeblair | clarkb: yeah, folks who want to use containers have some engineering work to do to have them well supported in our system i think. | 18:16 |
clarkb | sdake: and that at some point we will want to address that | 18:16 |
Clint | EmilienM: i think you may have erred with your url-shortening | 18:16 |
EmilienM | oh dear | 18:16 |
SpamapS | jeblair: the problem we have now is that UCA is badly broken for nova + ironic. Luckily, I'm an Ubuntu developer and I can at least try to help it get fixed in UCA (though UCA is Canonical, so....). But we need to think more about how much packaging infrastructure we want to deal with, and thus came the topic "could we just use pip+venv or docker or something" | 18:16 |
*** fallenpegasus has quit IRC | 18:16 | |
jeblair | clarkb: and to keep us from being a dos vector | 18:16 |
EmilienM | Clint: the URL works for me, it's originally https://review.openstack.org/#/q/status:open+owner:%22Emilien+Macchi+%253Cemilien%2540redhat.com%253E%22+project:openstack-infra/project-config,n,z | 18:17 |
jeblair | SpamapS: aiui part of this overall effort includes a packaging component | 18:17 |
jeblair | SpamapS: but also, aren't we expecting to get kilo packages soon? | 18:17 |
SpamapS | jeblair: yes, it's been somewhat hand-wavy and decoupled up until now. | 18:17 |
SpamapS | jeblair: we have kilo packages | 18:18 |
SpamapS | except python-ironicclient | 18:18 |
*** kiran-r has joined #openstack-infra | 18:18 | |
SpamapS | which is Icehouse versioned | 18:18 |
SpamapS | and too old for kilo's Ironic driver | 18:18 |
jeblair | that seems weird | 18:18 |
SpamapS | nobody seems to have tried to run Kilo Nova+Ironic from UCA yet. | 18:18 |
SpamapS | except me :-P | 18:18 |
clarkb | SpamapS: you are a trailblazer | 18:19 |
*** Sukhdev has quit IRC | 18:19 | |
SpamapS | clarkb: I prefer s/trailblazer/firework/ | 18:19 |
* SpamapS lets his colors burst | 18:19 | |
clarkb | SpamapS: careful fireworks are going to be banned in this part of the country | 18:20 |
AJaeger_ | dhellmann: https://review.openstack.org/#/c/196704/ needs a +1 from ttx | 18:20 |
AJaeger_ | also, I noticed one "sorting nit". Let me fix that for you and then +2. | 18:21 |
dhellmann | AJaeger_: ok, thanks | 18:21 |
clarkb | fungi: how did you find that precise stuff for ironic testing, good catch on removing that | 18:21 |
*** puranamr has joined #openstack-infra | 18:21 | |
*** puranamr has quit IRC | 18:21 | |
*** nihilifer has quit IRC | 18:22 | |
AJaeger_ | dhellmann: I'll +2 once ttx has given his explicit approval | 18:22 |
mordred | clarkb: because he's a magical bunny | 18:22 |
openstackgerrit | Doug Hellmann proposed openstack-infra/infra-specs: Centralize Release Tagging https://review.openstack.org/191193 | 18:22 |
fungi | clarkb: git grep | 18:23 |
jeblair | SpamapS: my understanding is that we have chosen to use puppet modules and packages, which carries the risk that we are dependent on distro packages, but we can potentially mitigate that risk by implementing our own packaging system. we may find problems along the way, but will try to get those corrected. | 18:23 |
*** e0ne has joined #openstack-infra | 18:23 | |
*** e0ne is now known as e0ne_ | 18:23 | |
jeblair | SpamapS: does that match your understanding? do you think we should consider changing any aspects of that? | 18:23 |
fungi | clarkb: tried to clean up as much as i can without intentionally breaking/removing jobs for non release:managed repos for now | 18:23 |
*** e0ne_ is now known as e0ne | 18:23 | |
*** e0ne has quit IRC | 18:23 | |
fungi | clarkb: when we tear out precise workers, we'll probably be able to remove a lot more | 18:23 |
clarkb | fungi: I also notice we have no python kilo bitrot jobs | 18:24 |
fungi | clarkb: ttx proposed a change to add them | 18:24 |
*** puranamr has joined #openstack-infra | 18:24 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add openstack/releases repository https://review.openstack.org/196704 | 18:24 |
clarkb | fungi: perfect | 18:24 |
*** e0ne has joined #openstack-infra | 18:24 | |
fungi | clarkb: i'm planning to review/stack it on this, but first i'm going through and abandoning icehouse changes which are still open | 18:24 |
*** puranamr has quit IRC | 18:24 | |
jeblair | SpamapS: also, should we start thinking of the packaging effort as a harder dependency? | 18:25 |
SpamapS | jeblair: That matches my understanding. I think it makes me want to fill in details about what we'll do with packages, but does not bring me to any new conclusions. | 18:25 |
AJaeger_ | fungi, clarkb : ttx' change is https://review.openstack.org/196709 - please review. I'm not convinced that the python 2.6 changes are right | 18:25 |
fungi | AJaeger_: yep i plan to give it a good going-over shortly | 18:25 |
jeblair | SpamapS: ++ | 18:25 |
SpamapS | jeblair: I think it's going to become a harder dependency, for the simple reason that we cannot "work upstream" on UCA AFAIK. | 18:25 |
clarkb | fungi: yup no rush, just pointing out my observations, should be approving your change shortly as long as it all looks good | 18:25 |
SpamapS | jeblair: we just have to ask nicely for packages to be updated in UCA | 18:26 |
SpamapS | and they may not even decide to support nova+ironic in UCA, and thus would leave us out in the cold. | 18:26 |
clarkb | speaking of, the state of the python3 trusty package bug was updated again to reset it back to not fix released | 18:26 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: warn on projects not in governance https://review.openstack.org/196785 | 18:26 |
clarkb | so maybe someone is workign on that again? | 18:26 |
fungi | clarkb: that's my hope | 18:26 |
fungi | clarkb: it's getting more and more embarrassing | 18:27 |
jeblair | SpamapS, crinkle: do the puppet modules have a hard dependency on UCA packages? if we start substituting our own, is that likely to succeed or cause undue problems? | 18:27 |
*** ivar-lazzaro has joined #openstack-infra | 18:27 | |
clarkb | fungi: I have comments on the zuul layout that will be posted as soon as I can write them | 18:27 |
crinkle | jeblair: they have an implicit dependency on UCA packages | 18:27 |
*** jsavak has joined #openstack-infra | 18:27 | |
crinkle | jeblair: they make assumptions about the packaging such as the package name, default locations of configuration files | 18:27 |
jeblair | SpamapS, crinkle: (also, it seems weird that there is a puppet module for ironic while it is so out of step with the rest) | 18:28 |
SpamapS | jeblair: no, the puppet modules just ask for packages by name. | 18:28 |
crinkle | the ironic module seems to get a little less love than the others | 18:28 |
jeblair | so probably minimal problems as long as we start with the uca sources | 18:28 |
SpamapS | Agreed, the ironic module doesn't get tagged for instance. | 18:28 |
crinkle | it hasn't been released yet, i expect it will for kilo ( EmilienM ?) | 18:29 |
SpamapS | jeblair: right, I think we simply make our package repo a downstream of UCA | 18:29 |
jeblair | is ubuntu the only operating system supported by the puppet modules? | 18:29 |
*** packet has joined #openstack-infra | 18:29 | |
EmilienM | crinkle: yes, it's mature enough now | 18:29 |
SpamapS | keep it in sync for the most part, and diverge when we need to. | 18:29 |
crinkle | no there is fedora, centos, and debian support | 18:29 |
*** ildikov has joined #openstack-infra | 18:29 | |
crinkle | and potential for solaris support | 18:29 |
jeblair | some of those are more likely for us than others ;) | 18:29 |
clarkb | fungi: posted | 18:30 |
fungi | clarkb: thanks | 18:30 |
clarkb | fungi: with those addressed I think it is ready to be merged | 18:30 |
openstackgerrit | Julia Kreger proposed openstack-infra/glean: Make glean python 2.6 compatible for Centos6 https://review.openstack.org/197690 | 18:30 |
jeblair | SpamapS, crinkle: are the debian packgase in better shape? | 18:30 |
crinkle | jeblair: i have no knowledge of that | 18:31 |
EmilienM | jeblair: they should be | 18:31 |
SpamapS | jeblair: ehhh.. yes and no | 18:31 |
*** nihilifer has joined #openstack-infra | 18:31 | |
EmilienM | jeblair: before our acquisition, we were deploying them every day and they are working very well (cc zigo ) | 18:31 |
EmilienM | jeblair: upstream puppet modules support them without any issue | 18:32 |
clarkb | TheJulia: re 197690 both those methods raise an exception if the command fails which means the subsequent poll will never run right? | 18:32 |
*** dannywilson has joined #openstack-infra | 18:33 | |
clarkb | greghaynes: mordred ^ | 18:33 |
jeblair | a potential idea is to run infra-cloud on a different os; we've certainly considered running more infra servers on debian, and we already run some centos servers. i think that's a significant enough departure from our established plan not to be undertaken lightly. but it can be an idea we keep in mind. | 18:33 |
SpamapS | jeblair: their shape is probaby about the same. The OS itself is quite a different beast from Ubuntu though. :) | 18:33 |
SpamapS | We actually have.. a ridiculous number of DD's available. | 18:33 |
clarkb | TheJulia: er rather it won't poll if it fails in that case | 18:34 |
fungi | well, debian and ubuntu aren't terribly divergent... however the debian and ubuntu openstack packages are fairly divergent still | 18:34 |
TheJulia | clarkb: from what I read, yes | 18:34 |
crinkle | iirc we talked ourselves into Ubuntu for some reason | 18:34 |
*** e0ne is now known as e0ne_ | 18:34 | |
Clint | SpamapS: and none of them looking at zuul-packaging | 18:34 |
EmilienM | jeblair: centos7 is running fine and we make CI on this (and trusty) | 18:34 |
clarkb | TheJulia: I think I have convinced myself its fine if maybe lacking more verbose logging for that fail case | 18:34 |
*** ilyashakhat has quit IRC | 18:34 | |
fungi | SpamapS: but yes, there are a lot of dds here and also non-dds who run pretty much pure-debian outside of openstack infra ;) | 18:34 |
*** ilyashakhat has joined #openstack-infra | 18:35 | |
fungi | so it's not a huge stretch | 18:35 |
fungi | (accidental pun there) | 18:35 |
TheJulia | clarkb: :) Yeah.... I looked at it and felt the urge to add more, but I figured simple would be best. At least it now executes on centos6. Now to just get interfaces to come online with simple-init! | 18:35 |
*** kushal has quit IRC | 18:35 | |
SpamapS | fungi: well played | 18:35 |
SpamapS | My feeling is meh on Debian vs. Ubuntu. | 18:35 |
*** mrmartin has joined #openstack-infra | 18:36 | |
SpamapS | I like the Ubuntu security team's track record a lot. I like the LTS release cadence a lot more than the Debian release cadence. | 18:36 |
clarkb | TheJulia: yup +2 from me | 18:36 |
*** signed8bit has quit IRC | 18:36 | |
*** rossella_s has quit IRC | 18:36 | |
*** e0ne_ is now known as e0ne | 18:37 | |
SpamapS | Regarding the packages.. its likely even with Debian packages that we'd have operationally-important issues that would have to be solved quickly with a patch that might not be suitable for Debian. | 18:37 |
*** rossella_s has joined #openstack-infra | 18:37 | |
SpamapS | So going to that OS does not really free us from a need to have our own repo. | 18:37 |
jeblair | SpamapS: agreed | 18:37 |
*** kiran-r has quit IRC | 18:38 | |
jeblair | SpamapS: i'll just go ahead and say i'm a little worried that we're running into a sabdfl-created ironic/maas conflict here, which prompted my thinking along this line. | 18:38 |
SpamapS | So, I think we should focus on the meta-problem of creating and maintaining a downstream package overlay repo. | 18:38 |
*** sdake has quit IRC | 18:38 | |
*** dprince has quit IRC | 18:38 | |
*** sdake has joined #openstack-infra | 18:38 | |
jeblair | SpamapS: yep. clearly we have demonstrated need. | 18:39 |
*** kiran-r has joined #openstack-infra | 18:39 | |
*** dprince has joined #openstack-infra | 18:39 | |
clarkb | AJaeger_: good catch on python26, we dropped 26 for servers in kilo so we can probably just remove that | 18:39 |
SpamapS | jeblair: yeah, that conflict is not lost on me at all. I think it is absolutely why ironicclient has gone completely un-touched for 18 months in Ubuntu. | 18:39 |
clarkb | AJaeger_: I think you can flip your review to a -1 if you like | 18:39 |
AJaeger_ | ;) | 18:40 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Remove managed stable/icehouse branch testing https://review.openstack.org/197687 | 18:40 |
AJaeger_ | Ah, now I see what confused me - there are python 3.4 projects in the python 2.6 deprecation list. Will resort... | 18:40 |
*** sdake_ has joined #openstack-infra | 18:41 | |
*** Rockyg has joined #openstack-infra | 18:41 | |
fungi | AJaeger_: yeah, we need to clean that up but i left it for later | 18:41 |
*** doude has joined #openstack-infra | 18:41 | |
*** homeless has quit IRC | 18:41 | |
AJaeger_ | fungi, I'll put my patch on top of yours and rebase if needed... | 18:41 |
clarkb | AJaeger_: or maybe even push a new patchset? ttx is likely afk at this point | 18:41 |
* crinkle -> lunch | 18:42 | |
*** fallenpegasus has joined #openstack-infra | 18:42 | |
SpamapS | Clint: have you taken a look at all at this problem of making a downstream apt repo? | 18:42 |
SpamapS | StevenK: ^ ? | 18:42 |
Clint | SpamapS: only as a handwavy idea | 18:43 |
mrmartin | pleia2: are you here? | 18:44 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Move python 3.4 jobs out of python 2.6 list https://review.openstack.org/197695 | 18:44 |
*** sdake has quit IRC | 18:44 | |
*** Sukhdev has joined #openstack-infra | 18:44 | |
*** kiran-r has quit IRC | 18:44 | |
AJaeger_ | clarkb: not at the moment... | 18:45 |
mordred | uhoh. the clints are involved | 18:45 |
SpamapS | Clint: seems like the best way to do it would be to use something really simple that would build packages using sbuild on merge to git, and then manage the whole thing in gerrit. | 18:45 |
Clint | SpamapS: packages based on what though? | 18:46 |
*** signed8bit has joined #openstack-infra | 18:46 | |
mrmartin | fungi: something not quite ok with this openstackid upgrade. can you help me and paste the output of this two commands: cat /opt/deploy/conf.d/openstackid.conf and /opt/deploy/deploy.sh status openstackid ? | 18:46 |
fungi | mrmartin: yep, trying now | 18:47 |
SpamapS | Clint: whatever we need to have in our apt repo. | 18:47 |
Clint | SpamapS: but like, are you maintaining divergent packaging repos for everything or are you specifying some sort of base + diff? | 18:47 |
SpamapS | Clint: I think you start with an import of the package into git as your base. | 18:48 |
jeblair | Clint, SpamapS: as you come to conclusions, can you help refine https://review.openstack.org/179713 ? | 18:48 |
SpamapS | Clint: if the package is already in git, great. :) | 18:48 |
*** SumitNaiksatam has joined #openstack-infra | 18:48 | |
mordred | yah. that's one of my main questions - git repos are pretty heavy-weight in gerrit land | 18:48 |
fungi | mrmartin: http://paste.openstack.org/show/332895/ | 18:48 |
SpamapS | Oh I hadn't looked at that one. | 18:48 |
mrmartin | fungi: thnx | 18:48 |
mordred | and it seems like we could quickly wind up with 200 infra-packaging repos | 18:48 |
SpamapS | mordred: I don't expect we'd want to have more than a handful of these. | 18:49 |
Clint | what's the scope then? | 18:49 |
SpamapS | mordred: if we end up at 200 ... we're our own distro at that point. Time to make t-shirts. | 18:49 |
SpamapS | The idea is to fix it in our apt repo only as a buffer to the fix actually landing in our upstream. | 18:50 |
Clint | and are we never going to want to spin custom packages for software that is not openstack-upstream | 18:50 |
*** gokrokve_ has quit IRC | 18:50 | |
SpamapS | But I agree, adding and removing git repos every time we diverge could end up with 200 total, even if only 10 of them are active. | 18:50 |
SpamapS | Clint: yes, because NEW is slow. ;) | 18:50 |
clarkb | anteaya: happy canada day (is that the appropriate thing to say for this holiday?) I hope you do the Canadian equivalent of exploding things and cooking food with fire | 18:51 |
fungi | mrmartin: we discovered that our puppet apply task was hung and not updating any servers for ~6 hours, so that first run which updated openstackid.org about 25 minutes ago may not have used the latest configuration yet | 18:51 |
*** bradjones has quit IRC | 18:51 | |
Clint | jeblair: i think there will be more questions than conclusions | 18:51 |
clarkb | Clint: possible libvirt, ovs, kernel, rabbitmq, etc. the system deps of openstack | 18:51 |
jeblair | Clint: questons are good to have there too :) | 18:51 |
mrmartin | fungi: I realized that one part, I just like to figure out why the status of deploy.sh is pending | 18:51 |
Clint | so do we want full-weight git repos for each of those/ | 18:51 |
*** julim has quit IRC | 18:51 | |
Clint | (i suspect we don't) | 18:52 |
mordred | I think we don't | 18:52 |
mordred | I think we ultimately want to support both things - both having a packaging repo and not having a packaging repo | 18:52 |
*** hodos has joined #openstack-infra | 18:52 | |
*** bradjones has joined #openstack-infra | 18:52 | |
*** bradjones has quit IRC | 18:52 | |
*** bradjones has joined #openstack-infra | 18:52 | |
fungi | i wonder if you want a git repo of patches which can be layered on the deb src v3 quilt stacks | 18:52 |
SpamapS | are branches heavyweight? | 18:52 |
mordred | because there are some things where a referecen in a file that says "please clone $packaging_repo, run dch $some_version_args, run debuild and put the results in a local repo" is fine for simple things for us | 18:53 |
mordred | and I think we are NOT a distro | 18:53 |
fungi | or possibly just overlay patches to the debian subtrees of unpacked source packages | 18:53 |
mordred | so having a long-lived repo for things like "we temporarily need a new copy of a thing in our local repo" really doesn't need us to own the git for it | 18:53 |
mordred | fungi: yah | 18:53 |
mordred | or *something hand wavy* | 18:53 |
SpamapS | Hrm | 18:54 |
Clint | fungi: i'd want something that could patch the debian/ packaging too | 18:54 |
fungi | a repo fully of ugly hack triples of "script+patch+metadata" per source package | 18:54 |
mordred | http://lists.openstack.org/pipermail/openstack-infra/2015-April/002723.html | 18:54 |
fungi | s/fully/full/ | 18:54 |
mordred | is what I rambled on the subject back in april | 18:55 |
SpamapS | Thats just the thing... git repos are, by definition, a series of patches on top of a base. | 18:55 |
mordred | yes. but a git repo in gerrit is a heavy prospect | 18:55 |
SpamapS | The fact that gerrit makes them hard to use is rather frustrating at this point. | 18:55 |
*** shardy has quit IRC | 18:55 | |
*** shardy has joined #openstack-infra | 18:55 | |
jeblair | SpamapS: well... let's pretend it was easy to delete git repos from gerrit. should we? i am not so sure. | 18:56 |
jeblair | i don't like deleting work history | 18:56 |
fungi | SpamapS: well, i don't think it's so much gerrit. we're talking about forks of a bunch of ...probably... git repos but really debian source packages. we don't necessarily need the entire archive history if we're just maintaining an overlay | 18:56 |
SpamapS | I don't want to delete them. I think its fine to mark them as inactive and let them sit until the next time we want to diverge that package. | 18:56 |
SpamapS | fungi: definitely agree there. | 18:56 |
jeblair | SpamapS: that's an option | 18:56 |
*** sergmelikyan has joined #openstack-infra | 18:57 | |
mrmartin | fungi: can you check me whether the /srv/openstackid/w/public/index.php file exists, w is symlink to slot0 or slot1 and /srv/openstackid/slot0 directory exists | 18:57 |
mordred | well, honestly | 18:57 |
mordred | SpamapS has a good point | 18:57 |
mordred | which is that there is really nothing that _prevents_ us from making some more repos | 18:57 |
mordred | we have like 1000 puppet repos | 18:57 |
jeblair | right, i've not generally objected to creating repos, just deleting them. i assumed that was what was at issue here. | 18:57 |
SpamapS | Can we hide them? | 18:58 |
mordred | yah - if we just keep them around after we've used them once, that work _did_ happen and we _did_ publish the artifact from it | 18:58 |
fungi | mrmartin: the public/index.php exists (and is nonempty). the w symlink points at slot0 | 18:58 |
mordred | SpamapS: shouldn't really need to - it's not a problem taht they exist I think | 18:58 |
SpamapS | as in, they are there, and available, but gerrit doesn't show them because we've re-synced? | 18:58 |
mordred | SpamapS: the more I think about it | 18:58 |
Clint | and then huge rebase if you want to use it again? | 18:58 |
fungi | mrmartin: and the slot0 directory does exits too, yes | 18:58 |
jeblair | Clint: well, 'merge commit' perhaps/ | 18:58 |
SpamapS | Clint: might not even really need to rebase. Just import dsc again. | 18:58 |
mordred | Clint: I think we could have upstream branches and infra branches like we do with gerrit | 18:58 |
mordred | or do that | 18:58 |
mrmartin | fungi: strange, I not get why it tells for the status that it is pending: https://github.com/openstack-infra/puppet-openstackid/blob/master/files/functions#L88 based on this | 18:58 |
*** hashar has joined #openstack-infra | 18:59 | |
*** hashar is now known as hasharCall | 18:59 | |
mordred | SpamapS: instead of inactiving them - we can always land a commit that deletes all the content and replaces it with a "unused right now" readme | 18:59 |
jeblair | the main thing i think it's important to avoid is the appearance that we are either maintaining or willing to accept patches to a defunct pagaging repo. we can fix that as SpamapS suggests | 18:59 |
mordred | SpamapS: and then import-dsc if we need a point-in-time package again in the future | 18:59 |
jeblair | and mordred suggests. | 18:59 |
mordred | I could be on board with that | 19:00 |
SpamapS | mordred: yeah, totally | 19:00 |
fungi | also it now feels somewhat like we're reinventing git-buildpackage | 19:00 |
SpamapS | fungi: wouldn't we be using git-buildpackage ? | 19:00 |
SpamapS | I sort of assumed ... ;) | 19:00 |
*** koolhead_ has quit IRC | 19:00 | |
mordred | yah. I think we'd use git-buildpackage for sure | 19:01 |
fungi | SpamapS: well, okay, reinventing one of the existing common gbp workflows, yeah | 19:01 |
mordred | if we go with having a repo for each pacakge in gerrit | 19:01 |
fungi | or perhaps converging on it | 19:01 |
mordred | I think converging on it | 19:01 |
SpamapS | fungi: to be clear, I'm trying hard to align us with that workflow. :) | 19:01 |
fungi | wfm | 19:02 |
pc_m | anteaya: hi | 19:02 |
SpamapS | so assuming we did that, the idea would be that on approval of a patch, a nodepool worker goes out and runs a package build, and uploads it to our repo? | 19:03 |
persia | I've maintained overlay repos in the past, and one of the biggest issues we had was response-time to changes in the repos we overlaid. While the git-based workflow described above looks good: if you don't control the mirror for your base (and fail to sync stuff that is modified), you end up with annoying race conditions. | 19:03 |
*** unicell has quit IRC | 19:03 | |
mordred | persia: good point - I think how we mirror the base is important | 19:03 |
SpamapS | persia: ah so overlay works today, but tomorrow base updates and all hell breaks loose? | 19:03 |
persia | SpamapS: Right. There are a few solutions that do analysis in various ways: usually using append notation in version numbers to blacklist things, but I don't know of any that are independent of an archive management suite. | 19:04 |
Clint | sounds like when gentoo first started | 19:04 |
persia | And it would be annoying to try to host DAK or Soyuz in -infra. | 19:04 |
SpamapS | Clint: except without the nitro? | 19:04 |
* Clint coughs. | 19:04 | |
Clint | i don't think we need anything more complex than reprepro to manage the .debs | 19:05 |
fungi | a big up-side to doing this as a fork of existing distro-managed git repos is at least we have easy ways to see what changed, hopefully why, and manage the necessary merge conflicts/rebases | 19:05 |
SpamapS | persia: I've never looked at how independent of launchpad Soyuz is... or.. is it at all? | 19:05 |
* Rockyg thinks branches are the right solution | 19:06 | |
mordred | Clint: ++ | 19:06 |
SpamapS | I had always basically been look at very funny when suggesting trying to do any part of Ubuntu's infrastructure without doing all of Ubuntu's infrastructure. | 19:06 |
mordred | I cannot imagine that we need not-reprepro | 19:06 |
fungi | Clint: yeah, or just a script that calls apt-ftparchive and then creates detached signatures | 19:06 |
fungi | Clint: basically a solved problem | 19:06 |
SpamapS | wait you're missing persia's point | 19:06 |
persia | SpamapS: It was once independent. I think it isn't now. StevenK or lifeless will have a more recent opinion than I. | 19:06 |
Rockyg | clone the upstream repo. Keep it updated. Branch any time you want to make changes. Re-merge or maintain branch if you need to when your done | 19:06 |
SpamapS | Yes reprepro will create a bunch of packages which will be available to our servers with apt. | 19:07 |
*** otter768 has joined #openstack-infra | 19:07 | |
mordred | SpamapS: I think there are two reprepro options to deal with persia's point | 19:07 |
mordred | we can use reprepro to maintain an overlay repo that only has our packages that we have built referencing UCA | 19:07 |
persia | mordred: There are some, but reprepro has some issues, some of which are solved. | 19:07 |
*** jsavak has quit IRC | 19:07 | |
SpamapS | But it also will be somewhat unpredictable when interwoven with whatever the upstream distro does on any given day. | 19:07 |
mordred | this has the problem that UCA can then move on and purge old packages making packages in our overlay repo uninstallable | 19:07 |
persia | More importantly, apt can recognise when a repo should be used, and not to override that from an update from another repo: some of the work done to support backports. | 19:07 |
mordred | we can also additionally use reprepro to maintain a local mirror of UCA that we update when we choose | 19:08 |
*** puranamr has joined #openstack-infra | 19:08 | |
mordred | and that we consume UCA through - and that we build the overlay repo using | 19:08 |
mordred | this has the problem if needing to manage syncs with upstream | 19:08 |
SpamapS | Rockyg: thats assuming there is an upstream repo to clone. ;) Sometimes it's just downloading the .dsc+bits and importing them. | 19:08 |
*** crc32 has joined #openstack-infra | 19:08 | |
*** dimtruck is now known as zz_dimtruck | 19:08 | |
openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: prototype script to generate tag history for a project https://review.openstack.org/197711 | 19:08 |
mordred | but does not leave us with an unusable repo state | 19:08 |
persia | Having a local mirror is the first step towards a working solution. | 19:09 |
Rockyg | SpamapS: Ah. Thanks. So, only works for things with repos. Would 2 solutions be bad? | 19:09 |
SpamapS | Rockyg: not at all. | 19:09 |
Rockyg | persia ++ | 19:09 |
SpamapS | Rockyg: basically the ones with git repos for their packaging will just be easier to keep merged. | 19:09 |
persia | Rockyg: For debian-style packaging, there are at least 4 different ways to organise a git repo, which complicates that part of the discussion. | 19:10 |
Rockyg | SpamapS: branching *is* the way to go for those | 19:10 |
*** crc32 has quit IRC | 19:10 | |
*** erlon has quit IRC | 19:10 | |
*** nihilifer has quit IRC | 19:10 | |
*** crc32 has joined #openstack-infra | 19:10 | |
SpamapS | And yeah, what persia said. Local reprepro that has "all the things" and then we inject our own overrides into it. We would need to put some kind of merge guard on the sync process which prevents overwriting our own packages. | 19:10 |
*** gokrokve has joined #openstack-infra | 19:10 | |
fungi | oh, there's an option... we test updates to both our mirror and overlay and don't update them when the proposed new state fails. of course that means having jobs that would run against a staging mirror, and trigger an afs vos release or whatever when the jobs succeed | 19:10 |
*** fallenpegasus has quit IRC | 19:10 | |
Rockyg | persia: grrr. darn open source! same NIH problem as everywhere else | 19:10 |
SpamapS | fungi: I so want that. I SO WANT THAT. | 19:11 |
*** DericHorn-HP has quit IRC | 19:11 | |
jeblair | fungi, SpamapS: yeah, i think we'll have it :) | 19:11 |
persia | fungi: That would be lovely, indeed. | 19:11 |
mordred | ++ | 19:11 |
*** otter768 has quit IRC | 19:11 | |
SpamapS | A package mirror that gates updates on stuff actually working? | 19:11 |
mordred | fungi: s/or whatever// | 19:11 |
Clint | that's some rainbow-unicorn-pals | 19:12 |
fungi | SpamapS: well, to the extent that the tests can validate that, yes | 19:12 |
*** romcheg1 has joined #openstack-infra | 19:12 | |
SpamapS | It's possible we could get that for free with autopkgtest, but I feel like we've introduced too many new concepts already. :) | 19:12 |
mordred | yah. I Think we can get a something | 19:12 |
mordred | and then make it better | 19:12 |
mordred | even if the first something isn't the best something | 19:12 |
clarkb | tumbleweed figured it out | 19:12 |
persia | I don't seem to share a channel with paultag today, but I know he wrote some stuff to do some of this for Tanglu, which might be suitable as a starting point, rather than starting from reprepro | 19:12 |
SpamapS | So, MVP for this is just a reprepro built from UCA | 19:12 |
jeblair | we can also make it worse but i wouldn't recommend that | 19:12 |
fungi | SpamapS: we've wanted that for a while with our package mirrors just so we can avoid the issue of distro official mirrors or mirrors in service providers being in a broken state (so badly that sometimes apt-get update just breaks for hours straight) | 19:12 |
clarkb | so it is doable | 19:12 |
*** ajmiller_ has joined #openstack-infra | 19:13 | |
romcheg1 | fungi: Sorry for poking, but your patch seems to be landed. Could you please re-trigger the job to release python-fuelclient-6.1.2? | 19:13 |
Clint | persia: paultag is distracted by things atm | 19:13 |
fungi | romcheg1: we had some delays with puppet getting changes out to our servers. i need to check the pypi upload worker and make sure that change propagated to it | 19:13 |
fungi | romcheg1: but yes, i will | 19:13 |
persia | Oh well. I'll see if I can find a real pointer then. | 19:13 |
*** boris-42 has joined #openstack-infra | 19:13 | |
romcheg1 | fungi: Thanks a lot! | 19:14 |
SpamapS | Clint: I'm going to give you a new task from the storyboard to drive this. K? | 19:14 |
Clint | SpamapS: i suppose i should ask how to get storyboard switched between ubuntu one whatsits then | 19:14 |
romcheg1 | fungi: Could you please let me know, when it's re-triggered? | 19:14 |
fungi | romcheg1: i will | 19:14 |
SpamapS | Clint: StevenK has investigating options and reporting to the team, but I think this is more "put together an MVP repo and document in the package building spec" | 19:15 |
*** reed_ has joined #openstack-infra | 19:15 | |
Clint | SpamapS: where mvp repo == plain mirror | 19:15 |
jeblair | SpamapS, Clint: can we get the spec updated and merged first? | 19:15 |
*** ajmiller has quit IRC | 19:16 | |
persia | https://github.com/opencollab/debile | 19:17 |
SpamapS | Clint: https://storyboard.openstack.org/#!/story/2000175 <-- you have a task there now | 19:17 |
Clint | persia: ahhh, i forgot about that | 19:17 |
persia | Should save some time instead of starting with reprepro. Not precisely what is needed. | 19:17 |
persia | But the ability to run custom tooling on mirror should be helpful. | 19:18 |
SpamapS | jeblair: Sorry, I'm a trial-and-error person so specs tend to trail POC's for me. I think we should focus on the spec 100%, and if Clint can reason about it properly before the POC, then seems like it would be his call when to start noodling with tools. | 19:18 |
persia | And I suspect the code running in production for Tanglu (which I can't find at the moment) probably has some of the mirror-catching stuff. | 19:18 |
SpamapS | jeblair: and likewise, StevenK probably would like to read this backscroll and at least be involved in the spec reboot we just hashed out. :) | 19:19 |
mrmartin | fungi, pleia2 puppet run seems to be ok now on openstackid.org http://puppetboard.openstack.org/report/openstackid.org/f39e037ca14c10fccbfb6159b1b28f5dd7061d78 | 19:19 |
*** sergmelikyan has quit IRC | 19:20 | |
jeblair | SpamapS: i hear you; i'm just trying to balance that with not wanting to freeze StevenK out, and making sure we can all collaborate cross-timezone, etc. so yeah, i think "poc to see if what i'm about to write is remotely feasible" is more cool than "implement the thing and write the spec for it later"; i guess i wasn't clear where on the spectrum your suggestion was :) | 19:20 |
jeblair | SpamapS: there are also openstack projects where apparently people write specs and then get them approved after the code lands.... | 19:21 |
fungi | pleia2: mrmartin: mystery solved too... looks like deploy.sh needs extra privs to check status http://paste.openstack.org/show/333002/ | 19:21 |
SpamapS | jeblair: I may have been suggesting Clint push his cart with a horse. ;) | 19:21 |
Clint | and then lifeless can huff it | 19:21 |
*** sdake has joined #openstack-infra | 19:21 | |
jeblair | SpamapS: so i guess i'm sensitive to that, and want to make sure that folks know our intended use of specs is "get approval for idea (spec merged) then implement" | 19:22 |
SpamapS | I also keep forgetting that when I say "Clint: something something something" thats not just my inner monologue. | 19:22 |
jeblair | or really s/approval/agreement/ | 19:22 |
*** sdake has quit IRC | 19:23 | |
mrmartin | fungi: yeah, nah, thanks :) | 19:23 |
SpamapS | jeblair: also I just raised priority of the investigate package building task to High, as not having it is going to start complicating other things. | 19:23 |
jeblair | SpamapS: ++ | 19:23 |
*** sdake has joined #openstack-infra | 19:23 | |
*** aysyd has quit IRC | 19:23 | |
*** DericHorn-HP has joined #openstack-infra | 19:24 | |
*** ivar-lazzaro has quit IRC | 19:25 | |
*** sdake_ has quit IRC | 19:25 | |
*** aysyd has joined #openstack-infra | 19:25 | |
*** kiran-r has joined #openstack-infra | 19:26 | |
*** mayurig has quit IRC | 19:27 | |
*** dansmith has quit IRC | 19:30 | |
*** dansmith has joined #openstack-infra | 19:30 | |
*** arosen has joined #openstack-infra | 19:31 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add periodic Kilo jobs https://review.openstack.org/196709 | 19:31 |
AJaeger_ | clarkb, fungi: removed python 2.6 ^ | 19:31 |
*** nihilifer has joined #openstack-infra | 19:33 | |
*** armax has quit IRC | 19:34 | |
*** dguerri` is now known as dguerri | 19:34 | |
*** Rockyg has quit IRC | 19:35 | |
*** gokrokve has quit IRC | 19:36 | |
*** ociuhandu has joined #openstack-infra | 19:36 | |
fungi | AJaeger_: lgtm, though will probably merge-conflict with 197687 | 19:37 |
*** jasondotstar has quit IRC | 19:37 | |
lifeless | persia: Clint: ?! | 19:37 |
*** aysyd has quit IRC | 19:37 | |
*** HeOS has joined #openstack-infra | 19:38 | |
*** e0ne has quit IRC | 19:38 | |
persia | lifeless: Discussing ways to handle mirroring UCA, and then having some custom -infra packages layered above that, ideally sanely. | 19:38 |
persia | It was thought you would likely have an opinion about ways of doing this. | 19:38 |
Clint | lifeless: the horse, not the cart | 19:38 |
lifeless | I'll think about it and swing back | 19:38 |
lifeless | right now its morning bootstrap | 19:38 |
persia | My understanding is that the consensus was to write stuff up, and make sure you had a chance to review before doing anything. | 19:38 |
*** aysyd has joined #openstack-infra | 19:39 | |
persia | Also, Good morning :) | 19:39 |
*** jsavak has joined #openstack-infra | 19:39 | |
*** yamada-h has joined #openstack-infra | 19:39 | |
AJaeger_ | fungi: yeah, expect so... Shall I rebase it after 197687? | 19:42 |
*** kiran-r has quit IRC | 19:42 | |
*** nadirvardar has joined #openstack-infra | 19:42 | |
fungi | romcheg1: https://pypi.python.org/pypi/python-fuelclient is updated now | 19:42 |
*** armax has joined #openstack-infra | 19:42 | |
fungi | AJaeger_: wouldn't be a bad idea, just to get that out of the way now | 19:42 |
lifeless | fungi: are there images with https://review.openstack.org/#/c/197400/ on yet? I was pinged in -nova about what looks like the older colde | 19:42 |
lifeless | *code* | 19:43 |
fungi | lifeless: looking now | 19:43 |
*** sergmelikyan has joined #openstack-infra | 19:43 | |
* AJaeger_ is rebasing... | 19:43 | |
lifeless | http://logs.openstack.org/69/175569/20/check/gate-nova-requirements/3119838/console.html#_2015-06-30_23_23_23_621 | 19:43 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add periodic Kilo jobs https://review.openstack.org/196709 | 19:43 |
romcheg1 | fungi: thanks! | 19:43 |
AJaeger_ | fungi, didn't cause any conflicts, still can't hurt to have it this way | 19:43 |
fungi | lifeless: everywhere except hpcloud-b5 and rax-ord got updated bare-trusty images today. i'll get those two spinning right now | 19:44 |
*** dguerri is now known as dguerri` | 19:44 | |
lifeless | fungi: thanks | 19:44 |
*** yamada-h has quit IRC | 19:44 | |
AJaeger_ | fungi, your +2 for 196709 is still there ;) | 19:44 |
fungi | jenkins06 is unhappy. grr. seeing if i can get it into shutdown and then clean it up and restart it | 19:45 |
fungi | we're apparently over-quota in rax-ord. i'll see if i can figure out what's leaked there | 19:45 |
lifeless | fungi: I thought jenkinses were separate? | 19:46 |
fungi | they are | 19:46 |
lifeless | fungi: or - were those two separate utterances ;) | 19:46 |
fungi | lifeless: me noticing multiple problems that need attention | 19:47 |
*** jsavak has quit IRC | 19:47 | |
lifeless | FIRE | 19:47 |
*** zz_dimtruck is now known as dimtruck | 19:47 | |
fungi | wow. no need to put jenkins06 into shutdown after all! [Wed Jul 1 12:00:55 2015] Out of memory: Kill process 23001 (java) score 905 or sacrifice child | 19:47 |
jeblair | it's helpful like that | 19:47 |
*** jsavak has joined #openstack-infra | 19:47 | |
fungi | it's like it knew _just_ what i needed | 19:47 |
jeblair | fungi: it looks like some ord nodes are in the nova 'deleted' state for quite some time | 19:51 |
mtreinish | fungi: heh, someone reading that oomkiller message without context (or the rest of the log) would probably think the computer is telling you to sacrifice your child if you didn't want it to kill java :) | 19:52 |
fungi | jeblair: interesting. i wonder why they're not deleting, and why they're counting against our quota | 19:52 |
*** Rockyg has joined #openstack-infra | 19:52 | |
jeblair | fungi: indeed | 19:53 |
fungi | mtreinish: it's a kernel hostage crisis | 19:53 |
*** samuelBartel has quit IRC | 19:53 | |
*** unicell has joined #openstack-infra | 19:53 | |
*** olaph has joined #openstack-infra | 19:54 | |
TheJulia | mordred: or any other infra folks that might know, have you guys managed to use the simple-init element with centos7 successfully? | 19:55 |
*** yamahata has joined #openstack-infra | 19:55 | |
fungi | ianw: ^ ? i think you did some work with dibified devstack centos 7 workers? | 19:55 |
*** michchap has joined #openstack-infra | 19:56 | |
*** sergmelikyan has quit IRC | 19:56 | |
fungi | jenkins02 looks like it's gotten pretty leaky too, so i'm quiescing it for cleanup | 19:57 |
clarkb | TheJulia: I don't think we are using simple init with centos7 yet | 19:57 |
clarkb | unsure if it has been attempted | 19:57 |
*** mrunge has joined #openstack-infra | 19:57 | |
*** hasharCall has quit IRC | 19:57 | |
*** michchap_ has quit IRC | 19:57 | |
*** Swami has quit IRC | 19:57 | |
fungi | ugh, jenkins03 needs help as well. i'll do that one too | 19:58 |
TheJulia | clarkb: that would kind of explain it not working unless I reset the service and start it manually. :( | 19:58 |
*** hashar has joined #openstack-infra | 19:59 | |
clarkb | TheJulia: centos7 is a systemd distro, prehaps related to that? | 20:00 |
*** shardy_ has joined #openstack-infra | 20:01 | |
openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder: openSUSE: Fix link to the images download folder https://review.openstack.org/197501 | 20:01 |
openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder: opensuse: Update README https://review.openstack.org/197719 | 20:01 |
greghaynes | TheJulia: We havent really tested it much at all | 20:02 |
TheJulia | clarkb: definitly related, although I'm not convinced that systemd is actually calling simple-init again. | 20:02 |
greghaynes | TheJulia: Yea, I wouldnt be surprised | 20:02 |
fungi | clarkb: if you want an easy review, https://review.openstack.org/197662 fixes that we somehow approved a project creation with no acl at all | 20:02 |
*** michchap_ has joined #openstack-infra | 20:03 | |
*** achanda has quit IRC | 20:03 | |
clarkb | fungi: I just approved the icehouse removal change stack too | 20:03 |
openstackgerrit | Merged openstack-infra/project-config: Remove managed stable/icehouse branch testing https://review.openstack.org/197687 | 20:03 |
fungi | clarkb: i saw, i'll keep an eye on jobs once that merges | 20:03 |
openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder: opensuse: Update README https://review.openstack.org/197719 | 20:03 |
openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder: openSUSE: Fix link to the images download folder https://review.openstack.org/197501 | 20:03 |
fungi | clarkb: i've already abandoned all open icehouse backports for those projects, so as soon as it's applied i can go on a branch-deleting bender | 20:04 |
*** abregman has joined #openstack-infra | 20:04 | |
*** DericHorn-HP has quit IRC | 20:04 | |
*** michchap has quit IRC | 20:04 | |
fungi | and then send an eol announcement to the usual lists and prepare for the deluge of hatemail which inevitably follows | 20:04 |
clarkb | embrace the dark side | 20:05 |
TheJulia | we have cookies! | 20:05 |
jeblair | fungi: or send the mail as "OpenStack Proposal Bot" | 20:05 |
Clint | ha | 20:05 |
fungi | jeblair: hah, the poor bot gets enough hatemail as it is | 20:05 |
fungi | jeblair: using my old alien node detection methods, i see a lot of aliens in rax. 27 in dfw | 20:06 |
fungi | jeblair: the list of uuids is in nodepool:~fungi/rax-dfw.aliens | 20:06 |
fungi | i'm seeing what i can identify about any of them | 20:07 |
*** achanda has joined #openstack-infra | 20:07 | |
*** shashank_hegde has joined #openstack-infra | 20:07 | |
fungi | jeblair: it looks like nodepoold knows at least some of these are aliens and is itself logging its attempts to delete them | 20:07 |
*** DericHorn-HP has joined #openstack-infra | 20:08 | |
*** achanda has quit IRC | 20:09 | |
fungi | jeblair: ahh, yep, deleted status in nova | 20:09 |
fungi | jeblair: when you said there were a bunch in ord, did you perchance mean dfw? | 20:09 |
fungi | some are also in error status according to nova | 20:10 |
*** dimtruck is now known as zz_dimtruck | 20:10 | |
*** jsavak has quit IRC | 20:12 | |
openstackgerrit | Merged openstack-infra/project-config: Move python 3.4 jobs out of python 2.6 list https://review.openstack.org/197695 | 20:12 |
*** zz_dimtruck is now known as dimtruck | 20:12 | |
Clint | SpamapS: is it expected that UCA has a lot of broken checksums? | 20:12 |
openstackgerrit | Merged openstack-infra/project-config: Reuse ironic ACLs for ironic-webclient https://review.openstack.org/197662 | 20:12 |
fungi | jeblair: out of the 27 in that list, nova says 2 are active, 12 are deleted and 13 are error | 20:13 |
openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image uploads using gearman https://review.openstack.org/197722 | 20:13 |
mriedem | is it just me or is launchpad not putting links in bug reports when a review is posted for the bug? | 20:13 |
mriedem | it's changing status to in progress though | 20:13 |
*** olaph has quit IRC | 20:13 | |
krotscheck | I have QA-core approval on a project addition, can infra cores take a look? https://review.openstack.org/#/c/194938/ | 20:13 |
jeblair | fungi: i thought i was checking ord | 20:14 |
*** yamamoto has joined #openstack-infra | 20:14 | |
fungi | mriedem: on a change where the bug was mentioned in the commit message of the initial patchset, or only added in a later patchset? if it really was in the initial patchset, maybe the ~hudson-openstack account lost bug supervisor membership over the project in question and can no longer reassign? | 20:15 |
fungi | jeblair: yeah, i simply checked them all, and dfw turned out to be pretty massively crufty | 20:15 |
mriedem | fungi: initial ps1 | 20:15 |
*** _nadya_ has joined #openstack-infra | 20:15 | |
*** jsavak has joined #openstack-infra | 20:15 | |
mriedem | fungi: i bet thta's the case, i got an email about nova bug team membership last week | 20:16 |
jeblair | fungi: probably a good idea to check on those 2 and see if they change state | 20:16 |
openstackgerrit | Merged openstack-infra/project-config: Add periodic Kilo jobs https://review.openstack.org/196709 | 20:16 |
*** olaph has joined #openstack-infra | 20:16 | |
jeblair | fungi: but at least, that suggests that as far as nodepool leaks go, we're at somewhere between 0-2, which is a definite improvement. | 20:16 |
mriedem | fungi: and i don't see hudson here https://launchpad.net/~nova-bugs/+members#active | 20:17 |
jeblair | fungi: i think perhaps we were never quite sure whether a nova 'deleted' instance counted against quota, and maybe nodepool assumes that it does not. maybe we need to reverse that assumption. | 20:17 |
*** _nadya_ has quit IRC | 20:17 | |
clarkb | not to be *that* person but does 194938 need to enforce CLA since its openstack/ ? | 20:17 |
fungi | jeblair: ooh, yeah 27 in a deleted state in ord. ugly | 20:17 |
clarkb | krotscheck: ^ | 20:18 |
*** e0ne has joined #openstack-infra | 20:18 | |
*** mrmartin has quit IRC | 20:18 | |
krotscheck | clarkb: Does hacking? | 20:18 |
fungi | mriedem: it's the "OpenStack Infra" user on page 2, so that's not the issue | 20:19 |
krotscheck | clarkb: ¯\_(ツ)_/¯ | 20:19 |
clarkb | krotscheck: yes hacking does | 20:19 |
mriedem | fungi: oh, ok, nvm then | 20:19 |
clarkb | oh wait no | 20:19 |
clarkb | hrm I dunno then | 20:19 |
*** yamamoto has quit IRC | 20:20 | |
krotscheck | clarkb: Well, teh openstack/* thing came because apparently there's open tent things and efforst to move hacking under openstack. | 20:20 |
krotscheck | I do _not_understand the depths of what's going on there. | 20:20 |
fungi | mriedem: another possibility is that launchpad changed its bug api and now we're failing to reassign... or that we've introduced some bug into the hook script that does that | 20:21 |
krotscheck | Or, for taht matter, what the CLA means. | 20:21 |
asselin | nibalizer, jeblair cmmon-zuul patches have been updated per our disucssion. We should merge them when things calm down: https://review.openstack.org/#/c/176010/ https://review.openstack.org/#/c/175970/ | 20:21 |
fungi | mriedem: do you have a recent example (for a change started in the past couple weeks maybe)? | 20:21 |
krotscheck | clarkb: But fwiw, given that the rules are openstack specific, I don't have a problem with CLA or Not CLA. | 20:21 |
mriedem | fungi: https://review.openstack.org/#/c/197721/ | 20:21 |
krotscheck | I just don't know how to express it in gerrit. | 20:22 |
*** ajmiller_ is now known as ajmiller | 20:22 | |
clarkb | krotscheck: https://git.openstack.org/cgit/openstack-infra/project-config/tree/gerrit/acls/openstack/aodh.config#n12 | 20:22 |
*** cburgess_ has quit IRC | 20:23 | |
krotscheck | clarkb: Ah, ok, that makes sense. | 20:23 |
krotscheck | Is that a thing we want? | 20:23 |
*** cburgess has joined #openstack-infra | 20:23 | |
krotscheck | Or rather: I, as the person working on it, don't really care. Other people will care more than me. Can we identify those other peoples who care and ask them whether they actually care? | 20:23 |
clarkb | the trouble is the people that actually care are legal counsels for $company and they don't seem to directly interact with us | 20:25 |
clarkb | fwiw I +2'd if someone think it needs to go in they can -1 | 20:25 |
clarkb | fungi: CNN really wants me to know that you should avoid your shark infested waters | 20:25 |
*** olaph has quit IRC | 20:28 | |
*** mayurig has joined #openstack-infra | 20:28 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/jeepyb: Default to no series in update_bug.py https://review.openstack.org/197725 | 20:28 |
fungi | mriedem: recently introduced bug ^ in jeepyb wins this round! | 20:28 |
*** marcusvrn1 has quit IRC | 20:28 | |
*** packet has quit IRC | 20:28 | |
fungi | clarkb: yes, sharks like to nibble on the tourists. especially the ones not smart enough to avoid swimming next to the piers where people are fishing and getting said sharks all excited | 20:29 |
*** olaph has joined #openstack-infra | 20:29 | |
*** jgrimm is now known as zz_jgrimm | 20:29 | |
*** esp has left #openstack-infra | 20:29 | |
fungi | we've had a few choppered out of here and up over state lines to the hospital in the past couple weeks | 20:30 |
krotscheck | fungi: At least you getting tornadoes is unlikey | 20:30 |
mriedem | fungi: sweet, thanks | 20:30 |
fungi | krotscheck: instead we get waterspouts which can be nearly as bad | 20:30 |
fungi | krotscheck: they're still tornadoes, they just call them something else because they form over the water | 20:30 |
krotscheck | fungi: Eeeehhh.... sharkwaterspout doesn't have the same ring. Can we just call them sharknado's and be done with it? | 20:31 |
fungi | krotscheck: sold! | 20:31 |
krotscheck | fungi: next openstack project you incubate has to be called sharknado | 20:32 |
*** mayurig has quit IRC | 20:33 | |
clarkb | will that pass legal review >_> probably depends on whether or not you use apache storm | 20:33 |
* krotscheck perks up. | 20:34 | |
krotscheck | Did you say storm? | 20:34 |
krotscheck | :D | 20:34 |
krotscheck | Ok, I've got one +2 on https://review.openstack.org/#/c/194938/ , looking for one more! Going once, going twice.... | 20:35 |
krotscheck | You, too, can help me continue to procastinate from writing documentation! | 20:35 |
openstackgerrit | Aaron Rosen proposed openstack-infra/project-config: Make check-tempest-dsvm-networking-ovn voting https://review.openstack.org/197728 | 20:35 |
*** earlephilhower has quit IRC | 20:35 | |
*** earlephilhower has joined #openstack-infra | 20:36 | |
crinkle | jeblair: nibalizer: when you have a moment could you take a look at https://review.openstack.org/#/c/197377/ and https://review.openstack.org/#/c/190839/ to confirm whether it's in line with what we talked about? | 20:36 |
*** alivigni has quit IRC | 20:36 | |
*** openstackgerrit has quit IRC | 20:37 | |
*** jasondotstar has joined #openstack-infra | 20:37 | |
*** openstackgerrit has joined #openstack-infra | 20:37 | |
*** jasondotstar has quit IRC | 20:37 | |
*** puranamr has quit IRC | 20:38 | |
*** olaph has quit IRC | 20:38 | |
nibalizer | asselin: crinkle pushing it on the stack | 20:39 |
jeblair | crinkle: hrm, why is r10k needed? (i read the part that it's recommended, but i'm wondering why, as it seems like the sort of network traffic that we would want to avoid) | 20:39 |
crinkle | jeblair: it is not more network traffic than writing a shell script to clone each repo | 20:40 |
jeblair | crinkle: zuul-cloner will use the local cache | 20:40 |
jeblair | so we're sort of defeating its optimizations | 20:41 |
*** spzala has quit IRC | 20:41 | |
crinkle | jeblair: good point, i can rework it to avoid the duplication | 20:43 |
crinkle | nibalizer: i don't understand | 20:43 |
jeblair | crinkle: would simply this approach work? "if zuul-cloner exists: zuul-cloner; else: r10k! | 20:43 |
jeblair | er that was supposed to be a ", but ! is nice too i guess | 20:44 |
nibalizer | crinkle: my to do task | 20:44 |
crinkle | jeblair: that doesn't account for the modules that can't be zuul-cloned | 20:44 |
*** Sukhdev has quit IRC | 20:44 | |
*** unicell1 has joined #openstack-infra | 20:45 | |
*** ayoung has quit IRC | 20:45 | |
openstackgerrit | Adam Harwell proposed openstack-infra/project-config: Octavia: enable a voting py34 gate on master https://review.openstack.org/197732 | 20:45 |
*** unicell has quit IRC | 20:45 | |
*** DericHorn-HP has quit IRC | 20:45 | |
*** Sukhdev has joined #openstack-infra | 20:45 | |
jeblair | crinkle: got it; maybe split the list and apply that to the ones that can, and just r10k the rest | 20:45 |
crinkle | jeblair: that's what i'm thinking | 20:45 |
jeblair | crinkle: we should also, probably at a later time, look into caching those dependencies on build images and then making use of that for the same reason. but we should let the dust settle on the nodepool dib work first. | 20:45 |
crinkle | jeblair: sounds good | 20:46 |
*** puranamr has joined #openstack-infra | 20:46 | |
jeblair | (very far aside: perhaps as part of the zuul+github work, zuul-cloner might grow the ability to clone/update an external git repo from a local cache) | 20:47 |
*** ihrachyshka has joined #openstack-infra | 20:47 | |
mordred | lifeless: if you're around, notmyname has a question about pbr, hacking and swift (he just ran in to an instance of the general class of problems you've been fixing) | 20:48 |
mordred | lifeless: notmyname | mordred: so is it worth proposing a fix to global requirements to update teh min version of pbr (or hacking)? | 20:48 |
lifeless | hi | 20:49 |
notmyname | hi | 20:49 |
mordred | lifeless: notmyname | mordred: or will that get fixed later? | 20:49 |
mordred | oh look. you're both here | 20:49 |
lifeless | so its awkward | 20:49 |
*** mriedem has quit IRC | 20:49 | |
lifeless | 0.11 is the only overlap between master and stable/kilo | 20:49 |
notmyname | 0.11 on what? | 20:49 |
lifeless | pbr | 20:49 |
lifeless | kilo is <1.0 | 20:49 |
lifeless | master is >=0.11 | 20:49 |
lifeless | if we move master to say >=1.2 (for instance) then there's no overlap and we've had bad experiences in the past there. | 20:50 |
notmyname | hacking 0.10.0 and 0.10.1 (which are both allowed), caps pbr at <1.0 | 20:50 |
lifeless | yes, as do many other kilo branches of things | 20:50 |
*** cindyo has joined #openstack-infra | 20:50 | |
lifeless | notmyname: ah, in g-r master? | 20:51 |
notmyname | yes | 20:51 |
lifeless | notmyname: yes, we should raise the hacking minimums I think | 20:51 |
lifeless | notmyname: raising pbr's minimum is tricky because of its use as a setup_requires | 20:51 |
lifeless | notmyname: literally none of the problems we've had would have been avoided by a higher pbr minimum in g-r | 20:51 |
notmyname | hmm | 20:52 |
*** fallenpegasus has joined #openstack-infra | 20:52 | |
lifeless | notmyname: because the pbr references in requirements.txt are evaluated *after* the downgraded pbr has tried and failed. | 20:52 |
notmyname | right. that's the problem we got | 20:52 |
lifeless | notmyname: its a great big honking defect in the otherwise great declarative stuff pip does | 20:52 |
lifeless | notmyname: and I have a proof of concept to fix it | 20:52 |
lifeless | notmyname: but its queued up behind the constraints work | 20:52 |
openstackgerrit | Cody Littley proposed openstack-infra/nodepool: Fixed crash in exception handler https://review.openstack.org/195172 | 20:52 |
notmyname | we've had a stack of patches blocked by the gate for about a week or so because our requirements has an older hacking version. we have just now figured it out that updating the hacking version will unblock things | 20:54 |
openstackgerrit | Cody Littley proposed openstack-infra/nodepool: Fixed crash in exception handler https://review.openstack.org/195172 | 20:54 |
lifeless | notmyname: oh! I wish someone had chatted with me, I would have helped diagnose. | 20:55 |
notmyname | but it's mildly irritating to have to update a dependency when your use of it hasn't changed but suddenly it breaks because external packages that you don't use are updated | 20:55 |
lifeless | notmyname: I did send mails to the list about it | 20:55 |
lifeless | notmyname: I agree | 20:55 |
lifeless | notmyname: the problem is again that we can't version dep setup_requires [yet] | 20:55 |
notmyname | yeah, I saw something about the ;python== stuff, whcih is where we were breaking | 20:56 |
lifeless | notmyname: once we can, each package can declare the right build dep for it, and pip will take care of doing the build in an isolated env | 20:56 |
notmyname | but since global requirements is what's used instead of the local requirements in the project, we didn't realize how we were affected by it | 20:57 |
notmyname | ie we have a dependency on something that global requriements added the ;python== stuff to, and that's what broke | 20:57 |
fungi | some of this pain also comes back to the need for a sane and stateful dep solver in pip. right now to guarantee co-installability of things we're stuck declaring identical versions of requirements across all of them. it's not that we _want_ that situation | 20:57 |
notmyname | I've got to go run the swift team meeting now | 20:57 |
notmyname | mordred: thanks for the info | 20:58 |
*** mayurig has joined #openstack-infra | 20:58 | |
notmyname | lifeless: thanks for fixing this, long term :-) | 20:58 |
notmyname | I'm looking forward to it | 20:58 |
* mordred hands lifeless a fluffy bunny | 20:58 | |
*** matt____ is now known as mattoliverau | 20:58 | |
fungi | i'm especially looking forward to upcoming pip release including lifeless's solver | 20:58 |
fungi | that opens us up to a lot more flexibility around divergent versions of requirements | 20:59 |
*** GheRivero has quit IRC | 20:59 | |
clarkb | fungi: we will still need to use the constraints file for testing though | 20:59 |
clarkb | and constraints can't be circumvented by setup_requires so have to be careful until those allow a version spec | 21:00 |
fungi | clarkb: yep, but projects will be a lot more free to declare differing ranges of support for things | 21:00 |
*** marcusvrn has joined #openstack-infra | 21:00 | |
*** jasondotstar has joined #openstack-infra | 21:01 | |
jeblair | fungi: can i add a rdns entry for ask-staging? | 21:01 |
*** shardy_ has quit IRC | 21:01 | |
clarkb | fungi: right as long as its resolvable for constraints and doesn't prevent us from depending on bugfixes or security fixes that we need | 21:01 |
fungi | jeblair: oh, i'll do it now. i didn't realize it was still spamming | 21:01 |
jeblair | looks like Subject: Cron <root@ask-staging> /bin/bash /srv/askbot-site/cron/clean_session.sh | 21:02 |
jeblair | spams regularly | 21:02 |
fungi | jeblair: yep, "There are 2944 expired sessions ..." | 21:02 |
*** mrunge has quit IRC | 21:03 | |
*** ajmiller_ has joined #openstack-infra | 21:03 | |
*** GheRivero has joined #openstack-infra | 21:04 | |
fungi | jeblair: ptr records added now | 21:04 |
*** puranamr has quit IRC | 21:04 | |
*** otherwiseguy has quit IRC | 21:04 | |
*** dizquierdo has joined #openstack-infra | 21:05 | |
*** thorst has quit IRC | 21:05 | |
*** spzala has joined #openstack-infra | 21:05 | |
*** maishsk has joined #openstack-infra | 21:06 | |
krotscheck | Hypothetically speaking, if I were to be able to generate a .lcov report for code coverage somehow, is there a place where that might be uploadable so that it integrates into our gate somehow? | 21:06 |
*** ajmiller has quit IRC | 21:06 | |
clarkb | krotscheck: the way we do coverage with python projects is to have the job render an html report then we host that with the job logs | 21:07 |
clarkb | krotscheck: nodepool runs it in check if you want an example | 21:07 |
*** maishsk has quit IRC | 21:07 | |
*** sdake_ has joined #openstack-infra | 21:07 | |
*** otter768 has joined #openstack-infra | 21:08 | |
*** e0ne has quit IRC | 21:08 | |
krotscheck | clarkb: So sortof like the js draft job, except you get the coverage report. | 21:08 |
krotscheck | Excellent. | 21:08 |
clarkb | krotscheck: yup | 21:08 |
*** sdake has quit IRC | 21:09 | |
krotscheck | clarkb: It turns out the javascript coverage tool is crazy simple. It spaws a process that wraps the test runner, intercepts all filesystem commands issued by the same, and only instruments those files that the test runner asks for. | 21:09 |
fungi | lifeless: the last of the bare-trusty images from earlier are caught up now, so rechecks should get the latest version of that script now | 21:10 |
*** mpavlase has joined #openstack-infra | 21:11 | |
*** aysyd has quit IRC | 21:11 | |
*** otter768 has quit IRC | 21:12 | |
*** teran has joined #openstack-infra | 21:13 | |
*** Swami has joined #openstack-infra | 21:13 | |
lifeless | dims: ^ | 21:13 |
fungi | okay, jenkins02 and 03 have been cleaned up and started again | 21:13 |
lifeless | fungi: thanks | 21:13 |
clarkb | fungi: was it looking like the thread leak again? | 21:13 |
fungi | clarkb: yep | 21:13 |
fungi | clarkb: i had to do 05 and 06 earlier in the week too | 21:14 |
clarkb | I don't think my jenkins bug has gotten anymore traction once I provided the concrete thread dump ingo | 21:14 |
clarkb | which is sad because why ask me if its just going to be ignored :/ | 21:14 |
*** ldnunes has quit IRC | 21:15 | |
fungi | clarkb: probably because there are 100 people who know how to tell when there's not enough detail in the bug, and 2 who actually stand a chance of interpreting the additional detail once it's added | 21:15 |
fungi | "please attach a thread dump" is the bug triage equivalent of submitting changes to correct typos in code comments | 21:16 |
*** tvanderwiel has quit IRC | 21:18 | |
*** austin81 has left #openstack-infra | 21:21 | |
*** marcusvrn has quit IRC | 21:23 | |
*** heyongli has quit IRC | 21:23 | |
*** heyongli has joined #openstack-infra | 21:24 | |
*** kgiusti has quit IRC | 21:29 | |
*** heyongli has quit IRC | 21:29 | |
*** jasondotstar has quit IRC | 21:30 | |
*** heyongli has joined #openstack-infra | 21:31 | |
*** ivar-lazzaro has joined #openstack-infra | 21:33 | |
fungi | i'm going to pop out for food and some evening errands. bbiaw | 21:35 |
*** radez` is now known as radez_g0n3 | 21:35 | |
*** doude has quit IRC | 21:38 | |
*** doude has joined #openstack-infra | 21:38 | |
openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image uploads using gearman https://review.openstack.org/197722 | 21:38 |
*** dprince has quit IRC | 21:39 | |
*** puranamr has joined #openstack-infra | 21:41 | |
*** maishsk has joined #openstack-infra | 21:42 | |
Sukhdev | fungi: If I may bug you for a quick question | 21:42 |
*** doude has quit IRC | 21:42 | |
Sukhdev | fungi: see this - https://review.openstack.org/#/c/195247/ | 21:42 |
*** doude has joined #openstack-infra | 21:43 | |
Sukhdev | fungi: it is in merge conflict - wondering if there is a painless way to resolve the merge conflict - short of pushing new patch and loosing all the votes? | 21:43 |
greghaynes | Sukhdev: Generally people should be able to recognize that it was just a merge conflict resolution and assume the votes are still there | 21:44 |
Sukhdev | pops sorry did not see fungi is gone out :-) | 21:44 |
*** spzala has quit IRC | 21:44 | |
greghaynes | most projects have some convention around that | 21:45 |
*** smarcet has quit IRC | 21:45 | |
greghaynes | but yea, its a process fix not a technical one | 21:45 |
*** pc_m has quit IRC | 21:45 | |
Sukhdev | greghaynes: so have to pull, merge, and push a new one, right? no other painless way around? | 21:46 |
greghaynes | Yep | 21:46 |
greghaynes | pull, rebase, push | 21:46 |
*** romcheg1 has quit IRC | 21:46 | |
Sukhdev | greghaynes: right - thanks | 21:47 |
*** doude has quit IRC | 21:47 | |
*** mmedvede has quit IRC | 21:48 | |
*** doude has joined #openstack-infra | 21:48 | |
*** ayoung has joined #openstack-infra | 21:51 | |
*** bknudson has quit IRC | 21:51 | |
*** amitgandhinz has quit IRC | 21:52 | |
*** _diana_ has joined #openstack-infra | 21:53 | |
*** _diana_ has quit IRC | 21:54 | |
*** _diana_ has joined #openstack-infra | 21:54 | |
*** dannywilson has quit IRC | 21:55 | |
*** puranamr has quit IRC | 21:55 | |
*** dannywilson has joined #openstack-infra | 21:56 | |
openstackgerrit | Khai Do proposed stackforge/python-jenkins: fix passing of byte object to url request method https://review.openstack.org/197752 | 21:58 |
*** shashank_hegde has quit IRC | 22:01 | |
*** annegentle has joined #openstack-infra | 22:02 | |
*** nihilifer_ has joined #openstack-infra | 22:04 | |
*** nihilifer has quit IRC | 22:04 | |
*** nihilifer_ is now known as nihilifer | 22:04 | |
*** dizquierdo has quit IRC | 22:05 | |
*** hashar has quit IRC | 22:05 | |
*** ZZelle_ has quit IRC | 22:08 | |
openstackgerrit | Tomoki Sekiyama proposed openstack-infra/project-config: Check requirements changes for each of python2 and python3 https://review.openstack.org/197753 | 22:10 |
*** chlong has joined #openstack-infra | 22:10 | |
*** thingee has quit IRC | 22:11 | |
*** thingee has joined #openstack-infra | 22:11 | |
*** thingee has quit IRC | 22:11 | |
*** thingee has joined #openstack-infra | 22:11 | |
*** pradk has quit IRC | 22:14 | |
*** mayurig has quit IRC | 22:15 | |
*** mmedvede has joined #openstack-infra | 22:16 | |
*** weshay has quit IRC | 22:16 | |
*** mayurig has joined #openstack-infra | 22:16 | |
*** sdake_ is now known as sdake | 22:17 | |
*** doude has quit IRC | 22:17 | |
*** dims_ has joined #openstack-infra | 22:17 | |
*** signed8bit has quit IRC | 22:19 | |
openstackgerrit | Merged openstack/requirements: Add openstack/designate-dashboard to projects https://review.openstack.org/197530 | 22:19 |
*** dizquierdo has joined #openstack-infra | 22:19 | |
*** tsekiyama has joined #openstack-infra | 22:20 | |
*** tsbot_ has joined #openstack-infra | 22:20 | |
*** tsbot_ has left #openstack-infra | 22:20 | |
*** dims has quit IRC | 22:21 | |
*** tsbot_ has joined #openstack-infra | 22:21 | |
*** dima____ has joined #openstack-infra | 22:22 | |
*** nadirvardar has quit IRC | 22:23 | |
*** jsavak has quit IRC | 22:25 | |
*** jsavak has joined #openstack-infra | 22:26 | |
*** sdake is now known as sdake_ | 22:29 | |
*** chlong has quit IRC | 22:30 | |
*** cindyo has quit IRC | 22:30 | |
*** chlong has joined #openstack-infra | 22:30 | |
tonyb | BobBall: Umm I'm not sure when the publisher runs. | 22:30 |
openstackgerrit | greghaynes proposed openstack-infra/nodepool: Run geard for nodepool tests https://review.openstack.org/194928 | 22:32 |
openstackgerrit | Christopher Aedo proposed openstack-infra/puppet-apps_site: Enable CORS for app-catalog https://review.openstack.org/194875 | 22:32 |
*** puranamr has joined #openstack-infra | 22:34 | |
*** _diana_ has quit IRC | 22:34 | |
*** cindyo has joined #openstack-infra | 22:36 | |
*** ddieterly has joined #openstack-infra | 22:38 | |
*** whoops has quit IRC | 22:38 | |
*** olaph has joined #openstack-infra | 22:38 | |
openstackgerrit | greghaynes proposed openstack-infra/nodepool: Run geard for nodepool tests https://review.openstack.org/194928 | 22:39 |
openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image builds using gearman https://review.openstack.org/195175 | 22:41 |
openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image uploads using gearman https://review.openstack.org/197722 | 22:41 |
tsekiyama | Requirements.txt update by OpenStack Proposal Bot (and also by humans) is failing in the CI for some projects (e.g. Nova, Glance) now. I hope https://review.openstack.org/#/c/197753/ will fix the issue. Could some one review this please? | 22:42 |
*** dizquierdo has quit IRC | 22:43 | |
*** ddieterly has quit IRC | 22:44 | |
*** ddieterl_ has joined #openstack-infra | 22:44 | |
*** rlandy has quit IRC | 22:44 | |
*** Sukhdev has quit IRC | 22:45 | |
*** Sukhdev has joined #openstack-infra | 22:45 | |
*** fallenpegasus has quit IRC | 22:45 | |
*** nihilifer has quit IRC | 22:46 | |
*** weshay has joined #openstack-infra | 22:47 | |
*** jsavak has quit IRC | 22:48 | |
*** shashank_hegde has joined #openstack-infra | 22:48 | |
openstackgerrit | lifeless proposed openstack-infra/devstack-gate: Switch to using constraints files. https://review.openstack.org/194886 | 22:49 |
*** jsavak has joined #openstack-infra | 22:50 | |
*** nihilifer has joined #openstack-infra | 22:52 | |
*** sdake_ has quit IRC | 22:54 | |
*** mpavlase has quit IRC | 22:55 | |
*** nihilifer has quit IRC | 22:56 | |
*** hodos has quit IRC | 22:57 | |
*** jsavak has quit IRC | 22:58 | |
*** olaph has quit IRC | 22:59 | |
jhesketh | Morning | 22:59 |
*** olaph has joined #openstack-infra | 23:01 | |
*** dannywilson has quit IRC | 23:02 | |
*** tonytan4ever has quit IRC | 23:02 | |
*** dannywilson has joined #openstack-infra | 23:03 | |
*** dimtruck is now known as zz_dimtruck | 23:03 | |
*** nelsnelson has quit IRC | 23:07 | |
lifeless | sob | 23:07 |
lifeless | glance has -e git+https://github.com/openstack/glance_store.git#egg=glance_store | 23:07 |
lifeless | in requirements.txt :/ | 23:07 |
lifeless | hmm, the py3 version | 23:07 |
*** otter768 has joined #openstack-infra | 23:08 | |
mgagne | is there some literature available about nodepool subnode support I can read and how I can use it? | 23:09 |
*** jasondotstar has joined #openstack-infra | 23:09 | |
*** annegentle has quit IRC | 23:10 | |
lifeless | I think tere are docs in the infra docs area about nodepool stuff | 23:10 |
greghaynes | mgagne: theres some info on http://docs.openstack.org/infra/nodepool/scripts.html in reguards to what info is there for each node | 23:10 |
clarkb | mgagne: http://docs.openstack.org/infra/nodepool/configuration.html tells you how to configure it and http://docs.openstack.org/infra/nodepool/scripts.html#ready-script describes the info left on the nodes | 23:10 |
greghaynes | hehe, yea, that | 23:10 |
mgagne | I think I missed the scripts part | 23:10 |
mgagne | will read | 23:10 |
mgagne | if I understand correctly, ready-script will be run on the primary node which can in turn prepare the su nodes? | 23:11 |
clarkb | mgagne: a | 23:11 |
clarkb | *ya | 23:11 |
mgagne | and /etc/nodepool/id_rsa is the key to use to connect to those sub nodes right? | 23:12 |
*** sabeen2 has quit IRC | 23:13 | |
*** DericHorn-HP has joined #openstack-infra | 23:13 | |
*** otter768 has quit IRC | 23:13 | |
openstackgerrit | Adam Gandelman proposed openstack-infra/project-config: Call sudo pip /w -H diskimage-builder-install macro https://review.openstack.org/197767 | 23:16 |
*** hichihara has joined #openstack-infra | 23:17 | |
Sukhdev | Hello Infra folks, this needs your blessing/review - https://review.openstack.org/#/c/195341/ | 23:17 |
pleia2 | Sukhdev: moves require scheduled downtime for gerrit, can you add this to this section of the wiki? https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Upcoming_Project_Renames | 23:18 |
*** ihrachyshka has quit IRC | 23:19 | |
*** Nakato_ is now known as Nakato | 23:19 | |
*** EricGonczer_ has quit IRC | 23:19 | |
greghaynes | adam_g: the sudo -H pip - does that fail because of the cached wheels? | 23:19 |
greghaynes | er, does that fail without -H because that | 23:20 |
adam_g | greghaynes, http://logs.openstack.org/73/736a7c9bfcb83367c722ca21ef55d0aa6093dd12/post/akanda-appliance-buildimage/884ae24/console.html | 23:20 |
clarkb | ya what happens is the dir gets owned by root in your homedir and you can't write new wheels to it | 23:20 |
clarkb | so you -H so that they go in roots homedir separate from your users cache | 23:20 |
greghaynes | yea, makes sense | 23:20 |
*** abregman has quit IRC | 23:22 | |
openstackgerrit | Christopher Aedo proposed openstack-infra/puppet-apps_site: Enable CORS for app-catalog https://review.openstack.org/194875 | 23:23 |
Sukhdev | pleia2: Thanks - I just added it to the wiki. This will need some +1/+2, right? | 23:24 |
pleia2 | Sukhdev: yes, people will look at it but we don't approve until a rename window comes up | 23:25 |
pleia2 | that's when we'll go through all of them a couple days before and make sure they're ready | 23:25 |
Sukhdev | pleia2: got it - thanks | 23:25 |
*** yamamoto has joined #openstack-infra | 23:27 | |
*** otter768 has joined #openstack-infra | 23:30 | |
*** fbo- has quit IRC | 23:31 | |
*** enikanorov2 has quit IRC | 23:33 | |
*** annegentle has joined #openstack-infra | 23:34 | |
*** wenlock_ has quit IRC | 23:38 | |
*** wenlock has quit IRC | 23:38 | |
*** yamamoto has quit IRC | 23:39 | |
*** puranamr has quit IRC | 23:39 | |
*** puranamr has joined #openstack-infra | 23:40 | |
*** mayurig has quit IRC | 23:40 | |
*** gyee has quit IRC | 23:40 | |
*** baoli has quit IRC | 23:41 | |
mordred | morning greghaynes | 23:41 |
greghaynes | morning? are you in SEA or something? | 23:41 |
mordred | greghaynes: nah - just bad at time :) | 23:41 |
mordred | greghaynes: jeblair and I looked further at the swift thing earlier today and were till not able to reproduce it | 23:42 |
greghaynes | mordred: yea - did you try doing an upload via nodepool command? | 23:42 |
mordred | yah | 23:42 |
greghaynes | did it work? | 23:42 |
mordred | yah | 23:42 |
mordred | I mean | 23:42 |
mordred | there was a cloud failure | 23:42 |
mordred | but the api calls all worked | 23:42 |
greghaynes | so that supports the theory that nodepool is just running with an old python dep that has since been upgraded in the venv | 23:43 |
greghaynes | and we just havent restarted nodepool | 23:43 |
*** mayurig has joined #openstack-infra | 23:43 | |
mordred | greghaynes: that's the best theory I've got | 23:43 |
greghaynes | sweet, well we should restart it and hopefully forget about this | 23:43 |
mordred | greghaynes: also - I saw a mentino of NOC things - did you do things with the noc people? (or the crabpeople?) | 23:44 |
greghaynes | mordred: Yea, they are doing another inventory of our hardware, just getting them somewhat sanely formatted data (for their definition of sane which seems to be able to put into a spreadsheet) | 23:44 |
greghaynes | havent heard back from them since I sent that off a couple days ago | 23:45 |
mordred | greghaynes: cool! it'll be neat to have that bit done | 23:45 |
*** sabeen has joined #openstack-infra | 23:46 | |
greghaynes | also as a PSA - im going to be traveling a bit next week but in theory I should be around, then the following two weeks I have vacation | 23:46 |
*** cindyo has quit IRC | 23:48 | |
Clint | hiding from oscon | 23:48 |
greghaynes | yep! | 23:49 |
greghaynes | actually, I am going to europython which seems to be at the same time | 23:49 |
greghaynes | just to be different | 23:49 |
mordred | yay! | 23:49 |
*** cebruns has quit IRC | 23:49 | |
clarkb | I bet oscon has better beer but worse spanish | 23:50 |
*** DericHorn-HP has quit IRC | 23:50 | |
Clint | also IETF93 | 23:51 |
*** cebruns has joined #openstack-infra | 23:51 | |
*** DericHorn-HP has joined #openstack-infra | 23:52 | |
*** jasondotstar has quit IRC | 23:52 | |
*** DericHorn-HP has quit IRC | 23:53 | |
*** mayurig has quit IRC | 23:53 | |
*** trey has quit IRC | 23:53 | |
mordred | fwiw, I'll also be on vacation OSCON week | 23:54 |
greghaynes | will you be on vacation at OSCON? | 23:55 |
mordred | followed by 3 weeks of conference/travel followed by a week of vacation - but I'm here and working the next two weeks | 23:55 |
mordred | greghaynes: nope! | 23:55 |
mordred | greghaynes: I will be on vacation in panama | 23:55 |
greghaynes | oh, nice | 23:55 |
greghaynes | hah | 23:55 |
greghaynes | wow | 23:55 |
mordred | where they will have probably much better spanish | 23:55 |
mordred | although I'm not sure why the quality of the spanish is important :) | 23:55 |
greghaynes | Yes, just a different kind | 23:56 |
greghaynes | I think clarkb meant because europython is in Bilbao | 23:56 |
clarkb | mordred it speaks to the cultural experience | 23:56 |
clarkb | eg its not MURICA | 23:56 |
mordred | ah | 23:56 |
mordred | wll yes then | 23:56 |
mordred | I will vacation in panama | 23:56 |
mordred | then I will conference for a while | 23:56 |
mordred | then I will vacation in bali | 23:57 |
clarkb | I hope you have excellent MURICA plans for freedom day | 23:57 |
mordred | \o/ | 23:57 |
mordred | clarkb: I'm going to freedom all the MURICAs | 23:57 |
mordred | clarkb: which will mostly involve drinking on my roof | 23:57 |
*** puranamr_ has joined #openstack-infra | 23:57 | |
mordred | clarkb: are the twins excited about explosions yet? | 23:57 |
clarkb | mordred I doubt it, though watchingbthem startle can be funny | 23:58 |
mordred | clarkb: I'm guessing they are excited by few things that are !(sleep|food) | 23:58 |
clarkb | there is a decebt chance we will have a firework ban though, will be interesting to see how that is enforced | 23:59 |
mordred | good luck with that | 23:59 |
greghaynes | I think it is full on burn ban ATM | 23:59 |
Clint | no more firepits | 23:59 |
greghaynes | yea, seriously, in portland on the 4th it gets a bit crazy | 23:59 |
*** laughterwym has joined #openstack-infra | 23:59 | |
fungi | mordred: greghaynes: for the "not restarted in a while" datapoint, nodepoold was last restarted on june 19, ~12 days ago | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!