| *** ddieterly has joined #openstack-infra | 00:03 | |
| *** annegentle has joined #openstack-infra | 00:03 | |
| *** adrian_otto has quit IRC | 00:03 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Add the ability for template to manage exim https://review.openstack.org/180782 | 00:06 |
|---|---|---|
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Move afs servers to using o_p::template https://review.openstack.org/180783 | 00:06 |
| *** annegentle has quit IRC | 00:08 | |
| *** shashankhegde has quit IRC | 00:09 | |
| *** shashankhegde has joined #openstack-infra | 00:10 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 00:12 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 00:12 | |
| *** sputnik13 has quit IRC | 00:13 | |
| *** dboik has joined #openstack-infra | 00:14 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/devstack-gate: Add errexit to setup & cleanup functions https://review.openstack.org/177017 | 00:14 |
| openstackgerrit | Ian Wienand proposed openstack-infra/devstack-gate: Return command status in tsfilter https://review.openstack.org/178905 | 00:14 |
| *** dboik has quit IRC | 00:18 | |
| fungi | puppet is once again reenabled and jenkins jobs fully updated on all our jenkins masters | 00:24 |
| mordred | fungi: woot | 00:26 |
| *** dkranz has joined #openstack-infra | 00:28 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: WIP: Use shade to get the client objects https://review.openstack.org/168603 | 00:28 |
| *** ddieterly has quit IRC | 00:31 | |
| mtreinish | jhesketh: on 179964 is the race you pointed out when we release the write lock on the tables? | 00:31 |
| mtreinish | jhesketh: if so that means I need to move the rename before the select, but still inside the write lock right? | 00:31 |
| openstackgerrit | Merged openstack-infra/bindep: Allow comments and blank lines in other-requirements.txt https://review.openstack.org/180060 | 00:34 |
| *** rm_work is now known as rm_work|away | 00:35 | |
| fungi | looks like we're slightly further on the centos-6 front. we have images in rax now so the snapshot versions are working well enough to complete image creation, but nodes aren't booting successfully there yet | 00:36 |
| fungi | no dib versions in hpcloud yet at all | 00:36 |
| *** dkranz has quit IRC | 00:36 | |
| *** dkranz has joined #openstack-infra | 00:37 | |
| *** bhunter71 has joined #openstack-infra | 00:37 | |
| *** annegentle has joined #openstack-infra | 00:39 | |
| *** craigbr has quit IRC | 00:40 | |
| jhesketh | mtreinish: yeah, that should help... but what I'm not sure about is if the writes that are pending for the table will go into the newly renamed 'runs' table or will go into 'runs_old' | 00:40 |
| jhesketh | might be worth playing with mysql cli | 00:41 |
| mtreinish | jhesketh: hmm that's a good question, dunno either | 00:42 |
| *** craigbr has joined #openstack-infra | 00:42 | |
| mtreinish | mordred: ^^^ it's based off what you originally wrote for the column add migration. Do you know? | 00:43 |
| *** dkranz has quit IRC | 00:44 | |
| *** ashleighfarnham has quit IRC | 00:47 | |
| *** sarob has quit IRC | 00:47 | |
| *** sarob has joined #openstack-infra | 00:49 | |
| *** shashankhegde has quit IRC | 00:49 | |
| *** hichihara has joined #openstack-infra | 00:53 | |
| *** smccully has quit IRC | 00:54 | |
| *** annegentle has quit IRC | 00:56 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 00:56 | |
| *** shashankhegde has joined #openstack-infra | 00:58 | |
| *** tiswanso has joined #openstack-infra | 01:00 | |
| *** craigbr has quit IRC | 01:01 | |
| *** ddieterly has joined #openstack-infra | 01:02 | |
| *** tiswanso_ has joined #openstack-infra | 01:04 | |
| *** dboik has joined #openstack-infra | 01:05 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 01:06 | |
| *** dboik_ has joined #openstack-infra | 01:06 | |
| mordred | mtreinish: so - before we dive in to that - can we go back to the other thing ... what is it that we're trying to solve with the myisam? | 01:06 |
| *** signed8bit is now known as signed8bit_ZZZzz | 01:06 | |
| *** tiswanso has quit IRC | 01:07 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add inventory command to shade https://review.openstack.org/175891 | 01:07 |
| Shrews | myisam?? oh dear. i don't want to know | 01:07 |
| mordred | jhesketh: ^^ I think that should address your concerns - and great call on the duplicate issue | 01:07 |
| jhesketh | mordred: will look later sorry, but thanks | 01:08 |
| mordred | Shrews: I _think_ the idea was to do a rolling merge-table based thing, so that old rows could be purged with drop rather than delete | 01:09 |
| mordred | Shrews: but I want to make sure that I grok the issues before we dive into that | 01:09 |
| *** dboik has quit IRC | 01:09 | |
| Shrews | mordred: merge tables aren't buggy at all | 01:09 |
| Shrews | </end sarcasm> | 01:10 |
| mordred | Shrews: I find it best to try to forget everything I know about mysql internals.... | 01:10 |
| *** claudiub has quit IRC | 01:12 | |
| *** asettle has joined #openstack-infra | 01:12 | |
| *** shashankhegde has quit IRC | 01:13 | |
| mtreinish | mordred: well, I was just trying to figure out our data expiration strategy for subunit2sql. I had: https://review.openstack.org/176564 up as the first idea | 01:17 |
| mtreinish | but that would just kill old data, so we were discussing alternatives, and jeblair brought up myisam merge | 01:17 |
| mtreinish | mordred: and you had mentioned that the append only nature of those tables was also a good fit for myisam | 01:18 |
| mordred | well - it is a good fit - although not if we delete from them | 01:18 |
| mtreinish | so I figured it would only take a few mins. to figure out how to do that if it's the direction we wanted to take | 01:18 |
| mtreinish | mordred: well I think it would be sharding (or something like that) instead of delete | 01:19 |
| mordred | when you say "that would kill old data" ... what would you prefer to do with old data? | 01:19 |
| mordred | yah | 01:19 |
| mtreinish | TBH, I haven't thought too much about what I want to do with old data yet. (if anything) | 01:19 |
| samueldmq | hey, do you know where do cross-project blueprints live ? | 01:20 |
| mtreinish | I haven't had too much time to play around with it | 01:20 |
| *** asahlin_afk has quit IRC | 01:20 | |
| mtreinish | samueldmq: http://git.openstack.org/cgit/openstack/openstack-specs ? | 01:20 |
| Shrews | mtreinish: partition tables can work well for old data expiration | 01:20 |
| mordred | oh - right - partition tables | 01:21 |
| Shrews | if they're partitioned by date | 01:21 |
| samueldmq | mtreinish, yeah there is for specs .. I am wondering if it would have a place to launchpad blueprints | 01:22 |
| mtreinish | Shrews: hmm, let me google that and how to use it. I'm guessing it should be doable | 01:23 |
| mordred | mtreinish: https://dev.mysql.com/doc/refman/5.1/en/partitioning-overview.html | 01:23 |
| Shrews | mtreinish: mordred: and using file_per_table with innodb can be helpful if going that route | 01:23 |
| Shrews | or whatever that option name was/is | 01:23 |
| mtreinish | mordred: thanks | 01:24 |
| *** asahlin has joined #openstack-infra | 01:24 | |
| *** otter768 has joined #openstack-infra | 01:26 | |
| *** ayoung has joined #openstack-infra | 01:27 | |
| mtreinish | Shrews: reading that link paritioning will probably work. It will probably help in general on the big table | 01:28 |
| Shrews | \o/ | 01:28 |
| mtreinish | Shrews: if you were curious you can look at the db in question at: mysql://query:query@logstash.openstack.org/subunit2sql | 01:29 |
| *** achanda has quit IRC | 01:29 | |
| *** otter768_ has joined #openstack-infra | 01:29 | |
| *** otter768 has quit IRC | 01:30 | |
| *** dannywilson has quit IRC | 01:31 | |
| mtreinish | heh, I guess I just need to figure out how to write a migration to set it up | 01:31 |
| Shrews | mtreinish: i'm a bit rusty, but probably something like: SELECT INTO OUTFILE ... ; create your partition tables ; LOAD DATA INFILE ... | 01:33 |
| Shrews | mtreinish: but don't listen to me. i don't know anything about databases. i'm just making stuff up :) | 01:33 |
| mtreinish | Shrews: heh, rusty is still probably better than new to sql | 01:33 |
| *** tnovacik has quit IRC | 01:35 | |
| mtreinish | samueldmq: I'm not sure they get set to a single lp project. I was of the impression that they were broader guidelines and each project could use it as a common name for a bp to track an effort to implement it if they wanted | 01:38 |
| mtreinish | mordred: heh, my backup plan for data expiration is to just not do anything and let the trove node run out of space and see what happens | 01:40 |
| samueldmq | mtreinish, nice got it, makes sense; the specs provide guidelines and projects create their lp bps to implement that global spec | 01:42 |
| mordred | mtreinish: that'sa great plan | 01:42 |
| mtreinish | samueldmq: yeah, at least that's how I thought it was supposed to work | 01:44 |
| samueldmq | mtreinish, it makes sense, I think it works as you described | 01:47 |
| samueldmq | mtreinish, thanks | 01:47 |
| *** ashleighfarnham has joined #openstack-infra | 01:47 | |
| *** shashankhegde has joined #openstack-infra | 01:47 | |
| *** zhiwei has joined #openstack-infra | 01:50 | |
| *** sarob has quit IRC | 01:51 | |
| *** ashleighfarnham has quit IRC | 01:51 | |
| *** otter768_ has quit IRC | 01:56 | |
| *** annegentle has joined #openstack-infra | 01:56 | |
| *** patrickeast has quit IRC | 01:59 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Look for yum instead of rpm in elements too https://review.openstack.org/180826 | 01:59 |
| *** tiswanso_ has quit IRC | 02:01 | |
| *** dboik_ has quit IRC | 02:01 | |
| *** erlon has quit IRC | 02:01 | |
| *** dboik has joined #openstack-infra | 02:01 | |
| *** tiswanso has joined #openstack-infra | 02:02 | |
| *** annegentle has quit IRC | 02:02 | |
| *** salv-orlando has quit IRC | 02:03 | |
| *** stevemar has joined #openstack-infra | 02:04 | |
| *** unicell has quit IRC | 02:07 | |
| openstackgerrit | Merged openstack/requirements: Adding os-brick for managing initiators https://review.openstack.org/177372 | 02:09 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for libvirt cannot recv data bug 1252947 https://review.openstack.org/180787 | 02:13 |
| openstack | bug 1252947 in OpenStack Compute (nova) "libvirtError: Cannot recv data: Connection reset by peer" [Undecided,Confirmed] https://launchpad.net/bugs/1252947 | 02:13 |
| *** mriedem has quit IRC | 02:14 | |
| *** sarob has joined #openstack-infra | 02:15 | |
| *** yamahata has joined #openstack-infra | 02:17 | |
| *** yamahata has quit IRC | 02:20 | |
| *** yamahata has joined #openstack-infra | 02:20 | |
| *** baoli has joined #openstack-infra | 02:27 | |
| *** achanda has joined #openstack-infra | 02:29 | |
| *** baoli_ has joined #openstack-infra | 02:30 | |
| *** crc32 has quit IRC | 02:30 | |
| *** mtanino has quit IRC | 02:32 | |
| *** baoli has quit IRC | 02:33 | |
| *** ddieterly has quit IRC | 02:33 | |
| *** tiswanso has quit IRC | 02:35 | |
| *** sarob has quit IRC | 02:42 | |
| *** jogo has quit IRC | 02:45 | |
| *** achanda has quit IRC | 02:46 | |
| *** achanda has joined #openstack-infra | 02:48 | |
| *** r-daneel has quit IRC | 02:49 | |
| *** ddieterly has joined #openstack-infra | 02:50 | |
| *** dims_ has quit IRC | 02:51 | |
| *** dims has joined #openstack-infra | 02:52 | |
| *** Krinkle is now known as Krinkle|detached | 02:52 | |
| *** annegentle has joined #openstack-infra | 02:57 | |
| *** nijaba has quit IRC | 03:02 | |
| *** jogo has joined #openstack-infra | 03:02 | |
| *** markvoelker has quit IRC | 03:04 | |
| *** ivar-laz_ has joined #openstack-infra | 03:06 | |
| *** nijaba has joined #openstack-infra | 03:08 | |
| *** nijaba has joined #openstack-infra | 03:08 | |
| *** ivar-lazzaro has quit IRC | 03:09 | |
| *** sdake_ has joined #openstack-infra | 03:09 | |
| *** ivar-laz_ has quit IRC | 03:10 | |
| *** dims has quit IRC | 03:11 | |
| *** shashankhegde has quit IRC | 03:13 | |
| *** sdake has quit IRC | 03:13 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: beaker: enable voting for puppet-(keystone/openstacklib) https://review.openstack.org/176343 | 03:14 |
| EmilienM | crinkle: I updated this patch ^ - let us know if you still want to wait a bit - jobs look pretty stable now | 03:15 |
| *** ajmiller_ has quit IRC | 03:19 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Puppet: move from Stackforge to OpenStack https://review.openstack.org/176326 | 03:19 |
| *** bhunter71 has quit IRC | 03:20 | |
| *** SumitNaiksatam has joined #openstack-infra | 03:23 | |
| *** jyuso1 has quit IRC | 03:23 | |
| *** annegentle has quit IRC | 03:25 | |
| *** otter768 has joined #openstack-infra | 03:26 | |
| *** achanda has quit IRC | 03:28 | |
| *** baoli_ has quit IRC | 03:30 | |
| *** asettle has quit IRC | 03:34 | |
| *** craigbr has joined #openstack-infra | 03:34 | |
| *** ivar-lazzaro has joined #openstack-infra | 03:34 | |
| *** craigbr has quit IRC | 03:35 | |
| *** sdake has joined #openstack-infra | 03:36 | |
| *** spzala has quit IRC | 03:36 | |
| *** craigbr has joined #openstack-infra | 03:37 | |
| *** sdake_ has quit IRC | 03:39 | |
| *** ujuc has joined #openstack-infra | 03:39 | |
| *** mmedvede_ has quit IRC | 03:41 | |
| *** pcrews has quit IRC | 03:43 | |
| *** marun has quit IRC | 03:44 | |
| *** links has joined #openstack-infra | 03:45 | |
| *** mmedvede_ has joined #openstack-infra | 03:48 | |
| *** btully has joined #openstack-infra | 03:53 | |
| *** ddieterly has quit IRC | 03:54 | |
| *** mrmartin has joined #openstack-infra | 04:00 | |
| *** otter768 has quit IRC | 04:01 | |
| *** emagana has quit IRC | 04:03 | |
| *** camunoz has quit IRC | 04:03 | |
| *** markvoelker has joined #openstack-infra | 04:04 | |
| *** achanda has joined #openstack-infra | 04:05 | |
| *** gnuoy has quit IRC | 04:05 | |
| *** jamespage has quit IRC | 04:05 | |
| *** gnuoy has joined #openstack-infra | 04:06 | |
| *** samueldmq has quit IRC | 04:07 | |
| *** yfried has joined #openstack-infra | 04:07 | |
| *** armax has joined #openstack-infra | 04:07 | |
| *** markvoelker has quit IRC | 04:09 | |
| *** sabeen1 has joined #openstack-infra | 04:13 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/puppet-diskimage_builder: Update metadata to be diskimage_builder https://review.openstack.org/180850 | 04:15 |
| *** armax has quit IRC | 04:16 | |
| *** jogo has quit IRC | 04:16 | |
| *** shashankhegde has joined #openstack-infra | 04:17 | |
| *** shashankhegde has quit IRC | 04:19 | |
| *** camunoz has joined #openstack-infra | 04:20 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Up the test timeout to 60 seconds https://review.openstack.org/180855 | 04:29 |
| *** jogo has joined #openstack-infra | 04:32 | |
| *** oomichi has joined #openstack-infra | 04:33 | |
| *** btully has quit IRC | 04:35 | |
| *** fedexo has joined #openstack-infra | 04:36 | |
| *** abregman has joined #openstack-infra | 04:37 | |
| *** amotoki has joined #openstack-infra | 04:38 | |
| *** craigbr has quit IRC | 04:39 | |
| *** emagana has joined #openstack-infra | 04:41 | |
| *** pcrews has joined #openstack-infra | 04:41 | |
| *** jog0 has joined #openstack-infra | 04:44 | |
| crinkle | EmilienM: i removed my -1 | 04:44 |
| crinkle | EmilienM: but if we add centos jobs things will start breaking again, we're not prepared for that | 04:44 |
| *** jogo has quit IRC | 04:45 | |
| *** emagana has quit IRC | 04:46 | |
| *** doug-fish has left #openstack-infra | 04:47 | |
| *** ildikov has quit IRC | 04:49 | |
| *** sabeen1 has quit IRC | 04:50 | |
| *** yfried has quit IRC | 04:54 | |
| *** ddieterly has joined #openstack-infra | 04:55 | |
| openstackgerrit | greghaynes proposed openstack-infra/project-config: Add DIB tests to dib-utils https://review.openstack.org/180861 | 04:55 |
| *** BharatK has quit IRC | 04:56 | |
| openstackgerrit | greghaynes proposed openstack-infra/project-config: Add DIB tests to dib-utils https://review.openstack.org/180861 | 04:56 |
| *** ddieterly has quit IRC | 04:59 | |
| *** mmedvede has quit IRC | 05:01 | |
| *** ildikov has joined #openstack-infra | 05:02 | |
| *** stevemar has quit IRC | 05:03 | |
| *** coolsvap|afk is now known as coolsvap | 05:03 | |
| *** ajmiller has joined #openstack-infra | 05:04 | |
| *** markvoelker has joined #openstack-infra | 05:05 | |
| *** unicell has joined #openstack-infra | 05:06 | |
| *** ajmiller_ has joined #openstack-infra | 05:07 | |
| *** ajmiller has quit IRC | 05:09 | |
| *** ajmiller__ has joined #openstack-infra | 05:09 | |
| *** ildikov has quit IRC | 05:09 | |
| *** markvoelker has quit IRC | 05:10 | |
| *** camunoz has quit IRC | 05:11 | |
| *** ajmiller_ has quit IRC | 05:12 | |
| *** BharatK has joined #openstack-infra | 05:12 | |
| *** shashankhegde has joined #openstack-infra | 05:12 | |
| *** btully has joined #openstack-infra | 05:13 | |
| *** ashleighfarnham has joined #openstack-infra | 05:13 | |
| *** ashleighfarnham has quit IRC | 05:13 | |
| *** ajmiller__ has quit IRC | 05:15 | |
| *** sdake has quit IRC | 05:20 | |
| *** camunoz has joined #openstack-infra | 05:22 | |
| *** ivar-laz_ has joined #openstack-infra | 05:24 | |
| *** ivar-laz_ has quit IRC | 05:24 | |
| *** sdake has joined #openstack-infra | 05:24 | |
| *** ivar-laz_ has joined #openstack-infra | 05:24 | |
| *** ivar-laz_ has quit IRC | 05:25 | |
| *** ivar-laz_ has joined #openstack-infra | 05:25 | |
| *** sdake_ has joined #openstack-infra | 05:26 | |
| *** ivar-lazzaro has quit IRC | 05:27 | |
| *** sdake has quit IRC | 05:29 | |
| *** woodster_ has quit IRC | 05:30 | |
| *** Longgeek has joined #openstack-infra | 05:33 | |
| *** emagana has joined #openstack-infra | 05:35 | |
| *** adrian_otto has joined #openstack-infra | 05:36 | |
| *** adrian_otto has quit IRC | 05:39 | |
| *** jamespage has joined #openstack-infra | 05:40 | |
| *** emagana has quit IRC | 05:40 | |
| *** jog0 has quit IRC | 05:42 | |
| *** jtomasek has joined #openstack-infra | 05:43 | |
| *** yolanda has quit IRC | 05:45 | |
| *** yolanda has joined #openstack-infra | 05:45 | |
| *** btully has quit IRC | 05:48 | |
| *** jogo has joined #openstack-infra | 05:50 | |
| *** jogo has quit IRC | 05:50 | |
| *** jogo has joined #openstack-infra | 05:50 | |
| *** salv-orlando has joined #openstack-infra | 05:50 | |
| *** markvoelker has joined #openstack-infra | 05:51 | |
| *** ashleighfarnham has joined #openstack-infra | 05:52 | |
| *** fedexo has quit IRC | 05:54 | |
| *** mmedvede_ has quit IRC | 05:55 | |
| *** markvoelker has quit IRC | 05:56 | |
| *** baoli has joined #openstack-infra | 05:57 | |
| *** mrunge has joined #openstack-infra | 05:59 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/180875 | 06:01 |
| *** baoli has quit IRC | 06:02 | |
| *** otter768 has joined #openstack-infra | 06:02 | |
| *** Kennan has quit IRC | 06:02 | |
| *** Kennan has joined #openstack-infra | 06:03 | |
| *** jyuso1 has joined #openstack-infra | 06:03 | |
| *** deepakcs has joined #openstack-infra | 06:06 | |
| *** Longgeek has quit IRC | 06:06 | |
| *** otter768 has quit IRC | 06:07 | |
| *** sdake_ is now known as sdake | 06:10 | |
| *** ashleighfarnham has quit IRC | 06:10 | |
| *** mmedvede has joined #openstack-infra | 06:15 | |
| *** ashleighfarnham has joined #openstack-infra | 06:17 | |
| *** ashleighfarnham has quit IRC | 06:18 | |
| *** ddieterly has joined #openstack-infra | 06:18 | |
| *** shashankhegde has quit IRC | 06:19 | |
| sdake | anyone around from the openstack infrastructure team that can register an irc channel for me? | 06:19 |
| *** ddieterly has quit IRC | 06:23 | |
| *** ildikov has joined #openstack-infra | 06:24 | |
| *** yfried has joined #openstack-infra | 06:25 | |
| *** scheuran has joined #openstack-infra | 06:25 | |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/180875 | 06:26 |
| *** jcoufal has joined #openstack-infra | 06:28 | |
| *** oomichi has quit IRC | 06:31 | |
| *** tnovacik has joined #openstack-infra | 06:32 | |
| *** ildikov has quit IRC | 06:32 | |
| *** soren has joined #openstack-infra | 06:33 | |
| *** emagana has joined #openstack-infra | 06:37 | |
| *** HeOS has quit IRC | 06:41 | |
| *** Swami has quit IRC | 06:41 | |
| *** emagana has quit IRC | 06:42 | |
| *** adrian_otto has joined #openstack-infra | 06:42 | |
| deepakcs | AJaeger, morning, i read thru the logs of yesterday's discussion on the "job name clash" issues, so looks like fixing jjb is the solution, hence you abandoned your 2patches | 06:43 |
| deepakcs | AJaeger, so I was curious to know how easy it is to fix jjb such that when it throws error it also shows the job templates from where the alleged dup jobs are coming from | 06:44 |
| deepakcs | AJaeger, just to be clear, as fungi said, git grep glusterfs won't help, since job w/ glusterfs in it can come bcos of someone supplying plugin = glusterfs which won't hit the grep command | 06:45 |
| AJaeger | deepakcs, I never touched the jenkins-job-builder code. According to fungi, it should be easy but I can't help further. | 06:47 |
| AJaeger | deepakcs, fixing this would be appreciated! | 06:47 |
| *** ildikov has joined #openstack-infra | 06:48 | |
| deepakcs | AJaeger, I can try but i would need some help to begin with. I assume there would be folks who already know jjb and how to fix it ? | 06:49 |
| AJaeger | deepakcs, sure, just ask on this channel during US time | 06:49 |
| AJaeger | and read first http://ci.openstack.org/jenkins-job-builder/ | 06:50 |
| *** bkero has quit IRC | 06:50 | |
| *** bkero has joined #openstack-infra | 06:50 | |
| deepakcs | AJaeger, frankly i liked your idea of adding explicit -plugin- in the name and havign parameterized tempest regex, they help debuggability a lot | 06:50 |
| *** markvoelker has joined #openstack-infra | 06:52 | |
| *** dannywilson has joined #openstack-infra | 06:55 | |
| *** dannywilson has quit IRC | 06:56 | |
| *** markvoelker has quit IRC | 06:56 | |
| *** dannywilson has joined #openstack-infra | 06:57 | |
| *** camunoz has quit IRC | 06:58 | |
| *** hdd has joined #openstack-infra | 07:01 | |
| *** mpavone has joined #openstack-infra | 07:02 | |
| *** yfried is now known as yfried|afk | 07:02 | |
| *** yfried|afk is now known as yfried | 07:03 | |
| ttx | jeblair: ack. I assumed they already did | 07:04 |
| ttx | jeblair: although raising a stink post-summit is more likely to be effective (or corner them at summit if they are around). Pre-summit is emergency change mode for them | 07:05 |
| *** Longgeek has joined #openstack-infra | 07:07 | |
| *** rm_work|away is now known as rm_work | 07:07 | |
| viktors|afk | Hi folks! Can someone look at patch https://review.openstack.org/#/c/180599/ ? It moves Ironic non-voting python34 job from experimental to gate. | 07:17 |
| *** viktors|afk is now known as viktors | 07:18 | |
| *** frobware_ has quit IRC | 07:19 | |
| *** ddieterly has joined #openstack-infra | 07:19 | |
| *** Longgeek has quit IRC | 07:21 | |
| *** Longgeek has joined #openstack-infra | 07:21 | |
| *** ddieterly has quit IRC | 07:23 | |
| *** markus_z has joined #openstack-infra | 07:31 | |
| *** claudiub has joined #openstack-infra | 07:31 | |
| *** emagana has joined #openstack-infra | 07:32 | |
| *** Ala has joined #openstack-infra | 07:34 | |
| *** hdd has quit IRC | 07:36 | |
| *** emagana has quit IRC | 07:36 | |
| *** skolekonov has joined #openstack-infra | 07:40 | |
| *** mmedvede has quit IRC | 07:45 | |
| *** hdd has joined #openstack-infra | 07:48 | |
| *** samueldmq has joined #openstack-infra | 07:51 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Allow configuring vhost parameter on paste https://review.openstack.org/171526 | 07:52 |
| *** mmedvede has joined #openstack-infra | 07:53 | |
| *** samueldmq has quit IRC | 07:54 | |
| *** jistr has joined #openstack-infra | 07:54 | |
| *** achanda has quit IRC | 07:56 | |
| *** jlanoux has joined #openstack-infra | 08:00 | |
| *** ajo has joined #openstack-infra | 08:01 | |
| *** scheuran has quit IRC | 08:02 | |
| *** otter768 has joined #openstack-infra | 08:03 | |
| *** jcoufal_ has joined #openstack-infra | 08:03 | |
| *** ivar-laz_ has quit IRC | 08:05 | |
| *** jcoufal has quit IRC | 08:07 | |
| *** otter768 has quit IRC | 08:08 | |
| *** Hal has joined #openstack-infra | 08:11 | |
| *** Hal is now known as Guest89533 | 08:11 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-cgit: Add puppet-cgit load balancer class https://review.openstack.org/179053 | 08:14 |
| *** liam_ has joined #openstack-infra | 08:16 | |
| *** liam_ is now known as Guest73172 | 08:17 | |
| *** scheuran has joined #openstack-infra | 08:17 | |
| *** fhubik has joined #openstack-infra | 08:18 | |
| *** Guest73172 has quit IRC | 08:18 | |
| *** ddieterly has joined #openstack-infra | 08:20 | |
| *** kiseok7_ has quit IRC | 08:20 | |
| *** HeOS has joined #openstack-infra | 08:20 | |
| *** panda has quit IRC | 08:21 | |
| *** hdd has quit IRC | 08:21 | |
| *** panda has joined #openstack-infra | 08:21 | |
| *** mrunge has quit IRC | 08:22 | |
| *** mrunge has joined #openstack-infra | 08:22 | |
| *** sergsh has joined #openstack-infra | 08:22 | |
| *** sergsh_ has joined #openstack-infra | 08:22 | |
| *** e0ne has joined #openstack-infra | 08:23 | |
| *** jlanoux has quit IRC | 08:23 | |
| *** ddieterly has quit IRC | 08:24 | |
| *** sergsh has quit IRC | 08:25 | |
| *** emagana has joined #openstack-infra | 08:26 | |
| *** jlanoux has joined #openstack-infra | 08:26 | |
| *** sergsh_ has quit IRC | 08:26 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-jeepyb: Ensure /var/lib/jeepyb exists https://review.openstack.org/180906 | 08:27 |
| *** sergsh has joined #openstack-infra | 08:27 | |
| *** dannywilson has quit IRC | 08:28 | |
| *** dannywilson has joined #openstack-infra | 08:30 | |
| *** hdd has joined #openstack-infra | 08:30 | |
| *** emagana has quit IRC | 08:31 | |
| *** ZZelle has quit IRC | 08:31 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-gerrit: Move gerrit fetch remotes to jeepyb https://review.openstack.org/161663 | 08:37 |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-jeepyb: Ensure /var/lib/jeepyb exists https://review.openstack.org/180906 | 08:39 |
| *** dizquierdo has joined #openstack-infra | 08:42 | |
| *** ssam2 has joined #openstack-infra | 08:42 | |
| *** mfmcdonagh has quit IRC | 08:46 | |
| *** shardy has joined #openstack-infra | 08:48 | |
| *** fhubik_afk has joined #openstack-infra | 08:49 | |
| *** fhubik_afk is now known as fhubik_meeting | 08:49 | |
| *** fhubik has quit IRC | 08:49 | |
| *** hichihara has quit IRC | 08:53 | |
| *** markvoelker has joined #openstack-infra | 08:53 | |
| *** jcoufal_ has quit IRC | 08:55 | |
| *** jcoufal has joined #openstack-infra | 08:56 | |
| *** markvoelker has quit IRC | 08:58 | |
| *** ildikov has quit IRC | 09:00 | |
| *** _nadya_ has joined #openstack-infra | 09:00 | |
| *** Ala has quit IRC | 09:00 | |
| *** yamahata has quit IRC | 09:01 | |
| *** _nadya_ has quit IRC | 09:02 | |
| *** e0ne is now known as e0ne_ | 09:03 | |
| *** dannywilson has quit IRC | 09:05 | |
| *** claudiub_ has joined #openstack-infra | 09:12 | |
| viktors | SergeyLukjanov: hi! Can you please look at patch https://review.openstack.org/#/c/180599/ ? | 09:14 |
| *** claudiub has quit IRC | 09:14 | |
| *** ildikov has joined #openstack-infra | 09:16 | |
| *** hdd has quit IRC | 09:16 | |
| *** derekh has joined #openstack-infra | 09:16 | |
| *** yfried is now known as yfried|afk | 09:17 | |
| *** ashleighfarnham has joined #openstack-infra | 09:18 | |
| openstackgerrit | Jerome Hourquebie proposed stackforge/python-jenkins: Adds Cloudbees folder plugin support https://review.openstack.org/180185 | 09:19 |
| *** emagana has joined #openstack-infra | 09:20 | |
| *** ddieterly has joined #openstack-infra | 09:21 | |
| *** ashleighfarnham has quit IRC | 09:23 | |
| *** scheuran has quit IRC | 09:24 | |
| *** emagana has quit IRC | 09:25 | |
| *** ddieterly has quit IRC | 09:25 | |
| *** pelix has joined #openstack-infra | 09:26 | |
| *** freerunner has joined #openstack-infra | 09:29 | |
| *** ssam2 has quit IRC | 09:29 | |
| *** cdent has joined #openstack-infra | 09:30 | |
| *** ssam2 has joined #openstack-infra | 09:30 | |
| *** freerunner has quit IRC | 09:31 | |
| *** e0ne_ is now known as e0ne | 09:33 | |
| *** dims has joined #openstack-infra | 09:36 | |
| *** nijaba has quit IRC | 09:36 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Add heat-config-script to our Puppet CI jobs. https://review.openstack.org/174151 | 09:38 |
| *** fhubik_meeting is now known as fhubik | 09:38 | |
| *** fhubik has quit IRC | 09:38 | |
| *** fhubik has joined #openstack-infra | 09:39 | |
| *** sputnik13 has joined #openstack-infra | 09:39 | |
| *** dims has quit IRC | 09:41 | |
| *** yfried|afk is now known as yfried | 09:41 | |
| *** scheuran has joined #openstack-infra | 09:46 | |
| *** rlandy has joined #openstack-infra | 09:47 | |
| *** yfried is now known as yfried|afk | 09:51 | |
| *** Ala has joined #openstack-infra | 09:52 | |
| *** fhubik is now known as fhubik_afk | 09:53 | |
| *** markvoelker has joined #openstack-infra | 09:54 | |
| *** fhubik_afk is now known as fhubik | 09:54 | |
| *** markvoelker has quit IRC | 09:58 | |
| *** dims_ has joined #openstack-infra | 09:59 | |
| *** otter768 has joined #openstack-infra | 10:04 | |
| *** nijaba has joined #openstack-infra | 10:04 | |
| *** nijaba has joined #openstack-infra | 10:04 | |
| *** otter768 has quit IRC | 10:09 | |
| *** freerunner has joined #openstack-infra | 10:12 | |
| *** samuelBartel has quit IRC | 10:13 | |
| *** emagana has joined #openstack-infra | 10:14 | |
| *** yfried|afk is now known as yfried | 10:16 | |
| *** emagana has quit IRC | 10:18 | |
| *** ujuc has quit IRC | 10:19 | |
| *** freerunner has quit IRC | 10:19 | |
| *** sputnik13 has quit IRC | 10:20 | |
| *** ddieterly has joined #openstack-infra | 10:21 | |
| *** ildikov has quit IRC | 10:22 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/requirements: add influxdb https://review.openstack.org/180925 | 10:23 |
| *** ddieterly has quit IRC | 10:26 | |
| *** zhiwei has quit IRC | 10:30 | |
| *** adrian_otto has quit IRC | 10:31 | |
| *** fhubik is now known as fhubik_afk | 10:35 | |
| *** BharatK has quit IRC | 10:36 | |
| *** yfried_ has joined #openstack-infra | 10:38 | |
| *** ildikov has joined #openstack-infra | 10:38 | |
| *** yfried has quit IRC | 10:38 | |
| *** freerunner has joined #openstack-infra | 10:42 | |
| *** _nadya_ has joined #openstack-infra | 10:43 | |
| *** coolsvap is now known as coolsvap|afk | 10:43 | |
| *** baoli has joined #openstack-infra | 10:43 | |
| *** tnovacik has quit IRC | 10:44 | |
| *** ociuhandu has joined #openstack-infra | 10:47 | |
| *** baoli has quit IRC | 10:48 | |
| *** alexpilotti has joined #openstack-infra | 10:49 | |
| *** BharatK has joined #openstack-infra | 10:49 | |
| *** pc_m has joined #openstack-infra | 10:49 | |
| *** frobware_ has joined #openstack-infra | 10:50 | |
| openstackgerrit | Sergey Skripnick proposed openstack-infra/project-config: Add heat to rally job https://review.openstack.org/180937 | 10:50 |
| *** fhubik_afk is now known as fhubik | 10:54 | |
| *** markvoelker has joined #openstack-infra | 10:55 | |
| *** weshay has joined #openstack-infra | 10:57 | |
| *** Longgeek has quit IRC | 10:58 | |
| *** Longgeek has joined #openstack-infra | 10:58 | |
| *** markvoelker has quit IRC | 11:00 | |
| *** achanda has joined #openstack-infra | 11:02 | |
| *** doug-fish has joined #openstack-infra | 11:04 | |
| *** achanda has quit IRC | 11:07 | |
| *** BharatK has quit IRC | 11:08 | |
| *** emagana has joined #openstack-infra | 11:08 | |
| *** freerunner has quit IRC | 11:13 | |
| *** emagana has quit IRC | 11:13 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/puppet-zuul: Manage logging configuration files (feature flag) https://review.openstack.org/180614 | 11:14 |
| *** freerunner has joined #openstack-infra | 11:16 | |
| *** BharatK has joined #openstack-infra | 11:20 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/system-config: Let puppet-zuul manage log configuration files https://review.openstack.org/180624 | 11:21 |
| *** ddieterly has joined #openstack-infra | 11:22 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/system-config: Let puppet-zuul manage log configuration files https://review.openstack.org/180624 | 11:22 |
| *** ldnunes has joined #openstack-infra | 11:25 | |
| *** e0ne is now known as e0ne_ | 11:27 | |
| *** ddieterly has quit IRC | 11:27 | |
| openstackgerrit | Merged openstack-infra/project-config: Add openstack-nfv to gerritbot https://review.openstack.org/180744 | 11:28 |
| openstackgerrit | Merged openstack-infra/project-config: Move Ironic python3.4 job from experimental to gate https://review.openstack.org/180599 | 11:30 |
| *** _nadya_ has quit IRC | 11:30 | |
| *** links has quit IRC | 11:31 | |
| openstackgerrit | Merged openstack-infra/project-config: Skip test_volume_boot_pattern for GlusterFS until bug 1444806 is fixed https://review.openstack.org/173408 | 11:31 |
| openstack | bug 1444806 in Cinder "test_volume_boot_pattern tempest test failure for glusterfs backend - Part 2" [Undecided,In progress] https://launchpad.net/bugs/1444806 - Assigned to Bharat Kumar Kobagana (bharat-kobagana) | 11:31 |
| boris-42 | AJaeger: hi | 11:32 |
| boris-42 | AJaeger: could you help to get this faster https://review.openstack.org/#/c/180937/ | 11:32 |
| *** links has joined #openstack-infra | 11:32 | |
| boris-42 | AJaeger: because it is blocking work on Rally project fully | 11:32 |
| boris-42 | AJaeger: thank you | 11:33 |
| openstackgerrit | Merged openstack-infra/project-config: Change OpenStack Python SDK gate to experimental https://review.openstack.org/180670 | 11:33 |
| openstackgerrit | Merged openstack-infra/project-config: Need to allow merge commits in vmtp.git https://review.openstack.org/180616 | 11:33 |
| AJaeger | boris-42, done - +2 | 11:33 |
| *** ujuc has joined #openstack-infra | 11:37 | |
| *** marcusvrn has joined #openstack-infra | 11:41 | |
| boris-42 | AJaeger: thank you | 11:43 |
| *** marcusvrn2 has quit IRC | 11:43 | |
| *** Ala has quit IRC | 11:44 | |
| openstackgerrit | Daniel Izquierdo proposed openstack-infra/activity-board: Enable Liberty release analysis in the dashboard https://review.openstack.org/180955 | 11:44 |
| *** yfried__ has joined #openstack-infra | 11:44 | |
| *** woodster_ has joined #openstack-infra | 11:46 | |
| *** _nadya_ has joined #openstack-infra | 11:47 | |
| *** yfried_ has quit IRC | 11:48 | |
| *** fhubik is now known as fhubik_afk | 11:50 | |
| *** e0ne_ is now known as e0ne | 11:51 | |
| *** openstackgerrit has quit IRC | 11:52 | |
| *** openstackgerrit has joined #openstack-infra | 11:52 | |
| *** markvoelker has joined #openstack-infra | 11:56 | |
| *** mmedvede_ has joined #openstack-infra | 11:59 | |
| *** markvoelker has quit IRC | 12:00 | |
| *** freerunner has quit IRC | 12:01 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Puppet: move from Stackforge to OpenStack https://review.openstack.org/176326 | 12:02 |
| *** hogepodge has quit IRC | 12:02 | |
| *** emagana has joined #openstack-infra | 12:02 | |
| *** freerunner has joined #openstack-infra | 12:04 | |
| *** hogepodge has joined #openstack-infra | 12:05 | |
| *** otter768 has joined #openstack-infra | 12:05 | |
| *** emagana has quit IRC | 12:07 | |
| *** ianychoi has quit IRC | 12:09 | |
| BobBall | mordred: Why did you abandon the RAX configdrive support at https://review.openstack.org/#/c/154132 ? | 12:09 |
| *** dmellado has quit IRC | 12:09 | |
| *** otter768 has quit IRC | 12:10 | |
| *** doude_ has quit IRC | 12:10 | |
| *** dmellado has joined #openstack-infra | 12:11 | |
| *** doude has joined #openstack-infra | 12:11 | |
| cdent | I somehow managed to trigger a rebase on this review despite not having a rebase button in my interface: https://review.openstack.org/#/c/180389/ What's up with that? | 12:12 |
| *** Ala has joined #openstack-infra | 12:12 | |
| cdent | (that's a ceilomter review and I'm not ceilometer core) | 12:13 |
| *** waterkinfe has joined #openstack-infra | 12:13 | |
| *** ianychoi has joined #openstack-infra | 12:13 | |
| *** markvoelker has joined #openstack-infra | 12:15 | |
| cdent | nm | 12:15 |
| *** waterkinfe has quit IRC | 12:15 | |
| cdent | Clearly I need more coffees | 12:16 |
| *** dprince has joined #openstack-infra | 12:16 | |
| *** aysyd has joined #openstack-infra | 12:18 | |
| *** fhubik_afk is now known as fhubik | 12:18 | |
| *** _nadya_ has quit IRC | 12:19 | |
| *** Ala has quit IRC | 12:21 | |
| openstackgerrit | Merged openstack-infra/project-config: Make glanceclient-dsvm-functional gating https://review.openstack.org/179415 | 12:22 |
| *** ddieterly has joined #openstack-infra | 12:23 | |
| *** dkranz has joined #openstack-infra | 12:24 | |
| *** bhunter71 has joined #openstack-infra | 12:24 | |
| *** ddieterly has quit IRC | 12:27 | |
| *** rfolco has joined #openstack-infra | 12:29 | |
| openstackgerrit | Joseph Lanoux proposed openstack-infra/project-config: WIP - Enable SSL in devstack https://review.openstack.org/180968 | 12:30 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: run beaker on both trusty & centos7 https://review.openstack.org/175434 | 12:34 |
| *** btully has joined #openstack-infra | 12:35 | |
| *** soren has quit IRC | 12:36 | |
| openstackgerrit | Merged openstack-infra/project-config: Add heat to rally job https://review.openstack.org/180937 | 12:36 |
| AJaeger | Does anybody know why this job is not entering the gate queue? I already run a recheck but that does not help: https://review.openstack.org/#/c/177915/ The job seems to have no dependencies, I'm puzzled | 12:39 |
| *** freerunner has quit IRC | 12:40 | |
| *** Ala has joined #openstack-infra | 12:41 | |
| *** freerunner has joined #openstack-infra | 12:41 | |
| *** marcusvrn1 has joined #openstack-infra | 12:42 | |
| vponomaryov | AJaeger: "recheck" does not run gate jobs | 12:42 |
| vponomaryov | AJaeger: "reverify" does it, ASAIK | 12:43 |
| AJaeger | vponomaryov, reverify is dead. A recheck should run the check jobs and then enter the gate | 12:43 |
| *** marcusvrn has quit IRC | 12:45 | |
| *** ddieterly has joined #openstack-infra | 12:45 | |
| *** freerunner has quit IRC | 12:46 | |
| openstackgerrit | Merged openstack-infra/activity-board: Enable Liberty release analysis in the dashboard https://review.openstack.org/180955 | 12:48 |
| *** btully has quit IRC | 12:48 | |
| *** dims_ has quit IRC | 12:51 | |
| *** dims has joined #openstack-infra | 12:51 | |
| *** bswartz has quit IRC | 12:53 | |
| openstackgerrit | Maxime Leroy proposed openstack-infra/project-config: Add stackforge/networking-6wind project https://review.openstack.org/180979 | 12:53 |
| *** deepakcs has quit IRC | 12:54 | |
| *** emagana has joined #openstack-infra | 12:57 | |
| *** signed8bit_ZZZzz has quit IRC | 12:57 | |
| fungi | vponomaryov: it already has a positive check result on it. looks like it was probably approved at a point when the gerrit event stream was hung. you'll need to add a new approval vote or remove and re-add the existing one | 12:57 |
| fungi | as for recheck vs reverify, they're synonymous in our configuration | 12:57 |
| vponomaryov | fungi: good to know, thanks | 12:58 |
| fungi | search https://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml for reverify and you'll see it's in an or (|) condition with recheck everywhere | 12:58 |
| frickler | now that we seem to have reached a calm between the storms, can someone give https://review.openstack.org/178709 a push and enlighten the glance+rally folk with the musings of statusbot? | 13:00 |
| fungi | but anyway, the reason that change isn't entering the gate pipeline is that gerrit doesn't emit new vote data if you add a comment with the same vote you already had on a change, so when jenkins is trying to leave a new +1 after the recheck completes, gerrit doesn't reflect that in the event stream and so zuul doesn't know to start gating it | 13:00 |
| *** claudiub_ has quit IRC | 13:00 | |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Add a ceph job https://review.openstack.org/176292 | 13:00 |
| *** ildikov has quit IRC | 13:00 | |
| AJaeger | fungi, thanks for the explanation. | 13:00 |
| *** emagana has quit IRC | 13:01 | |
| *** mriedem has joined #openstack-infra | 13:02 | |
| *** ildikov has joined #openstack-infra | 13:02 | |
| openstackgerrit | Davide Guerri proposed openstack-infra/shade: Add floating IP pool resource methods https://review.openstack.org/180255 | 13:02 |
| openstackgerrit | Davide Guerri proposed openstack-infra/shade: Add Neutron/Nova Floating IP support https://review.openstack.org/177036 | 13:02 |
| *** vhoward has joined #openstack-infra | 13:04 | |
| *** sarob has joined #openstack-infra | 13:05 | |
| *** freerunner has joined #openstack-infra | 13:06 | |
| *** ddieterly has quit IRC | 13:07 | |
| *** amotoki has quit IRC | 13:08 | |
| *** tonytan4ever has quit IRC | 13:08 | |
| mordred | BobBall: we replaced that with work that went into dib | 13:09 |
| mordred | BobBall: there is now a standalone program called "glean" which does what the scripts in that element did | 13:09 |
| BobBall | Ah - perfect. I'll try and hunt that down. | 13:09 |
| mordred | BobBall: and we include it in the ubuntu-minimal, centos-minimal and fedora-minimal elements | 13:09 |
| BobBall | BTW - did you have any (sometimes major) issues with networking in RAX? | 13:10 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Enforce COMPUTESCALE to 1 for CI, except HA jobs https://review.openstack.org/173372 | 13:10 |
| AJaeger | fungi, mordred, pleia2, sdague: The translation imports ("compression") work fine on the projects now, could you review and approve https://review.openstack.org/#/c/176943/3 as final step, please? | 13:10 |
| mordred | BobBall: http://git.openstack.org/cgit/openstack/diskimage-builder/tree/elements/simple-init | 13:10 |
| mordred | BobBall: it now properly does static config drive networking as well as ssh keys | 13:11 |
| BobBall | I'll look at updating to that version | 13:11 |
| *** fhubik has quit IRC | 13:11 | |
| *** baoli_ has joined #openstack-infra | 13:11 | |
| *** baoli_ has quit IRC | 13:13 | |
| openstackgerrit | Merged openstack-infra/system-config: Add two missing channels to statusbot https://review.openstack.org/178709 | 13:14 |
| BobBall | OK so pip install glean and then just replace calls to read-vendor-json.py with it | 13:14 |
| *** tiswanso has joined #openstack-infra | 13:14 | |
| *** baoli has joined #openstack-infra | 13:14 | |
| *** fhubik has joined #openstack-infra | 13:14 | |
| BobBall | Have you see networking problems with RAX when using configdrive? | 13:14 |
| *** freerunner has quit IRC | 13:14 | |
| mordred | BobBall: yeah - you may want to look at http://git.openstack.org/cgit/openstack/diskimage-builder/tree/elements/simple-init/install.d/simple-init.sh and also the udev and systemd files here : http://git.openstack.org/cgit/openstack/diskimage-builder/tree/elements/simple-init/install.d | 13:15 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Add a ceph job https://review.openstack.org/176292 | 13:15 |
| fungi | AJaeger: you meant to use compress_po_files instead of compress_non_en_po_files for django_openstack_auth right? if so, +2 | 13:15 |
| mordred | BobBall: not yet - but with rax we're still using snapshot iamges in nodepool | 13:15 |
| *** freerunner has joined #openstack-infra | 13:15 | |
| fungi | mordred: i've discovered a new hitch with downloading rpms with yum to cache them on centos 6.x... | 13:15 |
| AJaeger | fungi, yes, django_openstack_auth has a normal pot file, only horizon is different | 13:16 |
| fungi | mordred: yum install --downloadonly is provided by a separate yum plugin there | 13:16 |
| BobBall | Ah right... I'm using nodepool but with config-drive and my prepare_node script uses your read-vendor-json script to parse config drive | 13:16 |
| AJaeger | fungi, thanks for asking! | 13:16 |
| fungi | mordred: so we're going to need to preinstall that plugin first. hunting now to figure out where is best to do that | 13:16 |
| BobBall | mordred: Not sure what I'm seeing, but I'm working with RAX support to track it down (90% of servers haven't been getting working networking over the last few days) | 13:16 |
| jroll | ohai BobBall :P | 13:17 |
| BobBall | jroll :) | 13:18 |
| *** david-lyle has quit IRC | 13:19 | |
| *** dboik has quit IRC | 13:24 | |
| *** freerunner has quit IRC | 13:24 | |
| *** peristeri has joined #openstack-infra | 13:24 | |
| *** freerunner has joined #openstack-infra | 13:24 | |
| *** openstackstatus has quit IRC | 13:25 | |
| *** openstackstatus has joined #openstack-infra | 13:26 | |
| *** ChanServ sets mode: +v openstackstatus | 13:26 | |
| *** gordc has joined #openstack-infra | 13:27 | |
| *** yfried__ has quit IRC | 13:28 | |
| *** amitgandhinz has joined #openstack-infra | 13:28 | |
| *** eharney has quit IRC | 13:28 | |
| *** sabeen1 has joined #openstack-infra | 13:28 | |
| *** dustins has joined #openstack-infra | 13:28 | |
| *** bswartz has joined #openstack-infra | 13:29 | |
| openstackgerrit | Davide Guerri proposed openstack-infra/shade: Add Neutron/Nova Floating IP support https://review.openstack.org/177036 | 13:32 |
| *** changbl has quit IRC | 13:33 | |
| *** gokrokve has joined #openstack-infra | 13:33 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Install yum-plugin-downloadonly on nodes https://review.openstack.org/180990 | 13:33 |
| *** smarcet has joined #openstack-infra | 13:34 | |
| *** e0ne is now known as e0ne_ | 13:34 | |
| *** jtriley has joined #openstack-infra | 13:35 | |
| *** mrunge has quit IRC | 13:36 | |
| *** freerunner has quit IRC | 13:36 | |
| *** ajmiller has joined #openstack-infra | 13:37 | |
| *** e0ne_ is now known as e0ne | 13:37 | |
| yolanda | hi jhesketh, thx for review. About the jeepyb change, it's motivated for this one: https://review.openstack.org/#/c/161663/ | 13:37 |
| *** yamahata has joined #openstack-infra | 13:37 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 13:38 | |
| *** smarcet has quit IRC | 13:38 | |
| *** smarcet has joined #openstack-infra | 13:38 | |
| *** BharatK has quit IRC | 13:38 | |
| *** smarcet has quit IRC | 13:39 | |
| *** chlong has joined #openstack-infra | 13:39 | |
| *** smarcet has joined #openstack-infra | 13:40 | |
| *** marcusvrn1 has quit IRC | 13:41 | |
| *** signed8bit has joined #openstack-infra | 13:42 | |
| *** ddieterly has joined #openstack-infra | 13:42 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-jeepyb: Ensure /var/lib/jeepyb exists https://review.openstack.org/180906 | 13:42 |
| *** marcusvrn has joined #openstack-infra | 13:44 | |
| *** dboik has joined #openstack-infra | 13:44 | |
| *** dboik has quit IRC | 13:44 | |
| *** smarcet has quit IRC | 13:45 | |
| *** dboik has joined #openstack-infra | 13:45 | |
| *** signed8b_ has joined #openstack-infra | 13:45 | |
| *** smarcet has joined #openstack-infra | 13:47 | |
| *** craigbr has joined #openstack-infra | 13:48 | |
| *** _nadya_ has joined #openstack-infra | 13:49 | |
| *** gokrokve has quit IRC | 13:49 | |
| *** signed8bit has quit IRC | 13:49 | |
| *** r-daneel has joined #openstack-infra | 13:49 | |
| *** freerunner has joined #openstack-infra | 13:50 | |
| *** esker has joined #openstack-infra | 13:50 | |
| *** jamielennox is now known as jamielennox|away | 13:51 | |
| *** samuelBartel has joined #openstack-infra | 13:52 | |
| *** freerunner has quit IRC | 13:52 | |
| *** gokrokve has joined #openstack-infra | 13:53 | |
| openstackgerrit | Louis Taylor proposed openstack-infra/project-config: Add extra padding to some entries in layout.yaml https://review.openstack.org/181000 | 13:53 |
| *** links has quit IRC | 13:54 | |
| *** gokrokve has quit IRC | 13:54 | |
| *** gokrokve has joined #openstack-infra | 13:55 | |
| *** freerunner has joined #openstack-infra | 13:55 | |
| *** pabelanger has joined #openstack-infra | 13:56 | |
| *** pabelanger has joined #openstack-infra | 13:56 | |
| kragniz | promote the health of one's eyes! ^ | 13:56 |
| *** zul has quit IRC | 13:57 | |
| pabelanger | morning | 13:58 |
| *** SpamapS has quit IRC | 13:58 | |
| *** fhubik has quit IRC | 13:59 | |
| *** wenlock has joined #openstack-infra | 14:00 | |
| *** jamespage_ has joined #openstack-infra | 14:01 | |
| *** zul has joined #openstack-infra | 14:02 | |
| *** sarob has quit IRC | 14:02 | |
| *** Krinkle|detached is now known as Krinkle | 14:02 | |
| openstackgerrit | Davide Guerri proposed openstack-infra/shade: Add Neutron/Nova Floating IP support https://review.openstack.org/177036 | 14:04 |
| marcusvrn | anteaya: hi | 14:04 |
| *** achanda has joined #openstack-infra | 14:06 | |
| *** otter768 has joined #openstack-infra | 14:06 | |
| *** eharney has joined #openstack-infra | 14:06 | |
| *** adrian_otto has joined #openstack-infra | 14:06 | |
| *** jamespage_ has quit IRC | 14:07 | |
| *** freerunner has quit IRC | 14:09 | |
| *** achanda has quit IRC | 14:11 | |
| *** otter768 has quit IRC | 14:11 | |
| *** devvesa has joined #openstack-infra | 14:11 | |
| *** signed8b_ has quit IRC | 14:12 | |
| *** btully has joined #openstack-infra | 14:12 | |
| *** rossella_s has quit IRC | 14:13 | |
| *** rossella_s has joined #openstack-infra | 14:13 | |
| *** jcoufal has quit IRC | 14:14 | |
| *** atan8 has joined #openstack-infra | 14:14 | |
| *** freerunner has joined #openstack-infra | 14:14 | |
| *** skolekonov has quit IRC | 14:15 | |
| *** abregman has quit IRC | 14:16 | |
| *** adrian_otto has quit IRC | 14:17 | |
| EmilienM | AJaeger: when you got time, can you provide feedback on https://review.openstack.org/#/c/175434/ please ? | 14:18 |
| *** erikmwil_ has joined #openstack-infra | 14:18 | |
| *** erikmwilson is now known as Guest39939 | 14:18 | |
| *** erikmwil_ is now known as erikmwilson | 14:18 | |
| *** erikmwilson_ has joined #openstack-infra | 14:18 | |
| *** erikmwilson has quit IRC | 14:19 | |
| *** erikmwilson has joined #openstack-infra | 14:19 | |
| *** jtriley has quit IRC | 14:19 | |
| *** baoli has quit IRC | 14:22 | |
| *** baoli_ has joined #openstack-infra | 14:23 | |
| *** signed8bit has joined #openstack-infra | 14:26 | |
| *** signed8bit has quit IRC | 14:27 | |
| *** jcoufal has joined #openstack-infra | 14:27 | |
| *** achanda has joined #openstack-infra | 14:29 | |
| *** achanda has quit IRC | 14:31 | |
| *** craigbr has quit IRC | 14:31 | |
| openstackgerrit | Joseph Lanoux proposed openstack-infra/project-config: WIP - Enable SSL in devstack https://review.openstack.org/180968 | 14:32 |
| *** freerunner has quit IRC | 14:39 | |
| *** mattfarina has joined #openstack-infra | 14:39 | |
| *** emagana has joined #openstack-infra | 14:41 | |
| *** packet has joined #openstack-infra | 14:43 | |
| *** jgalvin2015 has joined #openstack-infra | 14:43 | |
| *** _nadya_ has quit IRC | 14:44 | |
| jgalvin2015 | test | 14:44 |
| *** jgalvin2015 has left #openstack-infra | 14:44 | |
| *** BharatK has joined #openstack-infra | 14:44 | |
| *** adrian_otto has joined #openstack-infra | 14:45 | |
| *** tonytan4ever has joined #openstack-infra | 14:45 | |
| *** adrian_otto has quit IRC | 14:45 | |
| *** radez_g0n3 is now known as radez | 14:45 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/requirements: Add InfluxDB https://review.openstack.org/180925 | 14:46 |
| *** adrian_otto has joined #openstack-infra | 14:48 | |
| openstackgerrit | Ian Cordasco proposed openstack-infra/system-config: Add statusbot to openstack-ansible https://review.openstack.org/179387 | 14:48 |
| *** tonytan4ever has quit IRC | 14:49 | |
| *** david-lyle has joined #openstack-infra | 14:49 | |
| *** freerunner has joined #openstack-infra | 14:51 | |
| *** fhubik has joined #openstack-infra | 14:52 | |
| *** hemnafk is now known as hemna | 14:52 | |
| *** _nadya_ has joined #openstack-infra | 14:53 | |
| anteaya | marcusvrn: how can I help? | 14:53 |
| *** fhubik has quit IRC | 14:53 | |
| *** fhubik has joined #openstack-infra | 14:54 | |
| marcusvrn | anteaya: I have created a new CI account (using the new self service method) and one step is to ask to Third Party Coordinators to add the account to the Third Party CI mail filter list | 14:55 |
| *** adrian_otto has left #openstack-infra | 14:55 | |
| *** amitgandhinz has quit IRC | 14:55 | |
| *** ociuhandu_ has joined #openstack-infra | 14:56 | |
| *** achanda has joined #openstack-infra | 14:56 | |
| anteaya | with you so far | 14:56 |
| *** ociuhandu has quit IRC | 14:56 | |
| *** ociuhandu_ is now known as ociuhandu | 14:56 | |
| *** xyang1 has joined #openstack-infra | 14:58 | |
| *** erikmwilson has quit IRC | 14:59 | |
| *** erikmwilson_ is now known as erikmwilson | 14:59 | |
| anteaya | marcusvrn: what would you like from me? | 14:59 |
| *** yamahata has quit IRC | 14:59 | |
| marcusvrn | anteaya: I don't have to do anything? | 14:59 |
| *** baoli_ has quit IRC | 14:59 | |
| anteaya | I understand what you said | 14:59 |
| anteaya | but I don't know what you want next | 14:59 |
| *** yamahata has joined #openstack-infra | 14:59 | |
| anteaya | you have to ask to be added to the mail filter | 14:59 |
| anteaya | have you done that? | 14:59 |
| openstackgerrit | Merged openstack/requirements: Remove tempest from projects.txt on stable https://review.openstack.org/179888 | 14:59 |
| *** baoli has joined #openstack-infra | 15:00 | |
| marcusvrn | anteaya: that's the question, where or how can I ask to be added? | 15:00 |
| anteaya | in gerrit when you are signed in | 15:00 |
| anteaya | go to people > list groups | 15:00 |
| anteaya | search for third party | 15:01 |
| *** dboik_ has joined #openstack-infra | 15:01 | |
| anteaya | click third party co-ordinators | 15:01 |
| anteaya | ask any person in that list | 15:01 |
| *** amitgandhinz has joined #openstack-infra | 15:02 | |
| *** tiswanso has quit IRC | 15:02 | |
| *** jcoufal has quit IRC | 15:02 | |
| *** tiswanso has joined #openstack-infra | 15:03 | |
| *** achanda has quit IRC | 15:03 | |
| *** fhubik_afk has joined #openstack-infra | 15:03 | |
| *** arielb has joined #openstack-infra | 15:03 | |
| *** arielb has quit IRC | 15:03 | |
| *** arielb has joined #openstack-infra | 15:03 | |
| *** craigbr has joined #openstack-infra | 15:03 | |
| *** fhubik has quit IRC | 15:04 | |
| krtaylor | marcusvrn, I can help you with that, I need the account username and/or email address | 15:04 |
| *** dboik has quit IRC | 15:05 | |
| marcusvrn | anteaya: nice, thanks! | 15:05 |
| marcusvrn | krtaylor: the account username is hitachi-hbsd-ci | 15:05 |
| anteaya | marcusvrn: you're welcome | 15:06 |
| openstackgerrit | Merged openstack/requirements: Remove tempest from projects.txt on stable https://review.openstack.org/179889 | 15:07 |
| openstackgerrit | Merged openstack/requirements: Remove tempest from projects.txt on stable https://review.openstack.org/179887 | 15:07 |
| openstackgerrit | Merged openstack-infra/project-config: Look for yum instead of rpm in elements too https://review.openstack.org/180826 | 15:08 |
| *** salv-orlando has quit IRC | 15:08 | |
| krtaylor | marcusvrn, what is the email to be filtered? | 15:08 |
| *** freerunner has quit IRC | 15:08 | |
| *** sabeen1 has quit IRC | 15:08 | |
| marcusvrn | OpenStackCI@hds.com | 15:08 |
| *** annegentle has joined #openstack-infra | 15:09 | |
| krtaylor | marcusvrn, nm, I found it, your all set | 15:09 |
| *** tonytan4ever has joined #openstack-infra | 15:09 | |
| krtaylor | you're | 15:09 |
| *** mwagner_lap has quit IRC | 15:10 | |
| *** apmelton_away is now known as apmelton | 15:10 | |
| *** freerunner has joined #openstack-infra | 15:11 | |
| marcusvrn | taylor: thanks!! will something need to appear in "included groups"? | 15:11 |
| marcusvrn | krtaylor: ^ | 15:11 |
| marcusvrn | krtaylor: now I can see the new CI into Third-party group | 15:13 |
| krtaylor | marcusvrn, here is the group, its there -> https://review.openstack.org/#/admin/groups/270,members | 15:13 |
| marcusvrn | krtaylor: thank you :) | 15:14 |
| *** annegentle has quit IRC | 15:14 | |
| krtaylor | marcusvrn, no problem at all | 15:14 |
| *** annegentle has joined #openstack-infra | 15:14 | |
| *** teran has joined #openstack-infra | 15:14 | |
| *** ashleighfarnham has joined #openstack-infra | 15:15 | |
| *** amitgandhinz has quit IRC | 15:15 | |
| *** Swami has joined #openstack-infra | 15:17 | |
| *** samuelBartel has quit IRC | 15:18 | |
| openstackgerrit | Davide Guerri proposed openstack-infra/shade: Add Neutron/Nova Floating IP support https://review.openstack.org/177036 | 15:19 |
| *** JayJ_ has joined #openstack-infra | 15:21 | |
| *** harlowja_at_home has joined #openstack-infra | 15:22 | |
| *** dannywilson has joined #openstack-infra | 15:22 | |
| *** shashankhegde has joined #openstack-infra | 15:23 | |
| *** Ala has quit IRC | 15:26 | |
| *** radez is now known as radez_g0n3 | 15:26 | |
| clarkb | good morning | 15:27 |
| jlvillal | I would like to make the gate-ironic-python34 job so that it votes. https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L825-L826 Would I just delete the 'voting' line or delete the two lines? | 15:27 |
| jlvillal | clarkb: Good morning | 15:27 |
| clarkb | jlvillal: remove both lines, the first is not necessary if you remove the voting: false line | 15:27 |
| jlvillal | clarkb: Thanks! :) | 15:27 |
| openstackgerrit | John L. Villalovos proposed openstack-infra/project-config: Have gate-ironic-python34 be a voting job https://review.openstack.org/181034 | 15:29 |
| *** craigbr has quit IRC | 15:29 | |
| *** pblaho has quit IRC | 15:30 | |
| clarkb | jlvillal: actually, hrm. Will that pass against all branches? you may need to keep the first line then replace voting: false with a branch restriction if say only master passes | 15:30 |
| jlvillal | clarkb: Oh, okay. Let me look into it. | 15:30 |
| *** scheuran has quit IRC | 15:31 | |
| clarkb | what you have is fine if the existing branches work | 15:31 |
| sdake | any chance an infra core can register an irc channel properly for me | 15:31 |
| *** sputnik13 has joined #openstack-infra | 15:31 | |
| clarkb | sdake: you want a #openstack-* channel? I want to say jeblair is the person with those freenode powers | 15:32 |
| sdake | clarkb thanks i'll ask him | 15:32 |
| jeblair | sdake: what do you need? | 15:32 |
| sdake | jeblair need a channel #openstack-cloudpulse registered properly for openstack | 15:32 |
| sdake | m0ar stackforge projects | 15:32 |
| jeblair | sdake: oh you're an op there. just follow these instructions then: http://ci.openstack.org/irc.html#access | 15:33 |
| openstackgerrit | John L. Villalovos proposed openstack-infra/project-config: Have gate-ironic-python34 be a voting job for master https://review.openstack.org/181034 | 15:33 |
| jlvillal | clarkb: Done! I think :) ^^^^^^ | 15:33 |
| sdake | I haven't registered the channel | 15:34 |
| sdake | do I need to do tha tfirst? | 15:34 |
| clarkb | asselin: when you are around, can you fill me in on the state of the robots.txt thing if you have had a chance to debug yet? I want to make sure we get that sorted today (happy to help too but don't want to duplicate work) | 15:34 |
| jeblair | sdake: yes | 15:34 |
| *** liam_ has joined #openstack-infra | 15:34 | |
| sdake | jeblair cool thanks i'll figure that out | 15:34 |
| *** liam_ has quit IRC | 15:34 | |
| *** cody-somerville has joined #openstack-infra | 15:34 | |
| *** cody-somerville has quit IRC | 15:34 | |
| *** cody-somerville has joined #openstack-infra | 15:34 | |
| jeblair | sdake: should just be: /msg chanserv register #openstack-cloudpulse | 15:35 |
| jeblair | sdake: then the command in the doc i sent | 15:35 |
| *** marun has joined #openstack-infra | 15:35 | |
| *** harlowja_at_home has quit IRC | 15:35 | |
| *** sdake_ has joined #openstack-infra | 15:36 | |
| *** sdake_ has quit IRC | 15:36 | |
| *** sdake_ has joined #openstack-infra | 15:36 | |
| *** samueldmq has joined #openstack-infra | 15:36 | |
| clarkb | jlvillal: close, see comment | 15:36 |
| clarkb | jlvillal: its usually best to exclude the known unworking branches so that new branches (liberty and beyond) get tested | 15:36 |
| jlvillal | clarkb: Okay. So basically everything before yesterday does not work. | 15:36 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Document IRC channel registration commands https://review.openstack.org/181036 | 15:37 |
| clarkb | jlvillal: yup, so my example should exclude all that and will only llow master for now, but will allow liberty when that happens | 15:37 |
| jlvillal | clarkb: Excellent. Thanks for your help | 15:37 |
| *** sergsh has quit IRC | 15:37 | |
| *** rm_work is now known as rm_work|away | 15:40 | |
| *** nelsnelson has joined #openstack-infra | 15:40 | |
| *** wenlock_ has joined #openstack-infra | 15:41 | |
| *** sdake_ has quit IRC | 15:42 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/project-config: Have gate-ironic-python34 be a voting job https://review.openstack.org/181034 | 15:42 |
| clarkb | I am going to put jenkins05 and jenkins06 in shutdown mode now | 15:42 |
| *** freerunner has quit IRC | 15:43 | |
| *** sdake has quit IRC | 15:44 | |
| *** freerunner has joined #openstack-infra | 15:44 | |
| *** sdake has joined #openstack-infra | 15:44 | |
| jamespage | can someone point me at docs for what goes into the images used for functional testing of openstack components? | 15:45 |
| chmouel | hey there, i am trying to change my primary email addr in gerrit, i can't seem to figure out that. this is changed on my openstack.org/ setting page but doesn't show in gerrit | 15:45 |
| jamespage | I'd like to reproduce this in the automated package testing we have in ubuntu so we can execute more tests on packages before entry to the archive... | 15:45 |
| clarkb | jamespage: its semi fuzzy because its based on devstack, let me get you a link to the script that does it | 15:46 |
| jamespage | clarkb, ta | 15:46 |
| clarkb | chmouel: you have to change it in gerrit under your settings | 15:46 |
| chmouel | clarkb: it doesn't not seem editable there http://ep.chmouel.com:8080/Screenshots/2015-05-07__17-47-15.png | 15:47 |
| EmilienM | AJaeger: re - https://review.openstack.org/#/c/175434/ - I don't want to double the number of tests, but be able to validate it works on Centos *and* Ubuntu | 15:47 |
| chmouel | clarkb: oops sorry | 15:47 |
| chmouel | i just foudn it | 15:47 |
| EmilienM | AJaeger: because our puppet modules have specific OS things | 15:47 |
| clarkb | jamespage: https://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/scripts/cache_devstack.py is what we use for rax images while we transition to using dib for those images which is what we use in hpcloud https://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/cache-devstack/extra-data.d/55-cache-devstack-repos | 15:48 |
| jeblair | clarkb: jenkins shutdown for gearman plugin upgrade? | 15:48 |
| clarkb | jamespage: but basic idea is it uses apt/yum to cache but not install the debs/rpms declared as required by devstack. Then when devstack runs devstack can install them without needing to get them from the internet in most cases | 15:48 |
| clarkb | jeblair: yup | 15:48 |
| yolanda | fungi, clarkb, i got reported a problem with this upstream change: https://review.openstack.org/#/c/180158/ | 15:48 |
| clarkb | jeblair: 07 is still happy from what I can tell | 15:49 |
| jamespage | clarkb, ah right - thanks | 15:49 |
| *** markus_z has quit IRC | 15:49 | |
| jamespage | clarkb, I think that give me what I need - much appreciated! | 15:49 |
| jeblair | yolanda: what kind of problem? | 15:49 |
| yolanda | Tom is rechecking, but change is just passing check, not gate | 15:50 |
| yolanda | and it's marked as +A | 15:50 |
| *** mtanino has joined #openstack-infra | 15:50 | |
| jeblair | yolanda: someone needs to approve it again | 15:51 |
| clarkb | jamespage: no problem, happy to help if you have other questions about our image builds. Also, you can run DIB locally with a bit of time, disk space, and bandwidth by running https://git.openstack.org/cgit/openstack-infra/project-config/tree/tools/build-image.sh should give you a qcow2 that is basically identical to what we use, including our ssh public keys >_> | 15:51 |
| *** mattfarina has quit IRC | 15:51 | |
| yolanda | ok | 15:51 |
| yolanda | jamespage, cheers :) | 15:51 |
| jeblair | yolanda: if a change already has a +1 from jenkins, an additional recheck won't emit the +1 event from gerrit again, so it doesn't automatically move into gate. an approval vote will do that though. | 15:52 |
| *** mtanino_ has joined #openstack-infra | 15:52 | |
| waynr | pelix clarkb zaro yolanda jeblair: is anyone aware of planning for JJB 2.x? I have some recommendations I'd like to make regarding backwards incompatible API changes but i'm not sure where that discussion should take place--openstack-infra specs, story board, openstack-infra mailing list? | 15:52 |
| yolanda | jeblair, thanks, new thing learnt | 15:52 |
| clarkb | I am wondering if we should just patch the fix for that into gerrit (not for this upgrade though) | 15:52 |
| clarkb | zaro: ^ do you expect your fix to merge? | 15:53 |
| jeblair | clarkb: how's the upstream change going? | 15:53 |
| clarkb | jeblair: let me dig it up | 15:53 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Generate machine-readable tree of change approvers https://review.openstack.org/80437 | 15:53 |
| clarkb | waynr: I have not heard of any JJB 2.0 planning | 15:53 |
| waynr | i haven't either, if there is no current discussion i'd like to initiate it | 15:54 |
| jeblair | waynr: probably a spec with discussion on openstack-infra list | 15:54 |
| clarkb | https://gerrit-review.googlesource.com/#/c/65530/ doesn't look like it has gotten any new reviews | 15:54 |
| clarkb | jeblair: ^ | 15:54 |
| *** btully has quit IRC | 15:54 | |
| jeblair | clarkb, zaro: i guess we need to "bump" it with a new patchset ;) | 15:55 |
| waynr | jeblair: okay thanks, i'll add that to my list of things to do in the next couple weeks | 15:55 |
| *** mtanino has quit IRC | 15:55 | |
| *** abregman has joined #openstack-infra | 15:57 | |
| openstackgerrit | Cyril Roelandt proposed openstack-infra/project-config: Enable a non-voting py34 check for Neutron https://review.openstack.org/181046 | 15:57 |
| *** marcusvrn has quit IRC | 15:57 | |
| fungi | clarkb: speaking of caching things and dib, https://review.openstack.org/180990 | 15:57 |
| *** craigbr has joined #openstack-infra | 15:57 | |
| fungi | every day i'm learning new things i never wanted to know about that nearly-dead platform | 15:58 |
| *** ajmiller has quit IRC | 15:58 | |
| yolanda | waynr, i don't know about it | 15:58 |
| clarkb | fungi: does the dib caching script need sudo powers? it should be running in the context of the chroot at that point so I think the answer is no | 15:59 |
| *** mtanino_ has quit IRC | 15:59 | |
| fungi | clarkb: great point. fixing now | 15:59 |
| clarkb | fungi: sorry it doesn't use sudo now, I am just trying to determine if it should | 16:00 |
| jeblair | fungi: the following lines use yum without sudo | 16:00 |
| *** marcusvrn has joined #openstack-infra | 16:00 | |
| clarkb | greghaynes: ^ describing that in your user docs might be good | 16:00 |
| jeblair | so i too think the answer is no and it is correct | 16:00 |
| *** mwagner_lap has joined #openstack-infra | 16:00 | |
| fungi | clarkb: oh, oops. i thought you meant i had added sudo unnecessarily | 16:00 |
| clarkb | jeblair: agreed. fungi +2 | 16:00 |
| fungi | looks like i didn't though | 16:00 |
| greghaynes | clarkb: hrm, looks like our user docs dont mention that at all :( | 16:01 |
| pleia2 | clarkb: jenkins07 still looking ok? | 16:01 |
| fungi | pleia2: yep, clean as a whistle | 16:01 |
| clarkb | pleia2: yup, I went ahead and put 05 and 06 in shutdown mode | 16:01 |
| fungi | squeaky even | 16:01 |
| *** erikmwil_ has joined #openstack-infra | 16:01 | |
| *** devvesa has quit IRC | 16:01 | |
| *** jlanoux has quit IRC | 16:02 | |
| pleia2 | clarkb: great | 16:02 |
| *** erikmwil_ has quit IRC | 16:02 | |
| clarkb | fungi: and approved now, noticed that jeblair previously +2'd before I applied my _2 | 16:02 |
| *** erikmwil_ has joined #openstack-infra | 16:03 | |
| *** erikmwil_ is now known as erikmwilson_ | 16:03 | |
| *** dboik_ has quit IRC | 16:04 | |
| *** erikmwilson has quit IRC | 16:04 | |
| *** erikmwilson_ is now known as erikmwilson | 16:04 | |
| *** dboik has joined #openstack-infra | 16:04 | |
| *** erikmwilson_ has joined #openstack-infra | 16:05 | |
| fungi | i'm going ahead and tagging bindep 0.0.1 now just to get something up on pypi so i can move forward on integrating it. when we get closer to being ready for projects to actually start making use of it individually i'll bump that to 1.0.0 (it's got all the features I think we're going to need for the near future anyway) | 16:05 |
| *** otter768 has joined #openstack-infra | 16:07 | |
| *** mpavone has quit IRC | 16:07 | |
| clarkb | fungi: for 179612, ubuntu-trusty is the appropriate name and not ubuntu-14.04 ? I am betting you know off the top of your head without my digging up meeting notes | 16:07 |
| clarkb | fungi: also any reason to not approve that given what you have learned from the centos-6 process? | 16:07 |
| zaro | morning | 16:08 |
| anteaya | morning zaro | 16:08 |
| greghaynes | clarkb: yes, its trusty | 16:08 |
| *** e0ne is now known as e0ne_ | 16:08 | |
| fungi | clarkb: yeah, we had settled on distro-codename for debian derivatives and distro-majorversion for red hat derivatives | 16:09 |
| clarkb | cool | 16:09 |
| fungi | clarkb: dib emites both | 16:09 |
| fungi | er, bindep | 16:09 |
| *** sarob has joined #openstack-infra | 16:09 | |
| fungi | emits | 16:09 |
| fungi | moar coffee | 16:09 |
| *** salv-orlando has joined #openstack-infra | 16:09 | |
| *** vhoward has left #openstack-infra | 16:09 | |
| *** vhoward has joined #openstack-infra | 16:10 | |
| fungi | mainly because the lsb-determined codenames for centos/rhel are useless and for fedora they're downright silly | 16:10 |
| fungi | and their communities mostly know them by major release version number instead | 16:11 |
| openstackgerrit | Merged openstack-infra/project-config: Install yum-plugin-downloadonly on nodes https://review.openstack.org/180990 | 16:11 |
| fungi | whereas debian/ubuntu communities stick to abbreviated codenames and tend to go by those in conversation | 16:11 |
| *** otter768 has quit IRC | 16:11 | |
| Clint | and not remember what the version numbers are | 16:11 |
| jeblair | clarkb, fungi: do you think it's okay for us to switch to the behavior in 117626, where git will hardlink objects if able? | 16:11 |
| *** salv-orlando has quit IRC | 16:12 | |
| fungi | jeblair: i think it's going to be an issue if we switch grenade to use zuul-cloner? | 16:12 |
| clarkb | ok I am approving mordreds add ubuntu-trusty image change now | 16:12 |
| fungi | jeblair: or similar situations where we might want to operate on multiple clones of one repo from the cache? | 16:13 |
| zaro | clarkb: i've pinged pursehouse about that change a few weeks ago and he said he would take a a look but i think he was busy with 2.11 release. might try to ping him again. | 16:13 |
| greghaynes | clarkb: \O/ | 16:13 |
| fungi | jeblair: though i guess this adds a switch and only changes the default behavior, so may be fine... | 16:13 |
| clarkb | fungi: I think it only hardlinks the .git contents but not the working dir | 16:13 |
| *** rm_work|away is now known as rm_work | 16:13 | |
| pelix | waynr: in the mean time before we have JJB 2.0, do you have any thoughts on param precedence and the possibility of nested job-groups (and of course how precedence should occur there)? | 16:13 |
| clarkb | fungi: but we should confirm that for grenade | 16:13 |
| jeblair | fungi: afaik it's just linking the object pack files, and the different repos cloned from there shouldn't see any difference, unless something goes in and makes the pack files go all weird | 16:14 |
| zaro | clarkb: it doesn't seem like something that would be controversial, so yeah i think it will get thru given time. | 16:14 |
| *** viktors is now known as viktors|afk | 16:14 | |
| fungi | clarkb: jeblair: oh! will this cause a problem if we clone as a different user than owns the cache and then try to remote update? | 16:14 |
| fbo | I'm trying to find the last tag of gear on pypi but it is still the old 0.5.5 version. It seems that the export job on pypi is setup for gear ( https://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n3729 ) - any idea why 0.5.6 sdist still not on pypi ? | 16:14 |
| fungi | i'll test that | 16:14 |
| clarkb | fungi: hardlinks can have different perms right? the file entry is separate its just a duplicate inode and counter? | 16:14 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add context "libvirt" back into query for bug 1451506 https://review.openstack.org/180793 | 16:15 |
| openstack | bug 1451506 in OpenStack Compute (nova) "spawn failed with "libvirtError: internal error: received hangup / error event on socket" in the gate" [Undecided,Confirmed] https://launchpad.net/bugs/1451506 | 16:15 |
| jeblair | fbo: i'll try to find the output from that job | 16:15 |
| fungi | yeah, i think the issue is if you try to modify the hardlinked file without unlinking? | 16:15 |
| clarkb | zaro: awesome, thanks | 16:15 |
| pelix | waynr zaro: see https://review.openstack.org/#/c/179459/ -> looking for thoughts on precedence of params as I'm finding a local change that implements nested job-groups very convenient with a change to how the order params override | 16:15 |
| clarkb | zaro: and yes, I agree it shouldn't be controversial for the reason I list on my comment :) | 16:15 |
| fungi | oh, also we're cloning from /opt to /home in our workers, so won't end up hardlinking anyway | 16:16 |
| zaro | clarkb: i'm trying to figure out how to support both Gerrit 2.8 & 2.10 here https://review.openstack.org/#/c/172534 so still haven't looked at your gearman-plugin chnage yet | 16:16 |
| clarkb | fungi: we should be cloning from /opt/git to /opt/stack/new | 16:16 |
| fbo | jeblair, Ok thanks. I tried on logstash but not sure I put the right query as I found nothing :p | 16:16 |
| fungi | oh, er maybe we do... /opt is on / along with /home on at least some workers | 16:16 |
| jeblair | fungi: i think we may move things around in devstack jobs, but not otherwise | 16:17 |
| *** unicell has quit IRC | 16:17 | |
| *** e0ne_ is now known as e0ne | 16:17 | |
| clarkb | zaro: will look | 16:17 |
| *** Guest89533 has quit IRC | 16:17 | |
| *** SpamapS has joined #openstack-infra | 16:18 | |
| fungi | looks like hardlinked clones allow differently-privileged users to update them fine, add new commits, et cetera | 16:18 |
| *** SpamapS has quit IRC | 16:18 | |
| *** SpamapS has joined #openstack-infra | 16:18 | |
| clarkb | so I think hardlinking should be fine | 16:19 |
| *** derekh has quit IRC | 16:19 | |
| fungi | hrm, when i cloned it didn't hardlink | 16:20 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Upgrade to hacking 0.10.x https://review.openstack.org/179299 | 16:20 |
| fungi | that's odd | 16:20 |
| zaro | pelix: is the "correct" order just your opinion? or does it solve some use case for you? the current order doesn't seem to happer us. | 16:20 |
| jeblair | fbo: https://jenkins02.openstack.org/job/gear-tarball/3/ | 16:20 |
| jeblair | fbo: looks like the upload job wasn't registered at the time | 16:21 |
| zaro | happer/hamper | 16:21 |
| openstackgerrit | greghaynes proposed openstack-infra/project-config: Add DIB tests to dib-utils https://review.openstack.org/180861 | 16:21 |
| asselin | clarkb, I took a look at robots.txt yesterday and didn't see anything wrong. I will run the script again on a fresh vm to try to reproduce. | 16:21 |
| fungi | yeah, ls -i says the inodes of files in /opt/git/openstack/nova/.git/objects/pack/ are not the same as in .git/objects/pack/ even immediately after cloning | 16:22 |
| *** gokrokve_ has joined #openstack-infra | 16:22 | |
| clarkb | fungi: did it hardlink anything? | 16:22 |
| fbo | jeblair, ok alright, and should it be possible to manually retrigger that job to push it on pypi ? | 16:23 |
| jeblair | fbo: yeah, i'm working on that now | 16:23 |
| fungi | hard to identify without comparing inode numbers or using stat and looking for additional link count | 16:23 |
| *** changbl has joined #openstack-infra | 16:23 | |
| fungi | so far the files i'm looking at in .git are different inode numbers than in the source path | 16:23 |
| *** gokrokve_ has quit IRC | 16:23 | |
| *** dizquierdo has quit IRC | 16:23 | |
| waynr | hmm pelix...i thought that project parameters overrode job-template parameters | 16:23 |
| fbo | jeblair, nice thanks you. | 16:24 |
| *** gokrokve_ has joined #openstack-infra | 16:24 | |
| clarkb | greghaynes: see coment on patchset 2 of https://review.openstack.org/#/c/180861/ which is why I -1'd ps3 | 16:24 |
| clarkb | greghaynes: figured I would call that out since its a little tricky | 16:24 |
| waynr | so the overall parameter predence low to high would be defaults -> job-template -> project -> job-group | 16:24 |
| *** mtanino has joined #openstack-infra | 16:25 | |
| jeblair | fbo: https://jenkins.openstack.org/job/gear-pypi-both-upload/1/console | 16:25 |
| greghaynes | clarkb: ah | 16:25 |
| *** gokrokve has quit IRC | 16:25 | |
| waynr | i guess your test fixture probably proves what you describe in the commit message | 16:25 |
| fbo | jeblair, Wonderful thank you ! | 16:26 |
| zaro | clarkb, fungi : so i think trying to get output from 'gerrit.war --version' is not doable in puppet so i think i'll try to get it from the url passed in from review.pp | 16:27 |
| fungi | zaro: yeah, i thought that was going to be a little too complex for the benefit | 16:27 |
| zaro | clarkb, fungi : is there an easy way to test a puppet script? just really want to test the split and versioncmp functions. | 16:28 |
| waynr | pelix: either way, i think this is probably a change that should wait for JJB 2.0...we may not have been properly testing parameter precedence before but this would fundamentally change the behavior of my own projects since i have been using job-group/project/job-template according to the way the yamlparser is currently written | 16:28 |
| asselin | clarkb, this is the issue: https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/static.pp#n113 | 16:28 |
| clarkb | zaro: ya you can make a test.pp and `puppet apply --test test.pp` then just put the bare minimum of what you want to test inside test.pp | 16:28 |
| clarkb | asselin: looking | 16:28 |
| asselin | clarkb, and disallow_robots.txt was deleted | 16:28 |
| fungi | jeblair: clarkb: looks like (based on testing so far) git clone will only use hardlinks when the original repo is owned by the invoking account/group | 16:28 |
| zaro | clarkb: cool, thanks. | 16:29 |
| clarkb | asselin: so we can add it back? | 16:29 |
| asselin | clarkb, yes | 16:29 |
| greghaynes | clarkb: is /opt/git the correct zuul-cloner cachedir for a job? | 16:29 |
| clarkb | greghaynes: yes | 16:29 |
| zaro | fungi, clarkb : i guess i should make sure those functions are available, which version of puppet are we using again? | 16:30 |
| clarkb | zaro: 3.7.x | 16:30 |
| openstackgerrit | Merged openstack-infra/system-config: Start building ubuntu-trusty nodes https://review.openstack.org/179612 | 16:30 |
| clarkb | zaro: with puppet stdlib 4.0.0 | 16:30 |
| waynr | pelix: i am also of the opinion that the precedence order really should be (lowest to highest) defaults -> job-template -> job-group -> project, in order to allow project parameters to override others | 16:30 |
| zaro | clarkb: ok looks like those functions are in the 3.x documentation | 16:31 |
| clarkb | zaro: should be fine then | 16:31 |
| openstackgerrit | greghaynes proposed openstack-infra/project-config: Add DIB tests to dib-utils https://review.openstack.org/180861 | 16:31 |
| *** alexsyip has joined #openstack-infra | 16:31 | |
| *** xyang1 has quit IRC | 16:32 | |
| *** rm_work is now known as rm_work|away | 16:32 | |
| clarkb | jeblair: ^ more zuul-cloner use | 16:33 |
| waynr | pelix: i also think nested job groups is a good idea but to be honest i spent about 12 hours hacking on JJB Tuesday and came up with a way to generate XML by writing python classes rather than YAML--my suggested API changes for JJB 2.0 will mostly be directed at making this possible so I can move away from using YAML, eventually I won't have to care about yamlparser behavior at all | 16:33 |
| openstackgerrit | Fabien Boucher proposed openstack-infra/puppet-zuul: Manage logging configuration files (feature flag) https://review.openstack.org/180614 | 16:33 |
| jeblair | clarkb: woot | 16:34 |
| jeblair | clarkb, fungi: i'll go ahead and aprv the cloner change then | 16:34 |
| clarkb | jeblair: sounds good. Good to know git is being smart for us | 16:34 |
| jeblair | clarkb: yeah. we might want to see if we can start taking advantage of that at some point; should speed things up a lot | 16:35 |
| *** emagana has quit IRC | 16:35 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/system-config: Let puppet-zuul manage log configuration files https://review.openstack.org/180624 | 16:36 |
| waynr | pelix: my current proof-of-concept python classes simply inherit from python's 'dict' so that the class can be passed directly to the XmlBuilder class in this patch: https://review.openstack.org/#/c/180315/ | 16:36 |
| clarkb | pleia2: jenkins05 is idle now, waiting on one more job on jenkins06 | 16:36 |
| clarkb | pleia2: looks like 06 just finished | 16:36 |
| pleia2 | clarkb: yep, have been keeping an eye on them \o/ | 16:36 |
| clarkb | pleia2: were you planning to upgrade the plugin on both? | 16:36 |
| pleia2 | clarkb: yep, I'll start with 05 | 16:37 |
| clarkb | pleia2: great, thank you | 16:37 |
| *** tiswanso has quit IRC | 16:37 | |
| fungi | jeblair: i think lifeless is hoping to do something similar in the pbr integration test, to keep from burning i/o cloning from the cache. he was looking at just operating on the cache itself, but hardlinking the clones may be nearly as fast | 16:37 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/system-config: Add back disallow_robots.txt https://review.openstack.org/181068 | 16:38 |
| asselin | clarkb, ^^ | 16:38 |
| waynr | pelix: by avoiding the yamlparser i also hope to make good use of ordered dicts when actually generating plugin-specific XML which would make this patch https://review.openstack.org/175049 unnecessary | 16:38 |
| clarkb | asselin: +2 | 16:38 |
| *** atan8 has quit IRC | 16:38 | |
| clarkb | asselin: and http://puppetboard.openstack.org/report/pypi.dfw.openstack.org/988d769825e9dee62ac14d2ffc774d0e82d94485 must be the same file | 16:39 |
| waynr | pelix: i'll include more details about this work when i get around to starting the backwards incompatible API changes discussion (and will be sure to include a bullet point for yamlparser parameter override order) | 16:39 |
| asselin | clarkb, sorry I think it's the wrong folder.... | 16:39 |
| *** annegentle has quit IRC | 16:39 | |
| clarkb | asselin: the dest path is different but I think the source is the same | 16:39 |
| clarkb | asselin: working to confirm now | 16:39 |
| openstackgerrit | Merged openstack-infra/system-config: Move server outside git_backend class https://review.openstack.org/179058 | 16:40 |
| clarkb | asselin: ya source => 'puppet:///modules/openstack_project/disallow_robots.txt', | 16:40 |
| asselin | clarkb, no...actually it's correct...... | 16:41 |
| clarkb | asselin: ya I think your change is good | 16:41 |
| openstackgerrit | Davide Guerri proposed openstack-infra/shade: Add Neutron/Nova Floating IP support https://review.openstack.org/177036 | 16:42 |
| clarkb | asselin: the files/ portion of the paht is dropped by puppet when referring to files in modules | 16:42 |
| *** whoops has joined #openstack-infra | 16:42 | |
| *** emagana has joined #openstack-infra | 16:42 | |
| frickler | how long will it take for jenkins to pick up the change from https://review.openstack.org/#/c/180937/ ? Still seeing rally tests fail currently | 16:42 |
| asselin | clarkb, yea.... | 16:42 |
| jeblair | frickler: 10-50 minutes | 16:43 |
| openstackgerrit | Ilya Shakhat proposed openstack-infra/project-config: Enable upload to pypi for Shaker project https://review.openstack.org/168047 | 16:43 |
| *** tiswanso has joined #openstack-infra | 16:43 | |
| frickler | so if it was merged 4 hours ago, something else will be wrong, I assume | 16:44 |
| jeblair | frickler: probably so; point me to a failed job? | 16:44 |
| pleia2 | jenkins05 back up, gearman plugin v0.1.1.6.0314ab1 | 16:45 |
| frickler | http://logs.openstack.org/28/179428/7/check/gate-rally-dsvm-rally/3a24ab4/console.html | 16:45 |
| clarkb | a random spot check says that heat is in the enabled services list on jenkins07 | 16:45 |
| clarkb | frickler: http://logs.openstack.org/28/179428/7/check/gate-rally-dsvm-rally/3a24ab4/console.html#_2015-05-07_15_33_35_920 its in your failed job too looks like | 16:46 |
| *** patrickeast has joined #openstack-infra | 16:46 | |
| *** unicell has joined #openstack-infra | 16:47 | |
| clarkb | pleia2: yup lgtm | 16:47 |
| clarkb | its running jobs too | 16:47 |
| pleia2 | yep \o/ | 16:47 |
| pleia2 | I'll start on 06 now | 16:47 |
| frickler | clarkb: right, still later rally thinks heat is not available (http://logs.openstack.org/28/179428/7/check/gate-rally-dsvm-rally/3a24ab4/console.html#_2015-05-07_15_54_32_553), guess I'll go back over to rally with that, thx | 16:48 |
| clarkb | frickler: sure, just pointing out the change you linked to appears to have been applied, so we need to look beyond that | 16:50 |
| clarkb | jesusaurus: yolanda: have a minute for a question on 179113? wondering if it makes sense to use the puppet built in authorized key manager thing | 16:52 |
| clarkb | rather than the template | 16:52 |
| *** sdake_ has joined #openstack-infra | 16:52 | |
| pleia2 | and now gearman 0.1.1.6.0314ab1 is up and running on jenkins06 | 16:53 |
| clarkb | pleia2: 06 is looking good too | 16:53 |
| *** ildikov has quit IRC | 16:53 | |
| clarkb | jesusaurus: yolanda: my initial reaction is no, due to the dance we have to do to get puppet to update those resources | 16:54 |
| *** claudiub has joined #openstack-infra | 16:54 | |
| clarkb | pleia2: want to put 03 and 04 in shutdown mode now? | 16:55 |
| clarkb | pleia2: we can basically roll through them and if you end up running out of time I can take over | 16:55 |
| clarkb | pleia2: just let me know when I should jump in so you can do other things | 16:55 |
| *** sdake has quit IRC | 16:56 | |
| pleia2 | clarkb: yep, sounds good | 16:56 |
| * pleia2 logs into 03 & 04 | 16:56 | |
| clarkb | mordred: fungi greghaynes ubuntu-trusty is building on nodepool.o.o now | 16:56 |
| greghaynes | \O/ | 16:57 |
| *** tjones2 has left #openstack-infra | 16:57 | |
| clarkb | oh except not really because its queued up behind other builds, but it will be building soonish | 16:57 |
| clarkb | jeblair: looks like the zuul approvals are gonna get kicked out after a python2.6 test fail | 16:58 |
| clarkb | hrm 27 failed as well | 16:58 |
| greghaynes | clarkb: on https://review.openstack.org/#/c/168603/11 you mentioned testing with a shaderc, do you mean .config/openstack? | 16:58 |
| pleia2 | clarkb: so just Manage Jenkins > Prepare for Shutdown ? | 16:58 |
| clarkb | pleia2: yup | 16:59 |
| pleia2 | ok, doing so for 03 & 04 now | 16:59 |
| clarkb | greghaynes: that sounds right. | 16:59 |
| *** craigbr has quit IRC | 17:00 | |
| *** emagana has quit IRC | 17:00 | |
| fungi | per the ml, rally jobs assumed heat installed in devstack by default, which stopped being the case earlier this week | 17:01 |
| *** emagana has joined #openstack-infra | 17:01 | |
| clarkb | fungi: correct, but enabling heat has not fixed the problems | 17:01 |
| jeblair | clarkb: perhaps the geard release broke something | 17:01 |
| fungi | frickler: ^ | 17:01 |
| clarkb | jeblair: oh! possible | 17:02 |
| jeblair | clarkb: i'll go futz with that | 17:02 |
| *** freerunner has quit IRC | 17:03 | |
| *** crc32 has joined #openstack-infra | 17:05 | |
| jeblair | we should maybe think about doing integration tests between those :) | 17:05 |
| clarkb | ++ | 17:05 |
| pelix | zaro: it makes it easier to use job-groups with minor variations instead of needing to defined 6 or 7 different sets which removes the usefulness of having a single name reference a set of jobs | 17:05 |
| mordred | clarkb: woot! | 17:06 |
| *** crc32 has quit IRC | 17:06 | |
| pelix | waynr: currently job-group parameters override project ones. I believe the current behaviour is undefined as no one was making use of being able to set params in a project on the job-group entry | 17:07 |
| *** wenlock has quit IRC | 17:09 | |
| *** BharatK has quit IRC | 17:11 | |
| *** e0ne has quit IRC | 17:11 | |
| pelix | waynr: like to see more about that use of dicts directly to XML as it's likely the small inconsistencies that will make/break it ;) | 17:12 |
| clarkb | mordred: do you have any opinions on using the authorized keys resource in puppet for 179113? I know we are using it in places but it hasn't always been the simplest thing bceause you have to make a newly named resource to get it to update iirc | 17:12 |
| *** shashankhegde has quit IRC | 17:12 | |
| mordred | clarkb: me looks | 17:12 |
| *** wenlock has joined #openstack-infra | 17:13 | |
| openstackgerrit | Mike Perez proposed openstack/requirements: Update python-cinderclient to 1.2.1 https://review.openstack.org/181083 | 17:13 |
| *** sdake has joined #openstack-infra | 17:13 | |
| mordred | clarkb: yeah - I mean, the thing in that module will work more expectedly | 17:14 |
| pelix | waynr: also would have said that for https://review.openstack.org/#/c/175049/ should be reading the order from yaml keys instead of providing a separate ordering variable. | 17:14 |
| mordred | clarkb: but it makes me question our use of authorized_key resource elsewhere | 17:14 |
| clarkb | mordred: ya | 17:14 |
| *** yamahata has quit IRC | 17:14 | |
| *** tonytan4ever has quit IRC | 17:14 | |
| clarkb | fedora21 is doing its qemu img convert now, then we get centos-6 build, then ubuntu-trusty if I am reading things correctly | 17:15 |
| clarkb | so should know if ubuntu-trusty works in about an hour | 17:15 |
| *** tonytan4ever has joined #openstack-infra | 17:16 | |
| mordred | woot | 17:17 |
| *** freerunner has joined #openstack-infra | 17:17 | |
| fungi | also i have working centos-6 nodes in rax already | 17:17 |
| *** jistr has quit IRC | 17:17 | |
| fungi | so yay | 17:17 |
| *** sdake_ has quit IRC | 17:17 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/system-config: Prevent puppet certname with mixed-case hostnames https://review.openstack.org/153823 | 17:19 |
| *** HeOS has quit IRC | 17:19 | |
| *** mattfarina has joined #openstack-infra | 17:20 | |
| openstackgerrit | Sergey Skripnick proposed openstack-infra/project-config: Add missing services to enable heat in rally job https://review.openstack.org/181088 | 17:20 |
| clarkb | SpamapS: did we run into https://review.openstack.org/#/c/153823/2 somewhere? | 17:21 |
| *** Krinkle is now known as Krinkle|detached | 17:21 | |
| *** btully has joined #openstack-infra | 17:21 | |
| *** yfried__ has joined #openstack-infra | 17:21 | |
| SpamapS | clarkb: yes, my laptop, when building images | 17:22 |
| clarkb | hrm we don't use a master when building images | 17:23 |
| SpamapS | clarkb: but the cert is still set | 17:23 |
| greghaynes | clarkb: thought - we can add tests to project-config that do a dib test build (just like dib testing does now) with some of the infra elements | 17:23 |
| mordred | yah. apply will still read it and be confused | 17:23 |
| clarkb | wait its a problem even if it doesn't use the cert to talk to a master? | 17:23 |
| clarkb | thats amazing | 17:23 |
| SpamapS | clarkb: we could also put a conditional around it and not set certname. | 17:23 |
| clarkb | SpamapS: nah I am +2 on the change just trying to make sure I understand how and where it breaks | 17:23 |
| mordred | clarkb: I'm amazed that you're still able to be amazed | 17:23 |
| SpamapS | clarkb: yes, it's just a problem because puppet tries to load its config and the cert can't be read, because the name is wrong. | 17:24 |
| SpamapS | I think failing pre-flights on security related matters is good actually. | 17:24 |
| SpamapS | Annoying, but good. | 17:24 |
| *** radez_g0n3 is now known as radez | 17:24 | |
| SpamapS | "You said use this cert if I ever talk to somebody, and it failed. 'SPLODE!" | 17:25 |
| clarkb | SpamapS: except that I didn't say to use any cert | 17:25 |
| clarkb | SpamapS: puppet apply never uses a cert | 17:25 |
| *** armax has joined #openstack-infra | 17:25 | |
| SpamapS | clarkb: yeah that's just a layering problem. :) | 17:25 |
| SpamapS | and separating "things from not apply" from "things from apply" isn't on anybody's radar. | 17:26 |
| SpamapS | I mean yes its wrong. | 17:26 |
| SpamapS | I'm just not all that amazed that it fails this way. | 17:26 |
| SpamapS | the more amazing part is that the cert name is case sensitive, despite being a hostname. | 17:26 |
| *** xyang1 has joined #openstack-infra | 17:26 | |
| openstackgerrit | James E. Blair proposed openstack-infra/gear: Fix regression in wakeConnections https://review.openstack.org/181089 | 17:26 |
| jeblair | clarkb, fungi: ^ i think that's worth a 0.5.7. | 17:27 |
| clarkb | jeblair: looking at ^ | 17:27 |
| fungi | gah | 17:27 |
| openstackgerrit | Alistair Coles proposed openstack-infra/project-config: Make python-swiftclient functional tests voting https://review.openstack.org/181090 | 17:27 |
| SpamapS | in fact it's not even case sensitive.. | 17:28 |
| SpamapS | it is just "must be lower case" :-P | 17:28 |
| clarkb | looks like we both +2'd at the same time | 17:28 |
| clarkb | I can approve | 17:28 |
| fungi | jeblair: so this was only impacting zuul's tests? | 17:28 |
| *** ssam2 has quit IRC | 17:30 | |
| pleia2 | clarkb: woo, my lunch got canceled, sticking around to see these upgrades through today | 17:30 |
| pleia2 | 04 is ready, upgrading plugin now | 17:31 |
| *** pelix has quit IRC | 17:31 | |
| clarkb | pleia2: on that one I think we have some stale nodes | 17:32 |
| clarkb | pleia2: if you haven't stopped it yet we might want to look at them | 17:32 |
| pleia2 | clarkb: oh, cleanup on nodepool? | 17:32 |
| *** crc32 has joined #openstack-infra | 17:32 | |
| pleia2 | oh, the .xml file | 17:32 |
| *** sputnik1_ has joined #openstack-infra | 17:32 | |
| clarkb | ya we should cross check the offline nodes on jenkins04 against nodepool | 17:32 |
| *** pabelanger has quit IRC | 17:32 | |
| * pleia2 nods | 17:32 | |
| frickler | jeblair: clarkb: though heat is in enabled services, devstack thinks it is not enabled here: http://logs.openstack.org/28/179428/7/check/gate-rally-dsvm-rally/3a24ab4/logs/devstacklog.txt.gz#_2015-05-07_15_48_15_441 | 17:32 |
| clarkb | pleia2: we don't want to compeltely cleanup the .xml because some of those are valid nodes | 17:32 |
| pleia2 | clarkb: ok | 17:33 |
| *** sputnik13 has quit IRC | 17:33 | |
| clarkb | pleia2: looks like 2394747 at least is "ready" in nodepool | 17:33 |
| clarkb | pleia2: but jenkins reports no build history for that node, its probably ok to restart as is and use that node? | 17:33 |
| clarkb | pleia2: I think this is an occurence of the node leakage and since we don't actually run any jobs on those nodes it is safe for jenkins to use them | 17:34 |
| frickler | https://wiki.openstack.org/wiki/Heat/GettingStartedUsingDevstack#Configure_DevStack_to_enable_Heat also would need updating | 17:34 |
| *** freerunner has quit IRC | 17:34 | |
| *** yfried__ has quit IRC | 17:34 | |
| clarkb | pleia2: so, I say go for it and don't worry | 17:35 |
| *** yfried__ has joined #openstack-infra | 17:35 | |
| *** freerunner has joined #openstack-infra | 17:35 | |
| pleia2 | clarkb: alright thanks, I'll remember to check for that too moving forward | 17:35 |
| *** freerunner has quit IRC | 17:35 | |
| clarkb | frickler: its in the localrc http://logs.openstack.org/28/179428/7/check/gate-rally-dsvm-rally/3a24ab4/logs/localrc.txt.gz | 17:35 |
| clarkb | frickler: so you would likely need to take that up with devstack? | 17:35 |
| openstackgerrit | Merged openstack-infra/system-config: Prevent puppet certname with mixed-case hostnames https://review.openstack.org/153823 | 17:35 |
| openstackgerrit | Merged openstack-infra/gear: Fix regression in wakeConnections https://review.openstack.org/181089 | 17:36 |
| openstackgerrit | Alistair Coles proposed openstack-infra/project-config: Make python-swiftclient functional tests voting https://review.openstack.org/181090 | 17:36 |
| openstackgerrit | Sergey Skripnick proposed openstack-infra/project-config: Add missing services to enable heat in rally job https://review.openstack.org/181088 | 17:37 |
| jeblair | fungi: yes -- that method is always called with an argu in gear; only zuul's tests used the bare/default call and depended on that | 17:37 |
| fungi | jeblair: thanks. that's how i interpreted the commit message and what it looked like in the gear source | 17:38 |
| jeblair | ment | 17:38 |
| jeblair | ^ some extra letters to fill out my previous sentence as needed | 17:38 |
| *** shashankhegde has joined #openstack-infra | 17:38 | |
| clarkb | jeblair: can we apply the extra letters arbitarily? | 17:38 |
| jeblair | clarkb: whatever scores highest, i guess? :) | 17:39 |
| pleia2 | jenkins04 back up, gearman plugin looks good | 17:40 |
| mordred | jeblair: I got into that missing refs state again | 17:40 |
| *** yamahata has joined #openstack-infra | 17:40 | |
| *** _nadya_ has quit IRC | 17:40 | |
| *** annegentle has joined #openstack-infra | 17:40 | |
| *** emagana has quit IRC | 17:40 | |
| * fungi got m on a triple letter space | 17:40 | |
| jeblair | mordred: anything interesting happen? crashes, weird shutdown/resumes, etc? | 17:41 |
| jeblair | mordred: are you missing refs for new changes or older ones too? | 17:41 |
| clarkb | pleia2: those nodes are still offline, I think that means we should clean them up via nodepool | 17:41 |
| pleia2 | clarkb: alright | 17:41 |
| mordred | jeblair: I believe my laptop has shutdown due to power loss at least once | 17:41 |
| clarkb | pleia2: I can do that if you like, or if you want to do it it is `sudo -H -u nodepool nodepool delete --now $id` | 17:42 |
| mtreinish | mordred: mine does all the time, mostly because I always forget to check the battery state | 17:42 |
| mtreinish | and even after a year I'm not used to having a battery which lasts >6 hours | 17:42 |
| mtreinish | so I forget to charge it | 17:42 |
| clarkb | mtreinish: the worst thing is with the 2 day battery on the x240 I getto the third day and have completely forgotten that charging is required | 17:42 |
| jeblair | mordred: assuming you haven't run '--fetch-missing-refs', are there lots of entries in '.git/refs/changes/...' of the relevant repos? | 17:43 |
| pleia2 | clarkb: so it's all the ones that still have (offline) next to them? | 17:43 |
| *** erlon has joined #openstack-infra | 17:43 | |
| *** achanda has joined #openstack-infra | 17:43 | |
| *** emagana has joined #openstack-infra | 17:43 | |
| clarkb | pleia2: ya | 17:44 |
| mordred | btw - 98306 may be my favorite change, in that the commit message feels like a comp sci lecture, and the patch is maybe 10 lines | 17:44 |
| clarkb | pleia2: and the id is the trailing number 2394747 for example | 17:44 |
| mordred | jeblair: I'll check | 17:44 |
| *** AJaeger_ has joined #openstack-infra | 17:44 | |
| pleia2 | clarkb: right, figured that one out, thanks | 17:44 |
| pleia2 | clarkb: I'll nodepool delete them | 17:45 |
| jeblair | mordred: it sort of sounds like git gc is running, but those refs should prevent it from deleting the commits | 17:45 |
| mordred | hrm | 17:45 |
| jeblair | mordred: do you have any git cleanup cronjobs or anything? | 17:45 |
| clarkb | pleia2: cool, you can leave off the --now and let the nodepool cleanup routine get them but instant deletion is so much more instant | 17:45 |
| *** anteaya has quit IRC | 17:45 | |
| mordred | I do not | 17:45 |
| *** sabeen1 has joined #openstack-infra | 17:45 | |
| *** craigbr has joined #openstack-infra | 17:45 | |
| *** tonytan4ever has quit IRC | 17:45 | |
| pleia2 | clarkb: alright, will do | 17:45 |
| *** craigbr has quit IRC | 17:45 | |
| mordred | jeblair: and I do have entries in refs/changes | 17:45 |
| pleia2 | clarkb: I mean, maybe I'll use now this time? | 17:45 |
| pleia2 | er --now | 17:46 |
| *** annegentle has quit IRC | 17:46 | |
| *** craigbr has joined #openstack-infra | 17:46 | |
| clarkb | pleia2: ya I prefer --now | 17:46 |
| pleia2 | clarkb: good to know | 17:46 |
| jeblair | clarkb, pleia2: i think the cleanup routine should get to them within 1 minute, so i usually omit it | 17:46 |
| jeblair | mordred: did you figure out if it's all refs missing, new ones? old ones? | 17:47 |
| pleia2 | jeblair: ok | 17:47 |
| *** emagana has quit IRC | 17:48 | |
| *** kaisers has quit IRC | 17:48 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Update to gear 0.5.7 https://review.openstack.org/180334 | 17:49 |
| pleia2 | clarkb: all the tripleo (offline) ones too? | 17:49 |
| *** jistr has joined #openstack-infra | 17:49 | |
| *** kaisers has joined #openstack-infra | 17:49 | |
| mordred | jeblair: I did not - although one of them was 98306 ... so I'm going to go with "old and new" | 17:49 |
| mordred | jeblair: since 98306 hasn't been updated or changed in quite a while | 17:49 |
| *** angela-s has joined #openstack-infra | 17:50 | |
| clarkb | pleia2: ya looks like those should go too | 17:50 |
| pleia2 | ok, on it | 17:50 |
| jeblair | mordred: okay, then i think "something changed your git repos behind gertty's back" is where to look. | 17:51 |
| mordred | jeblair: sweet | 17:51 |
| mordred | jeblair: we don't have git review gc'ing repos do we? | 17:52 |
| clarkb | pleia2: I am basically just checking that nodepool knwos about them but thinks they are ready for many hours | 17:52 |
| clarkb | pleia2: that indicates to me that jenkins and nodepool have miscommunicated which is a sign of the leak | 17:52 |
| jeblair | mordred: thing is, gc should be safe because of the refs | 17:52 |
| mordred | nod | 17:52 |
| mordred | jeblair: OH | 17:52 |
| mordred | jeblair: I have this hunch ... | 17:52 |
| pleia2 | clarkb: I see, so it *should* be that nodepool thinks they're ready and jenkins thinks they're idle or building | 17:53 |
| mordred | jeblair: I changed my git root a while back to not point to a location different from where I keep my source | 17:53 |
| *** ivar-lazzaro has joined #openstack-infra | 17:53 | |
| clarkb | pleia2: ya, or if they are offline in jenkins nodepool should say the node is used/delet | 17:53 |
| mordred | jeblair: is it possible that gertty's concept of whether or not it has a change might have been thrown off by that? | 17:53 |
| pleia2 | clarkb: right | 17:53 |
| jeblair | mordred: my gertty git root is where i edit things too | 17:53 |
| *** claudiub has quit IRC | 17:53 | |
| *** gokrokve has joined #openstack-infra | 17:53 | |
| jeblair | mordred: that is to say, that i do development work in the repos that gertty uses | 17:54 |
| jeblair | mordred: is that what you meant? | 17:54 |
| clarkb | I have seen this gertty behavior once and I don't share repos. So it may be something else | 17:55 |
| mordred | jeblair: yes. well, that's what it is now | 17:55 |
| *** tonytan4ever has joined #openstack-infra | 17:55 | |
| jeblair | clarkb: recently? | 17:55 |
| mordred | jeblair: but for a while it was configured to be ~/git instead of ~/src | 17:55 |
| clarkb | jeblair: no | 17:55 |
| mordred | jeblair: and I noticed that and changed it | 17:55 |
| mordred | because having two sets of repos is silly | 17:55 |
| jeblair | clarkb: then possibly before it started saving refs | 17:55 |
| clarkb | also it ended up being a corrupted pack file | 17:55 |
| clarkb | so it couldn't find the refs | 17:55 |
| jeblair | mordred: indeed, gertty is designed for that. the 'checkout' and 'cherry-pick' commands don't make sense otherwise :) | 17:55 |
| clarkb | mordred: did you try a git fsck? | 17:55 |
| *** sputnik1_ has quit IRC | 17:55 | |
| openstackgerrit | Sergey Skripnick proposed openstack-infra/project-config: Add missing services to enable heat in rally job https://review.openstack.org/181088 | 17:56 |
| mordred | clarkb: I have not, no | 17:56 |
| clarkb | mordred: I would run that to see if its a corrupted pack file | 17:56 |
| mordred | clarkb: well, it's perfassive across all the repos | 17:56 |
| clarkb | oh, I haven't seen that then | 17:56 |
| mordred | s/f/v/ | 17:56 |
| clarkb | in my case it was just one repo and happened once | 17:56 |
| *** SumitNaiksatam has left #openstack-infra | 17:56 | |
| mordred | I'll run --fetch-missing and some fsck's when I get back on dry land | 17:56 |
| clarkb | so I deleted the repo and started over | 17:56 |
| jeblair | gertty emits the error that mordred is seeing iff the actual _commit_ (referenced directly by sha) is missing from the repo. it saves refs to all of those commits in refs/changes/... to prevent gc from deleting those commits. | 17:57 |
| *** gokrokve_ has quit IRC | 17:57 | |
| jeblair | that means something deleted the _refs_, and gertty does not do that at all until change https://review.openstack.org/179981 | 17:57 |
| jeblair | which i don't believe you are running, right mordred? | 17:57 |
| clarkb | jeblair: in my case I saw the behavior because the pack file containing the ref was bad | 17:57 |
| clarkb | jeblair: so git couldn't get it | 17:57 |
| jeblair | clarkb: yeah that makes sense | 17:57 |
| *** rkukura has joined #openstack-infra | 17:57 | |
| clarkb | pleia2: jenkins04 lgtm now | 17:58 |
| clarkb | pleia2: one job to go on 03 | 17:58 |
| *** gokrokve has quit IRC | 17:59 | |
| clarkb | pleia2: we can put 02 in shutdown mode now if you like | 17:59 |
| pleia2 | clarkb: ok, on it | 17:59 |
| SpamapS | jeblair: I just noticed that gear doesn't have py34 in its envlist, but does have py26. Do we still care about py26 in gear? | 17:59 |
| jeblair | mordred: is there an entry in .git/refs/changes/06/98306/10 ? | 17:59 |
| * pleia2 keeps an eye on 03 | 17:59 | |
| mordred | jeblair: yes | 17:59 |
| mordred | jeblair: although I have 98306 now | 17:59 |
| jeblair | SpamapS: probably not? | 17:59 |
| *** derekh has joined #openstack-infra | 17:59 | |
| jeblair | mordred: oh, well that's less useful information | 18:00 |
| jeblair | mordred: you have run --fetch? | 18:00 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/gear: Add py34 to tox.ini envlist https://review.openstack.org/181097 | 18:00 |
| clarkb | jeblair: SpamapS: we have to keep testing zuul on py26 for at least the zuul cloner, this sets up an indirect and not completely necessary dependency on py26 in gear | 18:00 |
| mordred | jeblair: nope. plane wifi - didn't want to do somethign like that - but ... gertty does always correct itself | 18:00 |
| clarkb | if we rearrange how we do testing for that we can likely avoid testing gear on py26 | 18:00 |
| *** SumitNaiksatam has joined #openstack-infra | 18:01 | |
| SpamapS | yeah we can leave it be for now. | 18:01 |
| SpamapS | It might be one of those 'when it breaks we'll fix it or remove py26' things. ;) | 18:01 |
| mordred | ++ | 18:01 |
| jeblair | mordred: do you have .git/refs/changes/98/179498/1 in nodepool? | 18:02 |
| jeblair | mordred: (assuming you have not looked at that change in gertty) | 18:02 |
| SpamapS | actually, we don't have python26-jobs on gear | 18:02 |
| SpamapS | so we're not testing it anyway | 18:02 |
| *** gokrokve has joined #openstack-infra | 18:03 | |
| mordred | jeblair: yes I do | 18:03 |
| mordred | now let me see if gertty likes it | 18:03 |
| sdague | dstufft: before we land this change in the cffi devstack / wheels work around, can I get your eyes on it - https://review.openstack.org/#/c/180549/ ? | 18:03 |
| *** sabeen1 has quit IRC | 18:03 | |
| mordred | jeblair: yup. gerrty is not unhappy about that one | 18:03 |
| jeblair | mordred: i'm also assuming that you ran your last --fetch-missing-refs on the _new_ repos, right? | 18:03 |
| dstufft | sdague: looking | 18:04 |
| *** mattfarina has quit IRC | 18:04 | |
| jeblair | mordred: (that is, you ran fetch-missing after switching from git to src) | 18:04 |
| mordred | jeblair: yes. although tbh, it's possible that never finished? I stopped paying attention | 18:05 |
| mordred | jeblair: I'll re-run it when I get home and pay attention | 18:05 |
| jeblair | mordred: so you're missing a ref from 2 months ago, but you have one from yesterday | 18:05 |
| mordred | jeblair: yah | 18:05 |
| *** emagana has joined #openstack-infra | 18:05 | |
| *** _nadya_ has joined #openstack-infra | 18:05 | |
| *** amitgandhinz has joined #openstack-infra | 18:05 | |
| jeblair | mordred: have you run into a recent change missing a ref? | 18:05 |
| *** ildikov has joined #openstack-infra | 18:05 | |
| *** samueldmq has quit IRC | 18:06 | |
| *** annegentle has joined #openstack-infra | 18:06 | |
| jeblair | oh sorry, that was from ~1 week ago, not yesterday | 18:06 |
| mordred | jeblair: not to my knowledge - I'll start paying attention to old vs. new | 18:06 |
| dstufft | sdague: +1'd | 18:06 |
| *** e0ne has joined #openstack-infra | 18:06 | |
| sdague | dstufft: thanks | 18:06 |
| sdague | mtreinish: you want to land this - https://review.openstack.org/#/c/180549/ | 18:06 |
| mtreinish | sdague: done | 18:07 |
| *** otter768 has joined #openstack-infra | 18:07 | |
| jeblair | mordred: so think about things that could be manipulating the repos behind your back; make sure you really are in a known good state with no missing-refs, keep running it in debug logging mode and if you hit another change that is missing a commit, look in the debug log for that change and see if it synced it, assuming it is a recent patchset. | 18:08 |
| *** sdake has quit IRC | 18:08 | |
| *** _nadya_ has quit IRC | 18:09 | |
| openstackgerrit | Merged openstack-infra/nodepool: Log ipv6 addresses for nodes https://review.openstack.org/132307 | 18:09 |
| *** sdake has joined #openstack-infra | 18:09 | |
| *** tnovacik has joined #openstack-infra | 18:09 | |
| *** smccully has joined #openstack-infra | 18:09 | |
| *** otter768 has quit IRC | 18:12 | |
| boris-42 | sdague: could you help us to unblock Rally gates https://review.openstack.org/#/c/181088/ ? | 18:12 |
| pleia2 | AJaeger_: did you want/need to do any babysitting on 176943? if not, I'll +A now | 18:13 |
| sdague | boris-42: so... it seems like it would be better to list all the services there, instead of assuming a base | 18:13 |
| sdague | so this doesn't happen again | 18:13 |
| *** gokrokve has quit IRC | 18:13 | |
| *** anteaya has joined #openstack-infra | 18:13 | |
| boris-42 | sdague: can we get this merged | 18:14 |
| boris-42 | sdague: after that we will work on fully explicity? | 18:14 |
| sdague | ok | 18:14 |
| *** gokrokve has joined #openstack-infra | 18:14 | |
| boris-42 | sdague: thank you | 18:14 |
| jeblair | boris-42: why is heat required everywhere? | 18:14 |
| boris-42 | jeblair: various scenarios can require it | 18:15 |
| boris-42 | jeblair: like in soon feature in Murano they will get Heat APP | 18:15 |
| mordred | jeblair: another failure on a change from feb | 18:15 |
| boris-42 | jeblair: and we will need to test Heat-Murano stuff | 18:15 |
| boris-42 | jeblair: as well there will heat-mistral intergration | 18:15 |
| boris-42 | jeblair: so we need as well to test it.. | 18:15 |
| boris-42 | jeblair: and so on.. | 18:15 |
| jeblair | boris-42: as we reduce the shared-gating infrastructure to fewer projects, if rally is gating on those projects it will need to also not depend on anything outside of the smaller set. otherwise we'll have asymmetric gates | 18:16 |
| jeblair | boris-42: okay, that's fine | 18:16 |
| *** gema has quit IRC | 18:16 | |
| jeblair | boris-42: mostly pointing out that we can't have, say, a nova rally job depend on more than the nova tempest job | 18:16 |
| jeblair | if it's gating | 18:16 |
| openstackgerrit | Ramakrishnan G proposed openstack-infra/project-config: Add python34 job for proliantutils https://review.openstack.org/181104 | 18:17 |
| boris-42 | jeblair: not sure that I fully get how tempest and rally jobs are related | 18:17 |
| *** nikhil_k_ is now known as nikhil_k-afk | 18:17 | |
| *** ildikov has quit IRC | 18:17 | |
| *** baoli has quit IRC | 18:17 | |
| jeblair | mordred: interesting; it's smelling more like old changes | 18:17 |
| pleia2 | clarkb: ok, so 03 is done with jobs, but none of the (offline) ones are in nodepool | 18:17 |
| *** baoli has joined #openstack-infra | 18:18 | |
| *** baoli has quit IRC | 18:18 | |
| jeblair | boris-42: they aren't. rally must not expand the set of projects that are tested together in a shared gate. | 18:18 |
| jeblair | boris-42: tempest can't either. :) | 18:18 |
| *** derekh has quit IRC | 18:18 | |
| boris-42 | jeblair: so for heat we should have separated gate? | 18:18 |
| boris-42 | jeblair: I mean we have heat sceanrios that we should test | 18:19 |
| *** gokrokve has quit IRC | 18:19 | |
| boris-42 | jeblair: what is the proper way to do this? | 18:19 |
| boris-42 | jeblair: for now we are trying to reduce amount of resources that are used in gates | 18:19 |
| clarkb | pleia2: if none of the offline nodes are in nodepool you can delete them in jenkins via the ui or via the xml file | 18:19 |
| jeblair | boris-42: the goal is to say that "nova, keystone, neutron, swift, horizon" are tested together. nova does not have a job that runs a trove tempest test at this point. | 18:19 |
| clarkb | pleia2: since its a subset of nodes probably via the ui is easiest | 18:19 |
| openstackgerrit | Merged openstack-infra/nodepool: Allow for no ZMQ publishers https://review.openstack.org/179498 | 18:19 |
| jeblair | boris-42: why are you trying to reduce the amount of resources used in gates? | 18:19 |
| pleia2 | clarkb: ok, thanks | 18:19 |
| clarkb | pleia2: click on each on, hit delete node, yes | 18:19 |
| EmilienM | clarkb: someone in Puppet OpenStack community is also writing a blueprint about Puppet functional testing: https://review.openstack.org/#/c/180180/ | 18:19 |
| clarkb | pleia2: would be easier to edit file if it wasn't xml beacuse parsing that is :/ | 18:20 |
| boris-42 | jeblair: because I don't want to spend somebodies resources where it is not required | 18:20 |
| pleia2 | clarkb: "delete slave"? | 18:20 |
| pleia2 | clarkb: yeah :\ | 18:20 |
| boris-42 | jeblair: this will make gates faster for all other projects | 18:20 |
| EmilienM | clarkb: I asked him to have a look at yours, but I would ask you to look at his work too, maybe we can consolidate our efforts | 18:20 |
| mordred | boris-42: we have plenty of resources ... spend them | 18:20 |
| mordred | boris-42: all the clouds - all for you ;) | 18:21 |
| clarkb | EmilienM: that one looks a lot like describing what to test, which is important too but seems to be a step after mine | 18:21 |
| clarkb | EmilienM: so I think they complement each other | 18:21 |
| EmilienM | clarkb: good to know | 18:21 |
| clarkb | pleia2: ya delete slave | 18:21 |
| jeblair | boris-42: so as far as the jobs go, create one job for each of the groups of components you test together. so if you test on the compute kernel, create a job for that and use it on nova,neutron,swift,keystone,etc. | 18:21 |
| boris-42 | mordred: I am saying trying to say that Rally team is trying to avoid usage of resources if they are not needed | 18:21 |
| EmilienM | clarkb: we just don't want overlapping. Do you want me to move his blueprint to your repo? | 18:22 |
| jeblair | boris-42: then create another job and use it on heat,mistral,other-project-that-use-heat, etc. | 18:22 |
| boris-42 | jeblair: so let me try to expalin how things are working.. | 18:22 |
| boris-42 | jeblair: we have input task that describes what benchmark scenarios to run | 18:22 |
| jeblair | boris-42: or if they don't relate at all, create a job for each project | 18:22 |
| boris-42 | jeblair: so we can specify any sub-set | 18:22 |
| clarkb | EmilienM: no I don't think so, they don't appear to be overlapping. Mine says "this is how we setup then run the test runner" this one says "we should test for idempotency and dependency changes" | 18:22 |
| boris-42 | jeblair: of benchmarks | 18:22 |
| clarkb | EmilienM: so they complement well | 18:22 |
| boris-42 | jeblair: but I am not sure that this will be simpler for everybody including rally team.. | 18:22 |
| clarkb | EmilienM: I think it would be good if we made sure the proposal for how to run the tests enabled these specific test cases though. I will have to read and make sure that is reasonable | 18:23 |
| *** salv-orlando has joined #openstack-infra | 18:23 | |
| boris-42 | jeblair: but if you would prefer we will create seprated jobs for every porject | 18:23 |
| openstackgerrit | Merged openstack-infra/project-config: Add missing services to enable heat in rally job https://review.openstack.org/181088 | 18:23 |
| boris-42 | jeblair: at least we will try to analyze this | 18:24 |
| clarkb | crinkle: ^ do you agree? | 18:24 |
| boris-42 | and make some proposal | 18:24 |
| clarkb | looks like crinkle has done most of the review on the spec EmilienM linked | 18:24 |
| *** abregman has quit IRC | 18:24 | |
| *** david-lyle_ has joined #openstack-infra | 18:25 | |
| EmilienM | clarkb: ok cool. I just want to let you know: 1/ I'll make sure Puppet OpenStack team follows your BP in review and usage 2/ About the container BP from fbo ( https://review.openstack.org/#/c/172833 ) We may also be very interested by this work | 18:25 |
| pleia2 | jenkins03 done, looking good so far | 18:25 |
| *** gema_ has joined #openstack-infra | 18:25 | |
| clarkb | EmilienM: sounds good, thanks for pointing it out | 18:25 |
| EmilienM | clarkb: I see a lot of collaboration between infra & puppet teams, we want to solve the same problems | 18:25 |
| *** sputnik13 has joined #openstack-infra | 18:25 | |
| *** david-lyle has quit IRC | 18:25 | |
| jeblair | boris-42: i would recommend that you learn about zuul shared change queues and how integration testing is set up for tempest and the rest of the jobs. i do not know the right answer for your situation. | 18:25 |
| *** david_lyle__ has joined #openstack-infra | 18:25 | |
| jeblair | EmilienM: ++ yay! | 18:26 |
| EmilienM | clarkb: in long-term, will puppet be still the tool to configure os-infra ? | 18:26 |
| clarkb | pleia2: yup lgtm | 18:26 |
| clarkb | EmilienM: I think so | 18:26 |
| boris-42 | jeblair: btw what is the purpose of doing this? | 18:26 |
| EmilienM | cool, I can sleep tonight | 18:26 |
| clarkb | EmilienM: we are using ansible for orchestration but not any config management | 18:26 |
| EmilienM | and it makes sense | 18:26 |
| *** salv-orlando has quit IRC | 18:27 | |
| boris-42 | jeblair: in any case all our benchmark should pass the gates | 18:27 |
| *** jogo has quit IRC | 18:27 | |
| boris-42 | jeblair: (inside the rally project) so no matter do you have 1 or 10 gate jobs all should pass | 18:27 |
| clarkb | EmilienM: it has actually worked really well fwiw. Ansible knows how to drive things in order and check return codes and all that. And puppet already has tons of config management in it that mostly works :) | 18:27 |
| *** david-lyle has joined #openstack-infra | 18:28 | |
| yolanda | clarkb, sorry, i was out | 18:28 |
| yolanda | checking the change | 18:28 |
| *** sputnik13 has quit IRC | 18:28 | |
| clarkb | pleia2: jenkins01 into shutdown mode now? | 18:28 |
| *** david-lyle_ has quit IRC | 18:29 | |
| mordred | EmilienM: \o/ I'm happy about collaboration there | 18:29 |
| boris-42 | jeblair: I belive that it is important for projects on top that don't want to be blocked by not related failures* | 18:29 |
| boris-42 | jeblair: but in case of rally it won't help =( | 18:29 |
| EmilienM | mordred: I never worried about that :-) | 18:29 |
| pleia2 | clarkb: sure, after that it's just jenkins? (and jenkins-dev?) | 18:30 |
| yolanda | clarkb, so i wanted to do it simple, just add a parameter there with a list of keys, and just delegate the stuff of sending the keys to the manifest calling it, to be flexible | 18:30 |
| *** ildikov has joined #openstack-infra | 18:30 | |
| yolanda | then people can add the list including ::params classes, passing a list, whatever | 18:30 |
| clarkb | pleia2: yup | 18:31 |
| *** david_lyle__ has quit IRC | 18:31 | |
| clarkb | yolanda: right you can still use a list of keys I think, mostly wondering if it makes sense to use the built in resource | 18:31 |
| clarkb | yolanda: I think mordred has convinced me that using the template is simple and reliable where using the resource leads the trouble | 18:32 |
| yolanda | keep things simpler looks as a good idea | 18:32 |
| mordred | clarkb: I'm sad about that, btw - I really wish the resource was reliable | 18:33 |
| mordred | I'd blame crinkle ... but I suppose it's not her fault anymore | 18:33 |
| crinkle | hi | 18:34 |
| * crinkle scrolls back | 18:34 | |
| *** david-lyle has quit IRC | 18:34 | |
| *** eharney_ has joined #openstack-infra | 18:35 | |
| clarkb | pleia2: reading your latest comments on https://review.openstack.org/#/c/179840/1/doc/source/testing.rst I think we should use directions for glanceclient as you may not easily have network access to where horizon is listening from your browser. | 18:35 |
| clarkb | pleia2: I am not sure how best to fix the NODEPOOL_ROOT variable. Its used in both the shell and yaml so I am treating it as a generic variable | 18:36 |
| crinkle | clarkb: i'm not sure what i'm agreeing with, that your spec for how to test should account for our spec on what to test? | 18:36 |
| pleia2 | clarkb: wfm, easy enough with devstack, I'll draft them up as I test | 18:36 |
| clarkb | pleia2: would a path like /path/to/nodepool/things/ work better? | 18:36 |
| pleia2 | clarkb: I'd say so, $ALL_CAPS screams ennvar to me | 18:36 |
| crinkle | mordred: ssh_authorized_key resource? :( | 18:36 |
| crinkle | mordred: yeah template is probably simplest | 18:37 |
| EmilienM | clarkb: I'm looking at these blueprints because I have something in mind about longterm, this is about upgrade testing & a grenade job like for our Puppet modules | 18:37 |
| mordred | crinkle: yah | 18:37 |
| clarkb | crinkle: I am saying that they tackle different layers. My spec is saying "this is how we should run a test framework" the other one is saying "this is what we should test in the framework" | 18:37 |
| crinkle | clarkb: yes they are two different things | 18:37 |
| nibalizer | oh are we grumping about ssh_authorized_keys ? | 18:37 |
| nibalizer | ya we should just use https://github.com/nightfly19/puppet-ssh_keys | 18:38 |
| clarkb | EmilienM: ya fbo pointed out something ismilar in the integration testing spec that we will want to deploy from master, then redeploy with latest change | 18:38 |
| *** eharney has quit IRC | 18:38 | |
| clarkb | nibalizer: or just use a template | 18:38 |
| EmilienM | crinkle: should we think about having the 2 BP in same repo ? | 18:38 |
| clarkb | EmilienM: which is similar to doing upgrade testing, though generally the delta will be smaller | 18:38 |
| EmilienM | clarkb: some folks are doing CI/CD with Puppet and having this kind of job could really help | 18:38 |
| yolanda | nibalizer, yep, i just used a template for that | 18:38 |
| *** freerunner has joined #openstack-infra | 18:39 | |
| clarkb | pleia2: we should probably also add a heredoc'd script for prepare_node_ubuntu.sh example. Its simple but figuring that out from scratch is likely much harder than seeing a script that does it | 18:40 |
| clarkb | pleia2: I can push that up along with some of these other edits | 18:41 |
| crinkle | EmilienM: the only part of gabriele's spec i fully agree with is testing for idempotency, i don't know if the rest of the problems the spec tries to account for are shared with infra | 18:41 |
| pleia2 | clarkb: for the glance bits? | 18:41 |
| EmilienM | crinkle: forget about it then :) | 18:41 |
| fungi | interesting twist for the centos-6 workers... need to manually start mysqld and postgres before configuring them, and also need to init postgres as a separate step before starting it | 18:42 |
| clarkb | pleia2: no, for the setup: prepare_node_ubuntu.sh bits in the yaml file | 18:42 |
| pleia2 | clarkb: oh, right | 18:42 |
| clarkb | pleia2: basically you need to create a user and add the public key to authorized keys in that script | 18:42 |
| clarkb | pleia2: its pretty simple but having an example is probably super useful there | 18:42 |
| pleia2 | clarkb: yeah, definitely | 18:42 |
| EmilienM | clarkb: when you got time to review, do you think we can go ahead with https://review.openstack.org/#/c/175434/ ? | 18:43 |
| clarkb | fungi: what does init postgres involve? | 18:43 |
| *** jogo has joined #openstack-infra | 18:43 | |
| *** jogo has joined #openstack-infra | 18:43 | |
| fungi | clarkb: sudo service postgresql initdb | 18:43 |
| *** sdake_ has joined #openstack-infra | 18:43 | |
| fungi | clarkb: followed by sudo service postgresql start | 18:43 |
| clarkb | EmilienM: ya I can rereview that today likely | 18:43 |
| *** craigbr has quit IRC | 18:44 | |
| *** eharney_ is now known as eharney | 18:44 | |
| EmilienM | clarkb: cool, you may want to use the jobs too if you like | 18:44 |
| *** abregman has joined #openstack-infra | 18:44 | |
| fungi | clarkb: i assume that's to create the master db schema and whatever if it doesn't exist (which it doesn't by default on installation) | 18:44 |
| fungi | puppet was obviously handling those bits | 18:45 |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-gerrit: Move gerrit fetch remotes to jeepyb https://review.openstack.org/161663 | 18:45 |
| clarkb | fungi: that doesn't seem too bad at least | 18:46 |
| *** sdake has quit IRC | 18:47 | |
| *** david-lyle has joined #openstack-infra | 18:47 | |
| *** JayJ_ has quit IRC | 18:47 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Update to gear 0.5.7 https://review.openstack.org/180334 | 18:48 |
| openstackgerrit | Stephanie Miller proposed openstack-infra/project-config: [WIP] Draft proposal scripts for zanata https://review.openstack.org/181113 | 18:48 |
| jeblair | clarkb, fungi: ^ that has a test race fix, so maybe it will land | 18:48 |
| *** markmcclain has quit IRC | 18:48 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-gerrit: Move gerrit fetch remotes to jeepyb https://review.openstack.org/161663 | 18:48 |
| mordred | EmilienM: comments left - one syntax, one conceptual | 18:48 |
| cinerama | pleia2, AJaeger: that above is for you | 18:48 |
| EmilienM | mordred: damn it... thanks | 18:49 |
| AJaeger_ | pleia2: for 176943 I will check tomorrow's proposal run myself. Thanks for the review - I'll +A now | 18:49 |
| *** reed has quit IRC | 18:49 | |
| cinerama | pleia2: have you gardened the upstream bugs lately? if not i'll have a quick look | 18:49 |
| AJaeger_ | cinerama: will review - and will update that bug now... | 18:49 |
| fungi | clarkb: yeah, it's just something i'm going to need to weap in a conditional | 18:49 |
| *** ryanpetrello_ has quit IRC | 18:50 | |
| fungi | er, wrap | 18:50 |
| cinerama | AJaeger_: bear in mind that some stuff is missing as of now, i just wanted to get something up there so you folks can correct any misunderstandings etc | 18:50 |
| *** teran has quit IRC | 18:51 | |
| *** jistr has quit IRC | 18:51 | |
| fungi | jeblair: heh... "Also includes an unrelated test race fix." | 18:51 |
| AJaeger_ | cinerama: ok | 18:51 |
| clarkb | jeblair: see comment | 18:51 |
| jeblair | fungi: yeah, i could do that as 2 commits with one pinned to 0.5.5... but... | 18:51 |
| openstackgerrit | Merged openstack-infra/project-config: Make python-swiftclient functional tests voting https://review.openstack.org/181090 | 18:52 |
| fungi | jeblair: i think that's the race or races i was trying to figure out how to solve in 170317 | 18:52 |
| *** rm_work|away is now known as rm_work | 18:52 | |
| *** soren_ has joined #openstack-infra | 18:52 | |
| *** emagana has quit IRC | 18:53 | |
| *** david-lyle_ has joined #openstack-infra | 18:53 | |
| pleia2 | cinerama: nice! thanks for getting these drafts up | 18:53 |
| fungi | but that was a month ago and i got sidetracked in the middle and never got back to figuring it out | 18:53 |
| *** sputnik13 has joined #openstack-infra | 18:54 | |
| pleia2 | AJaeger_: great | 18:54 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: puppet: use a single image for CI https://review.openstack.org/177060 | 18:54 |
| pleia2 | cinerama: I've been keeping an eye on the bugs mailing list, I should do another run through of them though to make sure I didn't miss anything | 18:54 |
| *** craigbr has joined #openstack-infra | 18:54 | |
| *** soren_ has quit IRC | 18:55 | |
| *** soren_ has joined #openstack-infra | 18:55 | |
| *** emagana has joined #openstack-infra | 18:55 | |
| *** soren_ is now known as soren | 18:55 | |
| cinerama | pleia2: did we update the percentage bug with ajaeger's comments yet? i better do that if not | 18:55 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Update to gear 0.5.7 https://review.openstack.org/180334 | 18:55 |
| *** emagana has quit IRC | 18:55 | |
| jeblair | clarkb, fungi: ^ see response and one more patchset :) | 18:55 |
| pleia2 | cinerama: I don't think so | 18:56 |
| *** packet has quit IRC | 18:56 | |
| clarkb | jeblair: ya if order is important then you need to remove the code you removed otehrwise you would still get arbitrary release order | 18:56 |
| cinerama | right time for a bit of bug filing and gardening | 18:56 |
| pleia2 | cinerama: indeed! | 18:56 |
| *** david-lyle has quit IRC | 18:56 | |
| clarkb | jeblair: actually do you still need to hold in queue then let ordered_release release them? | 18:57 |
| *** david-lyle_ is now known as david-lyle | 18:57 | |
| *** packet has joined #openstack-infra | 18:57 | |
| *** reed has joined #openstack-infra | 18:57 | |
| jeblair | clarkb: the 'queue' code is okay -- it will actually cause jobs to _start_ in the order enqueued. but they finish randomly. the 'build' code determines when they finish (because orderedRelease waits until settled after each one) | 18:57 |
| clarkb | jeblair: right but they will have been released prior to getting there | 18:58 |
| jeblair | clarkb: oh drat, there's a reason the queue code needs to stay | 18:58 |
| *** Sukhdev has joined #openstack-infra | 18:58 | |
| clarkb | I think you want hold jobs in queue = true then run ordered release to release them in an order | 18:58 |
| jeblair | clarkb: nope, i'm wrong. it can go and the current ps is fine. | 18:58 |
| *** emagana has joined #openstack-infra | 18:59 | |
| clarkb | jeblair: then what is ordered release doing? | 18:59 |
| *** samueldmq has joined #openstack-infra | 18:59 | |
| clarkb | if we aren't holding anything there shouldn't be anything in the queue to release | 18:59 |
| jeblair | clarkb: it's causing the jobs to finish in a determined order, and finishing is what puts them in history[], and that's where we care about ordering | 18:59 |
| jeblair | clarkb: we're holding them in _build_, not queue | 18:59 |
| fungi | and build is the state after queue, right? | 19:00 |
| clarkb | oh release operates on build but not queuing, I thought it operated on queueing | 19:00 |
| fungi | at least that' | 19:00 |
| jeblair | fungi: yeah, it's "make jenkins take a long time to run" | 19:00 |
| *** sputnik1_ has joined #openstack-infra | 19:00 | |
| fungi | s the way i was following it | 19:00 |
| jeblair | fungi: where as queue is "make gearman wait before giving a job to jenkins" | 19:01 |
| fungi | normally if we hold in queue, then release it jumps from queue through build to release | 19:01 |
| fungi | as opposed to holding in build, where it's already finished queue | 19:01 |
| openstackgerrit | Merged openstack-infra/project-config: Decrease PO files for imports (horizon+friends) https://review.openstack.org/176943 | 19:01 |
| *** HeOS has joined #openstack-infra | 19:01 | |
| fungi | okay, my understanding seems to have been correct in that case. good ;) | 19:01 |
| jeblair | fungi, clarkb: https://etherpad.openstack.org/p/i2sEY3sVpf | 19:01 |
| *** sputnik13 has quit IRC | 19:02 | |
| fungi | btw, centos-6 post bindep and db prep passes nova py26 for stable/juno! jump for joy! | 19:02 |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Update bouncy castle libs for Gerrit 2.10+ https://review.openstack.org/172534 | 19:02 |
| greghaynes | clarkb: did the ubuntu-trusty build work? | 19:02 |
| clarkb | greghaynes: appears not to have | 19:03 |
| openstackgerrit | Merged openstack-infra/infra-manual: Adds project-gating description https://review.openstack.org/138595 | 19:03 |
| greghaynes | clarkb: womp womp | 19:03 |
| mordred | greghaynes: http://nodepool.openstack.org/dib.devstack-trusty.log | 19:03 |
| *** sputnik13 has joined #openstack-infra | 19:03 | |
| *** stevemar has joined #openstack-infra | 19:03 | |
| clarkb | jeblair: right and otherwise we could run 2,1 first because gearman | 19:03 |
| fungi | how do i get testr to tell me the list of skipped tests from the last run? | 19:04 |
| greghaynes | mordred: that looks like a success | 19:04 |
| clarkb | fungi: testr last --subunit | something iirc | 19:04 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: run beaker on both trusty & centos7 https://review.openstack.org/175434 | 19:04 |
| EmilienM | mordred: done sir ^^ | 19:04 |
| mordred | greghaynes: I agree | 19:04 |
| EmilienM | mordred: let me know if you like now | 19:04 |
| EmilienM | mordred: I meant, by the new patchset | 19:05 |
| lifeless | fungi: hi, pbr integration tests are faster than devstack now | 19:05 |
| lifeless | fungi: so I've stopped optimising them | 19:05 |
| *** sputnik1_ has quit IRC | 19:05 | |
| fungi | lifeless: yep. i just know you had expressed some concern about the i/o from the local clones | 19:05 |
| lifeless | yeah | 19:05 |
| mordred | EmilienM: why you did remove beaker tests from puppet storyboard? | 19:05 |
| EmilienM | mordred: nibalizer asked | 19:06 |
| lifeless | next steps for making it faster would be /opt/git use and a tempfs for the actual test work | 19:06 |
| lifeless | just little point right now | 19:06 |
| EmilienM | mordred: I wanted to do a separate patchset, but since we are refactoring beaker jobs... | 19:06 |
| EmilienM | I dropped all my non-tested modules too | 19:06 |
| mordred | ok | 19:06 |
| mordred | cool | 19:06 |
| clarkb | greghaynes: mordred http://paste.openstack.org/show/216388/ | 19:06 |
| jeblair | fungi: feel free to aprv (or -1) 180334 at will; i'm heading to lunch | 19:07 |
| fungi | jeblair: will do. was just waiting for the test results to come back on it | 19:07 |
| mordred | EmilienM: looks great to me | 19:07 |
| greghaynes | clarkb: different image than the one mordred linked | 19:07 |
| EmilienM | mordred: thx, will see if tests pass. I did not test it locally | 19:08 |
| clarkb | greghaynes: ah yup | 19:08 |
| clarkb | greghaynes: ubuntu-trusty is the node not devstack-trusty | 19:08 |
| *** ryanpetrello_ has joined #openstack-infra | 19:08 | |
| mordred | ah. duh | 19:08 |
| clarkb | mordred: greghaynes http://nodepool.openstack.org/image.log | 19:09 |
| clarkb | its there because we have to restart for the logging config changes | 19:09 |
| greghaynes | ah! | 19:09 |
| *** markmcclain1 has joined #openstack-infra | 19:09 | |
| clarkb | puppet failed | 19:10 |
| nibalizer | ya the storyboard tests never went anywhere | 19:10 |
| clarkb | did we actualyl build this image before proposing it? | 19:10 |
| clarkb | I didn't because it will take me ~1.5 hours to do so, but maybe we need to do that | 19:10 |
| greghaynes | yea, puppet | 19:10 |
| greghaynes | :( | 19:10 |
| greghaynes | clarkb: no | 19:10 |
| greghaynes | (re did I actually test that image) | 19:11 |
| *** wayneeseguin has joined #openstack-infra | 19:11 | |
| clarkb | greghaynes: msotly that was directed at mordred :) | 19:11 |
| clarkb | but it looks like normal puppety things fail | 19:11 |
| clarkb | so should be easy to reproduce | 19:12 |
| *** freerunner has quit IRC | 19:12 | |
| clarkb | note I did confirm that dib 0.1.44 is installed so I don't think that is a problem | 19:12 |
| * pleia2 does jenkins02 now | 19:13 | |
| mordred | I did | 19:13 |
| clarkb | mordred: with the puppet stuff? | 19:13 |
| mordred | yah - so I' not sure why that's failng - also, we shoudl be explicitly installing dhclient in the element | 19:14 |
| clarkb | mordred: looks like rsyslog may not be included | 19:14 |
| mordred | hrm | 19:14 |
| mordred | maybe I tested locally with the wrong set of elements | 19:14 |
| clarkb | mordred: ya so dhclient and rsyslog are both missing from ubuntu minimal | 19:14 |
| clarkb | which is :( because both should be unoptional | 19:14 |
| mordred | yah. well, I'm confused, because I explicitly added dhclient | 19:15 |
| mordred | since it networking not so much with working without it | 19:15 |
| clarkb | mordred: did that get into the dib shipped element? | 19:15 |
| mordred | checking | 19:15 |
| fungi | clarkb: to answer my question from earlier, activate the venv and then `testr last --subunit|subunit-filter --no-success|subunit-ls` | 19:15 |
| clarkb | or possibly the package installs are not able to write to /etc for some reason | 19:15 |
| mordred | isc-dhcp-client: | 19:15 |
| mordred | is in simple-init package-installs.yaml | 19:16 |
| clarkb | mordred: what about isc-dhcp-common? | 19:16 |
| greghaynes | mordred: did you include simple-init? | 19:16 |
| clarkb | thats a dep of the client so would expect it to get pulled in | 19:16 |
| *** zul has quit IRC | 19:16 | |
| *** markmcclain1 is now known as markmcclain | 19:16 | |
| mordred | NO | 19:17 |
| greghaynes | hah | 19:17 |
| mordred | greghaynes: that's it | 19:17 |
| greghaynes | :) | 19:17 |
| greghaynes | I do that all the time when I dev | 19:17 |
| mordred | I had it in my test script :) | 19:18 |
| clarkb | does simple-init fix rsyslog? if so that would be really weird | 19:18 |
| greghaynes | clarkb: probably not | 19:18 |
| mordred | no. it does not. so I don't know why that doesn't work | 19:18 |
| *** sputnik1_ has joined #openstack-infra | 19:19 | |
| jeblair | pleia2: it is raining here; the weather is coming from the east. it's freaking me out a bit. :) | 19:19 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Add script to split the secret hieradata file https://review.openstack.org/179653 | 19:20 |
| AJaeger_ | cinerama: Can we map VERSION to branches? Like have master and stable/kilo as separate versions? | 19:21 |
| AJaeger_ | That would be GREAT! | 19:21 |
| openstackgerrit | Kyle Mestery proposed openstack-infra/project-config: Be explicit about what services we enable for ODL https://review.openstack.org/181124 | 19:21 |
| *** sputnik13 has quit IRC | 19:22 | |
| pleia2 | jeblair: fortunately still dry here, I'm sure it'll start up as soon as I have to walk to caltrain this afternoon | 19:22 |
| pleia2 | jenkins02 is back up w/ new gearman plugin | 19:23 |
| clarkb | pleia2: lgtm | 19:23 |
| cinerama | AJaeger_: that's not a bad idea | 19:23 |
| clarkb | pleia2: you can probably go ahead and do jenkins-dev/jenkins.o.o at this point while waiting for 01. They should both be very quick | 19:23 |
| pleia2 | going to put jenkins.o.o into shutdown mode, and might be able to do it right away since it's quiet | 19:23 |
| pleia2 | :) | 19:24 |
| sdague | dstufft: so... lifeless filed an upstream cffi bug about the writable directory issue - https://bitbucket.org/cffi/cffi/issue/190/cffi-assumes-write-access-to-installed | 19:24 |
| sdague | and the response so far has been less than promissing | 19:25 |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config: Add CloudPulse https://review.openstack.org/181125 | 19:25 |
| sdague | might you know anyone that could explain the pain point better? | 19:25 |
| openstackgerrit | Stephanie Miller proposed openstack-infra/project-config: [WIP] Draft proposal scripts for zanata https://review.openstack.org/181113 | 19:25 |
| mordred | dstufft knows everyone | 19:25 |
| sdague | or that the cffi maintainer might listen to | 19:25 |
| sdague | right, that's why I'm askin :) | 19:25 |
| pleia2 | clarkb: should I clean up jenkins-dev? | 19:26 |
| dstufft | arigato isn't online right now, he's in some euro TZ | 19:26 |
| clarkb | pleia2: I lean towards no, those are likely all stale but they are manually managed for the most part | 19:26 |
| mordred | I mean, I hear his concern | 19:27 |
| pleia2 | clarkb: thanks, that's what I figured, putting into shutdown mode now, and j.o.o is done | 19:27 |
| clarkb | pleia2: awesome | 19:27 |
| mordred | I don't think lifeless solution being adopted is the important thing - I think the important thing is to not die when you can't write to a dir | 19:27 |
| mordred | right? | 19:27 |
| clarkb | pleia2: I am fixing up the nodepool testing directions now | 19:27 |
| clarkb | mordred: yes | 19:27 |
| clarkb | mordred: but I am biased because I threw that idea out there when everything is broken | 19:28 |
| sdague | mordred: correct, the issue is there is an assumption in the current code that you can always write to your installed directory as a fallback if things go wrong | 19:28 |
| mordred | yah | 19:28 |
| dstufft | mordred: so the question becomes, do you need it to work with the old API or is it working with the new API good enough | 19:28 |
| sdague | which is not true outside of a venv | 19:28 |
| dstufft | because the old API relies a ton of implicitly compiling | 19:28 |
| dstufft | it takes a signifcant chunk of effort to use the old way in a way that doesn't rely on it | 19:29 |
| sdague | dstufft: well, it would be nice to have some non explode case on the old API | 19:29 |
| clarkb | yes old vs new api isn't really relevant | 19:29 |
| clarkb | new api does not exist yet | 19:29 |
| clarkb | old api is broken | 19:29 |
| clarkb | there is a trivial fix for old api to keep things working | 19:29 |
| clarkb | lets do that | 19:29 |
| greghaynes | I dont get the push back for performance - its trying to compile the code in this case anyways so its not making it less performant that it succeeds in doing this... | 19:30 |
| sdague | also, it takes time for people to move to API | 19:30 |
| clarkb | mordred: also if you have a wheel mirror that you built say with devpi or pypi-mirror you will have to completely rebuilt it if/when cffi changes | 19:30 |
| greghaynes | I mean, I guess actually succeeding *is* slower than exit 1 | 19:30 |
| dstufft | greghaynes: once it's compiled and successfully saved you don't pay that cost the second time you import it | 19:30 |
| dstufft | is what he means | 19:30 |
| greghaynes | dstufft: yes, this is only relevant in the case where its already trying to compile though | 19:30 |
| mordred | I would say that compilation on import is about the worst idea anyone has ever had | 19:31 |
| sdague | right, for daemons, the overhead is going to be *meh* | 19:31 |
| mordred | quite literally | 19:31 |
| mordred | it's INSANE | 19:31 |
| dstufft | mordred: yea | 19:31 |
| dstufft | it's bad | 19:31 |
| *** zul has joined #openstack-infra | 19:31 | |
| openstackgerrit | Merged openstack-infra/zuul: Update to gear 0.5.7 https://review.openstack.org/180334 | 19:31 |
| dstufft | it's going away | 19:31 |
| sdague | for cli tools, it would get crazy | 19:31 |
| dstufft | :) | 19:31 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Project does not mean repository? Inconceivable! https://review.openstack.org/176469 | 19:31 |
| sdague | mordred: yes, cffi is crazy pants has been my moto since we figured out it did that | 19:31 |
| dstufft | I can maybe talk him into a fallback and printing a warning | 19:31 |
| mordred | cool | 19:31 |
| sdague | dstufft: that would be awesome | 19:31 |
| dstufft | as a hold over until cffi 1.0 is a thing and takes over the world or whatever | 19:32 |
| *** mpopow has joined #openstack-infra | 19:32 | |
| sdague | being verbose to the user that it's doing this thing which is terrible, but not exploding, and here is how they could fix it would be a great graceful fallback here | 19:32 |
| *** craigbr has quit IRC | 19:33 | |
| lifeless | mordred: so yes, my implementation sketch is irrelevant | 19:33 |
| mordred | lifeless: nothing you ever do is irrelevant | 19:33 |
| lifeless | mordred: the concern is the author preferring things die at runtime | 19:33 |
| lifeless | mordred: to actually following the semantics of every other python module ever | 19:33 |
| AJaeger_ | cinerama: as discussed yesterday, I suggest to first do the upstream_translation_update.sh script - the script that pushes to Zanata/Transifex | 19:34 |
| lifeless | greghaynes: the concern is that if you have a process doing a lot of fork/spawns | 19:34 |
| AJaeger_ | We can merge that change any time you like (as soon as we consider zanata testable) | 19:34 |
| lifeless | greghaynes: then it would suddenly have a go slow sad in the event that this is triggered | 19:34 |
| cinerama | AJaeger_: i had a look at that - the main thing is that i think there's a bug in the push that means we'll need to supply more data to it than we should have to | 19:34 |
| sdague | it would also be nice if the die error message was a lot more clear, it took us a really long time to figure out that there even was another cffi that had gotten involved | 19:34 |
| AJaeger_ | cinerama: ;( | 19:35 |
| sdague | if it had died with "this was built with cffi 1.0beta, but 0.9.2 is available, rebuilding" | 19:35 |
| sdague | that would have been huge time saving in figuring out the issue | 19:35 |
| fungi | zaro: if versioncmp($gerrit_war_version, '2.10') > 0 | 19:36 |
| fungi | zaro: that's some interesting magic | 19:36 |
| pleia2 | clarkb: and now jenkins-dev and jenkins01 all done \o/ | 19:36 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Actually include simple-init for minimal images https://review.openstack.org/181129 | 19:36 |
| Clint | hey folks | 19:36 |
| Clint | what does the following error indicate? | 19:37 |
| Clint | Code Review - Error | 19:37 |
| Clint | Server Error | 19:37 |
| Clint | Cannot store contact information | 19:37 |
| greghaynes | lifeless: yea, thats an issue with the mktemp impl. but that can be worked around I think | 19:37 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Document running Nodepool for testing https://review.openstack.org/179840 | 19:37 |
| clarkb | pleia2: ^ I stubbed out the glanceclient stuff because I don't know it off the top of my head | 19:38 |
| SpamapS | Clint: when trying to save your contact info on review.openstack.org yes? | 19:38 |
| clarkb | pleia2: but everything else should be good in there I think | 19:38 |
| Clint | SpamapS: correct | 19:38 |
| fungi | Clint: usually that either your foundation member profile primary e-mail doesn't match your gerrit preferred e-mail, or that your foundation account is community instead of foundation member, or that you don't have a foundation account, or that the network between gerrit and the foundation member system is broken, or that the foundation member system itself is broken/down | 19:38 |
| greghaynes | sdague: I think there is a bug in CFFI around that - it had a routine to ensure the build dir exists and it looked like that method was silently failing | 19:38 |
| pleia2 | clarkb: great, I'll comment w/ glance stuff when I test this afternoon, going to grab lunch momentarily though | 19:38 |
| *** ociuhandu has quit IRC | 19:38 | |
| lifeless | greghaynes: feel free to help negotiate an outcome upstream will accept | 19:38 |
| lifeless | greghaynes: I'm about 2 functions away from a working resolver impl in pip | 19:39 |
| clarkb | pleia2: so jenkins is done done? thanks for helping out | 19:39 |
| pleia2 | clarkb: all done! | 19:39 |
| sdague | lifeless: \o/ | 19:39 |
| lifeless | greghaynes: I really want that to get over the hump into cleanup and polish | 19:39 |
| greghaynes | lifeless: ooo | 19:40 |
| lifeless | greghaynes: so I'm not going to take on big timesinks right now | 19:40 |
| greghaynes | lifeless: yea, fair enough | 19:40 |
| lifeless | https://github.com/pypa/pip/pull/2716/ | 19:40 |
| lifeless | sdague: greghaynes: ^ if you're interested in some late-prototype stage stuff | 19:40 |
| Clint | fungi: thanks, it works now | 19:42 |
| *** erikmwilson has quit IRC | 19:42 | |
| *** ildikov has quit IRC | 19:43 | |
| clarkb | pleia2: also I totally have nested heredocs in that change <_< | 19:43 |
| *** david-lyle has quit IRC | 19:43 | |
| AJaeger_ | thanks pleia2 for your quick +2 on fungi's great https://review.openstack.org/176469 "Project does not mean repository? Inconceivable!". I suggest to merge that soonish - any other cores for the infra-manual up for it, please? | 19:43 |
| clarkb | AJaeger_: I can review it | 19:44 |
| fungi | yeah, it has a distinct chance to backslide into merge conflicts | 19:44 |
| AJaeger_ | clarkb: thanks - it's a larger change which leads to merge conflicts | 19:45 |
| AJaeger_ | fungi: this time it was no merge conflict, just me noticing that the new change (which I edited) needed adjustment | 19:45 |
| *** mrmartin has quit IRC | 19:46 | |
| pleia2 | AJaeger_: sure thing | 19:46 |
| pleia2 | ok, lunch | 19:47 |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Update bouncy castle libs for Gerrit 2.10+ https://review.openstack.org/172534 | 19:47 |
| clarkb | fungi: it bugs me slightly that the governance yaml does tags: name: team:diverseaffiliation. Far too many dict nested levels there | 19:48 |
| zaro | fungi: ^ yeah, that versioncmp works. | 19:48 |
| mordred | clarkb: docker should fix that | 19:48 |
| clarkb | mordred: I knew it | 19:49 |
| zaro | fungi: not sure how else to extract the version info besides doing those multiple splits | 19:49 |
| cinerama | AJaeger_: oh i forgot there is also another thing where if you use the locale name mapping, it says it's not going to work but then it does | 19:49 |
| clarkb | mordred: btw I am using docker for jenkins testing because mvn hpi:run explodes for me | 19:49 |
| cinerama | AJaeger_: that's a frustrating one | 19:49 |
| mordred | clarkb: it's really good at that sort of thing isn't it? | 19:49 |
| *** craigbr has joined #openstack-infra | 19:49 | |
| clarkb | mordred: ya, my only major complaint (and I now know that others have fixed this) is that ubuntu images are useless for running services as services | 19:50 |
| AJaeger_ | cinerama: hearing some of your comments, I sometimes wonder whether zanata was the right choice. Thanks for tackling it! | 19:50 |
| *** yamahata has quit IRC | 19:50 | |
| clarkb | mordred: its kinda nice saying start that container and getting a booted image with services running properly | 19:50 |
| zaro | clarkb: are you hpi:runing with same version as on jenkins.o.o? | 19:50 |
| *** gokrokve has joined #openstack-infra | 19:51 | |
| clarkb | zaro: I am running hpi:run inside the repo of the plugin | 19:51 |
| *** Krinkle|detached is now known as Krinkle | 19:51 | |
| cinerama | AJaeger_: on the upside there are some neat features and the team have been very responsive and helpful | 19:51 |
| AJaeger_ | cinerama: definitely | 19:51 |
| clarkb | AJaeger_: fungi this change is huge :P | 19:52 |
| zaro | clarkb: ohh yeah, i forgot the version is set in the pom.xml | 19:53 |
| zaro | clarkb: i would try 'mvn clean hpi:run' | 19:53 |
| fungi | clarkb: big change for a big tent | 19:53 |
| clarkb | zaro: I did that failed too | 19:53 |
| clarkb | zaro: the only thing I haven't tried is killing my local maven repo cache | 19:54 |
| *** ajmiller has joined #openstack-infra | 19:54 | |
| fungi | zaro: the splits are fine. i'm just amused by the comparison function and the fact that you (and the puppet example) use >0 rather than ==1 when the function never returns anything higher than 1 anyway | 19:54 |
| zaro | clarkb: that's what i was going to suggest next | 19:54 |
| clarkb | but I decided to spin up my jenkins docker container would be quicker so did that instead | 19:54 |
| *** heyongli has quit IRC | 19:55 | |
| *** gokrokve has quit IRC | 19:55 | |
| *** marun has quit IRC | 19:56 | |
| openstackgerrit | Merged openstack-infra/infra-manual: Project does not mean repository? Inconceivable! https://review.openstack.org/176469 | 19:57 |
| AJaeger_ | clarkb: thanks for reviewing and approving it! | 19:57 |
| zaro | fungi: actually i wasn't following an example, just happended by chance. Maybe provides more leaway in case never versions of the function extend the return value? | 19:57 |
| fungi | zaro: perhaps. anyway, that change lgtm | 19:57 |
| zaro | fungi: wondering if we care whether people think 2.9 would still work because i don't think it will | 19:58 |
| openstackgerrit | Derek Higgins proposed openstack-infra/system-config: Add a Fedora 21 node to tripleo cloud https://review.openstack.org/169778 | 19:58 |
| zaro | still work/still work with that change | 19:58 |
| openstackgerrit | Derek Higgins proposed openstack-infra/project-config: Add in F21 nonha job https://review.openstack.org/181136 | 19:58 |
| *** ildikov has joined #openstack-infra | 19:59 | |
| fungi | zaro: do you sustect that matching on >=2.9 instead of >=2.10 is warranted? | 19:59 |
| fungi | er, suspect | 19:59 |
| *** sputnik1_ is now known as sputnik13 | 20:00 | |
| *** tnovacik has quit IRC | 20:00 | |
| zaro | fungi: i don't know if that works either. i think gerrit may require different lib for 2.8, 2.9, and 2.10 | 20:01 |
| *** heyongli has joined #openstack-infra | 20:01 | |
| *** salv-orlando has joined #openstack-infra | 20:01 | |
| *** annegentle has quit IRC | 20:02 | |
| fungi | zaro: and the version that 2.10 requires is too _new_ to work with 2.9? | 20:02 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: run beaker on both trusty & centos7 https://review.openstack.org/175434 | 20:02 |
| *** annegentle has joined #openstack-infra | 20:02 | |
| *** AJaeger_ has quit IRC | 20:03 | |
| zaro | fungi: actually, looking at commit msg for https://review.openstack.org/#/c/151368/ shows that 2.8 & 2.9 work with the same libs. so looks like 2.9 is safe. | 20:03 |
| fungi | okay, cool. thanks for double-checking that | 20:03 |
| *** achanda has quit IRC | 20:04 | |
| *** achanda has joined #openstack-infra | 20:04 | |
| *** heyongli has quit IRC | 20:05 | |
| *** SumitNaiksatam has quit IRC | 20:06 | |
| *** SumitNaiksatam has joined #openstack-infra | 20:06 | |
| *** baoli has joined #openstack-infra | 20:07 | |
| *** sputnik1_ has joined #openstack-infra | 20:08 | |
| *** alexpilotti has quit IRC | 20:08 | |
| *** teran has joined #openstack-infra | 20:08 | |
| *** otter768 has joined #openstack-infra | 20:08 | |
| *** achanda has quit IRC | 20:08 | |
| *** baoli has quit IRC | 20:08 | |
| *** bknudson has joined #openstack-infra | 20:09 | |
| *** alexpilotti has joined #openstack-infra | 20:09 | |
| *** baoli has joined #openstack-infra | 20:09 | |
| *** ajmiller_ has joined #openstack-infra | 20:10 | |
| *** frobware_ has quit IRC | 20:10 | |
| *** heyongli has joined #openstack-infra | 20:10 | |
| *** sputnik13 has quit IRC | 20:11 | |
| *** baoli has quit IRC | 20:13 | |
| *** otter768 has quit IRC | 20:13 | |
| *** ajmiller has quit IRC | 20:13 | |
| *** baoli has joined #openstack-infra | 20:13 | |
| *** rkukura has quit IRC | 20:15 | |
| *** alexpilotti has quit IRC | 20:16 | |
| *** Krinkle is now known as Krinkle|detached | 20:16 | |
| *** salv-orlando has quit IRC | 20:16 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Update bouncy castle libs for Gerrit 2.10+ https://review.openstack.org/172534 | 20:16 |
| *** erikmwilson_ is now known as erikmwilson | 20:17 | |
| fungi | looking like graphite may be unhappy. checking on it now | 20:17 |
| zaro | fungi: ^ ok, just updated that info in commit message. | 20:17 |
| fungi | [Thu May 7 19:35:19 2015] Out of memory: Kill process 30401 (carbon-cache.py) score 752 or sacrifice child | 20:17 |
| fungi | i'll start it back up | 20:17 |
| *** craigbr has quit IRC | 20:17 | |
| *** Longgeek has quit IRC | 20:18 | |
| *** craigbr has joined #openstack-infra | 20:18 | |
| fungi | wow, statsd runs under node? | 20:18 |
| fungi | it's eating 840m of virtual memory on its own | 20:18 |
| greghaynes | theres about a thousand alternate implementations | 20:19 |
| *** pothole is now known as ptoohill | 20:19 | |
| pleia2 | ew | 20:19 |
| greghaynes | many in python | 20:19 |
| fungi | lifeless: heads up, 0.0.1 now at https://pypi.python.org/pypi/bindep (i've been exercising it fairly heavily before pushing the tag, so should be pretty solid) | 20:20 |
| *** alexpilotti has joined #openstack-infra | 20:21 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: run beaker on both trusty & centos7 https://review.openstack.org/175434 | 20:24 |
| fungi | graphite should start working again now. looks like carbon-cache likes to go a little bonkers with memory http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=443&rra_id=all | 20:25 |
| *** gokrokve has joined #openstack-infra | 20:26 | |
| *** ajmiller_ has quit IRC | 20:27 | |
| *** freerunner has joined #openstack-infra | 20:27 | |
| *** b^_^d has joined #openstack-infra | 20:27 | |
| *** gokrokve has quit IRC | 20:28 | |
| *** gokrokve has joined #openstack-infra | 20:28 | |
| *** alexpilotti has quit IRC | 20:29 | |
| *** ajmiller has joined #openstack-infra | 20:29 | |
| *** nikhil_k-afk is now known as nikhil_k | 20:29 | |
| *** sdake_ has quit IRC | 20:29 | |
| *** baoli has quit IRC | 20:29 | |
| *** rbradfor_ has joined #openstack-infra | 20:30 | |
| *** emagana has quit IRC | 20:31 | |
| mordred | fungi this is the second time this week | 20:31 |
| fungi | mordred: yeah, judging from the graph, happened 4 days ago too | 20:31 |
| mordred | maybe we've finally hit the graphite scaling point where we need to start caring about it | 20:32 |
| clarkb | or we CD'd a new bug | 20:32 |
| *** emagana has joined #openstack-infra | 20:32 | |
| fungi | are you saying it feels unloved and neglected? | 20:32 |
| greghaynes | caring about graphite will only make you unhappy | 20:32 |
| *** tonytan4ever has quit IRC | 20:33 | |
| *** Swami has quit IRC | 20:33 | |
| *** freerunner has quit IRC | 20:34 | |
| *** freerunner has joined #openstack-infra | 20:34 | |
| *** baoli has joined #openstack-infra | 20:35 | |
| greghaynes | didnt youall recently add a bunch of statsd keys from nodepool? | 20:35 |
| *** bnemec has quit IRC | 20:36 | |
| clarkb | not too many just 2 per cloud? | 20:36 |
| cinerama | AJaeger, pleia2: oh cool, we have a workaround for our bug i think | 20:38 |
| EmilienM | mordred: sorry, I had to fix another error I did, can you +2 again? | 20:38 |
| pleia2 | cinerama: yay! | 20:38 |
| cinerama | pleia2, AJaeger: so the url in the zanata.ini didn't match the one in the zanata.xml we pulled down from the server | 20:38 |
| cinerama | pleia2, AJaeger: when i adjust it it looks fine. so push should be easier | 20:38 |
| *** wenlock has quit IRC | 20:39 | |
| *** wenlock has joined #openstack-infra | 20:40 | |
| *** ibiris is now known as ibiris_away | 20:40 | |
| pleia2 | cinerama: ok, good | 20:40 |
| *** teran_ has joined #openstack-infra | 20:41 | |
| *** stevemar has quit IRC | 20:42 | |
| cinerama | it's still a bug but we can do the push sooner | 20:42 |
| * pleia2 nods | 20:42 | |
| *** teran has quit IRC | 20:43 | |
| cinerama | and i've updated the bug now | 20:43 |
| *** achanda has joined #openstack-infra | 20:44 | |
| pleia2 | thanks | 20:44 |
| *** marun has joined #openstack-infra | 20:44 | |
| cinerama | pleia2: can you do me a favour? i'm pretty sure we don't have per-file push in zanata-cli push but can you look at the help etc real quick and see if i'm missing something? | 20:45 |
| * pleia2 has a look | 20:46 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Upgrade Gerrit from 2.8 to ver 2.10 on review.o.o https://review.openstack.org/155463 | 20:46 |
| tchaypo | well that’s a fun migration gertty is doing | 20:46 |
| tchaypo | I think this is a good time to go get some coffee | 20:47 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/puppet-openstackci: Create a jenkins server like http://jenkins.openstack.org https://review.openstack.org/175571 | 20:47 |
| *** SumitNaiksatam has quit IRC | 20:49 | |
| pleia2 | cinerama: they have a shiny new docs.zanata.org as of today, but aaahh finding things | 20:50 |
| cinerama | pleia2: i know right | 20:50 |
| *** e0ne has quit IRC | 20:51 | |
| *** bnemec has joined #openstack-infra | 20:51 | |
| cinerama | pleia2: do you think i should change the script so that we get the matching URL when we generate zanata.xml? | 20:51 |
| cinerama | pleia2: we should be able to just replace that bit in the xml | 20:52 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Update Gerrit to newer 2.10 build on review-dev.o.o https://review.openstack.org/181143 | 20:52 |
| pleia2 | cinerama: so based on my analysis, it looks like the best we can do is something like using --excludes or --includes for the directory we point it at, but that's a huge mess | 20:52 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/system-config: Use common jenkins master implementation https://review.openstack.org/177373 | 20:52 |
| cinerama | pleia2: yep, that's what i thought. i just like a sanity check before i make big, sweeping statements | 20:52 |
| pleia2 | cinerama: re: URL, yeah, I think so | 20:53 |
| cinerama | pleia2: like i said before i do have an implementation of file-by-file pull, it's just a bit yucky | 20:54 |
| *** amitgandhinz has quit IRC | 20:54 | |
| cinerama | pleia2: basically some lightly modded code from the python client. i would rather not use since i think that might be too much maintenance burden | 20:54 |
| *** baoli has quit IRC | 20:55 | |
| pleia2 | cinerama: right, agreed | 20:56 |
| cinerama | pleia2: not that we COULDN'T do it but we might have different priorities | 20:56 |
| *** baoli has joined #openstack-infra | 20:56 | |
| *** bswartz has quit IRC | 20:57 | |
| pleia2 | cinerama: yeah, long term it seems like a bad idea | 20:57 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Upgrade Gerrit from 2.8 to ver 2.10 on review.o.o https://review.openstack.org/155463 | 20:57 |
| pleia2 | particularly as upstream seems happy to add features we need to the java client, eventually | 20:57 |
| cinerama | pleia2: if the json we got back from the server changed we'd be in for a hard time | 20:57 |
| cinerama | filing that bug | 20:58 |
| cinerama | i'm surprised i hadn't before, i think i was just trying to get stuff working | 20:58 |
| *** Sukhdev has quit IRC | 20:58 | |
| pleia2 | cinerama: nods | 20:58 |
| pleia2 | woo moving parts | 20:58 |
| *** amitgandhinz has joined #openstack-infra | 21:00 | |
| fungi | centos-6 y u no liek local auth without ident? what a silly configuration default | 21:01 |
| *** teran has joined #openstack-infra | 21:01 | |
| *** teran_ has quit IRC | 21:01 | |
| fungi | and now that's ironed out, mysql authentication is being silly on me too | 21:02 |
| fungi | it will let me authenticate as openstack_citest without a password, but not with the password i set for it | 21:03 |
| *** tnovacik has joined #openstack-infra | 21:03 | |
| jeblair | tchaypo: are you happy about the output from the migration? | 21:03 |
| *** annegentle has quit IRC | 21:04 | |
| tchaypo | jeblair: in that it tells me what is happening, and what the progress is, and gives me a strong hint that now is a good time to go for a coffee? | 21:04 |
| tchaypo | yeah, it’s brilliant | 21:04 |
| *** aysyd has quit IRC | 21:04 | |
| tchaypo | *checks* oh, and it’s hit some it can’t index too, and it’s telling me why | 21:05 |
| tchaypo | *reads again* actualy it’s not telling me why, it’s two difference messages - one for empty diffstats and one for “unable to examine diff" | 21:05 |
| *** sdake has joined #openstack-infra | 21:08 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Use shade to get the client objects https://review.openstack.org/168603 | 21:08 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/puppet-openstackci: Create a jenkins server like http://jenkins.openstack.org https://review.openstack.org/175571 | 21:08 |
| lifeless | fungi: cool; tell mgedmin :) | 21:08 |
| lifeless | fungi: also, was my being unable to release bindep deliberate? | 21:08 |
| *** Swami has joined #openstack-infra | 21:08 | |
| fungi | lifeless: nope. none of us could. the bindep-release group was empty | 21:08 |
| fungi | lifeless: i added you and infra-core | 21:09 |
| greghaynes | clarkb: let me know if https://review.openstack.org/#/c/168603 was what you were looking for in terms of tests, or if theres some other cases I should hit | 21:09 |
| lifeless | fungi: ah, cool. thanks! | 21:09 |
| *** jog0 has joined #openstack-infra | 21:09 | |
| *** jog0 has quit IRC | 21:09 | |
| *** jog0 has joined #openstack-infra | 21:09 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/puppet-jenkins: Adds jenkins default file https://review.openstack.org/178749 | 21:09 |
| fungi | lifeless: sure thing. i didn't know you had tried to release it. probably lost in the mountain of recent scrollback. sorry about that! | 21:09 |
| *** _nadya_ has joined #openstack-infra | 21:09 | |
| lifeless | fungi: all good | 21:10 |
| fungi | lifeless: i would expect to do a 1.0.0 soonish, just wanted to start with 0.0.1 until i was sure we had it working in automation reliably | 21:10 |
| lifeless | fungi: I tried when mgedmin asked for one, failed, pinged you (lost in noise) | 21:10 |
| lifeless | fungi: +1 | 21:10 |
| *** jogo has quit IRC | 21:11 | |
| fungi | it's worked great on our new minimal centos-6 workers. my current struggles are pgsql/mysql related now | 21:11 |
| *** sdake_ has joined #openstack-infra | 21:11 | |
| fungi | GRANT ALL PRIVILEGES ON *.* TO 'openstack_citest'@'%' identified by 'openstack_citest'; | 21:13 |
| fungi | that works fine | 21:13 |
| fungi | mysql -u openstack_citest -popenstack_citest | 21:13 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/puppet-openstackci: Simple script to setup and test jenkins server https://review.openstack.org/181149 | 21:13 |
| fungi | ERROR 1045 (28000): Access denied for user 'openstack_citest'@'localhost' (using password: YES) | 21:13 |
| fungi | why?!? | 21:13 |
| greghaynes | hah | 21:13 |
| greghaynes | fungi: this isnt the issue, but I also have to give grant perms to run infra tests since youall create and drop db's | 21:14 |
| *** _nadya_ has quit IRC | 21:14 | |
| greghaynes | fungi: also, did you flush? | 21:14 |
| jeblair | fungi: do you need to 'flush privileges'? | 21:14 |
| fungi | explicit -h 127.0.0.1 doesn't help either | 21:14 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Update query for bug 1403291 https://review.openstack.org/181150 | 21:14 |
| openstack | bug 1403291 in neutron "VM's fail to receive DHCPOFFER messages" [Critical,Fix released] https://launchpad.net/bugs/1403291 - Assigned to Kevin Benton (kevinbenton) | 21:14 |
| fungi | jeblair: oh! maybe. i didn't need to on ubuntu | 21:14 |
| fungi | doesn't seem to help, no | 21:15 |
| fungi | still gives me access denied | 21:15 |
| *** tiswanso has quit IRC | 21:15 | |
| *** sdake has quit IRC | 21:15 | |
| jeblair | fungi: have a node i can poke at? | 21:15 |
| mordred | did you remove the anonymous user | 21:16 |
| fungi | given that their postgresql default config insisted that ident needed to return the same local username, i wouldn't be surprised if this is more paranoid config wonkery | 21:16 |
| *** ldnunes has quit IRC | 21:16 | |
| *** EmilienM is now known as EmilienM|afk | 21:16 | |
| fungi | i did not, though again on ubuntu it didn't seem to matter | 21:16 |
| fungi | jeblair: 104.239.167.6 | 21:16 |
| fungi | jeblair: admin password is insecure_slave as usual | 21:16 |
| *** baoli has quit IRC | 21:16 | |
| clarkb | fungi: you have to grant with grant option | 21:16 |
| asselin | tristanC, jenkins change is getting complicated...we really should avoid moving too many things at once..... | 21:17 |
| clarkb | fungi: not sure if related to your error but tests will need that | 21:17 |
| *** baoli has joined #openstack-infra | 21:17 | |
| nibalizer | asselin: ++ | 21:17 |
| tristanC | asselin: yes I agree :) | 21:17 |
| clarkb | nibalizer: I was looking for your changes toda and they don't seem to have the right topic? | 21:17 |
| fungi | clarkb: interesting. i copied what we were doing in devstack, but perhaps that's insufficient | 21:17 |
| asselin | tristanC, so let's keep and simple. Move stuff around...keep it consistent. Improve on it later. | 21:17 |
| openstackgerrit | greghaynes proposed openstack-infra/system-config: Add simple-init element to devstack-trusty image https://review.openstack.org/181151 | 21:18 |
| clarkb | fungi: ya devstack only uses a single db per service, but in db per test we have to haev the extra perms | 21:18 |
| asselin | tristanC, /and/it/ | 21:18 |
| fungi | clarkb: thanks. i'll try to tease that out of our puppet class | 21:18 |
| asselin | fbo, ^^ re jenkins change | 21:19 |
| clarkb | pleia2: for https://review.openstack.org/#/c/179840/2/doc/source/testing.rst can you check if sourcing devstack/openrc works for image uploads | 21:19 |
| clarkb | pleia2: I think that uses the admin account too? | 21:19 |
| jeblair | fungi: datapoint -- setting the host value for that user to 'localhost' makes it work. | 21:19 |
| *** rbradfor_ has quit IRC | 21:19 | |
| fungi | jeblair: curious. perhaps that's host lookup being a problem | 21:20 |
| tristanC | asselin: so let's abandon this one https://review.openstack.org/#/c/178760/ and make https://review.openstack.org/#/c/177373/ depends on https://review.openstack.org/#/c/178749/ | 21:20 |
| * asselin looks | 21:20 | |
| *** dprince has quit IRC | 21:20 | |
| fungi | jeblair: what's odd is that openstack_citest can log in with no password | 21:20 |
| fungi | so maybe it is anon getting in the way as mordred suggests? | 21:21 |
| clarkb | pleia2: beacuse I didn't have to do anything special if using the openrc, uploads just worked | 21:21 |
| clarkb | pleia2: I suppose it could also be a config thing | 21:21 |
| *** cdent has quit IRC | 21:21 | |
| *** dkranz has quit IRC | 21:21 | |
| jeblair | fungi: well, i think you end up as the anon user in that case | 21:21 |
| mordred | always remove anon usee | 21:21 |
| mordred | user | 21:21 |
| fungi | clarkb: i'm missing where we specify an extra grant option at https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/slave_db.pp | 21:21 |
| asselin | tristanC, ok and bring https://review.openstack.org/#/c/177373 back to patch set 1? | 21:22 |
| pleia2 | clarkb: I'll check | 21:22 |
| clarkb | fungi: I think its a side effect of https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/slave_db.pp#n61 | 21:22 |
| clarkb | fungi: but can double check | 21:22 |
| *** packet has quit IRC | 21:23 | |
| clarkb | fungi: fwiw pleia2 and I ran into it in 179840 | 21:23 |
| tristanC | asselin: yep! | 21:23 |
| asselin | tristanC, honestly, I thought having the jenkins.default as part of puppet-openstackci just fine. | 21:23 |
| fungi | clarkb: oh, so all privileges in puppet may mean more than "grant all privileges"? | 21:23 |
| jeblair | mordred, fungi: yeah, dropping the anon user works | 21:23 |
| *** weshay has quit IRC | 21:23 | |
| pleia2 | clarkb: using latest devstack, devstack/openrc uses the demo account as a default, so you'd have to set OS_PASSWORD and OS_USERNAME | 21:23 |
| fungi | jeblair: mordred: perfect--thanks. i'll make sure to have our setup tooling always do that first thing | 21:23 |
| asselin | tristanC, that really should be moved again after it merged....need to see what th eissue really was.... | 21:23 |
| clarkb | fungi: ya thats what I am thinking | 21:24 |
| tristanC | asselin: well both ways works for me | 21:24 |
| jeblair | mordred, fungi: guessing it's something about the order in which it matches the various fields when deciding what user to actually log you in as | 21:24 |
| fungi | clarkb: crazytown, man | 21:24 |
| clarkb | pleia2: really? they must've just changed this because image upload without the public option totally worked | 21:24 |
| asselin | tristanC, this way there are just 2 consistent changes. easier to review and manage | 21:24 |
| pleia2 | clarkb: ah, without public, let me see... | 21:24 |
| pleia2 | clarkb: aha, that does work | 21:25 |
| asselin | nibalizer, what do you think? | 21:25 |
| asselin | ^^ | 21:25 |
| *** bnemec has quit IRC | 21:25 | |
| asselin | nibalizer, defer you suggestion to follow on patch: https://review.openstack.org/#/c/175571/3/manifests/jenkins_master.pp | 21:26 |
| pleia2 | clarkb: so yeah, can use openrc and remove --is-public true and it should be good to go | 21:26 |
| clarkb | pleia2: cool | 21:26 |
| *** craigbr has quit IRC | 21:26 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Document running Nodepool for testing https://review.openstack.org/179840 | 21:27 |
| tristanC | asselin: but it also makes sense to have /etc/default/jenkins in puppet-jenkins... | 21:27 |
| openstackgerrit | Stephanie Miller proposed openstack-infra/project-config: [WIP] Draft proposal scripts for zanata https://review.openstack.org/181113 | 21:27 |
| asselin | tristanC, yes I agree. my concern is managing many interrelated patches | 21:27 |
| asselin | across multiple repos | 21:27 |
| openstackgerrit | Merged openstack-infra/zuul: web: Allow clients (browsers, proxies) to cache status.json https://review.openstack.org/170081 | 21:28 |
| openstackgerrit | Merged openstack-infra/zuul: Fix timer jobs getting aborted from abandoning a change https://review.openstack.org/170614 | 21:28 |
| asselin | tristanC, so if you want to do that first, then ok. let's just make those two changes: update puppet-jenkins and remove from system-config. Then have a 2nd pair of changes to refactor jenkins out. | 21:29 |
| clarkb | fungi: ya https://github.com/puppetlabs/puppetlabs-mysql/blob/0.6.1/lib/puppet/provider/database_grant/mysql.rb#L170 they aren't using grant syntax they are just updating all the rows in the db | 21:29 |
| clarkb | fungi: er columns in the db. That means the grant option is flipped if using ALL | 21:29 |
| fungi | le sigh | 21:29 |
| tristanC | asselin: okay, I'll check that in an hour. got to go now. | 21:29 |
| asselin | tristanC, thanks | 21:29 |
| tristanC | asselin: anyway, thanks for the guidance :) | 21:29 |
| clarkb | pleia2: thanks for helping independently verify the nodepool stuff. Do you have a test nodepool running now? | 21:30 |
| hogepodge | I'm wondering if it would make sense to add a command for 'git review -d <changeid>' to review pages. It's such a cool feature. | 21:30 |
| *** smarcet has quit IRC | 21:30 | |
| *** sdake_ is now known as sdake | 21:30 | |
| *** smarcet has joined #openstack-infra | 21:30 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Fix race in test_crd_check_duplicate https://review.openstack.org/181156 | 21:30 |
| *** smarcet has quit IRC | 21:31 | |
| clarkb | fungi: jeblair mordred pleia2 jhesketh SergeyLukjanov can I get a second review on https://review.openstack.org/#/c/181068/ to hopefully unbreak static.o.o puppeting (along with the pypi mirrors) | 21:31 |
| jeblair | hogepodge: i think that would be relatively simple and possible by adding something to the gerrit 'download commands' plugin which is what produces those | 21:31 |
| fungi | okay, here's some fresh weirdness... the centos-6 dib build is dying while caching rpms for devstack, complaining that pylint and python-nose depend on python-setuptools. i wonder why it doesn't try to cache that too? | 21:31 |
| pleia2 | clarkb: not quite, I figure I'll run through the instructions from the top tomorrow (need to head out the door to make it to sunnyvale by 5 soon) | 21:31 |
| clarkb | pleia2: sounds good | 21:31 |
| clarkb | fungi: probably not listed as an rpm in devstack and yum is only doing first layer caching? | 21:32 |
| fungi | it seems to resolve and retrieve other deps | 21:32 |
| *** Sukhdev has joined #openstack-infra | 21:32 | |
| fungi | maybe it's breaking because we uninstall setuptools earlier in the node build process or something | 21:33 |
| fungi | i'll see if i can suss it out | 21:33 |
| clarkb | mordred: are you around? so we need a change for simple-init added to ubuntu-trusty and we need to get rsyslog in as a package somewhere? | 21:34 |
| *** rossella_s has quit IRC | 21:34 | |
| clarkb | ok time for zaro's gerrit lib change | 21:34 |
| greghaynes | clarkb: https://review.openstack.org/#/c/181129/ | 21:34 |
| clarkb | greghaynes: but thats an incomplete change | 21:35 |
| mordred | clarkb: also, rsyslog is in the puppet already | 21:35 |
| mordred | clarkb: so, there is nothing needed for that - I beileve the rsyslog fail is a cascading fail | 21:35 |
| clarkb | mordred: oh, hrm | 21:35 |
| mordred | clarkb: you know how puppet likes to fail weird thigns at times for reasons | 21:35 |
| clarkb | and simple-init is in dib 0.1.44? | 21:35 |
| *** sabeen1 has joined #openstack-infra | 21:36 | |
| greghaynes | wow, weve done a lot of dib commits recently | 21:37 |
| greghaynes | (looking at the commit log) | 21:37 |
| mordred | yah | 21:37 |
| clarkb | zaro: can I request that we have a list organized tomorrow for things that need attention before gerrit upgrade? | 21:37 |
| clarkb | zaro: I think many of us don't have a full picture so collating that and getting things done would be good | 21:37 |
| clarkb | (I know I don't have the full picture in my head) | 21:37 |
| greghaynes | clarkb: yes, its in that release | 21:38 |
| *** baoli has quit IRC | 21:38 | |
| *** baoli has joined #openstack-infra | 21:39 | |
| clarkb | ok simple-init approved, lets see how the image build does after that gets in | 21:39 |
| *** peristeri has quit IRC | 21:39 | |
| greghaynes | I should probably cut a dib release too, theres a fair amount of new changes piled up | 21:39 |
| *** jog0 is now known as jogo | 21:41 | |
| mordred | clarkb: woot | 21:41 |
| *** jogo has quit IRC | 21:41 | |
| openstackgerrit | Merged openstack-infra/system-config: Add back disallow_robots.txt https://review.openstack.org/181068 | 21:42 |
| clarkb | zaro: I am reading https://review.openstack.org/#/c/172534/12/manifests/init.pp don't we actually need to make sure that all of those run after gerrit init and the tidy otherwise we will remove those files? | 21:43 |
| *** jogo has joined #openstack-infra | 21:43 | |
| clarkb | zaro: and we have to ensure they all run before gerrit start | 21:44 |
| zaro | clarkb: ahh yeah, those need to be called don't they. | 21:44 |
| zaro | clarkb: do you need more than this for the upgrade? https://etherpad.openstack.org/p/gerrit-2.10-upgrade | 21:45 |
| *** rfolco has quit IRC | 21:45 | |
| clarkb | zaro: I left a note about the ordering stuff on the chagne | 21:45 |
| *** mwagner_lap has quit IRC | 21:45 | |
| *** sarob has quit IRC | 21:46 | |
| reed | jogo, re: https://review.openstack.org/#/q/is:merged+age:1week+project:%255Eopenstack/.*-specs,n,z the latest set of merged specs... | 21:46 |
| reed | the gerrit URL is not very useful IMHO if the intent is to show people what has merged recently | 21:47 |
| reed | the only accessible information 'at a glance' from that URL is the title of the spec and the project | 21:47 |
| reed | it would be IMO a lot better if there was a way to link to specs.o.o instead | 21:47 |
| clarkb | zaro: that helps, added a bit more info to that etherpad | 21:47 |
| reed | so people can read immediately the whole spec as approved | 21:47 |
| mordred | reed: hrm | 21:48 |
| clarkb | each change returned by gerrit iwll have links to the rendered spec | 21:49 |
| jeblair | reed: individual spec repos have rss feeds; there's an opml file with all of the feeds; but i'm unsure if that helps. i don't think there is a single feed that combines all the individual feeds. | 21:49 |
| *** amitgandhinz has quit IRC | 21:49 | |
| jeblair | reed: dhellmann did the rss stuff i think | 21:49 |
| reed | jeblair, I was thinking of 'planeting' those in fact | 21:49 |
| *** baoli has quit IRC | 21:49 | |
| reed | or just write a simple script to assemble a list I can put on the newsletter | 21:49 |
| *** dustins has quit IRC | 21:49 | |
| openstackgerrit | Merged openstack-infra/system-config: Actually include simple-init for minimal images https://review.openstack.org/181129 | 21:50 |
| *** baoli has joined #openstack-infra | 21:50 | |
| reed | I still think that it would be useful also to have a "new specs proposed this week" section | 21:50 |
| *** jpeeler has quit IRC | 21:50 | |
| reed | so people can get notified of incoming specs | 21:50 |
| *** dustins has joined #openstack-infra | 21:50 | |
| dhellmann | reed, jeblair : I decided not to put them on planet because I wasn't sure everyone reading planet would want the specs, but if you think they would that would be fine | 21:50 |
| reed | dhellmann, it should be a separate planet | 21:51 |
| dhellmann | reed: makes sense | 21:51 |
| reed | but a script that gets titles and URLs is good enough | 21:51 |
| reed | like a firehose from which I can copy-paste into the newsletter | 21:51 |
| reed | let's see if people find it useful | 21:52 |
| zaro | clarkb: i don't think the order matters in that change | 21:52 |
| clarkb | zaro: it does, otherwise you could download the libs then tidy will delete them | 21:52 |
| clarkb | zaro: or start gerrit before downloading them | 21:52 |
| zaro | clarkb: the tidy removes 'bcprov-jdk*.jar' but the download renames the jars to | 21:53 |
| zaro | clarkb: the tidy removes 'bcprov-jdk*.jar' but the download renames the jars to 'bcprov.jar' | 21:53 |
| zaro | tidy will not remove the jars that are downloaded by the script. | 21:54 |
| *** rlandy has quit IRC | 21:54 | |
| clarkb | zaro: gotcha, so then order would only matter for running before gerrit starts | 21:54 |
| clarkb | zaro: but not for the tidy | 21:54 |
| *** sdake_ has joined #openstack-infra | 21:54 | |
| zaro | yep. | 21:54 |
| clarkb | ok double checking that ordering now | 21:54 |
| clarkb | zaro: ya the gerrit-start exec oes not have the appropriate requires to enforce that order | 21:55 |
| clarkb | zaro: do you want me to update my comment on the change? it will still be a -1 but I can restrict it to being about the start ordering | 21:55 |
| zaro | clarkb: ok. i'm not seeing the problem | 21:56 |
| *** david-lyle has joined #openstack-infra | 21:56 | |
| clarkb | zaro: gerrit-start could run before we install the libs | 21:57 |
| clarkb | zaro: but we need it to run after otherwise gerrit may not have any libs to load | 21:57 |
| zaro | clarkb: i'm wondering whether puppet will always get the $gerrit_war_version before we reference it later in the script? | 21:57 |
| clarkb | zaro: variables are all done before everything else and you don't have to set order for them | 21:58 |
| zaro | clarkb: ahh,, good to know. | 21:58 |
| *** sdake has quit IRC | 21:58 | |
| zaro | clarkb: i see now, but that's always been missing right? | 21:59 |
| *** chlong has quit IRC | 21:59 | |
| zaro | clarkb: i don't see a requires for for init in install of BC libs from packages. | 21:59 |
| *** dannywilson has quit IRC | 22:00 | |
| *** shardy has quit IRC | 22:00 | |
| *** gokrokve has quit IRC | 22:01 | |
| *** gokrokve has joined #openstack-infra | 22:01 | |
| clarkb | zaro: ya I think it may have been missing, we don't need a require for init in the install of BC libs. All that says is do this after that which isn't sufficient | 22:01 |
| fungi | SET default_storage_engine=MYISAM also no good on centos-6? moar sigh | 22:01 |
| *** dannywil_ has joined #openstack-infra | 22:01 | |
| clarkb | zaro: we need gerrit-start to require the lib installs, or the lib installs to before => Exec['gerrit-start'] | 22:02 |
| *** dannywil_ has quit IRC | 22:02 | |
| *** pc_m has quit IRC | 22:03 | |
| mikal | Did you guys see that tonyb is going to try and trick you? | 22:03 |
| *** soren has quit IRC | 22:03 | |
| anteaya | mikal: I saw something in the meeting about tonyb | 22:04 |
| mikal | Yeah | 22:04 |
| *** dannywilson has joined #openstack-infra | 22:04 | |
| anteaya | mikal: expand on how he is going to trick us | 22:04 |
| mikal | So... We're curious about if a private gerrit for embargoed security reviews is possible these days | 22:05 |
| mikal | We've wanted one for a while, but its never happened | 22:05 |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config: Add CloudPulse https://review.openstack.org/181125 | 22:05 |
| *** btully has quit IRC | 22:05 | |
| anteaya | right you mentioned in the meeting that you had a conversation about it before | 22:05 |
| mikal | And we really really miss CI when we do the reviews for these things | 22:05 |
| mikal | And the launchpad code review UI is horrible | 22:05 |
| mikal | Yeah, like two years agoish | 22:05 |
| *** arielb has quit IRC | 22:05 | |
| clarkb | mikal: well private gerrit would not come with ci fwiw (at least if we went with the age old plan to make a private gerrit) | 22:05 |
| zaro | clarkb: hmm, so 'gerrit-start' requires libs for 2.10 _or_ libs for 2.8 ? | 22:05 |
| mikal | Is there anything like ACLs in modern gerrit? | 22:05 |
| clarkb | mikal: there are ACLs but all our CI is public and making it unpublic is not trivial | 22:06 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/puppet-jenkins: Adds jenkins default file https://review.openstack.org/178749 | 22:06 |
| mikal | Anyways, I just wanted to give you a heads up that this is still a pain point in nova and we might want to brain storm over beer in Canada | 22:06 |
| mikal | I don't particularly expect you to solve it now | 22:06 |
| anteaya | Canada has beer | 22:06 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/system-config: Use jenkins default file from puppet-jenkins https://review.openstack.org/178760 | 22:07 |
| clarkb | zaro: it should be both | 22:07 |
| zaro | clarkb: can you put all that all in a list that puppet will understands? | 22:07 |
| *** gokrokve has quit IRC | 22:07 | |
| *** emagana has quit IRC | 22:07 | |
| mikal | Anyway, I have to run | 22:07 |
| clarkb | zaro: you definitely can if you do the before => think | 22:07 |
| *** eharney has quit IRC | 22:07 | |
| mikal | But I will come be sarcastic in here some more later | 22:07 |
| clarkb | zaro: I want to say it will not work if you require all of them on the gerrit-start side | 22:07 |
| *** gokrokve has joined #openstack-infra | 22:07 | |
| anteaya | mikal: welcome anytime | 22:07 |
| anteaya | mikal: enjoy your run | 22:08 |
| clarkb | nibalizer: crinkle ^ can you require resources that don't end up getting declaired due to if else branching? | 22:08 |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Adding create permissions to networking-vsphere https://review.openstack.org/181172 | 22:08 |
| *** abregman has quit IRC | 22:08 | |
| mikal | Oh, not literal run | 22:09 |
| crinkle | clarkb: no | 22:09 |
| mikal | More "get dressed, find food, get to office" in time for another meeting | 22:09 |
| anteaya | mikal: ah well enjoy that | 22:09 |
| *** otter768 has joined #openstack-infra | 22:09 | |
| *** baoli has quit IRC | 22:10 | |
| *** baoli has joined #openstack-infra | 22:11 | |
| nibalizer | clarkb: no it wll break | 22:11 |
| nibalizer | you can have the thing being if blocked before => other resource | 22:11 |
| clarkb | nibalizer: oh right puppet 3 respects ordering | 22:11 |
| *** nelsnelson has quit IRC | 22:11 | |
| clarkb | zaro: so you can probabl get away with just moving all that stuff above gerrit-start then leave a comment that the order is important | 22:12 |
| crinkle | no no | 22:12 |
| clarkb | ha | 22:12 |
| clarkb | crinkle: then what use an anchor? | 22:12 |
| crinkle | he means add a before metaparameter | 22:12 |
| clarkb | ya ok | 22:12 |
| crinkle | so resource { 'thing': before => Otherthing[foo] } | 22:12 |
| *** dboik_ has joined #openstack-infra | 22:12 | |
| clarkb | zaro: ^ basically those things should do that for Exec['gerrit-start'] | 22:12 |
| zaro | clarkb: yeah, i see that. making the change now | 22:13 |
| *** otter768 has quit IRC | 22:14 | |
| *** dboik has quit IRC | 22:16 | |
| *** dboik_ has quit IRC | 22:17 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Get libs before running Gerrit https://review.openstack.org/181173 | 22:19 |
| zaro | clarkb: ^ | 22:19 |
| zaro | opps made mistake there, need another patch. | 22:20 |
| *** gokrokve has quit IRC | 22:21 | |
| jogo | reed: I am not sure if the firehose if all the approved specs is useful | 22:21 |
| *** rossella_s has joined #openstack-infra | 22:21 | |
| jogo | reed: I think some human review would be useful | 22:21 |
| clarkb | zaro: ya I commented, see if thats what you noticed | 22:21 |
| *** baoli has quit IRC | 22:21 | |
| *** baoli has joined #openstack-infra | 22:22 | |
| *** sdake has joined #openstack-infra | 22:22 | |
| *** ddieterly has quit IRC | 22:23 | |
| *** ddieterly has joined #openstack-infra | 22:23 | |
| openstackgerrit | Merged openstack-infra/project-config: Add DIB tests to dib-utils https://review.openstack.org/180861 | 22:23 |
| *** mpopow has quit IRC | 22:24 | |
| *** gordc has quit IRC | 22:24 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Get libs before running Gerrit https://review.openstack.org/181173 | 22:24 |
| zaro | clarkb: ^ yeah, noticed that right after pushing it. | 22:24 |
| zaro | clarkb: you suggesting that i make that a change on top of current master instead? | 22:25 |
| *** salv-orlando has joined #openstack-infra | 22:25 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Fix race condition relating to change updates https://review.openstack.org/181175 | 22:25 |
| clarkb | zaro: no, just update the existing change (the parent) | 22:25 |
| *** sdake_ has quit IRC | 22:25 | |
| *** mayurig has joined #openstack-infra | 22:25 | |
| zaro | clarkb: seperated because it never existed in the first place. | 22:26 |
| clarkb | zaro: ok | 22:26 |
| jeblair | clarkb, fungi, mordred: ^ just as i was started to get tired of functional tests with race conditions, i find one that uncovered a real production bug. | 22:26 |
| openstackgerrit | Merged openstack-infra/system-config: Document IRC channel registration commands https://review.openstack.org/181036 | 22:26 |
| zaro | ohh shoot, now i have one rocket ship mis-aligned :( | 22:27 |
| *** mayurig has quit IRC | 22:27 | |
| clarkb | jeblair: fun, thankfully the fix looks simple | 22:27 |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Get libs before running Gerrit https://review.openstack.org/181173 | 22:27 |
| openstackgerrit | Merged openstack-infra/project-config: Be explicit about what services we enable for ODL https://review.openstack.org/181124 | 22:27 |
| *** sharikapongubala has joined #openstack-infra | 22:29 | |
| *** btully has joined #openstack-infra | 22:29 | |
| jeblair | clarkb: do you understand these failures? http://logs.openstack.org/55/169955/1/gate/gate-zuul-python26/cdee749/testr_results.html.gz | 22:29 |
| jeblair | clarkb: this goes with it http://logs.openstack.org/55/169955/1/gate/gate-zuul-python26/cdee749/console.html | 22:30 |
| clarkb | jeblair: it looks like the test runners bailed out | 22:30 |
| jeblair | returncode -14 | 22:30 |
| fungi | mikal: yeah, i'm planning to bring security-review.openstack.org off the back-burner once we're through the gerrit 2.10 upgrade and summit https://review.openstack.org/47937 | 22:30 |
| clarkb | jeblair: but the return code is wrong for test timeouts iirc returncode is 142 if it timed out | 22:30 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Add the ability for template to manage exim https://review.openstack.org/180782 | 22:31 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Move afs servers to using o_p::template https://review.openstack.org/180783 | 22:31 |
| clarkb | jeblair: I am waiting for the subunit log to load up in my browser | 22:31 |
| jeblair | fungi, mikal: zuulv3 should make the zuul part of security reviews feasible -- log storage and display would still need to be solved though, but it's at least another step in the process. | 22:31 |
| *** salv-orlando has quit IRC | 22:31 | |
| mordred | jeblair: yah - I just +2'd hat | 22:32 |
| fungi | jeblair: yeah, i think the initial phase was to just be able to review things on it, and then punt on the rest (workflow would involve reproposing the same change to public review once the embargo was lifted) | 22:32 |
| mordred | clarkb: in your nodepool testing doc, you have a grant all on *.* so that the tests can create a database, but then the next step is creating a database ... | 22:32 |
| mordred | clarkb: do you really need that create step? | 22:33 |
| jeblair | fungi: yep. just thinking way ahead | 22:33 |
| mordred | (obviously it won't breka things) | 22:33 |
| fungi | appreciated! | 22:33 |
| openstackgerrit | Merged openstack-infra/zuul: Fix race in test_crd_check_duplicate https://review.openstack.org/181156 | 22:33 |
| *** ddieterly has quit IRC | 22:33 | |
| zaro | clarkb: maybe the depends-on doesn't make sense in https://review.openstack.org/#/c/173052/ ? | 22:34 |
| *** ociuhandu has joined #openstack-infra | 22:34 | |
| zaro | clarkb: we really want the plugin update to happen before starting the gerrit service. | 22:34 |
| *** mayurig has joined #openstack-infra | 22:35 | |
| clarkb | mordred: yes because the tests also expect that specific db to exist | 22:35 |
| *** mayurig has quit IRC | 22:35 | |
| openstackgerrit | Merged openstack-infra/nodepool: Allow for Jenkinsless targets https://review.openstack.org/179499 | 22:35 |
| fungi | so... sometime between mysql 5.1 and 5.6 "set storage_engine" became "set default_storage_engine". i suppose in our setup i should just try the more likely one and then if that fails, try the less likely one | 22:35 |
| fungi | mordred: jeblair: am i interpreting the documentation correctly there? | 22:35 |
| mordred | clarkb: kk | 22:35 |
| *** changbl has quit IRC | 22:36 | |
| mordred | fungi: yes. I think you should do the 5.6 one and fall back to the 5.1 one | 22:36 |
| mordred | 5.1 is ANCIENT these days | 22:36 |
| fungi | mordred: yep, so is centos 6 ;) | 22:36 |
| mordred | clarkb: I -1'd for a different reason - otherwise, patch looks great | 22:36 |
| clarkb | you mean 5.5 one | 22:36 |
| mordred | fungi: ++ | 22:36 |
| fungi | thanks! | 22:36 |
| clarkb | mordred: thanks | 22:36 |
| mordred | clarkb: the > 5.1 one | 22:36 |
| sharikapongubala | hello, I can't update my contact information in review.openstack.org. Does anyone have any idea why it is not allowing me to change my info? | 22:36 |
| fungi | the less ancient one before the more ancient one | 22:36 |
| clarkb | zaro: the depends on is a gerrit change thing though and won't affect puppet running right? | 22:37 |
| clarkb | zaro: we will merge both then run puppet with all the things together | 22:37 |
| fungi | sharikapongubala: either your foundation member profile primary e-mail doesn't match your gerrit preferred e-mail, or that your foundation account is community instead of foundation member, or that you don't have a foundation account, or that the network between gerrit and the foundation member system is broken, or that the foundation member system itself is broken/down | 22:37 |
| mordred | greghaynes: 179537 in python-openstackclient is something you may want to look at | 22:37 |
| mordred | greghaynes: dtroyer is working on tests for os-client-config override precedence | 22:37 |
| Clint | fungi: how long have you been pasting that? | 22:37 |
| fungi | Clint: this was repeat #1 | 22:38 |
| Clint | oh good | 22:38 |
| anteaya | sharikapongubala: have a look at https://ask.openstack.org/en/question/56720/cannot-store-contact-information-when-updating-info-in-openstack-gerrit/ and see if it helps you | 22:38 |
| clarkb | I usually link the aski.o.o answer | 22:38 |
| fungi | Clint: was saving myself some keystrokes | 22:38 |
| clarkb | ya that one | 22:38 |
| *** mpopow has joined #openstack-infra | 22:38 | |
| mordred | greghaynes: also, if you were not aware, python-openstackclient now consumes os-client-config | 22:38 |
| fungi | Clint: but yeah, we get asked on average about once a day. today is a bonus i guess ;) | 22:38 |
| mordred | clarkb: speaking of ^^ did I mention taht to you? | 22:38 |
| greghaynes | mordred: nice | 22:38 |
| *** david-lyle has quit IRC | 22:38 | |
| anteaya | clarkb: actually so does fungi, which is where I learned the link is there | 22:38 |
| greghaynes | mordred: did you see https://review.openstack.org/#/c/181098/ passes? | 22:38 |
| clarkb | mordred: the next ubuntu-trusty run should include simple-init | 22:39 |
| mordred | HAHAHAH. I just went to the gerrit webui and then pressed "d" to get the diff | 22:39 |
| zaro | clarkb: as long as both get merged before we run puppet then it's fine as-is. | 22:39 |
| mordred | clarkb: woot | 22:39 |
| mordred | "d" does not do that in webui | 22:39 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Add utility for inspecting puppet module versions https://review.openstack.org/175156 | 22:39 |
| fungi | sharikapongubala: https://ask.openstack.org/question/56720/ | 22:39 |
| clarkb | mordred: I think so and I had to -1 it for something but did not track it since then | 22:39 |
| jeblair | mordred: excellent | 22:39 |
| clarkb | zaro: ya I think that should be our plan, we can note it on the etherpad | 22:40 |
| clarkb | zaro: but basically stop puppet on review.o.o, merge everything, run puppet | 22:40 |
| jeblair | mordred: what's really weird is i can never get 'local checkout' to work in gerrit. ;) | 22:40 |
| *** sputnik1_ has quit IRC | 22:41 | |
| mordred | jeblair: you know, I feel like modern javascript should be able to handle that | 22:41 |
| clarkb | mordred: it can but only sandboxed iirc | 22:41 |
| greghaynes | mordred: Are we going to need a release of os-client-config now to get that fix for nodepool? | 22:41 |
| mordred | greghaynes: yah | 22:41 |
| mordred | greghaynes: but that's easy :) | 22:41 |
| greghaynes | ok | 22:42 |
| mordred | I'd lke to get the other patch in too | 22:42 |
| mordred | oh - the other patch is in | 22:42 |
| *** esker has quit IRC | 22:42 | |
| mordred | neat | 22:42 |
| *** rm_work is now known as rm_work|away | 22:42 | |
| mordred | actually - let me hack up the floating ip patch real quick | 22:42 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Bring in module to manage update-alternatives https://review.openstack.org/171556 | 22:42 |
| clarkb | jeblair: I have converted the subunit log to version1 locally (bit easier to read) and it says return code -140 | 22:43 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Fix race in test_crd_check_duplicate more https://review.openstack.org/181183 | 22:43 |
| jeblair | sorry about that ^ | 22:43 |
| clarkb | jeblair: so that adds to the mystery, best I can tell the test runners all exited while running the jobs that are listed as failing | 22:43 |
| jeblair | clarkb: that's TEN TIMES WORSE! | 22:43 |
| clarkb | jeblair: and in the negative direction | 22:44 |
| *** dannywilson has quit IRC | 22:44 | |
| zaro | clarkb: i've updated the etherpad, hopefully it's more clear now. | 22:45 |
| clarkb | jeblair: I would try running one of those tests on its own? | 22:45 |
| clarkb | jeblair: but other than that I am stumped | 22:45 |
| jeblair | clarkb: i'm pretty sure it's a complete fluke | 22:45 |
| *** tnovacik has quit IRC | 22:45 | |
| jeblair | clarkb: as in, not at all reproducible | 22:45 |
| *** dannywilson has joined #openstack-infra | 22:46 | |
| *** annegentle has joined #openstack-infra | 22:46 | |
| *** annegentle is now known as Guest52646 | 22:46 | |
| zaro | clarkb: alright, jenkins says +1, so let me know when you want to make that gerrit lib change happen. | 22:47 |
| clarkb | huh | 22:47 |
| clarkb | zaro I need to rereview, snack first as I neglected lunch | 22:47 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Use shade to get the client objects https://review.openstack.org/168603 | 22:48 |
| *** camunoz has joined #openstack-infra | 22:48 | |
| greghaynes | mordred: ^ should pass once os-c-c is released, and I think there should be tests to make everyone happy now | 22:49 |
| *** whoops has quit IRC | 22:50 | |
| *** sdake has quit IRC | 22:51 | |
| *** sharikapongubala has quit IRC | 22:52 | |
| *** sdake has joined #openstack-infra | 22:52 | |
| *** Guest52646 is now known as agentleexile | 22:52 | |
| *** baoli has quit IRC | 22:53 | |
| agentleexile | anyone here know what our Summit voting system is? I think it's Morey-crafted but wondered if there are alternatives? I have a techcomm conf organizer asking me if I know what tools they could use for their conference and they like the Summit one. :) | 22:53 |
| *** baoli has joined #openstack-infra | 22:54 | |
| anteaya | agentleexile: our Summit voting system? | 22:56 |
| anteaya | do you mean the voting that takes place for summit talks? | 22:56 |
| agentleexile | anteaya: yes | 22:56 |
| agentleexile | anteaya: I think Todd morey made it? | 22:56 |
| anteaya | agentleexile: might best to talk to todd then | 22:57 |
| anteaya | I'm going with todd@openstack.org as his email address | 22:57 |
| jeblair | agentleexile: it might be in https://github.com/OpenStackweb/openstack-org/tree/master/summit ? | 22:58 |
| jeblair | agentleexile: also, on the subject of conference organizing software, you may want to chat with mikal and/or jhesketh | 22:58 |
| *** angela-s has left #openstack-infra | 22:59 | |
| *** agentleexile has quit IRC | 23:01 | |
| clarkb | zaro: current patchset looks good. If we can get a second reviewer we can try getting that in today or early tomorrow | 23:02 |
| anteaya | was that anne? | 23:02 |
| *** baoli has quit IRC | 23:04 | |
| mordred | anteaya: yes | 23:04 |
| mordred | anteaya: well, at least I hope it was | 23:04 |
| anteaya | ah | 23:04 |
| anteaya | me too | 23:05 |
| mordred | anteaya: because I chatted with her privately about something for a second | 23:05 |
| anteaya | ah | 23:05 |
| anteaya | based upon the dearth of follow up before the departure I hope it was anne | 23:05 |
| anteaya | else we might have offended a new comer | 23:05 |
| zaro | clarkb: your lingering -1 is on the parent patch. | 23:05 |
| clarkb | zaro: oh right, sorry | 23:07 |
| jhesketh | Morning | 23:07 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Move afs servers to using o_p::template https://review.openstack.org/180783 | 23:08 |
| greghaynes | clarkb: looks like the dib change to use zuul-cloner is :( https://jenkins06.openstack.org/job/gate-dib-dsvm-functests-devstack-trusty/34/console | 23:09 |
| mordred | anteaya: if we offended a newcoming - they sure did have an amazing nick | 23:09 |
| clarkb | greghaynes: oh! you need to use the full path. openstack/diskimage-builder/stuff | 23:09 |
| greghaynes | ah! | 23:10 |
| greghaynes | hah | 23:10 |
| anteaya | mordred: true | 23:10 |
| anteaya | morning jhesketh | 23:10 |
| clarkb | greghaynes: thats mostly new with zuul-cloner and likely the correct decision, just makes it easy to overlook | 23:11 |
| openstackgerrit | greghaynes proposed openstack-infra/project-config: Use correct path for DIB tests https://review.openstack.org/181190 | 23:12 |
| greghaynes | clarkb: yea, its not a bad idea | 23:12 |
| clarkb | greghaynes: want to remove the gerrit git prep too? | 23:14 |
| greghaynes | clarkb: sure, what does that do? | 23:14 |
| clarkb | greghaynes: gerrit-git-prep is the old thing that zuul-cloner is replacing, and it only did the current project | 23:14 |
| greghaynes | gotcha | 23:15 |
| clarkb | greghaynes: so basically you are making a newer better gerrit git prep that understands multiple projects so don't need the old thing | 23:15 |
| openstackgerrit | greghaynes proposed openstack-infra/project-config: Use correct path for DIB tests https://review.openstack.org/181190 | 23:15 |
| *** hemna is now known as hemnafk | 23:17 | |
| openstackgerrit | Merged openstack/requirements: Bump pbr versions. https://review.openstack.org/180271 | 23:18 |
| jeblair | jhesketh: good morning; re 180855, we are? | 23:19 |
| jlvillal | Who would know about: gate-tempest-dsvm-ironic-agent_ssh test? http://logs.openstack.org/32/176832/4/check/gate-tempest-dsvm-ironic-agent_ssh-src/e156a5c/logs/devstacklog.txt.gz | 23:20 |
| jlvillal | I'm trying to understand the error. python-requests was updated in the patch: https://review.openstack.org/#/c/176832/ | 23:20 |
| jlvillal | I'm wondering if the pip version being used is incompatible? | 23:20 |
| clarkb | jlvillal: looks like linecache2 is broken? | 23:22 |
| jlvillal | clarkb: I'll admit I don't know what that is. I have done recheck twice over a period of several days and still fails. | 23:22 |
| clarkb | oh wait thats just noise | 23:22 |
| *** dboik has joined #openstack-infra | 23:23 | |
| clarkb | jlvillal: http://logs.openstack.org/32/176832/4/check/gate-tempest-dsvm-ironic-agent_ssh-src/e156a5c/logs/devstacklog.txt.gz#_2015-05-07_22_21_49_843 looking at that | 23:23 |
| clarkb | jlvillal: but then pip says it successfully installed so I dunno what is going on there | 23:23 |
| jhesketh | jeblair: clarkb discovered it actually https://review.openstack.org/#/c/76057/ | 23:23 |
| clarkb | jlvillal: looks like pip install ironic-python-agent is the actual fail | 23:24 |
| jlvillal | clarkb: I notice that the next step. Yes. | 23:24 |
| jlvillal | clarkb: And is it using pip 1.5.2? | 23:24 |
| jlvillal | Which seems old. | 23:24 |
| *** chlong has joined #openstack-infra | 23:24 | |
| clarkb | jhesketh: that seems reasonable | 23:24 |
| jlvillal | clarkb: I was wondering if python-requests 2.5.2 is incompatible with pip 1.5.2? | 23:24 |
| clarkb | jlvillal: I do not know what version of pip that coreos docker build thing does | 23:24 |
| *** dboik_ has joined #openstack-infra | 23:25 | |
| jeblair | jhesketh: hrm, my read of that is different -- i'm thinking that until we prove otherwise, the remote-url-override change is suspect, as in, i suspect it of causing a performance degredation. touching git operations, it's certainly capable of that. | 23:25 |
| clarkb | jlvillal: basically ironic has decided to be compeltely and super special there and I don't know anything :) | 23:25 |
| jlvillal | clarkb: Okay. I will ask the IPA guys. Thanks. | 23:25 |
| *** bswartz has joined #openstack-infra | 23:25 | |
| *** markvoelker has quit IRC | 23:26 | |
| jeblair | jhesketh, clarkb: slowest tests on the changes i've been doing are coming back with 13, 12, 8, 8, 8, ... seconds | 23:26 |
| jhesketh | jeblair: hmm good point | 23:26 |
| clarkb | jeblair: that would indicate a regression then | 23:26 |
| *** dboik has quit IRC | 23:28 | |
| clarkb | jlvillal: if I had to make a guess, pip version there is too new/old for the requests version | 23:29 |
| clarkb | jlvillal: while we typically control and make sure all of that works for you, the use of a container in an image we have no cntrol over subverts that | 23:29 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking: Updated from global requirements https://review.openstack.org/181196 | 23:29 |
| jlvillal | clarkb: That was my initial thought. I'm chatting with IPA guys. | 23:29 |
| JayF | clarkb: So we're using, in this case, stock pip from Ubuntu Trusty | 23:30 |
| JayF | clarkb: should we not expect that to work? | 23:30 |
| clarkb | JayF: apparently not. especially if you are changing the requests version | 23:30 |
| clarkb | mordred: you know, for all the work we do to make images that solve these problems it is really easy to get around that | 23:31 |
| JayF | It seems... broken if our software can't be installed from a stock pip in a relatively new distro (1y old) | 23:31 |
| clarkb | mordred: not sure there is a good answer for that though, just thinking about DNS rsolvers, pip mirrors, cached files, etc and doing work in a container throws it all out the door | 23:31 |
| clarkb | mordred: you might have ideas on how to deal with that | 23:31 |
| JayF | I can add a pip install pip to the dockerfile if you tell me what version I could install? | 23:31 |
| clarkb | JayF: its not our softwares fault | 23:32 |
| *** wenlock has quit IRC | 23:32 | |
| clarkb | JayF: pip is broken, has nothing to do with openstack | 23:32 |
| JayF | clarkb: it could be pip that was broken :) | 23:32 |
| JayF | clarkb: I agree with you, just worded it strangely | 23:32 |
| clarkb | it clearly is, its importing a thing from requests that does not exist | 23:32 |
| *** Sukhdev has quit IRC | 23:32 | |
| clarkb | lifeless: https://jenkins04.openstack.org/job/gate-requirements-pypy/9/console may interest you, appears to be testtools install failing under pypy | 23:33 |
| JayF | OK, I think jroll has a beat on a fix. ty | 23:33 |
| clarkb | lifeless: sorry, testrepository | 23:33 |
| *** hichihara has joined #openstack-infra | 23:33 | |
| clarkb | mordred: maybe we can aufs over the top of the host machine and use that as the base? | 23:34 |
| openstackgerrit | Joe Gordon proposed openstack-infra/project-config: Make tempest-dsvm-sahara job voting https://review.openstack.org/181210 | 23:34 |
| openstackgerrit | Joe Gordon proposed openstack-infra/project-config: Remove integrated-gate template from sahara https://review.openstack.org/181211 | 23:34 |
| lifeless | shouldn't, since I test on pypy before releasing | 23:34 |
| clarkb | lifeless: I suppose it could be related to the version of pbr under test now that testrepository uses pbr? | 23:35 |
| jeblair | clarkb: i may not be following, but is the bug under discussion not a legitimate bug in the image? | 23:35 |
| *** wenlock_ has quit IRC | 23:35 | |
| jeblair | clarkb: (in which case we would not want to alter the test environment to 'mask' it) | 23:35 |
| lifeless | clarkb: it could be. I don't think we have a pypy gate around pbr | 23:35 |
| clarkb | jeblair: its not a bug in the image, our image is perfectly fine. The test then goes and does all of its work in a docker image we have no control over | 23:35 |
| *** samueldmq has quit IRC | 23:36 | |
| lifeless | clarkb: I can't see the pypy log there can I? | 23:36 |
| clarkb | jeblair: so what they do there is their business I guess. There really isn't much we can do to fix that if projects decide that oeprating on a chroot is more important to them then reliability | 23:36 |
| lifeless | tox log | 23:36 |
| jeblair | clarkb: i thought the docker thing was the thing under test -- as in, IPA runs in a container, and if the docker image it is using is broken, that's a legitimate test result | 23:36 |
| *** samueldmq has joined #openstack-infra | 23:36 | |
| clarkb | jeblair: I don't think the docker image is broken | 23:36 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Remove sahara from the default configuration https://review.openstack.org/181230 | 23:37 |
| clarkb | jeblair: I think they do somethign to the image that is broken that they would not be doing if running on the host | 23:37 |
| clarkb | jeblair: eg upgrading requests but not pip | 23:37 |
| clarkb | lifeless: doesn't look like it | 23:37 |
| lifeless | clarkb: so how/why do we think its testr failing? | 23:37 |
| lifeless | clarkb: the error i see is a pip fail | 23:37 |
| clarkb | lifeless: error: option --single-version-externally-managed not recognized | 23:37 |
| lifeless | ERROR: pypy: could not install deps [setuptools>3.4, -r/home/jenkins/workspace/gate-requirements-pypy/test-requirements.txt]; v = InvocationError('/home/jenkins/workspace/gate-requirements-pypy/.tox/pypy/bin/pip install -U setuptools>3.4 -r/home/jenkins/workspace/gate-requirements-pypy/test-requirements.txt (see /home/jenkins/workspace/gate-requirements-pypy/.tox/pypy/log/pypy-1.log)', 1) | 23:38 |
| clarkb | lifeless: and that happens when installing testrepository | 23:38 |
| lifeless | ah, found it | 23:38 |
| *** btully has quit IRC | 23:38 | |
| clarkb | lifeless: it almost looks like it used a really old setuptools or distutils | 23:39 |
| clarkb | oh ya distutils is in the paths there | 23:39 |
| *** ajmiller has quit IRC | 23:40 | |
| clarkb | mordred: greghaynes rsyslog is still broken with simple-init | 23:40 |
| lifeless | yeah, thats really out of testr's hands | 23:40 |
| clarkb | mordred: greghaynes are you sure that rsyslog is part of ubuntu-minimal | 23:41 |
| clarkb | the dhcpclient issue did go away though | 23:41 |
| lifeless | clarkb: when from setuptools import setup gets you bad stuff, its going to break | 23:41 |
| greghaynes | clarkb: im not, mordred said puppet installs it | 23:42 |
| lifeless | the pip debug log may have more info | 23:42 |
| *** rossella_s has quit IRC | 23:42 | |
| lifeless | I can't tell what version of setuptools is actually being installed there | 23:42 |
| lifeless | testr doesn't use pbr yet | 23:42 |
| clarkb | lifeless: oh! I think I know what the problem is | 23:43 |
| clarkb | the problem is we upgrade setuptools in that invocation of pip | 23:43 |
| clarkb | that will likely break | 23:43 |
| clarkb | so we start with setuptools 2.2 then upgrade to latest and that explodes | 23:43 |
| lifeless | its across a process boundary | 23:44 |
| openstackgerrit | Merged openstack-infra/project-config: Use correct path for DIB tests https://review.openstack.org/181190 | 23:44 |
| lifeless | but | 23:44 |
| lifeless | thats plausible | 23:44 |
| lifeless | is this new? when did it start breaking? | 23:44 |
| clarkb | lifeless: its the first time I have seen it | 23:44 |
| clarkb | but I know cryptography has a specific workaround for pypy for things like this | 23:44 |
| clarkb | they normally install setuptools as a install_requires (for pkg_resources) but do not with pypy | 23:44 |
| clarkb | greghaynes: ya looks like an order of operations bug | 23:46 |
| *** mpopow has quit IRC | 23:46 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Update rsyslog config after install https://review.openstack.org/181256 | 23:48 |
| clarkb | mordred: greghaynes ^ | 23:48 |
| *** dims_ has joined #openstack-infra | 23:50 | |
| clarkb | lifeless: though maybe I misread the commit message | 23:50 |
| clarkb | lifeless: https://github.com/pyca/cryptography/commit/4cf381137643c2d78e8631f3f439daef62a97a67 | 23:51 |
| greghaynes | clarkb: yep. that looks like puppet. | 23:51 |
| greghaynes | :p | 23:51 |
| *** dims has quit IRC | 23:52 | |
| *** rmcall has joined #openstack-infra | 23:53 | |
| jeblair | clarkb, fungi:when you have a sec, tail the zuul debug log; it's a lot quieter :) | 23:54 |
| clarkb | woot, thank you pleia2 | 23:54 |
| *** mriedem is now known as mriedem_away | 23:54 | |
| clarkb | jeblair: still getting AttributeError: 'str' object has no attribute '_ZuulGearmanClient__gearman_job' though | 23:55 |
| fungi | ooh | 23:55 |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Update Rally meeting. https://review.openstack.org/181257 | 23:55 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Fix race condition relating to change updates https://review.openstack.org/181175 | 23:56 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Fix race in test_crd_check_duplicate more https://review.openstack.org/181183 | 23:56 |
| *** markvoelker has joined #openstack-infra | 23:56 | |
| jeblair | i'm reversing the dep order on those and will just self-approve | 23:56 |
| clarkb | kk | 23:56 |
| *** dustins has quit IRC | 23:56 | |
| fungi | wfm | 23:57 |
| *** markvoelker has quit IRC | 23:57 | |
| jeblair | clarkb: that's so weird :/ | 23:57 |
| *** markvoelker has joined #openstack-infra | 23:57 | |
| fungi | it's the time of night when i'm beginning to sample some of the local rum, so not approving anything else | 23:57 |
| clarkb | I am about to go prep dinner | 23:57 |
| jeblair | oh look! a farmers market! | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
