| davidlenwell | I'm getting a python failure on a commit that I do not understand.. trying to make sense of the console output.. https://review.openstack.org/#/c/174135/2 | 00:00 |
|---|---|---|
| fungi | yamamoto: only if the client implements a keepalive. it's an optional part of the protocol but i'm pretty sure the ssh implementation in gerrit doesn't send keepalives (it's usually off by default in most ssh clients and servers) | 00:00 |
| mtreinish | davidlenwell: switch April to Apr and March to Mar | 00:00 |
| davidlenwell | Doh | 00:01 |
| mtreinish | davidlenwell: it doesn't match the regex in the traceback: http://logs.openstack.org/35/174135/2/check/gate-stackalytics-python27/f053505/console.html#_2015-04-16_17_41_44_502 | 00:01 |
| yamamoto | fungi: ok then ryu ci side of the connections might be completely dead? | 00:01 |
| *** mahito has joined #openstack-infra | 00:01 | |
| *** emagana has joined #openstack-infra | 00:02 | |
| fungi | yamamoto: yes, it's possible your gateway has an aggressive timeout and keeps silently dropping it without forging a tcp/rst or similar to close our end, and then your client reconnects and these slowly build up over time | 00:02 |
| fungi | yamamoto: but in theory whoever's taking care of your ci system will probably be able to find evidence in debug logs of connections being restarted | 00:03 |
| *** mahito_ has joined #openstack-infra | 00:04 | |
| *** dims__ has joined #openstack-infra | 00:04 | |
| *** ZZelle_ has quit IRC | 00:04 | |
| *** mahito has quit IRC | 00:05 | |
| *** dims_ has joined #openstack-infra | 00:05 | |
| zaro | fungi: getting this error: Error: Puppet::Parser::AST::Resource failed with error ArgumentError: Could not find declared class mysql::client | 00:06 |
| zaro | fungi: in http://logs.openstack.org/64/164264/9/check/gate-infra-puppet-apply-trusty/65e542e/console.html | 00:06 |
| yamamoto | fungi: makes sense thank you | 00:06 |
| zaro | can we add mysql::client to our repo? if so how? | 00:07 |
| yamamoto | btw iirc metaplugin ci uses very similar setup with ryu ci. doesn't it have the same issue? | 00:07 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/jeepyb: New hook: cherry_pick https://review.openstack.org/174627 | 00:07 |
| fungi | zaro: i'm looking now | 00:08 |
| openstackgerrit | Alice Chen proposed openstack-infra/jeepyb: Let pull request message be customized via file https://review.openstack.org/115850 | 00:08 |
| fungi | yamamoto: if that's the "metaplugintest" account, it has 2 open connections as of a few minutes ago | 00:09 |
| *** dims__ has quit IRC | 00:09 | |
| fungi | yamamoto: i just polled again, metaplugintest is still at 2 open ssh connections, neutronryu is at 17 (so it's gone down a few, but still comparatively much higher) | 00:09 |
| anteaya | fungi: yes that is the username of the metaplugin ci: https://wiki.openstack.org/wiki/ThirdPartySystems/Metaplugin_CI | 00:10 |
| anteaya | tokyo is clean! http://imgur.com/a/hz6MZ | 00:11 |
| *** bknudson has joined #openstack-infra | 00:12 | |
| *** davideagnello has quit IRC | 00:12 | |
| yamamoto | ok then nat used at the location of ryu-ci is a suspicion... i'll take a look later today | 00:13 |
| fungi | yamamoto: thanks again | 00:13 |
| * zaro needs to head out. | 00:13 | |
| *** sputnik13 has quit IRC | 00:13 | |
| fungi | zaro: i wonder if you should just use an "include mysql::client" there instead of instantiating teh class with no parameters | 00:13 |
| fungi | nibalizer: ^ ? | 00:14 |
| fungi | https://review.openstack.org/#/c/164264/9/manifests/mysql.pp is the relevant file | 00:14 |
| *** markmcclain has joined #openstack-infra | 00:14 | |
| *** luqas has joined #openstack-infra | 00:15 | |
| yamamoto | anteaya: i've met the tortoise when i was walking. it's nearby my home. | 00:15 |
| fungi | zaro: nibalizer: er, i mean https://review.openstack.org/#/c/164264/9/manifests/init.pp | 00:15 |
| *** davideagnello has joined #openstack-infra | 00:16 | |
| anteaya | yamamoto: ha ha ha | 00:17 |
| anteaya | yamamoto: that is so cool | 00:17 |
| anteaya | yamamoto: that was from reddit | 00:17 |
| anteaya | yamamoto: have you seen it in the pink dress? | 00:17 |
| anteaya | yamamoto: tokyo looks like it just freshly vaccumed | 00:18 |
| yamamoto | anteaya: unfortunately not :( | 00:18 |
| anteaya | yamamoto: :( | 00:18 |
| yamamoto | (pink dress) | 00:18 |
| *** tkelsey has joined #openstack-infra | 00:18 | |
| nibalizer | fungi: :shrug: i've seen it both ways | 00:18 |
| nibalizer | I kinda prefer no-args over include but that is seriously just personal pref | 00:19 |
| fungi | nibalizer: then any insights into that error? | 00:19 |
| anteaya | yamamoto: seeing the turtle would still be awesome though | 00:19 |
| anteaya | turtle/tortoise | 00:20 |
| *** luqas has quit IRC | 00:20 | |
| fungi | nibalizer: http://logs.openstack.org/64/164264/9/check/gate-infra-puppet-apply-trusty/65e542e/console.html#_2015-04-16_23_52_36_997 | 00:20 |
| *** sdake has joined #openstack-infra | 00:20 | |
| *** dmellado has quit IRC | 00:21 | |
| nibalizer | fungi: yea it could be that ::mysql::client is needed, it could be that the mysql module didn't get installed right, it could be that the mysql module we are using doesn't have a ::client in it | 00:21 |
| yamamoto | in case you come to tokyo (eg. tokyo summit!) and want to meet the tortoise, it's around "Tsukishima" station. | 00:21 |
| anteaya | yamamoto: thank you | 00:21 |
| * anteaya notes Tsukishima station | 00:21 | |
| fungi | nibalizer: great point. occam would say check that it exists at all | 00:21 |
| anteaya | yamamoto: any other things to note about tokyo do share | 00:22 |
| fungi | zaro: nibalizer: think it should be mysql::client::install there? https://github.com/puppetlabs/puppetlabs-mysql/blob/master/manifests/client/install.pp | 00:23 |
| *** tkelsey has quit IRC | 00:23 | |
| fungi | oh, wait, https://github.com/puppetlabs/puppetlabs-mysql/blob/master/manifests/client.pp does exist though | 00:24 |
| nibalizer | fungi: right but thats master of mysql | 00:24 |
| nibalizer | we use $OLD | 00:24 |
| fungi | ooh | 00:24 |
| *** sdake_ has quit IRC | 00:24 | |
| yamamoto | anteaya: as tokyo is very big city, i'm afraid that many of sight-seeing spots might be too far from the summit location | 00:25 |
| fungi | 0.6.1 got it | 00:25 |
| yamamoto | time to go to office, later | 00:25 |
| *** yamamoto has quit IRC | 00:25 | |
| fungi | nibalizer: good call | 00:25 |
| fungi | zaro: https://github.com/puppetlabs/puppetlabs-mysql/tree/0.6.1/manifests/ doesn't have a client class | 00:26 |
| fungi | we probably need to just install the client package and move on | 00:26 |
| EmilienM | I'm having some beaker jobs failing, I don't know why exactly: https://jenkins03.openstack.org/job/gate-puppet-nova-puppet-beaker-rspec/35/console | 00:27 |
| EmilienM | nibalizer: have you seen that one already? | 00:27 |
| *** yamamoto has joined #openstack-infra | 00:27 | |
| *** radez is now known as radez_g0n3 | 00:27 | |
| EmilienM | I have the feeling Vagrant can't create the box | 00:27 |
| *** yamamoto has quit IRC | 00:28 | |
| fungi | Beaker::Hypervisor, found some none boxes to create | 00:29 |
| fungi | that's a neat and cryptic error | 00:29 |
| *** SumitNaiksatam has quit IRC | 00:29 | |
| *** dmellado has joined #openstack-infra | 00:29 | |
| *** SumitNaiksatam has joined #openstack-infra | 00:30 | |
| EmilienM | fungi: yeah, I just don't have access to the machine to debug | 00:30 |
| EmilienM | fungi: I'm investigating 'when the job ran successfuly' so I can dig the diff | 00:31 |
| *** marun has quit IRC | 00:31 | |
| EmilienM | today actually: https://jenkins01.openstack.org/job/gate-puppet-nova-puppet-beaker-rspec/27/console | 00:31 |
| fungi | EmilienM: here's a successful run from 10 days ago https://jenkins03.openstack.org/job/gate-puppet-nova-puppet-beaker-rspec/33/console | 00:32 |
| EmilienM | today ! | 00:32 |
| EmilienM | I have one: | 00:32 |
| fungi | 9 better! | 00:32 |
| *** davideagnello has quit IRC | 00:32 | |
| EmilienM | fungi: this one is from today, https://review.openstack.org/#/c/174120/ | 00:32 |
| EmilienM | fungi: anyway. I'll continue to dig :) | 00:33 |
| fungi | EmilienM: cool | 00:33 |
| *** zz_dimtruck is now known as dimtruck | 00:34 | |
| EmilienM | fungi: just read your email about the hook | 00:36 |
| EmilienM | fungi: you make my life easier :) | 00:36 |
| nibalizer | EmilienM: yup aeen that many timea | 00:39 |
| nibalizer | so beaker on infra doesnt use vagrant | 00:39 |
| nibalizer | it uses sah to talk to the local machinw | 00:40 |
| anteaya | sah? | 00:40 |
| fungi | EmilienM: when you get a chance to dig into that, let us know if you have questions. zuul post pipeline jobs to propose changes to projects when other changes merge is already a solved problem, so hopefully very little you'll really need to develop. also we try not to rely much on gerrit hooks | 00:40 |
| nibalizer | ssh sorry, phone is hard | 00:40 |
| anteaya | nibalizer: I was hoping it was ssh | 00:41 |
| nibalizer | anteaya: :) | 00:42 |
| anteaya | :) | 00:43 |
| nibalizer | EmilienM: anyways yea its buggy, i cant now but maybe tomorrw i can help you debug it | 00:43 |
| anteaya | nibalizer: kudos to you to still aim for real words when using the phone | 00:43 |
| *** thingee has joined #openstack-infra | 00:44 | |
| nibalizer | EmilienM: you can also try using latest beaker, supposedly they fixed the issue that causes that | 00:44 |
| lifeless | fungi: / clarkb: a +2 on https://review.openstack.org/#/c/142144/ would be nice | 00:45 |
| lifeless | erm and +A | 00:45 |
| lifeless | and if both of you could see your way to +2 and +A on https://review.openstack.org/#/c/174625/ | 00:46 |
| *** patrickeast has quit IRC | 00:50 | |
| *** achanda has quit IRC | 00:51 | |
| *** Prophidys2 has quit IRC | 00:52 | |
| openstackgerrit | David Lenwell proposed openstack-infra/project-config: New repos for Akanda https://review.openstack.org/174104 | 00:53 |
| EmilienM | fungi: I still need to see how to detect the tag in commit message | 00:57 |
| *** zhiwei has joined #openstack-infra | 00:58 | |
| *** achanda has joined #openstack-infra | 00:59 | |
| *** mwagner_lap has joined #openstack-infra | 01:00 | |
| *** emagana has quit IRC | 01:02 | |
| *** emagana has joined #openstack-infra | 01:03 | |
| *** emagana has quit IRC | 01:03 | |
| *** weshay has joined #openstack-infra | 01:05 | |
| nibalizer | ssss | 01:06 |
| fungi | EmilienM: right, probably what you'd need is a job that runs in the post pipeline for your projects and retrieves the commit which triggered it. if it's a merge commit this gets a little trickier since it'll need to look at the parents to determine which is the one that just got merged to the branch (it'll be the one with no other parents itself i think?) | 01:06 |
| openstackgerrit | David Lenwell proposed openstack-infra/project-config: New repos for Akanda https://review.openstack.org/174104 | 01:06 |
| anteaya | nibalizer: you're the best | 01:06 |
| fungi | EmilienM: at that point, do a pattern match on the commit message and the rest is fairly similar to http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/propose_update.sh i expect | 01:07 |
| *** tsg has quit IRC | 01:07 | |
| EmilienM | fungi: well, I was more thinking at a task that 1/ find tags in commit messages and list branches 2/ for each branch, do the cherry-pick in checking the patch is not a cherry-pick itself | 01:08 |
| *** baoli has joined #openstack-infra | 01:08 | |
| EmilienM | but I'll see how can I use the existing | 01:08 |
| fungi | EmilienM: yep, so that sounds like a couple conditional pattern matches. check out $ZUUL_REF and see if it has multiple parents. if it does, figure out which of its parents has no other parents and check that out instead | 01:09 |
| fungi | EmilienM: then pattern match in the commit message for a cherry-pick header and short-circuit the job successfully if found | 01:09 |
| fungi | EmilienM: if it wasn't already a cherry-pick, then check for a header indicating cherry-picks are desired and short-curcuit successfully if not found | 01:09 |
| EmilienM | fungi: with tag, like "run-cherry-pick" ? | 01:10 |
| *** yamamoto has joined #openstack-infra | 01:10 | |
| EmilienM | (in the commit message, like docimpact does) | 01:10 |
| fungi | EmilienM: better not to use the word "tag" here | 01:10 |
| fungi | tags are another concept in git | 01:10 |
| EmilienM | indeed | 01:10 |
| fungi | you're talking about headers in the commit message | 01:11 |
| EmilienM | ok. | 01:11 |
| fungi | (which git conventionally places in the last lines of the commit message, so tempting to call them "footers" but whatever) | 01:11 |
| fungi | anyway, you probably want a header like Cherry-Picks: icehouse juno kilo | 01:12 |
| fungi | or something | 01:12 |
| EmilienM | yeah | 01:12 |
| fungi | i'm sure reviewers will gladly bikeshed the header key on the change with you once you get that far | 01:12 |
| yamamoto | anteaya: fungi: hi. it turned out that we have upto 5-6 instances of ci for various purposes. backup/testing/etc. | 01:12 |
| EmilienM | I'm investigating that way now, I'll produce something with your suggestions | 01:12 |
| EmilienM | fungi: good to know. | 01:12 |
| EmilienM | fungi: thx again | 01:12 |
| fungi | yamamoto: okay, that makes sense then. i was just trying to make sure it wasn't indicating a problem on your end | 01:13 |
| *** gyee_ has quit IRC | 01:13 | |
| *** krtaylor has joined #openstack-infra | 01:13 | |
| yamamoto | fungi: if it seems to keep increasing, please let me know | 01:14 |
| fungi | EmilienM: actually, to bikeshed on that a bit, in launchpad bugs we've used the tag "backport-potential" so maybe Backport-Potential: icehouse juno kilo | 01:14 |
| fungi | yamamoto: i've just checked again and it seems to be holding steady between 17 and 20 so that's probably fine | 01:14 |
| EmilienM | fungi: will do, for consistency. | 01:14 |
| yamamoto | fungi: thank you | 01:15 |
| fungi | yamamoto: you're welcome! | 01:15 |
| *** notnownikki has quit IRC | 01:16 | |
| *** mattfarina has joined #openstack-infra | 01:17 | |
| *** mattfarina has quit IRC | 01:17 | |
| anteaya | yamamoto: thank you for looking into it | 01:17 |
| HenryG | Could a vendor (stackforge) repo hook in to global-requirements? Or is it a bad idea? | 01:18 |
| yamamoto | anteaya: you're welcome! thank you for letting me know. | 01:19 |
| fungi | HenryG: as in get your repo-level requirements list changes checked against teh global list and get updates proposed to your repo from the global list? there are quite a few stackforge projects doing so already | 01:19 |
| HenryG | fungi: yes, exactly that. Do you have a pointer for setting it up? | 01:20 |
| fungi | HenryG: however trying to get changes/additions made to the global requirements list solely in support of a stackforge project is a lot harder | 01:20 |
| HenryG | fungi: not interested in that (yet) | 01:20 |
| fungi | HenryG: add the requirements-check job for your repo in openstack-infra/project-config:zuul/layout.yaml and add your repo to the list in openstack/requirements:projects.txt | 01:21 |
| fungi | HenryG: you should see plenty of examples in those two files | 01:21 |
| HenryG | fungi: awesome, thanks! | 01:21 |
| fungi | any time! | 01:22 |
| *** smoser has quit IRC | 01:22 | |
| *** smoser has joined #openstack-infra | 01:24 | |
| *** smoser has quit IRC | 01:26 | |
| *** smoser has joined #openstack-infra | 01:26 | |
| HenryG | fungi: ok, so if our repo has a requirement that is not in global-reqs will that cause a problem? | 01:30 |
| EmilienM | nibalizer: well, I reverted the Gemfile to use an old version of beaker. It works now. Willd debug tomorrow. | 01:31 |
| nibalizer | haha | 01:32 |
| nibalizer | thats the other option | 01:32 |
| Clint | nibalizer: i think you don't know me, but tell aedo i say hi | 01:33 |
| fungi | HenryG: yes, though i think a "soft" option was recently added to the projects.txt which may prevent that from causing an issue. might want to double-check with someone who isn't about to head to bed | 01:33 |
| *** Sukhdev has quit IRC | 01:34 | |
| HenryG | fungi: thanks. I am also heading in that direction. I will pursue further tomorrow. | 01:34 |
| *** mbacchi1 has quit IRC | 01:37 | |
| *** tqtran has quit IRC | 01:38 | |
| nibalizer | Clint: will do | 01:40 |
| Clint | thanks | 01:40 |
| *** claudiub has quit IRC | 01:41 | |
| openstackgerrit | Merged openstack-dev/pbr: Ignore non-release related tags https://review.openstack.org/142144 | 01:43 |
| *** rfolco has quit IRC | 01:46 | |
| *** harlowja is now known as harlowja_away | 01:47 | |
| *** dims_ has quit IRC | 01:54 | |
| *** trey has quit IRC | 01:54 | |
| boris-42 | fungi: hi | 01:57 |
| *** trey has joined #openstack-infra | 01:59 | |
| boris-42 | fungi: I am trying to make voting coverage job | 01:59 |
| boris-42 | fungi: so basically I did it, and it works when I run it locally | 02:00 |
| boris-42 | fungi: but when I am trying to run it in infra I am getting strange errors | 02:00 |
| boris-42 | fungi: https://jenkins01.openstack.org/job/rally-coverage/908/consoleFull and here is the patch https://review.openstack.org/#/c/174645/ | 02:01 |
| boris-42 | fungi: I really can't understand what is the difference between local and gate in this case.. | 02:01 |
| *** ivar-laz_ has joined #openstack-infra | 02:03 | |
| *** ivar-lazzaro has quit IRC | 02:06 | |
| *** ivar-laz_ has quit IRC | 02:09 | |
| fungi | boris-42: i think git stash will only operate on files which are tracked | 02:10 |
| fungi | boris-42: particularly if you're wanting to stash files i think they can't match patterns in your .gitignore? | 02:11 |
| fungi | boris-42: yeah, they actually need to be added as tracked files even | 02:11 |
| fungi | if i create new files and don't git add them, then git stash says i have no local changes to save | 02:12 |
| fungi | boris-42: anyway, hope that helps. i'm heading to sleep but there are other people here who can probably help you debug further if you need | 02:13 |
| boris-42 | fungi: ok thanks | 02:13 |
| *** pal has joined #openstack-infra | 02:13 | |
| fungi | anyway, that looks like the failed assumption in your script. you're trying to stash the coverage report and then restore it after another checkout, and the log is saying there were no local changes to shash and no shash to apply | 02:14 |
| fungi | er, no sTash to apply | 02:15 |
| *** achanda has quit IRC | 02:20 | |
| *** dkranz has joined #openstack-infra | 02:21 | |
| *** achanda has joined #openstack-infra | 02:22 | |
| *** dmellado has quit IRC | 02:22 | |
| *** tiswanso has joined #openstack-infra | 02:24 | |
| *** ddieterly has joined #openstack-infra | 02:25 | |
| *** tiswanso has quit IRC | 02:27 | |
| *** tiswanso has joined #openstack-infra | 02:28 | |
| *** Krinkle is now known as Krinkle|detached | 02:31 | |
| openstackgerrit | David Lenwell proposed openstack-infra/project-config: New repos for Akanda https://review.openstack.org/174104 | 02:33 |
| *** pal_ has joined #openstack-infra | 02:33 | |
| *** pal has quit IRC | 02:34 | |
| *** dimtruck is now known as zz_dimtruck | 02:34 | |
| *** dkranz has quit IRC | 02:37 | |
| *** weshay has quit IRC | 02:37 | |
| *** dmellado has joined #openstack-infra | 02:42 | |
| *** liusheng has joined #openstack-infra | 02:46 | |
| *** baoli has quit IRC | 02:46 | |
| *** achanda has quit IRC | 02:49 | |
| *** woodster_ has quit IRC | 02:50 | |
| *** sputnik13 has joined #openstack-infra | 02:53 | |
| *** unicell has quit IRC | 02:54 | |
| *** yamahata has quit IRC | 02:56 | |
| *** baoli has joined #openstack-infra | 02:57 | |
| *** Longgeek has joined #openstack-infra | 02:59 | |
| clarkb | 560km later I am back home | 03:03 |
| *** Longgeek has quit IRC | 03:04 | |
| *** Longgeek has joined #openstack-infra | 03:06 | |
| *** liusheng has quit IRC | 03:07 | |
| *** liusheng has joined #openstack-infra | 03:07 | |
| *** otter768 has quit IRC | 03:08 | |
| *** baoli has quit IRC | 03:17 | |
| *** crc32 has joined #openstack-infra | 03:20 | |
| *** achanda has joined #openstack-infra | 03:20 | |
| *** pal_ has quit IRC | 03:22 | |
| *** tiswanso has quit IRC | 03:29 | |
| *** pal has joined #openstack-infra | 03:31 | |
| *** davideagnello has joined #openstack-infra | 03:33 | |
| *** sdake_ has joined #openstack-infra | 03:34 | |
| *** wenlock has quit IRC | 03:34 | |
| *** wwwBUKOLAYcom has quit IRC | 03:36 | |
| *** davideagnello has quit IRC | 03:38 | |
| *** sdake has quit IRC | 03:38 | |
| *** Sukhdev has joined #openstack-infra | 03:44 | |
| *** spzala has quit IRC | 03:45 | |
| *** trey has quit IRC | 03:50 | |
| *** gyee has quit IRC | 03:52 | |
| *** achanda has quit IRC | 03:52 | |
| *** luqas has joined #openstack-infra | 03:52 | |
| *** gyee_ has joined #openstack-infra | 03:52 | |
| *** sputnik13 has quit IRC | 03:53 | |
| *** gyee_ has quit IRC | 03:54 | |
| *** ddieterly has quit IRC | 03:56 | |
| *** luqas has quit IRC | 03:57 | |
| *** trey has joined #openstack-infra | 03:58 | |
| *** yfried|afk is now known as yfried__ | 04:06 | |
| *** achanda has joined #openstack-infra | 04:07 | |
| *** achanda has quit IRC | 04:11 | |
| *** MarkAtwood has joined #openstack-infra | 04:11 | |
| *** thingee has quit IRC | 04:15 | |
| *** achanda has joined #openstack-infra | 04:16 | |
| *** yfried__ is now known as yfried|afk | 04:17 | |
| *** achanda has quit IRC | 04:18 | |
| *** yfried|afk is now known as yfried__ | 04:19 | |
| *** tkelsey has joined #openstack-infra | 04:19 | |
| *** AJaeger has joined #openstack-infra | 04:20 | |
| *** achanda has joined #openstack-infra | 04:21 | |
| *** tkelsey has quit IRC | 04:24 | |
| *** ddieterly has joined #openstack-infra | 04:27 | |
| *** achanda has quit IRC | 04:29 | |
| *** ddieterly has quit IRC | 04:32 | |
| *** mrmartin has joined #openstack-infra | 04:37 | |
| *** crc32 has quit IRC | 04:38 | |
| *** crc32 has joined #openstack-infra | 04:38 | |
| *** achanda has joined #openstack-infra | 04:42 | |
| *** crc32 has quit IRC | 04:45 | |
| *** teran has quit IRC | 04:46 | |
| *** mmedvede has quit IRC | 04:46 | |
| *** ajmiller_ has joined #openstack-infra | 04:51 | |
| mordred | clarkb: nicely done | 04:52 |
| *** ajmiller has quit IRC | 04:54 | |
| *** mmedvede has joined #openstack-infra | 04:57 | |
| *** MarkAtwood has quit IRC | 05:01 | |
| *** dhritishikhar has joined #openstack-infra | 05:01 | |
| openstackgerrit | Merged openstack-infra/project-config: New repos for Akanda https://review.openstack.org/174104 | 05:06 |
| *** xyang1 has quit IRC | 05:07 | |
| *** oomichi has joined #openstack-infra | 05:08 | |
| *** otter768 has joined #openstack-infra | 05:09 | |
| *** sputnik13 has joined #openstack-infra | 05:09 | |
| *** sputnik13 has quit IRC | 05:11 | |
| *** otter768 has quit IRC | 05:13 | |
| *** crc32 has joined #openstack-infra | 05:15 | |
| *** openstackgerrit has quit IRC | 05:21 | |
| *** openstackgerrit has joined #openstack-infra | 05:21 | |
| *** stevemar has joined #openstack-infra | 05:21 | |
| *** sks has joined #openstack-infra | 05:27 | |
| *** ddieterly has joined #openstack-infra | 05:28 | |
| *** harlowja_at_home has joined #openstack-infra | 05:31 | |
| *** ddieterly has quit IRC | 05:32 | |
| *** stevemar has quit IRC | 05:32 | |
| *** stevemar has joined #openstack-infra | 05:33 | |
| *** yfried__ is now known as yfried|afk | 05:34 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Fix major update_user issues https://review.openstack.org/174704 | 05:37 |
| *** Sukhdev has quit IRC | 05:43 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Invalidate user cache on user create https://review.openstack.org/173589 | 05:45 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Add test for user_cache https://review.openstack.org/173584 | 05:45 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: MonkeyPatch time.sleep in unit tests to avoid wait https://review.openstack.org/173110 | 05:45 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Test that deleting user invalidates user cache https://review.openstack.org/173596 | 05:45 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Fix major update_user issues https://review.openstack.org/174704 | 05:45 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: create_user should return the user created https://review.openstack.org/174642 | 05:45 |
| *** Sukhdev has joined #openstack-infra | 05:50 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Test flavor cache and add invalidation https://review.openstack.org/174707 | 05:53 |
| openstackgerrit | yolanda.robla proposed openstack-infra/nodepool: Different queues for slow tasks. https://review.openstack.org/170788 | 05:54 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Test flavor cache and add invalidation https://review.openstack.org/174707 | 05:54 |
| *** tnovacik has joined #openstack-infra | 05:55 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Add experimental glusterfs centos7 job https://review.openstack.org/174708 | 05:55 |
| *** deepakcs has joined #openstack-infra | 05:57 | |
| deepakcs | AJaeger, https://review.openstack.org/173408 (do we need Sean's agreement before merging this one? ) | 05:57 |
| deepakcs | AJaeger, the glusterfs CI job is failing bcos of ^^ not being merged, it would be great to have it in asap pls | 05:57 |
| *** oomichi has quit IRC | 05:59 | |
| AJaeger | deepakcs: let me +2 it - and then let's see what other core reviewers say. Having sdague review it would be great | 06:01 |
| deepakcs | AJaeger, thanks, its been > 1 week that gluster CI is failing just bcos of this 1 testcase, otherwise it was green for many weeks | 06:02 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/174716 | 06:03 |
| *** rm_work is now known as rm_work|away | 06:03 | |
| AJaeger | deepakcs: that's unfortunate ;( | 06:04 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Add test for caching in list_images https://review.openstack.org/174717 | 06:06 |
| SpamapS | so many caches to invalidate :-P | 06:08 |
| *** pal has quit IRC | 06:10 | |
| deepakcs | AJaeger, hence the need to get this in asap :) | 06:10 |
| AJaeger | deepakcs: please ping other infra core reviewers later today (US morning) | 06:11 |
| *** stevemar has quit IRC | 06:12 | |
| deepakcs | AJaeger, sure | 06:12 |
| *** emagana has joined #openstack-infra | 06:16 | |
| *** ibiris_away is now known as ibiris | 06:17 | |
| *** harlowja_at_home has quit IRC | 06:18 | |
| *** tkelsey has joined #openstack-infra | 06:21 | |
| *** armax has quit IRC | 06:22 | |
| *** ildikov has quit IRC | 06:23 | |
| *** tkelsey has quit IRC | 06:25 | |
| sdake_ | can someone with github superpowers change github's descrption of kolla | 06:27 |
| sdake_ | https://bugs.launchpad.net/kolla/+bug/1437562 | 06:27 |
| openstack | Launchpad bug 1437562 in kolla "Uncorrect description on github" [Undecided,New] | 06:27 |
| sdake_ | A commit hit the infra repo but it didnt change the name in github | 06:27 |
| *** mrunge has joined #openstack-infra | 06:27 | |
| *** ddieterly has joined #openstack-infra | 06:29 | |
| *** bnemec has quit IRC | 06:32 | |
| *** hdd has joined #openstack-infra | 06:32 | |
| *** ddieterly has quit IRC | 06:33 | |
| *** scheuran has joined #openstack-infra | 06:36 | |
| *** Longgeek_ has joined #openstack-infra | 06:37 | |
| *** yamahata has joined #openstack-infra | 06:38 | |
| *** mrmartin has quit IRC | 06:38 | |
| *** Longgeek has quit IRC | 06:39 | |
| *** jyuso1 has quit IRC | 06:40 | |
| *** jyuso1 has joined #openstack-infra | 06:40 | |
| *** Kennan2 has quit IRC | 06:41 | |
| *** Kennan has joined #openstack-infra | 06:42 | |
| *** Sukhdev has quit IRC | 06:45 | |
| AJaeger | sdake_: so, you changed it in project-config but it was not hcanged in github? | 06:46 |
| AJaeger | AFAIK we have nothing implemented to change this automatically, might be a missing API on github site. | 06:47 |
| sdake_ | daneyon hansen changed it iirc | 06:47 |
| sdake_ | its really confusing to people because we abaonded kubernetes for kolla | 06:47 |
| AJaeger | Let's see whether an infra admin can help with manually doing it - please ping clarkb or fungi later today | 06:48 |
| sdake_ | will do thanks | 06:49 |
| sdake_ | its actually midnight time to ptfo :) | 06:49 |
| sdake_ | ttyl | 06:49 |
| *** achanda has quit IRC | 06:53 | |
| *** achanda has joined #openstack-infra | 06:56 | |
| *** yfried|afk is now known as yfried__ | 06:56 | |
| *** gilliard is now known as gillllliard | 07:03 | |
| *** gillllliard is now known as gillllllliard | 07:03 | |
| *** mpavone has joined #openstack-infra | 07:03 | |
| *** zz_avozza is now known as avozza | 07:04 | |
| *** sdake has joined #openstack-infra | 07:06 | |
| *** jyuso has joined #openstack-infra | 07:06 | |
| *** ildikov has joined #openstack-infra | 07:08 | |
| *** e0ne has joined #openstack-infra | 07:08 | |
| *** jyuso1 has quit IRC | 07:09 | |
| *** sdake_ has quit IRC | 07:09 | |
| *** otter768 has joined #openstack-infra | 07:10 | |
| *** jcoufal has joined #openstack-infra | 07:10 | |
| *** achuprin has quit IRC | 07:10 | |
| *** yfried__ is now known as yfried|afk | 07:12 | |
| *** dtantsur|afk is now known as dtantsur | 07:13 | |
| *** teran has joined #openstack-infra | 07:14 | |
| *** markus_z has joined #openstack-infra | 07:14 | |
| *** otter768 has quit IRC | 07:14 | |
| *** ibiris is now known as ibiris_away | 07:14 | |
| *** ibiris_away is now known as ibiris | 07:15 | |
| *** clayton has quit IRC | 07:17 | |
| *** amotoki has quit IRC | 07:18 | |
| *** tkelsey has joined #openstack-infra | 07:18 | |
| *** dvorak has joined #openstack-infra | 07:18 | |
| *** soren_ has joined #openstack-infra | 07:19 | |
| *** luqas has joined #openstack-infra | 07:22 | |
| *** e0ne has quit IRC | 07:23 | |
| *** dhritishikhar has quit IRC | 07:23 | |
| *** vlaza has joined #openstack-infra | 07:25 | |
| *** e0ne has joined #openstack-infra | 07:28 | |
| *** ibiris is now known as ibiris_away | 07:28 | |
| *** asettle has quit IRC | 07:28 | |
| *** devvesa has joined #openstack-infra | 07:29 | |
| *** achanda has quit IRC | 07:29 | |
| *** ddieterly has joined #openstack-infra | 07:29 | |
| *** Hal has joined #openstack-infra | 07:29 | |
| *** alexpilotti has joined #openstack-infra | 07:30 | |
| *** Hal is now known as Guest50816 | 07:30 | |
| *** andreykurilin__ has joined #openstack-infra | 07:32 | |
| *** achanda_ has joined #openstack-infra | 07:32 | |
| *** chlong has quit IRC | 07:33 | |
| *** dims__ has joined #openstack-infra | 07:33 | |
| *** ddieterly has quit IRC | 07:34 | |
| *** yamahata has quit IRC | 07:34 | |
| *** hashar has joined #openstack-infra | 07:35 | |
| *** jlibosva has joined #openstack-infra | 07:35 | |
| *** vponomaryov has quit IRC | 07:37 | |
| *** aarefiev_ has quit IRC | 07:38 | |
| *** dims__ has quit IRC | 07:38 | |
| *** mrmartin has joined #openstack-infra | 07:39 | |
| *** jlanoux has joined #openstack-infra | 07:40 | |
| *** achanda_ has quit IRC | 07:40 | |
| *** asettle has joined #openstack-infra | 07:41 | |
| *** yfried|afk is now known as yfried__ | 07:44 | |
| *** mahito has joined #openstack-infra | 07:46 | |
| *** alex_xu has quit IRC | 07:46 | |
| *** jyuso1 has joined #openstack-infra | 07:46 | |
| *** heyongli has quit IRC | 07:47 | |
| *** heyongli has joined #openstack-infra | 07:48 | |
| *** alex_xu has joined #openstack-infra | 07:48 | |
| *** jyuso has quit IRC | 07:49 | |
| *** mahito_ has quit IRC | 07:49 | |
| *** jistr has joined #openstack-infra | 07:50 | |
| *** abhiram_moturi has quit IRC | 07:50 | |
| *** abhiram_moturi has joined #openstack-infra | 07:50 | |
| *** dtantsur is now known as dtantsur|brb | 07:51 | |
| *** MaxV has joined #openstack-infra | 07:52 | |
| *** andreykurilin___ has joined #openstack-infra | 07:53 | |
| *** andreykurilin__ has quit IRC | 07:53 | |
| *** e0ne has quit IRC | 07:57 | |
| *** arxcruz has joined #openstack-infra | 08:00 | |
| *** HeOS has quit IRC | 08:00 | |
| *** ibiris_away is now known as ibiris | 08:01 | |
| *** e0ne has joined #openstack-infra | 08:01 | |
| ttx | AJaeger: o/ | 08:01 |
| ttx | AJaeger: translations updates and RC2s are delayed due to stable/kilo being on fire, so I won't ping you about that today | 08:02 |
| ttx | AJaeger: if you want to help, you can review https://review.openstack.org/#/c/174595/ which is on hte critical path to fix all things | 08:02 |
| *** mrmartin has quit IRC | 08:03 | |
| *** achanda has joined #openstack-infra | 08:06 | |
| *** sks has quit IRC | 08:08 | |
| *** mase_x200 has joined #openstack-infra | 08:08 | |
| *** sushilkm has joined #openstack-infra | 08:08 | |
| *** sushilkm has left #openstack-infra | 08:08 | |
| *** e0ne has quit IRC | 08:09 | |
| *** emagana has quit IRC | 08:12 | |
| *** e0ne has joined #openstack-infra | 08:14 | |
| *** sushilkm has joined #openstack-infra | 08:14 | |
| *** sushilkm has left #openstack-infra | 08:14 | |
| *** jyuso has joined #openstack-infra | 08:15 | |
| *** jyuso1 has quit IRC | 08:15 | |
| *** notnownikki has joined #openstack-infra | 08:17 | |
| *** e0ne has quit IRC | 08:18 | |
| *** turul has joined #openstack-infra | 08:18 | |
| *** unicell has joined #openstack-infra | 08:19 | |
| *** achanda has quit IRC | 08:20 | |
| *** jyuso has quit IRC | 08:20 | |
| *** jyuso1 has joined #openstack-infra | 08:20 | |
| *** hichihara has quit IRC | 08:21 | |
| *** derekh has joined #openstack-infra | 08:22 | |
| *** achanda_ has joined #openstack-infra | 08:22 | |
| *** zz_johnthetubagu is now known as johnthetubaguy | 08:22 | |
| *** yfried__ is now known as yfried|afk | 08:22 | |
| *** e0ne has joined #openstack-infra | 08:22 | |
| *** crc32 has quit IRC | 08:23 | |
| *** mrmartin has joined #openstack-infra | 08:24 | |
| *** sdake has quit IRC | 08:28 | |
| *** mrmartin has quit IRC | 08:29 | |
| *** turul is now known as afazekas | 08:30 | |
| ttx | johnthetubaguy: o/ | 08:30 |
| *** ddieterly has joined #openstack-infra | 08:30 | |
| johnthetubaguy | ttx: hello | 08:30 |
| ttx | johnthetubaguy: I think it's safer to wait for Monday to open the RC2 window | 08:31 |
| ttx | the stable/kilo branch testing is still in a lot of flux | 08:31 |
| johnthetubaguy | ttx: I was going to ask about that for other reasons, but that totally makes sense | 08:31 |
| AJaeger | ttx, will review now. Thanks for the heads-up | 08:31 |
| ttx | also we expect a couple libs once the mess is fixed, and we can't really close the RC2 window before we have them (so that the right requirements are shipped in) | 08:31 |
| johnthetubaguy | ttx: oh, very good point, eek | 08:32 |
| ttx | So at this point... keep identifying issues and proposing backpotrs | 08:32 |
| *** ssam2 has joined #openstack-infra | 08:32 | |
| ttx | we can open-close te RC2 quite fast if all patches are lined up | 08:32 |
| ttx | Thanks for your understanding :) | 08:32 |
| johnthetubaguy | yes, thats a good point, I need to check up on some of the backports, but yes, makes sense | 08:32 |
| AJaeger | ttx, approved | 08:33 |
| ttx | AJaeger: cool thx | 08:33 |
| johnthetubaguy | ttx: no problem, thank you for doing your usual amazing job at tidying up all the loose ends we leave around the place! | 08:33 |
| AJaeger | +1000 | 08:34 |
| AJaeger | ttx, any guess for translation updates? I'm travelling all of Tuesday, so won't be able to help then | 08:34 |
| ttx | np, would be more efficient if I wasn't sitting in a hotel room, but dhellmann stepped up and covered for me | 08:34 |
| *** ddieterly has quit IRC | 08:35 | |
| ttx | AJaeger: Monday-Wednesday at this point | 08:35 |
| *** achanda_ has quit IRC | 08:35 | |
| johnthetubaguy | ttx: I know that feeling, hotel rooms are bad places for fire fighting | 08:35 |
| *** mase_x200 has quit IRC | 08:35 | |
| AJaeger | thanks, ttx | 08:35 |
| * johnthetubaguy has a strange vision of lots of developers walking around tripping up over their badly tied shoe laces… | 08:35 | |
| *** dizquierdo has joined #openstack-infra | 08:36 | |
| *** mahito has quit IRC | 08:37 | |
| *** yfried|afk is now known as yfried__ | 08:37 | |
| openstackgerrit | Tim Kelsey proposed openstack-infra/project-config: Experimental bandit job for anchor https://review.openstack.org/174761 | 08:39 |
| *** teran has quit IRC | 08:40 | |
| *** e0ne has quit IRC | 08:42 | |
| *** andreykurilin___ has quit IRC | 08:43 | |
| *** GheRivero has quit IRC | 08:45 | |
| *** _nadya_ has joined #openstack-infra | 08:45 | |
| *** e0ne has joined #openstack-infra | 08:46 | |
| *** aarefiev has joined #openstack-infra | 08:47 | |
| *** sushilkm has joined #openstack-infra | 08:49 | |
| *** sushilkm has left #openstack-infra | 08:49 | |
| *** pcaruana has joined #openstack-infra | 08:50 | |
| *** mpaolino has joined #openstack-infra | 08:50 | |
| *** e0ne has quit IRC | 08:51 | |
| *** e0ne has joined #openstack-infra | 08:53 | |
| *** dhritishikhar has joined #openstack-infra | 08:53 | |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: Calico the new Fuel plugin project https://review.openstack.org/174763 | 08:55 |
| *** GheRivero has joined #openstack-infra | 09:00 | |
| *** e0ne has quit IRC | 09:00 | |
| *** pal has joined #openstack-infra | 09:00 | |
| *** claudiub has joined #openstack-infra | 09:01 | |
| *** tnovacik has quit IRC | 09:02 | |
| *** e0ne has joined #openstack-infra | 09:04 | |
| *** yamamoto has quit IRC | 09:06 | |
| *** jyuso1 has quit IRC | 09:07 | |
| *** ildikov has quit IRC | 09:08 | |
| *** e0ne has quit IRC | 09:09 | |
| *** HeOS has joined #openstack-infra | 09:09 | |
| openstackgerrit | Merged openstack-infra/project-config: Temporarily ignore requirements on master libs https://review.openstack.org/174595 | 09:09 |
| *** ibiris is now known as ibiris_away | 09:09 | |
| *** otter768 has joined #openstack-infra | 09:11 | |
| *** yfried__ is now known as yfried|afk | 09:12 | |
| *** mfmcdonagh has quit IRC | 09:14 | |
| openstackgerrit | Stuart McLaren proposed openstack/requirements: Update the minimum glanceclient version https://review.openstack.org/174770 | 09:15 |
| *** otter768 has quit IRC | 09:15 | |
| *** yfried|afk is now known as yfried__ | 09:15 | |
| *** ihrachyshka has joined #openstack-infra | 09:16 | |
| *** ibiris_away is now known as ibiris | 09:19 | |
| *** fhubik has joined #openstack-infra | 09:19 | |
| *** HeOS has quit IRC | 09:20 | |
| *** HeOS has joined #openstack-infra | 09:20 | |
| *** teran has joined #openstack-infra | 09:21 | |
| *** dizquierdo has quit IRC | 09:22 | |
| *** ildikov has joined #openstack-infra | 09:23 | |
| *** Nikkau has joined #openstack-infra | 09:27 | |
| *** dhritishikhar has quit IRC | 09:28 | |
| *** ddieterly has joined #openstack-infra | 09:31 | |
| *** dhritishikhar_ has joined #openstack-infra | 09:33 | |
| *** ibiris is now known as ibiris_away | 09:33 | |
| *** yfried__ is now known as yfried|afk | 09:34 | |
| *** ddieterly has quit IRC | 09:35 | |
| *** ibiris_away is now known as ibiris | 09:35 | |
| *** dhritishikhar_ has quit IRC | 09:37 | |
| *** dhritishikhar_ has joined #openstack-infra | 09:37 | |
| *** avozza is now known as zz_avozza | 09:39 | |
| *** claudiub_ has joined #openstack-infra | 09:39 | |
| *** claudiub has quit IRC | 09:42 | |
| *** dhritishikhar_ has quit IRC | 09:42 | |
| *** jamielennox is now known as jamielennox|away | 09:49 | |
| *** e0ne has joined #openstack-infra | 09:50 | |
| *** skolekonov has quit IRC | 09:50 | |
| *** sushilkm has joined #openstack-infra | 09:52 | |
| *** sushilkm has left #openstack-infra | 09:53 | |
| *** pelix has joined #openstack-infra | 09:56 | |
| AJaeger | ttx, patch for master libs has merged | 09:58 |
| *** cdent has joined #openstack-infra | 10:01 | |
| *** zz_avozza is now known as avozza | 10:07 | |
| *** enikanorov_ has quit IRC | 10:09 | |
| *** BobBall_AWOL is now known as BobBall | 10:12 | |
| *** sputnik13 has joined #openstack-infra | 10:12 | |
| *** cdent has quit IRC | 10:12 | |
| *** cdent has joined #openstack-infra | 10:13 | |
| *** enikanorov_ has joined #openstack-infra | 10:15 | |
| *** sputnik13 has quit IRC | 10:15 | |
| *** kmartin has quit IRC | 10:20 | |
| *** yfried|afk is now known as yfried__ | 10:22 | |
| *** dhritishikhar_ has joined #openstack-infra | 10:23 | |
| *** dhritishikhar_ has quit IRC | 10:27 | |
| *** pc_m has joined #openstack-infra | 10:28 | |
| *** MaxV has quit IRC | 10:31 | |
| *** ddieterly has joined #openstack-infra | 10:31 | |
| *** MaxV has joined #openstack-infra | 10:33 | |
| *** dtantsur|brb is now known as dtantsur | 10:35 | |
| *** ddieterly has quit IRC | 10:36 | |
| *** e0ne is now known as e0ne_ | 10:38 | |
| *** yfried__ is now known as yfried|afk | 10:38 | |
| *** ajmiller__ has joined #openstack-infra | 10:39 | |
| *** dhritishikhar_ has joined #openstack-infra | 10:41 | |
| *** e0ne_ is now known as e0ne | 10:42 | |
| *** ajmiller_ has quit IRC | 10:43 | |
| *** sushilkm has joined #openstack-infra | 10:43 | |
| *** sushilkm has left #openstack-infra | 10:44 | |
| *** pal has quit IRC | 10:45 | |
| *** Guest50816 has quit IRC | 10:46 | |
| *** _nadya_ has quit IRC | 10:47 | |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: New Fuel plugin project for Calico https://review.openstack.org/174763 | 10:49 |
| *** jlibosva has quit IRC | 10:53 | |
| *** jlibosva has joined #openstack-infra | 10:54 | |
| *** jlibosva has quit IRC | 10:54 | |
| *** jlibosva has joined #openstack-infra | 10:55 | |
| *** jlibosva has quit IRC | 10:56 | |
| *** jlibosva has joined #openstack-infra | 10:56 | |
| ttx | AJaeger: thx. Will approve the uncaps now | 10:57 |
| *** yfried|afk is now known as yfried__ | 10:57 | |
| *** jlibosva has quit IRC | 10:57 | |
| *** jlibosva has joined #openstack-infra | 10:57 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/nodepool: Different queues for slow tasks. https://review.openstack.org/170788 | 11:02 |
| ttx | I see sdague already sent the rechecks | 11:02 |
| *** dims__ has joined #openstack-infra | 11:02 | |
| *** _nadya_ has joined #openstack-infra | 11:03 | |
| *** _nadya_ has quit IRC | 11:03 | |
| sdague | ttx: yeh | 11:03 |
| sdague | things were idle | 11:03 |
| sdague | and it looked like they should work now | 11:03 |
| *** _nadya_ has joined #openstack-infra | 11:03 | |
| ttx | cool, trying to attract +2s by leaving comments. About to hop on a train | 11:03 |
| ttx | I should proabbly go now | 11:04 |
| sdague | I think you are going to need to email PTLs directly | 11:04 |
| sdague | clients get overlooked a lot | 11:05 |
| *** sks has joined #openstack-infra | 11:05 | |
| sdague | these are the times were we should have some uber team that can approve things like this | 11:05 |
| *** vponomaryov has joined #openstack-infra | 11:06 | |
| AJaeger | sdague: the infra admins have these permissions | 11:07 |
| AJaeger | so, if really needed, we can ask fungi, jeblair, clarkb,... | 11:07 |
| sdague | and then you also have things like - https://review.openstack.org/#/c/174528/ where ceilometer client doesn't reliably pass it's own unit tests :( | 11:07 |
| *** yfried__ is now known as yfried|afk | 11:07 | |
| *** annegentle has joined #openstack-infra | 11:07 | |
| AJaeger | That's sad | 11:08 |
| *** yfried|afk is now known as yfried__ | 11:09 | |
| *** otter768 has joined #openstack-infra | 11:11 | |
| openstackgerrit | Nikolay Fedotov proposed openstack-infra/zuul: Put valid username in repository url string https://review.openstack.org/174816 | 11:14 |
| *** otter768 has quit IRC | 11:16 | |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: New Fuel plugin project for Calico https://review.openstack.org/174763 | 11:17 |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Bump stankevich-python version https://review.openstack.org/174820 | 11:18 |
| *** mwagner_lap has quit IRC | 11:26 | |
| *** zhiwei has quit IRC | 11:29 | |
| *** ddieterly has joined #openstack-infra | 11:32 | |
| *** ldnunes has joined #openstack-infra | 11:35 | |
| *** prad has quit IRC | 11:36 | |
| *** ddieterly has quit IRC | 11:37 | |
| *** deepakcs has quit IRC | 11:40 | |
| *** zxiiro has quit IRC | 11:41 | |
| sdague | gah, jenkins02 went south? | 11:43 |
| sdague | https://jenkins02.openstack.org/job/gate-oslo.serialization-pep8/47/ | 11:43 |
| *** julim has joined #openstack-infra | 11:46 | |
| Shrews | fungi: shade reviews 173994 and 173998 seem to have gone into limbo since being approved yesterday | 11:47 |
| *** dprince has joined #openstack-infra | 11:47 | |
| *** Hal has joined #openstack-infra | 11:48 | |
| *** Hal is now known as Guest75261 | 11:49 | |
| *** prad has joined #openstack-infra | 11:51 | |
| *** prad has quit IRC | 11:54 | |
| *** cdent has quit IRC | 11:55 | |
| Shrews | fungi: nm. gave them another kick in the pants. seemed to work | 11:58 |
| *** e0ne is now known as e0ne_ | 11:58 | |
| *** cdent has joined #openstack-infra | 12:01 | |
| *** rfolco has joined #openstack-infra | 12:06 | |
| *** aysyd has joined #openstack-infra | 12:06 | |
| *** e0ne_ has quit IRC | 12:08 | |
| *** e0ne has joined #openstack-infra | 12:10 | |
| *** Krinkle|detached is now known as Krinkle | 12:11 | |
| jroll | ttx: when does the (ironic) rc2 window open? | 12:12 |
| *** annegentle has quit IRC | 12:12 | |
| *** weshay has joined #openstack-infra | 12:13 | |
| *** bknudson has quit IRC | 12:15 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Allow name or ID for update_subnet() https://review.openstack.org/173994 | 12:17 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Allow name or ID for update_router() https://review.openstack.org/173998 | 12:18 |
| *** kgiusti has joined #openstack-infra | 12:19 | |
| *** mwagner_lap has joined #openstack-infra | 12:19 | |
| *** woodster_ has joined #openstack-infra | 12:19 | |
| sgordon | refreshing my memory here....is it only possible to "un-abandon" a change in gerrit if you are core for the given project? | 12:20 |
| openstackgerrit | Julia Kreger proposed openstack-infra/shade: Add test of OperatorCloud auth_type=None https://review.openstack.org/172165 | 12:24 |
| mescanef | hello guys, can somebody retrigger jenkins in https://review.openstack.org/#/c/174763/ ? | 12:24 |
| *** sks has quit IRC | 12:25 | |
| *** dvorak is now known as clayton | 12:25 | |
| AJaeger | sgordon: owner and core can unabandon | 12:27 |
| AJaeger | mescanef: just add "recheck" as comment, for details see http://docs.openstack.org/infra/manual/developers.html#automated-testing | 12:28 |
| *** yfried__ is now known as yfried|afk | 12:29 | |
| *** yfried|afk is now known as yfried__ | 12:29 | |
| mescanef | AJaeger: ok tnx :-) | 12:32 |
| *** _nadya_ has quit IRC | 12:33 | |
| mescanef | AJaeger: btw, with these double quotes? | 12:33 |
| *** ddieterly has joined #openstack-infra | 12:33 | |
| *** cdent has quit IRC | 12:34 | |
| StevenK | mescanef: Nope, without quotes. | 12:34 |
| *** doude_ has quit IRC | 12:35 | |
| *** cdent has joined #openstack-infra | 12:35 | |
| *** bknudson has joined #openstack-infra | 12:36 | |
| *** ildikov has quit IRC | 12:36 | |
| *** doude has joined #openstack-infra | 12:37 | |
| *** dalgaaf has quit IRC | 12:37 | |
| *** ddieterly has quit IRC | 12:37 | |
| *** jaypipes has joined #openstack-infra | 12:38 | |
| *** rkukura has joined #openstack-infra | 12:39 | |
| *** rkukura has quit IRC | 12:39 | |
| *** cdent has quit IRC | 12:41 | |
| *** cdent has joined #openstack-infra | 12:41 | |
| *** rlandy has joined #openstack-infra | 12:42 | |
| *** gordc has joined #openstack-infra | 12:44 | |
| *** fhubik is now known as fhubik_afk | 12:44 | |
| *** dhritishikhar_ has quit IRC | 12:44 | |
| *** dhritishikhar_ has joined #openstack-infra | 12:44 | |
| *** dizquierdo has joined #openstack-infra | 12:47 | |
| *** fhubik_afk is now known as fhubik | 12:48 | |
| *** dkranz has joined #openstack-infra | 12:51 | |
| *** ildikov has joined #openstack-infra | 12:51 | |
| *** baoli has joined #openstack-infra | 12:52 | |
| *** mase_x200 has joined #openstack-infra | 12:57 | |
| *** baoli_ has joined #openstack-infra | 12:58 | |
| *** zz_dimtruck is now known as dimtruck | 12:59 | |
| *** scheuran has quit IRC | 13:00 | |
| *** baoli has quit IRC | 13:01 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Bump stankevich-python version https://review.openstack.org/174820 | 13:02 |
| *** dmellado has quit IRC | 13:02 | |
| *** xyang1 has joined #openstack-infra | 13:04 | |
| *** tiswanso has joined #openstack-infra | 13:07 | |
| sdague | sgordon: yes, core's can 'restore' | 13:07 |
| *** otter768 has joined #openstack-infra | 13:12 | |
| *** smccully has joined #openstack-infra | 13:14 | |
| *** otter768 has quit IRC | 13:17 | |
| *** marcusvrn has quit IRC | 13:19 | |
| *** hdd has quit IRC | 13:21 | |
| *** doug-fish has left #openstack-infra | 13:22 | |
| *** cdent has quit IRC | 13:23 | |
| *** dustins has joined #openstack-infra | 13:23 | |
| *** radez_g0n3 is now known as radez | 13:24 | |
| openstackgerrit | Julia Kreger proposed openstack-infra/shade: Add test of OperatorCloud auth_type=None https://review.openstack.org/172165 | 13:25 |
| *** mriedem has joined #openstack-infra | 13:26 | |
| *** peristeri has joined #openstack-infra | 13:26 | |
| *** dhritishikhar_ has quit IRC | 13:27 | |
| *** ddieterly has joined #openstack-infra | 13:28 | |
| *** markus_z has quit IRC | 13:29 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add a cli subcommand for deleting old rows https://review.openstack.org/172200 | 13:29 |
| sdague | fungi: so... jenkins02 is failing a bunch of stuff randomly it seems | 13:30 |
| *** dhritishikhar_ has joined #openstack-infra | 13:31 | |
| sdague | 502 proxy errors | 13:32 |
| *** fhubik has quit IRC | 13:33 | |
| mescanef | jenkins is nasty today :-( | 13:34 |
| *** fhubik has joined #openstack-infra | 13:34 | |
| *** prad has joined #openstack-infra | 13:35 | |
| *** dansmith is now known as superdan | 13:35 | |
| fungi | sdague: i'll take care of it | 13:36 |
| *** ddieterly has quit IRC | 13:36 | |
| fungi | jenkins02 is quiescing now. o | 13:37 |
| fungi | er | 13:37 |
| fungi | i'll give the others a once-over | 13:37 |
| *** pblaho_ has quit IRC | 13:37 | |
| *** doug-fish has joined #openstack-infra | 13:38 | |
| *** ddieterly has joined #openstack-infra | 13:39 | |
| fungi | jenkins02 seems to be the same thread leak we've been plagued by recently. and swift log uploads rely on being able to reach the jenkins web interface to pull the job console log. so when jenkins throws a proxy error, console log can't be retrieved and the job fails | 13:39 |
| fungi | though we do have a retry mechanism in place. this is a great opportunity to see if it's helping | 13:40 |
| *** fhubik has quit IRC | 13:40 | |
| *** ddieterl_ has joined #openstack-infra | 13:40 | |
| *** pblaho has joined #openstack-infra | 13:41 | |
| *** yfried__ is now known as yfried|afk | 13:41 | |
| fungi | it looks like the retry is still not happening https://jenkins02.openstack.org/job/gate-trove-docs/1991/console | 13:41 |
| fungi | i wonder if that latest fix made it into our nodepool images | 13:42 |
| fungi | ohh, we've got outdated images | 13:43 |
| *** yfried|afk is now known as yfried__ | 13:43 | |
| fungi | guess now i'll dig into why image updates are having a problem | 13:43 |
| *** ddieterly has quit IRC | 13:44 | |
| *** ddieterl_ has quit IRC | 13:45 | |
| odyssey4me | fungi is it an option for projects to prepare their own images for checks? | 13:45 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 13:45 | |
| *** mattfarina has joined #openstack-infra | 13:45 | |
| *** ddieterly has joined #openstack-infra | 13:46 | |
| fungi | odyssey4me: we're trying to condense the number of images we're using as it is. we'd like to get down to one per distro/release and have jobs modify the workers as needed at run-time | 13:46 |
| fungi | yep, we've done something in the past week to break image updates for all bare-.* labels, but devstack-.* seems fine | 13:47 |
| odyssey4me | fungi sure, the reason I'm asking is because we've had to do a fair amount of fudging to remove stuff that's in the images when all we hope to get is a bare base install image, similar to that which one would get from a cloud provider | 13:48 |
| fungi | odyssey4me: yep, that's my top priority at the moment (when i'm not trying to just keep stuff running) | 13:48 |
| *** ildikov has quit IRC | 13:49 | |
| odyssey4me | fungi fair enough, good to know and thank you guys for keeping the ship afloat! | 13:49 |
| fungi | odyssey4me: we want to make it easy to pre-cache as much as possible on our images but pre-install as little as possible, and set up a framework for projects/jobs to be able to easily describe what they'll need so we know what to cache and what of that to install during the job | 13:49 |
| *** pblaho has quit IRC | 13:49 | |
| fungi | it's getting very close | 13:50 |
| *** eharney has joined #openstack-infra | 13:50 | |
| odyssey4me | fungi yeah, that makes sense | 13:50 |
| aderyugin | hi, guys! there is a problem with gate-mrano-devstack-dsvm job. it fails if we enable neutron in murano scripts. there is a fix for this problem https://review.openstack.org/#/c/172447/ we need to merge it | 13:50 |
| anteaya | <-- not a guy | 13:50 |
| * anteaya moves on if only guys are needed today | 13:51 | |
| *** pblaho has joined #openstack-infra | 13:51 | |
| fungi | aderyugin: that range you've specified might also conflict with local interface addresses in one or more of our cloud providers where we run these jobs. i'm checking now | 13:52 |
| odyssey4me | I wonder if anyone knows whether it's possible to follow up on the status of the Visa invitation letter for the summit. It's getting a little close for comfort for me to get the visa appointment and all that and all I'm missing is the letter. | 13:52 |
| *** mpaolino has quit IRC | 13:53 | |
| fungi | odyssey4me: i'll find out who you need to contact | 13:53 |
| odyssey4me | fungi thanks, I appreciate it! | 13:54 |
| aderyugin | fungi: ok, thanks | 13:55 |
| *** _nadya_ has joined #openstack-infra | 13:56 | |
| fungi | aderyugin: looks like it might pose a problem with eth0 in hpcloud. for example http://logs.openstack.org/83/174383/1/check/check-tempest-dsvm-full/f596d38/console.html#_2015-04-16_14_32_59_824 | 13:56 |
| aderyugin | fungi: ok. I will try to find a better solution... | 13:57 |
| fungi | aderyugin: also whatever you pick, you'll probably need to be similarly mindful of eth1 in rackspace, e.g. http://logs.openstack.org/83/174383/1/gate/gate-tempest-dsvm-postgres-full/683faf7/console.html#_2015-04-16_16_57_42_762 | 13:57 |
| *** dimtruck is now known as zz_dimtruck | 13:58 | |
| *** jaypipes is now known as leakypipes | 13:59 | |
| fungi | odyssey4me: i just talked to shari and she said to follow up with eventvisa@openstack.org | 14:00 |
| jeblair | fungi, pleia2: i think we missed some steps related to backups recently -- review, review-dev, and ask were throwing errors in cron because they didn't have local ssh keys for root to use to shell into the backup server. i generated keys on those hosts | 14:00 |
| odyssey4me | excellent, thanks fungi | 14:00 |
| *** zhiwei has joined #openstack-infra | 14:00 | |
| fungi | jeblair: good to know--thanks. i don't think i helped set any of those up, but i'll be sure to keep an eye out for that in the future | 14:01 |
| fungi | it's probable we simply added a puppet class for backups on ask but hadn't gotten around to configuring that yet | 14:02 |
| jeblair | yeah, i think we missed review and review-dev with the server move | 14:02 |
| jeblair | cause that private key isn't puppeted (perhaps it should be) | 14:02 |
| jeblair | and yeah, ask just wasn't done yet | 14:02 |
| *** amitgandhinz has joined #openstack-infra | 14:03 | |
| fungi | and i agree, server moves for review and review-dev are a likely cause. i'll remember to update those when we rebuild anything which is getting backed up | 14:03 |
| *** bnemec has joined #openstack-infra | 14:03 | |
| *** mriedem has quit IRC | 14:03 | |
| *** yfried__ is now known as yfried|afk | 14:03 | |
| *** ildikov has joined #openstack-infra | 14:04 | |
| jeblair | i have removed oubiwann from the root distribution list for lists.o.o; his mail is bouncing | 14:05 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: DO NOT MERGE: Example of new getter https://review.openstack.org/174885 | 14:05 |
| fungi | Error: Invalid parameter manage_firewall on Class[Postgresql::Server] at /root/system-config/modules/openstack_project/manifests/slave_db.pp:100 | 14:05 |
| fungi | looks like that's probably our culprit | 14:05 |
| fungi | seeing if i can work out a fix now | 14:05 |
| *** wenlock has joined #openstack-infra | 14:05 | |
| jeblair | fungi: i'm guessing we have no puppet apply test for that module :/ | 14:06 |
| *** abhiram_moturi has quit IRC | 14:06 | |
| openstackgerrit | Alexey Deryugin proposed openstack-infra/project-config: [gate-murano-devstack-dsvm] Fix bug with neutron misconfiguration https://review.openstack.org/172447 | 14:06 |
| *** mriedem has joined #openstack-infra | 14:06 | |
| fungi | that's entirely possible | 14:06 |
| fungi | or it's shadowed by a --noop related dependency | 14:07 |
| openstackgerrit | Alexey Deryugin proposed openstack-infra/project-config: [gate-murano-devstack-dsvm] Fix bug with neutron misconfiguration https://review.openstack.org/172447 | 14:07 |
| *** sarob has joined #openstack-infra | 14:07 | |
| *** zz_dimtruck is now known as dimtruck | 14:07 | |
| fungi | this is odd. git blame says we haven't touched slave_db.pp in months, nor changed the version of puppetlabs-postgresql any time recently | 14:09 |
| *** cdent has joined #openstack-infra | 14:09 | |
| *** yfried|afk is now known as yfried__ | 14:09 | |
| fungi | i wonder if a recent module dep change is pulling in a newer version | 14:10 |
| fungi | yep! | 14:11 |
| fungi | Error: Could not install module 'puppetlabs-postgresql' (v4.0.0) | 14:11 |
| fungi | Module 'puppetlabs-postgresql' (v4.3.0) is already installed | 14:11 |
| *** e0ne is now known as e0ne_ | 14:11 | |
| *** signed8bit has joined #openstack-infra | 14:12 | |
| *** sdake has joined #openstack-infra | 14:12 | |
| jeblair | fungi: so, funny story for why i'm reading system cron mail... | 14:12 |
| *** bswartz has quit IRC | 14:13 | |
| fungi | i could use a funny story right about now | 14:13 |
| yolanda | hi jeblair, i saw hpcloud was blocked yesterday from upstream. That means no more test on nodepool patch? how is status now? | 14:13 |
| yolanda | btw, i submitted the change for stop() and a test | 14:13 |
| *** e0ne_ is now known as e0ne | 14:13 | |
| jeblair | fungi: the vm that my mail server is on had a filesystem error, and after the fsck was complete, everything looked great except pretty much all of the files in /var ended up as orphaned inodes. | 14:14 |
| fungi | yolanda: we've stopped using hpcloud at their request and haven't added them back yet. afaik we've heard no status update from them, but it sounded like it could be next week at least | 14:14 |
| fungi | jeblair: oh, ouch | 14:14 |
| fungi | that's got to be a pain to untangle | 14:15 |
| jeblair | fungi: yeah, so... i mean, the good news is that i now have a shiny new mail server running trusty (instead of lucid) | 14:15 |
| mordred | yolanda: I'm supposed to ask about a status on some things they're doing on Monday | 14:15 |
| yolanda | mordred, i heard something abou database cleanups? it may be index? | 14:16 |
| mordred | yolanda: but I believe that will be me getting a completion date from them on Monday - not them being complete on monday | 14:16 |
| jeblair | fungi: the current ETA for having all of my mail restored onto it is 16:11 PDT today | 14:16 |
| fungi | ouch | 14:16 |
| jeblair | fungi: but there was a window where i had deliveries but no sieve script, so i'm sorting through that :) | 14:16 |
| *** deepakcs has joined #openstack-infra | 14:17 | |
| yolanda | mordred, jeblair, did you see some significant update in the time it was running, or is not possible to tell? | 14:18 |
| deepakcs | Hi All, can someone from infra core pls bless https://review.openstack.org/#/c/173408/ ( It has +2 from ajaeger already) | 14:19 |
| deepakcs | the glusterfs CI job is failing bcos of ^^ not being merged, it would be great to have it in asap pls | 14:20 |
| deepakcs | its been > 1 week that gluster CI is failing just bcos of this 1 testcase, otherwise it was green for many weeks | 14:20 |
| deepakcs | sdague, fungi anteaya ^^ | 14:20 |
| *** ayoung has quit IRC | 14:20 | |
| *** yfried__ is now known as yfried|afk | 14:21 | |
| jeblair | yolanda: i have not looked yet, sorry. i may not get a chance to for a while. | 14:22 |
| jeblair | fungi: so i might be a bit distracted today | 14:22 |
| fungi | jeblair: got it | 14:22 |
| clarkb | fungi we should revert the puppetdb update change to fix postgres I think | 14:22 |
| fungi | i've got a lunch errand and another brief mid-afternoon errand, but will work on the etherpad for the 22:00 utc gerrit maintenance after i get back | 14:23 |
| *** signed8bit has quit IRC | 14:23 | |
| fungi | clarkb: i agree. reviewing historical update logs, we've got something in our modules list which is pulling in puppetlabs-postgresql. 7 days ago it couldn't install 4.0.0 because 3.4.2 was already installed. after that patch merged we started failing to install 4.0.0 because 4.3.0 was now installed | 14:24 |
| *** sabeen has joined #openstack-infra | 14:24 | |
| fungi | so something ahead of that module in the modules.env is depending on it and when we bumped the version it increased its dep version to one incompatible with our openstack_project::slave_db class | 14:24 |
| fungi | clarkb: alternatively, we could just try moving puppetlabs-postgresql to earlier than puppetlabs-firewall or puppetlabs-puppetdb, whichever is the one pulling it in early | 14:25 |
| clarkb | ya its puppetdb | 14:25 |
| clarkb | well puppetdb is broken for other reasons so reverting it to start again seems sane | 14:26 |
| fungi | submitting that now | 14:26 |
| *** alexpilotti has quit IRC | 14:27 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Revert "Bump puppetdb version" https://review.openstack.org/174897 | 14:28 |
| *** Nikkau has quit IRC | 14:28 | |
| fungi | unfortunately our images for today are already building, but aside from the console log retry fix i don't know of anything else pressing which would demand going to the trouble of restarting them all by hand | 14:29 |
| yolanda | clakb, so i found problems with module dependencies sometimes, we have a patch downstream to install modules on the right order, if not, it was doing crazy things. But i got that rejected upstream, because there was an intentaion to install every module from source. How is that? can i help with it? | 14:29 |
| *** mwagner_lap has quit IRC | 14:29 | |
| yolanda | clarkb, not clakb :) | 14:31 |
| clarkb | https://review.openstack.org/#/c/141182/ is the change, it needs a rebase and an update to make modules use the same versions of what we currently install | 14:31 |
| *** hashar has quit IRC | 14:32 | |
| *** sabeen2 has joined #openstack-infra | 14:32 | |
| *** sarob has quit IRC | 14:33 | |
| *** dims__ has quit IRC | 14:33 | |
| jeblair | From: root@ask.openstack.org (Cron Daemon) | 14:33 |
| jeblair | Subject: Cron <root@ask> /bin/bash /srv/askbot-sites/slot0/cron/send_email_alerts.sh | 14:33 |
| jeblair | {'': (501, '<>: missing or malformed local part')} | 14:33 |
| *** wwwBUKOLAYcom has joined #openstack-infra | 14:33 | |
| jeblair | the email has 2817 lines worth of that last bit ^ | 14:33 |
| *** zz_jgrimm is now known as jgrimm | 14:34 | |
| *** hashar has joined #openstack-infra | 14:34 | |
| jeblair | fungi: i'll forward that to mrmarton and cc you | 14:34 |
| fungi | i think reed, mrmartin and Evgeny were working on getting the askbot e-mail sender set correctly | 14:35 |
| *** tonytan4ever has joined #openstack-infra | 14:35 | |
| fungi | thanks | 14:35 |
| jeblair | fungi: oh, should i just discard for now, or still send it? | 14:35 |
| *** annegentle has joined #openstack-infra | 14:35 | |
| *** otter768 has joined #openstack-infra | 14:35 | |
| fungi | jeblair: please forward it along. it'll keep me from digging out a copy | 14:35 |
| *** otter768 has quit IRC | 14:36 | |
| jeblair | done. now i will see if i have my outgoing email config set up correctly :) | 14:36 |
| *** sabeen has quit IRC | 14:36 | |
| *** wenlock has quit IRC | 14:37 | |
| *** hashar is now known as hasharAway | 14:37 | |
| *** stevemar has joined #openstack-infra | 14:37 | |
| fungi | speaking of ask.openstack.org, if anyone wants to play around with it we have a zuul configuration help request ongoing at https://ask.openstack.org/question/65233 | 14:38 |
| jeblair | that seems misleading | 14:39 |
| *** mase_x200 has quit IRC | 14:39 | |
| fungi | i agree | 14:39 |
| fungi | i seriously doubt the reason his jobs aren't triggering is his reporter | 14:39 |
| jeblair | oh, er, i meant zuul questions on ask | 14:40 |
| *** MarkAtwood has joined #openstack-infra | 14:40 | |
| fungi | well, yes that too | 14:40 |
| *** soren_ has quit IRC | 14:40 | |
| fungi | we get occasional infra project help requests pop up on there. i've subscribed myself to keywords likely to spot them and if they rathole too far i try to redirect them to irc or our ml | 14:41 |
| *** marun has joined #openstack-infra | 14:41 | |
| jeblair | wow. i don't. ok. | 14:41 |
| fungi | which i'm about to do to this one | 14:41 |
| jeblair | thanks | 14:41 |
| *** mtanino has joined #openstack-infra | 14:41 | |
| jeblair | woot, i can send mail | 14:42 |
| *** Daisy has joined #openstack-infra | 14:44 | |
| *** carl_baldwin has joined #openstack-infra | 14:44 | |
| *** sdake_ has joined #openstack-infra | 14:47 | |
| *** sushilkm has joined #openstack-infra | 14:49 | |
| *** sushilkm has left #openstack-infra | 14:49 | |
| *** Daisy_ has joined #openstack-infra | 14:49 | |
| *** sdake has quit IRC | 14:50 | |
| *** annegentle has quit IRC | 14:51 | |
| *** annegentle has joined #openstack-infra | 14:51 | |
| deepakcs | Trying 2nd time - can someone from core pls review https://review.openstack.org/#/c/173408/ - It has +2 from AJaeger , thanks | 14:52 |
| *** Daisy has quit IRC | 14:52 | |
| *** Daisy_ is now known as Daisy | 14:52 | |
| *** dhritishikhar_ has quit IRC | 14:53 | |
| *** avozza is now known as zz_avozza | 14:54 | |
| *** Daisy_ has joined #openstack-infra | 14:55 | |
| *** dizquierdo has quit IRC | 14:56 | |
| *** Daisy has quit IRC | 14:57 | |
| *** Daisy_ is now known as Daisy | 14:57 | |
| *** prad has quit IRC | 14:57 | |
| *** sgordon has quit IRC | 14:58 | |
| *** nelsnelson has joined #openstack-infra | 14:58 | |
| sdake_ | jeblair happen to be around? Ajeager suggested I consult you on an issue with project-config | 14:58 |
| *** dhritishikhar_ has joined #openstack-infra | 14:58 | |
| *** yfried|afk is now known as yfried__ | 14:59 | |
| clarkb | deepakcs: I don't think the regex is correct | 14:59 |
| clarkb | deepakcs: it says not anything or not volume boot pattern | 14:59 |
| *** dhritishikhar_ has quit IRC | 14:59 | |
| *** dhritishikhar_ has joined #openstack-infra | 14:59 | |
| *** markvoelker has joined #openstack-infra | 15:00 | |
| *** markvoelker has quit IRC | 15:00 | |
| clarkb | deepakcs: also sdague did comment after you asked earlier | 15:00 |
| sdake_ | clarkb ajeager suggested you may be able to help too | 15:00 |
| *** carl_baldwin has left #openstack-infra | 15:00 | |
| clarkb | sdake_: what is the issue? | 15:00 |
| *** markvoelker has joined #openstack-infra | 15:00 | |
| *** prad has joined #openstack-infra | 15:01 | |
| *** yamahata has joined #openstack-infra | 15:01 | |
| sdake_ | clarkb need someone with github superpowers to manually change somethiing | 15:01 |
| sdake_ | https://bugs.launchpad.net/kolla/+bug/1437562 | 15:01 |
| openstack | Launchpad bug 1437562 in kolla "Uncorrect description on github" [Critical,Confirmed] - Assigned to Steven Dake (sdake) | 15:01 |
| sdake_ | we changed project-config, but it did not update the github description | 15:01 |
| sdake_ | and I get quesitons on it *all the time* | 15:02 |
| sdake_ | our project has abandoned kubernetes | 15:02 |
| sdake_ | naturally when people see "kubernetes and openstack" they get confused :) | 15:02 |
| deepakcs | clarkb, sdague thanks, will have BharatK add a new job then, if this method is not recommended | 15:03 |
| *** radez is now known as radez_g0n3 | 15:03 | |
| deepakcs | clarkb, I am not an expert in regex, will lookout for some doc to figure the syntax. BharatK did validate on tempest cmdline, so I thought the regex is correct. | 15:04 |
| *** dims__ has joined #openstack-infra | 15:04 | |
| clarkb | sdake_: ok, I want to say we cut out description updates because the github api would throttle us | 15:05 |
| clarkb | sdake_: I can update manually | 15:05 |
| sdake_ | clarkb that woudl rock :) | 15:05 |
| clarkb | done | 15:06 |
| sdake_ | normally i wouldn't care but its impacting our ability to attract devs | 15:06 |
| sdake_ | thanks :) | 15:06 |
| sdake_ | that was fast | 15:06 |
| *** radez_g0n3 is now known as radez | 15:06 | |
| *** zhiwei has quit IRC | 15:06 | |
| *** yfried__ is now known as yfried|afk | 15:09 | |
| deepakcs | sdague, clarkb thanks for the quick review. | 15:09 |
| *** zhiwei has joined #openstack-infra | 15:10 | |
| mordred | clarkb: perhaps we should stop setting the description field on gh repo creation | 15:10 |
| mordred | clarkb: because we don't change them later on updates to that file - so it's kind of misleading | 15:10 |
| *** dizquierdo has joined #openstack-infra | 15:10 | |
| *** wenlock has joined #openstack-infra | 15:10 | |
| mordred | or maybe put ina stock description "this is a read-only mirror of code hosted at review.o.o" or something | 15:11 |
| clarkb | mordred: it seems that all of our use of github is misleading | 15:11 |
| mordred | clarkb: yah - but sometimes it leads to funny rage comments | 15:11 |
| *** ildikov has quit IRC | 15:11 | |
| sdake_ | sdague on this version uncap on python-magnumclient, what is happening with jenkins? | 15:12 |
| sdake_ | the check is passing yet veritifed -1? | 15:12 |
| *** sslypushenko has joined #openstack-infra | 15:12 | |
| clarkb | fungi: I am +2 on the puppetdb bump revert | 15:12 |
| *** imcsk8 has quit IRC | 15:13 | |
| *** imcsk8 has joined #openstack-infra | 15:13 | |
| clarkb | looking at http://logs.openstack.org/39/174139/6/experimental/check-tempest-dsvm-multinode-full/288b165/logs/dhcpdump.txt.gz I have no idea how nova's dhcp server is working | 15:14 |
| clarkb | which makes me wonder if that is the actual reason people don't deploy with dhcp | 15:14 |
| jesusaurus | mordred: i think that some stock 'this is read-only' text would be good, but im also not sure why we mirror to github in the first place | 15:14 |
| mordred | clarkb: there's only one person out there who doesn't run dhcp | 15:14 |
| mordred | clarkb: and that's rackspace | 15:14 |
| mordred | all the other clouds run it | 15:14 |
| mordred | clarkb: that does look ugly though | 15:15 |
| clarkb | mordred: maybe they are more away of nova's oddities than others? In any case I see the discover requests from VMs but no responses | 15:15 |
| clarkb | and that is tcpdump -i any | 15:15 |
| mordred | jesusaurus: discoverability - people expect to be able to go clone a repo from github | 15:15 |
| sdague | sdake_: I don't know, have you looked at logs? | 15:15 |
| sdake_ | sdague admittidely not | 15:16 |
| mordred | jesusaurus: and if we didn't publish them there, someone else would, and then we wouldn't have any control over it | 15:16 |
| sdake_ | I assumed pass means jenkins liked the results :) | 15:16 |
| *** jistr is now known as jistr|mtg | 15:16 | |
| mordred | jesusaurus: those are my two reasons | 15:16 |
| *** dhritishikhar_ has quit IRC | 15:17 | |
| *** dannywilson has joined #openstack-infra | 15:18 | |
| *** rm_work|away is now known as rm_work | 15:18 | |
| *** harlowja_at_home has joined #openstack-infra | 15:19 | |
| jroll | clarkb: are you saying we maybe actually did something right? :o | 15:22 |
| jesusaurus | mordred: those both make a lot of sense | 15:22 |
| *** armax has joined #openstack-infra | 15:22 | |
| *** dims__ has quit IRC | 15:22 | |
| clarkb | jogo: after reading nova net docs, nova net hosts setup a local dnsmasq that assigns private IPs as assigned by nova. dnsmasq logs to syslog, so we should check syslog on the jobs that fail due to a VM not getting a lease. I would bet there is a race between booting the node and telling dnsmasq what IP to assign | 15:22 |
| clarkb | jroll: or more worked around problems by not ifxing them and instead making crazy system instead :) | 15:23 |
| jroll | :P | 15:23 |
| *** Ala has quit IRC | 15:24 | |
| *** tonytan4ever has quit IRC | 15:25 | |
| *** ZZelle has quit IRC | 15:25 | |
| *** ZZelle has joined #openstack-infra | 15:26 | |
| *** yfried|afk is now known as yfried__ | 15:26 | |
| *** ildikov has joined #openstack-infra | 15:26 | |
| *** Adri2000 has quit IRC | 15:28 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Update register_machine to use tasks https://review.openstack.org/171324 | 15:28 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Update unregister_machine to use tasks https://review.openstack.org/171325 | 15:28 |
| *** tonytan4ever has joined #openstack-infra | 15:28 | |
| *** dprince has quit IRC | 15:28 | |
| *** Adri2000 has joined #openstack-infra | 15:29 | |
| *** Adri2000 has quit IRC | 15:29 | |
| *** Adri2000 has joined #openstack-infra | 15:29 | |
| *** mpavone has quit IRC | 15:33 | |
| fungi | okay, popping out to lunch, back in a bit | 15:34 |
| *** zz_avozza is now known as avozza | 15:34 | |
| *** dtantsur is now known as dtantsur|afk | 15:37 | |
| *** nfedotov has joined #openstack-infra | 15:37 | |
| *** dangers_away is now known as dangers | 15:39 | |
| *** Swami has joined #openstack-infra | 15:39 | |
| fungi | also, jenkins02 has been cleaned up and restarted | 15:39 |
| *** thedodd has joined #openstack-infra | 15:39 | |
| *** tsg_ has joined #openstack-infra | 15:43 | |
| *** kmartin has joined #openstack-infra | 15:43 | |
| openstackgerrit | Mehdi Abaakouk proposed openstack/requirements: Bump kombu version to 3.0.9 https://review.openstack.org/174930 | 15:43 |
| *** jistr|mtg is now known as jistr | 15:44 | |
| *** zhiwei has left #openstack-infra | 15:44 | |
| *** Longgeek_ has quit IRC | 15:44 | |
| openstackgerrit | Merged openstack-infra/shade: Add some unit test for create_server https://review.openstack.org/170019 | 15:45 |
| *** Daisy has quit IRC | 15:48 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-diskimage_builder: Fix .gitreview file https://review.openstack.org/174505 | 15:48 |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-diskimage_builder: Consume vhd-util from infra vhd-util PPA https://review.openstack.org/174506 | 15:48 |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-diskimage_builder: Fix metadata.json file https://review.openstack.org/174935 | 15:48 |
| *** yfried__ has quit IRC | 15:48 | |
| *** enikanorov__ has joined #openstack-infra | 15:48 | |
| *** deepakcs has quit IRC | 15:49 | |
| *** esker has joined #openstack-infra | 15:50 | |
| *** ildikov has quit IRC | 15:50 | |
| *** enikanorov_ has quit IRC | 15:51 | |
| *** soren_ has joined #openstack-infra | 15:52 | |
| *** sslypushenko has quit IRC | 15:54 | |
| *** sslypushenko has joined #openstack-infra | 15:55 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/pypi-mirror: Workflow documentation is now in infra-manual https://review.openstack.org/139429 | 15:58 |
| mordred | jeblair: not urgent - but the "only show projects with unreview changes" keeps things in the unreviewed count that I've marked as viewed | 15:59 |
| mordred | jeblair: so I can have a project with 3 unreviewed changes show up in the list - but when I go to it, there are no changes | 15:59 |
| *** gyee has joined #openstack-infra | 15:59 | |
| jeblair | mordred: math is hard | 16:00 |
| ttx | jroll: I'd say Monday, so that we have a bit more time polishing the stable/kilo situation | 16:00 |
| *** r-daneel has joined #openstack-infra | 16:00 | |
| jroll | ttx: ok, thanks | 16:00 |
| ttx | jroll: in hte mean time, fix all issues in master and pile up backpotrs, we'll approve them in one go | 16:00 |
| *** ivar-lazzaro has joined #openstack-infra | 16:00 | |
| mordred | jroll: I agree | 16:01 |
| mordred | gah | 16:01 |
| *** devvesa has quit IRC | 16:01 | |
| mordred | jroll: I mean, I agree with jroll and all ... but | 16:01 |
| mordred | jeblair: I agree | 16:01 |
| *** armax has quit IRC | 16:01 | |
| *** garyk has quit IRC | 16:01 | |
| zaro | morning | 16:02 |
| jroll | heh | 16:02 |
| jroll | ttx: yep, already done :) | 16:02 |
| *** ivar-laz_ has joined #openstack-infra | 16:02 | |
| *** dprince has joined #openstack-infra | 16:02 | |
| *** ivar-laz_ has quit IRC | 16:03 | |
| *** ivar-laz_ has joined #openstack-infra | 16:03 | |
| *** annegentle has quit IRC | 16:05 | |
| *** ivar-lazzaro has quit IRC | 16:05 | |
| *** tqtran has joined #openstack-infra | 16:06 | |
| pleia2 | good morning | 16:06 |
| *** dkranz has quit IRC | 16:07 | |
| waynr | pelix: ping | 16:07 |
| pleia2 | jeblair: re: review-dev, I think that one was actually disabled before we moved the *backups* server to make more space and I didn't follow up to see about re-enabling it, sorry about that, the other two were server move + new server that weren't quite finished up | 16:08 |
| pelix | waynr: pong | 16:08 |
| *** tqtran is now known as tqtran_afk | 16:08 | |
| *** yamahata has quit IRC | 16:08 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Make mysql clients assume utf8 character encoding https://review.openstack.org/164264 | 16:08 |
| waynr | i've got a jjb question for ya related to local_yaml.py | 16:08 |
| *** harlowja_at_home has quit IRC | 16:09 | |
| waynr | i'm running into an issue in the trigger-parameterized-builds publisher where i can't seem to reorder the parameter settings for the downstream job (so the current job's build parameters will always override predefined or properties file parameters) | 16:09 |
| *** pcaruana has quit IRC | 16:10 | |
| waynr | in the jenkins web ui the order in which these settings are added to the trigger-parameterized-builds web element matters (presumably because it leads to a different ordering of xml elements) | 16:10 |
| *** sabeen2 has quit IRC | 16:11 | |
| *** e0ne has quit IRC | 16:12 | |
| waynr | anyway, i noticed that in local_yaml.py dictionaries seem to be created as OrderedDict but it's not clear to me if this means that the order in which keys are listed in a yaml file leads matters | 16:12 |
| pelix | waynr: looking, unlikely to be the yaml because that was specifically switched to use OrderedDict to deal with tests, but also it was reasoned that the user should control the order of the elements when dealing with lists and dicts | 16:12 |
| *** unicell has quit IRC | 16:13 | |
| zaro | pelix: fyi, will create a new jjb release today. | 16:13 |
| pelix | waynr: the order of the keys in the yaml is important, but the module code converting it to XML may not be written in a way that respects the order | 16:13 |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-diskimage_builder: Fix .gitreview file https://review.openstack.org/174505 | 16:13 |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-diskimage_builder: Consume vhd-util from infra vhd-util PPA https://review.openstack.org/174506 | 16:13 |
| waynr | oh i know where the parameter ordering problem is in jenkins_jobs/modules/publishers.py i'm just curious if i can rely on strict ordering as seen in the yaml file when i work on the trigger_parameterized_builds publisher | 16:13 |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-diskimage_builder: Fix metadata.json file https://review.openstack.org/174935 | 16:13 |
| *** jlanoux has quit IRC | 16:14 | |
| greghaynes | mordred: ^ do we have puppet installing a dib that installs puppets? | 16:14 |
| waynr | zaro: is there any particular jjb release cadence? | 16:14 |
| waynr | pelix: thanks, that answers my question :) | 16:14 |
| pelix | waynr: :) | 16:14 |
| pelix | yeap, you can rely on the order of the yaml | 16:15 |
| mordred | greghaynes: it's puppets all the way down | 16:15 |
| *** tonytan4ever has quit IRC | 16:15 | |
| mordred | greghaynes: that's the "install dib and also the dependencies and also the ppa with vhd-util" | 16:15 |
| greghaynes | ah | 16:15 |
| greghaynes | that reminds me, I need to binutils hack | 16:16 |
| *** claudiub_ has quit IRC | 16:16 | |
| zaro | i try to do it at least every 3 months. | 16:16 |
| zaro | waynr: ^ | 16:16 |
| waynr | okay, was just curious | 16:16 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Only query jenkins plugins if config provided https://review.openstack.org/158826 | 16:16 |
| *** marcusvrn has joined #openstack-infra | 16:17 | |
| *** wenlock has quit IRC | 16:17 | |
| pelix | zaro: I presume that means, please don't approve anything ;-) | 16:18 |
| *** mbacchi1 has joined #openstack-infra | 16:18 | |
| *** luqas has quit IRC | 16:18 | |
| *** salv-orl_ has quit IRC | 16:19 | |
| *** mriedem1 has joined #openstack-infra | 16:19 | |
| *** subscope has joined #openstack-infra | 16:20 | |
| *** mriedem has quit IRC | 16:21 | |
| zaro | pelix: yeah, probably a good idea for today. | 16:21 |
| *** wenlock has joined #openstack-infra | 16:21 | |
| *** kmartin_ has joined #openstack-infra | 16:21 | |
| *** kmartin has quit IRC | 16:21 | |
| *** marcusvrn1 has joined #openstack-infra | 16:22 | |
| *** marcusvrn2 has joined #openstack-infra | 16:22 | |
| *** marcusvrn has quit IRC | 16:23 | |
| *** marcusvrn3 has joined #openstack-infra | 16:23 | |
| *** dizquierdo has quit IRC | 16:23 | |
| *** claudiub has joined #openstack-infra | 16:24 | |
| *** salv-orlando has joined #openstack-infra | 16:24 | |
| *** dims__ has joined #openstack-infra | 16:24 | |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Add InvalidAttributeError and MissingAttributeError. https://review.openstack.org/167095 | 16:25 |
| *** soren_ has quit IRC | 16:26 | |
| *** marcusvrn1 has quit IRC | 16:26 | |
| *** marcusvrn2 has quit IRC | 16:26 | |
| * fungi returns | 16:27 | |
| Krinkle | Hm.. is there a way to enqueue zuul events from the command line for ref-updated / tag creations? Would make it a lot easier to backfill generated documentation for recent releases, since we only recently added a pipeline for it | 16:27 |
| *** patrickeast has joined #openstack-infra | 16:27 | |
| Krinkle | I've used the enqueue command for change-merged like this: | 16:27 |
| Krinkle | zuul enqueue --trigger gerrit --pipeline postmerge --project unicodejs --change 201944,2 | 16:27 |
| *** thingee has joined #openstack-infra | 16:27 | |
| Krinkle | But not sure what paremeters to pass for --pipeline publish (listens to ref-updated) | 16:28 |
| jeblair | Krinkle: i think we may not have fleshed out the enqueue command enough to support those yet | 16:29 |
| Krinkle | I would trigger them via Jenkins, but then additional functions to create environment variables don't get run, so will need to compute them by hand. | 16:30 |
| *** Guest75261 has quit IRC | 16:30 | |
| Krinkle | https://integration.wikimedia.org/ci/job/unicodejs-publish/10/ | 16:31 |
| Krinkle | Example of a regular ref-update job. Seems to have an odd "Old revision: 000000000000" | 16:31 |
| Krinkle | Not sure what's that for. | 16:31 |
| *** yamahata has joined #openstack-infra | 16:31 | |
| jeblair | Krinkle: that's what gerrit sends on a ref-update if the ref is being created | 16:32 |
| jeblair | (so tag creation in this case) | 16:32 |
| Krinkle | Ah, there's a delete event as well | 16:32 |
| jeblair | Krinkle: the opposite is true if a ref is deleted | 16:32 |
| Krinkle | Interesting | 16:32 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Pull o_p::server invocation out of afs roles https://review.openstack.org/171369 | 16:33 |
| Krinkle | Oh shit, it actually listens to that by default as well | 16:33 |
| Krinkle | When I deleted my test tag using push :refs/tag/test-2 it triggered the job | 16:33 |
| Krinkle | which failed on Git being unable to check out the candidate revision | 16:34 |
| Krinkle | gerrit: | 16:34 |
| Krinkle | - event: ref-updated | 16:34 |
| Krinkle | ref: ^refs/tags/.*$ | 16:34 |
| *** jcoufal has quit IRC | 16:34 | |
| Krinkle | Hm.. hoping there's a way to filter those ou | 16:34 |
| *** sdake has joined #openstack-infra | 16:35 | |
| fungi | Krinkle: we _do_ also have https://git.openstack.org/cgit/openstack-infra/zuul/tree/tools/trigger-job.py which can do some of what we'd eventually like to move into the zuul enqueue cli subcomannd | 16:36 |
| *** ivar-laz_ has quit IRC | 16:36 | |
| openstackgerrit | Doug Wiegley proposed openstack-infra/project-config: Add neutron-lib repo https://review.openstack.org/174952 | 16:36 |
| *** otter768 has joined #openstack-infra | 16:36 | |
| *** ivar-lazzaro has joined #openstack-infra | 16:36 | |
| *** derekh has quit IRC | 16:37 | |
| fungi | though that script just acts as a gearman client and injects work requests directly into the gearman queue, bypassing zuul entirely | 16:37 |
| *** nfedotov has quit IRC | 16:37 | |
| *** thingee has quit IRC | 16:37 | |
| fungi | it's still a way to re-trigger jobs for things like tags and merges | 16:38 |
| *** ivar-lazzaro has quit IRC | 16:38 | |
| Krinkle | yeah | 16:38 |
| *** dkranz has joined #openstack-infra | 16:38 | |
| *** ivar-lazzaro has joined #openstack-infra | 16:39 | |
| *** sdake_ has quit IRC | 16:39 | |
| Krinkle | I'm looking for a filter property to add to the pipeline or jobs that would allow it to not run a build if oldrev != 000 or if newref === 000 | 16:39 |
| *** thingee has joined #openstack-infra | 16:39 | |
| thingee | ./join #openstack-dev | 16:40 |
| *** otter768 has quit IRC | 16:41 | |
| jeblair | Krinkle: i don't think that exists either, but could be added fairly easily in zuul/model.py | 16:41 |
| *** unicell has joined #openstack-infra | 16:41 | |
| *** ayoung has joined #openstack-infra | 16:41 | |
| *** unicell has quit IRC | 16:41 | |
| *** unicell has joined #openstack-infra | 16:42 | |
| Krinkle | jeblair: Either by exposing oldref and newref (in addition to ref) or by abstracting into a tag-action: create/delete/alter property | 16:42 |
| *** BobBall is now known as BobBall_AWOL | 16:43 | |
| Krinkle | I'd prefer the latter | 16:43 |
| Krinkle | I imagine there isn't really a use for matching against the commit sha1 itself other than to match for or against 000 | 16:44 |
| *** armax has joined #openstack-infra | 16:46 | |
| *** jistr has quit IRC | 16:48 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Make mysql clients assume utf8 character encoding https://review.openstack.org/164264 | 16:49 |
| *** dims__ is now known as dimsum__ | 16:50 | |
| *** sgordon has joined #openstack-infra | 16:52 | |
| jeblair | Krinkle: agreed | 16:52 |
| jeblair | i have to run some errands, back before maintenance | 16:53 |
| *** ajmiller__ is now known as ajmiller | 16:53 | |
| Krinkle | OK. I filed it for us at https://phabricator.wikimedia.org/project/board/836/#zuul | 16:53 |
| *** pblaho has quit IRC | 16:54 | |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/system-config: Add pleia2 to statusbot_auth_nicks https://review.openstack.org/174962 | 16:55 |
| *** jlibosva has quit IRC | 16:55 | |
| openstackgerrit | Doug Wiegley proposed openstack-infra/project-config: Add neutron-lib repo https://review.openstack.org/174952 | 16:55 |
| pleia2 | anteaya: ^^ thanks for the ping there :) | 16:55 |
| anteaya | pleia2: welcome | 16:55 |
| *** wwwBUKOLAYcom has quit IRC | 16:57 | |
| *** unicell has quit IRC | 16:57 | |
| *** unicell has joined #openstack-infra | 16:57 | |
| *** annegentle has joined #openstack-infra | 16:58 | |
| *** armax has quit IRC | 16:58 | |
| clarkb | ok now that I am caught up on the thing I was working yesterday, is there a tl;dr for the other fun that happned yesterday? | 17:00 |
| *** ihrachyshka has quit IRC | 17:00 | |
| fungi | which fun specifically? there was so much to go around | 17:01 |
| fungi | release-related fun? systems-related fun? | 17:01 |
| clarkb | fungi: clouds went down, gerrit restarted, then nodepool something? | 17:01 |
| fungi | we have documentation migration fun too | 17:01 |
| clarkb | fungi: systems, though if there was release related fun I should probably figure out what happneed there too | 17:01 |
| annegentle | fungi: so much fun! | 17:01 |
| *** tonytan4ever has joined #openstack-infra | 17:02 | |
| fungi | annegentle: that's why this feels more like being retired. it's all fun and no work | 17:02 |
| *** prad has quit IRC | 17:02 | |
| fungi | clarkb: so on the systems front, we have hpcloud effectively turned off in nodepool | 17:02 |
| fungi | eta is early next week to get an update on when they're ready for us to reconnect them | 17:02 |
| *** armax has joined #openstack-infra | 17:03 | |
| *** markvoelker has quit IRC | 17:03 | |
| fungi | though the nodepool config change exposed a bug in the earlier version of yolanda's queue management patch which caused nodepool to fall over when it tried to reload its config | 17:03 |
| clarkb | so we rolled back that change? | 17:04 |
| fungi | and since that was mostly to help us deal with hpcloud's performance characteristics anyway, we've reverted while it can be worked through (hand-reverted, it didn't actually get merged yet anyway) | 17:04 |
| *** dimtruck is now known as zz_dimtruck | 17:05 | |
| fungi | the unrelated gerrit fun is our old friend, stream-events getting blocked | 17:05 |
| clarkb | except there was a twist that involved buck and jeblairs patch not working? | 17:05 |
| *** prad has joined #openstack-infra | 17:05 | |
| *** kmartin_ has quit IRC | 17:05 | |
| fungi | jeblair's earlier patch to add usernames to the stream-events tasks in the gerrit show-queue output was incomplete, but he managed to fire up a local gerrit and test it out until he got a working version implemented | 17:05 |
| *** ivar-laz_ has joined #openstack-infra | 17:05 | |
| clarkb | do we have the working version installed? | 17:06 |
| fungi | though on the way there he learned important lessons about gerrit and it's forked buck | 17:06 |
| *** salv-orlando has quit IRC | 17:06 | |
| *** prad has quit IRC | 17:06 | |
| fungi | i think we're ready for it to be working when we restart for today's maintenance | 17:06 |
| fungi | i don't _think_ we've restarted it since his latest patch for that merged | 17:07 |
| clarkb | gotcha | 17:07 |
| fungi | on the release front, we may have made a mistake when we decided to cap libs on master before branching | 17:07 |
| fungi | because then they went ahead and released new versions with those caps baked in | 17:07 |
| *** tsg_ has quit IRC | 17:07 | |
| *** ivar-lazzaro has quit IRC | 17:08 | |
| fungi | and now master basically needs them all uncapped again and new tags outside the stable/kilo caps before they can resume having working integration tests | 17:08 |
| clarkb | but if the caps merged doesn't that imply things were working first? | 17:09 |
| *** prad has joined #openstack-infra | 17:09 | |
| *** kmartin_ has joined #openstack-infra | 17:09 | |
| clarkb | I am guessing pip is unahppy resolving a complicated cap set though | 17:10 |
| fungi | requirements check jobs for all of them have been blacklisted on the master branch for a couple days so that they can be updated/released and then we'll turn that back on again and work out a better path for next time | 17:10 |
| fungi | yeah, the problem actually comes when we want to _un-cap_ one | 17:10 |
| fungi | because then you get an explosion of version conflicts all over the place | 17:10 |
| *** ivar-laz_ has quit IRC | 17:10 | |
| clarkb | aha! | 17:10 |
| *** tsg_ has joined #openstack-infra | 17:11 | |
| *** ivar-lazzaro has joined #openstack-infra | 17:11 | |
| fungi | well, either un-cap or raise a cap | 17:11 |
| clarkb | and changing the requirements version which is sycned doesn't help because we test from releases | 17:11 |
| fungi | anyway, i suspect it would have worked better if we'd added caps on the clients in the stable/kilo branch only | 17:12 |
| fungi | and made sure to tag a new release of each off master outside the stable/kilo cap range before tagging any versions with those caps in their source | 17:12 |
| *** MaxV has quit IRC | 17:13 | |
| *** russellb has quit IRC | 17:14 | |
| fungi | but the prevailing sentiment has started to swing toward ditching version constraints in the requirements of libraries entirely, and only constraining requirements on applications (the trick i think will be telling libraries and applications apart? it's sort of a fuzzy distinction in my opinion) | 17:14 |
| clarkb | oh nice | 17:14 |
| clarkb | well I think we should be mostly uncapped everywhere :) | 17:15 |
| *** tkelsey has quit IRC | 17:15 | |
| clarkb | but anyways sounds like we have a plan to unbreak the release so thats good | 17:15 |
| fungi | also there's been a lot of hand-waving around the current behaviors of pip when it comes to multiple install runs within one environment, ordering of constraints in requirements lists, et cetera | 17:15 |
| clarkb | its pretty straightforward, top level wins, otherwise its depth first, and an existing install won't be modified | 17:16 |
| fungi | i'm worried that we're continuing to focus on the "recommended practices" of the python community, some of which ignore the mismatch between those practices and pip's actual behaviors in the face of complex dependency lists | 17:16 |
| *** harlowja_away is now known as harlowja | 17:17 | |
| *** russellb has joined #openstack-infra | 17:17 | |
| fungi | especially since end users seem to want something which "just works" when you pip install it, but the python developer community at large is fairly against the idea of having your package really depend on anything at all unless it absolutely needs to have it in place to be able to install, and leaving definition of the sets of packages to be installed up to the end user instead | 17:18 |
| *** FallenPegasus has joined #openstack-infra | 17:18 | |
| *** luqas has joined #openstack-infra | 17:19 | |
| *** vlaza has quit IRC | 17:19 | |
| fungi | at least that's the conclusion i'm starting to arrive at in the wake of post-pycon discussions in here, and on our dev ml, and on the distutils-sig ml | 17:19 |
| clarkb | I will admit to mostly ignoring those conversations | 17:19 |
| clarkb | I always get sucked in and get frustrated by the lack of non hand waving around the problem | 17:20 |
| clarkb | so better to just avoid them | 17:20 |
| dprince | anteaya: might you have time for a quick review of this TripleO job https://review.openstack.org/#/c/173255/ | 17:20 |
| dprince | we are anxious to get HA working w/ puppet in TripleO | 17:20 |
| AJaeger | fungi, clarkb: Can I get some advice on requirements and doc repos from you, please? See http://lists.openstack.org/pipermail/openstack-docs/2015-April/006362.html | 17:21 |
| fungi | basically you have a bunch of packages, some of which may use setup_requires/install_requires to be able to install at all. then you have these "requirements" lists which are really an entirely separate concept outside of the packages themselves. so if you want a working system you tell pip to install a requirements list, not a package | 17:21 |
| AJaeger | fungi, clarkb: Please first finish you discussion ;) | 17:21 |
| AJaeger | and I'm used to RPMs that have hard-requires - and that's enough in most cases. | 17:22 |
| AJaeger | We've had them extended to soft-requires: Suggests and Recommends... | 17:22 |
| AJaeger | but I'm confused by the python practice as well | 17:23 |
| clarkb | AJaeger: infra does not sync openstack requirements to any of its projects and I think it works fine | 17:23 |
| fungi | clarkb: so i think to translate to something concrete in our terms, you might have a compute services requirements.txt which lists nova and all the other packages nova needs to be able to operate sanely. so if you want a working compute node you pip install the requirements list for that, rather than pip installing nova (which would just get you the nova package but you would be missing the things it | 17:23 |
| fungi | needs to do anything) | 17:23 |
| clarkb | but that doesn't address pip broken dep resolver or how caps are often a problem and which package version actually wins | 17:24 |
| *** luqas has quit IRC | 17:24 | |
| fungi | your requirements.txt would have a bunch of == version constraints. no ranges | 17:24 |
| clarkb | fungi: then it will break even harder | 17:24 |
| *** russellb has quit IRC | 17:25 | |
| clarkb | because now how do you bump that version constraint in all of your cleints | 17:25 |
| clarkb | you can't, first one to go will win, then the others will either be too high or too low and pkg_resources will explode | 17:25 |
| fungi | it seems like this workflow is more or less baked into the python community, or at least key members thereof, which explains why pbr's behavior is seen as such an anathema. because it's conflating their completely separate ideas of "package" and "application" | 17:25 |
| clarkb | thats really weird because it won't work | 17:25 |
| AJaeger | thanks, clarkb | 17:26 |
| clarkb | the only way it will work is if everything is in its own venv | 17:26 |
| fungi | i'm sure it works fine when you hand-curate a pip freeze which has between several and a dozen deps | 17:26 |
| clarkb | fungi: the issue is in installing two different requirements.txt for fooclient and barclient when the pins don't agree | 17:26 |
| fungi | and yes, when you only install one python "application" per system/environment | 17:26 |
| clarkb | fungi: say novaclient says I need A==1.0 and glanceclient says I need B==1.1 | 17:26 |
| clarkb | whichever one that installs first will win | 17:26 |
| clarkb | then the other will break | 17:27 |
| fungi | you wouldn't have that though | 17:27 |
| clarkb | fungi: oh maybe I misread what you said | 17:27 |
| clarkb | fungi: I thought ou said each package has its install requires then a separate requirements that ou install separately | 17:27 |
| fungi | you would have a requirements list encapsulating a known-working set of package versions of novaclient and glanceclient and all the things they depend on | 17:27 |
| clarkb | oh thats bonghits | 17:27 |
| *** mrmartin has joined #openstack-infra | 17:27 | |
| waynr | pelix: initial testing seems to indicate that changing the ordering of keys in my job-template definition does not affect the xml element ordering | 17:27 |
| clarkb | what happens when I want to use neutronclient tomorrow | 17:27 |
| clarkb | or uninstall glanceclient | 17:27 |
| fungi | and that would be a novaclient+glanceclient application requirements set | 17:27 |
| anteaya | dprince: 173255 +A | 17:27 |
| waynr | oh wait i am working on the wrong job-template | 17:28 |
| waynr | derp | 17:28 |
| fungi | clarkb: if you want all three in one environment, then you'd need a separate set of requirements to represent that | 17:28 |
| dprince | anteaya: thanks, appreciate it | 17:28 |
| clarkb | fungi: and a new environment | 17:28 |
| anteaya | dprince: you're welcome | 17:29 |
| fungi | yep | 17:29 |
| fungi | clarkb: think of requirements lists as "these are all the things i'm going to install on my server to make the one application i run there work" | 17:29 |
| waynr | okay, testing on the appropriate job-template the xml element order is still not affected | 17:29 |
| clarkb | fungi: ya, I understand now. This sounds a bit stockholm syndromy | 17:29 |
| *** russellb has joined #openstack-infra | 17:29 | |
| clarkb | fungi: the tools have us captive so now we just do what they want | 17:29 |
| *** salv-orlando has joined #openstack-infra | 17:29 | |
| clarkb | but everything is awesome | 17:29 |
| clarkb | now I have that song stuck in my head | 17:30 |
| fungi | clarkb: key point being it's what _you_ believe you need to be able to run _your_ particular setup. you might also publish that requirements list so that other people can redeploy the same setup you're deploying | 17:30 |
| clarkb | fungi: right but its also inflexible for what _I_ need if that changes tomorrow | 17:30 |
| clarkb | basically I am not the dep resolver | 17:30 |
| clarkb | and the uninstaller | 17:30 |
| fungi | then you get to keep both pieces | 17:30 |
| clarkb | s/not/now/ | 17:30 |
| clarkb | the only way for me to affect chagne in the system is to manually reason about it when it should be completely automatable | 17:31 |
| clarkb | and this results in everyone writing their own tools that don't place nice with other tools fracturing our ability to install different python applications | 17:31 |
| fungi | in some ways, i think it serves as an ecological limiter to prevent any one python-based tool from depending on too many libraries. because if you try, your users will just hunt you down and string you up | 17:31 |
| *** claudiub has quit IRC | 17:31 | |
| mordred | wow. the scrollback is discussing crazy things | 17:31 |
| clarkb | fungi: hahaha, but there isn't necessarily anything wrong with that. Its only "wrong" because pip can't deal with it | 17:32 |
| fungi | mordred: mostly just me ranting on requirements lists | 17:32 |
| fungi | and trying to reconcile ml threads between distutils-sig and our recent pbr discussions | 17:32 |
| mordred | well, for the record | 17:32 |
| mordred | I think everyone in distutils-sig is wrong | 17:32 |
| mordred | because there is a latent assumption that we need to keep something flexible in an arbitrary way for consumers who are theoretically going to want to make a set of choices | 17:33 |
| mordred | that I simply do not believe people want to make | 17:33 |
| mordred | except for the 5 people on distutils-sig | 17:33 |
| waynr | pelix: i am guessing parameter interpolation or defaults application somewhere is converting the OrderedDicts to normal dicts | 17:33 |
| mordred | it's pedantic correctness getting in the way of One Obvious Way | 17:33 |
| *** tsg_ has quit IRC | 17:34 | |
| mordred | but, then again, python has categorically rejected that tentant and really should re-brand itself TIMTOWTDI | 17:34 |
| zaro | pelix: i created the jjb release tag so approve away. | 17:35 |
| *** sushilkm has joined #openstack-infra | 17:35 | |
| *** sushilkm has left #openstack-infra | 17:35 | |
| clarkb | anyone else want to review https://review.openstack.org/#/c/174160/ and https://review.openstack.org/#/c/174897/ otehrwise I am approving both so that we can try spinning up new working slaves | 17:36 |
| waynr | i am just going to have to add a new trigger-parameterized-builds parameter to direct the ordering of parameter types | 17:36 |
| *** e0ne has joined #openstack-infra | 17:37 | |
| *** mriedem1 is now known as mriedem | 17:38 | |
| fungi | clarkb: switching those to the top of my pile now | 17:38 |
| fungi | oh, i've already reviewed | 17:38 |
| clarkb | fungi: ya you are set :) | 17:38 |
| fungi | i just always feel behind on getting anything done | 17:38 |
| clarkb | fungi: me too | 17:39 |
| fungi | and i'm about to pop back out on another errand. two races this weekend, need to pick up our registration packets | 17:39 |
| clarkb | have fun | 17:39 |
| fungi | at least the registrations are happening about 4 blocks from my house, so shouldn't take long unless there's a line waiting on them to open | 17:39 |
| clarkb | mordred: any interest in reviewing 174160 and 174897? | 17:39 |
| clarkb | AJaeger: ^ 174160 is project-config | 17:40 |
| AJaeger | clarkb: will do soon | 17:40 |
| harlowja | mordred u so popular, http://lwn.net/SubscriberLink/640296/f432dbc9c799fd47/ :-P | 17:40 |
| openstackgerrit | Andreas Jaeger proposed openstack/requirements: Remove doc repositories from projects.txt https://review.openstack.org/173201 | 17:40 |
| harlowja | 'Monty Taylor is "somewhere in between" Coghlan and Klose/Warsaw.' , lol | 17:41 |
| fungi | depends on how you define "between" | 17:41 |
| harlowja | lol | 17:41 |
| *** SumitNaiksatam has quit IRC | 17:41 | |
| fungi | every point on a globe is technically between any two other points via an arc | 17:41 |
| fungi | i am always somewhere between tokyo and seattle | 17:42 |
| harlowja | haha | 17:42 |
| *** _nadya_ has quit IRC | 17:42 | |
| clarkb | AJaeger: thank you | 17:43 |
| clarkb | AJaeger: I know its late on friday so no pressure :) | 17:43 |
| openstackgerrit | Merged openstack-infra/system-config: Expose jenkins_gitfullname and jenkins_gitemail https://review.openstack.org/161695 | 17:43 |
| clarkb | oh is pleia2 back? | 17:43 |
| *** esker has quit IRC | 17:43 | |
| clarkb | pleia2: 174160 and 174897 are related to hopefully making log uploads when jenkins has a sad more reliable | 17:43 |
| pleia2 | clarkb: I am | 17:43 |
| AJaeger | clarkb: +A | 17:43 |
| pleia2 | tad? :) | 17:44 |
| AJaeger | sdague: care to +2 https://review.openstack.org/173201 ? | 17:44 |
| *** tonytan4ever has quit IRC | 17:44 | |
| clarkb | oh hrm | 17:45 |
| clarkb | except 174897 may not fix puppet | 17:45 |
| pleia2 | doh | 17:45 |
| clarkb | gah | 17:45 |
| clarkb | I don't think puppet module install postgres==someversion is going to downgrade to that version | 17:45 |
| *** prad has quit IRC | 17:45 | |
| *** emagana has joined #openstack-infra | 17:45 | |
| *** e0ne is now known as e0ne_ | 17:45 | |
| nibalizer | yep | 17:45 |
| *** prad has joined #openstack-infra | 17:46 | |
| clarkb | so while we should revert for sanity | 17:46 |
| nibalizer | also puppet module install puppetlabs/postgres --version=myversion | 17:46 |
| *** sarob has joined #openstack-infra | 17:46 | |
| nibalizer | is the command | 17:46 |
| clarkb | we also need to manually install the right version either via my install all from source change or by hand | 17:46 |
| pleia2 | well, approved for sanity | 17:46 |
| clarkb | pleia2: ty | 17:46 |
| nibalizer | clarkb: i want your 'install all from git' change | 17:46 |
| clarkb | nibalizer: I need to rebase it and update all the versions and sources and make sure they are correct | 17:47 |
| nibalizer | but fixing it by hand to unbreak things is also good | 17:47 |
| clarkb | nibalizer: I can work on that today | 17:47 |
| nibalizer | clarkb: yea kindof a :( ammount of work | 17:47 |
| nibalizer | but hey you only have to do it once, or maybe two more times max | 17:47 |
| openstackgerrit | Merged openstack-infra/project-config: TripleO: Add f20puppet-ha check job https://review.openstack.org/173255 | 17:48 |
| *** achanda has joined #openstack-infra | 17:48 | |
| *** annegentle has quit IRC | 17:50 | |
| clarkb | nibalizer: :P | 17:50 |
| clarkb | hopefully just once | 17:50 |
| clarkb | I need to eat some food now then finally go get that tdap vaccine | 17:50 |
| clarkb | but will make the install from source change my priority after | 17:51 |
| fungi | clarkb: why wouldn't 174897 work? remember where it's breaking is on a fresh install of that set of modules in a nodepool image | 17:51 |
| *** ivar-lazzaro has quit IRC | 17:51 | |
| fungi | clarkb: the only fallout we've seen thus far has been image building | 17:51 |
| clarkb | fungi: oh right, for some reason I had in my head that the version was already changed on the puppetmaster but we are using apply | 17:51 |
| clarkb | so thats good | 17:51 |
| *** ivar-lazzaro has joined #openstack-infra | 17:51 | |
| *** sgordon has quit IRC | 17:51 | |
| *** sgordon has joined #openstack-infra | 17:51 | |
| clarkb | pleia2: ^ fungi is correct that will fix it | 17:51 |
| *** e0ne_ is now known as e0ne | 17:52 | |
| fungi | well, and whatever the deal with that was on the puppetmaster, i've already forgotten but it was not immediately impacting and i assume nibalizer is working on a solution | 17:52 |
| clarkb | the issue on puppetmaster is we didn't actually bump the puppetdb version | 17:52 |
| fungi | the problem you spotted in the log shortly after we merged the original change we're reverting there | 17:52 |
| fungi | yeah, that | 17:52 |
| clarkb | my isntall from source change will address ^ | 17:52 |
| clarkb | by giving us direct control of what is installed | 17:53 |
| clarkb | so I will still pick that up after food | 17:53 |
| *** FallenPegasus has quit IRC | 17:53 | |
| fungi | disappearing now for a few minutes (30 or so i hope), but will brb to start writing up the gerrit maintenance plan for 22:00 utc | 17:54 |
| *** annegentle has joined #openstack-infra | 17:54 | |
| *** isviridov_away is now known as isviridov | 17:55 | |
| pleia2 | ah, good | 17:55 |
| *** radez is now known as radez_g0n3 | 17:56 | |
| *** radez_g0n3 is now known as radez | 17:57 | |
| *** e0ne is now known as e0ne_ | 17:57 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix retries in grab_console_log.sh https://review.openstack.org/174160 | 18:01 |
| *** vponomaryov has quit IRC | 18:01 | |
| yolanda | ah fungi, i amended that change | 18:02 |
| yolanda | i added a stop method now | 18:02 |
| openstackgerrit | Merged openstack-infra/system-config: Revert "Bump puppetdb version" https://review.openstack.org/174897 | 18:02 |
| clarkb | so I just had a thought with hpcloud down | 18:02 |
| *** ddieterly has quit IRC | 18:02 | |
| clarkb | what if we do a first pass of infra cloud deployment with https://review.openstack.org/#/c/172614/ | 18:03 |
| clarkb | we would just need to write the nodepool info on all of the nodes then run devstack-gate on one we choose as the controller | 18:03 |
| *** ddieterly has joined #openstack-infra | 18:03 | |
| clarkb | 172614 works and we could have a cloud in about 25 minutes or so | 18:04 |
| greghaynes | clarkb: and just do a one time reimage of all the nodes? | 18:04 |
| clarkb | ya basically next time you want to upgrade cloud blow that away and rerun d-g | 18:04 |
| *** esker has joined #openstack-infra | 18:04 | |
| clarkb | total outage is ~30 minutes | 18:04 |
| greghaynes | that is one of the kickers - wed need a baremetal layer to redeploy | 18:04 |
| greghaynes | oh | 18:04 |
| greghaynes | so just hope we can restack | 18:05 |
| clarkb | nevermind images | 18:05 |
| clarkb | no don't even restack | 18:05 |
| *** armax has quit IRC | 18:05 | |
| clarkb | just rm -rf /opt | 18:05 |
| clarkb | reboot, d-g | 18:05 |
| greghaynes | heh | 18:05 |
| greghaynes | not pretty, but I dont see why not | 18:05 |
| *** sergmelikyan has quit IRC | 18:06 | |
| mordred | clarkb: we need to get networking changes made | 18:06 |
| mordred | we have not reconfigured the network there yet | 18:06 |
| clarkb | mordred: what changes? because the nice thing about d-g is it makes its own networking as necessary. | 18:06 |
| mordred | clarkb: public ips | 18:06 |
| clarkb | mordred: so as long as each node has connectivity to public ips | 18:06 |
| clarkb | oh ok | 18:06 |
| mordred | we need to redo the ranges and vlans in the switches | 18:06 |
| mordred | clarkb: btw - did you catch that ttx has arranged to get us 600 nodes of capacity from runabove? | 18:07 |
| clarkb | mordred: I did not | 18:07 |
| mordred | ttx: what are our next steps on that, btw? | 18:07 |
| greghaynes | wat | 18:07 |
| mordred | clarkb: ttx worked magic | 18:07 |
| clarkb | nice | 18:07 |
| *** tonytan4ever has joined #openstack-infra | 18:08 | |
| greghaynes | thats awesome | 18:08 |
| mordred | yah | 18:08 |
| clarkb | but ya I think if we seed the nodepool data on those servers, rm -rf /opt, reboot, d-g we have a deployment that should mostly work | 18:09 |
| clarkb | do need public IPs though | 18:09 |
| clarkb | and likely an option to disable compute on the controller | 18:09 |
| *** hdd has joined #openstack-infra | 18:10 | |
| greghaynes | or we could just ansible remove that compute node after we deploy | 18:10 |
| *** ZZelle_ has joined #openstack-infra | 18:10 | |
| greghaynes | but probably not hard to actually make d-g DTRT | 18:11 |
| *** HeOS has quit IRC | 18:15 | |
| *** notnownikki has quit IRC | 18:16 | |
| *** Sukhdev has joined #openstack-infra | 18:19 | |
| *** claudiub has joined #openstack-infra | 18:19 | |
| *** AJaeger has quit IRC | 18:19 | |
| *** armax has joined #openstack-infra | 18:20 | |
| *** sarob has quit IRC | 18:20 | |
| *** annegentle has quit IRC | 18:21 | |
| *** isviridov is now known as isviridov_away | 18:21 | |
| yolanda | mordred, clarkb, i've been doing some work on puppetmaster downstream, and i was thinking in propose a puppet-puppetmaster module to infra. What do you think? | 18:24 |
| pleia2 | could it be part of puppet-puppet? | 18:24 |
| clarkb | yolanda: we are trying to delete the puppetmaster | 18:24 |
| mordred | yolanda: I don't have a problem with that - other than that I'm planning on deleting the puppetmaster | 18:24 |
| pleia2 | or that | 18:24 |
| clarkb | yolanda: so I think our preference would be to spend time deleting the puppetmaster | 18:25 |
| mordred | yolanda: it's next on my list once dib-nodepool is done | 18:25 |
| *** annegentle has joined #openstack-infra | 18:25 | |
| mordred | ++ | 18:25 |
| mordred | it's actually not that far away | 18:25 |
| yolanda | ah, then it's not worth the effort | 18:25 |
| *** leakypipes has quit IRC | 18:25 | |
| mordred | clarkb: speaking of 167625 is safe to land to start clearing down the dib-nodepool stack | 18:26 |
| *** ildikov has joined #openstack-infra | 18:26 | |
| *** tonytan4ever has quit IRC | 18:26 | |
| *** dustins_ has joined #openstack-infra | 18:26 | |
| greghaynes | mordred: does that have the urlgrabber fix? | 18:27 |
| greghaynes | mordred: where we had to install that from git | 18:27 |
| *** teran has quit IRC | 18:27 | |
| fungi | mordred: you were previously talking about working on an ansible playbook for repo renames. is that close enough to working that we should try it in a few hours, or stick to our old methods and try that out next round? | 18:28 |
| *** teran has joined #openstack-infra | 18:28 | |
| *** ashleighfarnham has joined #openstack-infra | 18:28 | |
| openstackgerrit | Dan Prince proposed openstack-infra/project-config: puppet-keystone: Add tripleo check job https://review.openstack.org/174997 | 18:28 |
| mordred | fungi: let's stick to our old methods and try it out next round | 18:28 |
| *** johnthetubaguy is now known as zz_johnthetubagu | 18:28 | |
| mordred | greghaynes: urlgrabber fix? | 18:29 |
| fungi | mordred: sounds good. just making sure before i write the etherpad for this one | 18:29 |
| mordred | greghaynes: oh - in dib | 18:29 |
| greghaynes | mordred: yes, yumdownloader was failing unless we had urlgrabber installed from git on the builder | 18:29 |
| *** andreykurilin__ has joined #openstack-infra | 18:29 | |
| mordred | greghaynes: do we have the thing that needs to be done documented somewhere? | 18:29 |
| *** dustins has quit IRC | 18:29 | |
| *** carl_baldwin has joined #openstack-infra | 18:29 | |
| greghaynes | mordred: https://review.openstack.org/#/c/166640/17/elements/fedora-minimal/README.rst | 18:29 |
| mordred | greghaynes: also - do we have any sense of when that's going to be not broken? | 18:29 |
| *** ssam2 has quit IRC | 18:30 | |
| greghaynes | whenever they push a release to pypi | 18:30 |
| greghaynes | we could ask | 18:30 |
| *** e0ne_ is now known as e0ne | 18:30 | |
| clarkb | so urlgrabber is a thing that yum needs but isn't available on pypi or ubuntu apt repos? | 18:30 |
| clarkb | does that mean ubuntu's package is broken? | 18:30 |
| mordred | clarkb: the patched version isn't released yet | 18:30 |
| greghaynes | clarkb: theres a bug in something ssl related, its fixed but the pypi versoin is out of data | 18:31 |
| greghaynes | er, date | 18:31 |
| greghaynes | IIRC they even have tagged new versions, just not uploaded them | 18:31 |
| mordred | I think we should nudge them to release | 18:31 |
| openstackgerrit | Dan Prince proposed openstack-infra/project-config: puppet-keystone: Add tripleo check job https://review.openstack.org/174997 | 18:31 |
| mordred | SpamapS: what's the chance we can get the patch backported into trusty? ^^ | 18:31 |
| *** carl_baldwin has left #openstack-infra | 18:31 | |
| greghaynes | yea, 3.9.1 is on pypi but they have a 3.10.1 tagged right after the fix commit | 18:32 |
| *** teran has quit IRC | 18:32 | |
| clarkb | mordred: about as good as python3.4 backports making it to trusty? >_> | 18:32 |
| greghaynes | zing | 18:33 |
| mordred | clarkb: *sob* | 18:33 |
| *** avozza is now known as zz_avozza | 18:34 | |
| mordred | greghaynes: any chance you know what the "fix" patch is? | 18:35 |
| greghaynes | mordred: I bet its http://yum.baseurl.org/gitweb?p=urlgrabber.git;a=commit;h=857af5ac1cec0a06755b75286ae2192e398cd341 | 18:35 |
| greghaynes | not 100%, but that commit msg looks likely | 18:35 |
| *** cdent has quit IRC | 18:36 | |
| *** otter768 has joined #openstack-infra | 18:37 | |
| mordred | greghaynes: fedora has 3.10.1 | 18:38 |
| greghaynes | awesome | 18:38 |
| fungi | sounds like this is yet another problem we'd be able to safely ignore if we implemented that nodepool dib worker spec? | 18:38 |
| mordred | http://urlgrabber.baseurl.org/download/urlgrabber-3.10.1.tar.gz | 18:39 |
| * greghaynes was debating starting hacking on the dib worker stuff today | 18:39 | |
| greghaynes | not sure if we wanted to wait until the shade + nodepool sutff gets merged? | 18:39 |
| * mordred would like to be able to build these images locally | 18:39 | |
| mordred | greghaynes: yes please | 18:39 |
| mordred | there is too much churn already | 18:39 |
| fungi | mordred: does a container count as locally? | 18:39 |
| greghaynes | ok | 18:39 |
| mordred | fungi: right now it works | 18:39 |
| mordred | there is no problem with me just building them | 18:40 |
| mordred | I'd like to keep it that way | 18:40 |
| fungi | makes sense | 18:40 |
| mordred | because it's not broken right now - other than the debian version of urlgrabber is old | 18:40 |
| fungi | though i still feel like there is some class of issues where we're not going to be able to reasonably expect to build images for every platform we might want from one common distro/release | 18:40 |
| mordred | I think all of those are bugs | 18:41 |
| mordred | there is no reason why we can't copy files around in a fedora chroot on ubuntu | 18:41 |
| *** otter768 has quit IRC | 18:42 | |
| clarkb | until you need tar to support extended attributes | 18:42 |
| fungi | eh, for platforms which support the same set of filesystems anyway | 18:42 |
| fungi | (and filesystem features, point) | 18:42 |
| mordred | fungi: I disagree | 18:42 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Bump kombu version and add amqp version https://review.openstack.org/174930 | 18:43 |
| mordred | these are chroots, no? | 18:43 |
| mordred | in any case- if we fail, neat | 18:43 |
| *** tonytan4ever has joined #openstack-infra | 18:43 | |
| fungi | though i guess if you really want to bootstrap freebsd on ufs from trusty, there's ufs support in the linux kernel | 18:43 |
| greghaynes | its a chroot we copy into a mouned loop device we mkfs'd | 18:43 |
| mordred | but I would personally prefer to not give up on my being able to easily test things locally | 18:43 |
| fungi | you wouldn't be able to chroot into that filesystem, but you'd be able to write files into it | 18:44 |
| mordred | sure. although at the moment we don't support freebsd at all - so I'm not too worried about that | 18:44 |
| mtreinish | mordred: I thought someone was working on that | 18:45 |
| clarkb | mordred: you cannot locally build centos/fedora images on ubuntu precise | 18:45 |
| clarkb | mordred: jus saying, and I don't think anyone considers that a bug | 18:45 |
| mordred | right. because I don't care about precise | 18:46 |
| greghaynes | clarkb: that might work with -minimal now | 18:46 |
| fungi | or our friend who wants to nodepool a bunch of arm systems. with dib workers he could run nodepoold on x86 and the workers on arm | 18:46 |
| greghaynes | clarkb: since its doing rpm, not tar | 18:46 |
| *** achanda has quit IRC | 18:46 | |
| mordred | ++ | 18:46 |
| mordred | so - listen - don't get me wrong - I think the workers are a GREAT idea and we should do them | 18:46 |
| mordred | and it'll help some folks who want to do strange things like cross-compile onto arm and whatnot | 18:46 |
| * fungi supports the workers | 18:46 | |
| openstackgerrit | Khai Do proposed openstack-infra/jenkins-job-builder: hipchat bug fix https://review.openstack.org/133997 | 18:46 |
| mordred | but I think taht the general case is taht for normal things we should expect to be able to build ubuntu images on fedora and vice versa | 18:47 |
| * fungi doesn't want to be the first with his back against teh wall when the revolution comes | 18:47 | |
| mordred | and if something happens to start preventing that from being teh case, we should consider it a bug | 18:47 |
| mordred | and should not just assume that the host platform is going to need to match | 18:47 |
| fungi | yep. i think both those viewpoints are valid | 18:47 |
| *** mbacchi1 has quit IRC | 18:47 | |
| clarkb | mordred: then why isn't precise a thing you care about? | 18:47 |
| greghaynes | relatedly - there was talk from tripleo about splitting image building out of their devtest and create a script that an read yaml and call dib to make corresponding images | 18:48 |
| clarkb | mordred: I think you have to care about precise in your example | 18:48 |
| mordred | clarkb: I don't care about precise as a build host | 18:48 |
| greghaynes | I might have mentioned they should work to use the same code nodepool does | 18:48 |
| openstackgerrit | Khai Do proposed openstack-infra/jenkins-job-builder: hipchat bug fix https://review.openstack.org/133997 | 18:48 |
| mordred | clarkb: because I do not care about precise as a host for new things at all right now | 18:48 |
| greghaynes | so id kind of like to do the nodepool worker stuff with that in mind, if possible | 18:48 |
| mordred | greghaynes: the could also just use my ansible module that already does that | 18:48 |
| clarkb | mordred: except that you likely want to build precise images | 18:48 |
| mordred | since it exists today and works today | 18:49 |
| mordred | clarkb: yes - and I can | 18:49 |
| clarkb | mordred: just not on precise | 18:49 |
| mordred | clarkb: I can build precise images on my trusty laptop today | 18:49 |
| greghaynes | mordred: ooo, that would be neat | 18:49 |
| mordred | I do not care about building things on precise | 18:49 |
| clarkb | mordred: right I am saying each image should be self hosting too | 18:49 |
| clarkb | because if ubuntu should build fedora and vice versa, hopefully ubuntu can build ubuntu | 18:49 |
| mordred | clarkb: in general, sure - except that this is new development so I don't care if it doesn't support precise | 18:49 |
| mordred | yes. and it can. trusty, which is the first supported version, can build anything right now | 18:50 |
| mordred | it also doesn't work on lucid | 18:50 |
| mordred | although it can build a lucid image if you like | 18:50 |
| clarkb | lucid is actually eol this month | 18:50 |
| mordred | sure | 18:50 |
| clarkb | maybe even this week :) | 18:50 |
| clarkb | I think | 18:50 |
| clarkb | should ask blkperl | 18:50 |
| clarkb | mordred: it is just weird to me to say that ubuntu must build fedora and vice versa but not also say that builds are self hosting | 18:51 |
| clarkb | since the idea seems to be that we should make it easy for users to use | 18:51 |
| mordred | clarkb: I could just as easily just say "screw precise it's not supported" | 18:51 |
| greghaynes | the issue was fedora on precise builder right? | 18:51 |
| clarkb | and if a user wants precise images they likely want to build on precise too | 18:52 |
| greghaynes | I can just kick off a build with fedora-minimal and see if its even an issue still | 18:52 |
| mordred | clarkb: I'm just saying that precise, specifically, is currently half-supported | 18:52 |
| mordred | clarkb: it is a target but not a host | 18:52 |
| clarkb | greghaynes: it was any build that required tar to understand xattrs | 18:52 |
| greghaynes | yea | 18:52 |
| greghaynes | ok | 18:52 |
| *** zz_avozza is now known as avozza | 18:53 | |
| mordred | greghaynes, SpamapS: so - I think we really do need to get the urlgrabber packages fixed | 18:54 |
| mordred | because yum-utils depends on urlgrabber, and if we install urlgrabber over top of that via pip, it's going to be a mess | 18:54 |
| clarkb | mordred: I totally agree that ubuntu should be able to build fedora and vice versa | 18:55 |
| mordred | clarkb: ++ | 18:55 |
| clarkb | mordred: but as the person that was completely screwred by precise being unsupported I do not thinkyou can argue for that then say f precise | 18:55 |
| mordred | clarkb: I do - as long as I'm clear that precise is an unsupported platform | 18:55 |
| SpamapS | mordred: the Ubuntu release team is distracted with vivid | 18:55 |
| clarkb | mordred: but it is supported | 18:55 |
| SpamapS | mordred: they just have to click a single button to release it to trusty-updates .. not sure why they haven't. | 18:55 |
| * SpamapS will poke them | 18:56 | |
| clarkb | mordred: dib explicitly supported precise last I looked | 18:56 |
| *** MaxV has joined #openstack-infra | 18:56 | |
| mordred | SpamapS: urlgrabber? | 18:56 |
| SpamapS | mordred: yes | 18:56 |
| *** achanda has joined #openstack-infra | 18:56 | |
| mordred | clarkb: maybe dib should stop claiming precise support | 18:56 |
| SpamapS | mordred: oh wait..no, it's released! | 18:57 |
| SpamapS | mordred: trusty-updates has a working urlgrabber | 18:57 |
| mordred | aroo? | 18:57 |
| *** salv-orlando has quit IRC | 18:57 | |
| mordred | yay! | 18:57 |
| greghaynes | \O/ | 18:57 |
| *** e0ne has quit IRC | 18:58 | |
| SpamapS | as of Monday actually | 18:58 |
| SpamapS | I just missed the bug response | 18:58 |
| SpamapS | no, Tuesday. Anyway, it's up, so that should all work and stuff | 18:58 |
| SpamapS | now.. | 18:58 |
| mordred | woot! | 18:58 |
| SpamapS | can we get urlgrabber to release to pypi so Debian notices? | 18:58 |
| SpamapS | also it looks like Debian is getting on its horse and pushing hard for python3 in stretch (jessie+1) | 18:59 |
| SpamapS | Release goal will likely be that all leaf packages use python3 | 18:59 |
| *** MaxV has quit IRC | 18:59 | |
| SpamapS | And, love it or hate it, when Debian does something systematically, it usually ripples through the ecosystem. | 19:00 |
| mordred | dprince: you know everyone at redhat, right? | 19:00 |
| *** marcusvrn3 has quit IRC | 19:00 | |
| SpamapS | Feels a bit like maybe 2015 will be the year everybody starts caring enough that it gets done. | 19:00 |
| mordred | dprince: any chance you can get the urlgrabber maintainer to release 0.10.1 to pypi and not just to the urlgrabber download site? | 19:01 |
| mordred | dprince: it's been released for 2 years - just isn't on pypi | 19:01 |
| mordred | russellb, ianw: ^^ | 19:01 |
| mordred | SpamapS: you could also make a patch for debian to change the watch file to look at http://urlgrabber.baseurl.org/download/urlgrabber-3.10.1.tar.gz ... | 19:02 |
| *** MaxV has joined #openstack-infra | 19:03 | |
| openstackgerrit | Matthew Treinish proposed stackforge/gertty: Explain how to install on Arch Linux https://review.openstack.org/175008 | 19:03 |
| *** arxcruz has quit IRC | 19:03 | |
| mtreinish | jeblair: ^^^ figured I should document that | 19:03 |
| *** marun has quit IRC | 19:03 | |
| mtreinish | although not that I ever recommend using anything python from packages in arch | 19:04 |
| mtreinish | talk about a headache | 19:04 |
| *** pelix has quit IRC | 19:07 | |
| mtreinish | jeblair: I also figure it was better to not put the package from git in the readme: https://aur.archlinux.org/packages/python2-gertty-git/ | 19:07 |
| mordred | SpamapS: ok. https://bugzilla.redhat.com/show_bug.cgi?id=1212958 | 19:07 |
| openstack | bugzilla.redhat.com bug 1212958 in python-urlgrabber "Please release 0.10.1 to PyPI" [Unspecified,New] - Assigned to packaging-team-maint | 19:07 |
| zaro | waynr: had questions for you in https://review.openstack.org/#/c/150597 | 19:07 |
| *** mrunge has quit IRC | 19:07 | |
| zaro | and 150598 as well | 19:08 |
| SpamapS | mordred: ah so upstream just stopped uploading to pypi, but they have tarballs.. good to know. | 19:08 |
| *** peristeri has quit IRC | 19:08 | |
| mordred | SpamapS: yah - although they do not have an SSL download location | 19:09 |
| mordred | at least, not one with a working cert | 19:09 |
| mordred | so it would still be nice to get them to upload to pypi | 19:10 |
| SpamapS | mordred: nor gpg sig, but if tags are signed, that is sufficient | 19:10 |
| *** MaxV has quit IRC | 19:12 | |
| SpamapS | nope, no sigs | 19:12 |
| clarkb | ok really going to run so that I can be back before 2200 | 19:13 |
| clarkb | fungi: any chance you can kick off some image rebuilds to test your puppetdb revert? | 19:13 |
| fungi | clarkb: sure. i'll fire one up now to verify | 19:13 |
| SpamapS | mordred: yeah, they need to get their **** together... | 19:13 |
| SpamapS | such a basic thing.. sign your tarballs people. | 19:13 |
| fungi | it's sad, but i spend far more of my time than should be necessary explaining pgp to developers | 19:14 |
| clarkb | fungi: I think that says more about the implementation of gpg than anything else | 19:15 |
| clarkb | how to get confused very fast: man gpg | 19:15 |
| clarkb | even signing has ~3 different methods that should all be used in different circumstances that arent well documented iirc | 19:15 |
| fungi | i disagree. a much larger percentage of free software developers actively used pgp a decade ago than do now. maybe it says something about a new generation of free software developers not wanting to learn to use the tools of their trade? | 19:16 |
| clarkb | fungi: its very hard to learn | 19:16 |
| clarkb | I find gpg to be incredibly obtuse | 19:16 |
| clarkb | some of it is probably hard to make simple but signing should be easier for example | 19:17 |
| *** teran has joined #openstack-infra | 19:17 | |
| SpamapS | no you're absolutely right clarkb | 19:17 |
| SpamapS | when _debian's packaging tools_ are simpler to use... | 19:17 |
| fungi | maybe the problem is that other tools have become easier to use over time (or been replaced with easier to use tools) and pgp implementations generally have not | 19:17 |
| mordred | that's a scary bar | 19:17 |
| mordred | yah. nobody has really stepped up and made a better ui for it- other than keybase | 19:18 |
| fungi | SpamapS: you think they're using debian's packaging tools? and not just some other fire-and-forget script which makes a deb dpkg won't completely fail to install? | 19:18 |
| SpamapS | Honestly the problem is that nobody who started writing software 3 years ago sits in front of their terminal and thinks "How in the hell do I trust that software from this random FTP site on the internet?" They think .. well shit it's in git, that uses hashes, its on github... I'm good. | 19:19 |
| *** annegentle has quit IRC | 19:19 | |
| SpamapS | fungi: no I think it's easier to learn how to use debian's tools than gpg | 19:19 |
| SpamapS | especially debsign. :) | 19:19 |
| fungi | SpamapS: debsign isn't going to work if you haven't used gpg to set up a key, is it? | 19:20 |
| mordred | speaking of - I just uploaded a modification of the vhd-util package | 19:20 |
| mordred | that does not install library files | 19:20 |
| mordred | because it doesn't use them | 19:20 |
| mordred | and they conflict with libxenstore | 19:20 |
| mordred | which qemu depends on in vivid | 19:20 |
| SpamapS | fungi: no, but making a key isn't that hard and happens once. There are, as clarkb said, 3 ways to sign. | 19:20 |
| *** peristeri has joined #openstack-infra | 19:20 | |
| ttx | mordred: next steps with RunAbove is to send them a memo on what we agreed on, then have them come up with the exact set up (how many, what type, under what brand) | 19:21 |
| SpamapS | fungi: but managing ones' own key... getting it signed.. is actually the important part and is actually the hard part. :) | 19:21 |
| ttx | Ideally I'd like to piggyback on your Paris trip so that you can meet some of them | 19:21 |
| mordred | ttx: cool | 19:21 |
| ttx | mordred: know when you arrive and leave ? jeblair told me you'd rather limit the duration of your stay | 19:22 |
| *** bnemec is now known as beekneemech | 19:22 | |
| *** radez is now known as radez_g0n3 | 19:22 | |
| mordred | yah - but this is a worthwile reason to extend | 19:23 |
| openstackgerrit | Andrew Laski proposed openstack-infra/project-config: Blacklist last failing Tempest tests for cells job https://review.openstack.org/175015 | 19:23 |
| mordred | ttx: my current plan is to arrive morning of apr 29 and to leave on may 1 (since I hear paris will be shut down that day) | 19:23 |
| ttx | it is a holiday yes | 19:24 |
| fungi | also keybase makes me sad. it's actively encouraging people to upload their private key material to an on-line third party. does nobody remember hushmail? | 19:24 |
| ttx | and we kind of take those seriously | 19:24 |
| *** hdd has quit IRC | 19:24 | |
| mordred | fungi: it is? I do not remember any "upload private key" step ... | 19:24 |
| mordred | (which I would not have performed) | 19:24 |
| *** hasharAway is now known as hashar | 19:25 | |
| fungi | mordred: at least when i tried it out, that was their "recommended" usage. though if you really wanted, it also let you do local operations with your key and upload the results | 19:25 |
| fungi | they wanted to make it easier by generating and storing a key for you instead, so that you didn't have to worry about the complexities of key management | 19:26 |
| *** hdd has joined #openstack-infra | 19:26 | |
| SpamapS | mordred: true story | 19:26 |
| mordred | nod | 19:26 |
| greghaynes | WCPGW with that | 19:26 |
| SpamapS | It made ma a little sad too, but I just do the cli operations and paste | 19:26 |
| SpamapS | me | 19:27 |
| ttx | wow, every vote counts | 19:27 |
| SpamapS | greghaynes: it'll be fine as long as they don't cross the streams | 19:27 |
| * ttx just glanced at the results | 19:27 | |
| mordred | ah - yes - I see the option to upload one now | 19:27 |
| fungi | but that gives people new to the topic the impression that letting someone else be in control of your key material is a safe thing | 19:27 |
| mordred | ttx: yeah? | 19:27 |
| *** dustins_ has quit IRC | 19:27 | |
| ttx | 89-87 on the nova election | 19:27 |
| greghaynes | wow | 19:27 |
| ttx | 34-32 on the Glace one | 19:28 |
| ttx | glance* | 19:28 |
| mordred | wow | 19:28 |
| *** ajo has quit IRC | 19:28 | |
| mordred | ttx: who won? | 19:28 |
| ttx | John Garbutt and Nikhil Komawar | 19:28 |
| *** ajo has joined #openstack-infra | 19:28 | |
| fungi | from what i've heard they've in more recent months gotten a lot of concerned feedback and are since downplaying the on-line keys option a bit more than they were at the start | 19:28 |
| mordred | fungi: good | 19:29 |
| mordred | ttx: is that the first time that someone has run against a sitting ptl and won? | 19:29 |
| fungi | nope, neutron a couple cycles back | 19:29 |
| mordred | oh right | 19:29 |
| ttx | no, Kye won over Mark | 19:29 |
| ttx | Kyle* | 19:29 |
| mordred | I forgot about that one | 19:29 |
| * SpamapS wanders off to find food | 19:30 | |
| *** yamahata has quit IRC | 19:31 | |
| ttx | train is moving again. See you on the other side | 19:31 |
| dprince | mordred: I don't claim to know anyone, but I can put a ping in for it :) | 19:31 |
| mordred | dprince: thanks! I also filed a bugzilla | 19:31 |
| *** HeOS has joined #openstack-infra | 19:34 | |
| jeblair | mordred, ttx: back | 19:37 |
| mordred | jeblair: while you were gone, all the things broke, except for the ones that didn't, and also all the things got fixed, except we missed some | 19:38 |
| *** stevemar has quit IRC | 19:40 | |
| *** stevemar2 has joined #openstack-infra | 19:40 | |
| *** subscope has quit IRC | 19:40 | |
| hashar | nodepool_0.0.1-104-gddd6003_amd64.deb nodepool.NodePool: Loading configuration .... ^o^ | 19:40 |
| mordred | whee! | 19:41 |
| hashar | yeah slowly progressing! | 19:42 |
| hashar | mordred: I have a replied a bit to your Phabricator emails. I am not sure I will have time to reply ttx great analysis though :/ | 19:43 |
| jeblair | hashar: i know i promised i'd tag and release some things for you, but i haven't gotten to it yet and there's enough broken stuff for a friday already, so would next week be okay? :) | 19:44 |
| hashar | jeblair: yeah take your time | 19:44 |
| hashar | jeblair: I am building my package from arbitrary points. Just thought tags would help figure out something is going to break horribly | 19:44 |
| hashar | good luck on friday fixes! | 19:45 |
| jroll | random question of the day: is there a reason openstack projects use % and not .format() for string formatting? | 19:45 |
| *** ibiris is now known as ibiris_away | 19:45 | |
| *** tsg has joined #openstack-infra | 19:45 | |
| mtreinish | jroll: whimsy? | 19:46 |
| jroll | :) | 19:46 |
| hashar | less keystrokes? | 19:46 |
| jroll | python 2.6 came up as a possible reason | 19:46 |
| jeblair | jroll, hashar: yeah, i count 8 reasons ;) | 19:46 |
| jroll | I guess I wonder if we care about doing it as part of the road to python 3 | 19:46 |
| jroll | or if we care about the road to py3 | 19:47 |
| fungi | jroll: i thought % still worked in python 3.x | 19:47 |
| jeblair | we definitely care about the road to py3 | 19:47 |
| * hashar giggles | 19:47 | |
| hashar | the Debian python team is actively talking about switching to py3 | 19:47 |
| jroll | fungi: I don't believe it does | 19:47 |
| fungi | jroll: yeah, still seems to work in 3.4 | 19:48 |
| *** tsg_ has joined #openstack-infra | 19:48 | |
| jroll | O.o | 19:48 |
| fungi | jroll: fire up an interpreter and try it? | 19:48 |
| jroll | maybe they put it back at some point | 19:48 |
| jeblair | fungi, ttx: any (release-related) reason we should defer today's maintenance? | 19:48 |
| openstackgerrit | Merged openstack-infra/project-config: Update gerritbot #openstack-infra from governance https://review.openstack.org/173032 | 19:48 |
| jroll | definitely didn't work in earlier 3.x | 19:48 |
| *** arxcruz has joined #openstack-infra | 19:48 | |
| openstackgerrit | Khai Do proposed openstack-infra/jenkins-job-builder: zuul: drop notifications https://review.openstack.org/167254 | 19:48 |
| jroll | fungi: TIL, thanks :) | 19:48 |
| fungi | jeblair: not to my knowledge. unless there's another flurry of reviews on the way it looks like we'll likely catch up zuul-wise by 22:00 | 19:49 |
| jeblair | jroll: i want to say 3.3 was the big "put everything that made it impossible to move to py3 back in" release? | 19:49 |
| *** mrmartin has quit IRC | 19:49 | |
| clarkb | jeblair ya | 19:49 |
| jroll | jeblair: yeah, you might be right, I haven't been following | 19:49 |
| fungi | jeblair: jroll: yeah, it might have been lacking from 3.2, i don't recall | 19:49 |
| *** Darkwan has joined #openstack-infra | 19:49 | |
| *** salv-orlando has joined #openstack-infra | 19:49 | |
| jeblair | oh wow, imapsync is up to 3.56 m/s and expects to be done in 2 hours! | 19:50 |
| *** tsg has quit IRC | 19:50 | |
| fungi | dhellmann: any release-related issues you're aware of that we should postpone our scheduled 22:00-00:00 gerrit maintenance today? | 19:50 |
| *** achanda has quit IRC | 19:50 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: DO NOT MERGE: Example of get/list/search method https://review.openstack.org/175027 | 19:51 |
| fungi | clarkb: successfully rebuilt a bare-trusty in rax-iad, so we should be all set puppet-wise now | 19:52 |
| clarkb | woot | 19:52 |
| *** arxcruz has quit IRC | 19:52 | |
| clarkb | and that should make console logs more reliable | 19:52 |
| *** funzo has quit IRC | 19:53 | |
| *** patrickeast has quit IRC | 19:53 | |
| openstackgerrit | Merged openstack-infra/puppet-gerrit: Add properties, md and css files to direct download list https://review.openstack.org/173087 | 19:58 |
| *** nelsnelson has quit IRC | 19:59 | |
| openstackgerrit | Kyle Rockman proposed openstack-infra/jenkins-job-builder: Adding hipchat publisher https://review.openstack.org/174036 | 20:01 |
| openstackgerrit | Kyle Rockman proposed openstack-infra/jenkins-job-builder: adding support for the xcode builder plugin https://review.openstack.org/146918 | 20:02 |
| mordred | jroll: I try to use format | 20:03 |
| mordred | jroll: but I've been doing python for a long time, so I forget | 20:03 |
| *** teran_ has joined #openstack-infra | 20:04 | |
| jroll | mordred: right on, just wondering if there was a good reason, I think "3.4 supports %" is good enough for me | 20:04 |
| clarkb | fwiw transifex groks % but not sure if it groks format | 20:04 |
| clarkb | er | 20:04 |
| clarkb | zanata | 20:04 |
| mordred | do we know if zanata | 20:04 |
| clarkb | unsure of trnasifex | 20:04 |
| mordred | ah | 20:04 |
| mordred | well, we should file a bug with them if it doesn't | 20:05 |
| openstackgerrit | Kyle Rockman proposed openstack-infra/jenkins-job-builder: adding support for android emulator https://review.openstack.org/146990 | 20:05 |
| *** teran has quit IRC | 20:07 | |
| *** funzo has joined #openstack-infra | 20:09 | |
| kevinbenton | fungi: ping | 20:10 |
| fungi | kevinbenton: pong | 20:10 |
| *** mattfarina has quit IRC | 20:11 | |
| kevinbenton | fungi: quick clarification question regarding the email thread | 20:11 |
| fungi | yep | 20:11 |
| kevinbenton | fungi: "My takeaway from Tom's message was that there was a concern about | 20:11 |
| kevinbenton | "complexity" in all forms (not just of the API but also due to the | 20:11 |
| kevinbenton | lack of maturity, documentation and debuggability of the underlying | 20:11 |
| kevinbenton | technology), and that the self-service networking model was simply | 20:11 |
| kevinbenton | one example of that" | 20:11 |
| *** teran has joined #openstack-infra | 20:11 | |
| kevinbenton | fungi: the self-service networking model isn't from the underlying technology | 20:12 |
| kevinbenton | fungi: or did i parse that incorrectly? | 20:12 |
| *** MaxV has joined #openstack-infra | 20:12 | |
| kevinbenton | fungi: oh, i think i did now that i re-read the parens | 20:12 |
| openstackgerrit | Merged openstack-infra/project-config: Move cliff gerrit announcements to the sdk channel https://review.openstack.org/173401 | 20:13 |
| fungi | kevinbenton: the self-service model of neutron is one form of complexity concerning operators, but not the only source of complexity concerning them | 20:13 |
| kevinbenton | fungi: ok | 20:13 |
| clarkb | also note nova net flatdhcp doesnt give every node an fip | 20:13 |
| kevinbenton | clarkb: oh, how do they get connectivity out? | 20:14 |
| *** jogo has quit IRC | 20:14 | |
| fungi | (see rackspace for a good example of that) | 20:14 |
| clarkb | and I wrote a list of ovs complaints that are not "its new" | 20:14 |
| fungi | kevinbenton: globally routable ip addresses on your instance interfaces | 20:14 |
| clarkb | kevinbenton you put them on a network directly | 20:14 |
| fungi | nat is a disease | 20:14 |
| clarkb | can fip in addition to that | 20:14 |
| *** dkranz has quit IRC | 20:14 | |
| kevinbenton | fungi: i saw clarkb's complaints, but is there somewhere else that has operator complaints about OVS? we should kick them back upstream to OVS | 20:14 |
| *** teran_ has quit IRC | 20:15 | |
| *** stevemar2 is now known as stevemar | 20:15 | |
| kevinbenton | clarkb: so they would just get connectivity via whatever router is on the private network? | 20:15 |
| *** Krinkle is now known as Krinkle|detached | 20:15 | |
| fungi | kevinbenton: i've not really had much feedback directly from the operator community, so what i know comes from the user committee, user survey and the few who do show up on the operators ml | 20:15 |
| clarkb | yes direct connectivity | 20:16 |
| fungi | kevinbenton: ideally get tom, tim et al to pass along more specific complaints | 20:16 |
| kevinbenton | fungi: what is a 'user' in the user committee sense? | 20:16 |
| *** dprince has quit IRC | 20:16 | |
| fungi | kevinbenton: it's all over the map | 20:16 |
| kevinbenton | clarkb: that explains the email thread about people wanting to bypass the neutron router but still have floating IPs | 20:16 |
| kevinbenton | clarkb: thanks | 20:16 |
| fungi | from what i can tell it means people who rely on openstack in some way and aren't active developers with direct influence on the design (or who don't know they can have direct influence on the design, if they have time to get involved) | 20:17 |
| kevinbenton | fungi: why i asked is because 'tenants' shouldn't see OVS at all | 20:17 |
| kevinbenton | fungi: that makes sense | 20:17 |
| fungi | the user survey is a product of the user committee, but it asks questions about operator-related topics depending on what paths you take in the choose-your-own adventure | 20:18 |
| fungi | or perhaps it just seemed that way to me the last few times i've taken it | 20:18 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Support the use of lists in trigger-build publisher. https://review.openstack.org/150598 | 20:18 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Allow explicit parameter override ordering in trigger_parameterized_builds https://review.openstack.org/175049 | 20:18 |
| *** Sukhdev has quit IRC | 20:19 | |
| waynr | zaro: I'm interested in your thoughts on https://review.openstack.org/175049 | 20:20 |
| kevinbenton | fungi: sounds good | 20:20 |
| waynr | this parameter ordering is required for some work i am doing on my production CI jobs, or i have to rethink the way i am using build parameters | 20:21 |
| *** kgiusti has left #openstack-infra | 20:21 | |
| waynr | also, i am addressing your feedback on https://review.openstack.org/150598 | 20:21 |
| *** openstackgerrit has quit IRC | 20:22 | |
| *** openstackgerrit has joined #openstack-infra | 20:22 | |
| kevinbenton | fungi: sorry, that was an incompatible acknowledgement to the last thing you said. running on little sleep :) | 20:23 |
| *** marun has joined #openstack-infra | 20:25 | |
| fungi | kevinbenton: heh. i totally understand ;_ | 20:25 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Use envassert for integration tests https://review.openstack.org/173592 | 20:26 |
| *** achanda has joined #openstack-infra | 20:27 | |
| *** Sukhdev has joined #openstack-infra | 20:28 | |
| *** andreykurilin___ has joined #openstack-infra | 20:28 | |
| *** soren_ has joined #openstack-infra | 20:29 | |
| *** andreykurilin__ has quit IRC | 20:29 | |
| *** kgiusti has joined #openstack-infra | 20:31 | |
| *** gyee has quit IRC | 20:32 | |
| *** amitgandhinz has quit IRC | 20:35 | |
| *** otter768 has joined #openstack-infra | 20:38 | |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Allow explicit parameter override ordering in trigger_parameterized_builds https://review.openstack.org/175049 | 20:39 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Support the use of lists in trigger-build publisher. https://review.openstack.org/150598 | 20:39 |
| *** kgiusti has left #openstack-infra | 20:39 | |
| *** tqtran_afk is now known as tqtran | 20:41 | |
| *** thedodd has quit IRC | 20:42 | |
| *** otter768 has quit IRC | 20:43 | |
| *** tqtran has quit IRC | 20:43 | |
| *** tqtran has joined #openstack-infra | 20:43 | |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Enable parameter ordering in trigger_parameterized_builds https://review.openstack.org/175049 | 20:44 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Support use of lists in trigger-build publisher. https://review.openstack.org/150598 | 20:44 |
| *** tiswanso has quit IRC | 20:45 | |
| *** soren_ has quit IRC | 20:45 | |
| *** emagana has quit IRC | 20:45 | |
| *** tiswanso has joined #openstack-infra | 20:47 | |
| *** emagana has joined #openstack-infra | 20:47 | |
| openstackgerrit | Merged openstack-infra/project-config: Add #openstack-neutron-ovn to gerritbot. https://review.openstack.org/173873 | 20:49 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Support the use of lists in trigger-build builder. https://review.openstack.org/150597 | 20:53 |
| clarkb | ok working on puppet module installs now, does anyone know why we have a memcached module? | 20:54 |
| * clarkb guesses askbot | 20:54 | |
| *** sdake_ has joined #openstack-infra | 20:56 | |
| openstackgerrit | Merged openstack-infra/puppet-nodepool: Install additional depends for dib https://review.openstack.org/167625 | 20:56 |
| *** baoli_ has quit IRC | 20:56 | |
| nibalizer | clarkb: looks like wiki | 20:56 |
| nibalizer | modules/openstack_project/manifests/wiki.pp: class { 'memcached': | 20:56 |
| *** tonytan4ever has quit IRC | 20:56 | |
| *** luqas has joined #openstack-infra | 20:57 | |
| nibalizer | clarkb: do ping me if there is ways i can help | 20:57 |
| clarkb | nibalizer: thanks, I am making a list of toplevel devs now and checking the versions against what we have on the master | 20:58 |
| nibalizer | cool | 20:58 |
| *** jpeeler has quit IRC | 20:59 | |
| *** jpeeler has joined #openstack-infra | 20:59 | |
| *** jpeeler has quit IRC | 20:59 | |
| *** jpeeler has joined #openstack-infra | 20:59 | |
| *** sdake has quit IRC | 20:59 | |
| jeblair | status notice Gerrit will be unavailable between 22:00 and 23:59 UTC for project renames and a database update. | 21:00 |
| jeblair | fungi: ^ ? | 21:00 |
| *** armax has quit IRC | 21:01 | |
| *** luqas has quit IRC | 21:01 | |
| *** esker has quit IRC | 21:02 | |
| *** bcourt has quit IRC | 21:03 | |
| jeblair | #status notice Gerrit will be unavailable between 22:00 and 23:59 UTC for project renames and a database update. | 21:03 |
| openstackstatus | jeblair: sending notice | 21:03 |
| fungi | jeblair: lgtm | 21:03 |
| jeblair | whew | 21:03 |
| jeblair | i think there's some lag at play | 21:03 |
| fungi | just finishing up the details for the maintenance plan now | 21:04 |
| *** hdd has quit IRC | 21:04 | |
| -openstackstatus- NOTICE: Gerrit will be unavailable between 22:00 and 23:59 UTC for project renames and a database update. | 21:04 | |
| *** avozza is now known as zz_avozza | 21:04 | |
| fungi | though additional reviews of https://review.openstack.org/#/q/status:open+topic:project-rename,n,z over the next half hour or so would be good so we can adjust plans accordingly if something's amiss with any of them | 21:05 |
| *** peristeri has quit IRC | 21:05 | |
| openstackgerrit | Swaminathan Vasudevan proposed openstack-infra/devstack-gate: DVR Multinode test patch to separate ctlr and compute https://review.openstack.org/175056 | 21:05 |
| openstackstatus | jeblair: finished sending notice | 21:05 |
| fungi | i plan to go back through them all shortly, and then try merging them locally to check for conflicts | 21:05 |
| *** Krinkle|detached is now known as Krinkle | 21:06 | |
| *** mriedem has quit IRC | 21:07 | |
| jeblair | fungi: on it | 21:08 |
| jeblair | you'd think i woulda done that when i was copying the project names out of them into the announcement :) | 21:08 |
| *** tonytan4ever has joined #openstack-infra | 21:09 | |
| jeblair | fungi: i'd actually just recommend going ahead and stacking them in new patchsets | 21:11 |
| jeblair | fungi: that way we avoid the risk of octomerge | 21:11 |
| jeblair | (which is a terryfying multi-headed beast) | 21:11 |
| fungi | fair point | 21:11 |
| fungi | i'll do that close to the maintenance so that we don't risk approving anything else ahead of them | 21:11 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Enable parameter ordering in trigger_parameterized_builds https://review.openstack.org/175049 | 21:12 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Support use of lists in trigger-build publisher. https://review.openstack.org/150598 | 21:12 |
| dtroyer | do we have any jobs that do testing in other languages? ie, C or Go or something that needs compiler support? I'm looking for a cargo-cult to join… | 21:12 |
| fungi | dtroyer: how about a support group instead? ;) | 21:13 |
| fungi | dtroyer: there is some java | 21:13 |
| jeblair | dtroyer: java. ish. | 21:13 |
| jeblair | i mean, we turned the tests off. but that's actually a minor incidental detail. :) | 21:13 |
| fungi | well, we do have gerrit tests enabled now i believe (or has that patch merged yet?) | 21:13 |
| jeblair | fungi: oh, we're re-enabling them? cool. | 21:14 |
| fungi | i know i reviewed it very recently and it seemed to dtrt according to the log | 21:14 |
| fungi | including actually passing ;) | 21:14 |
| dtroyer | My goal is to get some useful tests in stackforge/golang-client | 21:14 |
| dtroyer | if there's examples or precedent I'm all ears | 21:14 |
| jeblair | dtroyer: basically, you've got a test node with root on it, so you can install whatever you need. | 21:14 |
| dtroyer | otherwise I'll need to work it out | 21:15 |
| fungi | dtroyer: jobs run shell commands. if your stuff happens via shell commands, there's not much to it | 21:15 |
| jeblair | dtroyer: if you can do that with jenkins-job-builder macros in project-config, that makes it easier for other folks to set up a 'go' env in the same way | 21:15 |
| fungi | shell commands and sane exit codes | 21:15 |
| *** ldnunes has quit IRC | 21:15 | |
| *** tiswanso has quit IRC | 21:15 | |
| dtroyer | ok, cool. and if I'm only pulling in distro stuff there shouldn't be any network-related hiccups | 21:15 |
| fungi | basically the two requirements | 21:15 |
| jeblair | dtroyer: yeah, it'll come from the cloud provider mirrors which are _generally_ okay :) | 21:16 |
| dtroyer | alright, thanks | 21:16 |
| zaro | waynr: https://review.openstack.org/#/c/175049/ failed tests? | 21:16 |
| jeblair | dtroyer: fungi is working on bindep which will let you express what you need in a way that we can pre-cache on nodes like devstack. and maybe just say "install the bindep requirements for this repo" at the start of the job | 21:16 |
| jeblair | fungi: but you're probably not quite ready for dtroyer to start using bindep for this, right? | 21:17 |
| dtroyer | I want to see how close to the automated golang testing setup I can get, they're using docker now but I was thinking that might be v2.0 | 21:18 |
| fungi | jeblair: dtroyer: er, it's very close. we could add it as a guinea pig | 21:18 |
| fungi | it's basically ready for me to tag a 1.0.0 release so it gets to pypi | 21:18 |
| *** pc_m has quit IRC | 21:18 | |
| jeblair | fungi: oh cool, well, i think that'd be ideal if dtroyer is game | 21:19 |
| dtroyer | I'm good with trying that…ping me when youre ready to try it | 21:19 |
| fungi | and whip up the changes to our nodepool scripts to preinstall it onto our images and work it into the package caching we're currently doing | 21:19 |
| fungi | but otherwise it's in good shape now i think | 21:19 |
| * jeblair is excited | 21:19 | |
| fungi | me too. if other stuff would just stop breaking i'd have fewer excuses to not have finished it already | 21:20 |
| *** shardy has quit IRC | 21:20 | |
| * dtroyer puts away secret hammer | 21:20 | |
| fungi | muahahahaha | 21:20 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Install all puppet modules from source https://review.openstack.org/141182 | 21:20 |
| clarkb | nibalizer: fungi jeblair ^ that should be correct as of our current module set | 21:21 |
| jeblair | if any projects have voting rally jobs, they may be disrupted for a while after the maint while jjb updates those defs | 21:21 |
| fungi | yep | 21:22 |
| fungi | boris-42: ^ happen to have a list of who those are handy? | 21:22 |
| jeblair | clarkb: oh, did that bitrot? | 21:22 |
| jeblair | (i was like -- i thought we already did that, but i see the last thing is i +2d 2 months ago) | 21:22 |
| *** hashar has quit IRC | 21:22 | |
| clarkb | ya it bitrotted, we have added a few more modules and a couple versions changed in places | 21:23 |
| *** openstackgerrit has quit IRC | 21:23 | |
| clarkb | but the broken puppetdb update prompted me to resurrect that change | 21:23 |
| jeblair | +2 | 21:23 |
| *** openstackgerrit has joined #openstack-infra | 21:23 | |
| clarkb | danke | 21:23 |
| jeblair | imapsync has 50 messages left! | 21:23 |
| fungi | jeblair: you're almost a real person again | 21:24 |
| fungi | with real e-mail and everything | 21:24 |
| clarkb | my lunch has arrived, back shortly to participate in gerrit things | 21:24 |
| boris-42 | fungi: hi | 21:24 |
| clarkb | do we have an etherpad handy yet? | 21:24 |
| boris-42 | fungi: there is no voting rally jobs | 21:25 |
| boris-42 | fungi: as far as I know | 21:25 |
| jeblair | yaaay it's done! | 21:25 |
| fungi | clarkb: https://etherpad.openstack.org/p/repo-renaming-2015-04-17 but i'm still fleshing out steps 12 and later | 21:25 |
| *** sdake has joined #openstack-infra | 21:25 | |
| fungi | boris-42: okay, thanks | 21:25 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: (hipchat) Accept list of hipchat rooms. https://review.openstack.org/153831 | 21:25 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Add support for hipchat notifier 0.1.8 https://review.openstack.org/135843 | 21:25 |
| *** dkranz has joined #openstack-infra | 21:26 | |
| *** stevemar has quit IRC | 21:29 | |
| *** sdake_ has quit IRC | 21:29 | |
| *** erlon has quit IRC | 21:31 | |
| *** emagana has quit IRC | 21:33 | |
| *** annegentle has joined #openstack-infra | 21:34 | |
| *** dangers is now known as dangers_away | 21:34 | |
| zaro | waynr: gave you some feeback on 175049 | 21:35 |
| fungi | okay, that etherpad is ready for review now too | 21:35 |
| clarkb | and I have finished eating way too fast | 21:36 |
| clarkb | fungi: I don't see the db encoding conversion in there? | 21:37 |
| openstackgerrit | Gary W. Smith proposed openstack-infra/project-config: Add manila-ui to OpenStack https://review.openstack.org/175063 | 21:37 |
| * clarkb reviews rename changes now | 21:37 | |
| fungi | clarkb: oh, great point | 21:37 |
| fungi | zaro: what was the etherpad you had the conversion steps in again? | 21:37 |
| fungi | i'll copy those steps into here | 21:37 |
| zaro | https://etherpad.openstack.org/p/gerrit-migration-utf8 | 21:38 |
| fungi | thanks! | 21:38 |
| zaro | didn't know we started already, thought it was in 1/2 hour | 21:38 |
| fungi | zaro: we're still preparing and making sure everything's ready to go on time | 21:38 |
| zaro | ahh, cool | 21:38 |
| clarkb | boris-42: doesn't look like you are moving rallyclient too? | 21:38 |
| pleia2 | I'll review some more changes in a moment, chrome is being a bit weird on me | 21:39 |
| * clarkb figures out if rallyclient is a thing | 21:39 | |
| boris-42 | clarkb: nope | 21:39 |
| clarkb | http://git.openstack.org/cgit/stackforge/python-rallyclient/tree/ | 21:39 |
| clarkb | boris-42: what is ^ | 21:39 |
| boris-42 | clarkb: mistake=) | 21:40 |
| clarkb | boris-42: should that go to the attic? | 21:40 |
| boris-42 | clarkb: yep it can | 21:40 |
| clarkb | we don't have to do it today, just want to make sure I understand what it is | 21:40 |
| clarkb | ok | 21:40 |
| boris-42 | clarkb: yep some day we can move it to attic | 21:40 |
| *** emagana has joined #openstack-infra | 21:41 | |
| *** ArxCruz has joined #openstack-infra | 21:41 | |
| fungi | hrm, worth discussing, do we want to do renames first and then the database conversion, or the other way around? i'm thinking do the renames first, that way if we have to back out the encoding change by restoring the unmodified db dump we create, it's still got the renaming taken care of (rather than needing to break in between them to test the encoding behaviors) | 21:41 |
| jeblair | fungi: ++ | 21:41 |
| nibalizer | clarkb: ill check it out | 21:41 |
| clarkb | fungi: agreed | 21:41 |
| *** emagana has quit IRC | 21:41 | |
| fungi | okay, i'll work in the encoding change to happen after rename-related database modifications | 21:42 |
| *** emagana has joined #openstack-infra | 21:42 | |
| clarkb | arosen: same question for you and moving congress to openstack/ https://git.openstack.org/cgit/stackforge/python-congressclient/tree/ should that move too? | 21:43 |
| clarkb | oh it does but the acl doesn't move /me investigates more | 21:43 |
| clarkb | ah its a sahred acl | 21:43 |
| *** bknudson has quit IRC | 21:44 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add design for an object interface https://review.openstack.org/164506 | 21:44 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add skeleton for an object interface https://review.openstack.org/175064 | 21:44 |
| jeblair | mordred: will you be around for the maintenance in case we have any mysql questions? | 21:45 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Enable parameter ordering in trigger_parameterized_builds https://review.openstack.org/175049 | 21:45 |
| clarkb | arosen: ignore me, your change looks great :) | 21:45 |
| mordred | jeblair: I unfortunately need to afk in 30 minutes | 21:46 |
| mordred | jeblair: so, I'll be here for the first bit | 21:46 |
| jeblair | bummer | 21:46 |
| *** armax has joined #openstack-infra | 21:47 | |
| pleia2 | my internet connection is really lousy this afternoon, I don't think I'll be able to help this time around | 21:48 |
| clarkb | fungi: the murano rename and rally rename may conflict on the rally.yaml file | 21:48 |
| jeblair | pleia2: i thought you had two? | 21:48 |
| *** jamielennox|away is now known as jamielennox | 21:48 | |
| clarkb | fungi: they both modify within one line of each other | 21:48 |
| fungi | zaro: so the last 4 lines of section 5 at https://etherpad.openstack.org/p/repo-renaming-2015-04-17 look right? | 21:49 |
| fungi | clarkb: yep, i'm getting ready to stack up those changes now anyway | 21:49 |
| pleia2 | jeblair: I do, the other one is doing an initial sync of some offsite backups | 21:49 |
| pleia2 | so it's slooow | 21:49 |
| fungi | jeblair suggested avoiding a gerrit multi-way merge if possible, and i agree it's a sane choice | 21:49 |
| *** markvoelker has joined #openstack-infra | 21:49 | |
| clarkb | fungi: and https://review.openstack.org/#/c/168531/ is unrelated correct? can I change the topic? | 21:50 |
| fungi | clarkb: you can. it's still outstanding from the last maintenance | 21:50 |
| fungi | its core review team is... somewhat slow | 21:50 |
| clarkb | topic changed | 21:50 |
| *** markvoelker_ has joined #openstack-infra | 21:50 | |
| clarkb | note https://review.openstack.org/#/c/173619/ is not merged yet and the saml2 rename depends on it | 21:50 |
| clarkb | so we won't get that in until either we remove the dep or the governance change is merged | 21:51 |
| zaro | fungi: only need to execute convert because that will do the backup as well | 21:51 |
| *** serg_melikyan has joined #openstack-infra | 21:51 | |
| fungi | clarkb: i'm in favor of enacting jeblair's workflow change from 173465 | 21:52 |
| fungi | zaro: oh, thanks! | 21:52 |
| fungi | i see that now | 21:52 |
| clarkb | fungi: fine by me particularly in this case as its a simple renmae of a project not adding anything new | 21:53 |
| fungi | clarkb: er, 173485 really, though i guess it depends on 173465 | 21:53 |
| clarkb | fungi: when you rebaes you will want to remove the depends on | 21:53 |
| *** Krinkle is now known as Krinkle|detached | 21:53 | |
| fungi | yep | 21:53 |
| pleia2 | https://review.openstack.org/#/c/169530/4/zuul/layout.yaml running stackforge-specs-jobs | 21:53 |
| pleia2 | I -1ed, but if it can be fixed afterwards maybe we just let it go | 21:54 |
| clarkb | fungi: other than that the stack lgtm | 21:54 |
| *** gordc has quit IRC | 21:54 | |
| *** otter768 has joined #openstack-infra | 21:54 | |
| clarkb | pleia2: it should work it will just run the jobs in that template | 21:54 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Add support for hipchat notifier 0.1.8 https://review.openstack.org/135843 | 21:54 |
| *** markvoelker has quit IRC | 21:54 | |
| clarkb | pleia2: but it should be fixed at some point. If arosen is around to fix now that would be great | 21:54 |
| fungi | i've added the utf-8 client config patch to step 14 if people could review that too https://review.openstack.org/164264 | 21:55 |
| jeblair | mordred: ^ if you have time | 21:56 |
| *** hdd has joined #openstack-infra | 21:56 | |
| mordred | looking | 21:56 |
| clarkb | 164264 is just changing how we connect to the db right? not changing the encoding in the db | 21:57 |
| jeblair | clarkb: and only for running "mysql" from the command line | 21:57 |
| clarkb | does that mean the encoding in the db is correct? I haven't been able to keep up with that | 21:57 |
| fungi | specifically changing how people manually invoking the client connect to the db | 21:57 |
| mordred | jeblair: +2 - I held off on +A | 21:58 |
| fungi | clarkb: i need to add steps to do the trove config switch and instance restart--thanks for the reminder | 21:58 |
| *** markvoelker_ has quit IRC | 21:58 | |
| * clarkb checks what override_options does | 21:58 | |
| zaro | fungi: also you should not need to execute convert-to-utf8.sh with the gerrit2 account, run with sudo should work. | 21:58 |
| clarkb | zaro: there is no override options at https://github.com/puppetlabs/puppetlabs-mysql/blob/0.6.1/manifests/server.pp | 21:59 |
| clarkb | I have -1'd for ^ | 21:59 |
| zaro | fungi: also i think i see why re-index complains complains about missing projects, there's some references in changes table that point to old projects. | 22:00 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Rename keystoneclient-federation to saml2 https://review.openstack.org/173634 | 22:00 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Rename stackforge/murano to openstack/murano https://review.openstack.org/167934 | 22:00 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Move Rally to OpenStack https://review.openstack.org/172701 | 22:00 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Remove the tuskar-ui-extras repository from Stackforge https://review.openstack.org/169715 | 22:00 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Move congress projects from stackforge to openstack https://review.openstack.org/169530 | 22:00 |
| clarkb | zaro: what is the intent of the override options setting there? | 22:01 |
| pleia2 | connection seems to have recovered some | 22:01 |
| zaro | clarkb: ohh i must have been looking at the latest docs. | 22:01 |
| fungi | okay, that's the new stack. please particularly check https://review.openstack.org/167934 murano.yaml and rally.yaml where i resolved merge conflicts | 22:01 |
| zaro | clarkb: it's to allow you to override default settings. | 22:01 |
| clarkb | zaro: it won't affect us because we use trove, but that will break anyone using our puppet module install script along with the gerrit module | 22:01 |
| clarkb | so maybe the thing to do is split that out of this change and figure it out in a separate chnage | 22:02 |
| zaro | clarkb: ++ | 22:02 |
| serg_melikyan | fungi: I've checked everything looks right | 22:02 |
| fungi | thanks serg_melikyan! | 22:03 |
| jeblair | #status notice Gerrit is unavailable until 23:59 UTC for project renames and a database update. | 22:03 |
| openstackstatus | jeblair: sending notice | 22:03 |
| jeblair | er, when that's done i'll make it an alert | 22:04 |
| -openstackstatus- NOTICE: Gerrit is unavailable until 23:59 UTC for project renames and a database update. | 22:04 | |
| zaro | clarkb: i'll fix up, but here's the reference: https://forge.puppetlabs.com/puppetlabs/mysql#beginning-with-mysql | 22:04 |
| *** Swami has quit IRC | 22:04 | |
| openstackstatus | jeblair: finished sending notice | 22:05 |
| jeblair | #status alert Gerrit is unavailable until 23:59 UTC for project renames and a database update. | 22:05 |
| openstackstatus | jeblair: sending alert | 22:05 |
| clarkb | zaro: I see maybe we can just update https://review.openstack.org/#/c/164264/11/manifests/mysql.pp line 30 instead | 22:06 |
| fungi | okay, i added the trove config changes into step #5 | 22:06 |
| *** annegentle has quit IRC | 22:06 | |
| zaro | clarkb: yep. | 22:07 |
| -openstackstatus- NOTICE: Gerrit is unavailable until 23:59 UTC for project renames and a database update. | 22:07 | |
| *** ChanServ changes topic to "Gerrit is unavailable until 23:59 UTC for project renames and a database update." | 22:07 | |
| clarkb | fungi: looks good based on what I know | 22:07 |
| fungi | thanks | 22:08 |
| fungi | i'm in place and ready on review.o.o once zuul is stopped | 22:08 |
| clarkb | the implicit backup bugs me a bit, I like to see that be explicit but I will live | 22:08 |
| jeblair | fungi: puppetmaster has been made safe | 22:08 |
| jeblair | i will shut down zuul now | 22:08 |
| fungi | thanks | 22:08 |
| clarkb | I am ready to help wherever I can, just let me know | 22:08 |
| jeblair | fungi, clarkb: oh, one thing | 22:09 |
| fungi | ? | 22:09 |
| jeblair | i think we have not installed a new gerrit war with my change? | 22:09 |
| fungi | oh, we probably should | 22:09 |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Make mysql clients assume utf8 character encoding https://review.openstack.org/164264 | 22:09 |
| fungi | do we need an updated puppet change to switch the warfile name? | 22:09 |
| openstackstatus | jeblair: finished sending alert | 22:09 |
| * clarkb grabs repo moves/renames | 22:09 | |
| jeblair | fungi: yeah. maybe let's just do that later. | 22:10 |
| zaro | clarkb: fixed up that change. | 22:10 |
| fungi | okie dokie. we can always do a quick gerrit restart when someone' | 22:10 |
| fungi | s around over the weekend | 22:10 |
| *** MaxV has quit IRC | 22:10 | |
| jeblair | fungi: zuul is stopped, clear to stop gerrit | 22:10 |
| fungi | on it | 22:10 |
| *** MaxV has joined #openstack-infra | 22:10 | |
| * zaro pushed just in time | 22:11 | |
| fungi | it's down. working on the database now | 22:11 |
| clarkb | moving repos on the mirrors now | 22:12 |
| fungi | i've finished the rename-related changes and am working on the encoding changes now | 22:13 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 22:13 | |
| *** andreykurilin___ has quit IRC | 22:13 | |
| jeblair | okay, i wrote the puppet change to upgrade gerrit | 22:14 |
| clarkb | git01-05 are done | 22:14 |
| clarkb | doing github now | 22:15 |
| *** MaxV has quit IRC | 22:15 | |
| *** hdd has quit IRC | 22:15 | |
| waynr | D: | 22:16 |
| zaro | jeblair: upgrade?? is that for later? | 22:17 |
| fungi | zaro: to upgrade the production gerrit to include his debugging patch for stream-events | 22:17 |
| *** soren has joined #openstack-infra | 22:17 | |
| zaro | ahh, ok. | 22:18 |
| fungi | in hopes of having it running the next time they hang | 22:18 |
| *** jgrimm is now known as zz_jgrimm | 22:20 | |
| fungi | i went ahead and did the filesystem updates while waiting on the database reencoding to finish | 22:20 |
| waynr | jeblair: just curious, was there any kind of prior notice for the gerrit downtime? like on a mailing list that i can subscribe to for future reference | 22:20 |
| fungi | waynr: http://lists.openstack.org/pipermail/openstack-dev/2015-April/061489.html | 22:20 |
| waynr | thanks fungi! | 22:21 |
| fungi | waynr: same message was also sent to openstack-infra for people not subscribing to openstack-dev | 22:21 |
| waynr | cool, i'll subscribe to both | 22:21 |
| *** sdake_ has joined #openstack-infra | 22:24 | |
| *** soren has quit IRC | 22:24 | |
| fungi | the database dump has been converted and it's been reapplying that to the db server for a few minutes now. not sure exactly how long to expect it to take but it's a 2.1gb dump (uncompressed) | 22:24 |
| *** otter768 has quit IRC | 22:24 | |
| zaro | is it doing the import now? | 22:25 |
| clarkb | github is done | 22:26 |
| fungi | yeah, i have to assume it's nearly finished | 22:26 |
| *** sdake has quit IRC | 22:27 | |
| zaro | fungi: as i recall testing with prod data it took quite some time, maybe 40 mins? | 22:28 |
| jeblair | i think it's safe to do step 16, the ansible workspace cleaning. i'll do that now. | 22:28 |
| fungi | jeblair: yep, should be | 22:28 |
| *** Sukhdev has quit IRC | 22:28 | |
| fungi | zaro: okay, thanks. hopefully it will be faster. the backup and conversion only took a few minutes | 22:28 |
| *** stevelle has joined #openstack-infra | 22:28 | |
| fungi | ah! it's moved on to table conversions now | 22:28 |
| zaro | ohh ok that's much faster than i expected! | 22:29 |
| cloudnull | hi infra. https://review.openstack.org/ seems to be 503'ing. known issue? | 22:29 |
| zaro | musta got lots O memory on that machine. | 22:29 |
| jeblair | cloudnull: see topic and http://lists.openstack.org/pipermail/openstack-dev/2015-April/061489.html | 22:30 |
| zaro | cloudnull: gerrit downtime for maintenance | 22:30 |
| *** bswartz has joined #openstack-infra | 22:30 | |
| * cloudnull goes and reads. | 22:30 | |
| cloudnull | thanks jeblair zaro | 22:30 |
| clarkb | I should convert the git0X moves to a set of ansible commands | 22:31 |
| clarkb | also the review.o.o moves | 22:31 |
| jeblair | really the whole thing :) | 22:31 |
| clarkb | that should be a good place to start the ansiblification of the whole thing | 22:31 |
| zaro | fungi: should be done now, yeah? | 22:31 |
| clarkb | ya but you have to start somewhere | 22:31 |
| jeblair | clarkb: agreed. the mysql part sounds harder :) | 22:31 |
| fungi | zaro: it's converting the change_messages table | 22:31 |
| clarkb | https://github.com/isaacs/github/issues/117 also that may present trouble | 22:33 |
| clarkb | trying to find out if the api exposes that | 22:33 |
| fungi | okay, it just finished | 22:36 |
| *** otter768 has joined #openstack-infra | 22:36 | |
| fungi | lucene reindex going now | 22:36 |
| *** annegentle has joined #openstack-infra | 22:38 | |
| *** dboik_ has quit IRC | 22:41 | |
| *** davideagnello has joined #openstack-infra | 22:41 | |
| *** dboik has joined #openstack-infra | 22:41 | |
| clarkb | you can rename within an org, but I still find no way to transfer ownership via the api | 22:42 |
| *** ArxCruz has quit IRC | 22:42 | |
| jeblair | clarkb: so we could either not transfer (delete/add), or just do the next 400 by hand and never do another one again | 22:43 |
| clarkb | jeblair: ya | 22:43 |
| clarkb | its not the end of the world, just curious to see what we can actually do with the github api | 22:43 |
| greghaynes | Since its just a mirror is there any downside to just git clone; create; git push to new location? | 22:44 |
| greghaynes | oh, delete/add | 22:44 |
| greghaynes | I bet thats what that means ;) | 22:44 |
| *** rlandy has quit IRC | 22:44 | |
| jeblair | greghaynes: yeah. transfer creates internal redirects on github's side. | 22:44 |
| clarkb | greghaynes: github sets up redirects when you transfer. and when we don't transfer people say "why didn't you transfer?" but thats about it | 22:44 |
| jeblair | meh. | 22:45 |
| greghaynes | ah | 22:45 |
| clarkb | we did use add delete | 22:45 |
| clarkb | er | 22:45 |
| clarkb | delete add :) | 22:45 |
| jeblair | clarkb: yeah, they say that for a day or two and then they stop saying it. :) | 22:45 |
| clarkb | fungi: how is the indexing going? | 22:45 |
| fungi | almost there | 22:45 |
| jeblair | anyway, all just goes to show that encoding the software development lifecycle into the name of your git repository is, er, not a sustainable best practice. :) | 22:46 |
| clarkb | ++ | 22:46 |
| fungi | okay, lucene reindex done! now we should be able to start gerrit again | 22:46 |
| fungi | anything else we need to worry about before i start it? | 22:46 |
| *** sdake has joined #openstack-infra | 22:46 | |
| jeblair | fungi: not that i can think of | 22:47 |
| clarkb | I have nothing | 22:47 |
| fungi | it's on its way up now | 22:47 |
| clarkb | jeblair: we probably want ot wait on starting zuul to check that gerrit is happy with new db first | 22:47 |
| clarkb | ? | 22:47 |
| jeblair | clarkb: agreed | 22:47 |
| jeblair | anyone have a test change handy we can poke at utf8 stuff? | 22:47 |
| zaro | may time a little time to start. | 22:48 |
| jeblair | zaro: it's been up for a couple minutes; i'm already logged in | 22:48 |
| fungi | i was going to leave a comment, appropriately, on https://review.openstack.org/164264 | 22:49 |
| clarkb | https://review.openstack.org/#/c/174632/ my comment there | 22:49 |
| *** annegentle has quit IRC | 22:49 | |
| clarkb | I see snowmen | 22:49 |
| fungi | seems to have worked for me | 22:49 |
| zaro | yay! | 22:49 |
| jeblair | well, that's what this was all about, right? :) | 22:50 |
| fungi | graffiti time! | 22:50 |
| clarkb | we should see if old comments render properly | 22:50 |
| *** doug-fish has left #openstack-infra | 22:50 | |
| * clarkb looks up the change from that ml thread | 22:50 | |
| *** sdake_ has quit IRC | 22:50 | |
| fungi | they'll just be ?????? | 22:50 |
| fungi | it was doing lossy substitution when it stored them | 22:50 |
| jeblair | yeah, i think fungi is right | 22:50 |
| clarkb | oh thats too bad | 22:50 |
| jeblair | start zuul? | 22:50 |
| clarkb | and yes confirmed https://review.openstack.org/#/c/162045/ | 22:51 |
| fungi | so there's nothing for it to decode. it's ascii question marks in the database | 22:51 |
| *** Sukhdev has joined #openstack-infra | 22:51 | |
| fungi | have at it | 22:51 |
| clarkb | right the client was ocnverting because it was talking not utf8 | 22:51 |
| jeblair | fungi, clarkb: look on the bright side -- at least it's still ???s. :) | 22:51 |
| clarkb | I am ready for zuul to start | 22:51 |
| fungi | heh | 22:51 |
| jeblair | we could have turned everything into snowmen | 22:51 |
| jeblair | reloading queue | 22:52 |
| clarkb | jeblair: we really should've | 22:52 |
| clarkb | jeblair: maybe we do that next winter | 22:52 |
| jeblair | haha | 22:52 |
| jeblair | ETOOCOLD | 22:53 |
| fungi | let me know when i should approve changes | 22:53 |
| fungi | now? | 22:53 |
| jeblair | fungi: ready now. | 22:53 |
| fungi | i guess they get to fight the queue | 22:53 |
| jeblair | oh, sorry about that. | 22:53 |
| jeblair | i don't think they'll wait for long. | 22:53 |
| *** achanda has quit IRC | 22:54 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Update production gerrit to 2.8.4.19 https://review.openstack.org/175068 | 22:54 |
| fungi | yeah, things weren't terribly busy when we started, so should be reasonably quick | 22:55 |
| *** aysyd has quit IRC | 22:56 | |
| clarkb | jeblair: we want to do 175068 real quick and restart again? | 22:56 |
| *** achanda has joined #openstack-infra | 22:56 | |
| fungi | probably better to let it settle and then restart again quick tomorrow or something | 22:56 |
| jeblair | yeah, let's do it tomorrow morning | 22:57 |
| fungi | or later tonight | 22:57 |
| jeblair | also, i'm pretty sure puppet does everything. | 22:57 |
| fungi | i'll be around most of tomorrow | 22:57 |
| jeblair | though since it also does a reindex, it's not fast. :/ | 22:57 |
| *** vilobhmm1 has joined #openstack-infra | 22:57 | |
| clarkb | oh right puppet should do it all | 22:58 |
| vilobhmm1 | does this bug still makes sense since now magnum are part of openstack namespace https://bugs.launchpad.net/magnum/+bug/1419766 ? | 22:58 |
| openstack | Launchpad bug 1419766 in Magnum "Magnum is already taken by someone else in pypi" [Wishlist,Triaged] | 22:58 |
| clarkb | wfm to do it tomorrow, I too will likely be around | 22:58 |
| zaro | puppet does it all on review-dev last i tried | 22:59 |
| sdake | not being a pypi expert, I'm not sure what the best answer is vilobhmm1 | 22:59 |
| clarkb | vilobhmm1: well you will need tofigure out a name you can publish too | 22:59 |
| sdake | I suspect someone in here will know | 22:59 |
| fungi | vilobhmm1: yeah, unless you can convince the current maintainer of https://pypi.python.org/pypi/magnum to give it up, your options are to rename your project or publish it under a different name on pypi | 22:59 |
| morganfainberg | fungi, yay renamed repo! | 23:00 |
| morganfainberg | :) | 23:00 |
| sdake | I never liked that name magnum anyway ;-) | 23:00 |
| fungi | morganfainberg: well, not completely renamed yet. we've still got config changes in flight which need to get applied | 23:00 |
| morganfainberg | eh, close enough... it's on it's way | 23:01 |
| clarkb | fungi: so we are ready to merge the projects.yaml and related update changes now? | 23:01 |
| clarkb | er thats what you were talking about earlier | 23:01 |
| fungi | gerrit's at least running again, and supports utf-8 comments now! (thanks zaro and pelix!) | 23:01 |
| sdake | uploaded 2012 | 23:01 |
| vilobhmm1 | ok…so nothing needs to be done as of now as the name will eventually change from magnum->openstack_containers ? | 23:02 |
| fungi | clarkb: yeah, they're approved, just waiting | 23:02 |
| *** dboik has quit IRC | 23:02 | |
| vilobhmm1 | with these config changes is what you mean ? | 23:02 |
| clarkb | vilobhmm1: I wouldn't expect it to be renamed openstack_containers | 23:02 |
| clarkb | but you can publish to a different name on pypi | 23:02 |
| jeblair | #status ok Gerrit is available again. | 23:03 |
| openstackstatus | jeblair: sending ok | 23:03 |
| openstackgerrit | Merged openstack-infra/project-config: Drop neutron-pg in favor of a voting neutron-pg-full https://review.openstack.org/168478 | 23:03 |
| fungi | vilobhmm1: no, your project name has not changed. your repositories have moved from the stackforge namespace to the openstack namespace, but that's all (e.g. stackforge/magnum became openstack/magnum) | 23:03 |
| jeblair | (i kind of think the name of the git repo should be the name of the thing published on pypi) | 23:03 |
| clarkb | jeblair: that is definitely ideal | 23:04 |
| fungi | i agree. we have some unusual exceptions to that, but generally should avoid a mismatch | 23:04 |
| openstackgerrit | Merged openstack-infra/project-config: Move neutron-pg-full to periodic https://review.openstack.org/168486 | 23:04 |
| clarkb | I'm just not a fan of unnecessary renames. It isn't hard on just gerrit, it is hard on anyone that may have cloned or installed your software previously | 23:04 |
| *** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/manual/ http://ci.openstack.org/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/" | 23:04 | |
| -openstackstatus- NOTICE: Gerrit is available again. | 23:04 | |
| jeblair | clarkb: i agree. we should probably build a check into the creation process to catch this. | 23:05 |
| morganfainberg | fungi, so out of curiosity is the infra slides (e.g. http://docs.openstack.org/infra/publications/2014-lca-overview/#(1) ) a pattern that makes sense for other projects? e.g. if keystone had set of publications (outside of the sphinx docs) on identity; or is this a rabbit hole/can of worms? (cc clarkb, jeblair, mordred ) - random thought. | 23:06 |
| fungi | ugh, we had some project-config changes already approved an in the queue apparently, so that stack of changes will all wind up as merge commits anyway | 23:06 |
| jeblair | fungi: double sorry :( | 23:06 |
| morganfainberg | feel free to ignore my question until you all have time / less headaches [i see you're busy] | 23:06 |
| openstackstatus | jeblair: finished sending ok | 23:07 |
| fungi | morganfainberg: it was an arbitrary choice. in retrospect we probably should have named it openstack-infra/infra-publications but name vaguery aside if it's a pattern you want to copy then feel free | 23:07 |
| jeblair | morganfainberg: only thing to keep in mind is that we have it set up as branch-per-publication. there's a bit of overhead to creating a new publication, and the model may not be for everyone. but of course you don't have to do it that way. | 23:07 |
| fungi | and if you come up with a better solution, we might copy yours instead ;) | 23:08 |
| pleia2 | ours are also text-based files in git, which are not what a lot of folks write slides in | 23:08 |
| jeblair | (i'm actually happy with branch-per-pub, but i came up with the idea so...) | 23:08 |
| morganfainberg | jeblair, i'll poke at what you've done but I'd like to see this happen for keystone. I would really enjoy official publications- and yes if we have something better (or think it might be easier) happy to discuss it | 23:08 |
| pleia2 | giant binary .odp/.ppt files would be a bit of a mess | 23:08 |
| morganfainberg | but branch-per-pub doesn't sound bad | 23:08 |
| fungi | righth, it may not work nearly so well for people writing slides in non-plaintext markup | 23:09 |
| *** MarkAtwood has quit IRC | 23:09 | |
| fungi | since that's a lot harder to code review | 23:09 |
| clarkb | jeblair: I like it too, also helps that you can git checkout -b origin/template my-talk and get going | 23:09 |
| jeblair | yeah, i thought it seemed reasonable because they are often completely unrelated. also, if you really want, you could set per-branch acls | 23:09 |
| morganfainberg | fungi, oh i expect that we would do [if anything] a "this needs to be converted to a sane format if it's an official publication" | 23:09 |
| morganfainberg | not just dumping PPTs in | 23:09 |
| morganfainberg | god no. | 23:09 |
| clarkb | er I got order on that wron | 23:09 |
| *** patrickeast has joined #openstack-infra | 23:10 | |
| morganfainberg | jeblair, yeah. | 23:10 |
| fungi | morganfainberg: but if your team settles on a presentation framework that takes plaintext markup with images/media included as separate files, then it could probably work well for you | 23:10 |
| fungi | being able to fork a presentation and then make incremental reviewable changes to it is extremely convenient | 23:10 |
| *** doude has quit IRC | 23:11 | |
| jeblair | morganfainberg: there's a job that generates http://docs.openstack.org/infra/publications/ automatically from the branches (current publications) and tags (previous publications) | 23:11 |
| morganfainberg | fungi, i don't care what people use for their personal presentations, but before it would go in a central repo i would require something [rst?] that could be reviewed. | 23:11 |
| *** achanda has quit IRC | 23:11 | |
| morganfainberg | fungi, and i do like the incremental change aspect. | 23:11 |
| *** ashleighfarnham has quit IRC | 23:11 | |
| morganfainberg | it's something i actually was thinking about when i was writing up the deck for the meetup I presented at | 23:11 |
| fungi | also it's convenient for us in that people newish to the team and to presenting at conferences can just grab one of those canned presentations, propose the abstract included with it, and then present it | 23:12 |
| jeblair | i'm a fan of rst -- you can generate slidy (what we mostly use), revealjs (mordred likes spinny things), or use it with presentty :) | 23:12 |
| morganfainberg | 1st: I don't want to do this from scratch again, 2nd: i like that infra has official publications, 3rd: it would help our users and deployers understand things w/o needing to dig through blogs etc. | 23:12 |
| nibalizer | wait i can generate my presentations? | 23:12 |
| morganfainberg | (#3 is "potentially") | 23:12 |
| serg_melikyan | folks, I got -1 from Jenkins https://review.openstack.org/167934 in gate-project-config-layout | 23:12 |
| nibalizer | i've been manually writing html things | 23:12 |
| fungi | nibalizer: i thought your presentations were already generated from random data sources | 23:13 |
| serg_melikyan | can't understand what is wrong there | 23:13 |
| jeblair | nibalizer: markov chains? :) | 23:13 |
| morganfainberg | jeblair, cool, i'll poke at what you guys have. i really really do like it. | 23:13 |
| *** ddieterly has quit IRC | 23:13 | |
| morganfainberg | jeblair, and i think it would be a win for [at least] us to have similar reference / not-boring-plain-docs about identity | 23:13 |
| nibalizer | heh, i mean i can write rst and it will generate slidy? then why do we store the slidy in git? | 23:13 |
| clarkb | serg_melikyan: http://logs.openstack.org/34/167934/10/check/gate-project-config-layout/9e20d06/console.html#_2015-04-17_23_05_45_466 one of the other changes involved seems to have broken it? | 23:13 |
| jeblair | nibalizer: i don't think we've done an RST -> slidy/reveal (maybe mordred has?). but pandoc can do it. i verified it when i wrote presentty | 23:13 |
| clarkb | fungi: ^ I am guessing that rebasing didn't go right there? | 23:13 |
| morganfainberg | jeblair, and not needing to say "sooo look for some blog jamielennox wrote some time about something" | 23:14 |
| *** sdake_ has joined #openstack-infra | 23:14 | |
| fungi | clarkb: possibly. i'm looking closer now | 23:14 |
| nibalizer | ahh okay | 23:15 |
| nibalizer | next time! | 23:15 |
| *** funzo has quit IRC | 23:15 | |
| jeblair | yeah, worth poking at | 23:15 |
| *** davideagnello has quit IRC | 23:15 | |
| clarkb | morganfainberg: for #3 it sounds like you need better documentation not a place to host presentations | 23:15 |
| *** achanda has joined #openstack-infra | 23:15 | |
| clarkb | morganfainberg: and imo that should go in the openstack docs and/or keystone docs | 23:16 |
| clarkb | because that is where people will go to look | 23:16 |
| morganfainberg | clarkb, nah it's things like "you could do X, Y, Z and here are examples of what has been done" not just the plain docs. | 23:16 |
| clarkb | morganfainberg: why shouldn't that go in the plain docs? | 23:16 |
| clarkb | morganfainberg: thats exactly where I would look for such things | 23:17 |
| morganfainberg | clarkb, difference between deployment specific choices and evaluations for these specific use-cases of benefit vs. the more raw "thing x is supported and this is how" | 23:17 |
| *** sdake has quit IRC | 23:17 | |
| fungi | Job gate-python-keystoneclient-federation-requirements not defined | 23:17 |
| clarkb | morganfainberg: for example https://docs.python.org/2/library/argparse.html and https://docs.python.org/2/howto/argparse.html#id1 | 23:17 |
| fungi | agreed, probably a rebase error. seeing if i can spot it | 23:17 |
| morganfainberg | clarkb, "I chose memcache to store tokens because in my environment I use memcache, and we did this thing etc" | 23:18 |
| clarkb | morganfainberg: yes I understand | 23:18 |
| clarkb | morganfainberg: there is no reason they cannot both be hosted under docs/keystone | 23:18 |
| morganfainberg | clarkb, or "here is a working example of WebSSO and steps i used in my environment | 23:18 |
| clarkb | morganfainberg: one would be docs/keystone/deployment_strategies the other docs/keystone/tutorials or whatever | 23:18 |
| morganfainberg | clarkb, sure. i see the publications as more white-paper / slides but i don't know if i'd put it in the keystone tree docs. | 23:19 |
| morganfainberg | clarkb, i'll talk it over with the team and i'll bring up your points too :) | 23:19 |
| morganfainberg | clarkb, it's worth mulling over before we do anything :) | 23:19 |
| clarkb | morganfainberg: so I have long tried to push openstack docs proper this direction fwiw | 23:19 |
| morganfainberg | clarkb, you know, i don't care where it coes come to thing of it. i care that we have a clear publication list we can link to. | 23:20 |
| morganfainberg | clarkb, so i'll think it all over and also disucss with the team :) | 23:20 |
| morganfainberg | clarkb, you did make me realize it was "official place for these things" not "something like what infra does" :) | 23:20 |
| * morganfainberg runs to the airplane. | 23:21 | |
| serg_melikyan | fungi: looks like I am late with my -1 :) You found not renamed line sooner in layout.yaml ) | 23:21 |
| morganfainberg | clarkb, thanks! | 23:21 |
| *** wenlock has quit IRC | 23:23 | |
| fungi | serg_melikyan: well, that's not the actual cause of the error. zuul ignores those if they don't match anything (though it will need to be corrected) | 23:23 |
| fungi | serg_melikyan: or if it is the cause of the issue then i'm not sure why the previous version passed before rebasing | 23:24 |
| fungi | the log, which hasn't posted to gerrit yet, is http://logs.openstack.org/34/173634/2/check/gate-project-config-layout/d6e462b/console.html | 23:24 |
| clarkb | fungi: the not defined should make the job fail | 23:25 |
| fungi | yeah, so why did it pass before? | 23:25 |
| clarkb | its saying that the job is in zuul layout but jenkins doesn't know about it | 23:25 |
| fungi | oh! i bet i know why | 23:25 |
| clarkb | fungi: because of the rebasing | 23:25 |
| clarkb | I think | 23:25 |
| serg_melikyan | https://review.openstack.org/173634 I don't +1 from jenkins after rebase | 23:25 |
| fungi | that probably was on the tip of master | 23:25 |
| fungi | and was newer than the original patch | 23:26 |
| clarkb | ya | 23:26 |
| fungi | okay, fixed stack on the way, re-rebased onto master | 23:26 |
| fungi | let's refrain from approving any more project-config changes until these land | 23:26 |
| clarkb | wfm | 23:26 |
| *** Swami has joined #openstack-infra | 23:28 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Rename keystoneclient-federation to saml2 https://review.openstack.org/173634 | 23:29 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Rename stackforge/murano to openstack/murano https://review.openstack.org/167934 | 23:29 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Move Rally to OpenStack https://review.openstack.org/172701 | 23:29 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Remove the tuskar-ui-extras repository from Stackforge https://review.openstack.org/169715 | 23:29 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Move congress projects from stackforge to openstack https://review.openstack.org/169530 | 23:29 |
| *** dboik has joined #openstack-infra | 23:29 | |
| fungi | that oughta do it now | 23:29 |
| clarkb | Swami: was is the intent with https://review.openstack.org/175056 ? | 23:29 |
| *** jamielennox is now known as jamielennox|away | 23:30 | |
| clarkb | Swami: we do not want to do that separation as many nova and neutron behaviors depend on having two compute hosts | 23:30 |
| clarkb | Swami: also I think the regular job isn't working so well currentkly | 23:30 |
| Swami | clarkb:ok got it. | 23:30 |
| clarkb | s/two compute hosts/more than one compute host/ | 23:31 |
| Swami | we are seeing some failures so I wanted to figure out what was causing those failures. | 23:31 |
| Swami | right now I don't think the neutron tests require more than one compute node. | 23:31 |
| clarkb | Swami: it is likely that having more than one compute makes things worse | 23:31 |
| clarkb | Swami: they do | 23:31 |
| Swami | clarkb: no it does not make things worse. we have our internal CI running with two or more compute hosts. | 23:32 |
| clarkb | Swami: we test things like live migration, shelve and unshelve, and others that have different behaviors with two compute hosts | 23:32 |
| Swami | I just want to figure out if having every VM instance in a single node, will make things better. | 23:32 |
| clarkb | Swami: we already test neutron with a single compute host so we really don't want to make the multinode job a single compute host | 23:32 |
| *** sdake has joined #openstack-infra | 23:32 | |
| clarkb | Swami: we know it will make things better, that is how we test normally | 23:32 |
| Swami | NO even though we have a single compute host, we do have a "network node". | 23:33 |
| Swami | So in our case we do have routers created on the network node and on the compute node. | 23:33 |
| clarkb | Swami: but in this case compute and network are colocated as on the single node test | 23:33 |
| Swami | So we will be basically testing the multinode scenarion irrespective of the number of compute nodes. | 23:33 |
| clarkb | Swami: we will not be testing the tests above | 23:33 |
| fungi | e.g. does live migration work with multi-node dvr? it's anybody's guess because we won't be testing that | 23:34 |
| Swami | but will the nova be scheduling the VMs on both the nodes. | 23:34 |
| clarkb | Swami: yes | 23:34 |
| clarkb | Swami: thats the point | 23:34 |
| Swami | clarkb: yes I understand that it would work, but I was having a chat with armax today and we decided to do some more testing and see if I can force all the compute to be in the same node and see how the tests fair. | 23:35 |
| clarkb | Swami: I think thats fine, I am just saying we should not merge that even if it makes things better. The purpose of this test is to have two compute nodes | 23:35 |
| Swami | clarkb: understood. I will not merge it. | 23:36 |
| Swami | this is just for my learning and debugging. | 23:36 |
| *** nikhil_k is now known as cpallares_ | 23:36 | |
| * armax scrolls up | 23:36 | |
| *** sdake_ has quit IRC | 23:36 | |
| armax | Swami: by the way I was looking here: | 23:36 |
| armax | http://logs.openstack.org/78/163178/10/experimental/check-tempest-dsvm-neutron-multinode-full/5c675b0/ | 23:36 |
| armax | Swami: it looks like we have a pass, I dug a bit deeper in the log and it seems like we’re landing VM’s across both compute hosts | 23:37 |
| fungi | looks like the layout jobs are passing on the new stack. one is in the gate pipeline now | 23:37 |
| clarkb | armax: Swami yes we are putting compute hosts on both nodes, we know this if live migration test passes | 23:38 |
| Swami | armax: that is good. that's what clarkb was also saying that it would schedule on both nodes. | 23:38 |
| clarkb | armax: Swami that is the specific intent of these tests | 23:38 |
| *** flaper87 has quit IRC | 23:38 | |
| armax | clarkb: true, but we had seem tests where we had massive failures | 23:39 |
| armax | clarkb: migration test included | 23:39 |
| clarkb | armax: yes, I think dvr is broken | 23:39 |
| clarkb | armax: now is the time to fix it before we release (if we can) | 23:39 |
| armax | clarkb: well, not entirely | 23:39 |
| clarkb | but fixing it doesn't involve "use one compute node" because in production there will be many compute nodes | 23:39 |
| armax | clarkb: that’s right, there’s no point to use one compute node permanently in the test | 23:40 |
| *** cpallares_ is now known as nikhil_k | 23:40 | |
| clarkb | if I had to guess what is breaking it is the arp stuff that makes vxlan work or ovs flows breaking | 23:41 |
| clarkb | the first one is easy to test by replacing vxlan with gre right? | 23:41 |
| clarkb | I have no idea how to debug ovs | 23:41 |
| armax | clarkb: we could switch DVR to using GRE | 23:41 |
| Swami | clarkb: no worries, for the dvr test failures, mostly we have seen issues just with the floatingIP not getting ready in time for the instances to test. | 23:42 |
| clarkb | armax: its just a hunch but the replace arp with service to keep arp tables populated seems like a culprit for connection failures | 23:42 |
| fungi | especially if that process gets resource-starved and lags | 23:42 |
| armax | clarkb: just to be clear, the migration test does not validate networking | 23:44 |
| clarkb | armax: it does | 23:44 |
| armax | clarkb: this one? https://github.com/openstack/tempest/blob/master/tempest/api/compute/admin/test_live_migration.py | 23:44 |
| openstackgerrit | Merged openstack-infra/project-config: Rename keystoneclient-federation to saml2 https://review.openstack.org/173634 | 23:45 |
| *** ajmiller has quit IRC | 23:45 | |
| clarkb | armax: I think so? maybe its a scenario test. But it does a libvirt migration which requires two hosts (libvirt won't migrate to itself) and libvirt requires working networking | 23:45 |
| armax | clarkb: I am not the most expert in Tempest tests, but all I could see are API tests and Scenario tetss | 23:46 |
| *** stevelle has quit IRC | 23:46 | |
| armax | clarkb: scenario tests that I am aware of do not test migration | 23:46 |
| *** stevelle has joined #openstack-infra | 23:46 | |
| clarkb | tempest.api.compute.admin.test_live_migration.LiveBlockMigrationTestJSON.test_live_block_migration thats the one according to console logs | 23:47 |
| clarkb | its the one you link to | 23:47 |
| armax | so I think that Swami’s troubleshooting attempt is only to rule out any possiblity that we see test passes just because we’re hitting the compute host colocated with the controller node where tempest is executed | 23:47 |
| armax | clarkb: the test is there, but I can’t see anything in the test code itself that tests connectivity | 23:48 |
| clarkb | armax: libvirt itself "tests" it | 23:48 |
| openstackgerrit | Merged openstack-infra/project-config: Move Rally to OpenStack https://review.openstack.org/172701 | 23:49 |
| clarkb | armax: live migration won't work if networking isn't working | 23:49 |
| armax | clarkb: I mean FIP connectivity | 23:49 |
| clarkb | armax: yes I don't think FIP connectivity is tested | 23:49 |
| armax | we do know that the VM’s do get DHCP address | 23:49 |
| clarkb | shelve unshelve is likely a better test for that since it will move a host offline (not live) and it does check FIP connectivity | 23:49 |
| clarkb | test_shelve_instance under scenario testing somewhere | 23:50 |
| *** patrickeast has quit IRC | 23:50 | |
| fungi | in the future it might be interesting to try a three-node variant where tempest runs on one node with no devstack whatsoever, just the tunnels it needs to reach the "pub" side of the two devstack nodes | 23:50 |
| armax | clarkb, fungi, swami and I were also considering the possiblity to write a scenario test where we force two VM’s to land on separate hosts and tess cross connectivity | 23:51 |
| clarkb | armax: I think that test exists, but let me look | 23:51 |
| armax | that would be the ultimate test for dvr | 23:51 |
| armax | clarkb: there’s a similar one | 23:51 |
| armax | in test_security_groups_basic_ops iirc | 23:52 |
| openstackgerrit | Merged openstack-infra/project-config: Remove the tuskar-ui-extras repository from Stackforge https://review.openstack.org/169715 | 23:52 |
| armax | but the VM’s can land on the same hosts | 23:52 |
| fungi | i wonder if there are any anti-affinity tests? | 23:52 |
| armax | clarkb: is this the one you’re thinking about? | 23:52 |
| armax | https://github.com/openstack/tempest/blob/master/tempest/scenario/test_security_groups_basic_ops.py#L32 | 23:52 |
| fungi | where we explicitly schedule them on different compute nodes | 23:52 |
| clarkb | armax: ah so we have a cross VM test but it doesn't enforce scheduling of the VMs | 23:52 |
| clarkb | armax: I think | 23:52 |
| armax | fungi: that’s right | 23:52 |
| armax | that’s what I am talking about | 23:53 |
| openstackgerrit | Merged openstack-infra/project-config: Move congress projects from stackforge to openstack https://review.openstack.org/169530 | 23:53 |
| armax | I am not 100% sure whether we have thouse | 23:53 |
| armax | those | 23:53 |
| armax | I would be pleasantly surprised if we did | 23:53 |
| fungi | i am woefully unfamiliar with actual openstack features, so it's entirely possible anti-affinity is not even a thing yet. i really don't know | 23:53 |
| clarkb | I think we don't have them explicitly | 23:53 |
| armax | but if we don’t, they would make a fine addition for the multi-node jobs | 23:53 |
| Swami | armax: yes that would be go idea. | 23:53 |
| clarkb | the way the nova shceduler works we should test that most of the time | 23:54 |
| armax | fungi: nova’s scheduler can be passed hints | 23:54 |
| clarkb | but it isn't enforced | 23:54 |
| *** annegentle has joined #openstack-infra | 23:54 | |
| armax | they work only as admin | 23:54 |
| clarkb | by default the scheduler will round robin across the compute nodes | 23:54 |
| fungi | armax: okay, so is sounds doable anyway | 23:54 |
| armax | and can be used to specify a host on which to do the placement | 23:54 |
| armax | at least that used to be there ;) | 23:54 |
| clarkb | so we should get two VMs on two hypervisors when booting two VMs but that isn't enforced | 23:54 |
| armax | clarkb: corrct | 23:54 |
| armax | clarkb: the two VM’s might as well as land on the same host | 23:55 |
| armax | clarkb: we’d need a way to be sure we always land on separate hosts | 23:55 |
| openstackgerrit | Merged openstack-infra/project-config: Rename stackforge/murano to openstack/murano https://review.openstack.org/167934 | 23:55 |
| fungi | yeah, with tests running in parallel that probably mucks with any expectations we might have from the round-robin scheduling | 23:55 |
| clarkb | fungi: yup | 23:55 |
| clarkb | but evidence is that the majority of the time we get that behavior | 23:56 |
| armax | fungi: there might be a nova scheduler filter with a round robin placement strategy | 23:56 |
| clarkb | armax: thats the default | 23:56 |
| fungi | okay, that was the last change we were waiting on to merge. should be safe to unleash puppet from its chains once more | 23:56 |
| fungi | clarkb: jeblair: objections? | 23:56 |
| clarkb | fungi: not from me | 23:57 |
| armax | clarkb: at one point the default was to fill up hosts first | 23:57 |
| *** dboik has quit IRC | 23:57 | |
| jeblair | fungi: nope, i will do that now | 23:57 |
| clarkb | armax: that isn't how it works based on my testing. at least not now | 23:57 |
| fungi | jeblair: thanks! | 23:57 |
| armax | clarkb: or at least the one I recall, for the round robin one, I am not sure how guaranteed the randomeness is | 23:57 |
| clarkb | armax: if you take the multinode test env then boot 2 nodes you will get one node on each hypervisor | 23:57 |
| armax | clarkb: fair point | 23:57 |
| *** serg_melikyan has quit IRC | 23:57 | |
| clarkb | armax: I think it may account for available resources to concurrent tests can affect scheduling | 23:57 |
| armax | clarkb: right | 23:57 |
| armax | clarkb: it depends on teh flavors too | 23:58 |
| jeblair | fungi, clarkb: it's 2 mins till, so i just uncommented the cron and will let it run normally | 23:58 |
| clarkb | jeblair: wfm | 23:58 |
| fungi | sounds fine | 23:58 |
| armax | clarkb: as far as I can tell, the backbone for testing DVR on multi-node is solid | 23:58 |
| fungi | i'll start prepping .gitreview changes | 23:58 |
| clarkb | armax: the other thing we are seeing with nova network is dnsmasq isn't being updated with mac addr to IP mappings on some tests | 23:59 |
| armax | clarkb: now we need to figure out where is the source of instability and kill it as fast as we can | 23:59 |
| clarkb | armax: which breaks dhcp, but you said that dhcp is working there | 23:59 |
| *** weshay has quit IRC | 23:59 | |
| armax | clarkb: is this instability recently observed? | 23:59 |
| armax | clarkb: as far as I can tell, all the tests that failed, failed because of L3 glitches, not because of DHCP | 23:59 |
| clarkb | armax: no, its also not as high an error rate as the dvr job | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!