| ianw | greghaynes: ok, cool. i'm still thinking installing from git will work, will finish up that idea today my time, might be one to disucss in meeting | 00:00 |
|---|---|---|
| *** chlong has quit IRC | 00:01 | |
| *** thorst has joined #openstack-infra | 00:02 | |
| *** dims_ has joined #openstack-infra | 00:02 | |
| *** salv-orlando has quit IRC | 00:03 | |
| *** thorst has quit IRC | 00:04 | |
| *** thorst has joined #openstack-infra | 00:04 | |
| *** dims has quit IRC | 00:05 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: fix gentoo hardened support https://review.openstack.org/273795 | 00:05 |
| prometheanfire | ianw: think that's all of them | 00:05 |
| prometheanfire | yep, nothing left to do is hope gate is working today and wait for reviews | 00:07 |
| *** iremizov has quit IRC | 00:08 | |
| *** tpeoples has quit IRC | 00:08 | |
| *** kgalanov has quit IRC | 00:08 | |
| *** evgenyl has quit IRC | 00:08 | |
| *** mwhahaha has quit IRC | 00:09 | |
| *** iremizov has joined #openstack-infra | 00:09 | |
| *** evgenyl has joined #openstack-infra | 00:09 | |
| *** mwhahaha has joined #openstack-infra | 00:10 | |
| *** kgalanov has joined #openstack-infra | 00:10 | |
| *** tpeoples has joined #openstack-infra | 00:10 | |
| *** ihrachys has quit IRC | 00:10 | |
| *** GheRivero has quit IRC | 00:12 | |
| *** dham1 has quit IRC | 00:12 | |
| *** GheRivero has joined #openstack-infra | 00:12 | |
| *** dham1 has joined #openstack-infra | 00:12 | |
| *** thorst has quit IRC | 00:13 | |
| *** betherly has quit IRC | 00:14 | |
| *** DuncanT has quit IRC | 00:15 | |
| *** betherly has joined #openstack-infra | 00:15 | |
| *** evgenyl has quit IRC | 00:16 | |
| *** DuncanT has joined #openstack-infra | 00:17 | |
| *** evgenyl has joined #openstack-infra | 00:17 | |
| *** chlong has joined #openstack-infra | 00:17 | |
| *** fedexo has quit IRC | 00:22 | |
| *** Sukhdev has joined #openstack-infra | 00:28 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: add new cloud-init element https://review.openstack.org/273764 | 00:29 |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: package-installs doesn't work in python3/gentoo https://review.openstack.org/273782 | 00:33 |
| jlvillal | Any idea how often the CI bot runs to generate a new upper-constraints.txt file? | 00:34 |
| *** ihrachys has joined #openstack-infra | 00:36 | |
| *** woodster_ has quit IRC | 00:36 | |
| prometheanfire | ianw: anything else? | 00:37 |
| *** elo has joined #openstack-infra | 00:38 | |
| ianw | prometheanfire: thanks, i'll loop back around this afternoon my time and take another look | 00:38 |
| prometheanfire | ianw: k, hoping gating is reliable this time mainly :P | 00:39 |
| ianw | prometheanfire: no, the ironic job seems to have gone haywire again :( | 00:39 |
| prometheanfire | lol, yay | 00:39 |
| *** ihrachys has quit IRC | 00:39 | |
| prometheanfire | so maybe sometime next month | 00:40 |
| prometheanfire | by that I don't mean tomorrow | 00:40 |
| *** Anticimex has quit IRC | 00:44 | |
| *** markvoelker has joined #openstack-infra | 00:46 | |
| *** Anticimex has joined #openstack-infra | 00:48 | |
| *** salv-orlando has joined #openstack-infra | 00:49 | |
| *** markvoelker has quit IRC | 00:50 | |
| *** hogepodge has quit IRC | 00:56 | |
| *** hogepodge has joined #openstack-infra | 00:59 | |
| *** kzaitsev_mb has quit IRC | 01:00 | |
| *** ihrachys has joined #openstack-infra | 01:01 | |
| *** markmcclain has quit IRC | 01:02 | |
| *** Jeffrey4l_ has joined #openstack-infra | 01:02 | |
| *** dims_ has quit IRC | 01:04 | |
| *** markmcclain has joined #openstack-infra | 01:05 | |
| openstackgerrit | Merged openstack-infra/project-config: Add devstack-centos7 to internap and blue box https://review.openstack.org/274161 | 01:07 |
| *** HenryG_ is now known as HenryG | 01:08 | |
| *** thorst has joined #openstack-infra | 01:11 | |
| *** camunoz has joined #openstack-infra | 01:11 | |
| *** thorst has quit IRC | 01:18 | |
| *** salv-orlando has quit IRC | 01:23 | |
| *** zhenguo_ has joined #openstack-infra | 01:25 | |
| *** mriedem is now known as mriedem_away | 01:42 | |
| *** markmcclain has quit IRC | 01:43 | |
| *** ashleighfarnham has joined #openstack-infra | 01:44 | |
| *** markmcclain has joined #openstack-infra | 01:45 | |
| *** salv-orlando has joined #openstack-infra | 01:45 | |
| *** markvoelker has joined #openstack-infra | 01:47 | |
| *** calebb has joined #openstack-infra | 01:47 | |
| *** ashleighfarnham has quit IRC | 01:49 | |
| *** markvoelker has quit IRC | 01:52 | |
| *** boris-42 has quit IRC | 01:53 | |
| *** yamamoto has joined #openstack-infra | 01:54 | |
| *** tonytan4ever has joined #openstack-infra | 02:00 | |
| *** yamamoto has quit IRC | 02:00 | |
| *** baoli has joined #openstack-infra | 02:02 | |
| *** dims has joined #openstack-infra | 02:02 | |
| *** baoli has quit IRC | 02:04 | |
| openstackgerrit | hardik proposed openstack-infra/project-config: gate-mistral-docker-buildimage has been moved to post https://review.openstack.org/274486 | 02:05 |
| *** zhurong has joined #openstack-infra | 02:07 | |
| *** dims has quit IRC | 02:12 | |
| *** tonytan4ever has quit IRC | 02:12 | |
| *** dims has joined #openstack-infra | 02:12 | |
| *** tonytan4ever has joined #openstack-infra | 02:13 | |
| *** dims has quit IRC | 02:13 | |
| *** thorst has joined #openstack-infra | 02:16 | |
| *** salv-orlando has quit IRC | 02:17 | |
| *** tonytan4ever has quit IRC | 02:18 | |
| *** tonytan4ever has joined #openstack-infra | 02:18 | |
| *** tonytan4ever has quit IRC | 02:19 | |
| *** tonytan4ever has joined #openstack-infra | 02:19 | |
| *** changzhi has joined #openstack-infra | 02:20 | |
| *** Sukhdev has quit IRC | 02:22 | |
| *** thorst has quit IRC | 02:23 | |
| *** Sukhdev has joined #openstack-infra | 02:23 | |
| *** yamamoto has joined #openstack-infra | 02:23 | |
| *** ihrachys has quit IRC | 02:24 | |
| *** baoli has joined #openstack-infra | 02:27 | |
| *** yamamoto has quit IRC | 02:28 | |
| *** MarkAtwood has joined #openstack-infra | 02:28 | |
| *** MarkAtwood has quit IRC | 02:29 | |
| *** jpr1 has quit IRC | 02:32 | |
| *** baoli has quit IRC | 02:33 | |
| *** sridhar_ram has joined #openstack-infra | 02:34 | |
| *** tonytan4ever has quit IRC | 02:37 | |
| *** boris-42 has joined #openstack-infra | 02:38 | |
| *** MarkAtwood has joined #openstack-infra | 02:38 | |
| *** salv-orlando has joined #openstack-infra | 02:42 | |
| openstackgerrit | Kyle Mestery proposed openstack-infra/project-config: Enable requirements and make it voting for Kuryr https://review.openstack.org/274447 | 02:50 |
| *** fedexo has joined #openstack-infra | 02:56 | |
| *** tiswanso has joined #openstack-infra | 02:57 | |
| *** shashank_hegde has joined #openstack-infra | 02:57 | |
| *** tiswanso has quit IRC | 03:01 | |
| *** tiswanso has joined #openstack-infra | 03:01 | |
| *** coolsvap|away is now known as coolsvap | 03:02 | |
| *** thorst has joined #openstack-infra | 03:21 | |
| *** yuanying has quit IRC | 03:22 | |
| *** yuanying has joined #openstack-infra | 03:22 | |
| *** Sukhdev has quit IRC | 03:22 | |
| *** Sukhdev has joined #openstack-infra | 03:23 | |
| *** salv-orlando has quit IRC | 03:26 | |
| *** thorst has quit IRC | 03:27 | |
| *** yamamoto_ has joined #openstack-infra | 03:33 | |
| *** gongysh_ has joined #openstack-infra | 03:38 | |
| *** links has joined #openstack-infra | 03:46 | |
| *** markvoelker has joined #openstack-infra | 03:47 | |
| *** mriedem_away has quit IRC | 03:50 | |
| *** spags has joined #openstack-infra | 03:50 | |
| *** markvoelker has quit IRC | 03:52 | |
| *** MarkAtwood has quit IRC | 03:54 | |
| *** Keedya_ has joined #openstack-infra | 03:57 | |
| *** flwang1 has quit IRC | 03:58 | |
| *** spags has quit IRC | 04:00 | |
| *** Keedya_ has quit IRC | 04:00 | |
| *** unicell has quit IRC | 04:02 | |
| *** yuanying has quit IRC | 04:06 | |
| *** unicell has joined #openstack-infra | 04:10 | |
| *** sridhar_ram has quit IRC | 04:15 | |
| *** tiswanso has quit IRC | 04:18 | |
| *** links has quit IRC | 04:19 | |
| *** keedya has quit IRC | 04:19 | |
| *** salv-orlando has joined #openstack-infra | 04:24 | |
| *** Sukhdev_ has joined #openstack-infra | 04:25 | |
| *** thorst has joined #openstack-infra | 04:26 | |
| *** julim_ has quit IRC | 04:26 | |
| *** shashank_hegde has quit IRC | 04:27 | |
| *** Sukhdev has quit IRC | 04:27 | |
| *** Sukhdev_ has quit IRC | 04:29 | |
| *** Sukhdev has joined #openstack-infra | 04:30 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: add new cloud-init element https://review.openstack.org/273764 | 04:33 |
| prometheanfire | SamYaple: thanks :D | 04:33 |
| *** thorst has quit IRC | 04:33 | |
| prometheanfire | Sam-I-Am: didn't know you were in here | 04:33 |
| *** yonglihe has quit IRC | 04:42 | |
| *** achanda has quit IRC | 04:44 | |
| *** Sukhdev has quit IRC | 04:44 | |
| *** baoli has joined #openstack-infra | 04:45 | |
| *** Sukhdev has joined #openstack-infra | 04:48 | |
| *** tphummel has joined #openstack-infra | 04:50 | |
| *** baoli has quit IRC | 04:50 | |
| *** zz_dimtruck is now known as dimtruck | 04:51 | |
| *** links has joined #openstack-infra | 04:53 | |
| *** achanda has joined #openstack-infra | 04:55 | |
| *** amotoki has joined #openstack-infra | 04:58 | |
| *** amotoki has quit IRC | 04:58 | |
| Sam-I-Am | prometheanfire: yarp | 04:59 |
| prometheanfire | Sam-I-Am: go to bed | 05:03 |
| *** [1]Thelo has joined #openstack-infra | 05:04 | |
| *** chlong has quit IRC | 05:05 | |
| Sam-I-Am | prometheanfire: yarp | 05:05 |
| greghaynes | prometheanfire: I reviewed all your dib patches | 05:05 |
| greghaynes | I think | 05:06 |
| *** salv-orlando has quit IRC | 05:06 | |
| *** Thelo has quit IRC | 05:07 | |
| prometheanfire | greghaynes: hehe, I replied to your -1 | 05:07 |
| *** [1]Thelo is now known as Thelo | 05:07 | |
| prometheanfire | https://review.openstack.org/#/c/273790 | 05:07 |
| prometheanfire | greghaynes: I don't think anything should add itself to init on install | 05:07 |
| greghaynes | prometheanfire: oh, well install is conflated here. Glean is 'installed' via pip install glean | 05:08 |
| greghaynes | that script is a helper script in glean rather than part of the 'install' for that reason | 05:08 |
| prometheanfire | greghaynes: ok, well, it can go in there then, I still don't like adding init things to packages as much as possible | 05:09 |
| *** amotoki has joined #openstack-infra | 05:10 | |
| greghaynes | Yea, it is wierd because of the python pacakging aspect - for a normal package we would just let the distro pacakge take care of it | 05:10 |
| greghaynes | for a non distro pacakged python thing either dib needs to carry the code or the package needs to provide it, both if which are not ideal | 05:10 |
| prometheanfire | I see dib taking on the role of a distro here | 05:11 |
| prometheanfire | greghaynes: mind if I keep it with [[]] | 05:11 |
| greghaynes | prometheanfire: eh, I think that will be the only place we use that for the debug conditional so it breaks our consistency... | 05:12 |
| prometheanfire | greghaynes: I've been told back and forth on that | 05:12 |
| greghaynes | ya, whoever told you otherwise is wrong ;) | 05:12 |
| prometheanfire | of course | 05:12 |
| prometheanfire | and they'd say the same to you | 05:12 |
| greghaynes | the rule is [] unless you need something in the builtin | 05:12 |
| greghaynes | We decided this as a project a while ago... | 05:12 |
| prometheanfire | bad decision imo, but ok | 05:13 |
| greghaynes | My opinion on it was pick one and do it | 05:13 |
| prometheanfire | I really don't want to have to go back and change all the [[ I've done to [ | 05:13 |
| greghaynes | so *shrug* | 05:13 |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: add new cloud-init element https://review.openstack.org/273764 | 05:13 |
| greghaynes | Yea, sorry about that :( | 05:13 |
| greghaynes | Re simple-init init, I think I agree with you | 05:14 |
| greghaynes | but | 05:14 |
| prometheanfire | I'm not doing it yet, just to the DIB_DEBUG_TRACE I've changed/added | 05:14 |
| greghaynes | we should still add it to glean for now so we match the other init systems | 05:15 |
| greghaynes | if we want to do init config in dib then we should move all of them in to there | 05:15 |
| greghaynes | That is also the kind of thing which would be good to discuss with other glean cores before actually doing | 05:16 |
| prometheanfire | ya, I get consistency | 05:16 |
| prometheanfire | anyway, I'm caught up, except for simple-init | 05:16 |
| *** salv-orlando has joined #openstack-infra | 05:17 | |
| *** chlong has joined #openstack-infra | 05:17 | |
| *** rguillebert has quit IRC | 05:17 | |
| *** ramishr__ has joined #openstack-infra | 05:18 | |
| greghaynes | prometheanfire: on that cloud-init element, do you not need a package map? | 05:19 |
| prometheanfire | it's called cloud-init in gentoo | 05:19 |
| greghaynes | ah, ok | 05:19 |
| greghaynes | I am not entirely clear on when you need to foo/package vs no | 05:20 |
| prometheanfire | it'd be more correct to have a pkg-map for cloud-init to map to app-emulation/cloud-init, but both work | 05:20 |
| greghaynes | ok | 05:20 |
| prometheanfire | it's needed for git because there are two 'git's in the tree | 05:20 |
| prometheanfire | dev-ruby/git and dev-vcs/git | 05:20 |
| greghaynes | eek, that seems scary from a backwards compat standpoint | 05:20 |
| prometheanfire | other times it's a package name change | 05:20 |
| prometheanfire | backwards compat? | 05:21 |
| greghaynes | someone adds another package with the same name and all of a sudden everyone who doesnt prefix the package breaks? | 05:21 |
| prometheanfire | on install it's added the the 'world' file as the full package name | 05:21 |
| prometheanfire | if it's just being installed as a dep our ebuilds also use the full name | 05:21 |
| prometheanfire | no issue | 05:21 |
| greghaynes | I just mean for something like dib as an example, if someone added foo/cloud-init we would break | 05:21 |
| openstackgerrit | Matthew Thode proposed openstack-infra/glean: enable glean in gentoo's init on install https://review.openstack.org/274505 | 05:21 |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Add support for OpenRC to dib-init-system https://review.openstack.org/273772 | 05:21 |
| prometheanfire | heh | 05:22 |
| greghaynes | I am not really worried about that specific case, but ya | 05:22 |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: add support for gentoo to simple-init https://review.openstack.org/273790 | 05:23 |
| *** chlong has quit IRC | 05:25 | |
| prometheanfire | greghaynes: how's this for a pkg-map? https://bpaste.net/show/8aba9005e5bc | 05:25 |
| prometheanfire | don't think I need to define a default | 05:26 |
| greghaynes | prometheanfire: Thats fine, I am actually +2 on the patch, I was mostly just commenting on the system as a whole | 05:26 |
| *** ramishr__ has quit IRC | 05:26 | |
| greghaynes | prometheanfire: I am going to update your commit msg on https://review.openstack.org/#/c/273790/3 to not mention enabling the glean service | 05:26 |
| prometheanfire | I'm still gonna add it | 05:26 |
| prometheanfire | sure | 05:27 |
| *** ramishr__ has joined #openstack-infra | 05:27 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: add new cloud-init element https://review.openstack.org/273764 | 05:27 |
| prometheanfire | though I may get there first | 05:27 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: add support for gentoo to simple-init https://review.openstack.org/273790 | 05:28 |
| prometheanfire | oh boo | 05:28 |
| greghaynes | I just use the gerrit web ui for that all the time | 05:28 |
| prometheanfire | I would have been faster if I didn't work on the cloud-init commit :P | 05:29 |
| *** zhenguo_ has quit IRC | 05:30 | |
| *** ramishr__ has quit IRC | 05:30 | |
| prometheanfire | greghaynes: https://review.openstack.org/#/c/273772/ https://review.openstack.org/#/c/273795/ https://review.openstack.org/#/c/274505/ | 05:31 |
| prometheanfire | greghaynes: think those are it | 05:31 |
| greghaynes | prometheanfire: ah, ok | 05:31 |
| *** thorst has joined #openstack-infra | 05:31 | |
| prometheanfire | yep, confirmed | 05:32 |
| greghaynes | hrm, gerrit is not happ6y | 05:32 |
| *** ramishr__ has joined #openstack-infra | 05:32 | |
| prometheanfire | ya, had to refresh | 05:33 |
| *** amotoki has quit IRC | 05:33 | |
| *** amotoki has joined #openstack-infra | 05:34 | |
| greghaynes | prometheanfire: You might also consider making a patch to add gentoo to http://docs.openstack.org/developer/diskimage-builder/user_guide/supported_distros.html | 05:35 |
| *** salv-orlando has quit IRC | 05:35 | |
| prometheanfire | greghaynes: after this, sure | 05:35 |
| prometheanfire | not need these 7 reviews :P | 05:36 |
| prometheanfire | just | 05:36 |
| *** gongysh_ has quit IRC | 05:36 | |
| prometheanfire | added to my todo for next sunday, hopefully my patches will be in by then | 05:37 |
| greghaynes | cool | 05:37 |
| *** thorst has quit IRC | 05:37 | |
| *** chlong has joined #openstack-infra | 05:38 | |
| *** coolsvap is now known as coolsvap|away | 05:40 | |
| *** denisra_ has joined #openstack-infra | 05:40 | |
| *** Sukhdev has quit IRC | 05:41 | |
| greghaynes | clarkb: When youre awake - ianw is looking for input on https://review.openstack.org/#/c/268241/ | 05:41 |
| *** mtanino___ has joined #openstack-infra | 05:42 | |
| *** ikalnitsky_ has joined #openstack-infra | 05:42 | |
| *** kuromagi^ has joined #openstack-infra | 05:43 | |
| *** trown has joined #openstack-infra | 05:43 | |
| *** DuncanT_ has joined #openstack-infra | 05:43 | |
| *** darrenc_ has joined #openstack-infra | 05:43 | |
| *** wendar_ has joined #openstack-infra | 05:43 | |
| *** fedexo_ has joined #openstack-infra | 05:43 | |
| *** Nakato_ has joined #openstack-infra | 05:44 | |
| *** matt6434 has joined #openstack-infra | 05:44 | |
| *** pfalleno1 has joined #openstack-infra | 05:45 | |
| *** gus_ has joined #openstack-infra | 05:45 | |
| *** bradm_ has joined #openstack-infra | 05:45 | |
| *** jokke__ has joined #openstack-infra | 05:45 | |
| *** gibi_ has joined #openstack-infra | 05:45 | |
| *** Anticime1 has joined #openstack-infra | 05:45 | |
| *** lifeless_ has joined #openstack-infra | 05:45 | |
| *** fabo_ has joined #openstack-infra | 05:45 | |
| *** ashleighfarnham has joined #openstack-infra | 05:45 | |
| *** _fortis_ has joined #openstack-infra | 05:46 | |
| openstackgerrit | Merged openstack/diskimage-builder: Remove zero length files https://review.openstack.org/270550 | 05:46 |
| *** amotoki has quit IRC | 05:47 | |
| *** achanda_ has joined #openstack-infra | 05:47 | |
| prometheanfire | greghaynes: dib workflow is broken atm I think | 05:47 |
| greghaynes | you mean merging? | 05:47 |
| *** Sukhdev has joined #openstack-infra | 05:47 | |
| prometheanfire | so https://review.openstack.org/#/c/273769/ won't work | 05:48 |
| *** anthonyper_ has joined #openstack-infra | 05:48 | |
| *** onovy_ has joined #openstack-infra | 05:48 | |
| *** jmccrory_ has joined #openstack-infra | 05:48 | |
| greghaynes | prometheanfire: yep, but you can recheck whenever the gate is un-broke and itll merge | 05:48 |
| prometheanfire | cool | 05:48 |
| *** markvoelker has joined #openstack-infra | 05:48 | |
| *** dimtruck_ has joined #openstack-infra | 05:48 | |
| *** med_ has joined #openstack-infra | 05:48 | |
| *** med_ is now known as Guest80711 | 05:49 | |
| *** fedexo has quit IRC | 05:49 | |
| *** changzhi has quit IRC | 05:49 | |
| *** Anticimex has quit IRC | 05:49 | |
| *** DuncanT has quit IRC | 05:49 | |
| *** _fortis has quit IRC | 05:49 | |
| *** pfallenop has quit IRC | 05:49 | |
| *** denisra has quit IRC | 05:49 | |
| *** lifeless has quit IRC | 05:49 | |
| *** madorn has quit IRC | 05:49 | |
| *** krtaylor has quit IRC | 05:49 | |
| *** mgagne has quit IRC | 05:49 | |
| *** mtanino__ has quit IRC | 05:49 | |
| *** aarefiev has quit IRC | 05:49 | |
| *** onovy has quit IRC | 05:49 | |
| *** bswartz has quit IRC | 05:49 | |
| *** jmccrory has quit IRC | 05:49 | |
| *** dtroyer has quit IRC | 05:49 | |
| *** luv has quit IRC | 05:49 | |
| *** Guest65103 has quit IRC | 05:49 | |
| *** jokke_ has quit IRC | 05:49 | |
| *** Kennan has quit IRC | 05:49 | |
| *** _diana_ has quit IRC | 05:49 | |
| *** lewo has quit IRC | 05:49 | |
| *** comstud has quit IRC | 05:49 | |
| *** gibi has quit IRC | 05:49 | |
| *** ikalnitsky has quit IRC | 05:49 | |
| *** trown|outttypeww has quit IRC | 05:49 | |
| *** bradm has quit IRC | 05:49 | |
| *** Zara_ has quit IRC | 05:49 | |
| *** mattoliverau has quit IRC | 05:49 | |
| *** dimtruck has quit IRC | 05:49 | |
| *** gus has quit IRC | 05:49 | |
| *** jamielennox has quit IRC | 05:49 | |
| *** Nakato has quit IRC | 05:49 | |
| *** kuromagi has quit IRC | 05:49 | |
| *** anthonyper has quit IRC | 05:49 | |
| *** darrenc has quit IRC | 05:49 | |
| *** fabo has quit IRC | 05:49 | |
| *** isviridov_away has quit IRC | 05:49 | |
| *** vaidy has quit IRC | 05:49 | |
| *** d34dh0r53 has quit IRC | 05:49 | |
| *** dolphm has quit IRC | 05:49 | |
| *** eglute has quit IRC | 05:49 | |
| *** cloudnull has quit IRC | 05:49 | |
| *** sigmavirus24_awa has quit IRC | 05:49 | |
| *** wendar has quit IRC | 05:49 | |
| *** fungi has quit IRC | 05:49 | |
| *** anthonyper_ is now known as anthonyper | 05:49 | |
| *** dimtruck_ is now known as dimtruck | 05:49 | |
| *** onovy_ is now known as onovy | 05:49 | |
| *** jmccrory_ is now known as jmccrory | 05:49 | |
| *** achanda has quit IRC | 05:49 | |
| *** mgagne_ has joined #openstack-infra | 05:49 | |
| *** coolsvap|away is now known as coolsvap | 05:49 | |
| *** mtanino___ is now known as mtanino__ | 05:49 | |
| *** luv has joined #openstack-infra | 05:49 | |
| *** dolphm has joined #openstack-infra | 05:50 | |
| *** ikalnitsky_ is now known as ikalnitsky | 05:50 | |
| *** dtroyer has joined #openstack-infra | 05:50 | |
| *** ashleighfarnham has quit IRC | 05:50 | |
| *** DuncanT_ is now known as DuncanT | 05:51 | |
| *** lewo has joined #openstack-infra | 05:51 | |
| *** d34dh0r53 has joined #openstack-infra | 05:52 | |
| *** comstud has joined #openstack-infra | 05:52 | |
| *** markvoelker has quit IRC | 05:53 | |
| *** sigmavirus24_awa has joined #openstack-infra | 05:54 | |
| *** amotoki has joined #openstack-infra | 05:54 | |
| *** eglute has joined #openstack-infra | 05:55 | |
| *** MarkAtwood has joined #openstack-infra | 05:55 | |
| *** krtaylor has joined #openstack-infra | 05:56 | |
| *** aarefiev has joined #openstack-infra | 05:56 | |
| *** _diana_ has joined #openstack-infra | 05:56 | |
| *** madorn has joined #openstack-infra | 05:57 | |
| *** fungi has joined #openstack-infra | 05:57 | |
| *** Kennan has joined #openstack-infra | 05:58 | |
| *** ramishr__ is now known as ramishra | 05:59 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Add support for OpenRC to dib-init-system https://review.openstack.org/273772 | 06:01 |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: fix gentoo hardened support https://review.openstack.org/273795 | 06:01 |
| prometheanfire | greghaynes: mind adding +W to https://review.openstack.org/#/c/273776/ | 06:02 |
| greghaynes | prometheanfire: done | 06:03 |
| prometheanfire | thanks | 06:03 |
| *** amotoki has quit IRC | 06:05 | |
| *** jamielennox|away has joined #openstack-infra | 06:07 | |
| *** jamielennox|away is now known as jamielennox | 06:07 | |
| *** abregman has joined #openstack-infra | 06:07 | |
| *** _fortis_ is now known as _fortis | 06:07 | |
| *** abregman has quit IRC | 06:08 | |
| *** abregman has joined #openstack-infra | 06:08 | |
| *** markmcclain has quit IRC | 06:13 | |
| *** salv-orlando has joined #openstack-infra | 06:13 | |
| *** amotoki has joined #openstack-infra | 06:14 | |
| *** markmcclain has joined #openstack-infra | 06:15 | |
| *** toabctl is now known as toabctl_ | 06:17 | |
| *** hichihara has joined #openstack-infra | 06:19 | |
| jlvillal | Anyone know how long it takes for a new release to propagate from PyPi to the gate system? This update to upper-constraints.txt keeps failing: https://review.openstack.org/#/c/274462/1 I can download the 1.1.0 version of python-ironicclient from PyPi. | 06:19 |
| jlvillal | The log file says: No matching distribution found for python-ironicclient===1.1.0 (from -c /opt/stack/new/requirements/upper-constraints.txt (line 286)) | 06:21 |
| jlvillal | http://logs.openstack.org/62/274462/1/check/gate-tempest-dsvm-full/c6252fe/logs/devstacklog.txt.gz#_2016-02-01_03_04_12_651 | 06:21 |
| *** markmcclain has quit IRC | 06:21 | |
| *** isviridov_away has joined #openstack-infra | 06:23 | |
| *** MarkAtwood has quit IRC | 06:24 | |
| *** tphummel has quit IRC | 06:24 | |
| *** vaidy_ril has joined #openstack-infra | 06:26 | |
| *** nikil89_ has joined #openstack-infra | 06:26 | |
| *** nikil89_ is now known as naggappan | 06:26 | |
| *** aopincar has joined #openstack-infra | 06:29 | |
| jlvillal | As a note, until the above patch is merged the Ironic gate is broken. | 06:30 |
| *** rossella_s has quit IRC | 06:31 | |
| *** rossella_s has joined #openstack-infra | 06:31 | |
| *** mrmartin has joined #openstack-infra | 06:33 | |
| *** thorst has joined #openstack-infra | 06:36 | |
| *** cloudnul- has joined #openstack-infra | 06:38 | |
| *** Nakato_ has quit IRC | 06:40 | |
| *** Daisy has joined #openstack-infra | 06:41 | |
| *** chlong has quit IRC | 06:41 | |
| *** thorst has quit IRC | 06:42 | |
| *** Nakato has joined #openstack-infra | 06:42 | |
| *** markmcclain has joined #openstack-infra | 06:43 | |
| *** _nadya_ has joined #openstack-infra | 06:46 | |
| *** chlong has joined #openstack-infra | 06:46 | |
| *** fabo_ is now known as fabo | 06:47 | |
| *** markmcclain has quit IRC | 06:48 | |
| *** hdd has quit IRC | 06:50 | |
| *** cloudnul- is now known as cloudnull | 06:51 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/273907 | 06:52 |
| *** salv-orlando has quit IRC | 06:57 | |
| *** achanda_ is now known as achanda | 06:57 | |
| *** esikachev has joined #openstack-infra | 06:59 | |
| *** gildub has quit IRC | 07:01 | |
| *** kushal has joined #openstack-infra | 07:02 | |
| *** [HeOS] has quit IRC | 07:05 | |
| *** [HeOS] has joined #openstack-infra | 07:05 | |
| *** salv-orlando has joined #openstack-infra | 07:09 | |
| Daisy | StevenK: ping | 07:10 |
| *** followinfrared has joined #openstack-infra | 07:13 | |
| *** zul has joined #openstack-infra | 07:14 | |
| *** sbalukoff has joined #openstack-infra | 07:15 | |
| *** markmcclain has joined #openstack-infra | 07:17 | |
| AJaeger | jlvillal: we updated our mirroring setup, might be that something is not working as it should. jeblair, krotschek, could you check python-ironicclient, please? We need version 1.1.0... | 07:19 |
| *** yamahata has joined #openstack-infra | 07:21 | |
| *** markmcclain has quit IRC | 07:22 | |
| *** hichihara has quit IRC | 07:24 | |
| *** jaosorior has joined #openstack-infra | 07:26 | |
| *** scheuran has joined #openstack-infra | 07:26 | |
| *** mrmartin has quit IRC | 07:26 | |
| *** jaosorior has quit IRC | 07:26 | |
| *** jaosorior has joined #openstack-infra | 07:27 | |
| *** jtomasek has joined #openstack-infra | 07:32 | |
| *** jyuso1 has joined #openstack-infra | 07:35 | |
| *** nmagnezi has joined #openstack-infra | 07:37 | |
| *** thorst has joined #openstack-infra | 07:40 | |
| *** jaosorior has quit IRC | 07:41 | |
| *** salv-orlando has quit IRC | 07:43 | |
| *** chlong has quit IRC | 07:46 | |
| *** placko has joined #openstack-infra | 07:46 | |
| *** thorst has quit IRC | 07:47 | |
| *** markvoelker has joined #openstack-infra | 07:49 | |
| *** shashank_hegde has joined #openstack-infra | 07:52 | |
| *** amotoki has quit IRC | 07:52 | |
| *** zul has quit IRC | 07:52 | |
| *** ttx has joined #openstack-infra | 07:52 | |
| *** markvoelker has quit IRC | 07:54 | |
| *** jokke__ is now known as jokke_ | 07:56 | |
| *** shashank_hegde has quit IRC | 07:59 | |
| *** zeih has joined #openstack-infra | 08:00 | |
| *** dimtruck is now known as zz_dimtruck | 08:03 | |
| *** alivigni has joined #openstack-infra | 08:04 | |
| *** yamamoto_ has quit IRC | 08:05 | |
| *** salv-orlando has joined #openstack-infra | 08:06 | |
| *** mikelk has joined #openstack-infra | 08:08 | |
| *** yamamoto_ has joined #openstack-infra | 08:08 | |
| *** gildub has joined #openstack-infra | 08:10 | |
| *** tosky has joined #openstack-infra | 08:10 | |
| *** arxcruz has joined #openstack-infra | 08:12 | |
| *** ildikov has quit IRC | 08:12 | |
| *** yamamoto_ has quit IRC | 08:13 | |
| *** mkoderer has quit IRC | 08:14 | |
| *** dcentral has joined #openstack-infra | 08:14 | |
| *** dcentral has quit IRC | 08:19 | |
| yolanda | morning | 08:19 |
| *** dcentral has joined #openstack-infra | 08:20 | |
| zeih | morning | 08:21 |
| AJaeger | good morning, yolanda and zeih. | 08:21 |
| AJaeger | yolanda: did everything go fine yesterday? | 08:21 |
| *** dcentral has quit IRC | 08:22 | |
| *** yamamoto_ has joined #openstack-infra | 08:23 | |
| nibalizer | morning yall | 08:23 |
| *** yamamoto_ has quit IRC | 08:24 | |
| yolanda | AJaeger, still working on it | 08:24 |
| *** amotoki has joined #openstack-infra | 08:24 | |
| AJaeger | morning, nibalizer ! | 08:25 |
| *** salv-orlando has quit IRC | 08:25 | |
| AJaeger | yolanda: I hope you had some sleep... | 08:25 |
| yolanda | AJaeger, yes, i could take some rest, we had some good progress yesterday but we still have to finish today | 08:26 |
| *** rcernin has joined #openstack-infra | 08:26 | |
| *** yamamoto_ has joined #openstack-infra | 08:27 | |
| AJaeger | I see - then have a successfull day ;) | 08:27 |
| *** yamamoto_ has quit IRC | 08:28 | |
| yolanda | thanks, i hope so :) | 08:28 |
| *** changzhi has joined #openstack-infra | 08:29 | |
| *** d0ugal_ has quit IRC | 08:30 | |
| *** d0ugal has joined #openstack-infra | 08:30 | |
| *** achanda has quit IRC | 08:31 | |
| *** camunoz has quit IRC | 08:31 | |
| nibalizer | AJaeger: did you have some things you wanted reviews on? | 08:31 |
| *** amotoki has quit IRC | 08:33 | |
| *** yamahata has quit IRC | 08:34 | |
| *** sshnaidm has quit IRC | 08:35 | |
| *** coolsvap is now known as coolsvap|away | 08:36 | |
| *** Sukhdev has quit IRC | 08:36 | |
| *** achanda has joined #openstack-infra | 08:37 | |
| *** dchen has joined #openstack-infra | 08:37 | |
| *** dchen has quit IRC | 08:38 | |
| *** amotoki has joined #openstack-infra | 08:38 | |
| *** achanda has quit IRC | 08:39 | |
| *** ifarkas has joined #openstack-infra | 08:39 | |
| *** shardy has joined #openstack-infra | 08:42 | |
| *** dingyichen has quit IRC | 08:42 | |
| openstackgerrit | Luigi Toscano proposed openstack-infra/project-config: Fix Sahara config for DevStack on stable branches https://review.openstack.org/274549 | 08:42 |
| *** mkoderer has joined #openstack-infra | 08:43 | |
| tosky | and that's ^ should properly fix stable/kilo for Sahara | 08:44 |
| *** yamamoto_ has joined #openstack-infra | 08:44 | |
| *** samuelBartel has joined #openstack-infra | 08:45 | |
| *** yamamoto_ has quit IRC | 08:45 | |
| *** thorst has joined #openstack-infra | 08:46 | |
| *** fedexo_ has quit IRC | 08:46 | |
| *** zz_dimtruck is now known as dimtruck | 08:47 | |
| *** davidlenwell has quit IRC | 08:47 | |
| *** yamamoto_ has joined #openstack-infra | 08:48 | |
| *** jlanoux has joined #openstack-infra | 08:51 | |
| *** thorst has quit IRC | 08:52 | |
| *** yamamoto_ has quit IRC | 08:53 | |
| AJaeger | nibalizer: yes, thanks for asking | 08:53 |
| AJaeger | nibalizer: https://review.openstack.org/274352 and https://review.openstack.org/274342 , please | 08:54 |
| AJaeger | tosky: I'll review... | 08:54 |
| tosky | AJaeger: thanks! | 08:55 |
| *** davidlenwell has joined #openstack-infra | 08:56 | |
| *** yamamoto_ has joined #openstack-infra | 08:56 | |
| *** dimtruck is now known as zz_dimtruck | 08:56 | |
| AJaeger | nibalizer: https://review.openstack.org/273032 and https://review.openstack.org/273010 would be nice as well | 08:56 |
| nibalizer | AJaeger: kk | 08:57 |
| AJaeger | nibalizer: and other reviews: tosky's 274549, https://review.openstack.org/272469 https://review.openstack.org/274447 | 08:57 |
| *** fhubik has joined #openstack-infra | 08:59 | |
| tosky | AJaeger: out of curiosity, are the jobs rebuilt immediately (or after a short time) when a change is merged to the jjb yamls? | 08:59 |
| *** lezbar has joined #openstack-infra | 08:59 | |
| AJaeger | tosky: jobs are deployed with puppet, puppet basically runs every 30 mins. | 09:00 |
| tosky | ah, ok | 09:00 |
| AJaeger | tosky: So, my rule of thumb: an hour after a merge, it should be propagaded to all systems and it's safe to "recheck" | 09:00 |
| tosky | perfect :) | 09:00 |
| *** mohankumar has joined #openstack-infra | 09:01 | |
| *** Hal has joined #openstack-infra | 09:03 | |
| *** yaume has joined #openstack-infra | 09:03 | |
| *** Hal is now known as Guest37814 | 09:03 | |
| *** jyuso1 has quit IRC | 09:03 | |
| yolanda | nibalizer, i put a -1 on https://review.openstack.org/#/c/274252/1/templates/statusbot.config.erb . Is that a bug, or do i miss some dependent change where it changes the name of the parameter? | 09:04 |
| *** yamamoto_ has quit IRC | 09:04 | |
| *** zhurong has quit IRC | 09:06 | |
| *** salv-orlando has joined #openstack-infra | 09:07 | |
| *** fhubik has quit IRC | 09:08 | |
| *** zul has joined #openstack-infra | 09:11 | |
| *** yamamoto_ has joined #openstack-infra | 09:12 | |
| jesusaur | nibalizer: how was fossdem? | 09:12 |
| *** yamamoto_ has quit IRC | 09:13 | |
| *** jordanP has joined #openstack-infra | 09:13 | |
| *** zhenguo_ has joined #openstack-infra | 09:16 | |
| *** ildikov has joined #openstack-infra | 09:18 | |
| *** fbo_ is now known as fbo | 09:18 | |
| nibalizer | jesusaur: very nice | 09:20 |
| nibalizer | now at config mgmt camp | 09:20 |
| *** amotoki has quit IRC | 09:20 | |
| *** jistr has joined #openstack-infra | 09:20 | |
| *** yamamoto_ has joined #openstack-infra | 09:21 | |
| nibalizer | yolanda: huh i thought i updated this | 09:23 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-statusbot: Allow statusbot to take a hash of auth nicks https://review.openstack.org/274252 | 09:23 |
| nibalizer | updated :) | 09:23 |
| *** zul has quit IRC | 09:25 | |
| *** salv-orlando has quit IRC | 09:27 | |
| *** markmcclain has joined #openstack-infra | 09:31 | |
| *** sshnaidm has joined #openstack-infra | 09:31 | |
| *** zul has joined #openstack-infra | 09:32 | |
| openstackgerrit | Merged openstack-infra/project-config: Add openstack-salt project and jobs https://review.openstack.org/272469 | 09:32 |
| *** fhubik has joined #openstack-infra | 09:35 | |
| *** ociuhandu has quit IRC | 09:37 | |
| *** ajo has joined #openstack-infra | 09:37 | |
| openstackgerrit | Merged openstack-infra/project-config: Move glanceclient-dsvm-function to glanceclient https://review.openstack.org/273032 | 09:38 |
| *** markmcclain has quit IRC | 09:40 | |
| *** fhubik is now known as fhubik_brb | 09:41 | |
| *** fhubik_brb is now known as fhubik | 09:41 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove jobs from gantt and python-ganttclient https://review.openstack.org/273010 | 09:42 |
| *** ajo has quit IRC | 09:42 | |
| *** ajo has joined #openstack-infra | 09:43 | |
| *** acruz has joined #openstack-infra | 09:43 | |
| *** electrofelix has joined #openstack-infra | 09:44 | |
| *** matrohon has joined #openstack-infra | 09:45 | |
| *** arxcruz has quit IRC | 09:45 | |
| *** ashleighfarnham has joined #openstack-infra | 09:47 | |
| *** ajo has quit IRC | 09:48 | |
| *** ajo has joined #openstack-infra | 09:48 | |
| *** ajo has quit IRC | 09:49 | |
| *** markvoelker has joined #openstack-infra | 09:50 | |
| *** thorst has joined #openstack-infra | 09:50 | |
| *** zul has quit IRC | 09:51 | |
| *** ashleighfarnham has quit IRC | 09:52 | |
| *** ramishra has quit IRC | 09:52 | |
| *** ramishra_ is now known as ramishra | 09:53 | |
| *** markvoelker has quit IRC | 09:54 | |
| *** pblaho has joined #openstack-infra | 09:56 | |
| *** amotoki has joined #openstack-infra | 09:56 | |
| *** thorst has quit IRC | 09:57 | |
| *** BobBall has quit IRC | 09:58 | |
| *** BobBall has joined #openstack-infra | 09:59 | |
| *** vgridnev has joined #openstack-infra | 10:02 | |
| *** openstackgerrit has quit IRC | 10:02 | |
| *** openstackgerrit_ has joined #openstack-infra | 10:02 | |
| *** openstackgerrit_ has quit IRC | 10:03 | |
| *** salv-orlando has joined #openstack-infra | 10:03 | |
| *** zeih has quit IRC | 10:05 | |
| *** sc68cal__ has joined #openstack-infra | 10:07 | |
| *** yamamoto_ has quit IRC | 10:08 | |
| *** matrohon has quit IRC | 10:08 | |
| *** achanda has joined #openstack-infra | 10:09 | |
| *** matrohon has joined #openstack-infra | 10:10 | |
| *** dtardivel has joined #openstack-infra | 10:10 | |
| *** notnownikki has joined #openstack-infra | 10:13 | |
| *** achanda has quit IRC | 10:14 | |
| *** sc68cal__ is now known as sc68cal | 10:17 | |
| *** sc68cal is now known as Guest69164 | 10:18 | |
| *** Guest69164 has quit IRC | 10:19 | |
| *** Guest69164 has joined #openstack-infra | 10:19 | |
| *** mrmartin has joined #openstack-infra | 10:20 | |
| *** ttx_ has joined #openstack-infra | 10:21 | |
| *** mkoderer__ has joined #openstack-infra | 10:21 | |
| *** ttx has quit IRC | 10:23 | |
| mescanef | hello, please review https://review.openstack.org/#/c/269007/ - only WF+1 needed:-) | 10:24 |
| *** ttx_ is now known as ttx | 10:24 | |
| *** daemontool_ has joined #openstack-infra | 10:25 | |
| *** daemontool has quit IRC | 10:28 | |
| *** ldnunes has joined #openstack-infra | 10:29 | |
| *** rossella_s has quit IRC | 10:31 | |
| *** rossella_s has joined #openstack-infra | 10:32 | |
| *** jokke_ has quit IRC | 10:34 | |
| *** jokke_ has joined #openstack-infra | 10:34 | |
| *** marekd has quit IRC | 10:34 | |
| *** gildub has quit IRC | 10:36 | |
| mrmartin | morning | 10:39 |
| *** salv-orlando has quit IRC | 10:40 | |
| *** marekd has joined #openstack-infra | 10:42 | |
| *** christiana has quit IRC | 10:45 | |
| *** zul has joined #openstack-infra | 10:46 | |
| EmilienM | AJaeger: hey, when you got tome, can you look https://review.openstack.org/#/c/274137/ please ? I don't want to break something :-) | 10:46 |
| *** zz_dimtruck is now known as dimtruck | 10:47 | |
| *** deepakcs has joined #openstack-infra | 10:49 | |
| deepakcs | Hi infra cores, can someone take a look and bless : https://review.openstack.org/#/c/273326/ | 10:50 |
| *** salv-orlando has joined #openstack-infra | 10:50 | |
| deepakcs | johnthetubaguy: when u have time: https://review.openstack.org/#/c/273326/ | 10:50 |
| *** rfolco has joined #openstack-infra | 10:50 | |
| AJaeger | EmilienM: I commented already, did you see my note? | 10:52 |
| EmilienM | AJaeger: if you don't -1, I don't see it, sorry for that | 10:52 |
| EmilienM | AJaeger: don't hesitate to -1 me :-P | 10:53 |
| * EmilienM is not reading Gerrit e-mails, shamelessly :-) | 10:53 | |
| AJaeger | EmilienM: Ok, will give -1 instead of 0 and -2 instead of -1. Correct? | 10:53 |
| EmilienM | lool | 10:53 |
| EmilienM | AJaeger++ | 10:53 |
| mrmartin | hi guys | 10:54 |
| mrmartin | do we have an infra-core here? | 10:54 |
| deepakcs | AJaeger: when u have some time: https://review.openstack.org/#/c/273326/ | 10:55 |
| EmilienM | AJaeger: I was wondering the layout ordering, but I'll let you review it, in case I missed something | 10:55 |
| nibalizer | mrmartin: ish | 10:55 |
| mrmartin | hi nibalizer | 10:56 |
| mrmartin | so it is not sure, that the code is wrong, had you made the backup yesterday of ask.o.o db? | 10:56 |
| AJaeger | EmilienM: I replaced just the last entry and run a diff and it looked fine - but will double check once you submit it. | 10:56 |
| *** thorst has joined #openstack-infra | 10:56 | |
| AJaeger | deepakcs: I'd like to see PTLs +1 first but let me comment on that... | 10:56 |
| *** fhubik is now known as fhubik_brb | 10:56 | |
| mrmartin | I want a move-infra-cores to EU travel program. | 10:57 |
| mrmartin | :) | 10:57 |
| EmilienM | I think openstack bot is dead | 10:57 |
| *** ildikov has quit IRC | 10:57 | |
| EmilienM | AJaeger: https://review.openstack.org/#/c/274137/1 updated - not urgent | 10:57 |
| nibalizer | mrmartin: i didn't take a db backup yesterday no | 10:58 |
| mrmartin | nibalizer: can you do one, and copy it to ask-staging.o.o somewhere? | 10:58 |
| deepakcs | AJaeger: thanks | 10:59 |
| mrmartin | I'll try to restore there, and check whether the branch changes confused things there. | 10:59 |
| deepakcs | I pinged PTLs too, lets see :) | 10:59 |
| mrmartin | nibalizer: this is the etherpad https://etherpad.openstack.org/p/askbot-migration2 | 10:59 |
| AJaeger | EmilienM: will review later | 11:00 |
| EmilienM | no urgency for me, thanks | 11:00 |
| mrmartin | I started to write a better ops guide yesterday for ask.o.o but cannot finish due the turbulence on the plane. | 11:00 |
| *** dimtruck is now known as zz_dimtruck | 11:01 | |
| AJaeger | Is gerritbot dead? I don't see a notification here for EmilienM's update of 274137... | 11:02 |
| EmilienM | same | 11:02 |
| EmilienM | EmilienM | I think openstack bot is dead | 11:02 |
| nibalizer | hrm | 11:02 |
| *** thorst has quit IRC | 11:03 | |
| *** fhubik_brb is now known as fhubik | 11:03 | |
| AJaeger | nibalizer: did it crash after the import of I705c9f2384efcaf4398c6662acdf0cff4b6ed348 ? Or just not restart properly? | 11:03 |
| nibalizer | AJaeger: lookng | 11:05 |
| *** dims has joined #openstack-infra | 11:09 | |
| *** ociuhandu has joined #openstack-infra | 11:10 | |
| *** achanda has joined #openstack-infra | 11:11 | |
| *** tosky has quit IRC | 11:12 | |
| *** aysyd has joined #openstack-infra | 11:12 | |
| *** erlon has joined #openstack-infra | 11:13 | |
| *** Guest69164 has quit IRC | 11:13 | |
| *** matt6434 is now known as mattoliverau | 11:14 | |
| *** yamamoto has joined #openstack-infra | 11:17 | |
| *** achanda has quit IRC | 11:17 | |
| *** lifeless_ is now known as lifeless | 11:17 | |
| *** gnuoy_ has joined #openstack-infra | 11:19 | |
| *** gnuoy_ has quit IRC | 11:19 | |
| *** changzhi has quit IRC | 11:21 | |
| *** fhubik is now known as fhubik_brb | 11:21 | |
| *** Daisy has quit IRC | 11:22 | |
| nibalizer | AJaeger: so gerritbot in logs is humming along | 11:23 |
| *** yamamoto has quit IRC | 11:23 | |
| *** yamamoto has joined #openstack-infra | 11:24 | |
| *** jpr has joined #openstack-infra | 11:26 | |
| *** yamamoto has quit IRC | 11:28 | |
| *** yamamoto has joined #openstack-infra | 11:31 | |
| *** yamahata has joined #openstack-infra | 11:32 | |
| nibalizer | AJaeger: is it possible gerritbot just netsplit? | 11:35 |
| *** yamamoto has quit IRC | 11:36 | |
| *** jaosorior has joined #openstack-infra | 11:36 | |
| deepakcs | AJaeger: you mean i need to remove gate-tempest-dsvm-full-ceph from under devstack-jobs as well as the template itself, right ? | 11:40 |
| *** aarefiev has quit IRC | 11:48 | |
| *** markvoelker has joined #openstack-infra | 11:50 | |
| *** mrmartin has quit IRC | 11:51 | |
| AJaeger | deepakcs: If it's not needed anymore: Yes, remove it everywhere | 11:51 |
| deepakcs | AJaeger: ok done, just 1 Q i see some jobs under devstack-jobs and some aren't, whats the signifgicance of adding a job under devstack-jobs | 11:52 |
| deepakcs | AJaeger: in jenkins/jobs/devstack-gate.yaml | 11:52 |
| *** mohankumar_ has joined #openstack-infra | 11:52 | |
| *** mohankumar has quit IRC | 11:52 | |
| AJaeger | deepakcs: there's a lot of cargo cult and I don't have the history. If your job runs on several repos, you can add it but you don't need to... | 11:53 |
| nibalizer | AttributeError: 'GerritBot' object has no attribute 'reconnect' | 11:53 |
| nibalizer | interesting | 11:53 |
| *** openstackgerrit has joined #openstack-infra | 11:53 | |
| AJaeger | nibalizer: yes, that's missing. WE have to restart it, do our scripts not do it this way? | 11:53 |
| *** jlanoux has quit IRC | 11:53 | |
| *** openstackgerrit has quit IRC | 11:54 | |
| *** openstackgerrit_ has joined #openstack-infra | 11:54 | |
| nibalizer | :shrug: ? | 11:54 |
| *** openstackgerrit_ is now known as openstackgerrit | 11:55 | |
| *** markvoelker has quit IRC | 11:55 | |
| *** aarefiev has joined #openstack-infra | 11:55 | |
| deepakcs | AJaeger: ok, thanks, i sent another patch with ur issue addressed. https://review.openstack.org/#/c/273326/ | 11:55 |
| AJaeger | nibalizer: I'm only aware of http://docs.openstack.org/infra/system-config/irc.html#troubleshooting as help here... | 11:56 |
| *** flepied has joined #openstack-infra | 11:56 | |
| nibalizer | ya | 11:57 |
| *** flepied1 has quit IRC | 11:59 | |
| *** openstackgerrit has quit IRC | 11:59 | |
| *** esikachev has quit IRC | 12:00 | |
| *** thorst has joined #openstack-infra | 12:01 | |
| *** salv-orl_ has joined #openstack-infra | 12:03 | |
| *** baoli has joined #openstack-infra | 12:04 | |
| * AJaeger just noticed that the openstack-salt repository uses submodules, it has a .gitmodules file. | 12:04 | |
| AJaeger | I remember some discussion about submodules years ago, is that setup valid, fungi? | 12:05 |
| *** baoli has quit IRC | 12:05 | |
| *** yamahata has quit IRC | 12:06 | |
| *** salv-orlando has quit IRC | 12:06 | |
| nibalizer | AJaeger: so i've restarted the bot a few times | 12:07 |
| nibalizer | nuthin | 12:07 |
| *** openstackgerrit has joined #openstack-infra | 12:07 | |
| nibalizer | gerritbot: Joined channel #openstack-kiloeyes | 12:08 |
| AJaeger | ;( Sorry, no idea. Thanks for trying, nibalizer | 12:08 |
| *** thorst has quit IRC | 12:08 | |
| nibalizer | I think its working now | 12:08 |
| *** baoli has joined #openstack-infra | 12:08 | |
| *** baoli has quit IRC | 12:08 | |
| AJaeger | Yes, openstackgerrit is here... | 12:08 |
| AJaeger | Great! Thanks for fixing ;) | 12:09 |
| nibalizer | heh | 12:09 |
| nibalizer | i'll restart something several times any day :P | 12:09 |
| AJaeger | ;) | 12:10 |
| nibalizer | mrmartin.... you left :( | 12:10 |
| nibalizer | I am working on your db | 12:10 |
| *** exploreshaifali has joined #openstack-infra | 12:12 | |
| *** rguillebert has joined #openstack-infra | 12:13 | |
| *** esikachev has joined #openstack-infra | 12:15 | |
| *** gordc has joined #openstack-infra | 12:16 | |
| *** jaosorior has quit IRC | 12:21 | |
| openstackgerrit | Merged openstack-infra/project-config: Re-enable oslo translations https://review.openstack.org/274342 | 12:21 |
| *** jcoufal has joined #openstack-infra | 12:21 | |
| *** jaosorior has joined #openstack-infra | 12:21 | |
| openstackgerrit | Merged openstack-infra/project-config: gate-mistral-docker-buildimage has been moved to post https://review.openstack.org/274486 | 12:22 |
| *** esikachev has quit IRC | 12:23 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix Sahara config for DevStack on stable branches https://review.openstack.org/274549 | 12:23 |
| *** esikachev has joined #openstack-infra | 12:24 | |
| openstackgerrit | Merged openstack-infra/project-config: Enable requirements and make it voting for Kuryr https://review.openstack.org/274447 | 12:24 |
| openstackgerrit | Merged openstack-infra/project-config: Make gate-solum-python34 voting; add gate job https://review.openstack.org/273425 | 12:25 |
| *** christiana has joined #openstack-infra | 12:25 | |
| mordred | AJaeger: yup - submodules are totally valid - and in fact, gerrit can do neat things with them | 12:26 |
| openstackgerrit | Deepak C Shetty (deepakcs) proposed openstack-infra/project-config: Ceph CI: Move from hook based job to plugin based job https://review.openstack.org/273326 | 12:26 |
| mordred | AJaeger: we don't normally use them in openstack projects because intreacting with them as a dev can be confusing | 12:26 |
| openstackgerrit | Merged openstack-infra/project-config: Add translation jobs and script for translation of monasca-ui https://review.openstack.org/273361 | 12:27 |
| *** weshay has quit IRC | 12:32 | |
| *** fhubik_brb is now known as fhubik | 12:36 | |
| Zara | mordred: btw, the subscriptions page patch I linked you for storyboard.openstack.org has been merged. it's still pretty rudimentary. https://storyboard.openstack.org/#!/dashboard/subscriptions | 12:39 |
| *** weshay_xchat has joined #openstack-infra | 12:40 | |
| *** bswartz has joined #openstack-infra | 12:41 | |
| *** jlanoux has joined #openstack-infra | 12:41 | |
| *** tosky has joined #openstack-infra | 12:42 | |
| *** doug-fish has joined #openstack-infra | 12:42 | |
| *** jlanoux has quit IRC | 12:47 | |
| *** salv-orl_ has quit IRC | 12:47 | |
| *** thorst has joined #openstack-infra | 12:48 | |
| EmilienM | nibalizer: hey, are you still interested by https://review.openstack.org/219879 ? I think _ody was also looking at doing something like this | 12:49 |
| *** sshnaidm has quit IRC | 12:50 | |
| *** markvoelker has joined #openstack-infra | 12:51 | |
| *** zz_dimtruck is now known as dimtruck | 12:52 | |
| *** weshay_xchat is now known as weshay | 12:52 | |
| *** gnuoy_ has joined #openstack-infra | 12:53 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/log_processor: Load auto foward field prefix from config https://review.openstack.org/274645 | 12:53 |
| *** mrmartin has joined #openstack-infra | 12:53 | |
| *** hashar has joined #openstack-infra | 12:54 | |
| *** realitix has joined #openstack-infra | 12:55 | |
| *** markvoelker has quit IRC | 12:56 | |
| *** MarkAtwood has joined #openstack-infra | 12:56 | |
| *** jlanoux has joined #openstack-infra | 12:57 | |
| *** Anticime1 is now known as Anticimex | 12:58 | |
| *** jaosorior has quit IRC | 13:00 | |
| *** mrmartin has quit IRC | 13:00 | |
| *** gnuoy_ has quit IRC | 13:01 | |
| *** mrmartin has joined #openstack-infra | 13:01 | |
| *** dimtruck is now known as zz_dimtruck | 13:01 | |
| *** salv-orlando has joined #openstack-infra | 13:02 | |
| *** gnuoy_ has joined #openstack-infra | 13:03 | |
| *** zul has quit IRC | 13:03 | |
| *** zeih has joined #openstack-infra | 13:04 | |
| *** dims has quit IRC | 13:06 | |
| jroll | hey y'all, are we using pypi mirrors in CI now? | 13:06 |
| jroll | got a fun one: http://logs.openstack.org/62/274462/1/check/gate-tempest-dsvm-full/43c74f5/logs/devstacklog.txt.gz#_2016-02-01_12_12_09_606 | 13:06 |
| *** shardy has quit IRC | 13:06 | |
| jroll | it does exist on pypi https://pypi.python.org/pypi/python-ironicclient/1.1.0 | 13:07 |
| *** gnuoy_ has quit IRC | 13:07 | |
| nibalizer | EmilienM: ya i saw odys work | 13:09 |
| nibalizer | i thought his stuff was superior to what I was working with | 13:09 |
| *** hashar has quit IRC | 13:09 | |
| *** dims has joined #openstack-infra | 13:09 | |
| *** hashar has joined #openstack-infra | 13:10 | |
| *** krotscheck1 has joined #openstack-infra | 13:11 | |
| *** krotscheck1 is now known as krotscheck_nobou | 13:11 | |
| *** xek__ is now known as xek | 13:12 | |
| *** naggappan has quit IRC | 13:13 | |
| *** markvoelker has joined #openstack-infra | 13:14 | |
| odyssey4me | is it possible to have a tox env execute other tox envs? ie if I setup a 'linters' tox target, can I make that env simply execute the other already setup targets? | 13:15 |
| *** edmondsw has joined #openstack-infra | 13:15 | |
| *** zul has joined #openstack-infra | 13:16 | |
| odyssey4me | AJaeger ^ perhaps you know if that's possible - this is in relation to https://review.openstack.org/272723 which works, but could be simpler if a different approach was possible | 13:16 |
| *** wei-wang has joined #openstack-infra | 13:17 | |
| *** flwang1 has joined #openstack-infra | 13:17 | |
| *** mattt has joined #openstack-infra | 13:18 | |
| *** fhubik is now known as fhubik_brb | 13:19 | |
| *** exploreshaifali has quit IRC | 13:20 | |
| *** fhubik_brb is now known as fhubik | 13:21 | |
| *** fhubik has quit IRC | 13:21 | |
| *** ildikov has joined #openstack-infra | 13:23 | |
| *** Daisy has joined #openstack-infra | 13:23 | |
| openstackgerrit | Miles Gould proposed openstack/requirements: python-ironicclient 1.1.0 https://review.openstack.org/274462 | 13:23 |
| *** Jeffrey4l_ has quit IRC | 13:23 | |
| openstackgerrit | Sam Betts proposed openstack-infra/project-config: Add a tinyIPA non-voting test to Ironic https://review.openstack.org/269684 | 13:23 |
| krotscheck_nobou | Mirros: Looks like gra1, iad, ord, hp region b, and sjc are entirely out of rotation. The others appear to have some leftover instances still using them. | 13:26 |
| zeih | hi, can someone have a look on https://review.openstack.org/#/c/271983/ ? in zuul all tests passed but in there is no +2 from jenkins :( | 13:26 |
| *** baoli has joined #openstack-infra | 13:27 | |
| esikachev | hi! i am need requirements core for merge https://review.openstack.org/#/c/270676/ | 13:27 |
| *** diana_clarke has joined #openstack-infra | 13:29 | |
| *** piet has joined #openstack-infra | 13:30 | |
| openstackgerrit | Merged openstack/requirements: Enforce compatibility job for tacker-horizon https://review.openstack.org/271983 | 13:32 |
| AJaeger | odyssey4me: there's macro substitution and you can reference another one but what you want does not work AFAIU | 13:32 |
| AJaeger | thanks mordred | 13:33 |
| krotscheck_nobou | zeih: That patch appears to be merged? | 13:33 |
| zeih | now it has merged :) | 13:33 |
| odyssey4me | thanks AJaeger - so the approach I'm taking is the only way to make it work then? | 13:33 |
| AJaeger | odyssey4me: let me check later a bit more and then comment on the review | 13:33 |
| AJaeger | nibalizer, yolanda : Could either of you +2A this change for translations, please? https://review.openstack.org/#/c/274352/ | 13:34 |
| *** amrith is now known as _amrith_ | 13:35 | |
| realitix | Hello everyone, can someone helps me with my registration. I followed all the procedures. I have a launchpad account, gerrit account, openstack foundation, all with the same name, id, and email. But when I try a "git review". I obtain "ICLA contributor agreement requires current contact information". But already did it. | 13:37 |
| *** wznoinsk has joined #openstack-infra | 13:38 | |
| wznoinsk | hi infra | 13:38 |
| wznoinsk | could you have a quick look at https://review.openstack.org/#/c/269225/, could there be a problem with SCP when jenkins is asked to recheck? | 13:39 |
| wznoinsk | subsequest patchset 6 rechecks failed, a check on patchset 7 worked | 13:39 |
| *** kzaitsev_mb has joined #openstack-infra | 13:40 | |
| *** sshnaidm has joined #openstack-infra | 13:41 | |
| openstackgerrit | Beth Elwell proposed openstack-infra/storyboard: Amended documentation naming of installations https://review.openstack.org/274661 | 13:43 |
| andreaf | hi - I'd like to resume work on this log processor change https://review.openstack.org/#/c/222369/4 - but I'm not sure whether to continue here or on the log-processor repo instead (or both?) | 13:44 |
| *** [HeOS] is now known as HeOS | 13:45 | |
| AJaeger | yolanda: http://logs.openstack.org/25/269225/6/check/gate-intel-nfv-ci-tests-python27/825458e/console.html is again a "failed to upload" to /srv/static - is that disk causing problems again? Could you check, please? | 13:45 |
| AJaeger | yolanda: that's wznoinsk's comment from above | 13:46 |
| yolanda | hi AJaeger, i can take a look | 13:46 |
| yolanda | a bit more free now | 13:46 |
| *** yamamoto has joined #openstack-infra | 13:46 | |
| AJaeger | thanks, yolanda - and thanks for the reviews! | 13:46 |
| *** bauzas has quit IRC | 13:47 | |
| wznoinsk | AJaeger, thanks, it looks like scp sees the parent directory(ies) and doesn't need to create it but something is happning with creating the deeper dictory (no parent directory actually?) | 13:47 |
| *** rlandy has joined #openstack-infra | 13:47 | |
| *** Jeffrey4l has joined #openstack-infra | 13:47 | |
| wznoinsk | yolanda, AJaeger is there a launchpad space for these bugs? | 13:47 |
| openstackgerrit | Illia Khudoshyn proposed openstack-infra/project-config: Add gate job for Rally against Keystone v2 https://review.openstack.org/274668 | 13:48 |
| *** diana_clarke has quit IRC | 13:48 | |
| *** ashleighfarnham has joined #openstack-infra | 13:48 | |
| mrmartin | hi yolanda | 13:49 |
| openstackgerrit | Merged openstack-infra/project-config: Do not sync translations: django_openstack_auth/designate-dashbaord https://review.openstack.org/274352 | 13:49 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use new translation setup for all python projects https://review.openstack.org/274421 | 13:50 |
| AJaeger | wznoinsk: we use storyboard.openstack.org | 13:50 |
| yolanda | wzoinsk, AJaeger, i don't see disk errors on static today | 13:50 |
| *** ikhudoshyn has joined #openstack-infra | 13:51 | |
| *** pradk has joined #openstack-infra | 13:52 | |
| *** pradk has quit IRC | 13:52 | |
| *** ashleighfarnham has quit IRC | 13:53 | |
| *** cbader has quit IRC | 13:54 | |
| *** jaypipes has joined #openstack-infra | 13:54 | |
| *** yamamoto has quit IRC | 13:55 | |
| wznoinsk | yolanda, can we turn on some 'debuggin' mode from inside the tox.ini for scp/jenkins? | 13:57 |
| *** yamamoto has joined #openstack-infra | 14:03 | |
| *** bauzas has joined #openstack-infra | 14:03 | |
| *** jaypipes has quit IRC | 14:03 | |
| *** yamamoto has quit IRC | 14:05 | |
| *** ayoung has joined #openstack-infra | 14:06 | |
| *** yamamoto has joined #openstack-infra | 14:08 | |
| *** amitgandhinz has joined #openstack-infra | 14:09 | |
| *** cbader has joined #openstack-infra | 14:10 | |
| openstackgerrit | Merged openstack/requirements: Bump upper constraint of futurist to 0.10.0 https://review.openstack.org/273246 | 14:10 |
| *** zz_dimtruck is now known as dimtruck | 14:12 | |
| *** jpr has quit IRC | 14:13 | |
| *** zul has quit IRC | 14:13 | |
| openstackgerrit | Sam Betts proposed openstack-infra/project-config: Add a tinyIPA non-voting test to Ironic https://review.openstack.org/269684 | 14:13 |
| *** julim has joined #openstack-infra | 14:14 | |
| EmilienM | AJaeger: replied | 14:14 |
| *** nelsnelson has joined #openstack-infra | 14:16 | |
| AJaeger | EmilienM: My highlight was that it includes syntax tests as well - but your commit message has fewer tests AFAIU | 14:16 |
| EmilienM | AJaeger: oh... ok it's okay for me, we'll have lint tests in all the cases, so we're good | 14:17 |
| *** nelsnels_ has quit IRC | 14:17 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Remove legacy pypi_trusted_hosts https://review.openstack.org/270930 | 14:17 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Removed pypi.<region> mirror manifests https://review.openstack.org/273518 | 14:17 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Update bandersnatch documentation https://review.openstack.org/273519 | 14:17 |
| *** fawadkhaliq has joined #openstack-infra | 14:17 | |
| *** sabeen1 has joined #openstack-infra | 14:18 | |
| *** fawadkhaliq has quit IRC | 14:18 | |
| AJaeger | EmilienM: could you update the commit message, please? | 14:18 |
| EmilienM | AJaeger: of course | 14:18 |
| AJaeger | krotscheck_nobou: do you have any ideas why python-ironicclient 1.1.0 is not mirrored? | 14:18 |
| AJaeger | krotscheck_nobou: see failures of https://review.openstack.org/#/c/274462/ | 14:19 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: zuul/layout: optimize puppet jobs https://review.openstack.org/274137 | 14:19 |
| *** krotscheck_nobou has quit IRC | 14:19 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Added afs to wheel mirror slaves https://review.openstack.org/273054 | 14:19 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Add AFS and Admin keytab to release slave. https://review.openstack.org/273538 | 14:19 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Added AFS keytab to wheel slave https://review.openstack.org/273206 | 14:19 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Added conditional install statements for kernel header packages https://review.openstack.org/273205 | 14:19 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Added wheel hosting for AFS mirror slave https://review.openstack.org/270979 | 14:19 |
| *** krotscheck1 has joined #openstack-infra | 14:19 | |
| * krotscheck1 peers at the bot | 14:20 | |
| *** fawadkhaliq has joined #openstack-infra | 14:20 | |
| *** nelsnelson has quit IRC | 14:20 | |
| AJaeger | krotscheck1: python-ironicclient 1.1.0 was released yesterday... | 14:20 |
| *** nelsnelson has joined #openstack-infra | 14:21 | |
| Daisy | Hi, EmilienM. Can I get your support to https://review.openstack.org/#/c/274090/ ? It's to create a puppet module under openstack-infra to support the translation check website. | 14:21 |
| AJaeger | Daisy: you need only fungi's +1 and have it. This is a pure formality now... | 14:22 |
| *** wendar_ is now known as wendar | 14:22 | |
| *** peristeri has joined #openstack-infra | 14:22 | |
| *** tiswanso has joined #openstack-infra | 14:22 | |
| krotscheck1 | AJaeger: ....and? | 14:22 |
| *** sabeen3 has joined #openstack-infra | 14:22 | |
| *** mohankumar_ has quit IRC | 14:22 | |
| AJaeger | see failures of https://review.openstack.org/#/c/274462/ - it cannot find the new release | 14:22 |
| *** mohankumar_ has joined #openstack-infra | 14:22 | |
| krotscheck1 | AJaeger: Got it. | 14:22 |
| krotscheck1 | Checking | 14:22 |
| krotscheck1 | AJaeger: I'm guessing that bandersnatch is stuck. | 14:23 |
| AJaeger | Daisy: I commented, ttx mixed up the ownership. | 14:24 |
| krotscheck1 | AJaeger: That's not something I have the ACL's, or experience, to fix. | 14:24 |
| Daisy | AJaeger: ok. Thank you. | 14:24 |
| AJaeger | ttx, https://review.openstack.org/#/c/274090/4 | 14:24 |
| AJaeger | krotscheck1: ok, we have to wait for jeblair then I guess | 14:24 |
| Daisy | Sorry, EmilienM. | 14:24 |
| *** sabeen1 has quit IRC | 14:25 | |
| *** dguitarbite has quit IRC | 14:25 | |
| *** dguitarbite has joined #openstack-infra | 14:26 | |
| krotscheck1 | AJaeger: You might be able to get an initial diagnosis on mirror-update.o.o by looking at the log. | 14:26 |
| EmilienM | Daisy: no problem! | 14:26 |
| EmilienM | I'll +1 for fun | 14:27 |
| AJaeger | thanks, EmilienM ! | 14:27 |
| *** dtantsur|afk is now known as dtantsur | 14:27 | |
| *** krotscheck1 has quit IRC | 14:28 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/puppet-log_processor: Create auto forwardable parameters https://review.openstack.org/222369 | 14:29 |
| *** krotscheck1 has joined #openstack-infra | 14:29 | |
| *** eharney has joined #openstack-infra | 14:29 | |
| *** pabelanger has quit IRC | 14:30 | |
| *** pabelanger has joined #openstack-infra | 14:30 | |
| *** tiswanso has quit IRC | 14:31 | |
| *** jsavak has joined #openstack-infra | 14:31 | |
| *** rossella_s has quit IRC | 14:31 | |
| *** tiswanso has joined #openstack-infra | 14:31 | |
| *** rossella_s has joined #openstack-infra | 14:32 | |
| *** Daisy has quit IRC | 14:32 | |
| *** diana_clarke has joined #openstack-infra | 14:32 | |
| *** esikachev has quit IRC | 14:33 | |
| * krotscheck1 has been unable to find that log in logstash | 14:34 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/puppet-log_processor: Create auto forwardable parameters https://review.openstack.org/222369 | 14:37 |
| *** mrmartin has quit IRC | 14:39 | |
| krotscheck1 | AJaeger: If I call zuul-clone: project: openstack/requirements, what directory will that end up in? `pwd`/openstack/requirements? | 14:42 |
| AJaeger | odyssey4me: you can do something like "commands = {[testenv:pep8]commands}" - but it only works if {posargs} is not used. You should be able to add several of these substitution. Please try it out locally... | 14:42 |
| AJaeger | krotscheck1: yes, AFAIK | 14:42 |
| odyssey4me | AJaeger :) thanks, let me try that out | 14:43 |
| krotscheck1 | AJaeger: Gotcha, thnks | 14:43 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add IRC notification for windmill https://review.openstack.org/274694 | 14:45 |
| *** zul has joined #openstack-infra | 14:45 | |
| *** deepakcs has quit IRC | 14:46 | |
| *** daemontool has joined #openstack-infra | 14:47 | |
| *** daemontool_ has quit IRC | 14:47 | |
| ttx | AJaeger: +2 | 14:49 |
| AJaeger | thanks, ttx | 14:50 |
| *** dimtruck is now known as zz_dimtruck | 14:50 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add missing node for windmill https://review.openstack.org/274697 | 14:51 |
| *** piet has quit IRC | 14:52 | |
| *** daemontool has quit IRC | 14:53 | |
| *** aopincar has quit IRC | 14:53 | |
| *** yamamoto has quit IRC | 14:54 | |
| jroll | fun one: http://logs.openstack.org/62/274462/1/check/gate-tempest-dsvm-full/43c74f5/logs/devstacklog.txt.gz#_2016-02-01_12_12_09_606 it does exist on pypi https://pypi.python.org/pypi/python-ironicclient/1.1.0 | 14:54 |
| jroll | I suspect pypi mirrors in use and not syncing right? | 14:54 |
| openstackgerrit | Frank Kloeker proposed openstack-infra/puppet-translation_checksite: Puppet module to provide a translation checksite https://review.openstack.org/274701 | 14:55 |
| *** krotscheck1 has quit IRC | 14:57 | |
| *** kgiusti has joined #openstack-infra | 14:57 | |
| *** MCoLo has quit IRC | 14:57 | |
| *** krotscheck1 has joined #openstack-infra | 14:57 | |
| *** peristeri has quit IRC | 14:58 | |
| *** piet has joined #openstack-infra | 14:58 | |
| openstackgerrit | Beth Elwell proposed openstack-infra/storyboard: Amended documentation naming of installations https://review.openstack.org/274661 | 14:58 |
| *** peristeri has joined #openstack-infra | 14:58 | |
| *** alivigni has quit IRC | 14:58 | |
| *** _amrith_ is now known as amrith | 14:59 | |
| *** daemontool has joined #openstack-infra | 14:59 | |
| jroll | krotscheck1: I know you've been working on mirror things, any thoughts on that ^ | 14:59 |
| krotscheck1 | jroll: The storyboard patch? | 15:00 |
| openstackgerrit | Illia Khudoshyn proposed openstack-infra/project-config: Add gate job for Rally against Keystone v2 https://review.openstack.org/274668 | 15:01 |
| *** ajo has joined #openstack-infra | 15:01 | |
| krotscheck1 | jroll: Or the python-ironicclient problem? | 15:01 |
| jroll | krotscheck1: the ironicclient thing | 15:01 |
| krotscheck1 | jroll: It's likely because bandersnatch on mirror-update.openstack.org got stuck on a package. | 15:02 |
| fungi | AJaeger: we don't officially support any workflows involving git submodules and actively discourage their use in our environment, but i really don't know what happens if you push up a .gitmodules file in your repo and start trying to refer to other projects in gerrit with it. presumably it works the same way as the openstack/openstack repo is doing, though that one's really a special case | 15:02 |
| jroll | krotscheck1: okay, how do we unwedge that | 15:02 |
| krotscheck1 | jroll: I don't have the ACL's to troubleshoot that. | 15:02 |
| *** amotoki has quit IRC | 15:02 | |
| jroll | ok | 15:02 |
| krotscheck1 | jroll: I've already pinged jeblair to look into it once he gets online | 15:02 |
| jroll | krotscheck1: awesome, thank you much | 15:02 |
| krotscheck1 | jroll: It's all in backscroll. | 15:02 |
| * krotscheck1 is rather annoyed that this irc client of his keeps disconnecting. | 15:03 | |
| jroll | krotscheck1: yeah, just doing the monday morning bump; our gate's down at the moment due to this | 15:04 |
| *** [1]Thelo has joined #openstack-infra | 15:04 | |
| *** sridhar_ram has joined #openstack-infra | 15:04 | |
| krotscheck1 | fungi might be able to look into it. fungi do you have the time & expertise to poke at bandersnatch? | 15:04 |
| krotscheck1 | jroll: Upside of the new mirrors, they're actually all in sync. Downside: They're actually all in sync. | 15:05 |
| *** regXboi has joined #openstack-infra | 15:05 | |
| jroll | heh | 15:05 |
| openstackgerrit | Jim Rollenhagen proposed openstack/requirements: python-ironicclient 1.1.0 https://review.openstack.org/274462 | 15:06 |
| *** Thelo has quit IRC | 15:07 | |
| *** [1]Thelo is now known as Thelo | 15:07 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 15:09 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Add wheel mirror to configure_mirror.sh https://review.openstack.org/267117 | 15:09 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added wheel-release job https://review.openstack.org/273549 | 15:09 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Create jobs for a wheel mirror https://review.openstack.org/164927 | 15:09 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for kilo 2015.1.4 version bump bug 1540411 https://review.openstack.org/274705 | 15:09 |
| openstack | bug 1540411 in neutron "kilo: ValueError: git history requires a target version of pbr.version.SemanticVersion(2015.1.4), but target version is pbr.version.SemanticVersion(2015.1.3)" [Critical,In progress] https://launchpad.net/bugs/1540411 - Assigned to Dave Walker (davewalker) | 15:09 |
| *** NobodyCa1 has joined #openstack-infra | 15:09 | |
| *** BoneScratcher has joined #openstack-infra | 15:11 | |
| *** aysyd has quit IRC | 15:11 | |
| *** burgerk has joined #openstack-infra | 15:11 | |
| *** aysyd has joined #openstack-infra | 15:11 | |
| *** BoneScratcher has quit IRC | 15:12 | |
| *** placko has quit IRC | 15:12 | |
| AJaeger | fungi, should we tell the salt guys - or wait and see? | 15:13 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add IRC notification for windmill https://review.openstack.org/274694 | 15:13 |
| *** mriedem has joined #openstack-infra | 15:13 | |
| *** Daisy has joined #openstack-infra | 15:14 | |
| *** denisra_ is now known as denisra | 15:15 | |
| *** woodster_ has joined #openstack-infra | 15:16 | |
| *** rbrndt has joined #openstack-infra | 15:17 | |
| *** mohankumar_ has quit IRC | 15:17 | |
| pabelanger | AJaeger: jeblair: Are we still good on landing 264994? Adds templating support to grafana for nodepool | 15:18 |
| *** tiswanso has quit IRC | 15:18 | |
| fungi | krotscheck1: jroll: in a meeting... summary? | 15:18 |
| *** achanda has joined #openstack-infra | 15:18 | |
| *** Daisy has quit IRC | 15:18 | |
| krotscheck1 | fungi: python-ironicclient never made it to the AFS mirrors. Bandersnatch likely stuck on mirror-update.o.o. Ironic gate wedged as a result. | 15:19 |
| openstackgerrit | Merged openstack-infra/storyboard: Amended documentation naming of installations https://review.openstack.org/274661 | 15:19 |
| pabelanger | AJaeger: did you hear anything more about Fedora nodes on Friday? | 15:19 |
| pabelanger | AJaeger: I didn't see what happen to them | 15:19 |
| krotscheck1 | fungi: Amendment: python-ironicclient 1.1.0 was released yesterday. That particular version isn't on the mirrors. | 15:19 |
| *** yamamoto has joined #openstack-infra | 15:20 | |
| AJaeger | pabelanger: don't remeber hearing anything more | 15:21 |
| AJaeger | pabelanger: if jeblair is happy wieth 264994, so am I - but wanted him to +2 first since he had objections - to avoid accidental merge | 15:21 |
| fungi | krotscheck1: i was away during the implementation. what's the hostname where we're running bandersnatch now? | 15:22 |
| anteaya | fungi: welcome back | 15:22 |
| prometheanfire | greghaynes: https://review.openstack.org/#/c/273772/ and https://review.openstack.org/#/c/273795/ I think is all | 15:22 |
| krotscheck1 | fungi: mirror-update.openstack.org | 15:22 |
| krotscheck1 | I think | 15:23 |
| pabelanger | AJaeger: okay, will follow up with ianw again | 15:23 |
| fungi | krotscheck1: thanks | 15:23 |
| *** dprince has joined #openstack-infra | 15:23 | |
| *** achanda has quit IRC | 15:23 | |
| fungi | anteaya: thanks, i was back on friday afternoon, though i'll admit i wasn't following things well since i was still catching up | 15:23 |
| jroll | thank you fungi, krotscheck1 | 15:24 |
| anteaya | fungi: yup, I hear that | 15:24 |
| *** followinfrared has quit IRC | 15:24 | |
| *** links has quit IRC | 15:24 | |
| anteaya | I just finished the third-party meeting and have doubts about my performance today as I am not feeling well | 15:24 |
| anteaya | going to have a nap and see how I feel | 15:24 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for kilo 2015.1.4 version bump bug 1540411 https://review.openstack.org/274705 | 15:26 |
| openstack | bug 1540411 in neutron "kilo: ValueError: git history requires a target version of pbr.version.SemanticVersion(2015.1.4), but target version is pbr.version.SemanticVersion(2015.1.3)" [Critical,In progress] https://launchpad.net/bugs/1540411 - Assigned to Dave Walker (davewalker) | 15:26 |
| AJaeger | anteaya: get well soon! | 15:26 |
| fungi | infra-root: looks like we have a stuck vldb lock. i'll try to start debugging when my current meeting wraps up, but this probably needs someone with deeper afs mojo than i possess (Bandersnatch completed successfully, running vos release. Could not lock the VLDB entry for the volume 536870931. VLDB: vldb entry is already locked) | 15:26 |
| *** dprince has quit IRC | 15:26 | |
| *** EricGonczer_ has joined #openstack-infra | 15:27 | |
| *** Daisy has joined #openstack-infra | 15:27 | |
| nibalizer | thats maybe related to the vos release I ran to add more replication to the pypi mirror | 15:27 |
| krotscheck1 | ...ahhhh | 15:28 |
| ikhudoshyn | Hi everybody! There is a small patch adding one more gate job for Rally https://review.openstack.org/#/c/274668 Could somebody please review it? | 15:30 |
| *** achanda has joined #openstack-infra | 15:30 | |
| *** ayoung has quit IRC | 15:30 | |
| ikhudoshyn | Is it a right place to ask here? | 15:30 |
| *** tiswanso has joined #openstack-infra | 15:31 | |
| fungi | nibalizer: first occurrence in the log is from the 2016-01-30 00:40 utc run | 15:31 |
| fungi | so friday evening your time | 15:32 |
| nibalizer | http://paste.openstack.org/show/485622/ | 15:37 |
| sdague | the lack of HP cloud is pretty noticable in the test load this morning. Bummer to be back at 600 nodes | 15:37 |
| nibalizer | I don't know how to tell if it is still proceeding or if its locked | 15:38 |
| nibalizer | eventually the ssh I was running vos release in closed | 15:38 |
| *** harlowja_at_home has joined #openstack-infra | 15:38 | |
| *** zeih has quit IRC | 15:39 | |
| *** mtanino has joined #openstack-infra | 15:39 | |
| *** zeih has joined #openstack-infra | 15:40 | |
| sdague | krotscheck1 / fungi - the mirrors aren't serving wheels yet? | 15:40 |
| *** achanda has quit IRC | 15:41 | |
| jeblair | o/ | 15:42 |
| *** Sukhdev has joined #openstack-infra | 15:43 | |
| nibalizer | fungi: it looks like maybe we could remsite the syncing thing | 15:44 |
| jeblair | nono | 15:44 |
| jeblair | don't remsite | 15:44 |
| jeblair | it just needs to be continued | 15:44 |
| nibalizer | ohai jeblair | 15:44 |
| *** zeih has quit IRC | 15:44 | |
| jeblair | i believe the initial copying of the data completed, but since vos release was interrupted, the flags weren't cleaned up | 15:45 |
| *** dalgaaf has joined #openstack-infra | 15:45 | |
| openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: Index tags in search https://review.openstack.org/274723 | 15:45 |
| jeblair | if we urgently need updated pypi, we can switch the mirrors to serve the rw volume | 15:45 |
| fungi | it sounds pretty urgent. somehow (i'm unclear on the specifics) ironic's jobs have grown a dependency on an ironicclient release which happened over the weekend | 15:46 |
| fungi | jroll can likely elaborate | 15:46 |
| openstackgerrit | Dmitry Tantsur proposed openstack/diskimage-builder: Mark ironic-discoverd-ramdisk as deprecated in favor of ironic-agent https://review.openstack.org/270267 | 15:48 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Temporarily switch to AFS RW mirrors https://review.openstack.org/274729 | 15:49 |
| jeblair | while that's winding through, i'd love for someone to explain how a change landed that broke a gate. | 15:50 |
| *** pradk has joined #openstack-infra | 15:50 | |
| fungi | jroll: ^ ? | 15:50 |
| AJaeger | AFAIR ironic merged a change that needs a new ironicclient release - and they were forced to release ironicclient to unblock their gate - and now it'S blocked since the new ironicclient client cannot get installed. | 15:50 |
| AJaeger | jroll: can you give more details, please? | 15:50 |
| jeblair | how did "ironic merged a change that needs a new ironicclient release" happen? | 15:50 |
| devananda | what? | 15:51 |
| jroll | jeblair: so | 15:51 |
| jroll | devstack removed keystone v2 | 15:51 |
| devananda | I think this is the devstack thing | 15:51 |
| AJaeger | jeblair: I don't have full story, that was my impression from trying to get something related in... | 15:51 |
| devananda | ya, that | 15:51 |
| jroll | instead of reverting that, we fixed our client to use v3 | 15:51 |
| AJaeger | Ah... | 15:51 |
| jroll | (which is a thing that should happen anyway) | 15:51 |
| stevemar | jroll: devstack is reverting that change | 15:52 |
| jroll | sdague has ALSO proposed a revert | 15:52 |
| jroll | but, we still want to release a client, regardless | 15:52 |
| jroll | which is done | 15:52 |
| jroll | and the requirements update is failing everything, because the new release is not in the mirrors | 15:52 |
| jroll | fungi: AJaeger jeblair ^ does that cover it? | 15:52 |
| *** daemontool_ has joined #openstack-infra | 15:52 | |
| jeblair | i understand why the requirements update is failing -- but what else is failing? | 15:52 |
| fungi | makes sense. so we should probably promote the revert in devstack too | 15:53 |
| jroll | relevant logs: http://logs.openstack.org/62/274462/1/check/gate-tempest-dsvm-full/43c74f5/logs/devstacklog.txt.gz#_2016-02-01_12_12_09_606 | 15:53 |
| fungi | i'm guessing devstack changes aren't gated on ironic jobs | 15:53 |
| jroll | jeblair: ironic jobs that use old ironicclient that is keystone v2 only | 15:53 |
| jroll | correct | 15:53 |
| krotscheck1 | sdague: nope. | 15:53 |
| clarkb | jroll your client should support both right? | 15:53 |
| jroll | clarkb: it should. it does in the release that went out this weekend. | 15:54 |
| krotscheck1 | sdague: Eyeballs appreciated https://review.openstack.org/#/q/(topic:wheel_mirror)+status:open+branch:master | 15:54 |
| devananda | clarkb: the changes do support both | 15:54 |
| openstackgerrit | Zara proposed openstack-infra/storyboard-webclient: Index tags in search https://review.openstack.org/274723 | 15:54 |
| jroll | clarkb: this release isn't in the mirrors and thus can't be put into g-r and u-c | 15:54 |
| *** daemontool has quit IRC | 15:54 | |
| jroll | because tests fail on the patch to do so | 15:54 |
| AJaeger | 274462 is currently in the check queue but failing, needs a restart | 15:54 |
| jeblair | so the missing piece is the devstack-ironic check, which i imagine is intentionally missing. | 15:55 |
| jroll | jeblair: correct | 15:55 |
| jeblair | this is an unfortunate consequence of that design | 15:55 |
| jroll | ouru gate isn't stable enough to be there, unfortunately | 15:55 |
| jroll | our* | 15:55 |
| jroll | we're working on it. | 15:55 |
| jeblair | nibalizer: want to +3 https://review.openstack.org/274729 ? | 15:56 |
| piet | Are any of the operator/admins in this channel interested in participating in a study on mobile use cases? We're kind of hurting for folks to interview. This is for the vahana project. | 15:56 |
| *** salv-orlando has quit IRC | 15:57 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add allow-nonvoting key https://review.openstack.org/274735 | 15:58 |
| *** zul has quit IRC | 15:58 | |
| *** rcernin has quit IRC | 15:58 | |
| jeblair | fungi: i see you started looking into the vldb thing -- aiui, vos release 1) locks the volumes, 2) sets some flags on them, 3) copies the data, 4) unsets the flags, 5) unlocks the volume | 15:59 |
| jeblair | fungi: the vos release command was likely terminated during 3, so we're stuck at 4 | 15:59 |
| nibalizer | jeblair: done | 15:59 |
| *** tswanson_ has quit IRC | 15:59 | |
| jeblair | fungi: i believe there are forms of vos release that can continue the process, but i haven't use them yet | 15:59 |
| fungi | that makes sense. my 1500 meeting just wrapped so i'm taking a closer look at the log from friday now | 16:00 |
| sdague | so the important thing to note, it didn't break "the gate". It broke some subset of projects outside the devstack in tree list. | 16:00 |
| jeblair | yeah, the 'gate' is why i didn't worry about this happening | 16:01 |
| *** markmcclain has joined #openstack-infra | 16:01 | |
| *** Swanson has joined #openstack-infra | 16:01 | |
| jeblair | fungi: (this is why the auto-releases haven't worked since friday -- that's when nibalizer started the release to the new site -- it was correctly locked while moving data) | 16:02 |
| jeblair | it only finished 10 hours ago | 16:02 |
| fungi | oh! | 16:02 |
| *** jsavak has quit IRC | 16:02 | |
| fungi | wow, that did take a while | 16:02 |
| fungi | that was a local rsync between directories on the same filesystem? | 16:03 |
| *** jsavak has joined #openstack-infra | 16:03 | |
| jeblair | yeah; i'm thinking we might want to profile iad instead of ord as a potential second site | 16:03 |
| *** mrmartin has joined #openstack-infra | 16:03 | |
| *** fawadkhaliq has quit IRC | 16:03 | |
| jeblair | fungi: no, it was a full copy of the 230G volume from dfw to ord | 16:03 |
| fungi | that makes more sense | 16:03 |
| jeblair | still not great, only got ~12mbit | 16:04 |
| jeblair | there's room for improvement, but once the initial is done, the incrementals should be faster | 16:04 |
| openstackgerrit | daisy-ycguo proposed openstack-infra/puppet-translation_checksite: Puppet module to provide a translation checksite https://review.openstack.org/274701 | 16:05 |
| fungi | my math agrees with yours. that's definitely not a great sustained rate. i wonder if ssh was cpu-bound on one end? | 16:06 |
| jeblair | fungi: this was afs, not ssh | 16:06 |
| fungi | oh, right, udp too? | 16:07 |
| jeblair | yup | 16:07 |
| *** nmagnezi has quit IRC | 16:07 | |
| *** vgridnev has quit IRC | 16:07 | |
| *** abregman has quit IRC | 16:07 | |
| jeblair | fungi: i'm looking into what we need to clean up | 16:09 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for magnum API test timeout https://review.openstack.org/274744 | 16:10 |
| openstackgerrit | Illia Khudoshyn proposed openstack-infra/project-config: Add gate job for Rally against Keystone v2 https://review.openstack.org/274668 | 16:13 |
| openstackgerrit | Merged openstack-infra/system-config: Temporarily switch to AFS RW mirrors https://review.openstack.org/274729 | 16:14 |
| odyssey4me | AJaeger much cleaner, thanks to you: https://review.openstack.org/272723 | 16:14 |
| openstackgerrit | Steve Martinelli proposed openstack/requirements: bump oslo.config in upper constraints https://review.openstack.org/274748 | 16:15 |
| *** mriedem is now known as mriedem_away | 16:15 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add allow-nonvoting key https://review.openstack.org/274735 | 16:15 |
| *** krotscheck1 has quit IRC | 16:15 | |
| *** esp has quit IRC | 16:16 | |
| pabelanger | yolanda: do you mind approving 274697 ? Missing node typo | 16:17 |
| *** NobodyCam has quit IRC | 16:17 | |
| *** devananda has quit IRC | 16:17 | |
| *** jesusaurus has quit IRC | 16:18 | |
| *** zaro has quit IRC | 16:18 | |
| *** mrmartin has quit IRC | 16:18 | |
| *** samueldmq has quit IRC | 16:18 | |
| *** lxsli has quit IRC | 16:18 | |
| *** NobodyCa1 has quit IRC | 16:18 | |
| *** tcammann1 has quit IRC | 16:18 | |
| *** anteaya has quit IRC | 16:18 | |
| openstackgerrit | Victor Stinner proposed openstack/requirements: Bump oslo.context to 2.0 in upper constraints https://review.openstack.org/274758 | 16:18 |
| *** cody-somerville- has quit IRC | 16:19 | |
| *** tcammann_ has quit IRC | 16:19 | |
| openstackgerrit | Victor Stinner proposed openstack/requirements: Bump oslo.concurrency to 3.4.0 in upper constraint https://review.openstack.org/274760 | 16:20 |
| *** devananda has joined #openstack-infra | 16:22 | |
| *** fedexo has joined #openstack-infra | 16:22 | |
| *** tongli has joined #openstack-infra | 16:22 | |
| *** NobodyCam has joined #openstack-infra | 16:23 | |
| jeblair | fungi: i'm going to unlock and release again (in screen this time) | 16:24 |
| openstackgerrit | Frank Kloeker proposed openstack-infra/puppet-translation_checksite: fix puppet lint errors https://review.openstack.org/274762 | 16:25 |
| *** bpokorny has joined #openstack-infra | 16:26 | |
| realitix | Hello Infra. Can someone take a look at my gerrit account. I can't push because of contact form but I already did all the steps. My username: jsbevilacqua | 16:26 |
| jeblair | okay, probably should have grabbed the bandersnatch lock before doing that | 16:26 |
| *** flwang1 has quit IRC | 16:28 | |
| *** tosky has quit IRC | 16:28 | |
| *** bpokorny has quit IRC | 16:28 | |
| *** _nadya_ has quit IRC | 16:28 | |
| *** bpokorny has joined #openstack-infra | 16:29 | |
| *** sbalukoff has quit IRC | 16:30 | |
| fungi | realitix: it would be helpful to confirm that when you say "all the steps" you mean http://docs.openstack.org/infra/manual/developers.html#account-setup and not something you found on a random blog somewhere | 16:31 |
| realitix | Ok I look at your guide and I answer to you in 2 minutes | 16:32 |
| *** tosky has joined #openstack-infra | 16:32 | |
| *** jistr has quit IRC | 16:33 | |
| openstackgerrit | Tim Birkett proposed openstack-infra/jenkins-job-builder: Add trigger for RabbitMQ trigger module https://review.openstack.org/273833 | 16:34 |
| fungi | realitix: for the record, i see two accounts in gerrit which look like they're probably both yours (so a duplicate account situation). the older one has username:realitix while the newer one is username:jsbevilacqua (both with the same gmail.com e-mail address) | 16:35 |
| realitix | Yes | 16:36 |
| realitix | Ok | 16:36 |
| *** wei-wang has quit IRC | 16:36 | |
| realitix | can you merge the two account ? | 16:36 |
| fungi | i can deactivate one and make it so you're only logging into the other, i just need to know which you want to use now | 16:37 |
| realitix | OK so i want to use realitix pseudo | 16:37 |
| *** krotscheck1 has joined #openstack-infra | 16:37 | |
| ikhudoshyn | AJaeger: I've updated timeout for the job. I think 60 min would be enough https://review.openstack.org/#/c/274668/ | 16:37 |
| realitix | not jsbevilacqua | 16:37 |
| krotscheck1 | Question: My current approach for wheel mirrors includes a daily execution of vos release - is that actually a sane thing to do given what we've just learned? | 16:38 |
| fungi | realitix: and right now your account id number at https://review.openstack.org/#/settings/ when you're logged in is 18807 | 16:38 |
| realitix | Iyes | 16:38 |
| realitix | If you disable jsbevilacqua, have I to update my launchpad id ? (currently jsbevilacqua) | 16:38 |
| openstackgerrit | daisy-ycguo proposed openstack-infra/puppet-translation_checksite: Puppet module to provide a translation checksite https://review.openstack.org/274701 | 16:39 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 16:39 | |
| fungi | krotscheck1: if the volume bandersnatch is writing to is the same volume the update workers write into, then we may need some lock waiting/retrying there | 16:39 |
| fungi | realitix: when i'm done you won't need to change anything in launchpad, no | 16:39 |
| *** jlanoux has quit IRC | 16:39 | |
| realitix | ok great. Thanks | 16:39 |
| *** rcernin has joined #openstack-infra | 16:40 | |
| *** thiagop has joined #openstack-infra | 16:40 | |
| krotscheck1 | fungi: I'm not certain what "volume" means in this context. The wheel mirrors are going to write to their own local afs disks, vos-release will be run on the release slave, bandersnatch is running on mirror-update... | 16:40 |
| jeblair | krotscheck1, fungi: i think we should vos release immediately after each upload job | 16:40 |
| *** shashank_hegde has joined #openstack-infra | 16:41 | |
| fungi | krotscheck1: jeblair: right, we should release as close as possible to when we make changes to the content | 16:41 |
| krotscheck1 | jeblair: On the wheel slave, or the release slave? | 16:41 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 16:41 | |
| krotscheck1 | Or does it not matter? | 16:41 |
| jeblair | krotscheck1: the release slave, since it requires admin permissions | 16:41 |
| fungi | i didn't know if "vos release daily" meant "vos release at the end of our daily update job" | 16:42 |
| *** daemontool has joined #openstack-infra | 16:42 | |
| krotscheck1 | Ok, so the build plan I have so far _should_ work | 16:42 |
| *** salv-orlando has joined #openstack-infra | 16:42 | |
| *** baoli has quit IRC | 16:42 | |
| jeblair | krotscheck1: so it'd be a separate job run after the build one | 16:42 |
| krotscheck1 | jeblair: Yep. https://review.openstack.org/#/c/273549/ | 16:42 |
| jeblair | fungi: oh i see, yeah, so to generalize, each time we update a wheel mirror for a given arch, we should release that arch's wheel mirror | 16:42 |
| jeblair | krotscheck1: ^ | 16:42 |
| *** baoli has joined #openstack-infra | 16:43 | |
| *** ashleighfarnham has joined #openstack-infra | 16:43 | |
| jeblair | (whether that's daily or due to a specific change) | 16:43 |
| krotscheck1 | Ok, I'm pretty certain my wheel patch chain does all those things. | 16:43 |
| krotscheck1 | But AFS is still not quite done landing. | 16:43 |
| jeblair | cool, i'll try to review today as soon as i stop making more problems for myself | 16:43 |
| * krotscheck1 goes off to check cacti for leftover usage. | 16:44 | |
| *** daemontool_ has quit IRC | 16:44 | |
| *** baoli has quit IRC | 16:46 | |
| realitix | I have to go, thank you fungi for your help. | 16:47 |
| fungi | realitix: if you log out of gerrit and back in again you should be in the older "realitix" (10848) account now. the newer "jsbevilacqua" (18807) account has been deactivated | 16:47 |
| realitix | Thanks | 16:47 |
| krotscheck1 | jeblair, fungi, mordred: Looks like the old pypi mirrors' traffic has flatlines. We should be able to remove those now. | 16:47 |
| openstackgerrit | Moshe Levi proposed openstack/diskimage-builder: Adding InfiniBand Support https://review.openstack.org/274781 | 16:47 |
| krotscheck1 | *flatlined | 16:47 |
| *** realitix has quit IRC | 16:47 | |
| jeblair | krotscheck1, fungi, mordred: let's leave them alone until i dig us out of the vos release mess i put us in, just in case something goes very wrong | 16:48 |
| krotscheck1 | You got it | 16:48 |
| clarkb | for the bluebox ovs gre tunnels I have confirmed that that underlying IP addrs are correct and that I can at least ping between them. So there isn't a general network issue between them | 16:50 |
| *** HeOS has quit IRC | 16:50 | |
| *** zeih has joined #openstack-infra | 16:50 | |
| clarkb | the arp who hases are making it onto the ovs bridge but not across the gre tunnels | 16:51 |
| clarkb | which is why I had suspected something provider level previously | 16:51 |
| *** harlowja_at_home has quit IRC | 16:51 | |
| krotscheck1 | Is the on-disk cacti stat for our mirrors accurate? Are we really only using 2-5GB of space for the afs cache? | 16:51 |
| clarkb | the mtu for eth0 (the underlying itnerface) is 1500 and the mtu on the gre tunnel interfaces is 1450 | 16:52 |
| *** ashleighfarnham has quit IRC | 16:52 | |
| *** mikelk has quit IRC | 16:54 | |
| jeblair | krotscheck1: which host? | 16:55 |
| openstackgerrit | Tim Birkett proposed openstack-infra/jenkins-job-builder: Add trigger for RabbitMQ trigger module https://review.openstack.org/273833 | 16:55 |
| clarkb | I hvae now confirmed that I have ip proto gre packets exiting eth0 on one host but not entering eth0 on the other | 16:55 |
| openstackgerrit | Frank Kloeker proposed openstack-infra/puppet-translation_checksite: added rspec files for automatic testing https://review.openstack.org/274788 | 16:56 |
| clarkb | and the total length of those packets is far below any tiny mtu we may have | 16:56 |
| *** baoli has joined #openstack-infra | 16:56 | |
| *** Daisy has quit IRC | 16:56 | |
| krotscheck1 | jeblair: All of them. bhs1.ovh is using 4 GB, dfw.rax is using 2.5 gra1 is using 3.2, etc etc | 16:57 |
| *** jpr has joined #openstack-infra | 16:57 | |
| jeblair | krotscheck1: the rax ones have a cinder partition which wasn't being graphed in cacti | 16:57 |
| krotscheck1 | jeblair: Ahhh, gotcha | 16:57 |
| *** Swami has joined #openstack-infra | 16:57 | |
| jeblair | krotscheck1: where do you see 2.5 for dfw? | 16:57 |
| * krotscheck1 idly wonders what the ratio of used/cached packages vs. actual mirror size is. | 16:58 | |
| krotscheck1 | jeblair: http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=190 -> Used space / | 16:58 |
| *** yamamoto has quit IRC | 16:58 | |
| clarkb | I have double checked that our security groups are wide open so this must be filtering on the provider side | 16:58 |
| jeblair | krotscheck1: ah. yeah, so the used space on / is accurate for ovh... but includes everything, so we can probably guestimate it by subtracting 2.5 | 16:59 |
| jeblair | krotscheck1: for rax, once http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=3172&rra_id=all populates, that will be accurate for just the afs cache | 16:59 |
| *** tphummel has joined #openstack-infra | 17:00 | |
| clarkb | let me double check our iptables but everything between the two nodes should be allowed | 17:00 |
| *** EricGonczer_ has quit IRC | 17:00 | |
| fungi | clarkb: it's the who-has to the ethernet broadcast address you're not receiving over the link? | 17:02 |
| *** rcernin has quit IRC | 17:02 | |
| fungi | clarkb: also i wouldn't suspect mtu anyway since those (even encapsulated) will be teensy | 17:03 |
| *** bpokorny has quit IRC | 17:03 | |
| *** Apoorva has joined #openstack-infra | 17:04 | |
| *** annegentle has joined #openstack-infra | 17:04 | |
| clarkb | fungi: yes, the arp who has for the address on the tunnel is being sent out eth0 encapsulated inthe tunnel. On the other side we don't see those packets | 17:04 |
| clarkb | I have zerod out the iptables counters and don't see any of the reject/drop rules going up with an active ping over the tunnel generating who has packet | 17:05 |
| clarkb | I suppose it could be ebtables | 17:05 |
| fungi | and the outer frame header and ip header destinations look correct? | 17:05 |
| clarkb | fungi: yes | 17:05 |
| *** armax has joined #openstack-infra | 17:05 | |
| clarkb | 17:05:31.885684 fa:16:3e:cc:ab:a5 > fa:16:3e:32:51:39, ethertype IPv4 (0x0800), length 84: 10.220.2.161 > 10.220.2.160: GREv0, key=0x2, proto TEB (0x6558), length 50: 92:0d:cc:4f:86:42 > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 42: Request who-has 172.24.4.1 tell 172.24.4.2, length 28 | 17:05 |
| *** vgridnev has joined #openstack-infra | 17:06 | |
| fungi | i wouldn't suspect ebtables or iptables if tcpdump shows the gre packet leaving the source and you also see it never leaving the destination | 17:06 |
| clarkb | the two sets of IP addrs look correct to me | 17:06 |
| fungi | and yeah, that looks right. just making sure it wasn't strangely reusing the broadcast mac on the outer frame destination | 17:06 |
| *** zz_dimtruck is now known as dimtruck | 17:07 | |
| *** EricGonczer_ has joined #openstack-infra | 17:07 | |
| fungi | they've got to have some sort of upper-layer packet inspection going on, or some intermediary device mistakenly unwrapping the packet and trying to act on the payload | 17:08 |
| *** ashleighfarnham has joined #openstack-infra | 17:08 | |
| *** JasonF is now known as JayF | 17:09 | |
| fungi | er, i meant to say earlier "...and you never see it arriving at the destination" | 17:09 |
| clarkb | jlk: if I leave that ping running can we use the above packet details to maybe track that down provider side | 17:09 |
| *** esker has joined #openstack-infra | 17:09 | |
| clarkb | fungi: right and it definitely isn't showing up on the interface with 10.220.2.160 | 17:09 |
| *** matrohon has quit IRC | 17:09 | |
| fungi | clarkb: are you able to forward anything else over the tunnel? (like if you manually add a static arp entry on each end)? | 17:09 |
| clarkb | fungi: that is a good question, I haven't tried that | 17:10 |
| fungi | would help to know if this is all gre not making it to the destination, or only arp over gre at issue | 17:10 |
| clarkb | ya let me try that | 17:11 |
| fungi | ahh, sorry, i was interpreting the description as the latter | 17:11 |
| clarkb | that doesn't help either, just transitions ping to send icmp echo requests that are unanswered | 17:12 |
| amaretskiy | AJaeger hi | 17:12 |
| clarkb | arp/icmp similarly affected | 17:13 |
| *** HeOS has joined #openstack-infra | 17:14 | |
| *** weshay has quit IRC | 17:14 | |
| amaretskiy | AJaeger: recently we discussed issue with stuck requests logged in logs/devstack-gate-setup-workspace-new.txt.gz - there were periodical significant amount of lost time on this set-up | 17:15 |
| *** tosky has quit IRC | 17:15 | |
| amaretskiy | AJaeger: I've prepared a report with statistics (as you requested) - please look at http://amaretskiy.droppages.com/lost-seconds-while-setting-up-dsvm-workspace.html | 17:15 |
| fungi | clarkb: yep, so sounds more like there are filters on the provider's hosts or somewhere between which are discarding all ip 47 packets | 17:16 |
| *** jgriffith_away is now known as jgriffith | 17:16 | |
| amaretskiy | AJaeger: this report is based on small tool https://github.com/maretskiy/stuff/blob/master/openstack/parse_lost_seconds.py | 17:16 |
| *** SumitNaiksatam has quit IRC | 17:16 | |
| amaretskiy | please look - in some cases there wee 11 minutes of lost time | 17:16 |
| fungi | (there is more to internet protocol than 1, 6 and 17!!!) | 17:16 |
| amaretskiy | AJaeger: ^ | 17:16 |
| *** gyee has joined #openstack-infra | 17:17 | |
| amaretskiy | AJaeger: please contact me if you have any questions or additional data | 17:17 |
| *** scheuran has quit IRC | 17:17 | |
| *** ifarkas has quit IRC | 17:17 | |
| *** HeOS has quit IRC | 17:19 | |
| *** rhallisey has joined #openstack-infra | 17:21 | |
| *** unicell has quit IRC | 17:21 | |
| fungi | amaretskiy: that's pretty interesting stuff. we do track basic system statistics on our zuul mergers, e.g. http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=1518&rra_id=all (there are 8 of them at the moment, zm01 through zm08). i wonder if the incidents line up with any load spikes on the corresponding merger worker mentioned in the fetch command? | 17:23 |
| *** _bmjen is now known as bmjen | 17:23 | |
| *** cody-somerville has quit IRC | 17:23 | |
| jeblair | slow fetches are probably due to too many refs | 17:25 |
| clarkb | I wonder if neutron has something that would prevent this by default | 17:25 |
| clarkb | armax: if you have a chance, can you think of anything in neutron that would prevent running gre tunnels over the existing neutron tenant overlay networks? | 17:26 |
| *** samuelBartel has quit IRC | 17:26 | |
| fungi | amaretskiy: yeah, jeblair makes a good point. i would expect to see that more frequently on higher-volume projects (your example was for nova, i wonder if most incidents are on a small number of larger repos) | 17:27 |
| armax | clarkb: you mean as in gre in gre? | 17:28 |
| clarkb | armax: or gre in vxlan, yes | 17:28 |
| fungi | gre between nova instances through unspecified neutron-based service provider's environment | 17:29 |
| fungi | wondering if they need some tuning of neutron in their environment to allow gre to pass between our instances | 17:30 |
| clarkb | the odd thing is it works somtimes | 17:30 |
| clarkb | which makes me wonder if being on the same hypervisor makes it owrk | 17:30 |
| clarkb | but once you actually traverse an overlay with an overlay it breaks | 17:31 |
| armax | clarkb: I can’t think of anything it that could prevent that if not potentially resizing the MTU accordingly | 17:31 |
| fungi | clarkb: that would be my suspicion. you're seeing success between instances on the same host but failure between instances on different hosts | 17:31 |
| fungi | armax: very small frames in this case, so wouldn't be mtu | 17:31 |
| *** mgagne_ has quit IRC | 17:32 | |
| *** mgagne_ has joined #openstack-infra | 17:32 | |
| fungi | like, the gre packets which aren't making it to their destination are an order of magnitude smaller than the expected mtu to begin with | 17:32 |
| *** piet has quit IRC | 17:33 | |
| fungi | (arp queries, non-padded icmp echo) | 17:33 |
| *** _nadya_ has joined #openstack-infra | 17:33 | |
| *** mrmartin has joined #openstack-infra | 17:34 | |
| *** mgagne_ is now known as mgagne | 17:34 | |
| openstackgerrit | Nikhil Komawar proposed openstack-infra/irc-meetings: Move Glance artifacts meeting https://review.openstack.org/274806 | 17:35 |
| *** rhallisey has quit IRC | 17:36 | |
| *** salv-orl_ has joined #openstack-infra | 17:36 | |
| openstackgerrit | Nikhil Komawar proposed openstack-infra/irc-meetings: Move Glance artifacts meeting https://review.openstack.org/274806 | 17:37 |
| clarkb | armax: it is entirely possible that the provider installation is doing something funny and neutron isn't at fault. Was just curious if there was any known thing with neutron that might be at play (sounds like no) | 17:38 |
| mgagne | clarkb in a nutshell, what's up with gre? trying to setup gre within VMs? | 17:38 |
| armax | clarkb: nothing on the top of my mind…perhaps it’s best to relay this question in #openstack-neutron (or the ML), as I might be missing something | 17:38 |
| armax | clarkb: I’ll poke around | 17:39 |
| clarkb | mgagne: tl;dr is our multi node test envs use gre to set up an overlay network that tehy can control addressing on | 17:39 |
| *** zeih has quit IRC | 17:39 | |
| fungi | given that we have what sounds like all gre passing between instances on the same host but not between instances on different hosts, it could be iptables on the hosts physical interfaces disallowing "scary" ip protocols, or similar filters somewhere in their underlying network deployment | 17:39 |
| *** salv-orlando has quit IRC | 17:39 | |
| clarkb | mgagne: and we see the gre packets exit host one but not enter host two | 17:40 |
| *** yaume has quit IRC | 17:40 | |
| mgagne | clarkb we found gre to not work properly unless nf_conntrack_proto_gre is loaded in the host | 17:40 |
| jlk | clarkb: okay | 17:40 |
| mgagne | clarkb even we wide open security gorups | 17:40 |
| clarkb | mgagne: on the hypervisor side you mean? let me check the vm side | 17:41 |
| mgagne | clarkb hypervisor side | 17:41 |
| fungi | well, from the service provider perspective, it's that we see one virtual machine instance place the gre packets on its transmit buffer without error, but the destination virtual instance never sees it arrive (based on packet captures within the instances) | 17:41 |
| *** shashank_hegde has quit IRC | 17:41 | |
| *** sjmc7 has joined #openstack-infra | 17:41 | |
| mgagne | clarkb and you need to add GRE proto to sg, which I guess is already done unless it's done cross-cloud | 17:42 |
| *** sjmc7 has left #openstack-infra | 17:42 | |
| clarkb | mgagne: security groups are wide open | 17:42 |
| mgagne | clarkb 1) add gre proto to SG 2) ask provider to load gre conntrack helper unless they disabled SG completely | 17:42 |
| mgagne | clarkb for which proto? | 17:42 |
| fungi | mgagne: that helps. i wasn't thinking about the fact that netfilter might need a plugin loaded to track gre state explicitly, since it's not a connection-oriented protocol | 17:43 |
| mgagne | clarkb tcp/udp/icmp? | 17:43 |
| clarkb | mgagne: ipv6, ipv6 | 17:43 |
| *** zeih has joined #openstack-infra | 17:43 | |
| clarkb | er ipv4 and ipv6 | 17:43 |
| mgagne | I know for a fact that we didn't open all proto by default, only tcp/udp/icmp IIRC | 17:43 |
| * fungi gets back on his "the internet is more than 1, 6 and 17" soapbox | 17:43 | |
| mgagne | =) | 17:44 |
| clarkb | mgagne: I havne't looked at internap yet but it exhibits similar behavior | 17:44 |
| clarkb | mgagne: and if you don't allow gre well that would explain it | 17:44 |
| mgagne | yea, we know =) | 17:44 |
| fungi | i guess that means no multihost devstack testing in at least some of our providers | 17:44 |
| clarkb | or convince our providers to allow ip | 17:45 |
| jeblair | mgagne: is there a reason you didn't? how difficult would it be to alter? | 17:45 |
| fungi | or do really ugly things like gre over udp | 17:45 |
| fungi | at least that would give our low-mtu testing a workout! | 17:45 |
| clarkb | the underlying issue is that we need to give the inner cloud under test control of its own ip address space | 17:46 |
| mgagne | jeblair there is no built-in way to tell Neutron to use another set of default security group rules =) | 17:46 |
| clarkb | there are other ways to tackle that problem | 17:46 |
| fungi | mgagne: let me guess, your customers also don't have any interest in doing ipsec between their instances | 17:46 |
| clarkb | mgagne: oh you are saying just in neutron? we have that handled | 17:46 |
| clarkb | mgagne: the rule is allow all traffic between 0.0.0.0/0 and 0.0.0.0/0 | 17:47 |
| clarkb | (we don't set tcp/udp/icmp) | 17:47 |
| *** _nadya_ has quit IRC | 17:47 | |
| mgagne | clarkb was answering jeblair. we hacked neutron to override its default security group rules when creating default sg. we authorized udp/tcp/icmp by default since they are the common proto used. (sorry fungi) | 17:47 |
| mgagne | anyone can override them | 17:47 |
| fungi | mgagne: yeah, if you're talking about our security groups, we override them to sane wide-open settings | 17:47 |
| mgagne | by "special" proto might need conntrack helper which Neutron won't load for you | 17:48 |
| jeblair | have we done that on internap? | 17:48 |
| clarkb | jeblair: I have only confirmed bluebox so far | 17:48 |
| jeblair | perhaps we did not because we didn't think we needed to because tcp/udp appeared to be open | 17:48 |
| jeblair | clarkb: good, i remember doing that on bluebox | 17:48 |
| jeblair | so if no one else has set up internap rules, perhaps the solution is simple there | 17:49 |
| mgagne | let me check. does it need to be default SG or do you create your own? | 17:49 |
| *** mrmartin has quit IRC | 17:49 | |
| jeblair | mgagne: (though even so, if your intent is to open things up by default (which i think is great), if you did so by opening all protocols, it might actually be simpler and better :) | 17:49 |
| fungi | right, and the bluebox situation could be as simple as getting the provider to load the netfilter connection tracking plugin for gre on their systems | 17:49 |
| mgagne | jeblair reviewing rules ATM | 17:50 |
| jeblair | mgagne: we can make our own if needed -- my suspicion is i just assumed i did not need too | 17:50 |
| mgagne | jeblair last time we setup them, it was in grizzly | 17:50 |
| mgagne | so things might have changed since | 17:50 |
| clarkb | fungi: we can also try switching to vxlan | 17:50 |
| clarkb | I will go ahead and push that patch and see what happens | 17:51 |
| *** weshay_xchat has joined #openstack-infra | 17:51 | |
| mgagne | fungi we should also asked neutron if they now load gre helper when gre is authorized in SG. but then, if you authorize ANY, they just can't load all helpers on earth just in case. | 17:51 |
| jeblair | oh that's an interesting idea | 17:51 |
| *** jgriffith is now known as jgriffith_away | 17:51 | |
| *** weshay_xchat is now known as weshay | 17:51 | |
| jeblair | clarkb: maybe we should explicitly authorize gre in bb? | 17:51 |
| mgagne | anyway, that's my take on gre not working. we did investigate when one customer asked about it and we find gre conntrack helper to be needed | 17:52 |
| fungi | mgagne: it would probably make the most sense for neutron to make choosing conntrack helpers separate (or optionally separate) from ruleset writing | 17:52 |
| *** aopincar has joined #openstack-infra | 17:52 | |
| mgagne | fungi I don't have an opinion on how it should be done | 17:53 |
| fungi | or better, make it possible to do proper "stateless" non-filtering | 17:53 |
| * clarkb runs into the lack of documentation problem again | 17:54 | |
| fungi | because you only need conntrack to grok various protocols if you're trying to do stateful filtering. a stateful filter of all sources/destinations and all protocols/ports is pretty silly, just stop state tracking | 17:54 |
| mgagne | fungi it's hard =) | 17:54 |
| fungi | yeah, probably neutron's security groups need a proper "off switch" so tenants can opt out of having state tracking forced onto them | 17:55 |
| *** jordanP has quit IRC | 17:55 | |
| mgagne | fungi we did it in the past with our other line of products. we have a custom kernel and "forgot" to compile conntrack. now you want stateful filter, yea, can't load conntrack now, kernel doesn't know about it. And we didn't wish to reboot =) | 17:55 |
| *** Sukhdev has quit IRC | 17:55 | |
| fungi | rather than having to make absurd "allow everything" filtering rulesets | 17:56 |
| pabelanger | fungi: do you have a moment to approve 274697? Fixes a typo for JJB | 17:56 |
| mgagne | fungi you cannot easily opt out of conntrack | 17:56 |
| mgagne | fungi you need to inject rules in the raw table instead of nat/filter | 17:56 |
| fungi | though stateless filtering support in neutron might also be interesting | 17:57 |
| fungi | mgagne: yeah, obviously this would be for non-nat use cases | 17:57 |
| *** cody-somerville- has joined #openstack-infra | 17:57 | |
| *** tcammann_ has joined #openstack-infra | 17:57 | |
| *** Sukhdev has joined #openstack-infra | 17:57 | |
| fungi | or, well, optionally for 1:1 nat use cases as well. just no layer 4 port address translation | 17:57 |
| *** tcammann has joined #openstack-infra | 17:58 | |
| *** zaro has joined #openstack-infra | 17:58 | |
| *** hashar has quit IRC | 17:58 | |
| *** esp has joined #openstack-infra | 17:58 | |
| *** trown is now known as trown|lunch | 17:58 | |
| *** Sukhdev has quit IRC | 17:59 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: Try vxlan instead of gre for overlays https://review.openstack.org/274821 | 18:00 |
| *** Sukhdev has joined #openstack-infra | 18:00 | |
| *** Sukhdev has quit IRC | 18:00 | |
| clarkb | the options:key value passed to ovs-vsctl is the vxlan network identifier | 18:00 |
| mgagne | fungi will add to our backlog to do "real" any/any, not just tcp/udp/icmp | 18:03 |
| mgagne | will only affect new users though | 18:03 |
| *** deva_ has joined #openstack-infra | 18:04 | |
| *** unicell has joined #openstack-infra | 18:04 | |
| clarkb | https://jenkins01.openstack.org/job/gate-tempest-dsvm-multinode-full/2522/ assuming I didn't get the vxlan stuff wrong that should tell us things | 18:04 |
| *** jaosorior has joined #openstack-infra | 18:05 | |
| *** bhunter71 has joined #openstack-infra | 18:05 | |
| *** tcammann has quit IRC | 18:05 | |
| *** esp has quit IRC | 18:05 | |
| *** tcammann_ has quit IRC | 18:05 | |
| *** cody-somerville- has quit IRC | 18:05 | |
| *** zaro has quit IRC | 18:05 | |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack-infra/project-config: Use Ironic as Devstack plugin in Rally gates https://review.openstack.org/274824 | 18:05 |
| *** tcammann_ has joined #openstack-infra | 18:06 | |
| *** tcammann has joined #openstack-infra | 18:06 | |
| openstackgerrit | Graham Hayes proposed openstack/requirements: bump python-designateclient to 2.0.0 https://review.openstack.org/273681 | 18:06 |
| *** NobodyCa1 has joined #openstack-infra | 18:08 | |
| *** cody-somerville- has joined #openstack-infra | 18:08 | |
| *** deva_ has quit IRC | 18:09 | |
| *** deva_ has joined #openstack-infra | 18:09 | |
| *** hdd has joined #openstack-infra | 18:10 | |
| *** rubasov has quit IRC | 18:10 | |
| *** fedexo has quit IRC | 18:10 | |
| *** ashleighfarnham has quit IRC | 18:11 | |
| *** tcammann has quit IRC | 18:11 | |
| *** esp has joined #openstack-infra | 18:11 | |
| *** tcammann has joined #openstack-infra | 18:12 | |
| *** zeih has quit IRC | 18:13 | |
| *** NobodyCa1 has quit IRC | 18:13 | |
| openstackgerrit | Merged openstack-infra/project-config: Add missing node for windmill https://review.openstack.org/274697 | 18:14 |
| *** deva_ has quit IRC | 18:14 | |
| *** ashleighfarnham has joined #openstack-infra | 18:14 | |
| dhellmann | AJaeger : do we need a requirements repo change to go with the doc tools release? https://review.openstack.org/#/c/274461/1 | 18:14 |
| *** NobodyCa1 has joined #openstack-infra | 18:14 | |
| *** Jeffrey4l has quit IRC | 18:14 | |
| *** yamahata has joined #openstack-infra | 18:14 | |
| *** cody-somerville- has quit IRC | 18:15 | |
| *** tcammann_ has quit IRC | 18:15 | |
| *** davideagnello has joined #openstack-infra | 18:15 | |
| *** esp has quit IRC | 18:15 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Re-Enable django_openstack_auth/designate-dashboard translations https://review.openstack.org/274832 | 18:16 |
| *** jesusaurus has joined #openstack-infra | 18:16 | |
| *** tcammann_ has joined #openstack-infra | 18:16 | |
| *** dtantsur is now known as dtantsur|afk | 18:17 | |
| *** tcammann has quit IRC | 18:17 | |
| *** mrmartin has joined #openstack-infra | 18:18 | |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack-infra/project-config: Use Ironic as Devstack plugin in Rally gates https://review.openstack.org/274824 | 18:18 |
| *** zaro has joined #openstack-infra | 18:19 | |
| *** xyang1 has joined #openstack-infra | 18:19 | |
| clarkb | a quick spot check of the bluebox host that vxlaned shows that ping works | 18:20 |
| *** NobodyCa1 has quit IRC | 18:20 | |
| clarkb | will have to see how tempest does | 18:20 |
| *** NobodyCa1 has joined #openstack-infra | 18:20 | |
| AJaeger | dhellmann: no, not needed. An update is only needed for openstack-manuals and that is not in requirements/projects.txt | 18:21 |
| AJaeger | dhellmann: thanks for double checking | 18:21 |
| *** jesusaurus has quit IRC | 18:21 | |
| openstackgerrit | Frank Kloeker proposed openstack-infra/puppet-translation_checksite: added spec files for automatic tests https://review.openstack.org/274835 | 18:21 |
| clarkb | some RTTs were >2ms though which seems slow | 18:21 |
| *** dims_ has joined #openstack-infra | 18:21 | |
| *** tcammann_ has quit IRC | 18:22 | |
| *** dims has quit IRC | 18:22 | |
| *** bpokorny has joined #openstack-infra | 18:22 | |
| clarkb | using the non tunnel addr is right around 1ms | 18:22 |
| clarkb | probably not an issue for what we are doing | 18:22 |
| *** yamahata has quit IRC | 18:23 | |
| *** jistr has joined #openstack-infra | 18:23 | |
| dhellmann | AJaeger : ok, I'll process that now. Should we remove the existing entry from g-r? | 18:23 |
| *** yamahata has joined #openstack-infra | 18:24 | |
| *** zaro has quit IRC | 18:24 | |
| *** NobodyCa1 has quit IRC | 18:25 | |
| *** sabeen3 has quit IRC | 18:26 | |
| AJaeger | amaretskiy: thanks! | 18:26 |
| *** baoli has quit IRC | 18:27 | |
| AJaeger | dhellmann: no, leave it in since there's one repo that needs the tool (trove?) but version is not relevant | 18:29 |
| dhellmann | AJaeger : ok | 18:29 |
| *** sridhar_ram has quit IRC | 18:29 | |
| *** mrmartin has quit IRC | 18:30 | |
| *** kushal has quit IRC | 18:31 | |
| *** rossella_s has quit IRC | 18:31 | |
| openstackgerrit | Frank Kloeker proposed openstack-infra/puppet-translation_checksite: Puppet module to provide a translation checksite https://review.openstack.org/274701 | 18:31 |
| *** kushal has joined #openstack-infra | 18:31 | |
| *** kushal has joined #openstack-infra | 18:31 | |
| *** rossella_s has joined #openstack-infra | 18:32 | |
| fungi | looks like we have some _very_ old ready nodes (bare-trusty and devstack-trusty) on jenkins01 and jenkins04 from 18-26 days ago | 18:32 |
| *** doug-fish has quit IRC | 18:32 | |
| fungi | and some on other jenkins masters as old as 9 days | 18:33 |
| fungi | jeblair: you wanted to hold the global lock on things happening on nodepool on friday... still the case? am i clear to nodepool delete those? | 18:34 |
| fungi | just trying to free up some job bandwidth | 18:34 |
| *** jsavak has quit IRC | 18:35 | |
| *** jsavak has joined #openstack-infra | 18:35 | |
| fungi | granted this would only free up ~4% of our overall quota, but nodepool also tends to not build as many new ready nodes if it sees these sitting around fulfilling demand | 18:36 |
| *** doug-fish has joined #openstack-infra | 18:36 | |
| *** zeih has joined #openstack-infra | 18:37 | |
| AJaeger | dhellmann: could you approve https://review.openstack.org/#/c/273088/? The release post job fails due to that currently (ok, failiure is cosmetic, still we should fix it to find real problems) | 18:37 |
| *** shashank_hegde has joined #openstack-infra | 18:37 | |
| prometheanfire | how big are the various pools in nodepool? | 18:38 |
| prometheanfire | rackspace/hp/whoever | 18:38 |
| *** _nadya_ has joined #openstack-infra | 18:38 | |
| dhellmann | AJaeger : how can it be that we haven't given you +2 on that repo yet? | 18:38 |
| dhellmann | AJaeger : let me know if I should propose you, but +2a in the mean time | 18:38 |
| fungi | prometheanfire: see the max-servers lines in http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/nodepool.yaml | 18:39 |
| fungi | prometheanfire: that's pretty much always going to reflect the current situation | 18:39 |
| prometheanfire | fungi: thanks | 18:40 |
| *** doug-fis_ has joined #openstack-infra | 18:40 | |
| AJaeger | dhellmann: if you need another reviewer, feel free to propose me - but I won't make that repo a priority... | 18:40 |
| fungi | prometheanfire: we also have some per-provider trending at http://grafana.openstack.org/ | 18:40 |
| prometheanfire | neato | 18:41 |
| *** doug-fish has quit IRC | 18:41 | |
| *** doug-fis_ has quit IRC | 18:41 | |
| prometheanfire | you have a timeline on the osic stuff? | 18:41 |
| *** jpr has quit IRC | 18:41 | |
| *** doug-fish has joined #openstack-infra | 18:41 | |
| *** jaosorior has quit IRC | 18:41 | |
| AJaeger | dhellmann: thanks for release of openstack-doc-tools | 18:42 |
| AJaeger | jeblair, could you review 264994 and tell us whether that's fine now, please? | 18:42 |
| *** ybathia has joined #openstack-infra | 18:44 | |
| *** rockyg has joined #openstack-infra | 18:45 | |
| *** AJaeger has quit IRC | 18:45 | |
| *** SumitNaiksatam has joined #openstack-infra | 18:45 | |
| *** doug-fish has quit IRC | 18:45 | |
| clarkb | prometheanfire: they were supposed to get back to me mid last month but haven't heard from them since | 18:45 |
| fungi | prometheanfire: yep. in theory we've been using nodes provided by osic weeks ago? | 18:45 |
| *** AJaeger has joined #openstack-infra | 18:46 | |
| clarkb | I guess I should double check my email | 18:46 |
| * fungi made a humor | 18:46 | |
| clarkb | ya nothing new on that thread | 18:46 |
| *** AJaeger has quit IRC | 18:46 | |
| clarkb | so we are just waiting | 18:46 |
| fungi | basically a couple months ago they said they've have something set up for us a couple weeks ago, but all's quiet on the western front | 18:47 |
| *** AJaeger has joined #openstack-infra | 18:48 | |
| *** pvaneck has joined #openstack-infra | 18:48 | |
| *** jgriffith_away is now known as jgriffith | 18:48 | |
| *** edmondsw has quit IRC | 18:49 | |
| prometheanfire | clarkb: fungi: I pinged a guy | 18:50 |
| prometheanfire | hopefully you'll get some status soon | 18:50 |
| *** jistr has quit IRC | 18:51 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Re-Enable django_openstack_auth/designate-dashboard translations https://review.openstack.org/274832 | 18:51 |
| fungi | prometheanfire: appreciated. last we heard (per the committee conference calls) there was a defined order in which the first "customers" of the osic were being turned on. ours is #3 on the list, so i'm guessing it's just taking longer to set up #1 and #2 than expected | 18:51 |
| *** trown|lunch is now known as trown | 18:52 | |
| *** followinfrared has joined #openstack-infra | 18:52 | |
| * prometheanfire shrugs, dunno the particular status, we just helped bring it online and handed it over more or less | 18:52 | |
| *** sabeen1 has joined #openstack-infra | 18:56 | |
| *** ihrachys has joined #openstack-infra | 18:59 | |
| jeblair | fungi: i have released the global nodepool lock | 18:59 |
| fungi | jeblair: appreciated. i'll clean up these moldy nodes | 19:00 |
| *** jgriffith is now known as jgriffith_away | 19:00 | |
| *** salv-orl_ has quit IRC | 19:00 | |
| *** doug-fish has joined #openstack-infra | 19:01 | |
| jeblair | Shrews, notmorgan: i was chatting with mordred and shade/keystonev2 testing came up; he suggests changing the dsvm keystone v2 job on shade to use the stable/liberty branches | 19:02 |
| openstackgerrit | Moshe Levi proposed openstack/diskimage-builder: Adding InfiniBand Support https://review.openstack.org/274781 | 19:02 |
| notmorgan | jeblair: https://etherpad.openstack.org/p/v3-only-devstack good plan, we have a number of other things to hit too | 19:02 |
| Shrews | jeblair: yeah, i think we should probably do that | 19:02 |
| notmorgan | there is brokeness in tempestlib, other functional tests too | 19:02 |
| *** doug-fis_ has joined #openstack-infra | 19:04 | |
| *** jpr has joined #openstack-infra | 19:04 | |
| *** ihrachys has quit IRC | 19:04 | |
| fungi | okay, removed 22 nodes which have been "ready" for more than a day. the only remaining "old" nodes now are a mere few hours. the oldest common node types in ready node are now close to none and have ages in seconds when they do exist | 19:04 |
| *** ociuhandu has quit IRC | 19:04 | |
| *** doug-fis_ has quit IRC | 19:04 | |
| *** julim has quit IRC | 19:04 | |
| *** doug-fis_ has joined #openstack-infra | 19:04 | |
| fungi | less common node types (tripleo, f23, et cetera) range up to 2-3 hours old | 19:05 |
| *** doug-fish has quit IRC | 19:05 | |
| fungi | which seems like our usual healthy situation | 19:05 |
| *** krtaylor has quit IRC | 19:06 | |
| krotscheck1 | jeblair: I'm wrapping up here, how're things going with the afs lock? | 19:07 |
| *** ddecapit has joined #openstack-infra | 19:07 | |
| *** ddecapit is now known as DuaneDeC7 | 19:07 | |
| pabelanger | if there any issue with puppet being run on jenkins.o.o ? | 19:07 |
| pabelanger | sorry, is* | 19:07 |
| pabelanger | they seem to be unreported for 1h30m | 19:07 |
| *** Daisy has joined #openstack-infra | 19:08 | |
| pabelanger | Hmm, seems like a lot more then just jenkins | 19:08 |
| *** julim_ has joined #openstack-infra | 19:08 | |
| openstackgerrit | Martin Oemke proposed openstack-infra/project-config: Enable Translation for tacker https://review.openstack.org/274855 | 19:08 |
| pabelanger | 112 nodes unreported | 19:08 |
| *** zeih has quit IRC | 19:10 | |
| *** baoli has joined #openstack-infra | 19:12 | |
| *** julim_ has quit IRC | 19:12 | |
| *** Daisy has quit IRC | 19:12 | |
| *** krotscheck1 has quit IRC | 19:14 | |
| *** baoli_ has joined #openstack-infra | 19:15 | |
| *** sabeen3 has joined #openstack-infra | 19:16 | |
| *** aopincar has quit IRC | 19:16 | |
| *** krtaylor has joined #openstack-infra | 19:17 | |
| openstackgerrit | Frank Kloeker proposed openstack-infra/puppet-translation_checksite: Puppet module to provide a translation checksite https://review.openstack.org/274701 | 19:18 |
| *** baoli has quit IRC | 19:18 | |
| *** kzaitsev_mb has quit IRC | 19:18 | |
| *** sabeen1 has quit IRC | 19:19 | |
| *** julim has joined #openstack-infra | 19:20 | |
| *** marekd has quit IRC | 19:21 | |
| pabelanger | fungi: happen to know what is going on with puppet? ^ | 19:22 |
| clarkb | https://jenkins01.openstack.org/job/gate-tempest-dsvm-multinode-full/2522/console appears to have lost jenkins connectivity | 19:23 |
| clarkb | so vxlan may not work well either (or it could have been a fluke) | 19:23 |
| AJaeger | sdague: could you review a new job for novaclient, please? https://review.openstack.org/266955 | 19:23 |
| clarkb | we should see if the neutron test fails the same way | 19:24 |
| notmorgan | fungi, jeblair, clarkb: where is the convo re phabricator happening? (cc zzzeek ) | 19:26 |
| clarkb | notmorgan: not sure I understand the context | 19:27 |
| notmorgan | clarkb: for issue tracking, just what is the status/where is that all happening (infra meetings? infra ml?, etherpads?) | 19:27 |
| *** davideagnello has quit IRC | 19:28 | |
| *** nikhil_k has joined #openstack-infra | 19:28 | |
| notmorgan | clarkb: zzzeek and i were talking about projects and moving them to use gerrit but LP being the issue tracker is rough. | 19:28 |
| clarkb | notmorgan: craige has been working it and keeping us up to date in the infra meetings | 19:28 |
| notmorgan | clarkb: because gerrit workflow is great :) [*spoiled*] | 19:28 |
| notmorgan | clarkb: fantastic :) | 19:29 |
| fungi | pabelanger: i'll check our main log | 19:31 |
| *** annegentle has quit IRC | 19:31 | |
| *** nikhil has quit IRC | 19:31 | |
| fungi | notmorgan: also to be more exact, it's maniphest which is the task tracker (from the phabricator suite of systems) | 19:31 |
| *** annegentle has joined #openstack-infra | 19:31 | |
| *** marekd has joined #openstack-infra | 19:32 | |
| *** edmondsw has joined #openstack-infra | 19:33 | |
| fungi | clarkb: i guess 264372 can be abandoned? | 19:33 |
| *** ociuhandu has joined #openstack-infra | 19:33 | |
| clarkb | ya I will clean that up | 19:34 |
| notmorgan | fungi: ok sure! :) | 19:34 |
| notmorgan | but still :) | 19:34 |
| notmorgan | good to know | 19:34 |
| *** jpr has quit IRC | 19:34 | |
| clarkb | fungi: done | 19:34 |
| fungi | notmorgan: when you say "phabricator" a lot of people will assume you mean their code review system | 19:34 |
| notmorgan | right | 19:35 |
| *** jsavak has quit IRC | 19:35 | |
| notmorgan | my mistake | 19:35 |
| notmorgan | ;) | 19:35 |
| * notmorgan corrects brain mapping of name of things | 19:35 | |
| *** jsavak has joined #openstack-infra | 19:35 | |
| pabelanger | fungi: thanks | 19:35 |
| jeblair | krotscheck1 appears to have disappeared | 19:36 |
| *** hashar has joined #openstack-infra | 19:36 | |
| jeblair | but the answer is that i think it will take me a while to get the bandersnatch RO mirror going, but in the mean time, the RW should be fine, and none of that should have any impact on the wheel work | 19:36 |
| clarkb | the neutron job with vxlan for the floating ip overlay succeeded | 19:37 |
| jeblair | aside from the fact that i haven't had time to review wheel-related patches | 19:37 |
| *** Sukhdev has joined #openstack-infra | 19:37 | |
| jeblair | i'm catching up on stuff i neglected last week | 19:37 |
| clarkb | https://jenkins03.openstack.org/job/gate-tempest-dsvm-multinode-full/2665/console is running in rax-dfw now instead of on bluebox will have to see if the network trouble is consistent | 19:37 |
| jeblair | clarkb: once you're done with vxlan testing, do you want to test the security group changes with gre? | 19:37 |
| clarkb | jeblair: what changes? I thought we were already good? | 19:38 |
| clarkb | bluebox allows all ipv4 and ipv6 | 19:38 |
| clarkb | according to the api at least | 19:38 |
| jeblair | clarkb: my understanding of the conversation earlier was that in internap we may have success in creating our own security group because the default one does not allow gre | 19:38 |
| jeblair | clarkb: and there was also the theory that perhaps if we specifically allowed gre in bluebox, it might trigger a conntrack module load | 19:39 |
| clarkb | ah | 19:39 |
| jeblair | clarkb: (and i don't know the sg state in ovh; one or both of those may be applicable there too?) | 19:40 |
| clarkb | I missed that | 19:40 |
| clarkb | ok looking at internap we do have explicit tcp/icmp/udp | 19:40 |
| *** Sukhdev has quit IRC | 19:40 | |
| clarkb | does neutron api accept an arbitrary IP type value? /me reads docs | 19:40 |
| jeblair | clarkb: we might also try 'all' in internap | 19:41 |
| *** piet has joined #openstack-infra | 19:43 | |
| clarkb | doesn't look like the api accepts arbitrary ip types | 19:43 |
| *** hashar has quit IRC | 19:43 | |
| clarkb | null, icmp, icmpv6, tcp, and udp are the values according to the docs | 19:43 |
| clarkb | so I don't think we can add a rule in bluebox for gre | 19:44 |
| jeblair | ok | 19:44 |
| *** gongysh has joined #openstack-infra | 19:44 | |
| clarkb | I can however try switching the rules in internap to match the others which use null and should apply to all types | 19:44 |
| jeblair | ++ | 19:44 |
| clarkb | will do that now | 19:45 |
| *** mrmartin has joined #openstack-infra | 19:45 | |
| *** matrohon has joined #openstack-infra | 19:45 | |
| notmorgan | clarkb, fungi: if we have a project that uses an external issue tracker, is there oposition to using a script provided to infra to update issue tracker? or do i need to watch the gerrit stream and source the data from there? | 19:47 |
| notmorgan | clarkb, fungi: until manaphest is ready and then there could be a move to that [evaluated when it's ready] | 19:47 |
| clarkb | notmorgan: I would not want to be responsible for maintaining arbitrary bug tracker updates | 19:48 |
| jeblair | notmorgan: we talking official or unofficial project? | 19:48 |
| clarkb | (more details may help) | 19:48 |
| notmorgan | jeblair, clarkb: looking at possibvly moving dogpile (and then talking about SQL-A depending on zzzeek's happiness with it all) to gerrit | 19:48 |
| jeblair | so probably not wanting to become an official openstack project | 19:49 |
| notmorgan | right | 19:49 |
| * notmorgan just agreed to help co-maintain dogpile so there are more eyes / help on it | 19:49 | |
| *** krotscheck1 has joined #openstack-infra | 19:50 | |
| *** flepied has quit IRC | 19:50 | |
| notmorgan | and yes i am totally spoiled by gerrit workflow vs PRs. | 19:50 |
| notmorgan | sooooooo | 19:50 |
| notmorgan | :) | 19:50 |
| notmorgan | i'm totally fine if it should be external bot reading the stream. | 19:51 |
| clarkb | jeblair: ok I have added two rules to internap, one for ipv4 0.0.0.0/0 and one for ipv6 ::/0 with all other details left blank | 19:51 |
| clarkb | jeblair: should go ahead and delete the icmp/tcp/udp rules? | 19:52 |
| clarkb | notmorgan: so these use the github tracker? | 19:52 |
| notmorgan | clarkb: right now i think one uses bitbucket, the other github. | 19:52 |
| *** cody-somerville has joined #openstack-infra | 19:52 | |
| *** cody-somerville has quit IRC | 19:52 | |
| *** cody-somerville has joined #openstack-infra | 19:52 | |
| notmorgan | but essentially same kind of thing. | 19:52 |
| *** flepied has joined #openstack-infra | 19:53 | |
| jeblair | clarkb: yes, i think delete the rules | 19:53 |
| jeblair | clarkb: (mostly for cleanliness; i think theoretically it shouldn't matter) | 19:54 |
| Shrews | jeblair: is there a way to lock a job down to a certain version of devstack? or is that done for you automatically if you lock it to stable/liberty? | 19:54 |
| clarkb | jeblair: all done | 19:55 |
| *** ihrachys has joined #openstack-infra | 19:55 | |
| clarkb | notmorgan: the first thing to keep in mind is we can really only sanely have one set of commentlinks in the gerrit config so the turn string in commit message to link to github won't happen. Instead it will be a broken link to launchpad | 19:56 |
| *** jgriffith_away is now known as jgriffith | 19:56 | |
| notmorgan | clarkb: i was actually thinking of having a bot add a separate link and use a different link-name for these, just not auto-linked in the gerrit css | 19:56 |
| clarkb | notmorgan: the problem with that is you break all those links when you switch to maniphest | 19:57 |
| clarkb | notmorgan: because you have changed the string | 19:57 |
| notmorgan | clarkb: well, i'll keep chatting with zzzeek on this and figure it out. also will bug craige and see where we are | 19:57 |
| notmorgan | cause if it's "soon-ish" then it can wait :) | 19:58 |
| notmorgan | clarkb: thanks! | 19:58 |
| *** jsavak has quit IRC | 19:59 | |
| *** jsavak has joined #openstack-infra | 20:00 | |
| clarkb | notmorgan: also github goes down a lot and aggressively rate limits us so there are various implementation details that you may have to work around | 20:00 |
| clarkb | I haven't tried interfacing with bitbucket to know if it has similar problems | 20:00 |
| notmorgan | clarkb: possibly | 20:00 |
| *** hashar has joined #openstack-infra | 20:01 | |
| *** amitgandhinz has quit IRC | 20:03 | |
| *** salv-orlando has joined #openstack-infra | 20:03 | |
| *** amitgandhinz has joined #openstack-infra | 20:04 | |
| *** weshay has quit IRC | 20:05 | |
| *** mrmartin has quit IRC | 20:05 | |
| *** salv-orlando has quit IRC | 20:07 | |
| *** annegentle has quit IRC | 20:11 | |
| prometheanfire | clarkb: can I get a email or something to give to the osic guy so he can search for you? | 20:12 |
| prometheanfire | fungi: ^ you too :P | 20:13 |
| clarkb | prometheanfire: cboylan@sapwetik.org is what I was on the thread as | 20:13 |
| prometheanfire | thanks | 20:14 |
| fungi | back now, sorry, quarterly pest control visit | 20:14 |
| *** sbalukoff has joined #openstack-infra | 20:14 | |
| *** ldnunes has quit IRC | 20:16 | |
| *** weshay has joined #openstack-infra | 20:17 | |
| fungi | and yeah, clarkb graciously volunteered to be the main point of contact on the osic thing | 20:17 |
| prometheanfire | clarkb: he found you | 20:18 |
| notmorgan | krotscheck1: ping | 20:18 |
| *** annegentle has joined #openstack-infra | 20:20 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/project-config: Change shade keystone v2 job for stable/liberty https://review.openstack.org/274877 | 20:22 |
| Shrews | jeblair: mordred: ^^^^ | 20:22 |
| *** jsavak has quit IRC | 20:22 | |
| * Shrews hopes that's all that is needed | 20:23 | |
| *** jsavak has joined #openstack-infra | 20:23 | |
| *** baoli_ has quit IRC | 20:23 | |
| *** nihilifer has quit IRC | 20:26 | |
| *** tongli has quit IRC | 20:28 | |
| Shrews | sdague: also fyi per our convo this morning ^^^ | 20:29 |
| *** nihilifer has joined #openstack-infra | 20:30 | |
| AJaeger | sdague: one more review request for you - I think you added this initially: https://review.openstack.org/#/c/272411/ | 20:31 |
| *** markmcclain has quit IRC | 20:32 | |
| *** rockyg has left #openstack-infra | 20:32 | |
| *** markmcclain has joined #openstack-infra | 20:33 | |
| *** DuaneDeC7 has quit IRC | 20:34 | |
| *** jsavak has quit IRC | 20:35 | |
| *** jsavak has joined #openstack-infra | 20:36 | |
| *** electrofelix has quit IRC | 20:37 | |
| *** flwang1 has joined #openstack-infra | 20:37 | |
| *** DuaneDeC7 has joined #openstack-infra | 20:38 | |
| *** gongysh has quit IRC | 20:38 | |
| *** _nadya_ has quit IRC | 20:40 | |
| *** ashleighfarnham has quit IRC | 20:40 | |
| *** DuaneDeC7 has quit IRC | 20:44 | |
| *** DuaneDeC7 has joined #openstack-infra | 20:44 | |
| *** baoli has joined #openstack-infra | 20:45 | |
| *** baoli has quit IRC | 20:45 | |
| *** baoli has joined #openstack-infra | 20:46 | |
| *** followinfrared has quit IRC | 20:46 | |
| *** timothyb89_ is now known as timothyb89 | 20:47 | |
| *** doug-fis_ has quit IRC | 20:47 | |
| *** ayoung has joined #openstack-infra | 20:47 | |
| *** dtardivel has quit IRC | 20:48 | |
| *** zeih has joined #openstack-infra | 20:48 | |
| *** doug-fish has joined #openstack-infra | 20:48 | |
| pabelanger | fungi: things look better on puppetdb now, what was the issue? | 20:48 |
| *** sabeen3 has quit IRC | 20:49 | |
| fungi | pabelanger: a 130-minute delay before saying... | 20:50 |
| fungi | 2016-02-01 20:15:28,471 p=1604 u=root | fatal: [mirror.region-b.geo-1.hpcloud.openstack.org]: FAILED! => {"changed": false, "failed": true, "module_stderr": "", "module_stdout": "", "msg": "MODULE FAILURE", "parsed": false} | 20:50 |
| fungi | looks like we need to dereigster that | 20:51 |
| *** Apoorva has quit IRC | 20:51 | |
| jeblair | wonder why the cache didn't update? | 20:51 |
| pabelanger | fungi: wow, 130min timeout | 20:51 |
| fungi | yeah, i don't see mirror.region-b.geo-1.hpcloud.openstack.org mentioned in system-config | 20:52 |
| *** salv-orlando has joined #openstack-infra | 20:53 | |
| bknudson | do you know why, when tox -e docs in infra, the remote.origin.url would have something like p/openstack/keystone rather than openstack/keystone? | 20:53 |
| *** thomasem is now known as thomasem-away | 20:53 | |
| bknudson | trying to figure out why all the project source links are wrong in the developer docs. | 20:53 |
| jeblair | fungi: we're using the openstack ansible inventory | 20:53 |
| jeblair | fungi: it caches because it's slow | 20:53 |
| jeblair | fungi: so it's probably still in the cache | 20:53 |
| clarkb | bknudson: we dont use tox -e docs | 20:53 |
| fungi | right, just making sure we'd thoroughly removed it from our static lists before looking into the caching | 20:54 |
| *** Sukhdev has joined #openstack-infra | 20:54 | |
| jeblair | ok | 20:54 |
| fungi | which we seem to have done | 20:54 |
| clarkb | bknudson: but the p/ prefix is a gerritism | 20:54 |
| jeblair | fungi: so i think either it disappeared since the last cache update, or maybe if it can't contact the cloud at all, it doesn't update the cache | 20:54 |
| bknudson | the cgit link doesn't have p/ -- http://git.openstack.org/cgit/openstack/keystone | 20:54 |
| clarkb | bknudson: correct it is a gerritism | 20:55 |
| jeblair | fungi: Shrews may either know or be interested in the answer :) | 20:55 |
| AJaeger | bknudson: we use "python setup.py build_sphinx" | 20:55 |
| *** hichihara has joined #openstack-infra | 20:55 | |
| fungi | i need to educate myself on what updates the /var/cache/ansible-inventory/ansible-inventory.cache file, but first i need to step away again so please don't let me hold up someone else investigating | 20:55 |
| jeblair | i am not investigating | 20:55 |
| Shrews | ?? | 20:55 |
| fungi | i'll continue looking in a bit when i get back, if nobody beats me to the root cause | 20:56 |
| bknudson | ok, I thought it did tox -e docs, but either way oslosphinx is doing `git config --local --get remote.origin.url` which has a p/ in the path. | 20:56 |
| jeblair | Shrews: hpcloud disappeared, but a host is still in our ansible inventory cache; i'm wondering if ansible will eventually remove it, or will it stay there forever since it can't contact the cloud at all? | 20:56 |
| fungi | ftr, mirror.region-b.geo-1.hpcloud.openstack.org is definitely still in /var/cache/ansible-inventory/ansible-inventory.cache and that file was last modified 18.5 hours ago | 20:57 |
| *** jcoufal has quit IRC | 20:57 | |
| ianw | clarkb: you moved the nodepool logging config over to the template, did we update the generation scripts? | 20:57 |
| fungi | so if it's a daily cache update, that would 'splain it i guess | 20:57 |
| clarkb | ianw: I did | 20:57 |
| * fungi will bbiab | 20:57 | |
| jeblair | fungi: yeah, and i don't know when the host actually disappeared...maybe cacti does | 20:57 |
| *** hdd has quit IRC | 20:57 | |
| *** ashleighfarnham has joined #openstack-infra | 20:57 | |
| clarkb | ianw: just needed path changes otherwise should be the same | 20:57 |
| AJaeger | Could some project-config cores review the next translation step, please? https://review.openstack.org/#/c/274421 switches most repos to the new set up | 20:57 |
| *** kzaitsev_mb has joined #openstack-infra | 20:58 | |
| jeblair | fungi, Shrews: we only lost contact with the host a few hours ago; perhaps the cloud went down at the same time. so yeah, we probably have not exercised the cache update since then. | 20:58 |
| openstackgerrit | Mikhail S Medvedev proposed openstack-infra/devstack-gate: Use first index-url in pip.conf to derive pypi_host https://review.openstack.org/274886 | 21:00 |
| zeih | AJaeger: should the patch be abandoned or workflow -1? https://review.openstack.org/#/c/274855/ | 21:01 |
| Shrews | jeblair: fungi: there is a refresh option to the inventory, if that's useful for you | 21:01 |
| *** dims has joined #openstack-infra | 21:02 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config: Update nodepool logging for Fedora 23 https://review.openstack.org/247909 | 21:02 |
| ianw | clarkb: ^ ok, the file there seems older ... jeblair had an update out there that got most of these changes, but maybe it's lost in the swizzle around | 21:02 |
| AJaeger | zeih: abandon it - you can always restore. And it's easy to regenerate... | 21:02 |
| zeih | AJaeger: yes it is. okay. Have a nice evening | 21:03 |
| *** dims_ has quit IRC | 21:03 | |
| clarkb | ianw: I didn't update any existing changes that update the file, I just updated the generation script | 21:04 |
| ianw | clarkb: right, digging further, the change i was thinking of didn't merge -> https://review.openstack.org/#/c/272757/ . that explains why the file looks "old" | 21:04 |
| *** zeih has quit IRC | 21:04 | |
| clarkb | ianw: I think the change that that conflicts with is the one I wrote which does the more complete thing | 21:05 |
| clarkb | maybe? | 21:06 |
| *** unicell has quit IRC | 21:06 | |
| *** vivekd has joined #openstack-infra | 21:06 | |
| clarkb | oh wait I see | 21:06 |
| clarkb | we just need to update to pick up delta gotcha | 21:06 |
| clarkb | so that will need an update and modify the imgae builder logging config instead | 21:06 |
| *** jsavak has quit IRC | 21:06 | |
| *** doug-fish has quit IRC | 21:06 | |
| *** sridhar_ram has joined #openstack-infra | 21:07 | |
| *** jsavak has joined #openstack-infra | 21:07 | |
| ianw | clarkb: https://review.openstack.org/#/c/247909/ i just updated will do that ... it's been around since nov 20 | 21:07 |
| *** baoli has quit IRC | 21:07 | |
| ianw | maybe we can just merge it, and we can abandon these others | 21:07 |
| *** doug-fish has joined #openstack-infra | 21:07 | |
| *** baoli has joined #openstack-infra | 21:07 | |
| clarkb | ianw: ++ | 21:08 |
| clarkb | ianw: +2'd | 21:08 |
| *** baoli has quit IRC | 21:08 | |
| *** rocky_g has joined #openstack-infra | 21:08 | |
| *** baoli has joined #openstack-infra | 21:09 | |
| *** esker has quit IRC | 21:09 | |
| *** markmcclain has quit IRC | 21:09 | |
| *** doug-fis_ has joined #openstack-infra | 21:09 | |
| *** markmcclain has joined #openstack-infra | 21:09 | |
| *** davideagnello has joined #openstack-infra | 21:10 | |
| *** doug-fi__ has joined #openstack-infra | 21:11 | |
| *** hichihara has quit IRC | 21:11 | |
| *** doug-fish has quit IRC | 21:11 | |
| *** thorst has quit IRC | 21:12 | |
| clarkb | any objection to me asking emc ipsilon third party ci to stop checking devstack-gate? | 21:13 |
| *** Sukhdev has quit IRC | 21:13 | |
| *** doug-fis_ has quit IRC | 21:13 | |
| jeblair | clarkb: huh, i thought i disabled them | 21:13 |
| jeblair | on friday | 21:14 |
| clarkb | jeblair: well that would work too I suppose but they just commented on my vxlan change | 21:14 |
| clarkb | perhaps they were reenabled or have multiple accounts? as stackalytics shows making a new account is apparently a work around of choice around here | 21:15 |
| *** Apoorva has joined #openstack-infra | 21:15 | |
| *** doug-fi__ has quit IRC | 21:15 | |
| *** ZZelle_ has joined #openstack-infra | 21:15 | |
| clarkb | I rechecked the vxlan change to get it to run against more clouds and see if I can tickle the jenkins disconnect again or maybe that was just a fluke | 21:15 |
| jeblair | nope, same account | 21:16 |
| *** rcernin has joined #openstack-infra | 21:19 | |
| *** darrenc_ is now known as darrenc | 21:19 | |
| *** aysyd has quit IRC | 21:20 | |
| openstackgerrit | Merged openstack-infra/system-config: Update nodepool logging for Fedora 23 https://review.openstack.org/247909 | 21:21 |
| *** doug-fish has joined #openstack-infra | 21:23 | |
| *** baoli has quit IRC | 21:24 | |
| dansmith | I'm getting lots of 503s from gerrit just now | 21:24 |
| jeblair | clarkb: the account is still disabled | 21:25 |
| clarkb | jeblair: huh | 21:25 |
| clarkb | dansmith: I think I have tracked that down to paache deciding the backend has gone to lunch and thus refusing to ocnnect to it | 21:26 |
| clarkb | but I havne't figured out why apache thinks that yet | 21:26 |
| *** jsavak has quit IRC | 21:26 | |
| jeblair | clarkb: they have some open connections though, so i'll kill them | 21:26 |
| dansmith | clarkb: yeah, apache will do that for some cache interval if it gets something seemingly fatal from the backend | 21:26 |
| stevemar | sdague: just finished documenting a bunch of failures on the etherpad https://etherpad.openstack.org/p/v3-only-devstack | 21:26 |
| *** jsavak has joined #openstack-infra | 21:27 | |
| dansmith | clarkb: just thought maybe it was indicative of time-to-reboot-gerrit | 21:27 |
| clarkb | dansmith: it may be | 21:27 |
| openstackgerrit | Merged openstack-infra/system-config: Add storyboard.openstack.org to cacti https://review.openstack.org/274177 | 21:27 |
| *** doug-fis_ has joined #openstack-infra | 21:27 | |
| *** markmcclain has quit IRC | 21:27 | |
| *** doug-fish has quit IRC | 21:28 | |
| *** julim has quit IRC | 21:28 | |
| *** sabeen has joined #openstack-infra | 21:28 | |
| *** dtardivel has joined #openstack-infra | 21:29 | |
| *** amrith is now known as _amrith_ | 21:31 | |
| *** thorst has joined #openstack-infra | 21:31 | |
| *** doug-fis_ has quit IRC | 21:32 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add functional tests for windmill https://review.openstack.org/274900 | 21:32 |
| *** doug-fish has joined #openstack-infra | 21:33 | |
| *** DuaneDeC7 has quit IRC | 21:34 | |
| *** markmcclain has joined #openstack-infra | 21:35 | |
| *** sabeen2 has joined #openstack-infra | 21:35 | |
| *** esker has joined #openstack-infra | 21:37 | |
| *** esker has quit IRC | 21:37 | |
| *** esker has joined #openstack-infra | 21:37 | |
| *** sabeen has quit IRC | 21:37 | |
| *** MarkAtwood has quit IRC | 21:41 | |
| openstackgerrit | Merged openstack/requirements: remove argparse from requirements list https://review.openstack.org/270354 | 21:42 |
| *** rcernin has quit IRC | 21:44 | |
| *** matrohon has quit IRC | 21:45 | |
| *** Sukhdev has joined #openstack-infra | 21:47 | |
| openstackgerrit | Mathieu Gagné proposed openstack-infra/system-config: gerrit: Add borders to test result table https://review.openstack.org/263866 | 21:47 |
| *** jpr has joined #openstack-infra | 21:48 | |
| clarkb | infra-root osic has asked me for a list of users and their email addrs, should I go ahead and tell them seomthing like admin@openstack or similar? | 21:49 |
| *** eil397 has joined #openstack-infra | 21:49 | |
| *** peristeri has quit IRC | 21:50 | |
| *** edmondsw has quit IRC | 21:50 | |
| openstackgerrit | Mathieu Gagné proposed openstack-infra/system-config: gerrit: Restore reasonable max-width to change info table https://review.openstack.org/267823 | 21:51 |
| clarkb | jeblair: how did you do that for bluebox and ovh and internap? I can try to keep them all similar | 21:51 |
| *** angdraug has joined #openstack-infra | 21:52 | |
| *** burgerk has quit IRC | 21:56 | |
| *** devananda has quit IRC | 21:57 | |
| *** rossella_s has quit IRC | 21:58 | |
| *** ihrachys has quit IRC | 22:03 | |
| *** j_king has quit IRC | 22:05 | |
| *** amitgandhinz has quit IRC | 22:06 | |
| *** j_king has joined #openstack-infra | 22:06 | |
| *** erlon has quit IRC | 22:06 | |
| *** eharney has quit IRC | 22:06 | |
| *** amitgandhinz has joined #openstack-infra | 22:07 | |
| *** thomasem-away is now known as thomasem | 22:09 | |
| *** vgridnev has quit IRC | 22:09 | |
| *** chlong has joined #openstack-infra | 22:10 | |
| *** thomasem is now known as thomasem-away | 22:15 | |
| jeblair | clarkb: i think the password file lists all of that | 22:15 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add support for gentoo to simple-init https://review.openstack.org/273790 | 22:15 |
| jeblair | krotscheck1: i know you're away now, but hopefully i left enough comments on the wheel patches that you can update them and maybe we can merge them tomorrow | 22:16 |
| jeblair | fungi: you may want to review these as well (topic:wheel_mirror) and related | 22:16 |
| jeblair | krotscheck1: i haven't made the volumes yet, i'll do that tomorrow after i confirm the names and paths with you (that's mentioned in one of the comments) | 22:17 |
| ianw | greghaynes: have you looked at this centos build failure in dib? just don't want to waste time rediscovering the same things ... :) | 22:17 |
| prometheanfire | kik | 22:17 |
| *** Sukhdev has quit IRC | 22:18 | |
| *** EricGonczer_ has quit IRC | 22:18 | |
| *** rfolco has quit IRC | 22:19 | |
| *** Sukhdev has joined #openstack-infra | 22:20 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Fix package-installs for python3 https://review.openstack.org/273782 | 22:22 |
| *** Sukhdev has quit IRC | 22:22 | |
| prometheanfire | nice to see ianw and greghaynes taking over my reviews :| | 22:22 |
| *** piet has quit IRC | 22:24 | |
| ianw | greghaynes: hmm, i wonder if this centos6 build is even worth testing in CI ... | 22:29 |
| *** Sukhdev has joined #openstack-infra | 22:31 | |
| *** Sukhdev has quit IRC | 22:31 | |
| *** Sukhdev has joined #openstack-infra | 22:31 | |
| openstackgerrit | Merged openstack/requirements: python-ironicclient 1.1.0 https://review.openstack.org/274462 | 22:32 |
| krotscheck1 | jeblair: Thanks, I'll take al ook | 22:36 |
| *** trown is now known as trown|outttypeww | 22:36 | |
| clarkb | jeblair: looks like we used infra-root@openstack.org which I am guessing is an alias for all of us | 22:37 |
| clarkb | I will use that | 22:37 |
| *** tiswanso has quit IRC | 22:38 | |
| clarkb | oh we also have openstack-infra@openstack.org | 22:38 |
| greghaynes | ianw: ya, if its failing a lot SGTM | 22:38 |
| clarkb | I guess I hsould do some digging to determine which is more appropriate | 22:38 |
| *** Sukhdev has quit IRC | 22:38 | |
| *** ybathia has quit IRC | 22:38 | |
| ianw | greghaynes: something borked with packages i guess | 22:39 |
| ianw | 2016-02-01 21:10:04.260 | Error: Package: python2-rsa-3.3-2.el6.noarch (epel) | 22:39 |
| ianw | 2016-02-01 21:10:04.260 | Requires: python-pyasn1 >= 0.1.3 | 22:39 |
| ianw | 2016-02-01 21:10:04.260 | Available: python-pyasn1-0.0.12a-1.el6.noarch (base) | 22:39 |
| openstackgerrit | Merged openstack/requirements: tuskar is no longer maintained https://review.openstack.org/273088 | 22:39 |
| ianw | trying to get to the bottom of it first ... | 22:39 |
| greghaynes | ianw: oh, so its an actual break | 22:39 |
| ianw | maybe, but just as likely we're doing something silly to cause it... | 22:39 |
| *** daemontool has quit IRC | 22:39 | |
| *** devananda has joined #openstack-infra | 22:39 | |
| Sam-I-Am | anyone here know about the docs ftp publisher? | 22:41 |
| ianw | i'm just bringing up a centos6 vm to test it in ... been (thankfully) long time since i had to use one :) | 22:41 |
| Sam-I-Am | or... can help me with a potential problem | 22:41 |
| clarkb | Sam-I-Am: I know things | 22:41 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Fix on user idenfier contruction https://review.openstack.org/274917 | 22:41 |
| Sam-I-Am | clarkb: cool | 22:41 |
| Sam-I-Am | clarkb: it looks to me that it doesn't delete obsolete files? | 22:42 |
| *** camunoz has joined #openstack-infra | 22:42 | |
| clarkb | Sam-I-Am: correct, its just ftp | 22:42 |
| fungi | okay, back again. catching up and then digging into ansible inventory cache questions | 22:42 |
| Sam-I-Am | clarkb: hmm, that is a problem | 22:42 |
| clarkb | fungi: do you know what the differences between infra-root@openstack.org and openstack-infra@openstack.org are? we used one on ovh and the other on internap | 22:42 |
| Sam-I-Am | clarkb: google picks up on individual files and people can still get to them, even when the docs no longer reference and delete them | 22:42 |
| clarkb | Sam-I-Am: yes that is a long known problem with cloud sites | 22:43 |
| *** Sukhdev has joined #openstack-infra | 22:43 | |
| clarkb | (if we could rsync this would be a non issue) | 22:43 |
| Sam-I-Am | is there any way to remove the target dir before copying files? | 22:43 |
| *** amitgandhinz has quit IRC | 22:43 | |
| Sam-I-Am | or is there a job that does cleanup that i can trigger | 22:43 |
| fungi | jeblair: krotscheck1: thanks--some light evening reading! | 22:44 |
| clarkb | currently no, I think it has to be done manually (I don't know that jenkins' publisher can express deletes) | 22:44 |
| Sam-I-Am | clarkb: hmm, that's frustrating. so things just keep piling up? | 22:44 |
| clarkb | Sam-I-Am: yes, it is one of the things that will be addressed by moving the hosting of docs but I don't think anyone is actively working that yet | 22:46 |
| Sam-I-Am | clarkb: is there a way i can submit a list of files to remove to... someone? | 22:47 |
| clarkb | Sam-I-Am: I think annegentle had been cleaning them up in the past? might be worth starting there to make sure we aren't doing something that has a process already | 22:47 |
| Sam-I-Am | ok, i'll ask her | 22:47 |
| Sam-I-Am | thx | 22:47 |
| fungi | clarkb: i definitely do not know the difference between those two mail aliases, have you logged into their inboxes? are they going to the same account? | 22:47 |
| *** jpr has quit IRC | 22:48 | |
| annegentle | Sam-I-Am: clarkb: we'd like to have infra implement swift objects so that the manual process can be dropped. | 22:48 |
| clarkb | fungi: I havne't yet am about to as soon as I get power to laptop | 22:48 |
| Sam-I-Am | and there she is | 22:48 |
| annegentle | fungi: I've asked around about prioritizing this spec: http://specs.openstack.org/openstack-infra/infra-specs/specs/doc-publishing.html | 22:48 |
| annegentle | fungi: can you try to find a resource? | 22:48 |
| annegentle | Sam-I-Am: log a bug and assign me in openstack-manuals if it's on docs.openstack; | 22:48 |
| fungi | annegentle: i can certainly shop it around our meeting tomorrow and start a ml thread to get some interest in doing the implementation work | 22:49 |
| Sam-I-Am | annegentle: this particular issue is a devref thing, but i see it come up now and then with other things | 22:49 |
| annegentle | fungi: sounds good, I'll join in and add it to the agenda for tomorrow. I've asked jhesketh since he knows alot about the swift logging blueprint; he's not sure he could take it on | 22:50 |
| *** esker has quit IRC | 22:50 | |
| *** hdd has joined #openstack-infra | 22:50 | |
| fungi | annegentle: thanks! and yeah, i'm sure jhesketh is already spread pretty thin | 22:50 |
| gtmanfred | SpamapS: awesome, just saw the prs today | 22:50 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Remove trusted-hosts from pip.conf https://review.openstack.org/273636 | 22:50 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Removed pypi.<region> mirror manifests https://review.openstack.org/273518 | 22:50 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Update bandersnatch documentation https://review.openstack.org/273519 | 22:50 |
| jeblair | krotscheck1: why the rebase on 273636? | 22:52 |
| krotscheck1 | becayse distracted by baby | 22:52 |
| krotscheck1 | gumme a few | 22:52 |
| jeblair | krotscheck1: i'll fix it for you :) | 22:54 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Removed pypi.<region> mirror manifests https://review.openstack.org/273518 | 22:55 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Update bandersnatch documentation https://review.openstack.org/273519 | 22:55 |
| *** bpokorny_ has joined #openstack-infra | 22:56 | |
| *** kzaitsev_mb has quit IRC | 22:57 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Remove trusted-hosts from pip.conf https://review.openstack.org/273636 | 22:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Remove trusted-hosts from pip.conf https://review.openstack.org/273636 | 22:57 |
| clarkb | infra-root doesn't appear to forward to anything | 22:57 |
| jeblair | that's harder to fix than it shoud be :( | 22:57 |
| clarkb | and I don't see creds for openstack-infra@openstack.org so I think infra-root is the one I want | 22:58 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Removed pypi.<region> mirror manifests https://review.openstack.org/273518 | 22:58 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Update bandersnatch documentation https://review.openstack.org/273519 | 22:58 |
| clarkb | jeblair: do you know if the intent with infra-root was we would just access that mailbox directly rather than via forward/alias? | 22:58 |
| krotscheck1 | jeblair: back | 22:59 |
| jeblair | clarkb: yep | 22:59 |
| fungi | clarkb: i think so, yes | 22:59 |
| * krotscheck1 wishes that dependent patches were a little more ovious | 22:59 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Fix on user idenfier contruction https://review.openstack.org/274917 | 22:59 |
| clarkb | cool I am just going to go ahead and use that address since it seems saner | 22:59 |
| jeblair | clarkb: yes | 22:59 |
| *** bpokorny has quit IRC | 22:59 | |
| jeblair | clarkb: note i think we also used jenkins@o.o for the second accounts | 22:59 |
| jeblair | (assuming the addr needs to be different) | 22:59 |
| *** jsavak has quit IRC | 23:00 | |
| clarkb | jeblair: ok can let them know that | 23:00 |
| fungi | okay, so our ansible inventory seems to be getting created by os-client-config. does that sound correct to anyone else? | 23:00 |
| clarkb | and that is an alias for infra-root | 23:00 |
| jeblair | clarkb: yup | 23:01 |
| *** weshay has quit IRC | 23:01 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Update bandersnatch documentation https://review.openstack.org/273519 | 23:01 |
| krotscheck1 | ok. | 23:01 |
| fungi | the only reference in our puppet i find to doing anything in that path other than deleting the cache is in our clouds.yaml template | 23:01 |
| krotscheck1 | Let me just take all those individually and rebase them on master | 23:02 |
| *** yuanying has joined #openstack-infra | 23:02 | |
| fungi | so it seems to me that when we're running client calls, oscc is caching our nova list there in a format which we subsequently use as our ansible inventory file | 23:02 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Update bandersnatch documentation https://review.openstack.org/273519 | 23:02 |
| fungi | it's not yet clear to me what routine process would be triggering that on the puppetmaster | 23:03 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Update bandersnatch documentation https://review.openstack.org/273519 | 23:03 |
| fungi | though mordred had previously indicated that blowing away the inventory cache would cause it to be regenerated | 23:03 |
| jeblair | fungi: i think the puppet runs | 23:03 |
| *** dingyichen has joined #openstack-infra | 23:04 | |
| *** pradk has quit IRC | 23:04 | |
| *** regXboi has quit IRC | 23:05 | |
| *** hashar has quit IRC | 23:05 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Removed pypi.<region> mirror manifests https://review.openstack.org/273518 | 23:05 |
| fungi | well, the wrapper script called from our cron jobs doesn't seem to do anything other than call ansible playbooks, so if it's self-healing at each run then presumably one of the playbooks is making a call to something which imports oscc | 23:06 |
| krotscheck1 | jeblair: WIPing ^^ | 23:06 |
| krotscheck1 | Oh wait, it still has your -2. | 23:06 |
| krotscheck1 | n/m | 23:06 |
| jeblair | fungi: ansible uses shade which uses occ | 23:07 |
| nibalizer | jeblair: fungi yes that | 23:07 |
| krotscheck1 | Ok, I think that handles bandersnatch doc and the trusted host removal and the legacy manifest removal for later. | 23:08 |
| krotscheck1 | Now, on to wheeling things | 23:08 |
| fungi | yeah, that's the path to it i'm finding. so presumably oscc has some built-in cache refresh age which would cause this to update periodically, but will create it anew if missing | 23:08 |
| nibalizer | fungi: what is the bug? | 23:08 |
| *** annegentle has quit IRC | 23:08 | |
| clarkb | response sent to osic | 23:08 |
| jeblair | fungi: i think it's ansible inventory that has the cache, and i think it's 24h | 23:08 |
| fungi | nibalizer: hpcloud pypi mirror became unreachable and our ansible runs are spending a couple hours waiting for it to respond before timing out | 23:09 |
| fungi | so anyway, i'm reasonably convinced that it really is just that it's been less than 24 hours since the change merged to tear that our of our host list, and that deleting the cache is the safest solution | 23:09 |
| jeblair | fungi: did you see the note from Shrews earlier about the refresh command? | 23:09 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Added afs to wheel mirror slaves https://review.openstack.org/273054 | 23:09 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Add AFS and Admin keytab to release slave. https://review.openstack.org/273538 | 23:09 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Added AFS keytab to wheel slave https://review.openstack.org/273206 | 23:09 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Added conditional install statements for kernel header packages https://review.openstack.org/273205 | 23:09 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Added wheel hosting for AFS mirror slave https://review.openstack.org/270979 | 23:09 |
| krotscheck1 | Ok, those are now rebased on master and not on afs-mirror things | 23:10 |
| fungi | oh, sorry Shrews i was probably skimming | 23:10 |
| * krotscheck1 looks at project-config things | 23:10 | |
| *** xyang1 has quit IRC | 23:10 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: Check branch-override in ofagent job-template https://review.openstack.org/274930 | 23:10 |
| jeblair | i have to run now | 23:10 |
| fungi | Shrews: what i should have asked is "refresh option where for the inventory?" | 23:10 |
| fungi | jeblair: thanks! | 23:10 |
| fungi | Shrews: like an on-demand thing, or you mean a config option to tune the refresh interval? | 23:11 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Add wheel mirror to configure_mirror.sh https://review.openstack.org/267117 | 23:13 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Added wheel-release job https://review.openstack.org/273549 | 23:13 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Create jobs for a wheel mirror https://review.openstack.org/164927 | 23:13 |
| krotscheck1 | And that's that. | 23:13 |
| *** piet has joined #openstack-infra | 23:14 | |
| openstackgerrit | Merged openstack-infra/openstackid: Fix on user idenfier contruction https://review.openstack.org/274917 | 23:14 |
| *** armax has quit IRC | 23:15 | |
| *** david-lyle has quit IRC | 23:15 | |
| fungi | today i learned ... mumble mumble ... ansible openstackclient shade oscc inventory cache ... mumble mumble | 23:16 |
| clarkb | harlowja: I never heard back on your end about talking about cloud resources. Just ping me on irc or via email if you want ot set something up | 23:16 |
| Shrews | fungi: i have no idea how you're using the inventory. are you going through shade directly or using the inventory module provided by ansible? | 23:16 |
| harlowja | clarkb ya, i think management here wanted to have a internal chat first, then pull u in :) | 23:16 |
| harlowja | u or someone in | 23:16 |
| Shrews | fungi: module has a --refresh option, shade has a 'refresh' parameter | 23:16 |
| harlowja | said internal chat/meeting hasn't happened yet | 23:16 |
| clarkb | harlowja: gotcha, well just let me/us know if/when you get to that point | 23:17 |
| harlowja | kk | 23:17 |
| fungi | Shrews: this is all under ansible, was just trying to narrow down the symptoms we were seeing to be sure we weren't failing to refresh the inventory cache | 23:17 |
| Shrews | fungi: also, i *think* the cache is just a file? could possibly delete it, but ymmv | 23:17 |
| clarkb | dogpile uses a file by default | 23:17 |
| ianw | greghaynes: ok, looks like upstream issue -> https://bugzilla.redhat.com/show_bug.cgi?id=1303660 . probably a botched fix | 23:17 |
| openstack | bugzilla.redhat.com bug 1303660 in python-rsa "Broken Dependencies for python2-rsa-3.3-2.el6.noarch" [Unspecified,New] - Assigned to yohangraterol92 | 23:17 |
| fungi | and yes, it's a cache, and yes i did just delete it a minute ago (well, moved it to my homedir so i can diff the auto-generated one against it shortly) | 23:17 |
| fungi | er, i meant yes it's a file | 23:18 |
| Shrews | fungi: https://github.com/ansible/ansible/blob/938c26d9524f0eecff03abc2678e6ccc5b36b034/contrib/inventory/openstack.py#L184-L185 | 23:19 |
| *** annegentle has joined #openstack-infra | 23:20 | |
| krotscheck1 | Oh look! | 23:20 |
| krotscheck1 | It's a bunch of patches! | 23:20 |
| krotscheck1 | Passing gate! | 23:20 |
| krotscheck1 | With a core +2 already! https://review.openstack.org/#/q/status:open+project:openstack-infra/system-config+branch:master+topic:wheel_mirror | 23:21 |
| krotscheck1 | What does it meaaaan! #doublerainbow | 23:21 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 23:22 | |
| *** rocky_g has quit IRC | 23:25 | |
| *** rbrndt has quit IRC | 23:26 | |
| *** vivekd has quit IRC | 23:27 | |
| krotscheck1 | Hrm. | 23:29 |
| *** armax has joined #openstack-infra | 23:29 | |
| krotscheck1 | jeblair: Sorry, was rushing through fixes. I'll look at the wheel-release job in the morning. | 23:30 |
| krotscheck1 | Or later tonight if the mucnhkin takes a nap | 23:30 |
| greghaynes | ianw: awesome | 23:31 |
| fungi | does this munchkin represent the lollipop guild? | 23:31 |
| greghaynes | ianw: so we find useful things! | 23:31 |
| krotscheck1 | fungi: Not yet, no sugar until he's at least 3. | 23:32 |
| fungi | got it, so lullaby league | 23:32 |
| *** mriedem_away is now known as mriedem | 23:32 | |
| *** rlandy has quit IRC | 23:34 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Skip centos functional testing https://review.openstack.org/274937 | 23:35 |
| *** gordc has quit IRC | 23:36 | |
| *** gildub has joined #openstack-infra | 23:36 | |
| fungi | Shrews: thanks! probably something that would take a bit of hackery to employ in situations where a host was removed from the inventory and then taken offline between typical cache refresh intervals. easier to just document blowing away the cache in these situations i guess | 23:36 |
| *** krotscheck1 has quit IRC | 23:36 | |
| *** jamielennox is now known as jamielennox|away | 23:36 | |
| fungi | rather than trying to detect the condition and remedy automagically | 23:36 |
| greghaynes | ianw: given that it is a real fail we found, I am less crazy about disabling that test | 23:37 |
| *** salv-orl_ has joined #openstack-infra | 23:37 | |
| greghaynes | ianw: I am more concerned with the sporadic mirror fails, which I think is mostly a fedora thing? | 23:37 |
| *** dtardivel has quit IRC | 23:38 | |
| *** dimtruck is now known as zz_dimtruck | 23:38 | |
| *** dalgaaf has quit IRC | 23:38 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: [DNM] Revert "Skip centos functional testing" https://review.openstack.org/274938 | 23:38 |
| *** kragniz_ is now known as kragniz | 23:38 | |
| ianw | greghaynes: so this failure is a hard-blocker until the upstream package is fixed. | 23:38 |
| ianw | see how the skip goes ... i can also put in a workaround | 23:40 |
| ianw | but really, i think i'll switch the functional testing over to fedora-minimal & centos-minimal builds | 23:40 |
| *** salv-orlando has quit IRC | 23:40 | |
| ianw | realistically, that is all i'm maintaining ... i doubt anyone cares about the cloud-image based builds | 23:41 |
| *** markvoelker has quit IRC | 23:41 | |
| *** MarkAtwood has joined #openstack-infra | 23:42 | |
| greghaynes | ianw: heh, fair enough | 23:43 |
| openstackgerrit | Eric Brown proposed openstack/requirements: Bump Bandit from 0.13.2 to 0.17.3 https://review.openstack.org/274939 | 23:44 |
| fungi | on a related note, i need to add some more bindep-fallback experimental jobs for different node types if we're close to having more dib-only types on rackspace | 23:45 |
| fungi | the one for ubuntu-trusty is passing both for bindep changes and project-config changes, and exercising the bindep fallback path in the job script at the same time | 23:46 |
| madorn | hi, does anyone know the status of enabling +2 reviews on openstack-dev/sandbox @ review.openstack.org? it has been broken since the Dec upgrade. | 23:46 |
| ianw | fungi: yeah, centos dib for rax is on my todo list, before being preempted (as usual). i'm not sure about it, so i will add it as a separate node & experimental job first i think | 23:47 |
| fungi | madorn: zaro found and fixed a bug in gerrit upstream, which needs to be backported to 2.11 (if it's merged yet) | 23:47 |
| fungi | though i think there was a related workaround in jeepyb which may fix it for us sooner | 23:48 |
| madorn | fungi: okay cool thanks for the info | 23:48 |
| fungi | if that's merged, then it should just be a matter of figuring out how to clean up the mess with the broken groups | 23:48 |
| fungi | which probably requires gerrit downtime | 23:48 |
| fungi | so will need to be scheduled once identified and tried out on review-dev | 23:49 |
| madorn | fungi: cool, let me know if i can help in anyway, thanks. | 23:49 |
| fungi | madorn: hopefully zaro sees this and can chime in with a more detailed status on the problem. i don't know if he's determined yet what the safest cleanup steps are | 23:50 |
| *** EricGonczer_ has joined #openstack-infra | 23:51 | |
| *** amotoki has joined #openstack-infra | 23:51 | |
| fungi | i'm guessing it's something like manually editing the groups files of all affected repos and then pushing those updates back into the gerrit meta/config ref | 23:51 |
| fungi | so maybe that can be done hot | 23:52 |
| *** yamahata has quit IRC | 23:53 | |
| *** Swami has quit IRC | 23:55 | |
| *** yamahata has joined #openstack-infra | 23:56 | |
| *** bpokorny_ has quit IRC | 23:57 | |
| madorn | fungi: cool, do you by any chance know the upstream gerrit bug # | 23:57 |
| *** bpokorny has joined #openstack-infra | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!