| *** armax has quit IRC | 00:02 | |
| *** gomarivera has quit IRC | 00:02 | |
| *** links has joined #openstack-infra | 00:06 | |
| *** Swami_ has quit IRC | 00:08 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Make zuul ansible dir self-contained https://review.openstack.org/468208 | 00:11 |
|---|---|---|
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add untrusted-projects ansible test https://review.openstack.org/461881 | 00:12 |
| *** salv-orlando has joined #openstack-infra | 00:21 | |
| *** hichihara has quit IRC | 00:25 | |
| *** krtaylor has joined #openstack-infra | 00:28 | |
| *** salv-orlando has quit IRC | 00:30 | |
| *** jamesmca_ has joined #openstack-infra | 00:35 | |
| *** jaypipes has quit IRC | 00:35 | |
| *** pahuang has quit IRC | 00:36 | |
| *** jamesmca_ has quit IRC | 00:40 | |
| *** rwsu has quit IRC | 00:41 | |
| *** LindaWang has joined #openstack-infra | 00:41 | |
| *** hongbin has quit IRC | 00:44 | |
| *** Douhet has joined #openstack-infra | 00:52 | |
| *** pahuang has joined #openstack-infra | 00:52 | |
| *** cuongnv has joined #openstack-infra | 00:54 | |
| *** gyee has quit IRC | 00:54 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/project-config master: Remove stable mitaka tempest periodic jobs https://review.openstack.org/469358 | 00:58 |
| *** stakeda has joined #openstack-infra | 00:59 | |
| *** Sukhdev has quit IRC | 01:04 | |
| *** mriedem has quit IRC | 01:06 | |
| *** Julien-zte has joined #openstack-infra | 01:08 | |
| *** nicolasbock has quit IRC | 01:10 | |
| *** j_king_ has quit IRC | 01:10 | |
| *** namnh has joined #openstack-infra | 01:11 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/project-config master: Remove stable mitaka tempest periodic jobs https://review.openstack.org/469358 | 01:12 |
| *** esberglu has quit IRC | 01:13 | |
| *** links has quit IRC | 01:14 | |
| *** esberglu has joined #openstack-infra | 01:14 | |
| *** esikachev has quit IRC | 01:17 | |
| *** thorst has quit IRC | 01:17 | |
| *** yolkfull_ has joined #openstack-infra | 01:18 | |
| *** esberglu has quit IRC | 01:19 | |
| *** esikachev has joined #openstack-infra | 01:23 | |
| *** esberglu has joined #openstack-infra | 01:25 | |
| *** esberglu has quit IRC | 01:26 | |
| *** esikachev has quit IRC | 01:28 | |
| *** dhinesh has quit IRC | 01:29 | |
| *** thorst has joined #openstack-infra | 01:33 | |
| *** thorst has quit IRC | 01:33 | |
| *** esikachev has joined #openstack-infra | 01:43 | |
| *** aeng has quit IRC | 01:45 | |
| *** esikachev has quit IRC | 01:48 | |
| clarkb | mtreinish is awake | 01:48 |
| *** rfolco has joined #openstack-infra | 01:50 | |
| *** rfolco has quit IRC | 01:50 | |
| *** thorst has joined #openstack-infra | 01:53 | |
| *** thorst has quit IRC | 01:53 | |
| *** liujiong has joined #openstack-infra | 01:59 | |
| *** salv-orlando has joined #openstack-infra | 02:05 | |
| *** yonglihe has quit IRC | 02:07 | |
| *** yonglihe has joined #openstack-infra | 02:08 | |
| *** thorst has joined #openstack-infra | 02:09 | |
| *** thorst has quit IRC | 02:10 | |
| *** flepied has quit IRC | 02:11 | |
| *** esikachev has joined #openstack-infra | 02:11 | |
| *** esikachev has quit IRC | 02:15 | |
| *** rwsu has joined #openstack-infra | 02:16 | |
| *** Apoorva_ has quit IRC | 02:17 | |
| *** Apoorva has joined #openstack-infra | 02:18 | |
| *** salv-orlando has quit IRC | 02:20 | |
| *** esikachev has joined #openstack-infra | 02:21 | |
| *** Apoorva has quit IRC | 02:22 | |
| *** armax has joined #openstack-infra | 02:23 | |
| *** esikachev has quit IRC | 02:25 | |
| *** hongbin has joined #openstack-infra | 02:27 | |
| dmsimard | Starting seeing setuptools/pip/"no module named 'six'" errors all over the place, apparently due to a new version of setuptools: https://github.com/pypa/setuptools/issues/1042 | 02:27 |
| *** yolkfull_ has quit IRC | 02:27 | |
| dmsimard | Not sure if it started showing up in the gate yet (due to pip/pypi mirror/cache), it's currently plaguing all my jobs on an external CI | 02:28 |
| gouthamr | +1 | 02:30 |
| clarkb | dmsimard: that is because six is a setup requires of setuptools and I think we may pin six? we basically can't pin any setup requires | 02:30 |
| clarkb | so fix would be to remove any pins from openstack/requirements and associated projects | 02:30 |
| dmsimard | clarkb: dunno I guess they're going to fix and ship it asap https://github.com/pypa/setuptools/pull/1043 | 02:31 |
| dmsimard | they're going to need to force merge because they've broken themselves it's glorious | 02:31 |
| clarkb | oh then thats a new exciting brokeness | 02:32 |
| mtreinish | clarkb: heh, I am | 02:32 |
| mtreinish | dmsimard: I'm seeing that six issue too | 02:32 |
| mtreinish | but when installing the latest reno on stestr test jobs | 02:32 |
| *** thorst has joined #openstack-infra | 02:34 | |
| clarkb | oh wow it looks like they reverted the cahnge to stop vendoring | 02:34 |
| clarkb | and what broke was they didn't update the paths to use the newly vendored again libs | 02:34 |
| dmsimard | All my shit is broken right now and I wanted to finish something tonight before going on PTO :( | 02:36 |
| dmsimard | Don't really want to submit workarounds all over the place for something that should be fixed quickly :( | 02:36 |
| clarkb | dmsimard: I'm sorry, if possible you can likely downgrade your setuptools version after installing python things | 02:36 |
| clarkb | but ya if its going to be fixed then probably not worth the trouble | 02:36 |
| dmsimard | clarkb: not your fault, nothing to be sorry about -- this isn't even in the openstack gate :p | 02:36 |
| clarkb | dmsimard: well I know the feeling a couple years ago they pushed a releas eon like christmas eve that broke everything | 02:37 |
| clarkb | I didn't have a fun december that year | 02:37 |
| *** thorst has quit IRC | 02:38 | |
| mtreinish | dmsimard: at least in my single case downgrading reno to 2.3.0 fixed the issue for me. But if setuptools is being pulled in by something else that won't really help you | 02:40 |
| *** ihrachys has quit IRC | 02:44 | |
| *** ihrachys has joined #openstack-infra | 02:44 | |
| *** ttx has quit IRC | 02:45 | |
| mtreinish | fungi: andreaf just showed me he's setup osx desktop notifications for gerrit events off of the firehose | 02:46 |
| *** masber has quit IRC | 02:46 | |
| clarkb | thats both cool and terrifying at the same time | 02:47 |
| clarkb | does it ever stop notifying? | 02:47 |
| dmsimard | clarkb++ | 02:47 |
| dmsimard | clarkb: I guess the point would be to notify for important things, i.e, new patchsets for one's own reviews | 02:48 |
| *** yolkfull_ has joined #openstack-infra | 02:48 | |
| mtreinish | clarkb: I don't know how he's setup the filtering, he left a comment on one of his patches and it popped up | 02:49 |
| mtreinish | clarkb: I asked andreaf to post the code somewhere so I could link it in the firehose docs | 02:49 |
| *** ttx has joined #openstack-infra | 02:51 | |
| *** links has joined #openstack-infra | 02:53 | |
| *** bobh has joined #openstack-infra | 02:57 | |
| *** yamamoto_ has joined #openstack-infra | 02:58 | |
| *** yamamoto_ has quit IRC | 02:58 | |
| *** yamamoto_ has joined #openstack-infra | 02:58 | |
| *** gordc has joined #openstack-infra | 03:04 | |
| *** mriedem has joined #openstack-infra | 03:04 | |
| *** baoli_ has quit IRC | 03:07 | |
| *** esikachev has joined #openstack-infra | 03:07 | |
| *** Sukhdev has joined #openstack-infra | 03:11 | |
| *** ykarel__ has joined #openstack-infra | 03:12 | |
| *** esikachev has quit IRC | 03:12 | |
| *** knangia has quit IRC | 03:14 | |
| *** dave-mccowan has quit IRC | 03:16 | |
| *** salv-orlando has joined #openstack-infra | 03:17 | |
| *** ramishra has joined #openstack-infra | 03:20 | |
| *** Sukhdev has quit IRC | 03:20 | |
| *** xinliang has joined #openstack-infra | 03:21 | |
| *** xinliang has joined #openstack-infra | 03:21 | |
| *** Sukhdev has joined #openstack-infra | 03:22 | |
| *** salv-orl_ has joined #openstack-infra | 03:24 | |
| *** salv-orlando has quit IRC | 03:24 | |
| *** prateek has joined #openstack-infra | 03:26 | |
| *** zhurong has joined #openstack-infra | 03:27 | |
| *** salv-orl_ has quit IRC | 03:29 | |
| *** bobh has quit IRC | 03:30 | |
| *** psachin has joined #openstack-infra | 03:30 | |
| *** csomerville has joined #openstack-infra | 03:31 | |
| *** cshastri has joined #openstack-infra | 03:32 | |
| *** prateek has quit IRC | 03:33 | |
| *** prateek has joined #openstack-infra | 03:34 | |
| *** esikachev has joined #openstack-infra | 03:34 | |
| *** prateek has quit IRC | 03:34 | |
| *** ykarel_ has joined #openstack-infra | 03:35 | |
| *** csomerville has quit IRC | 03:35 | |
| *** cody-somerville has joined #openstack-infra | 03:36 | |
| *** cody-somerville has joined #openstack-infra | 03:36 | |
| *** prateek has joined #openstack-infra | 03:36 | |
| *** ykarel__ has quit IRC | 03:36 | |
| *** esikachev has quit IRC | 03:38 | |
| *** thorst has joined #openstack-infra | 03:38 | |
| *** esikachev has joined #openstack-infra | 03:39 | |
| *** vikrant has joined #openstack-infra | 03:42 | |
| *** prateek_ has joined #openstack-infra | 03:43 | |
| *** esikachev has quit IRC | 03:43 | |
| *** cody-somerville has quit IRC | 03:46 | |
| *** prateek has quit IRC | 03:46 | |
| *** esikachev has joined #openstack-infra | 03:53 | |
| *** thorst has quit IRC | 03:57 | |
| *** esikachev has quit IRC | 03:59 | |
| *** gordc has quit IRC | 04:04 | |
| *** rwsu has quit IRC | 04:07 | |
| *** Sukhdev has quit IRC | 04:08 | |
| *** markvoelker has quit IRC | 04:12 | |
| *** mriedem has quit IRC | 04:18 | |
| *** ykarel_ is now known as ykarel|bootcamp | 04:23 | |
| *** salv-orlando has joined #openstack-infra | 04:26 | |
| *** zhurong has quit IRC | 04:27 | |
| *** kornica has quit IRC | 04:29 | |
| *** s-shiono has joined #openstack-infra | 04:32 | |
| *** cody-somerville has joined #openstack-infra | 04:33 | |
| *** cody-somerville has joined #openstack-infra | 04:33 | |
| *** zhurong has joined #openstack-infra | 04:36 | |
| *** jamesmca_ has joined #openstack-infra | 04:36 | |
| *** salv-orlando has quit IRC | 04:40 | |
| *** stevemar__ has joined #openstack-infra | 04:40 | |
| *** jamesmca_ has quit IRC | 04:41 | |
| *** esikachev has joined #openstack-infra | 04:42 | |
| *** stevemar__ has quit IRC | 04:43 | |
| *** pcaruana has joined #openstack-infra | 04:43 | |
| *** stevemar__ has joined #openstack-infra | 04:44 | |
| *** kornicameister has joined #openstack-infra | 04:47 | |
| *** esikachev has quit IRC | 04:47 | |
| *** stevemar__ has quit IRC | 04:48 | |
| *** yamamoto_ has quit IRC | 04:48 | |
| *** salv-orlando has joined #openstack-infra | 04:53 | |
| *** thorst has joined #openstack-infra | 04:55 | |
| *** gouthamr has quit IRC | 04:55 | |
| *** ramishra has quit IRC | 04:58 | |
| *** thorst has quit IRC | 04:59 | |
| *** csomerville has joined #openstack-infra | 05:01 | |
| *** armax has quit IRC | 05:02 | |
| *** cody-somerville has quit IRC | 05:04 | |
| *** sree has joined #openstack-infra | 05:04 | |
| *** cody-somerville has joined #openstack-infra | 05:08 | |
| *** cody-somerville has joined #openstack-infra | 05:08 | |
| *** csomerville has quit IRC | 05:10 | |
| *** zhurong has quit IRC | 05:16 | |
| *** zhurong has joined #openstack-infra | 05:17 | |
| *** hongbin has quit IRC | 05:22 | |
| *** jaosorior_away is now known as jaosorior | 05:24 | |
| *** yamamoto_ has joined #openstack-infra | 05:35 | |
| *** ykarel_ has joined #openstack-infra | 05:37 | |
| *** rwsu has joined #openstack-infra | 05:38 | |
| *** ykarel|bootcamp has quit IRC | 05:39 | |
| *** liujiong has quit IRC | 05:40 | |
| *** dhajare-brb has joined #openstack-infra | 05:43 | |
| *** esikachev has joined #openstack-infra | 05:45 | |
| *** florianf has joined #openstack-infra | 05:47 | |
| *** pcaruana has quit IRC | 05:49 | |
| *** esikachev has quit IRC | 05:49 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use picked nodes for later cmd_* calls https://review.openstack.org/469330 | 05:55 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add state to NodeBase class https://review.openstack.org/469749 | 05:55 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Remove 'state' argument from later cmd_* calls https://review.openstack.org/469750 | 05:55 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use global state to check for duplicate fs labels https://review.openstack.org/469751 | 05:55 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move global mount tracking into state https://review.openstack.org/469752 | 05:55 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove stable mitaka tempest periodic jobs https://review.openstack.org/469358 | 05:55 |
| *** thorst has joined #openstack-infra | 05:56 | |
| *** rcernin has joined #openstack-infra | 05:58 | |
| openstackgerrit | Merged openstack-infra/project-config master: neutron: don't override projects to clone for functional job https://review.openstack.org/469666 | 05:59 |
| *** esikachev has joined #openstack-infra | 05:59 | |
| mtreinish | clarkb, fungi: andreaf is using this: https://github.com/jpmens/mqttwarn and isn't really doing filtering | 06:00 |
| mtreinish | heh, he was just subscribing to gerrit comments on openstack/tempest | 06:00 |
| *** thorst has quit IRC | 06:00 | |
| *** masber has joined #openstack-infra | 06:00 | |
| *** pcaruana has joined #openstack-infra | 06:02 | |
| *** esikachev has quit IRC | 06:03 | |
| *** flepied has joined #openstack-infra | 06:05 | |
| *** esikachev has joined #openstack-infra | 06:08 | |
| *** ltomasbo|away is now known as ltomasbo | 06:08 | |
| *** salv-orlando has quit IRC | 06:11 | |
| *** salv-orlando has joined #openstack-infra | 06:11 | |
| *** markvoelker has joined #openstack-infra | 06:12 | |
| *** Swami_ has joined #openstack-infra | 06:13 | |
| *** lewo has quit IRC | 06:13 | |
| *** esikachev has quit IRC | 06:13 | |
| *** andreas_s has joined #openstack-infra | 06:13 | |
| *** lewo has joined #openstack-infra | 06:14 | |
| *** markus_z has joined #openstack-infra | 06:15 | |
| *** salv-orlando has quit IRC | 06:16 | |
| *** Dinesh_Bhor has quit IRC | 06:23 | |
| *** ramishra has joined #openstack-infra | 06:27 | |
| *** liujiong has joined #openstack-infra | 06:32 | |
| *** Swami_ has quit IRC | 06:33 | |
| kornicameister | hi guys, I am experiencing a rather strange problem with local vagrant based deployment of devstack, an error from stack run can be found here: http://paste.openstack.org/show/611166/ | 06:37 |
| *** e0ne has joined #openstack-infra | 06:39 | |
| *** dimak_ has joined #openstack-infra | 06:40 | |
| *** e0ne has quit IRC | 06:42 | |
| *** markvoelker has quit IRC | 06:47 | |
| *** tesseract has joined #openstack-infra | 06:51 | |
| *** esikachev has joined #openstack-infra | 06:53 | |
| *** hwoarang_ is now known as hwoarang | 06:54 | |
| *** thorst has joined #openstack-infra | 06:56 | |
| *** neiljerram has joined #openstack-infra | 06:57 | |
| ianw | kornicameister: i think something globally might be wrong | 06:57 |
| ianw | http://logs.openstack.org/30/469330/2/check/gate-dib-dsvm-functests-python2-ubuntu-trusty/1b7e09c/console.html#_2017-06-01_06_17_14_568807 | 06:58 |
| ianw | similar issue in a recent dib build | 06:58 |
| ianw | i wonder if it's a new setuptools or something... | 06:58 |
| *** salv-orlando has joined #openstack-infra | 06:58 | |
| ianw | setuptools-36.0.0-py2.py3-none-any.whl (md5) Python Wheel py2.py3 2017-06-01 | 06:59 |
| ianw | hmmm | 06:59 |
| *** arturb has joined #openstack-infra | 06:59 | |
| kornicameister | ianw: hi, thx for replying | 06:59 |
| ianw | yeah, https://github.com/pypa/setuptools/issues/1042 | 06:59 |
| kornicameister | ianw: so the quickest possible fix would be to globally prevent installing certain setuptool version | 07:00 |
| kornicameister | ? | 07:00 |
| *** jpich has joined #openstack-infra | 07:00 | |
| *** esikachev has quit IRC | 07:01 | |
| ianw | kornicameister: well ... that turns into quite a whack-a-mole having been down that path before. the best thing would be if upstream fix it quickly :) | 07:01 |
| *** thorst has quit IRC | 07:01 | |
| kornicameister | ianw: yeah I figure that is the best thing that can happen | 07:02 |
| kornicameister | ianw: in the meantime, I am not really how it goes that gates in overall (for my project - monasca) are working fine | 07:02 |
| kornicameister | *not really sure | 07:02 |
| kornicameister | ianw: you have any suggestion we might try to put local.conf or prior to stack.sh first run that could help you here ? | 07:04 |
| kornicameister | *help us here | 07:04 |
| *** rossella__ has joined #openstack-infra | 07:05 | |
| *** cschwede_ has quit IRC | 07:05 | |
| ianw | VIRTUALENV_NO_DOWNLOAD=1 ? sorry, not even sure what that does but it's in the bug :) or maybe a hacked in "pip install six" | 07:05 |
| ianw | sorry, don't have time to dig ATM | 07:05 |
| *** CynicGalahad has joined #openstack-infra | 07:06 | |
| *** otherwiseguy has quit IRC | 07:06 | |
| kornicameister | ianw: sure thing, thx for replying anyway - btw: I posted this to other channels to bring some attention to that as well - let's see how it turns out | 07:06 |
| *** eranrom has joined #openstack-infra | 07:07 | |
| *** cschwede has joined #openstack-infra | 07:09 | |
| *** rossella_ has joined #openstack-infra | 07:12 | |
| *** rossella__ has quit IRC | 07:13 | |
| *** slagle has quit IRC | 07:16 | |
| *** shardy has joined #openstack-infra | 07:16 | |
| *** stevebaker has quit IRC | 07:16 | |
| *** claudiub has joined #openstack-infra | 07:18 | |
| *** jpena|off is now known as jpena | 07:22 | |
| afazekas | adding six to requirements or specifying setuptools version there does not helps, but if you install six into your venv before the requirements it works | 07:22 |
| *** flepied has quit IRC | 07:22 | |
| therve | setuptools broke the world? | 07:22 |
| openstackgerrit | Nam Nguyen Hoai proposed openstack-infra/project-config master: Barbican: update tests https://review.openstack.org/469648 | 07:23 |
| *** cshastri has quit IRC | 07:23 | |
| *** cshastri has joined #openstack-infra | 07:24 | |
| *** eranrom has quit IRC | 07:26 | |
| *** salv-orl_ has joined #openstack-infra | 07:28 | |
| *** gomarivera has joined #openstack-infra | 07:28 | |
| *** esikachev has joined #openstack-infra | 07:28 | |
| kornicameister | therve: setuptool broker the world | 07:29 |
| kornicameister | *broke | 07:29 |
| kornicameister | https://bugs.launchpad.net/devstack/+bug/1694904 | 07:29 |
| openstack | Launchpad bug 1694904 in devstack "pip_install failed with 'ImportError: No module named six'" [Undecided,New] | 07:29 |
| *** salv-orlando has quit IRC | 07:30 | |
| therve | It'd be nice to have a global announce, I suspect most projects are affected | 07:30 |
| *** eranrom has joined #openstack-infra | 07:31 | |
| kornicameister | if you know how to post such announcement, feel free to do so, I am not too familiar with the process | 07:31 |
| *** gomarivera has quit IRC | 07:32 | |
| *** esikachev has quit IRC | 07:32 | |
| MatthewLi | also affected with this tox issue "No module named six' | 07:33 |
| openstackgerrit | Merged openstack-infra/project-config master: Add new repo for keystone tempest plugin https://review.openstack.org/468943 | 07:34 |
| kornicameister | MatthewLi: could you put that vote to launchpad bug | 07:35 |
| kornicameister | I guess the more votes there the quickest some feedback or an action will be | 07:35 |
| *** eranrom has quit IRC | 07:35 | |
| *** jamesmca_ has joined #openstack-infra | 07:35 | |
| MatthewLi | kornicameister: yep, I see several projects faced the same problem | 07:36 |
| kornicameister | MatthewLi: and I thought this week couldn't get any worse | 07:36 |
| *** faizy has joined #openstack-infra | 07:37 | |
| arturb | there is a pull request to setuptools project to fix this problem: https://github.com/pypa/setuptools/pull/1043/commits | 07:37 |
| *** cuongnv has quit IRC | 07:37 | |
| *** cuongnv has joined #openstack-infra | 07:38 | |
| kornicameister | ianw: I noticed one difference between my local failing env and gate env [from here https://review.openstack.org/#/c/468686/] and spotted that pip is installed in gate but not in local env | 07:38 |
| kornicameister | ianw: but in overall I don't think that makes any difference for the core issue | 07:39 |
| kornicameister | arturb: I let them know ]:-> | 07:39 |
| kornicameister | arturb: that some of Openstack CI got broken | 07:39 |
| *** jamesmca_ has quit IRC | 07:40 | |
| *** eranrom has joined #openstack-infra | 07:41 | |
| *** neiljerram has quit IRC | 07:41 | |
| *** pas-ha has joined #openstack-infra | 07:41 | |
| pas-ha | hi guys, are you aware of new setuptools problems? | 07:42 |
| kornicameister | pas-ha | 07:42 |
| kornicameister | yeah | 07:42 |
| kornicameister | https://github.com/pypa/setuptools/pull/1043 | 07:42 |
| pas-ha | cool, thanks | 07:43 |
| kornicameister | check last comment ]:-> | 07:43 |
| *** markvoelker has joined #openstack-infra | 07:44 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add non-voting CentOS job for monitorstack https://review.openstack.org/469487 | 07:45 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove pypy jobs for python-cinderclient repos https://review.openstack.org/469534 | 07:46 |
| *** ralonsoh has joined #openstack-infra | 07:48 | |
| rm_work | aaaah i noticed this 'six' bug today outside of openstack entirely and was planning to track it down tomorrow, guess it makes sense it'd hit us | 07:49 |
| *** jlibosva has joined #openstack-infra | 07:49 | |
| kornicameister | well, this is more or less fresh bug - there are several setuptools versions that are restricted from usage inside openstack CI (devstacks, gates) but obsviously the one with the bug isn't | 07:50 |
| kornicameister | anyway, I just hope that it will get done soon, I am not really in position to help here more...got different stuff, but the knowledge that it is not my fault kind of helps ;-) | 07:50 |
| *** esikachev has joined #openstack-infra | 07:53 | |
| openstackgerrit | Merged openstack-infra/project-config master: Build IPA ramdisk from source in ironic-lib jobs https://review.openstack.org/469367 | 07:53 |
| *** flepied has joined #openstack-infra | 07:53 | |
| *** amoralej|off is now known as amoralej | 07:54 | |
| *** tosky has joined #openstack-infra | 07:55 | |
| *** alexchadin has joined #openstack-infra | 07:55 | |
| openstackgerrit | Merged openstack-infra/project-config master: disable swift for py3 enablement in ironic https://review.openstack.org/467538 | 07:56 |
| *** pgadiya has joined #openstack-infra | 07:57 | |
| *** hashar has joined #openstack-infra | 07:57 | |
| *** esikachev has quit IRC | 07:57 | |
| *** tosky has quit IRC | 07:57 | |
| *** thorst has joined #openstack-infra | 07:58 | |
| *** zzzeek_ has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:00 | |
| *** esikachev has joined #openstack-infra | 08:01 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/system-config master: Add firehose documentation for notifications https://review.openstack.org/469802 | 08:01 |
| *** hashar has quit IRC | 08:05 | |
| *** hashar has joined #openstack-infra | 08:05 | |
| openstackgerrit | Merged openstack-infra/project-config master: Enable tlsproxy in python35 job https://review.openstack.org/469287 | 08:06 |
| *** kiran-r has joined #openstack-infra | 08:09 | |
| *** esikachev has quit IRC | 08:09 | |
| *** kiran-r has quit IRC | 08:09 | |
| *** stevemar__ has joined #openstack-infra | 08:15 | |
| *** thorst has quit IRC | 08:16 | |
| *** markvoelker has quit IRC | 08:18 | |
| *** liujiong has quit IRC | 08:18 | |
| *** stevemar__ has quit IRC | 08:20 | |
| *** hashar has quit IRC | 08:20 | |
| *** aarefiev_afk is now known as aarefiev | 08:27 | |
| *** dizquierdo has joined #openstack-infra | 08:27 | |
| *** lucas-afk is now known as lucasagomes | 08:27 | |
| *** zhurong has quit IRC | 08:29 | |
| *** liujiong has joined #openstack-infra | 08:33 | |
| *** electrofelix has joined #openstack-infra | 08:36 | |
| *** dpawlik has joined #openstack-infra | 08:39 | |
| *** liujiong has quit IRC | 08:40 | |
| *** liujiong has joined #openstack-infra | 08:40 | |
| *** sheeprine has joined #openstack-infra | 08:42 | |
| *** dingyichen has quit IRC | 08:43 | |
| *** derekh has joined #openstack-infra | 08:44 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config master: Start building security hardened images on tripleo https://review.openstack.org/469809 | 08:44 |
| *** hashar has joined #openstack-infra | 08:45 | |
| *** pbourke_ has quit IRC | 08:53 | |
| *** pbourke_ has joined #openstack-infra | 08:53 | |
| *** rossella_ has quit IRC | 08:54 | |
| openstackgerrit | Merged openstack-infra/project-config master: Puppet OpenStack CI: Add experimental jobs for Puppet 5 https://review.openstack.org/469477 | 08:55 |
| *** s-shiono has quit IRC | 08:59 | |
| *** flepied has quit IRC | 09:01 | |
| *** neiljerram has joined #openstack-infra | 09:02 | |
| frickler | how about setting a global status message for the "no six" issue? seems almost every patch should be failing on it currently? | 09:05 |
| *** e0ne has joined #openstack-infra | 09:05 | |
| *** pgadiya has quit IRC | 09:10 | |
| *** sambetts|afk is now known as sambetts | 09:13 | |
| *** thorst has joined #openstack-infra | 09:13 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement a static driver for Nodepool https://review.openstack.org/468624 | 09:14 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Extend Nodepool configuration syntax to support multiple drivers https://review.openstack.org/468751 | 09:14 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Collect request handling implementation in an OpenStack driver https://review.openstack.org/468750 | 09:14 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Abstract Nodepool provider management code https://review.openstack.org/468749 | 09:14 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Abstract Nodepool request handling code https://review.openstack.org/468748 | 09:14 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Add support for custom ssh port https://review.openstack.org/468752 | 09:14 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement an OpenContainer driver https://review.openstack.org/468753 | 09:14 |
| *** markvoelker has joined #openstack-infra | 09:15 | |
| *** flepied has joined #openstack-infra | 09:17 | |
| *** thorst has quit IRC | 09:17 | |
| *** rossella_ has joined #openstack-infra | 09:18 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/469818 | 09:18 |
| *** rossella_ has quit IRC | 09:22 | |
| *** e0ne has quit IRC | 09:24 | |
| *** liujiong_lj has joined #openstack-infra | 09:29 | |
| *** liujiong has quit IRC | 09:30 | |
| ianw | #status notice There is a known issue with setuptools 36.0.0 and errors about the "six" package. For current details see https://github.com/pypa/setuptools/issues/1042 | 09:31 |
| kornicameister | ianw: https://review.openstack.org/#/c/469819/ | 09:34 |
| kornicameister | just a temporary solution from my collegue | 09:35 |
| kornicameister | FYI: error is present also while running tox locally | 09:35 |
| kornicameister | it download setuptool==36.0.0 and basically everything goes wrong from that point | 09:35 |
| ianw | setuptools is a bit of a pain | 09:35 |
| *** openstackstatus has quit IRC | 09:36 | |
| kornicameister | why is that ? | 09:36 |
| ianw | to get pinned, i mean | 09:36 |
| *** flepied has quit IRC | 09:37 | |
| *** openstackstatus has joined #openstack-infra | 09:37 | |
| *** ChanServ sets mode: +v openstackstatus | 09:37 | |
| ianw | hello again openstackstatus ... back from whatever hiatus you were on | 09:38 |
| kornicameister | it got bad setuptools | 09:38 |
| kornicameister | had to revert | 09:38 |
| *** yolkfull has joined #openstack-infra | 09:40 | |
| ianw | #status notice There is a known issue with setuptools 36.0.0 and errors about the "six" package. For current details see https://github.com/pypa/setuptools/issues/1042 and monitor #openstack-infra | 09:40 |
| frickler | ianw: maybe you need to identify with nickserv? | 09:41 |
| ianw | hmm, i should be, maybe my bouncer didn't | 09:41 |
| frickler | ianw: nickserver tells me you last were seen in january | 09:42 |
| *** yolkfull__ has joined #openstack-infra | 09:42 | |
| *** yolkfull_ has quit IRC | 09:42 | |
| *** yolkfull__ has quit IRC | 09:43 | |
| ianw | i guess something's up with znc | 09:43 |
| ianw | #status notice There is a known issue with setuptools 36.0.0 and errors about the "six" package. For current details see https://github.com/pypa/setuptools/issues/1042 and monitor #openstack-infra | 09:43 |
| openstackstatus | ianw: sending notice | 09:43 |
| ianw | it's that easy! | 09:43 |
| -openstackstatus- NOTICE: There is a known issue with setuptools 36.0.0 and errors about the "six" package. For current details see https://github.com/pypa/setuptools/issues/1042 and monitor #openstack-infra | 09:44 | |
| *** ltomasbo is now known as ltomasbo|away | 09:44 | |
| ianw | note to readers, requirements changes like https://review.openstack.org/#/c/469819/1 are not a total solution, because setuptools gets brought in by other bits | 09:44 |
| ianw | i think our best course of action here is to give the pypa people a little more time when they wake up | 09:45 |
| *** yolkfull has quit IRC | 09:45 | |
| *** e0ne has joined #openstack-infra | 09:45 | |
| *** e0ne has quit IRC | 09:45 | |
| openstackstatus | ianw: finished sending notice | 09:46 |
| *** grosjean has joined #openstack-infra | 09:46 | |
| *** markvoelker has quit IRC | 09:47 | |
| *** shardy is now known as shardy_afk | 09:47 | |
| *** ltomasbo|away is now known as ltomasbo | 09:47 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config master: Start building security hardened images on tripleo https://review.openstack.org/469809 | 09:48 |
| *** nicolasbock has joined #openstack-infra | 09:51 | |
| *** MatthewLi has quit IRC | 09:52 | |
| *** flepied has joined #openstack-infra | 09:53 | |
| *** e0ne has joined #openstack-infra | 09:54 | |
| *** camunoz has quit IRC | 09:54 | |
| *** sheeprine has quit IRC | 09:57 | |
| *** MatthewLi has joined #openstack-infra | 09:58 | |
| *** dtantsur|afk is now known as dtantsur | 10:00 | |
| dtantsur | clarkb: thanks! will look into it | 10:01 |
| *** yolkfull has joined #openstack-infra | 10:03 | |
| *** salv-orl_ has quit IRC | 10:04 | |
| *** cuongnv has quit IRC | 10:04 | |
| *** shardy_afk is now known as shardy | 10:05 | |
| *** wolverineav has joined #openstack-infra | 10:09 | |
| *** dongjun has joined #openstack-infra | 10:10 | |
| *** dongjun has left #openstack-infra | 10:10 | |
| *** stakeda has quit IRC | 10:11 | |
| *** alexchadin has quit IRC | 10:11 | |
| *** faizy_ has joined #openstack-infra | 10:13 | |
| *** faizy has quit IRC | 10:14 | |
| *** wfoster has quit IRC | 10:17 | |
| *** lucasagomes has quit IRC | 10:18 | |
| *** rook has quit IRC | 10:18 | |
| *** florianf has quit IRC | 10:19 | |
| *** lucasagomes has joined #openstack-infra | 10:25 | |
| *** florianf has joined #openstack-infra | 10:25 | |
| *** rook has joined #openstack-infra | 10:33 | |
| *** rook is now known as Guest86464 | 10:33 | |
| *** zhurong has joined #openstack-infra | 10:34 | |
| openstackgerrit | Sorin Sbârnea proposed openstack-infra/jenkins-job-builder master: list jobs using alphanum sorting https://review.openstack.org/463729 | 10:34 |
| *** Julien-zte has quit IRC | 10:34 | |
| *** esikachev has joined #openstack-infra | 10:35 | |
| *** wfoster has joined #openstack-infra | 10:37 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Make zuul ansible dir self-contained https://review.openstack.org/468208 | 10:38 |
| *** jpena is now known as jpena|lunch | 10:43 | |
| *** jkilpatr has quit IRC | 10:45 | |
| *** markvoelker has joined #openstack-infra | 10:45 | |
| *** Dinesh_Bhor has joined #openstack-infra | 10:46 | |
| *** yamamoto_ has quit IRC | 10:47 | |
| openstackgerrit | Rosario Di Somma proposed openstack-infra/shade master: Add pagination for the list_volumes call https://review.openstack.org/466927 | 10:47 |
| *** vaidy has quit IRC | 10:54 | |
| *** gaurangt_ has joined #openstack-infra | 10:56 | |
| *** vaidy has joined #openstack-infra | 10:57 | |
| *** pblaho has joined #openstack-infra | 10:58 | |
| *** jkilpatr has joined #openstack-infra | 11:02 | |
| *** matrohon has joined #openstack-infra | 11:07 | |
| *** dave-mccowan has joined #openstack-infra | 11:08 | |
| *** amoralej is now known as amoralej|lunch | 11:09 | |
| *** mat128 has joined #openstack-infra | 11:13 | |
| *** dikonoor has joined #openstack-infra | 11:15 | |
| *** thorst has joined #openstack-infra | 11:15 | |
| *** alexchadin has joined #openstack-infra | 11:16 | |
| *** markvoelker has quit IRC | 11:18 | |
| *** thorst has quit IRC | 11:19 | |
| *** sree has quit IRC | 11:19 | |
| *** sree has joined #openstack-infra | 11:20 | |
| *** otherwiseguy has joined #openstack-infra | 11:23 | |
| *** sree has quit IRC | 11:24 | |
| *** liujiong_lj has quit IRC | 11:25 | |
| *** pgadiya has joined #openstack-infra | 11:28 | |
| *** yamamoto has joined #openstack-infra | 11:29 | |
| *** yamamoto_ has joined #openstack-infra | 11:29 | |
| *** rhallisey has joined #openstack-infra | 11:31 | |
| *** mat128 has quit IRC | 11:33 | |
| *** yamamoto has quit IRC | 11:33 | |
| *** cshastri has quit IRC | 11:33 | |
| *** mat128 has joined #openstack-infra | 11:34 | |
| *** pgadiya has quit IRC | 11:34 | |
| *** psachin has quit IRC | 11:34 | |
| *** prateek_ has quit IRC | 11:35 | |
| *** yamamoto_ has quit IRC | 11:35 | |
| frickler | infra-root: dstufft seems to have deleted the broken setuptools from pypi as an intermediate solution, will the get automatically removed from our mirrors, too, or would that require manual intervention? | 11:35 |
| *** shardy has quit IRC | 11:36 | |
| frickler | the=that version | 11:36 |
| *** links has quit IRC | 11:37 | |
| dims | frickler : don't think so... but not sure | 11:38 |
| *** kgiusti has quit IRC | 11:41 | |
| *** thorst has joined #openstack-infra | 11:41 | |
| *** Guest86464 is now known as rook | 11:41 | |
| *** lucasagomes is now known as lucas-hungry | 11:41 | |
| *** ldnunes has joined #openstack-infra | 11:43 | |
| *** nicolasbock has quit IRC | 11:43 | |
| *** ruijie_ has joined #openstack-infra | 11:45 | |
| *** pradk has joined #openstack-infra | 11:45 | |
| *** mat128 has quit IRC | 11:45 | |
| *** tushar has quit IRC | 11:47 | |
| AJaeger | mordred: has your github chnage for jjb merged? I0fc551d38aa7243a02eed39b663a21e88f2ad713 created a new repo but it's not on github, see https://github.com/openstack/keystone-tempest-plugin | 11:50 |
| *** jpena|lunch is now known as jpena | 11:50 | |
| *** rfolco has joined #openstack-infra | 11:50 | |
| *** Julien-zte has joined #openstack-infra | 11:53 | |
| *** ruijie_ has quit IRC | 11:54 | |
| tumbarka | AJaeger : mordred : DIB image creation is failing for me because of this - https://pastebin.com/4jDf1mHV | 11:56 |
| tumbarka | https://github.com/openstack/keystone-tempest-plugin is not available | 11:57 |
| *** nicolasbock has joined #openstack-infra | 11:57 | |
| *** dizquierdo has quit IRC | 11:57 | |
| pabelanger | frickler: no, deleting packages from pypi is the wrong approach, we won't delete it from our mirrors, since we cannot delete it from every download location | 11:58 |
| AJaeger | tumbarka: wrong URL - but you're right, the problem is that git.openstack.org is not set up at all. | 11:58 |
| *** psachin has joined #openstack-infra | 11:58 | |
| *** mjturek has quit IRC | 11:58 | |
| cmurphy | :( | 11:58 |
| *** shardy has joined #openstack-infra | 11:58 | |
| *** apuimedo has joined #openstack-infra | 11:59 | |
| AJaeger | infra-root, https://git.openstack.org/openstack/keystone-tempest-plugin.git is already non-existing, change merged earlier. | 11:59 |
| apuimedo | yolanda: I assume infra people are already working on this... But since I saw that setuptools 36.0 has been deleted from pypi, could you please remove it from the infra cache so all the gates resume working? | 11:59 |
| *** bobh has joined #openstack-infra | 12:00 | |
| tumbarka | AJaeger : okay | 12:00 |
| pabelanger | apuimedo: I think we still need to land manage-project changes | 12:02 |
| pabelanger | apuimedo: sorry | 12:02 |
| pabelanger | AJaeger: | 12:02 |
| tumbarka | Ajaeger : one more error which I am facing in my third party CI setup while creating the DIB image is - https://pastebin.com/AbYSb6dg | 12:03 |
| tumbarka | unable to find whats wrong in my setup | 12:03 |
| pabelanger | tumbarka: if you check the log for nodepool, it should log what diskimage-builder was doing | 12:04 |
| AJaeger | tumbarka: sorry, can't help you with that, hope others can - maybe later. Let's first fix the system wide problems | 12:04 |
| *** cshastri has joined #openstack-infra | 12:05 | |
| apuimedo | pabelanger: I don't think so | 12:07 |
| apuimedo | clean devstack on my machines worked | 12:08 |
| apuimedo | the minute they pulled setuptools 36.0 from pypi | 12:08 |
| *** slagle has joined #openstack-infra | 12:09 | |
| *** yamamoto has joined #openstack-infra | 12:09 | |
| tumbarka | Pabelanger : okay | 12:09 |
| AJaeger | apuimedo, pabelanger : Indeed, I do not find 36.0 at http://mirror.mtl01.internap.openstack.org/pypi/simple/setuptools/ | 12:09 |
| pabelanger | apuimedo: right, we don't tend to delete things from our mirrors manually, just leads to more problems | 12:09 |
| *** Julien-zte has quit IRC | 12:10 | |
| apuimedo | pabelanger: AJaeger: are you saying that executions now will not find setuptools 36 cached anymore in the jenkins slaves? | 12:10 |
| pabelanger | wait, did bandersnatch delete it? | 12:10 |
| AJaeger | apuimedo: please try ;) | 12:10 |
| apuimedo | ok | 12:11 |
| AJaeger | apuimedo: pabelanger knows more here than I do - and if he's confused, I won't give any authoritative answer ;) | 12:11 |
| cmurphy | is there anything i should do about the keystone-tempest-plugin breakage? that was my change | 12:11 |
| *** stevemar__ has joined #openstack-infra | 12:12 | |
| apuimedo | AJaeger: I just did a recheck | 12:12 |
| AJaeger | cmurphy: friendly persuade your favorite infra-root to check log files and what went wron ;) | 12:12 |
| apuimedo | if it is not in our mirrors nor on the slaves it should resume working | 12:12 |
| AJaeger | I meant: ... and figure out what went wrong | 12:12 |
| cmurphy | but they are all my favorite <3 | 12:13 |
| AJaeger | ;) | 12:13 |
| *** amrith has quit IRC | 12:14 | |
| *** bobh has quit IRC | 12:14 | |
| *** amrith has joined #openstack-infra | 12:15 | |
| pabelanger | sigh, I did ln backwards | 12:15 |
| *** markvoelker has joined #openstack-infra | 12:15 | |
| AJaeger | pabelanger: that'S a classic mistake ;) | 12:15 |
| AJaeger | pabelanger: what did you try? | 12:16 |
| pabelanger | clarkb: fungi: jeblair: yes, pip3 was something I noticed was different between DIB servers and production servers. Which, I've been using to test with to zuulv3 with python3 | 12:16 |
| *** zhurong has quit IRC | 12:16 | |
| *** amoralej|lunch is now known as amoralej | 12:17 | |
| *** mjturek has joined #openstack-infra | 12:19 | |
| *** krtaylor has quit IRC | 12:19 | |
| frickler | did creating new test nodes just break? lots of waiting jobs in zuul queue, but number of test nodes stays low | 12:19 |
| openstackgerrit | Pavel Goglov proposed openstack-infra/jenkins-job-builder master: Add pipeline/workflow multibranch module https://review.openstack.org/403940 | 12:20 |
| *** esikachev has quit IRC | 12:20 | |
| *** lucas-hungry is now known as lucasagomes | 12:22 | |
| *** stevemar__ has quit IRC | 12:23 | |
| *** ykarel_ has quit IRC | 12:23 | |
| pabelanger | infra-root: I have stopped puppet on puppetmaster. I fear my patch to puppet-pip has changed pip to python3 on our production servers due to a bad symlink | 12:23 |
| *** gibi has quit IRC | 12:24 | |
| pabelanger | I am in the process of auditing our servers, but currently I see bandersnatch is broken, since it was reinstalled under python3 | 12:24 |
| *** markvoelker has quit IRC | 12:24 | |
| pabelanger | I am also working on puppet patch to clean up pip / pip2 commands | 12:24 |
| *** markvoelker has joined #openstack-infra | 12:24 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-pip master: Switch incorrect symlink order https://review.openstack.org/469851 | 12:26 |
| *** pgadiya has joined #openstack-infra | 12:27 | |
| *** pgadiya has quit IRC | 12:27 | |
| *** Hal has joined #openstack-infra | 12:29 | |
| *** prashkre has joined #openstack-infra | 12:29 | |
| *** mugsie has joined #openstack-infra | 12:29 | |
| *** namnh has quit IRC | 12:30 | |
| *** ihrachys has quit IRC | 12:30 | |
| *** ihrachys has joined #openstack-infra | 12:31 | |
| *** gibi has joined #openstack-infra | 12:31 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-pip master: Switch incorrect symlink order https://review.openstack.org/469851 | 12:33 |
| apuimedo | AJaeger: didn't fix it | 12:33 |
| apuimedo | setuptools 36.0 is still somewhere in infra | 12:34 |
| pabelanger | right, that is expected. We won't be able to delete it everywhere | 12:34 |
| *** yolkfull has quit IRC | 12:34 | |
| apuimedo | pabelanger: we don't have control over the mirrors/slaves? | 12:34 |
| *** yolkfull has joined #openstack-infra | 12:35 | |
| apuimedo | or we just prefer to move over the way of doing requirementse banning of 36.0? | 12:35 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-pip master: Switch incorrect symlink order https://review.openstack.org/469851 | 12:35 |
| pabelanger | apuimedo: yes, but it will be a tedious task to find all the locations setuptools has been cached and delete it | 12:35 |
| apuimedo | pabelanger: understood. Thanks | 12:36 |
| *** yolkfull has quit IRC | 12:37 | |
| *** alexey_weyl has joined #openstack-infra | 12:37 | |
| *** gordc has joined #openstack-infra | 12:37 | |
| alexey_weyl | Hi. Vitrage is having some problems in the gate. | 12:38 |
| *** yolkfull has joined #openstack-infra | 12:38 | |
| *** yolkfull has quit IRC | 12:38 | |
| alexey_weyl | Was there something changed between May 30th and 31st | 12:38 |
| alexey_weyl | ? | 12:38 |
| *** yolkfull has joined #openstack-infra | 12:38 | |
| *** kgiusti has joined #openstack-infra | 12:39 | |
| *** salv-orlando has joined #openstack-infra | 12:39 | |
| pabelanger | alexey_weyl: yes, setuptools is currently broken | 12:40 |
| alexey_weyl | pabelanger: ok, good to know :) | 12:40 |
| AJaeger | alexey_weyl: see https://wiki.openstack.org/wiki/Infrastructure_Status | 12:40 |
| alexey_weyl | pabelanger: is there any schedule to when its supposed to start working? | 12:41 |
| *** dprince has joined #openstack-infra | 12:41 | |
| amrith | clarkb, when you get a chance I want to chat with you about the nova/compute-lxc stuff. it doesn't work :( | 12:42 |
| amrith | for trove that is | 12:42 |
| pabelanger | alexey_weyl: we are currently blocked on: https://github.com/pypa/setuptools/issues/1042 | 12:42 |
| *** yolkfull_ has joined #openstack-infra | 12:42 | |
| amrith | not intended to be a statement about nova/compute-lxc in general | 12:42 |
| *** stevemar__ has joined #openstack-infra | 12:43 | |
| alexey_weyl | pabelanger: just to make sure. the problem Vitrage is having is the following: "ERROR: the main setup script run by this job failed - exit code: 2" | 12:43 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-pip master: Switch incorrect symlink order https://review.openstack.org/469851 | 12:45 |
| *** yolkfull has quit IRC | 12:45 | |
| *** Dinesh_Bhor has quit IRC | 12:45 | |
| *** yolkfull_ has quit IRC | 12:45 | |
| pabelanger | alexey_weyl: the issue is ModuleNotFoundError: No module named 'six' from setuptools | 12:45 |
| pabelanger | alexey_weyl: if you want to check your logs to confirm | 12:45 |
| *** alegacy has joined #openstack-infra | 12:46 | |
| *** Dinesh_Bhor has joined #openstack-infra | 12:46 | |
| *** salv-orlando has quit IRC | 12:47 | |
| *** vikrant has quit IRC | 12:48 | |
| dims | pabelanger : plan for the setuptools is to wait for pypa to put out another release? | 12:48 |
| * dims reading the issue on github | 12:49 | |
| *** Dinesh_Bhor has quit IRC | 12:49 | |
| *** Dinesh_Bhor has joined #openstack-infra | 12:49 | |
| *** Dinesh_Bhor has quit IRC | 12:49 | |
| *** Dinesh_Bhor has joined #openstack-infra | 12:50 | |
| alexey_weyl | pabelanger: I have looked at the logs, but I am not sure where exactly to look. maybe you can help me? | 12:50 |
| alexey_weyl | pabelanger: https://review.openstack.org/#/c/469585/ | 12:51 |
| *** LindaWang has quit IRC | 12:51 | |
| *** gibi has quit IRC | 12:51 | |
| *** panda|pnq is now known as panda | 12:51 | |
| *** panda is now known as panda|travel | 12:51 | |
| *** salv-orlando has joined #openstack-infra | 12:52 | |
| alegacy | I am having some trouble with my gerrit and openstack.org accounts... hoping that someone can point me in the right direction. | 12:54 |
| pabelanger | dims: Yes, I don't want to push through anything on infra side until more core people come online. We'd have to pin setuptools, which has been a pain in the past | 12:54 |
| dims | ++ pabelanger | 12:54 |
| dims | looks like they merged a fix 2 mins ago - https://github.com/pypa/setuptools/commit/fa38086b6e4ccc2914a70cc635c0351a96c64647 | 12:54 |
| pabelanger | cool, hopefully they tag 36.0.1 | 12:55 |
| alegacy | on openstack.org i am a "community member" not a "foundation member" because i have an affiliation to my company which is a "foundation member" | 12:55 |
| alegacy | gerrit doesn't seem to know about that affiliation | 12:55 |
| alegacy | and it won't let me update my contact details because i am not a foundation member. | 12:56 |
| frickler | alegacy: you need to become a foundation member, see http://docs.openstack.org/infra/manual/developers.html#account-setup | 12:57 |
| *** xinliang has quit IRC | 12:57 | |
| *** gibi has joined #openstack-infra | 12:57 | |
| *** cshastri has quit IRC | 12:58 | |
| *** xinliang has joined #openstack-infra | 12:58 | |
| *** xinliang has quit IRC | 12:58 | |
| *** xinliang has joined #openstack-infra | 12:58 | |
| alegacy | yes, I saw that but I was told that I didn't have to do that if I had an affiliation added to point to my company. Is that not the case? | 12:58 |
| frickler | alegacy: no, you still need to sign the individual agreement https://docs.openstack.org/infra/manual/developers.html#sign-the-appropriate-individual-contributor-license-agreement | 12:59 |
| *** ansiwen is now known as ansiwen|lunch | 12:59 | |
| alegacy | frickler: ok, thanks... also, is it normal that my 5-digit ID over at gerrit is different than the ID at openstack.org or is that part of my issue? | 12:59 |
| frickler | alegacy: I think that is expected, the link should happen via the email address | 13:00 |
| alegacy | fickler: thank you. | 13:00 |
| *** gouthamr has joined #openstack-infra | 13:00 | |
| frickler | alegacy: seems your company may also need to add you to their list of allowed contributors: https://wiki.openstack.org/wiki/HowToUpdateCorporateCLA | 13:01 |
| jistr | setuptools 36.0.1 tagged | 13:02 |
| *** yamamoto has quit IRC | 13:02 | |
| alegacy | frickler: i am checking with the person responsible for that in our company. i'll hold off on the foundation member step until i find out if that's the only thing that is wrong. | 13:04 |
| *** gibi has quit IRC | 13:05 | |
| dims | jistr : pabelanger : let the rechecks begin! | 13:05 |
| *** mriedem has joined #openstack-infra | 13:05 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-pip master: Switch incorrect symlink order https://review.openstack.org/469851 | 13:07 |
| *** mdrabe has joined #openstack-infra | 13:08 | |
| *** Goneri has joined #openstack-infra | 13:09 | |
| *** psachin has quit IRC | 13:10 | |
| *** stevemar__ has quit IRC | 13:11 | |
| ihrachys | setuptools issue is good to recheck now? | 13:11 |
| pabelanger | working on fixing bandersnatch, so we can mirror pypi agian | 13:12 |
| pabelanger | again* | 13:12 |
| *** faizy has joined #openstack-infra | 13:12 | |
| *** faizy_ has quit IRC | 13:14 | |
| *** esikachev has joined #openstack-infra | 13:16 | |
| *** gibi has joined #openstack-infra | 13:17 | |
| pabelanger | okay, I have manually applied 469851 (thanks cmurphy) to mirror-update.o.o and bandersnatch is running again | 13:19 |
| dims | pabelanger : do we have to build new images? | 13:20 |
| *** yamamoto has joined #openstack-infra | 13:21 | |
| pabelanger | dims: I don't believe so. Looks like we are just starting daily builds (fedora-25) | 13:21 |
| pabelanger | we can roll back to images from yesteday if needed too | 13:22 |
| dims | pabelanger : scratching my head to figure out where/when setuptools is pulled down for example in this - http://logs.openstack.org/58/469658/3/check/gate-releases-docs-ubuntu-xenial/3706703/console.html | 13:22 |
| *** gomarivera has joined #openstack-infra | 13:22 | |
| dims | pabelanger : sounds like a good idea! if needed | 13:23 |
| pabelanger | until we get bandersnatch working again, we won't have the new release yet | 13:24 |
| pabelanger | working on that now | 13:24 |
| dims | ack thanks pabelanger. will follow along | 13:25 |
| *** witek has joined #openstack-infra | 13:27 | |
| *** witek has left #openstack-infra | 13:28 | |
| *** salv-orl_ has joined #openstack-infra | 13:28 | |
| *** rhallisey has quit IRC | 13:30 | |
| *** rhallisey has joined #openstack-infra | 13:30 | |
| *** askb has quit IRC | 13:30 | |
| *** salv-orlando has quit IRC | 13:31 | |
| *** esberglu has joined #openstack-infra | 13:33 | |
| *** dizquierdo has joined #openstack-infra | 13:33 | |
| *** bobh has joined #openstack-infra | 13:34 | |
| *** windmoon has joined #openstack-infra | 13:36 | |
| *** baoli has joined #openstack-infra | 13:37 | |
| *** windmoon has quit IRC | 13:38 | |
| yolanda | hi EmilienM , can you revisit https://review.openstack.org/#/c/469809/ ? | 13:40 |
| EmilienM | yolanda: +1 | 13:40 |
| *** trown is now known as trown|brb | 13:41 | |
| *** LindaWang has joined #openstack-infra | 13:41 | |
| *** yamamoto has quit IRC | 13:43 | |
| *** eharney has joined #openstack-infra | 13:43 | |
| pabelanger | it looks like our index isn't getting update on bandersnatch now | 13:44 |
| pabelanger | and we still have a 36.0.0 wheel | 13:45 |
| *** yamamoto has joined #openstack-infra | 13:45 | |
| *** yamamoto has quit IRC | 13:45 | |
| *** ykarel has joined #openstack-infra | 13:47 | |
| * fungi is working his way through scrollback, but is already aware of the setuptools release chaos | 13:49 | |
| openstackgerrit | Merged openstack-infra/project-config master: Start building security hardened images on tripleo https://review.openstack.org/469809 | 13:51 |
| *** Swami_ has joined #openstack-infra | 13:53 | |
| *** jkilpatr has quit IRC | 13:53 | |
| *** jkilpatr has joined #openstack-infra | 13:55 | |
| fungi | pabelanger: technically bandersnatch _does_ delete things from our normal pypi mirrors if they're deleted from pypi. however our wheel builder builds/copies wheels from there to our custom wheelhouse mirror and is strictly additive so doesn't know to clean up wheels which were deleted from pypi or wheels built from sdists which were deleted from pypi | 13:56 |
| pabelanger | fungi: yes, that is what I am seeing now I believe | 13:56 |
| pabelanger | we have a 36.0.0 wheels currently | 13:57 |
| *** edmondsw has joined #openstack-infra | 13:57 | |
| *** edmondsw has left #openstack-infra | 13:57 | |
| *** gomarivera has quit IRC | 13:58 | |
| *** gomarivera has joined #openstack-infra | 14:00 | |
| *** eharney has quit IRC | 14:00 | |
| *** spzala has joined #openstack-infra | 14:00 | |
| fungi | pabelanger: i just approved 469851. also did you see jeblair's alternative patches that don't need pip3 to install zuul under python3? | 14:00 |
| pabelanger | fungi: yes. I should have been more descriptive in my commit message, I noticed the difference between production servers and DIB images | 14:01 |
| fungi | pabelanger: what i've done in the past for wheel cleanup is to manually delete the offending wheels from the writable afs volume and then do another vos release | 14:04 |
| pabelanger | fungi: okay, I wasn't sure if that's what we did | 14:05 |
| *** stevemar__ has joined #openstack-infra | 14:05 | |
| pabelanger | fungi: is there a way to regerate our bandersnatch index? | 14:05 |
| fungi | but we may want to consider ways to get the wheel builder to do deletes for stuff which disappears from pypi | 14:05 |
| fungi | pabelanger: bandersnatch does that automatically when it runs | 14:06 |
| fungi | bandersnatch has nothing to do with the wheel mirror. for that we're just using apache mod_index to provide real-time indexing i believe | 14:06 |
| pabelanger | fungi: ya, I am cleaning up the python3 pip issue, but now debugging why bandersnatch mirror exists -1 still | 14:06 |
| *** gordc has quit IRC | 14:06 | |
| *** yamamoto has joined #openstack-infra | 14:07 | |
| pabelanger | sadly degugging around exit -1 is lacking | 14:07 |
| *** trown|brb is now known as trown | 14:07 | |
| fungi | pabelanger: oh, well it's possible bandersnatch broke and needs to completely rebuild its indices (which will take all day if so) | 14:07 |
| pabelanger | ya, I am hoping that is not the case. I have to uninstall / install 1.11 again because it got upgraded to python3 | 14:08 |
| pabelanger | it is python2 again | 14:08 |
| fungi | pabelanger: oh, did we also revert the locally-patched bandersnatch with my fix for its sys.exit(main()) behavior? | 14:08 |
| pabelanger | and looks to be running, if I manually invoke it | 14:08 |
| fungi | that was supposed to be fixed upstream but i don't know if they've tagged a new release since then | 14:08 |
| pabelanger | but our run-bandersnatch wrapper is not happy | 14:08 |
| pabelanger | fungi: sorry, what was to be fixed? | 14:09 |
| fungi | https://bitbucket.org/pypa/bandersnatch/issues/67/always-exit-with-code-1 | 14:09 |
| pabelanger | Oh | 14:09 |
| pabelanger | so, that looks like the issue | 14:09 |
| fungi | my patch was https://bitbucket.org/pypa/bandersnatch/pull-requests/23 | 14:09 |
| openstackgerrit | Sylvain Baubeau proposed openstack-infra/shade master: Handle ports with no 'created_at' attribute https://review.openstack.org/469869 | 14:10 |
| pabelanger | fungi: did we manually apply your patch to mirror-update.o.o? Or downgrade bandersnatch? | 14:11 |
| fungi | pabelanger: manually patched, because the newer (otherwise broken) bandersnatch was needed for the hash paths support jeblair got upstreamed | 14:11 |
| pabelanger | fungi: okay, so that explains it. Do you mind applying the patch again? | 14:12 |
| fungi | so the choice was between carrying a one-liner patch on the newer version or downgrading and carrying a fairly large patch | 14:12 |
| *** cody-somerville has quit IRC | 14:12 | |
| fungi | pabelanger: i removed the last line (return config) from /usr/local/lib/python2.7/dist-packages/bandersnat | 14:13 |
| fungi | ch/main.py | 14:13 |
| pabelanger | fungi: okay, let me look now | 14:13 |
| fungi | (apologies for the stray newline there) | 14:13 |
| pabelanger | I think puppet-bandersnatch support git installs too | 14:13 |
| fungi | we could consider trying to install trunk, though that seems brave for other reasons | 14:14 |
| openstackgerrit | Merged openstack-infra/puppet-pip master: Switch incorrect symlink order https://review.openstack.org/469851 | 14:14 |
| *** eharney has joined #openstack-infra | 14:15 | |
| pabelanger | ah, I thought we might have forked bandersnatch for our patches | 14:15 |
| pabelanger | okay, looking at wheels now | 14:15 |
| *** prashkre has quit IRC | 14:17 | |
| pabelanger | fungi: thank you, bandersnatch looks much happier | 14:17 |
| fungi | pabelanger: there is a /opt/bandersnatch on mirror-update.o.o but i don't believe we're installing from it. seems to be where jeblair had staged his patches to the older release | 14:18 |
| *** esikache1 has joined #openstack-infra | 14:18 | |
| fungi | based on `hg log` | 14:18 |
| *** mhickey has joined #openstack-infra | 14:19 | |
| *** esikachev has quit IRC | 14:20 | |
| pabelanger | fungi: okay, I have removed setuptools-36.0.0 wheels from our mirrors | 14:22 |
| pabelanger | and released afs volumes | 14:23 |
| *** armax has joined #openstack-infra | 14:24 | |
| *** ykarel_ has joined #openstack-infra | 14:26 | |
| *** rbrndt has joined #openstack-infra | 14:26 | |
| *** ykarel has quit IRC | 14:28 | |
| *** annegentle has joined #openstack-infra | 14:28 | |
| fungi | thanks pabelanger! | 14:29 |
| fungi | i _think_ everything should be fixed anyway between 36.0.0 gone everywhere and 36.0.1 starting to show up | 14:29 |
| fungi | may want to keep an eye out for weirdness if we somehow managed to bake a broken setuptools into our built images | 14:29 |
| pabelanger | http://logs.openstack.org/23/469523/2/check/gate-manila-pep8-ubuntu-xenial/ded1bfe/console.html#_2017-06-01_14_22_27_379652 | 14:30 |
| pabelanger | I see 36.0.1 in the gate now | 14:30 |
| pabelanger | Yup, in monitor mode now | 14:30 |
| pabelanger | will send out a status | 14:30 |
| *** esikache1 has quit IRC | 14:30 | |
| *** kgiusti has quit IRC | 14:31 | |
| pabelanger | #status notice: python-setuptools 36.0.1 has been released and now making its way into jobs. Feel free to 'recheck' your failures. If you have any problems, please join #openstack-infra | 14:31 |
| openstackstatus | pabelanger: unknown command | 14:31 |
| *** gomarivera has quit IRC | 14:32 | |
| pabelanger | #status notice python-setuptools 36.0.1 has been released and now making its way into jobs. Feel free to 'recheck' your failures. If you have any problems, please join #openstack-infra | 14:32 |
| openstackstatus | pabelanger: sending notice | 14:32 |
| *** andreas_s has quit IRC | 14:32 | |
| *** gomarivera has joined #openstack-infra | 14:32 | |
| -openstackstatus- NOTICE: python-setuptools 36.0.1 has been released and now making its way into jobs. Feel free to 'recheck' your failures. If you have any problems, please join #openstack-infra | 14:33 | |
| *** flepied has quit IRC | 14:34 | |
| *** openstackgerrit has quit IRC | 14:34 | |
| *** pstack_ has joined #openstack-infra | 14:34 | |
| openstackstatus | pabelanger: finished sending notice | 14:35 |
| *** kornicameister has quit IRC | 14:35 | |
| *** jaosorior has quit IRC | 14:36 | |
| *** gomarivera has quit IRC | 14:37 | |
| *** alexey_weyl has quit IRC | 14:37 | |
| *** arturb has quit IRC | 14:37 | |
| *** dimak_ has quit IRC | 14:38 | |
| *** ramishra has quit IRC | 14:41 | |
| *** esikache1 has joined #openstack-infra | 14:42 | |
| *** asselin has joined #openstack-infra | 14:43 | |
| pabelanger | pip --version | 14:43 |
| pabelanger | pip 9.0.1 from /usr/local/lib/python2.7/dist-packages (python 2.7) | 14:43 |
| pabelanger | cmurphy: fungi: puppet is fixing my mistake. Thanks again for help | 14:43 |
| fungi | good deal | 14:44 |
| fungi | thanks for cleaning that back up | 14:44 |
| pabelanger | it is possible something run pip install over night, and was upgraded to python3 | 14:44 |
| pabelanger | I am still auditing servers for that | 14:44 |
| fungi | grepping syslogs for calls to pip? | 14:45 |
| pabelanger | so far yes | 14:45 |
| fungi | or just spot-checking things we're pip-installing? | 14:45 |
| pabelanger | I've checked nodepool / zuul services, they don't seem affected | 14:45 |
| *** lbragsta_ has joined #openstack-infra | 14:45 | |
| pabelanger | currently looking to see what else me manage via pip | 14:45 |
| *** jamesmca_ has joined #openstack-infra | 14:46 | |
| *** spzala has quit IRC | 14:47 | |
| *** ramishra has joined #openstack-infra | 14:47 | |
| fungi | i guess `sudo grep /usr/local/bin/pip /var/log/syslog{,.1}` is about as good as we can look for | 14:47 |
| *** lbragsta_ has quit IRC | 14:47 | |
| *** hongbin has joined #openstack-infra | 14:47 | |
| *** gordc has joined #openstack-infra | 14:48 | |
| fungi | May 31 20:43:26 zuul puppet-user[3213]: Execution of '/usr/local/bin/pip install -q yappi' returned 1: Command "/usr/bin/python3 -u -c "import setuptools, [...] | 14:48 |
| fungi | zuul.o.o looks pretty unhappy puppetwise | 14:49 |
| pabelanger | checking logs | 14:49 |
| pabelanger | I might have missed that | 14:49 |
| fungi | but that at least seems to have prevented it reinstalling | 14:49 |
| asselin | pabelanger, hi....so for puppet-pip....is your latest change sufficient to back out? let me know if there's something I can help as we're on master and puppet is complaining everywhere on our system. | 14:49 |
| fungi | asselin: we think so, yes | 14:50 |
| pabelanger | fungi: yes, I didn't see zuul get reinstalled over night | 14:50 |
| *** kgiusti has joined #openstack-infra | 14:50 | |
| fungi | asselin: though if it managed to reinstall anything between when the original pip3 patch landed and when the cleanup patch landed, you may have some things reinstalled running via python 3.x | 14:51 |
| asselin | hmmm...ok...:( | 14:51 |
| pabelanger | pip is now under python2 again for zuul.o.o, so puppet is now propigating well | 14:51 |
| asselin | Jun 1 07:39:51 zuul puppet-agent[17324]: (/Stage[main]/Pip/Exec[download-pip3]/returns) change from notrun to 0 failed: sh: 1: /usr/bin/python3: not found | 14:51 |
| fungi | pabelanger: probably a post to the openstack-infra ml is warranted once we know the extent of the issues, so that downstream consumers of that module can similarly audit their systems | 14:51 |
| asselin | I don't think it worked for us | 14:51 |
| *** omkar_telee has joined #openstack-infra | 14:51 | |
| fungi | asselin: that's good at least | 14:51 |
| pabelanger | fungi: yes, good idea | 14:52 |
| *** esikache1 has quit IRC | 14:52 | |
| *** flepied has joined #openstack-infra | 14:52 | |
| pabelanger | asselin: which operating system | 14:52 |
| omkar_telee | facing issue - https://review.openstack.org/#/c/468791/ | 14:52 |
| pabelanger | is python3 not installed? | 14:52 |
| pabelanger | omkar_telee: you can recheck now | 14:52 |
| asselin | that's precise | 14:53 |
| pabelanger | omkar_telee: python setuptools was broken | 14:53 |
| asselin | I have to check other OSes | 14:53 |
| pabelanger | oh, ya. we likely didn't account for precise | 14:53 |
| fungi | asselin: yeah, precise didn't come with python 3 by default (it had 3.2 or maybe only 3.1 available in the main archive but not in the base package set) | 14:53 |
| omkar_telee | @pabelanger : I am new for gerrit, how can i recheck my commit? | 14:54 |
| asselin | do you think simply pinning to before the patch landed is good enough? | 14:54 |
| fungi | omkar_telee: leave a review comment starting with the word "recheck" and jobs will get rerun for it | 14:54 |
| pabelanger | omkar_telee: you can just leave a comment in gerrit | 14:54 |
| asselin | pinning puppet-pip | 14:54 |
| fungi | asselin: that should also work in the short term | 14:54 |
| pabelanger | we can update puppet-pip to skip precise too | 14:55 |
| *** gomarivera has joined #openstack-infra | 14:55 | |
| fungi | asselin: though pabelanger's change has exec calls to undo the incorrect symlinks so you may need to manually clean those up if you're just rolling back the module | 14:55 |
| pabelanger | we did that for centos because it was missing python3 | 14:55 |
| asselin | ok...I need to finish waking up and see what's going on | 14:56 |
| fungi | omkar_telee: now that you've left that comment, you can search or filter http://status.openstack.org/zuul/ for 468791 (your change number) and see the jobs queued getting ready to run again | 14:58 |
| *** jkilpatr has quit IRC | 14:59 | |
| omkar_telee | @fungi : Thanks a lot, I can see job queued .. :) | 15:00 |
| fungi | omkar_telee: happy to help! feel free to ask any other questions you might have about our toolchain/workflow... i know it can be daunting especially when you're new to it | 15:00 |
| *** dikonoor has quit IRC | 15:01 | |
| AJaeger | cmurphy: seems you have keystone-tempest now setup properly... | 15:01 |
| cmurphy | AJaeger: yay \o/ | 15:01 |
| fungi | pabelanger: i'm finding a similar error on firehose01, though again saved by pycrypto not supporting python 3 | 15:02 |
| omkar_telee | @fungi: sure, appreciate your help. :) | 15:03 |
| pabelanger | fungi: okay, I haven't checked that server yet | 15:03 |
| *** openstackgerrit has joined #openstack-infra | 15:04 | |
| openstackgerrit | Merged openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/469818 | 15:04 |
| fungi | pabelanger: i'm just jumping around checking syslogs of things i know we pip install services/tools on | 15:04 |
| fungi | figure it can't hurt to have a few extra sets of eyes on it just in case | 15:04 |
| pabelanger | fungi: https://etherpad.openstack.org/p/infra-pip-symlink-failure | 15:05 |
| pabelanger | I am going to track servers there | 15:05 |
| fungi | thanks! i'll pitch in | 15:05 |
| *** eharney has quit IRC | 15:05 | |
| asselin | pabelanger, fungi also centos6 (/Stage[main]/Pip/Exec[download-pip3]/returns) change from notrun to 0 failed: sh: /usr/bin/python3: No such file or directory | 15:06 |
| pabelanger | wow, didn't think people used centos6 for our puppet modules | 15:07 |
| pabelanger | we'll have to add more if operating system checks | 15:07 |
| *** esikache1 has joined #openstack-infra | 15:08 | |
| *** jkilpatr has joined #openstack-infra | 15:09 | |
| *** marst has joined #openstack-infra | 15:09 | |
| cmurphy | probably shouldn't run from master if you're on centos 6 :/ | 15:10 |
| pabelanger | fungi: okay, it looks like nodepool-builder installed diskimage-builder and virutalenv under python3 | 15:11 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci master: Bump undercloud flavor to disk 41 https://review.openstack.org/469917 | 15:11 |
| pabelanger | fungi: I'll have to uninstall / install both | 15:11 |
| openstackgerrit | Merged openstack-infra/project-config master: Set cinder API list limit to 6 https://review.openstack.org/469446 | 15:14 |
| openstackgerrit | Merged openstack-infra/project-config master: Test shade patches against zuulv3 branch of nodepool https://review.openstack.org/468441 | 15:14 |
| openstackgerrit | Merged openstack-infra/project-config master: Add job to test shade against nodepool 0.2.0 https://review.openstack.org/469124 | 15:14 |
| *** CynicGalahad has quit IRC | 15:14 | |
| fungi | pabelanger: oh, yep should broaden my pattern match on syslog to include virtualenv i guess | 15:15 |
| openstackgerrit | Merged openstack-infra/project-config master: Run Swift under py2 for py3 jobs https://review.openstack.org/468540 | 15:15 |
| pabelanger | okay, nb04.o.o fixed, waiting for nb03 to stop build | 15:16 |
| fungi | ugh, we really don't get enough stdout in the syslog to spot this easily | 15:16 |
| openstackgerrit | Merged openstack-infra/project-config master: Update periodic-package-stackviz-element job https://review.openstack.org/469599 | 15:16 |
| fungi | May 31 20:47:44 nb03 puppet-user[30351]: (/Stage[main]/Openstack_project::Server/Package[virtualenv]/ensure) created | 15:17 |
| fungi | May 31 20:47:56 nb03 puppet-user[30351]: (/Stage[main]/Diskimage_builder/Package[diskimage-builder]/ensure) created | 15:17 |
| fungi | that's really all we get there | 15:17 |
| pabelanger | right, I had to manually audit the /usr/local/bin files to see the shebang | 15:17 |
| pabelanger | and noticed they were python3 | 15:17 |
| fungi | good idea | 15:18 |
| *** eharney has joined #openstack-infra | 15:18 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add charm-glusterfs and charm-manila-glusterfs https://review.openstack.org/468112 | 15:19 |
| *** gyee has joined #openstack-infra | 15:19 | |
| fungi | ugh, `grep python3 /usr/local/{s,}bin/*` is pretty noisy, particularly on xenial servers | 15:20 |
| *** armax has quit IRC | 15:20 | |
| *** gildub has joined #openstack-infra | 15:20 | |
| *** florianf has quit IRC | 15:21 | |
| *** markus_z has quit IRC | 15:21 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove stable mitaka tempest periodic jobs https://review.openstack.org/469358 | 15:21 |
| *** toabctl has quit IRC | 15:22 | |
| pabelanger | fungi: pip install -U --force-reinstall virtualenv==13.1.0 will be the command, since we pin our virtualenv version | 15:22 |
| fungi | yeah, i think virtualenv got switched to python3 everywhere | 15:23 |
| *** toabctl has joined #openstack-infra | 15:23 | |
| fungi | looking on firehose01, /usr/local/bin/virtualenv:#!/usr/bin/python3 | 15:24 |
| *** omkar_telee has quit IRC | 15:24 | |
| *** sree has joined #openstack-infra | 15:25 | |
| openstackgerrit | Rosario Di Somma proposed openstack-infra/shade master: Add pagination for the list_volumes call https://review.openstack.org/466927 | 15:25 |
| pabelanger | fungi: yes, that looks to be the case. We could bump our min version in system-config to force a reinstall | 15:27 |
| pabelanger | 15.0.0 is the latest version | 15:27 |
| *** hashar has quit IRC | 15:28 | |
| pabelanger | fungi: or an ansible playbook to reinstall it on all servers | 15:28 |
| mordred | pabelanger, fungi: morining. how can I help? | 15:28 |
| *** ansiwen|lunch is now known as ansiwen | 15:29 | |
| pabelanger | mordred: my rush to add pip3 to our control plane servers failed drastically: https://etherpad.openstack.org/p/infra-pip-symlink-failure is what we are tracking | 15:29 |
| pabelanger | we have landed our symink fixes but some python ppackages have been upgraded / installed under python3 | 15:30 |
| pabelanger | so we are auditing servers to see what was affected | 15:30 |
| *** sree has quit IRC | 15:30 | |
| mordred | pabelanger: kk. with our use of virtualenvs that's gonna be fun to audit :) | 15:31 |
| *** mhickey has quit IRC | 15:31 | |
| pabelanger | puppmaster.o.o is okay | 15:32 |
| *** openstackgerrit has quit IRC | 15:33 | |
| *** ykarel_ has quit IRC | 15:33 | |
| pabelanger | Ya, I am not seeing us installing anyting into virtualenvs, so that is good | 15:34 |
| fungi | pabelanger: i actually like the virtualenv bump suggestion. we should be trying to follow newest virtualenv anyway | 15:34 |
| pabelanger | okay, let me get a patch | 15:34 |
| fungi | mordred: in most cases i don't think the python3 virtualenv bites us because we'd need to have then triggered a venv rebuild after the virtualenv reinstall | 15:35 |
| fungi | so as long as we don't unconditionally rebuild a venv on every puppet run we're just talking about things that tagged a release in the 12 hours or so this was an issue | 15:36 |
| *** florianf has joined #openstack-infra | 15:36 | |
| mordred | ah - gotcha | 15:36 |
| fungi | or stuff where we're building virtualenvs from branch tip and a change merged (which i think is the dib case) | 15:36 |
| *** pstack_ has quit IRC | 15:37 | |
| *** openstackgerrit has joined #openstack-infra | 15:37 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Bump virtualenv to 15.1.0 https://review.openstack.org/469927 | 15:37 |
| pabelanger | I am not sure we are using virtualenv for any production services today, is that the case | 15:38 |
| pabelanger | fungi: mordred: ^ for virtualenv patch | 15:38 |
| asselin | pabelanger, cmurphy yeah...these were set to master a long long time ago...probably should change to pins after today | 15:39 |
| *** vinaykns has joined #openstack-infra | 15:40 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config master: Add new hosted project: openstack/ptgbot https://review.openstack.org/469928 | 15:41 |
| *** mdrabe has quit IRC | 15:41 | |
| *** prashkre has joined #openstack-infra | 15:42 | |
| clarkb | pabelanger: the opemstack health server is in a venv | 15:42 |
| *** annegentle has quit IRC | 15:42 | |
| pabelanger | clarkb: thanks, looking at it now | 15:43 |
| *** annegentle has joined #openstack-infra | 15:43 | |
| pabelanger | okay .venv for openstack-health is still good. There have need no installs | 15:45 |
| pabelanger | I have manually reinstalled virtualenv to be safe | 15:45 |
| vinaykns | Hello everyone I am vinay, I am new to the openstack. Recently I filed a bug and filed a fix for that , but how can I add more reviewers for that bug fix, so that it could be reviewed faster. | 15:46 |
| *** annegentle has quit IRC | 15:47 | |
| *** prashkre has quit IRC | 15:48 | |
| *** matrohon has quit IRC | 15:49 | |
| AJaeger | vinaykns: welcome to OpenStack. adding more reviewers often does not work at all, better go on the relevant IRC channel. | 15:49 |
| AJaeger | vinaykns: what repo is the change for? | 15:50 |
| clarkb | I like the idea of bumping the venv version and forcing everything to update. Will review | 15:51 |
| *** yamamoto has quit IRC | 15:51 | |
| clarkb | pabelanger: fungi we should make sure that 15.1.0 doesn't have broken setuptools in it | 15:52 |
| *** yamamoto has joined #openstack-infra | 15:52 | |
| clarkb | it doesn't based on a local install (virtualenv updates those libs on install anyways looks like) | 15:53 |
| *** felipemonteiro has joined #openstack-infra | 15:53 | |
| vinaykns | The change is for repo monasca-agent | 15:54 |
| *** knangia_ has joined #openstack-infra | 15:54 | |
| *** Swami_ has quit IRC | 15:55 | |
| *** felipemonteiro__ has joined #openstack-infra | 15:55 | |
| *** yamamoto has quit IRC | 15:58 | |
| *** felipemonteiro has quit IRC | 15:58 | |
| *** trown is now known as trown|lunch | 15:59 | |
| *** dikonoor has joined #openstack-infra | 15:59 | |
| pabelanger | clarkb: thanks | 16:00 |
| pabelanger | that seems to be the only think I can see currently | 16:00 |
| *** alexchadin has quit IRC | 16:03 | |
| *** Apoorva has joined #openstack-infra | 16:03 | |
| *** rcernin has quit IRC | 16:04 | |
| *** jamesmca_ has quit IRC | 16:07 | |
| *** jamesmca_ has joined #openstack-infra | 16:08 | |
| *** annegentle has joined #openstack-infra | 16:09 | |
| *** flepied has quit IRC | 16:09 | |
| *** dikonoor has quit IRC | 16:11 | |
| clarkb | pabelanger: are there other things I can help with the untangling of pip python versions? | 16:11 |
| clarkb | or do we expect that reinstalling virtualenv will be it? | 16:11 |
| *** jpich has quit IRC | 16:12 | |
| pabelanger | clarkb: yes, I think virutualenv patch should be everything | 16:12 |
| pabelanger | I've looked at more servers and haven't seen any things new yet | 16:12 |
| pabelanger | https://etherpad.openstack.org/p/infra-pip-symlink-failure is the latest I have found | 16:12 |
| pabelanger | so, if you know of something I have missed, that would be great to note | 16:12 |
| *** sree has joined #openstack-infra | 16:13 | |
| *** jamesmca_ has quit IRC | 16:13 | |
| clarkb | pabelanger: has nb04 been fixed too? only nb03 is noted as ifxed on etherpad | 16:13 |
| *** ykarel_ has joined #openstack-infra | 16:14 | |
| pabelanger | I was waiting for image-build to finish, which it is | 16:14 |
| pabelanger | doing it now | 16:14 |
| *** esikache1 has quit IRC | 16:14 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Make zuul ansible dir self-contained https://review.openstack.org/468208 | 16:14 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add untrusted-projects ansible test https://review.openstack.org/461881 | 16:14 |
| *** esikache1 has joined #openstack-infra | 16:15 | |
| pabelanger | clarkb: okay, nb04 | 16:16 |
| pabelanger | fixed | 16:16 |
| *** LindaWang has quit IRC | 16:17 | |
| clarkb | cool and then once puppet change for virtualenv gets in and applies that should be the rest of it | 16:17 |
| *** mdrabe has joined #openstack-infra | 16:18 | |
| clarkb | pabelanger: I'm spot checking IP assignments in citycloud and Sto2 lgtm now. I think you can likely clean up your test server if you want then we can raise the max-servers back up to 50 | 16:22 |
| clarkb | However kna1 seems to have the multiple private IPs problem now. And it is almost on every server | 16:22 |
| clarkb | So perhaps some additional corner case not covered in our shade workarounds are the source of our citycloud launch errors re ^ | 16:22 |
| clarkb | I am going to hold one of the servers in kna1 and will send mail to citycloud with that server's info | 16:23 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Remove source from reporter https://review.openstack.org/462362 | 16:23 |
| *** esikache1 has quit IRC | 16:23 | |
| *** sambetts is now known as sambetts|afk | 16:23 | |
| clarkb | but first breakfast | 16:24 |
| *** cody-somerville has joined #openstack-infra | 16:25 | |
| *** cody-somerville has joined #openstack-infra | 16:25 | |
| *** flepied has joined #openstack-infra | 16:25 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Make zuul ansible dir self-contained https://review.openstack.org/468208 | 16:27 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add untrusted-projects ansible test https://review.openstack.org/461881 | 16:27 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add support for bwrap https://review.openstack.org/453851 | 16:27 |
| *** jascott1 has joined #openstack-infra | 16:28 | |
| mordred | clarkb: oh yeah? | 16:29 |
| mordred | clarkb: reading scrollback | 16:29 |
| *** armax has joined #openstack-infra | 16:29 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config master: Add new hosted project: openstack/ptgbot https://review.openstack.org/469928 | 16:30 |
| clarkb | mordred: well we still have some errors | 16:31 |
| clarkb | mordred: mostly just theorizing why that is based on minimal data | 16:31 |
| mordred | clarkb: nod | 16:31 |
| clarkb | need caffiene before trying to really dig in | 16:31 |
| mordred | clarkb: yah - lemme know when you have one held, i'll look too | 16:32 |
| *** spzala has joined #openstack-infra | 16:32 | |
| openstackgerrit | Saad Zaher proposed openstack-infra/project-config master: Added OpenStack-ansible repos for freezer https://review.openstack.org/469938 | 16:33 |
| *** sree has quit IRC | 16:33 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Make zuul ansible dir self-contained https://review.openstack.org/468208 | 16:34 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add untrusted-projects ansible test https://review.openstack.org/461881 | 16:34 |
| *** aarefiev is now known as aarefiev_afk | 16:35 | |
| *** nt has joined #openstack-infra | 16:35 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Make zuul ansible dir self-contained https://review.openstack.org/468208 | 16:36 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add untrusted-projects ansible test https://review.openstack.org/461881 | 16:36 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Only report to gerrit if the action is from gerrit https://review.openstack.org/461981 | 16:37 |
| ianychoi | clarkb, hello :) I copied an e-mail to you titled: "Re: Question on translating user-survey" which describes on openstackid-dev & openstackid issue in translate-dev.o.o. Would you see when you have time? | 16:37 |
| *** ykarel_ has quit IRC | 16:37 | |
| clarkb | ianychoi: I think the problem is likely related to when they normalized the openids? | 16:38 |
| clarkb | ianychoi: I remember yours had to be updated | 16:39 |
| clarkb | fungi: ^ do you remember if you normalized the dev server's db too? | 16:39 |
| *** derekh has quit IRC | 16:39 | |
| *** e0ne has quit IRC | 16:39 | |
| ianychoi | clarkb, oh the openid data in translate-dev.o.o db is already normalized? | 16:40 |
| *** rossella_s has joined #openstack-infra | 16:40 | |
| fungi | clarkb: great question... checking back to see what exactly i did there | 16:40 |
| clarkb | ianychoi: the data in the openstackid servers was normalized so we need to update the db fields for your openid. I'm not sure if we did that on translate-dev or not | 16:40 |
| *** hyakuhei has quit IRC | 16:41 | |
| *** hyakuhei has joined #openstack-infra | 16:41 | |
| *** hyakuhei has quit IRC | 16:41 | |
| *** hyakuhei has joined #openstack-infra | 16:41 | |
| ianychoi | clarkb, aha I see. It would be great but at least I think my two IDs - ianychoi from openstackid and ianychoi_dev from openstackid_dev in translate-dev.o.o might conflict. So I thought some additional stuff of jobs would be needed | 16:42 |
| fungi | i'm reconstructing my steps from my shell history now and making a paste | 16:43 |
| ianychoi | fungi, thanks a lot :) | 16:43 |
| clarkb | ianychoi: are the usernames different? | 16:43 |
| clarkb | that is possibly another explanation if so | 16:44 |
| *** dtantsur is now known as dtantsur|afk | 16:45 | |
| fungi | clarkb: ianychoi: so here's a reconstruction of the transformation i applied to translate01.o.o: http://paste.openstack.org/show/611226/ | 16:45 |
| ianychoi | clarkb, yep I created "ianychoi" from openstackid for my e-mail address and after changing to openstackid-dev, I needed to access translate-dev.o.o so I talked with smarcet and he gave me the access to openstackid-dev using my e-mail address and I created "ianychoi_dev" Zanata account using the same e-mail address. | 16:45 |
| clarkb | mordred: of the ~7 errors in the current laucnher debug file for citycloud 5 are in kna1 (where networking looks funny) and 2 are in Sto2 | 16:46 |
| fungi | though i think the set i have there omits ianychoi's account because i manually fixed it first before batching up the remaining ones | 16:46 |
| fungi | yep, in the mysqlclient command history there's this: | 16:47 |
| fungi | update HCredentials set user="https://openstackid.org/ian.y..choi" where user="https://openstackid.org/ian%20y..choi"; | 16:47 |
| ianychoi | clarkb, are you fine now to login to translate-dev.o.o using your e-mail address ? | 16:47 |
| clarkb | mordred: the Sto2 failures are ssh timeouts. The kna1 failures are due to unable to find public IP so I think that means floating IP getting attached to wrong private IP still | 16:48 |
| clarkb | mordred: this also oddly enough affects rh1 (the exception not sure about the multiple private ips) | 16:48 |
| clarkb | fungi: and that was against dev server? | 16:49 |
| fungi | clarkb: that was what i did on translate01.o.o (production) way back when this first came up | 16:49 |
| clarkb | ianychoi: I don't know the openstackid dev user password | 16:49 |
| ianychoi | clarkb, hmm, would you try 1qaz2wsx ? | 16:50 |
| openstackgerrit | Saad Zaher proposed openstack-infra/project-config master: Added OpenStack-ansible repos for freezer https://review.openstack.org/469938 | 16:50 |
| clarkb | ah yup username already taken | 16:51 |
| * fungi hopes that password was supposed to be public knowledge or can be changed now | 16:51 | |
| ianychoi | clarkb, oh then would you grant ianychoi_dev account as Zanata Administrator in Zanata administration menu? | 16:51 |
| clarkb | ianychoi: I can't I have the same problem you do | 16:52 |
| *** esikache1 has joined #openstack-infra | 16:52 | |
| *** MasterOfBugs has joined #openstack-infra | 16:52 | |
| ianychoi | clarkb, I think you should have admin priviledge in translate-dev Zanata instance. | 16:52 |
| clarkb | ianychoi: I won't because its a new username | 16:52 |
| *** shardy has quit IRC | 16:53 | |
| *** gomarivera has quit IRC | 16:53 | |
| ianychoi | clarkb, oh really yep I see | 16:53 |
| *** gomarivera has joined #openstack-infra | 16:53 | |
| pabelanger | fungi: clarkb: ML post sent about puppet-pip issue | 16:54 |
| fungi | thanks pabelanger! | 16:54 |
| *** tesseract has quit IRC | 16:54 | |
| ianychoi | clarkb, fungi: the previous modification was for new openstackid identifier characters by replacing some spacial characters with ".". Now I want to tell that there is now openstackid-dev users who have Zanata admin access even me or clarkb :( | 16:54 |
| clarkb | ianychoi: yes I think there are, but those users are associated to our openstackid.org openids | 16:55 |
| *** yamamoto has joined #openstack-infra | 16:55 | |
| fungi | clarkb: so you could at least adjust the openid urls on the admin accounts to your dev openids | 16:56 |
| ianychoi | clarkb, so I want to ask: 1) changing from openstackid-dev to openstackid for translate-dev.o.o, granting some dev users to adminirators and 3) changing again from openstackid to openstackid-dev would be one candidate solution | 16:56 |
| fungi | (via update query in the db similar to how i did the url normalization in prod) | 16:56 |
| clarkb | ya | 16:56 |
| ianychoi | clarkb, and yep fungi's suggestion is another candidate solution from my understanding | 16:56 |
| clarkb | but I don't think we want to do that every time we switch providers | 16:56 |
| *** faizy has quit IRC | 16:56 | |
| fungi | no, i mean do it temporarily to re-admin yourself so you can set the other alternate accounts to admins | 16:57 |
| *** faizy has joined #openstack-infra | 16:57 | |
| fungi | and then fix your account back again | 16:57 |
| fungi | i'm guessing zanata's openid support doesn't extend to multiple openids for a single account | 16:57 |
| clarkb | wondering if we shouldn't just stick to openstackid.org | 16:57 |
| ianychoi | clarkb, Initially I18n team used openstackid for the migration purpose: from Transifex to Zanata but from now I think translate-dev test purpose for I18n team is for API tests and more integration with openstack-infra | 16:58 |
| *** gomarivera has quit IRC | 16:58 | |
| ianychoi | clarkb, so if I18n team makes use of openstackid-dev then I think no further change to openstackid for translate-dev.o.o would be fine | 16:58 |
| ianychoi | (at least I do not want to re-iterate the changes: openstackid<->openstackid-dev for translate-dev) | 16:59 |
| *** jpena is now known as jpena|off | 16:59 | |
| *** ralonsoh has quit IRC | 16:59 | |
| *** esikache1 has quit IRC | 17:01 | |
| *** claudiub has quit IRC | 17:02 | |
| clarkb | ianychoi: I think for now I'm most comfortable using production openstackid.org for reasons of user management | 17:02 |
| clarkb | I'm discovering that there are some potential issues with the dev server in trying to get this working on translate-dev | 17:03 |
| ianychoi | clarkb, another idea would be to create one more translate-dev server (e.g., translate-dev2) :) | 17:03 |
| clarkb | ianychoi: I don't think making a new translation server addresses those concerns, they will need to be addressed on the openstackid side | 17:03 |
| clarkb | fungi: ^ thoughts? | 17:03 |
| *** yamamoto has quit IRC | 17:04 | |
| fungi | what are we currently trying to test on translate-dev? another zanata upgrade? a configuration change? something else? | 17:04 |
| *** ltomasbo is now known as ltomasbo|away | 17:04 | |
| fungi | how we configure it depends a lot on what's being tested | 17:04 |
| fungi | maybe we can live with toggling back and forth between using production openstackid.org while testing zanata-side changes but switching to openstackid-dev when testing openstackid-side changes | 17:06 |
| ianychoi | fungi, now I want to test glossary APIs, and next week, there will be a webinar from Zanata team to listen to "What's new since Zanata 3.9" (although I need to find out where I get access to webex). From current investigation, Zanata 3.9.6 has some bugs and I want to propose another upgrade (fortunately current Zanata 4.2.0 has the same version of Java and Wildfly) | 17:06 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Case sensitive label matching in canMerge https://review.openstack.org/469946 | 17:06 |
| fungi | though in the past that has led to some lengthy periods where one team is blocked on the other completing testing of something | 17:06 |
| *** cody-somerville has quit IRC | 17:06 | |
| *** cody-somerville has joined #openstack-infra | 17:07 | |
| *** cody-somerville has quit IRC | 17:07 | |
| *** cody-somerville has joined #openstack-infra | 17:07 | |
| clarkb | I think it may be best for us to just use openstackid.org and work with the devs of that openid server to set up their own test env with zanata? | 17:07 |
| fungi | so sort of still a "second translate-dev"? | 17:07 |
| ianychoi | But.. openstackid also needs to be tested? | 17:07 |
| jpmaxman | Just catching up on this but if I or Sebastian can be of any assistance let me know | 17:08 |
| *** trown|lunch is now known as trown | 17:08 | |
| clarkb | fungi: thinking more like ./make_me_a_local_zanata | 17:08 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Case sensitive label matching in canMerge https://review.openstack.org/469946 | 17:08 |
| clarkb | fungi: I don't think its infrastructure we run, more here is easy mode zanata install | 17:09 |
| fungi | clarkb: so basically some quick launcher wrapped around the puppet-zanata module? | 17:09 |
| clarkb | fungi: ya | 17:09 |
| clarkb | since the actual translation data and zanata apis don't matter for openstackid testing | 17:09 |
| ianychoi | clarkb, fungi: "./make_me_a_local_zanata" is so a great idea BTW :) | 17:09 |
| clarkb | only the openid interface does which is really small compared to what we are trying to use translate-dev for generally | 17:10 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Collect testr / testrepository results https://review.openstack.org/469947 | 17:10 |
| fungi | i guess if jpmaxman and smarcet don't need the i18n team to test logging into zanata from openstackid-dev then the ./make_me_a_test_zanata.sh could be viable | 17:10 |
| clarkb | fungi: unrelated but care to review https://review.openstack.org/#/c/469927/ to finish up the python3 virtualenv cleanup? | 17:11 |
| fungi | so anyway, short-term solution is status quo... keep switching between openstackid.org and openstackid-dev.openstack.org depending on what's being tested and give jpmaxman and smarcet a heads up whenever that transitions back and forth so they're not taken by surprise. longer term help put together a solution to make it easier for them to deploy a temporary zanata server like what we're using for | 17:12 |
| fungi | translate-dev01.o.o now | 17:12 |
| clarkb | and don't give admin access to any openstackid-dev users | 17:13 |
| AJaeger | pabelanger, yolanda, fungi, clarkb, ianw : FYI, I'll be on two week vacation starting Saturday - without internet. | 17:13 |
| fungi | right | 17:13 |
| fungi | AJaeger: well-deserved! enjoy | 17:13 |
| clarkb | AJaeger: that sounds like fun. Enjoy | 17:13 |
| AJaeger | thanks | 17:13 |
| pabelanger | AJaeger: enjoy | 17:13 |
| *** salv-orl_ has quit IRC | 17:14 | |
| ianychoi | clarkb, fungi: I am also okay for such short term solution if you are not too much stressful with such change iterations. | 17:14 |
| * fungi has to go afk for just a few minutes but will brb | 17:15 | |
| *** Swami_ has joined #openstack-infra | 17:15 | |
| *** dmsimard is now known as dmsimard|off | 17:16 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Collect testr / testrepository results https://review.openstack.org/469947 | 17:16 |
| ianychoi | clarkb, aha.. I see - haha granting admin access to openstackid-dev user should have problem - anyone can access to such Zanata admin account because the password is public. I have not considered such so important security aspect | 17:17 |
| clarkb | pabelanger: I sent citycloud mail about the kna1 multiple private IPs. Hoping to dig into ipv6 more later today and possibly send them a follow up | 17:17 |
| clarkb | pabelanger: what I want to try is setting up a completely separate throwaway network, subnets and router just to avoid the preexisting setup | 17:18 |
| *** jlibosva has quit IRC | 17:18 | |
| pabelanger | clarkb: ya, that would be a good test | 17:19 |
| openstackgerrit | Merged openstack-infra/system-config master: Bump virtualenv to 15.1.0 https://review.openstack.org/469927 | 17:21 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Do not merge https://review.openstack.org/469953 | 17:21 |
| *** smarcet has joined #openstack-infra | 17:23 | |
| ianychoi | smarcet, oh hello! | 17:23 |
| smarcet | ianychoi: hello there | 17:23 |
| *** florianf has quit IRC | 17:24 | |
| ianychoi | smarcet, do you have time now to discuss with openstackid-dev & openstackid for translate-dev server? | 17:24 |
| *** rbrndt has quit IRC | 17:25 | |
| smarcet | ianychoi: sure, thing is , translate-dev should use openstackid-dev | 17:25 |
| smarcet | if there is any openid url that is pointing to openstack production on zanata dev db | 17:25 |
| ianychoi | smarcet, to test openstackid-dev? But translators also need to test Zanata in the test server | 17:26 |
| smarcet | should be updated to poiting to openstackid-dev | 17:26 |
| *** flepied has quit IRC | 17:26 | |
| smarcet | ianychoi | 17:26 |
| smarcet | they should have their production accounts there | 17:26 |
| smarcet | with theirs passwords ( the one that they use on production) | 17:26 |
| ianychoi | smarcet, and another problem from clarkb's comment was that: if all the passwords are the same (1qaz2wsx) then some malicious users might use my account using my e-mail address and the password and have admin access in translate-dev server | 17:27 |
| *** jaypipes has joined #openstack-infra | 17:27 | |
| *** dizquierdo has quit IRC | 17:27 | |
| smarcet | ianychoi: yes we restored already the passwords from production | 17:27 |
| smarcet | so the default password is not valid anymore | 17:28 |
| ianychoi | smarcet, but clarkb just tested with such default password: about 15 mins ago | 17:28 |
| smarcet | yes | 17:29 |
| *** SumitNaiksatam has joined #openstack-infra | 17:29 | |
| *** gomarivera has joined #openstack-infra | 17:29 | |
| smarcet | i restored just now ;) | 17:29 |
| ianychoi | Aha :) | 17:29 |
| ianychoi | smarcet, another question which is not related with translate-dev: devbranch.openstack.org for user survey also applies for such password changes?) | 17:30 |
| *** rossella_s has quit IRC | 17:30 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Fix bad text wrap in status page https://review.openstack.org/468532 | 17:30 |
| smarcet | ianychoi: yes its same DB | 17:30 |
| *** gildub has quit IRC | 17:30 | |
| *** Apoorva_ has joined #openstack-infra | 17:31 | |
| ianychoi | clarkb, if you are online later, would you explain more on some potential issues using openstackid-dev for translate-dev: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/latest.log.html#t2017-06-01T17:02:40 ? | 17:31 |
| *** Goneri has quit IRC | 17:31 | |
| ianychoi | to smarcet | 17:31 |
| clarkb | ianychoi: the problem is user management. The password is shared, its a public resource. I'm not comfortable with admin accounts being set up that way | 17:32 |
| smarcet | clarkb: password were restored to production state | 17:33 |
| smarcet | so no default password anymore for anyone | 17:33 |
| pabelanger | jeblair: have a patch up to start collecting testr / testreposity results for zuulv3 again: 469947 | 17:33 |
| *** gomarivera has quit IRC | 17:33 | |
| *** Goneri has joined #openstack-infra | 17:33 | |
| *** neiljerram has quit IRC | 17:33 | |
| *** mat128 has joined #openstack-infra | 17:34 | |
| *** Apoorva has quit IRC | 17:34 | |
| *** mat128 has quit IRC | 17:35 | |
| *** esikache1 has joined #openstack-infra | 17:36 | |
| ianychoi | smarcet, can I ask which kind of others servers in openstack-infra uses openstackid-dev rather than translate-dev.o.o? | 17:36 |
| *** dhinesh has joined #openstack-infra | 17:37 | |
| smarcet | ianychoi: dont have the full list , but there are a couple, groups portal , refstack | 17:38 |
| *** vinaykns has quit IRC | 17:39 | |
| ianychoi | smarcet, aha.. I was wondering since "openstackid-dev" is specified to only openstackid-dev.o.o and translate-dev.o.o in http://git.openstack.org/cgit/openstack-infra/system-config/tree/manifests/site.pp | 17:40 |
| *** esikache1 has quit IRC | 17:40 | |
| ianychoi | I asked it since I wanted to listen to the perspective from the administrators from other sites which use openstackid-dev | 17:40 |
| *** xarses has joined #openstack-infra | 17:43 | |
| *** stewie925 has joined #openstack-infra | 17:44 | |
| *** amoralej is now known as amoralej|off | 17:44 | |
| *** ericyoung has joined #openstack-infra | 17:45 | |
| jamesmcarthur | ianychoi: we don't typically expose openstack dev to anyone. | 17:46 |
| *** mat128 has joined #openstack-infra | 17:46 | |
| jamesmcarthur | However, if you are using it, you must use openstackid-dev.o.o | 17:47 |
| *** mat128 has quit IRC | 17:47 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Whitelist pydevd debug threads https://review.openstack.org/465046 | 17:47 |
| stewie925 | hi guys, recently we set up a new project in openstack and we attempted to add members to our project core but have no access to it | 17:47 |
| jamesmcarthur | The simplest solution would be to update the zanata database to replace the path to openstackid-dev.o.o | 17:48 |
| ianychoi | jamesmcarthur, smarcet, clarkb: I am pretty okay to use openstackid-dev if - all of current OpenStack I18n users can access to translate-dev, passwords are being protected, and db adjustment (changing openid: from openstackid to openstackid-dev and deleting some users which have duplications of openid after such change). Any other concerns regarding that? | 17:49 |
| stewie925 | am wondering if it normally takes a few days before we can get access rights to add members to our new project core? | 17:50 |
| clarkb | stewie925: you need a gerrit admin to seed the initial group member | 17:50 |
| smarcet | ianychoi: i am cool witth that :) | 17:50 |
| clarkb | stewie925: do you have a link to the change that dded the new project? | 17:50 |
| stewie925 | clarkb yes - here it is https://review.openstack.org/#/c/467374/9 | 17:50 |
| *** salv-orlando has joined #openstack-infra | 17:50 | |
| *** spzala has quit IRC | 17:52 | |
| *** e0ne has joined #openstack-infra | 17:52 | |
| *** jamesmca_ has joined #openstack-infra | 17:52 | |
| ianychoi | smarcet, jamesmcarthur: I wanna also wait for fungi's opinion. Also, personally, I don't think why translate-dev server *should* use openstackid-dev. Initially, I18n team used openstackid for translate-dev.o.o then it was wrong? | 17:52 |
| *** esikache1 has joined #openstack-infra | 17:52 | |
| clarkb | stewie925: I have added Hari as the initial group member of ranger-core and ranger-release, they will be able to add others | 17:53 |
| stewie925 | thannk you very much! | 17:53 |
| stewie925 | clarkb: thank you very much :) | 17:54 |
| fungi | ianychoi: clarkb: smarcet: jamesmcarthur: using https://openstackid-dev.openstack.org/ as the openid provider for the test instance of zanata on translate-dev seems fine to me now that password management for openstackid-dev is back under user control | 17:54 |
| *** smarcet has left #openstack-infra | 17:55 | |
| fungi | we can disable existing openstackid-dev using accounts on translate-dev and then rewrite the openstackid.org accounts to use the openstackid-dev url with an update query against the zanata db backend like smarcet suggests | 17:55 |
| *** bobh has quit IRC | 17:56 | |
| *** electrofelix has quit IRC | 17:56 | |
| fungi | that way we also don't continue using zanata accounts which were created with openstackid-dev back when the password was shared across them all | 17:57 |
| jamesmca_ | fungi: good point | 17:57 |
| fungi | that might be overly paranoid on my part, but it's a pretty easy safety precaution to take | 17:57 |
| ianychoi | jamesmca_, oh you are now using different nick name :) | 17:57 |
| jamesmca_ | fungi: I prefer paranoia | 17:58 |
| ianychoi | jamesmca_, haha | 17:58 |
| jamesmca_ | ianychoi: sorry - different clients, i inadvertently have two irc nicks. need to fix :) | 17:58 |
| fungi | clarkb: ianychoi: any objections to that plan? | 17:58 |
| ianychoi | jamesmca_, that's pretty fine - I just want to more recognize you :) | 17:59 |
| fungi | i'm happy to volunteer for the db work since i already have messed with that column in the past | 17:59 |
| *** esikache1 has quit IRC | 17:59 | |
| clarkb | fungi: my only remaining concern thinking about that more is if password resets will propogate | 17:59 |
| jamesmca_ | clarkb: we periodically take backups from production. | 18:00 |
| ianychoi | fungi, I have no further objection - it solves all of my concerns + it reduces my future iterations on changing between openstackid <-> openstackid-dev, but it unfortunately requires your effort - thanks a lot | 18:00 |
| jamesmca_ | clarkb: but we don't have anything keeping passwords in synch b/w openstackid and openstackid-dev | 18:01 |
| clarkb | jamesmca_: so if a password is compromised openstackid-dev could be without updates for some time? | 18:01 |
| fungi | i guess making a dev version of the password management interface would be a lot of extra work | 18:01 |
| jamesmca_ | fungi: users can change their password on dev as well | 18:01 |
| fungi | jamesmca_: oh, what's the url for that? i was hunting around, i'm probably just blind | 18:02 |
| jamesmca_ | clarkb: I suppose that's true. The thing is, 95% of devbranch.o.o is behind basic auth as well. We only exposed this so that Ian's team could have access to review translations on the fly. | 18:02 |
| jamesmca_ | fungi: https://www.openstack.org/Security/lostpassword | 18:03 |
| jamesmca_ | also https://www.openstack.org/profile | 18:03 |
| ianychoi | jamesmca_, I have been asking this: because I do not want to write the simple password through mailing lists | 18:03 |
| ianychoi | jamesmca_, but the URLs are for production, not openstackid-dev? | 18:03 |
| *** e0ne has quit IRC | 18:03 | |
| jamesmca_ | oh sorry | 18:03 |
| ianychoi | fine | 18:03 |
| clarkb | jamesmca_: but the translate-dev server willwork just fine against production | 18:03 |
| clarkb | which is why I think we should just use production oepnstackid there | 18:04 |
| jamesmca_ | ianychoi: http://devbranch.openstack.org/Security/lostpassword and http://devbranch.openstack.org/profile | 18:04 |
| *** dimak_ has joined #openstack-infra | 18:04 | |
| ianychoi | jamesmca_, thanks for the url sharing | 18:04 |
| *** gomarivera has joined #openstack-infra | 18:04 | |
| fungi | jamesmca_: thanks, i was confused since the forgot password link on openstackid-dev goes to www.openstack.org so i didn't remember devbranch.openstack.org existed | 18:05 |
| jamesmca_ | clarkb: ianychoi: Since we're now normalizing passwords across production and devbranch, I guess it doesn't matter whether translate points to production or dev | 18:05 |
| *** gardlt has joined #openstack-infra | 18:05 | |
| jamesmca_ | ianychoi: correct me if I'm wrong, but the issue was specifically with people having to use different credentials b/w zanata and devbranch, correct? | 18:06 |
| fungi | right, the remaining concern is that users might be confused or dev services might be (minimally) at risk if a password is changed on openstackid.org and doesn't propagate quickly to openstackid-dev.openstack.org? | 18:06 |
| *** smarcet has joined #openstack-infra | 18:06 | |
| jamesmca_ | ianychoi: the only catch is they might have to log in twice. Once on zanata and another time on openstackid-dev.o.o. | 18:07 |
| ianychoi | jamesmca_, correct and if openstackid-dev team guarantees that there will be no default passwords for current existing users and everything will be fine I think. | 18:07 |
| jamesmca_ | fungi: that's a valid concern, but I do think we're talking about a fairly small number of people. And as long as they can update their passwords in both places, should be fine. | 18:07 |
| fungi | just trying to make sure i'm properly characterizing clarkb's remaining concern | 18:07 |
| clarkb | fungi: yes | 18:07 |
| clarkb | I think if openstackid-dev properly linked to password resetting location that would make me happy using it | 18:08 |
| jamesmca_ | clarkb: No problem. We can make that adjustment. | 18:08 |
| ianychoi | clarkb, oh good point | 18:08 |
| *** spzala has joined #openstack-infra | 18:08 | |
| smarcet | clarkb: yes password reseting is kind of an issue, bc all emails on dev are redirected to devs only | 18:09 |
| smarcet | not to real email address | 18:09 |
| *** gomarivera has quit IRC | 18:09 | |
| fungi | the password resetting on devbranch.o.o being locked up behind http basic auth still poses a bit of a challenge i think | 18:09 |
| smarcet | we could get rid of that | 18:09 |
| fungi | going afk again for a bit but will return shortly | 18:09 |
| smarcet | and update the logic of password reset process to properly send to intended user | 18:10 |
| ianychoi | jamesmca_, http://devbranch.openstack.org/profile url is being protected by basic auth but http://devbranch.openstack.org/Security/lostpassword doesn't require basic auth but I cannot check the password reset e-mail on my e-mail account now | 18:11 |
| jamesmca_ | smarcet: yeah, i think if we expose that and /profile as well as making sure that password email gets through, then we'd be in good shape | 18:11 |
| jamesmca_ | ianychoi: yes - we were just discussing that. | 18:11 |
| jamesmca_ | ianychoi: i believe we can fix that for you and then you'll be in good shape. | 18:12 |
| ianychoi | jamesmca_, I see :) thanks a lot | 18:12 |
| *** asselin has quit IRC | 18:13 | |
| ianychoi | clarkb, fungi, jamesmca_, smarcet: Thanks a lot for today (a little bit long) discussion regarding I18n issues | 18:13 |
| *** rcernin has joined #openstack-infra | 18:14 | |
| jamesmca_ | ianychoi: np. And apologies for the confusion. This is the first time we've opened that branch up publicly, so not too surprised by the hiccups. | 18:14 |
| *** lucasagomes is now known as lucas-afk | 18:14 | |
| ianychoi | jamesmca_, that's pretty fine. I wanted to protect the default as much as possible and I have been waiting from your response but sorry for today exposure on this channel. | 18:15 |
| ianychoi | s/default/default password | 18:15 |
| *** jkilpatr_ has joined #openstack-infra | 18:15 | |
| jamesmca_ | ianychoi: the only real reason it's behind basic auth is so that it doesn't inadvertently get indexed or shared | 18:16 |
| jamesmca_ | ianychoi: and no problem on discussing it in IRC :) It's much easier with all the players. | 18:16 |
| *** ramishra has quit IRC | 18:16 | |
| ianychoi | jamesmca_, I truly understand the purpose of basic auth and it is rather difficult to identify which things are actually protected using basic auth for the people who are in the range of basic auth area :) | 18:17 |
| *** jkilpatr has quit IRC | 18:18 | |
| jamesmca_ | ianychoi: :) | 18:18 |
| jamesmca_ | thanks fungi: and clarkb: for working through this as well! | 18:20 |
| *** e0ne has joined #openstack-infra | 18:21 | |
| *** e0ne has quit IRC | 18:24 | |
| *** e0ne has joined #openstack-infra | 18:24 | |
| *** salv-orlando has quit IRC | 18:25 | |
| *** esikache1 has joined #openstack-infra | 18:26 | |
| *** gyee has quit IRC | 18:27 | |
| *** rbrndt has joined #openstack-infra | 18:29 | |
| *** rfolco has quit IRC | 18:29 | |
| *** e0ne has quit IRC | 18:33 | |
| fungi | jamesmca_: smarcet: thanks right back! | 18:34 |
| *** dimak_ has quit IRC | 18:34 | |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Handle change related reqs on push like events https://review.openstack.org/469297 | 18:35 |
| clarkb | and noe I have to go to lunch | 18:37 |
| *** mat128 has joined #openstack-infra | 18:37 | |
| *** gomarivera has joined #openstack-infra | 18:38 | |
| *** Apoorva_ has quit IRC | 18:40 | |
| *** Apoorva has joined #openstack-infra | 18:41 | |
| *** alexchadin has joined #openstack-infra | 18:43 | |
| *** rfolco has joined #openstack-infra | 18:44 | |
| *** asselin has joined #openstack-infra | 18:46 | |
| openstackgerrit | Saad Zaher proposed openstack-infra/project-config master: Added OpenStack-ansible repos for freezer https://review.openstack.org/469938 | 18:57 |
| *** wolverineav has quit IRC | 19:03 | |
| *** wolverineav has joined #openstack-infra | 19:03 | |
| *** wolverineav has quit IRC | 19:05 | |
| *** esikache1 has quit IRC | 19:08 | |
| *** xyang1 has joined #openstack-infra | 19:08 | |
| *** spzala_ has joined #openstack-infra | 19:10 | |
| *** spzala has quit IRC | 19:13 | |
| *** bobh has joined #openstack-infra | 19:17 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/infra-specs master: Ansiblify control plane https://review.openstack.org/469983 | 19:20 |
| *** esikache1 has joined #openstack-infra | 19:20 | |
| pabelanger | infra-root: first pass at ansible spec from tuesdays meeting^ feedback is most welcome | 19:21 |
| *** spzala_ has quit IRC | 19:21 | |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Remove pipeline argument from various report fncts https://review.openstack.org/464252 | 19:22 |
| *** esikache1 has quit IRC | 19:25 | |
| *** prashkre has joined #openstack-infra | 19:28 | |
| *** claudiub has joined #openstack-infra | 19:30 | |
| *** dave-mccowan has quit IRC | 19:32 | |
| *** jamesmca_ has quit IRC | 19:36 | |
| pabelanger | jeblair: re: 469653 If we only install the zuul-scheduler for zuulv3.o.o, we should be able to get it online with minimal effort. The issue is if we want to run all 3 services at the same time. | 19:39 |
| pabelanger | I can iterate on that patch if you are okay with that | 19:39 |
| *** jamesmca_ has joined #openstack-infra | 19:40 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Case sensitive label matching https://review.openstack.org/469946 | 19:41 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Fix tests for "Case sensitive label matching" https://review.openstack.org/469985 | 19:41 |
| *** dave-mccowan has joined #openstack-infra | 19:46 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Fix tests for "Case sensitive label matching" https://review.openstack.org/469985 | 19:47 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Fix tests for "Case sensitive label matching" https://review.openstack.org/469985 | 19:47 |
| *** stevemar__ has quit IRC | 19:50 | |
| *** Apoorva has quit IRC | 19:50 | |
| *** spzala has joined #openstack-infra | 19:51 | |
| *** Apoorva has joined #openstack-infra | 19:51 | |
| *** mat128 has quit IRC | 19:54 | |
| *** Apoorva has quit IRC | 19:55 | |
| *** salv-orlando has joined #openstack-infra | 19:55 | |
| *** mat128 has joined #openstack-infra | 19:56 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Fix log streamer closing https://review.openstack.org/469989 | 19:57 |
| ianw | AJaeger: awesome, have fun! | 19:59 |
| * ianw wakes up to see how the great setuptools break of '17 looks | 19:59 | |
| ianw | oh, and we're talking dib if anyone wants to in meeting | 20:00 |
| *** armax has quit IRC | 20:00 | |
| *** mat128 has quit IRC | 20:01 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-zuul master: Initial commit of zuul-executor https://review.openstack.org/469994 | 20:03 |
| *** eharney has quit IRC | 20:03 | |
| *** gardlt has quit IRC | 20:03 | |
| *** mat128 has joined #openstack-infra | 20:04 | |
| *** dhajare-brb has quit IRC | 20:04 | |
| *** Apoorva has joined #openstack-infra | 20:06 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Create ze01.openstack.org https://review.openstack.org/469995 | 20:07 |
| pabelanger | jeblair: ^ first attempt at create zuul-executor servers. Pending your patch on how to do pip for python3 | 20:08 |
| *** prashkre has quit IRC | 20:09 | |
| fungi | dibbity-doo-dah | 20:10 |
| *** cody-somerville has quit IRC | 20:10 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-zuul master: Initial commit of zuul-executor https://review.openstack.org/469994 | 20:12 |
| openstackgerrit | Slawek Kaplonski proposed openstack-infra/shade master: Remove designateclient from commands related to recordsets https://review.openstack.org/469997 | 20:12 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Create ze01.openstack.org https://review.openstack.org/469995 | 20:17 |
| *** spzala has quit IRC | 20:17 | |
| *** ericyoung has quit IRC | 20:21 | |
| *** mat128 has quit IRC | 20:21 | |
| *** kgiusti has quit IRC | 20:23 | |
| *** stevemar__ has joined #openstack-infra | 20:23 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Create ze01.openstack.org https://review.openstack.org/469995 | 20:25 |
| fungi | disappearing again for a bit, but will be back shortly | 20:27 |
| *** dprince has quit IRC | 20:30 | |
| *** dave-mccowan has quit IRC | 20:32 | |
| *** alexchadin has quit IRC | 20:36 | |
| *** Goneri has quit IRC | 20:40 | |
| *** smarcet has quit IRC | 20:44 | |
| *** jamesmca_ has quit IRC | 20:44 | |
| *** jrist has quit IRC | 20:45 | |
| *** jkilpatr_ has quit IRC | 20:47 | |
| *** jrist has joined #openstack-infra | 20:49 | |
| *** cody-somerville has joined #openstack-infra | 20:51 | |
| *** jamesmca_ has joined #openstack-infra | 20:54 | |
| *** armax has joined #openstack-infra | 20:56 | |
| *** thorst has quit IRC | 20:57 | |
| pabelanger | clarkb: spacex launch in 55mins | 21:00 |
| *** thorst has joined #openstack-infra | 21:02 | |
| *** mjturek has left #openstack-infra | 21:03 | |
| clarkb | pabelanger: oh nice also lunch went long... Ill be at computer soon | 21:03 |
| *** stevemar__ has quit IRC | 21:04 | |
| *** rfolco has quit IRC | 21:04 | |
| ianw | oh cool, my app decided not to notify me about that one | 21:05 |
| *** trown is now known as trown|outtypewww | 21:05 | |
| ianw | i'm going to go wake kids yelling "there's a rocket launch!". you'll probably hear their eyes roll across the pacific | 21:05 |
| *** jamesmca_ has quit IRC | 21:06 | |
| *** jkilpatr has joined #openstack-infra | 21:06 | |
| *** gomarivera has quit IRC | 21:07 | |
| *** thorst has quit IRC | 21:07 | |
| clarkb | haha | 21:09 |
| *** stevemar__ has joined #openstack-infra | 21:09 | |
| *** gomarivera has joined #openstack-infra | 21:10 | |
| *** stevebaker has joined #openstack-infra | 21:10 | |
| clarkb | ianw: would you be willing to review https://review.openstack.org/468705 that was pushed in an effort to better support d-g and devstack on suse | 21:10 |
| openstackgerrit | Merged openstack/diskimage-builder master: Drop support for Ubuntu precise https://review.openstack.org/468186 | 21:10 |
| *** jamesmca_ has joined #openstack-infra | 21:10 | |
| *** kaisers1 has quit IRC | 21:12 | |
| pabelanger | ++ | 21:13 |
| *** gomarivera has quit IRC | 21:14 | |
| *** stevemar__ has quit IRC | 21:14 | |
| *** SumitNaiksatam has quit IRC | 21:15 | |
| *** neiljerram has joined #openstack-infra | 21:15 | |
| *** gyee has joined #openstack-infra | 21:16 | |
| *** trevormc has joined #openstack-infra | 21:17 | |
| *** ldnunes has quit IRC | 21:19 | |
| *** thorst has joined #openstack-infra | 21:20 | |
| *** arxcruz has quit IRC | 21:20 | |
| *** krtaylor has joined #openstack-infra | 21:23 | |
| *** arxcruz has joined #openstack-infra | 21:24 | |
| *** thorst has quit IRC | 21:24 | |
| *** trevormc has left #openstack-infra | 21:25 | |
| *** kaisers1 has joined #openstack-infra | 21:26 | |
| *** pramodrj07 has joined #openstack-infra | 21:26 | |
| *** MasterOfBugs has quit IRC | 21:29 | |
| *** baoli has quit IRC | 21:29 | |
| fungi | oh! right, the launch. looks like they're not scheduled to do another one from my area until september, and i'll be at the ptg when it happens :( | 21:36 |
| smcginnis | ianw, pabelanger: "Standing down due to lightning" | 21:37 |
| fungi | extra :( | 21:38 |
| pabelanger | sadface indeed | 21:38 |
| smcginnis | Saturday I think it said for the backup launch window. | 21:39 |
| *** jamesmca_ has quit IRC | 21:39 | |
| pabelanger | yes, 5:07pm EST | 21:39 |
| *** rossella_s has joined #openstack-infra | 21:39 | |
| *** salv-orlando has quit IRC | 21:40 | |
| *** jamesmca_ has joined #openstack-infra | 21:40 | |
| *** askb has joined #openstack-infra | 21:41 | |
| jeblair | pabelanger: sure, we can just go with scheduler for now | 21:43 |
| pabelanger | jeblair: okay, I'll start testing that | 21:44 |
| *** rossella_s has quit IRC | 21:44 | |
| *** jamesmca_ has quit IRC | 21:44 | |
| *** jascott1 has quit IRC | 21:45 | |
| jeblair | pabelanger: i don't have a strong opinion on whether we should use pip3 or not. i put up both patches, i'm happy to have either land. | 21:45 |
| fungi | hopefully saturday fares better... i'm bummed about the september launch now. it's only the second one out of the mid-atlantic regional spaceport (that's what it's named, i kid you not) since they rebuilt the pad after the antares launch explosion, and i won't be here to see it in person | 21:46 |
| *** jascott1 has joined #openstack-infra | 21:47 | |
| fungi | i guess there will be more, if the fates will it | 21:47 |
| *** neiljerram has quit IRC | 21:47 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Do less work when deleting a server and floating ips https://review.openstack.org/470031 | 21:48 |
| *** cody-somerville has quit IRC | 21:49 | |
| pabelanger | jeblair: I have a slight preference to pip3 vs python -m pip, only because DIB element set that up. and pip2 / pip3 do exist both inside and outside virtualenvs with get-pip.py | 21:51 |
| *** felipemonteiro__ has quit IRC | 21:51 | |
| clarkb | I'm testing a network setup in citycloud-la1 under the zuul user | 21:52 |
| clarkb | (and just realized that having a second network may confuse neutron when it needs to pick a network...) | 21:52 |
| ianw | fungi: just thinking ahead i guess. the "mid-atlantic region regional spaceport" sounds like where you'll hop on your SouthwestSpace shuttle to Mars. No assigned seating, one bag per person | 21:52 |
| clarkb | so uh let me know if you see anything funny there | 21:53 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use picked nodes for later cmd_* calls https://review.openstack.org/469330 | 21:54 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move global mount tracking into state https://review.openstack.org/469752 | 21:54 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use global state to check for duplicate fs labels https://review.openstack.org/469751 | 21:54 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Remove 'state' argument from later cmd_* calls https://review.openstack.org/469750 | 21:54 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add state to NodeBase class https://review.openstack.org/469749 | 21:54 |
| clarkb | pabelanger: 2a03:b000:902:5:f816:3eff:fe4d:8e5b seems to be working so far | 21:55 |
| *** cody-somerville has joined #openstack-infra | 21:55 | |
| *** cody-somerville has joined #openstack-infra | 21:55 | |
| clarkb | I made the subnet using dhcp6-stateless | 21:55 |
| pabelanger | clarkb: looking | 21:55 |
| clarkb | pabelanger: also that was booted using our test image so glean was happy with it | 21:56 |
| pabelanger | cool, was able to route to it | 21:56 |
| pabelanger | clarkb: is this lon1? | 21:56 |
| clarkb | la1 | 21:56 |
| pabelanger | k | 21:56 |
| clarkb | I'm going to put what I did in a paste in a sec | 21:56 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Fix log streamer closing https://review.openstack.org/469989 | 21:58 |
| clarkb | pabelanger: mordred http://paste.openstack.org/show/611259/ | 21:58 |
| *** jamesmca_ has joined #openstack-infra | 21:59 | |
| clarkb | I will probably leave the server up for about an hour and see if it stays up consistently | 21:59 |
| *** jamesmca_ has quit IRC | 21:59 | |
| jeblair | pabelanger: "python3 -m pip" will work everywhere, right? that's what fungi and clarkb were saying the other day i think? | 21:59 |
| clarkb | and if the second network is causing problems with node launches in that region I will tear the setup down | 22:00 |
| pabelanger | jeblair: I am not sure, I'll defer to clarkb / fungi | 22:00 |
| fungi | python3 -m pip will work everywhere as long as pip was also installed into the library search path for python3 (e.g., by running get-pip.py through python3 or installing the python3-pip package available on some distros) | 22:01 |
| pabelanger | clarkb: my network was dropping the router last time. So, we should see if that happens today | 22:01 |
| clarkb | pabelanger: ya mine too, low tech check is `watch date` in shell on that box | 22:01 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/project-config master: neutron: don't unstack services for functional and fullstack jobs https://review.openstack.org/470032 | 22:01 |
| jeblair | fungi: so in all cases where python3 -m pip will work, there should also be a pip3? | 22:01 |
| fungi | oh, and also get-pip is baked into some newer python3 interpreters (maybe 3.5 and later?) triggered by attempting to import the pip module that way | 22:02 |
| fungi | however some distros may neuter that in their interpreter packages, i know that got hotly debated for a while | 22:02 |
| *** jascott1 has quit IRC | 22:02 | |
| pabelanger | my testing show that pip3 will be created if get-pip.py is run though python3. | 22:02 |
| ihrachys | clarkb, we need https://review.openstack.org/470032 to continue running dstat during test run after switching to devstack-gate | 22:02 |
| *** jascott1 has joined #openstack-infra | 22:03 | |
| *** jamesmca_ has joined #openstack-infra | 22:03 | |
| clarkb | ihrachys: +2 | 22:03 |
| pabelanger | clarkb: still able to ssh to ipv6 | 22:03 |
| ihrachys | thanks! | 22:03 |
| fungi | basically the upstream python intent is that in newer python3 if you `python3 -m pip [...]` it will frontload by running get-pip.py under that interpreter before importing | 22:03 |
| *** annegentle has quit IRC | 22:04 | |
| jeblair | fungi: *fascinating* | 22:04 |
| *** jamesmca_ has quit IRC | 22:04 | |
| fungi | as a convenience so people don't need to `curl something|sudo bash` | 22:04 |
| fungi | or equivalent anyway | 22:04 |
| jeblair | fungi, pabelanger: i'm happy with whatever you are happy with. :) | 22:04 |
| *** jascott1 has quit IRC | 22:04 | |
| *** jascott1 has joined #openstack-infra | 22:06 | |
| clarkb | pabelanger: yup OpenStackCloudException: Error in creating instance (Inner Exception: Multiple possible networks found, use a Network ID to be more specific. (HTTP 409) (Request-ID: req-557e43a0-a8aa-46b4-84b0-d50bf7c98ed0)) | 22:06 |
| *** gouthamr has quit IRC | 22:06 | |
| jeblair | fungi: pabelanger has a preference for pip3; would you rather avoid it? | 22:06 |
| clarkb | pabelanger: so I'll need to delete the network router subnets I created once we are happy with the test server | 22:07 |
| fungi | i don't object to calling pip3 if that's convenient | 22:07 |
| jeblair | pabelanger: okay let's get us a server ^ :) | 22:08 |
| pabelanger | clarkb: ack, lets trying the network on openstackci user? | 22:08 |
| *** claudiub has quit IRC | 22:08 | |
| pabelanger | jeblair: ack | 22:08 |
| dirk | ianw: please make sure that https://review.openstack.org/#/c/469533/ is merged soonish (before nodepool-src* jobs become voting) | 22:08 |
| fungi | looks like the builtin ended up called "ensurepip" but anyway it might be worthwhile to see whether calling that makes things easier that running get-pip.py under python3 https://docs.python.org/3/library/ensurepip.html | 22:08 |
| fungi | in theory supported in 3.4 and later | 22:09 |
| ianw | dirk: thanks, lgtm | 22:09 |
| pabelanger | fungi: jeblair okay, so we should land https://review.openstack.org/#/c/469660/ ? | 22:09 |
| *** rcernin has quit IRC | 22:10 | |
| jeblair | pabelanger: ++ | 22:10 |
| pabelanger | wfm | 22:10 |
| *** jascott1 has quit IRC | 22:10 | |
| fungi | go for it | 22:11 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Fix fake gearman py3 bug and re-enable sched tests https://review.openstack.org/468583 | 22:13 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move global mount tracking into state https://review.openstack.org/469752 | 22:13 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use global state to check for duplicate fs labels https://review.openstack.org/469751 | 22:13 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Remove 'state' argument from later cmd_* calls https://review.openstack.org/469750 | 22:13 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add state to NodeBase class https://review.openstack.org/469749 | 22:13 |
| fungi | okay, so rereading the ensurepip documentation, upstream python>=3.4 bundles a contemporary version of pip, ad the ensurepip builtin module provides a way to bootstrap pip in case your python had its bundled pip stripped out by a concerned distro | 22:14 |
| fungi | that's slightly different from what i remember them wanting to do originally, but i guess it's still not too terrible | 22:14 |
| *** mdrabe has quit IRC | 22:16 | |
| *** annegentle has joined #openstack-infra | 22:17 | |
| fungi | confirmed that the python 3.5.3 in debian unstable still strips out the bundled copy of pip too (expecting you to install it some other way, either with `python3 -m ensurepip` or `apt-get install python3-pip`) | 22:17 |
| *** bobh has quit IRC | 22:19 | |
| *** aeng has joined #openstack-infra | 22:21 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-zuul master: Add initial py3 support (with pip3) https://review.openstack.org/469660 | 22:22 |
| clarkb | pabelanger: my ipv6 test server is still up, anything else you want to check before I tear all that down to make nodepool happy again? | 22:23 |
| *** marst has quit IRC | 22:23 | |
| pabelanger | clarkb: nope, I think I am good | 22:24 |
| clarkb | ok will delete things now then. Also did you get around to deleting your test server? do you think we should go ahead and d othat? | 22:24 |
| pabelanger | clarkb: sure, I can clean it up in a bit, unless you'd like to delete it | 22:24 |
| pabelanger | I can also tear down the network I created | 22:24 |
| *** darvon has quit IRC | 22:25 | |
| clarkb | you go for it, I'm learning you can't just delete things you have to unattach them all first | 22:26 |
| *** gomarivera has joined #openstack-infra | 22:27 | |
| openstackgerrit | Anne Gentle proposed openstack-infra/reviewstats master: Adds api-ref, docs, or installdocs statistics measures https://review.openstack.org/461280 | 22:28 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add zuulv3.o.o server https://review.openstack.org/469653 | 22:28 |
| *** darvon has joined #openstack-infra | 22:28 | |
| clarkb | should be all cleaned up now. watching nodepool to make sure it is happy again | 22:29 |
| clarkb | pabelanger: next thing is probably to try dhcpv6 stateless in lon1? | 22:29 |
| clarkb | and if it works there set up both regions with dhcpv6 stateless and go from there? | 22:30 |
| *** arahal_ has quit IRC | 22:30 | |
| clarkb | yup nodes are entering the ready state so that is happy now | 22:31 |
| pabelanger | jeblair: clarkb: fungi: it would be helpful if we could land 469660 (zuul pip3 patch) do you mind reviewing again. I just removed the depends-on header and reversed it to 469653 | 22:31 |
| pabelanger | clarkb: works for me | 22:31 |
| fungi | pabelanger: lookin' | 22:31 |
| *** gomarivera has quit IRC | 22:32 | |
| jeblair | pabelanger: +4 | 22:33 |
| fungi | pabelanger: did you mean to make it depend on 459728? | 22:33 |
| pabelanger | oh, I think that was the original topic for jeblair | 22:34 |
| pabelanger | we'll want to land that too for zuulv3 | 22:34 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Extend job list when inheriting jobs https://review.openstack.org/465393 | 22:35 |
| *** zz_dimtruck is now known as dimtruck | 22:35 | |
| fungi | done and done | 22:38 |
| jeblair | yeah, i accidentally did that on purpose because i know we won't get far without it | 22:38 |
| *** dimtruck is now known as zz_dimtruck | 22:39 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Enable test_project_override https://review.openstack.org/470049 | 22:41 |
| *** max_lobur has joined #openstack-infra | 22:42 | |
| *** darvon has quit IRC | 22:44 | |
| *** max_lobur has left #openstack-infra | 22:44 | |
| openstackgerrit | Merged openstack-infra/puppet-zuul master: Allow passing arbitrary connection objects https://review.openstack.org/459728 | 22:45 |
| openstackgerrit | Merged openstack-infra/puppet-zuul master: Add initial py3 support (with pip3) https://review.openstack.org/469660 | 22:45 |
| *** darvon has joined #openstack-infra | 22:45 | |
| *** ihrachys has quit IRC | 22:48 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add zuulv3.o.o server https://review.openstack.org/469653 | 22:48 |
| *** rbrndt has quit IRC | 22:49 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Enable test_periodic https://review.openstack.org/470053 | 22:55 |
| *** flepied has joined #openstack-infra | 22:55 | |
| *** stevemar__ has joined #openstack-infra | 22:57 | |
| *** jascott1 has joined #openstack-infra | 22:58 | |
| *** gouthamr has joined #openstack-infra | 22:58 | |
| *** rhallisey has quit IRC | 23:00 | |
| *** gordc has quit IRC | 23:03 | |
| *** annegentle has quit IRC | 23:05 | |
| *** stewie925 has quit IRC | 23:10 | |
| openstackgerrit | Merged openstack-infra/shade master: Log specific error message from RetriableConnectionFailure https://review.openstack.org/468091 | 23:10 |
| *** bobh has joined #openstack-infra | 23:17 | |
| *** spzala has joined #openstack-infra | 23:18 | |
| *** jamesmca_ has joined #openstack-infra | 23:21 | |
| pabelanger | fungi: clarkb do you mind a review on 469653, if not should be able to do tomorrow | 23:21 |
| *** spzala has quit IRC | 23:23 | |
| *** jamesmca_ has quit IRC | 23:26 | |
| *** bobh has quit IRC | 23:27 | |
| *** spzala has joined #openstack-infra | 23:29 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move global mount tracking into state https://review.openstack.org/469752 | 23:30 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use global state to check for duplicate fs labels https://review.openstack.org/469751 | 23:30 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Remove 'state' argument from later cmd_* calls https://review.openstack.org/469750 | 23:30 |
| *** bobh has joined #openstack-infra | 23:30 | |
| *** flepied has quit IRC | 23:32 | |
| *** Swami_ has quit IRC | 23:33 | |
| *** stevemar__ has quit IRC | 23:33 | |
| fungi | pabelanger: seems like it's unnecessarily declaring a bunch of top-level variables within the node resource an then passing those into the zuul class rather than just setting them there directly. i approved anyway, but any reason for the additional verbosity there? | 23:34 |
| pabelanger | fungi: agree, I think I can move all that logic into zuul_scheduler.pp class in our manifests folder. It was copypasta from our zuulv3-dev.o.o entry. I'll propse an clean up patch once I confirm zuulv3.o.o launched correctly | 23:36 |
| fungi | cool, wfm | 23:38 |
| *** pahuang has quit IRC | 23:38 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add zuulv3.o.o server https://review.openstack.org/469653 | 23:39 |
| *** stakeda has joined #openstack-infra | 23:39 | |
| *** stevemar__ has joined #openstack-infra | 23:43 | |
| oomichi | fungi: hi, I'd like to help stackalytics thing. now the launchpad of stackalytics has 60+ bug reports. Should we use storyboard instead? | 23:43 |
| *** xyang1 has quit IRC | 23:44 | |
| *** s-shiono has joined #openstack-infra | 23:45 | |
| *** camunoz has joined #openstack-infra | 23:46 | |
| *** gildub has joined #openstack-infra | 23:49 | |
| *** pahuang has joined #openstack-infra | 23:52 | |
| *** rkukura_ has joined #openstack-infra | 23:54 | |
| fungi | oomichi: it's a great question... stackalytics is an unofficial project which technically has maintainers, but they don't seem to have the bandwidth to actually keep up with the project and offers i've seen to help them out seem to mostly fall on deaf ears | 23:55 |
| *** dklyle has joined #openstack-infra | 23:55 | |
| *** rkukura has quit IRC | 23:55 | |
| *** rkukura_ is now known as rkukura | 23:55 | |
| fungi | oomichi: i agree something probably needs to be done about it since the community has grown dependent, but we can't (in my opinion) just decide to take it over from them | 23:55 |
| fungi | oomichi: we probably either need to find some way to work with them to hand it off to a new team of people willing to spend time improving the software, or fork it | 23:56 |
| *** hongbin has quit IRC | 23:56 | |
| *** dingyichen has joined #openstack-infra | 23:57 | |
| oomichi | fungi: yeah, I have the same feeling. I think stackalytics itself is good implementation and I don't think we should create another implementation by dropping it. collaboration or fork could be a good option | 23:57 |
| oomichi | fungi: now the other open source foundation also is interested in using stackalytics I heard | 23:58 |
| *** david-lyle has quit IRC | 23:58 | |
| fungi | i don't know what that is. do you mean the open source initiative (osi)? | 23:58 |
| *** jamielennox|away is now known as jamielennox | 23:59 | |
| oomichi | fungi: I mean cncf | 23:59 |
| fungi | ohhh... the google thing | 23:59 |
| fungi | yeah, i've heard of that | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!