Monday, 2015-06-22

mordredjhesketh: done00:00
*** asettle has quit IRC00:00
*** EricGonczer_ has joined #openstack-infra00:00
jheskethmordred: awesome, works now, thanks :-)00:00
mordredjhesketh: it comes along with root acess - since with root access you could just do that by editing the db anyway :)00:00
jhesketh:-)00:00
*** markvoelker has joined #openstack-infra00:01
*** markvoelker has quit IRC00:05
*** otter768 has joined #openstack-infra00:06
*** fallenpegasus has joined #openstack-infra00:10
lifelessWE CAN"T HAVE NICE THINGS.00:11
StevenKlifeless: This was known00:13
*** abitha has joined #openstack-infra00:14
*** wenlock has quit IRC00:15
*** bradjones has quit IRC00:22
*** ianw has quit IRC00:23
*** bradjones has joined #openstack-infra00:23
*** bradjones has quit IRC00:23
*** bradjones has joined #openstack-infra00:23
*** ianw has joined #openstack-infra00:24
*** ddieterly has joined #openstack-infra00:29
*** ddieterly has quit IRC00:34
*** yamamoto has joined #openstack-infra00:38
*** dimsum__ has quit IRC00:39
*** dimsum__ has joined #openstack-infra00:41
*** yamamoto has quit IRC00:43
*** amotoki has joined #openstack-infra00:50
*** dims_ has joined #openstack-infra00:50
*** dimsum__ has quit IRC00:50
*** yamamoto has joined #openstack-infra01:03
*** otter768 has quit IRC01:05
*** salv-orlando has joined #openstack-infra01:06
*** salv-orlando has quit IRC01:11
*** dimsum__ has joined #openstack-infra01:17
*** dims_ has quit IRC01:17
*** yamamoto has quit IRC01:25
*** jgrimm_ is now known as zz_jgrimm_01:27
*** marcusvrn has joined #openstack-infra01:29
*** ddieterly has joined #openstack-infra01:30
*** EricGonczer_ has quit IRC01:31
*** marcusvrn has quit IRC01:33
*** ddieterly has quit IRC01:35
*** dims_ has joined #openstack-infra01:40
*** dimsum__ has quit IRC01:41
*** fedexo has joined #openstack-infra01:49
*** markvoelker has joined #openstack-infra01:50
*** Sukhdev has joined #openstack-infra01:52
*** markvoelker has quit IRC01:55
*** stevemar has joined #openstack-infra01:57
*** SlickNik_ has joined #openstack-infra02:02
*** marcusvrn has joined #openstack-infra02:03
*** ajmiller_ has joined #openstack-infra02:03
*** ajmiller_ has quit IRC02:03
*** ajmiller_ has joined #openstack-infra02:04
*** linkedinyou has quit IRC02:06
*** ajmiller has quit IRC02:06
*** ajmiller__ has joined #openstack-infra02:07
*** woodster_ has joined #openstack-infra02:10
*** ajmiller_ has quit IRC02:10
*** yamamoto has joined #openstack-infra02:21
*** marcusvrn has quit IRC02:23
*** zz_dimtruck is now known as dimtruck02:24
*** ddieterly has joined #openstack-infra02:31
*** ddieterly has quit IRC02:35
*** dkranz has quit IRC02:55
*** otter768 has joined #openstack-infra03:05
*** achanda has joined #openstack-infra03:10
*** otter768 has quit IRC03:10
*** sdake_ has quit IRC03:10
*** alexpilotti has joined #openstack-infra03:13
*** rm_work is now known as rm_work|away03:16
*** marcusvrn has joined #openstack-infra03:17
*** salv-orlando has joined #openstack-infra03:19
*** marcusvrn has quit IRC03:21
*** asettle has joined #openstack-infra03:21
*** salv-orlando has quit IRC03:22
*** fallenpegasus has quit IRC03:31
*** ddieterly has joined #openstack-infra03:31
*** achanda has quit IRC03:33
*** ddieterly has quit IRC03:36
*** mriedem1 has joined #openstack-infra03:37
openstackgerritSachi King proposed openstack-dev/pbr: This documents the use of comments that work between 2.6, 2.7 and 3.4  https://review.openstack.org/19392703:38
*** mriedem has quit IRC03:38
*** markvoelker has joined #openstack-infra03:38
*** dims_ has quit IRC03:40
*** markvoelker has quit IRC03:43
*** mestery has joined #openstack-infra03:44
*** Longgeek has quit IRC03:48
*** abitha has quit IRC03:49
*** Longgeek has joined #openstack-infra03:50
*** AzherKhan has joined #openstack-infra03:51
*** Sukhdev has quit IRC03:52
*** jhesketh has quit IRC03:58
*** electrichead has quit IRC03:59
*** jhesketh has joined #openstack-infra04:01
*** sdake has joined #openstack-infra04:04
openstackgerritMerged openstack-infra/irc-meetings: Update the chair for the Puppet OpenStack meetings  https://review.openstack.org/19373804:07
*** ildikov has quit IRC04:11
*** ajmiller__ has quit IRC04:13
*** laughterwym has joined #openstack-infra04:14
*** redrobot has joined #openstack-infra04:16
*** redrobot is now known as Guest4778904:16
*** dimtruck is now known as zz_dimtruck04:21
*** jerryz has joined #openstack-infra04:23
*** unicell1 has joined #openstack-infra04:25
*** garyk has joined #openstack-infra04:26
*** unicell has quit IRC04:27
*** Guest47789 has quit IRC04:28
*** ddieterly has joined #openstack-infra04:32
*** ddieterly has quit IRC04:37
*** abregman has joined #openstack-infra04:37
*** dimsum__ has joined #openstack-infra04:41
*** dimsum__ has quit IRC04:46
*** ruagair has joined #openstack-infra04:47
ianwlifeless: we really want to re-install pbr every time ...04:48
ianw? (sorry, was a question)04:49
*** fallenpegasus has joined #openstack-infra04:49
*** mestery has quit IRC04:54
*** rakhmerov__ is now known as rakhmerov04:59
*** salv-orlando has joined #openstack-infra05:02
*** yfried__ has quit IRC05:05
*** otter768 has joined #openstack-infra05:06
*** fallenpegasus has quit IRC05:06
*** yuji_shimoda has joined #openstack-infra05:10
*** otter768 has quit IRC05:11
*** salv-orlando has quit IRC05:13
*** yuji_shimoda has quit IRC05:13
*** BharatK has joined #openstack-infra05:13
*** kdas_ has quit IRC05:14
*** yfried__ has joined #openstack-infra05:17
*** stevemar has quit IRC05:19
*** hdd has joined #openstack-infra05:19
*** hughhalf_ is now known as hughhalf05:22
*** gmann has quit IRC05:24
*** markvoelker has joined #openstack-infra05:27
*** fallenpegasus has joined #openstack-infra05:27
*** gmann has joined #openstack-infra05:31
*** markvoelker has quit IRC05:32
greghaynesnibalizer: ok, just confirmed with a test that os-client-config does not translate project-id into project_name, which jives with what I was saying originally about youre probably exploding when you properly set a tenant-id05:32
nibalizersweet05:33
greghaynesnibalizer: are you set up where you could pull in a modified os-client-config and test something?05:33
nibalizerif you set it up so i could pip install from git maybe?05:35
nibalizerlike push the change to github or something and i could install it from there?05:35
greghaynesnibalizer: ill just push up a change to fix what im seeing in os-c-c, that should make you see consistent behavior05:38
openstackgerritYuiko Takada proposed openstack-infra/project-config: Add Ironic-inspector's jobs  https://review.openstack.org/19394105:41
greghaynesnibalizer: https://review.openstack.org/19394205:44
*** hdd has quit IRC05:48
*** tobiash has joined #openstack-infra05:49
*** alexpilotti has quit IRC05:50
*** kushal has joined #openstack-infra05:55
*** mase_home has joined #openstack-infra05:59
*** nikil89_ has joined #openstack-infra06:01
*** nikil89_ is now known as naggappan06:01
*** coolsvapz is now known as coolsvap06:02
*** _nadya_ has joined #openstack-infra06:03
*** mase_home has quit IRC06:04
*** deepakcs has joined #openstack-infra06:08
*** asettle has quit IRC06:10
*** mrmartin has joined #openstack-infra06:11
*** liam__ has joined #openstack-infra06:11
*** unicell1 has quit IRC06:13
*** bexelbie has joined #openstack-infra06:13
*** unicell has joined #openstack-infra06:14
*** liam__ has quit IRC06:20
openstackgerritYuiko Takada proposed openstack-infra/project-config: Add Ironic-inspector's jobs  https://review.openstack.org/19394106:24
*** gmann has quit IRC06:24
*** jerryz has quit IRC06:24
*** garyk1 has joined #openstack-infra06:26
*** ParsectiX has joined #openstack-infra06:27
*** ihrachyshka has joined #openstack-infra06:27
*** garyk has quit IRC06:28
*** gmann has joined #openstack-infra06:28
*** bexelbie_ has joined #openstack-infra06:28
*** mrunge has joined #openstack-infra06:29
*** garyk1 has quit IRC06:31
*** sshnaidm has joined #openstack-infra06:32
*** ddieterly has joined #openstack-infra06:34
*** ddieterly has quit IRC06:39
openstackgerritMarton Kiss proposed openstack-infra/system-config: Initial commit of ask-staging.o.o site  https://review.openstack.org/17288006:40
*** ttx` is now known as ttx06:40
lifelessianw: no, but we need to.06:40
*** ttx has quit IRC06:41
*** ttx has joined #openstack-infra06:41
lifelessianw: once we have constraints in use we can remove this bandaid06:41
*** frickler_ is now known as frickler06:41
*** k4n0 has joined #openstack-infra06:45
*** devvesa has joined #openstack-infra06:47
*** Longgeek has quit IRC06:47
*** Longgeek has joined #openstack-infra06:47
*** ihrachyshka has quit IRC06:49
*** fedexo has quit IRC06:51
*** hichihara has joined #openstack-infra06:53
openstackgerrityolanda.robla proposed openstack-infra/nodepool: Allow to delete nodes with missing target or provider  https://review.openstack.org/19262906:54
*** jhesketh has quit IRC06:54
*** mrmartin has quit IRC07:02
*** fedexo has joined #openstack-infra07:03
*** sshnaidm has quit IRC07:03
*** sshnaidm has joined #openstack-infra07:03
*** jhesketh has joined #openstack-infra07:04
*** rcarrillocruz has quit IRC07:06
*** otter768 has joined #openstack-infra07:07
*** yamada-h has joined #openstack-infra07:09
*** [HeOS] has quit IRC07:09
openstackgerritSpencer Krum proposed openstack-infra/system-config: Bring in module to manage update-alternatives  https://review.openstack.org/17155607:10
openstackgerritSpencer Krum proposed openstack-infra/system-config: Alpha-sort modules.env  https://review.openstack.org/19124507:10
openstackgerritSpencer Krum proposed openstack-infra/system-config: Add puppet-community/archive module  https://review.openstack.org/16456907:10
openstackgerritSpencer Krum proposed openstack-infra/system-config: Load in nanliu/git module  https://review.openstack.org/16435507:10
*** salv-orlando has joined #openstack-infra07:10
*** zz_dimtruck is now known as dimtruck07:11
*** otter768 has quit IRC07:12
*** salv-orlando has quit IRC07:13
*** mrmartin has joined #openstack-infra07:14
lifelessjhesketh: are you still around ?07:16
lifelessjhesketh: we have a release request for some docs stuff07:16
lifelessv low risk again, lower than pbr07:16
*** markvoelker has joined #openstack-infra07:16
jheskethlifeless: yep, I'll be around this evening07:16
lifelesscool07:16
jheskethlifeless: got any more details (my irc client lost its scrollback)07:17
lifelessjhesketh: #openstack-relmgr-office07:17
*** salv-orlando has joined #openstack-infra07:17
*** mpaolino has joined #openstack-infra07:19
*** markvoelker has quit IRC07:21
*** dimtruck is now known as zz_dimtruck07:23
*** Guest87092 has quit IRC07:23
*** ihrachyshka has joined #openstack-infra07:24
*** d0ugal has joined #openstack-infra07:24
*** d0ugal is now known as Guest1487507:24
*** Guest14875 is now known as d0ugal07:25
*** d0ugal has quit IRC07:25
*** d0ugal has joined #openstack-infra07:25
*** samuelBartel has joined #openstack-infra07:25
*** yamada-h has quit IRC07:25
*** ildikov has joined #openstack-infra07:26
*** markus_z has joined #openstack-infra07:26
*** hashar has joined #openstack-infra07:26
*** mpavone has joined #openstack-infra07:26
*** mpavone has quit IRC07:27
*** hashar is now known as hasharAway07:29
*** dguerri` is now known as dguerri07:31
*** arxcruz has joined #openstack-infra07:31
*** afazekas has joined #openstack-infra07:31
*** jlanoux has joined #openstack-infra07:32
*** mrmartin has quit IRC07:34
flip214Does somebody know what kind of storage backend the Jenkins CI is using for the VMs? Is it Ceph, simple local LVs, or what is being used?07:34
*** ddieterly has joined #openstack-infra07:35
*** mrmartin has joined #openstack-infra07:35
*** dguerri is now known as dguerri`07:35
openstackgerritYuiko Takada proposed openstack-infra/project-config: Add Ironic-inspector's jobs  https://review.openstack.org/19394107:36
*** doude_ has quit IRC07:37
*** doude has joined #openstack-infra07:38
*** ddieterly has quit IRC07:39
*** chlong has quit IRC07:39
clarkbflip214 its provided by public clouds so whatever they use07:40
*** yfried__ is now known as yfried|afk07:41
*** bradjones has quit IRC07:43
*** fedexo has quit IRC07:44
flip214clarkb: yeah, but do you (or somebody else) know *what's* being used?07:45
*** bradjones has joined #openstack-infra07:45
*** bradjones has quit IRC07:45
*** bradjones has joined #openstack-infra07:45
*** yfried|afk is now known as yfried__07:47
*** Ala has joined #openstack-infra07:48
openstackgerritSteve Kowalik proposed openstack-infra/project-config: Update hacking to match requirements  https://review.openstack.org/19396607:49
*** jamespage_ has quit IRC07:51
*** SumitNaiksatam has quit IRC07:51
*** SumitNaiksatam has joined #openstack-infra07:54
openstackgerritMarton Kiss proposed openstack-infra/groups: Upgrade Drupal Core to 7.38 and module security updates  https://review.openstack.org/19396807:54
*** flepied1 has joined #openstack-infra07:55
*** vinayyadhav has joined #openstack-infra07:56
*** vinay_yadhav has joined #openstack-infra07:56
*** jamespag` is now known as jamespage07:56
* fifieldt appreciates lifeless' rapid releasing07:56
clarkbflip214 no I do not, would have to ask the clouds07:57
flip214clarkb: okay. would have been interested in that, to better understand the IO behaviour. thank you!07:58
*** flepied has quit IRC07:58
*** SumitNaiksatam has quit IRC08:01
*** SumitNaiksatam has joined #openstack-infra08:01
lifelessfifieldt: heh np08:01
*** woodster_ has quit IRC08:01
*** bradjones has quit IRC08:02
*** e0ne has joined #openstack-infra08:05
*** shardy has joined #openstack-infra08:05
*** hasharAway is now known as hashar08:06
openstackgerritMerged openstack-infra/groups: Upgrade Drupal Core to 7.38 and module security updates  https://review.openstack.org/19396808:07
*** notnownikki has joined #openstack-infra08:07
*** fhubik has joined #openstack-infra08:08
*** sshnaidm has quit IRC08:09
*** Mmike has quit IRC08:09
*** jklare has quit IRC08:10
*** jklare has joined #openstack-infra08:10
*** e0ne has quit IRC08:11
*** Mmike has joined #openstack-infra08:11
*** sshnaidm has joined #openstack-infra08:13
*** sshnaidm has quit IRC08:13
*** sshnaidm has joined #openstack-infra08:13
electricallifeless: clarkb morning gents08:14
*** bradjones has joined #openstack-infra08:14
*** bradjones has quit IRC08:14
*** bradjones has joined #openstack-infra08:14
*** [HeOS] has joined #openstack-infra08:17
openstackgerritMerged openstack/requirements: Add congress-pythonclient  https://review.openstack.org/19066908:18
*** leseb has joined #openstack-infra08:18
openstackgerritOpenStack Proposal Bot proposed openstack-dev/hacking: Updated from global requirements  https://review.openstack.org/18682908:19
openstackgerritOpenStack Proposal Bot proposed openstack-dev/pbr: Updated from global requirements  https://review.openstack.org/19397308:19
openstackgerritOpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements  https://review.openstack.org/19229608:20
*** gfidente has joined #openstack-infra08:20
gfidenteguys, there is a change which got workflow +1 two times but apparently won't merge I am unsure why08:20
gfidentehttps://review.openstack.org/#/c/182027/08:20
*** dguerri` is now known as dguerri08:20
gfidenteI has a depends-on, but that landed, are we missing anything?08:21
gfidente*it has08:21
*** ildikov has quit IRC08:23
*** claudiub has joined #openstack-infra08:24
AJaeger_gfidente: The depends-on does not work nicely accores repos08:25
AJaeger_you need to reapprove the 182027 one again.08:25
AJaeger_Zuul does not get informed that the dependent patch landed and will only check once somebody approves 027 again.08:25
AJaeger_So, remove your +A and set it again - and then it merges08:26
gfidenteAJaeger_, thanks!08:28
*** claudiub has quit IRC08:30
*** rossella_s has quit IRC08:30
AJaeger_gfidente: add it back directly...08:30
gfidenteAJaeger_, no need to wait for the other guy to remove +A as well?08:31
*** rossella_s has joined #openstack-infra08:31
*** eezhova19 is now known as eezhova08:32
AJaeger_gfidente: I don't think so, just try it out ;)08:32
*** oomichi has joined #openstack-infra08:32
gfidentestarting gate jobs looks good no?08:33
AJaeger_gfidente: YEah, looks great!08:34
gfidentethanks08:35
AJaeger_gfidente: you're welcome08:35
*** ddieterly has joined #openstack-infra08:35
*** shardy has quit IRC08:35
*** teran has quit IRC08:35
*** shardy has joined #openstack-infra08:36
*** ildikov has joined #openstack-infra08:36
*** jlanoux has quit IRC08:37
*** bradjones has quit IRC08:38
*** vinayyadhav has quit IRC08:38
*** vinay_yadhav has quit IRC08:38
*** vinayyadhav has joined #openstack-infra08:38
*** vinay_yadhav has joined #openstack-infra08:38
*** pelix has joined #openstack-infra08:39
*** bradjones has joined #openstack-infra08:40
*** bradjones has quit IRC08:40
*** bradjones has joined #openstack-infra08:40
*** ddieterly has quit IRC08:40
*** jcoufal has joined #openstack-infra08:41
*** sshnaidm has quit IRC08:42
*** Hal has joined #openstack-infra08:43
*** Hal is now known as Guest7523908:44
*** derekh has joined #openstack-infra08:44
*** yfried__ is now known as yfried|afk08:49
*** eantyshev has joined #openstack-infra08:49
*** flepied1 has quit IRC08:50
*** davideagnello has joined #openstack-infra08:50
*** yfried|afk is now known as yfried__08:50
AJaeger_lifeless: any idea why the most recent proposal run failed, see https://jenkins.openstack.org/job/propose-requirements-updates/123/consoleFull08:51
AJaeger_lifeless: "Error in syncing: Ignoring openstack/requirements"08:51
*** Guest75239 has quit IRC08:51
dtantsuroomichi or someone else: so e.g. we're creating a job to test ironic-inspector08:52
dtantsuroomichi, and then I see we checkout git master https://review.openstack.org/#/c/193941/3/jenkins/jobs/ironic-inspector.yaml line 2708:52
AJaeger_lifeless: the other failure is fixed with https://review.openstack.org/#/c/192336/08:52
dtantsurhow does it happen that we're testing the patch in question, not already merged git?08:52
dtantsurdoes it happen automagically, or do we need to support some env variables in our devstack plugin, or something like that?08:53
dtantsurAJaeger_, hi, maybe you can clarify ^^, if you're familiar with project-config?08:54
*** davideagnello has quit IRC08:55
AJaeger_dtantsur: The URL in line 27 is just for documentation, no worries08:55
oomichidtantsur: then?08:55
oomichidtantsur: the line is a setting for deploying inspector and line38-39 deploy DevStack env.08:55
AJaeger_dtantsur, oomichi: Could you add the template to jenkins/jobs/ironic.yaml, please? No need for an extra file for this..08:56
openstackgerritVictor Stinner proposed openstack-infra/project-config: Make gate-glance-python34 voting  https://review.openstack.org/19404808:56
*** marzif has joined #openstack-infra08:56
dtantsurAJaeger_, I'll ask the developer08:56
dtantsurAJaeger_, oh, she's offline, could you leave a review comment please?08:57
AJaeger_dtantsur: will do.08:57
oomichidtantsur: yeah, she is already back.08:57
*** jcoufal has quit IRC08:57
oomichidtantsur: can you do that instead of her?08:57
dtantsuroomichi, will do08:57
oomichidtantsur: nice08:58
dtantsurAJaeger_, sorry for taking your time, just trying to wrap my head around project-config: does something automagically replaces git line with the patch being tested?08:58
*** kushal has quit IRC09:00
*** oomichi has quit IRC09:01
AJaeger_dtantsur: only the first two params of that line are used, the third is just documentation...09:01
dtantsurAJaeger_, cool, thanks!09:01
AJaeger_dtantsur: copy the comment from jenkins/jobs/networking-odl.yaml over if you like ;)09:02
*** linkedinyou has joined #openstack-infra09:02
*** sshnaidm has joined #openstack-infra09:03
dtantsurAJaeger_, do I need the export PROJECTS=.. line as well?09:03
AJaeger_dtantsur: Yes. There was some email by sdague a few weeks ago on openstack-dev with details for external plugins if you want to read more about these09:04
dtantsurcool, will have a look09:04
*** markvoelker has joined #openstack-infra09:05
*** e0ne has joined #openstack-infra09:05
*** ociuhandu has joined #openstack-infra09:07
*** fallenpegasus has quit IRC09:07
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Add Ironic Inspector simple integration test job  https://review.openstack.org/19394109:08
*** shardy has quit IRC09:08
dtantsurAJaeger_ does it look better now ^^^?09:08
dtantsuroh, I forgot about PROJECTS line, sorry09:08
*** otter768 has joined #openstack-infra09:08
AJaeger_dtantsur: I'll review later, will be gone for a bit now...09:08
*** shardy has joined #openstack-infra09:08
dtantsurnp, still something to fix :)09:08
*** pdb is now known as pbourke09:08
*** markvoelker has quit IRC09:09
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Add Ironic Inspector simple integration test job  https://review.openstack.org/19394109:12
*** otter768 has quit IRC09:13
lifelessAJaeger_: its a few lines up09:13
lifeless"raise Exception("nonstandard requirement present.")09:13
*** sshnaidm has quit IRC09:13
lifeless"09:13
AJaeger_lifeless: yep. What an irony that requirements has non-standard requirements, isn't it ;)09:13
lifelessAJaeger_: so I imagine something in test-requirements.txt or requirements.txt is non-standard09:14
lifelessAJaeger_: indeed09:14
*** sshnaidm has joined #openstack-infra09:14
lifelessAJaeger_: but easily fixed - I'll do a patch later this week to fix the error09:14
AJaeger_lifeless: thanks09:15
lifelessAJaeger_: I mean, fix the error message.09:16
lifelessAJaeger_: then we can see the error clearly ;)09:16
lifelessAJaeger_: from the same thing09:16
lifeless015-06-22 08:28:22.885 | A new version of git-review is availble on PyPI. Please09:16
lifeless2015-06-22 08:28:22.885 | update your copy with:09:17
*** mohankumar has quit IRC09:17
*** ociuhandu has quit IRC09:19
*** jog0 has joined #openstack-infra09:19
*** jog0 is now known as jogo09:19
*** claudiub has joined #openstack-infra09:19
AJaeger_lifeless: that git-review message is there for a long time and I haven't bothered looking at it.09:19
*** dguerri is now known as dguerri`09:20
*** dguerri` is now known as dguerri09:20
lifelesskk09:20
lifelessianw: so, considering a +A on https://review.openstack.org/#/c/193911/ ? :)09:20
AJaeger_lifeless: but fixing it would be worth it.09:20
*** dtantsur is now known as dtantsur|brb09:21
*** e0ne is now known as e0ne_09:22
*** ociuhandu has joined #openstack-infra09:23
openstackgerritMarek Denis proposed openstack-infra/project-config: Rename keystoneclient-saml2 to keystoneauth-saml2  https://review.openstack.org/19063109:24
*** e0ne_ is now known as e0ne09:27
*** sshnaidm has quit IRC09:33
*** jlanoux has joined #openstack-infra09:33
StevenKAJaeger_: Re https://review.openstack.org/193966 , I spent a little bit of time trying to work if we want to keep that up to date by hand, but eh, it's two requirements09:35
*** ddieterly has joined #openstack-infra09:36
mrmartinmorgen09:36
*** shardy has quit IRC09:36
*** shardy has joined #openstack-infra09:37
*** ghostpl has joined #openstack-infra09:37
mrmartindo we have any chane in gerrit release process? When I like to push a new groups portal release, gerrit is refusing it. http://paste.openstack.org/show/313089/09:38
mrmartinchane / change I cannot type09:38
*** ddieterly has quit IRC09:41
*** esker has quit IRC09:42
*** flwang1 has joined #openstack-infra09:43
flwang1greetings, anybody can help fix the duplicated  account issue?09:44
flwang1thanks a lot09:44
flwang1on gerrit09:44
*** devvesa has quit IRC09:44
*** devvesa has joined #openstack-infra09:45
*** sshnaidm has joined #openstack-infra09:45
*** _nadya_ has quit IRC09:45
*** igorbelikov has joined #openstack-infra09:45
*** _nadya_ has joined #openstack-infra09:46
*** dizquierdo has joined #openstack-infra09:47
*** flepied has joined #openstack-infra09:47
*** fhubik is now known as fhubik_afk09:50
*** _nadya_ has quit IRC09:50
*** vinayyadhav has quit IRC09:52
*** vinay_yadhav has quit IRC09:53
*** marcusvrn has joined #openstack-infra09:53
*** gmann_ has joined #openstack-infra09:54
*** gmann has quit IRC09:55
*** mohankumar has joined #openstack-infra09:55
*** ghostpl has quit IRC09:56
*** rcarrillocruz has joined #openstack-infra09:57
*** marcusvrn has quit IRC09:58
*** mohankumar has quit IRC10:02
*** Longgeek has quit IRC10:04
*** flepied has quit IRC10:04
*** jogo has quit IRC10:06
*** _nadya_ has joined #openstack-infra10:08
openstackgerritThierry Carrez proposed openstack-infra/release-tools: Update milestone.sh to support new versioning  https://review.openstack.org/19406810:08
*** flepied has joined #openstack-infra10:08
*** _nadya_ has quit IRC10:09
*** _nadya_ has joined #openstack-infra10:09
flwang1ttx: ping10:10
*** amotoki has quit IRC10:10
ttxflwang1: o/10:10
*** rm_work|away is now known as rm_work10:10
flwang1ttx: could you please let me know who is the right guy i should ask for a help to remove my dup account on gerrit?10:10
*** cdent has joined #openstack-infra10:11
flwang1I'm working on api-wg, but they can't add me as a reviewer since the dup account issue10:11
flwang1ttx: thx a lot10:11
ttxflwang1: I suspect one of infra-core people should be able to help you10:11
ttxhttps://review.openstack.org/#/admin/groups/306,members10:11
openstackgerritSam Betts proposed openstack-infra/project-config: Add project arecibo to stackforge  https://review.openstack.org/18556210:11
mrmartinflwang1: I guess they're sleeping10:12
ttxmrmartin: SergeyLukjanov is not10:12
flwang1ttx: mrmartin: cool, cheers10:12
mrmartinttx: yeah, but sometimes SergeyLukjanov used to be in the states too :)10:12
ttxnot sure he has keys to that kingdom though10:12
mrmartinwe need an EU team10:12
SergeyLukjanovI'm here now :) I don't actually know how the account removal should be done10:13
flwang1ttx: should i submit any request by any tool? or just ask for help at here?10:13
SergeyLukjanovas I understabd it's just an account removal?10:13
SergeyLukjanovw/o any additional things10:13
flwang1SergeyLukjanov: i found this http://docs.openstack.org/infra/system-config/gerrit.html#duplicate-accounts-in-gerrit10:13
mrmartinSergeyLukjanov, can you check why I cannot have the right to push a release tag on openstack-infra/groups?10:13
SergeyLukjanovmrmartin, one moment10:13
*** _nadya_ has quit IRC10:14
mrmartinI like to release sec fix, but getting a refusal from gerrit: http://paste.openstack.org/show/313089/10:14
SergeyLukjanovflwang1, okay, thx, will take a look and try to do it for your acc10:14
*** dimsum__ has joined #openstack-infra10:14
mrmartinit was working before :)10:14
AJaeger_mrmartin: yes, there was a change - let me give you a link10:14
flwang1SergeyLukjanov: my email is flwang@catalyst.net.nz10:14
AJaeger_mrmartin: http://lists.openstack.org/pipermail/openstack-dev/2015-June/066346.html10:15
mrmartinAJaeger_: thnx10:15
AJaeger_mrmartin: wait - which repository is this?10:16
AJaeger_openstack-infra/groups ?10:16
mrmartinopenstack-infra/groups10:16
mrmartinyeap10:16
*** fhubik_afk is now known as fhubik10:17
AJaeger_mrmartin: Then it'S a different problem.10:17
mrmartin:)10:17
mrmartinok, I'll ask fungi to look that issue10:17
AJaeger_mrmartin: https://review.openstack.org/#/c/186217/  changed groups-core to groups-release10:17
AJaeger_and I guess you're not in groups-release ;(10:18
SergeyLukjanovmrmartin, you're not in release group10:18
SergeyLukjanovAJaeger_, yeah, I've just checked it ;)10:18
mrmartinwho can add me to the release group?10:18
AJaeger_mrmartin: Best talk with jeblair since he made that change. IF it'S urgent, SergeyLukjanov can...10:18
SergeyLukjanovthat's correct10:19
mrmartinok, then we need to check my other projects too :)10:19
SergeyLukjanovI'm just not sure, was it intended to grant release permissions or not, better to wait for jeblair10:19
AJaeger_mrmartin: check them and talk with jeblair as infra PTL. I assume it's an error but I prefer that he confirms it.10:19
SergeyLukjanovmrmartin, as an option, I can push the tag for you now and then you'll discuss it with jeblair10:20
mrmartinI hope so, thanks for the help10:20
AJaeger_mrmartin: these are your groups https://review.openstack.org/#/settings/group-memberships10:20
mrmartinok SergeyLukjanov, thanks, I'll discuss that with jeblair10:20
mrmartingoing to grab my lunch now10:20
AJaeger_mrmartin: the library release changes I mentioned first are not the problem for openstack-infra/groups10:20
AJaeger_mrmartin: I'll join you ;)10:20
*** flepied has quit IRC10:21
SergeyLukjanovflwang1, yeah, there are two accounts now in the db10:23
flwang1SergeyLukjanov: may i know the two ids?10:23
SergeyLukjanovflwang1, 6484 and 1277010:24
SergeyLukjanovflwang1, 6484 is the owner for many CRs, so, it looks like your acc10:24
SergeyLukjanovand there are no CRs for the second one10:24
flwang1SergeyLukjanov: yep10:24
SergeyLukjanovhttps://review.openstack.org/#/q/owner:6484,n,z10:25
flwang16484 is what i'm using10:25
SergeyLukjanovhttps://review.openstack.org/#/q/owner:12770,n,z10:25
SergeyLukjanovgreat10:25
*** ociuhandu has quit IRC10:25
*** jamielennox is now known as jamielennox|away10:25
flwang1SergeyLukjanov: i think it's caused by my company changing10:26
SergeyLukjanovflwang1, I've removed incorrect account and now flushing cache10:26
SergeyLukjanovit should disappear soon10:27
flwang1SergeyLukjanov: i can still see two accounts, i will check it later and let you after it works, cheers man10:28
SergeyLukjanovflwang1, you're welcome10:28
*** fhubik is now known as fhubik_afk10:29
SergeyLukjanovflwang1, flush finished10:29
AJaeger_lifeless: everything fine with openstack-doc-tools 0.29.1, the Japanese User Guide looks Japanese again ;)10:31
*** hichihara has quit IRC10:31
*** fhubik_afk is now known as fhubik10:32
*** flepied has joined #openstack-infra10:34
*** Longgeek has joined #openstack-infra10:34
*** Hal has joined #openstack-infra10:36
*** Hal is now known as Guest5451610:36
*** ddieterly has joined #openstack-infra10:37
*** katyafervent is now known as katyafervent_awa10:38
*** davideagnello has joined #openstack-infra10:39
*** ddieterly has quit IRC10:41
*** davideagnello has quit IRC10:43
*** arxcruz has quit IRC10:43
*** d0ugal has quit IRC10:43
*** bexelbie has quit IRC10:43
*** deepakcs has quit IRC10:43
*** sdake has quit IRC10:43
*** AzherKhan has quit IRC10:43
*** clif_h has quit IRC10:43
*** roaet_ has quit IRC10:43
*** xnox has quit IRC10:43
*** dtantsur|brb has quit IRC10:43
*** dguitarbite has quit IRC10:43
*** lbragstad has quit IRC10:43
*** rm_work has quit IRC10:43
*** Kiall has quit IRC10:43
*** zz_dimtruck has quit IRC10:43
*** masayukig has quit IRC10:43
*** markmcclain has quit IRC10:43
*** ryanpetrello has quit IRC10:43
*** freyes has quit IRC10:43
*** dolphm has quit IRC10:43
*** _d34dh0r53_ has quit IRC10:43
*** hockeynut has quit IRC10:43
*** odyssey4me_ has quit IRC10:43
*** persia has quit IRC10:43
*** ttx has quit IRC10:43
*** eglute_s has quit IRC10:43
*** sigmavirus24_awa has quit IRC10:43
*** Guest11697 has quit IRC10:43
*** fbo_ has quit IRC10:43
*** adam_g has quit IRC10:43
*** apmelton has quit IRC10:43
*** gus has quit IRC10:43
*** zigo has quit IRC10:43
*** Trozz_ has quit IRC10:43
*** jroll has quit IRC10:43
*** stevebaker has quit IRC10:43
*** jbryce has quit IRC10:43
*** comstud has quit IRC10:43
*** jbernard has quit IRC10:43
*** persia has joined #openstack-infra10:43
*** persia has quit IRC10:43
*** persia has joined #openstack-infra10:43
*** apmelton has joined #openstack-infra10:43
*** ttx has joined #openstack-infra10:43
*** comstud has joined #openstack-infra10:43
*** jbryce has joined #openstack-infra10:43
*** gus has joined #openstack-infra10:43
*** zz_dimtruck has joined #openstack-infra10:43
*** Trozz_ has joined #openstack-infra10:43
*** masayukig has joined #openstack-infra10:43
*** adam_g has joined #openstack-infra10:43
*** xnox has joined #openstack-infra10:43
*** Kiall has joined #openstack-infra10:43
*** markmcclain has joined #openstack-infra10:43
*** ryanpetrello has joined #openstack-infra10:43
*** arxcruz has joined #openstack-infra10:43
*** bexelbie has joined #openstack-infra10:43
*** dtantsur has joined #openstack-infra10:43
*** rm_work has joined #openstack-infra10:43
*** deepakcs has joined #openstack-infra10:43
*** d0ugal has joined #openstack-infra10:43
*** clif_h has joined #openstack-infra10:43
*** AzherKhan has joined #openstack-infra10:43
*** dguitarbite has joined #openstack-infra10:43
*** zz_dimtruck is now known as dimtruck10:43
*** jroll has joined #openstack-infra10:43
*** d0ugal is now known as Guest2901110:43
*** mgagne has joined #openstack-infra10:43
*** mgagne is now known as Guest8120210:43
*** adam_g has quit IRC10:43
*** adam_g has joined #openstack-infra10:43
*** odyssey4me has joined #openstack-infra10:43
*** fbo_ has joined #openstack-infra10:43
*** roaet_ has joined #openstack-infra10:43
*** lbragstad has joined #openstack-infra10:44
*** sdake has joined #openstack-infra10:44
*** stevebaker has joined #openstack-infra10:44
*** hockeynut has joined #openstack-infra10:44
*** freyes has joined #openstack-infra10:44
*** zigo has joined #openstack-infra10:44
*** Guest29011 is now known as d0ugal10:44
*** d0ugal has quit IRC10:44
*** d0ugal has joined #openstack-infra10:44
*** ghostpl has joined #openstack-infra10:44
*** e0ne is now known as e0ne_10:44
*** dolphm has joined #openstack-infra10:44
*** eglute has joined #openstack-infra10:44
*** sigmavirus24_awa has joined #openstack-infra10:45
*** d34dh0r53 has joined #openstack-infra10:45
openstackgerritMerged openstack-infra/groups-static-pages: Fix minor spelling issues  https://review.openstack.org/17009510:45
*** dguitarbite has quit IRC10:47
*** pc_m has joined #openstack-infra10:47
*** dimsum__ is now known as dims10:48
*** katyafervent_awa is now known as katyafervent10:51
*** dims has quit IRC10:53
*** fhubik is now known as fhubik_afk10:53
*** e0ne_ is now known as e0ne10:53
*** markvoelker has joined #openstack-infra10:53
flwang1SergeyLukjanov: seems it doesn't work well, see http://www.tiikoni.com/tis/view/?id=59a804b10:56
*** 5EXABIIJM has joined #openstack-infra10:57
*** 77CAA6XSB has joined #openstack-infra10:57
*** fhubik_afk is now known as fhubik10:58
*** markvoelker has quit IRC10:58
*** dizquierdo has quit IRC10:59
openstackgerritTom Fifield proposed openstack-infra/groups: Stop importing data from groups.json  https://review.openstack.org/19408211:04
*** AzherKhan has quit IRC11:04
*** linkedinyou has quit IRC11:04
*** dims has joined #openstack-infra11:05
*** linkedinyou has joined #openstack-infra11:06
*** marcusvrn has joined #openstack-infra11:07
*** dguerri is now known as dguerri`11:07
*** dguerri` is now known as dguerri11:08
cdentcould someone be so kind as to boot this into reality: https://review.openstack.org/#/c/187151/ It is blocking the merge of some related grenade and devstack fixes. Please and thank you.11:08
*** otter768 has joined #openstack-infra11:09
*** yamada-h has joined #openstack-infra11:09
sambettsAJaeger_: Is there a guide somewhere on how to setup a my project as a big tent one? I'm just following the guide here http://docs.openstack.org/infra/manual/creators.html still11:10
AJaeger_sambetts: Best discuss directly with jeblair. REad first http://governance.openstack.org/reference/new-projects-requirements.html11:11
sambettsAJaeger_: Ah, thanks :D11:11
AJaeger_sambetts: best show up in 3 or 4 hours and talk with jeblair or fungi about it... I'm busy with other stuff right now.11:12
sambettsAJaeger_: Ok awesome, I'll do that, the main reason I hadn't answered jeblair's question yet was I need to learn about the process11:13
*** otter768 has quit IRC11:14
*** ZZelle has joined #openstack-infra11:14
*** yamada-h has quit IRC11:15
SergeyLukjanovflwang1, but there is no conflict right now11:15
AJaeger_sambetts: recent example https://review.openstack.org/#/c/188014/11:15
*** sshnaidm has quit IRC11:16
*** daemontool_ has joined #openstack-infra11:16
*** sshnaidm has joined #openstack-infra11:16
flwang1SergeyLukjanov: but it looks really weird, the first one is using 12770, seems it's the valid one now, but you know it's not the correct id11:16
sambettsAJaeger_: the project config process is the same then? Accept I'd put it in the openstack namespace?11:17
*** nihilifer has joined #openstack-infra11:17
flwang1and the 2nd one, is showing my email, i think that's the correct format11:17
*** dizquierdo has joined #openstack-infra11:17
*** _nadya_ has joined #openstack-infra11:17
AJaeger_sambetts: the searchlight team got 188014 approved and then added their repo to openstack namespace.11:17
*** marzif has quit IRC11:18
AJaeger_sambetts: Please discuss with fungi and jeblair whether what you do would fit into the big tent, they can help...11:18
sambettsAJaeger_: :D I will thanks for the pointers11:18
*** Longgeek has quit IRC11:18
*** 5EXABIIJM has quit IRC11:20
flwang1SergeyLukjanov: can you help check again?11:21
*** mrmartin has quit IRC11:21
*** 77CAA6XSB has quit IRC11:22
*** ParsectiX has quit IRC11:24
openstackgerritFatih Degirmenci proposed openstack-infra/jenkins-job-builder: Add Disable Failed Job Plugin support  https://review.openstack.org/19272011:25
*** yamamoto has quit IRC11:25
*** dizquierdo_ has joined #openstack-infra11:26
*** sdake_ has joined #openstack-infra11:27
*** ParsectiX has joined #openstack-infra11:27
dtantsursambetts, out of curiosity: what are you proposing?11:28
*** dizquierdo has quit IRC11:28
*** jlvillal has quit IRC11:28
*** ttx has quit IRC11:28
*** ttx has joined #openstack-infra11:28
sambettsdtantsur: It was the project I discussed at the summit, although with the more recent changes to inspector I'm not sure its super nessesary anymore, but I've also got a thing for neutron that I need to put it too11:30
sambettsneed to put up too *11:30
*** sdake has quit IRC11:30
dtantsursambetts, ah, autodiscovery.. if it's possible, I'd prefer it to be a 3rdpary plugin for inspector :) but it's up to you to decide11:31
*** fhubik is now known as fhubik_afk11:31
dtantsursambetts, on the other hand, we're going to make one more inspector-related proposal, so stay tuned and watch the ML11:31
sambettsdtantsur: Yeah, with the new hooks etc I think it might not need a separate project11:32
*** [HeOS] has quit IRC11:33
*** hrubi has quit IRC11:34
*** ddieterly has joined #openstack-infra11:38
*** daemontool_ has quit IRC11:38
*** marzif has joined #openstack-infra11:39
*** HeOS has joined #openstack-infra11:39
*** ldnunes has joined #openstack-infra11:39
*** dizquierdo_ has quit IRC11:41
*** marzif_ has joined #openstack-infra11:42
*** ddieterly has quit IRC11:42
*** HeOS has quit IRC11:42
*** HeOS has joined #openstack-infra11:43
*** weshay has joined #openstack-infra11:44
openstackgerritSerg Melikyan proposed openstack-infra/project-config: Move puppet-murano from stackforge to openstack  https://review.openstack.org/19273011:45
*** Longgeek has joined #openstack-infra11:46
*** mwagner_afk has quit IRC11:47
*** deepakcs has quit IRC11:51
openstackgerritMerged openstack-dev/pbr: Updated from global requirements  https://review.openstack.org/19397311:52
*** BharatK has quit IRC11:53
openstackgerritFabio Porcedda proposed openstack-infra/git-review: Add "-p"/"--pull" option to merge a change on the local branch  https://review.openstack.org/19409411:53
openstackgerritYuiko Takada proposed openstack-infra/project-config: Add translation job for Ironic-inspector  https://review.openstack.org/19409511:53
*** markvoelker has joined #openstack-infra11:54
*** shardy has quit IRC11:57
*** markvoelker has quit IRC11:59
*** dprince has joined #openstack-infra12:00
pelixfungi jeblair mordred clarkb: looking for some infra reviewers to give some changes for JJB a look over https://review.openstack.org/183488, https://review.openstack.org/133997, https://review.openstack.org/181541 & https://review.openstack.org/18154212:01
*** shardy has joined #openstack-infra12:02
*** marcusvrn has quit IRC12:02
*** dangers_away has joined #openstack-infra12:02
*** marcusvrn has joined #openstack-infra12:02
*** markvoelker has joined #openstack-infra12:03
openstackgerritVictor Stinner proposed openstack-infra/project-config: Make gate-glance-python34 voting and a py34 gate  https://review.openstack.org/19404812:04
*** yuikotakada has joined #openstack-infra12:05
*** BharatK has joined #openstack-infra12:05
*** yamamoto has joined #openstack-infra12:07
yuikotakadaA-jaeger: around here?12:08
*** bdemers has quit IRC12:09
*** fhubik_afk is now known as fhubik12:10
*** bswartz has quit IRC12:10
*** sshnaidm has quit IRC12:10
*** dkranz has joined #openstack-infra12:11
*** kgiusti has joined #openstack-infra12:11
*** dangers_away has quit IRC12:14
dtantsuryuikotakada, the nick is AJaeger_12:15
AJaeger_yuikotakada: Yes, I am.12:15
AJaeger_dtantsur: thanks ;)12:15
* dtantsur likes autocomplete :)12:15
yuikotakadaAJaeger_: I'm very sorry for impoliteness.12:15
AJaeger_yuikotakada: how can I help?12:15
*** dizquierdo has joined #openstack-infra12:16
AJaeger_yuikotakada: no problems!12:16
*** mmedvede has joined #openstack-infra12:16
AJaeger_dtantsur: for translation we need a scheme for paths so that our scripts can work with all repos. I wouldn't call it hardcoded ;) Thanks for approving the patch quickly.12:17
yuikotakadaAJaeger_, Yes, thank you for reviewing https://review.openstack.org/#/c/194095/ . I'm not sure what should I do for zuul/layout.yaml. so that, could you please show me doc or something like that?12:17
*** e0ne is now known as e0ne_12:18
*** mnaser has joined #openstack-infra12:18
AJaeger_yuikotakada: jenkins/jobs/projects.yaml says *what* to run. zuul/layout.yaml triggers *when* to run12:18
yuikotakadaAnd also thank you very much for having posted a patch into Ironic-inspector.12:18
AJaeger_So far you created a job but haven't wired it so that it gets executed ;)12:18
AJaeger_yuikotakada: http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n1510 shows what is needed (from barbican)12:19
* dtantsur finally got an explanation, thanks, AJaeger_ :)12:19
*** e0ne_ is now known as e0ne12:19
*** amotoki has joined #openstack-infra12:19
dtantsurnote: inspector patch has merged12:19
yuikotakadaAJaeger_, I understand. Thank you. :)12:19
AJaeger_Add the translation-jobs template to ironic-inspector so that we run the translation jobs at the proper time12:19
AJaeger_proper time means: AFter each merge, we push to transifex (post queue).12:20
AJaeger_Once a day we push from transifex a proposal change to your repo - but only if there are new translations for it.12:20
AJaeger_So, you might go several months without any - the translation team is prioritiazing on a few projects (mainly horizon and manuals).12:20
*** ctlaugh has joined #openstack-infra12:20
* AJaeger_ keeps an eye currently on these jobs to see that they do the right thing ;)12:21
openstackgerritYuiko Takada proposed openstack-infra/project-config: Add translation job for Ironic-inspector  https://review.openstack.org/19409512:21
AJaeger_yuikotakada: your patch looks fine!12:22
*** sshnaidm has joined #openstack-infra12:22
yuikotakadaAJaeger_, Thank you for your kindness. You helped me.12:22
AJaeger_yuikotakada: you're welcome!12:23
*** dangers_away has joined #openstack-infra12:23
*** chlong has joined #openstack-infra12:25
*** chlong has quit IRC12:28
*** mestery has joined #openstack-infra12:29
openstackgerritThierry Carrez proposed openstack-infra/infra-specs: Add CustomFields exploration to Maniphest spec  https://review.openstack.org/19411912:31
*** chlong has joined #openstack-infra12:31
*** coreycb` is now known as coreycb12:32
*** aysyanne has joined #openstack-infra12:33
*** mwagner_afk has joined #openstack-infra12:33
*** rfolco has joined #openstack-infra12:36
*** alexpilotti has joined #openstack-infra12:37
*** ddieterly has joined #openstack-infra12:38
*** sshnaidm has quit IRC12:39
*** shardy has quit IRC12:39
*** shardy has joined #openstack-infra12:39
openstackgerritSam Betts proposed openstack-infra/project-config: Add project for python Neutron PD driver  https://review.openstack.org/19412312:40
*** sshnaidm has joined #openstack-infra12:40
*** yamamoto has quit IRC12:42
*** ddieterly has quit IRC12:43
*** sshnaidm has quit IRC12:45
*** sshnaidm has joined #openstack-infra12:45
*** Longgeek has quit IRC12:47
*** mrunge has quit IRC12:49
*** spzala has joined #openstack-infra12:52
*** marcusvrn has quit IRC12:52
*** bradjones has quit IRC12:52
*** leifmadsen has joined #openstack-infra12:54
*** baoli has joined #openstack-infra12:54
*** shardy has quit IRC12:54
*** bradjones has joined #openstack-infra12:54
*** bradjones has quit IRC12:54
*** bradjones has joined #openstack-infra12:54
*** leifmadsen has joined #openstack-infra12:54
openstackgerritVictor Stinner proposed openstack-infra/project-config: Make gate-nova-python34 voting  https://review.openstack.org/19412812:54
*** russellb has joined #openstack-infra12:54
*** gordc has joined #openstack-infra12:56
*** shardy has joined #openstack-infra12:56
*** Zhongjun has joined #openstack-infra12:56
*** hrubi has joined #openstack-infra12:56
*** yamamoto has joined #openstack-infra12:56
*** radez_g0n3 is now known as radez12:57
*** flepied1 has joined #openstack-infra12:57
*** e0ne is now known as e0ne_12:58
*** chlong has quit IRC12:58
*** otter768 has joined #openstack-infra12:59
*** e0ne_ is now known as e0ne12:59
*** yamamoto has quit IRC12:59
*** flepied has quit IRC12:59
mtreinishfungi, flip214: the only jobs that get captured by subunit2sql are jobs in the gate queue that match the regex 'gate-(tempest|grenade)-dsvm.*': http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/logstash/jenkins-log-client.yaml#n1413:00
mtreinishI'm not sure which jobs you were looking at the other day, so I'm not sure that will hit it13:00
*** woodster_ has joined #openstack-infra13:01
*** chlong has joined #openstack-infra13:02
fungimtreinish: custom tempest job exercising the drbd driver for cinder13:02
*** abregman has quit IRC13:02
fungiflwang1: are you still having duplicate account issues, or did SergeyLukjanov's efforts eventually solve them?13:03
mtreinishoh ok, then yeah that isn't going to have data in the subunit2sql db13:03
mtreinishfungi: while I've got your attention nothing has been captured in the subunit2sql db since the 4th, I think we might need to kick something13:04
*** yfried__ is now known as yfried|afk13:05
*** bswartz has joined #openstack-infra13:05
fungimtreinish: possibly so... no indication that it's run out of disk at least? if not, then maybe we've got a problem with the daemon on logstash.o.o13:06
*** sshnaidm has quit IRC13:06
*** yfried|afk is now known as yfried__13:06
*** rlandy has joined #openstack-infra13:06
mtreinishfungi: my guess is something is up with subunit worker13:06
mtreinishI couple weeks ago I thought it was the gearman server on logstash.o.o because it looked like logstash was flailing too, but that seems to be sorted now13:07
fungioh, right, it's a separate server13:07
fungii keep forgetting13:07
*** sshnaidm has joined #openstack-infra13:07
fungithe service wasn't running on it13:07
mtreinishheh, yeah it's a little one sitting out there. It's easy to forget13:08
mtreinishhah, ok well that would explain it :)13:08
*** chlong has quit IRC13:08
*** chlong has joined #openstack-infra13:08
fungiserver uptime is nearly 40 days, so it wasn't a reboot13:08
fungilogrotate only has a week's worth of system logs though13:09
*** marcusvrn has joined #openstack-infra13:09
mordredfungi: we spin up ssd volumes in rax, right?13:09
mtreinishhmm, oh well I would have liked to diagnose why it died, but I guess we can wait until next time..13:09
mordredfungi: doesn't that imply we shoud be able to run cinder type-list to discover that's a possibility?13:09
fungimtreinish: no oom mentioned in dmesg (last kernel message was from the day it booted)13:10
fungimordred: yeah, we have at least one ssd volume that i know of (attached to nodepool.o.o)13:10
*** dkranz has quit IRC13:10
fungimordred: i don't recall if i tried cinder type-list on rax though13:11
*** dustins has joined #openstack-infra13:11
mordredah - ok - something was hanging for me locally- it works if I run it from puppetmaster with our account13:11
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Take parameter order from yaml in trigger_parameterized_builds  https://review.openstack.org/19366013:11
mtreinishfungi: yeah I checked cacti when I noticed it was having issues and I didn't see a spike in mem usage, I'm thinking it was a functional failure13:12
fungimtreinish: oh, you're in luck. we do have older subunit worker logs13:12
mtreinishoh cool13:12
fungisince it's logging to its own debug log file13:12
*** rguillebert has joined #openstack-infra13:12
fungimtreinish: at 2015-06-04 04:47:45,808 it threw an exception connecting to the trove instance13:13
*** coolsvap is now known as coolsvap|away13:13
fungimtreinish: i'll paste up the traceback for you in moments13:13
mtreinishhmm, that corresponds to the the rough date of last item in the db before you restarted it13:14
*** erlon has joined #openstack-infra13:15
*** jaypipes has joined #openstack-infra13:15
openstackgerritThanh Ha proposed openstack-infra/nodepool: Add MySQL DB creation example  https://review.openstack.org/17069913:15
*** tlian has joined #openstack-infra13:15
mtreinishbut, I'm surprised that killed it because it doesn't persist a connection, it just establishes a new one on each event, (or at least that's what I thought it did) and I didn't think the worker would exit on an unhandled exception just log it13:15
*** Longgeek has joined #openstack-infra13:16
*** ari has joined #openstack-infra13:16
*** chlong has quit IRC13:17
*** hodos has joined #openstack-infra13:17
fungimtreinish: http://paste.openstack.org/show/31359013:17
*** AzherKhan has joined #openstack-infra13:18
fungithat's the end of the log before it went silent13:18
*** pbourke has quit IRC13:19
*** pbourke has joined #openstack-infra13:19
openstackgerritThanh Ha proposed openstack-infra/nodepool: Add prerequisites for nodepool on RHEL7  https://review.openstack.org/17070013:20
*** yfried__ has quit IRC13:20
*** yfried__ has joined #openstack-infra13:20
*** 1JTAAA236 is now known as cloudnull13:22
sdaguefungi: did gerrit just fall over?13:22
*** _nadya_ has quit IRC13:22
mtreinishfungi: oh, looking at the code it looks like the server will raise an exception after logging it. The retriever just logs and moves on: http://git.openstack.org/cgit/openstack-infra/puppet-subunit2sql/tree/files/subunit-gearman-worker.py#n24213:22
KiallLooks lilke review.openstack.org is down? (doublee checked with http://downforeveryoneorjustme.com/review.openstack.org  )13:22
*** shardy has quit IRC13:22
mtreinisherr that link is it raising causing it to be fatal13:22
*** shardy has joined #openstack-infra13:22
*** shardy has quit IRC13:22
*** shardy has joined #openstack-infra13:22
*** _nadya_ has joined #openstack-infra13:22
*** federico3 has joined #openstack-infra13:22
mordredthingee: morning! I have found a bug, and I'm not sure if it's in rackspace or in python-cinderclient13:22
mtreinishI was thinking of this bit in the code: http://git.openstack.org/cgit/openstack-infra/puppet-subunit2sql/tree/files/subunit-gearman-worker.py#n66 which is not where the failure was being triggered13:22
*** dkranz has joined #openstack-infra13:23
mtreinishso that explains why the connection fault was fatal I guess13:23
*** marekd has joined #openstack-infra13:23
*** pradk_ is now known as prad13:24
lennybIs something wrong with gerrit? I cant connect to review.openstack.org13:24
marekd^^ ++13:24
HenryG^^ same here13:24
dtantsur++13:24
mtreinishI guess maybe I should drop that raise, or come up with a better solution to handle connection faults for the worker13:24
*** baoli has quit IRC13:24
mordredfungi: fyi - do not update teh cinder-venv on puppetmaster13:26
Kialllooks like Gerrit is back now13:26
*** baoli_ has joined #openstack-infra13:26
mordredfungi: 1.1.1 of cinderclient works - 1.2.x does not13:26
mordredthingee: ^^13:26
*** cburroughs has joined #openstack-infra13:26
mordredthingee: version 1.2 of cinderclient hangs when trying to use it against either HP or Rackspace public clouds - in looking at the debug logging, it looks like it's trying to do version autonegotiation (thank you!) but it is getting incorrect urls13:27
*** _nadya_ has quit IRC13:27
mordredthingee: I'll also go mention this in cinder channel ... but thought I'd brainvomit here13:27
*** fhubik is now known as fhubik_afk13:27
*** ilyashakhat has joined #openstack-infra13:30
*** chlong has joined #openstack-infra13:30
*** mestery has quit IRC13:30
*** mrmartin has joined #openstack-infra13:30
dtantsurgerrit is back for me13:31
*** peristeri has joined #openstack-infra13:32
*** zz_jgrimm_ is now known as jgrimm13:35
openstackgerritJens Rosenboom proposed openstack-infra/system-config: Change doc link to the parsed version for gerrit  https://review.openstack.org/19172413:35
*** jroll has quit IRC13:36
*** jroll has joined #openstack-infra13:36
*** puranamr has joined #openstack-infra13:38
*** otter768 has quit IRC13:39
*** marekd has left #openstack-infra13:39
*** AzherKhan has quit IRC13:39
*** AzherKhan has joined #openstack-infra13:39
openstackgerritSam Betts proposed openstack-infra/project-config: Add project for python Neutron PD driver  https://review.openstack.org/19412313:39
*** ayoung has joined #openstack-infra13:41
*** jogo has joined #openstack-infra13:41
dtantsurfolks, could you please review https://review.openstack.org/#/c/193941/ which needs 2nd +2? Having the first proper check job is our long-term dream, please help it fulfil :)13:41
*** pabelanger_ is now known as pabelanger13:42
*** jasondotstar has joined #openstack-infra13:42
*** jasondotstar has quit IRC13:42
openstackgerritMonty Taylor proposed openstack-infra/shade: Pin cinderclient  https://review.openstack.org/19413813:43
*** flepied1 has quit IRC13:43
*** peristeri has quit IRC13:43
*** sshnaidm has quit IRC13:43
*** jasondotstar has joined #openstack-infra13:43
*** peristeri has joined #openstack-infra13:44
openstackgerritMonty Taylor proposed openstack-infra/shade: Pin cinderclient  https://review.openstack.org/19413813:44
*** sshnaidm has joined #openstack-infra13:44
*** sshnaidm has quit IRC13:44
*** sshnaidm has joined #openstack-infra13:44
*** jasondotstar has quit IRC13:44
mordredShrews, SpamapS: ^^ not urgent, nothing in production is using cinder at the moment - but cinderclient 1.2 is definitely broken from shade's pov13:44
openstackgerritMerged openstack-infra/grafyaml: Drop support for py26 and py33  https://review.openstack.org/18934813:45
openstackgerritAndrey Pavlov proposed openstack/requirements: Add botocore to requirements  https://review.openstack.org/17233513:45
*** jasondotstar has joined #openstack-infra13:46
*** zigo has quit IRC13:47
*** jogo has quit IRC13:47
*** yamamoto has joined #openstack-infra13:49
*** AJaeger_ is now known as AJaeger13:50
*** mpavone has joined #openstack-infra13:50
*** smcginni1 is now known as smcginnis13:51
*** r-daneel has joined #openstack-infra13:52
openstackgerritMatthew Treinish proposed openstack-infra/puppet-subunit2sql: Make unhandled exceptions not fatal  https://review.openstack.org/19414613:53
mtreinishfungi: ^^^ not sure that's really a good idea13:54
mtreinishmy other idea was to handle db connection faults in the worker and retry a couple of times before moving on13:54
mtreinishwhich would cover the specific fault we hit here13:55
*** mpaolino has quit IRC13:56
*** tvanderwiel has joined #openstack-infra13:56
*** e0ne is now known as e0ne_13:57
*** e0ne_ is now known as e0ne13:57
*** flepied has joined #openstack-infra13:57
*** bdemers has joined #openstack-infra13:58
*** yolanda has quit IRC13:59
fungisdague: Kiall: lennyb: HenryG: dtantsur: i don't see any indication that the gerrit server nor service restarted. i wonder if there are network issues13:59
*** yolanda has joined #openstack-infra13:59
funginothing of note on status.rackspace.com though13:59
dtantsurfungi, hmm maybe. also note that submitting new patches seemed to work13:59
dtantsurbut neither web UI not gertty did14:00
sdaguefungi: yeh, I don't know14:00
*** mpaolino has joined #openstack-infra14:00
fungiseeing some interesting spikes for outbound traffic on review.o.o http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=45&rra_id=all14:00
sdaguebut it was definitely out for a while14:00
fungithat last spike coule be related14:01
*** nelsnelson has joined #openstack-infra14:01
fungiat least on the 5-minute average, that peak is nowhere near the max bandwidth for a 30g performance flavor in rax though14:02
*** jasondotstar has quit IRC14:02
*** amitgandhinz has joined #openstack-infra14:02
*** stevemar has joined #openstack-infra14:04
*** zigo has joined #openstack-infra14:05
*** mrmartin has quit IRC14:05
*** claudiub has quit IRC14:05
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Update 'timeout' wrapper module  https://review.openstack.org/12946714:05
*** ParsectiX has quit IRC14:07
*** shardy has quit IRC14:07
*** shardy has joined #openstack-infra14:07
*** fallenpegasus has joined #openstack-infra14:07
*** flepied has quit IRC14:08
*** eharney has joined #openstack-infra14:08
*** nihilifer has quit IRC14:09
*** ajmiller has joined #openstack-infra14:09
*** BharatK has quit IRC14:09
openstackgerritSam Betts proposed openstack-infra/project-config: Add project for python Neutron PD driver  https://review.openstack.org/19412314:10
*** jbernard has joined #openstack-infra14:10
*** yamamoto has quit IRC14:11
*** mriedem1 is now known as mriedem_afk14:12
*** sigmavirus24_awa is now known as sigmavirus2414:12
*** beekneemech is now known as bnemec14:13
*** amitgandhinz has quit IRC14:15
*** puranamr has quit IRC14:15
*** yfried__ has quit IRC14:17
*** flepied has joined #openstack-infra14:17
*** _nadya_ has joined #openstack-infra14:22
*** ameade_ is now known as ameade14:23
mordreddguerri: I have a different idea for your neutron exceptions patch ...14:23
dguerrisure14:23
dguerrigo ahead14:23
*** bdemers has quit IRC14:24
dguerrimordred: do you mean to test it?14:24
*** ddieterly has joined #openstack-infra14:24
*** AzherKhan has quit IRC14:25
*** doug-fish has joined #openstack-infra14:25
samueldmqmordred: hi, morning14:26
*** dboik has joined #openstack-infra14:27
samueldmqmordred: based on the comment from SpamapS on change #19044214:27
samueldmqmordred: I am understanding shade still need to add functional tests, right ?14:27
jeblairi restarted paste because it was extremely slow14:29
*** sshnaidm has quit IRC14:31
openstackgerritSerg Melikyan proposed openstack-infra/project-config: Move puppet-murano from stackforge to openstack  https://review.openstack.org/19273014:32
mordredsamueldmq: well, shade has functional tests- we need to add functional tests for that functionality14:32
*** sshnaidm has joined #openstack-infra14:33
*** Guest78977 has joined #openstack-infra14:33
openstackgerritMonty Taylor proposed openstack-infra/shade: Fix intermittent error in unit tests  https://review.openstack.org/19383914:33
mordreddguerri: that ^^14:33
mordreddguerri: I don't think the mock_me method is needed14:33
samueldmqmordred: k got it, I need to take a look at the functional tests in there, before saying anything else ;)14:34
samueldmqmordred: thanks14:34
openstackgerritJan Klare proposed openstack-infra/project-config: WIP: add periodic chef-rake-integration job for openstack-chef-repo  https://review.openstack.org/19416414:34
*** yamamoto has joined #openstack-infra14:35
*** ociuhandu has joined #openstack-infra14:35
mordredsamueldmq: thank you!14:36
mordredShrews: ^^ https://review.openstack.org/193839 hopefully simpler14:36
*** baoli_ has quit IRC14:36
Shrewsmordred: great. but the methods should be moved to TestShade14:37
dguerrimordred: Shrews ++14:37
Shrewsmordred: as there is nothing operator specific about these14:38
dguerriShrews: correct. also commit message is now nonsense14:38
mordredShrews: ++14:38
dguerrimordred: I am going to fix that14:38
mordreddguerri: awesome14:38
dguerrithanks14:38
*** baoli has joined #openstack-infra14:38
*** marzif_ has quit IRC14:39
openstackgerritMarek Denis proposed openstack-infra/project-config: Rename keystoneclient-saml2 to keystoneauth-saml2  https://review.openstack.org/19063114:39
*** marzif_ has joined #openstack-infra14:39
sdaguefungi: so, I'm noticing that grenade logs are truncated - http://logs.openstack.org/33/194133/1/check/check-grenade-dsvm/abb04b5/logs/grenade.sh.txt.gz14:40
sdagueany ideas about that?14:41
*** sergmelikyan has joined #openstack-infra14:41
*** shardy has quit IRC14:41
*** shardy has joined #openstack-infra14:42
*** sergmelikyan has quit IRC14:42
*** k4n0 has quit IRC14:42
*** asselin has joined #openstack-infra14:42
fungisdague: all the ones you've looked at recently, or only some?14:43
*** Longgeek has quit IRC14:43
*** sergmelikyan has joined #openstack-infra14:43
*** marcusvrn_ has joined #openstack-infra14:43
sdaguefungi: so... honestly, I'm now wondering if we just lost an end marker14:43
sdaguemaybe a false alarm, let me look further14:44
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Re-run tox -egenconfig to fix oslo.config bug  https://review.openstack.org/19416914:44
*** sshnaidm has quit IRC14:44
*** EricGonczer_ has joined #openstack-infra14:44
*** ddieterly has quit IRC14:46
*** sergmelikyan has quit IRC14:47
*** sshnaidm has joined #openstack-infra14:47
jeblairfungi, mordred: https://review.openstack.org/193837 and https://review.openstack.org/193838 would let me enable puppet on git.o.o (and potentially delete git-fe* if/when we are comfortable with that)14:47
*** ddieterly has joined #openstack-infra14:47
*** claudiub has joined #openstack-infra14:48
*** Hal has joined #openstack-infra14:48
jeblairpabelanger: why does grafana use olso.config and oslo.log?14:48
*** shardy has quit IRC14:49
*** shardy has joined #openstack-infra14:49
*** shardy has quit IRC14:49
*** shardy has joined #openstack-infra14:49
*** Hal is now known as Guest9584814:49
pabelangerjeblair, no special reason.  Mostly for me to learn more about the libraries14:49
*** Guest54516 has quit IRC14:49
*** jlvillal has joined #openstack-infra14:49
openstackgerritDavide Guerri proposed openstack-infra/shade: Fix intermittent error in unit tests  https://review.openstack.org/19383914:50
openstackgerritDavide Guerri proposed openstack-infra/shade: Move TestShadeOperator in a separate file  https://review.openstack.org/19417214:50
dguerriShrews: ^14:50
*** redrobot has joined #openstack-infra14:51
*** redrobot is now known as Guest4440514:51
*** jlvillal has quit IRC14:51
fungijeblair: i assume you saw jhesketh's analysis over the weekend of continued disconnects even with the bare metal redirector?14:51
*** tonytan4ever has joined #openstack-infra14:52
*** fhubik_afk is now known as fhubik14:52
*** jlvillal has joined #openstack-infra14:52
*** sdake_ has quit IRC14:52
jeblairpabelanger: do you think we could remove them?  we actually tend to avoid the oslo libraries in infra for a few reasons -- first, so that we don't break our own infrastructure when oslo is broken (and therefore break our ability to fix it), and second because many of the oslo patterns work and are needed for openstack, but are not needed for our software (and may make it unecessarily complex; eg global config object in oslo.config)14:52
*** Guest44405 is now known as redrobot14:53
*** Guest78977 has quit IRC14:53
jeblairfungi: i did not (also, it's not actually bare metal, it's a compute-flavor vm)14:53
*** hdd has joined #openstack-infra14:54
jeblairfungi: can you help point me? i don't see it in scrollback14:54
*** Guest95848 has quit IRC14:55
pabelangerjeblair, I don't see a reason why not.  If it is going to cause issues, then it should be removed14:55
*** jonaspf has quit IRC14:55
*** marzif has quit IRC14:55
*** mfmcdonagh has quit IRC14:55
*** mcdonagm__ has quit IRC14:55
jeblairpabelanger: cool, i was hoping we weren't depending on them too much at this point14:56
*** pelix has quit IRC14:56
*** julim has joined #openstack-infra14:58
fungijeblair: finding now14:58
Kiallfungi: Looks like gerrit is down again? It pings, but doesn't load up the UI14:58
jroll+1 :(14:58
krotscheckWhat Kiall said14:58
fungii wonder if we're getting (accidentally?) dos'd by someone14:59
mordredthe box itself is bored14:59
*** patrickeast has joined #openstack-infra15:00
*** yamahata has joined #openstack-infra15:00
mordredbut I agree, the web ui is sad panda15:00
lennybis gerrit down again ???15:00
mordredlennyb: we're looking in to it15:00
lennybthanks.15:00
*** jcoufal has joined #openstack-infra15:01
*** wendar_ is now known as wendar15:01
funginothing current in /var/log/apache2/gerrit-ssl-error.log15:02
*** enikanorov2 has quit IRC15:02
*** bdemers has joined #openstack-infra15:02
fungithough there's a bug in update_bug.py15:03
mordredwe shoudl update it15:03
fungijeepyb/cmd/update_bug.py", line 229, in process_bugtask15:03
fungiUnboundLocalError: local variable 'series' referenced before assignment15:03
mordredthat does seem like a bug15:04
fungii suspect that's from a recent patch15:04
*** vinay_yadhav has joined #openstack-infra15:05
*** jpeeler has joined #openstack-infra15:05
*** mtanino has joined #openstack-infra15:05
*** vinay_yadhav has quit IRC15:06
*** davideagnello has joined #openstack-infra15:07
fungiin the gerrit service error_log i'm seeing "WARN  net.bull.javamelody : heaphisto report failed java.lang.IllegalStateException: Memory histogram not supported because the server uses the JRE and not the JDK."15:07
*** mjturek1 has joined #openstack-infra15:07
fungithough perhaps that's one of us trying to use javamelody right now?15:07
openstackgerritJan Klare proposed openstack-infra/project-config: move 'gate-{name}-chef-rake-integration' job from experimental to non-voting in check and gate queue  https://review.openstack.org/19418115:07
fungialso seeing org.apache.mina.core.write.WriteTimeoutException15:08
AJaegerjklare: reading the title of your patch above ^: Don't put a non-voting job in the gate queue15:08
jklareAJaeger ok, ty15:09
*** Longgeek has joined #openstack-infra15:10
openstackgerritJan Klare proposed openstack-infra/project-config: move 'gate-{name}-chef-rake-integration' job  https://review.openstack.org/19418115:11
*** _nadya__ has joined #openstack-infra15:12
jeblair"GET /%23/c/101002/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/gerrit_ui/static/title.png?e=d8e0442e7fabdf96d570b41918974ab2 HTTP/1.1"15:13
fungiyikes15:13
*** sergmelikyan has joined #openstack-infra15:13
fungithat looks like a path exploit attempt of some kind15:13
*** rguillebert has quit IRC15:13
*** rguillebert_ has joined #openstack-infra15:13
*** puranamr has joined #openstack-infra15:14
fungilots of those. they're getting proxied through, so no entry in the error log15:15
jeblairfungi: otoh, it's sequential requests that just keep getting longer15:15
*** _nadya_ has quit IRC15:15
*** dannywilson has joined #openstack-infra15:15
fungiahh, we've got something appending a redirect url?15:15
*** Ala has quit IRC15:15
fungidoesn't look like it's a redirect in apache doing it...15:16
*** wznoinsk1 is now known as wznoinsk15:17
fungiit's all from 2001:420:c0c8:1008::15215:17
*** naggappan has quit IRC15:17
*** dannywil_ has joined #openstack-infra15:17
fungiaddress is in cisco according to arin'15:17
*** dannywilson has quit IRC15:18
*** yuikotakada has quit IRC15:18
jeblairfungi: i think i just reproduced that locally by visiting https://review.openstack.org/%23/c/101002/15:18
*** agentle has joined #openstack-infra15:19
fungiwith safari or $randombrowser?15:19
* fungi doubts you have any platform that could run safari15:19
jeblairff15:20
fungioh yeah that page is toast even in iceweasel15:20
jeblairit's the %2315:20
fungigrr15:20
mordredyay!15:20
fungiyeah i can load it with a literal #15:20
*** Longgeek has quit IRC15:20
jeblairi doubt this is related to the outages; it could be, but i didn't see this happening a lot during them.15:21
fungii'm having little luck finding a gerrit bug report about that15:21
fungihowever we could mitigate this particular url with an explicit rewrite in apache15:22
*** spy2 is now known as antonym15:22
jeblairas for the outages -- all of the stats on the machine dropped (cpu, load, io, network) simultaneously.  it might be network issues, or the jvm gc.15:23
*** afazekas has quit IRC15:23
*** antonym is now known as spy15:23
*** spy is now known as antonym15:23
fungiwe saw some fairly large traffic spikes earlier, one of which seemed to correlate to an outage, but the peaks around this last one aren't nearly as large15:24
jeblairit looks like the most recent spike was 30 mins before this outage15:24
*** jasondotstar has joined #openstack-infra15:25
fungialso the redirect loop looks like it was only from 15:12-15:20 utc, so wouldn't account for prior impact15:26
mordredjeblair: if it was the jvm gc, I'd expect cpu to spike15:27
fungii don't find any patterns matching gerrit_ui/gerrit_ui/gerrit_ui outside that timeframe15:27
mordredor at least not drop15:27
jeblairmordred: true15:27
mordredso that makes me unscientifically want to go with 'network issues'15:27
*** sshnaidm has quit IRC15:28
*** pelix has joined #openstack-infra15:29
*** sshnaidm has joined #openstack-infra15:30
fungithe interesting thing is that it seems to impact https access but not ssh access15:30
fungiperhaps it's qos/dscp related?15:31
*** devvesa has quit IRC15:31
*** hodos has quit IRC15:31
*** hashar is now known as hasharAway15:32
*** pbourke has quit IRC15:32
*** sergmelikyan has quit IRC15:33
*** arxcruz has quit IRC15:33
openstackgerritDaneyon Hansen proposed openstack-infra/irc-meetings: Add meeting for Magnum Networking Subgroup  https://review.openstack.org/19369415:34
*** jasondotstar has quit IRC15:35
*** Guest81202 is now known as mgagne15:36
*** mgagne has joined #openstack-infra15:36
*** agentle has quit IRC15:39
*** linkedinyou has quit IRC15:39
*** jasondotstar has joined #openstack-infra15:39
*** otter768 has joined #openstack-infra15:39
pelixwaynr: found the cause of the ordering issue, it's in the deep_format function, instead of using the original type, we create new lists or dicts when we should use the original object to create the new instance.15:40
*** puranamr has quit IRC15:40
*** Sukhdev has joined #openstack-infra15:40
*** agentle has joined #openstack-infra15:40
openstackgerritMerged openstack-infra/shade: Fix intermittent error in unit tests  https://review.openstack.org/19383915:40
fungijeblair: back on the prior topic, http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2015-06-21.log.html#t2015-06-21T03:09:4515:41
openstackgerritMerged openstack-infra/shade: Move TestShadeOperator in a separate file  https://review.openstack.org/19417215:41
*** marzif_ has quit IRC15:41
jeblairfungi: oh, yeah, i expect "cloning at scale" to fail15:41
*** amitgandhinz has joined #openstack-infra15:41
*** marzif_ has joined #openstack-infra15:41
fungii'm mostly curious if the spikes for git-related bugs on http://status.openstack.org//elastic-recheck/ will mostly subside15:42
*** yfried__ has joined #openstack-infra15:42
fungiand whether image builds get more stable15:42
fungiespecially the remaining snapshot builds where we continue re-cloning everything, and are doing many in parallel15:43
*** bexelbie has quit IRC15:43
jeblairwe've tuned very little so far: we have switched to leastconn, and increased the timeout.  leastconn means we're utilizing the backends more efficiently, which means we should see a small increase in the amount of simultaneous clones.  increasing the timeout means that if there is a rush and it takes a bit longer to serve a clone request, a few more of those can be serviced.15:43
*** shardy has quit IRC15:44
*** _nadya__ has quit IRC15:44
jeblairi think we need to characterize the load better before we can tune further...15:44
russellbso, when i try to load this change (which was my patch and is still listed in my dashboard) it says it doesn't exist or i don't have permission to see it ... https://review.openstack.org/#/c/186894/15:44
russellbanyone a gerrit admin and can take a look at the state?15:44
*** otter768 has quit IRC15:45
*** _nadya_ has joined #openstack-infra15:45
*** harlowja_at_home has joined #openstack-infra15:45
fungirussellb: weird. i can see it fine15:45
russellbfungi: someone else didn't update as a draft or something right?15:45
krotscheckDid we just ditch chromium because of the unsolicited binary thing?15:45
openstackgerrityolanda.robla proposed openstack-infra/nodepool: Update nodepool to use nodepool.conf file  https://review.openstack.org/18976215:45
*** puranamr has joined #openstack-infra15:45
jeblairwe could limit the simultaneous number of connections to a backend to the number of nova clones it can handle (about 8), but we can handle a lot more simultaneous clones of other repositories15:46
fungirussellb: nope. i see arosen approved it 10 days ago but it depends-on 190325 which was approved after15:46
waynrpelix: i suspected it was something like that15:46
russellbfungi: weird.15:46
russellbfungi: it lets me view it logged out, but blocks me when i log back in, heh15:47
*** cody-somerville has quit IRC15:47
fungithat's really odd. checking the logs now15:47
*** bexelbie_ has quit IRC15:48
waynrpelix: i'm also worried that the new test case you added still doesn't cover my usage because I see a lack of ordering even when using python 2.7 whereas your new test case passes for python 2.715:48
*** Longgeek has joined #openstack-infra15:48
jeblairfungi: jhesketh ^ i think we should see how the system is performing under real load, and at this point, add git backends until it does what we want.  i also think we should collect stats from haproxy so we can see number of simultaneous backend connections over time, and other info.15:49
*** puranamr has quit IRC15:49
*** cody-somerville has joined #openstack-infra15:49
*** cody-somerville has quit IRC15:49
*** cody-somerville has joined #openstack-infra15:49
*** puranamr has joined #openstack-infra15:49
pelixwaynr: underlying reason for that is because of PYTHONHASHSEED=0, it's a bit tricky to ensure out of order behaviour, but in fixing the problem in deep_format, I was able to confirm that the OrderedDict object is always passed down correctly15:50
*** _nadya_ has quit IRC15:50
*** shardy has joined #openstack-infra15:50
waynri think there are edge cases in the YamlParser's expandYaml method that your test case doesn't touch but my usage does, specifically "trigger_parameterized_{version}" isn't used in a job group15:50
waynrhttps://git.openstack.org/cgit/openstack-infra/jenkins-job-builder/tree/jenkins_jobs/parser.py#n21715:50
jeblairkrotscheck: i don't understand your question15:50
waynrshould probably be using OrderedDict there also...I think?15:51
*** claudiub has quit IRC15:51
pelixI don't think job-groups would trigger it, since that only affects the toplevel order of the params being passed into the template which isn't important15:51
waynrthere's also this https://git.openstack.org/cgit/openstack-infra/jenkins-job-builder/tree/jenkins_jobs/parser.py#n14115:51
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Convert ironicclient node.get() call to Task  https://review.openstack.org/19353515:52
krotscheckjeblair: Chromium recently got flak for including the download of an unsolicited, opaque binary from google (To support Ok Google speech recognition). I'm wondering if we, in particular, did something to disable chromium on our jenkins nodes as a result of that, because I just had a test run fail to capture it.15:52
waynrthe new test doesn't really exercise the use of defaults either15:52
*** ildikov has quit IRC15:53
fungirussellb: i'm not finding any errors in the logs related to 18689415:53
openstackgerritDavide Guerri proposed openstack-infra/shade: Add Neutron/Nova Floating IP delete (de-allocate from project)  https://review.openstack.org/18363715:53
openstackgerritDavide Guerri proposed openstack-infra/shade: Add Neutron/Nova Floating IP create (i.e. allocate to project)  https://review.openstack.org/18355515:53
russellbfungi: oh well, i asked someone else to re-approve, and i'll just keep working with new changes :)15:53
waynrpelix: i'm reluctant to make statements about the importance or lack of importance of anything touched by YamlParser given that it's essentially a huge glob of spaghetti code15:53
*** cinerama` is now known as cinerama15:53
pelixwaynr: the apply defaults would affect the order you iterate over the scm, publishers, builders top level entries, but since they are unique it's not an issue, the problem is the order under each of those.15:53
krotscheckjeblair: Apparently not, because a recheck cleared it.15:53
russellbfungi: will let you know if something similar comes up again15:53
fungirussellb: i wonder if you have some weird state cached for that page? tried clearing your browser cache or restarting your browser?15:54
pelixstill using OrderedDict would probably be better in all places15:54
*** baoli has quit IRC15:54
russellbfungi: i tried clearing the cache, i'll restart browser now though15:54
waynrpelix: i'm really just tired of dealing with YamlParser and trying to prevent my jenkins jobs from being affected by changes to it, all i care about right now is fixing the API so I can circumvent the YamlParser entirely15:54
russellbfungi: another cache clear fixed it, *glare*15:54
russellbfungi: oh well sorry to bug you :)15:55
pelixthat wouldn't fix this for you15:55
mordredkrotscheck: well, glad tests are broken - I would like to glare at google real quick. otoh, I betcha that the debian packagers of chromium patched that 'feature' out15:55
openstackgerritSpencer Krum proposed openstack-infra/puppet-iptables: Support side-loading iptables rules  https://review.openstack.org/19384715:55
pelixunless you decided to bypass all the expansion capabilities as well15:55
fungikrotscheck: as someone who closely followed that explosion of concern over recent chromium behavior, that seems like an odd conclusion to jump to. we don't explicitly deny any browsers access to our systems15:55
openstackgerritDavide Guerri proposed openstack-infra/shade: Add Neutron/Nova Floating IP delete (i.e. deallocate from project)  https://review.openstack.org/18363715:55
waynrpelix: it would allow me to start defining jobs using pure Python and pass the resulting dictionaries directly to the upcoming XmlBuilder class15:55
krotscheckfungi: I was under the impression that we're allergic to code that we can't verify.15:56
pelixwaynr: problem is this line https://git.openstack.org/cgit/openstack-infra/jenkins-job-builder/tree/jenkins_jobs/formatter.py#n52, it should use the original type of obj instead of defining ret as a {}15:56
mordredfungi: I believe he's talking about the tests that spin up copies of browsers to run against web things15:56
waynrso correct I will be avoiding all of JJB's expansion features15:56
krotscheckfungi: Hence my paranoia.15:56
*** hodos has joined #openstack-infra15:56
nibalizermordred: clarkb first draft of concat-based iptables module refactor https://review.openstack.org/#/c/193847/315:56
mordredfungi: not us denying a human running a browser access to our system15:56
*** claudiub has joined #openstack-infra15:56
fungikrotscheck: i can't verify anything running on your machine. i'm not going to block access from your system on those grounds ;)15:56
mordrednibalizer: wow. there's chunks of code there - I'm going to have to properly read that15:56
mordredfungi: sure. but we might uninstall chromium from our test servers15:57
nibalizermordred: i reccomend you start at the readme15:57
pelixwaynr: fix was 'ret = type(obj)()'15:57
fungioh, chromium running inside a job15:57
mordredfungi: yes15:57
krotscheckfungi: I'm referring to this: http://logs.openstack.org/66/192366/3/gate/gate-merlin-npm-run-test-unit/752c631/console.html#_2015-06-22_14_36_19_42115:57
*** shardy has quit IRC15:57
openstackgerritFatih Degirmenci proposed openstack-infra/jenkins-job-builder: Add Disable Failed Job Plugin support  https://review.openstack.org/19272015:57
fungikrotscheck: thanks. i thought you meant you were running chromium and couldn't view something we're hosting. now i understand15:57
waynrpelix: that makes sense, hopefully the fix works for my configs :) i'll test it out15:57
krotscheckfungi: Wait... I'm supposed to USE these browsers instead of just testing with them?15:58
krotscheckThat's crazypants.15:58
*** ihrachyshka has quit IRC15:58
fungithis morning has been full of people failing to reach things we host, so tunnel vision on my part15:58
*** sarob has joined #openstack-infra15:58
*** afazekas has joined #openstack-infra15:58
pelixI'm tempted to include it in the existing JJB, cause otherwise JJB behviour for users on python 3+ is inconsistent and will randomly change the order of the outputted XML, though concerned it may break other users on python 2.715:59
*** bdemers has quit IRC15:59
*** jasondotstar has quit IRC15:59
*** jasondotstar has joined #openstack-infra16:00
*** salv-orl_ has joined #openstack-infra16:00
mordredkrotscheck: all pants are crazypants16:01
*** bdemers has joined #openstack-infra16:02
*** jasondotstar has quit IRC16:02
krotscheckmordred: Have I ever told you what Meredith said to me the first time she saw me off playa? "I didn't recognize you because you were wearing pants".16:02
waynrpelix: i just tried the deep_format fix locally and it fixes the py34 failure but not the failure I am seeing in my test configs16:02
mordredkrotscheck: nice16:02
*** shardy has joined #openstack-infra16:02
openstackgerrityolanda.robla proposed openstack-infra/nodepool: Update nodepool to use nodepool.conf file  https://review.openstack.org/18976216:03
*** salv-orlando has quit IRC16:03
*** jasondotstar has joined #openstack-infra16:03
pelixwaynr: well that's progress, can you put up a test config in a gist so I can dig further since I'd like to dig down into the different possible triggers for this16:03
waynrunfortunately i can't really focus on this bug right now because i have a fix that works using explicit parameter order and the teams for which i manage CI are currently in need of my assistance and generally unsympathetic to the need to fix JJB right now16:04
waynrlet me see if i can get the repro case into a single file16:05
pelixwaynr: well if you can share a basic test config file I'll continue to explore and let you focus on a quick fix for your team16:05
*** sshnaidm has quit IRC16:05
*** sshnaidm has joined #openstack-infra16:06
*** sshnaidm has joined #openstack-infra16:06
*** laughterwym has quit IRC16:06
*** jlanoux has quit IRC16:06
*** gyee has joined #openstack-infra16:06
*** afazekas has quit IRC16:06
*** agentle has quit IRC16:08
*** puranamr has quit IRC16:08
*** amuller has joined #openstack-infra16:08
*** puranamr has joined #openstack-infra16:08
waynrpelix: what is the general time range that you are available most days?16:09
*** jcoufal has quit IRC16:09
pelix9am - 5pm GMT16:09
*** thedodd has joined #openstack-infra16:10
*** fhubik has quit IRC16:11
fungiheads up, in about 45 minutes i'm disappearing for a while. travel vaccine booster shot, which i have to get on the next island over, so will likely be afk between 17:00-19:00 utc (possibly back sooner depending on how busy they are)16:11
*** e0ne has quit IRC16:11
*** puranamr has quit IRC16:12
*** mpavone has quit IRC16:12
*** puranamr has joined #openstack-infra16:12
waynrurgh16:12
*** mpopow has joined #openstack-infra16:12
*** unicell1 has joined #openstack-infra16:12
waynrdo all jjb defaults inherit from global defaults?16:12
waynr(mindblown)16:13
*** e0ne has joined #openstack-infra16:13
*** federico3 has quit IRC16:13
waynri feel like someone mentioned this in a recent gerrit review that i looked at16:13
waynrvaguely upsetting16:13
pelixno, they shouldn't. If you name the defaults to be used for a job it should use the named set16:13
*** dtroyer has joined #openstack-infra16:14
fungiclarkb: if you get bored and want to poke an ml thread, http://lists.openstack.org/pipermail/openstack-dev/2015-June/067612.html is asking a question about the usability of multi-node devstack workers in our ci (in this case to more thoroughly test the drbd cinder backend)16:14
*** afazekas has joined #openstack-infra16:14
*** yamamoto has quit IRC16:14
*** husanu1 has joined #openstack-infra16:15
*** bswartz has quit IRC16:15
waynrwell i seem to have found a case where somehow global defaults are being inherited...this isolated yaml repro case uses a non-global set of defaults named "zuul" but my job template is using variables only named in global defaults...when i run JJB it fails unless i copy my global defaults into this file16:15
*** husanu1 has quit IRC16:15
*** unicell has quit IRC16:15
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Convert ironicclient node.update() call to Task  https://review.openstack.org/19355316:15
*** samuelBartel has quit IRC16:16
*** patrickeast has quit IRC16:16
waynrthis is strange16:16
*** husanu has joined #openstack-infra16:17
*** unicell1 has quit IRC16:18
*** asselin has quit IRC16:18
*** ihrachyshka has joined #openstack-infra16:18
*** david-ly_ is now known as david-lyle16:18
*** sshnaidm has quit IRC16:19
pleia2_good morning16:20
*** pleia2_ is now known as pleia216:20
*** flepied1 has joined #openstack-infra16:20
*** arxcruz has joined #openstack-infra16:20
*** flepied has quit IRC16:20
*** ashleighfarnham has joined #openstack-infra16:21
SpamapSmordred: did you open a bug in cinderclient?16:21
*** SumitNaiksatam has quit IRC16:21
*** yamahata has quit IRC16:22
*** tonytan4ever has quit IRC16:22
openstackgerritFabio Porcedda proposed openstack-infra/git-review: Add "-p"/"--pull" option to merge a change on the local branch  https://review.openstack.org/19409416:23
*** yamamoto has joined #openstack-infra16:23
*** agentle has joined #openstack-infra16:23
*** bexelbie_ has joined #openstack-infra16:24
*** SumitNaiksatam has joined #openstack-infra16:25
waynrpelix: https://gist.github.com/waynr/5cb7f54c1462fee7bbb316:26
*** jerryz has joined #openstack-infra16:26
waynrat this point I suspect the problem may still be in deep_format16:26
*** yamamoto has quit IRC16:26
waynrpelix: if you try deleting the "global" defaults from this config file you should be able to see that the "zuul" defaults depend on those values somehow16:27
*** amuller is now known as amuller_afk16:27
waynroh, hmm16:28
waynrnope16:29
* waynr mumbles to self16:29
waynrpelix: oooh I see what you were saying about PYTHONHASHSEED now16:30
*** rossella_s has quit IRC16:30
pelixit's hiding a chunk of randomness in the tests :(16:30
*** rossella_s has joined #openstack-infra16:31
waynri mean i still don't fully understand but i see now that this leads to different behavior for py27 vs py3416:31
*** tqtran has joined #openstack-infra16:32
*** nihilifer has joined #openstack-infra16:33
*** yfried__ has quit IRC16:34
pelixit affects the order you get keys back when iterating over the keys of a dictionary. if you set PYTHONHASHSEED=0 you'll always get the same order for the same dictionary contents, it'll only change if you add/remove items16:34
fungiwaynr: PYTHONHASHSEED is random in python 3.4 but fixed in 2.7. however tox randomizes it in both unless you explicitly override the env16:34
*** harlowja_at_home has quit IRC16:34
*** husanu has quit IRC16:35
fungipython started making it random in 3.x as a mitigation for a mild class of security vulnerabilities around predictable hash collisions, but did not backport that behavior to 2.x because it could cause regressions in existing applications which relied on a specific hash ordering16:36
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Take parameter order from yaml in trigger_parameterized_builds  https://review.openstack.org/19366016:36
*** yfried__ has joined #openstack-infra16:36
*** dizquierdo has quit IRC16:36
*** husanu has joined #openstack-infra16:37
waynrfungi: okay, that makes sense16:37
fungiif jjb's tox.ini overrides with an explicit value (i haven't looked) it's presumably because when tox added its own randomization for 2.x interpreters we had some (arguably poorly written) tests which started failing. ideally PYTHONHASHSEED overrides should be phased out of tox.ini files where possible16:38
fungiunfortunately the failures which will arise from tests being hash-order-dependent will manifest nondeterministically, only under some PYTHONHASHSEED values and not others, so you'll have to keep an eye out for them16:38
fungiluckily tox logs the PYTHONHASHSEED it chose, so you can reproduce a bug like that reliably once you find it16:39
*** markus_z has quit IRC16:39
openstackgerritMerged openstack-infra/shade: Pin cinderclient  https://review.openstack.org/19413816:40
*** jasondotstar has quit IRC16:41
*** RichardRaseley has joined #openstack-infra16:41
*** xyang1 has joined #openstack-infra16:42
*** yamahata has joined #openstack-infra16:42
pelixwaynr: I've worked out your problem, you have to define defaults on the project level as well as the template16:42
pelixman, that's annoying16:42
*** Swami has joined #openstack-infra16:42
*** dguerri is now known as dguerri`16:42
pelixappears the defaults get expanded before checking the template defined which ones to use while the project did not.16:43
*** mpaolino has quit IRC16:43
krotscheckI've got 2 corse + the PTL of Horizon agreeing that this should land. All I need is one Infra +2A :) https://review.openstack.org/#/c/191919/16:43
krotscheck*2 cores16:43
* krotscheck has had cors on the brain16:43
*** asselin has joined #openstack-infra16:44
* fungi has a coarse brain16:45
*** rwsu has joined #openstack-infra16:45
*** yfried__ has quit IRC16:45
pelixwaynr: appears apply defaults gets called twice, once on getting the template, and a second time on expanding it for the job. The first time it get's the value to use from the template itself, the second time from the project definition.16:46
*** yfried__ has joined #openstack-infra16:46
pelixmeans if it's not defined for the project, it uses the global defaults when expanding the job definition16:47
*** unicell has joined #openstack-infra16:47
*** agentle has quit IRC16:49
*** afazekas has quit IRC16:49
*** agentle has joined #openstack-infra16:50
*** shardy has quit IRC16:50
krotscheckThanks, fungi :)16:50
*** shardy has joined #openstack-infra16:51
waynrpelix: mmm, spaghettic code ;)16:52
waynrs/ic/i/16:52
*** rkukura has quit IRC16:52
*** afazekas has joined #openstack-infra16:55
*** esmute has joined #openstack-infra16:55
*** derekh has quit IRC16:55
waynrpelix: i haven't run into this problem before because I have always only used global defaults16:56
openstackgerritgreghaynes proposed openstack-infra/glean: Use interfaces.d on debian distros  https://review.openstack.org/19423316:56
greghaynesmordred: ^16:56
waynrbut for my zuul work i've been using zuul-specific defaults16:56
*** ildikov has joined #openstack-infra16:56
waynryargh16:56
openstackgerritMerged openstack-infra/release-tools: Add adjust_blueprints.py script  https://review.openstack.org/19268616:57
*** pelix has quit IRC16:57
waynri am so excited to be able to define job configuration using python modules :)16:58
greghaynesmordred: respinning an image and uploading to rax to see if that works...16:58
*** mpopow has quit IRC16:58
fungiokay, time to go brave the tourist traffic. i'm hoping to shift gears back onto the nodepool-bindep cache integration work when i return, if things here haven't spontaneously combusted while i'm out and about... but i should be back by 19:00 utc if they have16:58
waynrwill be able to use true object-oriented inheritence16:58
pleia2fungi: good luck16:58
*** cinerama has quit IRC16:58
mordredgreghaynes: looks great!16:59
*** dboik has quit IRC16:59
mordredSpamapS: nope. I did report it in #openstack-cinder though16:59
waynrdang, 1700 GMT...no more pelix16:59
*** ivar-lazzaro has joined #openstack-infra16:59
*** cinerama has joined #openstack-infra17:00
*** yamada-h has joined #openstack-infra17:00
*** sergmelikyan has joined #openstack-infra17:00
*** afazekas has quit IRC17:00
*** dboik has joined #openstack-infra17:00
*** esmute has quit IRC17:01
*** dtantsur is now known as dtantsur|afk17:03
*** esker has joined #openstack-infra17:03
mordredgreghaynes: I'm excited that it seems solvable from glean too17:03
*** patrickeast has joined #openstack-infra17:05
greghaynesmordred: yea, I cant remember why I thought we needed a simple-init change... hopefully that wasnt just forgotten over the weekend17:05
*** e0ne has quit IRC17:05
greghaynesalso, those tests are awesome17:06
*** sarob has quit IRC17:06
mordredgreghaynes: I think that we were thinking we might need to have it lay down a different e-n-i17:07
mordredgreghaynes: but I think what you're doing there is spot on - it means we're write out e-n-i more than once - but MEH who cares17:07
greghaynesoh! yes.17:08
*** whoops has joined #openstack-infra17:08
*** sabeen has joined #openstack-infra17:08
*** dims has quit IRC17:09
*** rguillebert_ has quit IRC17:09
*** dims has joined #openstack-infra17:09
*** hodos has quit IRC17:10
*** ihrachyshka has quit IRC17:11
*** puranamr has quit IRC17:12
openstackgerritMerged openstack-infra/project-config: Horizon Karma test job is now voting  https://review.openstack.org/19191917:12
*** dboik has quit IRC17:13
*** sdake_ has joined #openstack-infra17:18
*** amuller_afk is now known as amuller17:18
*** unicell1 has joined #openstack-infra17:18
*** unicell has quit IRC17:19
*** rwsu has quit IRC17:19
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: rename release_library.sh to release_postversion.sh  https://review.openstack.org/19424217:20
*** fitoduarte has joined #openstack-infra17:20
*** Longgeek has quit IRC17:20
greghaynesnibalizer: did https://review.openstack.org/#/c/193942/ change what you were running in to last night?17:22
nibalizergreghaynes: oh i didn't pull it down17:24
*** marcusvrn_ has quit IRC17:24
*** ryanpetrello has quit IRC17:25
*** jasondotstar has joined #openstack-infra17:25
*** shardy has quit IRC17:25
*** shardy has joined #openstack-infra17:26
*** shardy has quit IRC17:26
*** shardy has joined #openstack-infra17:26
*** bexelbie_ has quit IRC17:27
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Translations: Update horizon  https://review.openstack.org/19424617:28
marcusvrnpatrickeast: hi!17:28
*** baoli has joined #openstack-infra17:28
*** Vivek_ is now known as Vivek17:28
*** harlowja has joined #openstack-infra17:28
*** Vivek is now known as Guest5003117:28
*** ryanpetrello has joined #openstack-infra17:28
patrickeastmarcusvrn: hey17:29
*** puranamr has joined #openstack-infra17:29
*** dustins_ has joined #openstack-infra17:30
*** markvan has quit IRC17:30
*** markvan_ has joined #openstack-infra17:30
*** Guest50031 is now known as Vivek_V_C17:31
mordredjeblair, fungi: https://review.openstack.org/194233 should be the last needed piece for dib-nodepool17:31
greghaynesmordred: Still testing to make sure17:31
*** baoli has quit IRC17:31
greghaynesuploading is slow...17:32
jeblairmordred: i'm reviewing it now17:32
*** baoli has joined #openstack-infra17:32
marcusvrnpatrickeast: I saw mikhail and your comments...I'm agreed with you guys17:33
marcusvrnpatrickeast: I was thinking how to improve the pagination, and then I did some mongodb tests17:33
*** dustins has quit IRC17:33
marcusvrnpatrickeast: the queries response are so fast17:34
jeblairgreghaynes, mordred: lgtm, did not +A pending further results from greghaynes17:34
*** esmute__ has joined #openstack-infra17:34
marcusvrnpatrickeast: I think the problem about heavier loads is just on client side (generate the table)17:34
*** zobel has joined #openstack-infra17:35
*** gfidente has quit IRC17:35
*** Vivek_V_C is now known as Vivek17:35
zobeli try to sign the CLA, but get "Code Review - Error \nServer Error \nCannot store contact information".17:35
zobelhttps://review.openstack.org/#/settings/new-agreement17:35
*** Vivek has quit IRC17:35
*** Vivek has joined #openstack-infra17:35
*** rwsu has joined #openstack-infra17:36
marcusvrnpatrickeast: maybe we can do the pagination only on client side and it will fixes the problem that you pointed out (number and order of columns), because the query retrieves all results17:36
zigomordred: Any idea what's going on with my DSA (Debian System Admin) friend zobel trying to sign the CLA?17:37
*** Zhongjun has quit IRC17:38
mnaserzigo: https://bugs.launchpad.net/openstack-ci/+bug/134683317:38
openstackLaunchpad bug 1346833 in OpenStack Core Infrastructure "Can't sign the CLA onreview.openstack.org" [Wishlist,Invalid]17:38
mordredzigo: I'm running out the door - fungi should be able to help ... and howdy zobel17:38
patrickeastmarcusvrn: sry had to step away for a min17:39
openstackgerritDan Prince proposed openstack-infra/tripleo-ci: Drop Fedora python-ipaddress package cherry pick  https://review.openstack.org/19425817:39
mnasertry making sure that you have an openstack member account first17:39
patrickeastmarcusvrn: that sounds like a good plan, if the queries are not going to be a bottleneck then we might as well just do it there17:39
*** marzif_ has quit IRC17:39
*** baoli has quit IRC17:40
zigozobel: So I guess the answer is in this launchpad bug: "It works, when not entering address information, but only "I AGREE""17:40
*** baoli has joined #openstack-infra17:40
*** otter768 has joined #openstack-infra17:40
*** Sukhdev has quit IRC17:40
mnaserzigo: or if you're not a foundation member, read: https://ask.openstack.org/en/question/56720/cannot-store-contact-information-when-updating-info-in-openstack-gerrit/17:40
zigozobel: Also "Indeed, becoming a Openstack member first, solves this issue!", so I gess you should first go to https://www.openstack.org/join/17:41
marcusvrnpatrickeast: I'll try it. I think it can solve all pagination problems17:41
openstackgerritgreghaynes proposed openstack/diskimage-builder: Dont fail simple-init without ssh installed  https://review.openstack.org/19426017:41
yolandagreghayns, about the change for nodepool.conf, it's really decided by consensus, jeblair was ok in that change and we decided to not be backwards-compatible17:41
yolandagreghaynes17:41
*** agentle has quit IRC17:41
*** agentle has joined #openstack-infra17:41
*** mfisch has joined #openstack-infra17:42
greghaynesyolanda: thats my name!17:42
mfischanyone know why a permissions change review keeps ending up in merge conflct?17:42
mfischhttps://review.openstack.org/#/c/194261/17:42
mfischthats my 2nd try17:42
patrickeastmarcusvrn: awesome! let me know if you run into any problems… i’m prett strapped for time, but i’ll help out as much as i can17:43
patrickeasts/prett/pretty/17:43
*** yamada-h has quit IRC17:43
yolandagreghaynes, and i did a typo first time i mentioned you :)17:43
*** dboik has joined #openstack-infra17:43
greghaynesyolanda: oh, there was a line above17:43
marcusvrnpatrickeast: sure! no problems :)17:43
greghaynesyolanda: I didnt see because it didnt highlight17:43
yolanda:)17:43
clarkbmfisch you cant update acls that way need to update them via project-config17:43
*** Sukhdev has joined #openstack-infra17:43
mfischclarkb: got a pointer on how to do that?17:44
*** reed has quit IRC17:44
*** reed has joined #openstack-infra17:44
mfischI think crinkle probably wants to learn how to do it ;)17:44
greghaynesyolanda: huh. That seems pretty mean to downstream users17:44
clarkbmfisch http://docs.openstack.org/infra/manual/creators.html17:45
greghaynesyolanda: Do we not try and preserve backwards compat in nodepool?17:45
yolandagreghaynes, it came from a need to isolate passwords (database and jenkins), from behaviour17:45
*** otter768 has quit IRC17:45
yolandaby that way nodepool.yaml can be brought from project-config17:45
yolandaand not need to be in a template17:46
greghaynesyolanda: yes, I get the idea, and thats fine, doing it in a backwards compat way shouldnt effect that17:46
yolandaactually same concern was raised by liz, and we agreed with jeblair to don't be backwards compatible17:46
greghayneshrm17:46
yolandaso we should add Jim on the loop for it17:46
greghaynesYea, if thats the consensus then thats fine, kind of :(17:46
jeblairnodepool is in no position to provide any kind of backwards compatability promises yet;  however, the puppet modules will provide a path forward that will avoid breakage17:48
jeblairso if you are using the puppet modules to deploy it (like we are), then there will be a stepwise process to upgrade without breaking17:48
yolandawe need to be sure to reflect that properly on documentation17:48
greghaynesjeblair: ok. Is that something we hope to eventually do with nodepool?17:48
yolandaand i added related stuff for it17:48
*** abitha has joined #openstack-infra17:49
jeblair(support new thing in nodepool, create new thing in puppet, stop creating old thing in puppet, drop old thing in nodepool)17:49
zobelzigo: will try that first.17:49
jeblairgreghaynes: eventually, but right now it doesn't even support schema migrations.17:49
greghaynesheh17:49
clarkbthere is a change fir that17:49
yolandait will hurt for people using nodepool and not using puppet17:49
clarkband I thibk I +2'd it17:49
*** Longgeek has joined #openstack-infra17:49
yolandaor people not being on sync with upstream puppet17:49
openstackgerritMatt Fischer proposed openstack-infra/project-config: Add puppet-manager-core to puppet-monasca  https://review.openstack.org/19426317:50
mfischclarkb: thanks, thats not too hard17:50
*** agentle has quit IRC17:50
greghaynesYes. We are still 0.x with nodepool so that is kind of the you cant trust us convention at least17:50
jeblairyolanda: yes, but only if they are running tip of master.17:50
jeblairwhich is a weird thing to do with nodepool and not using our puppet17:50
greghaynesIf they are installing from package itll break folks too?17:51
greghaynesjust when we release17:51
yolandaand the ones that do it, shouldn't be consuming nodepool changes blindly, but be careful on what they merge17:51
greghaynesyolanda: removed -1 btw17:52
openstackgerritPaul Belanger proposed openstack-infra/grafyaml: Add datasource functionality  https://review.openstack.org/19426517:52
yolandacool, you brought a legit feature17:52
yolandalegit concern17:52
yolandaah jeblair, actually, another suggestion i had, was to rename nodepool.conf to auth.conf17:52
yolandawhat do you think about it?17:53
*** sarob has joined #openstack-infra17:54
*** achanda has joined #openstack-infra17:54
*** HeOS has quit IRC17:54
jeblairi don't have strong feelings.  or secure.conf, if you want to pattern after gerrit.17:55
yolandaok, i'm fine with the rename17:55
yolandai'm also referencing on code as "secrets", so i'll rename to "secure" everywhere17:55
clarkbwhy rename it though?17:56
clarkbthat seems like needless churn, make the path settable if necessary17:56
*** hrubi has quit IRC17:57
yolandait's a new file really, that didn't exist before17:58
yolandaso we are on the time to name it properly17:58
clarkboh tgis is nodepool not zuul what goes in the.conf file?17:58
yolandanodepool.conf is new file to hold nodepool secrets17:58
clarkbisnt that the cloud cobfig?17:58
yolandaso it makes sense for that to be called secure.conf17:58
clarkbeg we already have that17:59
yolandano, that new secure.conf will only hold database creds and jenkins creds17:59
yolandaby that way, we leverage nodepool.yaml from any secret17:59
*** hrubi has joined #openstack-infra18:00
*** shardy has quit IRC18:00
*** amotoki has quit IRC18:00
*** shardy has joined #openstack-infra18:00
*** cdent has quit IRC18:01
*** SumitNaiksatam has quit IRC18:01
openstackgerritMerged openstack-infra/project-config: Made bashate test voting  https://review.openstack.org/19368218:01
clarkbwill the new file also accept cloud secrets?18:01
*** patrickeast_ has joined #openstack-infra18:03
greghaynesclarkb: the change thats up only does it for jenkins and db18:03
*** patrickeast has quit IRC18:03
*** patrickeast_ is now known as patrickeast18:03
yolandano, cloud secrets will be into another file, as it's not strictly related to nodepool18:03
greghaynesIMO I think cloud secrets should be clouds.yaml18:03
yolandathere was an agreement to work on a puppet module for cloud-config, nibalizer was on it18:03
yolandayes, secrets continue on clouds.yaml18:03
*** dustins_ has quit IRC18:03
clarkbit just seems inconsistent to need 3 files now18:04
clarkbwhen 2 are redundant18:04
*** dustins has joined #openstack-infra18:04
openstackgerritMerged openstack-infra/system-config: Replace git-fe* in cacti with git.o.o  https://review.openstack.org/19383718:04
yolandaclarkb, so get rid of clouds.yaml and use nodepool.conf for all secrets?18:04
greghaynesnonono18:05
clarkbno18:05
greghaynesWe will have invented 3 ways to read in cloud config data for 1 project at that point18:05
yolandaso?18:05
clarkbbut allow secure.conf to specify too18:05
clarkbthen stop accepting it in nodepool.yaml18:05
clarkbso still just 218:05
*** jasondotstar has quit IRC18:06
greghaynesYea, if we want to move it over that seems reasonable18:06
greghaynes(definitely not required for the initial patch though)18:07
*** salv-orl_ has quit IRC18:07
yolandaso, i'm a bit lost, not get rid of clouds.yaml but make that optional, and alternatively using secure.conf for all secrets?18:07
*** ghostpl has quit IRC18:07
clarkbyes since today clouds.yamk is optional and nodepool.yaml accomdoates all secrets18:07
*** jasondotstar has joined #openstack-infra18:08
greghaynesright now clouds.yaml is optional, I think youre saying move the ability to set secret bits of provider definitions out of nodepool.yaml and into the new secrets file18:09
*** jasondotstar has quit IRC18:09
clarkbyes18:09
clarkbas that is consistent and less confusing than having 3 qays to do it18:10
greghaynesagreed18:10
yolandai am ok with that, if there is consensus to use clouds.yaml as optional, i thought it will be enforced at some time18:10
yolandahowever, that's approach we discussed with jeblair, and asselin, so i'd like for them to give opinion18:10
clarkbit is optional...18:11
* asselin reads scrollback18:11
openstackgerritMerged openstack-infra/project-config: Add translation job for Ironic-inspector  https://review.openstack.org/19409518:11
*** e0ne has joined #openstack-infra18:12
*** bswartz has joined #openstack-infra18:12
*** afazekas has joined #openstack-infra18:12
*** jasondotstar has joined #openstack-infra18:13
*** ZZelle_ has joined #openstack-infra18:13
asselinyolanda, what's changing?18:13
*** angela-s has joined #openstack-infra18:14
*** jasondotstar has quit IRC18:14
yolandaasselin, so as clouds.yaml is optional, we won't be using that as the source of truth for provider secrets18:14
yolandabut we'll add the possibility to also set the into nodepool.comf18:14
hogepodgeWe're going to be discussing this in the refstack meeting today. I think we're ready to start moving forward if infra is ok with it https://review.openstack.org/#/c/188207/1018:14
asselinyolanda, so secrets can be in nodepool.conf or clouds.yaml?18:15
yolandayes18:15
*** ivar-lazzaro has quit IRC18:15
asselinyolanda, actually i'm not so familiar with clouds.yaml, never used it, but why do both?18:15
nibalizeryolanda: yea i have to get a governance change up18:16
openstackgerritChristopher Aedo proposed openstack-infra/system-config: Add apps.openstack.org to cacti  https://review.openstack.org/19199018:16
greghaynesThe alternative is what yolanda said, just dont support non clouds.yaml18:16
*** bexelbie_ has joined #openstack-infra18:17
yolandaso greghaynes, clarkb, what was the intention of clouds.yaml and why should we keep it?18:17
greghaynesasselin: we currently support clouds.yaml and nodepool.yaml18:17
*** jasondotstar has joined #openstack-infra18:17
clarkbyolanda tge intent is openstack client uses it18:17
greghaynesyolanda: the intention is to centralize config loading code for multi cloud into one codebase and allow multiple applications share a single cloud config file18:17
yolandawhy is it optional then?18:18
clarkbso nodepool respecti g it gives us a common config point for osc and nodepool18:18
openstackgerritAdam Gandelman proposed openstack-infra/project-config: Run sudo /w -H in akanda post_test_hook  https://review.openstack.org/19428218:18
clarkbyolanda because the use of osc is optional?18:18
clarkbits more a be a good ecosystem memeber thing18:18
SpamapSmordred: I don't want us to forget about this pin. At a minimum we should see if we can get a functional test that fails in devstack with the new one so we know when its ok to unpin.18:18
*** jasondotstar has quit IRC18:18
clarkbbut nodepool can and should config itself as necesaary imo18:18
SpamapSmordred: but if its only because the public clouds are bong... then not much we can do :-P18:18
greghaynesyolanda: we just didnt remove the nodepool.conf bits from nodepool, and osc automagically takes care of fallback between the two config places18:19
asselinI never tried it, but this might work for me: https://github.com/openstack-infra/system-config/blob/master/modules/openstack_project/manifests/nodepool_prod.pp#L8218:20
greghaynesasselin: yes, that should work for nodepool user18:20
yolandaso i don't like the extra complexity we are adding to nodepool, but there is a hard need to get rid of secrets in nodepool.yaml in order for that to be reusable18:21
clarkbnodepool why is that?18:21
*** bexelbie has joined #openstack-infra18:21
clarkber18:21
greghaynesIt actually wasnt any added code for that fallback - thats all in osc and existing nodepool code18:21
clarkbyolanda why is that necessaey?18:21
openstackgerritColleen Murphy proposed openstack-infra/project-config: Create puppet-openstack-integration repo  https://review.openstack.org/19428718:21
yolandaclarkb, for the puppet-openstackci effort18:21
*** notnownikki has quit IRC18:22
yolandaand allow more flexibility on nodepool.yaml file18:22
*** fallenpegasus has quit IRC18:22
asselinclarkb, b/c the file is a template and by taking the secrets out we can move it to project-config18:22
clarkbyolanda I still dont follow, we use templaye files to set that file so why wouldnt the curebt template work?18:22
asselinas a static files18:22
yolandaso clarkb, greghaynes, if you look at history of that change, you can see evolution on the change18:22
clarkbasselin iirc the long term plab was to support templates in project-config18:22
*** crc32 has joined #openstack-infra18:23
nibalizerinteresting18:23
asselindid not know that18:23
nibalizerI didn't know that either18:23
nibalizeri thouht that was the opposite of the long-term plan18:23
yolandatemplating was very complex, then we added an ability to pass that file from an external source, but then we decided that best way as move that secrets to an independent file18:23
zobelzigo: now that i signed the ICLA (without address), i get "ICLA contributor agreement requires current contact information" when doing git review.18:23
clarkbnibalizer asselin it wad a known limitation that we waved hands around gicing in the future18:23
*** e0ne is now known as e0ne_18:23
clarkb*gixing18:24
clarkbgah I give up18:24
nibalizergixing?18:24
nibalizerfixing?18:24
clarkbfixing18:24
pleia2fungi: I think your comment for 191990 landed on 191989 by mistake18:24
*** e0ne_ is now known as e0ne18:24
*** Sukhdev has quit IRC18:24
*** jasondotstar has joined #openstack-infra18:25
*** jasondot_ has joined #openstack-infra18:25
asselinclarkb, yolanda had a template approach earlier. Discussiong with jeblair changed to the current approach of separating secrets from the rest of the configuration18:25
openstackgerritChristopher Aedo proposed openstack-infra/system-config: Add apps.openstack.org to cacti  https://review.openstack.org/19199018:25
yolandayes, that request came actually from jeblair18:25
dhellmannlifeless: is https://review.openstack.org/#/c/192929/ going to cause problems when it merges and updates projects that specify those items in their test-requirements.txt? Or does your commit message mean those are already being ignored during a sync?18:26
yolandaand as i agreed on the logic, i started implementing that18:26
clarkbok18:26
asselinI also agreed. Seems jeblair forgot about long term support for templates in project-config.....??18:26
yolandai am fine to add this optional support of secrets in nodepool.conf, if clouds.yaml has the intention to continue optional18:27
openstackgerritBen Nemec proposed openstack/diskimage-builder: Optimize Python install in deploy-targetcli  https://review.openstack.org/19279818:27
lifelessdhellmann: they are already ignored18:27
lifelesssdague: hi18:27
lifelesssdague: if I could get your input on https://review.openstack.org/#/c/193911/ that would be great18:27
sdaguelifeless: looking18:28
dhellmannlifeless: ok, that's what I thought18:28
lifelessdhellmann: specifically hacking is ignored18:28
lifelessdhellmann: and the others cause issues today so shouldn't be there18:28
fungizigo: zobel: we tried to document the requirements and sequence of steps for proper account setup at http://docs.openstack.org/infra/manual/developers.html#account-setup18:28
*** SumitNaiksatam has joined #openstack-infra18:29
dhellmannlifeless: ok, as long as they are ignored it's fine, but if they're not already ignored then it's going to cause confusion when requirements check jobs start failing18:29
sdaguelifeless: hmmm... so... shouldn't we be fixing the source instead? Because this makes it basically not installable outside of this environment, right?18:30
*** xyang1 has quit IRC18:30
sdaguelifeless: do we know which libs have the problem?18:30
lifelesssdague: well, anything anywhere in our dep chain can break us until we get the constraints system live18:31
*** tonytan4ever has joined #openstack-infra18:31
lifelesssdague: so I do want to fix the libs, but also I want to stop the breakage cold18:31
openstackgerritSpencer Krum proposed openstack-infra/project-config: Create a puppet module for os_client_config  https://review.openstack.org/18889518:31
*** fallenpegasus has joined #openstack-infra18:31
lifelessdhellmann: I'm quite sure noone specifies e.g. flake8 today *because* it would cause issues today18:31
sdaguelifeless: right, but the problem is, this isn't really a fix, its a mask18:31
zobelfungi: i followed that. see backlog at 1736Z18:31
* dhellmann crosses his fingers and hopes lifeless is right18:32
lifelesssdague: its a workaround for sure.18:32
sdaguewhich means the issue won't expose in our system, but it will be an issue for people that aren't force installing new pbr after every package install18:32
lifelesssdague: *only* if they run update.py18:32
sdague?18:32
lifelessok so lets take a step back18:33
lifelessthe fix in pbr thats relevant is the 1.2.0 release18:33
lifelesswhich strips ;python_version==2.6 and similar in tests_require18:33
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Add Ironic Inspector simple integration test job  https://review.openstack.org/19394118:33
lifelessnow we don't use tests_require today - we use pip install -r tests-requirements.txt18:33
lifelessbut pbr still reflects that and breaks setup.py18:34
lifeless(you can look at the patch I linked from 193911 older failing runs to see what it looks like)18:34
*** ParsectiX has joined #openstack-infra18:35
lifelessfor a given project to get environment markers into its test-requirements.txt file18:35
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet: experiment upgrade job with beaker  https://review.openstack.org/19429318:35
lifelessthey need to successfully merge that proposal on their end18:36
mordredSpamapS: it's not only because public clouds are bong - but they are being bong18:36
lifelessor inside devstack(or similar) they need to run update.py to sync in advance from global requirements18:36
jeblairyolanda: what?  why would clouds.yaml be optional?18:36
clarkbjeblair it is currebtly optional...18:36
lifelessonce merged they must have a new enough pbr18:36
jeblairyeah, let's make it required ;)18:36
mordredyes18:36
lifelessbut we can't use versioned deps on pbr18:36
clarkbjeblair and that was intentional so that nodepool would continue to co fig itself18:36
mordredI intent to make it 100% mandatory18:36
*** xyang1 has joined #openstack-infra18:37
jeblairright, it's halfway through a transition18:37
jeblairwe should in now way construe that as suggestive of the end design goal18:37
clarkbnot sure I agree it should be mabdatory18:37
AJaegerpleia2: could you review https://review.openstack.org/194246 , please? The corresponding horizon change has just been approved. StevenK will be happy to see these changes since it simplifies the zanata setup.18:37
sdaguelifeless: so I'm not sure I understand how this is the fix. Because pbr is 1.2.0 all through that run, right?18:37
mordredthere is no reason for nodepool to continue to have 2 ways to configure clouds18:37
pleia2AJaeger: yep, having a look now18:37
clarkbthe proliferation of config files is just confusing and difficult to deal wih in the simple case18:37
lifelessdhellmann: that reminds me, can we please release ceilometermiddleware18:37
sdagueone of the issues is that pip is a 7.0.0alpha18:37
mordredright18:37
mordredthat's what we're stopping18:37
clarkbsee every openstavk service wver18:37
mordredthere will be one and only one way to configure cloud endpoints18:37
mordredthere will not be 218:37
fungihogepodge: great--we should add it to https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting i think so it gets a mention in the specs section of tomorrow's infra meeting18:37
dhellmannlifeless: we should coordinate with gordc18:37
jeblairclarkb: yes, nodepool will end up with two config files: clouds.yaml and nodepool.yaml18:37
mordredbecause having 2 is silly18:37
lifelessdhellmann: this is one of the broken packages still downgrading pbr18:38
jeblairclarkb: one has secrets, the other has configuration18:38
clarkbjevlair well 318:38
clarkbbecause jenkins18:38
* SpamapS smells an xkcd927 brewing18:38
lifelesssdague: no, pbr gets downgraded by the transitive dep via ceilometermiddleware18:38
jeblairor as mordred puts it, one has cloud configuration, one has nodepool configuration18:38
mordredclarkb: eventually there is no jenkins18:38
lifelesssdague: let me get a log ref for you18:38
*** esker has quit IRC18:38
sdaguelifeless: point me at a long line18:38
lifelessdhellmann: so its urgent18:38
jeblairclarkb: yep, and that's an interim step until jenkins goes away18:38
SpamapSif I ever get a vanity license plate.. that would be a valid option18:38
greghaynesjeblair: what about mysql?18:38
sdaguebecause nothing I'm seeing is that18:38
lifelesssdague: this is a run with my patched devstack in it. http://logs.openstack.org/50/189250/41/check/check-tempest-dsvm-full/c510b39/logs/devstacklog.txt.gz18:39
jeblairgreghaynes: maybe it stays for that?18:39
clarkbmordred does oscc suppory a global clouds.yaml?18:39
mordredyes18:39
sdaguelifeless: link me the fail point please?18:39
mordredclarkb: /etc/openstack/clouds.yaml18:39
clarkbmordred maybe we should switch to using it that way then18:39
clarkbsince nodepool is configured glovally18:39
mordredclarkb: I suggested that a little while back - can't remember why we decided not to18:39
lifelesssdague: http://logs.openstack.org/50/189250/41/check/check-tempest-dsvm-full/c510b39/logs/devstacklog.txt.gz#_2015-06-22_06_51_51_67218:39
sdaguelifeless: that whole run was a success18:39
lifelesssdague: (was just getting to it)18:40
lifelesssdague: thats the downgrade point18:40
fungizobel: right, when you followed that did you actually join the foundation as an individual member, or did you try to follow steps out of sequence after finding that document? it sounds like you followed mistaken advice to agree to the icla in gerrit without filling in the contact information fields. you have to go back and do that part at https://review.openstack.org/#/settings/contact now to18:40
jeblairmordred: maybe because we need the puppet config to do that first?18:40
fungicomplete it18:40
jeblairmordred: (which i think is being worked on?)18:40
dhellmannlifeless: I'm following up with him in #openstack-ceilometer18:40
*** tqtran is now known as tqtran_afk18:40
lifelesssdague: http://logs.openstack.org/50/189250/41/check/check-tempest-dsvm-full/57bbd07/logs/devstacklog.txt.gz#_2015-06-22_01_32_21_767 is the failure you get if that downgrade isn't rectified before we run setup.py on the next server18:40
mordredjeblair: no - I thought we decided to keep it in ~nodepool - but I cannot for the life of me remember _why_18:41
mordreds/no - //18:41
hogepodgefungi thanks, added18:41
lifelesssdague: https://review.openstack.org/#/c/189250/ is the patch that this is trying to get through18:41
jeblairyolanda, clarkb, greghaynes, asselin: this is the plan as i understand it:  we move nodepool creds to nodepool.conf (or whatever yolanda wants to call it), nodepool config stays in nodepool.yaml, and we use clouds.yaml to facilitate interoperation between nodepool and openstackclient.  we stop supporting cloud config anywhere else, and we stop supporting other nodepool creds anywhere else.18:42
*** afazekas has quit IRC18:42
sdagueok, so, honestly, I really don't want to do it this way. Because this is going to lead us to a point where stuff gets released without this fixed, and downstream is going to get broken. It's kind of the point of tests like this to force out all the fixes in the right places.18:42
lifelesssdague: if we could do versioned deps on pbr in setup_requires we could fix it the right way18:43
lifelesssdague: but I don't know of any way to do it right today.18:43
lifelesssdague: like, we can get the current break points fixed today18:43
asselinjeblair, so clouds.yaml is optional?18:43
mordredjeblair: ++18:44
mordredasselin: no18:44
jeblairno it becomes required; we'll have puppet to set it up.18:44
sdagueor get stuff to release uncapped, because this is going to blow up in a bunch of other ways for people in ways we don't test.18:44
lifelessyes18:44
greghaynesjeblair: That works for me18:44
lifelessAFAICT its just ceilometermiddleware today18:45
lifelessso it might be fairly straight forward18:45
mtreinishfungi, jeblair: so the periodic tempest jobs, it looks like they're still fubar. Looking through the logs it looks like ZUUL_BRANCH isn't making it into the setup_workspace function: http://logs.openstack.org/periodic-qa/periodic-tempest-dsvm-full-non-isolated-master/f7ed4d7/logs/devstack-gate-setup-workspace-new.txt.gz#_2015-06-22_06_04_54_22318:46
jeblairmtreinish: i have to lunch now; i'll check back with you in 1-2 hours18:47
mtreinishjeblair, fungi: although we're clearly exporting early in running the job: http://logs.openstack.org/periodic-qa/periodic-tempest-dsvm-full-non-isolated-master/f7ed4d7/console.html#_2015-06-22_06_02_07_13118:47
asselinmordred, jeblair ok, so cloud configs go to cloud.yaml, other secrets go to nodepool.conf, and no cloud confs in nodepool.conf.18:47
mtreinishjeblair: ok, cool thanks18:47
*** ddieterly has quit IRC18:47
sdaguelifeless: yeh, you should be able to build a clever Depends-On chain to test that theory18:48
fungimtreinish: right, that's where we were before the zuul-cloner rework made it into devstack-gate, but i guess the underlying issue is still that we've introduced some sort of regression where devstack-gate expect ZUUL_REF and ZUUL_BRANCH in the calling env even though zuul doesn't provide those for the periodic pipeline18:48
lifelesssdague: to trigger ceilometermiddleware from git + everything that uses it from git ... ?18:48
sdaguelifeless: yep18:48
lifelesssdague: I think I'll just get it released :)18:48
fungimtreinish: the zuul-cloner "sane defaults" improvement doesn't solve this because it still needs those parameters, so we need to figure out alternatives to declare for them18:49
*** afazekas has joined #openstack-infra18:49
clarkbfungi we may be setting zuul branch but nit ref18:50
clarkbwhen what we want to do is set zuul-cloners override branch18:50
mtreinishfungi: hmm, ok. Well I mean getting it to just set things to master seems like the right thing to me, but maybe I'm missing something18:50
openstackgerritMatt Fischer proposed openstack-infra/project-config: Add puppet-manager-core to puppet-monasca  https://review.openstack.org/19426318:50
*** ddieterly has joined #openstack-infra18:50
sdaguelifeless: also, you saw my email about requirements formating right?18:51
*** jasondot_ has quit IRC18:51
*** Rockyg has joined #openstack-infra18:51
openstackgerritMerged openstack-infra/subunit2sql: Fix miss spelled words  https://review.openstack.org/19389618:52
lifelesssdague: yes; that needs changes to the packaging library, then an update to setup_tools, then a release of virtualenv, and then we'll have it18:52
lifelesssdague: so don't hold your breath, but I'll kick it off18:52
mtreinishfungi: the stupid simple fix would be to change setup_workspace to just use the provided branch if ZUUL_BRANCH isn't set18:52
mtreinishthat way it just doesn't explode on sed like it is now18:52
sdaguelifeless: there is no way for you to reorder it in your code?18:53
*** sergmelikyan has quit IRC18:53
sdagueI don't understand how writing those things in a different order requires changes to 3 libraries18:53
mtreinisherr, I may just need to read the code a bit more closely18:53
EmilienMI'm interested by some feedback on https://review.openstack.org/#/c/194293/ - I try to run some tests on master first and then checkout the commit branch and run tests again. I'm sure I'm not using zuul cloner the right way18:53
lifelesssdague: its str(parsed_req.specifier)18:54
fungimtreinish: right, it's probably something like that. just that the branch selection logic in devstack-gate is subtly complex so we need to be careful when adjusting it18:54
lifelesssdague: if I write our own formatter ofthe internal objects, then if the objects change their internal state, we'll break18:54
lifelesssdague: so its technical debt todo that.18:54
mtreinishfungi: hmm, yeah I think that would work I'll push a patch and we can go from there18:54
sdaguelifeless: it seems really fragile and chatty to use their __repr__ honestly18:55
sdaguebecause I can't believe that's a contract18:55
lifelesssdague: back soon18:56
fungidhellmann: do you suspect that error on the integration job for 192929 is transient, or did you not see it?18:57
dhellmannfungi: looking18:57
fungidhellmann: also not a lot of use approving those until 193911 is approved, since the bottom one in the stack has a cross-repo depends on it and it's what sdague and lifeless are debating in here at the moment18:58
*** agentle has joined #openstack-infra18:58
dhellmannfungi: I think I assumed a transient failure, the patch looked fine18:58
AJaegerpleia2: thanks18:59
fungidhellmann: i have a feeling something has changed with the reqs in tooz to start causing that18:59
*** salv-orlando has joined #openstack-infra18:59
sdaguedhellmann: http://logs.openstack.org/29/192929/12/check/check-requirements-integration-dsvm/0d525da/console.html#_2015-06-22_15_18_23_864 that is very unlikely to be transient failure18:59
fungiyeah19:00
AJaegerfungi, sdague could either of you review https://review.openstack.org/194246, please? The horizon parts are approved and I'd like all of this in together.19:00
sdagueAJaeger: done19:00
AJaegerthanks, sdague19:01
mordredgreghaynes: too much scrollback for me to figure this out - did the glean fix work?19:01
*** agentle_ has joined #openstack-infra19:02
openstackgerritMatthew Treinish proposed openstack-infra/devstack-gate: Fix the setup_workspace to handle missing ZUUL_BRANCH  https://review.openstack.org/19430219:02
fungidhellmann: the scary thing is i think the only changes to the tooz requirements files were proposed by the requirements update job19:03
mtreinishfungi, jeblair, clarkb: ^^^ I probably screwed up my bash logic but that's what I was thinking19:03
*** afazekas has quit IRC19:03
fungidhellmann: lifeless: based on that i have a feeling we've got a situation where the requirements proposal job is creating entries the requirements integration job can't parse19:04
*** gordc is now known as gordc_afk19:04
*** e0ne has quit IRC19:04
*** afazekas has joined #openstack-infra19:04
*** salv-orlando has quit IRC19:04
openstackgerritSpencer Krum proposed openstack-infra/puppet-iptables: Support side-loading iptables rules  https://review.openstack.org/19384719:04
*** e0ne has joined #openstack-infra19:05
*** agentle has quit IRC19:05
openstackgerritDoug Hellmann proposed openstack/requirements: Add venv tox environment  https://review.openstack.org/19430519:08
*** bexelbie_ has quit IRC19:08
*** bexelbie has quit IRC19:08
openstackgerritBrandon Leonard proposed stackforge/python-jenkins: Creates ability to work with views in jenkins  https://review.openstack.org/19430719:09
*** Longgeek has quit IRC19:09
*** rfolco_ has joined #openstack-infra19:10
*** HeOS has joined #openstack-infra19:10
*** esker has joined #openstack-infra19:11
openstackgerritMatthew Treinish proposed openstack-infra/devstack-gate: Fix the setup_workspace to handle missing ZUUL_BRANCH  https://review.openstack.org/19430219:11
*** ari has quit IRC19:12
openstackgerritDoug Hellmann proposed openstack/requirements: Add convenience tox environments  https://review.openstack.org/19430519:12
*** puranamr has quit IRC19:13
amullersdague: Fishing for reviews on a new Neutron test job: https://review.openstack.org/#/c/193906/19:13
*** puranamr has joined #openstack-infra19:13
amullersdague: I don't know if you remember but we talked about this in the Vancouver functional testing session19:13
openstackgerritMerged openstack-infra/project-config: puppet-gnocchi: enable beaker jobs  https://review.openstack.org/19371519:14
amullerwell, not that patch, but the idea of Neutron "fullstack" tests19:14
*** rwsu has quit IRC19:15
openstackgerritlifeless proposed openstack/requirements: Remove hacking and hacking-owned dependencies.  https://review.openstack.org/19292919:15
openstackgerritlifeless proposed openstack/requirements: Mark as Python2.7 only the dependencies that are.  https://review.openstack.org/18925019:15
openstackgerritlifeless proposed openstack/requirements: Add upper-constraints.txt.  https://review.openstack.org/18925119:15
lifelesssdague: so the underlying type is pacakging.specifiers.SpecifierSet19:15
lifelesssdague: and its __str__ not __repr__ is what pip uses for outputting specifiers too19:15
lifelesssdague: so its a stable API (packaging exists to be stable APIs in this space)19:15
sdaguefor __str__ ?19:16
lifelessyes19:16
sdagueand if it's a stable api, then it's not changable to the thing we want, right?19:16
lifelessits the human representation of the set19:16
lifelessmaking the human representation nicer is totally reasonable IMO19:16
lifelessI haven't had this specific discussion upstream of course19:16
lifelessbut I will be doing so19:17
dhellmannfungi, sdague, lifeless : it's a dependency on pep8, in fact, which is one of the things being removed. So apparently we're not ignoring it.19:17
*** agentle_ has quit IRC19:17
lifelessdhellmann: econtext, I stepped away to cook breakfast for cynthia19:17
dhellmannlifeless: https://review.openstack.org/#/c/192929/ is failing19:17
fungidhellmann: aha! you're right, tooz does test-depend on pep819:18
fungiand pyflakes19:18
fungiand flake819:18
fungiand not hacking19:18
*** agentle has joined #openstack-infra19:18
dhellmannyes, not all projects actually use hacking19:18
lifelessok so this is a valid error19:19
sdaguelifeless: ok, I still feel like this was a noticable regression for our community, and really wish this had been addressed before 100 requirements updates were pushed :{19:19
lifelessso I can special case the generator to exclude hacking and the things we know derive from hacking19:19
*** afazekas has quit IRC19:19
lifelesssdague: so - I discussed it before doing it on the list. I called it out specifically. I've committed to doing the thing that you've asked for.19:20
fungilifeless: yeah, that seems like a saner approach. basically don't error on hacking's reqs, but don't propose updates for them either19:20
sdagueok, I guess I missed that.19:20
lifelesssdague: I don't really know what I could have done better19:20
*** _nadya_ has joined #openstack-infra19:20
lifelessfungi: dhellmann: the problem is this19:20
*** puranamr has quit IRC19:21
lifelessonce we constrain a dep, its lockstep for everyone that subscribes to the constraints19:21
*** husanu has quit IRC19:21
*** puranamr has joined #openstack-infra19:21
lifelessso we don't want hacking in there because we'd end up upgrading everyone at once19:21
lifeless(or getting conflicts when they want a different version)19:21
lifelessbut equally we don't want pep8 *either*19:21
fungii think the same goes for any source code checking tool, yeah? (pep8, pyflakes, bashate, bandit...)19:22
funginot all repos are going to be working with the same versions of those19:22
dhellmannI agree. We just need to add to the list of things being ignored, right?19:22
mordredI honestly thnk we should lock-step people to hacking - and that upgrades to hacking should not cause carnage for people - HOWEVER - that is a dark rathole and I'm willing to ignore it for now19:23
*** husanu has joined #openstack-infra19:23
*** ihrachyshka has joined #openstack-infra19:23
lifelessyeah. its going to be a bit of whackamole19:23
yolandajeblair, but the creds we talked about on the step:  we move nodepool creds to nodepool.conf19:23
sdagueall the linters that follow those rules are at the end of the file already today19:23
mordredyolanda: yes19:23
yolandawere database and jenkins targets only19:23
sdagueso they should at least be easy to identify19:23
mordredyolanda: that's totally right19:23
mordredsdague: ++19:23
lifelessI'll push up a thing to have a constraints blacklist a little later today19:23
lifelessand seed it with the fragile linters19:23
lifeless(e.g. all but bandit)19:23
yolandamordred, so the final target is to make clouds.yaml mandatory19:24
yolanda?19:24
openstackgerritAndrey Pavlov proposed openstack/requirements: Add botocore to requirements  https://review.openstack.org/17233519:24
*** jasondot_ has joined #openstack-infra19:24
*** EricGonczer_ has quit IRC19:24
mordredyolanda: yes19:25
sdaguelifeless: can you link me the email in question describing the new line format on the requirements file so I can make sure there wasn't anything else I missed?19:25
*** crc32 has quit IRC19:25
openstackgerritDoug Hellmann proposed openstack/requirements: Add convenience tox environments  https://review.openstack.org/19430519:25
openstackgerritDoug Hellmann proposed openstack/requirements: Report bad package when found  https://review.openstack.org/19431119:25
*** jgrimm is now known as zz_jgrimm19:26
yolandamordred, then that change https://review.openstack.org/#/c/189762/ is the one needed19:26
yolandaapart from renaming file19:26
*** EricGonczer_ has joined #openstack-infra19:26
*** agentle has quit IRC19:27
sdaguedhellmann: on - https://review.openstack.org/#/c/194311/1/openstack_requirements/update.py,cm would it be possible to just stack up the non standard requirements and throw the exception outside of the for loop?19:27
mordredyolanda: yes. I think so - I've got it open and will review it in just a few19:27
sdagueI can imagine people having 3 of them in there, and spending all day removing them because it dies as soon as it finds one19:27
yolandamordred, i wanted to add a rename to it, to secure.conf really19:27
yolandabut wanted to check about the direction of it19:27
lifelesssdague: [all][requirements] Proposing a slight change in requirements.txt syncing output.19:27
lifelesssdague: was the thread; it didn't actually say 'and the specifiers will reorder' - sorry19:28
lifelesssdague: yes, I'm going to make the error better19:28
lifelesssdague: I saw how opaque it was late yesterday and just haven't had time to loop around and make it better19:28
sdaguelifeless: right, ok, I did read that email19:28
*** EricGonczer_ has quit IRC19:28
mordredyolanda:it looks generally good to me - I have not read it in-depth - but I think it's worth renaming it to secure.conf19:29
yolandayep19:29
*** ociuhandu has quit IRC19:29
yolandanibalizer, about the logrotate thing, well, we really were using /var/log/manage_projects.log on that call19:31
yolandaactually in downstream, seems that we made that work by manually creating the file...19:32
dhellmannsdague: probably19:32
yolandaso with your basename() cut there, you won't be removing the right file on absent19:32
yolandayou won't be covering all the cases, only the ones where logrotate was called without a full path19:33
nibalizerwhats the other case?19:33
sdaguedhellmann: I found that pattern kind of useful in stuff that doesn't run on people's laptops easily with the devstack jobs, because people get grumpy when they fix one thing, then immediately die on the next line.19:33
dhellmannsdague: yeah, I may leave that to lifeless to fix; he's got a lot of code churn going still, it seems19:33
*** rlandy has quit IRC19:34
yolandanibalizer, i know about the jeepyb situation, and that was called with full path. You were telling that logrotate was generally called without that full path, but i don't know why19:34
sdaguedhellmann: cool, that's fair. https://review.openstack.org/#/c/194311 is better than what we have, so I'm +2 on it19:34
yolandaso we will need for that change to cover both situations19:34
sdaguepulling it out a loop level would be better still19:34
*** rlandy has joined #openstack-infra19:35
*** e0ne is now known as e0ne_19:35
*** e0ne_ is now known as e0ne19:35
*** jtomasek has quit IRC19:37
yolandanibalizer, so also i think your change won't work for single path, look:19:37
yolandayou pass logrotate a single file name, such as manage_projects.log19:37
*** Longgeek has joined #openstack-infra19:37
yolandait creates /etc/logrotate.d/manage_projects.log, because there is nothing to replace19:37
yolandaand then19:37
*** achanda has quit IRC19:37
yolandayou ensure that /etc/logrotate.d/manage_projects.log is absent19:37
yolandaas basename(manage_projects.log) = manage_projects.log19:38
*** rwsu has joined #openstack-infra19:38
nibalizerhrm19:39
*** bexelbie has joined #openstack-infra19:39
nibalizeryea I'm not sure we even need my patch at all19:39
yolandanibalizer, we should ensure if absent if new path is different than old path19:39
*** marzif_ has joined #openstack-infra19:40
nibalizersince the logroate::file { 'puppetmaster': log => '/var/log/puppet/master_http.log' } works great as is19:40
nibalizeryolanda: did we have some patch where we needed this?19:40
*** rwsu has quit IRC19:40
nibalizerI'm pretty sure we don't need this patch19:40
*** tqtran_afk has quit IRC19:40
yolandanibalizer, we need the first part you ddi for the regsubst, that is needed19:40
*** rwsu has joined #openstack-infra19:40
yolandafor jeepyb for example, or for any system that tries to use logrotate with a full path, not a dir19:40
yolandanot a file19:40
yolandasorry19:40
yolandabut the second part of removal19:41
nibalizercan you link me to where we need that?19:41
openstackgerritlifeless proposed openstack/requirements: Add upper-constraints.txt.  https://review.openstack.org/18925119:41
openstackgerritlifeless proposed openstack/requirements: Teach the constraints generator about excludes.  https://review.openstack.org/19431419:41
yolandasure, fungi has one change depending on yours19:41
nibalizerwe should be able to use log => $full_path,19:41
yolandalet me see19:41
lifelesssdague: dhellmann: ^ 19431419:41
lifelessfungi: we'll need to add the new parameter to the periodic jbo19:41
*** tonytan4ever has quit IRC19:41
*** otter768 has joined #openstack-infra19:41
lifelessI'm just regenerating the initial upper-constraints19:42
*** tonytan4ever has joined #openstack-infra19:42
yolandanibalizer https://review.openstack.org/#/c/192187/19:42
yolandalook at the usage of logrotate there, it won't work without your patch19:42
openstackgerritMonty Taylor proposed openstack/requirements: Bump oslotest to 1.6.1 for functional tests  https://review.openstack.org/18338619:42
*** dustins_ has joined #openstack-infra19:42
yolandaas /etc/logrotate.d is currently expecting full path structure to be created, or crashes19:43
yolandathe intention of that ensure absent, was to clean old logrotate files that may be present there. As logrotate wasn't allowing full paths, we shouldn't have any, but for example, we in downstream have, because we created paths for it19:44
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add external plugin support to subunit2sql-graph  https://review.openstack.org/18650619:44
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add subunit2sql-graph plugin interface docs  https://review.openstack.org/19431619:44
nibalizeryolanda: I don't see where logrotate is being used there19:45
openstackgerritlifeless proposed openstack/requirements: Add upper-constraints.txt.  https://review.openstack.org/18925119:45
funginibalizer: you can also see the current puppet failures for review.openstack.org in puppetboard for an example of what happens19:45
yolandanibalizer, in fetch_remotes.pp19:45
*** dustins has quit IRC19:46
nibalizeroh now i do19:46
*** otter768 has quit IRC19:46
yolandahttps://review.openstack.org/#/c/192187/9/manifests/fetch_remotes.pp19:46
*** tonytan4ever has quit IRC19:46
fungilifeless: okay, i'll whip up an update to add that19:47
*** _nadya_ has quit IRC19:47
yolandai have a parallel change for that, the logrotate::fileremoval thing19:47
*** tonytan4ever has joined #openstack-infra19:47
*** _nadya_ has joined #openstack-infra19:47
yolandaalternative is to get rid of your absent stuff here, and add that fileremoval to the jeepyb change, enforcing the old buggy path to be absent19:47
yolandaif you prefer that19:48
lifelessfungi: cool19:48
openstackgerritMerged openstack/requirements: Bump eventlet version to 0.17.4  https://review.openstack.org/18183019:48
openstackgerritMerged openstack/requirements: Fix the empty string issue for pip  https://review.openstack.org/18265519:48
openstackgerritMerged openstack/requirements: Block oslo.messaging 1.12.0  https://review.openstack.org/18780819:48
lifelessI really need to port my integration improvements over from pbr19:49
nibalizeryolanda: okay howabout yea I'll get rid of absent19:50
nibalizerand we can go forward with your fileremoval stuff as a way to get rid of cruft19:50
lifelessso the error thing is particularly bad today because the actual helpful message isn't shown19:50
nibalizeri wonder how hard it is to make purging work19:50
lifelessbecause stdout is buffered19:50
lifelessand the process exits before flushing19:50
yolandait's just a corner case19:50
mordredlifeless: flushing is good19:50
lifelessits because I separated IO and logic19:51
lifelessthe error should be considered IO, not logic, the way its setup.19:51
openstackgerritOpenStack Proposal Bot proposed openstack-dev/hacking: Updated from global requirements  https://review.openstack.org/18682919:51
*** _nadya_ has quit IRC19:52
*** agentle has joined #openstack-infra19:52
*** flwang1 has quit IRC19:53
*** ihrachyshka has quit IRC19:54
*** bexelbie_ has joined #openstack-infra19:55
*** afazekas has joined #openstack-infra19:57
*** rkukura has joined #openstack-infra19:58
greghaynesSpamapS: So I just found something awesome19:59
openstackgerritMerged openstack/requirements: Add vmware-nsx to the tracked project list  https://review.openstack.org/19168519:59
greghaynesSpamapS: dmidecode has valid serial numbers for the hp1 servers19:59
openstackgerritMerged openstack/requirements: Add python-muranoclient to requirements  https://review.openstack.org/17720520:00
*** shardy has quit IRC20:00
openstackgerritMerged openstack/requirements: Add dragonflow to requirements  https://review.openstack.org/18914320:00
openstackgerritMerged openstack/requirements: New oslo library - oslo.service  https://review.openstack.org/19288620:00
*** shardy has joined #openstack-infra20:02
openstackgerritMerged openstack/requirements: Rename stackforge/octavia -> openstack/octavia  https://review.openstack.org/19233620:02
mordredgreghaynes: \o/20:02
*** agentle has quit IRC20:02
mordredgreghaynes: does that mean we can concretely correlate them with the HP NOC CMDB you think?20:03
greghaynesmordred: yes, that is by far the best way20:03
*** waynr has quit IRC20:03
russellbseems the requirements bot is adding blank lines to requirements.txt if anyone wants to try to fix it ... https://review.openstack.org/#/c/194323/1/requirements.txt,cm20:03
greghaynesmordred: I'm going to add it to our inventory script to make sure all the servers have it, but seems like they should20:03
greghaynes(I just checked the bastion)20:03
greghaynesmordred: SpamapS TheJulia So that ^ resolves my issue with replacing NIC's before inventory, we should be able to double check the info they give up with dmidecode20:04
mordredgreghaynes: ++20:05
mordredgreghaynes: (glean? worked? can I land patch and cut release?)20:05
greghaynesmordred: I should know in ~5min, I had to do epic battle with source-repositories to get tha patch in the image20:06
greghaynesafter going through the whole build, upload, boot cycle and realizing it was using glean from master20:06
*** marzif_ has quit IRC20:07
mordredgreghaynes: oh wow20:07
mordredgreghaynes: maybe I should have just landed the patch first ;)20:07
greghaynesheh, the server is booting right now, so if I failed this time we can do that20:07
openstackgerritAleksandra Fedorova proposed openstack-infra/project-config: Allow Merge Commits to fuel-docs repo  https://review.openstack.org/19433820:07
*** fallenpegasus has quit IRC20:08
greghaynesmordred: it has networking!20:08
mordredgreghaynes: WOOT!20:08
mordredjeblair: ^^20:08
greghaynesmordred: theres also https://review.openstack.org/#/c/194260/ which is unimportant but related20:10
*** rwsu has quit IRC20:10
*** fallenpegasus has joined #openstack-infra20:11
SpamapSgreghaynes: Oh, I thought you knew that. :)20:12
greghaynesSpamapS: hah, maybe I did and unlearned20:12
openstackgerritMerged openstack-infra/glean: Use interfaces.d on debian distros  https://review.openstack.org/19423320:13
*** crc32 has joined #openstack-infra20:13
*** crc32 has quit IRC20:13
*** puranamr has quit IRC20:14
*** signed8bit has joined #openstack-infra20:14
*** gordc_afk is now known as gordc20:15
bookwarhi, i need help with this Merge Commits patch up there, basically i need to merge current master to stable/6.1 branch in stackforge/fuel-docs repo, so as i understood the only way to do it is to first allow must allow merge commits, and then create one20:15
*** puranamr has joined #openstack-infra20:17
*** jasondotstar has quit IRC20:18
*** afazekas has quit IRC20:19
mordredgreghaynes, SpamapS, jeblair, fungi: I'm going to release glean. anybody think 1.0.0 is too cheeky?20:19
greghaynesdoit doit doit20:19
mordredI mean, with this patch it'll be in production for infra ... so we REALLY shouldn't break things20:20
*** afazekas has joined #openstack-infra20:21
greghaynesthats an interesting idea20:21
mordredwhat, breaking things?20:22
greghaynesor not doing that20:22
mordredyah20:22
mordrednot breaking things is a great idea20:22
*** fitoduarte has quit IRC20:23
fungimordred: seems fine to me20:23
mordredDONE20:23
openstackgerritMerged openstack-infra/project-config: Translations: Update horizon  https://review.openstack.org/19424620:23
mordredfungi: so, once that exists and we do another round of image builds, we should have live images20:23
*** crc32 has joined #openstack-infra20:24
mordredfungi: I think that means next step is to start trying devstack runs on those images20:24
mordredyeah?20:24
*** mriedem_afk is now known as mriedem20:24
fungia grand idea if i've ever heard one20:25
greghaynesyep, once they boot :)20:26
openstackgerritlifeless proposed openstack/requirements: Teach the constraints generator about excludes.  https://review.openstack.org/19431420:27
openstackgerritlifeless proposed openstack/requirements: Mark as Python2.7 only the dependencies that are.  https://review.openstack.org/18925020:27
openstackgerritlifeless proposed openstack/requirements: Add upper-constraints.txt.  https://review.openstack.org/18925120:27
openstackgerritlifeless proposed openstack/requirements: Show not-in-global errors again.  https://review.openstack.org/19434920:27
openstackgerritlifeless proposed openstack/requirements: Remove unused test requirement toposort.  https://review.openstack.org/19435020:27
openstackgerritlifeless proposed openstack/requirements: Manual update run to get things aligned.  https://review.openstack.org/19435120:27
lifelesssdague: error handling cleanup ^. also the merges into requirements made the whole stack rebase :(20:27
*** Sukhdev has joined #openstack-infra20:27
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Alpha-sort the cacti host list  https://review.openstack.org/19198920:27
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Add apps.openstack.org to cacti  https://review.openstack.org/19199020:27
fungidocaedo: fixed ^20:28
*** mwagner_afk has quit IRC20:29
*** rossella_s has quit IRC20:30
*** rossella_s has joined #openstack-infra20:31
openstackgerritMerged openstack/requirements: Updating taskflow to >= 0.11.0  https://review.openstack.org/19234320:31
*** dustins_ has quit IRC20:32
*** jasondot_ has quit IRC20:33
*** Sukhdev has quit IRC20:33
*** Rockyg has quit IRC20:34
*** bexelbie has quit IRC20:36
*** Sukhdev has joined #openstack-infra20:36
*** bexelbie_ has quit IRC20:36
*** ivar-lazzaro has joined #openstack-infra20:38
*** ivar-lazzaro has quit IRC20:38
*** dprince has quit IRC20:38
*** mestery has joined #openstack-infra20:38
*** armax has joined #openstack-infra20:38
*** dizquierdo has joined #openstack-infra20:39
BobBallHas something changed with permissions lately?  Getting an error when running tox -esmoke saying permission denied on /opt/stack/.cache/pip/wheels/00/dc20:39
*** marcusvrn has quit IRC20:41
*** ivar-lazzaro has joined #openstack-infra20:41
*** puranamr has quit IRC20:42
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Use blacklist support in generate-constraints  https://review.openstack.org/19436320:43
fungilifeless: there we go ^20:43
*** puranamr has joined #openstack-infra20:43
*** dboik has quit IRC20:43
*** dboik has joined #openstack-infra20:43
docaedofungi: ah damn, I was hoping I could turn your one line commit into 20+ patch sets, I was just getting started!20:44
docaedofungi: (thank you :) )20:45
*** puranamr has quit IRC20:45
*** rguillebert has joined #openstack-infra20:45
greghaynesSpamapS: So im curious just so I know the state of things - ipxe was being a pain because as is bifrost doesnt work with mellanox for that? And also, I dont remember what didnt work about pxe other than the likely iptables + dnsmasq deal, does bifrost not support that?20:45
fungidocaedo: sure thing--thanks for spotting it needed a rebase20:45
*** hodos|2 has joined #openstack-infra20:46
*** yamahata has quit IRC20:46
openstackgerritSpencer Krum proposed openstack-infra/puppet-logrotate: Make logrotate::file more resilient  https://review.openstack.org/18937820:46
fungiBobBall: what job? that sounds like a sudo pip where we need to sudo -H pip20:46
nibalizeryolanda: fungi see changes on 17937820:47
*** puranamr has joined #openstack-infra20:47
*** shardy has quit IRC20:47
*** shardy has joined #openstack-infra20:47
funginibalizer: clearly you mispaste20:48
openstackgerritSpencer Krum proposed openstack-infra/puppet-logrotate: Make logrotate::file more resilient  https://review.openstack.org/18937820:48
fungitry again?20:48
fungiaha, that one20:48
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/devstack-gate: Add new oslo libraries  https://review.openstack.org/19436720:48
nibalizerfungi: probably20:48
fungiyou were off by a digit20:48
nibalizerah here  https://review.openstack.org/18937820:48
nibalizeri probably tried to type it and got distracted mid type20:48
lifelesssdague: still around?20:48
lifelesssdague: 2015-06-22 19:35:16.802 | Collecting pbr!=0.7,<1.0,>=0.6 (from keystonemiddleware<1.6.0,>=1.5.0)20:48
lifeless2015-06-22 19:35:16.892 |   Downloading http://pypi.region-b.geo-1.openstack.org/packages/py2.py3/p/pbr/pbr-0.11.0-py2.py3-none-any.whl (78kB)20:48
lifelesshttp://logs.openstack.org/50/189250/42/check/check-grenade-dsvm/af38171/logs/grenade.sh.txt.gz#_2015-06-22_19_35_16_80220:49
*** Sukhdev_ has joined #openstack-infra20:49
lifelesssdague: we're ending up with old pbr in grenade - http://logs.openstack.org/50/189250/42/check/check-grenade-dsvm/af38171/logs/grenade.sh.txt.gz#_2015-06-22_19_54_23_78820:49
*** afazekas has quit IRC20:50
lifelesssdague: thats with ceilometermiddleware releases20:50
BobBallfungi: Internal CI. Why is the -H needed out of interest?20:50
fungiBobBall: without -H sudo doesn't update $HOME20:51
nibalizerI have a nodepool running that can't create its base images, this seems to be the error: http://paste.ubuntu.com/11759102/ any ideas?20:51
fungiBobBall: and pip creates a $HOME/.cache/pip20:51
lifelesssdague: but I'm not sure whats going on there20:52
*** Sukhdev__ has joined #openstack-infra20:52
*** Sukhdev has quit IRC20:52
BobBallok.  I found a "sudo pip install tox=1.6.1" in our scripts; will try updating that first20:52
fungiBobBall: so you end up with pip trying to write to what looks like ~stack/.cache instead of ~root/.cache20:52
BobBall*nod* ok, thanks20:53
BobBallProbably the culprit - appreciated!20:53
lifelessmodern pip will actually complain about this20:53
lifelessIIRC20:53
*** gordc has quit IRC20:53
*** shardy has quit IRC20:53
openstackgerritMerged openstack/requirements: Bump cliff to 1.13.0  https://review.openstack.org/19284820:53
fungiBobBall: and then later when stack tries to update ~/.cache it can't because root owns some of the files20:53
openstackgerritMerged openstack/requirements: Bump kazoo to greater than or equal to 2.2  https://review.openstack.org/19205020:53
openstackgerritMerged openstack/requirements: Bump python-troveclient version to 1.0.9  https://review.openstack.org/19197720:53
BobBallok thanks!20:53
*** shardy has joined #openstack-infra20:53
*** gordc has joined #openstack-infra20:54
fungiBobBall: basically we just went through devstack and devstack-gate and project-config and peppered any calls to sudo ... pip with -H for good measure20:54
*** nihilifer has quit IRC20:54
fungiso that we don't write (or try to write) pip caches as the wrong users in the wrong homedirs20:55
jeblairsudo -H make me a sandwich20:55
fungijeblair: unfortunately that only works if you're at $HOME20:55
*** esmute__ has quit IRC20:55
*** salv-orlando has joined #openstack-infra20:56
*** sdake_ has quit IRC20:56
fungiotherwise you'll be asking the server at the sandwich shop where your food is and they'll say they sent it home for you20:56
*** Sukhdev_ has quit IRC20:56
*** mestery has quit IRC20:56
*** yamahata has joined #openstack-infra20:56
jeblairthis is so confusing20:56
openstackgerritBrian Exelbierd proposed openstack-infra/yaml2ical: Update docs to indicate requirements and expand example meeting  https://review.openstack.org/19437520:57
*** bexelbie has joined #openstack-infra20:58
*** bexelbie has quit IRC20:58
*** afazekas has joined #openstack-infra20:58
*** pc_m has quit IRC20:59
pleia2anyone have thoughts on this patch? https://review.openstack.org/#/c/170700/ to me it feels like adding redhat-specific dependencies implies that's the recommended way that we use it, but we don't, we use ubuntu with dependencies defined in puppet20:59
*** jasondotstar has joined #openstack-infra20:59
pleia2so if anything, I'd say we should add Ubuntu dependencies in a subsequent patch20:59
jeblairmtreinish: i'm not sure what would have caused that to change21:00
jeblairmtreinish: do you know the last time a periodic job worked?21:00
adam_goh, speaking of sudo -H, anyone have a sec for this trivial? https://review.openstack.org/#/c/194282/  our jobs borked over the weekend21:00
*** marcusvrn_ has joined #openstack-infra21:00
*** hichihara has joined #openstack-infra21:01
funginibalizer: see my inline comment on 18937821:01
jeblairmtreinish: (i worry about fixing it with your patch when we don't know the problem yet)21:01
mtreinishjeblair: I can dig through the email logs to find when it was last working21:01
*** dizquierdo has quit IRC21:01
mtreinishbut it's been in this broken state since before summit iirc21:01
mriedemproject-config can have jobs in the experimental queue right?21:01
mriedemit just doesn't today21:01
fungimriedem: right21:02
mriedemhot dog21:02
fungimriedem: any repo can have experimental pipeline entries21:02
mriedemfungi: so we want to wittle this regex list down for the cells job: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/devstack-gate.yaml#n100421:02
mriedembut i'm not sure how to do that right now w/o the cells job running in the experimental queue on project-config while we push changes to remove entries in that regex list21:03
*** e0ne has quit IRC21:03
*** mestery has joined #openstack-infra21:03
mriedemunless we can move the regex to devstack21:03
mtreinishjeblair: the first failure caused by this was on May 12th: http://lists.openstack.org/pipermail/openstack-qa/2015-May/001425.html21:03
fungimriedem: yeah, i think you need to move that regex into devstack or devstack-gate. job config changes aren't self-testing21:03
mtreinishon the 11th ran as expected: http://lists.openstack.org/pipermail/openstack-qa/2015-May/001424.html21:03
asselinjeblair, can you remove your -1 here? test cases are on depedent patch.21:03
asselinjeblair, https://review.openstack.org/#/c/188383/21:03
mriedemfungi: ah, ok21:04
mriedemalaski: ^ nuts21:04
jeblairasselin: marked for later, will do, thanks21:04
alaskimriedem: okay21:04
fungimriedem: alaski: that's another thing we're expecting to improve with zuul v321:04
lifelesspleia2: should be a bindep file :)21:04
jeblairmtreinish: let's pick a job to look at... all-master? )21:04
*** bhunter71 has joined #openstack-infra21:04
mriedemalaski: and devstack-gate has the old school exercises devstack job in it's check queue for cells, but not the cells tempest job in it's experimental queue21:05
fungioh, right, i was going to get back to wrapping up our bindep implementation and somehow got sucked into code review instead21:05
mriedemalaski: so i propose that we just add the cells tmepest job to d-g experimental queue, then move the regex into d-g and wittle from there21:05
pleia2lifeless: heh :)21:05
mtreinishjeblair: sure, all-master is fine21:05
openstackgerritSpencer Krum proposed openstack-infra/puppet-logrotate: Make logrotate::file more resilient  https://review.openstack.org/18937821:05
alaskimriedem: yep, sounds right to me21:05
mtreinishjeblair: but the pattern should be the same on all of them: http://logs.openstack.org/periodic-qa/periodic-tempest-dsvm-all-master/f2639ff/logs/devstack-gate-setup-workspace-new.txt.gz#_2015-05-12_06_04_38_42121:05
pleia2lifeless: honestly I'd be ok linking to our puppet module for nodepool in these docs, just something that doesn't make it feel like we're telling people to install it on RHEL21:06
jeblairmtreinish: the first failure though, should be because of the change to zuul-cloner which should have been fixed, so we may have two issues here21:06
*** doug-fish has left #openstack-infra21:06
*** e0ne has joined #openstack-infra21:06
*** ParsectiX has quit IRC21:08
*** e0ne has quit IRC21:09
*** rwsu has joined #openstack-infra21:10
mtreinishjeblair: which change was that? because I was looking through the git logs and nothing in zuul from between the 11th job and the 12th job looked like it would have broken anything21:10
jeblairmtreinish: it was a change to project-config; initially it left off ZUUL_BRANCH which was needed, but that has since been corrected21:10
EmilienMany zuul-cloner expert could look at https://review.openstack.org/#/c/194293/1 and give me some feedback? I'm probably doing the wrong way21:11
*** puranamr has quit IRC21:12
*** puranamr has joined #openstack-infra21:12
*** flwang has joined #openstack-infra21:13
jeblairEmilienM: i've flagged it to review later if no one else gets back to you first21:13
hodos|2hi guys, does 'recheck' restarts gate checks ?21:14
*** ldnunes has quit IRC21:15
lifelesshodos|2: yes21:15
EmilienMjeblair: thank you21:15
*** tonytan4ever has quit IRC21:16
markvan_Hi, zuul-cloner question.  Can it be usd to pull in gerrit patches  (git review -d <patchid>)   to handle cases where one gerrit review depends on another review in a different project?21:16
fungimarkvan_: if you declared depends-on in the commit message, then yes21:17
EmilienMmarkvan_: you might want to use Depends-On21:17
fungimarkvan_: zuul will generate a ref matching $ZUUL_REF for the repo that is the target of your depends-on in that case21:18
jeblairmtreinish: https://review.openstack.org/184111 and https://review.openstack.org/194302 are the project-config changes21:18
fungii'm going to go get some dinner before tourists completely overrun the restaurants, then try to hack on bindep implementation when i get back21:19
mtreinishjeblair: heh, well that second one is mine21:19
markvan_Humm, ok, that's kinda what I thought, but what does Depends-On actually do?   I need to download the other patch and then do some processing to get into the berks cookbook cache.   Where does it download it to?21:19
jeblairmtreinish: sorry21:19
*** aysyanne has quit IRC21:19
jeblairmtreinish: https://review.openstack.org/18931321:19
*** esmute__ has joined #openstack-infra21:19
mtreinishjeblair: so neither of those landed when the jobs started failing21:20
*** sarob has quit IRC21:20
fungia question to ponder in my absence... do we want to preinstall bindep into a /usr/bindep-env on all the workers, or do something like `tox -env venv pip install bindep && .tox/venv/bin/bindep ...`  in our jobs?21:20
*** marzif_ has joined #openstack-infra21:20
fungii'm leaning toward the former, but the latter would leave some additional job runtime flexibility21:20
fungianyway, bbiaw21:20
jeblairfungi: i also lean toward former21:20
*** juggler has joined #openstack-infra21:21
*** tlian has quit IRC21:21
openstackgerritBrian Exelbierd proposed openstack-infra/yaml2ical: Update docs to indicate requirements and expand example meeting  https://review.openstack.org/19437521:21
*** rlandy has quit IRC21:22
jeblairmtreinish: https://review.openstack.org/177017 did land then, and affects the exit code processing of the setup script21:22
*** esmute__ has quit IRC21:22
jeblairianw, sdague, mordred: ^21:23
jeblairlast success: http://logs.openstack.org/periodic-qa/periodic-tempest-dsvm-all-master/92543ab/logs/devstack-gate-setup-workspace-new.txt.gz21:23
jugglerhello...is this the correct channel regarding questions pertaining to usability of the page: https://www.openstack.org/community/jobs/21:23
jeblairfirst failure: http://logs.openstack.org/periodic-qa/periodic-tempest-dsvm-all-master/f2639ff/logs/devstack-gate-setup-workspace-new.txt.gz21:23
jeblairmtreinish, ianw, sdague, mordred: it looks like the benign exit code from sed is causing the setup script to fail21:24
pleia2juggler: unfortunately not, you might want to ask someone at the foundation, perhaps in #openstack-community21:25
jugglerthank you pleia221:25
dougwighi infra.  lots of churn in proposal bot's reviews today, but no real changes.  are we iterating a dictionary now something to build the file?21:25
mtreinishjeblair: ah, so it probably wasn't right before but it just didn't fail until that patch21:26
*** esmute__ has joined #openstack-infra21:26
*** jasondotstar has quit IRC21:27
*** ociuhandu has joined #openstack-infra21:27
*** hasharAway has quit IRC21:27
*** jasondotstar has joined #openstack-infra21:28
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Add check-tempest-dsvm-cells to experimental queue for devstack-gate  https://review.openstack.org/19439221:28
*** afazekas has quit IRC21:28
*** baoli has quit IRC21:28
*** puranamr has quit IRC21:29
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Add check-tempest-dsvm-cells to experimental queue for devstack-gate  https://review.openstack.org/19439221:29
mriedemalaski: melwitt: mtreinish: ^21:30
jeblairdougwig: requirements?21:30
*** ashleighfarnham has quit IRC21:30
dougwigjeblair: aye. looks like we're either doing space normalization and reordering min/max to be max/min, or something else is up.21:31
jeblairdougwig: i think lifeless has been digging around in there21:31
dougwigjeblair: check out the pbr line here: https://review.openstack.org/#/c/193992/2/requirements.txt,unified21:31
lifelesssomeone said my name21:31
lifelessdougwig: see my mail to the list21:32
*** esmute__ has quit IRC21:32
dougwiglifeless: i expected the space normalizing, not the order swap.  as long as it's consistent, it's all good.21:32
*** eharney has quit IRC21:32
*** ashleighfarnham has joined #openstack-infra21:33
lifelessdougwig: at least while we're on 2.7 its going to be consistent. Its possible the underlying library isn't entirely stable with set ordering, and if thats the case I'll submit a fix there and bubble it up if-and-when that happens.21:33
lifelessdougwig: the code works on the normalised values already, it won't propose a change because of churn21:33
dougwiglifeless: ok, i'll merge these then.  thanks.21:34
lifelesserm, actually no it probably does. Anyhow - its going to be stable for now; infrastructure environment changes may affectthat in time21:34
*** jasondot_ has joined #openstack-infra21:37
*** rfolco_ has quit IRC21:37
*** fallenpegasus has quit IRC21:37
*** rfolco has quit IRC21:37
*** dkranz has quit IRC21:38
markvan_fungi:  any doc/wiki/source for how Depends-On works, I think I might need to extend it a bit to make cross cookbook project patchs work, thx21:38
jeblairmarkvan_: how so?21:39
*** fallenpegasus has joined #openstack-infra21:39
jeblairmarkvan_: here is how to use zuul-cloner in a job; that's the right way to get repositories set up so that they respect the depends-on header: http://docs.openstack.org/infra/manual/drivers.html#integration-tests21:39
markvan_In order for one cookbook to "find" another, it needs to be setup correctly in the berks cache correctly.21:39
jeblairmarkvan_: ah yeah, so you should look into figuring out how to have zuul-cloner set up some git repos and have berks use them21:40
*** dboik has quit IRC21:40
*** Sukhdev__ has quit IRC21:40
markvan_yup, that's the idea I'm going after.21:40
*** dboik has joined #openstack-infra21:41
*** Sukhdev has joined #openstack-infra21:41
markvan_  How do I get at Depends-On info from the job/script?  More ENV vars somewhere?21:41
*** ParsectiX has joined #openstack-infra21:41
mtreinishmriedem: so sure you can make the regex cleaner, but my argument is still that tempest should still be able to divine the set of working tests from the config21:41
jeblairmarkvan_: no, you shuld not worry about depends-on; zuul handles that for you.  instead, tell zuul-cloner "i want to run a test with these repos" and zuul-cloner checks out the right revisions into the right locations for you21:42
mtreinishso we still try to eliminate the need for a regex21:42
*** weshay has quit IRC21:42
*** otter768 has joined #openstack-infra21:42
mriedemmtreinish: yeah, i know/agree :)21:42
openstackgerritlifeless proposed openstack/requirements: Teach the constraints generator about excludes.  https://review.openstack.org/19431421:43
openstackgerritlifeless proposed openstack/requirements: Show not-in-global errors again.  https://review.openstack.org/19434921:43
openstackgerritlifeless proposed openstack/requirements: Mark as Python2.7 only the dependencies that are.  https://review.openstack.org/18925021:43
openstackgerritlifeless proposed openstack/requirements: Add upper-constraints.txt.  https://review.openstack.org/18925121:43
openstackgerritlifeless proposed openstack/requirements: Manual update run to get things aligned.  https://review.openstack.org/19435121:43
openstackgerritlifeless proposed openstack/requirements: Remove unused test requirement toposort.  https://review.openstack.org/19435021:43
jeblairmarkvan_: for inspiration, you can look at our integration test the openstack-infra puppet: http://git.openstack.org/cgit/openstack-infra/system-config/tree/tools/apply-test.sh#n22  lines 22-28 and then lines 52-5521:43
*** zigo has quit IRC21:43
jeblairmarkvan_: it uses a feature of zuul-cloner to map the repository names into specific filesystem locations using a regex21:43
*** Longgeek has quit IRC21:43
*** ayoung has quit IRC21:44
jeblairmarkvan_: at any rate, the high-level steps are "get zuul cloner to put git repos in the right place" then "get your test to use those git repos"21:44
openstackgerritMerged openstack/requirements: Add senlin and its client to project list  https://review.openstack.org/18050121:44
jeblairmarkvan_: but you should definitely use zuul-cloner, because it's dealing with a huge amount of complexity for you21:44
markvan_jeblair: interesting....what is the link between zuul cloner and pointing at a Depends-On gerrit patch?   I tried the using the Depends-On, but did not see any activity in the log with regards to getting the dependency gerrit patch downloaded, looks like I'm missing something obvious here21:46
mtreinishjeblair: so getting back to the periodic job thing, so moving forward should I keep working on my patch? Or should we take a different approach?21:46
jeblairmarkvan_: zuul processes depends-on headers when constructing it's internal proposed future state of all repositories; so when zuul-cloner checks out the refs that zuul supplies, it will include those changes.21:46
*** esmute__ has joined #openstack-infra21:46
jeblairmtreinish: probably fixing the 'sed' thing is the easiest delta21:47
*** otter768 has quit IRC21:47
*** bdemers has quit IRC21:48
markvan_jeblair: where in the /home/jenkins/workspace/ do those ref checkouts go?   I was expecting to see the ones from another project go into a separate sub dir21:48
*** melwitt has quit IRC21:48
mtreinishman, the unit test output from d-g isn't the easiest thing to read21:48
*** zigo has joined #openstack-infra21:49
openstackgerritMerged openstack/requirements: Revert "Revert "Add heat-translator to global requirments projects""  https://review.openstack.org/19199221:49
jeblairmarkvan_: it is configurable with zuul-cloner; i believe by default it puts them in the working directory with the full repo name, so if you did nothing else, the openstack/foo project would end up in /home/jenkins/workspace/openstack/foo'21:50
openstackgerritMerged openstack/requirements: Add python-ironic-inspector-client to projects.txt  https://review.openstack.org/19306121:50
openstackgerritMerged openstack/requirements: Add python-ironic-inspector-client to global-requirements  https://review.openstack.org/19312221:50
jeblairmarkvan_: here's the docs for zuul-cloner itself: http://docs.openstack.org/infra/zuul/cloner.html21:50
openstackgerritRyan Bourgeois proposed openstack-dev/pbr: Support git://, git+ssh://, git+https:// without -e flag. Closes-Bug: 1467683  https://review.openstack.org/19440521:50
openstackbug 1467683 in PBR "PBR Ignores git://, git+ssh://, git+https:// Requirement Lines" [Undecided,New] https://launchpad.net/bugs/1467683 - Assigned to Ryan Bourgeois (bluedragonx)21:50
jeblairmarkvan_: if that hierarchy works for you, you can just 'cd' to whichever directory you want them based in; if you need to do something more complicated (like strip the prefix, etc), the clonemap is the way to go21:51
*** dizquierdo has joined #openstack-infra21:51
*** jbernard has quit IRC21:52
markvan_jeblair: thx. yup, been reading those.   And yes, if that's where they are put, it should be easy to adjust the berks to look for them there, that one "glue" step is needed21:52
*** kgiusti has quit IRC21:52
*** kevinbenton has quit IRC21:52
*** swat30 has quit IRC21:52
*** ruagair has quit IRC21:54
*** jasondotstar has quit IRC21:54
*** nihilifer has joined #openstack-infra21:54
*** ruagair has joined #openstack-infra21:54
*** kevinbenton has joined #openstack-infra21:54
*** TheJulia has quit IRC21:55
*** esmute__ has quit IRC21:55
*** TheJulia has joined #openstack-infra21:55
*** jasondotstar has joined #openstack-infra21:55
markvan_jeblair: humm, looking at my logs for a Depends-On run, I don't see any other dirs under /home/jenkins/workspace/, and I don't see any activity in the logs about a clone activity of the Depends-On ref.  I did see that in the zuul status, it did show the 2 patches stacked and connected.21:56
*** rkukura has quit IRC21:56
jeblairmarkvan_: have a link to the logs?21:56
*** swat30 has joined #openstack-infra21:56
markvan_Is there anything special a project (https://github.com/openstack?utf8=%E2%9C%93&query=cookbook) have to do make this work?21:57
jeblairmarkvan_: and the job config21:57
markvan_https://jenkins04.openstack.org/job/gate-cookbook-openstack-bare-metal-chef-rake/8/console21:57
*** rkukura has joined #openstack-infra21:57
*** mtanino has quit IRC21:57
jeblairmarkvan_: i don't see zuul-cloner being invoked21:57
markvan_job: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/chef-jobs.yaml#L2321:58
markvan_it's just doing a gerrit-git-prep21:58
*** jbernard has joined #openstack-infra21:58
markvan_so, that's where the 'glue' code is needed to make Depends-On work?21:58
*** ParsectiX has quit IRC21:58
*** esmute__ has joined #openstack-infra21:59
*** fawadkhaliq has joined #openstack-infra21:59
jeblairmarkvan_: yes, you need to switch from using gerrit-git-prep to invoking zuul-cloner with a list of all the repos that you are interested in21:59
*** isviridoz is now known as isviridov_away22:00
*** melwitt has joined #openstack-infra22:00
markvan_jeblair: thx, much I think I get it now, we'll head down that road22:00
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Use DEVSTACK_GATE_SETTINGS in tempest-dsvm-cells job definition  https://review.openstack.org/19441022:01
*** esmute__ has quit IRC22:01
david-lyleI have a pypi publishing question. I have tagged a couple of xstatic-* repos with a version number of say 0.2.0.1 where 0.2.0 represents the upstream version of the library packaged in the xstatic repo and the final .1 is a new version of that which fixes licensing issues22:01
david-lylewhen I pushed the tag, the automated script to publish to pypi did not pick up the change22:01
david-lyleis there a way to do this manually?22:02
david-lylehttps://github.com/stackforge/xstatic-magic-search/tree/0.2.0.122:02
david-lyleis one example22:02
*** dboik_ has joined #openstack-infra22:02
lifelessdavid-lyle: is that package using pbr? pbr doesn't support 4-element versions today22:03
*** esmute__ has joined #openstack-infra22:03
lifelessdavid-lyle: so its possible that that caused an explosion22:03
*** mancdaz has quit IRC22:04
david-lylelifeless the xstatic package is not using pbr internally22:04
clarkbI think zuul only accepts what pbr accrpts now22:05
clarkbso the tag is in git but doesnt trigger release jobs22:05
*** agentle has joined #openstack-infra22:06
david-lylehmm, would publishing that tag to pypi be bad otherwise?22:06
*** dboik has quit IRC22:06
*** tvanderwiel has quit IRC22:06
clarkbits not valid semvrr ehich is ehat zuul accepts22:06
*** sigmavirus24 is now known as sigmavirus24_awa22:06
*** mancdaz has joined #openstack-infra22:06
david-lyleok22:07
*** dboik_ has quit IRC22:07
clarkbor rather zuul accepts the intersection of semver and pep44022:07
*** rossella_s has quit IRC22:07
*** jasondotstar has quit IRC22:07
*** dizquierdo has quit IRC22:08
david-lyleso my options are create a new tag that doesn't directly map to upstream library version, have the owner push what's there and watch the world burn, or ?22:08
*** afazekas has joined #openstack-infra22:08
david-lyleseems like 1 is the only real choice?22:09
clarkbor we make a new release pipeline for thibgs that dont care22:09
*** amitgandhinz has quit IRC22:11
*** dizquierdo has joined #openstack-infra22:11
david-lyleseem like we've push some other packages with the same versioning scheme22:12
*** fawadkhaliq has quit IRC22:12
*** Longgeek has joined #openstack-infra22:12
david-lylewe being horizon developers22:12
clarkbiirc a lot of them (xstatic) were manually managed on pypi22:12
*** jasondot_ has quit IRC22:12
david-lyleclarkb: yes22:12
jeblairi think there's already a tag pipeline?22:13
*** afazekas has quit IRC22:13
*** zigo has quit IRC22:15
*** marzif__ has joined #openstack-infra22:16
*** timothyb89 has joined #openstack-infra22:17
*** zigo has joined #openstack-infra22:17
david-lylejeblair: but it doesn't publish tags that only change semver supported tags, so my 0.2.0.1 will never publish unless done manually. I guess my question is should I propose a change to support publishing more version depth, or work to change all of horizon xstatic tags to be more compliant?22:19
*** esmute__ has quit IRC22:19
*** marzif_ has quit IRC22:19
david-lyleerr, only supports22:20
david-lylenot sure what I started out typing there22:20
*** esmute__ has joined #openstack-infra22:20
*** marzif__ has quit IRC22:21
jeblairdavid-lyle, clarkb: we did not merge this change: https://review.openstack.org/#/c/180660/122:21
jeblairare we sure that's the problem?22:22
clarkboh then no not sure22:22
jeblair          ref: ^refs/tags/[0-9]+(\.[0-9]+)*$22:22
jeblairis the current regex22:22
lifelessis there a log of the job that would have fired somewhere?22:23
clarkbyes logs.o.o/first2ofsha1/sha122:23
*** whoops has quit IRC22:23
*** esmute__ has quit IRC22:24
lifelesshow do we figure out the sha1 there, for a new tag ?22:24
*** fawadkhaliq has joined #openstack-infra22:24
david-lyleit's happened to more than one package, I'm discovering22:24
*** mestery has quit IRC22:25
clarkblifeless git show-ref iirc22:25
lifelessdavid-lyle: okso - git show-ref that tag22:26
lifelessdavid-lyle: then we can look atthe log22:26
*** tjones1 has joined #openstack-infra22:27
*** armax has quit IRC22:27
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test dracut ramdisks  https://review.openstack.org/17255422:27
*** chlong has quit IRC22:29
*** waynr has joined #openstack-infra22:34
openstackgerritDavid Lenwell proposed openstack-infra/infra-specs: Spec to host refstack.org in infra  https://review.openstack.org/18820722:36
*** camunoz has joined #openstack-infra22:36
*** fallenpegasus has quit IRC22:36
jeblairdavidlenwell: oh i was just reviewing that22:36
davidlenwellsorry .. we changed something based on a vote in todays meeting..22:37
davidlenwellsimplified the hosting to one domain rather than two22:37
davidlenwelljeblair: ^22:37
jeblairoh ok22:37
openstackgerritMichael Krotscheck proposed openstack-infra/project-config: Added ironic-webclient to OpenStack  https://review.openstack.org/19442422:37
*** stevemar has quit IRC22:37
*** dizquierdo has quit IRC22:38
*** husanu has quit IRC22:38
davidlenwelljeblair: should be good now..22:39
jeblairdavidlenwell: i have a couple of really minor things (at least, i think they are minor, if they are not, then it'll be good i'm mentioning them :)22:39
davidlenwelloh.. I'll look at your comments22:39
jeblairalmost done22:40
*** husanu has joined #openstack-infra22:40
*** cburroughs has quit IRC22:40
jeblairdavidlenwell: ok, posted comments on ps1022:40
jeblairdavidlenwell: changes in ps11 look good; my comments in ps10 still apply22:41
davidlenwellhow are trove databases sized?22:41
davidlenwelllike by disk space allocated or by cpu/memory footprint?22:42
*** spzala has quit IRC22:42
jeblairdavidlenwell: primarily by disk i think22:42
davidlenwellahh.. well we don't have a lot of data to start with .. but that will change when the foundation makes all the vendors submit results22:42
bookwargate-infra-puppet-apply-centos6 for one line change in acl fails three times in a row. Is it a known issue? https://review.openstack.org/#/c/194338/22:42
jeblairprobably a du on the directory would get us in the right ballpark?  (i honestly don't know what that value exactly corresponds to in trove)22:42
*** salv-orlando has quit IRC22:42
jeblairbookwar: sadly, yes, there is something weird about git on centos that causes it to time out; no one has figured out what it is yet22:43
*** jasondotstar has joined #openstack-infra22:43
bookwari see, thanks22:44
*** bookwar has left #openstack-infra22:44
*** crc32 has quit IRC22:44
SlickNikdavidlenwell: by both — The trove create call requires a flavor parameter (which determines the cpu/mem combination) as well as a size parameter which determines the size of the volume to use for the datastore.22:45
*** austin81 has joined #openstack-infra22:45
openstackgerritMerged openstack/requirements: Report bad package when found  https://review.openstack.org/19431122:45
davidlenwellthanks SlickNik22:45
jeblairSlickNik: so on-disk usage is the important value for the "size" parameter?22:46
davidlenwelljeblair:  existing data is only 3.75 MB22:47
davidlenwellbut like I said .. thats not what we should expect22:47
jheskethMorning22:47
david-lylelifeless, jeblair tracking down a real tag, I'm not seeing a log, looking at http://git.openstack.org/cgit/stackforge/xstatic-angular-lrdragndrop for tag 1.0.2.3, the ref I get is 52ef65cb79f7e1487163f013cecdf3d479a32199, but no corresponding log at http://logs.openstack.org/22:47
davidlenwellI mean .. how hard will it be to make a change to the deployment once its up?22:48
davidlenwelljeblair: ^22:48
jeblairdavidlenwell: ok; our monitoring of this is more or less nonexistent at the moment, so we should try to make a good swag to start with22:48
davidlenwellSo how should I word it in the spec?22:48
jeblairSlickNik: volumes can grow, right?22:49
SlickNikjeblair: Yes. Trove supports a resize-volume to grow the volume in case you need to grow in the future.22:49
*** agentle has quit IRC22:50
SlickNikThe only caveat there is that the resize-volume operation does quiesce the datastore, so it requires some down time.22:51
*** agentle has joined #openstack-infra22:51
davidlenwelljeblair: I don't think ^^ that is a major problem.. as long as its planned and not automatic22:52
davidlenwellSo the question still remains.. what is the right wording for the spec here.. "default base sized trove database" ?22:53
*** peristeri has quit IRC22:53
jeblairdavidlenwell: i'd recommend coming up with some hand-wavey way of guessing how much we might need in 6 months....?  maybe you can multiple 3MB times the number of result sets you plan on keeping or something?  anyway, we need to boil it down to a number like "start with 5GB" or something.22:53
SlickNikdavidlenwell / jeblair: Also, a trove show on the instance will return the size-on-volume of the database — so you can use it see how close you are to your volume size. Helps to decide when's a good time to resize your volume as your data grows.22:53
jeblairSlickNik: good to know22:54
SpamapSgreghaynes: sorry I've been dealing with car service people all day :-P22:54
SpamapSgreghaynes: Bifrost is set up to use ipa-agent22:54
SpamapSgreghaynes: agent works via ipxe22:54
*** hodos|2 has quit IRC22:54
davidlenwelljeblair:  how does "Allocate a trove database instance, start with 5gb of disk and base level cpu" sound?22:54
SpamapSgreghaynes: what doesn't work is that the ipxe.boot file uses features not in the ipxe firmware inside the mellanox cards.22:54
SpamapSgreghaynes: TheJulia has found a way we might be able to chain load the new ipxe in without going into an endless loop.. which I have yet to try.22:55
jeblairdavidlenwell: sure; we can pick the cpu/ram level we have used for other hosts22:55
*** bookwar has joined #openstack-infra22:56
openstackgerritDavid Lenwell proposed openstack-infra/infra-specs: Spec to host refstack.org in infra  https://review.openstack.org/18820722:56
*** bookwar has quit IRC22:57
*** bookwar has joined #openstack-infra22:57
*** dimtruck is now known as zz_dimtruck22:58
*** dannywil_ has quit IRC22:58
*** DericHorn-HP_ has joined #openstack-infra22:59
*** rwsu has quit IRC23:00
*** ddieterly has quit IRC23:01
*** asettle has joined #openstack-infra23:01
greghaynesSpamapS: fun23:01
greghaynesSpamapS: on both counts23:01
*** esmute__ has joined #openstack-infra23:02
fungii'm not having a ton of luck digging up that xstatic-angular-lrdragndrop tag in the zuul debug logs23:03
greghaynesoh, that package again23:03
jeblairfungi: i think that tag was too long ago?23:03
fungioh! no wonder... that was tagged in early may :/23:04
lifelessfungi: may 6th:)23:04
*** DericHorn-HP_ is now known as DericHorn-HP23:04
fungihere i thought david-lyle was talking about a release he had just now made23:04
david-lylefungi: sorry, just realizing that a couple didn't publish23:04
jeblairit looks like 0.2.0.1 for magic-search is also pretty old23:04
david-lylethe licensing was messed up and we pushed fixes to allow them to make progress, just noticing they didn't make it to pypi23:05
david-lylejeblair: digging further I think the magic-search is a different mess of the authors creation23:06
david-lyleI'll have them work on that one23:06
greghayneslrdragndrop was the one that was named irdragndrop and then the author deleted and renamed with it added to global-reqs as the old spelling...23:06
*** esmute__ has quit IRC23:06
*** shardy has quit IRC23:06
greghaynesso if youre looking at super old logs itll probably be named that23:06
*** shardy has joined #openstack-infra23:07
david-lyleI greghaynes yes, it changed name23:07
fungiyeah, but also the logs for the 52ef65cb79f7e1487163f013cecdf3d479a32199 ref seem to not be there23:07
david-lylebut I pushed a subsequent tag23:07
david-lyleI may just try to push another tag in the morning and get some fresh data23:08
david-lyleor maybe it will just work, and resolve it to a timing issue in the past23:08
david-lylethanks all for the help, I'll report back on what I find23:08
fungiyeah, /srv/static/logs/52/52ef65cb79f7e1487163f013cecdf3d479a32199 is not on our server23:08
fungihttps://review.openstack.org/169274 was the change that added the release pipeline job for it23:10
jeblairfungi: huh, http://logs.openstack.org/dc/dcaaee2a68e2ec7a8b424c75ca828dba497b5d36/release/ does not contain 'glean-tarball'23:10
jeblairthough it does contain -both-upload23:10
fungijeblair: are the tarball jobs on swift now?23:10
lifelessok so without the log we can't tell what failed23:10
lifelessit might or might not be pbr related23:10
lifelessbut I don't think its pbr related23:10
*** ZZelle_ has quit IRC23:10
jeblairhttps://jenkins07.openstack.org/job/glean-tarball/1/console23:10
lifelessthe setup.py in the one we've been talking about is not using pbr23:10
jeblairfungi: OHHHHH23:11
fungiswift23:11
jeblairfungi: no indexes at that level in swift23:11
jeblairhttp://logs.openstack.org/dc/dcaaee2a68e2ec7a8b424c75ca828dba497b5d36/release/glean-tarball/6d765a9/23:12
*** amuller has quit IRC23:12
*** david-lyle_ has joined #openstack-infra23:12
jeblairhttp://logs.openstack.org/dc/dcaaee2a68e2ec7a8b424c75ca828dba497b5d36/release/23:12
*** asettle has quit IRC23:12
fungiyeah, so we need to know the unique id23:12
*** david_lyle__ has joined #openstack-infra23:12
jeblairthet's, uh, i thought we were going to deal with that?23:12
fungii don't suppose that's at all deterministic23:12
jeblairfungi: not at all, that's why indexes are important23:12
fungiyeah23:12
*** david_lyle__ has quit IRC23:13
*** thedodd has quit IRC23:13
jeblairjhesketh: hi, so what's the state of indexes in swift?23:13
jeblairhttp://logs.openstack.org/dc/dcaaee2a68e2ec7a8b424c75ca828dba497b5d36/release/glean-tarball/23:13
jeblairbasically, we at least need that to work ^23:13
*** austin81 has left #openstack-infra23:14
*** marcusvrn_ has quit IRC23:14
*** austin81 has joined #openstack-infra23:14
*** spzala has joined #openstack-infra23:15
*** hdd has quit IRC23:15
jeblairdavid-lyle: do you have any tags pushed within the past 30 days?23:15
*** markvoelker has quit IRC23:16
*** prad has quit IRC23:20
jheskethjeblair: sadly no progress last week after playing with git stuff sorry23:20
jheskethGoing to look it some today though23:21
jeblairjhesketh: cool; i know you were looking at binary data, wasn't sure if this indexing thing was on your radar23:21
*** DericHorn-HP has quit IRC23:21
*** melwitt_ has joined #openstack-infra23:22
jheskethjeblair: yeah that's new, not sure what's happening there23:22
jhesketh(new to me)23:22
*** linkedinyou has joined #openstack-infra23:22
jeblairjhesketh: okay cool23:23
*** gordc has quit IRC23:23
*** melwitt has quit IRC23:27
jheskethjeblair: I might not make it to tomorrow's meeting just fyi. (day off)23:27
*** melwitt_ is now known as melwitt23:27
jeblairjhesketh: thanks, enjoy!  (whatever "day off" means)23:28
openstackgerritKurt Taylor proposed openstack-infra/infra-specs: Host a CI monitoring dashboard service  https://review.openstack.org/19443723:28
*** rlandy has joined #openstack-infra23:28
jheskethHeh, annual leave23:28
jheskethOr vacation23:28
*** timothyb89 has quit IRC23:28
fungiyou'll be on holiday!23:29
* jhesketh can't remember how the states work 23:29
*** jasondotstar has quit IRC23:29
fungiactually "pto" (paid time off) is the current business jargon here. to distinguish from the rest of our population who are just staying home because they're jobless23:29
*** RichardRaseley has quit IRC23:29
*** esmute__ has joined #openstack-infra23:30
asselinkrtaylor, thank you23:30
krtaylorjeblair, we had discussed hosting a CI dashboard spec, but I didn't ask for a shepherd for it23:30
*** fallenpe_ has joined #openstack-infra23:30
krtaylorasselin, its rough, but a start23:30
krtaylorI borrowed heavily from fungi 's spec23:31
*** fawadkhaliq has quit IRC23:31
*** esmute__ has quit IRC23:31
jeblairdid we decide we needed shepherds?  i think probably for simple "spin up a new service" we probably don't need them so much?23:31
krtaylorjeblair, would you be willing to shepherd that one?23:31
krtayloroh, even better23:31
jeblairmaybe it's more important for data-migration situations?23:31
ianwjeblair: i guess the point of -e is to catch such failures?23:32
fungiyeah, having a root shepherd just means someone has explicitly volunteered to do the root-only bits, rather than you having to catch someone and get them to knock it out for you23:32
jeblairianw: i guess?  i mean, it was "failing" successfully for a couple of years :)23:33
openstackgerritKurt Taylor proposed openstack-infra/infra-specs: Host a CI monitoring dashboard service  https://review.openstack.org/19443723:33
jeblairianw: i'm okay with someone tightening that up23:33
krtaylorfungi, thanks, I removed it then23:33
krtaylorasselin, I know you are busy, but when you get a chance, please review23:35
krtaylorwe can talk about it in more detail in tomorrow's meeting23:35
asselinkrtaylor, +123:35
*** esmute__ has joined #openstack-infra23:36
*** cjwei has joined #openstack-infra23:37
*** esmute__ has quit IRC23:37
*** esmute__ has joined #openstack-infra23:37
*** claudiub has quit IRC23:38
*** angela-s has quit IRC23:38
*** yamamoto has joined #openstack-infra23:39
*** chlong has joined #openstack-infra23:40
*** Sukhdev has quit IRC23:41
*** yamamoto has quit IRC23:43
*** Longgeek has quit IRC23:43
*** otter768 has joined #openstack-infra23:43
*** agentle has quit IRC23:45
*** yamamoto has joined #openstack-infra23:46
*** jaypipes has quit IRC23:46
*** gmann_ has quit IRC23:46
*** otter768 has quit IRC23:48
*** sigmavirus24_awa is now known as sigmavirus2423:48
*** gmann has joined #openstack-infra23:48
*** gyee has quit IRC23:48
*** rguillebert has quit IRC23:48
*** ajmiller has quit IRC23:50
*** sigmavirus24 is now known as sigmavirus24_awa23:51
*** jasondotstar has joined #openstack-infra23:54
*** husanu has quit IRC23:55
*** signed8bit has quit IRC23:55
*** yamamoto has quit IRC23:57
*** husanu has joined #openstack-infra23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!