Saturday, 2016-03-19

fungithe atlantic ocean? yeah, pretty big. also your packets may be waylaid and boarded by pirates00:00
*** _ari_ has quit IRC00:00
fungior swallowed by sea monsters00:00
*** _ari_ has joined #openstack-infra00:00
fungiit's a treacherous crossing00:00
*** ajmiller has quit IRC00:00
*** _ari_ has quit IRC00:01
*** xiangxinyong has quit IRC00:01
* anteaya pictures pirates boarding and waylaying packets00:01
anteayawhere is my copy of Master and Commander?00:02
*** _ari_ has joined #openstack-infra00:02
*** x00350071 has joined #openstack-infra00:02
*** |-paul-| has quit IRC00:03
*** heyongli_ has quit IRC00:07
*** apoorvad has quit IRC00:07
*** heyongli_ has joined #openstack-infra00:07
*** knikolla has quit IRC00:07
jeblairor privateers.00:09
*** piet has quit IRC00:10
*** ddieterly is now known as ddieterly[away]00:10
*** baoli has quit IRC00:11
anteayanot sure which is worse00:11
jeblairprobably privateers.00:12
jeblairthey had a point to make.00:12
jeblairi have no idea why i put that in the past tense, since, in fact, our packets _are_ being boarded by privateers with a point to make.00:13
jroll:(00:14
fungipacketeers? i have terrible, terrible memories of those devices00:15
*** tpsilva has quit IRC00:17
*** heyongli_ has quit IRC00:17
*** heyongli_ has joined #openstack-infra00:17
*** adrian_otto has quit IRC00:18
anteaya:(00:19
*** kzaitsev_mb has quit IRC00:19
*** heyongli_ has quit IRC00:27
*** heyongli_ has joined #openstack-infra00:28
*** achanda has joined #openstack-infra00:28
*** sputnik13 has quit IRC00:30
*** pradk has joined #openstack-infra00:31
*** davideagnello has quit IRC00:32
*** e0ne has quit IRC00:32
*** pvaneck has quit IRC00:35
*** heyongli_ has quit IRC00:38
anteayahope enough of the image makes it across the atlantic00:38
*** heyongli_ has joined #openstack-infra00:38
anteayahave a good weekend everyone00:38
fungiwe only need the 1s to get there. if there's any missing 0s they can just fill in the blanks00:38
fungiyou too anteaya!00:38
*** yamahata has quit IRC00:40
*** apoorvad has joined #openstack-infra00:40
*** |-paul-| has joined #openstack-infra00:40
*** Qiming has joined #openstack-infra00:40
*** BobBall has quit IRC00:42
*** markvoelker has joined #openstack-infra00:42
*** ddieterly[away] is now known as ddieterly00:45
*** harlowja_at_home has quit IRC00:45
*** BobBall has joined #openstack-infra00:47
*** eharney has quit IRC00:48
*** BobBall is now known as Guest1795700:48
openstackgerritJames E. Blair proposed openstack-infra/infra-specs: Add Nodepool Zookeeper spec  https://review.openstack.org/27877700:48
*** heyongli_ has quit IRC00:48
*** heyongli_ has joined #openstack-infra00:48
openstackgerritJames E. Blair proposed openstack-infra/infra-specs: Add Nodepool Zookeeper spec  https://review.openstack.org/27877700:50
*** apoorvad has quit IRC00:50
*** bpokorny_ has joined #openstack-infra00:55
*** ZZelle has quit IRC00:56
*** heyongli_ has quit IRC00:58
*** heyongli_ has joined #openstack-infra00:58
*** bpokorny has quit IRC00:59
*** bpokorny_ has quit IRC01:00
*** mylu has quit IRC01:01
*** |-paul-| has quit IRC01:01
anteayaha ha ha01:02
anteayaand thank you01:02
anteayaabregman: http://paste.openstack.org/show/491173/01:02
anteayawe are going to have to do this in pieces01:02
anteayagoing again01:02
*** mylu has joined #openstack-infra01:05
*** Jeffrey4l has joined #openstack-infra01:05
*** ramishra has quit IRC01:07
*** heyongli_ has quit IRC01:08
*** esker has quit IRC01:08
*** heyongli_ has joined #openstack-infra01:09
*** ramishra has joined #openstack-infra01:09
*** harlowja_at_home has joined #openstack-infra01:09
*** dims has joined #openstack-infra01:12
*** dims_ has quit IRC01:12
*** fverbs has quit IRC01:13
*** kuromagi^ has quit IRC01:14
*** kuromagi has joined #openstack-infra01:15
*** _amrith_ is now known as amrith01:15
*** yamamoto_ has joined #openstack-infra01:16
*** fverbs has joined #openstack-infra01:18
*** heyongli_ has quit IRC01:19
*** heyongli_ has joined #openstack-infra01:19
*** amrith is now known as _amrith_01:22
*** tpsilva has joined #openstack-infra01:26
*** heyongli_ has quit IRC01:29
*** _amrith_ is now known as amrith01:29
*** heyongli_ has joined #openstack-infra01:29
*** sridhar_ram1 has joined #openstack-infra01:33
prometheanfirewooo01:36
*** heyongli_ has quit IRC01:39
*** heyongli_ has joined #openstack-infra01:39
*** dimtruck is now known as zz_dimtruck01:41
*** mescanef has quit IRC01:41
*** knikolla has joined #openstack-infra01:43
*** tphummel has quit IRC01:45
*** heyongli_ has quit IRC01:49
*** heyongli_ has joined #openstack-infra01:50
*** dims has quit IRC01:50
*** rhallisey has quit IRC01:53
*** mylu has quit IRC01:53
*** thorst has joined #openstack-infra01:55
*** thorst has quit IRC01:55
*** mylu has joined #openstack-infra01:56
*** ddieterly is now known as ddieterly[away]01:56
*** heyongli_ has quit IRC02:00
*** heyongli_ has joined #openstack-infra02:00
*** akshai has joined #openstack-infra02:00
*** mescanef has joined #openstack-infra02:01
*** _ari_ has quit IRC02:04
*** achanda_ has joined #openstack-infra02:09
*** heyongli_ has quit IRC02:10
*** heyongli_ has joined #openstack-infra02:10
*** achanda has quit IRC02:12
*** fverbs has quit IRC02:17
*** achanda_ has quit IRC02:19
*** achanda has joined #openstack-infra02:20
*** heyongli_ has quit IRC02:20
*** heyongli_ has joined #openstack-infra02:20
*** kmartin has quit IRC02:22
*** kmartin has joined #openstack-infra02:22
jrollyo infra, how might I get the last output of the ironic-python-agent post job02:23
jroll?02:23
jrollit appears to be failing based on the last uploaded tarball02:23
*** links has joined #openstack-infra02:24
*** achanda has quit IRC02:24
*** x00350071 has quit IRC02:27
*** x00350071 has joined #openstack-infra02:27
*** heyongli_ has quit IRC02:30
*** heyongli_ has joined #openstack-infra02:31
*** Sukhdev has joined #openstack-infra02:33
*** heyongli_ has quit IRC02:41
*** heyongli_ has joined #openstack-infra02:41
*** ajmiller has joined #openstack-infra02:42
*** yamamoto_ has quit IRC02:46
*** heyongli_ has quit IRC02:51
*** heyongli_ has joined #openstack-infra02:51
*** baoli has joined #openstack-infra02:52
*** yamamoto_ has joined #openstack-infra02:53
*** sridhar_ram1 has quit IRC02:54
*** ddieterly[away] has quit IRC02:56
*** ajmiller has quit IRC02:57
*** ajmiller_ has joined #openstack-infra02:57
SamYapledid the rax gate image just change?02:58
SamYaplerax-ord ubuntu-trusty image my gate is now failing on02:59
SamYaplecan't ssh to localhost (ansible does this in our script)02:59
*** mriedem has quit IRC03:01
*** heyongli_ has quit IRC03:01
*** mriedem has joined #openstack-infra03:01
*** heyongli_ has joined #openstack-infra03:01
*** pcrews_ has quit IRC03:03
*** binbincong has quit IRC03:03
*** links has quit IRC03:06
openstackgerritColleen Murphy proposed openstack-infra/puppet-infracloud: Add functional tests  https://review.openstack.org/28884003:08
*** baoli has quit IRC03:10
*** heyongli_ has quit IRC03:11
*** heyongli_ has joined #openstack-infra03:12
clarkbnothing changed thst should affect ssh or firewalls03:12
clarkbwe added cron and uuidgen03:12
*** ajmiller_ has quit IRC03:14
SamYapleclarkb: i think i see the issue03:14
SamYaplethe file /etc/nodepool/node_private03:14
*** ajmiller_ has joined #openstack-infra03:14
SamYaplethe ip it contains doesnt exist on the rax box03:14
SamYaple(eth1 doesnt have an ip)03:14
SamYapleclarkb: http://logs.openstack.org/54/294854/1/check/gate-kolla-dsvm-deploy-ubuntu-source/76941fc/console.html#_2016-03-19_00_52_20_93703:14
clarkbthsts not where localhost lives though03:15
*** gongysh has joined #openstack-infra03:15
SamYapleyea i forgot i changed that a while back for multinode03:15
clarkbI wonder if glean stopped configuring eth,103:15
SamYapleso eth1 is ip less and then this fails: http://logs.openstack.org/54/294854/1/check/gate-kolla-dsvm-deploy-ubuntu-source/76941fc/console.html#_2016-03-19_00_52_53_19503:15
SamYaplei can submit a patch to work around this in our gate by assigning that ip to eth1 if its missing, but thats not ideal03:17
SamYapleour gates are hard busted right now03:17
clarkbI have no idea why glean is my guess03:17
clarkbthe lack of dhcp is a pita03:18
* SamYaple doesnt know what glean is03:18
SamYaplemore things to learn03:18
clarkbSamYaple: its the cloud init replacement mordred wrote to handle rax's lack of dhcp03:18
SamYapleoh. yea its only in rax-ord i just confirmed that03:19
SamYapleor rax-*03:19
SamYaplebut ive only run on ord gates that ive seen03:19
clarkbbecause rax does nova agent or config drive passed network data03:19
clarkbinstead of dhcp03:19
SamYapleright, but cloud-init can use config drive, was that no good?03:19
* jroll prays to the NOC gods that we'll have dhcp one day03:20
clarkbcloud init doesnt understand rax network data in config drive03:20
SamYaplejroll: and youll finally switch to powerkvm like major wanted03:20
SamYapleclarkb: lol03:20
SamYaplethat sounds right03:20
jrollidk if that's true clarkb, but cloud-init doesn't understand bonds and vlans and such03:20
clarkbjroll: well yalls change was unmerged at the time03:21
clarkbunsure if it is merged and released now03:21
jrollclarkb: even before that, unless you mean the json stuff03:21
jrollI think the main reasoning was that cloud-init installs a bunch of python deps from system packages03:21
clarkbyes the read data from.config drive and configure interfaces was not a thing03:21
jrollalso that it's terrible03:21
clarkbbecause upstream wouldnt merge until nova merged03:21
jrollwell... before the json stuff, configdrive had a debian style interfaces file that cloud init could read03:22
*** heyongli_ has quit IRC03:22
clarkband rax deployed months before nova merged03:22
clarkbjroll: that rax doesnt supply aiui03:22
*** heyongli_ has joined #openstack-infra03:22
jrollwe do03:22
jrollanyway, it doesn't matter03:22
clarkbah well maybe thst was a misunderstanding03:22
jrollcloud-init is still terrible03:22
clarkbits all broken03:22
jroll:)03:22
clarkbdhcp is the thing03:22
jrollya. one day.03:22
clarkbpeople should use it03:22
SamYaplei wish publiccloud would roll out openstack one of these days jroll ;)03:23
jroll:(03:23
* jroll goes back to real life03:23
clarkbits not perfect and bonding and vlans create problems but for everything else its pretty good03:23
SamYaplewith arpresponder and dhcp per-compute-node its actually pretty lightwieght too03:24
SamYaplei woudl say far more lightwiegth than an iso per instance03:24
SamYapleugh anyway for me to get glean logs/debug stuff clarkb?03:27
clarkbSamYaple: hrm good question, wpuld be in the instance console log and syslog?03:27
clarkbI am finishing up feeding babies but can dump some console logs ina bit03:28
SamYaplethanks clarkb. now mine woke up.03:30
SamYaplenever mention food even through the interwebs!03:30
*** heyongli__ has joined #openstack-infra03:32
clarkbSamYaple: I get a free pass because I have 203:32
clarkbnever wish multiples on your worst enemy03:33
*** heyongli_ has quit IRC03:35
SamYaplei ahve 203:35
SamYapleunder 203:35
*** IlyaG has joined #openstack-infra03:36
clarkboh you understand then. its good fun03:36
*** tpsilva has quit IRC03:37
clarkbmy favorite is when they trade off not sleeping03:37
SamYaplethose are words. i dont nromally use them in that order. but those words exist yes03:37
SamYaplei like the loud noises all the time personally03:37
*** zz_dimtruck is now known as dimtruck03:39
clarkbthe attention you get in public can be pretty weird too03:39
clarkb"I just worship twins!" uhm ok I need to buy groceries now03:39
SamYaplei dont have twins, i just have no self control03:40
SamYapleor so im told03:40
*** pcrews has joined #openstack-infra03:41
morganfungi, pleia2: GL! we'll have an awesome infra PTL either way! :)03:41
*** heyongli__ has quit IRC03:42
*** heyongli__ has joined #openstack-infra03:42
*** binbincong has joined #openstack-infra03:48
clarkbSamYaple: http://paste.openstack.org/show/491177/ that may be related to the issue03:49
clarkboh rax doesn't allow nova console-log03:50
*** amrith is now known as _amrith_03:50
SamYaplewhat may be related? the || true?03:50
*** links has joined #openstack-infra03:52
clarkbSamYaple: there is an eth1 and an eth1.cfg03:52
clarkbone is statically configured and looks correct the other is dhcp03:52
*** heyongli__ has quit IRC03:52
SamYapleyea but it should only read .cfg03:52
clarkbhttp://paste.openstack.org/show/491178/ is the config drive data03:53
SamYaplei think. its been a while03:53
*** heyongli__ has joined #openstack-infra03:53
clarkbSamYaple: its possible this is a boot order of operations problem03:53
clarkband that if we bounce networking it will just work03:53
clarkblet me try that when this instance isn't running a test03:53
SamYapleyou mean like... https://github.com/openstack-infra/glean/commit/f700d4bcda8ea025737fc59bb594dc6102ce860103:53
SamYapleim just looking for interesting things in history since i dont have cloud-box rights like you do03:54
clarkbthings like that but thats openrc only and ubuntu-trusty should use upstart03:55
*** Vivek has quit IRC03:55
clarkbSamYaple: if I ifdown eth1 then ifup eth1 it comes up proeprly03:56
clarkbso that config must be fine, implying it is a boot ordering issue03:57
greghaynesjroll: how does rax supply it? AIUI the only methods on rax to get networking info were nova agent and config-drive03:57
SamYapleclarkb: https://github.com/openstack-infra/glean/commit/cf1b83e3e5a1327cd0083dc141d955e4b51e410d03:57
SamYaplelooks like a likely candidate03:57
greghaynesis glean broken?03:58
clarkbgreghaynes: I am guessing its the networking_data I pasted above vs the vendor_data03:58
SamYaplegreghaynes: appears to be. rax eth1 not getting ip03:58
greghaynesah. So the glean tests have a neat deal where you can just copy in the config drive data in to a dir and run glean tests against it03:59
greghaynesif someone wants an easy way to poke at it03:59
clarkbgreghaynes: it appears to be configured properly03:59
clarkbgreghaynes: I did an ifdown and ifup and it came up fine03:59
clarkbI think its yet another init system bug03:59
greghaynesah, its configuring but not starting the interface at the right time? :/03:59
clarkbya thats what it looks like03:59
clarkband just eth1, the eth0 public network interace is fine04:00
greghayneshrm, upstart logs might say something interesting04:00
clarkbsyslog shows eth1 dhcping04:01
clarkb~4 seconds after boot04:01
greghaynesbefore any logging that glean ran?04:01
clarkbgreghaynes: haven't found any glean logging04:02
SamYaplefeels related to https://review.openstack.org/#/c/25203704:02
greghaynesI wonder if this is another case of where we have eth1 baked in to the image which is preventing it from running on that interface04:02
SamYaplethe comments in that patch are all conflicted about ti too04:02
SamYaplesaying things like "this is the wrong fix" :P04:02
*** mylu has quit IRC04:02
*** heyongli__ has quit IRC04:03
clarkbgreghaynes: there is an eni/eth1 and an eni/eth1.cfg04:03
SamYapleoh im too tired for this04:03
greghaynesclarkb: heh04:03
*** heyongli__ has joined #openstack-infra04:03
SamYapleim out. ill check in later after youve debugged. been a long day04:03
greghaynesgn04:03
clarkbgreghaynes: where does glean log?04:04
clarkbthere isn't anything in /var/log/upstart or syslog or dmesg04:04
greghaynesclarkb: huh. It should log to upstart04:04
SamYaplecould it be its not starting?04:04
clarkbifup: waiting for lock on /run/network/ifstate.eth1 is in /var/log/upstart/networking but thats it04:04
clarkbSamYaple: it must be starting to get eth004:04
*** Qiming has quit IRC04:04
greghaynesclarkb: on my trusty box its in /var/log/boot.log04:06
clarkbthis is interetsing04:06
clarkbhttp://paste.openstack.org/show/491179/04:06
clarkbthe relavent bits of boot.log04:06
clarkbstarting configure network device is well before lgean04:07
greghaynesyea, so that looks right - it ran twice04:07
greghaynesI wonder if thats it04:07
greghaynesI bet it is, we probably have eth1 baked in to the image, it runs before and configres the interface, glean cowardly refuses to reassert state, or it even races04:07
clarkbI can look in an image real quick04:08
greghaynesI kind of think glean should get more assertive04:09
SamYaplei agree04:09
greghaynesand just do what config drive says04:09
clarkbwould that leak in via the dib build host?04:09
greghaynesclarkb: it shouldnt04:09
clarkbwe don't have any eth1 config on the build host in eni04:09
greghaynesclarkb: oh, actually. lol04:09
clarkbbeucase build host uses nova agent04:10
greghaynesclarkb: is it possible that cloud-init is also installed in the image?04:10
clarkbsince its booted off a rax image. anyways when this file copy is done I will mount the image and look04:10
clarkbgreghaynes: tab complete at least says no, time to check apt04:10
greghaynesah, ok, thats good04:10
clarkbnot installed04:12
greghayneshuh.04:12
greghaynesso, glean will only write out a eth1.cfg04:12
greghaynesso *something* is writing the eth1 file04:12
clarkbyup /etc/network/interfaces.d/eth1 which says dhcp is baked into the image04:13
*** heyongli__ has quit IRC04:13
clarkbits dib from somewhere04:13
greghaynesawesome04:13
greghaynesthis is ubuntu-minimal right?04:13
clarkbyup04:13
*** heyongli__ has joined #openstack-infra04:13
* greghaynes looks04:13
greghaynesclarkb: yea, that debootstrap element does that04:15
greghayneswith the comment "# cloud images expect eth0 and eth1 to use dhcp."04:15
greghaynesan easy fix is that the simple-init can rm those files04:16
clarkbwow04:16
clarkbgg04:16
greghayneshaha, actually, simple-init has code for that but it has a bug04:16
clarkbthere is no eth0 I wonder if simple init already does eth004:17
greghaynesyep04:17
greghaynesthats the bug :)04:17
clarkbare you fixing then? I am going to clean up the nde I held04:17
SamYaplethere is a commit in glean that changes us to using eth1.cfg rather than eth104:18
SamYapleso it appears previously we were overwritting eth04:18
SamYapleeth1*04:18
openstackgerritgreghaynes proposed openstack/diskimage-builder: Remove all interface configs for simple-init  https://review.openstack.org/29487104:18
greghaynesI think glean should try and re-assert networking state here, but I wonder if it is racing04:20
greghayneslike, it tries to assert state, dhcp fails after it does which breaks networking04:20
*** heyongli__ has quit IRC04:25
*** mylu has joined #openstack-infra04:26
*** treaki_ has joined #openstack-infra04:27
*** salv-orlando has joined #openstack-infra04:27
*** heyongli has joined #openstack-infra04:28
*** piet has joined #openstack-infra04:29
*** treaki__ has quit IRC04:30
*** salv-orl_ has quit IRC04:30
*** moravec has joined #openstack-infra04:32
*** heyongli has quit IRC04:33
*** heyongli has joined #openstack-infra04:34
*** moravec has quit IRC04:36
*** heyongli has quit IRC04:44
*** piet has quit IRC04:44
*** heyongli has joined #openstack-infra04:44
*** IlyaG has quit IRC04:45
*** rguillebert has quit IRC04:47
*** heyongli has quit IRC04:54
*** heyongli has joined #openstack-infra04:54
prometheanfiregreghaynes: ohai :P05:00
prometheanfirehttps://review.openstack.org/#/c/290894/ finally passed05:01
prometheanfiregreghaynes: I had to tell glean to start in the 'boot' phase for openrc, so it'd start before networking05:03
*** krtaylor has quit IRC05:03
*** achanda has joined #openstack-infra05:03
*** heyongli has quit IRC05:04
*** heyongli has joined #openstack-infra05:04
*** heyongli has quit IRC05:08
*** cody-somerville has quit IRC05:10
*** krtaylor has joined #openstack-infra05:15
*** larainema has quit IRC05:18
*** _amrith_ is now known as amrith05:19
*** moravec has joined #openstack-infra05:19
*** sridhar_ram1 has joined #openstack-infra05:21
*** moravec has quit IRC05:23
openstackgerritTony Breeds proposed openstack-infra/devstack-gate: Save PROJECTS form the job defintion for use in reproduce.sh  https://review.openstack.org/28002705:26
*** amrith is now known as _amrith_05:28
*** gongysh has quit IRC05:31
*** heyongli has joined #openstack-infra05:35
*** flepied has quit IRC05:36
*** nadya has joined #openstack-infra05:36
*** dimtruck is now known as zz_dimtruck05:42
*** [HeOS] has joined #openstack-infra05:44
*** heyongli has quit IRC05:45
*** heyongli has joined #openstack-infra05:45
*** mylu has quit IRC05:46
*** HeOS has quit IRC05:46
*** heyongli_ has joined #openstack-infra05:55
*** heyongli has quit IRC05:57
*** gongysh has joined #openstack-infra06:00
*** yamamoto_ has quit IRC06:01
*** sridhar_ram2 has joined #openstack-infra06:01
*** yamamoto has joined #openstack-infra06:01
*** yamamoto has quit IRC06:01
openstackgerritTony Breeds proposed openstack-infra/project-config: (re) skip python23 job on stable/kilo for nova  https://review.openstack.org/29487506:01
*** sridhar_ram1 has quit IRC06:04
*** yamamoto has joined #openstack-infra06:05
*** heyongli_ has quit IRC06:05
*** heyongli_ has joined #openstack-infra06:06
*** binbincong has quit IRC06:11
*** nadya has quit IRC06:12
*** yamamoto has quit IRC06:14
*** heyongli_ has quit IRC06:16
*** heyongli_ has joined #openstack-infra06:16
*** david-lyle has quit IRC06:22
*** binbincong has joined #openstack-infra06:23
*** david-lyle has joined #openstack-infra06:23
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/29488306:24
*** heyongli_ has quit IRC06:26
*** heyongli_ has joined #openstack-infra06:26
*** jtomasek has joined #openstack-infra06:29
openstackgerritMatthew Thode proposed openstack-infra/glean: change iteritems to items method  https://review.openstack.org/29488606:33
*** heyongli_ has quit IRC06:36
*** heyongli_ has joined #openstack-infra06:36
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/28884906:38
*** heyongli__ has joined #openstack-infra06:47
*** heyongli_ has quit IRC06:49
*** ociuhandu has quit IRC06:50
*** heyongli__ has quit IRC06:57
*** heyongli__ has joined #openstack-infra06:57
*** esikachev has joined #openstack-infra06:58
*** zhurong has joined #openstack-infra07:02
*** sridhar_ram2 has quit IRC07:07
*** heyongli__ has quit IRC07:07
*** heyongli__ has joined #openstack-infra07:07
*** zhurong has quit IRC07:07
*** |-paul-| has joined #openstack-infra07:10
*** ociuhandu has joined #openstack-infra07:13
*** yamamoto has joined #openstack-infra07:15
*** heyongli__ has quit IRC07:17
*** heyongli__ has joined #openstack-infra07:17
*** moravec has joined #openstack-infra07:19
*** infra-red has joined #openstack-infra07:22
*** moravec has quit IRC07:24
*** infra-red has quit IRC07:24
*** infra-red has joined #openstack-infra07:27
*** heyongli__ has quit IRC07:27
*** heyongli__ has joined #openstack-infra07:28
*** flepied has joined #openstack-infra07:28
*** yamamoto has quit IRC07:33
*** yamamoto has joined #openstack-infra07:37
*** heyongli__ has quit IRC07:38
*** heyongli__ has joined #openstack-infra07:38
*** achanda has quit IRC07:38
*** achanda has joined #openstack-infra07:40
*** yamamoto has quit IRC07:46
*** heyongli__ has quit IRC07:48
*** heyongli__ has joined #openstack-infra07:48
*** achanda has quit IRC07:51
*** abregman has joined #openstack-infra07:52
*** heyongli__ has quit IRC07:58
*** heyongli__ has joined #openstack-infra07:58
*** infra-red has quit IRC07:59
*** infra-red has joined #openstack-infra08:02
*** infra-red has quit IRC08:05
*** yamamoto has joined #openstack-infra08:06
*** yamamoto has quit IRC08:07
*** infra-red has joined #openstack-infra08:08
*** heyongli__ has quit IRC08:08
*** infra-red has quit IRC08:09
*** heyongli__ has joined #openstack-infra08:09
*** jtomasek has quit IRC08:14
*** sambetts|afk has quit IRC08:17
*** sambetts has joined #openstack-infra08:17
*** Sukhdev has quit IRC08:18
*** heyongli__ has quit IRC08:19
*** heyongli__ has joined #openstack-infra08:19
*** cfarquhar has quit IRC08:21
*** kzaitsev_mb has joined #openstack-infra08:22
*** cfarquhar has joined #openstack-infra08:24
*** cfarquhar has quit IRC08:24
*** cfarquhar has joined #openstack-infra08:24
*** kzaitsev_mb has quit IRC08:27
*** yamamoto has joined #openstack-infra08:27
*** heyongli__ has quit IRC08:29
*** heyongli__ has joined #openstack-infra08:29
*** yamamoto has quit IRC08:35
*** yamamoto has joined #openstack-infra08:36
*** nimbleark has quit IRC08:37
*** nimbleark has joined #openstack-infra08:37
*** heyongli__ has quit IRC08:39
*** heyongli__ has joined #openstack-infra08:39
*** esikachev has quit IRC08:44
*** heyongli__ has quit IRC08:49
*** heyongli__ has joined #openstack-infra08:50
AJaegertonyb: good morning, are you around?08:50
*** binbincong has quit IRC08:50
*** binbincong has joined #openstack-infra08:51
AJaegertonyb: wanted to discuss your project-config patch for nova...08:51
*** achanda has joined #openstack-infra08:51
openstackgerritMerged openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/29488308:54
*** achanda has quit IRC08:57
*** heyongli__ has quit IRC09:00
*** heyongli__ has joined #openstack-infra09:00
*** esikachev has joined #openstack-infra09:02
*** infra-red has joined #openstack-infra09:09
*** heyongli__ has quit IRC09:10
*** heyongli__ has joined #openstack-infra09:10
*** gongysh has quit IRC09:12
yolandanice, i see jenkins upgraded to new version!09:13
*** infra-red has quit IRC09:14
AJaegermorning, yolanda !09:17
yolandagood morning09:18
*** nadya has joined #openstack-infra09:18
AJaegerQuick question for you: If I understand it correctly, We can either merge  https://review.openstack.org/294875  or merge https://review.openstack.org/#/c/293526/5 - both will fix the situation that python34 job is currently run on stable/kilo for nova but shouldn't.09:18
AJaegerCould you confirm this, please? In that case I would go with 293526...09:19
*** heyongli__ has quit IRC09:20
*** flepied has quit IRC09:20
*** heyongli__ has joined #openstack-infra09:20
*** flepied has joined #openstack-infra09:21
*** salv-orlando has quit IRC09:21
*** moravec has joined #openstack-infra09:21
*** yamamoto has quit IRC09:21
*** yamamoto has joined #openstack-infra09:22
*** flepied has quit IRC09:22
*** yamamoto has quit IRC09:22
*** sbadia has quit IRC09:23
*** moravec has quit IRC09:25
*** yamamoto has joined #openstack-infra09:26
*** heyongli__ has quit IRC09:30
*** heyongli__ has joined #openstack-infra09:31
*** sbadia has joined #openstack-infra09:31
*** esikachev has quit IRC09:34
*** nikhil_k has joined #openstack-infra09:35
*** kzaitsev_mb has joined #openstack-infra09:35
*** nikhil has quit IRC09:38
*** heyongli__ has quit IRC09:41
*** heyongli__ has joined #openstack-infra09:41
*** shardy has joined #openstack-infra09:41
*** nadya has quit IRC09:42
*** cody-somerville has joined #openstack-infra09:44
openstackgerritMerged openstack-infra/glean: change iteritems to items method  https://review.openstack.org/29488609:44
*** Ravikiran_K has joined #openstack-infra09:45
Ravikiran_KHi..i have a question. how do i change my gerrit id?09:50
*** heyongli__ has quit IRC09:51
*** heyongli__ has joined #openstack-infra09:51
*** shardy has quit IRC09:52
*** cody-somerville has quit IRC09:53
AJaegerRavikiran_K: why do you want to do this?09:54
*** achanda has joined #openstack-infra09:54
*** kzaitsev_mb has quit IRC09:54
Ravikiran_Kmy launchpad id is not the same as gerrit id..when i see in stackalytics gerrit id does not exist09:57
Ravikiran_Kmay be i though of username change will reflect in stackalytics09:58
*** esikachev has joined #openstack-infra09:59
*** achanda has quit IRC09:59
*** heyongli__ has quit IRC10:01
*** heyongli__ has joined #openstack-infra10:01
*** esikachev has quit IRC10:03
*** Qiming has joined #openstack-infra10:03
*** infra-red has joined #openstack-infra10:06
*** gongysh has joined #openstack-infra10:08
*** cody-somerville has joined #openstack-infra10:08
*** ramishra has quit IRC10:09
*** ramishra has joined #openstack-infra10:09
*** heyongli__ has quit IRC10:11
*** heyongli__ has joined #openstack-infra10:12
*** infra-red has quit IRC10:14
*** sputnik13 has joined #openstack-infra10:15
abregmanrcarrillocruz: hi. here?10:20
*** jamespage has quit IRC10:21
*** gnuoy has quit IRC10:21
*** heyongli__ has quit IRC10:22
*** heyongli__ has joined #openstack-infra10:22
*** gnuoy has joined #openstack-infra10:22
*** esikachev has joined #openstack-infra10:24
*** kzaitsev_mb has joined #openstack-infra10:27
*** sputnik13 has quit IRC10:31
*** heyongli__ has quit IRC10:32
*** kzaitsev_mb has quit IRC10:32
*** heyongli__ has joined #openstack-infra10:32
*** heyongli__ has quit IRC10:42
*** heyongli__ has joined #openstack-infra10:42
*** [HeOS] is now known as HeOS10:45
*** daemontool_ has joined #openstack-infra10:46
*** hashar has joined #openstack-infra10:50
*** heyongli__ has quit IRC10:52
*** heyongli__ has joined #openstack-infra10:53
*** hashar has quit IRC10:59
*** heyongli__ has quit IRC11:03
*** heyongli__ has joined #openstack-infra11:03
mordredRavikiran_K: you may need to add a mapping for yourself here: http://git.openstack.org/cgit/openstack/stackalytics/tree/etc/default_data.json11:07
*** gongysh has quit IRC11:11
*** heyongli__ has quit IRC11:13
*** heyongli__ has joined #openstack-infra11:13
*** moravec has joined #openstack-infra11:22
*** heyongli__ has quit IRC11:23
*** heyongli__ has joined #openstack-infra11:23
*** moravec has quit IRC11:26
*** heyongli__ has quit IRC11:33
*** jamespage has joined #openstack-infra11:33
*** heyongli__ has joined #openstack-infra11:34
*** ociuhandu has quit IRC11:34
*** esikachev has quit IRC11:37
*** heyongli__ has quit IRC11:44
*** heyongli__ has joined #openstack-infra11:44
*** heyongli__ has quit IRC11:54
*** heyongli__ has joined #openstack-infra11:54
*** nimbleark has left #openstack-infra11:55
*** rhallisey has joined #openstack-infra11:57
*** achanda has joined #openstack-infra11:58
*** sputnik13 has joined #openstack-infra11:59
*** sputnik13 has quit IRC11:59
*** achanda has quit IRC12:03
*** heyongli__ has quit IRC12:04
*** heyongli__ has joined #openstack-infra12:04
*** rguillebert has joined #openstack-infra12:10
*** daemontool_ has quit IRC12:14
*** heyongli__ has quit IRC12:14
*** heyongli__ has joined #openstack-infra12:15
*** heyongli__ has quit IRC12:25
*** heyongli__ has joined #openstack-infra12:25
*** dims has joined #openstack-infra12:25
*** dims has quit IRC12:25
*** esikachev has joined #openstack-infra12:32
openstackgerritsebastian marcet proposed openstack-infra/openstackid: Reduce noise on error log  https://review.openstack.org/29490712:34
*** heyongli__ has quit IRC12:35
*** heyongli__ has joined #openstack-infra12:35
*** esikachev has quit IRC12:36
openstackgerritsebastian marcet proposed openstack-infra/openstackid: Reduce noise on error log  https://review.openstack.org/29490712:37
openstackgerritRyan Hallisey proposed openstack-infra/tripleo-ci: Allow the container job to run again  https://review.openstack.org/28891512:37
*** esikachev has joined #openstack-infra12:39
*** |-paul-| has quit IRC12:42
openstackgerritsebastian marcet proposed openstack-infra/openstackid: Reduce noise on error log  https://review.openstack.org/29490712:43
*** infra-red has joined #openstack-infra12:44
*** heyongli__ has quit IRC12:45
*** heyongli__ has joined #openstack-infra12:45
*** links has quit IRC12:48
*** ddieterly has joined #openstack-infra12:51
*** heyongli__ has quit IRC12:55
*** infra-red has quit IRC12:55
*** heyongli__ has joined #openstack-infra12:56
*** kzaitsev_mb has joined #openstack-infra12:56
*** achanda has joined #openstack-infra13:00
*** markvoelker has quit IRC13:00
*** hashar has joined #openstack-infra13:03
*** yamamoto has quit IRC13:04
*** achanda has quit IRC13:04
*** ddieterly is now known as ddieterly[away]13:05
*** yamamoto has joined #openstack-infra13:05
*** heyongli__ has quit IRC13:06
*** heyongli__ has joined #openstack-infra13:06
openstackgerritArie Bregman proposed openstack-infra/infra-ansible: Add keypairs to infra_config sample and option to use key file  https://review.openstack.org/29479113:11
*** hashar has quit IRC13:14
*** ddieterly[away] has quit IRC13:15
*** heyongli__ has quit IRC13:16
*** heyongli__ has joined #openstack-infra13:16
*** cody-somerville has quit IRC13:18
*** cody-somerville has joined #openstack-infra13:19
*** signed8bit has quit IRC13:20
openstackgerritIan Cordasco proposed openstack-dev/pbr: Include wsgi_scripts in generated wheels  https://review.openstack.org/28027013:20
*** moravec has joined #openstack-infra13:23
*** heyongli__ has quit IRC13:26
*** heyongli__ has joined #openstack-infra13:26
*** moravec has quit IRC13:27
*** kzaitsev_mb has quit IRC13:29
*** heyongli__ has quit IRC13:36
*** heyongli__ has joined #openstack-infra13:37
*** _amrith_ is now known as amrith13:37
*** heyongli__ has quit IRC13:47
*** heyongli__ has joined #openstack-infra13:47
*** heyongli__ has quit IRC13:57
*** heyongli__ has joined #openstack-infra13:57
*** thorst has joined #openstack-infra13:58
*** heyongli__ has quit IRC14:07
*** heyongli__ has joined #openstack-infra14:07
*** nelsnelson has quit IRC14:07
*** nelsnelson has joined #openstack-infra14:11
*** grue_pm has quit IRC14:11
*** thorst has quit IRC14:12
*** thorst has joined #openstack-infra14:14
*** links has joined #openstack-infra14:15
*** heyongli__ has quit IRC14:17
*** heyongli__ has joined #openstack-infra14:18
*** ddieterly has joined #openstack-infra14:19
*** thorst has quit IRC14:19
*** links has quit IRC14:19
*** HeOS has quit IRC14:22
*** armax has joined #openstack-infra14:23
*** heyongli__ has quit IRC14:28
*** knikolla has quit IRC14:28
*** heyongli__ has joined #openstack-infra14:28
*** esikachev has quit IRC14:30
*** jpr has joined #openstack-infra14:31
*** ddieterly has quit IRC14:34
*** ddieterly has joined #openstack-infra14:37
*** heyongli__ has quit IRC14:38
*** heyongli__ has joined #openstack-infra14:38
*** esikachev has joined #openstack-infra14:39
*** esikachev has quit IRC14:43
*** ddieterly is now known as ddieterly[away]14:44
*** mylu has joined #openstack-infra14:46
*** mylu has quit IRC14:48
*** heyongli__ has quit IRC14:48
*** heyongli__ has joined #openstack-infra14:48
*** ddieterly[away] has quit IRC14:50
openstackgerritMerged openstack/requirements: Revert "Tolerate both new and old setuptools"  https://review.openstack.org/29439614:52
*** fedexo has joined #openstack-infra14:57
*** thorst has joined #openstack-infra14:57
*** heyongli__ has quit IRC14:58
*** heyongli__ has joined #openstack-infra14:59
*** markvoelker has joined #openstack-infra15:00
*** achanda has joined #openstack-infra15:03
*** thorst has quit IRC15:04
*** markvoelker has quit IRC15:05
*** achanda has quit IRC15:08
*** Jeffrey4l_ has joined #openstack-infra15:08
*** heyongli__ has quit IRC15:09
*** Jeffrey4l has quit IRC15:09
*** heyongli__ has joined #openstack-infra15:09
*** Jeffrey4l_ has quit IRC15:13
*** esikachev has joined #openstack-infra15:14
*** zeih has joined #openstack-infra15:14
*** heyongli__ has quit IRC15:15
*** abregman has quit IRC15:16
*** armax has quit IRC15:17
*** andymaier has joined #openstack-infra15:18
*** heyongli has joined #openstack-infra15:23
*** mylu has joined #openstack-infra15:26
*** Jeffrey4l_ has joined #openstack-infra15:26
*** heyongli has quit IRC15:29
*** heyongli has joined #openstack-infra15:29
*** mylu has quit IRC15:30
*** piet has joined #openstack-infra15:32
*** heyongli has quit IRC15:39
*** heyongli has joined #openstack-infra15:40
*** esikachev has quit IRC15:42
*** yamamoto has quit IRC15:42
*** yamamoto has joined #openstack-infra15:43
*** infra-red has joined #openstack-infra15:45
*** heyongli has quit IRC15:50
*** heyongli has joined #openstack-infra15:50
*** Qiming has quit IRC15:50
*** yamamoto has quit IRC15:56
*** heyongli has quit IRC16:00
*** heyongli has joined #openstack-infra16:00
*** thorst has joined #openstack-infra16:02
*** asselin__ has quit IRC16:02
*** thorst has quit IRC16:06
*** thorst has joined #openstack-infra16:06
*** infra-red has quit IRC16:07
*** zz_dimtruck is now known as dimtruck16:09
*** heyongli has quit IRC16:10
*** ddieterly has joined #openstack-infra16:10
*** heyongli has joined #openstack-infra16:10
*** pcaruana has quit IRC16:15
openstackgerritMonty Taylor proposed openstack-infra/shade: Bug fix: Make set/unset of flavor specs work again  https://review.openstack.org/29474316:20
openstackgerritMonty Taylor proposed openstack-infra/shade: Log inner_exception in test runs  https://review.openstack.org/29492516:20
openstackgerritMonty Taylor proposed openstack-infra/shade: Add constructor param to turn on inner logging  https://review.openstack.org/29492616:20
openstackgerritMonty Taylor proposed openstack-infra/shade: Refactor unit tests to construct cloud in base  https://review.openstack.org/29492716:20
openstackgerritMonty Taylor proposed openstack-infra/shade: Run the extra specs calls through TaskManager  https://review.openstack.org/29492816:20
openstackgerritMonty Taylor proposed openstack-infra/shade: Add optimized path for get_extra_specs  https://review.openstack.org/29492916:20
openstackgerritMonty Taylor proposed openstack-infra/shade: Just use requests for raw calls  https://review.openstack.org/29493016:20
* mordred bombs the channel on saturday just for Shrews16:20
*** heyongli has quit IRC16:20
*** heyongli has joined #openstack-infra16:21
*** yamahata has joined #openstack-infra16:23
mordredShrews: ^^ that was based on me starting to poke at your flavor patch, and then a whole pile of other stuff kind of just fell out of it16:25
*** jpr has quit IRC16:26
*** esikachev has joined #openstack-infra16:26
*** pcaruana has joined #openstack-infra16:28
*** IlyaG has joined #openstack-infra16:29
fungiit was a piñata?16:30
*** heyongli has quit IRC16:31
fungifully of tasty shade candies16:31
*** piet has quit IRC16:31
*** heyongli has joined #openstack-infra16:31
*** esikachev has quit IRC16:31
AJaegerfungi, mordred: If I understand it correctly, We can either merge  https://review.openstack.org/294875  or merge https://review.openstack.org/#/c/293526/5 - both will fix the situation that python34 job is currently run on stable/kilo for nova but shouldn't as tonyb reported. I suggest to erge 293526 now but like confirmation before I +A over tonyb's -1...16:33
SamYaplemordred: thats what happens everyime i touch shade!16:35
fungiAJaeger: yeah, i agree. i'll check real quick and make sure those jobs are properly registered16:35
AJaegerOh, jenkins06 has "Jenkins is going to shut down"16:37
*** tphummel has joined #openstack-infra16:37
fungiAJaeger: yeah, looks like we're all clear to press forward with that, and it will fix nova's kilo branch too16:37
AJaegerBut gate-nova-python27-db job is registered16:37
AJaegerOk, then I'll +A - thanks funig16:37
fungii went ahead and commented and approved16:38
AJaegerOops, I meant fungi instead of funig ;)16:38
AJaegerthanks!16:38
fungii'll take a look at jenkins06 in a bit. the weekly restart probably broke there16:39
Shrewsmordred: ugh. i don't wanna look... so i won't. until monday that is16:39
fungiShrews: today is for beer16:39
*** heyongli has quit IRC16:41
*** heyongli has joined #openstack-infra16:41
*** doug-fish has joined #openstack-infra16:43
openstackgerritMerged openstack-infra/project-config: Switch nova to db jobs  https://review.openstack.org/29352616:45
*** heyongli has quit IRC16:51
*** heyongli has joined #openstack-infra16:51
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: keystone: Use db setup for python jobs  https://review.openstack.org/29493816:52
AJaegerbknudson, stevemar ^16:52
*** andymaier has quit IRC16:57
*** noorul has joined #openstack-infra16:57
*** nikhil_k has quit IRC16:58
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: ironic,ironic-inspector: Use db setup for python jobs  https://review.openstack.org/29493917:00
openstackgerritRyan Hallisey proposed openstack-infra/tripleo-ci: Allow the container job to run again  https://review.openstack.org/28891517:01
*** heyongli has quit IRC17:01
*** markvoelker has joined #openstack-infra17:02
*** heyongli has joined #openstack-infra17:02
*** nikhil has joined #openstack-infra17:02
noorulIs Zuul's job parallelism achieved by having more than on jenkins master?17:02
AJaegernoorul: no.17:03
*** rossella_s has quit IRC17:03
*** rossella_s has joined #openstack-infra17:03
AJaegerwe need multiple jenkins for the overall load that we have...17:04
noorulI have a local setup, with single jenkins master and couple of slaves17:04
*** amotoki has joined #openstack-infra17:04
noorulbut when I push two patches for review, tests for one runs and other one is queued17:05
AJaegernoorul: no idea on that one. Better ask here on Monday again...17:05
*** achanda has joined #openstack-infra17:06
*** markvoelker has quit IRC17:06
*** ociuhandu has joined #openstack-infra17:07
*** jpr has joined #openstack-infra17:07
*** moravec has joined #openstack-infra17:08
mordredShrews: :)17:10
*** achanda has quit IRC17:10
mordrednoorul: there is a global setting ... one sec17:11
*** heyongli has quit IRC17:12
*** heyongli has joined #openstack-infra17:12
*** ddieterly is now known as ddieterly[away]17:15
mordrednoorul: you need to make sure that the jobs themselves have "Execute concurrent builds if necessary" enabled17:15
* noorul is checking17:16
mordrednoorul: in jjb, it's in -defaults17:16
mordrednoorul: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/defaults.yaml#n1717:16
noorulmordred: Oops I think I removed defaults17:17
*** zeih has quit IRC17:17
mordredwhoop!17:17
*** zeih has joined #openstack-infra17:18
noorulhttps://github.com/noorul/os-project-config/commit/1bb63af7139e0bda5a2e54c1227cacc9b7e2bc4a17:18
noorulIndeed I did that, not sure why17:19
*** mylu has joined #openstack-infra17:20
*** heyongli has quit IRC17:22
*** zeih has quit IRC17:22
*** heyongli has joined #openstack-infra17:22
mordrednoorul: I constantly have no idea why I did things17:27
noorulmordred: Still I see that in Jenkins one job is queued up17:29
*** zeih has joined #openstack-infra17:29
noorulI have two patches17:30
noorulp1 and p217:30
noorulp2 is based on p117:30
nooruldemoclient-unit-tests does not run in parallel17:31
noorulThis is independent pipleline17:31
*** heyongli has quit IRC17:32
noorulhttp://picpaste.com/Screen_Shot_2016-03-19_at_11.02.06_PM-DBystdw7.png17:32
noorulmordred: ^^^17:32
*** heyongli has joined #openstack-infra17:32
*** abregman has joined #openstack-infra17:35
mordrednoorul: if you open up properties of democlient-unit-tests in your jenkins, do you see a check mark next to "execute concurrent builds if necessary" - http://picpaste.com/Screenshot-4-Zmbza5vA.png17:36
mordrednoorul: and also, you'r esure you have 2 slaves connected that both have the label that democlient-unit-tests needs?17:37
*** moravec has quit IRC17:38
noorulmordred: My bad!17:39
noorulmordred: Even though I reverted my patch which removed defaults17:39
noorulmordred: I was not having defaults.yaml file at all in the repo17:39
noorulmordred: That solved it! Thank you very much!17:42
noorulNow I need to understand Dependent pipleline17:42
*** heyongli has quit IRC17:42
*** heyongli has joined #openstack-infra17:43
*** maishsk has joined #openstack-infra17:44
*** esikachev has joined #openstack-infra17:45
*** knikolla has joined #openstack-infra17:45
mordrednoorul: woot!17:46
noorulI have two patches patch1 and patch217:48
noorulI approved patch1 and patch2 respectively17:49
noorulNow zuul is in loop17:49
*** esikachev has quit IRC17:49
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: keystone: Use db setup for python jobs  https://review.openstack.org/29493817:51
noorulmordred: http://picpaste.com/Screen_Shot_2016-03-19_at_11.22.24_PM-IQu0W0pY.png17:52
*** heyongli has quit IRC17:53
*** jpeeler has quit IRC17:53
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: ironic,ironic-inspector: Use db setup for python jobs  https://review.openstack.org/29493917:53
*** heyongli has joined #openstack-infra17:53
*** esikachev has joined #openstack-infra17:54
*** abregman has quit IRC17:55
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: neutron: Use db setup for python jobs  https://review.openstack.org/29494117:57
*** mylu has quit IRC18:00
*** mylu has joined #openstack-infra18:01
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add db setup for periodic-*with-oslo-master  https://review.openstack.org/29494318:02
AJaegerfungi, this job needs database set up in general ^. Seems that nobody noticed yet ;(18:02
*** heyongli has quit IRC18:03
AJaegerfungi, alternative is to split the job in two - one with db, on without.18:03
*** achanda has joined #openstack-infra18:03
*** heyongli has joined #openstack-infra18:03
*** zeih has quit IRC18:08
*** zeih has joined #openstack-infra18:08
openstackgerritGonéri Le Bouder proposed openstack-infra/devstack-gate: cleanup_host: files in $BASE/logs are readable  https://review.openstack.org/29494718:09
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: neutron: Use db setup for python jobs  https://review.openstack.org/29494118:10
*** esikachev has quit IRC18:11
*** infra-red has joined #openstack-infra18:12
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: oslo.db: Use db setup for python jobs  https://review.openstack.org/29494818:13
*** zeih has quit IRC18:13
*** heyongli has quit IRC18:13
*** heyongli has joined #openstack-infra18:13
*** ddieterly[away] is now known as ddieterly18:16
*** pcaruana has quit IRC18:18
fungiAJaeger: 294943 seems like a perfectly legitimate solution to the problem18:18
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: blazar,cerberus,kite: Use db setup for python jobs  https://review.openstack.org/29494918:20
fungiAJaeger: to get it running again anyway. though you're right if non-db-using projects are running that job then they'll be stuck adding databases to their other-requirements.txt file or else it'll just keep failing those periodic runs18:20
fungiso there may be some desire from projects in that situation to have a version of the job which does not set up the database18:21
AJaegerfungi: yes. And I just checked: ceilometer is the only job that does not seem to need databases (at least based on current understanding), so let's move forward with 294943 and revisit later18:21
fungiwfm18:22
* AJaeger adds a note to the etherpad18:22
fungithanks for spotting!18:22
*** heyongli has quit IRC18:23
*** heyongli has joined #openstack-infra18:24
AJaegeryou're welcome!18:24
fungiokay, jenkins06 has been cleaned up and restarted18:24
AJaegerfungi, so just updated a few projects as next step - enough for today;)18:24
AJaegerthanks, fugni18:24
fungiyou're welcome!18:24
* AJaeger cannot typo fungi today ;( Sorry!18:24
*** ddieterly is now known as ddieterly[away]18:25
fungii answer to most anything, in including "hey you"18:25
AJaeger;)18:26
openstackgerritMonty Taylor proposed openstack-infra/shade: Refactor unit tests to construct cloud in base  https://review.openstack.org/29492718:29
openstackgerritMonty Taylor proposed openstack-infra/shade: Add optimized path for get_extra_specs  https://review.openstack.org/29492918:29
openstackgerritMonty Taylor proposed openstack-infra/shade: Run the extra specs calls through TaskManager  https://review.openstack.org/29492818:29
openstackgerritMonty Taylor proposed openstack-infra/shade: Just use requests for raw calls  https://review.openstack.org/29493018:29
openstackgerritMonty Taylor proposed openstack-infra/shade: Bug fix: Make set/unset of flavor specs work again  https://review.openstack.org/29474318:29
*** yamamoto has joined #openstack-infra18:29
*** pcaruana has joined #openstack-infra18:32
*** yamamoto has quit IRC18:33
*** Ravikiran_K has left #openstack-infra18:33
*** heyongli has quit IRC18:34
*** heyongli has joined #openstack-infra18:34
*** gnuoy_ has joined #openstack-infra18:35
*** gnuoy_ has quit IRC18:36
*** jmccrory has quit IRC18:37
*** jmccrory has joined #openstack-infra18:37
*** IlyaG has quit IRC18:39
*** heyongli has quit IRC18:44
*** heyongli has joined #openstack-infra18:44
*** cody-somerville has quit IRC18:47
prometheanfiremordred: you mind cuting a 1.5.1 release for glean, that last commit was needed to install on gentoo (we default to py3)18:50
*** ddieterly has joined #openstack-infra18:51
prometheanfirehave been thinking of making it a proper package as well (packaging glean)18:52
prometheanfirethough maybe not, it does need to run it's own setup, which is odd18:52
*** heyongli has quit IRC18:54
*** heyongli has joined #openstack-infra18:54
*** ddieterly has quit IRC18:56
*** infra-re_ has joined #openstack-infra18:59
*** cody-somerville has joined #openstack-infra19:00
*** mylu has quit IRC19:01
*** infra-red has quit IRC19:02
*** markvoelker has joined #openstack-infra19:02
*** mylu has joined #openstack-infra19:03
*** harlowja_at_home has quit IRC19:04
*** heyongli has quit IRC19:04
*** heyongli has joined #openstack-infra19:05
*** achanda has quit IRC19:06
*** markvoelker has quit IRC19:09
*** mylu has quit IRC19:12
*** mylu has joined #openstack-infra19:13
*** esikachev has joined #openstack-infra19:14
*** heyongli has quit IRC19:15
*** heyongli has joined #openstack-infra19:15
*** amit213 has quit IRC19:16
*** amit213 has joined #openstack-infra19:17
*** knikolla has quit IRC19:17
*** esikachev has quit IRC19:19
*** mylu has quit IRC19:19
*** maishsk has quit IRC19:23
*** noorul has quit IRC19:23
*** mylu has joined #openstack-infra19:24
*** heyongli has quit IRC19:25
*** heyongli has joined #openstack-infra19:25
*** maishsk has joined #openstack-infra19:27
*** achanda has joined #openstack-infra19:32
*** Jeffrey4l__ has joined #openstack-infra19:33
*** yamamoto has joined #openstack-infra19:33
*** nadya has joined #openstack-infra19:33
*** Jeffrey4l_ has quit IRC19:34
*** heyongli has quit IRC19:35
*** heyongli has joined #openstack-infra19:35
mordredprometheanfire: what do you mean wrt run it's own setup? (wondering if something's broken)19:38
*** harlowja_at_home has joined #openstack-infra19:38
*** infra-re_ has quit IRC19:38
mordredprometheanfire: I'm fine cutting a release - but I'd rather wait until monday while people are around and lookin for breaks19:38
mordred(I do not think there will be any, but still)19:39
prometheanfirenothing broken now19:40
prometheanfiremonday is fine19:40
prometheanfireI built this months images with glean from git19:40
*** yamamoto has quit IRC19:41
prometheanfireglean just isn't the standard python program is all I'm saying19:41
mordredah. indeed19:42
prometheanfirejust need to sign these images and upload them19:42
*** esikachev has joined #openstack-infra19:42
prometheanfirehttp://gentoo.osuosl.org/experimental/amd64/openstack/19:42
mordredand woot!19:43
prometheanfireglean from git increases the image size by 11M (because of git being installed)19:43
*** harlowja_at_home has quit IRC19:44
*** heyongli has quit IRC19:45
*** heyongli has joined #openstack-infra19:46
*** nadya has quit IRC19:52
*** heyongli has quit IRC19:56
*** harlowja_at_home has joined #openstack-infra19:56
*** heyongli has joined #openstack-infra19:56
*** aviau has quit IRC19:57
fungilooks like we do make tarballs of it at each release and a version continuously updated from the master branch tip https://tarballs.openstack.org/glean/19:58
prometheanfireright, I was just looking for a new tag19:58
*** esker has joined #openstack-infra19:59
fungii like it when we release early, often and with reckless abandon. keeps everyone on their toes19:59
prometheanfireso do I :P20:00
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: cinder,glance,heat: Use db setup for python jobs  https://review.openstack.org/29495320:02
prometheanfireatm cloud-init doesn't actually configure or start networking on gentoo20:03
prometheanfiredon't know when it broke20:03
*** HeOS has joined #openstack-infra20:05
*** heyongli has quit IRC20:06
*** heyongli has joined #openstack-infra20:06
*** mylu has quit IRC20:09
*** akaszuba has joined #openstack-infra20:10
*** mylu has joined #openstack-infra20:11
*** markvoelker has joined #openstack-infra20:13
*** ddieterly has joined #openstack-infra20:15
*** infra-red has joined #openstack-infra20:15
*** heyongli has quit IRC20:16
*** heyongli has joined #openstack-infra20:16
*** mylu has quit IRC20:19
*** moravec has joined #openstack-infra20:22
*** achanda has quit IRC20:26
*** heyongli has quit IRC20:26
*** heyongli has joined #openstack-infra20:27
tonybAJaeger: sorry I'm here few a few mins now, just about to have Sunday breakfast.20:31
tonybAJaeger: I shoudl have included a link to the review that failed the gate-nova-python34 job20:31
tonybAJaeger: thanks for fixing python34 :)20:34
*** heyongli has quit IRC20:37
*** heyongli has joined #openstack-infra20:37
*** abregman has joined #openstack-infra20:38
fungitonyb: basically the issue is that the non-voting override should have been changed in the second patch which switched which jobs were run, not the first patch where the new jobs were added20:40
fungiso we ended up with a brief window where the old job was running and voting20:41
*** armax has joined #openstack-infra20:42
*** heyongli has quit IRC20:47
*** heyongli has joined #openstack-infra20:47
*** armax has quit IRC20:50
*** sdake has joined #openstack-infra20:52
*** esikachev has quit IRC20:52
*** esikachev has joined #openstack-infra20:53
*** moravec has quit IRC20:54
*** krtaylor has quit IRC20:57
*** heyongli has quit IRC20:57
*** heyongli has joined #openstack-infra20:57
*** piet has joined #openstack-infra21:00
*** ddieterly is now known as ddieterly[away]21:00
*** mylu has joined #openstack-infra21:02
*** mylu has quit IRC21:03
*** rossella_s has quit IRC21:03
*** fedexo has quit IRC21:03
*** rossella_s has joined #openstack-infra21:04
*** mylu has joined #openstack-infra21:05
*** heyongli has quit IRC21:07
*** heyongli has joined #openstack-infra21:08
*** krtaylor has joined #openstack-infra21:09
*** thorst has quit IRC21:09
*** thorst has joined #openstack-infra21:09
*** akaszuba has quit IRC21:11
*** infra-re_ has joined #openstack-infra21:11
*** piet has quit IRC21:11
*** achanda has joined #openstack-infra21:12
*** infra-red has quit IRC21:14
tonybfungi: okay.21:15
*** sdake has quit IRC21:15
tonybfungi: not that it was a big problem for nova, but hopefully things will be a little smoother for $next project.21:16
*** esikachev has quit IRC21:17
*** heyongli has quit IRC21:18
*** thorst has quit IRC21:18
*** heyongli has joined #openstack-infra21:18
*** kzaitsev_mb has joined #openstack-infra21:20
*** heyongli has quit IRC21:28
*** heyongli has joined #openstack-infra21:28
*** thorst has joined #openstack-infra21:29
*** heyongli has quit IRC21:38
*** heyongli has joined #openstack-infra21:38
*** dalgaaf has joined #openstack-infra21:43
*** achanda has quit IRC21:44
*** jpr has quit IRC21:46
*** moravec has joined #openstack-infra21:46
HeOSGuys, hello! Looks like gerrit works very slowly.21:48
*** heyongli has quit IRC21:48
*** heyongli has joined #openstack-infra21:49
SpamapSHeOS: I can confirm that21:50
SpamapSmordred: you here?21:51
SpamapSmordred: gerrit is laaaaaaaaagggging21:51
SpamapSclarkb: ^21:51
SpamapSjeblair: ^21:51
SpamapSfungi: ^21:51
HeOSSergeyLukjanov, are you here?21:54
nibalizerhi21:58
*** heyongli has quit IRC21:59
*** heyongli has joined #openstack-infra21:59
*** achanda has joined #openstack-infra21:59
SamYaplegerrit having issues?21:59
prometheanfirelol22:00
*** |-paul-| has joined #openstack-infra22:00
*** thorst has quit IRC22:00
*** ddieterly[away] has quit IRC22:01
*** thorst has joined #openstack-infra22:01
jrollit's saturday, this is the indication y'all need to go do something else :P22:02
SamYaplejroll: no rest for the wicked22:03
jrollignore the hypocrisy of me being here saying that.22:03
SamYapleim pretty sure youre a bot so its ok22:04
jroll>.>22:04
jroll<.<22:04
SpamapSit's a PTL22:05
SpamapSwith SHIFTY eyes22:05
jrollwhat other kind of PTLs are there?22:06
jrollinfra-root: gerrit seems to need a kick in the pants22:06
jrolla public "restart gerrit" button could be fun22:06
SamYaplewe should have a service called `tang` that can do that22:06
nibalizerheh22:06
nibalizeri can restart gerrit22:06
jrollty nibalizer :)22:07
SamYaplejroll: i was thinking a scanner that can scan irc logs for "gerrit" and "problems" in the same text in the span of a few minutes and just auto restart it22:07
nibalizerim waiting for the monitoring section tos tart22:07
jrollSamYaple: what could go wrong!22:07
HeOSnibalizer, could you view system information before?22:08
nibalizerHeOS: usurally yea22:08
*** heyongli has quit IRC22:09
*** heyongli has joined #openstack-infra22:09
HeOSnibalizer, could you share output of 'top' util anywhere?22:09
nibalizerHeOS: its a java application so that's not very interesting22:09
*** thorst has quit IRC22:10
HeOSnibalizer, what about load average, for example? And memory/cpu utilization ?22:10
nibalizerHeOS: we have a known mmory leak in the gerrit process22:11
nibalizerthe procedure is to just restart it22:11
SamYaplenibalizer: well duh, its java22:11
nibalizerim getting the jvm stats out of java melody then gonna bounce it22:11
SamYapleis there any java app that _doesnt_ leak?22:11
nibalizerHeOS: http://paste.openstack.org/show/491189/22:12
HeOSnibalizer, thanks.22:14
*** kzaitsev_mb has quit IRC22:15
*** moravec has quit IRC22:18
*** maishsk_ has joined #openstack-infra22:18
*** maishsk has quit IRC22:19
*** maishsk_ is now known as maishsk22:19
*** heyongli has quit IRC22:19
nibalizerhrm22:19
*** heyongli has joined #openstack-infra22:19
nibalizergerrit is too slow to allow me to log in22:20
nibalizerwhich means its too slow to get perf data22:20
nibalizerokay i m restarting it22:20
nibalizer#status notice Gerrit is restarting to increase performance issues22:22
openstackstatusnibalizer: sending notice22:22
HeOSBtw, nibalizer do you know about the following CVE: https://security-tracker.debian.org/tracker/CVE-2016-2324, https://security-tracker.debian.org/tracker/CVE-2016-2315? More additional information: https://ma.ttias.be/remote-code-execution-git-versions-client-server-2-7-1-cve-2016-2324-cve-2016-2315/22:22
HeOS*CVEs22:23
-openstackstatus- NOTICE: Gerrit is restarting to increase performance issues22:23
nibalizerHeOS: i saw them come through22:24
*** abregman has quit IRC22:25
openstackstatusnibalizer: finished sending notice22:25
nibalizerdoesn't look like http://www.ubuntu.com/usn/ has an entry?22:25
nibalizerthanks openstackstatus22:25
nibalizeroh wow that message was not what I intended haha22:26
nibalizerat any rate i think we have a gerrit again SpamapS jroll22:26
jrolllgtm nibalizer, thanks again22:27
*** infra-red has joined #openstack-infra22:27
jrolllol, increase performance issues22:27
nibalizeri couldn't decide between 'increasing performance' and 'decreasing issues'22:27
nibalizerand i guess i landed in the middle22:27
nibalizeryay saturday22:27
*** maishsk has quit IRC22:28
*** heyongli has quit IRC22:29
*** infra-re_ has quit IRC22:30
*** heyongli has joined #openstack-infra22:30
*** kzaitsev_mb has joined #openstack-infra22:31
openstackgerritAndrey Nikitin proposed openstack-infra/puppet-accessbot: Order of the class parameters is refactored  https://review.openstack.org/29495922:32
*** |-paul-| has quit IRC22:34
openstackgerritAndrey Nikitin proposed openstack-infra/puppet-ansible: Intendation of the class parameters is refactored  https://review.openstack.org/29496022:35
*** maishsk has joined #openstack-infra22:35
*** ddieterly has joined #openstack-infra22:35
*** kzaitsev_mb has quit IRC22:39
openstackgerritAndrey Nikitin proposed openstack-infra/puppet-apps_site: Order of the class parameters is refactored  https://review.openstack.org/29496122:39
*** heyongli has quit IRC22:40
openstackgerritAndrey Nikitin proposed openstack-infra/puppet-ansible: Intendation of the class parameters is refactored  https://review.openstack.org/29496022:40
*** heyongli has joined #openstack-infra22:40
*** ddieterly is now known as ddieterly[away]22:46
*** heyongli has quit IRC22:50
*** heyongli has joined #openstack-infra22:50
*** |-paul-| has joined #openstack-infra22:51
openstackgerritAndrey Nikitin proposed openstack-infra/puppet-askbot: Order of the classes parameters is refactored  https://review.openstack.org/29496222:51
*** sdake has joined #openstack-infra22:53
wznoinskhi all22:53
wznoinskdoes anyone have experience with running devstack-gate behind proxy?22:54
*** heyongli has quit IRC23:00
*** heyongli has joined #openstack-infra23:00
*** ddieterly[away] is now known as ddieterly23:03
openstackgerritAndrey Nikitin proposed openstack-infra/puppet-bandersnatch: Order of the classes parameters is refactored  https://review.openstack.org/29496323:05
*** thorst has joined #openstack-infra23:07
openstackgerritAndrey Nikitin proposed openstack-infra/puppet-bugdaystats: Order of the class parameters is refactored  https://review.openstack.org/29496423:09
*** heyongli has quit IRC23:10
*** heyongli has joined #openstack-infra23:11
*** mylu has quit IRC23:12
*** achanda has quit IRC23:13
*** sdake has quit IRC23:14
*** thorst has quit IRC23:14
*** maishsk has quit IRC23:17
*** heyongli has quit IRC23:21
*** heyongli has joined #openstack-infra23:21
*** infra-red has quit IRC23:23
*** infra-red has joined #openstack-infra23:23
*** sdake has joined #openstack-infra23:28
*** larainema has joined #openstack-infra23:29
*** mylu has joined #openstack-infra23:30
*** heyongli has quit IRC23:31
*** heyongli has joined #openstack-infra23:31
*** sdake has quit IRC23:32
*** sdake has joined #openstack-infra23:35
*** infra-re_ has joined #openstack-infra23:40
*** heyongli has quit IRC23:41
*** heyongli has joined #openstack-infra23:41
*** infra-re_ has quit IRC23:43
*** infra-red has quit IRC23:43
*** ddieterly has quit IRC23:45
*** heyongli has quit IRC23:51
*** heyongli has joined #openstack-infra23:52

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!