Tuesday, 2014-06-17

*** sarob_ has quit IRC00:00
* mikal files bug 133076300:00
uvirtbotLaunchpad bug 1330763 in nova "PostgrestSQLOpportunisticFixture fails with no attribute named _details" [Undecided,New] https://launchpad.net/bugs/133076300:00
*** adalbas has quit IRC00:01
ianwsdague: in the cleanup there's a lot of "mv $WORKSPACE/foo $BASE/logs/foo".  since db80d838 (Keep logs in $BASE instead of $WORKSPACE) this doesn't seem relevant.  do they remain for abstraction reasons, or has it just not been cleaned up?00:03
openstackgerritIan Wienand proposed a change to openstack-infra/devstack-gate: Cleanup of grenade and old/new log copy  https://review.openstack.org/9985200:06
jogoclarkb: ahh I figured it out00:08
jogoclarkb: re: why nodepool's periodic cleanup isn't working00:08
*** oomichi has quit IRC00:08
jogoclarkb: apscheduler allows only one copy of a periodic task to be running at a time00:09
jogoclarkb: and periodicCleanup waits tries to delete each stuck node and will wait until its cleaned00:10
jogojeblair: ^00:10
jeblairjogo: it's supposed to start a thread for each one it needs to delete00:11
*** sweston has quit IRC00:12
jogojeblair: but there is a waitForServerDeletion00:12
jeblairjogo: i have to run now, but i think that's inside of the thread00:13
*** oomichi has joined #openstack-infra00:16
jogojeblair: hmm if that is the case there may be a leak somewhere00:16
*** lttrl has quit IRC00:19
*** sarob__ has quit IRC00:20
*** dangers is now known as dangers_away00:20
*** sarob_ has joined #openstack-infra00:20
*** unicell has quit IRC00:21
*** cnesa has quit IRC00:22
*** sarob_ has quit IRC00:24
*** matsuhashi has joined #openstack-infra00:24
*** yamahata has joined #openstack-infra00:26
*** blamar has quit IRC00:27
*** CaptTofu_ has joined #openstack-infra00:27
*** otter768 has joined #openstack-infra00:29
openstackgerritTimothy R. Chavez proposed a change to openstack-infra/reviewstats: I think it should be '1st quartile' rather than '1rd quartile', but I'm no statistician.  https://review.openstack.org/10039300:31
openstackgerritMonty Taylor proposed a change to openstack-infra/reviewstats: Fix small grammatical errors  https://review.openstack.org/10039300:34
*** reed has quit IRC00:34
*** ramashri has quit IRC00:35
*** matjazp has joined #openstack-infra00:37
*** mmaglana has quit IRC00:38
*** dims has joined #openstack-infra00:38
*** wenlock_ has quit IRC00:40
*** matjazp has quit IRC00:42
*** dims has quit IRC00:43
*** lttrl has joined #openstack-infra00:49
*** rwsu has quit IRC00:52
openstackgerritSpencer Krum proposed a change to openstack-infra/infra-specs: Multiple Data Dirs proposal  https://review.openstack.org/10036300:59
*** otter768 has quit IRC01:06
*** CaptTof__ has joined #openstack-infra01:07
*** CaptTofu_ has quit IRC01:08
*** ramashri has joined #openstack-infra01:10
*** dims has joined #openstack-infra01:12
*** marcoemorais has quit IRC01:13
*** asettle has joined #openstack-infra01:16
harlowjahi guys, qq, is openstackgerrit acting odd, i noticed its in some rooms, but not in at least one of my other rooms?01:17
SpamapSCan elastic-recheck queries be written that span multiple lines?01:17
harlowjaoh, nm, my fault01:17
jogoSpamapS: no, each line is currently treated as a seperate document in ES01:18
SpamapSjogo: http://logs.openstack.org/09/96009/7/check/check-tempest-dsvm-postgres-full/7fb20c8/logs/screen-c-vol.txt.gz ... look for c895c621-772d-4064-af0b-319c0c1b5370 .. any ideas how to detect that failure, which appears to be that the lock is released before lvremove returns01:18
jogoSpamapS: a stacktrace is considered one line01:19
jogoso that may help01:19
jogojeblair: yeah your right, but based on the nodepool logs the cleanup task doesn't appear to run, at the very least the logs don't show it being run01:20
SpamapSjogo: the evidence is the lock removal preceding the lvremove failure01:23
SpamapSBut maybe the line number could work01:23
SpamapSuntil it changes. :-P01:23
jogoSpamapS: yeah we have no good way to handle that case currently01:26
SpamapSjogo: ok thanks.01:26
*** nosnos has joined #openstack-infra01:26
SpamapSjogo: if you think of a way to do it.. I filed the bug in cinder https://bugs.launchpad.net/cinder/+bug/133077601:27
uvirtbotLaunchpad bug 1330776 in cinder "lock may be released before lvremove command returns" [Undecided,New]01:27
*** sarob_ has joined #openstack-infra01:28
*** zehicle_at_dell has joined #openstack-infra01:29
*** sarob_ has quit IRC01:33
*** dprince has joined #openstack-infra01:36
*** matjazp has joined #openstack-infra01:38
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Put a default section header above the TTL  https://review.openstack.org/10032801:39
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: StoryBoard module bounces apache on update  https://review.openstack.org/10032901:39
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Add Storyboard puppet module  https://review.openstack.org/10032101:39
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Added Authorization Header flag to storyboard module  https://review.openstack.org/10032201:39
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Make storyboard run over ssl  https://review.openstack.org/10032301:39
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Load storyboard projects from projects.yaml  https://review.openstack.org/10032401:39
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Load storyboard superusers from yaml file  https://review.openstack.org/10032501:39
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Storyboard token expiration increased  https://review.openstack.org/10032601:39
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Make storyboard idempotent  https://review.openstack.org/10032701:39
*** sweston has joined #openstack-infra01:40
*** matjazp has quit IRC01:43
*** Ryan_Lane has quit IRC01:47
*** unicell has joined #openstack-infra01:47
*** dprince has quit IRC01:51
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Adding Rakefile  https://review.openstack.org/10037001:53
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Put a default section header above the TTL  https://review.openstack.org/10032801:53
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: StoryBoard module bounces apache on update  https://review.openstack.org/10032901:53
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Add Storyboard puppet module  https://review.openstack.org/10032101:53
*** sarob_ has joined #openstack-infra01:53
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Added Authorization Header flag to storyboard module  https://review.openstack.org/10032201:53
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Make storyboard run over ssl  https://review.openstack.org/10032301:53
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Load storyboard projects from projects.yaml  https://review.openstack.org/10032401:53
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Load storyboard superusers from yaml file  https://review.openstack.org/10032501:53
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Storyboard token expiration increased  https://review.openstack.org/10032601:53
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Make storyboard idempotent  https://review.openstack.org/10032701:54
*** wenlock_ has joined #openstack-infra01:56
*** sarob_ has quit IRC01:58
*** yaguang has joined #openstack-infra02:01
*** sweston has quit IRC02:03
*** nati_ueno has quit IRC02:08
*** zehicle_at_dell has quit IRC02:08
*** blamar has joined #openstack-infra02:16
openstackgerritA change was merged to openstack-infra/reviewstats: Fix small grammatical errors  https://review.openstack.org/10039302:17
*** Ryan_Lane has joined #openstack-infra02:18
*** marcoemorais has joined #openstack-infra02:23
*** otter768 has joined #openstack-infra02:25
*** basha has joined #openstack-infra02:31
openstackgerritgordon chung proposed a change to openstack-infra/elastic-recheck: Add query for ceilometer ValueError I/O bug 1329692  https://review.openstack.org/10040502:32
uvirtbotLaunchpad bug 1329692 in ceilometer "string io errors in unit test" [Undecided,New] https://launchpad.net/bugs/132969202:32
*** blamar has quit IRC02:32
*** penguinRaider has quit IRC02:35
*** bhuvan has quit IRC02:35
*** marcoemorais1 has joined #openstack-infra02:35
*** crc32 has quit IRC02:36
*** marcoemorais has quit IRC02:37
*** yjiang has joined #openstack-infra02:38
*** matjazp has joined #openstack-infra02:39
*** sarob_ has joined #openstack-infra02:39
*** crc32 has joined #openstack-infra02:40
*** otherwiseguy has joined #openstack-infra02:40
*** praneshp has quit IRC02:41
*** matjazp has quit IRC02:44
*** sarob_ has quit IRC02:44
*** ramashri has quit IRC02:47
*** niska has quit IRC02:49
*** niska has joined #openstack-infra02:51
*** otherwiseguy has quit IRC02:57
*** lttrl has quit IRC02:57
*** lttrl has joined #openstack-infra02:59
*** sarob_ has joined #openstack-infra03:00
*** renlt has joined #openstack-infra03:01
*** Ryan_Lane has quit IRC03:01
*** Longgeek has joined #openstack-infra03:02
mordrednibalizer wins the most recent patch-bomb-infra award03:02
*** yjiang has quit IRC03:02
*** asettle has quit IRC03:03
*** sarob_ has quit IRC03:04
*** basha has quit IRC03:06
*** yongli has joined #openstack-infra03:08
nibalizerwooooo03:09
*** otter768 has quit IRC03:15
*** mmaglana has joined #openstack-infra03:19
*** praneshp has joined #openstack-infra03:19
*** praneshp_ has joined #openstack-infra03:20
*** Ryan_Lane has joined #openstack-infra03:21
*** Ryan_Lane has joined #openstack-infra03:21
*** praneshp has quit IRC03:24
*** praneshp_ is now known as praneshp03:24
*** zhiyan_ is now known as zhiyan03:28
*** sarob_ has joined #openstack-infra03:28
*** matsuhashi has quit IRC03:30
*** sarob_ has quit IRC03:33
*** niska has quit IRC03:35
mikalDoes "reverify bug XXX" still work?03:35
mikalAhhh, it does. Good03:36
mikalJust saw another example of 133076303:36
*** ramashri has joined #openstack-infra03:37
*** niska has joined #openstack-infra03:37
*** harlowja is now known as harlowja_away03:37
*** matsuhashi has joined #openstack-infra03:37
*** harlowja_away is now known as harlowja03:39
*** matjazp has joined #openstack-infra03:40
*** Ryan_Lane has quit IRC03:40
*** nosnos has quit IRC03:41
*** matsuhashi has quit IRC03:44
*** matjazp has quit IRC03:44
*** matsuhashi has joined #openstack-infra03:45
jogolifeless: ping03:46
jogolifeless: so I think you are looking at the recent gate issues the wrong way03:47
*** trinaths has joined #openstack-infra03:48
*** matsuhashi has quit IRC03:49
*** niska has quit IRC03:50
lifelessjogo: hi!03:51
*** niska has joined #openstack-infra03:52
jogolifeless: so in short I think we have two related issues03:53
jogoin the past the only thing we tried to optimize for was gate stability, we could assume we could always get more cloud03:53
jogobut now we are almost always hitting the quota limits03:54
jogoso we need to optimize for constrained compute resources as well03:54
lifelessjogo: I alluded to this actually03:54
lifelessjogo: every gate reset is a resource hog, and every recheck is a resource hog.03:55
lifelessjogo: arguably the biggest resource hog is speculatively testing patches that haven't been reviewed.03:55
jogoright03:55
jogoso before we change anything, we should get better numbers03:55
lifelessjogo: so I agree that we have both those issues03:56
jogowe have done a significant amount of work on getting numbers to track job failure rates etc.03:56
lifelessjogo: now, how am I looking at it wrong ?03:56
jogowe need to do the same for gate throughput03:56
jogolifeless: I think the quota limits is a more significant factor at this point03:56
*** matsuhashi has joined #openstack-infra03:57
jogoso maybe not looking at it wrong per se.03:57
jogoI think one of the first steps is to collect data on some of this. how much of a resource hog are gate resets? rechecks? auto rechecks? etc03:58
lifelessMore significant than races in the gate? e.g. you're saying if we had 4x the total gate resources we wouldn't have a problem ?03:58
lifelessjogo: +1 on more data to model the problem03:58
lifelessjogo: cause, I don't believe more resources will fix anything03:58
jogolifeless: well sort of. if we had 4x the quota we would still have the occasional gate siezeup, but everything would be moving faster in general03:59
lifelessjogo: there's an easy way to test that. Turn off automatic checks entirely, leave check-before-gate in place and gate jobs only03:59
lifelesseasy in that its a fairly small config change.04:00
jogolifeless: actually I was thinking the same thing04:00
jogoso there may be some data to support that, that should be available today.04:00
jogowe can look at gerrit data to see how many auto rechecks are 'wasted'04:00
lifelessjogo: also regular check on upload04:01
lifelessjogo: and recheck xxx04:01
lifelessjogo: none of those at all are needed for gate health and velocity.04:01
mikalhttp://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOiBcIlVuaWNvZGVEZWNvZGVFcnJvclwiIiwiZmllbGRzIjpbXSwib2Zmc2V0IjowLCJ0aW1lZnJhbWUiOiI2MDQ4MDAiLCJncmFwaG1vZGUiOiJjb3VudCIsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxNDAwNDI3ODM3NzE0LCJtb2RlIjoiIiwiYW5hbHl6ZV9maWVsZCI6IiJ904:02
jogolifeless: so lets get some numbers on those04:02
mikal^-- scary... I'm not sure where to start to find the cause of that04:02
jogomikal: lol unicode04:03
mikaljogo: Yeah, the traceback doesn't really help identify where is coming from either04:03
jogomikal: you have a log file with what you are looking for?04:03
*** matsuhashi has quit IRC04:03
mikaljogo: I don't follow you?04:04
*** matsuhashi has joined #openstack-infra04:04
*** timfreund has quit IRC04:05
jogomikal: exactly, I don't follow you ^_^04:06
*** timfreund has joined #openstack-infra04:06
jogowhat are you looking for?04:06
mikalhttps://bugs.launchpad.net/nova/+bug/132065504:06
uvirtbotLaunchpad bug 1320655 in nova "UnicodeDecodeError in the nova gate logs" [Low,Confirmed]04:06
mikalWe're logging unicode decode stack traces in gate logs04:06
mikalBut the stack trace doesn't really help work out from ehre04:07
mikalDoesn't appear to happen in unit test runs04:08
*** yfried has quit IRC04:08
jogomikal: they all have Logged from file http.py, line 16704:10
jogothere is no http.py in nova04:10
jogome things glanceclient04:11
mikalTempest also has a http.py04:12
*** basha has joined #openstack-infra04:12
jogobut this is n-cpu04:12
mikalYeah, ok04:13
mikalIts not tempest anyways, that file isn't that long04:13
mikalLOG.debug('\n'.join([strutils.safe_encode(x) for x in dump]))04:14
jogohttp://git.openstack.org/cgit/openstack/python-glanceclient/tree/glanceclient/common/http.py#n16704:14
jogoyup04:14
mikalOh, safe_encode is throwing an exception?04:15
jogoperhaps04:15
jogonot sure04:15
* mikal fires off a test04:16
mikalhttps://review.openstack.org/100412 is with that line commented out04:16
jogogood idea04:18
*** basha has quit IRC04:18
*** penguinRaider has joined #openstack-infra04:19
jogoI am fairly sure that line is the issue04:20
jogonot sure why though04:20
*** crc32 has quit IRC04:20
mikalI'm not sure why they want to log that04:22
mikalI'm very tempted to comment it out for reals04:22
lifelessmikal: with the delete button ?04:23
*** Ryan_Lane has joined #openstack-infra04:23
mikalYah, something like that04:24
mikalJust checking its the thing first04:24
mikaljogo: does a reverify do a reverify now?04:24
mikaljogo: it seems to be rechecking, not reverifying?04:24
jogomikal: for a nova patch? just re +w it04:24
mikalHmmm, ok04:25
jogobut 'recheck' should do it tii04:25
lifelessmikal: thats the check-before-gate thing, I believe04:25
jogotoo04:25
jogolifeless: thats what  I believe too04:25
*** ramashri has quit IRC04:25
*** basha has joined #openstack-infra04:25
*** arnaud__ has quit IRC04:26
*** Ryan_Lane has quit IRC04:28
*** sarob_ has joined #openstack-infra04:28
*** arnaud__ has joined #openstack-infra04:30
*** nosnos has joined #openstack-infra04:30
*** sarob_ has quit IRC04:33
*** matsuhashi has quit IRC04:36
*** matsuhas_ has joined #openstack-infra04:37
*** matjazp has joined #openstack-infra04:40
*** asettle has joined #openstack-infra04:40
*** asettle has quit IRC04:41
*** matjazp has quit IRC04:45
jogolifeless: so yeah I think we need to collect some data on where the check queue work comes from04:46
*** penguinRaider has quit IRC04:48
*** lukego has joined #openstack-infra04:49
*** gyee has quit IRC04:51
*** dims has quit IRC04:58
jogonot sure how to slice it though04:58
*** yamahata has quit IRC04:58
*** yamahata has joined #openstack-infra04:59
jogojhesketh: ping05:03
jogogot a zuul question05:03
jheskethjogo: pong05:03
jheskethsuer05:03
jhesketh*sure05:03
jogojhesketh: where is the logic that says rerun check on a comment05:04
jheskethas in the configuration?05:04
jogoand the code05:04
jogoand/or05:04
jheskeththe configuration is in layout.yaml05:04
jhesketheach trigger is different05:04
jheskeththe gerrit triggers on comments05:04
jheskethand can have comment filters05:05
jheskethso in the code it's zuul/trigger/gerrit05:05
jhesketh.py05:05
jheskeththe scheduler.py builds an EventFilter object from the configuration05:06
jheskeththen in models.py:1037 there is EventFilter().matches05:06
jogojhesketh: is it possible to say that we don't want to rerun the check queue on negative votes?05:06
jheskethmodes.py:1066 is where the comment regex is performed05:07
jogoheh zuul docs say require-approval is deprecated05:08
jogobut I see it all over our config file05:08
jheskethyeah05:09
jheskethI'm just looking to see if we can do a negative against vote05:09
*** sweston has joined #openstack-infra05:09
jheskeths05:09
*** matjazp has joined #openstack-infra05:10
*** yfried has joined #openstack-infra05:10
jogojhesketh: I don't see a modes.py file05:10
jheskethsorry, typo, model.py05:11
jheskethso I think the answer is no05:11
jogojhesketh: ahh a comment is a comment is a comment05:11
jogojhesketh: can  that be changed?05:11
*** markmc has joined #openstack-infra05:12
*** penguinRaider has joined #openstack-infra05:14
jheskethjogo: at the moment require-approval and requires are both OR'd filters05:14
jheskethrequiring that nobody has given it a negative vote means we need to say AND not negative05:15
jheskethso it's a bit of rework05:15
jogojhesketh: I was thinking it would be a new filter05:15
jogonon_negative_comment or something05:16
jogoas running recheck on a negative comment seems strange05:16
jheskethjogo: so the recheck is for when Jenkins vote is outdated05:18
jheskethmaybe we just need to change the trigger for that to only happen if Jenkins is outdated and it had originally voted +105:18
jhesketh(so it won't try again on -1's)05:18
jogojhesketh: so that is a seperate case, but I like it05:19
*** mmaglana has quit IRC05:19
jheskethonly mildly separate, it should cover your case pretty well05:20
*** zhiyan is now known as zhiyan_05:20
lifelessjhesketh: no, it won't05:20
lifelessjhesketh: what jogo means is this:05:20
jogojhesketh: my case is, patch passes jobs, but I vote -105:20
*** eharney has quit IRC05:20
jogome not jenkins05:21
lifelessjhesketh: review is sitting open, jenkins is +1, reviewer pans it. No point rechecking at that point, since a human is saying 'no'.05:21
lifelessor wtf, or whatevs05:21
jheskethjogo, lifeless: ah right, I see05:22
jheskethwell that'll require some more work05:22
jheskethhowever there is an argument to be made if it should rerun or not05:22
jheskethas a reviewer's -1 doesn't always mean it won't be merged05:23
jheskethor that cores are still interested in it05:23
jheskethin which case re-running tests is still valuable05:23
*** doude_ has quit IRC05:23
jogojhesketh: true, but but it needs at least another + vote before it can be merged05:23
jogojhesketh: this is optimizing for a rare case IMHO05:23
jogobut unfortunitly my gerrit foo isn't strong enough to figure out how rare05:24
jogojhesketh: so this is all coming from the fact that we are hitting the quota limits on a regular basis.05:24
openstackgerritJoshua Hesketh proposed a change to openstack-infra/config: Don't auto-recheck when last check was false  https://review.openstack.org/10041705:24
jogojhesketh: nooo I was writting that patch05:24
* jhesketh wins05:25
* jogo sulks 05:25
jogowell my patch was wrong05:25
jheskethyeah I tend to agree, but I'd like to get jeblair's input before implementing such a feature in zuul05:25
jogojhesketh: works for me05:26
*** ildikov has quit IRC05:28
*** sarob_ has joined #openstack-infra05:28
jogodo we have recheck enabled for non integrated jobs?05:29
*** rcarrillocruz has joined #openstack-infra05:31
jheskethjogo: any jobs in the check queue will have it05:31
jogojhesketh: looks like we do, anyway to change that as well05:31
trinathssweston: ping05:31
jogojhesketh: as we only care about the check freshness for things that will be part of the integrated gate right?05:31
jogoor care about a lot more05:31
swestontrinaths: pong05:31
jheskethjogo: I guess that's true.. they are the things that'll hold up the gate05:32
jheskethhowever having a fresh check is a good idea05:32
swestontrinaths:  remind me what I was helping you with05:32
jogojhesketh: a good idea sure, but this all comes down to we keep hitting our resource limits05:32
*** sarob_ has quit IRC05:32
swestontrinaths: long day :-)05:32
jogoso we have to now optimize to get the most bang for our buck05:32
trinathssweston: yes.  I need help on CI performance improvement05:32
trinathssweston: :-)05:33
swestontrinaths: ok, how long are your runs taking now?05:33
trinathssweston: free now ..?05:33
swestontrinaths: yes, free now05:33
trinathssweston: it take around 1 hr average for each build.05:33
jogojhesketh: anyway I am just poking around to get a sense of things. and it looks like there is plenty of room for tweaking05:34
jogoif we so choose05:34
mikaljogo: my patch did not remove the unicodedecode error05:34
mikalMutter05:34
jheskethsure05:34
swestontrinaths:  do you know what a pypi mirror is?05:34
trinathssweston: setting up work space takes around 25 minutes05:34
swestontrinaths: wow05:34
trinathssweston: no.05:34
swestontrinaths: how fast is your internet?05:35
swestontrinaths: a pypi mirror will cache all of the packages needed to set up your jenkins slave, at least the python packages05:36
swestontrinaths: you might benefit also from a ubuntu mirror05:36
trinathssweston: its our corp network.05:36
trinathssweston: pypi mirror needs some other configuration. how can I do that.05:37
*** ildikov has joined #openstack-infra05:37
swestontrinaths: let me dig around for some directions that look good05:37
trinathssweston: okay.05:38
*** lukego has quit IRC05:41
*** sarob_ has joined #openstack-infra05:42
*** denis_makogon has joined #openstack-infra05:42
*** lukego has joined #openstack-infra05:42
swestontrinaths: this one looks pretty good. https://github.com/mviera/pypi-mirror05:43
jogomikal: hrm, I wonder what other http.py it could be05:44
jogomikal: link?05:44
*** matjazp has quit IRC05:44
*** Longgeek has quit IRC05:45
swestontrinaths: would you like to give it a shot?  I need about 4 hours of sleep, then can meet you back here05:45
*** Longgeek has joined #openstack-infra05:45
trinathssweston: okay. i need to install this in my jenkins slave.05:46
*** matjazp has joined #openstack-infra05:46
trinathssweston: sure. sleep is the first priority in life for a hard worker.05:46
*** sarob_ has quit IRC05:46
trinathssweston: kindly ping me when you are free05:46
swestontrinaths: yes, I will do so. ;-)05:47
jogomikal: anyway its getting late here o/05:47
trinathssweston: thanks for help. good night05:47
*** harlowja is now known as harlowja_away05:48
jogomikal: strange it loooks like that line is still being used05:48
*** Longgeek has quit IRC05:49
jogomikal: wrong line05:51
jogo        LOG.debug('\n'.join([strutils.safe_encode(x) for x in dump05:51
jogoline 16705:51
jogonot 15305:51
*** rfolco has quit IRC05:51
jogoanyway o/05:51
mikalOh wait05:52
mikalWould it be because tempest is usign the pypi glaneclient for that test?05:52
swestontrinaths: anytime, see you in a bit05:52
trinathssweston: okay05:53
jogomikal: see above, your patch is wrong ;)05:53
*** _nadya_ has joined #openstack-infra05:55
mikaljogo: go to bed05:55
mikalI will flail without you05:55
trinathssweston: one doubt, if you are around, when I install pypi-mirrors as per the link, do I need to configure devstack(-gate) ?05:55
*** matjazp has quit IRC05:56
lukegoHowdy. I’m recovering my CI from problems over the weekend, possibly related to the setuptools issue. anyone know why I might be seeing this?05:58
lukegoci@egg:/opt/stack/tempest$ python -m subunit.run discover -t . --list05:58
lukegoValueError: Duplicate test id detected: tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network[gate,smoke]05:58
swestontrinaths: thinking05:58
swestontrinaths: it should be on a separate vm05:59
trinathssweston: okay, can it be with the jenkins master05:59
trinathssweston: I have a master and 3 slave nodes06:00
swestontrinaths: theoretically that should work, looks like the port will be on port 900006:01
*** zhiyan_ is now known as zhiyan06:02
swestontrinaths: might need to inject something into the slave nodes, let me check on that06:02
trinathssweston: okay let me try on jenkins master when runs zuul, gearman, jenkins to host this mirror.06:03
*** rfolco has joined #openstack-infra06:04
*** yfried_ has joined #openstack-infra06:04
*** yfried has quit IRC06:05
trinathssweston: will these mirrors be helpful. http://www.pypi-mirrors.org/06:06
*** oomichi has quit IRC06:07
*** matjazp has joined #openstack-infra06:07
swestontrinaths: probably better to have the mirror on your network06:08
*** Longgeek has joined #openstack-infra06:08
swestontrinaths: then you only have to pull everything down once06:08
trinathssweston: okay. can you be some what clear on " then you only have to pull everything down once"06:09
swestontrinaths: so you won't need to keep downloading the same packages repeatedly06:10
trinathssweston: will the git package suggested before does the package download on a periodic manner and preserve a local copy.06:10
trinathssweston: okay06:10
*** matjazp has quit IRC06:11
*** e0ne has joined #openstack-infra06:12
*** unicell has quit IRC06:14
*** yfried_ has quit IRC06:15
*** oomichi has joined #openstack-infra06:17
*** penguinRaider has quit IRC06:18
openstackgerritJoshua Harlow proposed a change to openstack/requirements: Fix whitespace that occurs after comma  https://review.openstack.org/9048406:22
*** sunrenjie6 has joined #openstack-infra06:24
*** sunrenjie6 has quit IRC06:25
*** sunrenjie6 has joined #openstack-infra06:26
*** freyes has joined #openstack-infra06:26
*** sarob_ has joined #openstack-infra06:28
*** sunrenjie6 has quit IRC06:30
*** flaper87|afk is now known as flaper8706:32
*** afazekas_ has joined #openstack-infra06:32
*** sarob_ has quit IRC06:32
*** dkehnx has quit IRC06:36
*** dkehnx has joined #openstack-infra06:36
openstackgerritMark McLoughlin proposed a change to openstack-infra/elastic-recheck: Add signature for flavors marker not found bug  https://review.openstack.org/10043206:36
*** marcoemorais1 has quit IRC06:36
*** e0ne has quit IRC06:38
*** chandan_kumar has quit IRC06:38
*** sunrenjie6 has joined #openstack-infra06:41
*** _nadya_ has quit IRC06:42
*** sweston has quit IRC06:46
renltHi infra team06:48
renlthere is a question about delete branch for stackforge project06:48
*** sunrenjie6 has quit IRC06:48
*** matjazp has joined #openstack-infra06:49
renltgit push --force gerrit :stable/icehouse06:49
renltremote: Branch refs/heads/stable/icehouse:06:49
renltremote: You need 'Push' rights with the 'Force Push'06:49
renltremote: flag set to delete references.06:49
renltremote: User: gpanda06:49
renltremote: Please read the documentation and contact an administrator06:49
renltremote: if you feel the configuration is incorrect06:49
renltremote: Processing changes: refs: 1, done06:49
renltTo ssh://gpanda@review.openstack.org:29418/stackforge/powervc-driver.git06:49
renlt ! [remote rejected] stable/icehouse (cannot delete references)06:49
*** sunrenjie6 has joined #openstack-infra06:49
renlterror: failed to push some refs to 'ssh://gpanda@review.openstack.org:29418/stackforge/powervc-driver.git06:49
renltany one has idea with this, do I need set acl for this force push rights? thanks in advance.06:50
*** matjazp_ has joined #openstack-infra06:50
*** matjazp_ has quit IRC06:50
*** yfried_ has joined #openstack-infra06:51
*** matjazp has quit IRC06:53
*** sunrenjie6 has quit IRC06:54
*** matjazp has joined #openstack-infra07:05
mattoliveraurenlt: looks like a missing acl to me, and infact I think only gerrit administators can delete branches.. although I could be wrong. You may need to either come back here when some infra-root's are available who have to rights to do so, or I've seen in a quick search some people raise a infra bug (openstack-ci) for that. E.g: http://is.gd/jaE6g907:05
*** yfried_ has quit IRC07:09
*** navneet1 has joined #openstack-infra07:09
*** jcoufal has joined #openstack-infra07:09
navneet1Hi..anybody canhelp regarding 3rd party ci set up07:10
navneet1?07:10
navneet1our gerrit keys are still not registered...though the bug raised was closed07:11
renltmattoliverau: thanks, here is my acl config for our project, https://review.openstack.org/#/c/97726/2/modules/openstack_project/files/gerrit/acls/stackforge/powervc-driver.config07:13
renltmattoliverau: there is a abandon right07:14
mattoliverauHey navneet1, you might have to wait until an infra-root is awake and available, I can't get on the boxes to check, but do you have the bug id or url in question so I can take a look?07:15
*** Hal_ has joined #openstack-infra07:15
mattoliveraurenlt: yeah, but I think the abandon allows cores to control abandoned changes in gerrit07:15
*** pcrews has quit IRC07:17
*** arnaud__ has quit IRC07:17
*** andreykurilin_ has joined #openstack-infra07:17
renltmattoliverau: maybe, thanks for the bug sample.07:19
*** rdopiera has joined #openstack-infra07:19
*** rdopiera has quit IRC07:20
*** rdopieralski has joined #openstack-infra07:20
mattoliveraurenlt: no problem, sorry I can't be of more help. You can do the 2 pronged attack. Post a bug and then talk to someone in here during US hours.. Then you can't fail :) And I'll tell you what, I'll ask someone in my morning because that's usually the end of the US day. And I can let you know tomorrow if you want.07:22
navneet1mattoliverau: hi mattoliverau...this is the bug   https://bugs.launchpad.net/openstack-ci/+bug/128480807:22
*** lukego has quit IRC07:22
uvirtbotLaunchpad bug 1284808 in openstack-ci "Request for NetAPP CI service account" [Medium,Fix released]07:22
*** ArxCruz has quit IRC07:23
navneet1mattoliverau: it says fixed released but we get error when we do connectivity tests07:23
boris-42jhesketh hi there07:24
navneet1mattoliverau: also I just tried searching launchpad with the email and it says no account registered....not sure if went to the right place07:24
jheskethboris-42: howdy07:25
*** yfried_ has joined #openstack-infra07:25
*** sarob_ has joined #openstack-infra07:28
*** andreykurilin_ has quit IRC07:28
*** e0ne has joined #openstack-infra07:30
mattoliveraunavneet1: It needs to be placed on the gerrit server, So you can access the gerrit event stream. I was hoping that the users were managed via the config repo, like most other things, but isn't. Sorry. but you've updated the bug, so hopefully an infra-root can help you when they are awake. Sorry I can't help further.07:30
boris-42jhesketh could you pls help with patch https://review.openstack.org/#/c/100052/ I am not sure that I did it properly07:31
boris-42jhesketh I need to get publish on pushing tags to pypi new releases=)07:31
boris-42jhesketh I forgot to do this in first patch =(07:31
navneet1mattoliverau: can I see if the id is on gerrit server?07:32
navneet1any link/website?07:32
*** denis_makogon has quit IRC07:33
navneet1mattoliverau: Also do you know ppl in infra-rrot whom I can ping for the same?07:33
*** sarob_ has quit IRC07:33
openstackgerrityolanda.robla proposed a change to openstack-infra/nodepool: Build images using diskimage-builder  https://review.openstack.org/4648207:34
*** e0ne has quit IRC07:35
mattoliveraunavneet1: not that I am aware of (though I could be wrong), it isn't a user or group in gerrit, but a system user how can SSH in as access to event stream.07:36
renltmattoliverau:you are so kind! I just opened a bug https://bugs.launchpad.net/openstack-ci/+bug/1330854 and maybe Jeremy Stanley is the right person.07:37
uvirtbotLaunchpad bug 1330854 in openstack-ci "Please help to delete stack/icehouse branch of stackforge/powervc-driver" [Undecided,New]07:37
*** mrda is now known as mrda-away07:37
mattoliveraunavneet1: There are quite a few, but clarkb would be your best bet as he is the one who worked on you the bug you have.07:37
mattoliveraurenlt: Thanks, and nice, I'll follow up on it when I wake up :)07:38
*** wenlock_ has quit IRC07:39
*** lukego has joined #openstack-infra07:39
*** ihrachyshka has joined #openstack-infra07:39
mattoliveraunavneet1: Also, cause I put him in the message, he'll read it during scroll back when he wakes up and hopefully ping you :)07:40
renltmattoliverau: appreciate your help!07:41
mattoliveraunavneet1: but just to be sure.. clarkb: when you wake up could you please help navneet1 with his 3rd party gerrit account, you worked on it in  http://is.gd/yvybff and he still can't log in.07:42
mattoliveraurenlt: any time.07:42
mattoliverauOn that note I need to go start making dinner before the wife gets home. Night all.07:42
*** pblaho has joined #openstack-infra07:44
*** matsuhas_ has quit IRC07:49
*** dizquierdo has joined #openstack-infra07:49
*** renlt has quit IRC07:50
*** matsuhashi has joined #openstack-infra07:51
*** pblaho is now known as pblaho|afk07:54
*** jpich has joined #openstack-infra07:55
*** jcooley has quit IRC07:56
*** matjazp has left #openstack-infra07:56
*** jcooley has joined #openstack-infra07:56
navneet1mattoliverau: Thanks!07:58
*** pblaho|afk is now known as pblaho07:58
*** _nadya_ has joined #openstack-infra08:00
*** jp_at_hp has joined #openstack-infra08:01
*** _nadya_ has quit IRC08:16
*** ildikov has quit IRC08:16
*** nosnos has quit IRC08:16
*** maxbit has quit IRC08:16
*** krtaylor has quit IRC08:16
*** yolanda has quit IRC08:16
*** amotoki has quit IRC08:16
*** camunoz has quit IRC08:16
*** Alexei_987 has quit IRC08:16
*** slamont has quit IRC08:16
*** bradm has quit IRC08:16
*** grantbow has quit IRC08:16
*** bcrochet has quit IRC08:16
*** jcooley has quit IRC08:16
*** basha has quit IRC08:16
*** medieval1 has quit IRC08:16
*** gargola has quit IRC08:16
*** cody-somerville has quit IRC08:16
*** salv-orlando has quit IRC08:16
*** saper has quit IRC08:16
*** gnuoy has quit IRC08:16
*** torgomatic has quit IRC08:16
*** d0ugal has quit IRC08:16
*** bogdando has quit IRC08:16
*** masayukig has quit IRC08:16
*** phschwartz has quit IRC08:16
*** skraynev has quit IRC08:16
*** bnemec has quit IRC08:16
*** jd__ has quit IRC08:16
*** fbo has quit IRC08:16
*** portante has quit IRC08:16
*** sdague has quit IRC08:16
*** russell_h has quit IRC08:16
*** briancline has quit IRC08:16
*** tnurlygayanov has quit IRC08:16
*** morganfainberg has quit IRC08:16
*** paul-- has quit IRC08:16
*** harlowja_away has quit IRC08:16
*** mgagne has quit IRC08:16
*** sileht has quit IRC08:16
*** jlk has quit IRC08:16
*** yjiang5 has quit IRC08:16
*** roaet_ has quit IRC08:16
*** adam_g has quit IRC08:16
*** mkoderer has quit IRC08:16
*** rainya has quit IRC08:16
*** dolphm has quit IRC08:16
*** russellb has quit IRC08:16
*** zz_gondoi has quit IRC08:16
*** vishy has quit IRC08:16
*** wendar has quit IRC08:16
*** stevebaker has quit IRC08:16
*** Mithrandir has quit IRC08:16
*** alaski has quit IRC08:16
*** jbryce has quit IRC08:16
*** Adri2000 has quit IRC08:16
*** mordred_phone has quit IRC08:16
*** bodepd has quit IRC08:16
*** zigo has quit IRC08:16
*** jgriffith has quit IRC08:16
*** morgabra has quit IRC08:16
*** notmyname has quit IRC08:16
*** hdd has quit IRC08:16
*** zhiyan has quit IRC08:16
*** briancurtin has quit IRC08:16
*** chmouel has quit IRC08:16
*** mrda-away has quit IRC08:16
*** antonym has quit IRC08:16
*** thingee has quit IRC08:16
*** clarkb has quit IRC08:16
*** ttx has quit IRC08:16
*** uvirtbot has quit IRC08:16
*** dragondm has quit IRC08:16
*** boris-42 has quit IRC08:16
*** dizquierdo has quit IRC08:16
*** dkehnx has quit IRC08:16
*** trinaths has quit IRC08:16
*** ociuhandu has quit IRC08:16
*** vhoward has quit IRC08:16
*** miqui has quit IRC08:16
*** dmakogon_ has quit IRC08:16
*** zul has quit IRC08:16
*** rgerganov has quit IRC08:16
*** gema has quit IRC08:16
*** pfallenop has quit IRC08:16
*** HenryG has quit IRC08:16
*** mattoliverau has quit IRC08:16
*** johnthetubaguy has quit IRC08:16
*** mancdaz has quit IRC08:16
*** ihrachyshka has quit IRC08:16
*** rdopieralski has quit IRC08:16
*** navneet1 has quit IRC08:16
*** markmc has quit IRC08:16
*** yamahata has quit IRC08:16
*** CaptTof__ has quit IRC08:16
*** enikanorov__ has quit IRC08:16
*** YorikSar has quit IRC08:16
*** openstackgerrit has quit IRC08:16
*** mrodden has quit IRC08:16
*** fifieldt has quit IRC08:16
*** cdub has quit IRC08:16
*** mwagner_lap has quit IRC08:16
*** vladan has quit IRC08:16
*** matsuhashi has quit IRC08:16
*** Hal_ has quit IRC08:16
*** oomichi has quit IRC08:16
*** yongli has quit IRC08:16
*** krotscheck has quit IRC08:16
*** eglynn-regus has quit IRC08:16
*** kmartin has quit IRC08:16
*** moted has quit IRC08:16
*** kashyap has quit IRC08:16
*** jhesketh has quit IRC08:16
*** srenatus has quit IRC08:16
*** mmitchell_ has quit IRC08:16
*** jamielennox has quit IRC08:16
*** achuprin_ has quit IRC08:16
*** enikanorov has quit IRC08:16
*** jp_at_hp has quit IRC08:16
*** lukego has quit IRC08:16
*** afazekas_ has quit IRC08:16
*** rfolco has quit IRC08:16
*** rcarrillocruz has quit IRC08:16
*** timfreund has quit IRC08:16
*** praneshp has quit IRC08:16
*** yaguang has quit IRC08:16
*** dhellmann has quit IRC08:16
*** lyxus has quit IRC08:16
*** changbl has quit IRC08:16
*** fabo has quit IRC08:16
*** dosaboy has quit IRC08:16
*** afazekas has quit IRC08:16
*** med_ has quit IRC08:16
*** AaronGr has quit IRC08:16
*** dkehn has quit IRC08:16
*** Guest56682 has quit IRC08:16
*** mnaser has quit IRC08:16
*** mdenny has quit IRC08:16
*** sulochan_ has quit IRC08:16
*** anteaya has quit IRC08:16
*** pblaho has quit IRC08:16
*** yfried_ has quit IRC08:16
*** jcoufal has quit IRC08:16
*** W00die has quit IRC08:16
*** chuckC has quit IRC08:16
*** vponomaryov has quit IRC08:16
*** plars has quit IRC08:16
*** mkerrin has quit IRC08:16
*** locke105 has quit IRC08:16
*** dkliban has quit IRC08:16
*** msuriar has quit IRC08:16
*** spiffxp has quit IRC08:16
*** Shrews has quit IRC08:16
*** gilliard has quit IRC08:16
*** nikhil___|afk has quit IRC08:16
*** devananda has quit IRC08:16
*** tristanC has quit IRC08:16
*** dtroyer_zz has quit IRC08:16
*** timrc has quit IRC08:16
*** BadCub has quit IRC08:16
*** ekarlso has quit IRC08:16
*** jerryz has quit IRC08:16
*** StevenK has quit IRC08:16
*** maurosr has quit IRC08:16
*** gfa has quit IRC08:16
*** SpamapS has quit IRC08:16
*** jpeeler has quit IRC08:16
*** toabctl has quit IRC08:16
*** mugsie has quit IRC08:16
*** simonmcc has quit IRC08:16
*** flaviof has quit IRC08:16
*** ogelbukh has quit IRC08:16
*** rossella_s has quit IRC08:16
*** mattymo has quit IRC08:16
*** sabari has quit IRC08:16
*** arunkant has quit IRC08:16
*** ctracey has quit IRC08:16
*** dougwig has quit IRC08:16
*** Alec-A2 has quit IRC08:16
*** serverascode has quit IRC08:16
*** ChanServ has quit IRC08:16
*** cyli has quit IRC08:16
*** Hunner has quit IRC08:16
*** proffalken has quit IRC08:16
*** GheRivero has quit IRC08:16
*** Kiall has quit IRC08:16
*** NobodyCam has quit IRC08:16
*** jesusaurus has quit IRC08:16
*** jeblair has quit IRC08:16
*** dansmith has quit IRC08:16
*** dangers_away has quit IRC08:16
*** NithyaG_afk has quit IRC08:16
*** flaper87 has quit IRC08:16
*** soren has quit IRC08:16
*** lifeless has quit IRC08:16
*** pbelanyi has quit IRC08:16
*** mtreinish has quit IRC08:17
*** slagle has quit IRC08:17
*** Longgeek has quit IRC08:17
*** lttrl has quit IRC08:17
*** rkukura has quit IRC08:17
*** Ryan_Lane1 has quit IRC08:17
*** loquacities has quit IRC08:17
*** dkranz has quit IRC08:17
*** hogepodge has quit IRC08:17
*** sandywalsh has quit IRC08:17
*** ianw has quit IRC08:17
*** jamespage has quit IRC08:17
*** bookwar has quit IRC08:17
*** SumitNaiksatam has quit IRC08:17
*** SlickNik has quit IRC08:17
*** tteggel has quit IRC08:17
*** isviridov|away has quit IRC08:17
*** shardy has quit IRC08:17
*** pleia2 has quit IRC08:17
*** therve has quit IRC08:17
*** hughsaunders has quit IRC08:17
*** Ng has quit IRC08:17
*** psedlak has quit IRC08:17
*** SergeyLukjanov has quit IRC08:17
*** NikitaKonovalov has quit IRC08:17
*** dmitryme has quit IRC08:17
*** gaelL has quit IRC08:17
*** ptoohill has quit IRC08:17
*** sbadia has quit IRC08:17
*** clayg has quit IRC08:17
*** jpich has quit IRC08:17
*** Clabbe has quit IRC08:17
*** vipul has quit IRC08:17
*** mikal has quit IRC08:17
*** jamespd has quit IRC08:17
*** ruhe has quit IRC08:17
*** BobBall has quit IRC08:17
*** jomara has quit IRC08:17
*** gpocentek has quit IRC08:17
*** comstud has quit IRC08:17
*** nibalizer has quit IRC08:17
*** tchaypo has quit IRC08:17
*** pabelanger has quit IRC08:17
*** jasond` has quit IRC08:17
*** nijaba has quit IRC08:17
*** esmute has quit IRC08:17
*** radez_g0n3 has quit IRC08:17
*** greghaynes has quit IRC08:17
*** jogo has quit IRC08:17
*** wayneeseguin has quit IRC08:17
*** Daviey has quit IRC08:17
*** juice has quit IRC08:17
*** kevinbenton has quit IRC08:17
*** mika has quit IRC08:17
*** zaro has quit IRC08:17
*** gothicmindfood has quit IRC08:17
*** cgoncalves has quit IRC08:17
*** EntropyWorks has quit IRC08:17
*** dragondm has joined #openstack-infra08:22
*** uvirtbot has joined #openstack-infra08:22
*** ttx has joined #openstack-infra08:22
*** clarkb has joined #openstack-infra08:22
*** thingee has joined #openstack-infra08:22
*** antonym has joined #openstack-infra08:22
*** chmouel has joined #openstack-infra08:22
*** hdd has joined #openstack-infra08:22
*** notmyname has joined #openstack-infra08:22
*** morgabra has joined #openstack-infra08:22
*** jgriffith has joined #openstack-infra08:22
*** zigo has joined #openstack-infra08:22
*** zhiyan has joined #openstack-infra08:22
*** mrda-away has joined #openstack-infra08:22
*** bodepd has joined #openstack-infra08:22
*** mordred_phone has joined #openstack-infra08:22
*** Adri2000 has joined #openstack-infra08:22
*** jbryce has joined #openstack-infra08:22
*** alaski has joined #openstack-infra08:22
*** Mithrandir has joined #openstack-infra08:22
*** stevebaker has joined #openstack-infra08:22
*** wendar has joined #openstack-infra08:22
*** vishy has joined #openstack-infra08:22
*** zz_gondoi has joined #openstack-infra08:22
*** russellb has joined #openstack-infra08:22
*** briancline has joined #openstack-infra08:22
*** russell_h has joined #openstack-infra08:22
*** dolphm has joined #openstack-infra08:22
*** rainya has joined #openstack-infra08:22
*** mkoderer has joined #openstack-infra08:22
*** sdague has joined #openstack-infra08:22
*** adam_g has joined #openstack-infra08:22
*** roaet_ has joined #openstack-infra08:22
*** portante has joined #openstack-infra08:22
*** fbo has joined #openstack-infra08:22
*** yjiang5 has joined #openstack-infra08:22
*** jd__ has joined #openstack-infra08:22
*** bnemec has joined #openstack-infra08:22
*** jlk has joined #openstack-infra08:22
*** bcrochet has joined #openstack-infra08:22
*** grantbow has joined #openstack-infra08:22
*** briancurtin has joined #openstack-infra08:22
*** bradm has joined #openstack-infra08:22
*** sileht has joined #openstack-infra08:22
*** skraynev has joined #openstack-infra08:22
*** phschwartz has joined #openstack-infra08:22
*** masayukig has joined #openstack-infra08:22
*** bogdando has joined #openstack-infra08:22
*** d0ugal has joined #openstack-infra08:22
*** torgomatic has joined #openstack-infra08:22
*** mgagne has joined #openstack-infra08:22
*** slamont has joined #openstack-infra08:22
*** gnuoy has joined #openstack-infra08:22
*** saper has joined #openstack-infra08:22
*** Alexei_987 has joined #openstack-infra08:22
*** camunoz has joined #openstack-infra08:22
*** amotoki has joined #openstack-infra08:22
*** salv-orlando has joined #openstack-infra08:22
*** yolanda has joined #openstack-infra08:22
*** tnurlygayanov has joined #openstack-infra08:22
*** krtaylor has joined #openstack-infra08:22
*** cody-somerville has joined #openstack-infra08:22
*** gargola has joined #openstack-infra08:22
*** harlowja_away has joined #openstack-infra08:22
*** medieval1 has joined #openstack-infra08:22
*** maxbit has joined #openstack-infra08:22
*** basha has joined #openstack-infra08:22
*** nosnos has joined #openstack-infra08:22
*** ildikov has joined #openstack-infra08:22
*** jcooley has joined #openstack-infra08:22
*** _nadya_ has joined #openstack-infra08:22
*** sunrenjie6 has joined #openstack-infra08:22
*** pelix has joined #openstack-infra08:22
*** jistr has joined #openstack-infra08:22
*** jp_at_hp has joined #openstack-infra08:22
*** jpich has joined #openstack-infra08:22
*** matsuhashi has joined #openstack-infra08:22
*** dizquierdo has joined #openstack-infra08:22
*** pblaho has joined #openstack-infra08:22
*** ihrachyshka has joined #openstack-infra08:22
*** lukego has joined #openstack-infra08:22
*** yfried_ has joined #openstack-infra08:22
*** rdopieralski has joined #openstack-infra08:22
*** Hal_ has joined #openstack-infra08:22
*** jcoufal has joined #openstack-infra08:22
*** navneet1 has joined #openstack-infra08:22
*** dkehnx has joined #openstack-infra08:22
*** afazekas_ has joined #openstack-infra08:22
*** oomichi has joined #openstack-infra08:22
*** Longgeek has joined #openstack-infra08:22
*** rfolco has joined #openstack-infra08:22
*** rcarrillocruz has joined #openstack-infra08:22
*** markmc has joined #openstack-infra08:22
*** yamahata has joined #openstack-infra08:22
*** timfreund has joined #openstack-infra08:22
*** trinaths has joined #openstack-infra08:22
*** praneshp has joined #openstack-infra08:22
*** yongli has joined #openstack-infra08:22
*** lttrl has joined #openstack-infra08:22
*** yaguang has joined #openstack-infra08:22
*** CaptTof__ has joined #openstack-infra08:22
*** rkukura has joined #openstack-infra08:22
*** Ryan_Lane1 has joined #openstack-infra08:22
*** ociuhandu has joined #openstack-infra08:22
*** loquacities has joined #openstack-infra08:22
*** dhellmann has joined #openstack-infra08:22
*** vhoward has joined #openstack-infra08:22
*** lyxus has joined #openstack-infra08:22
*** krotscheck has joined #openstack-infra08:22
*** miqui has joined #openstack-infra08:22
*** eglynn-regus has joined #openstack-infra08:22
*** flaviof has joined #openstack-infra08:22
*** kmartin has joined #openstack-infra08:22
*** denis_makogon has joined #openstack-infra08:22
*** enikanorov__ has joined #openstack-infra08:22
*** zul has joined #openstack-infra08:22
*** moted has joined #openstack-infra08:22
*** dkranz has joined #openstack-infra08:22
*** changbl has joined #openstack-infra08:22
*** hogepodge has joined #openstack-infra08:22
*** W00die has joined #openstack-infra08:22
*** kashyap has joined #openstack-infra08:22
*** chuckC has joined #openstack-infra08:22
*** sandywalsh has joined #openstack-infra08:22
*** mugsie has joined #openstack-infra08:22
*** YorikSar has joined #openstack-infra08:22
*** openstackgerrit has joined #openstack-infra08:22
*** vponomaryov has joined #openstack-infra08:22
*** dmitryme has joined #openstack-infra08:22
*** Clabbe has joined #openstack-infra08:22
*** rgerganov has joined #openstack-infra08:22
*** mrodden has joined #openstack-infra08:22
*** gema has joined #openstack-infra08:22
*** jhesketh has joined #openstack-infra08:22
*** ianw has joined #openstack-infra08:22
*** fifieldt has joined #openstack-infra08:22
*** cdub has joined #openstack-infra08:22
*** fabo has joined #openstack-infra08:22
*** pfallenop has joined #openstack-infra08:22
*** dosaboy has joined #openstack-infra08:22
*** afazekas has joined #openstack-infra08:22
*** srenatus has joined #openstack-infra08:22
*** HenryG has joined #openstack-infra08:22
*** mattoliverau has joined #openstack-infra08:22
*** jamespage has joined #openstack-infra08:22
*** mmitchell_ has joined #openstack-infra08:22
*** plars has joined #openstack-infra08:22
*** mwagner_lap has joined #openstack-infra08:22
*** bookwar has joined #openstack-infra08:22
*** slagle has joined #openstack-infra08:22
*** med_ has joined #openstack-infra08:22
*** AaronGr has joined #openstack-infra08:22
*** jamielennox has joined #openstack-infra08:22
*** mkerrin has joined #openstack-infra08:22
*** johnthetubaguy has joined #openstack-infra08:22
*** dkehn has joined #openstack-infra08:22
*** achuprin_ has joined #openstack-infra08:22
*** SumitNaiksatam has joined #openstack-infra08:22
*** vladan has joined #openstack-infra08:22
*** boris-42 has joined #openstack-infra08:22
*** mancdaz has joined #openstack-infra08:22
*** jerryz has joined #openstack-infra08:22
*** locke105 has joined #openstack-infra08:22
*** StevenK has joined #openstack-infra08:22
*** enikanorov has joined #openstack-infra08:22
*** SlickNik has joined #openstack-infra08:22
*** mnaser has joined #openstack-infra08:22
*** tteggel has joined #openstack-infra08:22
*** dkliban has joined #openstack-infra08:22
*** Guest56682 has joined #openstack-infra08:22
*** msuriar has joined #openstack-infra08:22
*** mdenny has joined #openstack-infra08:22
*** spiffxp has joined #openstack-infra08:22
*** simonmcc has joined #openstack-infra08:22
*** sulochan_ has joined #openstack-infra08:22
*** anteaya has joined #openstack-infra08:22
*** Shrews has joined #openstack-infra08:22
*** ogelbukh has joined #openstack-infra08:22
*** rossella_s has joined #openstack-infra08:22
*** cyli has joined #openstack-infra08:22
*** gilliard has joined #openstack-infra08:22
*** nikhil___|afk has joined #openstack-infra08:22
*** mattymo has joined #openstack-infra08:22
*** maurosr has joined #openstack-infra08:22
*** devananda has joined #openstack-infra08:22
*** tristanC has joined #openstack-infra08:22
*** jasond` has joined #openstack-infra08:22
*** dtroyer_zz has joined #openstack-infra08:22
*** gfa has joined #openstack-infra08:22
*** SpamapS has joined #openstack-infra08:22
*** sabari has joined #openstack-infra08:22
*** nijaba has joined #openstack-infra08:22
*** timrc has joined #openstack-infra08:22
*** arunkant has joined #openstack-infra08:22
*** BadCub has joined #openstack-infra08:22
*** esmute has joined #openstack-infra08:22
*** jpeeler has joined #openstack-infra08:22
*** ekarlso has joined #openstack-infra08:22
*** greghaynes has joined #openstack-infra08:22
*** isviridov|away has joined #openstack-infra08:22
*** Hunner has joined #openstack-infra08:22
*** proffalken has joined #openstack-infra08:22
*** radez_g0n3 has joined #openstack-infra08:22
*** Alec-A2 has joined #openstack-infra08:22
*** jogo has joined #openstack-infra08:22
*** toabctl has joined #openstack-infra08:22
*** wayneeseguin has joined #openstack-infra08:22
*** Daviey has joined #openstack-infra08:22
*** vipul has joined #openstack-infra08:22
*** juice has joined #openstack-infra08:22
*** mikal has joined #openstack-infra08:22
*** GheRivero has joined #openstack-infra08:22
*** ctracey has joined #openstack-infra08:22
*** jamespd has joined #openstack-infra08:22
*** Kiall has joined #openstack-infra08:22
*** kevinbenton has joined #openstack-infra08:22
*** ruhe has joined #openstack-infra08:22
*** mika has joined #openstack-infra08:22
*** NobodyCam has joined #openstack-infra08:22
*** zaro has joined #openstack-infra08:22
*** BobBall has joined #openstack-infra08:22
*** shardy has joined #openstack-infra08:22
*** jomara has joined #openstack-infra08:22
*** gpocentek has joined #openstack-infra08:22
*** jesusaurus has joined #openstack-infra08:22
*** jeblair has joined #openstack-infra08:22
*** gothicmindfood has joined #openstack-infra08:22
*** dansmith has joined #openstack-infra08:22
*** dougwig has joined #openstack-infra08:22
*** pleia2 has joined #openstack-infra08:22
*** therve has joined #openstack-infra08:22
*** serverascode has joined #openstack-infra08:22
*** dangers_away has joined #openstack-infra08:22
*** NithyaG_afk has joined #openstack-infra08:22
*** hughsaunders has joined #openstack-infra08:22
*** cgoncalves has joined #openstack-infra08:22
*** flaper87 has joined #openstack-infra08:22
*** soren has joined #openstack-infra08:22
*** lifeless has joined #openstack-infra08:22
*** pbelanyi has joined #openstack-infra08:22
*** mtreinish has joined #openstack-infra08:22
*** comstud has joined #openstack-infra08:22
*** EntropyWorks has joined #openstack-infra08:22
*** nibalizer has joined #openstack-infra08:22
*** tchaypo has joined #openstack-infra08:22
*** ChanServ has joined #openstack-infra08:22
*** Ng has joined #openstack-infra08:22
*** psedlak has joined #openstack-infra08:22
*** clayg has joined #openstack-infra08:22
*** ptoohill has joined #openstack-infra08:22
*** pabelanger has joined #openstack-infra08:22
*** SergeyLukjanov has joined #openstack-infra08:22
*** NikitaKonovalov has joined #openstack-infra08:22
*** gaelL has joined #openstack-infra08:22
*** sbadia has joined #openstack-infra08:22
*** dickson.freenode.net sets mode: +o ChanServ08:22
*** morganfainberg has joined #openstack-infra08:22
*** paul-- has joined #openstack-infra08:22
openstackgerritMark McLoughlin proposed a change to openstack-infra/elastic-recheck: Add query for cinder lvmremove failure  https://review.openstack.org/10044708:22
*** basha has quit IRC08:23
*** d0ugal has quit IRC08:24
*** d0ugal_ has joined #openstack-infra08:24
*** d0ugal_ is now known as d0ugal08:25
*** roeyc has joined #openstack-infra08:25
*** d0ugal has quit IRC08:25
*** d0ugal has joined #openstack-infra08:25
*** jcoufal has quit IRC08:27
*** fifieldt has quit IRC08:27
*** krtaylor has quit IRC08:27
*** ildikov has quit IRC08:27
*** grantbow has quit IRC08:28
*** fifieldt has joined #openstack-infra08:28
yolanda hi, having failure on one job, are there some problems with these tests? https://review.openstack.org/#/c/99924/08:28
*** grantbow_ has joined #openstack-infra08:28
yolanda hi, having failure on one job, are there some problems with these tests? https://review.openstack.org/#/c/99924/08:28
*** krtaylor has joined #openstack-infra08:28
*** sarob_ has joined #openstack-infra08:28
*** jcoufal has joined #openstack-infra08:29
*** nati_ueno has joined #openstack-infra08:31
*** sarob_ has quit IRC08:33
*** grantbow_ has quit IRC08:33
*** _nadya_ has quit IRC08:33
*** nosnos has quit IRC08:33
*** maxbit has quit IRC08:33
*** yolanda has quit IRC08:33
*** amotoki has quit IRC08:33
*** camunoz has quit IRC08:33
*** Alexei_987 has quit IRC08:33
*** slamont has quit IRC08:33
*** bradm has quit IRC08:33
*** bcrochet has quit IRC08:33
*** sunrenjie6 has quit IRC08:33
*** jcooley has quit IRC08:33
*** medieval1 has quit IRC08:33
*** gargola has quit IRC08:33
*** cody-somerville has quit IRC08:33
*** salv-orlando has quit IRC08:33
*** saper has quit IRC08:33
*** gnuoy has quit IRC08:33
*** torgomatic has quit IRC08:33
*** bogdando has quit IRC08:33
*** masayukig has quit IRC08:33
*** phschwartz has quit IRC08:33
*** skraynev has quit IRC08:33
*** bnemec has quit IRC08:33
*** jd__ has quit IRC08:33
*** fbo has quit IRC08:33
*** portante has quit IRC08:33
*** sdague has quit IRC08:33
*** russell_h has quit IRC08:33
*** briancline has quit IRC08:33
*** tnurlygayanov has quit IRC08:33
*** harlowja_away has quit IRC08:33
*** mgagne has quit IRC08:33
*** sileht has quit IRC08:33
*** jlk has quit IRC08:33
*** yjiang5 has quit IRC08:33
*** roaet_ has quit IRC08:33
*** adam_g has quit IRC08:33
*** mkoderer has quit IRC08:33
*** rainya has quit IRC08:33
*** dolphm has quit IRC08:33
*** russellb has quit IRC08:33
*** zz_gondoi has quit IRC08:33
*** vishy has quit IRC08:33
*** wendar has quit IRC08:33
*** stevebaker has quit IRC08:33
*** Mithrandir has quit IRC08:33
*** alaski has quit IRC08:33
*** jbryce has quit IRC08:33
*** Adri2000 has quit IRC08:33
*** mordred_phone has quit IRC08:33
*** bodepd has quit IRC08:33
*** zigo has quit IRC08:33
*** jgriffith has quit IRC08:33
*** morgabra has quit IRC08:33
*** notmyname has quit IRC08:33
*** hdd has quit IRC08:33
*** zhiyan has quit IRC08:33
*** briancurtin has quit IRC08:33
*** chmouel has quit IRC08:33
*** mrda-away has quit IRC08:33
*** antonym has quit IRC08:33
*** thingee has quit IRC08:33
*** clarkb has quit IRC08:33
*** ttx has quit IRC08:33
*** uvirtbot has quit IRC08:33
*** dragondm has quit IRC08:33
*** johnthetubaguy has quit IRC08:35
*** johnthetubaguy has joined #openstack-infra08:36
*** enikanorov_ has joined #openstack-infra08:37
*** enikanorov__ has quit IRC08:37
*** praneshp has quit IRC08:37
*** ildikov has joined #openstack-infra08:41
*** e0ne has joined #openstack-infra08:41
*** grantbow_ has joined #openstack-infra08:43
*** sunrenjie6 has joined #openstack-infra08:43
*** _nadya_ has joined #openstack-infra08:43
*** jcooley has joined #openstack-infra08:43
*** nosnos has joined #openstack-infra08:43
*** maxbit has joined #openstack-infra08:43
*** medieval1 has joined #openstack-infra08:43
*** harlowja_away has joined #openstack-infra08:43
*** gargola has joined #openstack-infra08:43
*** cody-somerville has joined #openstack-infra08:43
*** tnurlygayanov has joined #openstack-infra08:43
*** yolanda has joined #openstack-infra08:43
*** salv-orlando has joined #openstack-infra08:43
*** amotoki has joined #openstack-infra08:43
*** camunoz has joined #openstack-infra08:43
*** Alexei_987 has joined #openstack-infra08:43
*** saper has joined #openstack-infra08:43
*** gnuoy has joined #openstack-infra08:43
*** slamont has joined #openstack-infra08:43
*** mgagne has joined #openstack-infra08:43
*** torgomatic has joined #openstack-infra08:43
*** bogdando has joined #openstack-infra08:43
*** masayukig has joined #openstack-infra08:43
*** phschwartz has joined #openstack-infra08:43
*** skraynev has joined #openstack-infra08:43
*** sileht has joined #openstack-infra08:43
*** bradm has joined #openstack-infra08:43
*** briancurtin has joined #openstack-infra08:43
*** bcrochet has joined #openstack-infra08:43
*** zz_gondoi has joined #openstack-infra08:43
*** vishy has joined #openstack-infra08:43
*** wendar has joined #openstack-infra08:43
*** stevebaker has joined #openstack-infra08:43
*** Mithrandir has joined #openstack-infra08:43
*** alaski has joined #openstack-infra08:43
*** jbryce has joined #openstack-infra08:43
*** Adri2000 has joined #openstack-infra08:43
*** mordred_phone has joined #openstack-infra08:43
*** bodepd has joined #openstack-infra08:43
*** mrda-away has joined #openstack-infra08:43
*** zhiyan has joined #openstack-infra08:43
*** zigo has joined #openstack-infra08:43
*** jgriffith has joined #openstack-infra08:43
*** morgabra has joined #openstack-infra08:43
*** notmyname has joined #openstack-infra08:43
*** hdd has joined #openstack-infra08:43
*** chmouel has joined #openstack-infra08:43
*** antonym has joined #openstack-infra08:43
*** thingee has joined #openstack-infra08:43
*** clarkb has joined #openstack-infra08:43
*** ttx has joined #openstack-infra08:43
*** uvirtbot has joined #openstack-infra08:43
*** dragondm has joined #openstack-infra08:43
*** russellb has joined #openstack-infra08:43
*** briancline has joined #openstack-infra08:43
*** russell_h has joined #openstack-infra08:43
*** dolphm has joined #openstack-infra08:43
*** rainya has joined #openstack-infra08:43
*** mkoderer has joined #openstack-infra08:43
*** sdague has joined #openstack-infra08:43
*** adam_g has joined #openstack-infra08:43
*** roaet_ has joined #openstack-infra08:43
*** portante has joined #openstack-infra08:43
*** fbo_away has joined #openstack-infra08:43
*** yjiang5 has joined #openstack-infra08:43
*** jd__ has joined #openstack-infra08:43
*** bnemec has joined #openstack-infra08:43
*** jlk has joined #openstack-infra08:43
*** basha has joined #openstack-infra08:48
*** mwagner_lap has quit IRC08:48
*** mwagner_lap has joined #openstack-infra08:48
*** jgallard has joined #openstack-infra08:49
*** isviridov|away is now known as isviridov08:53
*** nosnos has quit IRC08:54
*** andreaf has joined #openstack-infra08:55
*** nosnos has joined #openstack-infra08:55
*** basha has quit IRC08:57
*** norman has joined #openstack-infra08:59
normanHi all, when I tried to send review by git review, it complains that 'ICLA contributor agreement requires current contact information', and then I go to the https://review.openstack.org/#/settings/contact  to save the info,  it said 'Server error, cannot save the information'08:59
*** ociuhandu has quit IRC08:59
normananyone can help this?09:00
rcarrillocruzi think that can only be checked by infra core09:08
rcarrillocruzjhesketh: hi there sir, are you a core ^ ?09:09
*** ilyashakhat has joined #openstack-infra09:10
lifelessrcarrillocruz: SergeyLukjanov has ops on the boxen I believe09:11
rcarrillocruzah yes, thx09:11
rcarrillocruzSergeyLukjanov: ^ , norman has problems to update contact details in Gerrit, i think we need infra ops powerz09:12
*** basha has joined #openstack-infra09:12
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Validate Project and Project Groups names  https://review.openstack.org/9872809:14
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard-webclient: Sync name validatoin regex with API  https://review.openstack.org/10045809:15
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Validate Project and Project Groups names  https://review.openstack.org/9872809:19
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Added tests for Project Groups API  https://review.openstack.org/9874509:20
*** sunrenjie6 has quit IRC09:22
*** matsuhashi has quit IRC09:22
*** matsuhashi has joined #openstack-infra09:24
*** jpich has quit IRC09:26
*** dims_ has joined #openstack-infra09:27
*** nati_ueno has quit IRC09:28
*** sarob_ has joined #openstack-infra09:28
*** matsuhashi has quit IRC09:30
*** matsuhashi has joined #openstack-infra09:30
*** sunrenjie6 has joined #openstack-infra09:32
*** dims_ has quit IRC09:32
*** sarob_ has quit IRC09:32
*** sunrenjie6 has quit IRC09:34
*** matsuhashi has quit IRC09:34
*** sunrenjie6 has joined #openstack-infra09:35
*** salv-orlando has quit IRC09:36
*** matsuhashi has joined #openstack-infra09:37
*** habib has joined #openstack-infra09:37
*** jpich has joined #openstack-infra09:39
*** sunrenjie6 has quit IRC09:39
*** jamespd has quit IRC09:40
*** pblaho is now known as pblaho|afk09:41
*** jamespd has joined #openstack-infra09:41
SergeyLukjanovrcarrillocruz, lifeless, norman, hey folks, I don't actually know the reason for such behavior of contact details update :(09:44
*** matsuhashi has quit IRC09:48
openstackgerritIsaku Yamahata proposed a change to openstack-infra/config: Add tacker project on StackForge  https://review.openstack.org/9743509:48
openstackgerritVictor Sergeyev proposed a change to openstack/requirements: Add oslo.db library  https://review.openstack.org/9140709:48
*** matsuhashi has joined #openstack-infra09:50
openstackgerritp-draigbrady proposed a change to openstack/requirements: Bump minimum oslo.config version to 1.2.1  https://review.openstack.org/10047209:55
pleia2anteaya: not around much this week, conferencing in Croatia09:56
pleia2overview-based keynote tomorrow \o/09:57
*** doude has joined #openstack-infra09:58
*** amotoki has quit IRC09:59
*** salv-orlando has joined #openstack-infra10:00
*** unicell has joined #openstack-infra10:01
*** matsuhashi has quit IRC10:03
*** matsuhashi has joined #openstack-infra10:03
*** matsuhashi has quit IRC10:04
*** matsuhashi has joined #openstack-infra10:04
*** jlibosva has joined #openstack-infra10:10
*** ominakov has joined #openstack-infra10:11
*** jgallard has quit IRC10:14
*** matsuhashi has quit IRC10:14
openstackgerritBoris Pavlovic proposed a change to openstack-infra/config: Add new project logaas  https://review.openstack.org/10024310:15
*** matsuhashi has joined #openstack-infra10:21
*** yaguang has quit IRC10:28
*** sarob_ has joined #openstack-infra10:28
*** rlandy has joined #openstack-infra10:31
*** sarob_ has quit IRC10:33
*** matsuhashi has quit IRC10:35
*** matsuhashi has joined #openstack-infra10:36
*** matsuhashi has quit IRC10:40
*** trinaths has quit IRC10:41
*** basha has quit IRC10:43
openstackgerritAlexandre Levine proposed a change to openstack-infra/config: Initial commit for the AWS EC2 and VPC API standalone service project  https://review.openstack.org/9779510:44
*** yamahata has quit IRC10:45
*** yaguang has joined #openstack-infra10:46
*** freyes has quit IRC10:49
*** freyes has joined #openstack-infra10:49
*** weshay has joined #openstack-infra10:54
*** weshay has quit IRC10:59
*** salv-orlando has quit IRC10:59
*** freyes has quit IRC10:59
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add signature for flavors marker not found bug  https://review.openstack.org/10043211:00
*** freyes has joined #openstack-infra11:00
*** SumitNaiksatam has quit IRC11:03
*** salv-orlando has joined #openstack-infra11:05
*** SumitNaiksatam has joined #openstack-infra11:05
*** jistr has quit IRC11:06
*** jistr has joined #openstack-infra11:07
*** dims_ has joined #openstack-infra11:09
*** ilyashakhat has quit IRC11:15
*** skolekonov has joined #openstack-infra11:15
*** ociuhandu has joined #openstack-infra11:21
openstackgerritRadomir Dopieralski proposed a change to openstack/requirements: Add xstatic-packaged JavaScript libraries for Horizon  https://review.openstack.org/9779311:24
e0nehi all! we have some python scripts here: https://github.com/openstack-infra/config/tree/master/modules/openstack_project/files/nodepool/scripts. Do we have any tests for it? I didn't found anything11:26
*** ociuhandu has quit IRC11:27
*** sarob_ has joined #openstack-infra11:28
*** e0ne has quit IRC11:30
*** e0ne has joined #openstack-infra11:30
*** pblaho|afk is now known as pblaho11:31
*** sarob_ has quit IRC11:33
*** trinaths has joined #openstack-infra11:35
SergeyLukjanove0ne, hey, I think we have no tests for them except thousands of jobs running using them every day11:37
e0ne:)11:37
e0nethanks11:37
e0nei want to change one of them and interesting in covering it by unit tests if needed11:38
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Allow GET for Projects by name  https://review.openstack.org/10050711:41
*** mrmartin has joined #openstack-infra11:41
mrmartinre11:41
mrmartinguys, is everything allright with check jobs? http://status.openstack.org/zuul/11:41
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Allow GET for Projects by name  https://review.openstack.org/10050711:42
*** dizquierdo has quit IRC11:44
*** dizquierdo has joined #openstack-infra11:44
*** ianw has quit IRC11:57
*** ianw has joined #openstack-infra11:58
*** dkranz has quit IRC11:59
*** ianw has quit IRC12:03
*** ArxCruz has joined #openstack-infra12:03
*** ianw has joined #openstack-infra12:04
*** ianw has quit IRC12:06
*** mwagner_lap has quit IRC12:06
*** hughsaunders is now known as andymcr12:06
*** ianw has joined #openstack-infra12:06
*** andymcr is now known as hughsaunders12:07
*** weshay has joined #openstack-infra12:08
sdagueSergeyLukjanov: permissions in gerrit question12:09
sdagueApparently in nova I can't rebase or WIP patches12:09
*** trinaths has quit IRC12:10
sdagueactually, anywhere12:10
sdagueI thought I could do that?12:10
*** ianw has quit IRC12:10
*** ianw has joined #openstack-infra12:11
*** dims_ has quit IRC12:13
*** ianw has quit IRC12:13
*** sjm42 has joined #openstack-infra12:14
sjm42https://review.openstack.org/#/settings/new-agreement12:15
sjm42^ can someone fix this pls? :)12:15
sjm42I have been getting server error for several weeks now12:15
sjm42"Cannot store contact information"12:16
*** ianw has joined #openstack-infra12:17
*** rfolco has quit IRC12:18
*** rfolco has joined #openstack-infra12:19
*** ityaptin has joined #openstack-infra12:22
SergeyLukjanove0ne, please, note that the you should change this scripts in backward compatible way, because slave images rebuild daily12:23
SergeyLukjanovsdague, hey12:23
e0neSergeyLukjanov sure, i will12:23
sdagueok, the WIP thing I figured out, I was just not caffinated enough12:23
*** adalbas has joined #openstack-infra12:23
sdagueSergeyLukjanov: but I really thought I could Rebase changes12:24
sdaguevia the web UI12:24
SergeyLukjanovsdague, nope, it's only for the CR author IMP12:24
SergeyLukjanovIMO*12:24
*** pblaho is now known as pblaho|afk12:24
SergeyLukjanovsdague, I don't remember that we had the ability to rebase for non-authors12:25
SergeyLukjanovsdague, oh, you could just cherry-pick to master12:26
sdagueok12:27
SergeyLukjanovusing the cherry-pick button, it'll upload the new patch set to the same change request12:27
*** sarob_ has joined #openstack-infra12:28
*** annegentle has joined #openstack-infra12:30
*** zul has quit IRC12:31
*** zul has joined #openstack-infra12:31
*** flaviof is now known as flaviof_zzz12:31
SergeyLukjanovanteaya, do we have any conditions for personal 3rd party testing accounts?12:32
*** ociuhandu has joined #openstack-infra12:32
SergeyLukjanovanteaya, that will vote only for sandbox12:33
SergeyLukjanovanteaya, re http://lists.openstack.org/pipermail/openstack-infra/2014-June/001310.html12:33
*** sarob_ has quit IRC12:33
*** dizquierdo has quit IRC12:34
openstackgerritBoris Pavlovic proposed a change to openstack-infra/config: Publish osprofiler on pypi and add check for requirements  https://review.openstack.org/10005212:39
*** ianw has quit IRC12:41
*** ianw has joined #openstack-infra12:42
*** mbacchi has joined #openstack-infra12:43
*** pdmars has joined #openstack-infra12:44
*** dizquierdo has joined #openstack-infra12:44
*** pdmars has quit IRC12:48
*** pdmars has joined #openstack-infra12:49
*** smarcet has joined #openstack-infra12:49
*** jistr has quit IRC12:50
*** jistr has joined #openstack-infra12:52
*** yamahata has joined #openstack-infra12:52
*** nosnos has quit IRC12:53
*** bknudson has joined #openstack-infra12:57
*** pblaho|afk is now known as pblaho12:58
*** annegentle has quit IRC12:58
anteayaSergeyLukjanov: no, we don't have any conditions against this type of account13:01
anteayawhy this person only wants to vote against the sandbox is beyond my ability to comprehend, but we don't have any provisions against it13:02
anteayapleia2: I hope things are going well in Croatia13:03
anteayapleia2: happy keynoting13:03
*** navneet has joined #openstack-infra13:04
*** navneet1 has quit IRC13:04
*** dkranz has joined #openstack-infra13:04
*** radez_g0n3 is now known as radez13:06
*** julim has joined #openstack-infra13:07
*** mriedem has joined #openstack-infra13:08
*** zul has quit IRC13:08
*** zul has joined #openstack-infra13:08
*** dprince has joined #openstack-infra13:09
*** zzelle has joined #openstack-infra13:09
*** prad_ has joined #openstack-infra13:10
anteayaSergeyLukjanov: do you know how to free up nodepool nodes?13:16
anteayawe have a lot of them in the delete state again13:16
*** flaviof_zzz is now known as flaviof13:16
*** zhiyan is now known as zhiyan_13:17
*** nati_ueno has joined #openstack-infra13:17
zzelleHi everyone !13:18
*** Longgeek has quit IRC13:18
*** Longgeek has joined #openstack-infra13:18
zzelleIt seems there is a trouble with ICLA signing in gerrit13:18
anteayahi zzelle13:18
anteayazzelle: please expand13:18
anteayazzelle: what trouble are you seeing?13:19
SergeyLukjanovanteaya, AFAIK folks have some scripts for doing it, but I'm not aware about how to di it13:19
*** yaguang has quit IRC13:20
*** Longgeek has quit IRC13:20
zzelleanteaya: my college created its gerrit account and sign the ICLA but without defining contact information (no mailing address ...)13:20
*** eharney has joined #openstack-infra13:20
anteayazzelle: yeah, apparently the system needs the entire form to be filled out or it won't connect you13:21
anteayaI talked to someone yesterday who had the same experience13:21
zzelleanteaya: but he cannot update it13:21
*** Longgeek has joined #openstack-infra13:21
anteayawhat do you mean he cannot update it13:22
*** changbl has quit IRC13:22
anteayawhat happens when he inputs information into the form and presses submit?13:22
zzelleanteaya: the following error is raised by gerrit IHM: Server Error \n Cannot store contact information \n (button) Continue13:23
anteayaSergeyLukjanov: timestamp 2014-06-16T14:39:45 http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2014-06-16.log13:23
anteayazzelle: is this person a member of the openstack foundation?13:23
zzelleanteaya: nope13:23
zzelleanteaya: is it the trouble cause ?13:23
openstackgerritgordon chung proposed a change to openstack-infra/elastic-recheck: Add query for ceilometer Build timed out bug 1328679  https://review.openstack.org/10040513:24
uvirtbotLaunchpad bug 1328679 in ceilometer "recent build timeout failure in gate" [Medium,Triaged] https://launchpad.net/bugs/132867913:24
anteayazzelle: https://www.openstack.org/join/register/13:24
anteayayes13:24
anteayathey have to be a member of the openstack foundation13:24
*** nikhil___|afk is now known as nikhil___13:25
*** _nadya_ has quit IRC13:26
zzelleanteaya: live testing :)13:27
*** mfer has joined #openstack-infra13:27
*** sarob_ has joined #openstack-infra13:28
*** lcostantino has joined #openstack-infra13:29
*** jgrimm_ has joined #openstack-infra13:29
zzelleanteaya: live success, thanks :)13:31
anteayazzelle: glad you got it worked out13:31
anteayawelcome to your collegue13:31
*** jgallard has joined #openstack-infra13:33
sdagueanteaya: any chance we can figure out a way to make the error message people are getting be self explanatory?13:33
*** sarob_ has quit IRC13:33
SergeyLukjanovanteaya, oh, thanks for the tip, I'll check it right now13:35
*** doug-fish has joined #openstack-infra13:35
*** arnaud__ has joined #openstack-infra13:35
anteayasdague: from what I have gathered from the backscroll, there used to be a more descriptive error message than what we have now when we had gerrit 2.413:38
anteayaI don't know if we lost what we had in the transfer or if gerrit 2.8 is missing something that gerrit 2.4 had13:38
anteayathe issue last night was the individual was not doing what the error message was telling them anyway13:39
anteayasince as so as the did what the error message told them they needed to do, they could submit their patch13:39
openstackgerritIvan Kolodyazhny proposed a change to openstack-infra/config: Make GIT_BASE configurable for each project  https://review.openstack.org/10054713:39
anteayasdague: but I do agree that the current error message is causing more confusion that necessary13:39
anteayaI don't know where in gerrit the messages get set13:40
anteayaI will look13:40
*** _nadya_ has joined #openstack-infra13:42
*** mrmartin has quit IRC13:43
*** navneet has quit IRC13:44
anteayasdague: here are the error messages for gerrit: http://git.openstack.org/cgit/openstack-infra/gerrit/tree/gerrit-common/src/main/java/com/google/gerrit/common/errors13:44
anteayaI'm not sure what our process if for changing these13:45
*** wenlock_ has joined #openstack-infra13:45
anteayaif we change in place or submit patches to upstream, I don't know13:45
*** navneet has joined #openstack-infra13:45
SergeyLukjanovanteaya, heh, I've started removing old slaves, but it takes several mins per each13:48
*** nati_ueno has quit IRC13:49
anteayaSergeyLukjanov: thank you and yes13:49
anteayaclarkb noticed they were a tad surly when he tried to knock them down yesterday13:49
anteayathey put up a bit of a fight13:50
openstackgerritA change was merged to openstack/requirements: Add xstatic and xstatic-jquery for Horizon  https://review.openstack.org/9433713:50
anteayathough all the ones that would go quietly have probably already done so in normal delete sweeps13:50
anteayathe gate is not bad, top patch is an hour and a half13:51
anteayacheck needs some room to work though13:51
SergeyLukjanovanteaya, I'm thinking now about writing multithread script to auto remove old slaves13:51
anteayaSergeyLukjanov: I'm sure jeblair would love to have that conversation13:52
anteayasince I'm not up on the latest of what we do have with nodepool other than 'good idea' that is all I have to contribute13:52
*** pcrews has joined #openstack-infra13:54
SergeyLukjanovanteaya, yeah13:54
SergeyLukjanovanteaya, for one slaves it13:54
SergeyLukjanovalready takes >5 mins to delete :(13:54
*** bcrochet has quit IRC13:55
*** otherwiseguy has joined #openstack-infra13:55
SergeyLukjanovanteaya, aaand timeout ;)13:57
SergeyLukjanovI see images that are in delete state for more than 100h13:57
*** dizquierdo has quit IRC13:58
*** bcrochet has joined #openstack-infra13:58
*** dizquierdo has joined #openstack-infra13:58
*** dims has joined #openstack-infra13:58
*** nati_ueno has joined #openstack-infra13:59
*** dims has quit IRC13:59
*** homeless has joined #openstack-infra13:59
*** julim has quit IRC14:00
*** julim has joined #openstack-infra14:01
*** trinaths has joined #openstack-infra14:03
anteayaSergeyLukjanov: yeah14:04
anteayait is eating up quota14:04
SergeyLukjanovanteaya, yup, there are about 75/300 slaves that are living for more than hour and in delete state14:05
*** wenlock_ has quit IRC14:05
*** sballe has joined #openstack-infra14:06
SergeyLukjanovI mean 300 in delete state in total and 75 of them are with age > 1h14:06
*** dims has joined #openstack-infra14:07
*** dangers_away is now known as dangers14:07
*** bcrochet has quit IRC14:08
anteayayeah14:08
anteayawe could use those 75 in check14:08
openstackgerritgordon chung proposed a change to openstack-infra/elastic-recheck: Add query for ceilometer Build timed out bug 1328679  https://review.openstack.org/10040514:09
uvirtbotLaunchpad bug 1328679 in ceilometer "recent build timeout failure in gate" [Medium,Triaged] https://launchpad.net/bugs/132867914:09
SergeyLukjanovanteaya, heh, 5/5 attempts to remove slave in rackspace cloud ends with timeout :(14:09
SergeyLukjanovfolks, I need to go, will return back in 3 hours14:10
SergeyLukjanovdriving practise14:10
*** bcrochet has joined #openstack-infra14:10
normanHi I'd open the bug https://bugs.launchpad.net/openstack-ci/+bug/1330879  about the saving error of contact information ,hope some one can help14:11
uvirtbotLaunchpad bug 1330879 in openstack-ci "Can't save contact information in review.openstack.org" [Undecided,New]14:11
*** amalagon has joined #openstack-infra14:12
*** prad_ has quit IRC14:12
*** prad_ has joined #openstack-infra14:12
*** sweston has joined #openstack-infra14:16
*** zhiyan_ is now known as zhiyan14:16
*** mwagner_lap has joined #openstack-infra14:17
anteayaSergeyLukjanov: drive safe14:19
anteayaSergeyLukjanov: thanks for trying14:19
*** yfried_ has quit IRC14:19
anteayanorman: are you a member of the openstack foundation?14:19
*** nati_ueno has quit IRC14:20
*** trinaths has quit IRC14:21
*** markmcclain has joined #openstack-infra14:24
*** agentleone has joined #openstack-infra14:24
*** rwsu has joined #openstack-infra14:24
*** nati_ueno has joined #openstack-infra14:25
*** mestery has joined #openstack-infra14:27
*** wenlock_ has joined #openstack-infra14:32
boris-42anteaya hi there14:32
boris-42anteaya can you help me a bit14:32
*** viktors has joined #openstack-infra14:33
boris-42anteaya I tried this https://review.openstack.org/#/c/100243/5/modules/openstack_project/files/zuul/layout.yaml14:33
*** navneet has quit IRC14:34
boris-42anteaya but it doesn't pass tests gates cause of line 356914:34
*** mestery has quit IRC14:34
*** mestery has joined #openstack-infra14:35
*** zhiyan is now known as zhiyan_14:35
*** zhiyan_ is now known as zhiyan14:36
*** crc32 has joined #openstack-infra14:36
* anteaya clicks14:36
*** blamar has joined #openstack-infra14:36
*** zhiyan is now known as zhiyan_14:37
anteayaboris-42: what is the reported failur14:37
anteayaline 3569 is a blank line14:37
anteayawhich needs to be there14:37
*** zhiyan_ is now known as zhiyan14:37
boris-42356814:38
boris-42anteaya ^14:38
*** jasond` has quit IRC14:38
anteayaagain, what is the reported failure14:38
anteayaI can't tell what system is upset or why just by looking at the code14:38
boris-42anteaya one sec I'm not so fast=)14:38
*** jasond` has joined #openstack-infra14:38
anteayaboris-42: kk14:38
boris-42anteaya ah remember I have the similar issue but in another patch (project)14:41
normananteaya: should be ,since I have the account of lauchpad, and actually, I ever follow the guide that how  to be a contributor14:41
boris-42anteaya 2014-06-14 10:50:59.447 | Job osprofiler-pypi-wheel-upload not defined14:41
anteayanorman: having a launchpad account doesn't make you a foundation member14:42
boris-42anteaya in this file https://review.openstack.org/#/c/100052/14:42
boris-42anteaya patch*14:42
boris-42anteaya when I have such change https://review.openstack.org/#/c/100052/2/modules/openstack_project/files/zuul/layout.yaml14:42
anteayanorman: can you find yourself in here? http://www.openstack.org/community/members/14:42
*** agentleone has quit IRC14:42
morganfainbergclarkb, sdague, anteaya, any preference which gate test gets converted to apache deployed keystone? I'm leaning towards dsvm-full (non-neutron). once this lands https://review.openstack.org/#/c/98897/ we should be able to start gating on it.14:42
morganfainbergclarkb, sdague, anteaya, wanted to open the conversation asap so we can start guaranteeing changes don't break this :)14:43
*** markmcclain has quit IRC14:43
*** roeyc has quit IRC14:45
*** jistr has quit IRC14:45
anteayamorganfainberg: I don't know14:46
*** reed has joined #openstack-infra14:46
viktorsHello Folks! Can someone help me to solve issue with the patch to openstack/requirements ?14:46
anteayaviktors: please post the url to the patch in question14:46
*** jistr has joined #openstack-infra14:46
anteayaboris-42: here are the pypi-jobs: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/pypi-jobs.yaml14:46
boris-42anteaya ah14:47
viktorsanteaya: https://review.openstack.org/#/c/91407/ (Add oslo.db library)14:47
clarkbmorganfainberg: sounds good to me. apache + wsgi is the recommended deployment right? makes sense to test it in the main job14:47
clarkbalso I am still blah. dont count on me much today14:47
morganfainbergclarkb, yep. well with the compressed tokens it's the recommended (or UUID)14:47
anteayaclarkb: :(14:47
boris-42anteaya got it thanks14:47
morganfainbergclarkb, aw :(14:47
anteayaclarkb: able to delete any nodes?14:47
boris-42anteaya going to update patches14:47
openstackgerritA change was merged to openstack/requirements: Fix whitespace that occurs after comma  https://review.openstack.org/9048414:47
openstackgerritA change was merged to openstack/requirements: Bump minimum oslo.config version to 1.2.1  https://review.openstack.org/10047214:48
anteayaboris-42: wait, do you know how you should update them yet?14:48
clarkbanteaya not now.14:48
anteayaboris-42: because I don't14:48
anteayaclarkb: k, thanks14:48
morganfainbergboris-42, ^ apache + keystone is almost capable 2 patches to land (PKI tokens), uuid tokens work now. [unrelated to your current convo]14:48
boris-42anteaya I'll make like in stacalytics14:48
anteayaboris-42: all I see is that what you have isn't what you need14:48
boris-42morganfainberg nice!14:48
anteayaboris-42: up to you14:48
boris-42anteaya heh14:48
boris-42anteaya I need just to publish new versions of pushing tags...14:49
morganfainbergclarkb, ok well i'll propose the change to the main test then. - we can discuss it further in the review :) worst case, we pick a different test.14:49
boris-42anteaya how to do that?14:49
boris-42morganfainberg going to make some benchmarks in gates against apache keystone?)14:49
morganfainbergboris-42, would love to. once that lands, lets build up a scenario for it.14:49
boris-42morganfainberg btw it will be in default gates?14:49
morganfainbergboris-42, for one of the gates14:50
morganfainbergboris-42, we will need to keep it split since eventlet is a real deployment option most people use14:50
boris-42morganfainberg so we can change this current job14:50
boris-42morganfainberg or add another14:50
*** markmcclain has joined #openstack-infra14:50
boris-42morganfainberg to be able to benchmark with rally in gates14:50
boris-42against apach14:50
morganfainbergboris-42, ++ cool. lets discuss once this lands.14:51
boris-42morganfainberg ok14:51
morganfainbergboris-42, hope to have it gating today :), then the change for the gate jobs once it's in14:51
*** thedodd has joined #openstack-infra14:51
boris-42morganfainberg and I hope to get new release of osprofiler14:51
boris-42morganfainberg that will allow us to profile everything=)14:51
boris-42morganfainberg but have issues with gates14:52
*** pblaho is now known as pblaho|afk14:52
anteayaboris-42: you need openstack-publish-jobs: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/openstack-publish-jobs.yaml#n2214:52
*** agentleone has joined #openstack-infra14:53
boris-42anteaya it doesn't works..14:53
anteayashow me14:53
*** jgrimm_ is now known as jgrimm14:53
dhellmannviktors, anteaya : the requirements job that is failing is trying to do something using "pip --no-use-wheel" for a requirement that has only been released as a wheel14:53
*** ihrachyshka has quit IRC14:53
dhellmannviktors, anteaya : it's a new oslo library that is still in alpha, so there's no sdist release, yet14:54
anteayadhellmann: thanks was just going to try to address that one next14:54
boris-42anteaya take a look at this https://review.openstack.org/#/c/100052/2/modules/openstack_project/files/zuul/layout.yaml14:54
dhellmannanteaya: it's not clear if the job is "wrong" in not accounting for this case, or if we have a chicken-and-egg question about how to add new libraries to the acceptable list before we have 1.x releases14:54
boris-42anteaya it's  -osprofiler-merge-release-tags14:54
*** markmcclain has quit IRC14:55
anteayaboris-42: on line 2309 you need openstack-publish-jobs: https://review.openstack.org/#/c/100052/2/modules/openstack_project/files/jenkins_job_builder/config/projects.yaml14:55
anteayaboris-42: you have pypi-jobs14:55
anteayamerge-release-tags is not in pypi-jobs14:56
boris-42anteaya so I need both?14:56
*** marun has joined #openstack-infra14:56
boris-42anteaya and do we need actually merge-release-tags14:56
anteayaand you also have publish-to-pypi14:56
anteayawhich is not in pypi-jobs14:56
anteayapublish-to-pypi is not in pypi-jobs14:56
anteayaI showed you the pypi-jobs file14:56
anteayapublish-to-pypi is not in there14:57
*** pblaho|afk is now known as pblaho14:57
*** dims_ has joined #openstack-infra14:57
anteayaboris-42: publish-to-pypi is not the name of a job that jjb knows about: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/projects.yaml14:58
*** navneet has joined #openstack-infra14:58
*** navneet has left #openstack-infra14:58
boris-42anteaya btw seems line only integrated projects are using merge-release-tags14:58
anteayaboris-42: {name}-merge-release-tags is the name of a job jjb knows about14:58
anteayaand you need to call openstack-publish-jobs for {name}-merge-release-tags to work14:59
boris-42anteaya I think it's only for integrated projects..14:59
anteayaboris-42: yes, that is what I am seeing in the file14:59
anteayaI don't know that14:59
*** markmcclain has joined #openstack-infra14:59
openstackgerritcraigtracey proposed a change to openstack-infra/config: Add Octavia to Stackforge  https://review.openstack.org/10057614:59
*** mriedem has quit IRC15:00
anteayaall I do know is that you can't use it without calling openstack-publish-jobs in projects.yaml15:00
*** basha has joined #openstack-infra15:00
*** dims has quit IRC15:01
boris-42anteaya I asked colleague15:02
boris-42anteaya he said that python-munranoclient works15:02
anteayado show me the patch15:02
boris-42anteaya this thing http://paste.openstack.org/show/84302/15:02
boris-42anteaya it publishes on tag new releases to pypi15:03
anteayahttp://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/projects.yaml#n12615:03
anteayaboris-42: well then I am at a loss15:04
anteayaI have given you all I have15:04
*** chandan_kumar has joined #openstack-infra15:04
anteayaand I haven't solved your problem15:04
*** renlt has joined #openstack-infra15:06
*** jasond` has quit IRC15:06
boris-42anteaya oh15:06
boris-42anteaya they have template in layout.yaml15:07
*** nati_ueno has quit IRC15:07
anteayado they15:07
openstackgerritJames E. Blair proposed a change to openstack-infra/nodepool: Handle task manager shutdown more correctly  https://review.openstack.org/10058915:08
*** marun has quit IRC15:08
jeblairclarkb, jogo: ^ that's why the periodic cleanup thread is not running15:08
*** ildikov has quit IRC15:08
*** marun has joined #openstack-infra15:08
jeblairi will restart nodepool now to correct the problem15:08
*** rkukura has quit IRC15:09
jeblairanteaya: ^15:09
anteayajeblair: great thank you15:09
*** rkukura has joined #openstack-infra15:09
openstackgerritBoris Pavlovic proposed a change to openstack-infra/config: Add new project logaas  https://review.openstack.org/10024315:09
boris-42anteaya ^ ok let's try this=)15:10
anteayaboris-42: okay, let's see what jenkins comes back with15:11
*** crc32 has quit IRC15:13
*** mriedem has joined #openstack-infra15:14
*** crc32 has joined #openstack-infra15:16
*** rkukura has quit IRC15:16
anteayajeblair: how soon do you expect to see results from the nodepool restart15:17
jeblairanteaya: immediately15:17
anteayabased on what I see on the graph we are down to about 100-ish nodes running tests15:17
anteayak15:17
clarkbjeblair should it be if not task or not running?15:20
clarkbrather than and?15:20
*** sabeen has joined #openstack-infra15:20
*** basha has quit IRC15:20
*** jistr has quit IRC15:21
jeblairclarkb: well, i can't think of any other reason for a negative-evaluating task to be on the queue15:21
jeblairi agree it's a bit weird with two indicators...15:21
morganfainbergjeblair, welcome back! hope you had a good time away15:21
jeblairmorganfainberg: i did, very much, thank you15:22
clarkbjeblair: but if we are running it will try to run a nil task15:23
jeblairyup15:23
clarkbwont that traceback and die?15:24
openstackgerritJames E. Blair proposed a change to openstack-infra/nodepool: Handle task manager shutdown more correctly  https://review.openstack.org/10058915:24
jeblairclarkb: how about that?15:24
clarkbthat works thanks15:24
*** phschwartz has quit IRC15:24
*** jasond` has joined #openstack-infra15:25
*** zz_gondoi is now known as gondoi15:25
*** sweston has quit IRC15:26
reedclarkb, jeblair, if you have time today, i'd appreciate a review on https://review.openstack.org/#/c/99481/15:26
*** phschwartz has joined #openstack-infra15:27
*** rkukura has joined #openstack-infra15:27
*** freyes has quit IRC15:27
*** rkukura has quit IRC15:28
*** _nadya_ has quit IRC15:29
*** dkranz has quit IRC15:32
sdaguemorganfainberg: so realistically what the path to everything on wsgi?15:32
*** zhiyan is now known as zhiyan_15:32
*** e0ne has quit IRC15:32
morganfainbergsdague, hm. good question. eventually we want the default to be wsgi based, with one gate job running eventlet (so we continue to test it)15:33
morganfainbergsdague, maybe the right answer is to make the default wsgi in devstack and re-kerjigger the gate scripts so we can run one of the jobs in eventlet instead of wsgi?15:34
openstackgerritcraigtracey proposed a change to openstack-infra/config: Add Octavia to Stackforge  https://review.openstack.org/10057615:34
sdaguemorganfainberg: right, but I'd sort of like to world switch that kind of thing15:35
*** lcheng has joined #openstack-infra15:35
sdaguethe per service backends get sort of squirely and we tend to break the logic15:35
sdaguewhich was basically my same objections to the per service ssl patch15:35
morganfainbergsdague, so you want a global toggle?15:35
sdagueyeh15:36
morganfainbergsdague, sure no complaint there.15:36
openstackgerritA change was merged to openstack-infra/elastic-recheck: add a tool for determining unaccounted for rechecks  https://review.openstack.org/9462415:36
morganfainbergsdague, woudl you global toggle in devstack-gate ?15:37
sdagueyep15:37
morganfainbergsdague, easy then.15:37
morganfainbergsdague, we actually already have the mechanism(s) to do that.15:37
sdagueI realistically want our default test case to be wsgi, ipv6, ssl15:37
sdaguebut it will take us a while to get there15:37
morganfainbergsdague, sure. i don't think we can 100% elminate eventlet from keystone unless we deprecate eventlet support (i'd like to but not today)15:38
sdaguesure15:38
sdaguethis isn't to say we won't run on eventlet, just that our gold standard would be wsgi15:38
morganfainbergsdague, ++15:38
morganfainbergsdague, ok so i see the changes working like this: get changes merged to make this possible (keystone), make devstack invert (turn off wsgi instead of turn it on) for keystone (use the current ds-g toggle for "global"), provide a single override for one job to run eventlet15:40
*** lukego has quit IRC15:41
openstackgerritA change was merged to openstack-infra/devstack-gate: Add an option to enable the nova v3 api tests  https://review.openstack.org/9983315:45
anteayajeblair: did you see that the initial commit to infra-specs merged: https://review.openstack.org/#/c/94440/15:45
anteayajeblair: we tweaked it a bit15:45
*** viktors is now known as viktors|afk15:45
*** blamar has quit IRC15:46
*** rkukura has joined #openstack-infra15:47
*** dkranz has joined #openstack-infra15:47
jeblairgah15:47
jeblairclarkb: why did you do this: https://review.openstack.org/#/c/94440/3..4/doc/source/index.rst15:47
openstackgerritDenis M. proposed a change to openstack-infra/config: Added job for trove functional tests with heat support enabled  https://review.openstack.org/10060115:48
*** primemin1sterp has joined #openstack-infra15:49
openstackgerritJames E. Blair proposed a change to openstack-infra/infra-specs: Restore directory hierarchy to original design  https://review.openstack.org/10060215:49
*** primemin1sterp has quit IRC15:50
*** primeministerp has joined #openstack-infra15:50
anteayajeblair: we discussed it at the meeting last week: 19:43:28 <fungi> #topic Infra specs (fungi) eavesdrop.openstack.org/meetings/infra/2014/infra.2014-06-10-19.02.log.html15:51
openstackgerritKyle Mestery proposed a change to openstack-infra/config: Add neutron-lbaas to list of logged channels  https://review.openstack.org/10060315:51
reedone question about this change: https://review.openstack.org/#/c/99223/ it supposed to make groups 'public' but it seems it made the list public to authenticated only... is that what it meant to do?15:51
anteayajeblair: clark noticed that the docs weren't building with the original code15:51
jeblairclarkb: ^ that was a deliberate choice, one which was reaffirmed in review of another change to the specs repo15:52
jeblairanteaya: they most certainly were: http://docs-draft.openstack.org/40/94440/3/check/gate-infra-specs-docs/7c2a71b/doc/build/html/specs/test.html15:52
*** agentleone has quit IRC15:53
anteayajeblair: okay good, I had never checked myself, I took clarkb's word for it15:54
jeblairanteaya: yeah, the 'implemented' specs aren't built as part of the final doc.  i'm not even sure we want them published.  but if we did, i'm fairly certain that we wouldn't want them lumped in with the ones in progress.15:54
*** changbl has joined #openstack-infra15:54
*** dkranz has quit IRC15:55
* anteaya nods15:55
anteayamakes sense15:55
anteayasorry I didn't know to stand up for it last week15:55
jeblairanteaya: i'm leaning toward the first option there, thus the choice i made when setting it up.  but fungi suggested the second one in his response to clarkb.  since clarkb didn't respond, i assumed that settled the matter and did not respond myself.15:55
anteayaah15:56
anteayayou just should never disappear15:56
anteayathings run better when you are always here15:56
anteaya:D15:56
jogojeblair: sweet15:56
*** rdopieralski has quit IRC15:56
*** rdopieralski has joined #openstack-infra15:57
*** denis_makogon has quit IRC15:57
jeblairanteaya: nah, it's fine, i'm just switching it back is all.  :)15:57
anteayakk15:58
*** sarob_ has joined #openstack-infra15:58
phschwartzWhat image are you guys using for the git servers? I know it is a centos, but which one.15:59
*** ociuhandu_ has joined #openstack-infra15:59
reedjeblair, can you help with this please? https://review.openstack.org/#/c/99223/ the list of member of iCLA group should be public as in readable by anonymous, too15:59
*** markwash has joined #openstack-infra16:00
*** james_li has joined #openstack-infra16:00
*** mrmartin has joined #openstack-infra16:00
clarkbjeblair: we had suggested publishing implemented specs would be a good thing16:00
clarkbas a reference16:00
jogojeblair: so not sure if you saw what jhesketh and I talked about last night16:00
jeblairclarkb: if we decide to do that (i don't see the purpose), they should certainly not be just lumped in with the others.16:01
clarkbbut also figured the cost of change is low. I am ok with changing it back16:01
anteayaphschwartz: hi, pleia2 set up the git servers and she is in Croatia today, let me see if the config/site.pp has it listed16:01
phschwartzanteaya: It just says it is a centos, but doesn't state the image.16:02
phschwartzI was holding my self from pulling up the tenant and looking16:02
*** virmitio has joined #openstack-infra16:02
anteayaphschwartz: yeah I see the same16:02
anteayaI don't know where else to look for the image16:02
clarkbcentos pvhvm after the most recent rebuild iirc16:03
*** hogepodge_ has joined #openstack-infra16:03
clarkbdoes it matter?16:03
*** sarob_ has quit IRC16:03
anteayayay, we deleted some nodes16:03
*** hogepodge has quit IRC16:03
*** hogepodge_ is now known as hogepodge16:03
*** nati_ueno has joined #openstack-infra16:04
phschwartzclarkb: We have about 30 centos images exposed. I wanted to make sure that I was using the same base for my setup as you guys and just wanted to make sure you were using the latest 6.5 PVHVM16:04
*** renlt has quit IRC16:04
*** blamar has joined #openstack-infra16:04
jeblairreed: in what way do you need help with that?16:05
reedjeblair, since the patch merged but the behavior is not as intended I don't understand if the patch is wrong or we just didn't understand each other16:05
*** nati_uen_ has joined #openstack-infra16:06
*** nati_ueno has quit IRC16:06
*** arnaud__ has quit IRC16:06
*** arnaud__ has joined #openstack-infra16:07
*** dkranz has joined #openstack-infra16:07
zaromorning16:08
anteayamorning zaro16:08
anteayaI have a question for you about gerrit error messages16:08
anteayazaro: people get this error message and come into the channel confused: http://git.openstack.org/cgit/openstack-infra/gerrit/tree/gerrit-common/src/main/java/com/google/gerrit/common/errors/ContactInformationStoreException.java16:08
*** jistr has joined #openstack-infra16:08
jeblairzaro: and when you're done with that, can you please look into reed's question about what needs to happen for https://review.openstack.org/#/c/99223/ to work?16:09
*** arnaud__ has quit IRC16:09
anteayazaro: frequently the cause of the error is that they haven't signed up to be a foundation member16:09
anteayazaro: how do we say, ensure you are a foundation member in the error message?16:09
clarkbyou cant with current gerrit16:10
anteayaclarkb: can you explain why that is?16:10
clarkbgerrit gets back a non 200 from foundation and reports error16:10
anteayawe seem to have been better at it with old gerrit16:10
anteayaah16:10
anteayaany non-200 spits out this error16:10
clarkbalso when people provide incomplete details and it "works" is not a gerrit bug aiui. the foundation side must return 20016:11
reedanteaya, I think it's because the current gerrit doesn't check that Mailing Address actually has *something* in it16:11
reedand in Country, too16:11
clarkbreed ots not gerrits fault16:11
anteayareed, no this latest one was the person was not a foundation member16:11
reedclarkb, it's a different behavior16:11
mrmartinhi. I need a little help seems to be that I successfully locked out myself from groups project, because the gating constantly fails. This patch could bring a resolution but cannot go through, and I not understand why. https://review.openstack.org/#/c/100548/ http://logs.openstack.org/48/100548/1/check/gate-groups-unittests/6731e1f/console.html16:11
reedanteaya, you mean the one on the mailing list?16:11
anteayareed: no16:12
anteayaI am following up on the conversation I had with sdague this morning16:12
clarkbyou mean if its just the email thats set?16:12
*** marcoemorais has joined #openstack-infra16:12
anteayathe person was not a foundation member16:12
anteayabecoming a foundation member solved the issue16:12
reedanteaya, then possibly the sdague is the one that reported on the mailing list too16:13
clarkbthat is a "feature" means I can register to foundation wirh different email address than I want to use in gerrit16:13
anteayasdague made the point that the error message isn't clear that becoming a foundation member is the behaviour required16:13
clarkbbut may be confusing16:13
*** jgallard has quit IRC16:13
reedi'm less concerned about people not reading the manual16:13
anteayareed: I have no idea16:13
*** james_li has quit IRC16:13
zarowould making the fields *required* solve this issue?16:13
anteayawhat manual?16:13
reedI suspect there is some *wrong* document out there circulating16:13
clarkbzaro I dont want that though16:13
reedanteaya, the wiki on how to sign the CLA16:14
anteayamost people who come in here haven't read any manual16:14
*** gokrokve has joined #openstack-infra16:14
anteayathey just start pushing buttons16:14
clarkbI use a different email address in gerrit than provided to foundation16:14
reedI had episodes in the past of waves of people not able to get git review working...16:14
anteayaso yeah, they haven't read the wikipages16:14
*** basha has joined #openstack-infra16:14
anteayawhich we usually tell them to do16:14
reedturned out they were all following instructions from the same *wrong* blog post16:14
anteayazaro: so you are saying we can't alter the text of that error message, is that an accurate reflection of your perspective?16:15
reednext thing this happens, I hope to remember asking them which documents they're following16:15
dougwighi infra team.  can someone point me at the repo that needs editing for adding an irc channel to eavesdrop?  it's #openstack-lbaas, and openstackinfra already has admin rights, as per this page: http://ci.openstack.org/irc.html16:15
anteayareed: I do ask16:15
sdaguereed: I'm pretty concerned about being really cryptic to users about what went wrong16:15
anteayareed: I get crickets16:15
anteayareed: then fungi gives them the wikipage16:15
anteayaso I am left to assume, they follow no documentation16:16
reedanteaya, that explains :) I'm less concerned about them then16:16
anteayathose are the ones who show up here16:16
zarohttp://git.openstack.org/cgit/openstack-infra/gerrit/tree/16:16
sdaguebecause the process is so freaking long, getting it right is actually hard16:16
clarkbsdague: so there are two halves to that problem. 1 gerrit does't know hwo to do anything else and 2 we are stuck with what the foundation tells us16:16
anteayabecause yes, if there is erroneous info circulating I want to know about it16:16
sdagueclarkb: ok, that was mostly the problem16:16
reedsdague, for sure, it's horribly cryptic... but we'll be able to get rid of that fairly soon so to me it's not a priority to fix16:16
jeblairreed: ++16:17
anteayazaro: yes, the gerrit repo16:17
openstackgerritKyle Mestery proposed a change to openstack-infra/config: Add openstack-lbaas to list of logged channels  https://review.openstack.org/10060316:17
*** marcoemorais1 has joined #openstack-infra16:17
sdagueI wanted to see *if* it was easy to provide a better error message16:17
sdaguethe answer being no, answers it :)16:17
*** hogepodge has quit IRC16:17
jeblairsdague: nope, if it were, we would have :)16:17
reedsdague, don't waste too much time on it16:17
*** markmc has quit IRC16:17
*** marcoemorais has quit IRC16:17
anteayaokay thanks16:17
clarkbdougwig: http://ci.openstack.org/irc.html#gerritbot though you also need to add your channel to https://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/accessbot/channels.yaml16:17
*** sweston has joined #openstack-infra16:17
anteayaglad we discussed it16:17
reedthe new openID provider will take care of that, and a change to the bylaws is not excluded either...16:18
dougwigty16:18
clarkbthat irc doc should probably be updated to include the channels.yaml stuff16:18
anteayareed: I was talking to ttx16:18
*** sweston has quit IRC16:18
anteayareed: he expects zero changes to the bylaws16:18
*** dizquierdo has quit IRC16:19
clarkbanteaya: well its hard16:19
anteayasince once the infra in in place the bylaws support not forcing every contributor to be a foundation member16:19
reedlooks like mrmartin  needs help urgently16:19
anteayaclarkb: what part is hard?16:19
clarkbanteaya: changing the bylaws16:19
*** habib has quit IRC16:19
anteayawe don't need to change them16:19
*** afazekas_ has quit IRC16:19
ttxwe don't need to changethe bylaws16:20
*** gyee has joined #openstack-infra16:20
anteayathe bylaws already support not forcing every contributor to be a member16:20
clarkbmrmartin: http://logs.openstack.org/48/100548/1/check/gate-groups-unittests/6731e1f/console.html#_2014-06-17_14_07_58_048 is the error and I have no idea how to debug drush unittets16:20
ttxthey never linked the two. We did.16:20
*** dizquierdo has joined #openstack-infra16:20
reedanteaya, we'll see... I think what's hard is change the bylaws not to require the CLAs16:20
clarkbin that case why don't we just remove the check?16:20
clarkbdoes the foundation actually use that linklage in any meaningful way?16:21
zaroanteaya: i think we can alter anything.  i'm not exactly sure what we want to alter it to so that it's general enough for every use case.16:21
anteayareed the CLAs are an entirely differnt conversation16:21
reedclarkb, I think I sent a message to the mlist about that16:21
clarkbreed: I don't think it is a mail list discussion honestly16:21
anteayareed: mushing them into one conversation impeeds progress where we need clear understanding16:21
clarkbreed: we are doing it purely for the foudation16:21
*** basha has quit IRC16:21
clarkbI don't get to see that linkage and no one else does16:21
jeblairclarkb: the linkage is used for elections16:21
jeblair(implicitly currently)16:21
reedclarkb, http://maffulli.net/2014/06/03/towards-a-directory-for-all-openstack-people talks a bit about this issue and I sent also an email with similar content to #infra mlist16:22
anteayawhich I want to seperate at the earliest possible opportunity16:22
jeblairso before we cut it, we need to make sure there's a plan to correlate git committers and foundation members in order to run PTL/TC elections16:22
ttxclarkb: the whole thing is because we have no way to determine ATCs if we don't "recommend" that committers are Foundation members :)16:22
anteayaas soon as we have a way to select all ATCs from contributors16:22
anteayabecause right now, we don't have access to the foundation db to perform that query16:22
clarkbttx: jeblair: why can't PTL and TC elections be run out of purely gerrit/git data?16:23
clarkband foundation elections out of foundation membership?16:23
*** arnaud has joined #openstack-infra16:23
zaroanteaya: i'm not sure what you are asking in regards to https://review.openstack.org/#/c/9922316:23
reedclarkb, because matching people to their electronic ID is a nightmare16:23
ttxclarkb: because ATCS need to be foundation members16:23
anteayabecause we don't have current data on foundation memberships status16:23
jeblairclarkb: PTL and TC elections are foundation elections16:23
anteayalinked to gerrit emails16:23
ttxbut you don't have to be an ATC to submit code.16:23
clarkbohhhhh so we can't separate them16:23
mordredso ...16:23
anteayaclarkb: not yet16:23
mordredI was thinking about this a little16:23
reeduh oh16:23
clarkbanteaya: doesn't sound like ever16:24
ttxso ATC = committer + Foundation member16:24
clarkbyou have to link them somehow16:24
anteayathe openstackid thing will allow us to seperate them16:24
* reed braces for mordred's crazy idea16:24
clarkbthe linkage doesn't need to be in CLA signing16:24
ttxand it gives you the right to vote.16:24
mordredwhy don't we just sent an email to the set of committers we know of a week before the elections16:24
clarkbbut you need to linkl them16:24
mordredsaying "hey, elections are coming up, if you're not a foundation member and you want to vote, make sure you go sign up16:24
*** hogepodge has joined #openstack-infra16:24
mordredand then, when we make the ATC list - it may not match the committer list 100%16:24
mordredbut some of the committers may not care16:24
mordredI think we're trying too hard to hand hold a group of very smart people16:25
zaroreed: did your question get answered in this review? https://review.openstack.org/#/c/9922316:25
anteayazaro: I have no comment son 99223, never seen it before16:25
reedsounds like a crazy idea that needs to be run by the lawyers16:25
ttxmordred: sure, as long as we ahve a way to tell who is a committer AND a foundation member16:25
ttx(i.e. an ATC)16:25
zaroanteaya: you asked in scrollback.16:25
reedzaro, not really... the commit message says that the list is 'public' but it's only available to authenticated16:25
jeblairmordred: yeah, i think that's fine.  i think grabbing both lists and matching on meails is fine16:25
ttxcurrently we have no celan way to determine who is an ATC, sadly16:25
mordredjeblair: ++16:26
reedzaro, I'd rather have that list available to anonymous16:26
ttxmatching on email was quite error-prone in the past16:26
clarkbjeblair: mordred the proiblem with that is I wouldn't show up as an ATC then16:26
mordredclarkb: why not?16:26
ttxand I'm not sure we can exclude people because they don't have matching email addreses16:26
clarkbmordred: my gerrit email != foundation email16:26
mordredclarkb: why?16:26
*** dizquierdo has quit IRC16:26
anteayazaro: not me, reed16:27
ttxlast time we tried, about 40% of the committers turned out not to have an email mathcing in the Foundation DB16:27
reedindeed, we can't exclude people from voting, I'm quite sure that the corporation has obligations toward its members16:27
clarkbmordred: because I find gmails spam filter really good but its terrible for gerrit email16:27
jeblairclarkb: gerrit allows multiple emails; i think the restriction would be that _one of_ your gerrit emails has to match your foundation email.16:27
mordredjeblair: ++16:27
ttxpeople tend to update Gerrit email without updating Foundation email16:27
clarkbjeblair: that may work (its not how it works today though...)16:27
zarofungi: ohh i see, more appropriate for fungi to make that change.16:27
ttxI think it's fine for elections (require that emails are synced)16:27
ttxafter all we need to send an email to let them vote16:27
reedzaro, if I curl https://review.openstack.org/a/groups/a49e4febb69477d0aa5737038c1802dd6cab67c5/members I get accessdenied16:27
ttxThe trick is...16:28
jeblairclarkb: we are talking about the future :)  but actually, no, when i provide the list for the ATC badges, I give _all_ the gerrit emails to the foundation.16:28
mordredright. I mean, I'm just saying ... sending a note saying "elections are coming up, if you care, please do X"16:28
clarkbjeblair: ah ok so that part of linking uses all the emails. thats good16:28
openstackgerritcraigtracey proposed a change to openstack-infra/config: Add Octavia to Stackforge  https://review.openstack.org/10057616:28
ttxwe still need to be able to tell "who is an ATC" and the bylwas don't say "you're an ATC only if your emails match between Gerrit and Foundation DB"16:28
*** dizquierdo has joined #openstack-infra16:28
reedguys, we'll solve this problem once the damn openid server is live and currently we have a bunch of blockers that prevent that from happening16:28
jeblairclarkb: yeah, it's only the current CLA signing thing, which we're talking about nixing anyway, that requries your primary16:28
ttxmordred: it's not just an election thing.16:29
reedone is the issue, not solved by https://review.openstack.org/#/c/99223/16:29
ttxWe need to be able to give the list of ATCs to the Foundation. Currently we can't16:29
zaroreed: yes, acls need to explicitly set to 'anonymous' access. It wasn't clear to me that was what you wanted in your comment.16:29
ttxthe only way we can is because we enforced a limitation that has no right to be there16:29
jeblairttx: this process doesn't _determine_ whether you are an ATC, it just helps identify ATCs.16:29
clarkbreed: anteaya re 99223 that is just documentation. It is possible fungi did not update gerrit16:29
ttxjeblair: the bylaws still ask us to have a clear list of ATCs.16:30
jeblairttx: and people who are not correctly identified as such can easily correct it16:30
jeblairttx: sure, we match up both lists and we get our list.  if it's wrong, people can help fix it.16:30
* ttx is having a meeting in parallel16:30
ttxcan't argue with the full brain yet16:30
reedttx, jeblair, indeed, I think it's related to the CLA too, whether we like it or not16:30
anteayattx sorry about this16:30
anteayathis was the conversation I hoped we would have during a meeting16:31
anteayareed how is this related to the CLA?16:31
reedanteaya, yeah, we keep circling around this issue and we already have decided what the solutions are only the solutions are slow to appear16:31
*** ociuhandu_ has quit IRC16:32
clarkbCLA Accepted - ICLA claims to be visible by all registered users16:32
anteayabut how is selected all contributers who are ATCs for the electoral roll related to the CLA?16:32
reedclarkb, zaro: I think I wasn't clear about what I meant with 'public'16:32
anteayas/selected/selecting16:32
*** ramashri has joined #openstack-infra16:33
clarkbreed: what do you mean?16:33
ttxWe are confusing two issues16:33
anteayattx no kidding16:33
ttxas far as elections are concerned, I think we can survive the decouplin16:33
reedclarkb, public as in visible to all, non authenticated included16:33
anteayaagreed16:33
ttxby asking people to sync their emails if they want to vote16:33
clarkbreed: there isn't a way to do that in gerrit aiui16:33
ttxBUT there is more to ATC status than just election16:33
clarkbreed: but that shouldn't be a problem right?16:33
anteayattx awesome16:33
bodepdfungi: I was just having a look at my CI user and it doesn't seem to exist anymore in gerrit16:33
clarkbreed: anonymous users don't need that data16:33
ttxit's a status defined in the bylaws unfortunately16:33
bodepdfungi: I'm asking you b/c you mentioned that you had changed the name?16:34
ttxand the bylaws ask that we maintain the list. And they don't say emails should be synced.16:34
anteayabodepd: what is the name?16:34
clarkbbodepd: it would just be the Name not user name16:34
ttxSo we need a unified solution, rather sooner than later16:34
reedclarkb, it makes things easier but if it cannot be done from gerrit side that's a fine answer too16:34
*** nati_uen_ has quit IRC16:34
ttxBut I think the election hack + the ID project covers us nicely16:34
anteayabodepd: what is the name of the CI?16:34
sdagueclarkb: you feel like pushing this one in - https://review.openstack.org/#/c/9796516:34
*** nati_ueno has joined #openstack-infra16:35
clarkbreed: the options are to make a group visible to the group itself or to all registered users or to no one16:35
anteayabodepd: I'm concerned if CI accounts disappear16:35
clarkbreed: I don't see a way to make it actually public public.16:35
reedclarkb, good enough, thanks16:35
bodepdanteaya: puppet-openstack-ci-user16:35
ttxWe can basically say: "if you're an ATC and want to vote, make sure your emails match!" -- that's election procedural, will work if communicated early enough16:35
anteayabodepd: https://review.openstack.org/#/q/owner:puppet.openstack.ci%2540gmail.com+status:open,n,z16:36
ttxBut we'll still need a clear way to determine who is an ATC.16:36
ttxBut that's two slightly different issues.16:36
anteayabodepd: we haven't changed any CI account names yet16:36
anteayabodepd: is that your account?16:36
ttxbecause one is carved in bylaws stone and the other is not.16:36
clarkbsdague: ya I can approve that. I really don't think you will get any valuable info16:36
clarkbsdague: as you can see hpcloud claims to use 7 yaer old core 2 duos16:36
clarkbwhich can't be true and if it is true...16:37
*** nati_ueno has quit IRC16:37
sdagueheh16:37
sdaguewell, it would be good to have16:37
*** nati_ueno has joined #openstack-infra16:37
bodepdanteaya: that is the one that I am looking for16:37
anteayattx will the openstackid setup not allow us to determine who are ATCs16:37
anteayabodepd: great16:37
*** sweston has joined #openstack-infra16:37
reedttx, I'm not sure that's good enough... we are a corporation, may be obligated by Delaware's laws to do more than that16:37
ttxanteaya: it will.16:37
bodepdanteaya: the private key that I thought was associated with it doesn't work, I tried to reset the password and got "No account associated with puppet.openstack.ci@gmail.com"16:38
*** agentleone has joined #openstack-infra16:38
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for cinder lvmremove failure  https://review.openstack.org/10044716:38
jeblairttx: we could identify the ATCs with mordred's proposal with the same fidelity we do today.16:38
anteayattx great16:38
anteayabodepd: ah16:38
reeddo you realise we're spending time discussing something for which we already have a fix in the pipeline?16:38
ttxreed: it's not for board election, so I'm not sure where Delaware law is getting into the picture16:38
anteayabodepd: do you need an updated key associated with the account?16:38
bodepdanteaya: can I not do it myself?16:39
anteayareed: but people don't know we do16:39
reedttx, TC and PTL are organs of the corporation, too16:39
anteayabodepd: no, third party CI accounts don't have gui access16:39
*** krtaylor has quit IRC16:39
ttxreed: if the TC was, we couldn't use Condorcet :)16:39
*** nati_ueno has quit IRC16:39
anteayabodepd: and you can't shell in to change it16:39
*** sweston is now known as sweston_mobile16:39
clarkbsdague: that may actually be part of the speed problem if the feature list lines up with a core 2 duo16:40
*** pblaho has quit IRC16:40
*** nati_ueno has joined #openstack-infra16:40
clarkbsdague: hrm, that would be really annoying16:40
reedttx, it is, and condorcet is an anomaly :)16:40
clarkbsdague: in 1.0 we had xeons16:40
clarkbaccording to cpuinfo16:40
clarkbwhich would come with a lot more special magic than a fake core 2 duo16:40
openstackgerritDevananda van der Veen proposed a change to openstack-infra/config: Revert "disable voting on gate-tempest-dsvm-virtual-ironic"  https://review.openstack.org/10062316:40
devanandasdague: ^16:40
reedttx, in any case, a change like the one you propose would have to be evaluated by our lawyers... which will take more time than actually deploying our damn openid16:40
anteayabodepd: if you do need a new key for the account, please email the infra ml with the new public key and the account info16:40
ttxreed: I'm also not sure the TC would qualify as anorgan of a Delaware corporation. It's a committee in it, and they can be freely arranged16:41
*** isviridov is now known as isviridov|be16:41
*** isviridov|be is now known as isviridov|away16:41
anteayathe tc can conduct elections as it sees fit16:41
anteayait is in the bylaws16:41
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for ceilometer Build timed out bug 1328679  https://review.openstack.org/10040516:41
uvirtbotLaunchpad bug 1328679 in ceilometer "recent build timeout failure in gate" [Medium,Triaged] https://launchpad.net/bugs/132867916:41
ttxreed: i'm not sure we actually change anything16:42
reedi'm done talking about this16:42
*** ominakov has quit IRC16:42
*** sweston_mobile has quit IRC16:42
*** sweston has joined #openstack-infra16:42
openstackgerritA change was merged to openstack-infra/infra-specs: Restore directory hierarchy to original design  https://review.openstack.org/10060216:43
ttxIn particular, we are not changing anything in the bylaws.16:43
reedttx, we change our processes and as you noticed with the specs thing, that requires *lots* of work. We can't change something as crucial as how we run elections every month16:43
*** harlowja_away is now known as harlowja16:43
anteayareed we don't change them every month16:43
*** sweston has quit IRC16:43
anteayathe elections only happen every 6 months16:43
reedanteaya, we do a lot more often than we strictly need to16:43
anteayaunless we need a by-election16:43
jeblairttx: (minor clarification: there's no delaware-law reason condorcet can't be used for board elections.  a number of corporations do use it.)16:43
anteayahow do you mean?16:43
*** Longgeek has quit IRC16:44
ttxreed: I see your point, but in this precise case, we would make the process more bylaws-compatible than it is today.16:44
*** jistr has quit IRC16:44
reedwe should not change anything about how we operate until we have moved the openid server to production and replaced launchpad with it16:44
reedttx, a change is a change, don't do it16:44
ttxreed: i'm fine with that option too.16:44
clarkbsdague: I think sse4_1 is newer than the T7700 so we seem to get a better feature list16:44
reedgreat :)16:45
ttxThe key issue here is our requirement to be a Foundation member to submit code... which is backed by nothing in the bylaws or the CLA16:45
ttxit's only reason for existing is to close a technical loophole in electorate generation16:45
reedcan we now switch to fixing issues that prevent code to be deployed? mrmartin has issues16:45
ttxloophole that we can close in other ways.16:45
mrmartinreed: I found meanwhile16:46
ttxI'll shut up now16:46
ttxIt's inner time anyway.16:46
ttx+d16:46
andreafclarkb: ping16:46
reedttx, we talked about that loophole and provided a solution for that already, and there is a discussion on mlist about that. Done. Next topic for me too :)16:46
bodepdanteaya: ah, yep, my key works. I was confused by not being able to login16:46
clarkbandreaf: pong16:46
reeds/provided/designed16:46
andreafclarkb: re https://review.openstack.org/#/c/98365/316:46
anteayabodepd: great, many happy returns16:47
* ttx would rather have us focus on getting that openstackID thing up asap -- which will solve all problems in one shot16:47
andreafclarkb: I was thinking that perhaps the feature.yaml should be in openstack-infra/config16:47
anteayattx but I am glad that we gave some air so that folks know what problems we are fixing16:47
ttxrather than investigating hypothetical workarounds in the case it's not ready by the time we need to have the next round of PTl elections16:47
ttxanteaya: agreed, lots of confusion as to what we are trying to solve here16:48
*** Ryan_Lane has joined #openstack-infra16:48
harlowjasdague are u ok with https://review.openstack.org/#/c/99556/16:48
* ttx dinners16:48
anteayaso we do have an item on today's infra agenda to discuss the openstackid timeframe16:48
anteayado attend16:48
clarkbandreaf: it is16:48
clarkbandreaf: but you can provide your own16:48
clarkbandreaf: which was one of the ncie things about adding the test-matrix.py script16:48
*** jvrbanac has quit IRC16:48
clarkbanteaya: so if you need to override something just provide a different feature.yaml16:48
andreafclarkb: I think at the moment it's stored in devstack-gate, isn't it?16:49
clarkbandreaf: we are trying to avoid handling every downstream testers openstack testing needs through code and push it into config16:49
clarkbandreaf: it is but you can provide your own16:49
clarkbandreaf: you will need to update devstack-gate to pass in the path to the file which was my suggestion in that change16:49
andreafclarkb: right I was thinking that also for upstream it should be in openstack-infra/config rather than openstack-infra/devstack-gate16:49
clarkbandreaf: upstream it will be16:50
clarkband upstream should default to that location16:50
clarkbbut if you need a different test matrix we should just provide a different matrix16:50
*** adalbas has quit IRC16:50
andreafso if the config repo precached on the devstack VMs?16:50
*** ihrachyshka has joined #openstack-infra16:50
mordredall repos are16:51
clarkball of the repos are precached on all of our slaves16:51
*** jcoufal has quit IRC16:51
*** ildikov has joined #openstack-infra16:52
*** yaguang has joined #openstack-infra16:52
*** Sam_S has joined #openstack-infra16:52
*** bhuvan has joined #openstack-infra16:52
andreafok I didn't see the config repo being fetched from the logs that's why I was asking... so under /opt/stack?16:52
clarkbandreaf: it shouldn't be in the config repo16:53
clarkbandreaf: it will stay in devsatck-gate for upstream16:53
clarkbandreaf: where you want to provide your test matrix is up to you16:53
andreafclarkb: it feels a bit odd that you have to change devstack-gate to change the branches rather than config16:54
clarkbandreaf: that is config though16:54
*** Sam_S has quit IRC16:54
clarkbmordred: ^ can I say that the branches thing you did is still terrible16:54
mordredclarkb: I still disagree with you 100%16:54
clarkbandreaf: we have explicitly pulled that out into a config file to make it easier for folks like you to reconsume devstack gate without needing to use our workflow16:55
clarkbandreaf: that means you may need to carry different config though16:55
*** SumitNaiksatam has quit IRC16:55
andreafclarkb: sure ok16:55
*** Sam_S has joined #openstack-infra16:56
*** jvrbanac has joined #openstack-infra16:57
*** harlowja has quit IRC16:57
*** Hal_ has quit IRC16:57
*** rdopieralski has quit IRC16:57
*** dkehn_ has joined #openstack-infra16:59
*** agentleone has quit IRC16:59
*** jvrbanac has quit IRC16:59
*** dkehnx has quit IRC16:59
*** dkehn has quit IRC16:59
*** rcarrillocruz has quit IRC16:59
*** jvrbanac has joined #openstack-infra16:59
*** rcarrillocruz has joined #openstack-infra17:00
*** salv-orlando has quit IRC17:00
*** dkehn has joined #openstack-infra17:01
*** jvrbanac has quit IRC17:01
*** harlowja has joined #openstack-infra17:01
*** _nadya_ has joined #openstack-infra17:02
*** agentleone has joined #openstack-infra17:02
*** jvrbanac has joined #openstack-infra17:03
*** yaguang has quit IRC17:03
*** yamahata has quit IRC17:03
*** adalbas has joined #openstack-infra17:03
*** dizquierdo has quit IRC17:04
*** dizquierdo has joined #openstack-infra17:05
*** dkehn__ has joined #openstack-infra17:05
*** mestery_ has joined #openstack-infra17:05
*** mestery_ has quit IRC17:05
*** blamar has quit IRC17:05
*** mestery_ has joined #openstack-infra17:06
*** dkehn has quit IRC17:06
*** agentleone has quit IRC17:07
*** mestery has quit IRC17:07
*** dkehn_ has quit IRC17:07
*** mestery_ is now known as mestery17:07
jogojeblair: did your nodepool patch land? because I see a spike where the number of nodes in deleting state dropped17:08
*** dkehn has joined #openstack-infra17:08
*** unicell has quit IRC17:09
anteayajogo: I know jeblair restarted nodepool to cause the spike, I am uncertain of the status of the patch17:09
*** marcoemorais1 has quit IRC17:10
jeblairanteaya, jogo: right -- the patch has not landed, but the simple restart corrected the immedate problem (and it should stay corrected until the config changes again17:10
anteayaI look forward to jeblair's clarification17:10
*** marcoemorais has joined #openstack-infra17:10
anteayaah cool17:10
jeblairif it does, it may need another restart if the problem trips again)17:10
jeblairof course the rax deleting problem still persists afaik, but at least nodepool should delete nodes almost as fast as rax lets it17:11
*** jpich has quit IRC17:11
devanandaclarkb, sdague: so I'm comfortable with the stability of the tempest-dsvm-virtual-ironic job, and that it also covers what the earlier tempest-dsvm-ironic job does (api exercises). I'm going to propose we drop one of those jobs.17:12
anteayawhich will help17:12
jogojeblair:  ahh17:13
*** yfried_ has joined #openstack-infra17:13
devanandaI'd like to merge them and just call it by the shorter name (tempest-dsvm-ironic). any thoughts / objections?17:13
*** sarob_ has joined #openstack-infra17:17
*** nati_ueno has quit IRC17:18
*** nati_ueno has joined #openstack-infra17:20
*** plars has quit IRC17:21
*** denis_makogon has joined #openstack-infra17:22
*** Hal_ has joined #openstack-infra17:25
*** sabari has quit IRC17:25
clarkbdevananda: wfm17:27
*** nati_ueno has quit IRC17:28
devanandacool17:29
*** agentleone has joined #openstack-infra17:30
*** mugsie has quit IRC17:30
krotschecknibalizer: On https://review.openstack.org/#/c/100370/2/Rakefile, is there supposed to be a duplicate disable_class_parameter_defaults?17:31
krotscheckI don’t quite understand the linked bug ticket.17:31
nibalizerhaha yes, its double disabled17:31
nibalizerjk thats  a bug17:31
krotscheckIt’s SUPER disabled.17:31
nibalizeri stole that comment from the rakefile in infra/config17:31
*** agentleone has quit IRC17:31
*** sweston_ has joined #openstack-infra17:32
*** agentleone has joined #openstack-infra17:32
openstackgerritFlavio Percoco proposed a change to openstack-infra/config: Create a marconi-specs repository  https://review.openstack.org/10063317:32
jesusaurusnibalizer: double secret disabled?17:32
anteayadoes anyone have any info on how to change the style in a wiki template?17:33
nibalizerkrotscheck: basically doing variable interpolation in parameters to class parameters17:33
anteayaI'm trying to get the name in https://wiki.openstack.org/w/index.php?title=Template:ThirdPartySystemInfo&action=edit more prominent17:33
*** praneshp has joined #openstack-infra17:33
*** agentleone has quit IRC17:33
*** sweston_ is now known as sweston_mobile17:33
*** agentleone has joined #openstack-infra17:33
*** dkranz has quit IRC17:34
krotschecknibalizer: So wait, it’s _supposed_ to disable twice?17:34
nibalizerkrotscheck: no i was joking17:34
*** weshay has quit IRC17:34
nibalizerthis is what i'm used to using for a rakefile for a puppet module17:34
nibalizerbut a lot of it is opinionated and I don't really care17:34
nibalizerhttps://github.com/nibalizer/puppet-module-puppetboard/blob/master/Rakefile17:34
*** mmaglana has joined #openstack-infra17:34
*** rm_work has joined #openstack-infra17:35
*** nati_ueno has joined #openstack-infra17:36
rm_workanyone available to review https://review.openstack.org/#/c/100603/ ?17:36
*** sweston_mobile is now known as sweston17:37
anteayarm_work: if you want to do /msg chanserv info #openstack-lbaas and paste the output in a comment on that patch, that will save me a step17:37
*** sweston has quit IRC17:37
*** sweston has joined #openstack-infra17:38
*** agentleone has quit IRC17:38
boris-42jeblair clarkb mordred pls could I get review for osprofiler (publishing tag stuff) really need it… https://review.openstack.org/#/c/100052/17:39
boris-42jeblair clarkb  mordred thanks a lot17:39
*** ominakov has joined #openstack-infra17:43
*** sweston_mobile has joined #openstack-infra17:43
nibalizerkrotscheck: so i've verified that we don't have to have that disabled any more because the bug is fixed17:43
nibalizerso im gonna remove both instances of the disabling17:44
*** sweston_mobile has quit IRC17:44
krotscheckGot it17:44
*** sweston_mobile has joined #openstack-infra17:44
*** doude has quit IRC17:47
*** weshay has joined #openstack-infra17:47
*** jlibosva has quit IRC17:47
*** mugsie has joined #openstack-infra17:48
nibalizerbomb incomipng17:49
*** mugsie is now known as Guest410817:49
*** dkranz has joined #openstack-infra17:49
openstackgerritAndrea Frittoli  proposed a change to openstack-infra/devstack-gate: Support for alternate trunk name (not master)  https://review.openstack.org/9836517:49
andreafclarkb: does this look better: https://review.openstack.org/#/c/98365/4 ?#17:50
*** _nadya_ has quit IRC17:50
*** ihrachyshka has quit IRC17:51
*** ihrachyshka has joined #openstack-infra17:52
*** johnthetubaguy is now known as zz_johnthetubagu17:52
clarkbandreaf: yup thanks17:53
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Put a default section header above the TTL  https://review.openstack.org/10032817:54
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: StoryBoard module bounces apache on update  https://review.openstack.org/10032917:54
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Add Storyboard puppet module  https://review.openstack.org/10032117:54
andreafclarkb: cool thanks for the feedback17:54
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Added Authorization Header flag to storyboard module  https://review.openstack.org/10032217:54
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Adding Rakefile  https://review.openstack.org/10037017:54
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Make storyboard run over ssl  https://review.openstack.org/10032317:54
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Load storyboard projects from projects.yaml  https://review.openstack.org/10032417:54
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Load storyboard superusers from yaml file  https://review.openstack.org/10032517:54
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Storyboard token expiration increased  https://review.openstack.org/10032617:54
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Make storyboard idempotent  https://review.openstack.org/10032717:54
*** zzelle has quit IRC17:54
rm_workanteaya: hmm, i did that but the formatting is a bit wonky <_< i can try again if that's not enough17:55
rm_workand we're submitting patch #2 in a sec to fix the logging thing17:55
*** SumitNaiksatam has joined #openstack-infra17:55
*** sweston_mobile has quit IRC17:56
*** e0ne has joined #openstack-infra17:57
anteayarm_work: that works for me17:57
anteayaas long as it is in one of the comments on the patch17:58
anteayarm_work: thanks17:58
anteayajeblair: I'm cleaning up the meeting agenda, fungi is mostly away this week, do you still want infra-specs on today's agenda?17:59
sabeenHi All! I was wondering if there is there any documentation around what the localrc file looks like for the server on which the tempest gating tests run?17:59
*** Hal_ has quit IRC17:59
anteayasabeen: #openstack-qa is a better bet17:59
clarkbsabeen: yes it hsould be included with the logs of every test run17:59
sabeenthanks anteaya - i'll get more details there18:00
sabeenthanks clarkb, i'll take a look!18:00
anteayaianw: is the f20 item on today's infra agenda your item?18:01
jeblairanteaya: i'm not sure if anything about specs needs to be discussed beyond "infra-cores and especially jeblair should get around to reviewing them"18:02
*** dkranz has quit IRC18:02
jeblairanteaya: are you aware of anything beyond that?18:02
*** rfolco has quit IRC18:03
anteayajeblair: no, I shall remove it from the agenda18:03
anteayagoing to be a packed meeting anyhow18:03
anteayamordred: are you going to be around to discuss manage-projects status?18:04
anteayaI'm guessing fungi will try to be at the meeting but he might not make it18:04
clarkbanteaya: I believe manage-projects is good18:04
*** sarob_ is now known as sarob18:04
clarkbcan probably be removed from the agenda if mordred confirm18:04
clarkbs18:04
anteayakk18:04
*** melwitt has joined #openstack-infra18:04
clarkbanteaya: that last bug to fix ACL updates has made new projects happy. The only outstanding issue sometimes github tells us to go away18:05
clarkbanteaya: and I believe that is owrked around by running fewer github API calls18:05
mordredanteaya: yah18:05
anteayaagenda item being removed18:05
anteayathanks18:05
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: New StoryBoard Logo  https://review.openstack.org/9921718:06
anteayaso zaro reed me and maybe rdopiera and maybe ianw18:06
*** ihrachyshka has quit IRC18:07
*** cdub has quit IRC18:07
openstackgerritKyle Mestery proposed a change to openstack-infra/config: Add openstack-lbaas to list of logged channels  https://review.openstack.org/10060318:07
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Put a default section header above the TTL  https://review.openstack.org/10032818:07
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: StoryBoard module bounces apache on update  https://review.openstack.org/10032918:07
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Add Storyboard puppet module  https://review.openstack.org/10032118:07
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Added Authorization Header flag to storyboard module  https://review.openstack.org/10032218:07
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Adding Rakefile  https://review.openstack.org/10037018:07
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Make storyboard run over ssl  https://review.openstack.org/10032318:08
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Load storyboard projects from projects.yaml  https://review.openstack.org/10032418:08
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Load storyboard superusers from yaml file  https://review.openstack.org/10032518:08
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Storyboard token expiration increased  https://review.openstack.org/10032618:08
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Make storyboard idempotent  https://review.openstack.org/10032718:08
*** zzelle has joined #openstack-infra18:08
*** SumitNaiksatam has left #openstack-infra18:09
rm_workanteaya: patch is in for https://review.openstack.org/#/c/100603/18:09
rm_workanteaya: and I fixed the chanserv info on my last review18:10
*** SumitNaiksatam has joined #openstack-infra18:10
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Put a default section header above the TTL  https://review.openstack.org/10032818:11
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: StoryBoard module bounces apache on update  https://review.openstack.org/10032918:11
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Add Storyboard puppet module  https://review.openstack.org/10032118:11
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Added Authorization Header flag to storyboard module  https://review.openstack.org/10032218:11
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Adding Rakefile  https://review.openstack.org/10037018:11
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Make storyboard run over ssl  https://review.openstack.org/10032318:11
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Load storyboard projects from projects.yaml  https://review.openstack.org/10032418:11
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Load storyboard superusers from yaml file  https://review.openstack.org/10032518:11
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Storyboard token expiration increased  https://review.openstack.org/10032618:11
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Make storyboard idempotent  https://review.openstack.org/10032718:11
openstackgerritcraigtracey proposed a change to openstack-infra/config: Add Octavia to Stackforge  https://review.openstack.org/10057618:11
anteayarm_work: thanks voted +118:11
anteayanibalizer: dude you know how to clog a channel18:11
*** krtaylor has joined #openstack-infra18:12
cody-somervilleDoes anybody have quick link to the infra/qa sprint mail?18:12
clarkbcody-somerville: http://lists.openstack.org/pipermail/openstack-infra/2014-May/001279.html18:13
*** jswarren has joined #openstack-infra18:13
*** e0ne has quit IRC18:14
*** e0ne has joined #openstack-infra18:15
nibalizeranteaya: sorry...18:15
*** dkranz has joined #openstack-infra18:15
nibalizerim replaying history so its a bit spammy18:16
yolandahi there, having a lot of bugs for new ironic tests: http://logs.openstack.org/24/99924/6/check/check-tempest-dsvm-virtual-ironic/df58fe818:16
nibalizermaybe we should hack openstackgerrit to say cchange change, and 7 more changes18:16
yolandaerrors doesn't seem related to my work, what should i do for my change to pass?18:16
clarkbyolanda: devananda and adam_g would be the folks to talk to18:16
yolandaok18:17
adam_gyolanda, https://bugs.launchpad.net/tempest/+bug/133083418:17
uvirtbotLaunchpad bug 1330834 in tempest "tempest.api.baremetal.test_ports_negative.TestPortsNegative are broken, failing all ironic tempest jobs" [Undecided,In progress]18:17
yolandahi adam_g, so i wait and follow this bug, rihgt?18:18
*** nati_ueno has quit IRC18:18
adam_gyolanda, yeah, there's a patch up now to fix it18:18
yolandagreat, thx18:18
openstackgerritMichael Krotscheck proposed a change to openstack-infra/config: Modularized StoryBoard Module  https://review.openstack.org/9800718:18
*** nati_ueno has joined #openstack-infra18:18
*** e0ne has quit IRC18:19
rm_workwho do we need to bug to get a fast-track on https://review.openstack.org/#/c/100603/ ?18:19
clarkbrm_work: you probably won't get it fast tracked. That change requires a resstart of the meeting bot and tuesdays are meeting heavy18:20
anteayanibalizer: :D18:20
rm_workJust need to get the bot online quickly so we can capture the activity of the next few days (there is a hackathon ongoing), since we need logs for those who are not local18:20
rm_workclarkb: hmm, ok18:20
clarkbrm_work: you can always have someone else get logs if you need them right now18:21
*** krtaylor has quit IRC18:21
clarkbmost irc clients will do this for you18:21
rm_workyeah, we can look at a temporary solution then18:21
clarkbor maybe just have them listen in...18:21
rm_workyeah, I suggested they use a bouncer :)18:21
rm_workor just leave their computer on18:22
*** changbl has quit IRC18:22
rm_workbut, logs would be good not just for now, but for posterity, since we are making decisions about future roadmap stuff in these meetings, so official is better18:22
clarkbrm_work: well meetings should go in the meetings channels18:23
rm_workbut if that is not possible then it is fine18:23
clarkbfor exactly this reason18:23
rm_workcan we monopolize a meeting channel for three days? :P18:23
clarkbthat isn't a meeting then...18:23
rm_workit's a hackathon / sub-team midcycle meetup18:23
clarkboh for that I would use ml maybe?18:24
rm_workwe have about 25 people local including PTLs18:24
rm_workheh18:24
rm_workyeah, we will try transcribing major points to the ML daily18:24
rm_workhopefully that will work18:24
clarkbif you make a big decision and need to let people know about mail is a good way to summarize and get out the important bits18:24
*** ihrachyshka has joined #openstack-infra18:24
rm_workyep18:24
rm_workthanks!18:25
*** chuck__ has joined #openstack-infra18:25
*** zul has quit IRC18:25
anteayarm_work: you can log you individual irc clients and post the logs as long as folks are in agreement18:25
*** chuck__ has quit IRC18:26
*** zul has joined #openstack-infra18:26
*** dkehn__ is now known as dkehnx18:26
anteayarm_work: and are you using etherpads?18:26
*** ominakov has quit IRC18:26
*** sweston_mobile has joined #openstack-infra18:27
sdagueclarkb: we seem to be taking another ES hit18:27
sdaguetime for ssd volumes?18:27
anteayaoh what just happened18:28
anteayasomething just happened to nodes in delete state18:28
ctraceyhey folks.  About to propose a new project add to stackforge.  'check-projects-yaml-alphabetized' is failing in Jenkins.  Is this expected? It seems to be voting. https://review.openstack.org/#/c/100576/18:28
anteayahi ctracey you need to alphabetize your yaml entry18:29
clarkbsdague: we can't18:29
clarkbsdague: at least not without shutting everything down18:29
clarkbmay need to do that anyways... hrm18:29
ctraceyanteaya: i was confused as it looks like the rest of the yaml is not alphabetized18:29
anteayanodes stuck in delete state seem to be unstuck all of a sudden18:29
*** lukego has joined #openstack-infra18:29
anteayactracey: yes, the test only came in recently18:30
clarkbsdague: but yes moving to ssd volumes may be the answer. We need more quota to have any hope at doing this without downtime18:30
clarkband lost data18:30
*** sandywalsh has quit IRC18:30
anteayactracey: so it only applies to new patches18:30
sdagueclarkb: well, if we're going to take an outage, the overall health of the project is actually pretty good right now18:30
jogoanteaya: oh wow18:30
sdagueso we'd want to do it when we aren't fighting hard with race bugs18:30
clarkbsdague: we can do this without downtime. Stop ES on a node, change mount, start ES on a node18:30
anteayajogo: stuck nodes?18:30
sdagueclarkb: ok, cool18:30
clarkbif we go node by node we don't lose any data. But we need more quota to do that18:30
sdagueclarkb: gotcha18:31
anteayajogo: yeah so that makes me think rax did something18:31
jogoanteaya: yeah the test nodes graph18:31
jogoanteaya: yeah thats what I was thinking too18:31
anteayasince when we do something the purple line stays at its upper boundary and the blue goes up18:31
anteayawhen the purple upper boundary drops that is a host change18:31
*** e0ne has joined #openstack-infra18:32
*** sweston_mobile has quit IRC18:32
anteayaor has been so far18:32
rcarrillocruzhey guys, who's going to the infra/qa sprint myd-cycle? could anyone please explain a bit the focus (will it focused for PTLs / Roadmap/ Design? or will it be for bootstrapping new folks doing Infra/QA ? A  bit of both?18:32
*** sandywalsh has joined #openstack-infra18:32
clarkbsdague: alternative is shut everything down. remove existing volumes, create new ssd volumes, start cluster. But that lsoes all the data18:32
anteayarcarrillocruz: bootstrapping new folks18:32
rcarrillocruznice18:32
*** agentleone has joined #openstack-infra18:32
rcarrillocruzthen i'm interested18:32
rcarrillocruzthanks18:32
jogoanteaya: on a strange note, we don't have any patches waiting in zuul18:32
anteayarcarrillocruz: and allowing us to talk to each other and put some stuff in play18:32
anteayarcarrillocruz: great, would love to have more hands18:32
* jogo does more reviews18:32
openstackgerritcraigtracey proposed a change to openstack-infra/config: Add Octavia to Stackforge  https://review.openstack.org/10057618:32
clarkbrcarrillocruz: anteaya: the wiki page has a schedule that include things other than boostrapping18:33
clarkbbut yes bootstrapping will happen too18:33
anteayajogo: meaning queue length zero?18:33
rcarrillocruzoh18:33
sdagueclarkb: yeh, if we can rotate through that would be best18:33
clarkbsdague: agreed18:33
*** harlowja has quit IRC18:33
* rcarrillocruz checking wiki18:33
clarkbmordred: ^ any luck talking to rax about that?18:33
anteayaclarkb rcarrillocruz yes, I probably still have my 'this isn't about setting up your third-party system' hat on18:34
anteayafunny it tends to be my default hat18:34
sdagueclarkb: while I'm thinking logstash things18:34
sdaguewould it be possible to get the approved status of the patch into the metadata?18:34
sdaguebecause it occurs to me that we should have reasonably clean data in check queue on stuff that's got +A on it18:35
clarkbsdague: not today. It would require a zuul patch to provide jenkins with that data18:35
clarkbbecause we only know what jenkins knows18:35
*** Guest4108 has quit IRC18:36
clarkbone way to deal with this may be to make a different "check" queue for approved things18:36
clarkbthat check queue could also haev a higher priority than normal check queue18:36
sdagueyeh, that seems like more complexity18:36
rcarrillocruzclarkb: do you have the link handy for the agenda?18:36
*** krtaylor has joined #openstack-infra18:36
sdaguethe approved status is in git notes, right?18:36
sdagueor is that not until the end?18:36
clarkbsdague: that isn't until the end18:36
sdagueI wonder if we could surface that in the console log18:36
*** atiwari has joined #openstack-infra18:37
pabelangerafternoon.  I'm seeing some issues with nodepool where the node becomes active, and the jenkins manager task runs, but jenkins doesn't actually launch on the node.  Curious where I could start looking to see what is going on18:37
clarkbrcarrillocruz: https://wiki.openstack.org/wiki/Qa_Infra_Meetup_201418:37
*** agentleone has quit IRC18:37
rcarrillocruzthanks sir18:37
clarkbpabelanger: first thing I would check is credentials for jenkins to node auth18:37
clarkbpabelanger: or is the node not ending up in jenkins at all?18:37
clarkbif it was an auth thing I would expect the node to be offline in jenkins18:38
pabelangerclarkb, the node registers with jenkins correctly, and goes into an offline mode.  Just the job is not launch18:38
clarkbya I would check auth in that case18:38
pabelangerok18:38
*** sweston_mobile has joined #openstack-infra18:39
*** agentleone has joined #openstack-infra18:39
*** harlowja has joined #openstack-infra18:40
*** agentleone has quit IRC18:40
openstackgerritMarton Kiss proposed a change to openstack-infra/config: Fix groups project check failure  https://review.openstack.org/10064818:40
*** nati_ueno has quit IRC18:40
sdagueclarkb: out of random curiosity, you happen to know the cli invocation to get the review notes out. Which doesn't help with this problem, but has been a missing piece of info for me18:40
*** nati_ueno has joined #openstack-infra18:40
*** _nadya_ has joined #openstack-infra18:40
*** cnesa has joined #openstack-infra18:41
*** dkehn_ has joined #openstack-infra18:41
openstackgerritcraigtracey proposed a change to openstack-infra/config: Add Octavia to Stackforge  https://review.openstack.org/10057618:42
*** dkehnx has quit IRC18:42
*** dkehn has quit IRC18:42
clarkbsdague: that is a good question. I think gerrit puts them in a non standard location so you have to convince git to show them to you18:42
clarkblet me figure it out18:42
*** changbl has joined #openstack-infra18:43
jogoanteaya: meaning no patches are sitting with in queue with no jobs  being run on it18:43
reedguys, we need your help to review https://review.openstack.org/100648 asap, it's blocking a lot of other patches18:43
clarkbreed: mrmartin that almost seems like the wrong approach18:44
clarkbcant you just point make at not github?18:44
clarkbyou shouldn't use github18:44
*** dkehn has joined #openstack-infra18:44
*** cnesa has quit IRC18:44
mrmartinclarkb: we are not using now18:44
anteayajogo: ah /me checks18:44
clarkbI thought the bug said this fails because it hits github instaed of using the current ref?18:44
mrmartinclarkb: this patch solves the problem, but it was just mistake that the code used that18:44
sdagueclarkb: actually, the answer is here - http://blog.adamspiers.org/2013/10/02/more-uses-for-git-notes/18:45
mrmartinclarkb: it fails because drush make tries to fetch the HEAD again18:45
sdagueyou have to fetch ref/notes/review to get it18:45
anteayajogo: well three at the bottom now18:45
anteayajogo: but yes, yay!!18:45
pabelangerclarkb, would you still expect an auth issue, if the problem is intermittent?18:45
clarkbpabelanger: yes, but a different issue. Maybe ssh isn't spinning up quickly enough or the connectivity between jenkins and slave is not good?18:46
clarkbsdague: thanks18:46
*** rcarrill` has joined #openstack-infra18:46
pabelangerclarkb, okay, I don't see anything in nodepool logs about auth issue. Let me check the code and see what exception handling there is18:47
clarkbpabelanger: no I don't think its between nodepool and the node18:48
clarkbit would be between jenkins and the node18:48
*** Guest4108 has joined #openstack-infra18:48
*** rcarrillocruz has quit IRC18:48
pabelangerok18:48
*** Guest4108 is now known as mugsie18:48
*** mugsie has joined #openstack-infra18:48
pabelangerclarkb, that makes more sense18:48
clarkbpabelanger: if nodepool fails to auth to the machine it won't be added to jenkins. Instead it will be deleted18:49
*** e0ne has quit IRC18:49
*** e0ne has joined #openstack-infra18:50
mrmartinclarkb: may I ask you to review this patch: https://review.openstack.org/#/c/100648/ it is blocking our community project18:51
clarkbmrmartin: I just asked about it18:51
clarkbI still don't understand how github was the problem and this fixes that18:52
mrmartinclarkb: the problem was not the github itself, it failed because drush make checked out the HEAD from repo, instead of using the specific ref related to the patch18:53
*** jp_at_hp has quit IRC18:53
clarkbmrmartin: right can we just set a make variable to change that?18:53
mrmartinclarkb: if you check this makefile: https://github.com/openstack-infra/groups/blob/master/build-groups.make it contains the github ref, enough for any remote dev to use it, but I cannot replace until the gating fails18:53
clarkbthis feels really complicated for a simple change18:53
*** e0ne has quit IRC18:53
mrmartinclarkb: drush make is a bit different, I needed to add another way to build the drupal distribution from fragments instead of using the one-step drush make process18:54
*** e0ne has joined #openstack-infra18:54
clarkbso you cannot set variables?18:55
clarkbMAKE_REPO and MAKE_REF for example?18:56
clarkbdefault to master and git.openstack.org18:56
*** weshay has quit IRC18:56
*** arnaud has quit IRC18:56
mrmartinclarkb: I can, but drush make invokes the git checkout, and I don't want to rewrite this tool18:56
*** cnesa has joined #openstack-infra18:57
clarkbyou don't need to if you can just provide that tool a variable18:57
*** sweston_mobile has quit IRC18:57
*** annegentle has joined #openstack-infra18:57
clarkbmrmartin: the way I read this is run make to build a dist. Copy that disk into a dir then rerun make on that dist18:58
clarkbwhich somehow avoids hitting github?18:58
mrmartinclarkb: ok, but I don't wait to deliver a patch for a third-party tool, if I can write a simple fix which is still correct18:58
clarkbif the goal is to avoid hitting github why not just point at not github?18:58
clarkbmrmartin: does drush make not accept variables?18:59
mrmartinclarkb: we can avoid github, but not github the problem now, I can fix it in drupal-org.make file later, we can see the same issue with git.openstack.org18:59
*** ArxCruz has quit IRC18:59
*** annegentle has quit IRC18:59
clarkbmrmartin: this is the file right https://github.com/openstack-infra/groups/blob/master/build-groups.make#L1018:59
*** arnaud has joined #openstack-infra18:59
mrmartinclarkb: exactly, bit it won't solve our current issue19:00
anteayameeting time19:00
clarkbok I really don't understand the problem then19:00
clarkbmrmartin: can you just change that git.openstack.org and HEAD?19:00
mrmartinclarkb: I cannot change it, because I cannot send a patch, because the gating job fails19:01
ianwanteaya: yes for f20 item19:01
anteayaianw: great19:01
clarkbmrmartin: that will ifx the gating job though right?19:01
anteayahere we go19:01
*** dizquierdo has quit IRC19:01
clarkbmrmartin: if that fixes the test then the gate passes19:01
mrmartinclarkb: replacing github to git.openstack.org won't fix this issue19:01
*** ominakov has joined #openstack-infra19:01
clarkbmrmartin: but changing to HEAD will19:01
mrmartinclarkb: no :)19:01
clarkbmrmartin: ok so I think there is a more fundamental issue here19:02
clarkbmrmartin: in our testing you should always use the local repo19:02
mrmartinclarkb: because the gate check must not use the HEAD, it must use the ref19:02
clarkbmrmartin: the tests don't do that19:02
clarkbHEAD is a ref in the local repo19:02
mrmartinclarkb: exactly, I'm telling the same19:02
openstackgerritDan Bode proposed a change to openstack-infra/config: Remove irc notification from puppet-openstack_dev_env  https://review.openstack.org/10065319:02
clarkbmrmartin: so why don't we fix that problem?19:02
pabelangerclarkb, that is my issue right now.  The node sits around forever in a ready state, and no other nodes have the ability to run said job19:02
*** sweston_mobile has joined #openstack-infra19:04
mrmartinclarkb: but what's wrong with this solution anyway: https://review.openstack.org/#/c/100648/ ? This solves a problem.19:04
clarkbmrmartin: it is complicated and fixes it in a round about way19:04
clarkbmrmartin: more importantly it doesn't fix it for anyone running make locally19:04
mrmartinclarkb: why do you think that it is complicated? we used to use this method on local dev environments19:05
clarkbmrmartin: because if I clone your repo and run make it won't do what I expect19:05
clarkbit will test upstream code and not my local code19:05
clarkbif I run make in a local repo that local repo should be used every time19:05
mrmartinclarkb: https://github.com/openstack-infra/groups/blob/master/scripts/dev-build.sh19:06
*** nati_ueno has quit IRC19:06
mrmartinclarkb: this is exactly doing that19:06
*** ominakov has quit IRC19:07
clarkbmrmartin: if that is how you are running tests locally that is what you should run in the gate19:07
clarkbmrmartin: then we don't even need to change the jenkins jobs when you fix things19:07
*** nati_ueno has joined #openstack-infra19:07
mrmartinclarkb: ok, but I cannot change the dev-build.sh script until I cannot fix this problem19:07
clarkbyou don't need to change the dev-build script right? you just need to change the jenkins job to run the dev build script19:08
mrmartinclarkb: I need to change the dev-build script because it builds into a different directory19:08
clarkbmrmartin: the underlying issue here is you run tests differently in your local env than we gate on19:08
clarkbmrmartin: you can do that after the job is udpated19:08
clarkbwe should fix the underlying issue19:08
mrmartinclarkb: ok, but now how can I modify the dev-build.sh to update the drush path to use ./drush/drush in jenkins job? and convert TARGET_DIR into a cli argument?19:10
clarkbmrmartin: if you setup the job in the desired configuration it will pass once you make the changes in the groups repo19:11
clarkbmrmartin: so step one is modifying the job, then step two is modifying groups19:11
*** ociuhandu has quit IRC19:11
mrmartinclarkb: it will fail due missing drush: http://paste.openstack.org/show/84335/19:14
clarkbmrmartin: you can leave the curl to get drush in the jobs or copy that into the dev build script19:15
clarkbmrmartin: also it should work with the existing TARGET right?19:15
mrmartinclarkb: it can, just need to rewrite the tarball part to use public instead of dist19:16
clarkbthe key thing is you want to make your local tests run exactly the same as the gate tests19:16
clarkbthen we avoid these problems completely19:16
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Error message & notification handling  https://review.openstack.org/9951519:16
*** nati_ueno has quit IRC19:17
mrmartinclarkb: ok I understand that, but what you think about to accept this fix temporarily, than I can deliver a more robust solution?19:17
mrmartinclarkb: I now it is a workaround19:18
clarkbI don't think we need this as a temporary fix19:18
clarkbyou just change the job to do what it should be doing then update groups to pass in that environment19:18
*** doude has joined #openstack-infra19:18
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for infra bug 1326122  https://review.openstack.org/10065519:20
uvirtbotLaunchpad bug 1326122 in openstack-ci "neutron-icehouse fails devstack apt-get problems" [Undecided,Confirmed] https://launchpad.net/bugs/132612219:20
openstackgerritMarton Kiss proposed a change to openstack-infra/config: Fix groups project check failure  https://review.openstack.org/10064819:24
*** dims_ has quit IRC19:25
clarkbmrmartin: thanks19:25
mrmartinclarkb: ok I'll patch the drupal-org.make to use git.openstack.org instead of github19:26
*** sweston_mobile has quit IRC19:27
*** arnaud has quit IRC19:28
*** dkehn_ is now known as dkehnx19:30
*** lukego has quit IRC19:35
*** isviridov|away is now known as isviridov19:38
*** dims_ has joined #openstack-infra19:40
*** rcarrill` has quit IRC19:41
*** rcarrillocruz has joined #openstack-infra19:41
*** ramashri has quit IRC19:42
*** eglynn has joined #openstack-infra19:42
*** arnaud has joined #openstack-infra19:43
eglynn'evening all!19:43
*** gyee has quit IRC19:43
*** pelix has quit IRC19:43
*** denis_makogon has quit IRC19:43
eglynnjust wondering, does etherpad.openstack.org fall with the ambit of the os-infra group?19:44
*** markmc has joined #openstack-infra19:44
*** ociuhandu has joined #openstack-infra19:45
clarkbeglynn: yes19:45
* eglynn asks coz his OPW intern has been tracking her status/progress on an etherpad, but recently it freezes on load19:45
eglynnclarkb: but I think I just figured out how to recover the pad content19:45
SergeyLukjanoveglynn, it's working for me right now19:45
clarkbeglynn: that may be a known bug with etherpad if you get to a certain size19:46
clarkbalso possibly a firefox vs chromium thing19:46
clarkbiirc chromium deals with the js much better19:46
eglynnclarkb: I'm seeing it with chrome also19:46
eglynnclarkb: tho' is it a large pad19:46
eglynnclarkb: in any case, I think the context can be recover by simply appending "/export/txt" to the path19:47
clarkbgreat19:47
eglynnclarkb: s/context/content/19:47
eglynnsorry for the noise gentlemen!19:47
*** e0ne has quit IRC19:48
*** e0ne has joined #openstack-infra19:48
*** eharney has quit IRC19:49
*** lcostantino has quit IRC19:50
openstackgerritA change was merged to openstack-infra/devstack-gate: capture cpu information when we setup_host  https://review.openstack.org/9796519:50
*** eglynn is now known as eglynn-afk19:51
*** CaptTof__ has quit IRC19:52
*** CaptTofu_ has joined #openstack-infra19:52
*** e0ne_ has joined #openstack-infra19:53
*** e0ne has quit IRC19:53
*** ArxCruz has joined #openstack-infra19:53
*** _nadya_ has quit IRC19:54
*** Sam-I-Am has quit IRC19:55
*** CaptTofu_ has quit IRC19:56
*** annegentle has joined #openstack-infra19:58
mrmartinSergeyLukjanov, may I ask you to review this patch: https://review.openstack.org/#/c/100648/19:59
sdagueeglynn-afk: is the etherpad > 800 lines?19:59
sdaguethat impacts things a lot19:59
*** sweston_mobile has joined #openstack-infra19:59
*** chmartinez has joined #openstack-infra20:00
chmartinezHello, could someone please help me and put this review in WIP (https://review.openstack.org/#/c/46216/)? thanks!20:00
*** sweston_mobile has quit IRC20:00
SergeyLukjanovmrmartin, I'll take a look when have a better internet connection20:00
bodepdDoes this zuul warning just mean that no matchings projects section exists:: Project openstack-dev/sandbox not found20:00
*** rcarrillocruz has quit IRC20:01
clarkbbodepd: yes20:01
*** dprince has quit IRC20:01
mrmartinSergeyLukjanov: Budapest is a great place to live and we have quite nice internet connection here20:01
*** lcheng has quit IRC20:01
*** rcarrillocruz has joined #openstack-infra20:02
clarkbchmartinez: the change owner or ceilometer core can do that for you20:02
*** Sam-I-Am has joined #openstack-infra20:02
clarkbchmartinez: er sorry horizon core20:02
chmartinezclarkb: cool. Thanks20:02
*** lcheng has joined #openstack-infra20:02
SergeyLukjanovmrmartin, I have an issues with only gerrit20:03
SergeyLukjanovmrmartin, 100648 approved20:04
mrmartinSergeyLukjanov: thank you!20:04
*** salv-orlando has joined #openstack-infra20:05
nibalizerreed: re: mediawiki looking poor, this skin makes it look much better: http://www.mediawiki.org/wiki/Skin:Foreground20:05
reednibalizer, it's not a question of skins, I'm afraid20:05
nibalizerah :(20:05
openstackgerritA change was merged to openstack-infra/config: Fix groups project check failure  https://review.openstack.org/10064820:07
*** marcoemorais has quit IRC20:07
*** marcoemorais has joined #openstack-infra20:08
reednibalizer, checking a site that uses that skin, it looks cool but the UI problem I mention is on the backend, this stuff is ... old https://wikiapiary.com/w/index.php?title=Main_Page&action=edit20:10
*** ArxCruz has quit IRC20:10
*** chmartinez has quit IRC20:10
reedand we're offtopic for this channel too20:10
bodepdclarkb: my best guess is that zuul was not honering layout_config20:12
*** nati_ueno has joined #openstack-infra20:12
*** dhellman_ has joined #openstack-infra20:12
*** yolanda has quit IRC20:13
*** rlandy has quit IRC20:13
bodepdI ran into a few other issues that I would not have expected. Zuul does not lay down the PID file expected by the service stop command20:13
clarkbbodepd: it should20:13
*** andreykurilin_ has joined #openstack-infra20:13
clarkbit uses the python lockfiles lib which handkles all of that20:13
clarkboh you know what I should've brought dib up in the meeting oh well we ran to time anyways20:15
clarkbjeblair: mordred: we should probably discuss that when you have time20:15
clarkbspecifically whether or not we should continue to hold up trusty for dib nodepool support considering the problems we have had with dib20:17
clarkband probably work discussing if dib is something we should use at all20:17
*** sweston_mobile has joined #openstack-infra20:18
jeblairclarkb: oh, yeah, that sounds like something to discuss.  i'm unaware of the problems or reasons why we may not want to use it.20:18
mordredjeblair: I can fill you in this afternoon20:19
mordredif we don't get to it in channel20:19
*** rcarrillocruz has quit IRC20:19
*** doude has quit IRC20:19
*** changbl has quit IRC20:19
*** praneshp has quit IRC20:19
*** bhuvan has quit IRC20:19
*** ildikov has quit IRC20:19
*** rkukura has quit IRC20:19
*** jasond` has quit IRC20:19
*** crc32 has quit IRC20:19
*** mriedem has quit IRC20:19
*** mwagner_lap has quit IRC20:19
*** jcooley has quit IRC20:19
*** medieval1 has quit IRC20:19
*** gargola has quit IRC20:19
*** cody-somerville has quit IRC20:19
*** saper has quit IRC20:19
*** gnuoy has quit IRC20:19
*** torgomatic has quit IRC20:19
*** bogdando has quit IRC20:19
*** masayukig has quit IRC20:19
*** skraynev has quit IRC20:19
*** bnemec has quit IRC20:19
*** jd__ has quit IRC20:19
*** fbo_away has quit IRC20:19
*** portante has quit IRC20:19
*** sdague has quit IRC20:19
*** russell_h has quit IRC20:19
*** briancline has quit IRC20:19
*** tnurlygayanov has quit IRC20:19
*** marcoemorais has quit IRC20:19
*** harlowja has quit IRC20:19
*** melwitt has quit IRC20:19
*** sarob has quit IRC20:19
*** wenlock_ has quit IRC20:19
*** mgagne has quit IRC20:19
*** sileht has quit IRC20:19
*** ityaptin has quit IRC20:19
*** jlk has quit IRC20:19
*** yjiang5 has quit IRC20:19
*** roaet_ has quit IRC20:19
*** adam_g has quit IRC20:19
*** mkoderer has quit IRC20:19
*** rainya has quit IRC20:19
*** dolphm has quit IRC20:19
*** russellb has quit IRC20:19
*** gondoi has quit IRC20:19
*** vishy has quit IRC20:19
*** wendar has quit IRC20:19
*** stevebaker has quit IRC20:19
*** Mithrandir has quit IRC20:19
*** alaski has quit IRC20:19
*** jbryce has quit IRC20:19
*** Adri2000 has quit IRC20:19
*** mordred_phone has quit IRC20:19
*** bodepd has quit IRC20:19
*** zigo has quit IRC20:19
*** jgriffith has quit IRC20:19
*** morgabra has quit IRC20:19
*** notmyname has quit IRC20:19
*** hdd has quit IRC20:19
*** zhiyan_ has quit IRC20:19
*** briancurtin has quit IRC20:19
*** chmouel has quit IRC20:19
*** mrda-away has quit IRC20:19
*** antonym has quit IRC20:19
*** thingee has quit IRC20:19
*** clarkb has quit IRC20:19
*** ttx has quit IRC20:19
*** uvirtbot has quit IRC20:19
*** dragondm has quit IRC20:19
jeblairmordred: cool, thx20:19
mordredjeblair: tl;dr - there is weirdness aroudn databases20:19
jeblairwell, i'm only half here right now because of tc meeting, then i'm off to meet mordred and do new-hire stuff20:20
mordredjeblair: clarkb is also worried about iptables rules - I'm less concerned with them myself - but I think that disagreement is moot until we sort out the databases question20:20
*** gargola has joined #openstack-infra20:20
*** marcoemorais has joined #openstack-infra20:20
*** rcarrillocruz has joined #openstack-infra20:20
*** doude has joined #openstack-infra20:20
*** changbl has joined #openstack-infra20:20
*** harlowja has joined #openstack-infra20:20
*** melwitt has joined #openstack-infra20:20
*** praneshp has joined #openstack-infra20:20
*** sarob has joined #openstack-infra20:20
*** bhuvan has joined #openstack-infra20:20
*** ildikov has joined #openstack-infra20:20
*** rkukura has joined #openstack-infra20:20
*** jasond` has joined #openstack-infra20:20
*** crc32 has joined #openstack-infra20:20
*** mriedem has joined #openstack-infra20:20
*** wenlock_ has joined #openstack-infra20:20
*** mwagner_lap has joined #openstack-infra20:20
*** ityaptin has joined #openstack-infra20:20
*** jcooley has joined #openstack-infra20:20
*** medieval1 has joined #openstack-infra20:20
*** cody-somerville has joined #openstack-infra20:20
*** tnurlygayanov has joined #openstack-infra20:20
*** saper has joined #openstack-infra20:20
*** gnuoy has joined #openstack-infra20:20
*** mgagne has joined #openstack-infra20:20
*** torgomatic has joined #openstack-infra20:20
*** bogdando has joined #openstack-infra20:20
*** masayukig has joined #openstack-infra20:20
*** skraynev has joined #openstack-infra20:20
*** sileht has joined #openstack-infra20:20
*** briancurtin has joined #openstack-infra20:20
*** jlk has joined #openstack-infra20:20
*** bnemec has joined #openstack-infra20:20
*** jd__ has joined #openstack-infra20:20
*** yjiang5 has joined #openstack-infra20:20
*** fbo_away has joined #openstack-infra20:20
*** portante has joined #openstack-infra20:20
*** roaet_ has joined #openstack-infra20:20
*** adam_g has joined #openstack-infra20:20
*** sdague has joined #openstack-infra20:20
*** mkoderer has joined #openstack-infra20:20
*** rainya has joined #openstack-infra20:20
*** dolphm has joined #openstack-infra20:20
*** russell_h has joined #openstack-infra20:20
*** briancline has joined #openstack-infra20:20
*** russellb has joined #openstack-infra20:20
*** dragondm has joined #openstack-infra20:20
*** uvirtbot has joined #openstack-infra20:20
*** ttx has joined #openstack-infra20:20
*** clarkb has joined #openstack-infra20:20
*** thingee has joined #openstack-infra20:20
*** antonym has joined #openstack-infra20:20
*** chmouel has joined #openstack-infra20:20
*** hdd has joined #openstack-infra20:20
*** notmyname has joined #openstack-infra20:20
*** morgabra has joined #openstack-infra20:20
*** jgriffith has joined #openstack-infra20:20
*** zigo has joined #openstack-infra20:20
*** zhiyan_ has joined #openstack-infra20:20
*** mrda-away has joined #openstack-infra20:20
*** bodepd has joined #openstack-infra20:20
*** mordred_phone has joined #openstack-infra20:20
*** Adri2000 has joined #openstack-infra20:20
*** jbryce has joined #openstack-infra20:20
*** alaski has joined #openstack-infra20:20
*** Mithrandir has joined #openstack-infra20:20
*** stevebaker has joined #openstack-infra20:20
*** wendar has joined #openstack-infra20:20
*** vishy has joined #openstack-infra20:20
*** gondoi has joined #openstack-infra20:20
jeblairso perhaps the brief from mordred this afternoon followed by more discussion tomorrow might be best20:20
mordredjeblair: ++20:20
ianwsdague / jeblair : http://lists.openstack.org/pipermail/openstack-infra/2014-June/001354.html (Status of check-tempest-dsvm-f20 job) <- it would be really great if i could get a overview because i'm not understanding what caused the issues & how i can help to fix it20:21
*** gargola has quit IRC20:21
*** gargola has joined #openstack-infra20:21
clarkboh good everyone came back20:21
bodepdclarkb: weird, everything works perfectly now. You probably have to gripe in irc for it to work correcrly20:21
sdagueianw: there is an expectation mismatch between nodepool, zuul, and me when we max our our quota20:22
clarkbjeblair: mordred: let me tl;dr it as it isn't super complicated. The major issue is image builds happen in chroots. This is fine until you want to start services to say setup a database or setup unbound. There is also the issue where building fedora on ubuntu may not work due to kernel compat20:22
*** sweston_mobile has quit IRC20:22
clarkbjeblair: mordred: I think the tool is good for people that are willing to spend time post boot to perform setup in a homogenous environment. We are not that user20:22
sdagueianw: that we need a better story on, because the behavior we were seeing was that devstack patches would stall waiting for f20 nodes, which weren't getting created, because their ratio was off20:23
*** AaronGr has quit IRC20:23
mordredclarkb: the fedora problem is still theory - it has not reared its head in practice20:23
clarkbmordred: correct, but you hit it with debian and /tmp20:23
*** AaronGr has joined #openstack-infra20:23
mordredclarkb: currently it's quite specifically the tool's expectation that that's a supported thing to do20:23
clarkbmordred: so that case is theory the overall issue is not20:24
mordredclarkb: right. that was a bug and was agreed to be a bug20:24
mordredclarkb: and a fix is being worked20:24
mordredit had just never been tried20:24
mordredthere is a difference between "a thing has a bug" and "there is a fundamental flaw" is all I'm pointing out20:24
*** SumitNaiksatam has quit IRC20:24
*** mmaglana has quit IRC20:24
*** yfried_ has quit IRC20:24
*** chandan_kumar has quit IRC20:24
*** thedodd has quit IRC20:24
*** bcrochet has quit IRC20:24
*** julim has quit IRC20:24
*** otherwiseguy has quit IRC20:24
*** smarcet has quit IRC20:24
*** pdmars has quit IRC20:24
*** andreaf has quit IRC20:24
*** grantbow_ has quit IRC20:24
*** maxbit has quit IRC20:24
*** camunoz has quit IRC20:24
*** Alexei_987 has quit IRC20:24
*** slamont has quit IRC20:24
*** bradm has quit IRC20:24
clarkbsure20:24
ianwsdague: ok; i think that's the crux of the matter, where is the ratio set?  sorry, i'm still learning nodepool, etc20:24
clarkband I wouldn't characterize it as a fundamental flaw considering the dib use case20:25
clarkbI think it is flawed for our use case20:25
*** mrmartin has quit IRC20:25
mordredI still don't think it's flawed for our use case because of that20:25
mordredI think there was a bug20:25
clarkbright its the sum of the above not one thing20:25
*** ramashri has joined #openstack-infra20:25
clarkbit was very clearly not meant to tackle these problems20:26
mordredI think it was meant to tackle these problems20:26
mordredbut I still haven't finished my next patch because $sick20:26
sdagueianw: so I think we probably want to chat with jeblair about nodepool allocator, because it seems wrong that we have to manually set ratios for node types, regardless of the kinds of patches that hit zuul in a given day. And I'm wondering if there is a longer term fix to make that more dynamic.20:26
clarkbmordred: the fact we need that patch is the problem20:26
clarkbmordred: we can work around it20:26
clarkbthe work around sucks20:27
mordredclarkb: the fact that we uncovered a bug in a tool is a problem?20:27
clarkbmordred: what bug are you talking about?20:27
mordredclarkb: I'm talking about the debian/ubuntu bug20:28
clarkbmordred: I am talking about all of the various work arounds we have had to come up with to get useable nodes20:28
clarkbmordred: no thats different20:28
clarkbsounds like an actual bug20:28
mordredok. listen. can we cme back to this?20:28
clarkbsure20:28
mordredI'm also in a tC meeting20:28
*** dims_ has quit IRC20:28
*** yfried_ has joined #openstack-infra20:28
mordredand I'm still raging from teh infra meeting20:28
openstackgerritIvan Kolodyazhny proposed a change to openstack-infra/config: Make GIT_BASE configurable for each project  https://review.openstack.org/10054720:28
*** jgrimm has quit IRC20:29
ianwsdague: where is the ratio set manually?  this is different to "min-ready"?20:29
sdagueianw: nope, it's min-ready20:30
*** dims_ has joined #openstack-infra20:30
jeblairsdague: and i don't agree that the observed behavior is a bug20:30
sdaguejeblair: ok20:31
jeblairsdague: your rationale for turning it off included that you needed a devstack change merged asap to stop existing gate breakage20:31
ianwsdague: so one might say that f20's min ready was 5, which gives it a say X% share of the ratio, which was insufficient to keep up with the incoming reviews?20:31
jeblairthat was all a temporal issue relating to the current state of the code, and the fact that our providers were unable to delete nodes and that nodepool itself had a bug and was not trying20:31
sdaguejeblair: sure, but now that I understand how the situation degrades, I really don't want it coming back on for projects20:31
*** chandan_kumar has joined #openstack-infra20:34
*** maxbit has joined #openstack-infra20:34
*** maxbit is now known as 18VAAD33720:36
*** andreaf_ has joined #openstack-infra20:36
*** SumitNaiksatam has joined #openstack-infra20:36
*** mmaglana has joined #openstack-infra20:36
*** thedodd has joined #openstack-infra20:36
*** bcrochet has joined #openstack-infra20:36
*** julim has joined #openstack-infra20:36
*** otherwiseguy has joined #openstack-infra20:36
*** smarcet has joined #openstack-infra20:36
*** pdmars has joined #openstack-infra20:36
*** andreaf has joined #openstack-infra20:36
*** maxbit has joined #openstack-infra20:36
*** camunoz has joined #openstack-infra20:36
*** Alexei_987 has joined #openstack-infra20:36
*** slamont has joined #openstack-infra20:36
*** bradm has joined #openstack-infra20:36
*** andreaf has quit IRC20:36
*** grantbow has joined #openstack-infra20:36
*** grantbow has quit IRC20:36
*** grantbow has joined #openstack-infra20:36
*** julim has quit IRC20:37
*** marcoemorais has quit IRC20:37
*** marcoemorais has joined #openstack-infra20:38
ianwjeblair: sorry to be dense, are the logs or anything of where nodepool was not creating the f20 nodes?  or was it just an absence of nodes20:38
*** maxbit has quit IRC20:38
*** marcoemorais has quit IRC20:38
*** marcoemorais has joined #openstack-infra20:38
jeblairianw: it was choosing not to create them because it needed more precise nodes and it did not have the capacity to satisfy everything it needed20:38
*** e0ne_ has quit IRC20:39
*** Alec-A2 has quit IRC20:39
jeblairianw: sdague would prefer it have a diffirent algorithm under those constrained circumstances20:39
*** e0ne has joined #openstack-infra20:39
jeblairianw: i don't think it's important because once capacity is available again, it will self-correct and everything will be fine20:39
sdagueright, which is where we disagree :)20:40
ianwjeblair: this is in nodepool/allocation.py?20:40
jeblair(and if capacity is never recovered, it doesn't matter anyway)20:40
*** Alec-A2 has joined #openstack-infra20:40
sdaguebecause I feel that means you take a strong penalty on turn around time if you add f20 jobs to your project20:40
sdagueespecially when that project is one of the knobs we often have to tweak to recover the whole system20:41
*** e0ne has quit IRC20:42
*** maxbit has joined #openstack-infra20:42
jeblairsdague: right, so what we have at the moment is the decision about whether testing f20 is worth the potential delay in results under constrained circumstances20:42
ianwsdague: but i don't want to be running "check experimental" all the time, because that multiples load issues running all those other jobs.  but i also don't want the job to regress20:43
jeblairsdague: yesterday i bought the answer was "no" because of all the reasons i said20:43
jeblairsdague: but today, we identified the bug in nodepool that caused it to not delete nodes for, what, like a week20:43
sdaguejeblair: sure20:43
jeblairsdague: and zuul currently has 0 waiting jobs20:43
sdaguebut we're also not actually at a busy point in the cycle20:43
jeblairsdague: so the answer may be different20:43
sdagueand we recovered the failure rate so the round tripping is far less20:44
sdaguehttp://jogo.github.io/gate/ - that's kind of as low a failure rate as we've had in a long time20:44
jeblairsdague: if the answer is not different, then i think we need a proposal for an allocator that behaves in the way you would like under contraint20:44
*** rcarrill` has joined #openstack-infra20:44
*** 18VAAD337 has quit IRC20:44
jeblairsdague: i'm not certain that is easy20:44
sdaguejeblair: right, I agree. Both on the need, and it not being easy20:45
*** flaper87 is now known as flaper87|afk20:45
*** eglynn-afk is now known as eglynn20:46
sdagueit seems like germany might be an ideal time to discuss this, face to face, with white board20:46
jeblair(since designing for constraints is all about tradeoffs, we probably need to identify what we gain/lose with the different systems and figure out our priority)20:46
clarkbjeblair: that is why I think a PID loop may work well as in theory it can change priority in tradeoffs as the running system changes20:46
jogosdague: don't jinx it20:46
*** rcarrillocruz has quit IRC20:46
sdaguejogo: I'll wear a talisman and keep the tigers away20:47
jeblairsdague: are you attending?20:47
jogosdague: and we aren't hitting quota either20:47
sdaguejeblair: yeh20:47
jeblairsdague: oh neat, i thought you had a conflict20:47
sdagueno, things shuffled around. And given a few topics we're going to hit, germany is probably a good idea for me to be there20:47
wenlock_clarkb is launchpad oid not happy today?20:48
clarkbwenlock_: it was working earlier for me20:48
clarkbit was broken over the weekend though20:48
wenlock_clarkb  i droped you a note in email... was hoping you could take a peak20:49
jogosdague jeblair: thoughts on turning off the auto-recheck on negative reviews. So we only recheck for >=0 reviews where previous jenkins results are over 72 hours old20:49
*** e0ne has joined #openstack-infra20:50
sdaguejogo: as long as +A triggered it, I'd be fine with that.20:50
jogosdague:  you mean +W ;) and yes20:50
sdaguejogo: meh, I'm in my old ways20:50
sdague+A 4evar!20:50
jogoyou should make that a button20:51
jogoto wear20:51
jogojeblair: thoughts? as its a zuul change?20:51
jogoerr that last question mark wasn't supposed to be there20:51
ianwsdague / jeblair: just to be clear, what is the status?  the job will not be enabled until the nodepool allocator is modified?20:51
*** Ryan_Lane1 has quit IRC20:52
*** _nadya_ has joined #openstack-infra20:54
*** maxbit_ has joined #openstack-infra20:54
*** duran has joined #openstack-infra20:55
openstackgerritA change was merged to openstack/requirements: Bump up to the six 1.7.x series  https://review.openstack.org/9955620:57
wenlock_clarkb yeah, restarting our gerrit clears it20:57
jeblairjogo: didn't i already +2 that?20:58
jeblairianw: i would be willing to re-enable it now that the immediate crisis has passed.  i believe sdague would rather not.  i'm not willing to have a showdown with him on this one so i think we need some more consensus.20:58
*** andreykurilin_ has quit IRC20:59
openstackgerritOpenStack Proposal Bot proposed a change to openstack-dev/hacking: Updated from global requirements  https://review.openstack.org/10068020:59
jogojeblair: that was a  different scenario20:59
clarkbwenlock_: interesting. I just popped open email and no hadn't seen that before20:59
clarkbwenlock_: glad you worked around it20:59
jogothat was don't rerun jenkins if the previous jenkins run voted -120:59
*** bhuvan_ has joined #openstack-infra20:59
jeblairianw: the fix that would make sdague happy is not an easy one, so i know of no short-term thing we could do, other than move 50% of our testing to f20.20:59
jogothis is the use case where a human votes -120:59
*** maxbit has quit IRC21:01
wenlock_clarkb well... kinda... not sure i have21:01
wenlock_clarkb we restart it  but then try another git clone and it goes to 100% again21:02
*** radez is now known as radez_g0n321:02
*** changbl has quit IRC21:02
*** bhuvan has quit IRC21:02
*** e0ne has quit IRC21:02
*** bhuvan_ has quit IRC21:02
*** _nadya_ has quit IRC21:03
*** bhuvan has joined #openstack-infra21:03
*** e0ne has joined #openstack-infra21:03
*** gyee has joined #openstack-infra21:04
*** maxbit has joined #openstack-infra21:05
adam_gsdague, ping.. https://review.openstack.org/#/c/92216/2/functions.sh  .. you would prefer we stuff vm logs in a subdir of $BASE/logs (ie, $BASE/logs/ironic-bm-logs/)?21:06
*** maxbit_ has quit IRC21:07
*** e0ne has quit IRC21:07
jeblairjogo: have to run now, sorry21:08
*** mark0n has joined #openstack-infra21:08
sdagueadam_g: yes, exactly21:09
mark0nHow do I need to quote curly braces in a Jenkins Job Builder file (shell section)? I tried "\{\}", '{}' and "\0x7b\0x7d". None of these work :-(21:11
clarkbmark0n: {{}}21:12
*** marcoemorais has quit IRC21:12
clarkbmark0n: it uses python string substition so python escape rules21:12
*** marcoemorais has joined #openstack-infra21:12
*** annegentle has quit IRC21:13
*** marcoemorais has quit IRC21:13
*** marcoemorais has joined #openstack-infra21:13
mark0nclarkb: thanks!21:13
*** andreaf has joined #openstack-infra21:16
*** akerr has joined #openstack-infra21:17
*** mfer has quit IRC21:18
akerris there a way to stop a runaway CI system on the sandbox project?  https://review.openstack.org/#/c/99678/ keeps spamming several times a minute and has flooded our system's email with thousands of emails today21:18
openstackgerritAdam Gandelman proposed a change to openstack-infra/devstack-gate: Archive Ironic VM nodes console logs  https://review.openstack.org/9221621:19
clarkbakerr: in theory that is what the repo is for21:20
clarkbakerr: you can always ping the email address for that account21:20
akerrclarkb: an infinite loop?21:20
clarkband ask them to stop21:20
clarkbakerr: do we know it is an infinite loop? maybe they are testing soemthing?21:20
*** dkranz has quit IRC21:21
harlowjalifeless did u have time to checkout comments @ https://review.openstack.org/#/c/98946/ ?21:21
harlowja*if not thats ok*21:21
akerrclarkb: pretty sure it's looping, its been testing the same patch set over and over for 5 hours, but I will email the account21:23
*** ihrachyshka has quit IRC21:24
*** markmc has quit IRC21:24
lifelessharlowja: not yet, will do so soon21:25
sdagueok, this is a pretty awesome view that dolphm made of the gate queue depth - http://goo.gl/dFW8kd21:25
harlowjalifeless thx :)21:25
sdagueyes, this was a Jan level event :)21:25
*** e0ne has joined #openstack-infra21:25
*** e0ne has quit IRC21:26
*** pdmars has quit IRC21:26
*** e0ne has joined #openstack-infra21:26
*** dhellman_ has quit IRC21:26
*** isviridov is now known as isviridov|away21:28
*** jgrimm has joined #openstack-infra21:28
*** e0ne has quit IRC21:29
*** mwagner_lap has quit IRC21:30
*** akerr has left #openstack-infra21:30
clarkbmordred: when you are ready to talk again. I agree the debian thing is a bug and fixable. I was trying to get at there are mutliple things we have had to work around on top of dib that are a bit ugh21:31
clarkbmordred: and that is where most of my concern comes from21:31
*** andreaf has quit IRC21:31
*** dizquierdo has joined #openstack-infra21:35
*** sweston has quit IRC21:35
*** sweston_mobile has joined #openstack-infra21:37
*** dims has joined #openstack-infra21:37
*** duran has quit IRC21:38
*** dims_ has quit IRC21:39
*** sweston_mobile has quit IRC21:40
openstackgerritCedric Brandily proposed a change to openstack-infra/git-review: Disable ssh/scp password authentication during tests  https://review.openstack.org/9702521:40
*** sweston_mobile has joined #openstack-infra21:42
*** ramashri has quit IRC21:45
*** mriedem has quit IRC21:48
mordredclarkb: totally grok - and I don't disagree that there is concern to keep our eyes on21:48
*** sweston_mobile has quit IRC21:48
openstackgerritJoe Gordon proposed a change to openstack-infra/config: Whitelist hacking in the requirements job  https://review.openstack.org/10069921:49
clarkbmordred: and i think the image building problem we have is fundamentally served better with building in a real VM21:49
clarkbmordred: we can definitely improve that process too21:49
mordredclarkb: I hear that - but I'd like to try harder here, mainly because it drives me batty when someone looks at one of our tools, thinks their use case is a little too different and goes and invents largely the same thing21:50
*** morganfainberg has quit IRC21:50
mordredclarkb: you may ultimately be right21:50
mordredI'm just not ready to concede that yet21:50
clarkbmordred: well we could use a different tool like packer21:50
clarkbrather than reinventing21:50
mordredthere is an openstack tool to do the job which is _really_ close21:50
clarkbwhich may help solve the $person wants to build an image use case21:50
*** morganfainberg has joined #openstack-infra21:50
mordredI'd like to keep hammering at it for a bit21:50
clarkbwhich I think is fine, but I definitely don't think we should make trusty depend on that21:51
mordredI really don't think we're that far off21:51
sdagueso, unrelated to dib, https://review.openstack.org/#/c/99333/ - appears to be working, and will drop the double indexing of console logs in grenade (completing the transition of grenade console in gate to be like devstack console in the gate)21:52
clarkbmordred: we are when you start considering centos 721:52
mordredclarkb: why?21:52
clarkbmordred: and the next distro. I really expect significant pain on each thing we want to build images for21:52
mordredand when did centos7 all of a sudden become an issue?21:52
clarkbmordred: because we have had to get away from generic puppet to specific things21:52
mordredI do not expect that21:52
clarkbmordred: well rhel7 released last week21:52
clarkbso centos 7 should happen rsn21:52
mordredI do not expect significant pain21:52
*** mark0n has quit IRC21:52
mordredthe redhat guys are working with dib quite a bit you know21:52
mordredand supporting cross-distro build is a fundamental feature of the tool21:53
clarkbmordred: but not when it comes to the services dance we will have to do21:53
clarkbmordred: and those are completely different21:53
mordredI do not think we have to do as much of a services dance as you think21:53
clarkbbecause systemd vs upstart. mysql and postgres being different and so on21:53
mordredI do not agree with what you think we need to do there21:53
openstackgerritJoe Gordon proposed a change to openstack/requirements: Update skip pep8 clause to use hacking  https://review.openstack.org/10070221:53
*** mrda-away is now known as mrda21:54
clarkbmordred: do we not need to script the manual starting and stopping of DB services on sockets to seed them?21:54
mordredclarkb: I do not think that we need to do that21:54
clarkboh21:54
clarkbhow do we solve that problem?21:55
mordredI think it can all be done directly in the puppet21:55
mordredcleanly21:55
clarkbthis is news to me21:55
clarkbI will be very excited if it is possible21:55
mordredsorry - I've been wanting to write the patch and show it rather tahn talk about the aptch and then watch soccer :)21:55
mordredwhich is bad on me - and then sick happened21:55
openstackgerritAlex Gaynor proposed a change to openstack/requirements: Add the Openstack SDK project to projects.txt  https://review.openstack.org/10070321:55
lifelessharlowja: ok so21:57
lifelessharlowja: I think we're talking past each other21:58
harlowjalifeless possibly, haha21:58
lifelessharlowja: specifically, I have no objection to marking non-taken subgraphs explicitly.21:58
lifelessharlowja: but your algorithm implies only one taken subgraph21:58
lifelessharlowja: does that help clarify?21:58
harlowjalifeless yes, one taken subgraph seems to be an ok assumption to start?21:59
jogomordred clarkb: https://review.openstack.org/#/c/100699/  https://review.openstack.org/#/c/100702/21:59
jogonow that the second patch is approved the first needs reviews21:59
clarkbjogo: I don't like 100699 it encodes too much in code21:59
harlowjalifeless not saying this can't change someday, just gotta start somewhere vs everywhere22:00
*** pdmars has joined #openstack-infra22:00
*** doude has quit IRC22:00
jogoclarkb: alternative propsal?22:00
*** doude has joined #openstack-infra22:00
*** maxbit_ has joined #openstack-infra22:00
clarkbjogo: well hold on sdague is talkingabout it over there in qa22:01
bodepdjob name is the things that binds gearman to zuul? which is specified as a list to a project's pipeline?22:01
*** Sukhdev has joined #openstack-infra22:01
bodepdso if I have a job 'foo' in jenkins and : https://gist.github.com/bodepd/0cea5cfa96ac5b30e398 it should just work?22:02
mordredbodepd: yes22:02
mordredbodepd: well, also node label needs to be correct22:02
bodepdmordred: does the job need any special params?22:02
bodepdmordred: where are the docs for that? is it in the jjb docs?22:03
lifelessharlowja: I think its a corner case, and good design starts with general case22:03
mordredbodepd: zuul docs - lemme find you a link22:03
lifelessharlowja: in that its much less common to have to fundamentally rework things if you start that way22:03
*** SumitNaiksatam has quit IRC22:03
*** maxbit has quit IRC22:04
clarkbdhellmann: we only publish wheels for oslo.db? is that because it is a prerelease?22:04
clarkbdhellmann: iirc that is intentional22:04
dhellmannclarkb: yes, that's right, we only have alphas for now22:04
clarkbdhellmann: so that old pip won't install prerelease versions22:04
harlowjalifeless possibly but i imagine most users would expect that only 1 path of a conditional actually is executed, since this is what they are used to22:04
dhellmannclarkb: the issue is the job that checks requirements can't find it, because it is specifically skipping wheels22:04
lifelessharlowja: case statements don't have that property22:05
dhellmannand so when we try to add oslo.db to the requirements list, it looks like there is nothing released to be downloaded22:05
clarkbdhellmann: ya so I think that is intentional22:05
lifelessharlowja: to name a common conditional construct22:05
dhellmannclarkb: ok, so how do I make new libraries?22:05
clarkbdhellmann: cut a release22:05
lifelessharlowja: nor do for loops22:05
*** eglynn has quit IRC22:05
dhellmannclarkb: this code isn't ready for a formal release yet22:05
*** doude has quit IRC22:05
clarkbmordred: ^ did yo uconsider this in the wheels only for prerelease world?22:05
*** marcoemorais has quit IRC22:05
*** sweston has joined #openstack-infra22:05
mordredbodepd: the doc I was thinking of doesn't asnwer your question clearly ... but22:05
clarkbdhellmann: in the integration testing we test everything against git22:05
mordredbodepd: http://ci.openstack.org/zuul/launchers.html#zuul-gearman-protocol22:06
clarkbdhellmann: so I don't think it makes a difference for prereleases22:06
*** marcoemorais has joined #openstack-infra22:06
dhellmannclarkb: projects can't add oslo.db to their requirements list until it is in the global list, though22:06
mordredbodepd: http://ci.openstack.org/zuul/launchers.html#gearman-jenkins-plugin22:06
mordredbodepd: between the two of those, you should understand everything22:06
dhellmannclarkb: and if it isn't in the project list, then it won't be installed for devs running tests locally22:06
clarkbdhellmann: ok I think we haev two desired fighting each other and one will lose22:06
dhellmannclarkb: yeah22:06
*** nati_ueno has quit IRC22:06
clarkbbut I can't really speak to which one should lose. I lean towards doing a release if openstack should consume the bits22:07
clarkbdhellmann: releases are cheap22:07
sdagueyeh, agree with clarkb22:07
mordredclarkb: oh bother22:07
clarkbbreaking end user clouds is not22:07
lifelessconsuming without releases bad22:07
dhellmannsdague, clarkb : so no alpha releases of new projects?22:07
clarkbdhellmann: alphas are fine as we will integration test them in the gate22:07
mordredwait... grokking22:07
clarkbdhellmann: you just can't depend on an alpha22:07
dhellmannclarkb: but I can't release an alpha until I have a non alpha releases?22:08
*** nati_ueno has joined #openstack-infra22:08
mordreddhellmann: I think what you said before is correct22:08
clarkbyes I think you need to start with a proper release22:08
dhellmannmordred: which?22:08
mordreddhellmann: for a NEW project - just make a release22:08
mordredbecause the concern with alphas and olso is breaking deployed clouds22:08
* dhellmann bangs head on desk22:08
mordredsorry22:08
* mordred sucks22:08
harlowjalifeless understood, point taken for switch statements, sooo to work this, in the spec i think what u are saying is to not have a selector, but only a boolean gate (pass, or do not pass), the do not pass case can do the ignore stuff, otherwise it can just leave the nodes under the switch avaiable for scheduling, this allows for something like switch by just letting all the gates be 'open'22:08
mordredbut since oslo.db does not exist anywhere in the wile22:08
dhellmannno, no, I just thought we had all of this worked out and signed off22:08
mordredyeah. me too22:08
mordredwe did not consider this case, which is why I suck22:09
sdaguedhellmann: no, we had the old way22:09
dhellmannok, so we're back to < 1.0 releases until a 1.0 and then alphas *after* a 1.022:09
sdaguewhich became really problematic22:09
lifelessharlowja: right22:09
harlowjalifeless if thats a correct understanding, then i think it makes sense to me :)22:09
clarkbdhellmann: the numbers are arbitrary22:09
harlowjalifeless ok dokie, understand now22:09
dhellmannat some point, I'm just going to give up and start incrementing the major versions every time we do a release22:09
clarkbdhellmann: as long as you semver22:09
sdaguedhellmann: go for it :)22:09
harlowjalifeless will update soon, thx :)22:09
harlowjamakes much more sense now22:09
* dhellmann wonders if 0.1.0 is < 1.0.0.0a122:10
mordreddhellmann: I see nothing wrong with doing 0.x releases for oslo.db though (other than your current alpha tag)22:10
mordredit is22:10
bodepdmordred: thanks for the reference, that is exactly what I was looking for22:10
dhellmannmordred: ok, so we have to *delete* the existing releases from pypi and our mirror, remove those tags from the git repo so we can reuse them later, and then start tagging with 0.1.022:11
clarkbno do not delete any releases22:11
clarkbotherwise you will be like setuptools and people will cry22:11
mordredclarkb: I think it's probably fine in this case ... I'm guessing nobody has ever downloaded oslo.db yet22:11
lifelessyou have to roll forward with published artifacts22:12
*** jamielennox is now known as jamielennox|away22:12
lifelessmordred: ahahahahahaha. no.22:12
lifelessmordred: it'll be in plenty of tripleo mirrors22:12
lifelessmordred: bandersnatch.22:12
mordredoh, right. remember when I mentioned that we don't use that ...22:12
lifelessmordred: the special case is not special enough.22:12
lifelessmordred: infra don't, rest of the world is not infra.22:12
bodepdactually mordred what did you mean by label? do you mean that it needs to expose all of the jenkins build parameters?22:13
mordredlifeless: actually, bandersnatch will do the right thing22:13
mordredlifeless: it's required by mirrors that follow the mirror protocol that they honor deletes22:13
dhellmannI don't know what bandersnatch is, is that related to my question about removing those releases?22:13
clarkbdhellmann: yes, it is a pypi mirroring tool22:14
mordreddhellmann: we're having a religious debate real quick22:14
dhellmannok22:14
clarkbmordred: I feel it would be bad to yell at setuptools one day then do it ourselves today22:14
lifelessmordred: ok fair enough. will any other mirroring things be sure to do tht ?22:14
lifelessclarkb: I totally agree22:14
clarkbmordred: principles and leading by example yada yada yada22:14
mordredlifeless: if they don't, they are in violation of the pypi mirroring protocol22:14
mordredclarkb: we have deleted mistake releases before22:14
mordredsetuptools is actually different22:14
mordredsetuptools is, well, setuptools22:14
dhellmannclarkb: if I don't delete the existing alphas, and the project isn't a 1.0 yet, how do I ensure that 0.1.0 is used?22:15
mordredjudgement must be able to be used22:15
lifelessdhellmann: whats the highest alpha version released ?22:15
mordreddhellmann: how many minutes ago did you upload this/22:15
mordred?22:15
dhellmann1.0.0.0a2 I think22:15
*** smarcet has quit IRC22:15
dhellmanndays ago22:15
mordred 2014-06-1722:15
clarkbdhellmann: you release a 1.0.022:15
dhellmannno, today22:15
mordredthat's when pypi says you released it22:15
dhellmannclarkb: that is really really not a helpful answer22:15
mordredseriously guys. this is not a big deal22:15
clarkbdhellmann: why not? the number is mostly arbitrary anyways22:16
mordredwe ahve deleted mistake tags when they are this close to the time22:16
mordredoslo.db is a new project22:16
clarkbits the sequence of numbers that actually matters22:16
clarkbmordred: I won't stop you22:16
mordredit is NOT in use by ANYTHING22:16
dhellmannclarkb: not if we're doing semver, which we're trying to do22:16
mordredbecause it just got released22:16
clarkbmordred: but I don't think this is a problem22:16
clarkbdhellmann: then why are your alphas for 1.0.0?22:16
mordredI think dhellmann is trying to follow the instructions we gave him and there was a bug in them that we just discovered22:16
dhellmannI don't want this version packaged by the distros. Will they understand the distinction?22:16
mordredso I'd like to help him make the first release of this correctly22:16
dhellmannclarkb: because that's the version we will release at the end of juno22:17
clarkbdhellmann: if you put in in requirements you should assume it will be packaged22:17
lifelessclarkb: this is why pre-versioning is a headache22:17
clarkbdhellmann: can that be 2.0.0?22:17
mordredthis is the reason we developed oslo alphas22:17
mordredcan we not re-hash this entire thing?22:17
dhellmannthis is the reason I didn't want to do alphas22:17
mordredwe talked about it for a bout a year and a half22:17
clarkbmordred: sure like I said go ahead22:17
lifelessplease tell me most oslo libraries will do semver not pre-versioned releases ?22:17
lifelessok,clearly sore topic, I'll bow out.22:17
dhellmannlifeless: I don't know what you mean. Did you read my ML thread on what we plan to do?22:17
mordredGAAAHAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA22:18
*** CaptTofu_ has joined #openstack-infra22:18
dhellmannlifeless: http://lists.openstack.org/pipermail/openstack-dev/2014-June/037159.html22:18
mordreddhellmann: I'm not an owner of the pypi resource, but you are. if you delete it from pypi and push a tag delete, I'll go remove from mirrors22:19
mordredluckily, I wrote a script to do that when setuptools derped22:19
dhellmannmordred: I'm not sure I have permission to push a tag delete, but I can try22:19
mordredfor the record, I AM opposed to removing releases22:19
mordredit's just that this one does not seem like a real release that is likely to have been consumed by anyone22:20
dhellmannmordred: let me warn victors and roman, too22:20
mordredactually, it won't even be in our mirrors22:20
mordredbecause we can't get it into global-reqs :)22:20
dhellmanngood point, it never got that far22:20
clarkbmordred: correct, BUT its also not hard to deal with properly22:20
mordredclarkb: that is true - except for the fact that dhellman quite explicitly wants to communicate that this is not ready yet22:21
clarkbmordred: then we shouldn't depend on it22:21
mordredand that's teh 1.5 year discussion22:21
mordredof how we deal with oslo22:21
mordredthat I don't think we're just going to ninja change here in #infra in the middle of the afternoon22:22
clarkbI only put it in these terms because the requirements and mirror etc are doing their job22:22
mordredI know22:22
clarkbwhich is to prevent what you want to happe nfrom happening22:22
mordredthere is a very specificly different usecase for oslo22:22
mordredand the design of the system blocking this, while a thing that we _do_ want for pre-releases of upcoming things22:23
dhellmannmordred: if I push a tag "juno-a1" to gerrit, what's likely to happen? will it build a package, be ignored, break something?22:23
mordrednever accounted for initial releases of things not quite ready yet22:23
lifelessdhellmann: why do you want to release the libraries in sync with the servers?22:23
mordreddhellmann: uhm. we have no jobs taht will do anything for that22:23
clarkbdhellmann: it should be ignored as that tag doesn't match any of our *release regexes22:23
lifelessdhellmann: that will make it impossible to fix client libraries except every six months?22:23
dhellmannlifeless: I really don't have time to go through that with you right now. I would be happy to discuss it on the mailing list.22:24
dhellmannmordred: ok, good, I just don't want to lose what we have already tagged before I delete those bad tags.22:24
mordredlifeless: yeah. seriously. this is one of the most argued and rehashed topics in all of openstack22:24
*** maxbit_ has quit IRC22:24
mordredand believe me, I've argued the side that you're going to argue22:24
lifelessdhellmann: ok, I will reply to your thread22:24
*** maxbit has joined #openstack-infra22:24
mordredlifeless: please read ALL of the history on the topic22:24
*** sballe has quit IRC22:25
lifelessmordred: you just made it too hard22:26
*** jamielennox|away is now known as jamielennox22:26
lifelesslet me just say that I'm going to be a sad panda when novaclient etc use any oslo library.22:26
*** ramashri has joined #openstack-infra22:26
lifelessand leave it at that.22:26
dhellmannlifeless: stop being melodromatic and go reply to the mailing list thread22:27
*** sweston has quit IRC22:27
lifelessdhellmann: I now have conflicting requirements from you and mordred, 2 tripleo regions down and a tonne of stuff I *have* to do.22:27
lifelessdhellmann: I'll get back to this when I can; the implications seem to be well understood by mordred since he says he argues the point I have made above.22:28
lifelessdhellmann: and as already stated this is a long running plan, its not going to change overnight, and I wouldn't want to make it halt anyway22:28
dhellmannlifeless: I don't know about conflicting requirements.22:28
dhellmannmordred: apparently I don't know how to (or don't have permission to) delete tags in gerrit22:29
lifelessdhellmann: mordred says i have to read everything; you say you want me to just reply to the thread. Time-and-space boom.22:29
dhellmannI did: git push gerrit :refs/tags/1.0.0a122:29
dhellmannlifeless: markmc explains some of the history in the thread22:29
mordreddhellmann: and nothing?22:29
dhellmannlifeless: so you can do both22:29
dhellmannmordred: You need 'Push' rights with the 'Force Push'22:29
*** maxbit has quit IRC22:29
mordreddhellmann: great. if markmc has a  history in the thread, then taht should be sufficient22:29
mordreddhellmann: gotcha. one sec22:29
lifelessdhellmann: if thats sufficient for you, I have read through to markmc's nov 2012 post22:30
dhellmannlifeless: yeah, I think that covers it22:30
dstufftmordred: the mirroring protocol requires it, but theres no like penality for not doing it22:31
dstufftbut setuptools is probably a lot more used than some random alpha lib22:31
mordreddstufft: yah22:31
*** maxbit has joined #openstack-infra22:31
dhellmannthe only projects that should use oslo.db are openstack projects, and none of them can be using it because they can't include it in their requirements list yet22:32
mordreddhellmann: ok. tags deleted22:32
dhellmannmordred: thank you22:33
dhellmannok, now remind me what we said about verisoning? 0.1.0?22:33
dstufftnote: I have zero interest about arguing about oslo.db, just clarifying that although it's part of the spec there's no promises :)22:33
dstufftthe deletion that is22:33
dhellmanndstufft: thanks, I think that's ok22:34
mordreddhellmann: yeah. 0.1.0 seems safe for this use case22:34
mordreddhellmann: I'm sure we'll figure out some other reason why it's not tomorrow22:34
dhellmannmordred: ok, I'm going to retag those juno tags as 0.1.0 and 0.2.0 then22:34
dstufft(interesting enough, in the futur there will actually be promises, since mirrors will need to refresh themselves regularly with signed by PyPI metadata that they can't modify)22:34
mordreddstufft: awesome22:35
mordreddstufft: actually, I'm going to argue with you about oslo.db whether you want to or not22:35
mordredbecause apparently that's who I am today22:35
clarkbmordred: if you end up having time I am curious to hear how you plan to do the puppet in dib stuff (or I guess you could use that time to write the patch)22:36
dstufftmordred: lol22:36
*** JoshNang has joined #openstack-infra22:37
mordredclarkb: well, step one to prove the concept at all I'm going to re-enable the service scripts in post-install and then run the puppet stuff that does the db22:37
mordredclarkb: and I'm going to have that stuff not just do the permissions - but do the install too (otherwise we don't get root users)22:37
*** sweston has joined #openstack-infra22:37
clarkbok22:38
mordredclarkb: if that works, then I'm going to do something _similar_ to the flags we had in there already22:38
bodepdmordred: I was thinking about that problem. Would it make sense to boot images for service level stuff and use snapshots?22:38
mordredto control the listen parameter22:38
clarkbmordred: if you go that route you will want to try dumping the flag for no network into mysql.conf.d22:38
mordredbodepd: no, that's the system we're trying to get away from22:38
clarkbmordred: and whatever the postgres equivalent is. SO that we can run concurrent builds22:38
*** thedodd has quit IRC22:38
mordredclarkb: yes22:38
mordredclarkb: that's step 222:38
openstackgerritIan Wienand proposed a change to openstack-infra/nodepool: Add @localhost to openstack_citest user example  https://review.openstack.org/10071222:38
*** gondoi is now known as zz_gondoi22:39
openstackgerritIan Wienand proposed a change to openstack-infra/nodepool: Add @localhost to openstack_citest user example  https://review.openstack.org/10071222:41
*** sweston has quit IRC22:42
lifelessdhellmann: I hope my mail isn't inflammatory22:42
bodepdsomeone mind having a look at this log: https://gist.github.com/bodepd/0101cd092d9f51005afb22:43
lifelessdhellmann: the snippy here (environmental, not pointing fingers) was a bit contagious.22:43
bodepdI'm missing the bread-crumb trail from gearman to jenkins22:43
dhellmannlifeless: yeah, it's the end of a long day and this is not what I wanted to be doing -- sorry22:43
*** nati_ueno has quit IRC22:44
lifelessdhellmann: I believe I see genuine issues, and hopefully have expressed them without too much editorial or presuming the answer22:44
*** nati_ueno has joined #openstack-infra22:44
lifelessdhellmann: I'm now going to context switch and ignore this until it pops up into my face again somehow :)22:44
dhellmannlifeless: I'm currently waiting for SMTP to do its thing with your message, but I'll read it before I follow-up about the new plan I wrote in https://wiki.openstack.org/wiki/Oslo/VersioningPolicy#A_Version_Numbering_Scheme22:45
lifelessdhellmann: I have no issue with the issueing of alphas etc, in fact I entirely support that. Its just the interaction with requirements files of other projects, regardless of their release schedule, that concerns me.22:45
lifelessdhellmann: One thing I didn't put in there, but possibly should have, is that IMO its a bug to have something in requirements that isn't on regular pip.22:46
lifeless(specific version of, I mean)22:46
dhellmannlifeless: no one will ever adopt an oslo library if it is not being tested against the application, and we can't do that unless it's in the requirements list22:46
lifelessthat is AIUI compatible with doing alpha releases22:46
dhellmannthe use of alphas is meant to protect CD environments from seeing things that aren't fully baked, but that we're trying to integration test with the rest of a release22:47
dhellmannwhich I think is what you're saying is good?22:47
lifelessdhellmann: the thing about CD environments is they treat 'trunk of nova' as a release.22:47
dhellmannlifeless: yes, well, they'll have a wheel of the alpha that worked with that version of nova that they can use22:48
lifelessdhellmann: so they will have to drag in the alpha to their environment if nova depends on the alpha22:48
lifelessdhellmann: anyhow, you have things to do; lets follow up on mail22:48
dhellmannok22:48
lifelessdhellmann: so you can do the thing you want to do, today :)22:48
* dhellmann looks for his bottle of bourbon22:49
*** jgrimm has quit IRC22:52
*** markmcclain has quit IRC22:52
*** flaviof is now known as flaviof_zzz22:53
*** plars has joined #openstack-infra22:58
*** mbacchi has quit IRC23:00
*** markmcclain has joined #openstack-infra23:00
*** crc32 has quit IRC23:00
*** sweston has joined #openstack-infra23:01
*** dizquierdo has quit IRC23:03
*** rm_work is now known as rm_work|away23:04
*** sabeen has quit IRC23:05
mattoliverauMorning23:06
*** mbacchi has joined #openstack-infra23:06
*** virmitio has quit IRC23:06
*** mestery has quit IRC23:06
*** wenlock_ has quit IRC23:08
*** yamahata has joined #openstack-infra23:09
*** gokrokve has quit IRC23:09
*** lcheng has quit IRC23:11
dhellmannwhat does it mean when zuul reports that something in the gate is "skipped"?23:14
*** markmcclain has quit IRC23:14
Alex_Gaynor dhellmann possible taht's what it does in the event of a merge conflict?23:15
dhellmannspecifically, oslo.i18n 99054,223:15
clarkbdhellmann: if you hover your mouse over the colored balls you get the reason23:15
dhellmannclarkb: cool, thanks, I didn't know about that23:16
dhellmannAlex_Gaynor: that's exactly it23:16
jheskethMorning23:16
* dhellmann waits for zull to merge what it will before rebasing23:16
*** nati_ueno has quit IRC23:18
sdaguedhellmann: if the ball is black, is a merge commit23:21
sdagueI figured that was better than showing it as a fail23:21
*** lcheng has joined #openstack-infra23:23
dhellmannsdague: yeah, I just hadn't seen that one before23:23
sdagueclean check definitely reduced the amount we see it23:23
sdaguebut mass approves will trigger it23:23
sdaguehonestly, I'd rebase it on top of whatever is in front of it in the gate23:24
sdaguethen once that merges you'll be back on master23:24
sdagueand you'll have check results back23:24
*** zzelle has quit IRC23:25
sdaguejogo: it's a 100+ merge day23:25
sdaguewe should have a bell that goes off after 100 merges in a day :)23:25
jogosdague:  hehe yeah23:26
jogosdague: its hard keeping the pipelines full of work23:26
jogowe should be able to hit 110 by the end of the UTC day23:26
*** CaptTofu_ has quit IRC23:27
*** nati_ueno has joined #openstack-infra23:29
openstackgerritAdam Gandelman proposed a change to openstack-infra/devstack-gate: Archive Ironic VM nodes console logs  https://review.openstack.org/9221623:34
*** atiwari has quit IRC23:35
*** nati_ueno has quit IRC23:35
*** nati_ueno has joined #openstack-infra23:35
lifelessjhesketh: do you twitter?23:39
*** unicell has joined #openstack-infra23:42
*** gokrokve has joined #openstack-infra23:43
*** jerryz has quit IRC23:44
*** hogepodge has quit IRC23:49
*** adalbas has quit IRC23:55
*** dangers is now known as dangers_away23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!