Saturday, 2014-05-10

*** praneshp has joined #openstack-infra00:00
SlickNikclarkb: Gotcha. Thanks!00:01
cody-somervilleHey. I thought this was a cool blog post that might interest folks here: http://nvie.com/posts/better-package-management/00:04
*** freyes_ has joined #openstack-infra00:06
clarkbcody-somerville: neat. pip compile does something very similar to our pypi mirror00:06
fungianteaya: i keep a rain hat with me so i can see where i'm going. otherwise it's hawaiian shirts, shorts and sandals in that weather00:07
clarkbI love `pip sync` "we haven't actually written this yet" also pip uninstall is derpy00:08
fungiif i were water-soluble i'd have melted away long ago00:08
anteayafungi: :D00:08
clarkbI wonder if we can replace a lot of the work that pypi mirror does with pip compile though00:08
clarkbalso waterproof bag00:09
clarkbI don't buy anything else anymore00:09
anteayawell it is my sandals I am concerned about, and yeah I don't have a waterproof bag00:09
anteayaand a raincoat won't protect either one00:09
*** hemna is now known as hemnafk00:09
anteayaI'll take a plastic bag to put my laptop in00:10
fungiyeah, my pack is water-shedding, and i have a duck cover for the large pack00:10
fungiin case i need to hike through a waterfall or something ;)00:10
anteayahandy00:10
anteayamy bag protects my stuff from snow?00:11
fungibut i also learned long ago that you subdivide your luggage contents into multiple water-tight bags too00:11
clarkbalchemy goods and black star bags make waterproof bags right here in the pacific NW00:11
anteayaclarkb: I saw some of those00:11
anteayaI wanted one of those00:11
anteayaI didn't get one of those00:12
fungiclarkb: which pip release? i don't see a compile subcommand in 1.5.500:12
clarkbfungi: it hasn't been released yet00:12
clarkbfungi: its talked about in the blog cody-somerville linked00:12
fungioh, cool. i should read more often00:13
clarkbfungi: oh and its in the pip tools repo00:14
clarkbI thought it was part of pip itself00:15
clarkbin any case pip-compile definitely looks useful00:15
*** shardy has joined #openstack-infra00:15
*** shardy has quit IRC00:15
*** adarazs has joined #openstack-infra00:16
*** flaper87|afk has joined #openstack-infra00:17
openstackgerritMaru Newby proposed a change to openstack-infra/config: Allow the neutron functional job to gate merges  https://review.openstack.org/9316100:17
*** flaper87|afk is now known as flaper8700:18
*** UtahDave has quit IRC00:18
*** shardy has joined #openstack-infra00:20
marun^ clarkb, jeblair, fungi: comments welcome, I haven't made a job gating before.00:20
marun…and am confused by the jenkins failure :/00:21
maruner, got it.  didn't define the new job00:22
anteayaJob gate-neutron-dsvm-functional not defined00:22
anteayayeah00:22
anteayamarun: start looking around in here: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config00:24
*** flashgordon is now known as jogo00:24
*** qs201 has joined #openstack-infra00:24
openstackgerritMaru Newby proposed a change to openstack-infra/config: Allow the neutron functional job to gate merges  https://review.openstack.org/9316100:26
marunanteaya: got it, thanks00:26
anteayanp00:26
marunthankfully I can just copy what swift does.00:26
*** adam_g is now known as adam_gone00:27
marunanteaya: out of curiosity, how do the regular nodes differ from the check nodes?00:27
*** unicell has joined #openstack-infra00:28
anteayaI don't think check nodes are any different from other nodes00:29
anteayathe check pipeline jobs run on them00:29
anteayaoh, and gate has priority over check00:29
fungimarun: right now they don't really differ substantially, but we've used that to shift check jobs to lesser-performing providers when we need the better-performing nodes only for the gate00:29
anteayamaybe that is it00:29
anteayaah, okay there it is, priority00:30
marunah, ok.00:30
marunfungi: thanks for the clarification00:30
fungiallows us to keep check jobs off of better-performing nodes which might help clear long gates a little faster00:30
fungithough i suspect we'll clean that up once we have a couple more providers00:31
marunstill hp and rackspace?00:31
anteayado we have any more offers of hosting?00:31
anteayaso far, yes00:31
anteayathough redhat does host tripleo jobs00:31
nibalizerkrotscheck: around?00:31
clarkbgranted we run 30GB 8vcpu nodes in one az in order to get the same performance of 8GB 4vcpu nodes in other az00:32
marunweird.  30gb in terms of memory?00:33
clarkbyes00:33
marunhow does that speed things up?  caching?00:33
clarkbthe memory isn't the issue though. the cpus are. we need twice as many to keep up and those come in a 30gb flavor00:33
clarkbwhich we hobble to 8gb in order to prevent needing 30gb for some reason00:34
cody-somervilleThe reason is because one az allows instances to use more cpu time then they're suppose to while the other does not.00:34
clarkbcody-somerville: well00:34
marunah, ok.  no standard for vcpu performance00:34
clarkbcody-somerville: more like one explicitly uses less than the other00:34
clarkbnot that any are using more than they are supposed to00:34
cody-somervilleIf we're talking about HP Cloud, one AZ allows instances allow CPU to burst if there is free cycles whereas the other explicitly limits the instances to what they're rated for.00:35
clarkbright00:36
clarkbthe one that allows bursting isn't using more than it should00:36
clarkbthey explicitly allow that00:36
fungii guess it depends on how you define "should"00:36
clarkbfwiw if those cycles are free I think it is great that I can use them :)00:37
cody-somervilleIf we're going to be specific, it's not that they explicitly allow that in one az, it is really that they explicitly _don't_ allow it in the new az ;)00:37
*** sandywalsh has quit IRC00:37
clarkband incredibly frustrating that I can't use free cycles in the other az00:37
*** qs201 has quit IRC00:38
cody-somervilleI agree with that. Though it makes sense. HP wanted to be honest about what people were getting and for it to be consistent.00:38
*** yamahata has quit IRC00:38
*** sandywalsh has joined #openstack-infra00:39
*** aconrad_ has quit IRC00:39
*** aconrad has quit IRC00:39
*** pcrews has quit IRC00:39
*** Longgeek has joined #openstack-infra00:40
*** e0ne has quit IRC00:42
*** e0ne has joined #openstack-infra00:43
openstackgerritJoshua Harlow proposed a change to openstack/requirements: Zake 0.0.17 released  https://review.openstack.org/9315600:45
*** pcrews has joined #openstack-infra00:45
zarofungi: i've reviewed 9312900:46
zarocody-somerville: been trying to work with james but he hasn't been very active in hipchat.00:47
fungizaro: thanks. i think it's probably safe to approve then. i'll ram it through00:49
fungisince Ajaeger indicated it was blocking docs jobs00:50
*** pcrews has quit IRC00:51
*** hdd has quit IRC00:51
*** Sukhdev has quit IRC00:52
openstackgerritA change was merged to openstack-infra/config: Inject gerrit-doc.properties for gate-{name}-tox-doc-publish-{envlist}  https://review.openstack.org/9312900:53
*** gokrokve has joined #openstack-infra00:53
*** gokrokve_ has joined #openstack-infra00:53
*** Sukhdev has joined #openstack-infra00:55
cody-somervillezaro: I appreciate that. I'll follow up.00:56
openstackgerritA change was merged to openstack-infra/devstack-gate: Add zeromq config  https://review.openstack.org/9303000:56
*** gokrokve has quit IRC00:57
*** arnaud has quit IRC00:58
*** freyes_ has quit IRC00:58
*** ArxCruz has quit IRC00:59
*** marcoemorais has quit IRC01:01
*** yamahata has joined #openstack-infra01:01
*** Sukhdev has quit IRC01:02
*** yamahata__ has joined #openstack-infra01:03
*** e0ne has quit IRC01:03
*** yamahata has quit IRC01:03
*** e0ne has joined #openstack-infra01:04
openstackgerritJoshua Harlow proposed a change to openstack/requirements: Zake 0.0.18 released  https://review.openstack.org/9315601:05
*** gokrokve_ has quit IRC01:07
*** yamahata__ has quit IRC01:07
*** gokrokve has joined #openstack-infra01:10
*** gokrokve has quit IRC01:12
*** michchap has quit IRC01:13
*** saschpe has quit IRC01:17
*** saschpe has joined #openstack-infra01:22
*** praneshp has quit IRC01:30
*** msabramo1 has quit IRC01:30
*** mburned is now known as mburned_out01:34
*** e0ne has quit IRC01:43
*** jamespage_ has joined #openstack-infra01:43
*** e0ne has joined #openstack-infra01:43
*** dstanek is now known as dstanek_zzz01:44
*** morganfainberg is now known as morganfainberg_Z01:50
*** rwsu has quit IRC01:53
*** thomasem has joined #openstack-infra02:00
*** mriedem has quit IRC02:00
*** thomasem has quit IRC02:00
*** dstanek_zzz is now known as dstanek02:05
*** aconrad has joined #openstack-infra02:09
*** aconrad_ has joined #openstack-infra02:09
*** praneshp has joined #openstack-infra02:10
*** jasondotstar has joined #openstack-infra02:10
*** zhiyan_ is now known as zhiyan02:13
*** dstanek is now known as dstanek_zzz02:15
*** SumitNaiksatam has joined #openstack-infra02:16
*** aconrad has quit IRC02:20
*** e0ne has quit IRC02:20
*** aconrad_ has quit IRC02:20
*** e0ne has joined #openstack-infra02:21
*** yamahata has joined #openstack-infra02:24
*** dstanek_zzz is now known as dstanek02:45
*** zhiyan is now known as zhiyan_02:49
*** jamespage_ has quit IRC02:49
*** Longgeek has quit IRC02:52
*** unicell has quit IRC02:54
*** Longgeek has joined #openstack-infra03:04
openstackgerritSpencer Krum proposed a change to openstack-infra/config: Logstash: Modifying rewrite rules to allow kibana 3  https://review.openstack.org/9316703:07
*** Sukhdev has joined #openstack-infra03:07
*** dstanek is now known as dstanek_zzz03:08
*** dstanek_zzz is now known as dstanek03:10
*** ivar-lazzaro has quit IRC03:12
*** matsuhashi has joined #openstack-infra03:16
*** dstanek is now known as dstanek_zzz03:19
*** dstanek_zzz is now known as dstanek03:23
*** gyee has quit IRC03:25
*** matsuhashi has quit IRC03:27
*** matsuhashi has joined #openstack-infra03:27
*** matsuhashi has quit IRC03:32
*** dstanek is now known as dstanek_zzz03:33
*** e0ne has quit IRC03:33
*** e0ne has joined #openstack-infra03:34
*** matsuhashi has joined #openstack-infra03:38
*** praneshp_ has joined #openstack-infra03:45
*** praneshp has quit IRC03:45
*** praneshp_ is now known as praneshp03:45
*** aconrad_ has joined #openstack-infra03:46
*** aconrad has joined #openstack-infra03:48
*** e0ne has quit IRC04:03
*** e0ne has joined #openstack-infra04:03
*** matsuhashi has quit IRC04:12
*** e0ne has quit IRC04:12
*** e0ne has joined #openstack-infra04:13
*** jcoufal has joined #openstack-infra04:17
*** jasondotstar has quit IRC04:17
*** otherwiseguy has joined #openstack-infra04:18
*** aconrad has quit IRC04:22
*** aconrad_ has quit IRC04:22
*** otherwiseguy has quit IRC04:22
*** harlowja has quit IRC04:26
*** matsuhashi has joined #openstack-infra04:31
*** e0ne has quit IRC04:47
*** e0ne has joined #openstack-infra04:48
*** msabramo has joined #openstack-infra04:50
*** Longgeek_ has joined #openstack-infra04:53
*** moted has quit IRC04:55
*** Longgeek has quit IRC04:56
*** notmyname has quit IRC04:59
*** notmyname has joined #openstack-infra05:05
*** Sukhdev has quit IRC05:07
*** jcoufal has quit IRC05:11
*** matsuhashi has quit IRC05:17
*** e0ne has quit IRC05:17
*** e0ne has joined #openstack-infra05:18
*** markwash has joined #openstack-infra05:24
*** markwash has quit IRC05:26
*** wenlock has joined #openstack-infra05:33
*** e0ne has quit IRC05:39
*** e0ne has joined #openstack-infra05:39
*** markwash has joined #openstack-infra05:40
*** markwash has quit IRC05:45
*** Longgeek_ has quit IRC05:45
*** Longgeek has joined #openstack-infra05:48
*** marun is now known as maru_afk05:49
*** Longgeek has quit IRC05:49
*** dkehn_ has joined #openstack-infra05:50
*** matsuhashi has joined #openstack-infra05:50
*** Longgeek has joined #openstack-infra05:53
*** dkehnx has quit IRC05:54
*** e0ne has quit IRC06:02
*** e0ne has joined #openstack-infra06:03
*** wenlock has quit IRC06:03
*** matsuhashi has quit IRC06:03
*** geertj has joined #openstack-infra06:14
*** otherwiseguy has joined #openstack-infra06:20
*** otherwiseguy has quit IRC06:24
*** _nadya_ has joined #openstack-infra06:34
*** e0ne has quit IRC06:42
*** _nadya_ has quit IRC06:45
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Revert "Inject gerrit-doc.properties for gate-{name}-tox-doc-publish-{envlist}"  https://review.openstack.org/9317606:54
*** Ajaeger has joined #openstack-infra06:55
AjaegerHi, any core still around?06:55
*** yamahata has quit IRC06:56
Ajaegerfungi, zaro, SergeyLukjanov, clarkb, jeblair : 93129 breaks the gate jobs completely, I'm sorry ;( I've reverted it: https://review.openstack.org/#/c/93176/ could I get an approval, please?06:58
*** matsuhashi has joined #openstack-infra07:04
clarkbAjaeger: done07:06
clarkbalso I'm not actually here. this is an illusion. :) good night07:06
Ajaegerclarkb: Thanks a lot!07:08
Ajaegergood night07:08
openstackgerritA change was merged to openstack-infra/config: Revert "Inject gerrit-doc.properties for gate-{name}-tox-doc-publish-{envlist}"  https://review.openstack.org/9317607:09
*** maxbit has quit IRC07:11
*** _nadya_ has joined #openstack-infra07:27
*** salv-orlando_ has joined #openstack-infra07:32
*** andreykurilin_ has joined #openstack-infra07:34
*** kmartin has joined #openstack-infra07:34
*** tnurlygayanov has quit IRC07:36
*** bnemec has joined #openstack-infra07:37
*** sabari` has joined #openstack-infra07:40
*** salv-orlando has quit IRC07:41
*** salv-orlando_ is now known as salv-orlando07:41
*** matsuhashi has quit IRC07:42
*** KurtMartin has quit IRC07:45
*** russell_h has quit IRC07:45
*** salv-orlando has quit IRC07:46
*** beekneemech has quit IRC07:47
*** sabari has quit IRC07:47
*** russell_h has joined #openstack-infra07:47
*** che-arne has joined #openstack-infra08:04
*** maxbit has joined #openstack-infra08:09
*** salv-orlando has joined #openstack-infra08:12
*** geertj has quit IRC08:18
*** cyeoh has quit IRC08:18
*** exz has quit IRC08:18
*** mancdaz has quit IRC08:18
*** johnthetubaguy has quit IRC08:18
*** _nadya_ has quit IRC08:22
*** salv-orlando has quit IRC08:27
*** geertj has joined #openstack-infra08:29
*** cyeoh has joined #openstack-infra08:29
*** exz has joined #openstack-infra08:29
*** mancdaz has joined #openstack-infra08:29
*** johnthetubaguy has joined #openstack-infra08:29
*** Ajaeger has quit IRC08:36
*** salv-orlando has joined #openstack-infra08:40
*** _nadya_ has joined #openstack-infra08:58
*** _nadya_ has quit IRC09:02
*** _nadya_ has joined #openstack-infra09:02
*** che-arne has quit IRC09:09
*** che-arne has joined #openstack-infra09:10
*** geertj has quit IRC09:25
*** cyeoh has quit IRC09:25
*** exz has quit IRC09:25
*** mancdaz has quit IRC09:25
*** johnthetubaguy has quit IRC09:25
*** geertj has joined #openstack-infra09:36
*** cyeoh has joined #openstack-infra09:36
*** exz has joined #openstack-infra09:36
*** mancdaz has joined #openstack-infra09:36
*** johnthetubaguy has joined #openstack-infra09:36
*** Longgeek has quit IRC09:45
*** Longgeek has joined #openstack-infra09:47
*** azneita has joined #openstack-infra09:47
*** yamahata has joined #openstack-infra09:51
*** yamahata has quit IRC09:52
*** yamahata has joined #openstack-infra09:52
*** praneshp has quit IRC09:54
*** azneita has quit IRC09:57
*** _nadya_ has quit IRC10:04
*** azneita has joined #openstack-infra10:15
*** azneita has quit IRC10:22
*** azneita has joined #openstack-infra10:25
*** _nadya_ has joined #openstack-infra10:33
*** azneita has quit IRC10:35
*** Longgeek has quit IRC10:37
*** dstanek_zzz is now known as dstanek10:52
*** geertj has quit IRC10:54
*** cyeoh has quit IRC10:54
*** exz has quit IRC10:54
*** mancdaz has quit IRC10:54
*** johnthetubaguy has quit IRC10:54
*** che-arne_afk has joined #openstack-infra11:03
*** geertj has joined #openstack-infra11:05
*** cyeoh has joined #openstack-infra11:05
*** exz has joined #openstack-infra11:05
*** mancdaz has joined #openstack-infra11:05
*** johnthetubaguy has joined #openstack-infra11:05
*** geertj has quit IRC11:05
*** che-arne has quit IRC11:06
*** _nadya_ has quit IRC11:07
*** che-arne_afk has quit IRC11:12
*** _nadya_ has joined #openstack-infra11:19
*** dstanek is now known as dstanek_zzz11:26
*** _nadya_ has quit IRC11:30
*** Longgeek has joined #openstack-infra11:38
*** Longgeek has quit IRC11:43
*** azneita has joined #openstack-infra11:52
*** lcostantino has joined #openstack-infra11:57
*** lcostantino has quit IRC12:08
*** Longgeek has joined #openstack-infra12:09
*** lcostantino has joined #openstack-infra12:30
*** Longgeek has quit IRC12:47
*** _nadya_ has joined #openstack-infra12:49
*** mriedem has joined #openstack-infra12:51
*** Longgeek has joined #openstack-infra12:59
*** geertj has joined #openstack-infra13:05
*** _nadya_ has quit IRC13:12
*** jasondotstar has joined #openstack-infra13:19
*** maxbit has quit IRC13:26
*** azneita has quit IRC13:27
*** lcostantino has quit IRC13:31
*** Mithrandir has quit IRC13:43
*** Mithrandir has joined #openstack-infra13:45
*** rfolco has joined #openstack-infra13:54
*** andreykurilin_ has quit IRC14:04
*** andreykurilin_ has joined #openstack-infra14:04
*** dkranz has quit IRC14:30
*** dkranz has joined #openstack-infra14:31
*** dims has joined #openstack-infra14:37
*** dkranz has quit IRC14:42
*** dkranz has joined #openstack-infra14:43
sdagueanyone happen to be on or on a plane to push this through - https://review.openstack.org/#/c/93123/ ?14:54
*** gokrokve has joined #openstack-infra15:10
*** rcarrill` is now known as rcarrillocruz15:11
anteayasdague: I +1'd15:19
sdaguethanks15:19
anteayanp15:20
*** gokrokve has quit IRC15:22
*** gokrokve has joined #openstack-infra15:22
* fungi is not yet on a plane, looking15:23
*** reed has joined #openstack-infra15:31
anteayareed: how goes upstream university?15:32
reedanteaya, at full speed, pretty awesome, thanks :)15:32
reedwe're in the classroom now, I wanted to check if IRC ports were available :)15:33
reedand they are indeed15:33
anteayareed: yay15:34
anteayaglad it is going well15:34
*** russell_h has quit IRC15:35
*** russell_h has joined #openstack-infra15:35
*** cody-somerville has quit IRC15:38
*** andreykurilin_ has quit IRC15:43
*** Longgeek has quit IRC15:43
*** dizquierdo has joined #openstack-infra15:46
*** dims has quit IRC15:57
*** otherwiseguy has joined #openstack-infra16:05
*** toddmorey has quit IRC16:06
*** otherwiseguy has quit IRC16:10
*** superdan is now known as dansmith16:12
*** dizquierdo has quit IRC16:17
*** andreykurilin_ has joined #openstack-infra16:18
*** zns has joined #openstack-infra16:25
*** geertj has quit IRC16:26
*** cyeoh has quit IRC16:26
*** exz has quit IRC16:26
*** mancdaz has quit IRC16:26
*** johnthetubaguy has quit IRC16:26
openstackgerritA change was merged to openstack-infra/devstack-gate: remove libvirt work around  https://review.openstack.org/9312316:33
*** pcrews has joined #openstack-infra16:36
*** geertj has joined #openstack-infra16:38
*** cyeoh has joined #openstack-infra16:38
*** exz has joined #openstack-infra16:38
*** mancdaz has joined #openstack-infra16:38
*** johnthetubaguy has joined #openstack-infra16:38
*** yamahata has quit IRC16:39
*** gokrokve has quit IRC16:40
*** blamar has quit IRC16:42
*** blamar has joined #openstack-infra16:55
*** _nadya_ has joined #openstack-infra16:56
fungisdague: ^16:56
* fungi is leavin' on a jet plane. don't know when he'll be back again16:57
*** blamar_ has joined #openstack-infra16:57
*** blamar has quit IRC17:00
*** blamar_ is now known as blamar17:00
*** _nadya_ has quit IRC17:18
*** sandywalsh has quit IRC17:23
*** sandywalsh has joined #openstack-infra17:23
*** _nadya_ has joined #openstack-infra17:26
*** dkranz has quit IRC17:31
*** dkranz has joined #openstack-infra17:31
*** sarob has joined #openstack-infra17:34
*** sarob has quit IRC17:35
*** sarob has joined #openstack-infra17:35
*** dkranz has quit IRC17:37
*** dkranz has joined #openstack-infra17:37
*** toddmorey has joined #openstack-infra17:38
*** sandywalsh_ has joined #openstack-infra17:42
*** jasondotstar has quit IRC17:42
*** jerryz has joined #openstack-infra17:44
*** sandywalsh has quit IRC17:45
*** jasondotstar has joined #openstack-infra17:48
*** changbl has quit IRC17:51
*** sarob has quit IRC17:53
*** fifieldt has joined #openstack-infra17:55
*** geertj has quit IRC18:04
*** andreykurilin_ has quit IRC18:06
*** otherwiseguy has joined #openstack-infra18:07
*** _nadya_ has quit IRC18:11
*** otherwiseguy has quit IRC18:11
*** zns has quit IRC18:24
*** toddmorey has quit IRC18:25
*** vishy has quit IRC18:28
*** vishy has joined #openstack-infra18:29
*** jaypipes has joined #openstack-infra18:30
*** zns has joined #openstack-infra18:32
reedfungi, yt?18:35
*** rickerc has joined #openstack-infra18:38
*** dkranz has quit IRC18:38
*** dkranz has joined #openstack-infra18:39
*** _nadya_ has joined #openstack-infra18:41
clarkbreed: I think he is doing that travel thing18:45
reedclarkb, and you're not? :)18:46
reedhttps://bugs.launchpad.net/openstack-org/+bug/1317957 reappeared18:46
uvirtbotLaunchpad bug 1317957 in openstack-org "Server error when updating contacts" [Critical,Confirmed]18:46
reedclarkb, not sure you can help though18:46
*** dkranz has quit IRC18:46
clarkbreed: I don't fly out until tomorrow18:46
*** dkranz has joined #openstack-infra18:47
clarkbreed: you need todd18:47
clarkbI don't think fungi can do anything to fix it either18:47
clarkbI am going to reproduce now if I can though18:48
reedyeah, pinged todd and tipit too18:48
reedit is produced regularly here at the upstream training session :(18:49
clarkbyup reproduced18:49
clarkbreed: my suggestion in the future would be to not make major changes the week before the summit that would impact summit participation :)18:49
clarkbbut ya I don't think there is much we can do here other than disabling the check18:50
reedclarkb, yeah... there is a big disconnect between infra and .org18:50
clarkbfungi indicated that would require a gerrit restart18:50
reedwhat?18:50
clarkbreed: we can disable the check when signing CLAs18:50
reedwait, let me understand18:50
reedwhat would require a gerrit restart?18:51
clarkbdisabling the CLA check18:51
clarkber sorry not the CLA check. The CLA signing check that does the contact info handshake18:51
reedi still don't understand...18:52
reedI thought I did :)18:52
reedwait, I have the tipit folks responding18:52
reedbbl18:52
clarkbthe way this works is you fill out a CLA thing with contact info in gerrit. It posts that contact info to a foundation server. If the foundation server returns and HTTP 200 gerrit thinks you are good18:52
clarkbif the foundation server returns anything else gerrit treats the CLA signing as a failure18:52
clarkbit is setup this way to correlate individuals signing the CLA to their foundation membership18:53
clarkbwe can disable that18:53
clarkbbut doing so requires a gerrit restart18:53
clarkbor you know we could just make the service work again18:53
reedok, now it's clearer18:55
reedclarkb, do you have a set of IP that make the request from our gerrit to .org?18:55
reeddo these IP change a lot?18:56
reedmaybe not all of these IPs were whitelisted yesterday?18:56
*** cyeoh has quit IRC18:56
*** exz has quit IRC18:56
*** mancdaz has quit IRC18:56
*** johnthetubaguy has quit IRC18:56
clarkbthere are two IPs, one ipv4 and one ipv6. They haev changed twice in the last two years18:57
clarkbonce almost 2 weeks ago and again in november after the san diego summit18:57
reedso maybe it's not an issue of whitelisting19:02
* reed doesn't believe in CDN :)19:02
clarkbCDN is fine, it should've been communicate to us so we could possibly test things with review-dev and done after the summit19:03
clarkbor far enough ahead of the summit not to cause a panic now19:03
* reed adds another line in his personal religion, next to 'wikis are useless, CDN are bad'19:03
*** zns has quit IRC19:03
reedclarkb, which ip is making the calls to openstack.org?19:06
clarkbreview.openstack.org19:06
reedno roundrobin ip? always those two?19:07
clarkbyes19:07
reedjust triple checking...19:07
*** cyeoh has joined #openstack-infra19:07
*** exz has joined #openstack-infra19:07
*** mancdaz has joined #openstack-infra19:07
*** johnthetubaguy has joined #openstack-infra19:07
clarkbgerrit doesn't do HA really19:07
reedi'm reading the conversation about the CLA on tc and discussing this issue with tipit19:08
reedsurreal19:08
reed:)19:08
*** gokrokve has joined #openstack-infra19:08
*** wenlock has joined #openstack-infra19:10
*** wenlock has quit IRC19:13
*** markmcclain has joined #openstack-infra19:18
*** markmcclain has quit IRC19:18
*** mrodden has joined #openstack-infra19:19
*** dkranz has quit IRC19:20
*** cyeoh has quit IRC19:21
*** exz has quit IRC19:21
*** mancdaz has quit IRC19:21
*** johnthetubaguy has quit IRC19:21
*** rcarrill` has joined #openstack-infra19:26
*** rcarrillocruz has quit IRC19:27
*** gokrokve has quit IRC19:29
*** cyeoh has joined #openstack-infra19:32
*** exz has joined #openstack-infra19:32
*** mancdaz has joined #openstack-infra19:32
*** johnthetubaguy has joined #openstack-infra19:32
reedclarkb, can you modify hosts file on review.openstack.org?19:33
clarkbreed: I can but really shouldn't19:34
reedJP from tipit tells me that calling the IP address directly, that would bypass cloudflare19:34
reedand eventually make the error disappear19:34
*** yfried has quit IRC19:34
*** yfried has joined #openstack-infra19:34
clarkbreed: yall can propose a change to https://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/manifests/review.pp#n11419:35
clarkbit will require a gerrit restart19:35
reedam I right assuming that a) gerrit restart is (at least moderately) painful and b) approval of that patch will take more than 30 minutes?19:37
*** e0ne has joined #openstack-infra19:38
clarkbgerrit restart isn't too painful. just pointing out it needs doing and would be nice to not have to do it when I am the only one around19:38
clarkbwhich ties into b19:38
clarkbwould be good to get a second opinion19:38
reedeheheh19:38
clarkbwhy can't they just make cloudflare not hate review.o.o?19:38
clarkbit seems to have aowrked for a few hours19:38
reedclarkb, I have the impression that cloudflare is not well known at the moment and the experts are in flight19:39
mnaseri know cloudflare quite well, if i can help out in anyway :\19:39
reedi guess I'll have to live with this for today19:40
reedmnaser, I have no access to that account19:40
reedmnaser, thanks for offering though19:40
mnaserif i may ask, what exactly is running cloudflare?19:40
*** rcarrill` has quit IRC19:41
reedmnaser, i don't even know for sure... i think it's in front of openstack.org19:41
reedwww.openstack.org19:41
reedwww.openstack.org is an alias for www.openstack.org.cdn.cloudflare.net.19:41
clarkbreed: you should probably propose the change either wy19:42
*** cyeoh has quit IRC19:43
*** exz has quit IRC19:43
*** mancdaz has quit IRC19:43
*** johnthetubaguy has quit IRC19:43
mnaseryeah hosts file update would be the only work around to avoid cloudflare in that case19:43
clarkbthen if fungi/jeblair/mordred shows up we can apply it and restart gerrit if that makes everyone happy19:43
clarkbmnaser: reed why is a host file change necessary?19:43
clarkbjust talk to whatever cloudflar talks to19:43
clarkborigin.www.openstack.org or whatever it is19:44
mnaseryeah, but that seems to redirect to www.openstack.org to enforce the www.19:44
reedclarkb, if you can create a cname on openstack.org dns that would also probably fix the issue :)19:45
clarkbreed: there should already be a name that cloudflare is using19:45
mnaserdirect.openstack.org from what it seems, but cloudflare resolves that and sends the Host header that it's sent19:45
mnaserso accessing directly will still invoke the redirect to www.19:45
reedhttps://launchpadlibrarian.net/175118471/2014-05-10_14-31-40.png19:45
reedthe bug was updated19:46
mnaseror that would be perfect ^19:46
*** PLATOSCAVE has joined #openstack-infra19:46
reedhttps://bugs.launchpad.net/bugs/131795719:46
uvirtbotLaunchpad bug 1317957 in openstack-org "Server error when updating contacts" [Critical,Confirmed]19:46
*** rcarrillocruz has joined #openstack-infra19:46
mnaserthat should addrres it, also whitelisting the gerrit IP would probably be good19:47
mnaserreed: https://support.cloudflare.com/hc/en-us/articles/200171346-How-do-I-block-blacklist-or-trust-whitelist-an-IP-address-manually- -- if you want to refer that19:47
mnaserbecause i believe bypass cache will not cache, but it will still block afaik19:48
*** aconrad has joined #openstack-infra19:48
clarkbfwiw I can't updte my contact info19:48
reedjonathan just texted me that he switched the DNS back to straight website, no cloudflare19:48
*** aconrad_ has joined #openstack-infra19:48
reedit'll clear in a few minutes19:48
mnaserprobably a better idea till this is more tested out19:48
mnaserresolving properly already here again19:49
clarkbsame here19:49
reedcool19:49
clarkbnow we need gerrit to uncache its dns record19:49
mnaseri'm a cloudflare optimized hosting partner and i've worked with cloudflare a lot in the past, so if there's any help in getting this setup and fixing issues, i don't mind helping19:50
reedthanks mnaser19:51
*** PLATOSCAVE has quit IRC19:51
reedmnaser, can you add yourself to the bug above?19:51
*** cyeoh has joined #openstack-infra19:54
*** exz has joined #openstack-infra19:54
*** mancdaz has joined #openstack-infra19:54
*** johnthetubaguy has joined #openstack-infra19:54
mnaserreed: not sure how to do that exactly? I'm more usually assigning bugs to myself19:54
*** PLATOSCAVE has joined #openstack-infra19:54
*** PLATOSCAVE has joined #openstack-infra19:54
*** PLATOSCAVE has quit IRC19:54
*** PLATOSCAVE has joined #openstack-infra19:55
*** PLATOSCAVE has joined #openstack-infra19:55
jerryzclarkb: can i open a bug in project A and submit a patch to project B to fix the bug in project A? i mean will gerrit hook associate the patch with the bug in a different project?19:55
*** PLATOSCAVE has joined #openstack-infra19:56
reedmnaser, what's your launchpad ID?19:56
mnaserhttps://launchpad.net/~mnaser19:56
clarkbjerryz: I don't think so. It looks up the bug based on project name. You can however assign multiple prohjects to the bug which you should do if one project fixes a bug in another19:56
reedclarkb, aren't bug numbers unique in Launchpad?19:57
clarkbreed: they are but the way the scriptage works is it looks things up by project name19:57
clarkbits possible lp will loosely associate and things will just work anyways19:57
reedmnaser, I added you as a subscriber to bug #131795719:57
uvirtbotLaunchpad bug 1317957 in openstack-org "Server error when updating contacts" [Critical,Confirmed] https://launchpad.net/bugs/131795719:57
clarkbbut really you should track the bug in both projects19:57
mnaserthanks, reed19:58
jerryzclarkb: got it.19:58
reedmnaser, you will most likely get email notifications when that bug is updated19:58
clarkbreed: gerrit apepars to be workign now19:59
mnaserreed: no problem, i'll pitch in when i can :)19:59
reedclarkb, thanks, i'll ask folks to try again here19:59
*** aconrad has quit IRC20:03
*** aconrad_ has quit IRC20:03
*** cyeoh has quit IRC20:09
*** exz has quit IRC20:09
*** mancdaz has quit IRC20:09
*** johnthetubaguy has quit IRC20:09
*** e0ne has quit IRC20:11
reeddamnit it's still not working here20:15
clarkbreed: let me check again on my side20:15
clarkbI did get it to succeed once recently20:15
clarkbyup still working20:16
reedclarkb, but are you signing a new agreement?20:17
clarkbno I am just updating my contact info20:17
reedI don't think that does it though20:17
clarkbit does20:18
reedit does? well... signing a new agreement is what's blocked here20:18
clarkbits the same process20:18
reednew signatures are failing20:18
clarkbat least for the communication between gerrit and foundation20:18
reedsomething changed on the database side then?20:18
clarkbmake sure that people doing new signatures are foundation members and using the same primary email id in btoh cases20:19
reedanything on the logs that tells us more than the gerrit error?20:19
clarkbI don't have access to the gerrit server logs right now so I don't know20:19
clarkbalso make sure you type in the I AGREE line or whatever it is20:20
reedclarkb, GOAWD! That was it20:21
reedat least they both confessed they're not members of the foundation, yet20:21
mnasergerrit account id #100420:24
mnaserif only i could have been 4 before20:24
clarkbmnaser: gues what 1 and 2 are20:26
*** mancdaz has joined #openstack-infra20:26
*** exz has joined #openstack-infra20:26
clarkb(you don't really need to guess you can look them up)20:26
*** johnthetubaguy has joined #openstack-infra20:26
mnaseri've been trying to look up by id20:26
mnaserbut i haven't found it yet :p20:26
*** cyeoh has joined #openstack-infra20:27
reedok, done, thanks clarkb20:27
clarkb1 is jeblair and 2 is jenkins20:27
mnaserpretty nice :p20:27
*** e0ne has joined #openstack-infra20:27
mnaserhow many users approx. in gerrit atm?20:27
clarkb11k?20:28
clarkblast I looked it was around there20:28
clarkbbut its account management isn't so good so a lot of those are duplicates and idle I think20:28
*** _nadya_ has quit IRC20:31
*** _nadya_ has joined #openstack-infra20:32
*** fbo is now known as fbo_away20:34
*** yamahata has joined #openstack-infra20:37
openstackgerritDarragh Bailey proposed a change to openstack-infra/jenkins-job-builder: Patch writexml for non standard XML DOM implementations  https://review.openstack.org/9319820:38
*** _nadya_ has quit IRC20:40
clarkbare there etherpads for the monday ops sessions?21:11
clarkbthere they are21:11
*** aconrad has joined #openstack-infra21:13
*** ChanServ has quit IRC21:14
*** jerryz has quit IRC21:20
openstackgerritDarragh Bailey proposed a change to openstack-infra/jenkins-job-builder: Test creation of multiple jobs from templates  https://review.openstack.org/9196021:21
*** reed has quit IRC21:24
*** otter768 has joined #openstack-infra21:26
*** aconrad_ has joined #openstack-infra21:30
*** ChanServ has joined #openstack-infra21:30
*** dickson.freenode.net sets mode: +o ChanServ21:30
*** rickerc has quit IRC21:30
*** kgriffs|afk is now known as kgriffs21:31
*** sballe__ has quit IRC21:41
*** sballe__ has joined #openstack-infra21:41
*** praneshp has joined #openstack-infra21:43
*** andreykurilin_ has joined #openstack-infra21:44
* fungi is in his room in atlanta now an caught up on scrollbacl21:59
fungiscrollback21:59
fungilooks like the cdn fixes todd put in place yesterday were insufficient to prevent a recurrence, huh22:00
clarkbfungi: ya I don't think that was explained22:00
clarkbbut DNS was poitned back to the origin not cloudflare and it is working again22:01
*** yamahata has quit IRC22:01
fungiso i saw22:01
fungigood deal22:01
fungiclearly gerrit irritates cloudflare in unfortunate ways22:01
fungiour suspicion yesterday was that gerrit was asked to confirm one user whose address didn't match, that causes the api on the www site to return a 403 forbidden. we *think* that causes cloudflare to decide that the caller should never be allowed to query that ever again and blocks it as a hostile enemy combatant with extreme prejudice22:02
clarkbhuh wouldn't a 404 be more approprite22:03
fungino clue22:03
clarkb"look for this user that doesn't exist" "I didn't find that use"22:03
*** fifieldt has quit IRC22:04
fungitodd whitelisted gerrit's ipv4 and ipv6 to bypass the cache completely for posts to that url, or so he thought anyway22:04
clarkbinstead of "look for this user that doesn't exist" "access denied forbidden"22:05
*** jasondotstar has quit IRC22:07
*** rfolco has quit IRC22:09
clarkbfungi: if you can set up some time with todd maybe we can point review-dev at www.openstack.org.cdn.cloudflare.net and get it working22:10
clarkbdoesn't look like todd is in here any more and I don't have a phone number22:11
fungiclarkb: i will hunt him down at the earliest opportunity22:11
clarkbalso doing ^ during summit week may be ugh22:11
*** yamahata has joined #openstack-infra22:11
fungii don't know if the number i have for him is a cell, but i'll definitely see him tomorrow22:11
fungianyway, popping out to dinner. bbiaw22:12
*** changbl has joined #openstack-infra22:14
*** medieval1 has quit IRC22:15
*** cody-somerville has joined #openstack-infra22:18
*** cody-somerville has quit IRC22:18
*** cody-somerville has joined #openstack-infra22:18
*** yamahata has quit IRC22:18
*** medieval1 has joined #openstack-infra22:18
*** yamahata has joined #openstack-infra22:18
*** andreykurilin_ has quit IRC22:19
*** e0ne has quit IRC22:25
*** e0ne has joined #openstack-infra22:26
*** arnaud has joined #openstack-infra22:49
*** SumitNaiksatam has quit IRC22:53
*** arnaud has quit IRC22:53
*** aconrad has quit IRC22:56
*** aconrad_ has quit IRC22:59
*** e0ne has quit IRC23:02
*** e0ne has joined #openstack-infra23:03
*** yamahata has quit IRC23:20
*** yamahata has joined #openstack-infra23:20
*** kgriffs is now known as kgriffs|afk23:21
*** e0ne has quit IRC23:28
*** alexpilotti has joined #openstack-infra23:29
*** gokrokve has joined #openstack-infra23:33
*** gokrokve_ has joined #openstack-infra23:34
*** alexpilotti_ has joined #openstack-infra23:37
*** gokrokve has quit IRC23:38
*** alexpilotti has quit IRC23:39
*** yamahata has quit IRC23:39
*** alexpilotti_ is now known as alexpilotti23:39
*** harlowja_at_home has joined #openstack-infra23:39
*** Sukhdev has joined #openstack-infra23:41
*** e0ne has joined #openstack-infra23:45
*** e0ne has quit IRC23:45
*** alexpilotti has quit IRC23:46
*** alexpilotti has joined #openstack-infra23:46
*** mancdaz has quit IRC23:48
*** exz has quit IRC23:49
*** johnthetubaguy has quit IRC23:49
*** johnthetubaguy has joined #openstack-infra23:50
*** exz has joined #openstack-infra23:50
*** StevenK has quit IRC23:50
*** otter768 has quit IRC23:51
*** mancdaz has joined #openstack-infra23:51
*** StevenK has joined #openstack-infra23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!