*** thorst_ has joined #openstack-infra | 00:00 | |
fungi | right now, with reprepro generating the index _from_ the set of packages on disk, there's no consistency issue at a single point in time, but really the most painful race we had was dealing with mirrors which were actually just plain inconsistent, often for long spans of time. i have to assume they were not using the officially prescribed mechanisms for mirroring | 00:01 |
---|---|---|
SpamapS | yyyeeaaahh | 00:01 |
*** aysyd has quit IRC | 00:01 | |
SpamapS | Maybe just mirror from the official sources? | 00:01 |
fungi | i don't see how any magic in apt solved _that_ problem | 00:01 |
mordred | SpamapS: we do mirror from the official sources to make our mirror | 00:02 |
mordred | SpamapS: before we did that, we had per-cloud mirrors run by the clouds in question that were out of date and inconsistent | 00:02 |
SpamapS | yeah | 00:02 |
SpamapS | I remember those | 00:02 |
mordred | those were worse than unhelpful | 00:02 |
fungi | SpamapS: maybe, though ubuntu's "official" mirrors tended to have that issue from time to time, i think because they were hosted locally in cloud providers and masquerading as normal mirrors or something (or the providers could have been doing some terrible cached proxying at their border or something?) | 00:02 |
SpamapS | yeah that's not really official | 00:03 |
SpamapS | I mean it's maintained.. but.. archive.ubuntu.com is the one you want. | 00:03 |
mordred | yah. | 00:03 |
*** xyang1 has quit IRC | 00:03 | |
fungi | anyway, i know we'd hit it on archive.u.o for spans of time far too long to be a short update race | 00:03 |
SpamapS | even tho those local ones are super fast :-P | 00:03 |
lifeless | fungi: http front-end accelerators can mess up repos even when they are actually consistent on disk | 00:03 |
fungi | er, archive.u.c | 00:03 |
mordred | yah. the o.o mirrors have been very pleasant since we put them in | 00:03 |
SpamapS | Right, they're pleasant, but not usable for production. | 00:04 |
mordred | nope | 00:04 |
lifeless | nope? | 00:04 |
mordred | lifeless: I mean, I agree with SpamapS | 00:04 |
lifeless | I mean why aren't they | 00:04 |
mordred | in their current state, they are useful for the gate, but not for external parties wanting to run production | 00:04 |
mordred | lifeless: no auth - could be MITM'd | 00:04 |
*** fungi_lounge has joined #openstack-infra | 00:04 | |
lifeless | mordred: what about the signing key? | 00:05 |
fungi | granted, we didn't bill our ci mirrors as "recommended for production cloud deployments" or anything | 00:05 |
*** fungi_lounge has quit IRC | 00:05 | |
mordred | lifeless: we don't sign them currently | 00:05 |
*** sree has joined #openstack-infra | 00:05 | |
lifeless | oh, because not mirrored. right | 00:05 |
mordred | lifeless: yah | 00:05 |
*** ffrank has quit IRC | 00:05 | |
*** zhurong has quit IRC | 00:05 | |
SpamapS | A more sinister person might see that as a problem for the gate too.. like.. mitm in a python package which disguises broken things in OpenStack's security code. | 00:05 |
mordred | so - fungi is working on our signing infrastructure in general, so we could choose to start signing them | 00:05 |
mordred | SpamapS: that would be an exceptionally hard MITM to pull off | 00:05 |
*** ffrank has joined #openstack-infra | 00:06 | |
mordred | given that to be successful they'd have to MITM the AFS protocol between rax dfw and all of the other cloud regions we have | 00:06 |
SpamapS | mordred: all nodes don't mount afs | 00:07 |
mordred | granted, not technically unpossible - but still I'd expect the gain to be higher than a library that would fail-open | 00:07 |
SpamapS | mordred: so, all they have to do is mitm the http between nodes and the mirror. | 00:07 |
mordred | SpamapS: we have an HTTP host in each cloud region | 00:07 |
mordred | that mounts AFS | 00:07 |
*** fungi_lounge has joined #openstack-infra | 00:07 | |
mordred | so either way they'd need to do the MITM across all 10 cloud-regions we have | 00:07 |
SpamapS | not so crazy thing to do if you can run arbitrary code in the check queue on the same network as those nodes. | 00:08 |
*** jamesmcarthur has joined #openstack-infra | 00:08 | |
SpamapS | And then make it serve your "yes I do validate SSL certs" version of XYZ python lib, and then introduce patches to subtly break that....... | 00:08 |
SpamapS | but the tests pass and verify SSL certs are validating | 00:08 |
SpamapS | Yes I know | 00:09 |
*** thorst_ has quit IRC | 00:09 | |
mordred | sure - but you can't request a region - so you'd have to submit code into the code review system that implemented an exploit - and run it/ recheck it enough that it ran in all 10 regions | 00:09 |
SpamapS | straw man army ;) | 00:09 |
mordred | yah | 00:09 |
mordred | I mean, I hear you | 00:09 |
fungi | actually, our trusted job workers and afs mirrors are in a separate tenant from the nodes that run arbitrary code | 00:09 |
mordred | I'm just not going to lose any sleep over that one | 00:09 |
*** sree has quit IRC | 00:09 | |
lifeless | mordred: MITM HTTP is not hard | 00:09 |
*** sree has joined #openstack-infra | 00:09 | |
mordred | lifeless: didn't say it was | 00:09 |
lifeless | mordred: just saying, that the AFS step isn't relevant | 00:09 |
fungi | the nodes that run arbitrary code are sandboxed in their own tenant, but yes the provider in question puts them on a shared provider network so it's all a question of how good their arp spoofing and such is | 00:10 |
SpamapS | No not losing sleep. Just pointing out that having them signed isn't _that_ hard, and should be done as a dot on an i, not as the lynchpin of OpenStacks' code integrity. :) | 00:10 |
fungi | er, arp spoofing prevention | 00:10 |
mordred | I'm saying that MITMing 10 different regions at the same time is a bit steep given the dubious gain you'd get | 00:10 |
lifeless | mordred: they just have to MITM the node->http->mirror link | 00:10 |
mordred | lifeless: yes. in 10 places | 00:10 |
SpamapS | you don't even need arp | 00:10 |
SpamapS | DNS | 00:10 |
lifeless | mordred: sure, but since you'd be basically automating any such attack... | 00:10 |
SpamapS | but yeah, the many many regions does help | 00:10 |
fungi | SpamapS: right, so also ip source address spoofing prevention comes into play | 00:11 |
SpamapS | provides more "wtf why is this patch over here having so many rechecks?" | 00:11 |
SpamapS | anyway | 00:11 |
SpamapS | this has been fun | 00:11 |
mordred | :) | 00:11 |
SpamapS | I am hoping I can help | 00:11 |
SpamapS | it's down to 106F outside | 00:12 |
SpamapS | so I'm going to jump in my 79F pool now | 00:12 |
mordred | SpamapS: woot! | 00:12 |
fungi | basically node on the can-run-anything tenant needs to somehow convince the provider to reroute traffic between two instances on the ci control plane tenant through itself | 00:12 |
mordred | SpamapS: ours is up to 86F now | 00:12 |
pleia2 | SpamapS: ugh, that temperature is not ok, enjoy the pool | 00:12 |
SpamapS | yeah the water over the baja bench is up to 82F :) | 00:12 |
mordred | fungi: and needs to convince 6 different providers to do that | 00:12 |
jeblair | ianw: yep | 00:13 |
mordred | fungi: at least one of whom runs a very different network stack from the others | 00:13 |
fungi | mordred: not if they just want to temporarily backdoor a release tarball | 00:13 |
lifeless | there was a great discussion about dns poisoning attacks in ubuntu-devel recently | 00:13 |
mordred | fungi: I don't think mitm'ing the mirrors has any bearing on backdooring a release tarball | 00:13 |
lifeless | dns is how I'd do it, no ip spoofing needed. | 00:13 |
fungi | i'm sure it's not impossible (with my tenure on the vmt i've seen plenty of network issues in openstack that would make layer 2 or layer 3 traffic redirection to accomplish a mitm possible | 00:14 |
*** sree has quit IRC | 00:14 | |
mordred | I'm not saying this is not possible | 00:14 |
mordred | I'm saying at best MITM'ing the mirrors might get you a false positive/false negative on some gate tests | 00:14 |
openstackgerrit | Ian Wienand proposed openstack-infra/zuul: Make console log output use deliminator https://review.openstack.org/331892 | 00:14 |
lifeless | sure | 00:14 |
mordred | that's the best outcome you can hope for as an attacker - it's not really worth the effort | 00:14 |
lifeless | the idea would be to land known vulnerable code | 00:14 |
ianw | jeblair: ^ something like that | 00:15 |
lifeless | how you'd keep it from being discovered shortly thereafter I have no idea | 00:15 |
fungi | lifeless: true, dns response flooding the builder in question would be a possibility, and doesn't require access to that network | 00:15 |
mordred | lifeless: right. but to do such a thing by poisoning a dependency library ... and yes, then keeping it secret | 00:15 |
lifeless | since if it needs an active attack to pass tests | 00:15 |
*** hosanai has joined #openstack-infra | 00:15 | |
mordred | in this context | 00:15 |
mordred | is way harder than just socially engineering the bad code in through normal means | 00:15 |
mordred | lifeless: exactly | 00:15 |
fungi | or yes, dns cache poisoning (google's resolvers since those are the ones we're using) | 00:16 |
jeblair | ianw: oh, er, i don't think i want to lose precision on the timestamp. i thought only the '|' was at issue. | 00:16 |
mordred | if we build rpms or debs or go/rust binaries or something, such that an attack could get bad code into a release tarball, that would be a different story I think | 00:16 |
lifeless | single emitter somewhere on the internet with ip source spoofing off, flood of src=8.8.8.8 packets. | 00:16 |
*** notmars-lounge has joined #openstack-infra | 00:17 | |
ianw | jeblair: well, i think most things we have (os-loganalyze & logstash) will handle the extra precision ... but it is a change. what's more important? | 00:17 |
ianw | compatability or microseconds? | 00:17 |
*** sree has joined #openstack-infra | 00:17 | |
*** amotoki has joined #openstack-infra | 00:17 | |
jeblair | ianw: microseconds :) | 00:17 |
jeblair | ianw: so both things are at issue? the ts format and the | ? | 00:18 |
ianw | jeblair: the thing that causes the weird coloring on,e.g. http://logs.openstack.org/14/331514/1/check/gate-os-loganalyze-python27/3c70514/console.html is just the missing " | " i *think* | 00:19 |
ianw | i'll have to check with the higher precision timestamp, but i think osloganalyze has regexes that handle that | 00:19 |
mordred | I can be down with adding a | to get colors | 00:19 |
jeblair | ianw: okay. i (perhaps this is unusual) have no strong opinion on the '|' and will happily approve a patch to add it to zuul_runner (but also don't object if we want to leave it as is and change os-loganalyze) | 00:20 |
jeblair | ianw: i'm fond of high-precision timestamps and would like to keep them if possible. | 00:20 |
ianw | mordred: actually, it's adding a | to get *rid* of colors. osloganalyze's oslo-highlighting regex is picking up the console logs and trying to color them, badly | 00:20 |
mordred | ianw: I should have said "correct" colors | 00:21 |
mordred | :) | 00:21 |
fungi | i guess it boils down to whether it's faster to update osla or to roll a zuul patch out to all the launchers and gracefully restart them | 00:21 |
ianw | jeblair: ok, let me test osloganalyze with higher precision timestamps and if so, i'll update the zuul to put in the " | " and we should be OK | 00:21 |
*** sree has quit IRC | 00:21 | |
ianw | logstash does handle it with it's built-in timestamp regex stuff | 00:21 |
jeblair | fungi: meh. this isn't that urgent. i think we can do the thing we want in this case. whatever that is. :) | 00:21 |
jeblair | ianw: sounds like a plan | 00:21 |
mordred | \o/ | 00:22 |
fungi | true. a few more days of miscolorization (if that's what it takes) isn't the end | 00:22 |
jeblair | fungi: plus, who lets websites tell their browser what color to use anyway? ;) | 00:22 |
fungi | on the other hand, fixing osla to not expect the | means that teh logs we've already uploaded will get colored correctly, rather than only the logs we upload after the zuul behavior change | 00:22 |
*** amotoki has quit IRC | 00:22 | |
*** sree has joined #openstack-infra | 00:23 | |
fungi | jeblair: yep, i have gertty pull job logs up in lynx, so i don't actually see the colorization regardless | 00:23 |
*** jamesmcarthur has quit IRC | 00:23 | |
jamielennox | fungi: when you have a minute do you know why: https://review.openstack.org/#/c/330845/ didn't work? | 00:24 |
ianw | color is a bit meh, but i kind of found this when trying to go through kibana to pull out some logs, where we're not matching too | 00:24 |
fungi | jamielennox: oh, yep! | 00:25 |
ianw | https://review.openstack.org/#/c/331526/ <- actually, i kind of think it makes sense to have the log in one message anyway, but it is unintentional | 00:25 |
fungi | jamielennox: we need to manually switch it back from read-only first | 00:25 |
*** salv-orlando has joined #openstack-infra | 00:25 | |
fungi | jamielennox: catch-22, if the project is read-only, manage-projects can't update the acl for it | 00:26 |
fungi | i always forget about this | 00:26 |
fungi | doesn't come up very often | 00:26 |
openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Add configurations for gerrit its plugins https://review.openstack.org/330922 | 00:26 |
nibalizer | haha | 00:26 |
jamielennox | fungi: excellent - because i was coming up with weird ideas that didn't make sense even to me | 00:26 |
fungi | jamielennox: most of my ideas don't make sense to me, so you'd be in fine company | 00:26 |
pleia2 | hehe | 00:27 |
nibalizer | fungi: anteaya this is passing now if you've got a sec to reapply votes | 00:27 |
nibalizer | https://review.openstack.org/#/c/331780/ | 00:27 |
*** pvaneck has quit IRC | 00:27 | |
fungi | jamielennox: i've switched it from read-only to active, and will manually run manage-projects for that repo now | 00:27 |
*** sree has quit IRC | 00:28 | |
jamielennox | fungi: thank you | 00:28 |
*** burgerk has quit IRC | 00:28 | |
fungi | so that i can make sure it's really and truly fixed | 00:28 |
fungi | jamielennox: lgtm now | 00:28 |
*** yamahata has quit IRC | 00:29 | |
*** ffrank has quit IRC | 00:29 | |
jamielennox | fungi: yep, lgtm https://review.openstack.org/#/admin/projects/openstack/oslo.context,access | 00:29 |
*** jamesmcarthur has joined #openstack-infra | 00:29 | |
openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Add configurations for gerrit its plugins https://review.openstack.org/330922 | 00:30 |
*** salv-orlando has quit IRC | 00:32 | |
openstackgerrit | Spencer Krum proposed openstack-infra/vinz: First (hacky) poke at vinz https://review.openstack.org/331894 | 00:32 |
*** sshnaidm has quit IRC | 00:33 | |
*** sshnaidm has joined #openstack-infra | 00:34 | |
openstackgerrit | Khai Do proposed openstack-infra/system-config: Configure its-storyboard plugin https://review.openstack.org/330925 | 00:34 |
*** savihou has quit IRC | 00:34 | |
*** savihou has joined #openstack-infra | 00:34 | |
*** lvdongbing has joined #openstack-infra | 00:38 | |
*** hosanai_ has quit IRC | 00:41 | |
*** masayukig has quit IRC | 00:41 | |
*** rfolco has quit IRC | 00:42 | |
*** thorst_ has joined #openstack-infra | 00:42 | |
*** sree has joined #openstack-infra | 00:43 | |
*** sdake_ has quit IRC | 00:44 | |
*** gouthamr_ has quit IRC | 00:44 | |
*** masayukig has joined #openstack-infra | 00:45 | |
*** sree_ has joined #openstack-infra | 00:46 | |
*** markvoelker has quit IRC | 00:46 | |
*** sree_ is now known as Guest90631 | 00:47 | |
*** amitgandhinz has joined #openstack-infra | 00:47 | |
*** markvoelker has joined #openstack-infra | 00:47 | |
*** sree has quit IRC | 00:47 | |
*** sree has joined #openstack-infra | 00:47 | |
*** ddieterly has joined #openstack-infra | 00:50 | |
*** Guest90631 has quit IRC | 00:50 | |
ianw | ahh unittest -- 30 levels of backtrace, and not one of them in code i've written | 00:51 |
*** sree has quit IRC | 00:52 | |
*** amitgandhinz has quit IRC | 00:52 | |
*** yamamot__ has joined #openstack-infra | 00:53 | |
*** sree has joined #openstack-infra | 00:54 | |
*** rajinir has quit IRC | 00:54 | |
fungi | nibalizer: gate-project-config-nodepool for 331780 wanged off a POST_FAILURE and bounced out. i've rechecked it | 00:56 |
nibalizer | fungi: thanks | 00:57 |
*** yamamot__ has quit IRC | 00:58 | |
*** sree has quit IRC | 00:58 | |
*** ddieterly is now known as ddieterly[away] | 00:58 | |
*** sree has joined #openstack-infra | 01:00 | |
*** zul has joined #openstack-infra | 01:00 | |
*** asselin has quit IRC | 01:00 | |
*** tkelsey has joined #openstack-infra | 01:02 | |
*** sree has quit IRC | 01:04 | |
*** hosanai_ has joined #openstack-infra | 01:05 | |
*** jamesmcarthur has quit IRC | 01:05 | |
*** jamesmcarthur has joined #openstack-infra | 01:05 | |
*** yamahata has joined #openstack-infra | 01:06 | |
openstackgerrit | Ian Wienand proposed openstack-infra/os-loganalyze: Test high-precision timestamps in console log https://review.openstack.org/331898 | 01:06 |
*** tkelsey has quit IRC | 01:06 | |
*** penguinolog has quit IRC | 01:07 | |
*** penguinolog has joined #openstack-infra | 01:07 | |
*** weshay has quit IRC | 01:07 | |
*** ddieterly[away] has quit IRC | 01:08 | |
*** zhurong has joined #openstack-infra | 01:09 | |
*** jamesmcarthur has quit IRC | 01:10 | |
*** tphummel has quit IRC | 01:10 | |
*** sree has joined #openstack-infra | 01:12 | |
*** ddieterly has joined #openstack-infra | 01:12 | |
openstackgerrit | Ian Wienand proposed openstack-infra/zuul: Make console log output use deliminator https://review.openstack.org/331892 | 01:13 |
ianw | jeblair: ^ think that should do it | 01:13 |
*** hosanai_ has quit IRC | 01:15 | |
*** mrunge has quit IRC | 01:15 | |
*** sree has quit IRC | 01:16 | |
*** sree has joined #openstack-infra | 01:16 | |
*** thorst_ has quit IRC | 01:18 | |
*** thorst_ has joined #openstack-infra | 01:19 | |
*** amotoki has joined #openstack-infra | 01:20 | |
*** sree has quit IRC | 01:20 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/infra-specs: Priority specs cleanup/update for Newton cycle https://review.openstack.org/331903 | 01:21 |
*** mrunge has joined #openstack-infra | 01:21 | |
openstackgerrit | Merged openstack-infra/project-config: Add infra puppet gem dependency holder repo https://review.openstack.org/331780 | 01:22 |
*** sree has joined #openstack-infra | 01:23 | |
*** amotoki has quit IRC | 01:24 | |
*** xenogear has quit IRC | 01:25 | |
*** thorst_ has quit IRC | 01:28 | |
*** sree has quit IRC | 01:28 | |
*** sree has joined #openstack-infra | 01:29 | |
*** raunak has quit IRC | 01:29 | |
*** zhurong has quit IRC | 01:31 | |
*** zhurong has joined #openstack-infra | 01:32 | |
*** sree has quit IRC | 01:33 | |
*** Apoorva has quit IRC | 01:34 | |
*** sree has joined #openstack-infra | 01:36 | |
*** salv-orlando has joined #openstack-infra | 01:37 | |
*** kzaitsev_mb has quit IRC | 01:38 | |
*** zhurong has quit IRC | 01:38 | |
*** amotoki has joined #openstack-infra | 01:40 | |
*** sree has quit IRC | 01:40 | |
*** zhurong has joined #openstack-infra | 01:42 | |
*** salv-orlando has quit IRC | 01:44 | |
*** roxanaghe has quit IRC | 01:45 | |
anteaya | nibalizer: sorry thunderstorm took me out, coming in off my phone hope my back-up modem works, will test tomorrow | 01:45 |
*** xarses has joined #openstack-infra | 01:46 | |
*** gouthamr_ has joined #openstack-infra | 01:47 | |
*** amitgandhinz has joined #openstack-infra | 01:49 | |
*** zz_dimtruck is now known as dimtruck | 01:53 | |
*** yanyanhu has joined #openstack-infra | 01:53 | |
*** amitgandhinz has quit IRC | 01:53 | |
openstackgerrit | greghaynes proposed openstack/diskimage-builder: Fix sphinx-build to not depend on diskimage-builder https://review.openstack.org/331911 | 01:54 |
*** ddieterly is now known as ddieterly[away] | 01:54 | |
*** ddieterly[away] is now known as ddieterly | 01:54 | |
anteaya | off again, hoping the internets heal themselves and let me connect tomorrow | 01:57 |
anteaya | night | 01:58 |
*** jamesmcarthur has joined #openstack-infra | 01:59 | |
*** yamamoto has joined #openstack-infra | 02:00 | |
*** savihou has quit IRC | 02:00 | |
*** amotoki has quit IRC | 02:00 | |
*** zhurong has quit IRC | 02:00 | |
*** savihou has joined #openstack-infra | 02:01 | |
*** claudiub has quit IRC | 02:02 | |
*** zhurong has joined #openstack-infra | 02:03 | |
*** jamesmcarthur has quit IRC | 02:03 | |
*** kzaitsev_mb has joined #openstack-infra | 02:03 | |
*** yamahata has quit IRC | 02:06 | |
*** zhurong has quit IRC | 02:08 | |
*** zhurong has joined #openstack-infra | 02:09 | |
*** ddieterly has quit IRC | 02:09 | |
*** pt_15 has joined #openstack-infra | 02:10 | |
*** zhs has joined #openstack-infra | 02:10 | |
*** dimtruck is now known as zz_dimtruck | 02:11 | |
*** hosanai_ has joined #openstack-infra | 02:15 | |
*** erlon has quit IRC | 02:16 | |
*** amotoki has joined #openstack-infra | 02:16 | |
*** kzaitsev_mb has quit IRC | 02:16 | |
jeblair | ianw: thanks! | 02:19 |
jeblair | pabelanger, mordred: all zls are running | 02:19 |
*** hongbin has joined #openstack-infra | 02:19 | |
*** hosanai_ has quit IRC | 02:20 | |
*** rhallisey has quit IRC | 02:25 | |
*** mriedem has quit IRC | 02:26 | |
*** thorst_ has joined #openstack-infra | 02:26 | |
fungi | nibalizer: openstack-infra/puppet-openstack_infra_spec_helper is live now | 02:30 |
*** raunak has joined #openstack-infra | 02:32 | |
*** thorst_ has quit IRC | 02:33 | |
*** psilvad has quit IRC | 02:33 | |
*** zhs_s has joined #openstack-infra | 02:34 | |
*** PollyZ has joined #openstack-infra | 02:35 | |
fungi | okay, gonna knock off for the night. tomorrow is meeting day! | 02:36 |
fungi | night all | 02:36 |
pleia2 | night fungi | 02:37 |
*** zhurong has quit IRC | 02:37 | |
*** zhs has quit IRC | 02:37 | |
*** PollyZ has quit IRC | 02:38 | |
*** PollyZ has joined #openstack-infra | 02:40 | |
nibalizer | awesome | 02:43 |
nibalizer | thansk fungi | 02:43 |
*** PollyZ has quit IRC | 02:44 | |
*** zhurong has joined #openstack-infra | 02:48 | |
*** amitgandhinz has joined #openstack-infra | 02:49 | |
*** csomerville has joined #openstack-infra | 02:50 | |
*** yuanying has quit IRC | 02:51 | |
*** zhurong has quit IRC | 02:52 | |
*** zhurong has joined #openstack-infra | 02:53 | |
*** zhs_ss has joined #openstack-infra | 02:53 | |
*** stevemar has quit IRC | 02:54 | |
*** zz_dimtruck is now known as dimtruck | 02:54 | |
*** amitgandhinz has quit IRC | 02:54 | |
*** yuanying has joined #openstack-infra | 02:54 | |
*** zhs_s has quit IRC | 02:56 | |
*** zhurong has quit IRC | 02:58 | |
*** zhurong has joined #openstack-infra | 02:59 | |
*** PollyZ has joined #openstack-infra | 03:02 | |
*** yamahata has joined #openstack-infra | 03:02 | |
*** sree has joined #openstack-infra | 03:06 | |
*** sree has quit IRC | 03:06 | |
*** sree has joined #openstack-infra | 03:06 | |
*** salv-orlando has joined #openstack-infra | 03:08 | |
*** sree_ has joined #openstack-infra | 03:09 | |
*** sree_ has quit IRC | 03:10 | |
*** sputnik13 has joined #openstack-infra | 03:12 | |
*** zhs_ss has quit IRC | 03:12 | |
*** gouthamr_ has quit IRC | 03:12 | |
*** sree has quit IRC | 03:12 | |
*** sputnik13 has quit IRC | 03:12 | |
*** sree_ has joined #openstack-infra | 03:12 | |
*** kzaitsev_mb has joined #openstack-infra | 03:12 | |
*** sree_ is now known as Guest97986 | 03:13 | |
*** sputnik13 has joined #openstack-infra | 03:13 | |
*** sputnik13 has quit IRC | 03:14 | |
*** salv-orlando has quit IRC | 03:14 | |
*** sputnik13 has joined #openstack-infra | 03:16 | |
*** raunak has quit IRC | 03:16 | |
*** hosanai_ has joined #openstack-infra | 03:16 | |
*** kzaitsev_mb has quit IRC | 03:17 | |
*** sputnik13 has quit IRC | 03:18 | |
*** hosanai_ has quit IRC | 03:21 | |
*** julim has joined #openstack-infra | 03:23 | |
*** csomerville has quit IRC | 03:23 | |
nibalizer | crinkle: EmilienM https://review.openstack.org/#/c/331923/ | 03:25 |
*** kushal has joined #openstack-infra | 03:27 | |
*** zhurong has quit IRC | 03:29 | |
*** tphummel has joined #openstack-infra | 03:29 | |
openstackgerrit | Spencer Krum proposed openstack-infra/project-config: Notify puppet-openstack_infra_spec_helper events in the infra channel https://review.openstack.org/331926 | 03:29 |
*** raunak has joined #openstack-infra | 03:30 | |
*** rbrndt has joined #openstack-infra | 03:32 | |
*** raunak has quit IRC | 03:32 | |
*** thorst_ has joined #openstack-infra | 03:32 | |
*** julim has quit IRC | 03:33 | |
*** zhurong has joined #openstack-infra | 03:34 | |
*** Srinu has joined #openstack-infra | 03:34 | |
Srinu | Hi | 03:34 |
*** Nikolay_St has joined #openstack-infra | 03:35 | |
*** zhurong has quit IRC | 03:35 | |
Srinu | Nikolay_St: While running jobs in Openstack CI i am getting this error http://paste.openstack.org/show/520842/ | 03:36 |
*** thorst_ has quit IRC | 03:37 | |
*** zhurong has joined #openstack-infra | 03:39 | |
openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Add configurations for gerrit its plugins https://review.openstack.org/330922 | 03:42 |
openstackgerrit | Fei Long Wang proposed openstack-infra/project-config: Enable install-guide job for zaqar https://review.openstack.org/331928 | 03:44 |
*** zhurong has quit IRC | 03:45 | |
*** raunak has joined #openstack-infra | 03:47 | |
*** zhurong has joined #openstack-infra | 03:49 | |
*** amitgandhinz has joined #openstack-infra | 03:50 | |
*** shahid__ has joined #openstack-infra | 03:51 | |
*** amitgandhinz has quit IRC | 03:55 | |
*** hongbin has quit IRC | 03:59 | |
*** yuanying has quit IRC | 04:02 | |
*** yuanying has joined #openstack-infra | 04:03 | |
*** tkelsey has joined #openstack-infra | 04:04 | |
*** PollyZ has quit IRC | 04:04 | |
*** zhurong has quit IRC | 04:05 | |
*** zhurong has joined #openstack-infra | 04:06 | |
*** tkelsey has quit IRC | 04:08 | |
*** zhurong has quit IRC | 04:12 | |
*** kzaitsev_mb has joined #openstack-infra | 04:13 | |
*** hosanai_ has joined #openstack-infra | 04:14 | |
openstackgerrit | Hisashi Osanai proposed openstack-infra/project-config: Fix Monasca Analytics python27 job https://review.openstack.org/331535 | 04:15 |
*** links has joined #openstack-infra | 04:17 | |
*** kzaitsev_mb has quit IRC | 04:18 | |
*** savihou has quit IRC | 04:21 | |
*** _nadya_ has joined #openstack-infra | 04:21 | |
*** salv-orlando has joined #openstack-infra | 04:22 | |
*** hosanai_ has quit IRC | 04:25 | |
*** zhurong has joined #openstack-infra | 04:25 | |
zaro | beaker-ubuntu-trusty job failing with "basic openstackci installation of packages Package "apache2" should be installed” message. anybody know what’s up with that? | 04:26 |
zaro | http://logs.openstack.org/22/330922/8/check/gate-openstackci-beaker-ubuntu-trusty/244d443/console.html | 04:27 |
*** salv-orlando has quit IRC | 04:29 | |
*** maishsk has joined #openstack-infra | 04:30 | |
*** ramishra has joined #openstack-infra | 04:30 | |
openstackgerrit | Mathieu Mitchell proposed openstack-infra/project-config: (WIP) Enable ironic multinode grenade as non-voting https://review.openstack.org/331936 | 04:30 |
*** psachin has joined #openstack-infra | 04:31 | |
nibalizer | zaro: yep | 04:32 |
*** Nikolay_St has quit IRC | 04:32 | |
nibalizer | basically all of those jobs will fail until we land 331923 then patch all the modules | 04:32 |
*** Jeffrey4l_ has quit IRC | 04:33 | |
zaro | nibalizer: gotcha, thanks. | 04:34 |
*** rbrndt has quit IRC | 04:34 | |
*** thorst_ has joined #openstack-infra | 04:34 | |
*** denisra has quit IRC | 04:35 | |
*** denisra has joined #openstack-infra | 04:36 | |
*** maishsk has quit IRC | 04:41 | |
*** thorst_ has quit IRC | 04:42 | |
*** zhurong has quit IRC | 04:45 | |
*** zhurong has joined #openstack-infra | 04:46 | |
*** dimtruck is now known as zz_dimtruck | 04:46 | |
*** asselin__ has quit IRC | 04:46 | |
*** dfflanders has joined #openstack-infra | 04:47 | |
*** _nadya_ has quit IRC | 04:48 | |
*** ramishra has quit IRC | 04:50 | |
*** amitgandhinz has joined #openstack-infra | 04:51 | |
*** _nadya_ has joined #openstack-infra | 04:52 | |
*** banix has joined #openstack-infra | 04:53 | |
*** yamamoto has quit IRC | 04:53 | |
*** zhurong has quit IRC | 04:54 | |
*** zz_dimtruck is now known as dimtruck | 04:54 | |
*** Jeffrey4l_ has joined #openstack-infra | 04:55 | |
*** amitgandhinz has quit IRC | 04:55 | |
crinkle | nibalizer: are you sure you want all of that copied into the infra gem? right now infra only needs the gemspec part | 04:55 |
crinkle | 95% of that is not relevant to infra | 04:56 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use noop-jobs template https://review.openstack.org/331805 | 04:57 |
*** _nadya_ has quit IRC | 04:57 | |
nibalizer | crinkle: right this is why I wanted reviews | 04:57 |
nibalizer | it seems there is some testing built in to this thing that it would be nice to take advantge of | 04:58 |
nibalizer | it looks like the 'unit test' is basically install the gems and make sure that works, which seems pretty sane and useful | 04:58 |
nibalizer | I don't think we need the release notes stuff | 04:58 |
*** abregman has joined #openstack-infra | 05:00 | |
*** zhurong has joined #openstack-infra | 05:04 | |
*** ramishra has joined #openstack-infra | 05:07 | |
*** slaweq has quit IRC | 05:11 | |
*** amotoki has quit IRC | 05:11 | |
*** javeriak has joined #openstack-infra | 05:13 | |
*** ramishra has quit IRC | 05:14 | |
*** amotoki has joined #openstack-infra | 05:14 | |
*** ramishra has joined #openstack-infra | 05:15 | |
*** salv-orlando has joined #openstack-infra | 05:15 | |
*** tphummel has quit IRC | 05:16 | |
*** roxanaghe has joined #openstack-infra | 05:23 | |
*** hosanai_ has joined #openstack-infra | 05:26 | |
*** savihou has joined #openstack-infra | 05:27 | |
*** roxanaghe has quit IRC | 05:27 | |
*** jaosorior has joined #openstack-infra | 05:28 | |
*** rbrndt has joined #openstack-infra | 05:29 | |
*** claudiub has joined #openstack-infra | 05:30 | |
*** hosanai_ has quit IRC | 05:30 | |
*** javeriak has quit IRC | 05:31 | |
*** aeng has quit IRC | 05:32 | |
*** banix has quit IRC | 05:33 | |
*** zhurong has quit IRC | 05:34 | |
*** xarses_ has joined #openstack-infra | 05:35 | |
*** isaacb has joined #openstack-infra | 05:35 | |
*** zhurong has joined #openstack-infra | 05:35 | |
*** rbrndt has quit IRC | 05:35 | |
*** xarses_ has quit IRC | 05:35 | |
*** xarses_ has joined #openstack-infra | 05:36 | |
*** ramishra has quit IRC | 05:37 | |
*** rbrndt has joined #openstack-infra | 05:37 | |
*** ramishra has joined #openstack-infra | 05:37 | |
*** andreww has joined #openstack-infra | 05:38 | |
*** zhurong has quit IRC | 05:38 | |
*** xarses has quit IRC | 05:39 | |
*** salv-orl_ has joined #openstack-infra | 05:39 | |
*** zhurong has joined #openstack-infra | 05:39 | |
*** thorst_ has joined #openstack-infra | 05:40 | |
AJaeger | jhesketh: https://review.openstack.org/331563 is wrong, fungi commented here in IRC and I added that as comment to the review. Please abandon. | 05:40 |
*** xarses_ has quit IRC | 05:41 | |
*** armax has joined #openstack-infra | 05:41 | |
*** andreww is now known as xarses | 05:41 | |
jhesketh | AJaeger: thanks | 05:41 |
*** salv-orlando has quit IRC | 05:41 | |
*** yamamot__ has joined #openstack-infra | 05:41 | |
AJaeger | jhesketh, ianw: If either of has time for a review, https://review.openstack.org/331928 would be appreciated - adding Install Guide for Zaqar. | 05:42 |
jhesketh | AJaeger: lgtm | 05:43 |
AJaeger | thanks, jhesketh ! | 05:43 |
*** rlandy has quit IRC | 05:43 | |
*** rbrndt has quit IRC | 05:43 | |
*** javeriak has joined #openstack-infra | 05:44 | |
*** armax has quit IRC | 05:46 | |
*** thorst_ has quit IRC | 05:47 | |
*** aeng has joined #openstack-infra | 05:49 | |
*** rossella_s has quit IRC | 05:50 | |
*** amitgandhinz has joined #openstack-infra | 05:52 | |
*** Julien-zte has joined #openstack-infra | 05:52 | |
*** _nadya_ has joined #openstack-infra | 05:53 | |
*** yolanda has joined #openstack-infra | 05:55 | |
openstackgerrit | Merged openstack-infra/project-config: Enable install-guide job for zaqar https://review.openstack.org/331928 | 05:55 |
*** rcernin has joined #openstack-infra | 05:56 | |
*** amitgandhinz has quit IRC | 05:56 | |
*** _nadya_ has quit IRC | 05:58 | |
*** mohankumar has joined #openstack-infra | 06:00 | |
*** jtomasek has joined #openstack-infra | 06:02 | |
*** _nadya_ has joined #openstack-infra | 06:03 | |
*** mohankumar has quit IRC | 06:05 | |
*** zhurong has quit IRC | 06:08 | |
*** raunak has quit IRC | 06:09 | |
*** pgadiya has joined #openstack-infra | 06:11 | |
*** zhurong has joined #openstack-infra | 06:11 | |
*** Nikolay_St has joined #openstack-infra | 06:12 | |
*** armax has joined #openstack-infra | 06:12 | |
*** isaacb has quit IRC | 06:14 | |
*** javeriak has quit IRC | 06:14 | |
*** maishsk has joined #openstack-infra | 06:14 | |
*** kzaitsev_mb has joined #openstack-infra | 06:15 | |
*** zhurong has quit IRC | 06:16 | |
*** linuxmaniac_ has joined #openstack-infra | 06:16 | |
*** linuxmaniac has quit IRC | 06:16 | |
*** sarob has joined #openstack-infra | 06:17 | |
*** armax has quit IRC | 06:17 | |
*** mohankumar has joined #openstack-infra | 06:17 | |
*** sputnik13 has joined #openstack-infra | 06:19 | |
*** sputnik13 has quit IRC | 06:19 | |
*** kzaitsev_mb has quit IRC | 06:20 | |
*** armax has joined #openstack-infra | 06:21 | |
*** slaweq has joined #openstack-infra | 06:22 | |
*** garyk1 has joined #openstack-infra | 06:23 | |
*** bhavik has quit IRC | 06:23 | |
*** roxanaghe has joined #openstack-infra | 06:24 | |
*** wanghua has quit IRC | 06:25 | |
*** hosanai_ has joined #openstack-infra | 06:26 | |
*** dfflanders has quit IRC | 06:26 | |
openstackgerrit | Hisashi Osanai proposed openstack-infra/project-config: Fix Monasca Analytics python27 job https://review.openstack.org/331535 | 06:27 |
*** zhurong has joined #openstack-infra | 06:28 | |
*** roxanaghe has quit IRC | 06:29 | |
*** sarob has quit IRC | 06:29 | |
*** sarob has joined #openstack-infra | 06:29 | |
*** prabu has joined #openstack-infra | 06:31 | |
*** rwsu_ is now known as rwsu | 06:32 | |
prabu | could someone help me on this error ERROR gerrit.GerritWatcher: Exception on ssh event stream: | 06:32 |
*** yolanda has quit IRC | 06:32 | |
*** aeng has quit IRC | 06:34 | |
*** markvoelker has quit IRC | 06:35 | |
*** andreas_s has joined #openstack-infra | 06:36 | |
*** hosanai_ has quit IRC | 06:37 | |
*** dimtruck is now known as zz_dimtruck | 06:37 | |
*** rwsu has quit IRC | 06:40 | |
*** zhurong has quit IRC | 06:40 | |
*** zhurong has joined #openstack-infra | 06:41 | |
*** hosanai_ has joined #openstack-infra | 06:43 | |
*** lucasagomes has quit IRC | 06:44 | |
*** thorst_ has joined #openstack-infra | 06:45 | |
*** javeriak has joined #openstack-infra | 06:47 | |
prabu | could someone help me on this error ERROR gerrit.GerritWatcher: Exception on ssh event stream: | 06:47 |
*** isaacb has joined #openstack-infra | 06:48 | |
*** slaweq has quit IRC | 06:51 | |
*** lucasagomes has joined #openstack-infra | 06:51 | |
*** rwsu has joined #openstack-infra | 06:51 | |
AJaeger | prabu: please provide some context on where you hit this error | 06:51 |
*** thorst_ has quit IRC | 06:52 | |
*** pcaruana has joined #openstack-infra | 06:52 | |
*** amitgandhinz has joined #openstack-infra | 06:52 | |
*** _nadya_ has quit IRC | 06:54 | |
Srinu | Hi | 06:57 |
*** amitgandhinz has quit IRC | 06:57 | |
Srinu | Jenkins jobs which are in queue are not waiting until slave node is online and running in the same old nodepool vm and while the job in progress it is deleting the old nodepool vm and results failure of the job | 06:57 |
*** jpich has joined #openstack-infra | 07:00 | |
*** aeng has joined #openstack-infra | 07:03 | |
*** sarob has quit IRC | 07:08 | |
*** matrohon has joined #openstack-infra | 07:09 | |
*** zhurong has quit IRC | 07:11 | |
*** pt_15 has quit IRC | 07:13 | |
*** larainema has quit IRC | 07:13 | |
prabu | AJaeger: zuul service is running in the system, now i wanted to read gerrit event stream and trigger a jenkins job as configured in layout.yaml file | 07:13 |
*** zhurong has joined #openstack-infra | 07:13 | |
prabu | i am verifying the connection by 2 methods | 07:13 |
*** jargonmonk has joined #openstack-infra | 07:13 | |
prabu | 1. ssh -p 29418 user@review.openstack.org | 07:14 |
prabu | its perfectly working fine and i am able to read the gerrit streams | 07:14 |
prabu | ssh -p 29418 user@review.openstack.org gerrit stream-events | 07:14 |
AJaeger | prabu: so, this is a third party system? There's a separate channel for that, please use that one. Btw. right now nobody from the OpenStack infra team is around to help either. | 07:14 |
*** ociuhandu has joined #openstack-infra | 07:15 | |
AJaeger | prabu: channel is openstack-third-party-ci | 07:15 |
prabu | yes it's a third party system | 07:15 |
prabu | thank you so much Ajaeger | 07:15 |
Srinu | AJaeger: Hi. jenkins jobs which are in queue are not waiting until slave node is online and running in the same old nodepool vm and while the job in progress it is deleting the old nodepool vm and results failure of the job | 07:16 |
AJaeger | Srinu: Do you speak about zuul-launcher? jeblair, pabelanger, and others are asleep now. If you have some more information - including log files, please leave them here, so that they can followup once they are awake (US time). | 07:16 |
AJaeger | Srinu: no need to repeat yourself | 07:16 |
Srinu | AJaeger: Which logs i have to sencd | 07:17 |
AJaeger | Srinu: Those that show the behaviour. This is OpenStack CI - or a third-pary system? | 07:18 |
*** zhurong has quit IRC | 07:18 | |
AJaeger | For third-party system, see my answer to prabu. | 07:18 |
AJaeger | If it's OpenStack CI, use paste.openstack.org or a link to log files. | 07:18 |
*** zhurong has joined #openstack-infra | 07:18 | |
*** woodster_ has quit IRC | 07:18 | |
*** amoralej|off is now known as amoralej | 07:19 | |
Srinu | AJaeger: i am using third party openstack ci | 07:20 |
AJaeger | Srinu: with zuul-launcher or jenkins? | 07:20 |
Srinu | AJaeger: Jenkins | 07:22 |
*** netsin has quit IRC | 07:22 | |
AJaeger | Srinu: ok. Read my answer to prabu, please and discuss with other third party operators... | 07:23 |
* AJaeger cannot help more in this area than giving these pointers | 07:24 | |
*** roxanaghe has joined #openstack-infra | 07:25 | |
*** ihrachys has joined #openstack-infra | 07:25 | |
*** Na3iL has joined #openstack-infra | 07:26 | |
*** chlong|rhce_trng has quit IRC | 07:27 | |
*** roxanaghe has quit IRC | 07:30 | |
*** kaisers has joined #openstack-infra | 07:32 | |
*** yaume has joined #openstack-infra | 07:35 | |
*** markvoelker has joined #openstack-infra | 07:36 | |
*** jed56 has joined #openstack-infra | 07:37 | |
*** kushal has quit IRC | 07:37 | |
*** infra-red has joined #openstack-infra | 07:38 | |
*** infra-red has quit IRC | 07:38 | |
*** mohankumar has quit IRC | 07:38 | |
*** vincentll has joined #openstack-infra | 07:40 | |
*** hashar has joined #openstack-infra | 07:40 | |
*** nmagnezi has joined #openstack-infra | 07:40 | |
*** kaisers has quit IRC | 07:40 | |
*** markvoelker has quit IRC | 07:41 | |
*** kaisers has joined #openstack-infra | 07:41 | |
*** chem|off has quit IRC | 07:41 | |
*** zhurong has quit IRC | 07:42 | |
*** chem has joined #openstack-infra | 07:44 | |
*** lucasagomes has quit IRC | 07:46 | |
*** lucasagomes has joined #openstack-infra | 07:47 | |
*** mikelk has joined #openstack-infra | 07:48 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Fix tempest configuration https://review.openstack.org/331997 | 07:50 |
*** thorst_ has joined #openstack-infra | 07:50 | |
*** mohankumar has joined #openstack-infra | 07:51 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE TESTING https://review.openstack.org/316436 | 07:51 |
*** amitgandhinz has joined #openstack-infra | 07:53 | |
*** salv-orl_ has quit IRC | 07:53 | |
*** esikachev has joined #openstack-infra | 07:55 | |
*** zhurong has joined #openstack-infra | 07:56 | |
*** chem has quit IRC | 07:56 | |
*** _nadya_ has joined #openstack-infra | 07:56 | |
*** thorst_ has quit IRC | 07:57 | |
*** chem has joined #openstack-infra | 07:57 | |
*** binbincong has joined #openstack-infra | 07:58 | |
*** amitgandhinz has quit IRC | 07:58 | |
*** eezhova has joined #openstack-infra | 07:59 | |
*** zzzeek has quit IRC | 08:00 | |
*** _nadya__ has joined #openstack-infra | 08:00 | |
*** mhickey has joined #openstack-infra | 08:00 | |
*** _nadya_ has quit IRC | 08:01 | |
esikachev | AJaeger: hi! | 08:02 |
esikachev | here? | 08:02 |
*** zzzeek has joined #openstack-infra | 08:03 | |
*** dizquierdo has joined #openstack-infra | 08:04 | |
*** shardy has joined #openstack-infra | 08:05 | |
AJaeger | sometimes, esikachev ;) | 08:05 |
esikachev | AJaeger: about https://review.openstack.org/#/c/329497/9/zuul/layout.yaml, how specify job in 2 projects without dublicates? | 08:07 |
esikachev | *duplicates | 08:07 |
AJaeger | we have many jobs like these, e.g. gate-swift-dsvm-functional-nv | 08:08 |
* esikachev looking... | 08:08 | |
AJaeger | esikachev: or gate-grenade-dsvm-neutron-multinode | 08:08 |
esikachev | ok, thanks! | 08:09 |
AJaeger | esikachev: since your two jobs are just duplicates - there's not any difference between them AFAIU - let's not have twins but a single job that is triggered from two places. | 08:09 |
AJaeger | esikachev: JJB gives you a library of jobs, zuul tells you when to schedule them... | 08:10 |
AJaeger | hope that helps, I'll be back later.. | 08:10 |
*** e0ne has joined #openstack-infra | 08:11 | |
*** matrohon has quit IRC | 08:12 | |
*** dfflanders has joined #openstack-infra | 08:12 | |
*** zhurong has quit IRC | 08:13 | |
*** Julien-zte has quit IRC | 08:15 | |
*** kzaitsev_mb has joined #openstack-infra | 08:16 | |
*** hosanai_ has quit IRC | 08:17 | |
*** zhurong has joined #openstack-infra | 08:17 | |
*** dmk0202 has joined #openstack-infra | 08:18 | |
*** Julien-zte has joined #openstack-infra | 08:19 | |
*** salv-orlando has joined #openstack-infra | 08:19 | |
*** zhurong has quit IRC | 08:19 | |
*** kzaitsev_mb has quit IRC | 08:21 | |
*** zhurong has joined #openstack-infra | 08:23 | |
*** jlanoux has joined #openstack-infra | 08:23 | |
openstackgerrit | Evgeny Sikachev proposed openstack-infra/project-config: Migrated sahara-client-functional-job https://review.openstack.org/329497 | 08:23 |
*** eezhova has quit IRC | 08:24 | |
*** hosanai_ has joined #openstack-infra | 08:25 | |
*** roxanaghe has joined #openstack-infra | 08:26 | |
*** hosanai_ has quit IRC | 08:26 | |
*** larainema has joined #openstack-infra | 08:29 | |
*** roxanaghe has quit IRC | 08:30 | |
*** shardy has quit IRC | 08:32 | |
*** mohankumar has quit IRC | 08:32 | |
*** ociuhandu has quit IRC | 08:34 | |
*** dfflanders has quit IRC | 08:35 | |
*** yolanda has joined #openstack-infra | 08:39 | |
*** dmk0202 has quit IRC | 08:42 | |
*** zeih has joined #openstack-infra | 08:43 | |
*** armax has quit IRC | 08:44 | |
electrofelix | zaro: don't know what RTD refers to? | 08:44 |
*** derekh has joined #openstack-infra | 08:44 | |
*** _degorenko|afk is now known as degorenko | 08:45 | |
*** HeOS has quit IRC | 08:45 | |
*** acoles_ is now known as acoles | 08:45 | |
*** mohankumar has joined #openstack-infra | 08:46 | |
*** pt_15 has joined #openstack-infra | 08:46 | |
*** zhurong has quit IRC | 08:46 | |
*** permalac__ has quit IRC | 08:47 | |
openstackgerrit | Merged openstack-infra/project-config: Notify puppet-openstack_infra_spec_helper events in the infra channel https://review.openstack.org/331926 | 08:48 |
*** jargonmonk has quit IRC | 08:49 | |
*** maishsk has quit IRC | 08:49 | |
openstackgerrit | Merged openstack-infra/project-config: Run Swift functional tests in Identity v3-only https://review.openstack.org/313659 | 08:49 |
*** permalac has joined #openstack-infra | 08:50 | |
*** BobBall_AWOL is now known as BobBall | 08:52 | |
*** markusry has joined #openstack-infra | 08:53 | |
*** vincentll has quit IRC | 08:53 | |
*** vincentll has joined #openstack-infra | 08:53 | |
openstackgerrit | Merged openstack-infra/project-config: Add stable/mitaka branch for #openstack-ansible https://review.openstack.org/331775 | 08:53 |
openstackgerrit | Merged openstack-infra/project-config: Run Magnum functional tests in Identity v3-only https://review.openstack.org/315118 | 08:54 |
*** amitgandhinz has joined #openstack-infra | 08:54 | |
*** zhurong has joined #openstack-infra | 08:57 | |
*** amitgandhinz has quit IRC | 08:58 | |
*** roxanaghe has joined #openstack-infra | 09:01 | |
*** maishsk has joined #openstack-infra | 09:02 | |
*** ociuhandu has joined #openstack-infra | 09:02 | |
*** javeriak has quit IRC | 09:04 | |
openstackgerrit | Merged openstack-infra/project-config: Make ironic grenade voting https://review.openstack.org/331422 | 09:04 |
*** dfflanders has joined #openstack-infra | 09:04 | |
*** roxanaghe has quit IRC | 09:05 | |
openstackgerrit | Merged openstack-infra/project-config: Run cinderclient functional tests in Identity v3-only https://review.openstack.org/313562 | 09:06 |
openstackgerrit | Merged openstack-infra/project-config: Use ironic-core for ironic-python-agent ACLs https://review.openstack.org/331425 | 09:07 |
*** jaosorior has quit IRC | 09:09 | |
*** jaosorior has joined #openstack-infra | 09:10 | |
*** javeriak has joined #openstack-infra | 09:13 | |
*** ramishra has quit IRC | 09:13 | |
*** ramishra has joined #openstack-infra | 09:13 | |
*** matrohon has joined #openstack-infra | 09:15 | |
*** eezhova has joined #openstack-infra | 09:17 | |
rdx_matt | I've mistakenly named my branch bb/<blueprint_name> instead of bp/<blueprint_name>. Should submit a new review? If so, how do I delete the old review? | 09:17 |
*** openstackgerrit has quit IRC | 09:18 | |
*** openstackgerrit has joined #openstack-infra | 09:18 | |
*** rdxMatt has joined #openstack-infra | 09:18 | |
rdxMatt | I've mistakenly named my branch bb/<blueprint_name> instead of bp/<blueprint_name>. Should submit a new review? If so, how do I delete the old review? | 09:19 |
*** zhurong has quit IRC | 09:19 | |
*** eezhova has quit IRC | 09:22 | |
*** zhurong has joined #openstack-infra | 09:23 | |
*** ramishra has quit IRC | 09:23 | |
*** ociuhandu has quit IRC | 09:23 | |
*** ociuhandu_ has joined #openstack-infra | 09:23 | |
*** ociuhandu_ is now known as ociuhandu | 09:24 | |
*** amotoki has quit IRC | 09:24 | |
*** mohankumar has quit IRC | 09:26 | |
AJaeger | rdxMatt: just go to review.openstack.org/YOUR_CHANGE and adjust in the UI | 09:27 |
AJaeger | Change the TOPIC in the ui and all is fine... | 09:28 |
*** ifarkas has joined #openstack-infra | 09:28 | |
*** ramishra has joined #openstack-infra | 09:29 | |
*** HeOS has joined #openstack-infra | 09:32 | |
*** ianychoi has joined #openstack-infra | 09:33 | |
*** rdxMatt has quit IRC | 09:34 | |
openstackgerrit | Merged openstack-infra/project-config: Add networking-extreme project to neutron https://review.openstack.org/322803 | 09:34 |
*** armax has joined #openstack-infra | 09:34 | |
*** eezhova has joined #openstack-infra | 09:35 | |
*** esikachev has quit IRC | 09:37 | |
*** locust has joined #openstack-infra | 09:37 | |
*** esikachev has joined #openstack-infra | 09:37 | |
*** markvoelker has joined #openstack-infra | 09:37 | |
locust | hello, I am setting up CI and I am loking for documentation | 09:37 |
locust | I know about http://docs.openstack.org/infra/openstackci/third_party_ci.html#configure-masterless-puppet | 09:38 |
openstackgerrit | Merged openstack-infra/project-config: add networking-sfc gate for functional tests and tempest tests https://review.openstack.org/324135 | 09:38 |
*** eezhova has quit IRC | 09:38 | |
locust | but it looks that is not enough for me to understand what is going on | 09:38 |
openstackgerrit | Merged openstack-infra/project-config: Add Rally job against deployment with existing users https://review.openstack.org/328249 | 09:39 |
locust | may be there is some pre definde configs or tutorial of step by step with configs and description? | 09:39 |
openstackgerrit | Merged openstack-infra/project-config: Add devstack-plugin-mariadb as new project https://review.openstack.org/320983 | 09:41 |
rcarrillocruz | locust: check puppet-openstackci project | 09:42 |
rcarrillocruz | it's a project specifically for deploying 3rd party CI | 09:42 |
*** markvoelker has quit IRC | 09:43 | |
openstackgerrit | Merged openstack-infra/project-config: Enable Tempest test job also for sahara-tests https://review.openstack.org/329590 | 09:43 |
*** ociuhandu_ has joined #openstack-infra | 09:47 | |
*** ociuhandu has quit IRC | 09:47 | |
*** ociuhandu_ is now known as ociuhandu | 09:47 | |
*** zhurong has quit IRC | 09:47 | |
*** zhurong has joined #openstack-infra | 09:48 | |
*** winggundamth has quit IRC | 09:49 | |
*** zhurong has quit IRC | 09:50 | |
*** Julien-zte has quit IRC | 09:50 | |
*** kzaitsev_mb has joined #openstack-infra | 09:51 | |
*** Guest97986 has quit IRC | 09:52 | |
*** sree has joined #openstack-infra | 09:52 | |
*** eezhova has joined #openstack-infra | 09:54 | |
*** ociuhandu has quit IRC | 09:54 | |
*** amitgandhinz has joined #openstack-infra | 09:55 | |
*** maishsk has quit IRC | 09:56 | |
*** genunix has joined #openstack-infra | 09:56 | |
*** kzaitsev_mb has quit IRC | 09:56 | |
openstackgerrit | Hisashi Osanai proposed openstack-infra/project-config: Fix Monasca Analytics python27 job https://review.openstack.org/331535 | 09:56 |
*** sree has quit IRC | 09:56 | |
*** armax has quit IRC | 09:58 | |
*** pilgrimstack has joined #openstack-infra | 09:58 | |
*** amitgandhinz has quit IRC | 09:59 | |
*** ramishra has quit IRC | 09:59 | |
locust | rcarrillocruz: thank you | 10:00 |
locust | may be you know any shared CI git repo for single node | 10:00 |
locust | that can be used as example? | 10:01 |
*** roxanaghe has joined #openstack-infra | 10:02 | |
rcarrillocruz | not really, because the 3rd party cis conf are really private | 10:03 |
rcarrillocruz | contain keys etc | 10:03 |
rcarrillocruz | check the contrib folder | 10:03 |
openstackgerrit | Dmitry Ilyin proposed openstack-infra/project-config: Add puppet-4.5 unit test to the fuel-library https://review.openstack.org/332049 | 10:03 |
rcarrillocruz | it contains a hiera.yml | 10:03 |
rcarrillocruz | with dummy values | 10:03 |
rcarrillocruz | just put yours | 10:03 |
rcarrillocruz | you should be good | 10:03 |
*** eantyshev has joined #openstack-infra | 10:03 | |
eantyshev | jhesketh, jeblair: Hello! Our CI suffers from occasional hangups, which are dealt with here: https://review.openstack.org/#/c/238988 | 10:04 |
*** ramishra has joined #openstack-infra | 10:04 | |
*** tqtran has quit IRC | 10:05 | |
locust | rcarrillocruz: can I setup log server on the same machine with Puppet? | 10:06 |
rcarrillocruz | i guess so | 10:06 |
*** roxanaghe has quit IRC | 10:06 | |
rcarrillocruz | just put the relevant class on the same node you put the other stuff like nodepool, zuul etc | 10:06 |
locust | and it is not the part of puppet | 10:06 |
*** mohankumar has joined #openstack-infra | 10:07 | |
*** yolanda has quit IRC | 10:08 | |
*** sshnaidm is now known as sshnaidm|afk | 10:08 | |
*** lvdongbing has quit IRC | 10:09 | |
*** eezhova has quit IRC | 10:11 | |
*** hosanai has quit IRC | 10:12 | |
openstackgerrit | Dmitry Ilyin proposed openstack-infra/project-config: Change puppet-4.0 unit test to puppet-4.5 https://review.openstack.org/332049 | 10:13 |
openstackgerrit | Dmitry Ilyin proposed openstack-infra/project-config: Change puppet-4.0 unit test to puppet-4.5 https://review.openstack.org/332049 | 10:14 |
*** amotoki has joined #openstack-infra | 10:17 | |
openstackgerrit | Evgeny Sikachev proposed openstack-infra/project-config: Migrated sahara-client-functional-job https://review.openstack.org/329497 | 10:18 |
andreaf | here: a project-config change for review please https://review.openstack.org/#/c/329723/ | 10:22 |
*** ihrachys has quit IRC | 10:22 | |
*** winggundamth has joined #openstack-infra | 10:23 | |
milan | Hey Infra, I'm running grenade for Ironic inspector and grenade/inc/upgrade:save_mysql_dbs fails for me because of wrong DB name (ironic-inspector --- the project name). Correct db name is ironic_inspector. I'm wondering where is the best spot to override the database name. Thanks a lot! | 10:23 |
AJaeger | andreaf: since it runs against tempest, please get tempest folks to review it - ask openstack QA team to review and +1. | 10:23 |
AJaeger | milan: grenade is done by QA team - I suggest to ask on #openstack-qa channel | 10:24 |
milan | AJaeger, thx, will do | 10:24 |
andreaf | AJaeger: ok, sure - I discussed this in http://lists.openstack.org/pipermail/openstack-dev/2016-June/097383.html and with few folks already but I'll ask them to +1 | 10:25 |
*** sambetts|afk is now known as sambetts | 10:25 | |
openstackgerrit | Evgeny Sikachev proposed openstack-infra/project-config: Migrated sahara-client-functional-job https://review.openstack.org/329497 | 10:26 |
AJaeger | andreaf: add that link to your commit message - or at least as comment. That will help in evaluating the change... | 10:26 |
*** pilgrimstack has quit IRC | 10:27 | |
*** tosky has joined #openstack-infra | 10:27 | |
*** maishsk has joined #openstack-infra | 10:27 | |
*** winggundamth has quit IRC | 10:28 | |
*** eezhova has joined #openstack-infra | 10:28 | |
*** amrith has quit IRC | 10:28 | |
andreaf | heh, I should have done that already | 10:29 |
andreaf | sorry | 10:29 |
*** amrith has joined #openstack-infra | 10:29 | |
openstackgerrit | Kota Tsuyuzaki proposed openstack-infra/project-config: WIP: Enable storlets to show test_result https://review.openstack.org/332065 | 10:30 |
*** yanyanhu has quit IRC | 10:30 | |
openstackgerrit | Zara proposed openstack-infra/python-storyboardclient: Add boards https://review.openstack.org/299445 | 10:32 |
*** eezhova has quit IRC | 10:32 | |
*** amrith has quit IRC | 10:32 | |
*** eezhova has joined #openstack-infra | 10:33 | |
*** amrith has joined #openstack-infra | 10:33 | |
*** rfolco has joined #openstack-infra | 10:35 | |
*** rfolco has quit IRC | 10:35 | |
*** pilgrimstack has joined #openstack-infra | 10:38 | |
*** ramishra has quit IRC | 10:38 | |
*** ramishra has joined #openstack-infra | 10:38 | |
*** markvoelker has joined #openstack-infra | 10:38 | |
*** winggundamth has joined #openstack-infra | 10:40 | |
*** zeih has quit IRC | 10:41 | |
*** markvoelker has quit IRC | 10:43 | |
*** sdague has joined #openstack-infra | 10:43 | |
*** eezhova has quit IRC | 10:49 | |
*** chlong|rhce_trng has joined #openstack-infra | 10:50 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/system-config: Add Zara to StoryBoard Admin https://review.openstack.org/329092 | 10:50 |
openstackgerrit | Adam Coldrick proposed openstack-infra/system-config: Add Adam Coldrick to StoryBoard Admin https://review.openstack.org/332072 | 10:50 |
*** hdaniel has joined #openstack-infra | 10:51 | |
*** eezhova has joined #openstack-infra | 10:52 | |
*** amitgandhinz has joined #openstack-infra | 10:55 | |
*** ArxCruz has joined #openstack-infra | 10:56 | |
*** eezhova has quit IRC | 10:56 | |
*** eezhova has joined #openstack-infra | 10:59 | |
*** rodrigods has quit IRC | 11:00 | |
*** rodrigods has joined #openstack-infra | 11:00 | |
*** amitgandhinz has quit IRC | 11:00 | |
*** roxanaghe has joined #openstack-infra | 11:02 | |
*** Julien-zte has joined #openstack-infra | 11:03 | |
*** kzaitsev_mb has joined #openstack-infra | 11:03 | |
*** ikhudoshyn has quit IRC | 11:05 | |
*** armax has joined #openstack-infra | 11:06 | |
*** makowals has joined #openstack-infra | 11:06 | |
*** lucasagomes is now known as lucas-afk | 11:06 | |
*** yaume has quit IRC | 11:07 | |
*** roxanaghe has quit IRC | 11:07 | |
*** sree__ has joined #openstack-infra | 11:07 | |
*** eezhova has quit IRC | 11:09 | |
*** abregman is now known as abregman|afk | 11:10 | |
openstackgerrit | Kota Tsuyuzaki proposed openstack-infra/project-config: Enable storlets to show test_result https://review.openstack.org/332065 | 11:10 |
*** eezhova has joined #openstack-infra | 11:11 | |
*** sree__ has quit IRC | 11:11 | |
*** sorantis has joined #openstack-infra | 11:11 | |
*** kushal has joined #openstack-infra | 11:12 | |
*** pilgrimstack has quit IRC | 11:13 | |
*** abregman|afk is now known as abregman|pto | 11:13 | |
*** javeriak has quit IRC | 11:14 | |
*** sorantis has quit IRC | 11:14 | |
openstackgerrit | Mário Santos proposed openstack-infra/shade: Add support for changing metadata of compute instances https://review.openstack.org/319395 | 11:17 |
*** javeriak has joined #openstack-infra | 11:18 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add quick non-permanent filter buttons for timeline events https://review.openstack.org/331748 | 11:19 |
*** amotoki has quit IRC | 11:22 | |
*** dfflanders has quit IRC | 11:23 | |
*** sree has joined #openstack-infra | 11:23 | |
*** pilgrimstack has joined #openstack-infra | 11:24 | |
*** ihrachys has joined #openstack-infra | 11:24 | |
*** ihrachys has quit IRC | 11:26 | |
*** sree has quit IRC | 11:27 | |
*** prabu has quit IRC | 11:29 | |
*** zeih has joined #openstack-infra | 11:31 | |
*** sree has joined #openstack-infra | 11:32 | |
*** ArxCruz has quit IRC | 11:32 | |
*** sorantis has joined #openstack-infra | 11:32 | |
*** armax has quit IRC | 11:33 | |
*** zhurong has joined #openstack-infra | 11:33 | |
*** ihrachys has joined #openstack-infra | 11:34 | |
*** links has quit IRC | 11:35 | |
*** ldnunes has joined #openstack-infra | 11:35 | |
*** sree has quit IRC | 11:36 | |
openstackgerrit | Evgeny Sikachev proposed openstack-infra/project-config: Migrated sahara-client-functional-job https://review.openstack.org/329497 | 11:36 |
*** sree has joined #openstack-infra | 11:36 | |
*** sree___ has joined #openstack-infra | 11:37 | |
*** makowals has quit IRC | 11:38 | |
*** salv-orl_ has joined #openstack-infra | 11:39 | |
openstackgerrit | Dmitry Ilyin proposed openstack-infra/project-config: Add puppet-4.5 unit tests to the fuel-library https://review.openstack.org/332049 | 11:39 |
*** makowals has joined #openstack-infra | 11:39 | |
openstackgerrit | Ofer Ben-Yacov proposed openstack-infra/project-config: Add new project: networking-icc https://review.openstack.org/332091 | 11:39 |
*** markvoelker has joined #openstack-infra | 11:39 | |
*** makowals has quit IRC | 11:39 | |
*** makowals has joined #openstack-infra | 11:40 | |
*** sree has quit IRC | 11:41 | |
*** salv-orlando has quit IRC | 11:41 | |
*** pilgrimstack has quit IRC | 11:41 | |
*** ociuhandu has joined #openstack-infra | 11:42 | |
*** ccamacho is now known as ccamacho|lunch | 11:42 | |
*** sree___ has quit IRC | 11:42 | |
*** weshay has joined #openstack-infra | 11:43 | |
*** armax has joined #openstack-infra | 11:43 | |
openstackgerrit | Kirill Zaitsev proposed openstack-infra/project-config: Make murano-agent py34 job voting https://review.openstack.org/332093 | 11:44 |
*** rfolco has joined #openstack-infra | 11:45 | |
*** pilgrimstack has joined #openstack-infra | 11:45 | |
*** markvoelker has quit IRC | 11:46 | |
*** links has joined #openstack-infra | 11:47 | |
*** dizquierdo has quit IRC | 11:48 | |
*** ldnunes_ has joined #openstack-infra | 11:49 | |
*** javeriak has quit IRC | 11:49 | |
mordred | 082793 | 11:49 |
mordred | 325189 | 11:50 |
openstackgerrit | Dmitry Ilyin proposed openstack-infra/project-config: Change puppet-4.0 unit test to puppet-4.5 https://review.openstack.org/332049 | 11:50 |
*** ociuhandu has quit IRC | 11:51 | |
*** ociuhandu_ has joined #openstack-infra | 11:51 | |
*** ociuhandu_ is now known as ociuhandu | 11:51 | |
openstackgerrit | Kirill Zaitsev proposed openstack-infra/project-config: Make murano-agent py34 job voting https://review.openstack.org/332093 | 11:53 |
AJaeger | mordred: What kind of code is this today? | 11:54 |
*** salv-orl_ has quit IRC | 11:54 | |
*** ldnunes_ has quit IRC | 11:54 | |
*** sree has joined #openstack-infra | 11:55 | |
AJaeger | http://www.fileformat.info/info/unicode/char/4f645/index.htm - 325189 is not valid unicode ;) | 11:55 |
*** amitgandhinz has joined #openstack-infra | 11:56 | |
*** aysyd has joined #openstack-infra | 11:56 | |
*** hdaniel has quit IRC | 11:57 | |
*** Julien-zte has quit IRC | 11:59 | |
*** sree has quit IRC | 11:59 | |
*** pilgrimstack has quit IRC | 11:59 | |
*** sshnaidm|afk is now known as sshnaidm | 12:00 | |
*** sree has joined #openstack-infra | 12:00 | |
*** amitgandhinz has quit IRC | 12:00 | |
*** dtantsur|afk is now known as dtantsur | 12:01 | |
*** haaj has joined #openstack-infra | 12:02 | |
*** roxanaghe has joined #openstack-infra | 12:03 | |
*** haaj has quit IRC | 12:03 | |
*** haaj has joined #openstack-infra | 12:03 | |
*** esikachev has quit IRC | 12:04 | |
*** shardy has joined #openstack-infra | 12:04 | |
*** shardy has quit IRC | 12:04 | |
*** psilvad has joined #openstack-infra | 12:04 | |
*** rossella_s has joined #openstack-infra | 12:05 | |
*** raildo-afk is now known as raildo | 12:07 | |
openstackgerrit | Merged openstack-infra/zuul: Add support for bindep https://review.openstack.org/325519 | 12:07 |
*** dprince has joined #openstack-infra | 12:07 | |
*** roxanaghe has quit IRC | 12:08 | |
*** yolanda has joined #openstack-infra | 12:08 | |
*** ramishra has quit IRC | 12:08 | |
*** pilgrimstack has joined #openstack-infra | 12:09 | |
*** psilvad has quit IRC | 12:10 | |
*** hdaniel has joined #openstack-infra | 12:10 | |
*** krtaylor has quit IRC | 12:11 | |
*** tpsilva has joined #openstack-infra | 12:13 | |
*** ramishra has joined #openstack-infra | 12:13 | |
openstackgerrit | Merged openstack-infra/zuul: Make console log output use deliminator https://review.openstack.org/331892 | 12:13 |
*** pilgrimstack has quit IRC | 12:13 | |
amrith | timeout errors on launchpad, doesn't bode well for the rest of the day ... | 12:14 |
*** krtaylor has joined #openstack-infra | 12:15 | |
*** markvoelker has joined #openstack-infra | 12:16 | |
*** pilgrimstack has joined #openstack-infra | 12:16 | |
*** pradk has joined #openstack-infra | 12:18 | |
*** ifarkas has quit IRC | 12:18 | |
*** ifarkas has joined #openstack-infra | 12:19 | |
*** esikachev has joined #openstack-infra | 12:19 | |
*** kgiusti has joined #openstack-infra | 12:19 | |
*** salv-orlando has joined #openstack-infra | 12:20 | |
*** psilvad has joined #openstack-infra | 12:20 | |
*** armax has quit IRC | 12:20 | |
*** gordc has joined #openstack-infra | 12:22 | |
*** ddieterly has joined #openstack-infra | 12:22 | |
*** garyk1 has quit IRC | 12:23 | |
*** yamamot__ has quit IRC | 12:23 | |
*** rossella_s has quit IRC | 12:24 | |
*** ramishra has quit IRC | 12:24 | |
*** kushal has quit IRC | 12:24 | |
*** ccamacho|lunch is now known as ccamacho | 12:25 | |
*** amoralej is now known as amoralej|lunch | 12:25 | |
*** armax has joined #openstack-infra | 12:27 | |
*** eezhova has quit IRC | 12:28 | |
*** pilgrimstack has quit IRC | 12:29 | |
*** rossella_s has joined #openstack-infra | 12:29 | |
*** yaume has joined #openstack-infra | 12:32 | |
*** links has quit IRC | 12:33 | |
*** zhurong has quit IRC | 12:35 | |
*** armax has quit IRC | 12:35 | |
*** zul has quit IRC | 12:35 | |
*** armax has joined #openstack-infra | 12:35 | |
*** ddieterly has quit IRC | 12:35 | |
*** zul has joined #openstack-infra | 12:35 | |
*** tkelsey has joined #openstack-infra | 12:37 | |
*** esikachev has quit IRC | 12:38 | |
openstackgerrit | Dmitry Ilyin proposed openstack-infra/project-config: Change puppet-4.0 unit test to puppet-4.5 https://review.openstack.org/332049 | 12:39 |
mordred | AJaeger: I'm bad at not hitting a button my laptop :) | 12:40 |
Srinu | asselin__:Hi | 12:40 |
*** daemontool has joined #openstack-infra | 12:40 | |
*** ArxCruz has joined #openstack-infra | 12:41 | |
*** matt-borland has joined #openstack-infra | 12:41 | |
*** ramishra has joined #openstack-infra | 12:42 | |
*** rlandy has joined #openstack-infra | 12:42 | |
*** baoli has joined #openstack-infra | 12:43 | |
*** esikachev has joined #openstack-infra | 12:46 | |
*** links has joined #openstack-infra | 12:46 | |
pabelanger | mordred: I added a comment to 331426 about extra_vars, mind checking when you had bandwidth? | 12:46 |
*** trown|outtypewww is now known as trown | 12:47 | |
*** cbader has quit IRC | 12:49 | |
mordred | pabelanger: OH! my bad - in the new world where we don't actually read the timeout in the timeout plugin but instead just register elapsed time, this totally works now | 12:49 |
*** ociuhandu_ has joined #openstack-infra | 12:49 | |
*** ociuhandu has quit IRC | 12:49 | |
*** ociuhandu_ is now known as ociuhandu | 12:49 | |
*** baoli_ has joined #openstack-infra | 12:49 | |
*** ArxCruz has quit IRC | 12:50 | |
derekh | Is there anybody around to take a look at adding a new cloud rh2 for tripleo ci https://review.openstack.org/#/c/330514/3 | 12:51 |
derekh | and a experimental job to test it out https://review.openstack.org/#/c/330515/3 | 12:51 |
*** baoli has quit IRC | 12:52 | |
mordred | derekh: did you see pabelanger's comment? | 12:52 |
*** rhallisey has joined #openstack-infra | 12:52 | |
mordred | derekh: on 330514 - re: AFS mirror | 12:53 |
pabelanger | mordred: Oh, right. Now I see what you were saying about extra_vars. | 12:53 |
openstackgerrit | Merged openstack-infra/storyboard: Allow tags to be filtered by name https://review.openstack.org/331027 | 12:53 |
pabelanger | mordred: I should see if that could be updated to use the combined vars. But, not the case any more | 12:53 |
*** ArxCruz has joined #openstack-infra | 12:54 | |
*** ArxCruz has quit IRC | 12:55 | |
*** erlon has joined #openstack-infra | 12:55 | |
mordred | pabelanger: yup. yay! | 12:55 |
derekh | mordred: i hadn't, pabelanger I'll create a flavor with 100G in a few minutes | 12:55 |
*** ddieterly has joined #openstack-infra | 12:56 | |
*** jcoufal has joined #openstack-infra | 12:56 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Use gear module from pip https://review.openstack.org/332123 | 12:57 |
*** kushal has joined #openstack-infra | 12:57 | |
*** grassass has quit IRC | 13:00 | |
*** ramishra has quit IRC | 13:00 | |
*** cbader has joined #openstack-infra | 13:01 | |
*** eezhova has joined #openstack-infra | 13:01 | |
andreaf | AJaeger: got a couple of +1 from QA on https://review.openstack.org/#/c/329723/ | 13:03 |
*** roxanaghe has joined #openstack-infra | 13:04 | |
*** Julien-zte has joined #openstack-infra | 13:05 | |
*** ramishra has joined #openstack-infra | 13:05 | |
AJaeger | andreaf: I'd like to have one from mtreinish or oomichi as well, especially after reading oomichi's mail in your thread. | 13:06 |
*** ddieterly has quit IRC | 13:06 | |
derekh | pabelanger: flavor created on rh2 "d1.medium", can't we approve rh2 anyways and the experimental job so that other tests can happen in parallel? | 13:07 |
*** salv-orlando has quit IRC | 13:07 | |
*** tlian has joined #openstack-infra | 13:07 | |
derekh | pabelanger: gotta run, back later tonight | 13:08 |
andreaf | AJaeger: sure | 13:08 |
*** roxanaghe has quit IRC | 13:08 | |
*** amitgandhinz has joined #openstack-infra | 13:09 | |
pabelanger | derekh: you can remove the configure_mirror.sh script, that'll get the nodes online | 13:09 |
*** edmondsw has joined #openstack-infra | 13:10 | |
*** afred312 has quit IRC | 13:11 | |
*** grassass has joined #openstack-infra | 13:12 | |
*** locust has quit IRC | 13:12 | |
*** zz_dimtruck is now known as dimtruck | 13:13 | |
*** esikachev has quit IRC | 13:13 | |
*** Srinu has quit IRC | 13:13 | |
*** esikachev has joined #openstack-infra | 13:14 | |
*** sigmavirus24_awa is now known as sigmavirus24 | 13:14 | |
*** amitgandhinz has quit IRC | 13:14 | |
*** Srinu has joined #openstack-infra | 13:15 | |
*** haaj has quit IRC | 13:15 | |
*** eezhova has quit IRC | 13:15 | |
*** gouthamr has joined #openstack-infra | 13:16 | |
mtreinish | AJaeger: which patch? | 13:16 |
Srinu | gouthamr: Hi | 13:16 |
*** mdrabe has joined #openstack-infra | 13:16 | |
*** psilvad has quit IRC | 13:16 | |
gouthamr | Srinu: hi! | 13:16 |
AJaeger | mtreinish: https://review.openstack.org/#/c/329723/ | 13:16 |
Srinu | gouthamr: i am using Openstack CI in that i am running jenkins job | 13:17 |
Srinu | gouthamr:jenkins jobs which are in queue are not waiting until slave node is online and running in the same old nodepool vm and while the job in progress it is deleting the old nodepool vm and running another job that is in queue. | 13:17 |
*** xyang1 has joined #openstack-infra | 13:17 | |
mtreinish | AJaeger: oh that one, yeah +1. I was the one who asked andreaf to start with the layer4 job so we didn't effect anyone elses gate as we ramped that up | 13:18 |
Srinu | gouthamr: this is the nodepool log http://paste.openstack.org/show/520897/ | 13:18 |
*** Julien-zte has quit IRC | 13:18 | |
AJaeger | mtreinish: thanks, mtreinish. andreaf, will +2 now... | 13:18 |
*** sree_ has joined #openstack-infra | 13:18 | |
*** esikachev has quit IRC | 13:19 | |
*** sree has quit IRC | 13:19 | |
*** sree_ is now known as Guest55489 | 13:19 | |
gouthamr | Srinu: your question's in the right channel, but i'm not too familiar with nodepool... probably fungi, AJaeger can help? | 13:19 |
*** amoralej|lunch is now known as amoralej | 13:20 | |
*** fifieldt has joined #openstack-infra | 13:20 | |
*** bhavik has joined #openstack-infra | 13:20 | |
* AJaeger cannot | 13:20 | |
*** esikachev has joined #openstack-infra | 13:21 | |
Srinu | AJaeger: Hi.jenkins jobs which are in queue are not waiting until slave node is online and running in the same old nodepool vm and while the job in progress it is deleting the old nodepool vm and running another job that is in queue. this is the nodepool logs http://paste.openstack.org/show/520897/ | 13:21 |
*** ramishra has quit IRC | 13:22 | |
*** esberglu has joined #openstack-infra | 13:22 | |
*** links has quit IRC | 13:23 | |
pabelanger | Srinu: Have you set OFFLINE_NODE_WHEN_COMPLETE? http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/openstack_functions.py#n47 | 13:24 |
*** inc0 has joined #openstack-infra | 13:24 | |
openstackgerrit | Merged openstack-infra/project-config: Zun: rename higgins to zun (1) https://review.openstack.org/326306 | 13:26 |
*** e0ne has quit IRC | 13:27 | |
*** _ari_ has joined #openstack-infra | 13:27 | |
Srinu | pabelanger: in openstack_functions.py file i used single_use_node function in that i used params['OFFLINE_NODE_WHEN_COMPLETE'] = '1' | 13:27 |
*** mriedem has joined #openstack-infra | 13:30 | |
Srinu | pabelanger: can you check this nodepool log http://paste.openstack.org/show/520897/ | 13:31 |
*** e0ne has joined #openstack-infra | 13:31 | |
*** akshai has joined #openstack-infra | 13:32 | |
*** burgerk has joined #openstack-infra | 13:32 | |
*** pgadiya has quit IRC | 13:33 | |
Srinu | pabelanger : i am using this code in openstack_function.py can you check this and tell me anything to change http://paste.openstack.org/show/520939/ | 13:33 |
*** burgerk_ has joined #openstack-infra | 13:33 | |
*** dizquierdo has joined #openstack-infra | 13:34 | |
*** BigWillie has joined #openstack-infra | 13:34 | |
*** ddieterly has joined #openstack-infra | 13:34 | |
*** hichihara has joined #openstack-infra | 13:34 | |
*** afred312 has joined #openstack-infra | 13:35 | |
*** ajmiller has quit IRC | 13:35 | |
*** rossella_s has quit IRC | 13:35 | |
*** ajmiller has joined #openstack-infra | 13:35 | |
*** sdake has joined #openstack-infra | 13:36 | |
*** yamamoto has joined #openstack-infra | 13:36 | |
*** derekh has quit IRC | 13:36 | |
*** burgerk has quit IRC | 13:37 | |
*** tkelsey has quit IRC | 13:38 | |
*** eharney has joined #openstack-infra | 13:39 | |
Srinu | fungi: Hi | 13:39 |
*** nwkarsten has joined #openstack-infra | 13:41 | |
*** binbincong has quit IRC | 13:41 | |
*** e0ne has quit IRC | 13:41 | |
*** binbincong has joined #openstack-infra | 13:41 | |
Srinu | nwkarsten: hi | 13:41 |
pabelanger | Srinu: your nodepool.log file is raising some exceptions, so nodepool is likely not working correctly. If you look at jenkins logs you'll also be able to see why the jobs are running back to back | 13:43 |
*** yolanda has quit IRC | 13:43 | |
*** shahid__ has quit IRC | 13:45 | |
*** sshnaidm_ has joined #openstack-infra | 13:46 | |
*** PollyZ has joined #openstack-infra | 13:46 | |
*** afred312 has quit IRC | 13:46 | |
*** M-docaedo_vector has quit IRC | 13:47 | |
*** afred312 has joined #openstack-infra | 13:47 | |
Srinu | pabelanger: this is the jenkins log http://paste.openstack.org/show/520941/ | 13:47 |
*** openstackgerrit has quit IRC | 13:48 | |
*** openstackgerrit has joined #openstack-infra | 13:48 | |
*** sshnaidm has quit IRC | 13:48 | |
*** haaj has joined #openstack-infra | 13:48 | |
pabelanger | if I had to guess, jenkins is not putting the node into offline mode, next job runs then nodepool eventually deletes it mid run. For some reason OFFLINE_NODE_WHEN_COMPLETE is not setting up properly. | 13:49 |
*** ajmiller has quit IRC | 13:50 | |
pabelanger | what version of jenkins are you using? Wonder if this is related to CSRF Protection | 13:50 |
*** abregman|pto has quit IRC | 13:51 | |
*** e0ne has joined #openstack-infra | 13:51 | |
*** sorantis has quit IRC | 13:51 | |
*** jkraj has joined #openstack-infra | 13:51 | |
openstackgerrit | Victor Ryzhenkin proposed openstack-infra/project-config: Add openstack/fuel-plugin-murano-tests project https://review.openstack.org/332151 | 13:51 |
Srinu | pabelanger: i am using Jenkins ver. 1.651.2 | 13:51 |
*** afred312 has quit IRC | 13:51 | |
*** kencjohnston has joined #openstack-infra | 13:51 | |
*** kencjohnston has quit IRC | 13:51 | |
zaro | electrofelix: re RTD, wanted to add you as maintainer of https://readthedocs.org/projects/jenkins-job-builder/ | 13:52 |
*** ajmiller has joined #openstack-infra | 13:52 | |
zigo | What's wrong with my patch? | 13:52 |
zigo | https://review.openstack.org/#/c/331008/ | 13:52 |
zigo | I'm stairing at the console logs, but can't find what's wrong. | 13:52 |
*** rbrndt has joined #openstack-infra | 13:52 | |
*** ajmiller has quit IRC | 13:52 | |
zigo | fungi: ^ | 13:52 |
pabelanger | Srinu: I recommend reading up on CSRF Protection, there was a recent thread on our openstack-infra ML. It might be possible you having problems with that | 13:53 |
*** ddieterly is now known as ddieterly[away] | 13:53 | |
Srinu | pabelanger: If the Jobs are not in queue it is deleting the node if the job is success or failure | 13:54 |
*** bhavik has quit IRC | 13:55 | |
*** amitgandhinz has joined #openstack-infra | 13:55 | |
*** eezhova has joined #openstack-infra | 13:56 | |
pabelanger | Srinu: I am not sure I understand. Jenkins slaves will be deleted regardless of success or failure, nodepool will ensure a fresh slave is online for the next job | 13:56 |
Srinu | pabelanger: but in my case it is taking another job in queue | 13:56 |
mrhillsman | g'morning | 13:57 |
*** kencjohnston_ is now known as kencjohnston | 13:57 | |
Srinu | pabelanger: and deleting the slave when it is progress | 13:57 |
Srinu | pabelanger: it is making offline and creating another | 13:57 |
*** kencjohnston has quit IRC | 13:57 | |
pabelanger | Srinu: there is some confusion, what do you expect to happen? | 13:58 |
*** kencjohnston has joined #openstack-infra | 13:58 | |
*** afred312 has joined #openstack-infra | 14:00 | |
Srinu | pabelanger: the first job in queue is passed all the test cases and success, the job in queue is taking same slave and running the job and nexts it is deleting that slave and the test is failed | 14:01 |
*** fifieldt has quit IRC | 14:01 | |
*** jaosorior has quit IRC | 14:01 | |
*** isaacb has quit IRC | 14:01 | |
*** M-docaedo_vector has joined #openstack-infra | 14:02 | |
*** ArxCruz has joined #openstack-infra | 14:02 | |
*** ddieterly[away] is now known as ddieterly | 14:02 | |
*** PollyZ_ has joined #openstack-infra | 14:02 | |
pabelanger | Srinu: right, that is how I understand your problem. Which, I have listed a potential fix. See my comments about CSRF Protection | 14:02 |
*** eezhova has quit IRC | 14:03 | |
*** kencjohnston has quit IRC | 14:03 | |
*** kencjohnston has joined #openstack-infra | 14:04 | |
*** M-docaedo_vector has quit IRC | 14:04 | |
*** roxanaghe has joined #openstack-infra | 14:05 | |
*** zeih has quit IRC | 14:05 | |
*** PollyZ_ has quit IRC | 14:05 | |
Srinu | pabelanger: Can you suggest me a link for CSRF Protection | 14:05 |
*** PollyZ has quit IRC | 14:05 | |
*** PollyZ has joined #openstack-infra | 14:07 | |
*** kencjohnston has quit IRC | 14:07 | |
*** salv-orlando has joined #openstack-infra | 14:08 | |
*** afred312 has quit IRC | 14:08 | |
*** haaj has quit IRC | 14:08 | |
*** afred312 has joined #openstack-infra | 14:08 | |
Srinu | pabelanger: in my Jenkins CSRF Protection is not enable | 14:08 |
*** kencjohnston has joined #openstack-infra | 14:08 | |
*** yamamoto has quit IRC | 14:08 | |
*** yamamoto has joined #openstack-infra | 14:09 | |
*** eezhova has joined #openstack-infra | 14:09 | |
*** roxanaghe has quit IRC | 14:09 | |
*** bhavik has joined #openstack-infra | 14:10 | |
*** zeih has joined #openstack-infra | 14:11 | |
*** kencjohnston has quit IRC | 14:11 | |
*** stevemar has joined #openstack-infra | 14:12 | |
*** kencjohnston has joined #openstack-infra | 14:12 | |
*** M-docaedo_vector has joined #openstack-infra | 14:13 | |
*** kencjohnston has quit IRC | 14:13 | |
*** kencjohnston has joined #openstack-infra | 14:14 | |
*** salv-orlando has quit IRC | 14:14 | |
*** amitgandhinz has quit IRC | 14:14 | |
*** amitgandhinz has joined #openstack-infra | 14:15 | |
*** kencjohnston has quit IRC | 14:15 | |
*** wfoster has quit IRC | 14:16 | |
*** dimtruck is now known as zz_dimtruck | 14:16 | |
*** kencjohnston has joined #openstack-infra | 14:16 | |
fungi | zigo: in the gate | 14:17 |
zigo | fungi: What do you mean? No pb with my patch, that's just an issue with the gate? | 14:17 |
fungi | -project-config-jenkins-project log it has "yaml.scanner.ScannerError: mapping values are not allowed here" so my guess is some syntax issue. looking at the patch now | 14:17 |
zigo | Thanks. | 14:17 |
fungi | zigo: stray newline in my message | 14:17 |
fungi | sorry for the confusion | 14:17 |
*** wfoster has joined #openstack-infra | 14:18 | |
fungi | i was cutting and pasting from lynx and it had wrapped the job name in the log so i didn't notice i was copying a newline | 14:18 |
fungi | zigo: oh, when adding parameters, we need a : after the publisher name. left a comment inline | 14:20 |
fungi | sorry for missing that earlier | 14:20 |
zigo | Oh, I see... | 14:20 |
zigo | I'm still not completely used to yaml, thanks for your patience. | 14:21 |
openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Fix upload path to tarballs.o.o for packaging https://review.openstack.org/331008 | 14:22 |
*** armax has quit IRC | 14:23 | |
*** snarwade has quit IRC | 14:23 | |
*** snarwade has joined #openstack-infra | 14:23 | |
pabelanger | Srinu: http://lists.openstack.org/pipermail/openstack-infra/2016-May/004284.html | 14:23 |
*** jkraj has quit IRC | 14:24 | |
*** yujunz has joined #openstack-infra | 14:25 | |
*** rajinir has joined #openstack-infra | 14:25 | |
Srinu | pabelanger: How can i check is Single Use Slave Plugin enable | 14:26 |
pabelanger | Srinu: you'll need to see if https://git.openstack.org/cgit/openstack-infra/zmq-event-publisher is enabled | 14:27 |
*** tonytan4ever has joined #openstack-infra | 14:28 | |
*** amrith has quit IRC | 14:28 | |
pabelanger | while not a single use plugin, it is the interface used between nodepool and jenkins | 14:28 |
*** yujunz has quit IRC | 14:28 | |
*** amrith has joined #openstack-infra | 14:28 | |
*** isaacb has joined #openstack-infra | 14:29 | |
*** dizquierdo has quit IRC | 14:29 | |
Srinu | pabelanger: it is in enable ZMQ Event Publisher | 14:30 |
Srinu | pabelanger: can you check this link https://wiki.jenkins-ci.org/display/JENKINS/Single+Use+Slave+Plugin | 14:30 |
fungi | Srinu: pabelanger: if the question is how to find out whether you're set for single-use slaves, it's the jenkins-gearman plugin which adds that feature, and you need to pass a parameter OFFLINE_NODE_WHEN_COMPLETE=1 | 14:30 |
*** nmagnezi has quit IRC | 14:31 | |
fungi | Srinu: oh, i was unaware of the Single+Use+Slave+Plugin | 14:31 |
Srinu | fungi: i added the parameter OFFLINE_NODE_WHEN_COMPLETE=1 | 14:31 |
fungi | we don't use that at all, so couldn't tell you much about it | 14:31 |
pabelanger | Ya, never seen that before | 14:31 |
Srinu | fungi: how can i check OFFLINE_NODE_WHEN_COMPLETE=1 is exported correctly | 14:31 |
*** eezhova has quit IRC | 14:32 | |
pabelanger | look at the job parameters in jenkins | 14:32 |
pabelanger | you should see it | 14:32 |
fungi | Srinu: i think it's probably a very stripped-down fork of the gearman plugin for people who aren't actually using zuul/gearman | 14:32 |
*** hongbin has joined #openstack-infra | 14:32 | |
Srinu | pabelanger: i have to ZMQ Events inZMQ Event Publisher | 14:34 |
*** xarses has quit IRC | 14:34 | |
Srinu | pabelanger: i have to enable ZMQ Events inZMQ Event Publisher | 14:34 |
fungi | wow, looking at the singleuseslave-plugin source code, there are no licenses and no copyright statements... | 14:35 |
rdx_matt | Does someone know how to integrate Hacking+Flacke8 into PyCharm? | 14:35 |
pabelanger | Srinu: yes: http://docs.openstack.org/infra/nodepool/installation.html#jenkins | 14:35 |
fungi | rdx_matt: no clue. most of us use free software. not a lot of pycharm users around here | 14:36 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Support colorized output https://review.openstack.org/332173 | 14:36 |
AJaeger | anteaya: what do you think of the above ^ | 14:36 |
*** Guest55489 has quit IRC | 14:37 | |
rdx_matt | fungi: Thanks. Which software do you use? | 14:37 |
fungi | rdx_matt: i use vim. some use emacs | 14:37 |
Srinu | pabelanger: i enabled that ZMQ publisher but in job whether i have to enable the ZMQ events are not | 14:37 |
mordred | rdx_matt: I also use vim. although sometimes I use emacs too | 14:37 |
fungi | rdx_matt: i think in general not a lot of people use an ide for python since its interpreter is already quite suitable for interactive code validation and it's easy to invoke a debugger for it directly as well | 14:39 |
pabelanger | Srinu: check if we should publish events for all jobs should be enabled | 14:39 |
fungi | rdx_matt: so it's not hard to get by with a bog standard text editor plus syntax highlighting and maybe some minimal plugins | 14:40 |
openstackgerrit | Timofey Durakov proposed openstack-infra/project-config: Moving live-migration job to check queue for nova https://review.openstack.org/332175 | 14:40 |
rdx_matt | fungi: Well, It's a matter of personal taste. As a Java developer, I feel much more in control of my code with PyCharm. I will try to make it work. Thanks again guys | 14:41 |
fungi | rdx_matt: for example, there's at least one vim plugin which can run pep8/flake8 on the fly in the background and highlight failing lines for you as you type | 14:41 |
*** Nikolay_St has quit IRC | 14:41 | |
fungi | though i find that sort of thing extremely annoying so i don't use it | 14:41 |
AJaeger | sdague: could you review https://review.openstack.org/332174 , please? It's needed for os-api-ref. | 14:41 |
*** jamesmcarthur has joined #openstack-infra | 14:42 | |
fungi | rdx_matt: yeah, i can see how coming from java you might get accustomed to needing a much more robust ide | 14:42 |
rdx_matt | fungi: Yeah, all of those plugins are just a pain. I'd rather have syntax highlighting and some auto formatting. | 14:42 |
*** sorantis has joined #openstack-infra | 14:43 | |
fungi | but if all you want is syntax highlighting, autoindenting and the ability to trigger custom commands in the background on demand, just about any popular text editor can do that | 14:43 |
rdx_matt | fungi: vim is way too much hardcore for me :) I will try sublime though | 14:44 |
*** zeih has quit IRC | 14:45 | |
*** afred312 has quit IRC | 14:46 | |
*** nmagnezi has joined #openstack-infra | 14:46 | |
*** sree has joined #openstack-infra | 14:46 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Support colorized output for our tests https://review.openstack.org/332173 | 14:47 |
*** zz_dimtruck is now known as dimtruck | 14:47 | |
*** yolanda has joined #openstack-infra | 14:47 | |
*** lucas-afk is now known as lucasagomes | 14:48 | |
fungi | rdx_matt: yep, vi-derived text editors are mainly popular with people who started out as unix sysadmins on platforms where there was frequently no other editor available (except maybe ed) | 14:48 |
fungi | old habits die hard | 14:48 |
*** Volundr has quit IRC | 14:49 | |
AJaeger | fungi, pabelanger, mordred : I fear with merging https://review.openstack.org/331892 , we lost the coloring of console output that we had for a few days. | 14:49 |
sdague | AJaeger: +2 | 14:49 |
AJaeger | have a look at http://logs.openstack.org/91/332091/1/check/gate-project-config-projects-yaml/4f0d803/console.html#_2016-06-21_11_43_53_541588 and compare with http://logs.openstack.org/51/332151/1/check/gate-project-config-gerrit/e451e7a/console.html#_2016-06-21_14_35_00_802216 | 14:49 |
AJaeger | thanks, sdague | 14:49 |
AJaeger | fungi, pabelanger, mordred, so what's correct? And is my change 332173 needed/correct in this case? | 14:50 |
*** sree_ has joined #openstack-infra | 14:50 | |
*** xarses has joined #openstack-infra | 14:51 | |
*** sree has quit IRC | 14:51 | |
*** sree_ is now known as Guest43990 | 14:51 | |
pabelanger | AJaeger: I actually like the lack of color :) So, not sure which way the the correct way | 14:51 |
mordred | I think before we had a problem where things were getting colored incorrectly | 14:51 |
mordred | and now we may have a problem where things are not getting colored incorrectly | 14:52 |
fungi | pabelanger: well, what's SUPPOSED to happen is that the lines which start with WARNING are supposed to be highlighted in yellow, and those starting with ERROR in red, but not all the lines which come after them | 14:52 |
*** rhochmuth has joined #openstack-infra | 14:52 | |
*** dtardivel has joined #openstack-infra | 14:52 | |
fungi | AJaeger: 332173 is probably an improvement, but isn't going to bring back the intended colorization until we fix whatever other matching issue we have | 14:53 |
fungi | ianw: had speculated that osla may also be thrown off by now having microsecond precision in the timestamps | 14:53 |
*** alfredodeza has joined #openstack-infra | 14:53 | |
pabelanger | fungi: Good to know | 14:54 |
mordred | yah. I bet it's the microsecond | 14:54 |
*** jordanP has joined #openstack-infra | 14:54 | |
fungi | http://git.openstack.org/cgit/openstack-infra/os-loganalyze/tree/os_loganalyze/filter.py#n31 | 14:55 |
fungi | DATEFMT = '\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}((\.|\,)\d{3,6})?' | 14:55 |
*** Guest43990 has quit IRC | 14:55 | |
pabelanger | nice find | 14:55 |
mordred | fungi: it doesn't seem to have support for the | in the string | 14:55 |
fungi | looks like that _should_ handle microseconds | 14:55 |
*** zeih has joined #openstack-infra | 14:56 | |
*** ArxCruz has quit IRC | 14:56 | |
openstackgerrit | Timofey Durakov proposed openstack-infra/project-config: Moving live-migration job to check queue for nova https://review.openstack.org/332175 | 14:57 |
fungi | and yeah, i'm not finding where | is expected | 14:57 |
alfredodeza | A while ago I was doing a bit of research trying to see if zuul had integration with Github, and fungi mentioned that a rest API in zuul would be the first step for such a thing | 14:57 |
*** abregman has joined #openstack-infra | 14:57 | |
alfredodeza | I wanted to ping again and see if there was anything there today for github integration :) | 14:57 |
mordred | alfredodeza: the code has been written but merging it is on the backburner pending other things | 14:57 |
alfredodeza | mordred: that sounds similar to what I recall from about a year ago | 14:58 |
alfredodeza | I guess it hasn't moved too much (understandably so) | 14:58 |
alfredodeza | mordred: do you have the link to the review handy? | 14:58 |
mordred | alfredodeza: it's on the list for sure, there are legit needs we have for it - we just haven't gotten to it yet :) | 14:59 |
*** ramishra has joined #openstack-infra | 14:59 | |
*** amitgandhinz has quit IRC | 14:59 | |
*** Srinu_ has joined #openstack-infra | 14:59 | |
Srinu_ | Hi | 14:59 |
mordred | alfredodeza: https://review.openstack.org/#/c/325300/2 and the 19 changes before it | 14:59 |
alfredodeza | mordred: thank you | 15:00 |
*** julim has joined #openstack-infra | 15:00 | |
*** Jeffrey4l_ has quit IRC | 15:00 | |
openstackgerrit | Monty Taylor proposed openstack-infra/os-loganalyze: Add support for optional vertical bar https://review.openstack.org/332185 | 15:00 |
mordred | fungi, pabelanger: ^^ ? | 15:00 |
*** amitgandhinz has joined #openstack-infra | 15:00 | |
*** makowals has quit IRC | 15:00 | |
*** zeih has quit IRC | 15:01 | |
fungi | mordred: could that be taking things the wrong direction? seems like a reaction to https://review.openstack.org/331892 | 15:01 |
openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Website: Switch to planet-venus code https://review.openstack.org/332186 | 15:01 |
openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Add dprince to planet https://review.openstack.org/332187 | 15:01 |
*** daemontool has quit IRC | 15:02 | |
pabelanger | fungi: mordred: there is also some line where are still missing |. http://logs.openstack.org/51/332151/1/check/gate-project-config-gerrit/e451e7a/console.html#_2016-06-21_14_34_41_654618 | 15:03 |
pabelanger | zuul_log was likely not updated too | 15:03 |
*** abregman is now known as abregman|afk | 15:03 | |
*** amitgandhinz has quit IRC | 15:04 | |
*** ociuhandu has quit IRC | 15:04 | |
*** amitgandhinz has joined #openstack-infra | 15:04 | |
electrofelix | zaro: ah, I'll sign up | 15:05 |
*** dimtruck is now known as zz_dimtruck | 15:05 | |
*** timothyb89 has quit IRC | 15:05 | |
*** swat30 has quit IRC | 15:06 | |
*** timothyb89 has joined #openstack-infra | 15:06 | |
*** ajmiller has joined #openstack-infra | 15:06 | |
*** swat30 has joined #openstack-infra | 15:06 | |
*** piet_ has joined #openstack-infra | 15:06 | |
*** sorantis has quit IRC | 15:07 | |
*** isaacb has quit IRC | 15:07 | |
*** Srinu_ has quit IRC | 15:08 | |
fungi | looking at the page source for a current log, timestamp parsing looks correct, just the ERROR/WARNING matches aren't happening (all lines are span class='NONE ...' | 15:08 |
*** Srinu_ has joined #openstack-infra | 15:08 | |
Srinu_ | Hi | 15:08 |
fungi | looks like that's supposed to be matched by the STATUSFMT subexpression, which is only used by OSLO_LOGMATCH | 15:10 |
fungi | so i'm going to guess that before zuul-launcher we had no colorization on console logs | 15:10 |
fungi | when zuul-launcher came along and didn't use | we had some lines starting to sort of match the OSLO_LOGMATCH pattern | 15:11 |
AJaeger | fungi, I only saw it recently, so zuul-launcher might have given it to us. | 15:11 |
*** hichihara has quit IRC | 15:11 | |
*** PollyZ has quit IRC | 15:11 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: copy lib/plugins at startup https://review.openstack.org/332198 | 15:11 |
*** PollyZ has joined #openstack-infra | 15:11 | |
*** PollyZ has quit IRC | 15:11 | |
fungi | my vote would be to get zuul-launcher logs looking more like oslo log format rather than emulating jenkins console logs as closely | 15:11 |
AJaeger | and then ianw proposed https://review.openstack.org/#/c/331526/ | 15:11 |
AJaeger | where I suggested to make them look like jenkins console log ;/ | 15:12 |
jeblair | most console lines don't have severity | 15:12 |
jeblair | what's the severity of a bash command? | 15:12 |
fungi | that's a good point. it looks like oslo/syslog format have a severity on every line | 15:12 |
*** kzaitsev_mb has quit IRC | 15:12 | |
fungi | which the multi-line colorizing relies on | 15:12 |
*** jlanoux has quit IRC | 15:13 | |
fungi | so that explains why we got the behavior we did on the console logs | 15:13 |
*** vhosakot has joined #openstack-infra | 15:13 | |
*** zul_ has joined #openstack-infra | 15:13 | |
fungi | it assumes any lines with no severity are continuation lines not new log entries | 15:13 |
Srinu_ | Fungi: how can we export param offline node with complete manually | 15:14 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: add '|' to zuul_log https://review.openstack.org/332201 | 15:14 |
fungi | Srinu_: i don't know what you're asking. you mean instead of having zuul set it? | 15:14 |
*** Volundr has joined #openstack-infra | 15:16 | |
*** PollyZ has joined #openstack-infra | 15:16 | |
*** kzaitsev_mb has joined #openstack-infra | 15:16 | |
Srinu_ | Fungi: yes instead of zuul to set offline node with complete. Can we set manually offline node with complete=1 | 15:16 |
jeblair | mordred, pabelanger: i'm going to stack a bunch of the zuul patches and test them all locally | 15:16 |
*** zul has quit IRC | 15:17 | |
fungi | Srinu_: it looks like that's probably what that singleuseslave-plugin was developed for, but i don't really know since we're not using it | 15:17 |
fungi | we set it with zuul | 15:17 |
jeblair | Srinu_: if this is to fix the jenkins permissions problem, you should know that none of the other zuul parameters will be available, so the job won't actually work | 15:17 |
Srinu_ | Fungi: how to set with zuul can you tell | 15:18 |
jeblair | Srinu_: the only solution to that is to disable the check as described in the mailing list post | 15:18 |
*** salv-orlando has joined #openstack-infra | 15:18 | |
pabelanger | jeblair: sounds good | 15:18 |
mordred | jeblair: ++ | 15:18 |
*** Julien-zte has joined #openstack-infra | 15:18 | |
pabelanger | jeblair: let me know if you revisit ssh_known_hosts patch. Interested to see what the issues are | 15:19 |
jeblair | pabelanger: i'll throw that one on the pile too | 15:19 |
*** vincentll has quit IRC | 15:19 | |
mordred | mmm. pile of zuul | 15:19 |
Shrews | eew | 15:19 |
Srinu_ | Jeblair: when jenkind jobs are queue it is executing first job and queued job not waiting until the deletion of slave i | 15:20 |
*** mohankumar has quit IRC | 15:20 | |
*** hrubi has quit IRC | 15:20 | |
Srinu_ | Jelblair: and after some time deleting the old slave and jobs fails | 15:21 |
*** sree has joined #openstack-infra | 15:21 | |
fungi | Srinu_: that matches the symptom i would expect from OFFLINE_NODE_WHEN_COMPLETE not getting set | 15:22 |
pabelanger | Agreed | 15:22 |
*** andreas_s has quit IRC | 15:23 | |
openstackgerrit | zzxwill proposed openstack-infra/zuul: Rename jenkins to zuul https://review.openstack.org/330853 | 15:23 |
jeblair | Srinu_: you need to tell jenkins to allow the gearman plugin to receive job parameters (i don't know how to do that, but the mailing list thread says how). your sigle_use_node function sets the parameter correctly, but you need to tell zuul to call that in your layout.yaml file. | 15:23 |
fungi | Srinu_: if you're using jenkins 1.651.2 or later, you probably need to read the mailing list thread jeblair mentioned, starting at http://lists.openstack.org/pipermail/openstack-infra/2016-May/004284.html | 15:23 |
*** piet_ has quit IRC | 15:24 | |
*** azvyagintsev has joined #openstack-infra | 15:25 | |
*** shardy has joined #openstack-infra | 15:25 | |
*** e0ne has quit IRC | 15:25 | |
*** sree has quit IRC | 15:26 | |
*** hrubi has joined #openstack-infra | 15:26 | |
*** e0ne has joined #openstack-infra | 15:26 | |
*** hashar is now known as hasharAway | 15:26 | |
*** javeriak has joined #openstack-infra | 15:27 | |
*** ajmiller has quit IRC | 15:27 | |
*** sree has joined #openstack-infra | 15:27 | |
*** ajmiller has joined #openstack-infra | 15:28 | |
*** hdaniel has quit IRC | 15:29 | |
*** bhavik has quit IRC | 15:29 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: Move job timeout into playbook as vars https://review.openstack.org/331426 | 15:29 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: add support for node revocation https://review.openstack.org/331273 | 15:29 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: Add local_tmp to ansible.cfg https://review.openstack.org/331797 | 15:29 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: Remove unused timeout args for _makeBuilderTask https://review.openstack.org/331429 | 15:29 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: Enable keep_remote_files in ansible.cfg https://review.openstack.org/331819 | 15:29 |
Srinu_ | Fungi:i used keepundefinedparameters=true but it is not work | 15:29 |
jeblair | mordred, pabelanger: no changes there ^ only rebased into a stack (which i tested and they all look good) | 15:29 |
jeblair | mordred, pabelanger: i'm going to do the ssh change separately now | 15:30 |
*** melwitt_ is now known as melwitt | 15:30 | |
fungi | Srinu_: i don't know what to suggest. we never used that newer version of jenkins and we don't use jenkins at all now, so hopefully someone who is can provide you with additional troubleshooting suggestions | 15:30 |
*** Na3iL has quit IRC | 15:30 | |
*** melwitt is now known as Guest61873 | 15:30 | |
*** javeriak_ has joined #openstack-infra | 15:31 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Store history of a comment when editing https://review.openstack.org/332208 | 15:32 |
*** sree has quit IRC | 15:32 | |
Shrews | mordred: if you get the chance, could you provide thoughts on the comment I left on Ghe's shade change: https://review.openstack.org/330739 | 15:32 |
*** Guest61873 is now known as melwitt | 15:32 | |
*** javeriak has quit IRC | 15:33 | |
*** salv-orlando has quit IRC | 15:33 | |
*** zz_dimtruck is now known as dimtruck | 15:33 | |
*** Nikolay_St has joined #openstack-infra | 15:33 | |
*** jordanP has quit IRC | 15:33 | |
openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Fix GET /v1/worklists/:id/filters/:id https://review.openstack.org/332210 | 15:33 |
*** Srinu_ has quit IRC | 15:34 | |
*** Srinu_ has joined #openstack-infra | 15:34 | |
*** e0ne has quit IRC | 15:34 | |
stajkowski | AJaeger: hey! ty again, we'll need to place myself into the quark-core and quark-release groups so I can add others, per the guide | 15:34 |
Srinu_ | Jeblair: can you tell me how to overcome that issue | 15:35 |
*** pcaruana has quit IRC | 15:35 | |
Srinu_ | Fungi: can you tell me how to overcome that issue | 15:36 |
rcarrillocruz | Shrews: besides the operator to openstack move | 15:36 |
rcarrillocruz | the change has domain_id plus name_or_id, should only have name_or_id | 15:36 |
rcarrillocruz | and also | 15:36 |
rcarrillocruz | keystone domains are unique both by name and ids | 15:36 |
rcarrillocruz | therefore doesn't make much sense to have filters | 15:36 |
rcarrillocruz | if you get the domain, you get it.. | 15:36 |
AJaeger | stajkowski: I don't have those permissions. Other in the team will need to do it. Please provide a link to the review that created the repo for reference | 15:36 |
*** nmagnezi has quit IRC | 15:37 | |
*** piet has joined #openstack-infra | 15:37 | |
*** amotoki has joined #openstack-infra | 15:38 | |
jeblair | Srinu_: the only suggestion i have is to look at the parameters jenkins got for that build and see if offline_node_when_complete is there | 15:39 |
*** jaosorior has joined #openstack-infra | 15:39 | |
stajkowski | AJaeger: ty, here is the patch https://review.openstack.org/#/c/319368/9 | 15:39 |
AJaeger | can any infra-root help stajkowski , please? ^ | 15:40 |
Srinu_ | Jeblair: where can i find the parameters of jenkins | 15:40 |
pabelanger | AJaeger: sure, let me look | 15:40 |
*** dizquierdo has joined #openstack-infra | 15:40 | |
stajkowski | pabelanger: just need myself added to the quark-core and quark-release groups so I can add others, ty! | 15:41 |
fungi | Srinu_: when you're logged into the jenkins webui and looking at the page for a recent job run status, you should see a link on the left side for "job parameters" or something like that. we don't use jenkins at all any more so i don't have an easy way to check what it's called exactly | 15:42 |
pabelanger | AJaeger: stajkowski: added | 15:42 |
*** sheeprine_ has joined #openstack-infra | 15:42 | |
openstackgerrit | greghaynes proposed openstack-infra/puppet-gerrit: Remove text/html as a safe mimetype https://review.openstack.org/332219 | 15:43 |
stajkowski | pabelanger: ty! | 15:43 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Website: Switch to planet-venus code https://review.openstack.org/332186 | 15:44 |
*** jlanoux has joined #openstack-infra | 15:44 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Add dprince to planet https://review.openstack.org/332187 | 15:44 |
*** Julien-zte has quit IRC | 15:46 | |
*** maishsk has quit IRC | 15:47 | |
*** amotoki has quit IRC | 15:48 | |
*** sputnik13 has joined #openstack-infra | 15:48 | |
*** sputnik13 has quit IRC | 15:49 | |
*** sheeprine_ has quit IRC | 15:49 | |
*** sheeprine_ has joined #openstack-infra | 15:50 | |
*** sheeprine_ has quit IRC | 15:50 | |
*** sheeprine_ has joined #openstack-infra | 15:51 | |
*** sheeprine_ has quit IRC | 15:51 | |
*** salv-orlando has joined #openstack-infra | 15:51 | |
*** ddieterly is now known as ddieterly[away] | 15:51 | |
*** amitgandhinz has quit IRC | 15:51 | |
*** sheeprine_ has joined #openstack-infra | 15:51 | |
*** amitgandhinz has joined #openstack-infra | 15:51 | |
*** sheeprine_ has quit IRC | 15:51 | |
*** tphummel has joined #openstack-infra | 15:52 | |
*** sheeprine_ has joined #openstack-infra | 15:52 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: Revert "Revert "Enabled host_key_checking"" https://review.openstack.org/332224 | 15:52 |
*** yamamoto has quit IRC | 15:52 | |
jeblair | pabelanger: okay, i can't find anything wrong with it now :) | 15:52 |
*** yamamoto has joined #openstack-infra | 15:52 | |
pabelanger | jeblair: excellent! | 15:52 |
jeblair | pabelanger: maybe there was something wrong in my test environment. sorry | 15:52 |
jeblair | (or maybe something else changed) | 15:52 |
jeblair | pabelanger: anyway, take a look at that patch because i had to fix several conflicts | 15:53 |
pabelanger | No, that's fine. I'd rather tested it before we upgrade zuul-launchers | 15:53 |
*** gyee has joined #openstack-infra | 15:53 | |
*** afred312 has joined #openstack-infra | 15:53 | |
*** dmk0202 has joined #openstack-infra | 15:54 | |
jeblair | mordred: would you please review https://review.openstack.org/332198 and https://review.openstack.org/331819 ? | 15:54 |
*** ddieterly[away] is now known as ddieterly | 15:55 | |
*** mhickey has quit IRC | 15:55 | |
*** bhavik has joined #openstack-infra | 15:55 | |
*** psachin has quit IRC | 15:55 | |
*** Srinu_ has quit IRC | 15:55 | |
mordred | jeblair: oh - funny story - that's open in gertty right now | 15:56 |
pabelanger | jeblair: looks good, left it open for you to approve when ready | 15:56 |
mordred | then devananda suckered me into a conversation | 15:56 |
jeblair | pabelanger: i also tested that the ssh key thing does what we want -- i regenerated keys on my test host mid-job, and it exited with code 3 | 15:56 |
jeblair | pabelanger: that means that zuul would re-launch the job | 15:56 |
jeblair | pabelanger: so ... hrm | 15:56 |
pabelanger | excellent! | 15:56 |
mordred | jeblair: done | 15:57 |
jeblair | pabelanger: yeah, that's good if we run into the thing we did before... except, we will never notice it, and if we have a job that regenerates host keys, it will loop forever | 15:57 |
pabelanger | Right, we maybe we should have it fail for now, just to see how often the issue happens | 15:57 |
*** chem is now known as chem|off | 15:57 | |
jeblair | pabelanger: yeah, but i don't know if we can do that? | 15:58 |
*** ihrachys has quit IRC | 15:58 | |
pabelanger | Ya, exit code 3 is the issue atm | 15:58 |
jeblair | because it looks just like the case where we can't *initially* connect to the node (where we do want to retry) | 15:58 |
jeblair | anyway, i'm okay with it going in as-is, and maybe we can improve it later | 15:59 |
pabelanger | ++ | 15:59 |
jeblair | so when those 8 patches land, let's run your restart playbook | 15:59 |
*** sheeprine_ has quit IRC | 15:59 | |
pabelanger | okay | 15:59 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Use gear module from pip https://review.openstack.org/332123 | 15:59 |
anteaya | fungi: I have no internets, I'm coming in on my phone | 16:01 |
*** sheeprine_ has joined #openstack-infra | 16:01 | |
openstackgerrit | Merged openstack-infra/puppet-gerrit: Remove text/html as a safe mimetype https://review.openstack.org/332219 | 16:01 |
*** sheeprine_ has quit IRC | 16:01 | |
fungi | infra-root: i'm going to hand-apply that ^ on review.openstack.org and perform an emergency gerrit restart | 16:02 |
*** sheeprine_ has joined #openstack-infra | 16:02 | |
fungi | thanks greghaynes for bringing it to my attention | 16:02 |
anteaya | fungi: I haven't read all the backscroll on storyboard/gerrit accounts but the bottom line is I don't care what things are called but would really like the integration in place for tomorrow | 16:02 |
anteaya | thank you | 16:02 |
greghaynes | :) | 16:02 |
*** alfredodeza has left #openstack-infra | 16:02 | |
*** esikachev has quit IRC | 16:03 | |
*** yolanda has quit IRC | 16:04 | |
fungi | #status notice Gerrit is being restarted now to apply an emergency security-related configuration change | 16:04 |
openstackstatus | fungi: sending notice | 16:04 |
mordred | fungi: ++ | 16:04 |
Shrews | gah | 16:05 |
fungi | it should be on its way back up now | 16:05 |
-openstackstatus- NOTICE: Gerrit is being restarted now to apply an emergency security-related configuration change | 16:05 | |
*** sheeprine_ has quit IRC | 16:05 | |
d0ugal | Yup, it is back | 16:06 |
*** sheeprine_ has joined #openstack-infra | 16:06 | |
fungi | greghaynes is working on a quick advisory about that for the infra ml and oss-sec ml so people will be aware to update their configs if they were relying on ours | 16:06 |
*** sree has joined #openstack-infra | 16:06 | |
*** Apoorva has joined #openstack-infra | 16:07 | |
openstackstatus | fungi: finished sending notice | 16:07 |
openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: copy lib/plugins at startup https://review.openstack.org/332198 | 16:07 |
jeblair | greghaynes: thanks for that. i wonder if you could provide a citation for your first sentence in the commit message? i'd like to read more. | 16:07 |
*** yamamoto has quit IRC | 16:08 | |
greghaynes | jeblair: Ya, I found it on the gerrit ML last night, let me find it... | 16:08 |
*** mikelk has quit IRC | 16:08 | |
greghaynes | jeblair: https://groups.google.com/forum/#!topic/repo-discuss/h7Bvgns5cyY last comment | 16:08 |
jeblair | greghaynes: thanks! | 16:08 |
*** piet has quit IRC | 16:09 | |
Shrews | jeblair: pabelanger: why does that host_key_checking change use pre_tasks? | 16:09 |
greghaynes | that actually is about why .zip instead of just setting mimetype, but that is protecting against the same issue... so I guess its not directly about that | 16:09 |
*** _nadya__ has quit IRC | 16:10 | |
fungi | yeah, https://review.openstack.org/Documentation/config-gerrit.html#mimetype doesn't do a good job of warning about that possibility | 16:10 |
*** sheeprine_ has quit IRC | 16:10 | |
*** sree_ has joined #openstack-infra | 16:10 | |
*** sree_ is now known as Guest95223 | 16:10 | |
fungi | a good upstream patch to gerrit might be to add a sentence about it to the documentation there | 16:10 |
*** sheeprine_ has joined #openstack-infra | 16:10 | |
*** sree has quit IRC | 16:10 | |
greghaynes | agreed | 16:10 |
greghaynes | IMO gerrit just shouldnt let you set that | 16:10 |
jeblair | yeah, that was the first place i looked | 16:11 |
greghaynes | especially for text/html | 16:11 |
*** mdrabe has quit IRC | 16:11 | |
fungi | i wonder if there are any vectors via text/xml | 16:11 |
fungi | er, application/xml i mean | 16:11 |
pabelanger | jeblair: Shrews: doesn't need to, but felt moving it to a pre_task would break up the this run before a job, this runs during a job | 16:11 |
greghaynes | heh, I was wondering the same. Its really going to come down to browser behavior. IMO all of those should be unset as they are an attack surface area (there have been libjpg vuls which could be exploited this way too) | 16:12 |
*** yamamoto has joined #openstack-infra | 16:12 | |
greghaynes | but thats only if you have something that could be considered another vulnerability | 16:12 |
fungi | yeah, the html one is a pretty obvious (in retrospect) risk | 16:13 |
*** raunak has joined #openstack-infra | 16:13 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Support colorized output for our tests https://review.openstack.org/332173 | 16:13 |
fungi | we definitely don't want gerrit serving user-supplied html to people | 16:13 |
openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: add '|' to zuul_log https://review.openstack.org/332201 | 16:14 |
greghaynes | hah, yep, certainly not | 16:14 |
*** sheeprine_ has quit IRC | 16:15 | |
*** Guest95223 has quit IRC | 16:15 | |
*** sheeprine_ has joined #openstack-infra | 16:15 | |
*** esikachev has joined #openstack-infra | 16:15 | |
fungi | if any of you have viewed html files from an untrusted submitter via download links in gerrit, you may want to consider the possibility that your gerrit account is compromised | 16:16 |
anteaya | <-- walking uptown to use public wifi at the library hope to be online by meeting time | 16:16 |
*** sree has joined #openstack-infra | 16:16 | |
mordred | anteaya: have a good walk! | 16:16 |
*** trown is now known as trown|lunch | 16:17 | |
bkero | fungi: any clue how long the vulnerability has been around? | 16:17 |
bkero | Like if I viewed ahtml from an untrusted committer sometime last year? | 16:17 |
fungi | bkero: likely since the dawn of our gerrit configuration, but i'm digging in our git history now to find out | 16:17 |
bkero | oh awesome | 16:18 |
*** piet has joined #openstack-infra | 16:18 | |
zaro | fungi: https://review.openstack.org/#/c/262605/ | 16:19 |
fungi | https://review.openstack.org/151376 seems to have added it | 16:19 |
fungi | rather, switched it from a broken value to a "working" one | 16:19 |
*** esikachev has quit IRC | 16:20 | |
fungi | at least, i'm assuming that back when it was application/html it didn't render? | 16:20 |
*** haaj has joined #openstack-infra | 16:20 | |
*** Sukhdev_ has joined #openstack-infra | 16:20 | |
*** sree has quit IRC | 16:21 | |
fungi | otherwise, it dates back to https://review.openstack.org/93108 | 16:21 |
AJaeger | fungi, see 262605 which mentioned that html was broken... | 16:21 |
*** Sukhdev_ has quit IRC | 16:21 | |
fungi | oh! | 16:21 |
*** Sukhdev_ has joined #openstack-infra | 16:22 | |
fungi | so without application/xml, text/html doesn't actually work | 16:22 |
*** dmk0202 has quit IRC | 16:22 | |
zaro | yeah, i think the one i referenced was when it was actually enabled. | 16:22 |
fungi | which means it's only been in place since our first restart after 2016-01-04 | 16:22 |
*** yaume_ has joined #openstack-infra | 16:24 | |
zigo | fungi: It passed checks this time: https://review.openstack.org/#/c/331008/ | 16:26 |
zigo | Can you review it so I can attempt the next step? | 16:27 |
*** yaume has quit IRC | 16:27 | |
fungi | greghaynes: jeblair: zaro: https://review-dev.openstack.org/cat/5453%2C1%2Cxss-vuln-example.html^0 | 16:28 |
greghaynes | fungi: oh, I have a poc | 16:29 |
greghaynes | fungi: if youre looking for one | 16:29 |
*** stevemar has quit IRC | 16:29 | |
fungi | greghaynes: not looking for one, that's a pretty clear demonstration (runs a javascript alert window box) | 16:29 |
greghaynes | ah, yea | 16:29 |
*** amotoki has joined #openstack-infra | 16:30 | |
*** links has joined #openstack-infra | 16:30 | |
openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Add plugin="junit" attribute for JUnit plugin https://review.openstack.org/332238 | 16:31 |
*** e0ne has joined #openstack-infra | 16:32 | |
*** chem|off has quit IRC | 16:32 | |
*** kien-ha has joined #openstack-infra | 16:33 | |
*** mdrabe has joined #openstack-infra | 16:34 | |
fungi | greghaynes: also, i've checked your poc and it's properly serving me a zipfile from review.o.o now | 16:35 |
greghaynes | \O/ | 16:35 |
greghaynes | I never thought i'd actually *want* to be served a zipfile | 16:36 |
fungi | better than being served a steaming pile of compromised account | 16:36 |
jeblair | can we use rar instead? | 16:36 |
jeblair | i hear it's better than zip | 16:36 |
*** akshai_ has joined #openstack-infra | 16:36 | |
nibalizer | jeblair: zing | 16:37 |
*** shardy has quit IRC | 16:37 | |
mordred | jeblair: no shar? | 16:37 |
*** degorenko is now known as _degorenko|afk | 16:37 | |
* greghaynes has flashbacks | 16:37 | |
SpamapS | lzip ftw? | 16:37 |
pabelanger | <3 rar | 16:37 |
* rcarrillocruz votes for arj | 16:37 | |
* SpamapS wants ARJ's | 16:37 | |
SpamapS | rcarrillocruz: ^5! | 16:37 |
rcarrillocruz | :D | 16:37 |
SpamapS | takin it back to the old school cause we're old fools who are so cool | 16:38 |
*** ramishra has quit IRC | 16:38 | |
rcarrillocruz | indeed | 16:38 |
*** david-lyle has quit IRC | 16:38 | |
* mordred hands SpamapS a cpio | 16:38 | |
*** baoli_ has quit IRC | 16:38 | |
*** david-lyle has joined #openstack-infra | 16:38 | |
*** akshai has quit IRC | 16:39 | |
*** sree has joined #openstack-infra | 16:39 | |
SpamapS | On my first HP-UX box ever, there was a post-it on the console: "cpio -ocvBdum / > /dev/st0" | 16:39 |
SpamapS | "We run this every night at 5 before we go home, after we put a new tape in." | 16:40 |
*** jaosorior has quit IRC | 16:40 | |
mordred | nice | 16:40 |
fungi | jeblair: i was hoping for split uuencode | 16:40 |
SpamapS | "Why don't you use cron?" "What's cron?" | 16:40 |
mordred | because I'm a dork, I have now run across this: http://www.nordier.com/v7x86/index.html | 16:40 |
mordred | and kind of want to build a dib image for it so I can boot it in openstack | 16:41 |
*** dizquierdo has quit IRC | 16:41 | |
nibalizer | greghaynes: thanks for chasing this down | 16:41 |
SpamapS | yoink.. wow... | 16:41 |
SpamapS | mordred: can't be any less useful than cirros.. ;) | 16:42 |
zaro | jeblair: i don’t see an option for other compression formats. | 16:42 |
fungi | mordred: ooh! i wonder if it's possible to boot openvms as a vm | 16:42 |
mordred | fungi: I bet openvms doesn't use systemd | 16:42 |
jeblair | zaro: sorry, i was joking :) | 16:42 |
fungi | mordred: i'm quite certain it does not, in fact | 16:42 |
*** genunix has left #openstack-infra | 16:42 | |
*** sree has quit IRC | 16:43 | |
jeblair | Inventory script (/etc/ansible/hosts/openstack) had an execution error: /usr/local/lib/python2.7/dist-packages/os_client_config/config.py:476: UserWarning: Couldn't find the vendor profile 'hp', for the cloud 'openstackjenkins-hpcloud' | 16:43 |
*** sree has joined #openstack-infra | 16:44 | |
Shrews | we removed the HP profile in 1.15 | 16:44 |
mordred | jeblair: where is that? | 16:45 |
rcarrillocruz | nice | 16:45 |
jeblair | mordred: when i 'sudo ansible' on puppetmaster | 16:45 |
*** tonytan4ever has quit IRC | 16:45 | |
jeblair | mordred: but not when i 'sudo su -; ansible' | 16:45 |
mordred | jeblair: oh - it's probably looking at an old clouds.yaml in your home dir? | 16:46 |
jeblair | mordred: oh, i thought it only looked in .config | 16:46 |
*** savihou has quit IRC | 16:46 | |
mordred | I meant in ~/.config | 16:46 |
*** piet has quit IRC | 16:47 | |
mordred | jeblair: but it will also use a clouds.yaml in the current dir if there is one | 16:47 |
jeblair | mordred: no ~/.config is clean -- you were right, it was looking at ~/clouds.yaml | 16:47 |
mordred | jeblair: awesome | 16:47 |
jeblair | mordred: i was in ~ | 16:47 |
jeblair | i'm going to say "clouds.yaml in current dir" is a mildly surprising behavior :) | 16:48 |
*** sree has quit IRC | 16:48 | |
jeblair | (especially so far removed from ansible) | 16:48 |
jeblair | just some user feedback. take it or leave it. :) | 16:48 |
mordred | jeblair: yah - I hear that :) | 16:49 |
mordred | jeblair: I'm not sure I'd do the same thing if I were doing it over again today | 16:49 |
openstackgerrit | Merged openstack-infra/project-config: Fix upload path to tarballs.o.o for packaging https://review.openstack.org/331008 | 16:50 |
*** yamamoto has quit IRC | 16:51 | |
*** Srinu_ has joined #openstack-infra | 16:51 | |
*** armax has joined #openstack-infra | 16:51 | |
*** jlanoux has quit IRC | 16:52 | |
*** piet has joined #openstack-infra | 16:53 | |
Srinu_ | Hi | 16:54 |
*** jpich has quit IRC | 16:54 | |
nibalizer | jeblair: i've tripped there too | 16:55 |
nibalizer | but once you know about it its really nice to be able to plop one in your cwd for testing and poking things | 16:56 |
*** Srinu_ has quit IRC | 16:56 | |
*** amotoki has quit IRC | 16:57 | |
jeblair | ya | 16:57 |
*** zhurong has joined #openstack-infra | 16:58 | |
*** sarob has joined #openstack-infra | 16:58 | |
openstackgerrit | Merged openstack-infra/zuul: Add local_tmp to ansible.cfg https://review.openstack.org/331797 | 16:58 |
*** dmsimard is now known as dmsimard|afk | 16:59 | |
*** inc0 has quit IRC | 17:01 | |
*** inc0 has joined #openstack-infra | 17:02 | |
*** xenogear has joined #openstack-infra | 17:02 | |
*** e0ne has quit IRC | 17:02 | |
*** Guest32736 has quit IRC | 17:03 | |
*** ihrachys has joined #openstack-infra | 17:03 | |
*** matt-borland has quit IRC | 17:03 | |
openstackgerrit | Merged openstack-infra/zuul: Enable keep_remote_files in ansible.cfg https://review.openstack.org/331819 | 17:05 |
openstackgerrit | Merged openstack-infra/zuul: Ansible launcher: add support for node revocation https://review.openstack.org/331273 | 17:05 |
openstackgerrit | Merged openstack-infra/zuul: Move job timeout into playbook as vars https://review.openstack.org/331426 | 17:05 |
openstackgerrit | Merged openstack-infra/zuul: Remove unused timeout args for _makeBuilderTask https://review.openstack.org/331429 | 17:05 |
*** akshai has joined #openstack-infra | 17:05 | |
openstackgerrit | Merged openstack-infra/zuul: Revert "Revert "Enabled host_key_checking"" https://review.openstack.org/332224 | 17:05 |
jeblair | pabelanger: okay, how do we run that thar playbook you got? | 17:06 |
jeblair | pabelanger: you want to do it? | 17:07 |
pabelanger | jeblair: I tested it from puppetmaster.o.o as root, but you could run it locally, but I need to do a patch for that | 17:07 |
*** dprince has quit IRC | 17:07 | |
pabelanger | jeblair: I can run it if needed | 17:07 |
pabelanger | jeblair: how many zuul-launchers to we want to rotate at a time? | 17:08 |
*** akshai_ has quit IRC | 17:08 | |
jeblair | pabelanger: let's just do 1 at a time | 17:08 |
pabelanger | jeblair: okay, let me get started | 17:09 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Enable pipelining for ansible-playbook https://review.openstack.org/331499 | 17:09 |
pabelanger | jeblair: I'll start with zlstatic01 | 17:10 |
*** BobBall is now known as BobBall_AWOL | 17:11 | |
jeblair | pabelanger: if you start with static01, make sure the changes have landed on disk first | 17:12 |
jeblair | (since it might be able to cycle quickly) | 17:13 |
*** ihrachys_ has joined #openstack-infra | 17:13 | |
pabelanger | jeblair: ack | 17:13 |
fungi | zaro: playing around with https://review-dev.openstack.org/cat/5453%2C1%2Cxss-vuln-example.html^0 it looks like 262605 must have been a red herring. i still get a vulnerable page served even without application/xml or text/xml in the config, with just text/html in there | 17:13 |
*** qb_ has joined #openstack-infra | 17:15 | |
*** ihrachys has quit IRC | 17:16 | |
*** piet has quit IRC | 17:17 | |
nibalizer | crinkle: so for 331923 maybe we should just drop the entire lib and releasenotes directories | 17:18 |
*** yujunz has joined #openstack-infra | 17:18 | |
nibalizer | since we're not getting a lot of value out of that stuff | 17:18 |
AJaeger | nibalizer: you can always add them in again later ;) | 17:19 |
*** dizquierdo has joined #openstack-infra | 17:21 | |
*** yujunz has quit IRC | 17:21 | |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-openstack_infra_spec_helper: Initial commit https://review.openstack.org/331923 | 17:21 |
*** ddieterly is now known as ddieterly[away] | 17:21 | |
*** PollyZ has quit IRC | 17:21 | |
nibalizer | AJaeger: cool | 17:22 |
*** psilvad has joined #openstack-infra | 17:22 | |
*** sputnik13 has joined #openstack-infra | 17:23 | |
*** electrofelix has quit IRC | 17:23 | |
*** sarob_ has joined #openstack-infra | 17:24 | |
cinerama | mordred: hi! can we have a glean release please if it's not too much trouble? | 17:24 |
*** sdake_ has joined #openstack-infra | 17:24 | |
*** mriedem has quit IRC | 17:25 | |
*** PollyZ has joined #openstack-infra | 17:25 | |
fungi | zaro: so some further testing on review-dev, with 93108 i don't get rendered html from the download. with 151376 i do. 262605 doesn't seem to actually affect it one way or the other | 17:25 |
*** rbradfor has quit IRC | 17:25 | |
*** yamahata has quit IRC | 17:26 | |
*** sdake has quit IRC | 17:27 | |
*** sarob has quit IRC | 17:28 | |
zaro | fungi: hmm, not sure why it wasn't working for me before. could be that code mirror was updated | 17:28 |
*** trown|lunch is now known as trown | 17:28 | |
*** mriedem has joined #openstack-infra | 17:28 | |
zaro | i think with 151376 we were still on gerrit 2.8? | 17:29 |
fungi | zaro: right. likely this behavior changed with our upgrade to 2.11 | 17:30 |
*** PollyZ has quit IRC | 17:30 | |
*** kien-ha has quit IRC | 17:30 | |
fungi | so our configuration in that puppet module was potentially vulnerable starting in february 2015, but our production deployment was unimpacted by it until december 2015 when we upgraded from 2.8 to 2.11 | 17:30 |
fungi | at least that's my guess | 17:31 |
fungi | so other sites deploying newer gerrit releases with our puppet module would potentially have been impacted all the way back to when 151376 merged | 17:31 |
*** matt-borland has joined #openstack-infra | 17:32 | |
*** ffrank has joined #openstack-infra | 17:32 | |
*** dprince has joined #openstack-infra | 17:32 | |
*** ihrachys_ has quit IRC | 17:32 | |
*** ayoung has quit IRC | 17:33 | |
*** ihrachys has joined #openstack-infra | 17:33 | |
*** baoli has joined #openstack-infra | 17:34 | |
*** Sukhdev_ has quit IRC | 17:34 | |
crinkle | nibalizer: agree | 17:34 |
zaro | yeah, i think that's correct. | 17:35 |
*** tosky has quit IRC | 17:35 | |
nibalizer | crinkle: cool | 17:35 |
nibalizer | also yes I did sync the gemfile from a puppet module with the gemspec so we should be good | 17:35 |
*** sree_ has joined #openstack-infra | 17:35 | |
*** sree_ is now known as Guest61424 | 17:36 | |
openstackgerrit | Victor Ryzhenkin proposed openstack-infra/project-config: Add openstack/fuel-plugin-murano-tests project https://review.openstack.org/332151 | 17:36 |
*** stevemar has joined #openstack-infra | 17:36 | |
* zaro is afk for kids field trip. bb in about 4hrs | 17:36 | |
nibalizer | zaro: have fun | 17:37 |
pabelanger | jeblair: zlstatic01 restarted | 17:37 |
pabelanger | moving to zl03 now | 17:37 |
pabelanger | ansible-playbook choice | 17:37 |
*** salv-orl_ has joined #openstack-infra | 17:38 | |
*** sputnik13 has quit IRC | 17:39 | |
*** Guest61424 has quit IRC | 17:40 | |
*** sree has joined #openstack-infra | 17:40 | |
*** pcaruana has joined #openstack-infra | 17:40 | |
pabelanger | http://logs.openstack.org/33/33dea6b3815409b8a2342f954b662b0f888e70ff/post/ironic-inspector-upstream-translation-update/25d74ef/_zuul_ansible/known_hosts | 17:41 |
jeblair | neat! | 17:41 |
*** salv-orlando has quit IRC | 17:41 | |
*** rcernin has quit IRC | 17:43 | |
*** sree has quit IRC | 17:44 | |
*** piet has joined #openstack-infra | 17:45 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: move ansible log to ansible root https://review.openstack.org/332263 | 17:46 |
*** ihrachys has quit IRC | 17:46 | |
openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Use become for service restart for zuul-launcher playbooks https://review.openstack.org/332264 | 17:46 |
*** rbrndt has quit IRC | 17:47 | |
jeblair | pabelanger: do you need a 'become_user' for that? | 17:47 |
pabelanger | jeblair: no, the default is root | 17:48 |
*** binbincong has quit IRC | 17:48 | |
pabelanger | however, we can add it to be safe | 17:49 |
anteaya | <-- at the library | 17:49 |
openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Use root to restart our zuul-launcher service https://review.openstack.org/332264 | 17:50 |
*** binbincong has joined #openstack-infra | 17:51 | |
*** bhavik has quit IRC | 17:51 | |
openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: Refactor: block-device handling (partitioning) https://review.openstack.org/322671 | 17:51 |
*** yamamoto has joined #openstack-infra | 17:52 | |
*** PollyZ has joined #openstack-infra | 17:52 | |
*** armax has quit IRC | 17:53 | |
*** aviau has quit IRC | 17:57 | |
*** aviau has joined #openstack-infra | 17:57 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking: Updated from global requirements https://review.openstack.org/332268 | 17:57 |
openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/pbr: Updated from global requirements https://review.openstack.org/332269 | 17:57 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements https://review.openstack.org/332281 | 17:58 |
openstackgerrit | Brian Stajkowski proposed openstack-infra/project-config: Quark Project Non-Voting Py3 We will need to make pu3 jobs non-voting until we can address some issues. https://review.openstack.org/332287 | 17:59 |
*** _nadya_ has joined #openstack-infra | 17:59 | |
*** nwkarsten has quit IRC | 17:59 | |
stajkowski | pabelanger: AJaeger we'll need one last thing then we're good | 17:59 |
stajkowski | pabelanger: AJaeger https://review.openstack.org/#/c/332287/ non-voting on py3 for now | 17:59 |
*** nwkarsten has joined #openstack-infra | 18:00 | |
*** SamYaple has joined #openstack-infra | 18:00 | |
*** yamamoto has quit IRC | 18:01 | |
*** netsin has joined #openstack-infra | 18:02 | |
*** yamahata has joined #openstack-infra | 18:02 | |
AJaeger | stajkowski: that commit message is broken, please add an empty line after the title | 18:02 |
AJaeger | stajkowski: and that's not how you do it either - I'll comment | 18:02 |
dhellmann | fungi , clarkb : ttx and I are probably going to need more guidance on https://review.openstack.org/#/c/322863/ w.r.t. whether you think this is a useful direction to be trying to go, or if we should just stick with our current system | 18:02 |
stajkowski | AJaeger: my bad ty | 18:02 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/os-testr: Updated from global requirements https://review.openstack.org/332335 | 18:04 |
*** javeriak_ has quit IRC | 18:04 | |
*** nwkarsten has quit IRC | 18:04 | |
*** cody-somerville has joined #openstack-infra | 18:05 | |
*** ayoung has joined #openstack-infra | 18:05 | |
*** pvaneck has joined #openstack-infra | 18:05 | |
*** maishsk has joined #openstack-infra | 18:06 | |
*** Rockyg has joined #openstack-infra | 18:06 | |
*** zhurong has quit IRC | 18:06 | |
stajkowski | AJaeger: so the check doesn't actually launch a job, just basically ignores it? | 18:06 |
AJaeger | stajkowski: ? | 18:07 |
*** nwkarsten has joined #openstack-infra | 18:07 | |
stajkowski | AJaeger: the job doesn't actually exist per say | 18:07 |
fungi | dhellmann: looking over that, it's similar to what we discussed as the primary alternative to mass acl changes back when we tried this solution | 18:07 |
fungi | dhellmann: i have a possibly simpler idea though... | 18:07 |
AJaeger | stajkowski: I'm not getting what you reference | 18:07 |
fungi | dhellmann: groups can "include" groups, and we can change that inclusion (add/remove) through the gerrit api | 18:08 |
clarkb | fungi: thats what this proposal uses aiui, make a group that doesnt change then change the membership of it ad apptopriate depending on cycle time | 18:08 |
dhellmann | right | 18:09 |
fungi | clarkb: hrm, rereading again before what i suggest turns out to be in the lines i somehow missed | 18:09 |
stajkowski | AJaeger: i only see gate-drgonflow-python34 referenced in zuul/layout so the job isn't an actual jenkins job, just a dummy placeholder? | 18:09 |
dhellmann | there are open questions about how to name the groups | 18:09 |
*** haaj has quit IRC | 18:10 | |
*** markusry has quit IRC | 18:11 | |
*** markusry has joined #openstack-infra | 18:11 | |
*** markusry has quit IRC | 18:11 | |
*** amoralej is now known as amoralej|off | 18:11 | |
*** kzaitsev_mb has quit IRC | 18:11 | |
AJaeger | stajkowski: It's a job for sure. Defined via python-jobs in jenkins directory. | 18:12 |
AJaeger | stajkowski: Do it exactly like dragonflow has done it... | 18:12 |
*** rbrndt has joined #openstack-infra | 18:12 | |
AJaeger | stajkowski: http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n5850 | 18:12 |
AJaeger | stajkowski: http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n1710 | 18:12 |
AJaeger | stajkowski: and do not use the python3-jobs template. That's all you need to do. | 18:12 |
fungi | dhellmann: clarkb: yep, so this proposal seems fine to me. basically switch from reverting a mass acl change immediately after release to updating group memberships immediately after release and cleaning up the acl down the line | 18:13 |
*** sree has joined #openstack-infra | 18:13 | |
*** maishsk has quit IRC | 18:14 | |
fungi | and either we live with an ever growing pile of defunct groups (i'd love to come up with a mechanism for finding and cleaning those up in gerrit anyway, we already have a bunch) or renaming them each release | 18:15 |
fungi | we don't actually need to rotate through more than one set as long as we revert the branch-specific acl pattern for the previous release prior to adjusting the group inclusion and adding the acl pattern for the coming release branch | 18:16 |
dhellmann | yeah, the only part I don't like is leaving cruft in gerrit | 18:16 |
*** akshai has quit IRC | 18:16 | |
fungi | dhellmann: i don't think that leaves cruft in gerrit, it just creates a set of groups which are unused for some portion of each cycle | 18:16 |
fungi | but we can recycle those same set of groups every cycle without needing to rename them | 18:17 |
clarkb | fungi: good point | 18:17 |
clarkb | n-1-nova-stable and n-2-nova-stable | 18:17 |
*** droyo has joined #openstack-infra | 18:17 | |
fungi | we just need to stop referencing them in the acl before we switch their included group from the stable team to the release team, and then propose the acl for the coming release which uses that group on the not-yet-existent branch | 18:18 |
*** sree has quit IRC | 18:18 | |
dhellmann | that sounds a bit like the alternative I propose around line 99, is that what you mean? | 18:18 |
openstackgerrit | Brian Stajkowski proposed openstack-infra/project-config: Quark Project Non-Voting Py3 https://review.openstack.org/332287 | 18:18 |
openstackgerrit | Spencer Krum proposed openstack-infra/project-config: Infra spec helper is in openstack-infra https://review.openstack.org/332412 | 18:19 |
fungi | except with "n different groups" being just 1 | 18:19 |
*** javeriak has joined #openstack-infra | 18:19 | |
stajkowski | AJaeger: ok updated ty | 18:19 |
fungi | dhellmann: starting at the steady state (1) refs/heads/stable/* is granted to nova-stable-maint | 18:19 |
*** e0ne has joined #openstack-infra | 18:19 | |
*** sputnik13 has joined #openstack-infra | 18:20 | |
*** maishsk has joined #openstack-infra | 18:20 | |
fungi | dhellmann: then we prepare for release (2) by adding refs/heads/stable/newton controlled by nova-new-stable-maint | 18:20 |
fungi | dhellmann: then (3) we make release managers the only team included in nova-new-stable-maint | 18:21 |
openstackgerrit | Merged openstack/os-testr: Add documentation for generate-subunit https://review.openstack.org/328352 | 18:21 |
fungi | dhellmann: then (4) the rc period is upon us and we create the stable/newton branch in nova | 18:21 |
*** sree_ has joined #openstack-infra | 18:21 | |
*** ddieterly[away] has quit IRC | 18:21 | |
*** sree_ is now known as Guest9118 | 18:21 | |
fungi | dhellmann: then the release happens (5) and we replace release managers with nova-stable-maint as included in the nova-new-stable-maint group | 18:21 |
AJaeger | stajkowski: looks fine. Just a cosmetic nit: Could you move the voting: false line above the mutex entries so that we have some order in the file, please? | 18:21 |
fungi | dhellmann: then sometime later in the cycle, as immediately as you like, (6) we merge a change to remove refs/heads/stable/newton from the acl so the nova-new-stable-maint group is no longer referenced | 18:22 |
*** pcaruana has quit IRC | 18:22 | |
fungi | dhellmann: after that, (7) replace remove nova-stable-maint as included in the nova-new-stable-maint group and add release managers back to being included in that group | 18:23 |
dhellmann | I like that. it leaves us with no cruft. | 18:23 |
dhellmann | and we don't even need to do step 7 until we are ready to do step 2 again | 18:23 |
fungi | dhellmann: and that brings it full circle for ocata | 18:23 |
fungi | right-o | 18:23 |
dhellmann | so it could just be part of the script for step 3 | 18:24 |
dhellmann | steps 2 and 3 could be handled by the same script (set up the group memberships in gerrit and build the patch for project-config) | 18:24 |
dhellmann | or separate, it doesn't matter | 18:24 |
dhellmann | ok, I'll paste this into a comment on the review for ttx to update | 18:24 |
fungi | dhellmann: i can rehash it there, just a sec | 18:25 |
dhellmann | ok | 18:25 |
*** Guest9118 has quit IRC | 18:25 | |
*** ifarkas has quit IRC | 18:26 | |
openstackgerrit | Spencer Krum proposed openstack-infra/project-config: Infra spec helper is in openstack-infra https://review.openstack.org/332412 | 18:26 |
*** dangers_away has quit IRC | 18:30 | |
*** dangers_away has joined #openstack-infra | 18:31 | |
nibalizer | EmilienM: crinkle does https://review.openstack.org/#/c/331923/3 look good to go? | 18:32 |
fungi | dhellmann: my suggested plan is now outlined (slightly more clearly) in the comment i just added to 322863 | 18:33 |
crinkle | nibalizer: it's failing tests? | 18:34 |
crinkle | nibalizer: maybe we want to get rid of those jobs | 18:34 |
*** rhochmuth has quit IRC | 18:34 | |
nibalizer | crinkle: experimental tests | 18:34 |
dhellmann | fungi : great, thank you! | 18:34 |
EmilienM | nibalizer: looking | 18:34 |
nibalizer | crinkle: https://review.openstack.org/#/c/332412/ should fix the tests | 18:35 |
nibalizer | or at least allow them to go forward | 18:35 |
*** _milan_ has joined #openstack-infra | 18:35 | |
nibalizer | but right now we can't make any changes to infra puppet, so there is some desire to gogo on this | 18:35 |
nibalizer | fungi: had to manually verify gregs security patch earlier | 18:35 |
stajkowski | pabelanger: AJaeger all should be set to go now on https://review.openstack.org/#/c/332287/ | 18:35 |
anteaya | nibalizer: or system-config | 18:35 |
fungi | dhellmann: i think this is also remarkably similar to the current process, but uses group manipulation to move the cleanup down the road so it can happen post-release | 18:35 |
*** ajmiller has quit IRC | 18:36 | |
anteaya | nibalizer: https://review.openstack.org/#/c/329092/ | 18:36 |
dhellmann | fungi : yeah, the issue we were trying to address was the tight scheduling synchronization | 18:36 |
*** links has quit IRC | 18:36 | |
EmilienM | nibalizer: +1 & commented | 18:37 |
AJaeger | stajkowski: did you want to upload a new version with my suggested nit fixed? | 18:37 |
openstackgerrit | Merged openstack-dev/hacking: Updated from global requirements https://review.openstack.org/332268 | 18:37 |
*** milan has quit IRC | 18:37 | |
sdague | anyone know why our specs tree has blank documents - https://specs.openstack.org/openstack/nova-specs/specs/newton/approved/api-no-more-extensions.html ? | 18:38 |
sdague | that was valid content last week | 18:38 |
crinkle | nibalizer: did we decide we want to keep release notes? | 18:40 |
*** PollyZ has quit IRC | 18:40 | |
crinkle | nibalizer: i don't think we're ever going to release this thing (i don't think puppet-openstack even releases theirs) | 18:40 |
anteaya | sdague: looking at https://specs.openstack.org/openstack/nova-specs/specs/newton/approved/ only that file has a size of 0 | 18:40 |
sdague | anteaya: yep | 18:40 |
*** HeOS has quit IRC | 18:41 | |
sdague | why is the real question | 18:41 |
anteaya | indeed | 18:41 |
sdague | did some disk fill up and bork the publishing? | 18:41 |
*** ddieterly has joined #openstack-infra | 18:41 | |
clarkb | sdague: have you tried a local build to see if it is consistent? | 18:41 |
sdague | clarkb: yes, local build is fine | 18:42 |
jeblair | i don't see anything interested on 6-14 on https://wiki.openstack.org/wiki/Infrastructure_Status | 18:43 |
jeblair | er interesting | 18:43 |
sdague | ls -la doc/build/html/specs/newton/approved/api-no-more-extensions.html | 18:43 |
sdague | -rw-rw-r-- 1 sdague sdague 22893 Jun 21 14:42 doc/build/html/specs/newton/approved/api-no-more-extensions.html | 18:43 |
sdague | just rebuilt | 18:43 |
*** piet has quit IRC | 18:43 | |
*** PollyZ has joined #openstack-infra | 18:44 | |
clarkb | was it possibly lost when the static host disappeared? | 18:44 |
*** r-mibu has quit IRC | 18:45 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Quark Project Non-Voting Py3 https://review.openstack.org/332287 | 18:45 |
*** dizquierdo has quit IRC | 18:45 | |
fungi | yeah, it's possible that got truncated or something | 18:45 |
*** r-mibu has joined #openstack-infra | 18:45 | |
jeblair | clarkb: no that was 2016-06-20 05:24:05 according to the status page | 18:45 |
fungi | -rw-rw-r-- 1 jenkins jenkins 0 Jun 14 09:33 /srv/static/specs/openstack/nova-specs/specs/newton/approved/api-no-more-extensions.html | 18:46 |
fungi | from the server | 18:46 |
clarkb | would fsck possibly do that though? or other recovery steps | 18:46 |
jeblair | http://logs.openstack.org/03/03d5114f5fce342e144010e8a1e7a2a41416d9a2/post/nova-specs-publish-specs/284bb18/console.html.gz | 18:46 |
AJaeger | clarkb: could you look at https://review.openstack.org/330821 - this adds back the files rules for project-config. | 18:46 |
jeblair | i don't see anything interesting in the job | 18:47 |
sdague | that file has definitely been live and working previously, I've shared that link | 18:47 |
*** roaet has joined #openstack-infra | 18:47 | |
clarkb | AJaeger: I have already said my piece if others want to take the time to review and keep those up tondate thats fine | 18:47 |
sdague | so it was good, then got truncated sometime after wed | 18:47 |
fungi | though we have ick in syslog like: Jun 19 13:47:01 static kernel: [30671148.000318] EXT4-fs (dm-0): error count since last fsck: 11962 | 18:47 |
*** rhochmuth has joined #openstack-infra | 18:48 | |
sdague | I was offline thu -> sun, so that's as good as I can narrow it :) | 18:48 |
*** htruta` is now known as htruta | 18:48 | |
jeblair | then yeah, fallout from the hardware failure seems to make the most sense to me | 18:48 |
sdague | it would be helpful if we could get things regenerated regardless | 18:48 |
AJaeger | thanks, clarkb. jeblair, fungi, do we have then consensus on 330821? | 18:49 |
* AJaeger is willing to help keeing this up to date | 18:49 | |
openstackgerrit | Merged openstack/os-testr: Sort failed tests at the top on HTML result page https://review.openstack.org/321841 | 18:49 |
fungi | sdague: if it's going to be a while before another commit merges to the nova-specs repo, i can reenqueue the branch tip for it in post | 18:49 |
zigo | fungi: I'm not sure what happened, now we have a http://tarballs.openstack.org/openstack-pkg-tools/, but it is empty. | 18:49 |
sdague | fungi: it might be, we're past non priority spec freeze | 18:50 |
fungi | zigo: getting ready for our weekly meeting in 10 minutes so don't have time to look at the moment | 18:50 |
zigo | Sure. | 18:50 |
fungi | sdague: i've reenqueued it into post, though looks like we have a ~5.5 hour backlog there so it's not going to update straight away | 18:52 |
stajkowski | AJaeger: thank you! | 18:52 |
sdague | fungi: cool, thank you | 18:52 |
sdague | it should at least be there by tomorrow morning | 18:52 |
*** jaosorior has joined #openstack-infra | 18:52 | |
*** sputnik13 has quit IRC | 18:52 | |
*** ayoung has quit IRC | 18:54 | |
*** PollyZ_ has joined #openstack-infra | 18:55 | |
*** sdake has joined #openstack-infra | 18:56 | |
*** piet has joined #openstack-infra | 18:56 | |
*** PollyZ has quit IRC | 18:56 | |
*** sree has joined #openstack-infra | 18:56 | |
*** javeriak has quit IRC | 18:57 | |
*** mriedem1 has joined #openstack-infra | 18:58 | |
*** mriedem has quit IRC | 18:59 | |
*** ayoung has joined #openstack-infra | 18:59 | |
*** sdake_ has quit IRC | 18:59 | |
*** mriedem1 is now known as mriedem | 19:00 | |
*** ayoung has quit IRC | 19:00 | |
fungi | it's that (weekly infra team meeting) time again! find us in #openstack-meeting for the next hour | 19:00 |
jeblair | YAAAAAAAAAAAAAAAAY! | 19:00 |
*** sree has quit IRC | 19:01 | |
*** zul_ has quit IRC | 19:01 | |
* anteaya imagines jeblair with kermit arms | 19:01 | |
*** zul has joined #openstack-infra | 19:02 | |
*** ajmiller has joined #openstack-infra | 19:02 | |
fungi | pabelanger: you're not in #openstack-meeting | 19:04 |
*** jaosorior has quit IRC | 19:05 | |
*** amitgandhinz has quit IRC | 19:05 | |
*** amitgandhinz has joined #openstack-infra | 19:05 | |
*** acoles is now known as acoles_ | 19:07 | |
jhesketh | Morning | 19:07 |
*** akshai has joined #openstack-infra | 19:10 | |
anteaya | morning here too jhesketh | 19:11 |
jhesketh | o/ | 19:11 |
*** Sukhdev has joined #openstack-infra | 19:13 | |
anteaya | :) | 19:13 |
*** dmsimard|afk is now known as dmsimard | 19:15 | |
*** bhavik has joined #openstack-infra | 19:15 | |
*** ajmiller has quit IRC | 19:19 | |
*** haaj has joined #openstack-infra | 19:19 | |
*** _nadya_ has quit IRC | 19:19 | |
*** gyee has quit IRC | 19:19 | |
*** joaotargino has joined #openstack-infra | 19:20 | |
*** sree_ has joined #openstack-infra | 19:22 | |
*** sree_ is now known as Guest2819 | 19:22 | |
openstackgerrit | Matthew Treinish proposed openstack/os-testr: Remove the TODO file https://review.openstack.org/328357 | 19:23 |
*** abregman|afk has quit IRC | 19:24 | |
*** abregman has joined #openstack-infra | 19:24 | |
*** akshai has quit IRC | 19:25 | |
*** xenogear has quit IRC | 19:25 | |
*** ihrachys has joined #openstack-infra | 19:25 | |
*** Guest2819 has quit IRC | 19:26 | |
*** rdx_matt_ has joined #openstack-infra | 19:27 | |
*** permalac_ has joined #openstack-infra | 19:27 | |
*** esberglu_ has joined #openstack-infra | 19:27 | |
*** claudiub|2 has joined #openstack-infra | 19:27 | |
*** xarses_ has joined #openstack-infra | 19:27 | |
*** jcoufal_ has joined #openstack-infra | 19:27 | |
*** esberglu has quit IRC | 19:28 | |
*** jpmaxman has quit IRC | 19:28 | |
*** esberglu_ is now known as esberglu | 19:28 | |
*** e0ne_ has joined #openstack-infra | 19:28 | |
*** e0ne_ has quit IRC | 19:28 | |
*** piet has quit IRC | 19:29 | |
*** kaisers1 has quit IRC | 19:29 | |
*** aysyd has quit IRC | 19:29 | |
*** scottynomad has quit IRC | 19:29 | |
*** rdx_matt has quit IRC | 19:29 | |
*** arif-ali has quit IRC | 19:29 | |
*** toabctl has quit IRC | 19:29 | |
*** inc0_ has joined #openstack-infra | 19:29 | |
*** rossella_s has joined #openstack-infra | 19:29 | |
*** e0ne has quit IRC | 19:30 | |
*** david-lyle has quit IRC | 19:30 | |
*** jcoufal has quit IRC | 19:30 | |
*** pradk has quit IRC | 19:30 | |
*** claudiub has quit IRC | 19:30 | |
*** leifmadsen has quit IRC | 19:30 | |
*** vsaienko has quit IRC | 19:30 | |
*** aderyugin has quit IRC | 19:30 | |
*** mandre has quit IRC | 19:30 | |
*** ioni has quit IRC | 19:30 | |
*** cinerama has quit IRC | 19:30 | |
*** pfallenop has quit IRC | 19:30 | |
*** SotK has quit IRC | 19:30 | |
*** aarefiev has quit IRC | 19:30 | |
*** gabriel-bezerra has quit IRC | 19:30 | |
*** esikachev has joined #openstack-infra | 19:30 | |
*** inc0 has quit IRC | 19:31 | |
*** xarses has quit IRC | 19:31 | |
*** permalac has quit IRC | 19:31 | |
*** tristanC has quit IRC | 19:31 | |
*** sc` has quit IRC | 19:31 | |
*** tonyb has quit IRC | 19:31 | |
*** ajmiller has joined #openstack-infra | 19:32 | |
*** pfallenop has joined #openstack-infra | 19:32 | |
*** tristanC has joined #openstack-infra | 19:32 | |
*** sc` has joined #openstack-infra | 19:32 | |
*** tonyb has joined #openstack-infra | 19:32 | |
*** ioni has joined #openstack-infra | 19:32 | |
*** ioni is now known as Guest23899 | 19:33 | |
*** sree has joined #openstack-infra | 19:33 | |
*** ldnunes has quit IRC | 19:34 | |
*** amitgandhinz has quit IRC | 19:34 | |
*** amitgandhinz has joined #openstack-infra | 19:34 | |
*** cinerama has joined #openstack-infra | 19:34 | |
*** toabctl has joined #openstack-infra | 19:35 | |
*** arif-ali has joined #openstack-infra | 19:35 | |
*** scottynomad has joined #openstack-infra | 19:35 | |
*** leifmadsen has joined #openstack-infra | 19:35 | |
*** aderyugin has joined #openstack-infra | 19:35 | |
*** ldnunes has joined #openstack-infra | 19:36 | |
*** mandre has joined #openstack-infra | 19:36 | |
*** SotK has joined #openstack-infra | 19:36 | |
fungi | pabelanger: you're still not in #openstack-meeting and we're at your topic now | 19:37 |
*** flepied1 has joined #openstack-infra | 19:37 | |
*** aysyd has joined #openstack-infra | 19:37 | |
*** sree has quit IRC | 19:38 | |
*** _nadya_ has joined #openstack-infra | 19:38 | |
openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: import the release tools that need to run on secure nodes https://review.openstack.org/332447 | 19:39 |
openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: move the release tools that need to run on secure nodes https://review.openstack.org/332448 | 19:39 |
*** flepied has quit IRC | 19:39 | |
*** ayoung has joined #openstack-infra | 19:40 | |
*** david-lyle has joined #openstack-infra | 19:41 | |
*** haaj has quit IRC | 19:41 | |
*** kzaitsev_mb has joined #openstack-infra | 19:42 | |
*** jpmaxman has joined #openstack-infra | 19:42 | |
*** gabriel-bezerra has joined #openstack-infra | 19:43 | |
*** pradk has joined #openstack-infra | 19:43 | |
*** aarefiev has joined #openstack-infra | 19:43 | |
*** vsaienko has joined #openstack-infra | 19:44 | |
*** kaisers1 has joined #openstack-infra | 19:45 | |
*** BigWillie has quit IRC | 19:45 | |
*** sarob has joined #openstack-infra | 19:46 | |
*** maishsk_ has joined #openstack-infra | 19:47 | |
*** maishsk has quit IRC | 19:48 | |
*** maishsk_ is now known as maishsk | 19:48 | |
*** sree has joined #openstack-infra | 19:48 | |
*** banix has joined #openstack-infra | 19:49 | |
*** sarob_ has quit IRC | 19:49 | |
*** rhochmuth has quit IRC | 19:49 | |
*** HeOS has joined #openstack-infra | 19:50 | |
*** dtantsur is now known as dtantsur|afk | 19:51 | |
*** PollyZ_ has quit IRC | 19:51 | |
*** sree has quit IRC | 19:52 | |
*** sree has joined #openstack-infra | 19:53 | |
*** akshai has joined #openstack-infra | 19:54 | |
*** tphummel has quit IRC | 19:56 | |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Don't try to get stack details if the stack doesn't exist https://review.openstack.org/319337 | 19:56 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished https://review.openstack.org/297328 | 19:56 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test overcloud deletion in periodic job https://review.openstack.org/296765 | 19:56 |
openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: import the release tools that need to run on secure nodes https://review.openstack.org/332447 | 19:56 |
*** rhochmuth has joined #openstack-infra | 19:57 | |
*** rhochmuth has quit IRC | 19:57 | |
*** sree has quit IRC | 19:57 | |
*** PollyZ has joined #openstack-infra | 19:58 | |
*** rhochmuth has joined #openstack-infra | 19:59 | |
*** akshai has quit IRC | 20:00 | |
*** sree has joined #openstack-infra | 20:01 | |
*** amitgandhinz has quit IRC | 20:01 | |
*** _nadya_ has quit IRC | 20:01 | |
*** amitgandhinz has joined #openstack-infra | 20:01 | |
fungi | pabelanger: when you're around again, see meeting log. pleia2 is going to update your upgrade notification to be july 1st and get the announcement out in short order. i gather it's a holiday in canada but there are several of us over the border who plan to be around and are happy to take care of the upgrades | 20:02 |
*** PollyZ has quit IRC | 20:02 | |
fungi | and that way we have a week+ of advance notice to the community that we're taking stuff offline for hours | 20:03 |
*** marcusvrn_ has joined #openstack-infra | 20:03 | |
*** ihrachys has quit IRC | 20:04 | |
*** sree has quit IRC | 20:05 | |
*** Nikolay_St has quit IRC | 20:06 | |
*** sree has joined #openstack-infra | 20:07 | |
rcarrillocruz | pabelanger: https://review.openstack.org/#/c/332435/1 , generating a keypair on-the-fly in the launcher role | 20:08 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add other-requirements to files list for project-config https://review.openstack.org/332460 | 20:08 |
*** Apoorva has quit IRC | 20:10 | |
*** PollyZ has joined #openstack-infra | 20:11 | |
pleia2 | downtime announcement sent | 20:11 |
*** sree has quit IRC | 20:12 | |
*** kgiusti has left #openstack-infra | 20:12 | |
*** Sukhdev has quit IRC | 20:13 | |
*** rcernin has joined #openstack-infra | 20:13 | |
AJaeger | thanks, pleia2 ! That was quick! | 20:13 |
* Zara makes note, thanks :) | 20:13 | |
*** sree has joined #openstack-infra | 20:14 | |
*** rossella_ has joined #openstack-infra | 20:14 | |
pleia2 | it was already drafted :) | 20:14 |
*** PollyZ has quit IRC | 20:16 | |
*** dtardivel has quit IRC | 20:17 | |
*** rossella_s has quit IRC | 20:17 | |
*** sree has quit IRC | 20:18 | |
*** kzaitsev_mb has quit IRC | 20:19 | |
nibalizer | thansk pleia2 | 20:20 |
*** sree has joined #openstack-infra | 20:20 | |
*** kzaitsev_mb has joined #openstack-infra | 20:22 | |
openstackgerrit | Merged openstack/os-testr: Remove the TODO file https://review.openstack.org/328357 | 20:23 |
jroll | mordred: ircops won't bump the channel limit? :/ | 20:23 |
mordred | jroll: it's global currently | 20:23 |
mordred | jroll: not per-accout | 20:23 |
nibalizer | ah | 20:23 |
jroll | ah, I thought there was a per-user override | 20:23 |
nibalizer | so are we gonna have a fleet of gerritbots then? | 20:23 |
mordred | jroll: used to be - doesn't seem to be any more | 20:23 |
mordred | nibalizer: yah. I think we should name them fun things | 20:24 |
clarkb | I would prefer a "listen here " chennel to multiple robots | 20:24 |
mordred | nibalizer: like openstackgerrit-spencer | 20:24 |
njohnston | FYI review.openstack.org comes up as having broken HTTPS in my web client - Chrome 51.0.2704.84 - because SHA-1 signatures are used: http://imgur.com/Q4w33jt | 20:24 |
nibalizer | mordred: im going for 'openstackgerrit-ping-mordred' | 20:24 |
*** sputnik13 has joined #openstack-infra | 20:24 | |
*** matbu has quit IRC | 20:25 | |
*** sree has quit IRC | 20:25 | |
kzaitsev_mb | can anyone help me with https://review.openstack.org/#/c/331754/3 — as far as I understand it should have been merged long ago, but the gate check just doesn't start | 20:25 |
*** PollyZ has joined #openstack-infra | 20:25 | |
mordred | njohnston: oh. uhm | 20:25 |
rcarrillocruz | mordred , clarkb : can you look https://review.openstack.org/#/c/327789/ ? got a +2 from nibalizer .... | 20:25 |
mordred | fungi: ^^ | 20:25 |
mordred | fungi: if new chrome doesn't like our ssl certs, that's going to probably hit more people soonish | 20:26 |
clarkb | we also refreshed our certs all together a year ago iirc | 20:26 |
clarkb | so likely need to do it across the baord | 20:26 |
anteaya | pleia2: thanks for sending the announcement | 20:27 |
*** banix has quit IRC | 20:27 | |
*** markvoelker has quit IRC | 20:27 | |
AJaeger | kzaitsev_mb: could you toggle your workflow, please? Remove it and add it back again. | 20:27 |
fungi | oh sigh | 20:27 |
AJaeger | kzaitsev_mb: I see: +2W and then a rebase, this looks strange | 20:27 |
jeblair | mordred, njohnston, fungi: i see a sha-256 signature. | 20:27 |
*** Apoorva has joined #openstack-infra | 20:27 | |
fungi | njohnston: are you behind a proxy of some kind? | 20:28 |
AJaeger | kzaitsev_mb: let's check zuul status first | 20:28 |
kzaitsev_mb | AJaeger: just did that and the gate job started. phew. | 20:28 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-openstack_infra_spec_helper: Initial commit https://review.openstack.org/331923 | 20:28 |
kzaitsev_mb | I actually thought this trick doesn't work (I thought I did it and it had no effect) | 20:29 |
AJaeger | kzaitsev_mb: changeset 2 had the +2W and then it was rebased and now it's changeset 3. Not sure what happened there... | 20:29 |
njohnston | fungi: I'm not supposed to be... let me check and see if my corporate network put up a transparent proxy without telling me | 20:29 |
jeblair | njohnston: could you paste the output from: openssl s_client -showcerts -connect review.openstack.org:443 | 20:29 |
*** PollyZ has quit IRC | 20:29 | |
AJaeger | kzaitsev_mb: why did you rebase at all? gerrit rebases for you... | 20:30 |
kzaitsev_mb | it's always like this — you try everything, then come to #infra and someone asks to do an obvious thing and everything works %) | 20:30 |
openstackgerrit | Jef Mallal proposed openstack-infra/jenkins-job-builder: Add support for retry in multijob plugin https://review.openstack.org/329169 | 20:30 |
kzaitsev_mb | AJaeger: because the gate job didn't start even though it had 2+W | 20:30 |
AJaeger | kzaitsev_mb: always check first zuul queue length... | 20:31 |
*** ldnunes_ has joined #openstack-infra | 20:31 | |
*** matt-borland has quit IRC | 20:31 | |
*** mdrabe has quit IRC | 20:31 | |
fungi | njohnston: http://paste.openstack.org/show/520987/ "Signature Algorithm: sha256WithRSAEncryption" | 20:31 |
AJaeger | rebasing is seldom the solution, it will just force it back into check queue | 20:31 |
* AJaeger waves good bye | 20:32 | |
kzaitsev_mb | AJaeger: it was based on 2d patchset of a different patch, the 3d patchset of that change got merged and I thought that retriggering all the things might force it back into check and then into gate | 20:32 |
fungi | night AJaeger! | 20:32 |
kzaitsev_mb | ok, will know, that it's a bad idea | 20:32 |
*** bhavik1 has joined #openstack-infra | 20:32 | |
kzaitsev_mb | thanks for help +) | 20:32 |
*** matbu has joined #openstack-infra | 20:32 | |
njohnston | fungi: http://paste.openstack.org/show/520988/ I don't see a "Signature Algorithm" line | 20:33 |
*** tphummel has joined #openstack-infra | 20:33 | |
*** ldnunes has quit IRC | 20:33 | |
*** bhavik has quit IRC | 20:33 | |
*** bhavik1 is now known as bhavik | 20:33 | |
*** cody-somerville has quit IRC | 20:34 | |
jeblair | njohnston, fungi: that appears to be the correct cert and have a sha256 signature | 20:35 |
jeblair | so at least openssl gets the right cert | 20:35 |
jeblair | njohnston: can you ask chrome to give you a copy of the certificate it received? | 20:35 |
njohnston | Yeah, I just tried from a computer not on my corporate network, and after refreshing it looks fine, the warning disappears from Chrome. The bastards implemented a transparent ssl proxy on me. :-( | 20:35 |
jeblair | njohnston: apparently one that is active for chrome, but not command line openssl... | 20:35 |
fungi | njohnston: and even more insecure of a proxy than it needed to be apparently! | 20:35 |
SamYaple | njohnston: not so transparent there | 20:36 |
fungi | njohnston: is it possible to get chrome to give you details on the cert? as a not-chrome user i don't know the answer there | 20:36 |
SamYaple | fungi: yea you can | 20:36 |
*** sree_ has joined #openstack-infra | 20:36 | |
SamYaple | click on the lock in the top left by the url bar and then "details" | 20:36 |
clarkb | you click the green(or not green) lock | 20:36 |
*** sree_ is now known as Guest2209 | 20:37 | |
fungi | you should be able to tell what the reissued cert looks like. presumably you've allowed them to update your browser's trust store to include whatever the proxy's (terroble) cert is | 20:37 |
*** maishsk has quit IRC | 20:37 | |
*** jefmallal has joined #openstack-infra | 20:38 | |
njohnston | now I can't get it to give me the insecure certificate icon anymore. It's as if there are multiple servers behind a VIP, and at first I hit a real server that had a bad cert, but now I'm on a good real server. | 20:38 |
*** ayoung has quit IRC | 20:38 | |
*** PollyZ has joined #openstack-infra | 20:38 | |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-accessbot: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332466 | 20:39 |
fungi | in the entire cert chain from your paste, our cert's signature is the _shortest_ with sha256. the two others further up the chain are sha384 even | 20:39 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-openstack_infra_spec_helper: Initial commit https://review.openstack.org/331923 | 20:39 |
*** maishsk has joined #openstack-infra | 20:39 | |
clarkb | njohnston: that is a common deployment method for large corp proxies | 20:40 |
*** Guest2209 has quit IRC | 20:41 | |
*** sree has joined #openstack-infra | 20:41 | |
SamYaple | njohnston: call corporate IT and ask them to turn the servers on and off again | 20:41 |
*** ddieterly is now known as ddieterly[away] | 20:42 | |
*** rossella__ has joined #openstack-infra | 20:43 | |
openstackgerrit | Merged openstack-infra/project-config: Infra spec helper is in openstack-infra https://review.openstack.org/332412 | 20:43 |
*** PollyZ has quit IRC | 20:43 | |
*** bhavik1 has joined #openstack-infra | 20:45 | |
*** sree has quit IRC | 20:45 | |
*** pt_15 has quit IRC | 20:46 | |
*** rossella_ has quit IRC | 20:46 | |
*** matbu has quit IRC | 20:47 | |
*** matbu has joined #openstack-infra | 20:47 | |
anteaya | so I have an appointment to have internets again, let's hope the gods are smiling oh whoever is assigned the ticket to fix my internets tomorrow | 20:48 |
*** hemanthm is now known as hemanthm|afk | 20:48 | |
anteaya | I'm packing up to go get something to eat then will come back to the library in a bit | 20:48 |
openstackgerrit | Sean Roberts proposed openstack-infra/project-config: add craton project https://review.openstack.org/332470 | 20:48 |
Zara | :) | 20:48 |
*** bhavik has quit IRC | 20:49 | |
*** bhavik1 is now known as bhavik | 20:49 | |
*** sputnik13 has quit IRC | 20:51 | |
*** pradk has quit IRC | 20:51 | |
*** maishsk has quit IRC | 20:52 | |
*** dprince has quit IRC | 20:53 | |
*** pilgrimstack has joined #openstack-infra | 20:53 | |
*** sputnik13 has joined #openstack-infra | 20:54 | |
*** sarob_ has joined #openstack-infra | 20:54 | |
*** rossella_ has joined #openstack-infra | 20:55 | |
*** Sukhdev_ has joined #openstack-infra | 20:56 | |
*** shashank_hegde has joined #openstack-infra | 20:57 | |
*** rossella__ has quit IRC | 20:58 | |
*** sarob has quit IRC | 20:59 | |
*** gyee has joined #openstack-infra | 21:00 | |
*** raunak has quit IRC | 21:00 | |
dhellmann | fungi : I've put the release tools that we'll need for the automation in a subdir of jenkins/scripts, is that going to work OK? | 21:00 |
dhellmann | fungi : https://review.openstack.org/#/c/332447/ | 21:01 |
*** pilgrimstack has quit IRC | 21:01 | |
*** jefmallal has quit IRC | 21:01 | |
*** _ari_ has quit IRC | 21:02 | |
fungi | dhellmann: yep, that's where they belong | 21:02 |
*** sputnik13 has quit IRC | 21:02 | |
*** ddieterly[away] is now known as ddieterly | 21:04 | |
*** raildo is now known as raildo-afk | 21:04 | |
*** rfolco has quit IRC | 21:04 | |
*** PollyZ has joined #openstack-infra | 21:06 | |
*** kzaitsev_mb has quit IRC | 21:06 | |
*** yolanda has joined #openstack-infra | 21:06 | |
*** trown is now known as trown|outtypewww | 21:07 | |
*** eharney has quit IRC | 21:07 | |
rajinir | Zuul: Having a wierd problem in our CI. Zuul is not passing a range of built-in parameters (eg: ZUUL_PROJECT) . Any clues where to debug this problem? | 21:08 |
*** psilvad has quit IRC | 21:08 | |
*** matt-borland has joined #openstack-infra | 21:09 | |
*** sputnik13 has joined #openstack-infra | 21:10 | |
*** armax has joined #openstack-infra | 21:10 | |
*** kzaitsev_mb has joined #openstack-infra | 21:10 | |
*** inc0_ has quit IRC | 21:10 | |
*** rossella__ has joined #openstack-infra | 21:10 | |
*** esikachev has quit IRC | 21:11 | |
*** baoli has quit IRC | 21:11 | |
*** baoli has joined #openstack-infra | 21:12 | |
dhellmann | fungi : ok, I wasn't sure about the new subdirectory | 21:12 |
*** gouthamr has quit IRC | 21:12 | |
*** rhallisey has quit IRC | 21:14 | |
*** rossella_ has quit IRC | 21:14 | |
*** rossella_ has joined #openstack-infra | 21:15 | |
fungi | dhellmann: oh, new directory? i haven't pulled up the change yet | 21:15 |
fungi | ahh, jenkins/scripts/release-tools/ | 21:15 |
pleia2 | oh, forgot to mention earlier, I'm away Mon-Wednesday next week, will be at CodeConfLA | 21:15 |
*** sree has joined #openstack-infra | 21:16 | |
jpmaxman | ok fungi - I think I'm going to try recaptcha to see if it successfully stops the spam | 21:16 |
fungi | dhellmann: we've not done subtrees under there in the past, but with that many scripts it makes some sense to keep 'em separated | 21:16 |
jpmaxman | I've been watching the server off and on | 21:16 |
fungi | jpmaxman: great, thanks for the heads-up! happy to test | 21:16 |
jpmaxman | and one thing I notice | 21:16 |
jpmaxman | 2001:4800:7810:512:3bc3:d7f6:ff04:5371 - - [21/Jun/2016:21:15:19 +0000] "POST /w/index.php?title=Special%3ARunJobs&tasks=jobs&maxjobs=1&sigexpiry=1466543724&signature=6e25ad7850a068071bfb103182b594f701003350 HTTP/1.1" 302 725 "-" "-" | 21:16 |
jpmaxman | continuous posts to this url in the logs | 21:16 |
jpmaxman | is that something you're aware of? | 21:16 |
*** rossella__ has quit IRC | 21:16 | |
jpmaxman | i don't think it is related to the spam | 21:17 |
jpmaxman | just thought I'd point it out | 21:17 |
*** sree_ has joined #openstack-infra | 21:17 | |
fungi | jpmaxman: i think there's a cron job on the server calling that to do some sort of periodic wiki maintenance. checking now | 21:17 |
dhellmann | fungi : that's what I thought re organization, but I wasn't sure how those files are "installed" on a node and if that extra level would cause an issue. I may end up putting a little readme in there, too, since sometimes it's necessary/useful to run those scripts by hand | 21:17 |
pleia2 | speaking of the wiki, I still could use some eyes on the upgrade spec https://review.openstack.org/#/c/328455/ | 21:17 |
*** sree_ is now known as Guest92258 | 21:17 | |
jpmaxman | yeah I found this | 21:17 |
jpmaxman | https://phabricator.wikimedia.org/T68225 | 21:17 |
pleia2 | jpmaxman: could use input from you as well, in case we want to include any anti-spam stuff in the spec | 21:18 |
pleia2 | (not sure if we do) | 21:18 |
*** ajmiller_ has joined #openstack-infra | 21:19 | |
pleia2 | fungi: I think you also mentioned that pabelanger may not have time to work on this? so I think we need to change the primary assignee | 21:19 |
fungi | pleia2: yep, i'm happy to be the primary assignee on it | 21:19 |
pleia2 | ok, I'll make a comment to update it in the next revision | 21:19 |
fungi | pleia2: pabelanger and nibalizer had volunteered to work on it at the summit but have since been pulled in other directions | 21:20 |
* pleia2 nods | 21:20 | |
*** sree has quit IRC | 21:20 | |
nibalizer | oh the wiki? | 21:20 |
*** gouthamr has joined #openstack-infra | 21:20 | |
nibalizer | yea I had hoped to help pabelanger not drive | 21:20 |
pleia2 | yeah, wiki upgrade | 21:21 |
nibalizer | i.e. be around for reviews and bounce ideas and stuff | 21:21 |
pleia2 | nibalizer: can you look at the spec? | 21:21 |
nibalizer | generally 'hand me a task' and ill do it | 21:21 |
*** mdrabe has joined #openstack-infra | 21:21 | |
*** sree has joined #openstack-infra | 21:21 | |
nibalizer | but like planning and figuring out what needs to be done... don't depend on me | 21:21 |
nibalizer | btw i am actually trying to fix puppet still yall | 21:21 |
*** markvoelker has joined #openstack-infra | 21:21 | |
*** Guest92258 has quit IRC | 21:22 | |
jpmaxman | pleia2 yup - I think it is all a good idea regardless | 21:22 |
pleia2 | fix puppet \o/ (that's part of the spec) | 21:22 |
jpmaxman | I'm not sure of the current state of puppetization | 21:22 |
jpmaxman | I know that the settings file was added | 21:22 |
*** ajmiller has quit IRC | 21:22 | |
pleia2 | jpmaxman: puppet does still need a bit of work, but I haven't dug into it | 21:23 |
clarkb | the puppet installs apache and php, elasticsearch, and the config but does not control the mediawiki install iirc | 21:23 |
pleia2 | yeah, it doesn't install the mediawiki software itself | 21:23 |
pleia2 | that was all done manually | 21:23 |
clarkb | basically the only but missing is the nebulous install mediawiki and plugins | 21:23 |
clarkb | and possibly db management byt I think thats automagic with mediawiki? | 21:24 |
*** ccamacho has left #openstack-infra | 21:24 | |
pleia2 | yeah, I think it has a script | 21:24 |
*** ldnunes_ has quit IRC | 21:25 | |
pleia2 | I think we need to still create the database and user though | 21:25 |
pleia2 | the script just populates it | 21:25 |
*** sree has quit IRC | 21:25 | |
clarkb | pleia2: currently thats trove iirc which isnt part of puppet for our things | 21:25 |
*** ramishra has joined #openstack-infra | 21:26 | |
jpmaxman | right I think it is using a local mysql | 21:27 |
pleia2 | no, clarkb is right, we are using trove (just checked) | 21:28 |
fungi | also the mediawiki installation there can be massively simplified | 21:28 |
fungi | the whole red/blue paradigm is serious additional complication if we're planning to also haev a wiki-dev to test out new versions | 21:29 |
pleia2 | agreed | 21:29 |
*** ddieterly is now known as ddieterly[away] | 21:29 | |
*** jcoufal_ has quit IRC | 21:30 | |
*** amitgandhinz has quit IRC | 21:30 | |
fungi | a brief window every few weeks where the wiki is offline because files are being untarred is tolerable for this system | 21:30 |
*** baoli has quit IRC | 21:30 | |
fungi | generally going to be on the order of seconds | 21:30 |
*** amitgandhinz has joined #openstack-infra | 21:30 | |
fungi | so i really don't want to overengineer it | 21:30 |
*** markusry has joined #openstack-infra | 21:30 | |
pleia2 | ++ | 21:30 |
*** burgerk_ has quit IRC | 21:30 | |
pabelanger | fungi: pleia2: sorry for missing our meeting, got pulled away from computer for personal reason | 21:30 |
pleia2 | pabelanger: no problem, it got you out of a maintenance window :D | 21:31 |
fungi | pabelanger: no apologies needed! just wanted to point you to maintenance updates in the meeting log so you're aware | 21:31 |
pleia2 | (enjoy Canada Day) | 21:31 |
mtreinish | fungi: any amount of downtime and someone will notice and come in channel to complain | 21:31 |
*** sputnik13 has quit IRC | 21:31 | |
fungi | why ask why, drink canada dry? | 21:31 |
* fungi can't remember the canada dry slogan | 21:32 | |
pabelanger | fungi: pleia2: sure, looking at the meeting logs now | 21:32 |
fungi | mtreinish: yep, and we'll refund them every cent they pay for wiki access | 21:32 |
nibalizer | pleia2: spec looks solid | 21:32 |
pleia2 | nibalizer: thanks for looking <3 | 21:32 |
nibalizer | yah no prblem | 21:32 |
pabelanger | jeblair: zl03 was restarted correctly by our ansible-playbook. moving to zl01 now | 21:33 |
*** gouthamr has quit IRC | 21:33 | |
mtreinish | fungi: https://flic.kr/p/A154HN I tried that during my first trip to japan | 21:33 |
*** gouthamr has joined #openstack-infra | 21:33 | |
mtreinish | fungi: I don't think they sold it for very long, I haven't been able to find it since | 21:34 |
bkero | mmm hot ginger ale | 21:34 |
fungi | mtreinish: oh, interesting! however we have plenty of very spicy ginger ales available in the usa made with far better ingredients | 21:35 |
mtreinish | bkero: heh, it's not as good as it sounds. It was actually kinda gross :) | 21:35 |
bkero | aww | 21:35 |
openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/infra-specs: Add wiki modernization spec https://review.openstack.org/328455 | 21:35 |
*** sree has joined #openstack-infra | 21:35 | |
*** ddieterly[away] is now known as ddieterly | 21:35 | |
bkero | mtreinish: Blenheim is my favorite hot ginger ale | 21:35 |
bkero | super spicy | 21:35 |
mtreinish | fungi: hot as in serving temperature, not how spicy it was : | 21:35 |
bkero | oooooh | 21:35 |
fungi | mtreinish: WEIRD | 21:35 |
SpamapS | too bad about Quorrobolong | 21:35 |
SpamapS | that's a FUNNY word | 21:36 |
pleia2 | hot ginger ale is a thing? | 21:36 |
mtreinish | yes, it was very strange. That's why I had to try it :) | 21:36 |
fungi | mtreinish: well, maybe not so weird. i drink hot ginger broth ("tea") frequently | 21:36 |
pleia2 | had alcoholic ginger ale recently, enjoyed | 21:36 |
mtreinish | pleia2: I only ever saw it during that trip. I think they learned their lesson | 21:36 |
pleia2 | haha | 21:36 |
*** jpeeler has quit IRC | 21:36 | |
pleia2 | fungi: yeah, I think it's hot+carbonated that's throwing me off | 21:37 |
pleia2 | ginger tea is tastey | 21:37 |
fungi | take fresh ginger root, slice thin, simmer for a few minutes, filter and consume. add a little honey if you like | 21:37 |
fungi | but hot carbonation seems physically infeasible | 21:37 |
pabelanger | pleia2: regarding wiki, that's currently last on my list for upgrades. Let me loop back to it tomorrow and see what our current status on the precise upgrades are | 21:37 |
fungi | solubility of gasses goes down as the solution temperature increases | 21:38 |
mtreinish | I thought it'd be like warm ginger ale, which can be soothing, especially if you're sick | 21:38 |
pleia2 | pabelanger: thanks, I'd appreciate your eyes on the upgrade spec when you do that | 21:38 |
mtreinish | but increase the temperature too much and it just tastes bad | 21:38 |
*** dimtruck is now known as zz_dimtruck | 21:38 | |
pabelanger | pleia2: sure, I'll read up on it too | 21:38 |
jeblair | pabelanger: that seems like zl03 took a long time? | 21:39 |
*** bhavik has quit IRC | 21:39 | |
*** markvoelker has quit IRC | 21:39 | |
bkero | fungi: your ginger tea sounds fantsatic | 21:39 |
*** sputnik13 has joined #openstack-infra | 21:39 | |
fungi | bkero: in the summer i just drop sliced ginger in a pitcher of water and keep it in the fridge for a day or so before drinking | 21:40 |
*** bhavik has joined #openstack-infra | 21:40 | |
*** sree has quit IRC | 21:40 | |
fungi | adding a lemon wedge is great too | 21:40 |
* pleia2 adds bourbon to fungi's ginger tea | 21:40 | |
fungi | rum! | 21:40 |
pleia2 | how pirate of you | 21:40 |
fungi | arrrrr | 21:40 |
fungi | we have a pretty drinkable local rum here now (well, brewed on the next island over, but near) | 21:41 |
*** ayoung has joined #openstack-infra | 21:41 | |
*** rcernin has quit IRC | 21:41 | |
pabelanger | jeblair: zl03 took 2.3 hours to restart using the playbook. It actually tried to do the next server in the list, but I had not accepted the ssh host key from puppetmaster.o.o under my username. | 21:41 |
bkero | fungi: is the ginger good for more than one steep? | 21:41 |
jeblair | pabelanger: 2.3 is still a long time :( | 21:42 |
bkero | I didn't think the gingery-ness would come out if you don't steep it in hot water | 21:42 |
*** abregman has quit IRC | 21:42 | |
fungi | bkero: the cold variety i will sometimes top back up with water at least once. the hot less so (heat tends to extract the sap more rapidly) | 21:43 |
bkero | Ah | 21:43 |
bkero | I'll probably try that when I get home | 21:43 |
pabelanger | jeblair: not sure how we can speed that up with graceful | 21:43 |
fungi | yeah, you need to slice thinly or mince finely and leave the water sitting on it for a good 24 hours to steep it sufficiently for a cold brew. also i think the slight acidity from the lemon juice helps | 21:44 |
bkero | Maybe add some sugar and yeast and time to make some carbonated ginger tea beer | 21:44 |
*** jamesmca_ has joined #openstack-infra | 21:44 | |
bkero | I have a hard time slicing ginger thinly. I have a pretty sharp mandolin, but it's not good enough to slice ginger :( | 21:44 |
fungi | bkero: yeah, making ginger beer is pretty easy. used to do it all the time growing up. also birch beer and sassafrass beer | 21:44 |
bkero | Mmmmm | 21:44 |
*** amitgandhinz has quit IRC | 21:45 | |
fungi | more of the latter two since they grew all over the mountains where i grew up | 21:45 |
fungi | ginger we had to buy | 21:45 |
jeblair | pabelanger: well, i wonder what jobs it was running? | 21:45 |
*** sputnik13 has quit IRC | 21:46 | |
pabelanger | jeblair: let me check | 21:46 |
openstackgerrit | Spencer Krum proposed openstack-infra/project-config: More typos in infra_spec_helper job definition https://review.openstack.org/332486 | 21:46 |
jeblair | i like this idea of being upfront in the commit message with commits that add typos | 21:46 |
*** clayton has quit IRC | 21:46 | |
*** jamesmcarthur has quit IRC | 21:47 | |
*** stevemar has quit IRC | 21:47 | |
*** clayton has joined #openstack-infra | 21:47 | |
jeblair | it's like setting the evil bit on your packets | 21:47 |
*** rossella__ has joined #openstack-infra | 21:47 | |
*** gouthamr has quit IRC | 21:47 | |
bkero | fungi: none of that grows around here sadly. We just make gin with the stuff that grows around here | 21:48 |
fungi | jpmaxman: strangely, we have a todo comment in the mw config to add a cronjob to post to the RunJobs url http://git.openstack.org/cgit/openstack-infra/puppet-mediawiki/tree/templates/Settings.php.erb#n56 | 21:48 |
nibalizer | jeblair: its a story of the discovery of more typos | 21:48 |
*** chlong|rhce_trng has quit IRC | 21:48 | |
nibalizer | i only rechecked it like 4 times to make sure! | 21:48 |
*** zz_dimtruck is now known as dimtruck | 21:49 | |
fungi | jpmaxman: but that ipv6 address calling it is definitely the one from the local eth0 interface | 21:49 |
*** sputnik13 has joined #openstack-infra | 21:49 | |
nibalizer | pleia2: unfortunately, it doesn't look like we have a lot of options for a puppet mediawiki module | 21:49 |
*** markvoelker has joined #openstack-infra | 21:50 | |
pleia2 | nibalizer: yeah, I did a basic review of the two that exist, hoping that their out of dateness wouldn't matter, but it does :( | 21:50 |
nibalizer | yep | 21:50 |
pleia2 | someone should dig deeper, but I don't think we can reasonably use either one | 21:50 |
*** dimtruck is now known as zz_dimtruck | 21:50 | |
pleia2 | and I'm not keen on adopting an upstream and maintaining things we don't use | 21:50 |
*** rossella_ has quit IRC | 21:51 | |
fungi | right, i similarly evaluated the three mentioned in the puppetforge and even the most "active" one hadn't seen a commit to its master branch in over two years | 21:51 |
pleia2 | yeah | 21:51 |
fungi | and the one we have is partway there anyway | 21:51 |
* pleia2 nods | 21:52 | |
pleia2 | and we can keep it simple | 21:52 |
fungi | we can certainly borrow relevant ideas from those others too if we hit a head scratcher | 21:52 |
pabelanger | jeblair: last 2 jobs we on tripleo-test-cloud-rh1, which took about 1 hour more to finish then final job from rax-ord. | 21:52 |
*** sree has joined #openstack-infra | 21:53 | |
*** sputnik13 has quit IRC | 21:53 | |
*** Rockyg has quit IRC | 21:55 | |
*** dfflanders has joined #openstack-infra | 21:55 | |
*** claudiub|2 has quit IRC | 21:55 | |
*** jordan__ has joined #openstack-infra | 21:57 | |
*** zeih has joined #openstack-infra | 21:57 | |
*** sree has quit IRC | 21:57 | |
*** sputnik13 has joined #openstack-infra | 21:58 | |
*** jordan__ has quit IRC | 21:59 | |
*** jamesmca_ has quit IRC | 22:00 | |
*** esberglu has quit IRC | 22:00 | |
*** cody-somerville has joined #openstack-infra | 22:00 | |
*** cody-somerville has joined #openstack-infra | 22:00 | |
*** sree has joined #openstack-infra | 22:01 | |
openstackgerrit | Sam Betts proposed openstack-infra/project-config: Add Ironic multinode job https://review.openstack.org/332490 | 22:01 |
*** sree_ has joined #openstack-infra | 22:02 | |
*** sambetts is now known as sambetts|afk | 22:02 | |
*** sputnik13 has quit IRC | 22:03 | |
*** sree_ is now known as Guest64181 | 22:03 | |
*** mriedem has quit IRC | 22:03 | |
*** yaume_ has quit IRC | 22:05 | |
*** raunak has joined #openstack-infra | 22:05 | |
*** sputnik13 has joined #openstack-infra | 22:05 | |
nibalizer | any cores wanna push https://review.openstack.org/#/c/332486/ through? | 22:05 |
*** sree has quit IRC | 22:06 | |
*** matt-borland has quit IRC | 22:07 | |
*** Guest64181 has quit IRC | 22:07 | |
*** sputnik13 has quit IRC | 22:07 | |
*** mdrabe has quit IRC | 22:08 | |
pleia2 | nibalizer: lgtm | 22:08 |
*** ramishra has quit IRC | 22:10 | |
*** banix has joined #openstack-infra | 22:10 | |
*** markusry has quit IRC | 22:11 | |
mtreinish | pleia2, nibalizer: any idea why this doesn't ever want to land: https://review.openstack.org/328467 it seems to keep getting stuck on random unrelated failures | 22:11 |
mtreinish | although I'm not the best at reading the output from beaker tests | 22:11 |
*** xarses_ is now known as xarses | 22:12 | |
pleia2 | mtreinish: hm, there were some issues yesterday, but I thought it had gotten sorted | 22:12 |
anteaya | beaker tests are currently broken | 22:13 |
pleia2 | ah, still :\ | 22:13 |
nibalizer | mtreinish: yea they are broken | 22:13 |
nibalizer | still working on it | 22:13 |
anteaya | this is what nibalizer is trying to fix with the new repo | 22:13 |
nibalizer | so close though | 22:13 |
nibalizer | ya we're headed for the 'real solution' instead of the quick fix | 22:13 |
nibalizer | just experienceing some pain from that | 22:13 |
anteaya | yeah basically some new gem release broke all the things and pinning in all the infra modules is painful | 22:13 |
nibalizer | pleia2: thanks | 22:13 |
anteaya | so new repo is a gem that is the source of the pins for all infra puppte modules gems | 22:14 |
anteaya | go go new repo | 22:14 |
mtreinish | nibalizer: :/ ok thanks | 22:14 |
* mtreinish just wants his 1 line config change to land | 22:14 | |
anteaya | mtreinish: I hear ya | 22:14 |
*** sree has joined #openstack-infra | 22:15 | |
nibalizer | mtreinish: yea | 22:15 |
*** Sukhdev_ has quit IRC | 22:16 | |
*** njohnston is now known as njohnston|afk | 22:17 | |
*** sree has quit IRC | 22:19 | |
*** tphummel has quit IRC | 22:19 | |
*** ddieterly is now known as ddieterly[away] | 22:19 | |
*** vhosakot has quit IRC | 22:19 | |
*** Sukhdev_ has joined #openstack-infra | 22:20 | |
mordred | mtreinish: I'm secretly blocking your patch just to mess with you ... but sssh, don't tell mtreinish | 22:21 |
mtreinish | mordred: lol | 22:21 |
mtreinish | mordred: I think it's been failing to get through the gate since you were away | 22:22 |
pleia2 | mordred: Your father's a scoundrel, and so, it seems, are you. | 22:22 |
openstackgerrit | Merged openstack-infra/project-config: More typos in infra_spec_helper job definition https://review.openstack.org/332486 | 22:22 |
*** marcusvrn_ has quit IRC | 22:23 | |
*** tphummel has joined #openstack-infra | 22:24 | |
pleia2 | (too much hamilton soundtrack) | 22:24 |
*** shashank_hegde has quit IRC | 22:24 | |
*** edmondsw has quit IRC | 22:25 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Fix tempest configuration https://review.openstack.org/331997 | 22:25 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE TESTING https://review.openstack.org/316436 | 22:25 |
mordred | pleia2: I'm young, scrappy and hungry | 22:26 |
pleia2 | :D | 22:26 |
mordred | pleia2, notmorgan: btw, Lin-Manuel, Leslie Odom and Phillipa Sou are all leaving July 9 | 22:27 |
pleia2 | yeah, I just learned about Phillipa Sou :\ | 22:27 |
pleia2 | but they said they'd record it before then | 22:27 |
mordred | I saw all of them except Lin | 22:27 |
mordred | ooh. I would watch the video recording constantly | 22:28 |
*** javeriak has joined #openstack-infra | 22:28 | |
mordred | pleia2: fwiw, the understudy is _amazing_ ... so it should still be quite good enough once they | 22:28 |
mordred | are gone | 22:28 |
pleia2 | that's good | 22:28 |
jpmaxman | fungi ok - maybe we can circle back around to that in the wiki upgrade | 22:29 |
jpmaxman | so can you suspend the updating of the settings file? | 22:29 |
*** haaj has joined #openstack-infra | 22:29 | |
*** sree has joined #openstack-infra | 22:30 | |
mordred | jpmaxman: one sec, I can help with that | 22:30 |
jpmaxman | thanks :D | 22:30 |
jpmaxman | pleia2 I took a look at the upgrade doc - it looks good to me and certainly seems a good place to start. I'm sure there will be other things that will come up, but the sooner it is started... | 22:31 |
pleia2 | jpmaxman: thanks, want to leave a +1? :) | 22:32 |
*** banix has quit IRC | 22:32 | |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Disable puppet on wiki.openstack.org https://review.openstack.org/332497 | 22:33 |
mordred | pleia2: ^^ | 22:33 |
pleia2 | mordred: need a colon in there? | 22:33 |
mordred | pleia2: thank you | 22:34 |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Disable puppet on wiki.openstack.org https://review.openstack.org/332497 | 22:34 |
mordred | 548814 | 22:34 |
pleia2 | +2 | 22:34 |
mordred | nibalizer: ^^ you got a sec for that? | 22:34 |
*** sree has quit IRC | 22:34 | |
jpmaxman | pleia2 yeah did :) | 22:35 |
pleia2 | jpmaxman: thank you | 22:35 |
*** sree has joined #openstack-infra | 22:35 | |
*** zeih has quit IRC | 22:35 | |
nibalizer | mordred: why not just use the emergency file? | 22:36 |
mordred | nibalizer: cause I think it's gonna be turned off for a bit | 22:36 |
nibalizer | ok | 22:36 |
mordred | nibalizer: while they figure out the sitch | 22:36 |
nibalizer | i love that we have a random uuid | 22:36 |
*** markvoelker has quit IRC | 22:36 | |
nibalizer | disabled, | 22:36 |
mordred | of course we do :) | 22:37 |
mordred | (I think that's new-gerrit, yeah?) | 22:37 |
anteaya | does anyone know what that uuid is? | 22:37 |
anteaya | new-gerrit? how old is new gerrit? | 22:37 |
anteaya | is there backscroll I need to read? | 22:37 |
mordred | anteaya: we're doing an OS upgrade in a couple of weeks, right? | 22:38 |
*** shashank_hegde has joined #openstack-infra | 22:39 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Remove unused success extra_vars from post_playbook https://review.openstack.org/332499 | 22:39 |
*** rcarrillocruz has quit IRC | 22:39 | |
*** sree has quit IRC | 22:40 | |
anteaya | mordred: oh obviously I have reading to do | 22:40 |
anteaya | mordred: I must have missed this bit entirely | 22:40 |
*** rcarrillocruz has joined #openstack-infra | 22:40 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Remove unused success extra_vars from post_playbook https://review.openstack.org/332499 | 22:40 |
*** sree has joined #openstack-infra | 22:41 | |
mordred | anteaya: nope. I suck. | 22:41 |
mordred | anteaya: we're updating static and zuul - not review | 22:41 |
mordred | anteaya: I'm back to not knowing what uuid is | 22:42 |
*** ddieterly[away] is now known as ddieterly | 22:43 | |
anteaya | mordred: okay | 22:43 |
anteaya | mordred: I'm in sync with you again | 22:43 |
*** shashank_hegde has quit IRC | 22:44 | |
*** ajmiller_ has quit IRC | 22:44 | |
fungi | jpmaxman: sorry, stepped away for dinner, but looks like mordred took care of you. as for the runjobs call, i have a strong suspicion it's the cirrussearch plugin, since it runs elasticsearch in a persistent daemon jvm, so it may be making local callouts to mw to do something, just need to take some time to research what | 22:44 |
jpmaxman | ok cool | 22:44 |
*** droyo has quit IRC | 22:45 | |
jpmaxman | and no problem - all set - we'll see what we can do | 22:45 |
*** sree has quit IRC | 22:45 | |
*** hongbin has quit IRC | 22:45 | |
*** sree has joined #openstack-infra | 22:46 | |
*** rossella_ has joined #openstack-infra | 22:46 | |
*** rbrndt has quit IRC | 22:47 | |
anteaya | jenkins failed on the beaker test, or sorry zuul did | 22:49 |
anteaya | so how long before we make beaker tests on system-config non voting? | 22:49 |
fungi | jpmaxman: suspicion confirmed, sort of... https://www.mediawiki.org/wiki/Thread:Extension_talk:CirrusSearch/How_does_CirrusSearch_refresh_the_index%3F | 22:49 |
anteaya | I'm in the now camp if anyone is counting votes | 22:49 |
*** armax has quit IRC | 22:50 | |
*** rossella__ has quit IRC | 22:50 | |
fungi | apparently mw calls runjobs _itself_ on each pageload by default, and cirrussearch adds a job hook in there to do its index refreshes | 22:50 |
*** sputnik13 has joined #openstack-infra | 22:51 | |
anteaya | this is the beaker is busted issue: http://logs.openstack.org/97/332497/2/check/gate-openstackci-beaker-ubuntu-trusty/83411e8/console.html#_2016-06-21_22_42_14_467513 | 22:51 |
*** sree has quit IRC | 22:51 | |
anteaya | which nibalizer is trying to fix but won't be in a postion to have the things fixed for a day or so | 22:51 |
fungi | jpmaxman: which explains the todo comment in our config... if you set it to 0 then you can make a cron job to periodically call that instead, otherwise it calls back to that itself on each page load (highly inefficient) https://www.mediawiki.org/wiki/Thread:Extension_talk:CirrusSearch/How_does_CirrusSearch_refresh_the_index%3F | 22:51 |
anteaya | estimate * typos | 22:52 |
jpmaxman | yes - pleia2 maybe should make that part of the upgrade to move to a cron job | 22:52 |
*** xyang1 has quit IRC | 22:53 | |
pleia2 | jpmaxman: moving or adding? | 22:53 |
openstackgerrit | Merged openstack-infra/system-config: Disable puppet on wiki.openstack.org https://review.openstack.org/332497 | 22:53 |
pleia2 | we should probably add specifics like this to the etherpad we had going | 22:53 |
fungi | adding a cron job (moving from having mw call that itself to having a cron job call it) | 22:53 |
pleia2 | oh I understand | 22:54 |
jpmaxman | right moving away from mw calls | 22:54 |
fungi | i manually bypassed the broken beaker job for 332497 (which is why it just merged) but i agree with anteaya we should probably make these jobs nonvoting until the fix lands if nibalizer estimates another day for them | 22:54 |
anteaya | fungi: thank you | 22:54 |
pleia2 | adding an Upgrade section to https://etherpad.openstack.org/p/wiki.openstack.org | 22:55 |
nibalizer | well its not a day | 22:55 |
*** sree has joined #openstack-infra | 22:55 | |
nibalizer | its 'this should have taken a day' | 22:55 |
fungi | nibalizer: anything i can help get rolled through to wrap it up? | 22:55 |
nibalizer | im waiting for a job to be updated in zuul-launcher | 22:56 |
nibalizer | then gonna check experimental on this; https://review.openstack.org/#/c/331923/; land it; then land this https://review.openstack.org/#/c/332466/ | 22:57 |
anteaya | nibalizer: then create all the patches to fix the jobs, yeah? | 22:57 |
nibalizer | and once 332466 works and is known to work, then i run explode.sh (hopefully for the last time) to update all the other puppet modules the same as 332466 and then its fixed | 22:57 |
anteaya | nibalizer: how much time do you think? | 22:57 |
*** ddieterly has quit IRC | 22:57 | |
*** tpsilva has quit IRC | 22:57 | |
fungi | i'm happy to use gertty batch reviewing on them if they have a consistent topic when you create them all | 22:58 |
anteaya | given this issue started morning of Monday and it is end of day Tuesday | 22:58 |
* fungi doesn't get enough excuses for batch reviewing | 22:58 | |
nibalizer | anteaya: engineering estimates are the best estimates | 22:59 |
anteaya | nibalizer: always | 22:59 |
anteaya | personally I'm thinking Friday | 22:59 |
nibalizer | but i think (as long as we have cores around to approve the masses) we should be done by today | 22:59 |
anteaya | okay | 22:59 |
anteaya | the librarians will kick me out in an hour | 22:59 |
*** sree has quit IRC | 22:59 | |
anteaya | but I'm not the core you need for mass approval | 23:00 |
fungi | nibalizer: you were waiting for the typos change to propagate i guess? that merged about 40 minutes ago so hopefully is everywhere now | 23:00 |
nibalizer | fungi: i believe there were more typos | 23:01 |
*** javeriak has quit IRC | 23:01 | |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-openstack_infra_spec_helper: Initial commit https://review.openstack.org/331923 | 23:01 |
nibalizer | a couple minor updates to that | 23:01 |
*** sree has joined #openstack-infra | 23:02 | |
nibalizer | technically we can land it now and go with it, but I was trying to get this little test working first | 23:02 |
mordred | nibalizer: I'm ready to mass-approve | 23:02 |
nibalizer | mordred: im glad | 23:02 |
*** chlong has joined #openstack-infra | 23:02 | |
nibalizer | ill start working on the explosion | 23:02 |
fungi | i'm on board to help get these through. i have a 750ml bottle of hananomai sake "katana" chilling, but it can stay in the fridge until we're through with this | 23:03 |
*** rhochmuth has quit IRC | 23:03 | |
fungi | whee. i can't load that change because gertty doesn't know about the new repo yet | 23:04 |
fungi | browser for now i guess so i don't lose my gertty stack | 23:04 |
anteaya | crinkle: have you time for a pass of https://review.openstack.org/#/c/331923/6 | 23:05 |
jeblair | fungi: have you set up a 'recently seen changes' dashboard? | 23:05 |
anteaya | crinkle: now with less cruft | 23:05 |
fungi | jeblair: i have, but... | 23:05 |
nibalizer | we need to remove the depends on I think | 23:05 |
nibalizer | but the depends on does allow the experimental test to pass | 23:05 |
notmorgan | mordred: =/ | 23:05 |
anteaya | nibalizer: I agree, when you are ready to remove it | 23:05 |
*** sree has quit IRC | 23:06 | |
notmorgan | mordred: i am sad i wont see it with the original cast though! | 23:06 |
nibalizer | oh i think its totally working | 23:06 |
*** stevemar has joined #openstack-infra | 23:07 | |
crinkle | anteaya: sure | 23:07 |
nibalizer | crinkle: thanks | 23:07 |
*** sdague has quit IRC | 23:08 | |
*** sree_ has joined #openstack-infra | 23:08 | |
jpmaxman | ok I've enabled recaptcha and disabled the new user creation | 23:09 |
anteaya | fungi: would you feel like shoehorning this patch in so Zara can be a storyboard Admin for tomorrow in case it is needed: https://review.openstack.org/#/c/329092/ same beaker failure | 23:09 |
*** sree_ is now known as Guest93622 | 23:09 | |
jpmaxman | ironically in testing this I had to work really hard to convince launchpad I was not a bot | 23:09 |
anteaya | fungi: sorry to jump on the wagon here | 23:09 |
fungi | jpmaxman: funny indeed | 23:10 |
jpmaxman | i'm going to monitor this https://wiki.openstack.org/wiki/Special:RecentChanges | 23:10 |
fungi | anteaya: yep, will look in just a sec | 23:10 |
jpmaxman | unfortunately it is the old ugly recapthca | 23:10 |
anteaya | fungi: yup, thanks | 23:10 |
jpmaxman | I think because confirmedit is bundled with mediawiki and we are on an old version | 23:10 |
jpmaxman | but I'd still like to see how it holds | 23:11 |
fungi | jpmaxman: even ugly old recaptcha can't be any uglier than the built-in captcha, so thanks | 23:11 |
fungi | nibalizer: looks like it's passed | 23:11 |
anteaya | yay! | 23:11 |
*** stevemar has quit IRC | 23:12 | |
fungi | all three experimental jobs passing there | 23:12 |
*** Guest93622 has quit IRC | 23:12 | |
*** gouthamr has joined #openstack-infra | 23:13 | |
fungi | anteaya: i thought the idea was that we were going to make the superusers file a new class parameter and have a custom one for storyboard-dev | 23:14 |
*** sree has joined #openstack-infra | 23:14 | |
crinkle | nibalizer: sorry i should have looked more closely at the gemspec before, there's one gem that's going to cause failures in some modules, otherwise it's fine | 23:14 |
anteaya | fungi: I didn't know that | 23:14 |
fungi | rather than the current state of affairs where the superusers list is shared by both storyboard and storyboard-dev | 23:14 |
anteaya | fungi: oh okay, where might I find an example to point Zara at so she can fix the patch? | 23:15 |
fungi | anteaya: i can update these. it's almost certainly eod for Zara and SotK | 23:15 |
fungi | working on it now | 23:15 |
anteaya | thanks so much | 23:15 |
anteaya | I'm grateful | 23:15 |
nibalizer | crinkle: ok | 23:15 |
fungi | anteaya: no need to thank me. i want the next couple days for sb to go as smoothly as possible | 23:16 |
anteaya | oh thank you, me too | 23:16 |
nibalizer | crinkle: i've wired it up so the 'unit test' just tries to do a bundle install, basically makes sure bundle install works, i figure this tests that we haven't asked for an imposible set of gems to be installed and that we have all the dev libraries needed | 23:17 |
nibalizer | we can make it a better name after things are unbroken (since we have to go through project-config to get it fixed) | 23:17 |
crinkle | nibalizer: oh okay | 23:18 |
crinkle | nibalizer: sounds good | 23:18 |
*** stevemar has joined #openstack-infra | 23:18 | |
*** sree has quit IRC | 23:18 | |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-openstack_infra_spec_helper: Initial commit https://review.openstack.org/331923 | 23:19 |
nibalizer | crinkle: updated | 23:19 |
*** sree has joined #openstack-infra | 23:19 | |
*** sputnik13 has quit IRC | 23:20 | |
anteaya | crinkle: thank you for your fantastic reviews! | 23:21 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Give storyboard-dev its own superusers list https://review.openstack.org/332505 | 23:22 |
fungi | anteaya: Zara: SotK: i'll rebase the other two changes on that, moving them to the new dev superusers list | 23:22 |
nibalizer | crinkle: if you're good with it, plaese land 331923 | 23:23 |
*** sree has quit IRC | 23:23 | |
mordred | 217450 | 23:23 |
mordred | gah | 23:23 |
nibalizer | i'm using the gemfile-sync topic | 23:23 |
fungi | mordred: nice otp | 23:24 |
nibalizer | reviewers remember that a couple of these look a little different | 23:24 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Add Zara to StoryBoard Dev Admin https://review.openstack.org/329092 | 23:24 |
mordred | fungi: yah man. I'm good with them | 23:24 |
mordred | AND- have now moved the location of the thing | 23:24 |
anteaya | fungi: I think you got the file name wrong in storyboard.pp, or did I misunderstand? | 23:24 |
* nibalizer logs into mordreds instagram, posts picture of bud light lime | 23:24 | |
nibalizer | caption "why have I never tried this? It's delicious" | 23:25 |
mordred | nibalizer: where did you get such a picture? | 23:25 |
*** julim has quit IRC | 23:25 | |
nibalizer | not a picture of you drinking it, that would be too hard to forge | 23:25 |
pleia2 | anteaya: the dev.pp is where we want to the dev storyboard one linked (and it is) | 23:25 |
* mordred hides the bud light | 23:25 | |
*** dingyichen has joined #openstack-infra | 23:25 | |
anteaya | pleia2: oh so I'm confused? | 23:25 |
anteaya | okay, thanks | 23:25 |
pleia2 | anteaya: the storyboard.pp file changes are just setting up the environment so $superusers is a variable | 23:25 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Add Adam Coldrick to StoryBoard Admin https://review.openstack.org/332072 | 23:25 |
fungi | anteaya: pleia2: there's the whole stack done. i'll have a look now and check over it myself | 23:26 |
anteaya | pleia2: ah | 23:26 |
anteaya | thanks fungi | 23:26 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Add Adam Coldrick to StoryBoard Dev Admin https://review.openstack.org/332072 | 23:26 |
fungi | forgot to correct the subject on that last one initially | 23:27 |
*** sputnik13 has joined #openstack-infra | 23:27 | |
pleia2 | fungi: thanks, all lgtm | 23:27 |
*** sputnik13 has quit IRC | 23:27 | |
anteaya | thank you fungi for patches and to pleia2 and mordred for reviews | 23:28 |
fungi | anteaya: i explained a little in my inline comment | 23:28 |
anteaya | fungi: thanks, I'll read that | 23:28 |
mordred | fungi, pleia2 - need a +3 on 332072 | 23:28 |
fungi | i'll likely still need to bypass the beaker jobs on these changes in the near term | 23:29 |
pleia2 | done | 23:29 |
*** shashank_hegde has joined #openstack-infra | 23:29 | |
fungi | but let's see them pass the apply tests first | 23:29 |
pleia2 | makes sense | 23:29 |
nibalizer | can folks land https://review.openstack.org/#/c/331923/ please | 23:30 |
anteaya | is crinkle happy? | 23:31 |
anteaya | crinkle: are you happy? | 23:31 |
*** zz_dimtruck is now known as dimtruck | 23:31 | |
anteaya | I'm happy if she's happy | 23:31 |
*** Jeffrey4l_ has joined #openstack-infra | 23:32 | |
fungi | lgtm. looks like ps7 addresses crinkle's comments | 23:32 |
anteaya | nibalizer: do you know if crinkle is around to say she is happy? | 23:33 |
anteaya | nibalizer: or should we move ahead? | 23:33 |
openstackgerrit | Merged openstack-infra/puppet-openstack_infra_spec_helper: Initial commit https://review.openstack.org/331923 | 23:33 |
anteaya | well that's done then | 23:33 |
fungi | her comments seemed to be addressed, and if they aren't sufficient we can always add a new change | 23:34 |
anteaya | cool, thanks | 23:34 |
anteaya | nibalizer: what next? | 23:34 |
fungi | bracing for nibalizer's asplode.sh channelspam | 23:34 |
*** aysyd has quit IRC | 23:34 | |
nibalizer | yep | 23:35 |
nibalizer | seconds away | 23:35 |
fungi | and then watching us consume every last ounce of nodepool quota | 23:35 |
*** sree has joined #openstack-infra | 23:36 | |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-ansible: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332509 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-apparmor: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332510 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-apps_site: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332511 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-askbot: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332512 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-asterisk: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332513 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-bandersnatch: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332514 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-bugdaystats: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332515 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-bup: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332516 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-cgit: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332517 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-ciwatch: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332518 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-diskimage_builder: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332520 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-drupal: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332521 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-elastic_recheck: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332522 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-elasticsearch: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332523 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-etherpad_lite: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332524 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-exim: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332525 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-gerrit: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332526 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-gerritbot: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332527 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-github: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332528 | 23:36 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-grafyaml: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332529 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-graphite: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332530 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-haveged: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332531 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-hound: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332532 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-httpd: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332533 | 23:37 |
*** PollyZ has quit IRC | 23:37 | |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-infracloud: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332534 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-iptables: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332535 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-jeepyb: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332536 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-jenkins: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332537 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-kerberos: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332538 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-kibana: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332539 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-lodgeit: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332540 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-log_processor: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332541 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-logrotate: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332542 | 23:37 |
bkero | wat | 23:37 |
Shrews | oh my | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-logstash: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332543 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-mailman: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332544 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-mediawiki: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332545 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-meetbot: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332546 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-mysql_backup: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332547 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-nodepool: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332548 | 23:37 |
nibalizer | this is hopefully the last time I have to do this | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-odsreg: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332549 | 23:37 |
fungi | nibalizer: i guess 332466 was updated too soon and needs a recheck? | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-openafs: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332550 | 23:37 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-openstack_health: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332551 | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-openstackid: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332552 | 23:38 |
pleia2 | ^5 nibalizer | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-os_client_config: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332553 | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-packagekit: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332554 | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-pgsql_backup: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332555 | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-phabricator: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332556 | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-pip: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332557 | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-planet: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332558 | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-project_config: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332559 | 23:38 |
fungi | riiiiide the walrus | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-puppet: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332560 | 23:38 |
nibalizer | fungi: that was the speciimen, yes it needs a recheck | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-redis: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332561 | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-refstack: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332562 | 23:38 |
nibalizer | we shoulda rechecked it before i submitted all these | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-releasestatus: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332563 | 23:38 |
nibalizer | in case they all fail | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-reviewday: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332564 | 23:38 |
nibalizer | oh well | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-simpleproxy: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332565 | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-snmpd: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332566 | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-ssh: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332567 | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-ssl_cert_check: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332568 | 23:38 |
Shrews | nibalizer: you gonna kill da interwebs! | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-stackalytics: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332569 | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-statusbot: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332570 | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-storyboard: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332571 | 23:38 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-subunit2sql: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332572 | 23:39 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-sudoers: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332573 | 23:39 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-tmpreaper: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332574 | 23:39 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-ulimit: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332575 | 23:39 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-unattended_upgrades: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332576 | 23:39 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-unbound: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332577 | 23:39 |
pabelanger | jeblair: okay, I see the confusion on 332499, the missing "{{ }}" confused me. | 23:39 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-user: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332578 | 23:39 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-vcsrepo: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332579 | 23:39 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-vinz: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332580 | 23:39 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-yum: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332581 | 23:39 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-zanata: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332582 | 23:39 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-zuul: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332583 | 23:39 |
*** salv-orlando has joined #openstack-infra | 23:39 | |
Nakato | jeblair: https://review.openstack.org/#/c/293194/ | 23:39 |
anteaya | nibalizer: I hope they pass | 23:40 |
nibalizer | anteaya: me too | 23:40 |
*** sree has quit IRC | 23:41 | |
anteaya | well nothing more for me to do tonight I don't think, I'm going to pack up and leave the library | 23:41 |
anteaya | pleia2: text me if you want me to come online once I get home | 23:41 |
anteaya | g'night and thank you for all the help | 23:41 |
*** salv-orl_ has quit IRC | 23:42 | |
fungi | nibalizer: puppet-lint and beaker-rspec-centos-7 seem unhappy on them so far | 23:42 |
nibalizer | TT | 23:42 |
nibalizer | or T_T | 23:42 |
nibalizer | i'm not super familiar with that emoji | 23:42 |
nibalizer | okay lets see what we borke | 23:42 |
fungi | across the board, so hopefully something simple? | 23:42 |
nibalizer | really really shoulda rechecked the accessbot one before sending the hoard | 23:42 |
mtreinish | nibalizer: what's the fun in doing that? ;) | 23:43 |
*** yamahata has quit IRC | 23:43 | |
nibalizer | mtreinish: ikr | 23:43 |
fungi | nibalizer: beaker-ubuntu-trusty failing on them too | 23:43 |
* bkero waits for patchset 2 to every module | 23:44 | |
pleia2 | anteaya: have a good evening | 23:44 |
*** amitgandhinz has joined #openstack-infra | 23:45 | |
*** sree has joined #openstack-infra | 23:45 | |
*** salv-orlando has quit IRC | 23:46 | |
*** hosanai has joined #openstack-infra | 23:47 | |
nibalizer | i think ivet got it | 23:47 |
nibalizer | yep patchset to every module | 23:47 |
nibalizer | puppet-accessbot to start | 23:47 |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-accessbot: Use new infra_spec_helper for gem dependencies https://review.openstack.org/332466 | 23:47 |
fungi | testing one first: golden ;) | 23:47 |
nibalizer | fungi: okay lets see if that works | 23:48 |
fungi | once our test resources recover sufficiently from the first round anyway | 23:48 |
fungi | though i have a somewhat unorthodox solution to speed this up. just a sec | 23:49 |
*** sree has quit IRC | 23:50 | |
nibalizer | haha yesss | 23:50 |
*** amitgandhinz has quit IRC | 23:51 | |
openstackgerrit | Khai Do proposed openstack-infra/system-config: disable puppet to install its-storyboard plugin https://review.openstack.org/332585 | 23:51 |
fungi | it's testing that one with gate priority now | 23:51 |
nibalizer | cool | 23:51 |
zaro | pleia2: ^ would you mind? i forgot we need to turn off puppet on review-dev to install the plugin | 23:51 |
fungi | if it works, you can napalm-carpet the others with new patchsets so the old ones get aborted quicker and free resources back to the pool | 23:52 |
*** sree has joined #openstack-infra | 23:52 | |
zaro | thanks nibalizer | 23:53 |
nibalizer | zaro: o7 | 23:53 |
nibalizer | fungi: yep | 23:53 |
zaro | nibalizer: is this the pattern to move params into it's own file? | 23:55 |
zaro | https://docs.puppet.com/puppet/latest/reference/lookup_quick_module.html#example-with-function | 23:55 |
nibalizer | well thats all puppet 4 stuff | 23:55 |
*** sree has quit IRC | 23:56 | |
nibalizer | to move params to its own file | 23:56 |
fungi | all green, waiting for the last job to complete | 23:56 |
nibalizer | https://github.com/puppetlabs/puppetlabs-apache/blob/master/manifests/params.pp | 23:56 |
fungi | no, wait | 23:56 |
*** sree has joined #openstack-infra | 23:57 | |
fungi | nibalizer: "LoadError: cannot load such file -- puppet" http://logs.openstack.org/66/332466/2/gate/gate-puppet-accessbot-puppet-lint/d4237ae/console.html#_2016-06-21_23_55_32_821363 | 23:57 |
zaro | nibalizer: looks like it's the same. | 23:58 |
fungi | nibalizer: also failed gate-openstackci-beaker-ubuntu-trusty | 23:58 |
mat128 | https://wiki.openstack.org/wiki/Infrastructure/Conferencing | 23:59 |
zaro | nibalizer: looking at https://github.com/puppetlabs/puppetlabs-apache/blob/master/manifests/init.pp it looks like all vars need to be in the class that consumes the params. doesn't seem like much benefit. | 23:59 |
mat128 | PSTN line is busy | 23:59 |
fungi | pabelanger: ^ any chance you can check on pbx.o.o? | 23:59 |
zaro | nibalizer: or am i missing something? | 23:59 |
*** tphummel has quit IRC | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!