*** hongbin has quit IRC | 00:00 | |
*** thorst has quit IRC | 00:01 | |
asselin_ | clarkb, fungi thanks for you help. Confirming that it 'just works'. I have gerrit started and logged in via LP! \o/ | 00:02 |
---|---|---|
mtreinish | fungi: what's the interval we run ansible stuff at on puppetmaster? | 00:02 |
*** esikachev has quit IRC | 00:02 | |
*** yee37917 has quit IRC | 00:04 | |
fungi | mtreinish: it differs by situation | 00:04 |
fungi | mtreinish: the cronjob which updates the bulk of our control plane is kicked off every 15 minutes under a lock, and doesn't refire if there's one already running | 00:04 |
*** xarses_ has joined #openstack-infra | 00:04 | |
fungi | lately ist's taking around 20-30 minutes to run, so effectively runs every 30-45 minutes | 00:05 |
mtreinish | ok, because I haven't seen any events in a while and I was a bit surprised | 00:05 |
*** andreww has quit IRC | 00:05 | |
mtreinish | but that makes sense | 00:05 |
fungi | the cronjob which updates the infracloud is kicked off separately every 15 minutes | 00:05 |
*** yee379 has joined #openstack-infra | 00:06 | |
fungi | and then the cronjob which updates the network and tenant configuration on all our clouds where we have accounts runs hourly | 00:06 |
*** esikachev has joined #openstack-infra | 00:06 | |
clarkb | every 15 minutes but usually takes longer so effectively every half hpur or 45 minutes | 00:06 |
*** ijw has joined #openstack-infra | 00:06 | |
fungi | mtreinish: also a recent run probably reverted my handpatch of the plugin and won't get fixed for real until your 461180 change is fully in effect | 00:07 |
fungi | which is the more likely reason it went back on silent running | 00:08 |
mtreinish | ah, ok | 00:09 |
fungi | so in theory it will fix itself on the next pass | 00:09 |
fungi | yeah, just checked the log and the callback warnings have returned, so that's definitely it | 00:09 |
mtreinish | ugh, just caught a typo in the mqtt plugin topic code when I was writing the schema docs | 00:09 |
*** esikachev has quit IRC | 00:11 | |
cmurphy | fungi: clarkb I think this is semi-urgent https://review.openstack.org/#/c/461181/ | 00:11 |
fungi | cmurphy: ouch! | 00:13 |
openstackgerrit | Matthew Treinish proposed openstack-infra/system-config master: Make playbook and task in topic singular https://review.openstack.org/461183 | 00:13 |
mtreinish | fungi, clarkb: ^^^ | 00:13 |
fungi | cmurphy: i left you this question inline too, but should the /home/jenkins/cache dir also get a chown? | 00:13 |
fungi | mtreinish: see my question on that one, i think you missed an occurrence still | 00:15 |
cmurphy | fungi: responded | 00:17 |
cmurphy | it already happens later in that script | 00:17 |
*** lamt has joined #openstack-infra | 00:17 | |
fungi | cmurphy: i see that now--thanks for pointing it out! | 00:18 |
fungi | (and thanks for catching and fixing!) | 00:18 |
*** Sukhdev has quit IRC | 00:18 | |
cmurphy | :) | 00:18 |
mtreinish | fungi: sigh, I should have triple checked it | 00:18 |
openstackgerrit | Matthew Treinish proposed openstack-infra/system-config master: Make playbook and task in topic singular https://review.openstack.org/461183 | 00:19 |
fungi | proof code review is still good at catching 10% of trivial typos ;) | 00:19 |
mtreinish | ooh, the ansible event flood is back :) | 00:21 |
fungi | yeah i noticed that the warnings subsided a few minutes ago | 00:21 |
fungi | so presumed it had | 00:21 |
rm_work | would be awesome to have a +A before the weekend on this project-config CR: https://review.openstack.org/#/c/461116/2 | 00:23 |
fungi | i'm not really sure how to interpret http://grafana.openstack.org/dashboard/db/mosquitto-status but guessing our earlier data collection weirdness is throwing off the scale | 00:23 |
rm_work | as a few of us are planning to work through the weekend | 00:23 |
openstackgerrit | Merged openstack-infra/project-config master: Let the jenkins user own the cache files https://review.openstack.org/461181 | 00:24 |
mtreinish | fungi: yeah it's throwing off the scale, set the time window to something like 30min | 00:25 |
mtreinish | after the recent puppet-mqtt_statsd patch took effect | 00:25 |
mtreinish | it's hard for message counts to compete with a running total since mosquitto was last started | 00:26 |
fungi | indeed | 00:26 |
fungi | figured that was it | 00:26 |
rm_work | thanks for the +A Jeremy (not sure your nick) :) | 00:26 |
fungi | that's me | 00:26 |
fungi | you're welcome, rm_work | 00:27 |
rm_work | ah | 00:27 |
rm_work | one more RealName (tm) connected to an IRC Nick ^_^ | 00:27 |
fungi | just another ptl lurking in the shadows ;) | 00:27 |
mtreinish | rm_work: you'll never guess my RealName :p | 00:30 |
rm_work | lol | 00:30 |
fungi | mtreinish: the puppet update cadence has a very interesting spike/backoff envelope on the graph | 00:30 |
fungi | i'm guessing a lot of that is driven by most of the tasks having very short completion times | 00:31 |
mtreinish | yeah probably | 00:32 |
mtreinish | I'm writing the docs now but there are 3 event categories we're emitting events for | 00:32 |
mtreinish | one is each task completion | 00:32 |
mtreinish | the other big message load one is at the end of the playbook we push a message for each host that ran tasks in the playbook with the overall task stats for that host | 00:33 |
mtreinish | the 3rd category is just playbook start and stop :) | 00:33 |
mtreinish | not too much load there | 00:33 |
openstackgerrit | Merged openstack-infra/system-config master: Make playbook and task in topic singular https://review.openstack.org/461183 | 00:35 |
openstackgerrit | Merged openstack-infra/project-config master: Use DEVSTACK_PROJECT_FROM_GIT for python-octaviaclient https://review.openstack.org/461116 | 00:35 |
*** baoli has quit IRC | 00:36 | |
*** baoli has joined #openstack-infra | 00:36 | |
*** ijw has quit IRC | 00:52 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/system-config master: WIP: Add firehose docs for ansible events https://review.openstack.org/461184 | 00:52 |
mtreinish | fungi: ^^^ I need to take a break from writing, but that's what I have so far | 00:52 |
mtreinish | (this is by far the most complex schema we have so far) | 00:52 |
*** thorst has joined #openstack-infra | 00:57 | |
*** ijw has joined #openstack-infra | 00:58 | |
*** ijw has quit IRC | 00:59 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/project-config master: Add messages dropped to mosquitto graphs and add units https://review.openstack.org/461185 | 00:59 |
*** ijw has joined #openstack-infra | 00:59 | |
mtreinish | fungi: ^^^ also to add units to the graphs so people know what they're looking at | 00:59 |
*** sree has joined #openstack-infra | 01:01 | |
*** thorst has quit IRC | 01:02 | |
*** ijw has quit IRC | 01:02 | |
*** sree has quit IRC | 01:05 | |
*** esikachev has joined #openstack-infra | 01:08 | |
mtreinish | fungi: hehe, some of these ansible events are interesting, like: http://paste.openstack.org/show/608380/ | 01:08 |
mtreinish | oh, wow sry I forgot paste doesn't linewrap | 01:08 |
mtreinish | but that's for uploading the infra-root public keys into nova on infra cloud | 01:09 |
mtreinish | which of course includes all the text of the public keys | 01:10 |
mtreinish | mordred: ^^ also it's missing the request id is that a shade bug? | 01:10 |
mtreinish | "x_openstack_request_ids": [], | 01:10 |
fungi | when we say "public" we mean it | 01:11 |
*** baoli has quit IRC | 01:12 | |
*** gyee has quit IRC | 01:17 | |
*** esikachev has quit IRC | 01:17 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/system-config master: Add firehose docs for ansible events https://review.openstack.org/461184 | 01:25 |
mtreinish | fungi: ^^^ ok that should be pretty much done now | 01:25 |
*** ijw has joined #openstack-infra | 01:27 | |
*** tphummel has quit IRC | 01:29 | |
*** ijw has quit IRC | 01:31 | |
*** rhallisey has joined #openstack-infra | 01:41 | |
*** leakypipes has quit IRC | 01:47 | |
*** thorst has joined #openstack-infra | 01:58 | |
*** yamamoto has joined #openstack-infra | 01:59 | |
*** esikachev has joined #openstack-infra | 02:01 | |
*** esikachev has quit IRC | 02:05 | |
*** tinwood has quit IRC | 02:05 | |
*** esberglu has joined #openstack-infra | 02:06 | |
*** tinwood has joined #openstack-infra | 02:06 | |
*** esberglu has quit IRC | 02:06 | |
*** megm has quit IRC | 02:07 | |
*** megm has joined #openstack-infra | 02:08 | |
*** yamamoto has quit IRC | 02:11 | |
*** thorst has quit IRC | 02:17 | |
*** EricGonczer_ has joined #openstack-infra | 02:23 | |
*** yamahata_ has quit IRC | 02:31 | |
*** esikachev has joined #openstack-infra | 02:40 | |
*** esikachev has quit IRC | 02:44 | |
*** rhallisey has quit IRC | 02:47 | |
*** EricGonczer_ has quit IRC | 02:53 | |
*** yamamoto has joined #openstack-infra | 02:58 | |
*** baoli has joined #openstack-infra | 03:05 | |
*** tphummel has joined #openstack-infra | 03:10 | |
*** baoli has quit IRC | 03:10 | |
*** yamamoto has quit IRC | 03:12 | |
*** esikachev has joined #openstack-infra | 03:13 | |
*** thorst has joined #openstack-infra | 03:14 | |
*** esikachev has quit IRC | 03:17 | |
*** thorst has quit IRC | 03:19 | |
*** yamahata_ has joined #openstack-infra | 03:32 | |
*** nicolasbock has quit IRC | 03:42 | |
*** Sukhdev has joined #openstack-infra | 03:43 | |
*** jrist has quit IRC | 03:47 | |
*** esberglu has joined #openstack-infra | 03:53 | |
*** armax has quit IRC | 03:54 | |
*** ykarel has joined #openstack-infra | 03:57 | |
*** esberglu has quit IRC | 03:58 | |
*** jrist has joined #openstack-infra | 03:59 | |
*** ijw has joined #openstack-infra | 04:03 | |
*** ijw has quit IRC | 04:08 | |
*** yamamoto has joined #openstack-infra | 04:13 | |
openstackgerrit | Hongbin Lu proposed openstack-infra/project-config master: [Zun] Add release jobs for Zun server https://review.openstack.org/461188 | 04:18 |
*** yamamoto has quit IRC | 04:23 | |
*** lamt has quit IRC | 04:31 | |
*** erikmwilson has quit IRC | 04:39 | |
*** erikmwilson has joined #openstack-infra | 04:39 | |
*** dimtruck is now known as zz_dimtruck | 04:42 | |
*** tphummel has quit IRC | 04:47 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Fixed null organization on Affiliation https://review.openstack.org/461189 | 04:56 |
openstackgerrit | Merged openstack-infra/openstackid-resources master: Fixed null organization on Affiliation https://review.openstack.org/461189 | 04:57 |
*** arxcruz has quit IRC | 05:01 | |
*** kuromagi has quit IRC | 05:04 | |
*** Sukhdev has quit IRC | 05:07 | |
*** arxcruz has joined #openstack-infra | 05:08 | |
*** kuromagi has joined #openstack-infra | 05:15 | |
*** thorst has joined #openstack-infra | 05:16 | |
*** esikachev has joined #openstack-infra | 05:17 | |
*** thorst has quit IRC | 05:20 | |
*** flepied has joined #openstack-infra | 05:21 | |
*** esikachev has quit IRC | 05:23 | |
*** lamt has joined #openstack-infra | 05:33 | |
*** psachin has joined #openstack-infra | 05:35 | |
*** psachin has quit IRC | 05:41 | |
*** flepied has quit IRC | 05:43 | |
*** andreas-f has joined #openstack-infra | 05:50 | |
*** ijw has joined #openstack-infra | 05:52 | |
*** ijw has quit IRC | 05:56 | |
*** esikachev has joined #openstack-infra | 06:02 | |
*** ihrachys has quit IRC | 06:10 | |
*** thorst has joined #openstack-infra | 06:16 | |
*** thorst has quit IRC | 06:21 | |
*** mkebich has quit IRC | 06:22 | |
*** mkebich has joined #openstack-infra | 06:23 | |
*** mkebich_ has joined #openstack-infra | 06:26 | |
*** mkebich has quit IRC | 06:28 | |
*** esberglu has joined #openstack-infra | 06:38 | |
*** esberglu has quit IRC | 06:42 | |
*** e0ne has joined #openstack-infra | 06:46 | |
*** jamesmca_ has joined #openstack-infra | 06:55 | |
*** psachin has joined #openstack-infra | 06:55 | |
*** baoli has joined #openstack-infra | 06:57 | |
*** jamesmca_ has quit IRC | 07:00 | |
*** e0ne has quit IRC | 07:00 | |
*** baoli has quit IRC | 07:01 | |
*** salv-orlando has joined #openstack-infra | 07:02 | |
*** salv-orlando has quit IRC | 07:11 | |
*** thorst has joined #openstack-infra | 07:17 | |
*** thorst has quit IRC | 07:22 | |
*** deafult has joined #openstack-infra | 07:32 | |
*** psachin has quit IRC | 07:34 | |
*** ijw has joined #openstack-infra | 07:40 | |
*** ijw has quit IRC | 07:45 | |
*** zzzeek has quit IRC | 08:00 | |
*** zzzeek has joined #openstack-infra | 08:00 | |
*** esikachev has quit IRC | 08:11 | |
*** thorst has joined #openstack-infra | 08:18 | |
*** gaurangt has quit IRC | 08:36 | |
*** thorst has quit IRC | 08:38 | |
*** beisner has quit IRC | 08:52 | |
*** psachin has joined #openstack-infra | 09:05 | |
*** esberglu has joined #openstack-infra | 09:22 | |
*** esberglu has quit IRC | 09:22 | |
*** csomerville has joined #openstack-infra | 09:26 | |
*** cody-somerville has quit IRC | 09:26 | |
*** ijw has joined #openstack-infra | 09:28 | |
*** yamamoto has joined #openstack-infra | 09:32 | |
*** ijw has quit IRC | 09:33 | |
*** thorst has joined #openstack-infra | 09:34 | |
*** yamahata_ has quit IRC | 09:38 | |
*** thorst has quit IRC | 09:38 | |
*** jascott1 has quit IRC | 09:40 | |
*** cshastri has joined #openstack-infra | 09:40 | |
*** jascott1 has joined #openstack-infra | 09:40 | |
*** coffee_cat is now known as ildikov | 09:44 | |
*** jascott1 has quit IRC | 09:46 | |
*** yamamoto has quit IRC | 09:50 | |
*** yamamoto has joined #openstack-infra | 09:52 | |
*** cshastri has quit IRC | 09:53 | |
*** yamamoto has quit IRC | 09:53 | |
*** yamamoto has joined #openstack-infra | 10:04 | |
*** yamamoto has quit IRC | 10:09 | |
*** psachin has quit IRC | 10:14 | |
*** esikachev has joined #openstack-infra | 10:16 | |
*** Qiming has quit IRC | 10:21 | |
*** nicolasbock has joined #openstack-infra | 10:31 | |
*** jamesmca_ has joined #openstack-infra | 10:31 | |
*** thorst has joined #openstack-infra | 10:35 | |
*** jamesmca_ has quit IRC | 10:35 | |
*** thorst has quit IRC | 10:40 | |
*** yamamoto has joined #openstack-infra | 10:54 | |
*** jkilpatr has quit IRC | 10:56 | |
*** jkilpatr has joined #openstack-infra | 10:56 | |
*** jamesmca_ has joined #openstack-infra | 11:07 | |
*** esberglu has joined #openstack-infra | 11:10 | |
*** jamesmca_ has quit IRC | 11:11 | |
*** esberglu has quit IRC | 11:14 | |
*** ijw has joined #openstack-infra | 11:16 | |
*** ijw has quit IRC | 11:21 | |
*** gildub has quit IRC | 11:34 | |
*** oanson has quit IRC | 11:35 | |
*** oanson has joined #openstack-infra | 11:35 | |
*** thorst has joined #openstack-infra | 11:36 | |
*** thorst has quit IRC | 11:40 | |
*** jamesmca_ has joined #openstack-infra | 11:44 | |
*** jascott1 has joined #openstack-infra | 11:45 | |
*** jamesmca_ has quit IRC | 11:48 | |
*** oanson has quit IRC | 11:49 | |
*** jascott1 has quit IRC | 11:50 | |
*** oanson has joined #openstack-infra | 11:50 | |
*** thorst has joined #openstack-infra | 11:58 | |
*** oanson has quit IRC | 11:59 | |
*** oanson has joined #openstack-infra | 12:00 | |
*** thorst has quit IRC | 12:01 | |
*** lamt has quit IRC | 12:11 | |
*** tojuvone has joined #openstack-infra | 12:15 | |
*** sigmavirus has joined #openstack-infra | 12:16 | |
*** sigmavirus is now known as Guest2997 | 12:17 | |
*** EricGonczer_ has joined #openstack-infra | 12:34 | |
*** yamamoto has quit IRC | 12:36 | |
*** yamamoto has joined #openstack-infra | 12:43 | |
*** yamamoto has quit IRC | 12:45 | |
*** jascott1 has joined #openstack-infra | 12:46 | |
*** jascott1 has quit IRC | 12:52 | |
*** Guest2997 has quit IRC | 12:52 | |
*** esberglu has joined #openstack-infra | 13:00 | |
*** esberglu has quit IRC | 13:00 | |
*** thorst has joined #openstack-infra | 13:02 | |
*** ijw has joined #openstack-infra | 13:04 | |
*** thorst has quit IRC | 13:07 | |
*** ijw has quit IRC | 13:09 | |
openstackgerrit | Merged openstack-infra/project-config master: Add messages dropped to mosquitto graphs and add units https://review.openstack.org/461185 | 13:11 |
*** annegentle has joined #openstack-infra | 13:14 | |
*** annegentle has quit IRC | 13:19 | |
*** askb has quit IRC | 13:24 | |
*** Goneri has quit IRC | 13:29 | |
*** chlong has joined #openstack-infra | 13:30 | |
*** EricGonczer_ has quit IRC | 13:38 | |
*** yamamoto has joined #openstack-infra | 13:46 | |
*** esikachev has quit IRC | 13:47 | |
*** esberglu has joined #openstack-infra | 13:54 | |
*** yamamoto has quit IRC | 13:55 | |
*** esberglu has quit IRC | 13:59 | |
*** thorst has joined #openstack-infra | 14:03 | |
openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add specs and validation jobs for service-types-authority https://review.openstack.org/461208 | 14:05 |
*** hongbin has joined #openstack-infra | 14:09 | |
pabelanger | mtreinish: fungi: What does a hieradata task look like? | 14:10 |
jeblair | mtreinish, fungi: if we started using secret data with ansible, i expect it would go out over the wire too. i don't *think* ansible knows any secrets right now (i think they are all in puppet). how would we safely do that now? | 14:13 |
jeblair | pabelanger: i think it just says it's copying the file, like http://paste.openstack.org/raw/608396/ | 14:14 |
*** hongbin_ has joined #openstack-infra | 14:14 | |
jeblair | and, incidentally, i think we have disabled stdout printing with puppet (we only syslog), so we don't see anything from the puppet runs. | 14:15 |
pabelanger | cool | 14:16 |
*** hongbin has quit IRC | 14:17 | |
pabelanger | Hmm | 14:19 |
pabelanger | https://bugzilla.redhat.com/show_bug.cgi?id=1440912 | 14:19 |
openstack | bugzilla.redhat.com bug 1440912 in vulnerability "CVE-2017-7473 ansible: Potential information disclosure via no_log directive" [Medium,New] - Assigned to security-response-team | 14:19 |
pabelanger | dmsimard: ^ | 14:19 |
dmsimard | pabelanger: hi | 14:19 |
dmsimard | sorry ? | 14:19 |
pabelanger | you reported that bug about ansible disclosing info? | 14:20 |
dmsimard | yup, my name's on there: https://access.redhat.com/security/cve/CVE-2017-7473 | 14:20 |
jeblair | oh nice, so no_log doesn't affect callback plugins | 14:21 |
jeblair | is there a github bug? | 14:21 |
dmsimard | It's set to high confidentiality right now :( | 14:21 |
*** thorst has quit IRC | 14:22 | |
jeblair | weird. you'd think the cat is out of the bag, but maybe it's worse. | 14:23 |
jeblair | https://github.com/ansible/ansible/issues/22505 | 14:23 |
jeblair | i'm guessing that one was a precursor to the private bug | 14:23 |
*** hongbin has joined #openstack-infra | 14:27 | |
jeblair | mtreinish: https://github.com/ansible/ansible/issues/22505#issuecomment-285746082 suggests that you should use self._dump_results(result._result) to sanitize output. mqtt.py just returns raw result._result. can you look into doing that (and verifying that when you do so, no_log is effective)? | 14:27 |
jeblair | fungi, pabelanger: ^ | 14:27 |
pabelanger | I'm just collecting some events from mqtt now | 14:29 |
*** hongbin_ has quit IRC | 14:29 | |
*** sree has joined #openstack-infra | 14:39 | |
jeblair | mtreinish, fungi: when we get to the point where we're ready to start talking about mqtt in zuulv3, we already have ideas with dmsimard to incorporate ara (which is a callback plugin) into zuulv3 so it runs with every job. i expect the callback plugins to be site-customizable, so we can consider running the mqtt callback plugin with every job too. if we did that, the firehose could see every ansible task for every zuul job. | 14:39 |
jeblair | firehose indeed | 14:39 |
*** lamt has joined #openstack-infra | 14:40 | |
jeblair | mtreinish, fungi: i think in the long run, much (all?) of the ansible/puppet we run from puppetmaster we can move to zuulv3, so it's worth keeping in mind that this could change significantly. also, really important to get the secret data masking correct. :) | 14:41 |
*** hongbin_ has joined #openstack-infra | 14:43 | |
*** hongbin has quit IRC | 14:44 | |
dmsimard | jeblair: yeah I think we had consensus that I needed to re-write https://review.openstack.org/#/c/444088/ into a broader "zuul should easily support callbacks" kind of thing | 14:45 |
dmsimard | Haven't got around to it yet | 14:46 |
*** rossella_s has joined #openstack-infra | 14:50 | |
*** sree has quit IRC | 14:50 | |
*** sree has joined #openstack-infra | 14:51 | |
*** hongbin_ has quit IRC | 14:53 | |
*** hongbin has joined #openstack-infra | 14:53 | |
*** sree has quit IRC | 14:55 | |
*** fandi has quit IRC | 14:57 | |
fungi | jeblair: dmsimard: pabelanger: thanks! all very good points | 15:03 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Sanitize ansible results in mqtt callback plugin https://review.openstack.org/461214 | 15:09 |
fungi | mtreinish: jeblair: dmsimard: pabelanger: ^ straw man | 15:09 |
fungi | i can work on testing it in a few hours but need to pop out to run some errands | 15:13 |
fungi | just wanted to make sure it doesn't slip through the cracks | 15:14 |
*** hongbin_ has joined #openstack-infra | 15:15 | |
*** Goneri has joined #openstack-infra | 15:18 | |
*** hongbin has quit IRC | 15:18 | |
*** thorst has joined #openstack-infra | 15:19 | |
*** armax has joined #openstack-infra | 15:20 | |
*** thorst has quit IRC | 15:23 | |
*** sree has joined #openstack-infra | 15:24 | |
*** tphummel has joined #openstack-infra | 15:25 | |
*** sree_ has joined #openstack-infra | 15:25 | |
*** sree_ is now known as Guest28036 | 15:26 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Increase file permissions around generate keys https://review.openstack.org/461218 | 15:27 |
openstackgerrit | Hongbin Lu proposed openstack-infra/project-config master: [Fuxi] Add devstack-plugin-container to PROJECTS https://review.openstack.org/461219 | 15:27 |
*** sree has quit IRC | 15:29 | |
*** sree has joined #openstack-infra | 15:34 | |
*** Guest28036 has quit IRC | 15:34 | |
pabelanger | heh, that is new: http://logs.openstack.org/14/461214/1/check/gate-infra-puppet-apply-3-centos-7/29c1563/puppetapplytest73.final.out.FAILED | 15:37 |
pabelanger | fungi: puppet failing now on krotscheck ssh key^. Should we add null value or consider disabling the account? I think he is no longer doing openstack thing | 15:38 |
*** sree has quit IRC | 15:41 | |
*** sree has joined #openstack-infra | 15:42 | |
*** EricGonczer_ has joined #openstack-infra | 15:46 | |
*** jamesmca_ has joined #openstack-infra | 15:47 | |
*** jamesmca_ has quit IRC | 15:47 | |
*** jamesmca_ has joined #openstack-infra | 15:47 | |
*** baoli has joined #openstack-infra | 15:49 | |
openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add empty SSH key for krotscheck https://review.openstack.org/461222 | 15:49 |
openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Remove SSH keys from oubiwann and rockstar (disabled accounts) https://review.openstack.org/461223 | 15:49 |
*** armax has quit IRC | 15:53 | |
*** baoli has quit IRC | 15:53 | |
*** neiljerram has joined #openstack-infra | 15:55 | |
*** esikachev has joined #openstack-infra | 15:56 | |
*** Goneri has quit IRC | 15:58 | |
*** ykarel has quit IRC | 16:03 | |
openstackgerrit | Hongbin Lu proposed openstack-infra/project-config master: [Kuryr] Add devstack-plugin-contianer to PROJECTS https://review.openstack.org/461224 | 16:04 |
*** EricGonczer_ has quit IRC | 16:12 | |
*** john-davidge has joined #openstack-infra | 16:15 | |
*** baoli has joined #openstack-infra | 16:17 | |
*** baoli has quit IRC | 16:17 | |
*** baoli has joined #openstack-infra | 16:18 | |
*** john-davidge has quit IRC | 16:19 | |
*** funzo has quit IRC | 16:25 | |
*** sree has quit IRC | 16:29 | |
*** sree has joined #openstack-infra | 16:30 | |
*** funzo has joined #openstack-infra | 16:30 | |
openstackgerrit | Hongbin Lu proposed openstack-infra/project-config master: [Kuryr] Use gate hook in dsvm jobs https://review.openstack.org/461226 | 16:31 |
*** baoli has quit IRC | 16:32 | |
*** sree has quit IRC | 16:34 | |
*** yamahata_ has joined #openstack-infra | 16:35 | |
*** hongbin has joined #openstack-infra | 16:41 | |
*** hongbin_ has quit IRC | 16:43 | |
*** hongbin_ has joined #openstack-infra | 16:48 | |
*** hongbin has quit IRC | 16:48 | |
*** jamesmca_ has quit IRC | 16:49 | |
*** jamesmca_ has joined #openstack-infra | 16:49 | |
*** rkukura has joined #openstack-infra | 16:50 | |
*** jascott1 has joined #openstack-infra | 16:53 | |
*** hongbin has joined #openstack-infra | 16:53 | |
*** jamesmca_ has quit IRC | 16:54 | |
pabelanger | mordred: any chance to try the vhdutil ppa upload again? | 16:54 |
*** hongbin_ has quit IRC | 16:56 | |
*** jascott1 has quit IRC | 16:58 | |
*** hongbin has quit IRC | 16:58 | |
openstackgerrit | Tomasz Trębski proposed openstack-infra/project-config master: Adding CI jobs to monasca-kibana-plugin https://review.openstack.org/459511 | 17:02 |
*** nicolasbock has quit IRC | 17:04 | |
mordred | pabelanger: sure! | 17:05 |
*** asselin has joined #openstack-infra | 17:06 | |
mordred | pabelanger: just uploaded - no error, but no entry in the needs-building section | 17:07 |
mordred | https://launchpad.net/~openstack-ci-core/+archive/ubuntu/vhd-util/+builds?build_text=&build_state=all | 17:08 |
*** asselin_ has quit IRC | 17:08 | |
pabelanger | mordred: and no email back from launchpad.net? | 17:08 |
pabelanger | I thought it would confirm / deny uploads via email too | 17:08 |
mordred | it's entirely possible I block emails from launchpad :) | 17:09 |
mordred | oh - that reminds me - I built that patched version of qemu-img | 17:09 |
pabelanger | ya, I think launchpad will email the rejection reason | 17:09 |
* mordred goes to look at email server logs | 17:10 | |
mordred | pabelanger: I show no records of emails coming from launchpad | 17:11 |
mordred | pabelanger: I just made a new ppa in my account and have tried uploading there | 17:13 |
mordred | pabelanger: yah - no dice | 17:13 |
*** jamesmca_ has joined #openstack-infra | 17:14 | |
mordred | oh - you know what- I wonder if launchpad doens't have my current gpg key | 17:14 |
fungi | pabelanger: i guess let's check systems he's still authorized on and if he's not logged in that's an easy choice | 17:14 |
fungi | pabelanger: seems that account was added by https://review.openstack.org/260129 but never realized on any servers | 17:16 |
pabelanger | fungi: the commit message makes me thing something for afs | 17:16 |
fungi | right | 17:16 |
pabelanger | think* | 17:16 |
fungi | timing suggests it was around when we started planning for the npm mirror | 17:17 |
pabelanger | ya, but you are right. I don't see us adding his account to any servers | 17:17 |
fungi | though correctness would have us keep the uid reserved indefinitely so it's not reallocated | 17:17 |
pabelanger | mordred: oh, gpg might be it | 17:17 |
fungi | pabelanger: yeah, maybe just a null ssh key in this case and move on | 17:18 |
pabelanger | fungi: ++ | 17:18 |
mordred | I just re-uploaded my key to the ubuntu keyserver - I'm thinking maybe it's a subkey update thing | 17:18 |
fungi | mordred: if you're like me and keep refreshing with a short expiration, then that could be it? | 17:19 |
* fungi re-signs his key with a one-year expiration every month or so | 17:19 | |
*** thorst has joined #openstack-infra | 17:21 | |
*** thorst has quit IRC | 17:21 | |
mordred | ooh. I'm trying a thing in the webui | 17:21 |
mordred | I requested that launchpad rebuild the thign we have there but for xenial | 17:22 |
mordred | if that works, we can assume I'm just personally unable to upload things, but we'll have an answer at least | 17:22 |
*** thorst has joined #openstack-infra | 17:23 | |
*** thorst has quit IRC | 17:24 | |
mordred | pabelanger: ooh - I got an email from launchpad | 17:24 |
pabelanger | yay | 17:24 |
mordred | this could be good news for us putting a bubblewrap package in a PPA and being done with it :) | 17:26 |
*** otherwiseguy has quit IRC | 17:28 | |
mordred | pabelanger: woot! I have uploaded a source package and it shows queued for building | 17:29 |
*** aspiers has joined #openstack-infra | 17:29 | |
pabelanger | awesome | 17:29 |
mordred | pabelanger: I'm not 100% sure which, if any, of the actions I took made it start working, but let's not ask too many questions lest we anger it | 17:33 |
pabelanger | :) | 17:33 |
*** ykarel has joined #openstack-infra | 17:38 | |
*** tphummel has quit IRC | 17:39 | |
*** tphummel has joined #openstack-infra | 17:39 | |
*** tphummel has quit IRC | 17:40 | |
*** tphummel has joined #openstack-infra | 17:40 | |
*** tphummel has quit IRC | 17:40 | |
*** tphummel has joined #openstack-infra | 17:41 | |
*** tphummel has quit IRC | 17:41 | |
*** jamesdenton has joined #openstack-infra | 17:45 | |
*** felipemonteiro has joined #openstack-infra | 17:48 | |
*** anthonyper has quit IRC | 17:49 | |
*** anthonyper has joined #openstack-infra | 17:49 | |
openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/gear master: Provide TextJob and TextWorker for convenience https://review.openstack.org/461172 | 17:50 |
*** jamesmca_ has quit IRC | 17:51 | |
*** aspiers has quit IRC | 17:54 | |
*** anthonyper has quit IRC | 17:58 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Remove empty single_use_slave class https://review.openstack.org/461230 | 17:58 |
*** anthonyper has joined #openstack-infra | 17:59 | |
openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Remove empty single_use_slave class https://review.openstack.org/461230 | 18:00 |
*** aspiers has joined #openstack-infra | 18:04 | |
*** rossella_s has quit IRC | 18:05 | |
*** funzo has quit IRC | 18:13 | |
*** mdrabe has joined #openstack-infra | 18:14 | |
*** john-davidge has joined #openstack-infra | 18:16 | |
*** mdrabe has quit IRC | 18:19 | |
*** john-davidge has quit IRC | 18:20 | |
*** thorst has joined #openstack-infra | 18:24 | |
*** EricGonczer_ has joined #openstack-infra | 18:26 | |
*** thorst has quit IRC | 18:30 | |
*** EricGonczer_ has quit IRC | 18:35 | |
*** sree has joined #openstack-infra | 18:42 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: CI test - never merge https://review.openstack.org/461001 | 18:44 |
*** sree_ has joined #openstack-infra | 18:49 | |
*** sree_ is now known as Guest24144 | 18:50 | |
*** sree has quit IRC | 18:52 | |
*** rkukura has quit IRC | 18:53 | |
*** dave-mccowan has joined #openstack-infra | 18:55 | |
*** andreas-f has quit IRC | 18:59 | |
pabelanger | mordred: yay, vhd-utils was build by PPA. Sadface, it failed | 19:03 |
pabelanger | looks like warnings are errors by default | 19:03 |
*** jamesdenton has quit IRC | 19:03 | |
*** wolverineav has joined #openstack-infra | 19:09 | |
*** thorst has joined #openstack-infra | 19:26 | |
openstackgerrit | Morgan Fainberg proposed openstack-infra/shade master: Convert test_role_assignments to requests mock https://review.openstack.org/448313 | 19:32 |
*** esikachev has quit IRC | 19:33 | |
*** nicolasbock has joined #openstack-infra | 19:36 | |
*** jascott1 has joined #openstack-infra | 19:42 | |
*** jroll has quit IRC | 19:43 | |
*** thorst has quit IRC | 19:45 | |
*** jroll has joined #openstack-infra | 19:46 | |
*** thorst has joined #openstack-infra | 19:46 | |
*** thorst has quit IRC | 19:47 | |
*** andreww has joined #openstack-infra | 19:47 | |
*** ykarel has quit IRC | 19:47 | |
*** jascott1 has quit IRC | 19:47 | |
*** xarses_ has quit IRC | 19:50 | |
*** jamesmca_ has joined #openstack-infra | 19:52 | |
*** esikachev has joined #openstack-infra | 19:53 | |
*** jamesmca_ has quit IRC | 19:56 | |
*** EricGonczer_ has joined #openstack-infra | 19:59 | |
*** Guest24144 has quit IRC | 20:10 | |
*** ijw has joined #openstack-infra | 20:11 | |
*** ijw has quit IRC | 20:12 | |
*** dave-mccowan has quit IRC | 20:12 | |
*** ijw has joined #openstack-infra | 20:12 | |
*** nicolasbock has quit IRC | 20:12 | |
*** john-davidge has joined #openstack-infra | 20:18 | |
*** john-davidge has quit IRC | 20:23 | |
*** flepied has joined #openstack-infra | 20:26 | |
*** felipemonteiro has quit IRC | 20:30 | |
*** EricGonczer_ has quit IRC | 20:33 | |
*** nicolasbock has joined #openstack-infra | 20:34 | |
*** jascott1 has joined #openstack-infra | 20:44 | |
openstackgerrit | Slawek Kaplonski proposed openstack-infra/shade master: Remove neutronclient mocks from sec groups tests https://review.openstack.org/461238 | 20:46 |
*** thorst has joined #openstack-infra | 20:47 | |
*** jascott1 has quit IRC | 20:48 | |
*** thorst has quit IRC | 20:53 | |
*** ijw has quit IRC | 20:59 | |
mordred | pabelanger: yah -I'll fix in a bit | 20:59 |
*** ijw has joined #openstack-infra | 21:00 | |
*** ijw has joined #openstack-infra | 21:00 | |
*** andreas-f has joined #openstack-infra | 21:01 | |
*** esikachev has quit IRC | 21:04 | |
*** jamesdenton has joined #openstack-infra | 21:06 | |
*** armax has joined #openstack-infra | 21:09 | |
*** esberglu has joined #openstack-infra | 21:10 | |
*** esberglu has quit IRC | 21:15 | |
*** askb has joined #openstack-infra | 21:21 | |
*** thorst has joined #openstack-infra | 21:22 | |
*** thorst has quit IRC | 21:22 | |
*** dave-mccowan has joined #openstack-infra | 21:27 | |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Support homing diskimage builds to specific builder https://review.openstack.org/461239 | 21:27 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Support homing diskimage builds to specific builder https://review.openstack.org/461239 | 21:28 |
*** thorst has joined #openstack-infra | 21:30 | |
openstackgerrit | Morgan Fainberg proposed openstack-infra/shade master: Convert test_role_assignments to requests mock https://review.openstack.org/448313 | 21:33 |
*** baoli has joined #openstack-infra | 21:35 | |
*** thorst has quit IRC | 21:43 | |
*** neiljerram has quit IRC | 21:44 | |
*** baoli has quit IRC | 21:45 | |
*** ijw has quit IRC | 21:46 | |
*** ijw has joined #openstack-infra | 21:47 | |
*** ijw has quit IRC | 21:47 | |
*** dave-mccowan has quit IRC | 21:49 | |
*** dave-mccowan has joined #openstack-infra | 21:56 | |
*** dave-mccowan has quit IRC | 22:16 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 22:24 |
*** yamamoto has joined #openstack-infra | 22:27 | |
*** armax has quit IRC | 22:32 | |
*** wolverineav has quit IRC | 22:38 | |
*** wolverineav has joined #openstack-infra | 22:39 | |
*** yamamoto has quit IRC | 22:43 | |
*** wolverineav has quit IRC | 22:44 | |
*** thorst has joined #openstack-infra | 22:44 | |
*** ijw has joined #openstack-infra | 22:48 | |
*** thorst has quit IRC | 22:49 | |
*** ijw has quit IRC | 22:56 | |
*** gibi has quit IRC | 22:58 | |
*** onovy has quit IRC | 22:58 | |
*** gibi has joined #openstack-infra | 22:58 | |
*** breton has quit IRC | 22:59 | |
*** onovy has joined #openstack-infra | 23:00 | |
*** breton has joined #openstack-infra | 23:00 | |
*** esikachev has joined #openstack-infra | 23:01 | |
openstackgerrit | Michael Johnson proposed openstack-infra/project-config master: Revert "Use DEVSTACK_PROJECT_FROM_GIT for python-octaviaclient" https://review.openstack.org/461243 | 23:05 |
johnsom | Anyone around that can push that revert ^^^^ through? | 23:05 |
*** esikachev has quit IRC | 23:06 | |
*** yamamoto has joined #openstack-infra | 23:06 | |
johnsom | It broke our gates... | 23:06 |
*** jamesdenton has quit IRC | 23:18 | |
*** yamamoto has quit IRC | 23:25 | |
*** thorst has joined #openstack-infra | 23:45 | |
*** jascott1 has joined #openstack-infra | 23:48 | |
*** thorst has quit IRC | 23:50 | |
*** ijw has joined #openstack-infra | 23:52 | |
*** jascott1 has quit IRC | 23:53 | |
*** esberglu has joined #openstack-infra | 23:55 | |
*** tphummel has joined #openstack-infra | 23:55 | |
*** ijw has quit IRC | 23:57 | |
*** esberglu has quit IRC | 23:57 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!