| *** rascasoft has joined #openstack-infra | 00:00 | |
| *** sdake has quit IRC | 00:01 | |
| *** wolverineav has joined #openstack-infra | 00:02 | |
| *** jamesmcarthur has joined #openstack-infra | 00:02 | |
| *** elod has quit IRC | 00:05 | |
| *** wolverineav has quit IRC | 00:06 | |
| *** jamesmcarthur has quit IRC | 00:06 | |
| openstackgerrit | Merged openstack-infra/system-config master: Correct insecure-ci-registry01 hostvar filename https://review.openstack.org/635652 | 00:09 |
|---|---|---|
| *** rascasoft has quit IRC | 00:10 | |
| *** bobh has joined #openstack-infra | 00:10 | |
| *** bobh has quit IRC | 00:10 | |
| *** markvoelker has quit IRC | 00:11 | |
| fungi | clarkb: as for earlier curiosity about the claimed csrf vulnerability in gearman-plugin, "Client-side form validation is done via an HTTP request to an endpoint implemented in your plugin. The way the Stapler web framework works with convention it's not explicit that this is what happens." | 00:13 |
| clarkb | ah ya so must be the config stuff | 00:14 |
| fungi | so i guess the plugin is responsible for implementing an api endpoint for its config option settings which gets loosely glommed into the jenkins rest api | 00:14 |
| fungi | but could in theory be called directly | 00:14 |
| fungi | bypassing the csrf protections in the main api | 00:14 |
| clarkb | fungi: any idea where smarcet sees nodejs/npm install fail with the openstackid work? | 00:17 |
| clarkb | looking at openstackid-dev.o.o it seems fine but I'm guessing I am looking at the wrong place | 00:17 |
| fungi | clarkb: try openstackid-dev01.openstack.org | 00:17 |
| fungi | you may be looking at the current trusty server and not the new xenial server which isn't in use yet | 00:18 |
| *** wolverineav has joined #openstack-infra | 00:19 | |
| fungi | i recall there was a changeup in how nodejs and npm were packaged in ubuntu between trusty and xenial, and something about the puppet-nodejs module (i think?) made it particularly hard to simultaneously support both because of package name conflicts | 00:19 |
| clarkb | ya it is in a weird state, but nodejs repo seems to have done what it tries to do | 00:20 |
| fungi | also possible he manually installed npm on there when troubleshooting, hard to know without hearing back from him | 00:22 |
| clarkb | ya | 00:22 |
| clarkb | its looking like maybe that happened | 00:22 |
| clarkb | fungi: https://review.openstack.org/#/c/635666/1 I've written down what I think is happening | 00:25 |
| clarkb | basically xenial's version is newer than nodesource repo we install so xenials nodejs gets installed. However distro nodejs package doesn't install npm but nodesource would have | 00:25 |
| clarkb | so the fix here is to specify a newer version of nodesource repo than what comes with the distro. Considering we've never really been able to run node from the distro I think we should stick to nodesource and set the version | 00:26 |
| fungi | makes sense | 00:28 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: config: add playbooks to job.toDict() https://review.openstack.org/621343 | 00:31 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: Add API endpoint to get frozen jobs https://review.openstack.org/607077 | 00:31 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: Get executor job params https://review.openstack.org/607078 | 00:31 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: Separate out executor server from runner https://review.openstack.org/607079 | 00:31 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: zuul-runner: implement prep-workspace https://review.openstack.org/607082 | 00:31 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add /connections route https://review.openstack.org/631703 | 00:31 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: zuul-runner: use connections endpoint for prepare-workspace https://review.openstack.org/631704 | 00:31 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: zuul-runner: add execute sub-command https://review.openstack.org/630944 | 00:31 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: zuul-runner: add support for depends-on https://review.openstack.org/632064 | 00:31 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: zuul-runner: add quick-start integration test https://review.openstack.org/635701 | 00:31 |
| *** elod has joined #openstack-infra | 00:32 | |
| *** wolverineav has quit IRC | 00:33 | |
| *** wolverineav has joined #openstack-infra | 00:34 | |
| *** wolverineav has quit IRC | 00:39 | |
| *** wolverineav has joined #openstack-infra | 00:44 | |
| *** sdake has joined #openstack-infra | 00:45 | |
| openstackgerrit | Paul Vinciguerra proposed openstack-infra/zuul master: configloader.py: Not all jobs have an .updated attribute. https://review.openstack.org/633259 | 00:46 |
| *** mriedem_afk has quit IRC | 00:49 | |
| *** agopi|pto has joined #openstack-infra | 01:01 | |
| *** sdake has quit IRC | 01:06 | |
| *** markvoelker has joined #openstack-infra | 01:09 | |
| *** rascasoft has joined #openstack-infra | 01:12 | |
| *** wolverineav has quit IRC | 01:13 | |
| *** wolverineav has joined #openstack-infra | 01:14 | |
| *** agopi|pto has quit IRC | 01:14 | |
| *** agopi|pto has joined #openstack-infra | 01:14 | |
| *** agopi|pto has quit IRC | 01:16 | |
| *** agopi|pto has joined #openstack-infra | 01:16 | |
| *** agopi|pto has quit IRC | 01:17 | |
| *** agopi|pto has joined #openstack-infra | 01:17 | |
| *** wolverineav has quit IRC | 01:19 | |
| *** rascasoft has quit IRC | 01:20 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: zuul-runner: add quick-start integration test https://review.openstack.org/635701 | 01:22 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: Separate out executor server from runner https://review.openstack.org/607079 | 01:22 |
| *** rh-jelabarre has quit IRC | 01:29 | |
| *** rlandy has quit IRC | 01:30 | |
| *** markvoelker has quit IRC | 01:41 | |
| *** wolverineav has joined #openstack-infra | 01:44 | |
| *** mriedem has joined #openstack-infra | 01:46 | |
| *** agopi|pto has quit IRC | 01:49 | |
| *** agopi|pto has joined #openstack-infra | 01:49 | |
| *** agopi|pto has quit IRC | 01:56 | |
| *** agopi|pto has joined #openstack-infra | 01:56 | |
| *** wolverineav has quit IRC | 01:57 | |
| *** wolverineav has joined #openstack-infra | 01:57 | |
| *** agopi|pto has quit IRC | 01:58 | |
| *** agopi|pto has joined #openstack-infra | 01:58 | |
| *** wolverineav has quit IRC | 02:02 | |
| *** jamesmcarthur has joined #openstack-infra | 02:03 | |
| *** sdake has joined #openstack-infra | 02:06 | |
| *** jamesmcarthur has quit IRC | 02:07 | |
| *** sdake has quit IRC | 02:13 | |
| *** mriedem has quit IRC | 02:14 | |
| *** diablo_rojo has quit IRC | 02:15 | |
| ianw | clarkb: urgh, it looks to me like f29 has regressed again on the unbound returning ipv6 addresses when it shouldn't bug | 02:23 |
| ianw | http://paste.openstack.org/show/744717/ | 02:35 |
| ianw | same wget, one time it tries ipv6 which doesn't work, second time it tries ipv4 :/ | 02:35 |
| prometheanfire | can you switch to curl -4 (or add -4 to wget if it supports it)? | 02:36 |
| prometheanfire | not sure if that's too much a workaround though | 02:36 |
| *** markvoelker has joined #openstack-infra | 02:38 | |
| *** ykarel|away has joined #openstack-infra | 02:48 | |
| *** psachin has joined #openstack-infra | 02:51 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: zuul-runner: implement prep-workspace https://review.openstack.org/607082 | 02:52 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add /connections route https://review.openstack.org/631703 | 02:52 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: zuul-runner: use connections endpoint for prepare-workspace https://review.openstack.org/631704 | 02:52 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: zuul-runner: add execute sub-command https://review.openstack.org/630944 | 02:52 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: zuul-runner: add support for depends-on https://review.openstack.org/632064 | 02:52 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: zuul-runner: add quick-start integration test https://review.openstack.org/635701 | 02:54 |
| *** hwoarang has quit IRC | 03:00 | |
| *** hwoarang has joined #openstack-infra | 03:02 | |
| *** udesale has joined #openstack-infra | 03:11 | |
| *** markvoelker has quit IRC | 03:12 | |
| *** dave-mccowan has joined #openstack-infra | 03:14 | |
| *** ekcs has quit IRC | 03:18 | |
| fungi | prometheanfire: it presents an alternative issue in providers where ipv6 is our primary means of egress because all the ipv4 traffic goes through a single overload pat | 03:19 |
| prometheanfire | ah | 03:19 |
| fungi | basically we need ipv6 to be preferred in places where ipv6 is working, and not attempted in places where we have no global v6 default route | 03:19 |
| fungi | which we could work around everywhere with hackish calls to `ip -6 route show default` but, ugh | 03:21 |
| fungi | the tcp/ip stack should, you know, just work | 03:21 |
| prometheanfire | well, that's true | 03:21 |
| fungi | though to your question, yes wget *does* have a -6 option if we wanted to go that route (pun intended) | 03:23 |
| *** apetrich has quit IRC | 03:23 | |
| prometheanfire | :D | 03:24 |
| prometheanfire | setting up routes could work? maybe based on source ip (so it's different per DC?) | 03:25 |
| fungi | you mean tunnels? | 03:26 |
| prometheanfire | no tunnels needed | 03:26 |
| fungi | i'm not really following | 03:26 |
| prometheanfire | souce based, if in broken DC set v6 route to nothing, maybe | 03:27 |
| prometheanfire | not really sure it'd work in real life | 03:27 |
| fungi | oh, well if we're in a non-v6 provider we have no default v6 route anyway | 03:27 |
| prometheanfire | true | 03:28 |
| fungi | the bug seems to be that the applications in question are for some reason attempt to connect to ipv6 addresses when they have no route to them | 03:28 |
| prometheanfire | ah | 03:29 |
| ianw | yeah, i have no idea why it would choose it when there's no ipv6 access | 03:30 |
| ianw | fungi: here's a strace ... http://paste.openstack.org/show/744719/ | 03:31 |
| fungi | i don't think it's a problem with unbound. the dns resolver should return all address records for a request, but applications shouldn't be connecting over a protocol for which they have no route | 03:31 |
| ianw | of course, it's heisenbug ... at some point it goes away and i can't get it to return | 03:31 |
| clarkb | is it unbound failing to resolve talking to ipv6 resolver or unbound returning AAAA record to ipv4 only host and it using that unexpectedly? | 03:35 |
| ianw | clarkb: it's somehow returning ... something ... and then wget wants to use AAAA records | 03:37 |
| fungi | the first paste was wget deciding to try to retrieve a file via the ipv6 address provided rather than v4 | 03:37 |
| ianw | it's not just wget ... this manifests in dnf failing, but wget replicates | 03:37 |
| ianw | if i change the nameserver to 8.8.8.8 i can run it 30 times and not hit it | 03:37 |
| fungi | yeah, it's probably more to do with the socket implementation would be my guess | 03:38 |
| ianw | but back to 127.0.0.1 and it hits ~20% of time | 03:38 |
| fungi | so potentially impacting anything which tries to initiate communication over the network | 03:38 |
| fungi | oh, i missed the part about unbound seeming to cause it | 03:39 |
| ianw | yeah ; i have an unbound log of a failing and a passing | 03:39 |
| fungi | have you tried querying that address from 127.0.0.1 lots of times and seeing if sometimes it only returns aaaa records? | 03:39 |
| ianw | fungi: i think in the failing strace, you can see the ipv4 addresses ... i'm trying | 03:40 |
| fungi | also could just be down to the order in which the addresses are returned | 03:40 |
| ianw | # host mirrors.fedoraproject.org | 03:41 |
| ianw | Host mirrors.fedoraproject.org not found: 2(SERVFAIL) | 03:41 |
| fungi | neat! | 03:41 |
| ianw | so now i have random AAAA connect AND androm SERVFAILs | 03:42 |
| fungi | i see three nameservers for fedoraproject.org, two of which have both a and aaaa rrs, while the third one has only a | 03:43 |
| *** bhavikdbavishi has joined #openstack-infra | 03:45 | |
| fungi | all three are returning the same round-robin set for wildcard.fedoraproject.org though (but each in a different order, as they should) | 03:45 |
| fungi | and all of them also agree that mirrors.fedoraproject.org is a cname to that | 03:46 |
| fungi | ianw: is that the only domain you're seeing this behavior with, or are there others? | 03:47 |
| ianw | fungi: it's one of the first we try and connect to on boot | 03:48 |
| clarkb | in the trace those ipv4 addrs are for localhost | 03:48 |
| ianw | so yes, only that, i guess, but haven't investigate others | 03:48 |
| clarkb | I think its checking if it has ipv6 or ipv4 to do the actual connectio | 03:48 |
| *** ianychoi has quit IRC | 03:49 | |
| clarkb | shows 127.0.0.1, public v4, private v4, ::1 and link local v6 | 03:49 |
| * ianw has to go get kids .. bib | 03:49 | |
| fungi | thanks ianw! | 03:49 |
| clarkb | rax has working v6 but glean doesnt know how to configure it iirc | 03:50 |
| clarkb | so we end up effectively v4 only there | 03:50 |
| ianw | for reference, here's a "good" trace | 03:50 |
| ianw | http://paste.openstack.org/show/744720/ | 03:50 |
| ianw | same host, but it worked that time | 03:51 |
| clarkb | getsockname says interface is ens3 on working paste but eth0 on broken paste | 03:53 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: zuul-runner: add support for depends-on https://review.openstack.org/632064 | 03:53 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: zuul-runner: add quick-start integration test https://review.openstack.org/635701 | 03:53 |
| clarkb | if that is same.host that is weird and may be the thread to pull on | 03:54 |
| fungi | that's definitely unexpected | 03:55 |
| *** ianychoi has joined #openstack-infra | 03:55 | |
| fungi | unless they're different distros | 03:55 |
| clarkb | ianw said same host | 03:56 |
| clarkb | I have t compared IPs | 03:56 |
| *** ekcs has joined #openstack-infra | 03:56 | |
| fungi | or one happened in early boot before interface renaming happened | 03:56 |
| clarkb | seems like IPs are different so maybe that is noise | 03:56 |
| *** armax has quit IRC | 03:58 | |
| *** markvoelker has joined #openstack-infra | 04:09 | |
| *** armax has joined #openstack-infra | 04:09 | |
| *** hwoarang has quit IRC | 04:19 | |
| *** hwoarang has joined #openstack-infra | 04:20 | |
| *** whoami-rajat has joined #openstack-infra | 04:24 | |
| ianw | it's same host, like seconds apart :/ | 04:31 |
| *** armax has quit IRC | 04:33 | |
| *** ykarel|away is now known as ykarel | 04:37 | |
| *** markvoelker has quit IRC | 04:41 | |
| *** ramishra has joined #openstack-infra | 05:05 | |
| *** dave-mccowan has quit IRC | 05:08 | |
| *** bobh has joined #openstack-infra | 05:18 | |
| *** bobh has quit IRC | 05:23 | |
| *** bobh has joined #openstack-infra | 05:34 | |
| *** gyee has quit IRC | 05:36 | |
| *** ekcs has quit IRC | 05:37 | |
| *** markvoelker has joined #openstack-infra | 05:38 | |
| *** bobh has quit IRC | 05:38 | |
| *** chandankumar is now known as chkumar|ruck | 05:41 | |
| ianw | fungi / clarkb : https://www.nlnetlabs.nl/bugs-script/show_bug.cgi?id=4226 is about the best i can do right now ... out of time for today :/ | 05:46 |
| openstack | www.nlnetlabs.nl bug 4226 in server "Clients somehow confused into using AAAA records" [Enhancement,New] - Assigned to unbound-team | 05:46 |
| *** bobh has joined #openstack-infra | 05:53 | |
| *** bobh has quit IRC | 05:57 | |
| *** raghav has joined #openstack-infra | 06:01 | |
| *** jamesmcarthur has joined #openstack-infra | 06:03 | |
| *** janki has joined #openstack-infra | 06:05 | |
| *** jamesmcarthur has quit IRC | 06:08 | |
| *** bobh has joined #openstack-infra | 06:10 | |
| *** markvoelker has quit IRC | 06:12 | |
| *** bobh has quit IRC | 06:15 | |
| *** bobh has joined #openstack-infra | 06:29 | |
| *** bobh has quit IRC | 06:34 | |
| *** pleia2 has quit IRC | 06:35 | |
| *** pleia2 has joined #openstack-infra | 06:35 | |
| *** bobh has joined #openstack-infra | 06:46 | |
| openstackgerrit | Felix Schmidt proposed openstack-infra/zuul master: Retrieve full list of jobs with details per tenant via API https://review.openstack.org/635714 | 06:49 |
| *** e0ne has joined #openstack-infra | 06:50 | |
| *** bobh has quit IRC | 06:51 | |
| *** chkumar|ruck has quit IRC | 06:51 | |
| *** quiquell|off is now known as quiquell|rover | 06:52 | |
| *** chandankumar has joined #openstack-infra | 06:52 | |
| *** chandankumar is now known as chkumar|ruck | 06:52 | |
| openstackgerrit | Felix Schmidt proposed openstack-infra/zuul master: Retrieve full list of jobs with details per tenant via API https://review.openstack.org/635714 | 06:53 |
| *** kopecmartin|off is now known as kopecmartin | 06:58 | |
| *** bobh has joined #openstack-infra | 07:02 | |
| *** pgaxatte has joined #openstack-infra | 07:04 | |
| *** e0ne has quit IRC | 07:06 | |
| *** bobh has quit IRC | 07:07 | |
| *** markvoelker has joined #openstack-infra | 07:09 | |
| *** zaro has joined #openstack-infra | 07:12 | |
| *** remi_ness has joined #openstack-infra | 07:15 | |
| *** wolverineav has joined #openstack-infra | 07:22 | |
| *** pcaruana has joined #openstack-infra | 07:23 | |
| *** wolverineav has quit IRC | 07:28 | |
| *** wolverineav has joined #openstack-infra | 07:29 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: webtrigger: add initial driver and event https://review.openstack.org/555153 | 07:32 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: webtrigger: add web route and rpclistener https://review.openstack.org/554839 | 07:32 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add build modal button to trigger job https://review.openstack.org/635716 | 07:32 |
| *** quiquell|rover is now known as quique|rover|brb | 07:35 | |
| *** bobh has joined #openstack-infra | 07:35 | |
| *** bobh has quit IRC | 07:40 | |
| *** markvoelker has quit IRC | 07:41 | |
| *** hrubi has quit IRC | 07:51 | |
| *** bobh has joined #openstack-infra | 07:54 | |
| *** bobh has quit IRC | 07:59 | |
| *** auristor has quit IRC | 08:00 | |
| *** ccamacho has joined #openstack-infra | 08:00 | |
| *** takamatsu has joined #openstack-infra | 08:00 | |
| *** bobh has joined #openstack-infra | 08:03 | |
| openstackgerrit | Felix Schmidt proposed openstack-infra/zuul master: Retrieve full list of jobs with details per tenant via API https://review.openstack.org/635714 | 08:04 |
| *** jamesmcarthur has joined #openstack-infra | 08:05 | |
| *** gfidente has joined #openstack-infra | 08:05 | |
| *** quique|rover|brb is now known as quiquell|rover | 08:05 | |
| *** gfidente has quit IRC | 08:06 | |
| *** aojea has joined #openstack-infra | 08:08 | |
| *** bobh has quit IRC | 08:08 | |
| *** bobh_ has joined #openstack-infra | 08:08 | |
| *** jamesmcarthur has quit IRC | 08:10 | |
| *** rascasoft has joined #openstack-infra | 08:10 | |
| *** Emine has joined #openstack-infra | 08:12 | |
| *** bobh_ has quit IRC | 08:12 | |
| *** tkajinam has quit IRC | 08:14 | |
| *** zaro has quit IRC | 08:19 | |
| *** auristor has joined #openstack-infra | 08:22 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: webtrigger: add initial driver and event https://review.openstack.org/555153 | 08:24 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: webtrigger: add web route and rpclistener https://review.openstack.org/554839 | 08:24 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add build modal button to trigger job https://review.openstack.org/635716 | 08:24 |
| *** rossella_s has joined #openstack-infra | 08:30 | |
| *** markvoelker has joined #openstack-infra | 08:38 | |
| *** bobh has joined #openstack-infra | 08:38 | |
| *** gfidente has joined #openstack-infra | 08:42 | |
| *** bobh has quit IRC | 08:42 | |
| *** jpena|off is now known as jpena | 08:45 | |
| *** xek has joined #openstack-infra | 08:45 | |
| *** ianychoi has quit IRC | 08:50 | |
| *** bobh has joined #openstack-infra | 08:55 | |
| *** rpittau has joined #openstack-infra | 08:56 | |
| *** bobh has quit IRC | 09:00 | |
| *** ykarel is now known as ykarel|lunch | 09:04 | |
| *** Emine has quit IRC | 09:05 | |
| *** ociuhandu has joined #openstack-infra | 09:07 | |
| *** raissa has joined #openstack-infra | 09:07 | |
| *** panda|off is now known as panda | 09:08 | |
| *** jpich has joined #openstack-infra | 09:10 | |
| quiquell|rover | Hello | 09:10 |
| quiquell|rover | How was te rest api to get gerrit comments on a change ? | 09:10 |
| quiquell|rover | curl -H "Accept: application/json" https://review.openstack.org/changes/60445/comments ? | 09:10 |
| *** markvoelker has quit IRC | 09:12 | |
| *** whoami-rajat has quit IRC | 09:14 | |
| *** kjackal has joined #openstack-infra | 09:17 | |
| *** e0ne has joined #openstack-infra | 09:20 | |
| quiquell|rover | zbr: ^ | 09:21 |
| *** bobh has joined #openstack-infra | 09:23 | |
| *** bobh has quit IRC | 09:24 | |
| *** bobh has joined #openstack-infra | 09:24 | |
| *** hrubi has joined #openstack-infra | 09:26 | |
| *** whoami-rajat has joined #openstack-infra | 09:28 | |
| *** bobh has quit IRC | 09:29 | |
| *** kjackal has quit IRC | 09:31 | |
| *** kjackal has joined #openstack-infra | 09:32 | |
| *** derekh has joined #openstack-infra | 09:36 | |
| *** bobh has joined #openstack-infra | 09:37 | |
| *** bauzas is now known as bauwser | 09:39 | |
| *** dtantsur|afk is now known as dtantsur | 09:40 | |
| *** bobh has quit IRC | 09:42 | |
| *** slaweq has joined #openstack-infra | 09:42 | |
| *** roman_g has joined #openstack-infra | 09:44 | |
| *** tosky has joined #openstack-infra | 09:45 | |
| *** david-lyle has joined #openstack-infra | 09:54 | |
| *** manjeets_ has joined #openstack-infra | 09:55 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: URLTrigger driver time based - artifact change jobs triggering driver https://review.openstack.org/635567 | 09:56 |
| *** dklyle has quit IRC | 09:57 | |
| *** manjeets has quit IRC | 09:57 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: URLTrigger driver time based - artifact change jobs triggering driver https://review.openstack.org/635567 | 09:59 |
| *** rkukura has quit IRC | 09:59 | |
| *** gfidente has quit IRC | 10:00 | |
| *** rkukura has joined #openstack-infra | 10:01 | |
| *** bobh has joined #openstack-infra | 10:07 | |
| *** remi_ness has quit IRC | 10:07 | |
| *** markvoelker has joined #openstack-infra | 10:10 | |
| *** ociuhandu has quit IRC | 10:10 | |
| *** bobh has quit IRC | 10:12 | |
| *** ginopc has joined #openstack-infra | 10:16 | |
| *** bhavikdbavishi has quit IRC | 10:18 | |
| *** ykarel|lunch is now known as ykarel | 10:24 | |
| *** ociuhandu has joined #openstack-infra | 10:30 | |
| *** ociuhandu has quit IRC | 10:31 | |
| *** ociuhandu has joined #openstack-infra | 10:31 | |
| *** bobh has joined #openstack-infra | 10:34 | |
| *** bobh has quit IRC | 10:39 | |
| *** markvoelker has quit IRC | 10:42 | |
| *** bobh has joined #openstack-infra | 10:48 | |
| *** bobh has quit IRC | 10:52 | |
| *** yamamoto has quit IRC | 10:57 | |
| *** bobh has joined #openstack-infra | 10:58 | |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/bindep master: Refactor: factor out subprocess and error handling stub https://review.openstack.org/455832 | 11:01 |
| *** bobh_ has joined #openstack-infra | 11:01 | |
| *** bobh has quit IRC | 11:02 | |
| *** Emine has joined #openstack-infra | 11:02 | |
| *** jamesmcarthur has joined #openstack-infra | 11:03 | |
| *** bobh_ has quit IRC | 11:06 | |
| *** jamesmcarthur has quit IRC | 11:07 | |
| *** udesale has quit IRC | 11:10 | |
| *** udesale has joined #openstack-infra | 11:10 | |
| *** bobh has joined #openstack-infra | 11:16 | |
| *** ramishra has quit IRC | 11:20 | |
| *** bobh has quit IRC | 11:20 | |
| *** takamatsu_ has joined #openstack-infra | 11:20 | |
| *** takamatsu has quit IRC | 11:20 | |
| *** wolke has joined #openstack-infra | 11:21 | |
| *** stephenfin is now known as finucannot | 11:27 | |
| *** kjackal has quit IRC | 11:31 | |
| *** yamamoto has joined #openstack-infra | 11:32 | |
| *** yamamoto has quit IRC | 11:32 | |
| *** sdake has joined #openstack-infra | 11:34 | |
| *** yamamoto has joined #openstack-infra | 11:39 | |
| *** markvoelker has joined #openstack-infra | 11:39 | |
| *** sdake has quit IRC | 11:41 | |
| *** yamamoto has quit IRC | 11:44 | |
| *** sdake has joined #openstack-infra | 11:44 | |
| *** bobh has joined #openstack-infra | 11:45 | |
| *** raissa has quit IRC | 11:46 | |
| *** Emine has quit IRC | 11:51 | |
| *** ramishra has joined #openstack-infra | 11:56 | |
| *** gfidente has joined #openstack-infra | 12:09 | |
| *** sdake has quit IRC | 12:11 | |
| *** wolverineav has quit IRC | 12:11 | |
| *** markvoelker has quit IRC | 12:12 | |
| *** sdake has joined #openstack-infra | 12:13 | |
| *** slaweq has quit IRC | 12:15 | |
| *** rossella_s has quit IRC | 12:15 | |
| *** slaweq has joined #openstack-infra | 12:18 | |
| *** whoami-rajat has quit IRC | 12:24 | |
| *** raghav has quit IRC | 12:27 | |
| *** Adri2000 has quit IRC | 12:27 | |
| *** kjackal has joined #openstack-infra | 12:27 | |
| *** e0ne has quit IRC | 12:29 | |
| *** Adri2000 has joined #openstack-infra | 12:32 | |
| *** jpena is now known as jpena|lunch | 12:37 | |
| *** whoami-rajat has joined #openstack-infra | 12:44 | |
| *** Emine has joined #openstack-infra | 12:47 | |
| *** bobh has quit IRC | 12:48 | |
| *** bobh has joined #openstack-infra | 12:48 | |
| *** jtomasek has joined #openstack-infra | 12:48 | |
| *** sdake has quit IRC | 12:48 | |
| *** bobh has quit IRC | 12:52 | |
| *** Diabelko has quit IRC | 12:53 | |
| *** Diabelko has joined #openstack-infra | 12:54 | |
| ianw | quiquell|rover: i'm not sure, but i think zuul switched to http based reporting, might be some bits in there | 12:58 |
| quiquell|rover | ianw: ack | 12:58 |
| *** agopi|pto has quit IRC | 13:00 | |
| *** bobh has joined #openstack-infra | 13:01 | |
| *** psachin has quit IRC | 13:03 | |
| ianw | fungi / clarkb : very interesting response on previous unbound bug re dnssec ... need to look into | 13:03 |
| *** bobh has quit IRC | 13:06 | |
| *** markvoelker has joined #openstack-infra | 13:09 | |
| *** bobh has joined #openstack-infra | 13:14 | |
| *** eharney has joined #openstack-infra | 13:15 | |
| *** e0ne has joined #openstack-infra | 13:17 | |
| *** auristor has quit IRC | 13:17 | |
| *** gary_perkins has quit IRC | 13:18 | |
| *** bobh has quit IRC | 13:19 | |
| *** bobh_ has joined #openstack-infra | 13:19 | |
| *** gary_perkins has joined #openstack-infra | 13:19 | |
| clarkb | ianw ya sounds like maybe weneed new dns servers? | 13:21 |
| clarkb | odd we'd only notice with fedora though | 13:21 |
| clarkb | cloudflare dns instead maybe | 13:25 |
| *** yamamoto has joined #openstack-infra | 13:26 | |
| *** bobh_ has quit IRC | 13:26 | |
| *** ianychoi has joined #openstack-infra | 13:27 | |
| openstackgerrit | Jakub Libosvar proposed openstack-infra/project-config master: Move networking-ansible jobs to its project https://review.openstack.org/635836 | 13:27 |
| *** lpetrut has joined #openstack-infra | 13:29 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zone-opendev.org master: Add kubernetes nodes to DNS https://review.openstack.org/635485 | 13:31 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zone-opendev.org master: Switch opendev.org to point to gitea https://review.openstack.org/635486 | 13:31 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] web: add tenant and project scoped, JWT-protected actions https://review.openstack.org/576907 | 13:31 |
| *** mriedem has joined #openstack-infra | 13:31 | |
| *** rh-jelabarre has joined #openstack-infra | 13:34 | |
| *** kgiusti has joined #openstack-infra | 13:34 | |
| *** rlandy has joined #openstack-infra | 13:37 | |
| *** eharney has quit IRC | 13:38 | |
| *** yamamoto has quit IRC | 13:39 | |
| *** chkumar|ruck is now known as chkumar|out | 13:39 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/zuul master: Escape jinja2 template from commit message https://review.openstack.org/633930 | 13:39 |
| *** jpena|lunch is now known as jpena | 13:39 | |
| *** rpittau has quit IRC | 13:40 | |
| *** rpittau has joined #openstack-infra | 13:40 | |
| *** markvoelker has quit IRC | 13:42 | |
| *** eharney has joined #openstack-infra | 13:43 | |
| *** jamesmcarthur has joined #openstack-infra | 13:44 | |
| *** jamesmcarthur has quit IRC | 13:45 | |
| *** jamesmcarthur has joined #openstack-infra | 13:45 | |
| *** raissa has joined #openstack-infra | 13:47 | |
| fungi | quiquell|rover: ianw: https://review.openstack.org/Documentation/rest-api-changes.html#list-change-comments | 13:56 |
| fungi | so basically what you had there | 13:57 |
| *** HenryG has quit IRC | 13:57 | |
| fungi | https://review.openstack.org/Documentation/rest-api-changes.html#change-id tells you the possible forms of the {change-id} parameter | 13:58 |
| quiquell|rover | fungi: I have use "detail" to get them | 14:00 |
| clarkb | fungi thoughts on replacing opends servers basedon that response to the unbound bug? | 14:03 |
| clarkb | *opendns | 14:03 |
| fungi | quiquell|rover: i'm able to see comments by retrieving just https://review.openstack.org/changes/611945/comments | 14:05 |
| *** jcoufal has joined #openstack-infra | 14:06 | |
| quiquell|rover | https://review.openstack.org/changes/60445/comments <- not here | 14:07 |
| mordred | clarkb, fungi: I think it sounds like we should remove the opendns servers for now | 14:09 |
| mordred | although also potentially send a note to the opendns people about the RRSIG failure | 14:11 |
| *** EmilienM is now known as EvilienM | 14:15 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] web: add tenant and project scoped, JWT-protected actions https://review.openstack.org/576907 | 14:16 |
| zbr | mordred: fungi : few minor bindep CRs: fungi https://review.openstack.org/635590 https://review.openstack.org/635576 https://review.openstack.org/622325 thanks | 14:17 |
| *** jamesmcarthur has quit IRC | 14:18 | |
| *** HenryG has joined #openstack-infra | 14:23 | |
| *** jcoufal has quit IRC | 14:24 | |
| *** TheJulia is now known as needssleep | 14:25 | |
| zbr | clarkb: git-review: https://review.openstack.org/#/c/630661/ https://review.openstack.org/#/c/628655/ ? | 14:25 |
| *** jcoufal has joined #openstack-infra | 14:25 | |
| *** jamesmcarthur has joined #openstack-infra | 14:32 | |
| *** bobh has joined #openstack-infra | 14:34 | |
| *** ramishra has quit IRC | 14:34 | |
| *** efried is now known as fried_rice | 14:35 | |
| *** jtomasek has quit IRC | 14:37 | |
| *** auristor has joined #openstack-infra | 14:37 | |
| *** dtantsur is now known as creepy_owlet | 14:37 | |
| *** sdake has joined #openstack-infra | 14:38 | |
| *** jtomasek has joined #openstack-infra | 14:38 | |
| mnaser | infra-root: http://codesearch.openstack.org/ was randomly giving me too many open files errors a few second sago | 14:39 |
| *** markvoelker has joined #openstack-infra | 14:39 | |
| *** kopecmartin is now known as kopecmartin|off | 14:39 | |
| zbr | mnaser: seems like something easy to fix but i have no access to investigate cause. likely it needs an ulimit boost unless that is caused by a leak. | 14:41 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Update k8s-on-openstack for ssh known_hosts https://review.openstack.org/635482 | 14:41 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Add opendev kubernetes nodes to ansible inventory https://review.openstack.org/635472 | 14:41 |
| fungi | it's a recurring problem with hound | 14:41 |
| *** sdake has quit IRC | 14:42 | |
| fungi | i think we've made a few stabs at fixing it so far, but i don't recall what now | 14:42 |
| fungi | the obvious and straightforward solutions weren't terribly effective, if memory serves | 14:42 |
| mordred | we also might be able to retire hound with the gitea install | 14:42 |
| *** yamamoto has joined #openstack-infra | 14:44 | |
| fungi | yes | 14:46 |
| *** raissa has quit IRC | 14:46 | |
| *** janki has quit IRC | 14:50 | |
| *** yamamoto has quit IRC | 14:51 | |
| *** sdake has joined #openstack-infra | 14:52 | |
| *** aojea has quit IRC | 14:52 | |
| *** gary_perkins has quit IRC | 14:55 | |
| *** gary_perkins has joined #openstack-infra | 14:56 | |
| *** gary_perkins has joined #openstack-infra | 14:56 | |
| *** rkukura has quit IRC | 15:01 | |
| *** whoami-rajat has quit IRC | 15:04 | |
| *** Emine has quit IRC | 15:05 | |
| *** rkukura has joined #openstack-infra | 15:07 | |
| *** _walshh2 has quit IRC | 15:11 | |
| *** markvoelker has quit IRC | 15:12 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Stop running k8s-on-openstack nested https://review.openstack.org/635857 | 15:15 |
| mordred | corvus: ^^ I think that might fix the debuggability | 15:15 |
| *** roman_g has quit IRC | 15:17 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] web: add tenant and project scoped, JWT-protected actions https://review.openstack.org/576907 | 15:17 |
| mordred | corvus: I took a stab at making a playbook to just use the roles - but ran in to issues because internal to those roles they expect certain group names in the inventory that I think would be problematic to put directly into our normal inventory.. things like: command: "{{ hostvars[groups.master[0]]['joincommand'] }}" | 15:17 |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid master: Update nodejs default version https://review.openstack.org/635666 | 15:19 |
| *** quiquell|rover is now known as quiquell|off | 15:22 | |
| *** remi_ness has joined #openstack-infra | 15:27 | |
| *** lpetrut has quit IRC | 15:29 | |
| *** lpetrut has joined #openstack-infra | 15:30 | |
| *** kjackal has quit IRC | 15:31 | |
| *** whoami-rajat has joined #openstack-infra | 15:31 | |
| *** kjackal has joined #openstack-infra | 15:31 | |
| *** pcaruana has quit IRC | 15:31 | |
| *** priteau has joined #openstack-infra | 15:50 | |
| *** armax has joined #openstack-infra | 15:51 | |
| *** lpetrut has quit IRC | 15:51 | |
| *** sdake has quit IRC | 15:52 | |
| *** Emine has joined #openstack-infra | 15:52 | |
| *** sdake has joined #openstack-infra | 15:52 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] web: add tenant and project scoped, JWT-protected actions https://review.openstack.org/576907 | 15:54 |
| *** sdake has quit IRC | 15:56 | |
| *** eharney has quit IRC | 15:58 | |
| *** sdake has joined #openstack-infra | 15:58 | |
| *** bobh has quit IRC | 15:58 | |
| *** priteau has quit IRC | 16:00 | |
| openstackgerrit | Mohammed Naser proposed openstack-infra/nodepool master: docker: don't daemonize when starting images https://review.openstack.org/635584 | 16:03 |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid master: Update nodejs default version https://review.openstack.org/635666 | 16:04 |
| *** smarcet has joined #openstack-infra | 16:07 | |
| smarcet | fungi: clarkb: morning i just updated https://review.openstack.org/#/c/635666/ please review at will thx u | 16:08 |
| *** eharney has joined #openstack-infra | 16:09 | |
| *** markvoelker has joined #openstack-infra | 16:09 | |
| *** bobh has joined #openstack-infra | 16:10 | |
| clarkb | smarcet: is nodejs 7.x the version you want? iirc even numbers are the stable releases | 16:11 |
| smarcet | clarkb: well its does not matter to much, the deployment script just install n and use the latest one ( 10.x) and latest npm | 16:12 |
| smarcet | just need to be sure that npm its installed :) | 16:12 |
| clarkb | smarcet: right my suggestion is taht you install the version you actually want. In this case it sounds like 10.x | 16:13 |
| smarcet | well | 16:13 |
| clarkb | rather than using a random version like 7.x which is unstable | 16:13 |
| smarcet | 10.x is not available | 16:13 |
| clarkb | https://deb.nodesource.com/node_10.x/dists/xenial/ it seems to be available | 16:13 |
| smarcet | ok ok | 16:14 |
| smarcet | oh ok | 16:14 |
| smarcet | i was taking in consideration this one https://github.com/voxpupuli/puppet-nodejs/tree/v2.3.0#repo_url_suffix | 16:14 |
| smarcet | i will change then | 16:14 |
| smarcet | :) thx u | 16:14 |
| clarkb | smarcet: ah I think that may have been up to date when that release happened | 16:14 |
| clarkb | and since then 10.x has happened | 16:14 |
| openstackgerrit | Mohammed Naser proposed openstack-infra/nodepool master: bindep: add sudo https://review.openstack.org/635876 | 16:15 |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid master: Update nodejs default version https://review.openstack.org/635666 | 16:15 |
| smarcet | ok clarkb ^^^ updated thx u so much for guidance :) | 16:15 |
| clarkb | +2 thanks | 16:16 |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul-jobs master: Add the skip_bindep option to the tox job https://review.openstack.org/635877 | 16:16 |
| *** e0ne has quit IRC | 16:17 | |
| *** smarcet has quit IRC | 16:19 | |
| corvus | mordred: are you around to fix the syntax error in 635857 ? | 16:23 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool master: WIP Base nodepool-builder on diskimage-builder https://review.openstack.org/635879 | 16:24 |
| corvus | mordred: oh, actually the error is in 635472 | 16:24 |
| corvus | mordred: http://logs.openstack.org/57/635857/1/check/system-config-run-base/3e35250/ara-report/result/f68a4b1a-59d2-48b8-ad05-e656327e8b4c/ | 16:24 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] web: add tenant and project scoped, JWT-protected actions https://review.openstack.org/576907 | 16:25 |
| *** ykarel is now known as ykarel|away | 16:27 | |
| *** owalsh_ has joined #openstack-infra | 16:27 | |
| *** shardy has quit IRC | 16:30 | |
| *** owalsh has quit IRC | 16:30 | |
| *** owalsh_ is now known as owalsh | 16:32 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Add opendev kubernetes nodes to ansible inventory https://review.openstack.org/635472 | 16:33 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Stop running k8s-on-openstack nested https://review.openstack.org/635857 | 16:33 |
| mordred | corvus: ^^ fixed | 16:33 |
| corvus | mordred: i don't see the fix | 16:34 |
| corvus | mordred: 635472 ps3 -> ps4 is just a comment change | 16:34 |
| corvus | mordred: you're missing "roles:" | 16:35 |
| *** bobh has quit IRC | 16:35 | |
| corvus | mordred: i left an inline comment | 16:35 |
| *** ykarel|away has quit IRC | 16:38 | |
| *** gyee has joined #openstack-infra | 16:38 | |
| mordred | corvus: oh. hah. I was thinking the issue was the 's in the comments | 16:40 |
| *** smarcet has joined #openstack-infra | 16:40 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul-jobs master: Add the skip_bindep option to the tox job https://review.openstack.org/635877 | 16:40 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Add opendev kubernetes nodes to ansible inventory https://review.openstack.org/635472 | 16:40 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Stop running k8s-on-openstack nested https://review.openstack.org/635857 | 16:40 |
| mordred | corvus: maybe I suck less now | 16:40 |
| corvus | we shall see! | 16:40 |
| mordred | probably not - but we can always hope | 16:40 |
| *** diablo_rojo has joined #openstack-infra | 16:42 | |
| *** raissa has joined #openstack-infra | 16:43 | |
| *** markvoelker has quit IRC | 16:43 | |
| *** smarcet has quit IRC | 16:43 | |
| *** bhavikdbavishi has joined #openstack-infra | 16:44 | |
| *** hamzy has quit IRC | 16:47 | |
| *** smarcet has joined #openstack-infra | 16:47 | |
| *** eharney has quit IRC | 16:48 | |
| *** iurygregory has quit IRC | 16:49 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Update k8s-on-openstack for ssh known_hosts https://review.openstack.org/635482 | 16:49 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Add opendev kubernetes nodes to ansible inventory https://review.openstack.org/635472 | 16:49 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Stop running k8s-on-openstack nested https://review.openstack.org/635857 | 16:49 |
| mordred | corvus: landed a bugfix to k8s-on-openstack - stack updated with the new sha | 16:49 |
| corvus | mordred: has he given you merge perms yet? :) | 16:50 |
| mordred | corvus: incidentally - False | bool in ansible fails | 16:50 |
| clarkb | mordred: because it is already bool? | 16:50 |
| mordred | clarkb: https://travis-ci.org/infraly/k8s-on-openstack/builds/490573781#L1232 | 16:51 |
| clarkb | ha fun | 16:52 |
| *** walshh_ has joined #openstack-infra | 16:52 | |
| mordred | OH! wait - no, it was as different syntax issue on my part | 16:53 |
| mordred | (turns out the | bool isn't needed anyway - but the real problem is: | 16:53 |
| mordred | nodes_auto_ip: "{{ lookup('env', 'NODE_AUTO_IP') | default ('False', true) }} | bool" | 16:53 |
| mordred | the '| bool' is outside of the }} :) | 16:53 |
| *** adriancz has quit IRC | 16:55 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] web: add tenant and project scoped, JWT-protected actions https://review.openstack.org/576907 | 16:55 |
| *** diablo_rojo has quit IRC | 16:55 | |
| *** ekultails has joined #openstack-infra | 16:57 | |
| *** diablo_rojo has joined #openstack-infra | 16:57 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Report tenant and project specific resource usage stats https://review.openstack.org/616306 | 17:00 |
| *** manjeets_ is now known as manjeets | 17:00 | |
| *** kgiusti has left #openstack-infra | 17:01 | |
| *** wolverineav has joined #openstack-infra | 17:02 | |
| *** Emine has quit IRC | 17:03 | |
| *** pgaxatte has quit IRC | 17:03 | |
| corvus | mordred, clarkb: i think when i did this: http://38.108.68.64/openstack-infra/system-config/src/branch/master/playbooks/roles/registry/tasks/main.yaml#L13-L17 i may have installed python2 on the registry server | 17:03 |
| corvus | of course, the next task doesn't work because we're running python3 and it should have been python3-passlib | 17:04 |
| corvus | but having python2 on our tests nodes means we didn't catch any of this | 17:04 |
| clarkb | python2 isn't exclusive to python3 though right? so ansible should keep running under python3? | 17:05 |
| corvus | yep | 17:05 |
| *** ginopc has quit IRC | 17:05 | |
| clarkb | corvus: note that docker-compose is another python utility that may pull in python2 | 17:05 |
| clarkb | depending on how it is packaged | 17:05 |
| corvus | that's why it fails | 17:05 |
| clarkb | oh passlib is used by htpasswd module, got it | 17:06 |
| *** wolverineav has quit IRC | 17:07 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Handle registry role running under py3 https://review.openstack.org/635888 | 17:07 |
| corvus | clarkb, mordred: ^ | 17:07 |
| clarkb | corvus: you can run ansible under python3 on the test side too I think then you only need the one? | 17:08 |
| corvus | oh, hrm, now that you say that... why isn't it running under py3 on tests | 17:09 |
| clarkb | docker-compose is a python2 package | 17:09 |
| clarkb | on bionic | 17:09 |
| openstackgerrit | Helen Walsh proposed openstack-infra/project-config master: Devstack for PowerMax/ VMAX https://review.openstack.org/635890 | 17:09 |
| corvus | clarkb: no i understand that | 17:09 |
| clarkb | ya sorry I was just confirming it | 17:09 |
| corvus | clarkb: i don't understand why the test job didn't catch that | 17:10 |
| corvus | i see the problem | 17:10 |
| *** walshh__ has joined #openstack-infra | 17:13 | |
| *** walshh_ has quit IRC | 17:13 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Handle registry role running under py3 https://review.openstack.org/635888 | 17:13 |
| corvus | clarkb, mordred: ^ that should fix it, and explains why testing didn't catch it -- we didn't run the job. | 17:13 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Report tenant and project specific resource usage stats https://review.openstack.org/616306 | 17:14 |
| corvus | however, since the host_vars file *still* had the wrong name, i'm not sure how it worked in production... does ansible read hostvar files with and without .yaml extensions? | 17:14 |
| pabelanger | I believe so | 17:15 |
| pabelanger | https://docs.ansible.com/ansible/latest/user_guide/intro_inventory.html#splitting-out-host-and-group-specific-data | 17:16 |
| pabelanger | extensions are optional | 17:16 |
| *** jamesmcarthur has quit IRC | 17:17 | |
| *** smarcet has quit IRC | 17:17 | |
| *** rpittau has quit IRC | 17:17 | |
| *** gcutrini has joined #openstack-infra | 17:17 | |
| mordred | corvus, pabelanger, ianw: does diskimage-builder obey openstack global requirements? I know it's an infra project, but it's also something used by openstack projects directly. the tox file has upper-constraints in it | 17:18 |
| *** gfidente has quit IRC | 17:18 | |
| corvus | pabelanger: thanks, that 'splains it :) | 17:18 |
| clarkb | mordred: I think it might because its used in devstack and everything in devstack wants to be global req'd | 17:19 |
| mordred | kk. I thought it was - but just thought I'd make sure | 17:19 |
| corvus | mordred: maybe it shouldn't be in opendevorg then. | 17:19 |
| corvus | maybe it should be an openstack-infra project, even after the opendev split. | 17:20 |
| mordred | also - anybody know if there is a specific reason why it installs python-lzma as a distro package instead of as a python package? | 17:20 |
| clarkb | no clue | 17:20 |
| mordred | k. I'm fixing it, but thought maybe there might be an explicit reason | 17:20 |
| pabelanger | would have to defer to ianw for tox.ini settings, maybe legacy from when it was under tripleo? | 17:21 |
| *** jcoufal has quit IRC | 17:21 | |
| clarkb | we are fully converted over to opendev-base/jobs now right? | 17:24 |
| clarkb | I'm going to push up dns changes and watn to make sure I make that change in the right spot | 17:24 |
| *** smarcet has joined #openstack-infra | 17:25 | |
| corvus | clarkb: everything in opendev/base-jobs is out of project-config/base-jobs; there shouldn't be ambiguity. however, there are some things in project-config/base-jobs which should still be moved over to opendev/base-jobs | 17:26 |
| *** ijw has quit IRC | 17:26 | |
| corvus | (anything using the secret "site_logs_project_config" should probably be moved) | 17:26 |
| openstackgerrit | Monty Taylor proposed openstack/diskimage-builder master: Install pyliblzma with pip instead of distro packages https://review.openstack.org/635892 | 17:27 |
| mordred | pabelanger, clarkb: ^^ let's see what that breaks | 17:27 |
| corvus | mordred: can you +3 https://review.openstack.org/635888 ? | 17:27 |
| mordred | corvus: done | 17:28 |
| zbr | mordred: not sure about this specific case but is usually easier to instal distro package than a python library that is not pure-python,.... as it would need compilation. | 17:28 |
| clarkb | corvus: in this case the configure-unbound role is in openstack-infra/project-config and opendev/base-jobs | 17:28 |
| mordred | zbr: we've got all that handled generally - the compilation needs are described in bindep.txt | 17:28 |
| clarkb | corvus: er that is ozj not project-config | 17:29 |
| mordred | zbr: it also gets complicated when using virtualenvs and/or installing into the python base docker images which don't install python from distro | 17:29 |
| corvus | that should probably be opendevifified | 17:29 |
| mordred | zbr: so - yeah - it is - but it's also complicated :) | 17:29 |
| clarkb | corvus: how do I know which role is used now? is it first listed in zuul's main.yaml? so to fix we can just delete the role from ozj? | 17:30 |
| clarkb | I can send a followup to do that if that is the case. | 17:30 |
| zbr | clarkb: to wk the DISK_FULL css fix: https://review.openstack.org/#/c/631488/1 if you cna. | 17:31 |
| mordred | AH | 17:32 |
| * mordred has learned things | 17:32 | |
| corvus | clarkb: first repo mentioned in the roles section of the job. the repo itself is first. so if it's in o/bj then that's the one it's using. | 17:32 |
| clarkb | corvus: cool I'll work to clean that up too | 17:33 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Stop using OpenDNS https://review.openstack.org/635895 | 17:34 |
| clarkb | infra-root ^ that should be safe since its just the nodepool image build base config. I'll sort out the job stuff next | 17:35 |
| openstackgerrit | Monty Taylor proposed openstack/diskimage-builder master: Remove python-lzma https://review.openstack.org/635896 | 17:35 |
| openstackgerrit | Merged openstack-infra/puppet-openstackid master: Update nodejs default version https://review.openstack.org/635666 | 17:36 |
| corvus | clarkb, mordred: i added fallback rewrites, so any unknown cgit url goes to gitea /. i also added the redirect for git itself. "git clone http://git-test.openstack.org/openstack-infra/gear" works (and does so by cloning from gitea). one thing i didn't quite anticipate is that while git follows the redirect, it doesn't register it as such. so the remote url is still git-test.o.o | 17:40 |
| corvus | i guess that's not a problem, but it is a missed opportunity. | 17:40 |
| *** Emine has joined #openstack-infra | 17:40 | |
| *** markvoelker has joined #openstack-infra | 17:40 | |
| *** smarcet has quit IRC | 17:42 | |
| clarkb | oh interesting, does that chagne if it is a permanent redirect (not sure if they are already) | 17:43 |
| *** creepy_owlet is now known as dtantsur|afk | 17:43 | |
| *** udesale has quit IRC | 17:44 | |
| *** bobh has joined #openstack-infra | 17:45 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Cleanup ozj confingure-unbound usage https://review.openstack.org/635900 | 17:45 |
| *** sdake has quit IRC | 17:47 | |
| corvus | clarkb: i just tested that, and no, same behavior | 17:47 |
| *** jpena is now known as jpena|off | 17:48 | |
| corvus | clarkb: can you move the swift test job to opendev/base-jobs? | 17:48 |
| corvus | i view it as being on stand-by and ready for emergency deployment if needed. | 17:49 |
| *** jpich has quit IRC | 17:49 | |
| openstackgerrit | Merged openstack-infra/project-config master: Devstack for PowerMax/ VMAX https://review.openstack.org/635890 | 17:49 |
| clarkb | corvus: I can | 17:50 |
| *** remi_ness has quit IRC | 17:50 | |
| *** ccamacho has quit IRC | 17:50 | |
| clarkb | I'll get ozj change up first then set a depends on for the move to opendev/base-jobs for base-swift-test | 17:50 |
| clarkb | will just take a few to get to that final state | 17:50 |
| openstackgerrit | Clark Boylan proposed openstack-infra/openstack-zuul-jobs master: Remove configure-unbound role https://review.openstack.org/635901 | 17:51 |
| corvus | k. we can move the job in any order, since we don't have to keep it running | 17:52 |
| clarkb | oh thats a good point. I have to move the secret too right? so maybe I'll do it as a follow on rather than a prefix since I have to sort out what needs encrpytion | 17:53 |
| *** derekh has quit IRC | 17:53 | |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/devstack-gate master: Replace cp -l with --reflink=auto https://review.openstack.org/628998 | 17:54 |
| corvus | fungi: can you +3 https://review.openstack.org/635481 and children? | 17:56 |
| fungi | gladly! | 17:57 |
| fungi | (well, once i read them over and agree with them obviously) | 17:57 |
| corvus | fungi: fine do it your way ;) | 17:57 |
| corvus | (to be clear, my request for +3 was to indicate that i believe they are ready for approval once sufficient +2s have accumulated) | 17:58 |
| corvus | (and one more +2 would do) | 17:58 |
| fungi | of course ;) | 18:00 |
| corvus | clarkb, tobiash: 635593 the kubectl change still failed after the connection reset; i will set an autohold and poke | 18:00 |
| clarkb | corvus: is playbooks/base-test/post-ssh.yaml expected to be missing? it was part of the base swift test but I don't see it in project-config to copy into base-jobs | 18:00 |
| clarkb | re kubectl ack | 18:00 |
| corvus | clarkb: it should already be in base-jobs | 18:01 |
| clarkb | corvus: there are other base-test playbooks in base-jobs but not that one | 18:01 |
| clarkb | and it wasn't on the project-config side either. Maybe it has been replaced? | 18:01 |
| clarkb | oh yes actually | 18:01 |
| clarkb | mordred did something related to that now I recall | 18:02 |
| clarkb | its just called base-test/post.yaml now | 18:02 |
| *** smarcet has joined #openstack-infra | 18:02 | |
| openstackgerrit | Merged openstack-infra/project-config master: Stop using OpenDNS https://review.openstack.org/635895 | 18:02 |
| corvus | clarkb: okay, it should be fine to just switch that to 'post' | 18:03 |
| corvus | there's no swift magic in there | 18:03 |
| openstackgerrit | John Dickinson proposed openstack-infra/project-config master: swift: gerritbot alert on all the branches https://review.openstack.org/635905 | 18:03 |
| clarkb | corvus: yup I did that | 18:03 |
| corvus | usually notmyname just shows up and says "hi" when we say swift, but now he's pushing up patches! | 18:03 |
| notmyname | :-) | 18:04 |
| *** trown is now known as trown|lunch | 18:04 | |
| clarkb | corvus: remote: https://review.openstack.org/635906 Move base test swift job into the base-jobs repo I still need to sort out the credentials secret but figured I'd get that up first | 18:04 |
| fungi | he said hi to me in #openstack-swift instead because he knows i like to feel special | 18:04 |
| clarkb | corvus: do you know where those credentials live in a form I can easily reencrypt them with the opendev/base-jobs key | 18:04 |
| *** jamesmcarthur has joined #openstack-infra | 18:05 | |
| openstackgerrit | Monty Taylor proposed openstack/diskimage-builder master: WIP Build Docker image of diskimage-builder https://review.openstack.org/635908 | 18:06 |
| corvus | clarkb: i believe it's just the standard vexxhost cloud creds | 18:07 |
| timburke | fungi: corvus: clarkb: you guys should *always* feel special | 18:07 |
| timburke | you're real treasures | 18:07 |
| openstackgerrit | Merged openstack-infra/system-config master: Handle registry role running under py3 https://review.openstack.org/635888 | 18:07 |
| mordred | pabelanger, mnaser: there's an initial stab at making a diskimage-builder image | 18:07 |
| corvus | timburke: is that you, mom? | 18:07 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Cleanup ozj confingure-unbound usage https://review.openstack.org/635900 | 18:08 |
| clarkb | corvus: thanks | 18:08 |
| pabelanger | mordred: ack | 18:08 |
| timburke | i just wanted to make sure you're eating enough, getting enough sleep... | 18:08 |
| fungi | my mom says i'm special too | 18:08 |
| fungi | and to always wear a muffler | 18:08 |
| *** ociuhandu_ has joined #openstack-infra | 18:08 | |
| mnaser | mordred: awesome. i'll try to see how that works locally | 18:09 |
| *** smarcet has quit IRC | 18:09 | |
| fungi | this is sad, but i've come to realize i measure the level of excitement in my day by the amount by which my browser tab count grows or shrinks | 18:10 |
| mnaser | lol | 18:10 |
| mordred | fungi: your tab count shrinks? | 18:10 |
| mordred | I didn't know that was an option | 18:10 |
| fungi | mordred: sometimes yes, but it looks like i accumulated far too many browser tabs yesterday | 18:11 |
| mnaser | mordred: failed for me locally.. "E: Unable to locate package zypper" .. im gonna look into why | 18:11 |
| corvus | "You are about to close 4 windows with 108 tabs. Are you sure you want to continue?" | 18:11 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: docker: don't daemonize when starting images https://review.openstack.org/635584 | 18:11 |
| mordred | mnaser: hrm. debian doesn't seem to have zypper | 18:11 |
| *** ociuhandu has quit IRC | 18:11 | |
| mnaser | i have way too often hit command+q (exit $world) instead of command+w (close a tab) | 18:11 |
| mordred | it's in jessie but not in stretch | 18:12 |
| fungi | no, it's not in stretch | 18:12 |
| mnaser | and how i feel about hitting command+q with everyting disappearing | 18:12 |
| mnaser | https://i.imgur.com/RMy2WZI.jpg | 18:12 |
| fungi | https://packages.debian.org/search?keywords=zypper | 18:12 |
| *** Emine has quit IRC | 18:12 | |
| fungi | for some reason it was removed from testing after jessie released but re-added since | 18:12 |
| pabelanger | yah, it was dropped from stretch I think, but added back IIRC | 18:12 |
| fungi | you could probably install the version from buster/testing | 18:12 |
| mordred | awesome. that's not going to make this awkward to deal with AT ALL | 18:12 |
| mordred | yeah | 18:13 |
| mnaser | mordred: zypper [!platform:redhat !platform:ubuntu-trusty !platform:ubuntu-bionic] | 18:13 |
| *** markvoelker has quit IRC | 18:13 | |
| fungi | which also seems to be the same as the version in sid/unstable | 18:13 |
| mnaser | so it seems to be excluded on all ubuntu platforms | 18:13 |
| *** ociuhandu_ has quit IRC | 18:13 | |
| mnaser | so maybe we should just exclude it from debian too? | 18:13 |
| mordred | it's not excluded on xenial | 18:13 |
| mordred | (I'm guessing for similar reasons) | 18:14 |
| mordred | mnaser: let me see how bad it is to install it from buster real quick | 18:14 |
| fungi | https://tracker.debian.org/news/836378/zypper-removed-from-testing/ | 18:14 |
| fungi | tracker.d.o is super useful (to me anyway) | 18:14 |
| *** hamzy has joined #openstack-infra | 18:14 | |
| mnaser | fyi http://git.openstack.org/cgit/openstack/diskimage-builder/commit/bindep.txt?id=96e801fcd4b5d8f83628a8b44b3e7a357d7f410d | 18:15 |
| fungi | wasn't zypper's first removal from testing either, there was one in 2015 as well | 18:15 |
| fungi | seems to have suffered a tenuous maintenance in debian in recent years | 18:16 |
| *** ekultails has quit IRC | 18:16 | |
| fungi | missing a number of library transition deadlines | 18:16 |
| mnaser | saface | 18:16 |
| *** Emine has joined #openstack-infra | 18:16 | |
| mnaser | sadface | 18:16 |
| mordred | mnaser: so - we should probably put debian:stretch into the list to be correct | 18:17 |
| mordred | mnaser: and then if we can install it from testing, we can just do that directly in the dockerfile | 18:17 |
| mnaser | mordred: right, wanna split this up or you're dealing with other fires and i can do that? | 18:18 |
| mordred | fungi: there isn't a debian backports that stretch might be in is there? | 18:18 |
| fungi | i would have hoped the buster version would have also been requested in stretch-backports, but seems nobody's done that (or done the work to make it possible) | 18:18 |
| mordred | fungi: you answer before I even ask :) | 18:18 |
| fungi | or just seconds after | 18:18 |
| *** jamesmcarthur has quit IRC | 18:19 | |
| fungi | but yes, same line of thought | 18:19 |
| *** jamesmcarthur has joined #openstack-infra | 18:19 | |
| *** jamesmcarthur has quit IRC | 18:19 | |
| fungi | if it were in a backports suite, p.d.o would have shown it in that query | 18:19 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Return artifacts as dicts and add metadata https://review.openstack.org/634825 | 18:19 |
| mordred | fungi: is there a less-bad way to install it from buster on a stretch system? | 18:20 |
| mnaser | fungi: would https://tracker.debian.org/news/836378/zypper-removed-from-testing/ be the best reference point to point to with it not being in debian stretch? | 18:20 |
| mnaser | im just gonna push up a small bindep change | 18:20 |
| mordred | mnaser: yeah. I think so | 18:20 |
| *** remi_ness has joined #openstack-infra | 18:20 | |
| clarkb | corvus: remote: https://review.openstack.org/635906 Move base test swift job into the base-jobs repo is ready now I think | 18:21 |
| fungi | testing always has a lower install priority than stable, so if you add it into the sources list you can trust it won't be installed from unless you append a /buster (or /testing) to the package name or pass -t buster (or -t testing) as an apt command-line option | 18:21 |
| mordred | fungi: ah - cool | 18:21 |
| *** hamzy has quit IRC | 18:22 | |
| mordred | fungi: darn. as expected - that wants to pull in libc (and a bunch of other things) from buster | 18:22 |
| fungi | mnaser: yeah, that removal news item references the various bug reports which caused its removal | 18:22 |
| mordred | fungi: so I think I'd need to apt-get source it and then do a rebuild | 18:22 |
| *** wolverineav has joined #openstack-infra | 18:22 | |
| fungi | mordred: yeah, quite possibly why nobody's ported it to stretch for the backports suite in that case | 18:22 |
| mordred | (basically, make a local backport) | 18:22 |
| clarkb | also as a sanity check I have been running local dns at home against cloudflare using unbound and both dns over tls and not dns over tls and it all seems to have worked fine for months | 18:22 |
| clarkb | so I expect those changes to also work fine | 18:23 |
| fungi | mordred: don't be surprised if it build-depends on newer libs from buster too | 18:23 |
| openstackgerrit | Mohammed Naser proposed openstack/diskimage-builder master: WIP Build Docker image of diskimage-builder https://review.openstack.org/635908 | 18:23 |
| openstackgerrit | Mohammed Naser proposed openstack/diskimage-builder master: bindep: exclude zypper from debian-stretch https://review.openstack.org/635910 | 18:23 |
| *** ociuhandu has joined #openstack-infra | 18:23 | |
| *** wolverineav has quit IRC | 18:23 | |
| mnaser | mordred: i added a patch below your wip one ^ | 18:23 |
| mordred | fungi: seems like I might wind up doing the majority of the work needed to propose and actual backport | 18:23 |
| mordred | mnaser: sweet | 18:23 |
| mnaser | doesn't get us any closer, but it atleast does the correct thing | 18:24 |
| *** wolverineav has joined #openstack-infra | 18:24 | |
| mnaser | (for now?) | 18:24 |
| mordred | well - it'll get us closer to having an image that builds | 18:24 |
| mnaser | the image builds for me locally now | 18:24 |
| mordred | that docker image will be deficient and unable to build opensuse images | 18:24 |
| mnaser | unfortuantely yes, that's the limitation | 18:24 |
| mordred | but that seems like a good incremental step forward | 18:24 |
| mnaser | *perhaps* until we get that resolved, maybe include a warning of some sorts, i guess. | 18:24 |
| mordred | and won't be any worse than the current situation with nodepool-builder image | 18:24 |
| mordred | yueah | 18:24 |
| *** hamzy has joined #openstack-infra | 18:25 | |
| mnaser | im going to try out your FROM dib magic | 18:25 |
| mnaser | and see how that works | 18:25 |
| fungi | mordred: if you do, might want to open (or follow up on if there already is one) a wishlist bug for adding to stretch-backports and attach your patch | 18:25 |
| mordred | mnaser: (obviously you'll need to either tag the dib image you built appropriately or change the FROM line) | 18:26 |
| mnaser | mordred: yeah i'm tagging it locally as openstack/diskimage-builder as in your 'wip' check and going to try that now | 18:26 |
| openstackgerrit | Merged openstack-infra/system-config master: Run base-repos as ubuntu on k8s nodes to bootstrap https://review.openstack.org/635481 | 18:27 |
| fungi | though to set expectations, deb packages for alternative package managers tend to be not super actively maintained in debian (not that i figure you might expect otherwise) | 18:27 |
| mnaser | i'm surprised they are installable at all :) | 18:27 |
| *** ociuhandu has quit IRC | 18:27 | |
| fungi | the debian package of rpm has been fairly well-maintained but it's by far the most popular one so not *that* surprising | 18:29 |
| corvus | i used to use alien a lot | 18:29 |
| *** ijw has joined #openstack-infra | 18:29 | |
| fungi | it was quite useful back when a lot of stuff was only packages for other distros | 18:30 |
| fungi | er, only packaged for | 18:30 |
| openstackgerrit | Merged openstack-infra/system-config master: Update k8s-on-openstack for ssh known_hosts https://review.openstack.org/635482 | 18:30 |
| mordred | fungi: is there a command I'm fogetting about to install the build-depends from a local debian/control file? | 18:30 |
| fungi | apt-get build-dep | 18:30 |
| mordred | that only works for the build-deps for the package in the repo though | 18:31 |
| *** wolverineav has quit IRC | 18:31 | |
| fungi | i think you can ./ reference a locally unpacked package | 18:31 |
| mordred | oh - nevermind though - still fine for my case | 18:31 |
| fungi | or maybe the control file | 18:31 |
| mordred | neat! I didn't know that | 18:31 |
| *** wolverineav has joined #openstack-infra | 18:32 | |
| fungi | i want to say i've done that in the past, but been a while so not 100% certain of the syntax | 18:32 |
| * fungi isn't technically even an official dd, but thought you were ;) | 18:33 | |
| *** wolverineav has quit IRC | 18:34 | |
| *** wolverineav has joined #openstack-infra | 18:34 | |
| *** whoami-rajat has quit IRC | 18:34 | |
| mordred | I was ALMOST a dd several times in the past | 18:34 |
| mordred | but I had a really bad habit of selecting a mentor who stopped working with new dds at the wrong time - or of hitting periods where debian decided to pause accepting new dds for a minute | 18:35 |
| mordred | so I eventually gave up | 18:35 |
| fungi | i've just not been able to bring myself to apply through nm once they increased the complexity of becoming one | 18:35 |
| mordred | yeah | 18:35 |
| fungi | so i get rra to sponsor my uploads. problem solved! ;) | 18:36 |
| mordred | I use SpamapS | 18:36 |
| fungi | your friendly local dd | 18:36 |
| clarkb | mordred: corvus can I interest you in a mostly simple puppet change to make puppet 4 less cranky https://review.openstack.org/#/c/635543/ | 18:37 |
| clarkb | if we get that in and confirm etherpad-dev is happy I think we can do some more widespread puppet upgrades | 18:37 |
| fungi | mordred: amusingly, the hardest requirement for most applicants, aiui, is to get their key signed by two current dds. i don't think either of us have any problem there | 18:37 |
| mnaser | mordred: ok so it works and doesn't work | 18:38 |
| *** Emine has quit IRC | 18:38 | |
| mnaser | it works as in i see 'rpm' and 'debootstrap' and other fun stuff from dib = yay | 18:38 |
| *** eharney has joined #openstack-infra | 18:38 | |
| mnaser | it doesn't work because sudo is still missing from bindep of dib :P | 18:38 |
| openstackgerrit | Mohammed Naser proposed openstack/diskimage-builder master: WIP Build Docker image of diskimage-builder https://review.openstack.org/635908 | 18:39 |
| openstackgerrit | Mohammed Naser proposed openstack/diskimage-builder master: bindep: add sudo https://review.openstack.org/635913 | 18:39 |
| *** smarcet has joined #openstack-infra | 18:40 | |
| * mnaser sighs | 18:46 | |
| mnaser | E: No such script: /usr/share/debootstrap/scripts/bionic | 18:46 |
| *** yamamoto has joined #openstack-infra | 18:48 | |
| *** ociuhandu has joined #openstack-infra | 18:49 | |
| clarkb | is https://review.openstack.org/#/c/635898/ a force merge change because we don't have jobs running against that repo yet? | 18:49 |
| *** electrofelix has quit IRC | 18:50 | |
| *** hamzy has quit IRC | 18:50 | |
| *** wolverineav has quit IRC | 18:50 | |
| mnaser | https://bugs.launchpad.net/ubuntu/+source/debootstrap/+bug/1727732 | 18:52 |
| openstack | Launchpad bug 1727732 in debootstrap (Ubuntu Artful) "Add Ubuntu bionic as a supported release" [Medium,Fix released] - Assigned to Andy Whitcroft (apw) | 18:52 |
| mnaser | looks like it was fixed in ubuntu but not debian? | 18:52 |
| *** yamamoto has quit IRC | 18:53 | |
| mnaser | hmm, looks like stretch-backports is not enabled on the image | 18:55 |
| mnaser | because if it pulls https://packages.debian.org/stretch-backports/debootstrap it will work fine | 18:55 |
| mnaser | is there any particular reason why it's not? | 18:55 |
| *** Emine has joined #openstack-infra | 18:55 | |
| *** ociuhandu has quit IRC | 18:55 | |
| fungi | likely just that we haven't needed anything from stretch-backports yet | 18:56 |
| mnaser | fungi: i'm not too great with the debian packaging policy but are we opposed to adding it into our build image? | 18:57 |
| * SpamapS is afraid to confirm he can, in fact, sponsor into Debian if needed. ;) | 18:58 | |
| *** ekcs has joined #openstack-infra | 18:58 | |
| *** hamzy has joined #openstack-infra | 18:58 | |
| SpamapS | I'm rather proud of recently getting shade updated | 18:58 |
| mnaser | as in, the two routes i have is either inject stretch-backports into the dib image only *or* to our base python-builder | 19:00 |
| *** bobh has quit IRC | 19:00 | |
| mnaser | the first one makes it a much more local change and the second one could potentially be more largely impacting | 19:00 |
| mnaser | or it looks like backports are disabled by default, so maybe this is something i'll just do in the nodepool dockerfile i guess | 19:01 |
| mordred | mnaser: I think we should install debootstrap from backports just in teh dockerfile | 19:01 |
| *** raissa has quit IRC | 19:01 | |
| mordred | mnaser: (btw - I'm hacking on the zypper thing) | 19:01 |
| *** raissa has joined #openstack-infra | 19:02 | |
| *** raissa has quit IRC | 19:02 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add opendev kubernetes nodes to ansible inventory https://review.openstack.org/635472 | 19:02 |
| *** raissa has joined #openstack-infra | 19:03 | |
| *** raissa has quit IRC | 19:03 | |
| mnaser | mordred: ok awesome, i'm gonna keep iterating on dib till i get something functional | 19:03 |
| mordred | mnaser: awesome. | 19:03 |
| *** raissa has joined #openstack-infra | 19:04 | |
| *** raissa has joined #openstack-infra | 19:04 | |
| mnaser | this debootstrap thing feels really hacky though | 19:05 |
| *** raissa has joined #openstack-infra | 19:05 | |
| *** raissa has quit IRC | 19:05 | |
| mordred | totally. but that's ok for now I think :) | 19:06 |
| *** raissa has joined #openstack-infra | 19:06 | |
| *** raissa has quit IRC | 19:06 | |
| fungi | yeah, while backports is basically a similar situation to what i described above when combining stable and testing (where you have to explicitly request the backports version if that's what you want), having it turned on for all jobs running on our images could in theory be considered a global behavior change for our ci system | 19:06 |
| fungi | on the other hand, we don't currently run many jobs on debian | 19:06 |
| *** Emine has quit IRC | 19:06 | |
| clarkb | fungi it would just be in the container image for the nodepool builder aiui | 19:07 |
| clarkb | not the test nodes | 19:07 |
| fungi | oh, okay that's different then | 19:07 |
| fungi | i misunderstood the context of "into the dib image" | 19:07 |
| mnaser | yeah, sorry i meant the docker dib image :) | 19:08 |
| JpMaxMan | mordred corvus we have a proof of concept up for the Netlify CMS Gerrit integration. If you want to have a look. Disclaimer it is lightly tested and very much a proof of concept, so there are likely some bugs to be worked out. But it would be good to discuss next steps if you feel this is useful. There are a few work arounds like right now updates are handled by a cron instead of a zuul hook. But I think it | 19:08 |
| JpMaxMan | gives us at least something to work with. You can view the front end site here: https://gerritpoc.starlingx.io/ and the admin here https://gerritpoc.starlingx.io/admin/#/ you login with your Gerrit HTTP credentials. Once you make a change you'll see it in Gerrit. Once you +2 the change it will be updated on the front end site. Have a look when you have a chance and we can discuss more. cc gcutrini | 19:08 |
| mordred | image image docker docker | 19:08 |
| *** markvoelker has joined #openstack-infra | 19:10 | |
| mordred | JpMaxMan: that's exciting! | 19:10 |
| *** hamzy has quit IRC | 19:10 | |
| *** hamzy has joined #openstack-infra | 19:11 | |
| mnaser | wee, that worked, lets see where it might break next heh | 19:11 |
| clarkb | JpMaxMan: +2 or merge to update frontend? | 19:11 |
| JpMaxMan | clarkb well when you +2 in gerrit it should merge | 19:12 |
| corvus | +2 and workflow+1 i'm assuming | 19:13 |
| JpMaxMan | right | 19:13 |
| *** raissa has joined #openstack-infra | 19:15 | |
| fungi | cool, so making a change through the netlify cms interface replicates your change into gerrit to wait for approval, in essence. sounds like a winner! | 19:15 |
| *** raissa has joined #openstack-infra | 19:15 | |
| *** wolverineav has joined #openstack-infra | 19:16 | |
| JpMaxMan | right it calls the Gerrit API to propose the change | 19:16 |
| fungi | idea being, people who want to propose changes to the web content do still need a gerrit account but don't need to grok git and other command-line tools? | 19:16 |
| openstackgerrit | Mohammed Naser proposed openstack/diskimage-builder master: WIP Build Docker image of diskimage-builder https://review.openstack.org/635908 | 19:16 |
| mordred | fungi: that's right | 19:17 |
| corvus | JpMaxMan: so if i wanted to build a static copy of the site, i would run "yarn site:build" ? | 19:17 |
| fungi | pretty darned amazing | 19:17 |
| mordred | fungi: right? | 19:17 |
| JpMaxMan | right so people can work where theyr'e comfortable. Marketers can just update a CMS. Others can git clone. | 19:17 |
| *** raissa has joined #openstack-infra | 19:18 | |
| *** ociuhandu has joined #openstack-infra | 19:18 | |
| *** raissa has quit IRC | 19:18 | |
| * fungi takes exception to painting marketers with a broad brush, some do in fact know how to use git ;) | 19:18 | |
| JpMaxMan | corvus: if you want to build a local copy? | 19:18 |
| corvus | JpMaxMan: yes, or, to have zuul build a test copy to validate a change | 19:19 |
| gcutrini | corvus: supposedly netlify runs “yarn site:build”, but that didnt work out locally | 19:19 |
| gcutrini | we use “vuepress build site” | 19:20 |
| corvus | hrm. "yarn install; yarn site:build" worked | 19:21 |
| corvus | for me locally | 19:21 |
| corvus | at least, it claimed to succeed | 19:21 |
| gcutrini | cool ;) | 19:21 |
| corvus | gcutrini, JpMaxMan: i'll start working on a zuul job to build the site so we can try that out | 19:22 |
| mnaser | mordred: i think our efforts might not be so successful | 19:22 |
| mnaser | mordred: i just had a nodepool build fail or some reason, didn't unmount cleanly, not its just "/usr/local/lib/python3.7/site-packages/diskimage_builder/lib/disk-image-create: line 210: /dev/fd/62: No such file or directory" within a privileged container | 19:23 |
| mnaser | so im wondering if how dib works doesnt work in docker :( | 19:23 |
| mordred | mnaser: I think it's possible you might need to run it specially? I know tobiash runs dib in docker on openshift in nodepool | 19:24 |
| * mnaser is watching more closely how it fails the first time | 19:24 | |
| mnaser | mordred: it's a privileged container so i guess thats as much perms as it gets, but i'll see if he has anything toa dd, ill try to retrieve the exact error | 19:25 |
| JpMaxMan | covus: cool - so there were two things we had talked about, one was having zuul do a build to preview the change. The other is instead of a cron on the server having zuul call a web hook or something that triggered a build upon merge. | 19:25 |
| mordred | mnaser: might need to bind-mount some things in - or run it with --privileged or something | 19:25 |
| mordred | mnaser: cool | 19:25 |
| mnaser | yeah its privileged right now but maybe bind mount is the trick | 19:25 |
| JpMaxMan | The later we ran into some debate because we weren't sure if the intention was to self host using the netlify CMS or to host on the Netlify platform itself | 19:25 |
| *** mriedem has quit IRC | 19:27 | |
| corvus | JpMaxMan: there's a third option there, which is to publish to a static location, and only use netlify for the cms portion. all of those should be possible. | 19:27 |
| mnaser | findmnt: can't read /proc/mounts: No such file or directory | 19:27 |
| *** mriedem has joined #openstack-infra | 19:27 | |
| *** wolverineav has quit IRC | 19:28 | |
| corvus | JpMaxMan: i think my order of preference would be 1) self-host static publication; 2) self-host netlify; 3) netlify platform. mostly because that's in order of increasing complexity for the production site (i love it when we can just host static content) | 19:28 |
| mordred | I think 1 and 2 are the same thing | 19:28 |
| corvus | oh i may have misunderstood then, sorry | 19:28 |
| mordred | and I do not think 3 is a thing we want to do | 19:29 |
| JpMaxMan | corvus: right. I mean either way the netlify cms eventually triggers a static site with vuepress regardless of where that ends up :) | 19:29 |
| *** sdake has joined #openstack-infra | 19:29 | |
| JpMaxMan | it could be pushed out to servers around the world and globally load balanced though :) | 19:29 |
| *** wolverineav has joined #openstack-infra | 19:29 | |
| corvus | ++ | 19:29 |
| mordred | yah | 19:29 |
| corvus | cool, so i think the next step, regardless, is to have zuul do a test build. then, if static publication is what we want, we basically take that job and tell it to put its results somewhere else. | 19:30 |
| *** trown|lunch is now known as trown | 19:30 | |
| JpMaxMan | I'm not familiar enough with the Netlify platform and how it handles the continuous delivery though. My assumption is it just monitors any GIT repo for you and when updated publishes in a similar fashion. | 19:30 |
| mordred | yeah. that's what it does | 19:30 |
| tobiash | mnaser: you also should have the tmp dir dib is using on the same bind mount as the image it is generating | 19:31 |
| mordred | which is why I think we're more likely to just want to publish to a static location ourselves | 19:31 |
| JpMaxMan | corvus: sounds good :) | 19:31 |
| mordred | since we already have a nice build system :) | 19:31 |
| corvus | JpMaxMan, gcutrini: i should have something for you to look at later today | 19:31 |
| mordred | but yes - I agree with corvus as next step | 19:31 |
| mnaser | tobiash: ok so you have bind mounts in that case for certain folders to make it work? | 19:31 |
| clarkb | is the gerrit driver something we expect to be able to upstream too? | 19:32 |
| JpMaxMan | corvus: awesome, I'm headed to lunch, but if you need anything just hollar :) | 19:32 |
| mordred | clarkb: yah, I believe so | 19:32 |
| tobiash | mnaser: I'm bind mounting a volume to /mnt and have dib using /mnt/tmp for scratch space and /mnt/gen for the generated images | 19:32 |
| corvus | we talked with the netlify folks and they seemed very excited by the prospect | 19:32 |
| mordred | clarkb: the netlify cms team were excited about the concept of growing a gerrit driver | 19:32 |
| mordred | when we chatted in vancouver | 19:32 |
| JpMaxMan | clarkb: that reminds me, a few things, we're currently using a proxy to get around the CORS issue that supposedly is solved in the latest version of Gerrit | 19:32 |
| mordred | JpMaxMan: cool. cause we want to upgrade to recent gerrit in the not-too-distant future anyway | 19:33 |
| mnaser | tobiash: ill try that out and see what happens | 19:33 |
| JpMaxMan | we're also scraping gitweb to get a listing of the files / dirs in GIT. Extending Gerrit with an API call for that would be awesome. | 19:33 |
| clarkb | well we also proxy with apache already and can probably modify headers | 19:33 |
| mordred | JpMaxMan: ++ | 19:33 |
| clarkb | JpMaxMan: why not use git itself for that? | 19:33 |
| JpMaxMan | clarkb: it's the only thing that isn't supported by the API and extending JS with a git client seemed bloated | 19:34 |
| clarkb | I am fairly sure thus is why it isnt in the api already | 19:34 |
| *** wolverineav has quit IRC | 19:34 | |
| JpMaxMan | and it was easier to use a low level http html structured api ;) | 19:35 |
| clarkb | are the current cors rules preventing any requests from other domains? | 19:35 |
| mnaser | tobiash: so using DIB_NO_TMPFS or nope? | 19:35 |
| *** wolverineav has joined #openstack-infra | 19:35 | |
| JpMaxMan | but again it's proof of concept so we could adapt | 19:35 |
| gcutrini | clarkb: yes | 19:35 |
| tobiash | mnaser: let me dig up my vars | 19:36 |
| *** wolverineav has quit IRC | 19:36 | |
| *** wolverineav has joined #openstack-infra | 19:36 | |
| mnaser | tobiash: thank you! | 19:36 |
| * mordred hands JpMaxMan a case of beers | 19:37 | |
| tobiash | mnaser: I'm setting DIB_NO_TMPFS=1 and TMP_DIR=/mnt/tmp | 19:37 |
| *** hamzy has quit IRC | 19:37 | |
| AJaeger | clarkb, your opendev changes are still not tested by Zuul, see https://review.openstack.org/#/c/635898/ - for 2 hours now. Is the repo not setup with jobs? | 19:37 |
| *** hamzy has joined #openstack-infra | 19:38 | |
| clarkb | JpMaxMan: gcutrini I mostly don't want us to assume that upgrading to gerrit 2.15 or changing gerrits API is practical in the short term. Modifying their api may never even happen given our history with the project | 19:39 |
| clarkb | we definitely do want to upgrade to 2.15 and we believe they have improved that process to make it easier for us but we still have to test it and prepare for the wave of unhappy people after the UI updates etc | 19:40 |
| clarkb | AJaeger: ya I don't think it is | 19:40 |
| anteaya | fungi: I got your email reply to smcginnis' email in my inbox but for some reason didn't get the original | 19:40 |
| anteaya | I mention as email to the list has been a topic of discussion | 19:40 |
| anteaya | not sure if it is related to the other issue or not | 19:41 |
| fungi | anteaya: that's interesting. i doubt it's dkim signature related as the dkim signature on his message looked valid to me | 19:41 |
| clarkb | corvus: do we need an opendev tenant so that we can set up jobs for opendev in that context? or is there some more practical approach there? | 19:41 |
| anteaya | fungi: yeah, no idea, just thought I'd mention it | 19:41 |
| anteaya | message isn't in trash or spam either | 19:41 |
| fungi | anteaya: i appreciate the info. i've had surprisingly few people come to me about missing specific messages, mostly just about getting unsubscribed for bounces | 19:42 |
| anteaya | yup, saw some of those | 19:42 |
| fungi | so it's definitely good to keep in mind. thanks! | 19:42 |
| anteaya | welcome | 19:42 |
| gcutrini | crarkb: that’s why we went ahead and setup the proxy. But seems like a setback for commiting the netlify cms driver upstream. | 19:43 |
| corvus | clarkb: we can gate it in openstack tenant for now | 19:43 |
| *** markvoelker has quit IRC | 19:44 | |
| clarkb | corvus: ok | 19:44 |
| corvus | gotta run to lunch; biab | 19:44 |
| clarkb | AJaeger: I'm trying to figure out why one of my chagnes had post failures if you want to maybe add the jobs to the openstack tenant? | 19:45 |
| clarkb | AJaeger: though its also your weekend now so no worries if you'd rather do that instead | 19:45 |
| *** ekcs has quit IRC | 19:47 | |
| fungi | https://github.com/glowing-bear/glowing-bear looks possibly useful for people who want a graphical irc client which does image and video embedding but still retains the flexibility of weechat | 19:48 |
| fungi | graphical browser-based irc client i should say | 19:48 |
| AJaeger | clarkb: indeed, sorry - I'm signing off now... | 19:48 |
| fungi | AJaeger: have a great weekend, and thanks for everything!!! | 19:49 |
| * AJaeger wishes everybody a great weekend | 19:49 | |
| AJaeger | thanks, fungi | 19:49 |
| *** mgoddard has quit IRC | 19:50 | |
| *** mgoddard has joined #openstack-infra | 19:51 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: docker: don't daemonize when starting images https://review.openstack.org/635584 | 19:53 |
| fungi | anteaya: SMTP error from remote mail server after end of data: host aspmx.l.google.com [108.177.9.27]: 550-5.7.1 This message does not have authentication information or fails to pass\n550-5.7.1 authentication checks. To best protect our users from spam, the\n550-5.7.1 message has been blocked. Please visit\n550-5.7.1 https://support.google.com/mail/answer/81126#authentication for more\n550 5.7.1 | 19:53 |
| fungi | information. q6si1253611oig.187 - gsmtp | 19:53 |
| *** ijw has quit IRC | 19:54 | |
| fungi | so for some reason gmail blocked that (i think, still trying to match the queue reference up to the specific post) | 19:55 |
| *** bobh has joined #openstack-infra | 19:58 | |
| *** wolverineav has quit IRC | 19:58 | |
| *** sdake has quit IRC | 19:59 | |
| fungi | yeah, the particular queue item was 1gs6iA-0006MV-9o at 2019-02-08 14:04:33 and generated that rejection | 19:59 |
| *** wolverineav has joined #openstack-infra | 19:59 | |
| *** sdake has joined #openstack-infra | 20:00 | |
| *** eharney has quit IRC | 20:03 | |
| *** wolverineav has quit IRC | 20:04 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Cleanup ozj confingure-unbound usage https://review.openstack.org/635900 | 20:04 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Fix use of old site_logs secerts https://review.openstack.org/635925 | 20:04 |
| anteaya | ooooh | 20:04 |
| anteaya | glad you found the error | 20:04 |
| clarkb | corvus: fungi mordred ^ the jobs on the ozj change were failing because of the broken secrets in playbooks fixed by 635925. Or at least I assume that will fix it. If you can review that it would be great so changes to ozj can merge | 20:05 |
| clarkb | now to add jobs for opendev/base-jobs. Maybe just noop to start? | 20:06 |
| fungi | anteaya: that suggests to me that github has decided one of the signatures (maybe not the normal dkim signature?) of the message was invalid. it looked fine to me though | 20:06 |
| anteaya | github? | 20:07 |
| anteaya | how id github involved? | 20:07 |
| anteaya | s/id/is | 20:07 |
| fungi | sorry, gmail | 20:07 |
| fungi | too many g-things | 20:08 |
| fungi | it's a message which originated in gmail and made a round-trip through our listserv back to gmail only to be rejected | 20:08 |
| anteaya | far too many | 20:08 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Add noop jobs to opendev/base-jobs https://review.openstack.org/635926 | 20:08 |
| anteaya | rather random of gmail to reject it then | 20:08 |
| *** ijw has joined #openstack-infra | 20:08 | |
| clarkb | fwiw weird gmail behavior like that is what basically forced me to switch mail services for work | 20:09 |
| *** sdake has quit IRC | 20:09 | |
| fungi | so i'm starting to wonder whether gmail disregards some part of the dkim validation rules for messages which claim to originate there (perhaps treating relaxed as simple) | 20:09 |
| anteaya | clarkb: ack | 20:09 |
| clarkb | it was dropping lots of mailing list mail on the floor many years ago and I caved and went to fastmail | 20:09 |
| fungi | in which case other recipients may still treat gmail dkim signatures forwarded through mailman as valid while gmail itself does not | 20:10 |
| fungi | if so, that's exceedingly unfortunate | 20:10 |
| clarkb | heh why even have a rough standard if we don't follow it | 20:11 |
| clarkb | dkim gets better | 20:11 |
| *** sdake has joined #openstack-infra | 20:12 | |
| fungi | the only way dkim would get better is if we set it on fire and roasted marshmallows over it | 20:12 |
| *** sdake has quit IRC | 20:13 | |
| * anteaya gets a stick | 20:13 | |
| fungi | that said, i moved my office to the deck this afternoon because it's 75f and sunny out. now watching bream jumping in the sound catching flies... hard for me to *really* care that much about gmail's silly choices | 20:13 |
| anteaya | oooh nice | 20:14 |
| clarkb | fungi: we are all preparing for the end of the world here | 20:14 |
| clarkb | we've been told its gonna snow | 20:14 |
| clarkb | and then not stop snowing for like a week | 20:14 |
| anteaya | oh my | 20:14 |
| clarkb | we don't know what to do in this part of the world with news like that | 20:14 |
| *** bhavikdbavishi has quit IRC | 20:14 | |
| *** sdake has joined #openstack-infra | 20:14 | |
| anteaya | water and candles and batteries | 20:14 |
| anteaya | and wool socks | 20:15 |
| clarkb | I'm not super worried about it | 20:15 |
| anteaya | that's good | 20:15 |
| anteaya | you seemed to take the ireland snow shutdown in stride | 20:15 |
| clarkb | worst case I walk to the grocery store whcih has an attached liquor store | 20:15 |
| fungi | it's supposed to drop into the 30s f here tonight, so enjoying this sort of "winter" while i can | 20:15 |
| fungi | though i'm sure 30s f sounds like a warm summer day to canadians | 20:16 |
| anteaya | indeed | 20:16 |
| anteaya | bring on the 30s F | 20:16 |
| anteaya | white out around my house about an hour ago | 20:17 |
| anteaya | couldn't see my car in the yard 40 feet away from my door | 20:17 |
| clarkb | the big issue is going to be that we'll be going above and below freezing liek a seesaw | 20:17 |
| anteaya | glad I didn't have to drive my house anywhere | 20:17 |
| clarkb | with rain at times too | 20:17 |
| anteaya | that is the worst road conditions | 20:17 |
| clarkb | so by next friday I expect everything to be encased in ice and I won't really be going anywhere for a week | 20:17 |
| anteaya | above and below zero | 20:18 |
| anteaya | or freezing in F | 20:18 |
| anteaya | candles batteries and warm socks | 20:18 |
| *** ociuhandu has quit IRC | 20:20 | |
| *** hamzy has quit IRC | 20:21 | |
| *** trident has quit IRC | 20:21 | |
| *** trident has joined #openstack-infra | 20:22 | |
| fungi | fond childhood memories of having to wear three pairs of socks to bed | 20:23 |
| fungi | being unable to drive to town for a week or two at a stretch can be a bit liberating though | 20:25 |
| fungi | ironically | 20:25 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Fix use of old site_logs secerts https://review.openstack.org/635925 | 20:27 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Cleanup ozj confingure-unbound usage https://review.openstack.org/635900 | 20:27 |
| clarkb | this is a fun set of things to untangle. I think ^ is getting close though | 20:27 |
| fungi | is that supposed to fix the linters failure? | 20:28 |
| *** e0ne has joined #openstack-infra | 20:29 | |
| clarkb | ya, I ended up rebasing that change at the bottom and in doing so failed to update some additional playbooks that still existed in that land before time | 20:30 |
| clarkb | I had written the change near the end of time where playbooks had been deleted and failed to rebase the first time around. I've not updated things such that the before time situation should work | 20:30 |
| clarkb | s/not/now/ | 20:30 |
| clarkb | so even if the rest of my stack takes a while to get in we should be able to merge changes | 20:31 |
| *** ijw has quit IRC | 20:32 | |
| *** trident has quit IRC | 20:34 | |
| *** trident has joined #openstack-infra | 20:35 | |
| *** ijw has joined #openstack-infra | 20:36 | |
| *** markvoelker has joined #openstack-infra | 20:40 | |
| clarkb | ya https://review.openstack.org/#/c/635925/ passes now | 20:43 |
| clarkb | so I think I'ev now got all the changes up to roll through both dns updates and cleanup of project-config base jobs | 20:43 |
| *** sdake has quit IRC | 20:44 | |
| *** sdake has joined #openstack-infra | 20:46 | |
| anteaya | fungi: agreed, when the whole neighbourhood shuts down everything just gets so quiet | 20:47 |
| anteaya | it is rather beautiful | 20:47 |
| *** whoami-rajat has joined #openstack-infra | 20:48 | |
| *** dave-mccowan has joined #openstack-infra | 20:54 | |
| *** hamzy has joined #openstack-infra | 20:59 | |
| *** e0ne has quit IRC | 21:06 | |
| *** e0ne has joined #openstack-infra | 21:11 | |
| *** markvoelker has quit IRC | 21:12 | |
| *** dave-mccowan has quit IRC | 21:18 | |
| *** ociuhandu has joined #openstack-infra | 21:19 | |
| *** e0ne has quit IRC | 21:24 | |
| *** ociuhandu has quit IRC | 21:24 | |
| *** rlandy has quit IRC | 21:33 | |
| openstackgerrit | Tobias Urdin proposed openstack-infra/zuul-jobs master: Rework upload-puppetforge role to use module https://review.openstack.org/635941 | 21:34 |
| corvus | mordred, clarkb, tobiash, fungi: i'm *really* confused by this: http://paste.openstack.org/show/744766/ | 21:39 |
| corvus | kubectl is installed, it's in the path, but when i try to run it with ansible, the shell can't find it. | 21:39 |
| corvus | that's an ansible command which shows the path (/snap/bin is included), runs 'which kubectl' (it fails), does an ls on /snap/bin (kubectl is there). | 21:40 |
| fungi | corvus: missing executable perms? | 21:40 |
| corvus | it's runnable | 21:41 |
| fungi | or (less likely) /snap is mounted noexec? | 21:41 |
| fungi | hrm, probably not the case then | 21:41 |
| corvus | in fact, this works: ansible -i /etc/ansible/hosts/inventory.yaml bridge.openstack.org -m shell -a "/snap/bin/kubectl" | 21:41 |
| fungi | far out | 21:41 |
| corvus | so it's runnable by the shell in ansible if it's given the full path | 21:41 |
| fungi | is kubectl an elf executable? interpreted script with a shebang? | 21:42 |
| clarkb | elf iirc | 21:42 |
| corvus | yes, the first 4 bytes are ?ELF | 21:43 |
| corvus | (oy this host is missing some tools. i used dd) | 21:44 |
| corvus | 104.130.239.108 if any infra-root wants to poke | 21:44 |
| corvus | it's had the base playbook run on it, so it has our keys | 21:45 |
| corvus | oh wait, did i interpret path too early in that test? | 21:46 |
| corvus | (ie, is that *my* path, not the ansible-shell path) | 21:47 |
| corvus | yes! | 21:47 |
| corvus | ansible -i /etc/ansible/hosts/inventory.yaml bridge.openstack.org -m shell -a 'echo $PATH' | 21:47 |
| corvus | produces /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games | 21:47 |
| clarkb | no snap, is profile.d not loaded for root? | 21:48 |
| corvus | it's looking like ansible isn't starting that as a login shell? | 21:52 |
| corvus | this fails: ansible -i /etc/ansible/hosts/inventory.yaml bridge.openstack.org -m shell -a "bash -c 'echo \$PATH'" | 21:53 |
| corvus | this works: ansible -i /etc/ansible/hosts/inventory.yaml bridge.openstack.org -m shell -a "bash -l -c 'echo \$PATH'" | 21:53 |
| clarkb | oh interesting, ya that must be the case then | 21:53 |
| ianw | clarkb: thanks for fixing the dns ... unbound maintainers seem to always be very helpful | 21:53 |
| corvus | clarkb, fungi: maybe we should go ahead and add a symlink to /usr/local/bin ? | 21:57 |
| clarkb | corvus: that wfm | 21:57 |
| clarkb | I wonder if the ansible shell module has a flag for this though | 21:58 |
| *** sdake has quit IRC | 21:58 | |
| clarkb | seems like no | 21:58 |
| corvus | not that i could find before i got tired of trying to convey the different nuances of shell and login to google in my search queries. | 21:58 |
| fungi | corvus: symlink seems like a safe solution, and easier than trying to manipulate the ansible environment | 22:00 |
| openstackgerrit | Monty Taylor proposed openstack/diskimage-builder master: WIP Build Docker image of diskimage-builder https://review.openstack.org/635908 | 22:01 |
| corvus | yeah, i'd like the follow-on tasks not to care how or where it was installed | 22:01 |
| mordred | corvus: ++ symlink | 22:01 |
| mordred | mnaser: ^^ enjoy that madness | 22:01 |
| *** bobh has quit IRC | 22:02 | |
| openstackgerrit | Tobias Urdin proposed openstack-infra/project-config master: Rework to use new upload-puppetforge module https://review.openstack.org/635965 | 22:03 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Install kubectl on bridge https://review.openstack.org/635593 | 22:04 |
| tobias-urdin | fungi: ^ think i got it on that one | 22:04 |
| tobias-urdin | much cleaner there as well, dont have to rely on file naming, can even wait for them to be placed in artifacts folder after they are signed | 22:04 |
| mnaser | mordred: where does backportzypper.sh come from? | 22:05 |
| *** trown is now known as trown|outtypewww | 22:05 | |
| openstackgerrit | Monty Taylor proposed openstack/diskimage-builder master: WIP Build Docker image of diskimage-builder https://review.openstack.org/635908 | 22:06 |
| mordred | mnaser: from me actually running git add | 22:06 |
| *** ekcs has joined #openstack-infra | 22:07 | |
| mnaser | mordred: that looks a bit more mad now :) | 22:08 |
| *** remi_ness has quit IRC | 22:09 | |
| *** markvoelker has joined #openstack-infra | 22:10 | |
| mordred | mnaser: I'm iterating on it right now though - just found a bug in it (I did all of the steps in it by hand - so it's mostly right) | 22:10 |
| openstackgerrit | Tobias Urdin proposed openstack-infra/zuul-jobs master: Rework upload-puppetforge role to use module https://review.openstack.org/635941 | 22:11 |
| *** rkukura_ has joined #openstack-infra | 22:12 | |
| *** rkukura has quit IRC | 22:14 | |
| *** rkukura_ is now known as rkukura | 22:14 | |
| corvus | mordred: on my machine, yarn ran "vuepress build site", but under zuul it ran "vuepress build site --verbose". see http://logs.openstack.org/24/635924/3/check/netlify-sandbox-build-site/216c0de/job-output.txt.gz#_2019-02-08_22_11_13_145227 | 22:18 |
| corvus | mordred: any idea why? | 22:18 |
| corvus | mordred: i have yarn v1.12.3 installed which is older than what zuul got | 22:19 |
| *** wolverineav has joined #openstack-infra | 22:19 | |
| *** diablo_rojo has quit IRC | 22:20 | |
| corvus | mordred: oh. i see. | 22:22 |
| mordred | corvus: yay, I fix things! | 22:22 |
| *** wolverineav has quit IRC | 22:23 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Remove "--verbose" from yarn commands https://review.openstack.org/635973 | 22:23 |
| corvus | mordred: ^ i hope so! :) | 22:23 |
| *** wolverineav has joined #openstack-infra | 22:23 | |
| mordred | corvus: you're saying that zuul ran --verbose because it was in the role? MADNESS | 22:24 |
| corvus | https://review.openstack.org/635924 updated with depends-on | 22:24 |
| corvus | mordred: yes, the role you wrote. :) | 22:24 |
| *** remi_ness has joined #openstack-infra | 22:26 | |
| *** wolverineav has quit IRC | 22:28 | |
| *** hwoarang has quit IRC | 22:31 | |
| corvus | good news and bad news! http://logs.openstack.org/24/635924/4/check/netlify-sandbox-build-site/a552f5d/npm/html/ | 22:32 |
| *** wolverineav has joined #openstack-infra | 22:32 | |
| *** hwoarang has joined #openstack-infra | 22:32 | |
| corvus | that's what was produced when i ran it locally too | 22:32 |
| corvus | mordred: do you know off the top of your head why the fetch-javascript stuff ends up in npm/html? | 22:33 |
| clarkb | X marks the spot | 22:33 |
| corvus | it looks like all the errors are due to absolute urls | 22:34 |
| *** remi_ness has quit IRC | 22:35 | |
| clarkb | config-core and infra-root for the dns cleanup and base jobs work I was doing earlier starting at https://review.openstack.org/635926 and https://review.openstack.org/#/c/635925/ gets jobs working so we can merge stuff. Then https://review.openstack.org/#/c/635900/ will be ready and I can recheck everything else | 22:36 |
| corvus | clarkb: lgtm | 22:38 |
| mordred | corvus: I believe over in netlify world they solve the absolute path thing by creating a per-build hostname so that their draft build publication is all rooted | 22:40 |
| mordred | corvus: I do not know off the top of my head - it might just be hysterical raisins | 22:41 |
| corvus | mordred: this would be a function of vuepress i think? so if vuepress supports generating a site with relative assets... | 22:41 |
| *** markvoelker has quit IRC | 22:42 | |
| fungi | anteaya: out of curiosity did you receive http://lists.openstack.org/pipermail/openstack-discuss/2019-February/002535.html just now? | 22:43 |
| fungi | i see that the address he's using actually isn't a gmail one and i had misremembered. there is no dkim signature in the headers, so i'm checking to see whether google's complaint is that there should be according to dns | 22:44 |
| openstackgerrit | Merged openstack-infra/project-config master: Add noop jobs to opendev/base-jobs https://review.openstack.org/635926 | 22:44 |
| gcutrini | corvus: looking into it | 22:44 |
| corvus | gcutrini, JpMaxMan: https://review.openstack.org/635924 is my work-in-progress change for the zuul job | 22:45 |
| openstackgerrit | Merged openstack-infra/project-config master: Fix use of old site_logs secerts https://review.openstack.org/635925 | 22:46 |
| corvus | gcutrini, JpMaxMan: if you click on the job name link ("netlify-sandbox-build-site") it will take you to the built preview on our log server | 22:46 |
| *** panda has quit IRC | 22:46 | |
| corvus | gcutrini, JpMaxMan: also, fun zuul thing -- you'll notice that there's a "depends-on" in the commit message -- we needed a small fix to our javascript build roles -- that tells zuul to include that in this build. | 22:47 |
| corvus | (it hasn't actually merged yet, but we can still use it this way) | 22:47 |
| JpMaxMan | corvus: looks cool!! | 22:49 |
| *** diablo_rojo has joined #openstack-infra | 22:49 | |
| *** panda has joined #openstack-infra | 22:49 | |
| *** bobh has joined #openstack-infra | 22:50 | |
| clarkb | config-core infra-root and now https://review.openstack.org/#/c/635898/ and https://review.openstack.org/#/c/635906/ should be ready. First one configures DNS on our jobs the other rehomes the base swift test job | 22:51 |
| mordred | JpMaxMan: if we don't watch out, we're going to, you know, get this bad boy done :) | 22:51 |
| mordred | JpMaxMan, gcutrini where's the unminified version of the netlify-cms stuff? is it anywhere convenient to look at yet? | 22:52 |
| fungi | yeah, if we distribute minified/transmogrified javascript anywhere we need to be mindful to distribute the original source versions alongside it | 22:53 |
| *** kjackal has quit IRC | 22:53 | |
| gcutrini | mordred: http://logs.openstack.org/24/635924/4/check/netlify-sandbox-build-site/a552f5d/npm/html/admin/#/ | 22:54 |
| gcutrini | inspect the web | 22:54 |
| gcutrini | the netlify-cms.js.map is alongside the netlify-cms.js | 22:54 |
| gcutrini | will allow the look at the source | 22:55 |
| mordred | gcutrini: oh - totally - I more wanted to poke at the build system | 22:55 |
| mordred | gcutrini: but it's not urgent this second or anything | 22:55 |
| openstackgerrit | Tobias Urdin proposed openstack-infra/zuul-jobs master: Rework upload-puppetforge role to use module https://review.openstack.org/635941 | 22:56 |
| gcutrini | mordred: we ll put it up on a public repo asap | 22:56 |
| gcutrini | corvus: all path start with /assets/.. , should start with assets/.. | 22:57 |
| mordred | gcutrini: cool - let me know when it is, I just get excited about things :) | 22:58 |
| gcutrini | will doo | 22:59 |
| *** ekcs has quit IRC | 23:01 | |
| *** wolverineav has quit IRC | 23:02 | |
| *** wolverineav has joined #openstack-infra | 23:02 | |
| corvus | gcutrini, mordred: if i set the 'base' value, then i get a completely working site preview: https://vuepress.vuejs.org/guide/assets.html#base-url | 23:03 |
| corvus | unfortunately, we're moving to a log storage system where we won't be able to predict the final location where the logs will be stored until they are there... | 23:03 |
| clarkb | so netlify is cms software that uses vuejs to generate the static site? | 23:04 |
| corvus | so i'm not sure that setting it to something like "/24/635924/5/check/netlify-sandbox-build-site/926bb0a/npm/html/" will work in the long run | 23:04 |
| corvus | clarkb: i believe it supports multiple static site generators; vuepress is the ssg being used in this poc | 23:05 |
| clarkb | gotcha | 23:05 |
| corvus | https://github.com/vuejs/vuepress/issues/796 looks relevant | 23:06 |
| corvus | maybe we should just stick a post-run task in there to mutate the urls | 23:07 |
| *** ijw has quit IRC | 23:07 | |
| *** ijw_ has joined #openstack-infra | 23:07 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Remove "--verbose" from yarn commands https://review.openstack.org/635973 | 23:08 |
| *** whoami-rajat has quit IRC | 23:08 | |
| clarkb | as a heads up I have to go afk in about 20 minutes to visit the tax preparer | 23:08 |
| gcutrini | corvus: lol was trying setting base to `""` | 23:09 |
| *** wolverineav has quit IRC | 23:09 | |
| mordred | clarkb: yah. what corvus said. netlify-cms is the web interface for making and proposing changes cms-style | 23:10 |
| *** sdake has joined #openstack-infra | 23:10 | |
| mordred | netlify itself is a service for publish website content - netlify-cms is just an in-browser cms thing they developed | 23:10 |
| *** wolverineav has joined #openstack-infra | 23:11 | |
| anteaya | fungi: no | 23:11 |
| *** sdake has quit IRC | 23:11 | |
| anteaya | fungi: the last email I recieved from smcginnis was on the 31st, finding the link now | 23:11 |
| clarkb | anteaya: I wonder if youget other gmail emails /me looks for another example | 23:12 |
| clarkb | anteaya: when was the last time you got mail from lbragstad? | 23:12 |
| clarkb | there was one sent ~9 hours ago with subject [dev][tc][ptl] Continuing Evaluating projects in relation to OpenStack cloud vision | 23:13 |
| anteaya | last email from smcginnis http://lists.openstack.org/pipermail/openstack-discuss/2019-January/002276.html | 23:13 |
| anteaya | I'll look up lbragstad | 23:13 |
| clarkb | cdent sent the first email on that thread | 23:14 |
| clarkb | if that helps you find it | 23:14 |
| gcutrini | corvus: maybe try setting base: "../html", | 23:14 |
| anteaya | I got the email from lance with that subject line about 9 hours ago, yes | 23:14 |
| anteaya | clarkb: thanks | 23:14 |
| clarkb | ok so its not a bulk gmail problem | 23:14 |
| clarkb | or at least probably isn | 23:14 |
| fungi | clarkb: i was mistaken about smcginnis's address earlier, it's gmx.com not gmail.com | 23:15 |
| * anteaya checks dinner | 23:15 | |
| gcutrini | corvus: seem it should work | 23:15 |
| *** wolverineav has quit IRC | 23:16 | |
| *** wolverineav has joined #openstack-infra | 23:16 | |
| clarkb | fungi: ah | 23:16 |
| *** wolverineav has quit IRC | 23:17 | |
| *** bobh has quit IRC | 23:18 | |
| clarkb | fungi: so gmail is rejecting emails from gmx.com forwarded by our list server | 23:18 |
| *** wolverineav has joined #openstack-infra | 23:18 | |
| fungi | yep | 23:18 |
| fungi | with no apparent dkim signature that i can see | 23:19 |
| fungi | complaining that it has an invalid or missing signature | 23:19 |
| clarkb | fungi: could it be the -all in the spf record? | 23:19 |
| fungi | but the dns record which i think would indicate that domain requires a dkim signature isn't present | 23:19 |
| clarkb | and/or the IP addrs listed there since we don't happen to be from there | 23:20 |
| fungi | mailman rewrites the smtp sender field (just not the to header in the message payload) so spf _should_ be irrelevant | 23:20 |
| anteaya | recently though, I did recieve this one sent from his gmx email: http://lists.openstack.org/pipermail/openstack-discuss/2019-January/002276.html | 23:20 |
| corvus | gcutrini: i tried locally with "../dist" and... it's showing the 404 page (which seems weird to me) | 23:21 |
| corvus | gcutrini: i'm wondering if some of the javascript inspects the url to determine what page it's on | 23:22 |
| anteaya | so I got one from smcginnis' gmx email on Jan. 31st and did not get one from smcginnis' gmx email on Feb. 1st: http://lists.openstack.org/pipermail/openstack-discuss/2019-February/002304.html | 23:23 |
| anteaya | and haven't gotten any email from smcginnis' gmx address in Feb | 23:23 |
| mordred | corvus: I imagine probably so - similar to the react routers | 23:23 |
| clarkb | fungi: there is a google product forum thread on this and one accusation is that gmail treats all gmx email as spam unless the gmail user has first sent email to that gmx address | 23:23 |
| fungi | clarkb: sounds like a smoking gun | 23:24 |
| *** slaweq has quit IRC | 23:24 | |
| fungi | "freemail wars: the saga continues" | 23:25 |
| clarkb | https://productforums.google.com/forum/#!msg/gmail/ECEDhFIuTuo/y8lXpqGhXgEJ | 23:25 |
| *** wolverineav has quit IRC | 23:25 | |
| smcginnis | Is there a known problem with gmx emails? Should I think about switching. | 23:26 |
| gcutrini | corbus: 404 because you are not allowed to access a local resource | 23:26 |
| smcginnis | And hi anteaya o/ :) | 23:26 |
| clarkb | smcginnis: still unclear, that thread doesn't seem to have definitive data. Even the google employees on it say " we can't tell you what is going on but contact support via this method" | 23:26 |
| clarkb | wee | 23:26 |
| gcutrini | corvus: sorry mispelled your name. “../html” should work | 23:26 |
| anteaya | both http://lists.openstack.org/pipermail/openstack-discuss/2019-February/002502.html and http://lists.openstack.org/pipermail/openstack-discuss/2019-February/002526.html originated from smcginnis and I didn't get either | 23:27 |
| anteaya | smcginnis: and hi, I miss you, I want to be getting your emails | 23:27 |
| anteaya | :) | 23:27 |
| fungi | in my opinion, the problem is with gmail rejecting legitimate messages | 23:27 |
| anteaya | no argument | 23:28 |
| gcutrini | corvus: need to run; will catch up later. | 23:28 |
| gcutrini | great weekend everyone ! | 23:28 |
| corvus | gcutrini: thanks! | 23:28 |
| clarkb | anteaya: if you haven't arleady you might be able to set up a filter rule in gmail that basically says "always accept email from this mailing list" and maybe that will give gmail the hint it needs to accept the email | 23:29 |
| *** mriedem has quit IRC | 23:29 | |
| anteaya | clarkb: I could try and figure out how to do that, you are correct, this might be just me | 23:30 |
| smcginnis | I have received responses occasionally from others on the ML, so it must not be blocked for everyone. | 23:30 |
| fungi | smcginnis: from gmail users too? | 23:31 |
| * corvus notes the number of people acting as volunteer tech support for gmail, since google doesn't provide that to people who aren't its customers, and its users are not its customers. | 23:31 | |
| smcginnis | fungi: That I am not sure. | 23:31 |
| fungi | i mean, i'm receiving your messages to the ml just fine, but my mta also doesn't seem to think there's anything wrong with your messages either | 23:31 |
| *** jklare has quit IRC | 23:32 | |
| *** sdake has joined #openstack-infra | 23:32 | |
| anteaya | I have to dinner and evening soon, thanks for looking into this, as corvus notes fixing google's issues | 23:33 |
| fungi | smcginnis: to recap, this is what gmail is rejecting with: SMTP error from remote mail server after end of data: host aspmx.l.google.com [108.177.103.26]: 550-5.7.1 This message does not have authentication information or fails to pass\n550-5.7.1 authentication checks. To best protect our users from spam, the\n550-5.7.1 message has been blocked. Please visit\n550-5.7.1 | 23:33 |
| fungi | https://support.google.com/mail/answer/81126#authentication for more\n550 5.7.1 information. p23si942536oip.32 - gsmtp | 23:33 |
| *** calbers has quit IRC | 23:33 | |
| anteaya | smcginnis: nice to see you, hope to chat again soon | 23:33 |
| smcginnis | Have a nice weekend anteaya | 23:34 |
| anteaya | :) you too! | 23:34 |
| smcginnis | fungi: Anything I can do from my end to improve things? | 23:34 |
| fungi | smcginnis: no idea. i'm not super concerned, but you might personally want to figure out whether you're able to successfully communicate with gmail users you care to converse with | 23:35 |
| fungi | sounds like something may have changed in that regard around a week ago | 23:36 |
| smcginnis | OK. I only use that for ML, as much as possible. Maybe I should switch. | 23:36 |
| *** jklare has joined #openstack-infra | 23:37 | |
| fungi | as someone who won't trust any mailserver he doesn't run himself, i'm probably the wrong one to be giving e-mail advice | 23:39 |
| *** rh-jelabarre has quit IRC | 23:39 | |
| *** ijw_ has quit IRC | 23:39 | |
| anteaya | smcginnis: I'll email you | 23:40 |
| smcginnis | Sadly I used to run my own until Comcast decided to block it. | 23:40 |
| smcginnis | Because paying for internet access apparently didn't mean you were entitled to access to the internet. | 23:40 |
| smcginnis | mutt | 23:40 |
| smcginnis | Oops | 23:40 |
| anteaya | sent | 23:41 |
| fungi | this seems to be a commonly-held opinion for many internet service "providers" | 23:41 |
| anteaya | the potatoes are cooked, I have 2 minutes | 23:42 |
| smcginnis | anteaya: Nothing received yet. | 23:42 |
| anteaya | try me | 23:42 |
| anteaya | nick at nick.info | 23:42 |
| smcginnis | anteaya: Sent | 23:43 |
| smcginnis | Err, or not. "SMTP session failed: 550 invalid DNS MX or A/AAAA resource record" | 23:43 |
| smcginnis | Oh, typo. | 23:43 |
| fungi | though if that forum thread is to be believed, now that you've sent a message to his address you may start receiving his messages through the ml too | 23:43 |
| smcginnis | anteaya: OK, now actually sent. | 23:44 |
| anteaya | fungi: that is what I'm wondering | 23:44 |
| anteaya | smcginnis: I'll click the go fetch button | 23:44 |
| *** wolverineav has joined #openstack-infra | 23:44 | |
| anteaya | smcginnis: recieved and replied | 23:44 |
| smcginnis | anteaya: Interesting that I still have not recieved yours, but if you can at least receive mine now, that's a win. | 23:44 |
| anteaya | so you outbound works | 23:45 |
| smcginnis | And, and I got your response. | 23:45 |
| anteaya | sounds like you have to initiate | 23:45 |
| anteaya | or did I have to send to you first to get your email? | 23:45 |
| smcginnis | Perhaps | 23:45 |
| anteaya | hopefully I'll get your emails to the list now | 23:45 |
| anteaya | still very odd | 23:45 |
| smcginnis | If I remember, next time I post to the ML I will ping you to see if you get it via that route. | 23:45 |
| anteaya | smcginnis: please ping | 23:46 |
| anteaya | okay have to afk now | 23:46 |
| anteaya | enjoy weekends | 23:46 |
| smcginnis | You too | 23:46 |
| corvus | gcutrini, mordred: http://logs.openstack.org/83/635983/1/check/netlify-sandbox-build-site/6d1f6bf/npm/html/ works (that's with ../html) for a split second, before the javascript takes over and can't figure out where it is. | 23:50 |
| corvus | same with ./ http://logs.openstack.org/82/635982/1/check/netlify-sandbox-build-site/1221089/npm/html/ | 23:52 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
