| ianw | hahah something totally weird has gone on | 00:00 |
|---|---|---|
| ianw | root@bridge:# rs*t* | 00:01 |
| ianw | I just typed "reset" to try and reset the terminal | 00:01 |
| ianw | somehow half the letters seem to have been captured by some sort of zombie pinentry process | 00:01 |
| openstackgerrit | Merged openstack-infra/system-config master: Set Ansible forks to 50 https://review.openstack.org/599850 | 00:01 |
| *** diablo_rojo has quit IRC | 00:08 | |
| ianw | argh, so simple https://emacs.stackexchange.com/questions/32881/enabling-minibuffer-pinentry-with-emacs-25-and-gnupg-2-1-on-ubuntu-xenial | 00:11 |
| *** jesusaur has quit IRC | 00:12 | |
| *** dingyichen has joined #openstack-infra | 00:15 | |
| *** dchen has joined #openstack-infra | 00:15 | |
| *** dingyichen has quit IRC | 00:15 | |
| ianw | ok i've followed those 5 simple steps and can now open it just as before. if this survives across multiple people doing su - etc etc is all still unknown | 00:15 |
| *** jesusaur has joined #openstack-infra | 00:18 | |
| *** diablo_rojo has joined #openstack-infra | 00:19 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: prometheus: add options to start the server and process collector https://review.openstack.org/599209 | 00:25 |
| ianw | clarkb: ok, looks like nodepool ~/.config/config & bridge /etc/openstack rolled out ok, paths to pem files all lg | 00:27 |
| openstackgerrit | Merged openstack-infra/system-config master: Add logrotate role and rotate ansible log files https://review.openstack.org/597333 | 00:33 |
| *** longkb has joined #openstack-infra | 00:36 | |
| ianw | alright, paged in what 598329 is doing and approved | 00:39 |
| *** spartakos has quit IRC | 00:40 | |
| *** markvoelker has joined #openstack-infra | 00:42 | |
| *** jamesmcarthur has joined #openstack-infra | 00:44 | |
| *** markvoelker has quit IRC | 00:47 | |
| *** jamesmcarthur has quit IRC | 00:54 | |
| *** jamesmcarthur has joined #openstack-infra | 00:54 | |
| *** caphrim007 has joined #openstack-infra | 01:00 | |
| *** jamesmcarthur has quit IRC | 01:01 | |
| *** jamesmcarthur has joined #openstack-infra | 01:02 | |
| *** caphrim007 has quit IRC | 01:05 | |
| *** florianf has quit IRC | 01:06 | |
| *** florianf has joined #openstack-infra | 01:06 | |
| *** rh-jelabarre has quit IRC | 01:08 | |
| *** zigo has joined #openstack-infra | 01:09 | |
| tonyb | I'd like to know the review that has triggered the ci run. I think I can get that from vars zuul.ref (but that's probably the wrong syntax). Is it available as a ZUUL_REF envvar? | 01:18 |
| clarkb | tonyb it is if you add a legacy compat role but not generally iirc | 01:19 |
| tonyb | clarkb: Okay I don't want to enable legacy mode as that's just debt to pay down later ;P | 01:19 |
| * tonyb will just play with getting it from the vars | 01:20 | |
| *** jamesmcarthur has quit IRC | 01:22 | |
| *** hongbin_ has joined #openstack-infra | 01:26 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Add some details for various cloud config files https://review.openstack.org/599884 | 01:26 |
| ianw | (err): Could not evaluate: Could not find command '/var/lib/puppet/concat/bin/concatfragments.rb' | 01:31 |
| ianw | http://logs.openstack.org/78/598378/1/gate/infra-puppet-apply-4-centos-7/6bae404/applytest/puppetapplytest26.final.out | 01:31 |
| ianw | clarkb: ^ seem familiar? | 01:31 |
| *** bobh has joined #openstack-infra | 01:32 | |
| *** jamesmcarthur has joined #openstack-infra | 01:34 | |
| fungi | tonyb: see http://codesearch.openstack.org/?q=zuul\.ref for some examples of how to do it | 01:34 |
| *** mriedem is now known as mriedem_afk | 01:35 | |
| clarkb | ianw not familiar sorry | 01:35 |
| tonyb | fungi: Thanks. | 01:37 |
| fungi | ianw: are we failing to install puppet concat? | 01:37 |
| fungi | ianw: oh, noop mode maybe? | 01:38 |
| fungi | https://tickets.puppetlabs.com/browse/MODULES-2206 | 01:38 |
| fungi | can't use concat under noop by design, won't fix | 01:39 |
| ianw | fungi: yeah, but it worked in the check run, but not gate run ... trying to see what, if naything changed | 01:40 |
| ianw | good: http://logs.openstack.org/78/598378/1/check/infra-puppet-apply-4-centos-7/b09858a/job-output.txt.gz#_2018-08-30_22_31_44_668875 | 01:41 |
| ianw | bad: http://logs.openstack.org/78/598378/1/gate/infra-puppet-apply-4-centos-7/6bae404/job-output.txt.gz | 01:41 |
| *** markvoelker has joined #openstack-infra | 01:43 | |
| *** anteaya has joined #openstack-infra | 01:43 | |
| ianw | actually, maybe that's a red herring | 01:43 |
| ianw | http://logs.openstack.org/78/598378/1/gate/infra-puppet-apply-4-centos-7/6bae404/applytest/puppetapplytest27.final.out.FAILED has no details of what failed | 01:45 |
| mriedem_afk | fungi: can i depends-on 2 changes from the same repo as long as they don't merge conflict? | 01:47 |
| clarkb | mriedem_afk: yes | 01:48 |
| mriedem_afk | well hot diggity dog | 01:48 |
| ianw | hrm ... "xargs -0 -P 8 -n 1 -I filearg ./tools/test_puppet_apply.sh filearg" | 01:49 |
| ianw | 2018-09-04 22:58:44.782100 | centos-7 | TASK [puppet : copy puppet modules] ******************************************** | 01:49 |
| ianw | 2018-09-04 22:58:44.782374 | centos-7 | fatal: [localhost]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} | 01:50 |
| ianw | it looks like it couldn't log into itself copy the files. with nothing helpful | 01:50 |
| fungi | mriedem_afk: s/two/as many as you like/ (but beware of introducing dependency loops!) | 01:51 |
| fungi | it's all too easily lose track of complex change dependencies and end up with some combination which has a closed loop | 01:52 |
| fungi | s/easily/easy to/ | 01:52 |
| *** r-daneel has joined #openstack-infra | 01:53 | |
| *** spartakos has joined #openstack-infra | 01:56 | |
| ianw | ... can only assume it's a transient error and possibly relating to running the tests in parallel | 01:56 |
| *** anteaya has quit IRC | 02:00 | |
| *** apetrich_ has joined #openstack-infra | 02:06 | |
| openstackgerrit | Kaifeng Wang proposed openstack-infra/project-config master: Add api-ref job to ironic-inspector https://review.openstack.org/599890 | 02:06 |
| *** apetrich has quit IRC | 02:09 | |
| *** gyee has quit IRC | 02:12 | |
| *** bobh has quit IRC | 02:15 | |
| openstackgerrit | Merged openstack-infra/puppet-openstackci master: Make oscc_file_contents optional https://review.openstack.org/598378 | 02:20 |
| *** annp has joined #openstack-infra | 02:21 | |
| *** ijw has quit IRC | 02:21 | |
| *** threestrands has joined #openstack-infra | 02:22 | |
| openstackgerrit | Merged openstack-infra/system-config master: Manage clouds.yaml files in ansible https://review.openstack.org/598329 | 02:26 |
| *** jamesmcarthur has quit IRC | 02:32 | |
| *** lbragstad has quit IRC | 02:39 | |
| *** florianf has quit IRC | 02:44 | |
| *** rlandy|bbl is now known as rlandy | 02:45 | |
| *** bgmccollum has quit IRC | 02:45 | |
| *** bgmccollum has joined #openstack-infra | 02:45 | |
| *** yamamoto has quit IRC | 02:47 | |
| *** dave-mccowan has joined #openstack-infra | 02:49 | |
| *** bharath_t has joined #openstack-infra | 02:54 | |
| *** florianf has joined #openstack-infra | 02:57 | |
| *** psachin has joined #openstack-infra | 02:57 | |
| *** mrhillsman has joined #openstack-infra | 02:58 | |
| *** caphrim007 has joined #openstack-infra | 03:01 | |
| *** psachin has quit IRC | 03:04 | |
| *** bharath_t has quit IRC | 03:06 | |
| *** caphrim007 has quit IRC | 03:08 | |
| *** bharath_t has joined #openstack-infra | 03:14 | |
| *** tdasilva has quit IRC | 03:27 | |
| *** bharath_t has quit IRC | 03:28 | |
| *** tdasilva has joined #openstack-infra | 03:36 | |
| *** bharath_t has joined #openstack-infra | 03:40 | |
| *** hongbin_ has quit IRC | 03:46 | |
| *** eernst has joined #openstack-infra | 03:47 | |
| *** diablo_rojo has quit IRC | 03:49 | |
| *** bharath_t has quit IRC | 03:49 | |
| *** udesale has joined #openstack-infra | 03:54 | |
| *** yamamoto has joined #openstack-infra | 03:56 | |
| *** spartakos has quit IRC | 03:57 | |
| *** vivsoni has joined #openstack-infra | 03:58 | |
| *** ramishra has joined #openstack-infra | 03:59 | |
| *** eernst has quit IRC | 04:11 | |
| *** eernst has joined #openstack-infra | 04:11 | |
| *** bobh has joined #openstack-infra | 04:12 | |
| ianw | ok, logrotate files deployed on bridge, i think it will rotate tomorrow | 04:15 |
| *** bobh has quit IRC | 04:18 | |
| *** eernst has quit IRC | 04:21 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Add testinfra tests for bridge https://review.openstack.org/598404 | 04:24 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Add project templates for openstack-tox-cover https://review.openstack.org/598104 | 04:28 |
| *** mpeterson_ has joined #openstack-infra | 04:29 | |
| *** wznoinsk_ has joined #openstack-infra | 04:29 | |
| *** wznoinsk has quit IRC | 04:30 | |
| *** mpeterson has quit IRC | 04:30 | |
| openstackgerrit | Merged openstack-infra/project-config master: Switch unmodified readthedocs jobs to warning job https://review.openstack.org/599270 | 04:35 |
| *** bandini has quit IRC | 04:37 | |
| *** adriant has quit IRC | 04:40 | |
| *** tonyb has quit IRC | 04:40 | |
| *** tonyb has joined #openstack-infra | 04:40 | |
| *** adriant has joined #openstack-infra | 04:41 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Add project templates for openstack-tox-cover https://review.openstack.org/598104 | 04:42 |
| *** dave-mccowan has quit IRC | 04:48 | |
| *** xinliang has joined #openstack-infra | 04:55 | |
| *** jamesmcarthur has joined #openstack-infra | 05:01 | |
| *** yboaron_ has joined #openstack-infra | 05:01 | |
| AJaeger | ianw: want to write an email now since 599270 is merged? | 05:03 |
| ianw | AJaeger: will do | 05:04 |
| *** vivsoni has quit IRC | 05:05 | |
| *** jamesmcarthur has quit IRC | 05:06 | |
| AJaeger | ianw: could you review https://review.openstack.org/#/c/598929 to finish cloudkitty python3-first migration, please? | 05:06 |
| *** dingyichen has joined #openstack-infra | 05:12 | |
| *** markvoelker has quit IRC | 05:13 | |
| *** kjackal has joined #openstack-infra | 05:16 | |
| openstackgerrit | Merged openstack-infra/nodepool master: uncap sphinx https://review.openstack.org/599742 | 05:16 |
| *** shachar is now known as snapiri | 05:16 | |
| *** shabeeb has joined #openstack-infra | 05:19 | |
| *** cshastri has joined #openstack-infra | 05:20 | |
| *** shabeeb has quit IRC | 05:29 | |
| *** bandini has joined #openstack-infra | 05:32 | |
| *** apetrich_ has quit IRC | 05:36 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Add list of metrics provided to statsd https://review.openstack.org/590233 | 05:41 |
| *** ijw has joined #openstack-infra | 05:42 | |
| *** apetrich has joined #openstack-infra | 05:46 | |
| *** ijw has quit IRC | 05:47 | |
| *** jiapei has joined #openstack-infra | 05:48 | |
| openstackgerrit | Merged openstack-infra/project-config master: remove job settings for cloudkitty repositories https://review.openstack.org/598929 | 05:56 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Fix variable names in nodepool cloud config https://review.openstack.org/599927 | 05:57 |
| ianw | corvus / clarkb : ^ check my work here ,but i think this is quite important. i think we're saved from an invalid config by ansible not touching what's there | 05:57 |
| *** pgadiya has joined #openstack-infra | 05:58 | |
| ianw | we can also rename the variables; but given variables and namespacing issues i think having more descriptive names is probably erring on the side of better | 06:00 |
| *** kjackal has quit IRC | 06:04 | |
| *** kjackal has joined #openstack-infra | 06:05 | |
| *** holser_ has joined #openstack-infra | 06:09 | |
| *** markvoelker has joined #openstack-infra | 06:10 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/599928 | 06:12 |
| *** quiquell has joined #openstack-infra | 06:15 | |
| *** xinliang has quit IRC | 06:16 | |
| *** xinliang has joined #openstack-infra | 06:16 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Update static nodes in Zookeeper on config change https://review.openstack.org/598156 | 06:23 |
| *** pcaruana has joined #openstack-infra | 06:23 | |
| *** Bhujay has joined #openstack-infra | 06:25 | |
| *** Bhujay has quit IRC | 06:26 | |
| *** kjackal has quit IRC | 06:26 | |
| *** Bhujay has joined #openstack-infra | 06:26 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul-jobs master: Add a role to upload logs to Amazon's S3 service https://review.openstack.org/599931 | 06:30 |
| tonyb | mordred, pabelanger: Do we have a timeline for the T release name poll? | 06:36 |
| *** ijw has joined #openstack-infra | 06:37 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: prometheus: add options to start the server and process collector https://review.openstack.org/599209 | 06:40 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: prometheus: add existing metrics https://review.openstack.org/599210 | 06:40 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: prometheus: add decorators to measure scheduler latency https://review.openstack.org/599211 | 06:40 |
| *** ijw has quit IRC | 06:42 | |
| openstackgerrit | Merged openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/599928 | 06:43 |
| *** rlandy has quit IRC | 06:45 | |
| openstackgerrit | Markus Hosch proposed openstack-infra/nodepool master: Add metric for image build result https://review.openstack.org/590412 | 06:49 |
| *** hashar has joined #openstack-infra | 06:58 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add testinfra tests for bridge https://review.openstack.org/598404 | 06:58 |
| *** ijw has joined #openstack-infra | 07:00 | |
| *** rcernin has quit IRC | 07:04 | |
| *** ijw has quit IRC | 07:04 | |
| *** caphrim007 has joined #openstack-infra | 07:05 | |
| *** kjackal has joined #openstack-infra | 07:06 | |
| *** ginopc has joined #openstack-infra | 07:08 | |
| *** caphrim007 has quit IRC | 07:09 | |
| gema | ianw: we sent you some credentials for UK cloud | 07:11 |
| gema | ianw: I hope you got them :D | 07:11 |
| ianw | gema: yes, thanks, haven't actioned it yet but will do | 07:17 |
| ianw | gema: should this replace the cn cloud? | 07:17 |
| *** janki has joined #openstack-infra | 07:21 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Add ansible runtime script https://review.openstack.org/599943 | 07:21 |
| gema | ianw: no, it is on top of | 07:23 |
| gema | ianw: I am hoping we can get over the network hurdles whilst the other one is being investigated | 07:23 |
| gema | and once it is fixed we'll be able to use it too | 07:23 |
| *** olivierb has joined #openstack-infra | 07:23 | |
| ianw | ok cool | 07:24 |
| gema | ianw: thanks, there's no rush, just making sure you had got it :D | 07:25 |
| gema | ianw: it runs rocky | 07:25 |
| gema | ianw: at some point we'll upgrade CN too | 07:25 |
| *** tesseract has joined #openstack-infra | 07:25 | |
| ttx | AJaeger: re: odsreg I commented on https://review.openstack.org/#/c/599702/ -- TL;DR being we should probably keep it a bit longer. | 07:37 |
| openstackgerrit | Markus Hosch proposed openstack-infra/nodepool master: Add metric for image build result https://review.openstack.org/590412 | 07:39 |
| ttx | also replied to thread | 07:40 |
| *** tosky has joined #openstack-infra | 07:40 | |
| *** alexchadin has joined #openstack-infra | 07:41 | |
| *** jpena|off is now known as jpena | 07:45 | |
| *** e0ne has joined #openstack-infra | 07:46 | |
| kei-ichi | Hi Infra team. | 07:47 |
| kei-ichi | I have one question about release management about qinling-dashboard. | 07:47 |
| kei-ichi | This repository does not have stable/rocky branch yet. | 07:47 |
| kei-ichi | I'd like to create this branch. | 07:47 |
| kei-ichi | Currently qinling-dashboard repo only have qinling-dashboard-core group. (does not have qinling-dashboard-release group) | 07:47 |
| kei-ichi | According to https://docs.openstack.org/infra/manual/creators.html it says "For unofficial projects, a second “<projectname>-release” team should be created and populated with a small group of the primary maintainers with permission to push tags to trigger releases." | 07:47 |
| kei-ichi | Is qinling-dashboard is handled as unofficial? So I'd better to create -release group to add stable/rocky branch? | 07:47 |
| *** ccamacho has joined #openstack-infra | 07:51 | |
| *** Emine has joined #openstack-infra | 07:58 | |
| *** pguimaraes has joined #openstack-infra | 07:58 | |
| *** pguimaraes has quit IRC | 08:00 | |
| *** pguimaraes has joined #openstack-infra | 08:00 | |
| AJaeger | kei-ichi: reach out to release team, they can do this for you - via the releases repo. | 08:01 |
| AJaeger | kei-ichi: #openstack-release is the irc channel | 08:02 |
| kei-ichi | Ajaeger thanks! I'll contact them through that channel. o/ | 08:02 |
| AJaeger | ttx, so retiring puppet-odsreg is fine but we should wait with odsreg, correct? | 08:03 |
| *** jaosorior has quit IRC | 08:03 | |
| *** kei-ichi has quit IRC | 08:04 | |
| *** kei-ichi has joined #openstack-infra | 08:04 | |
| *** jaosorior has joined #openstack-infra | 08:05 | |
| *** corvus has quit IRC | 08:05 | |
| ttx | AJaeger: yes | 08:06 |
| *** jpich has joined #openstack-infra | 08:08 | |
| ianw | clarkb / corvus : see notes in https://review.openstack.org/599943 about ansible runtimes ... not sure what's causing it | 08:13 |
| ianw | i suspect the forks=50 ... but it doesn't quite match up. so at a loss for now | 08:13 |
| *** electrofelix has joined #openstack-infra | 08:13 | |
| *** corvus has joined #openstack-infra | 08:22 | |
| *** threestrands has quit IRC | 08:26 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: web: add tenant-scoped, JWT-protected actions https://review.openstack.org/576907 | 08:27 |
| *** Bhujay has quit IRC | 08:30 | |
| *** dtantsur|afk is now known as dtantsur | 08:35 | |
| *** Bhujay has joined #openstack-infra | 08:35 | |
| *** sshnaidm|afk is now known as sshnaidm | 08:36 | |
| *** priteau has quit IRC | 08:42 | |
| *** priteau has joined #openstack-infra | 08:42 | |
| *** gfidente has joined #openstack-infra | 08:42 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Update the IRC room for TripleO https://review.openstack.org/599615 | 08:43 |
| *** derekh has joined #openstack-infra | 08:44 | |
| *** yamamoto has quit IRC | 08:46 | |
| *** pcaruana has quit IRC | 08:50 | |
| *** psachin has joined #openstack-infra | 08:56 | |
| *** dingyichen has quit IRC | 09:01 | |
| *** jamesmcarthur has joined #openstack-infra | 09:02 | |
| *** jamesmcarthur has quit IRC | 09:06 | |
| *** yamamoto has joined #openstack-infra | 09:06 | |
| *** caphrim007 has joined #openstack-infra | 09:08 | |
| *** caphrim007 has quit IRC | 09:12 | |
| *** hashar is now known as hasharAway | 09:43 | |
| *** pcaruana has joined #openstack-infra | 09:58 | |
| *** slaweq_ is now known as slaweq | 10:00 | |
| *** zigo has left #openstack-infra | 10:02 | |
| *** zigo has joined #openstack-infra | 10:02 | |
| *** longkb has quit IRC | 10:05 | |
| *** wolverineav has joined #openstack-infra | 10:15 | |
| *** alexchadin has quit IRC | 10:17 | |
| *** wolverineav has quit IRC | 10:20 | |
| *** udesale has quit IRC | 10:21 | |
| *** udesale has joined #openstack-infra | 10:21 | |
| *** udesale has quit IRC | 10:21 | |
| *** udesale has joined #openstack-infra | 10:22 | |
| *** annp has quit IRC | 10:29 | |
| *** wolverineav has joined #openstack-infra | 10:30 | |
| *** wolverineav has quit IRC | 10:50 | |
| *** alexchadin has joined #openstack-infra | 10:50 | |
| *** wolverineav has joined #openstack-infra | 10:53 | |
| *** caphrim007 has joined #openstack-infra | 10:56 | |
| *** pbourke has quit IRC | 10:57 | |
| *** pbourke has joined #openstack-infra | 10:59 | |
| *** caphrim007 has quit IRC | 11:00 | |
| *** jamesdenton has quit IRC | 11:01 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Retire puppet-odsreg (step 2) https://review.openstack.org/599700 | 11:06 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Retire puppet-odsreg (step 4) https://review.openstack.org/599710 | 11:07 |
| *** dtantsur is now known as dtantsur|brb | 11:08 | |
| *** udesale has quit IRC | 11:10 | |
| *** rh-jelabarre has joined #openstack-infra | 11:11 | |
| *** jento has joined #openstack-infra | 11:21 | |
| *** mshalamov has joined #openstack-infra | 11:22 | |
| *** mshalamov has quit IRC | 11:24 | |
| *** mshalamov has joined #openstack-infra | 11:26 | |
| *** jamesdenton has joined #openstack-infra | 11:28 | |
| *** eharney has quit IRC | 11:32 | |
| *** nicolasbock has joined #openstack-infra | 11:32 | |
| *** jpena is now known as jpena|lunch | 11:36 | |
| *** jamesdenton has quit IRC | 11:37 | |
| *** jamesdenton has joined #openstack-infra | 11:37 | |
| *** jamesdenton has quit IRC | 11:39 | |
| *** jamesdenton has joined #openstack-infra | 11:41 | |
| *** sshnaidm has quit IRC | 11:43 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool master: Do not abort node launch if failed node cannot be deleted https://review.openstack.org/589854 | 11:44 |
| *** zigo has quit IRC | 11:45 | |
| *** sshnaidm has joined #openstack-infra | 11:46 | |
| *** dave-mccowan has joined #openstack-infra | 11:47 | |
| *** odyssey4me has quit IRC | 11:53 | |
| *** odyssey4me has joined #openstack-infra | 11:54 | |
| pabelanger | tonyb: mordred: I haven't heard anything officially, guess we should start looking into it | 11:57 |
| *** lbragstad has joined #openstack-infra | 11:57 | |
| *** weshay|pto is now known as weshay | 11:58 | |
| *** gcb_ has joined #openstack-infra | 12:01 | |
| *** e0ne has quit IRC | 12:03 | |
| *** tpsilva has joined #openstack-infra | 12:05 | |
| *** zigo has joined #openstack-infra | 12:08 | |
| *** markvoelker has quit IRC | 12:09 | |
| *** markvoelker has joined #openstack-infra | 12:09 | |
| *** quiquell is now known as quiquell|lunch | 12:12 | |
| *** e0ne has joined #openstack-infra | 12:19 | |
| *** rh-jelabarre has quit IRC | 12:26 | |
| *** rh-jelabarre has joined #openstack-infra | 12:26 | |
| *** boden has joined #openstack-infra | 12:30 | |
| *** tmorin has joined #openstack-infra | 12:31 | |
| *** ansmith has joined #openstack-infra | 12:32 | |
| tmorin | ping infra-root: I've got an issue with zuul not triggering any job for the new PS's on https://review.openstack.org/598677 and no error message either | 12:32 |
| tmorin | infra-root: any idea ? | 12:32 |
| *** rlandy has joined #openstack-infra | 12:33 | |
| frickler | tmorin: that smells like a cyclic dependency | 12:34 |
| *** boden has joined #openstack-infra | 12:34 | |
| frickler | tmorin: yes, https://review.openstack.org/598677 => Ibd5389d333e46e3f30dd29022932d78c89c85410 = https://review.openstack.org/599321 => https://review.openstack.org/598677 | 12:35 |
| *** trown|outtypewww is now known as trown | 12:37 | |
| tmorin | frickler: ok | 12:37 |
| tmorin | frickler: but this was working yesterday ... | 12:37 |
| tmorin | frickler: also, is it expected/normal that no error message is provided ? | 12:38 |
| tmorin | frickler: I mean, it somehow cyclic, and would prevent merging, but nothing that would prevent from launching tests, right ? | 12:39 |
| *** jpena|lunch is now known as jpena | 12:41 | |
| frickler | tmorin: zuul cannot build a mergeset for a cyclic dependency, so it cannot run tests, iiuc. the error currently is only logged in the zuul log, not sure about plans to publish it | 12:41 |
| tmorin | frickler: ok | 12:42 |
| tmorin | frickler: it seems like perhaps zuul could solve at least some cycles: in this particular case drawing change 598677 for n8g-bagpipe along with 599321 for neutron satisfies both Depends-On | 12:43 |
| *** yamamoto has quit IRC | 12:45 | |
| *** agopi has quit IRC | 12:45 | |
| frickler | tmorin: I'm no zuul expert, not sure what could be done there or not. I just can tell you that currently any dependency cycle means that zuul gives up on the patch immediately and (from a user pov) silently | 12:45 |
| tmorin | frickler: yes, ok, understood -- thanks very much for your help! | 12:46 |
| *** quiquell|lunch is now known as quiquell | 12:46 | |
| *** sthussey has joined #openstack-infra | 12:53 | |
| *** jamesmcarthur has joined #openstack-infra | 12:54 | |
| *** camunoz has joined #openstack-infra | 12:55 | |
| *** udesale has joined #openstack-infra | 12:57 | |
| *** alexchadin has quit IRC | 12:59 | |
| *** ssbarnea has quit IRC | 12:59 | |
| *** bhavikdbavishi has joined #openstack-infra | 13:00 | |
| *** eernst has joined #openstack-infra | 13:00 | |
| *** ssbarnea has joined #openstack-infra | 13:01 | |
| *** ssbarnea has quit IRC | 13:01 | |
| *** yamamoto has joined #openstack-infra | 13:03 | |
| *** eharney has joined #openstack-infra | 13:06 | |
| *** hasharAway is now known as hashar | 13:07 | |
| *** alexchadin has joined #openstack-infra | 13:07 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 13:11 | |
| *** agopi has joined #openstack-infra | 13:11 | |
| *** bhavikdbavishi has quit IRC | 13:12 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 13:12 | |
| *** mriedem_afk is now known as mriedem | 13:15 | |
| *** bhavikdbavishi has quit IRC | 13:17 | |
| *** dtantsur|brb is now known as dtantsur | 13:17 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/zuul-website master: Add a "start" redirect https://review.openstack.org/599699 | 13:19 |
| *** kgiusti has joined #openstack-infra | 13:23 | |
| *** eernst has quit IRC | 13:23 | |
| *** ssbarnea1 has joined #openstack-infra | 13:27 | |
| *** beagles is now known as beagles_mtgs | 13:30 | |
| *** _ari__ has joined #openstack-infra | 13:30 | |
| *** jamesmcarthur has quit IRC | 13:31 | |
| *** jamesmcarthur has joined #openstack-infra | 13:32 | |
| *** r-daneel has quit IRC | 13:34 | |
| *** jamesmcarthur has quit IRC | 13:34 | |
| *** mdrabe_ has joined #openstack-infra | 13:35 | |
| *** jamesmcarthur has joined #openstack-infra | 13:37 | |
| *** jamesmcarthur has quit IRC | 13:40 | |
| *** udesale_ has joined #openstack-infra | 13:41 | |
| *** psachin has quit IRC | 13:42 | |
| *** udesale has quit IRC | 13:43 | |
| *** eernst has joined #openstack-infra | 13:48 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/nodepool master: Do not abort node launch if failed node cannot be deleted https://review.openstack.org/589854 | 13:54 |
| *** d0ugal_ has joined #openstack-infra | 13:58 | |
| *** d0ugal has quit IRC | 13:58 | |
| *** janki has quit IRC | 14:01 | |
| *** ssbarnea|ruck has joined #openstack-infra | 14:05 | |
| *** hashar is now known as hasharAway | 14:06 | |
| *** jaosorior has quit IRC | 14:06 | |
| *** d0ugal_ has quit IRC | 14:06 | |
| *** jtomasek has quit IRC | 14:15 | |
| *** eernst has quit IRC | 14:20 | |
| *** d0ugal_ has joined #openstack-infra | 14:20 | |
| *** ssbarnea|ruck has quit IRC | 14:20 | |
| *** jamesmcarthur has joined #openstack-infra | 14:20 | |
| *** cshastri has quit IRC | 14:21 | |
| *** dtantsur is now known as dtantsur|brb | 14:24 | |
| *** caphrim007 has joined #openstack-infra | 14:31 | |
| *** quiquell has quit IRC | 14:32 | |
| *** jamesmcarthur has quit IRC | 14:32 | |
| AJaeger | clarkb, fungi, ttx is not ready with removing odsreg - but we can continue with puppet-odsreg. Could you review https://review.openstack.org/#/c/599710/ and https://review.openstack.org/#/c/599700/ again, please? | 14:32 |
| AJaeger | config-core, next teams are ready with python3-first and we can now merge https://review.openstack.org/#/c/598620/ and https://review.openstack.org/#/c/598314/ - please review | 14:35 |
| *** ssbarnea|bkp has joined #openstack-infra | 14:37 | |
| openstackgerrit | Simon Westphahl proposed openstack-infra/nodepool master: Improve static provider to check non-ssh hosts https://review.openstack.org/600079 | 14:38 |
| openstackgerrit | Simon Westphahl proposed openstack-infra/nodepool master: Fix missing node state refresh in static driver https://review.openstack.org/600080 | 14:38 |
| openstackgerrit | Simon Westphahl proposed openstack-infra/nodepool master: Fix use of wrong label static test fixture https://review.openstack.org/600081 | 14:38 |
| openstackgerrit | Simon Westphahl proposed openstack-infra/nodepool master: Worker and interfaces for checking node liveness https://review.openstack.org/600082 | 14:38 |
| openstackgerrit | Simon Westphahl proposed openstack-infra/nodepool master: Implement liveness probe for static driver https://review.openstack.org/600083 | 14:38 |
| openstackgerrit | Simon Westphahl proposed openstack-infra/nodepool master: Cleanup of leaked resource for static driver https://review.openstack.org/600084 | 14:39 |
| *** ssbarnea|bkp is now known as ssbarnea|bkp2 | 14:40 | |
| *** gfidente has quit IRC | 14:45 | |
| *** gfidente has joined #openstack-infra | 14:46 | |
| openstackgerrit | Markus Hosch proposed openstack-infra/zuul master: Reload tenant in case of new project branches https://review.openstack.org/600088 | 14:48 |
| *** jamesmcarthur has joined #openstack-infra | 14:48 | |
| openstackgerrit | Markus Hosch proposed openstack-infra/zuul master: Reload tenant in case of new project branches https://review.openstack.org/600088 | 14:49 |
| *** caphrim007_ has joined #openstack-infra | 14:50 | |
| *** mdrabe has joined #openstack-infra | 14:51 | |
| openstackgerrit | Merged openstack-infra/zuul master: Add private key storage migration https://review.openstack.org/592213 | 14:51 |
| *** mdrabe_ has quit IRC | 14:53 | |
| *** caphrim007 has quit IRC | 14:54 | |
| *** d0ugal_ has quit IRC | 14:57 | |
| *** d0ugal has joined #openstack-infra | 14:57 | |
| *** bobh has joined #openstack-infra | 14:58 | |
| clarkb | tmorin: frickler there is an outstanding bug in zuul to report the cycle information back when not running jobs, just hasn't been done yet. Also I'm not sure zuul can safely break cycles for humans as it can't interpret intent from the parent specifications | 14:59 |
| *** r-daneel has joined #openstack-infra | 14:59 | |
| openstackgerrit | Merged openstack-infra/zuul master: Change project.private_key to private_secrets_key https://review.openstack.org/597302 | 15:00 |
| *** camunoz has quit IRC | 15:02 | |
| openstackgerrit | Merged openstack-infra/zuul master: Create per-project ssh keys https://review.openstack.org/597711 | 15:03 |
| frickler | clarkb: do you have a reference to that bug? I wasn't able to locate it in storyboard | 15:04 |
| openstackgerrit | Merged openstack-infra/zuul master: Provide per-project ssh key to executor https://review.openstack.org/597727 | 15:04 |
| clarkb | frickler: tmorin https://storyboard.openstack.org/#!/story/2001428 | 15:04 |
| tmorin | clarkb, frickler: ack | 15:05 |
| * Shrews just notices sahara-related items in the zuulv3 storyboard worklist | 15:06 | |
| Shrews | odd | 15:06 |
| *** yboaron_ has quit IRC | 15:06 | |
| tmorin | clarkb: the particular case here was that change A in project X had a dependency on change B in project Y, and vice-versa, and it seems that in such a case, although you can see that as a cycle, these are compatible Depends-On | 15:06 |
| clarkb | Shrews: that is based on tags, guessing they used a tag that overlaps with zuuls | 15:06 |
| openstackgerrit | Merged openstack-infra/zuul master: Serve project SSH keys and document https://review.openstack.org/599063 | 15:07 |
| clarkb | tmorin: but how would zuul know which one is the parent? | 15:07 |
| Shrews | :( | 15:07 |
| tmorin | I'd think that no guessing is required to conclude that running the jobs with X:A and Y:B is the intent | 15:07 |
| clarkb | tmorin: it could guess, but that likely isn't a good hueristic | 15:07 |
| clarkb | tmorin: oh, I see, that is incompatbile with how we use zuul. Zuul forces linear history | 15:07 |
| clarkb | so you cannot aggregate like that | 15:08 |
| tmorin | clarkb: yes, this is perhaps/probably what I don't grasp: zuul needs some parent, including across repos ? | 15:08 |
| fungi | in a shared change queue zuul linearizes a series of changes across projects and branches | 15:08 |
| clarkb | tmorin: basically two changes cannot merge at the same time because of how git works and our desire to support continuous deployment of downstreams | 15:08 |
| clarkb | tmorin: so we serialize merges meaning every commit merges on its own in some order | 15:09 |
| tmorin | clarkb, fungi: as I was saying earlier, I 100% get why such a Depends-On loop would prevent merging, but not why it would prevent the preparation of an environment with both of the changes | 15:09 |
| *** takamatsu has quit IRC | 15:10 | |
| fungi | because of some of the changes are for the same project and branch... | 15:10 |
| fungi | er, if some | 15:10 |
| clarkb | well and we test what we can merge | 15:10 |
| clarkb | if something cannot merge it is an error | 15:10 |
| fungi | basically you're asking to optimize for scenarios where all changes involved are for independent projects/branches | 15:10 |
| tmorin | fungi: yes, that was my question | 15:11 |
| *** alexchadin has quit IRC | 15:11 | |
| tmorin | fungi: but honestly its more out of curiosity, I currently couldn't describe a case where I need that | 15:11 |
| *** alexchadin has joined #openstack-infra | 15:11 | |
| *** alexchadin has quit IRC | 15:12 | |
| *** takamatsu has joined #openstack-infra | 15:12 | |
| fungi | and also zuul would need some deterministic rule to arbitrarily order those because even in independent pipelines like openstack's check pipeline, zuul creates a throwaway change queue to build up the series of dependencies | 15:12 |
| tmorin | fungi: in the case where I created a cycle, I finally did it differently (the intent was merely to test the effect of a change on another project, and vice-versa, and remove one of the Depends-On later) | 15:12 |
| *** alexchadin has joined #openstack-infra | 15:12 | |
| *** alexchadin has quit IRC | 15:12 | |
| *** alexchadin has joined #openstack-infra | 15:13 | |
| *** alexchadin has quit IRC | 15:13 | |
| *** alexchadin has joined #openstack-infra | 15:14 | |
| *** alexchadin has quit IRC | 15:14 | |
| *** jtomasek has joined #openstack-infra | 15:14 | |
| *** alexchadin has joined #openstack-infra | 15:14 | |
| *** alexchadin has quit IRC | 15:15 | |
| *** camunoz has joined #openstack-infra | 15:18 | |
| *** anteaya has joined #openstack-infra | 15:18 | |
| *** Bhujay has quit IRC | 15:18 | |
| clarkb | checking scrollback I don't see any spam yet (have I just jinxed it?) what do we think about removing +rf from openstack channels globally? | 15:19 |
| clarkb | infra-root ^ | 15:19 |
| pabelanger | sure, happy to try | 15:20 |
| openstackgerrit | Merged openstack-infra/zuul master: Display correct cursor when hovering over patchset header https://review.openstack.org/598222 | 15:21 |
| Shrews | clarkb: i don't see any recent news about it in #freenode topic or the blog (beyond the Aug 6th posting) | 15:21 |
| corvus | tmorin, fungi: at some point in the future i expect zuul to support co-dependent changes, however, i doubt we would enable that feature in openstack because we feel that having a strict sequential series of changes across projects is important for upgrading openstack in a CD environment. | 15:21 |
| clarkb | Shrews: ya I removed +rf from this channel to see if we got spam here and its been about 18 hours with no spam that I see | 15:22 |
| fungi | clarkb: i haven't seen any irc spam in here yet either, though it may also be that it takes the spammers a while to discover spammable channels | 15:22 |
| *** gyee has joined #openstack-infra | 15:22 | |
| Shrews | yeah, i'm not sure if they are attacking in waves or a steady stream | 15:23 |
| *** pcaruana has quit IRC | 15:25 | |
| Shrews | maybe give it another day | 15:25 |
| tmorin | corvus, clarkb, fungi: thanks for the details insight on zuul... I wasn't asking that much when naively asking my question :) | 15:26 |
| anteaya | the spammers might also be looking for critical mass | 15:32 |
| anteaya | one channel might not be worth their trouble | 15:32 |
| *** beagles_mtgs is now known as beagles | 15:33 | |
| *** Emine has quit IRC | 15:33 | |
| clarkb | ya we can always revert if we need to, its just been long enough I figured we'd check if still a problem and so far in this channel at least it has beenfine | 15:34 |
| anteaya | that is good | 15:35 |
| *** bobh has quit IRC | 15:38 | |
| openstackgerrit | Thierry Carrez proposed openstack/ptgbot master: Add channel feedback on 'book' command https://review.openstack.org/600100 | 15:39 |
| *** spartakos has joined #openstack-infra | 15:42 | |
| openstackgerrit | Merged openstack-infra/zuul master: Add container spec https://review.openstack.org/560136 | 15:42 |
| *** dave-mccowan has quit IRC | 15:44 | |
| *** ihar has joined #openstack-infra | 15:44 | |
| *** eernst has joined #openstack-infra | 15:45 | |
| AJaeger | infra-root, ianw has some changes up for variable naming policy on zuul-jobs. Anybody else wants to review, please? | 15:53 |
| AJaeger | infra-root, change is https://review.openstack.org/#/c/595920/ | 15:53 |
| *** dave-mccowan has joined #openstack-infra | 15:55 | |
| *** udesale_ has quit IRC | 15:55 | |
| *** yamamoto has quit IRC | 15:56 | |
| *** bobh has joined #openstack-infra | 15:56 | |
| *** jaosorior has joined #openstack-infra | 15:57 | |
| *** hasharAway is now known as hashar | 15:59 | |
| *** dtantsur|brb is now known as dtantsur | 16:01 | |
| *** markvoelker has quit IRC | 16:03 | |
| *** markvoelker has joined #openstack-infra | 16:04 | |
| *** camunoz has quit IRC | 16:04 | |
| *** jamesmcarthur has quit IRC | 16:04 | |
| *** spartakos has quit IRC | 16:05 | |
| *** spartakos has joined #openstack-infra | 16:05 | |
| *** dave-mcc_ has joined #openstack-infra | 16:05 | |
| AJaeger | config-core, next teams are ready with python3-first and we can now merge https://review.openstack.org/#/c/598620/ and https://review.openstack.org/#/c/598314/ - please review | 16:06 |
| *** dave-mccowan has quit IRC | 16:06 | |
| *** jamesmcarthur has joined #openstack-infra | 16:09 | |
| *** efried is now known as efried_rollin | 16:17 | |
| *** bobh has quit IRC | 16:19 | |
| clarkb | catching up on the clouds.yaml stuff I see an all-clouds.yaml on bridge.o.o now | 16:20 |
| clarkb | AJaeger: I'll review those momentarily | 16:21 |
| clarkb | just double checking the ansible changes from last night | 16:21 |
| *** jiapei has quit IRC | 16:22 | |
| *** tmorin has quit IRC | 16:23 | |
| *** jamesmcarthur has quit IRC | 16:23 | |
| cmurphy | clarkb: should I still be pushing the puppet-4 things or are we going full throttle on rewriting in ansible? | 16:26 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: add-build-sshkey: Remove only the master key https://review.openstack.org/599073 | 16:26 |
| cmurphy | it's a lot of work to keep rebasing groups.yaml changes | 16:26 |
| *** yamamoto has joined #openstack-infra | 16:27 | |
| *** shardy has quit IRC | 16:28 | |
| *** ginopc has quit IRC | 16:28 | |
| clarkb | cmurphy: we've been full steam on on getting bridge.openstack.org ansibled so that we can boot new instances and hte like. We haven't done much ansible to replace config for other services | 16:29 |
| clarkb | cmurphy: I expect we'll continue with the puppet work in parallel once bridge.openstack.org is configured properly (and I think it is very close at this point) | 16:30 |
| *** jpich has quit IRC | 16:30 | |
| clarkb | cmurphy: monty will return at the PTG, we can sync up there if you want to hold off on rebasing to avoid conflicts? | 16:31 |
| cmurphy | clarkb: sure | 16:33 |
| openstackgerrit | Merged openstack-infra/project-config master: remove job settings for adjutant repositories https://review.openstack.org/598620 | 16:34 |
| openstackgerrit | Merged openstack-infra/project-config master: remove job settings for Release Management repositories https://review.openstack.org/598314 | 16:34 |
| clarkb | fungi: reading the gpg doc, we are setting a passphrase on the signing key? we must pass that passphrase to the job along with the key itself? | 16:34 |
| *** bobh has joined #openstack-infra | 16:35 | |
| *** yamamoto has quit IRC | 16:35 | |
| fungi | clarkb: we strip the passphrase from the signing key in the temporary keychain and then export it from there | 16:35 |
| clarkb | ah | 16:35 |
| clarkb | haven't gotten that far yet | 16:36 |
| fungi | it's basically 1. generate new master key encrypted in persistent keychain, 2. create signing subkey for that master key, 3. export only the subkey and import into a temporary keychain, 4. unset the passphrase on the signing key in th etemporary keychain, 5. export the signing subkey from the temporary keychain, 6. encrypt the ascii-armored plaintext subkey blob for use by zuul as a secret | 16:37 |
| fungi | 7. securely delete the temporary keychain and associated temporary files | 16:38 |
| *** ramishra has quit IRC | 16:39 | |
| fungi | this ensures no keys/subkeys are ever stored unencrypted in the persistent keychain, and the only keys stored temporarily in plaintext are the signing subkeys | 16:39 |
| clarkb | and the biggest change in the process had to do with setting the empty passphrase on the temp key for the secret | 16:40 |
| clarkb | otherwise it appears to largely be order of operations in the process of creating keys and key size | 16:40 |
| fungi | yeah, courtesy of the separated pinentry implementation in gpg2 | 16:40 |
| AJaeger | thanks, clarkb | 16:40 |
| clarkb | fungi: we are ready to approve the secret update too right? main rocky release is behind us | 16:40 |
| fungi | this is basically a transition from gnupg 1.x to 2.x | 16:41 |
| AJaeger | clarkb, one more review request, please: ttx is not ready with removing odsreg - but we can continue with puppet-odsreg. Could you review https://review.openstack.org/#/c/599710/ and https://review.openstack.org/#/c/599700/ again, please? | 16:41 |
| fungi | clarkb: yes, i got the go-ahead from the release team last friday | 16:41 |
| clarkb | ya locally it spawns a xfce/gnome askpass for me I think | 16:41 |
| fungi | was hoping it would have been merged before the weekend, but i only really need to update the date on the releases change | 16:41 |
| fungi | so if it merges today, i'll update the effective date to today | 16:42 |
| clarkb | AJaeger: is there an ozj change to remove puppet-odsreg like the fix we had to make yesterday for puppet-vinz and others? | 16:42 |
| clarkb | git grep says it isn't in ozj | 16:43 |
| AJaeger | clarkb: already merged ;) | 16:43 |
| clarkb | perfect | 16:43 |
| AJaeger | clarkb: change Ia98095ac039c0e28b7eaf448a6a4845309997413 | 16:44 |
| clarkb | thanks | 16:44 |
| *** holser_ has quit IRC | 16:44 | |
| *** olivierb has quit IRC | 16:44 | |
| *** holser_ has joined #openstack-infra | 16:45 | |
| AJaeger | there are two more retirement changes in the queue - https://review.openstack.org/599241 and https://review.openstack.org/597018 - any config-core to review those? | 16:45 |
| *** holser_ has quit IRC | 16:46 | |
| AJaeger | And please review https://review.openstack.org/599553 - for python36 | 16:46 |
| *** hashar has quit IRC | 16:48 | |
| AJaeger | thanks, clarkb | 16:49 |
| *** armax has joined #openstack-infra | 16:50 | |
| AJaeger | config-core, these are also ready for merge : https://review.openstack.org/596874 https://review.openstack.org/598610 https://review.openstack.org/599547 https://review.openstack.org/599453 https://review.openstack.org/597168 https://review.openstack.org/599757 | 16:52 |
| openstackgerrit | Merged openstack-infra/project-config master: Replace the old Rocky cycle signing key with Stein https://review.openstack.org/599092 | 16:53 |
| openstackgerrit | Merged openstack-infra/project-config master: Retire puppet-odsreg (step 2) https://review.openstack.org/599700 | 16:55 |
| openstackgerrit | Merged openstack-infra/system-config master: Update artifact signing key generation process https://review.openstack.org/599094 | 16:57 |
| openstackgerrit | Merged openstack-infra/puppet-odsreg master: Retire puppet-odsreg https://review.openstack.org/599706 | 16:57 |
| openstackgerrit | Merged openstack-infra/project-config master: Retire openstack-chef-repo (step 2) https://review.openstack.org/599241 | 16:58 |
| openstackgerrit | Merged openstack-infra/project-config master: Retiring project Anchor https://review.openstack.org/597018 | 16:58 |
| *** anteaya has quit IRC | 16:58 | |
| clarkb | pabelanger: can we make the change to use-cached-repos quieter? http://logs.openstack.org/21/596421/20/check/test2/5f0c823/job-output.txt.gz#_2018-08-27_19_46_23_050914 compared to http://logs.openstack.org/21/596421/20/check/test1/569e3fd/job-output.txt.gz#_2018-08-27_19_42_20_967656 with the old code | 16:59 |
| dhellmann | clarkb , AJaeger : it seems from the ML discussion that you don't want to move the zuul settings for infra repos. Is that right? | 16:59 |
| clarkb | I don't think it needs to be as quiet as the old code, but we have many jobs that clone many repos and that is really verbose for that logging wise | 16:59 |
| clarkb | dhellmann: at least not right now. I think we'll do it where we find benefit but for the most part the same people revieiwng hte central config also review the infra repos so its very similar overhead to us | 17:00 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Add openstack-tox-functional-py36 job https://review.openstack.org/599553 | 17:00 |
| dhellmann | clarkb : yep, it makes sense, I just wanted to confirm before I drop infra from the tracking list | 17:00 |
| *** gfidente is now known as gfidente|afk | 17:00 | |
| *** derekh has quit IRC | 17:00 | |
| *** imacdonn has quit IRC | 17:00 | |
| clarkb | we also have a lot of non python jobs so tying it to python3 is also less important for us | 17:01 |
| *** e0ne has quit IRC | 17:02 | |
| *** hashar has joined #openstack-infra | 17:03 | |
| *** anteaya has joined #openstack-infra | 17:04 | |
| clarkb | AJaeger: https://review.openstack.org/#/c/599453/2 depends on is not merged yet, but I +2'd | 17:05 |
| AJaeger | clarkb: ok, thanks | 17:06 |
| AJaeger | infra-root, zuul-jobs is broken - I'm fixing right now... | 17:06 |
| clarkb | fungi: https://review.openstack.org/#/c/599757/1 is safe to change like this without human intervention right? it is only when the group name changes from one group to another that we need to update the db? | 17:07 |
| *** trown is now known as trown|lunch | 17:09 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul-jobs master: Add missing README.rst for roles https://review.openstack.org/600128 | 17:10 |
| *** hashar has quit IRC | 17:10 | |
| corvus | AJaeger: we can't remove roles/__init__.py -- it's needed for stestr | 17:11 |
| *** hashar has joined #openstack-infra | 17:11 | |
| fungi | clarkb: yep, it'll add the kayobe group if it doesn't already exist and add those two projects as members of it | 17:11 |
| fungi | renaming project groups (and projects) currently requires manual intervention | 17:12 |
| AJaeger | corvus: argh ;( Then building fails with current zuul-sphinx ;( | 17:12 |
| fungi | clarkb: removing projects from groups may also require manual intervention, i've never tested that | 17:12 |
| corvus | AJaeger: 1 sec | 17:12 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Turn of missing docs warnings temporarily https://review.openstack.org/600132 | 17:14 |
| corvus | AJaeger: ^ i think that's a temp fix until we fix zuul-sphinx to be smarter | 17:14 |
| AJaeger | corvus: thanks - I'll update my change then so that we have the READMEs in at least... | 17:15 |
| corvus | AJaeger: ++ | 17:15 |
| AJaeger | ianw: see above for a fallout from the zuul-sphinx change to check for README.rst ^ | 17:15 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul-jobs master: Add missing README.rst for roles https://review.openstack.org/600128 | 17:16 |
| AJaeger | corvus, updated ^ | 17:16 |
| *** hashar has quit IRC | 17:17 | |
| AJaeger | config-core, one more change for review - https://review.openstack.org/598477 removes a dead irc channel | 17:17 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul-jobs master: Add missing README.rst for roles https://review.openstack.org/600128 | 17:19 |
| openstackgerrit | Merged openstack-infra/project-config master: Switch to tempest-multinode-full job https://review.openstack.org/598610 | 17:19 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove job settings for metalsmith https://review.openstack.org/599547 | 17:19 |
| openstackgerrit | Merged openstack-infra/project-config master: Match older neutron dashboards to HEAD one, bump versions https://review.openstack.org/597168 | 17:19 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-sphinx master: Ignore non-directory entries in roles/ https://review.openstack.org/600135 | 17:19 |
| *** jamesmcarthur has joined #openstack-infra | 17:19 | |
| corvus | AJaeger, ianw: ^ i think that will fix it | 17:19 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Revert "Turn of missing docs warnings temporarily" https://review.openstack.org/600137 | 17:20 |
| openstackgerrit | Merged openstack-infra/project-config master: Retire puppet-odsreg (step 4) https://review.openstack.org/599710 | 17:21 |
| AJaeger | corvus, LGTM, thanks | 17:21 |
| *** dtantsur is now known as dtantsur|afk | 17:26 | |
| *** diablo_rojo has joined #openstack-infra | 17:30 | |
| *** anteaya has quit IRC | 17:31 | |
| *** olivierb has joined #openstack-infra | 17:31 | |
| *** sshnaidm is now known as sshnaidm|afk | 17:32 | |
| *** electrofelix has quit IRC | 17:32 | |
| *** yamamoto has joined #openstack-infra | 17:34 | |
| *** tesseract has quit IRC | 17:35 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Update params on get promocodes (CVS) https://review.openstack.org/600143 | 17:36 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Update params on get promocodes (CVS) https://review.openstack.org/600143 | 17:36 |
| *** anteaya has joined #openstack-infra | 17:37 | |
| *** olivierb has quit IRC | 17:38 | |
| *** emerson has joined #openstack-infra | 17:38 | |
| *** jpena is now known as jpena|off | 17:40 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add a group for kayobe projects https://review.openstack.org/599757 | 17:41 |
| corvus | clarkb: did you see https://review.openstack.org/599927 ? i know you checked on the current clouds.yaml status.... what's the situation? | 17:44 |
| *** ccamacho has quit IRC | 17:44 | |
| clarkb | oh I had only looked at bridge which does use a different set of values | 17:45 |
| clarkb | bridge looked fine | 17:45 |
| clarkb | how did that work in puppet? I copied the values over directly | 17:46 |
| clarkb | manifests/site.pp: $ovh_password = hiera('nodepool_ovh_password') there was a translation layer in puppet | 17:47 |
| corvus | https://git.openstack.org/cgit/openstack-infra/system-config/tree/manifests/site.pp#n800 | 17:47 |
| corvus | ya :) | 17:47 |
| clarkb | corvus: ianw's change lgtm | 17:47 |
| *** yboaron_ has joined #openstack-infra | 17:47 | |
| corvus | yeah, i think that's the best approach | 17:48 |
| corvus | clarkb: https://review.openstack.org/599884 is nice too | 17:48 |
| eernst | mnaser: ping? | 17:48 |
| eernst | Hey, heard graham was reaching out. Any chance you know a good POC for who is managing elasticdb/kibana @ OSF? | 17:49 |
| fungi | eernst: the community infra team here is managing an elasticsearch/kibana system. the osf doesn't really run anything like that | 17:51 |
| *** pcaruana has joined #openstack-infra | 17:52 | |
| *** camunoz has joined #openstack-infra | 17:52 | |
| fungi | eernst: though if this is in regard to your recent efforts on getting your third-party ci job logs published somewhere, you don't need anything so complex as elasticsearch/logstash for that | 17:52 |
| clarkb | corvus: 597728 should be ready too but waiting on new ci results now | 17:56 |
| fungi | eernst: oh, wait, you're working on kata right? i was thinking of starlingx third-party ci efforts. anyway if you want to know more about how we deploy and run our elk stack for http://logstash.openstack.org/ there's an overview at https://docs.openstack.org/infra/system-config/logstash.html | 17:59 |
| *** openstackgerrit has quit IRC | 18:00 | |
| eernst | okay, will take a look. Yes, I'm on Kata Containers, and we're looking for a place to host different metrics/CI information over time. | 18:00 |
| eernst | Will look at the link for Elk Stack....... | 18:00 |
| *** yamamoto has quit IRC | 18:01 | |
| *** hashar has joined #openstack-infra | 18:02 | |
| fungi | eernst: just to be clear, the osf doesn't really run any infrastructure at all except some informational/marketing sites, foundation membership management and event schedule apps... the community infrastructure is run and managed by the community members who hang out in this channel | 18:02 |
| fungi | (some of us are osf staff, but the vast majority are not) | 18:03 |
| *** eharney has quit IRC | 18:04 | |
| *** anteaya has quit IRC | 18:04 | |
| * mordred waves hello to people from an airplane | 18:04 | |
| *** hashar is now known as hasharAway | 18:04 | |
| * fungi waves hello to mordred's airplane | 18:04 | |
| *** anteaya has joined #openstack-infra | 18:05 | |
| persia | mordred: Remember that every hour you spend with network access in an airplane is an hour you don't get to bask in disconnected separation. | 18:05 |
| fungi | mordred: are you heading straight to denver or do you get a day at home first? | 18:05 |
| mordred | persia: yes indeed! however, after a week and a half of disconnected bliss having something to do on this flight is winning out :) | 18:07 |
| mordred | fungi: I get a day at home! | 18:07 |
| persia | Heh :) | 18:07 |
| mordred | persia: in the world of long and short flights - ICN-ATL isn't on the shorter end of the spectrum | 18:08 |
| clarkb | atlanta is not dallas | 18:08 |
| clarkb | if you were wondering | 18:09 |
| persia | When one starts from ICN, it may as well be :) | 18:09 |
| *** spartakos has quit IRC | 18:09 | |
| clarkb | mordred: we've done all sorts of exciting new things with bridge.openstack.org you'll be excited to find | 18:09 |
| mordred | yup to both | 18:09 |
| corvus | the bbq is completely different | 18:09 |
| * persia remembers boarding a NRT->JFK flight that terminated in ATL: it wasn't obvious to most fokl on the plane until the last hour or so before landing. | 18:09 | |
| *** d0ugal has quit IRC | 18:10 | |
| *** openstackgerrit has joined #openstack-infra | 18:10 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add ansible runtime script https://review.openstack.org/599943 | 18:10 |
| mordred | clarkb: neat! iI was just looking at a clouds.yaml related patch | 18:10 |
| clarkb | mordred: we spun up a new region in vexxhost and in the process discovered that clouds.yaml and cloud launcher needed doing on bridge.o.o | 18:10 |
| clarkb | ianw and corvus added testing too | 18:10 |
| *** jamesmcarthur has quit IRC | 18:11 | |
| corvus | yeah, we got the whole testinfra thing going | 18:11 |
| mordred | woot! that's super exciti | 18:12 |
| mordred | exciting | 18:12 |
| *** jamesmcarthur has joined #openstack-infra | 18:12 | |
| clarkb | mordred: we also discovered that the whole python3 vs python2 thing is maybe complicated | 18:12 |
| clarkb | currently dealing with that by installing python2 on xenial nodes | 18:13 |
| corvus | yeah, that's a thing where it'll be worth looping back on, cause i don't think things are working like we expected them to | 18:13 |
| mordred | oh good | 18:13 |
| mordred | I think it would be neat to not need to install python2 - but having things work is probably neater | 18:14 |
| clarkb | mordred: what we ran into is that you cannot collect facts to switch ansible_python_interpreter without a working findable python already | 18:14 |
| clarkb | and ansible won't try python3 if python/python2 does not exist | 18:15 |
| clarkb | apparently the next release may do this though | 18:15 |
| mordred | huh. how did I get bridge bootstrapped I wonder | 18:15 |
| clarkb | mordred: you just set that in host_vars for bridge | 18:15 |
| mordred | ah. yeah | 18:16 |
| *** yboaron_ has quit IRC | 18:16 | |
| clarkb | which we could do for all our nodes by setting all.yaml to python3 and then trusty and centos7 to python2 | 18:16 |
| *** yboaron_ has joined #openstack-infra | 18:16 | |
| *** jamesmcarthur has quit IRC | 18:16 | |
| clarkb | but then we wouldn't be able to use mitogen on xenial. (though I don't think we'll be doing that in the immediate future anyway) | 18:16 |
| *** trown|lunch is now known as trown | 18:17 | |
| *** e0ne has joined #openstack-infra | 18:18 | |
| corvus | basically, without ansible supporting a fallback, we just have to pick a default and manually set it for each exceptional host, right? | 18:18 |
| *** jamesmcarthur has joined #openstack-infra | 18:18 | |
| clarkb | corvus: yup | 18:18 |
| clarkb | apparently we might be able to hack something with the raw module too but that seems fragile | 18:19 |
| fungi | mordred: oh, also, the mitogen docs have an "importer wall of shame" where they totally dump on pbr. some confusing feedback but i think it's about the git fallback for missing metadata | 18:20 |
| mordred | heh. I'm SURE I'll enjoy that | 18:20 |
| fungi | they override version detection for pbr via the usual envvars to work around it | 18:20 |
| pabelanger | clarkb: not sure, I think that is zuul_console doing the extra verbose. Will see what no_log looks like, or atleast a flag for it | 18:21 |
| clarkb | fungi: my understanding of it is that mitogen runs code on the remote by shipping all the content over in memory so nothing is on disk on the remote. The problem with pbr is it tries to read the version info off of disk directly | 18:21 |
| clarkb | mordred: ^ | 18:21 |
| mordred | they should only have issues if they're installing pbr-based projects from github generated tarballs | 18:21 |
| mordred | ah | 18:21 |
| mordred | gotcha | 18:21 |
| fungi | mordred: apparently they also are unfond of any python module which attempts to import pkg_resources for similar reasons | 18:21 |
| clarkb | mordred: fungi the issue is not with git but with the pkg_resources bypass to read the package metdata file direclty off of disk | 18:21 |
| openstackgerrit | Merged openstack-infra/system-config master: Fix variable names in nodepool cloud config https://review.openstack.org/599927 | 18:21 |
| mordred | clarkb: yah. makes sense | 18:21 |
| fungi | ahh, yep | 18:22 |
| clarkb | but then pkg_resources is also a problem for similar reasons. My read of the complaint was if pbr used pkg_resources then they could monkey patch a single fix instead of having one specific to pbr | 18:22 |
| mordred | anybody remember wy we avoid pkg_resources ? | 18:22 |
| clarkb | I do not | 18:23 |
| clarkb | my guess is it is related to the major performance hit for doing so | 18:23 |
| corvus | so.... we are to feel "ashamed" because their *monkey patch* doesn't work? | 18:23 |
| clarkb | corvus: oui | 18:23 |
| corvus | i'm... going to go back to not saying anything about this. | 18:23 |
| *** dave-mcc_ is now known as dave-mccowan | 18:23 | |
| mordred | yeah. I'm not going to spend much mental energy on solving that 'shame' | 18:23 |
| clarkb | https://review.openstack.org/#/c/597728/3 is +1 from zuul now, reviews much appreciated (adds cloud launcher to bridge.o.o) | 18:24 |
| clarkb | hrm I guess I should add a testinfra test for the cron | 18:24 |
| clarkb | I'll work on that if people want to review what I do already have | 18:24 |
| corvus | clarkb: sounds good | 18:24 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove unused noop-jobs from stx https://review.openstack.org/600166 | 18:25 |
| AJaeger | dtroyer: ^ | 18:25 |
| corvus | clarkb: i left a comment on that change | 18:27 |
| *** Emine has joined #openstack-infra | 18:28 | |
| clarkb | corvus: hrm ya, maybe it is better to use fully qualified paths in the cron entries as much as possible | 18:29 |
| openstackgerrit | Merged openstack-infra/system-config master: Add some details for various cloud config files https://review.openstack.org/599884 | 18:29 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Run cloud launcher on bridge.o.o https://review.openstack.org/597728 | 18:30 |
| clarkb | that is just a rebase to make reviewing easier (I need to rebase to get testinfra reorg changes) | 18:30 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Updated endpoints POST/PUT track by summit https://review.openstack.org/600171 | 18:31 |
| *** yamamoto has joined #openstack-infra | 18:32 | |
| corvus | clarkb: i wonder what the path is needed for anyway? | 18:34 |
| corvus | flock and bash i guess? | 18:34 |
| *** jamesmcarthur has quit IRC | 18:35 | |
| *** priteau has quit IRC | 18:35 | |
| clarkb | corvus: ya, I'll add paths to them | 18:35 |
| *** priteau has joined #openstack-infra | 18:36 | |
| *** spartakos has joined #openstack-infra | 18:38 | |
| *** spartakos has quit IRC | 18:39 | |
| mordred | clarkb: the bash script might need path set to find the ansible-playbook command | 18:40 |
| *** spartakos has joined #openstack-infra | 18:40 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Run cloud launcher on bridge.o.o https://review.openstack.org/597728 | 18:40 |
| clarkb | the ansible-cron path definition should be global I think | 18:42 |
| clarkb | but ansible cron doesn't build in per entry path env vars like puppet does | 18:42 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Run cloud launcher on bridge.o.o https://review.openstack.org/597728 | 18:43 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Updated endpoints POST/PUT track by summit https://review.openstack.org/600171 | 18:43 |
| clarkb | that should be all PATH'd now and hav ea test. Assuming I got the stdout return type correct I expect that to work | 18:43 |
| mordred | clarkb: wow. that test infra test makes immediate sense to me | 18:48 |
| clarkb | mordred: ya the only weirdness we've run into is bytes vs strings because we python3 bridge.o.o | 18:49 |
| clarkb | oh and I think we found the parallel execution wasn't working as expected | 18:50 |
| clarkb | but that is fairly common | 18:50 |
| corvus | clarkb: parallel is incompatible with iptables | 18:51 |
| clarkb | corvus: I should update the update_cron_interval var to run_cloud_launcher_interval maybe? | 18:51 |
| clarkb | to be in line with role prefixed values? | 18:51 |
| * clarkb does this because it will irritate him otherwise | 18:51 | |
| corvus | clarkb: or maybe start with "cloud_launcher" but yeah | 18:51 |
| *** jamesmcarthur has joined #openstack-infra | 18:52 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Run cloud launcher on bridge.o.o https://review.openstack.org/597728 | 18:53 |
| clarkb | done | 18:53 |
| *** e0ne has quit IRC | 18:54 | |
| *** eharney has joined #openstack-infra | 19:00 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove unused noop-jobs from stx https://review.openstack.org/600166 | 19:02 |
| *** r-daneel has quit IRC | 19:03 | |
| *** jtomasek has quit IRC | 19:04 | |
| *** r-daneel has joined #openstack-infra | 19:05 | |
| *** yamamoto has quit IRC | 19:07 | |
| clarkb | zuul is very busy today | 19:11 |
| *** e0ne has joined #openstack-infra | 19:18 | |
| *** jamesmcarthur has quit IRC | 19:22 | |
| pabelanger | clarkb: we are getting a high number of errors launching nodes in nodepool: http://grafana.openstack.org/dashboard/db/nodepool so down in some capacity | 19:22 |
| pabelanger | limestone is erroring again | 19:23 |
| *** jamesmcarthur has joined #openstack-infra | 19:23 | |
| pabelanger | and packethost seems to still have quota issue | 19:23 |
| clarkb | pabelanger: I think we are still using the vast majority of our available quota though | 19:23 |
| pabelanger | yah, limestone is 50% and packethost seems to be 33% | 19:24 |
| mgagne | and inap-mtl01 still disabled =) | 19:25 |
| pabelanger | oh, right | 19:25 |
| mgagne | we are also taking the opportunity to upgrade some compute nodes | 19:25 |
| mgagne | more update | 19:25 |
| clarkb | no rush, the system is built to handle these sorts of things, just slows down overall throughput slightly | 19:26 |
| mgagne | +1 | 19:26 |
| pabelanger | ++ | 19:26 |
| openstackgerrit | Merged openstack-infra/zuul-sphinx master: Ignore non-directory entries in roles/ https://review.openstack.org/600135 | 19:28 |
| *** jamesmcarthur has quit IRC | 19:28 | |
| AJaeger | corvus: want to make a new release of zuul-sphinx - or wait for https://review.openstack.org/600132 ? | 19:30 |
| clarkb | oh does that neeed a new release? | 19:30 |
| *** jamesmcarthur has joined #openstack-infra | 19:30 | |
| clarkb | I mentioned in #zuul that we should be able to move forward on https://review.openstack.org/#/c/600137/1 | 19:30 |
| AJaeger | clarkb: we need https://review.openstack.org/600128 as well | 19:31 |
| AJaeger | clarkb: we didn't merge https://review.openstack.org/600132 at all | 19:31 |
| clarkb | ah it never even merged the whole stack, well in any case the zuul-sphinx change is merged | 19:31 |
| *** efried_rollin is now known as efried | 19:31 | |
| AJaeger | clarkb: I think we install zuul-sphinx from pypi | 19:32 |
| clarkb | yes I think that is correct. maybe we should just drop the undo and revert and make a zuul-sphinx release then merge the readme fixes? | 19:32 |
| AJaeger | So, we could abandon 600132 and 600137 - and rebase 600128. But first need a release | 19:32 |
| clarkb | yup | 19:32 |
| AJaeger | Or merge 600132, then 600128, then 600137 - and don't need a release | 19:33 |
| clarkb | we need a release before 600137 right? | 19:33 |
| clarkb | the __init__.py thing is what we need a fix for | 19:33 |
| *** d0ugal has joined #openstack-infra | 19:33 | |
| clarkb | in addition to adding the readme files | 19:33 |
| AJaeger | yes, a release before 600137 either way | 19:34 |
| AJaeger | I would prefer release, abandon 132 and 137 - and merge 128 | 19:34 |
| clarkb | ++ | 19:34 |
| clarkb | corvus is going to make a release I think (based on #zuul) | 19:35 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/zuul-jobs master: Add missing README.rst for roles https://review.openstack.org/600128 | 19:35 |
| *** d0ugal_ has joined #openstack-infra | 19:36 | |
| AJaeger | clarkb: thanks - I joined #zuul now | 19:36 |
| *** ijw has joined #openstack-infra | 19:37 | |
| *** d0ugal has quit IRC | 19:37 | |
| *** wolverineav has quit IRC | 19:37 | |
| *** wolverineav has joined #openstack-infra | 19:38 | |
| *** anteaya has quit IRC | 19:39 | |
| *** anteaya has joined #openstack-infra | 19:40 | |
| *** holser_ has joined #openstack-infra | 19:42 | |
| *** wolverineav has quit IRC | 19:43 | |
| *** holser_ has quit IRC | 19:43 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient master: Add a route to redirect from a Task ID to the relevant Story https://review.openstack.org/589652 | 19:45 |
| * clarkb finds lunch | 19:47 | |
| *** jcoufal has joined #openstack-infra | 19:47 | |
| *** r-daneel_ has joined #openstack-infra | 19:48 | |
| *** r-daneel has quit IRC | 19:49 | |
| *** r-daneel_ is now known as r-daneel | 19:49 | |
| *** ijw has quit IRC | 19:49 | |
| *** ijw has joined #openstack-infra | 19:50 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient master: Support Task ID in the "Jump to..." box https://review.openstack.org/589653 | 19:52 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient master: Fix the background colour of comments https://review.openstack.org/599182 | 19:54 |
| *** ijw has quit IRC | 19:57 | |
| mordred | you know it's a long day when you're flying over alberta on your way to atlanta and it feels like you're "almost" back to dallas | 19:59 |
| clarkb | same continent at least | 20:00 |
| mordred | yah | 20:00 |
| corvus | mordred: wow. yeah, thinking about that is making me twitch | 20:00 |
| mordred | SGN-ICN-ATL-DFW is ... well, it's not a quick trip | 20:00 |
| *** yboaron_ has quit IRC | 20:00 | |
| *** hasharAway has quit IRC | 20:00 | |
| corvus | mordred, clarkb: the zuul per-project key stuff has landed... when should we restart zuul? | 20:00 |
| corvus | i'd say "now" but it seems busy... | 20:00 |
| mordred | corvus: how about "now" for some value of "now" that's maybe later when it's less busy | 20:01 |
| corvus | ohh... you mean $now | 20:01 |
| mordred | and now I'm over Saskatchewan | 20:02 |
| mordred | even closer | 20:02 |
| *** ijw has joined #openstack-infra | 20:05 | |
| *** jcoufal has quit IRC | 20:07 | |
| *** wolverineav has joined #openstack-infra | 20:08 | |
| *** e0ne has quit IRC | 20:08 | |
| clarkb | corvus: does system-config-run-base run the test_bridge.py tests? | 20:09 |
| corvus | should yes | 20:09 |
| clarkb | looks like it does but double checking | 20:09 |
| clarkb | thanks | 20:09 |
| corvus | clarkb: way it works now is that all the 'run' jobs run all the testinfra tests, but each testinfra file selects which hosts it runs on | 20:10 |
| clarkb | and it will noop if that host isn't present in the inventory right? | 20:10 |
| corvus | so you can just match hostnames at the top of each file to say 'these tests apply to this host' | 20:10 |
| corvus | yep | 20:10 |
| mordred | corvus, clarkb: we seem dangerously close with the zuul restart to being in a position to run ansible from zuul instead of cron aren't we? | 20:11 |
| clarkb | mordred: yes | 20:12 |
| mordred | tat's so exciting | 20:12 |
| *** wolverineav has quit IRC | 20:13 | |
| corvus | mordred: yeah, we might want to lift the add_host restriction too. then we should be able to do it all in an untrusted project | 20:13 |
| corvus | i don't think there's a patch for that yet | 20:13 |
| *** holser_ has joined #openstack-infra | 20:18 | |
| *** tonytan4ever has joined #openstack-infra | 20:28 | |
| AJaeger | config-core, https://review.openstack.org/600166 removes a couple of noop-jobs templates for stx - the repos are set up with in-repo .zuul.yaml files now. Could you review, please? | 20:29 |
| pabelanger | +3 | 20:31 |
| AJaeger | thanks! | 20:31 |
| clarkb | testinfra file contents are bytes but process stdout is string http://logs.openstack.org/28/597728/7/check/system-config-run-base/485c94f/job-output.txt.gz#_2018-09-05_20_30_11_104602 | 20:32 |
| clarkb | the more you know | 20:32 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Run cloud launcher on bridge.o.o https://review.openstack.org/597728 | 20:33 |
| clarkb | I hvae high hopes for ^ now | 20:33 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Remove restriction on add_host https://review.openstack.org/600205 | 20:35 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove unused noop-jobs from stx https://review.openstack.org/600166 | 20:39 |
| *** pcaruana has quit IRC | 20:40 | |
| *** jamesmcarthur has quit IRC | 20:41 | |
| openstackgerrit | Nate Johnston proposed openstack-infra/project-config master: Change neutron grafana dashboard to 2-column format https://review.openstack.org/600240 | 20:43 |
| *** jamesmcarthur has joined #openstack-infra | 20:43 | |
| *** bobh has quit IRC | 20:44 | |
| *** bobh has joined #openstack-infra | 20:44 | |
| *** ansmith has quit IRC | 20:46 | |
| *** jamesmcarthur_ has joined #openstack-infra | 20:47 | |
| *** jamesmcarthur has quit IRC | 20:48 | |
| *** diablo_rojo has quit IRC | 20:49 | |
| *** anteaya has quit IRC | 20:51 | |
| *** holser_ has quit IRC | 20:52 | |
| *** anteaya has joined #openstack-infra | 20:52 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Stop requiring users be registered on openstack channels https://review.openstack.org/600251 | 20:52 |
| clarkb | infra-root ^ I think we should move ahead with that tomorrow if we continue to not get hit by spam | 20:53 |
| ianw | corvus: oops, thanks ... i did some co-install testing but probably should have done that with zuul-jobs too | 20:53 |
| corvus | ianw: np, no reason you should expect to have a __init__.py in that dir :) | 20:53 |
| *** sshnaidm|afk has quit IRC | 20:54 | |
| *** kgiusti has left #openstack-infra | 20:59 | |
| *** sshnaidm has joined #openstack-infra | 21:00 | |
| *** sshnaidm has quit IRC | 21:01 | |
| *** anteaya has quit IRC | 21:01 | |
| *** anteaya has joined #openstack-infra | 21:01 | |
| *** trown is now known as trown|outtypewww | 21:03 | |
| *** diablo_rojo has joined #openstack-infra | 21:03 | |
| *** bobh has quit IRC | 21:03 | |
| *** yamamoto has joined #openstack-infra | 21:06 | |
| openstackgerrit | Guillaume Roy-Babin proposed openstack-infra/project-config master: Revert "Disable inap-mtl01 provider" https://review.openstack.org/600254 | 21:07 |
| corvus | maybe we should direct-enqueue that? | 21:08 |
| clarkb | corvus: ++ | 21:08 |
| clarkb | mgagne: I've approved ^ we are good to go on it now right? | 21:08 |
| clarkb | I can enqueue it | 21:08 |
| mgagne | yep, +1 the changed | 21:09 |
| corvus | clarkb: i've got the cmd line standing by :) | 21:09 |
| *** r-daneel has quit IRC | 21:09 | |
| mgagne | Guillaume is a coworker at INAP | 21:09 |
| corvus | done | 21:09 |
| clarkb | corvus: thanks | 21:09 |
| ianw | corvus/clarkb: did you see the run results on 599943 http://paste.openstack.org/show/729549/ ? i can't quite determine what happened | 21:11 |
| corvus | ianw: i saw your comment but hadn't looked into it. think we should? | 21:12 |
| corvus | of course you do that's a dumb question | 21:12 |
| corvus | i think i really meant to ask if you wanted me to help dig into it :) | 21:12 |
| clarkb | ianw: I had read it and think it was too early in the morning to parse what the data was trying to tell me | 21:13 |
| ianw | heh, well i got to the point of extracting the two runs | 21:13 |
| clarkb | first column is total time, second is end time, then lsat is commit it ran with right? | 21:14 |
| ianw | http://people.redhat.com/~iwienand/599943/long.txt & http://people.redhat.com/~iwienand/599943/short.txt | 21:14 |
| ianw | clarkb: it *should* be what the HEAD of system-config was at the time it started; i hope. that seems to be a harder thing in git to determine than you'd hope | 21:14 |
| corvus | ianw: i wonder about the forks thing though -- you said that the first long run missed that change by a few mins, but that's determined by git commit timestamps -- that may not be accurate | 21:14 |
| corvus | yeah, it's not really possible. you can determine it with the help of gerrit. | 21:15 |
| corvus | but maybe we should have run_all.sh emit the commit sha | 21:15 |
| corvus | then we'll be sure | 21:15 |
| clarkb | corvus: ++ | 21:15 |
| corvus | (the pathological case, btw, is a fast-forward commit that sits in review for a long time. there's no way to determine in git when that merged) | 21:16 |
| corvus | only merge commits come close | 21:16 |
| *** gfidente|afk has quit IRC | 21:16 | |
| ianw | one thing in http://people.redhat.com/~iwienand/599943/long.txt -- if you search for "Delete old users" it doesn't appear in the little summary section | 21:16 |
| corvus | that makes me wonder if the forks change failed | 21:16 |
| ianw | i wonder if that's an ansible bug | 21:16 |
| openstackgerrit | Merged openstack-infra/project-config master: Revert "Disable inap-mtl01 provider" https://review.openstack.org/600254 | 21:17 |
| ianw | coruvs: my thinking was if the timestamp on that was 00:01 then it couldn't have merged *before* the 00:00 run? | 21:17 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Fix ansible forks env variable https://review.openstack.org/600255 | 21:17 |
| corvus | ianw, clarkb: almost like, i dunno, the setting didn't take effect at all? ^ | 21:17 |
| corvus | Zuul: Change has been successfully merged by Zuul (2018-09-05 00:01:51+0000) | 21:18 |
| clarkb | oh right | 21:18 |
| clarkb | won't be exposed to the child processes without that, good to know that there is a performance impact (even if in the wrong direction) | 21:19 |
| *** david-lyle has joined #openstack-infra | 21:19 | |
| corvus | yeah 5 -> 20 forks ~= 65 -> 45 mins | 21:19 |
| ianw | hrm, if that applied to the 2018-09-05 00:00:01 run i'm not sure how | 21:20 |
| corvus | yeah, i'm still puzzling that one out | 21:21 |
| *** jesusaur has quit IRC | 21:22 | |
| *** dklyle has quit IRC | 21:22 | |
| *** jesusaur has joined #openstack-infra | 21:22 | |
| *** r-daneel has joined #openstack-infra | 21:24 | |
| corvus | pabelanger: what does all this mean? http://paste.openstack.org/show/729550/ | 21:26 |
| corvus | large sections of the ansible logs are just timestamps with no context | 21:27 |
| *** agopi is now known as agopi|brb | 21:28 | |
| *** anteaya has quit IRC | 21:29 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Up profiled tasks limit https://review.openstack.org/600256 | 21:29 |
| pabelanger | corvus: I think that is the timestamps each host in the play ran the task but agree, it doesn't really express that well for some reason | 21:30 |
| clarkb | corvus: aiui that is each task completing on different nodes. first column is time now, then data in parens is how long task took and last column is time since playbook start iirc | 21:30 |
| *** anteaya has joined #openstack-infra | 21:30 | |
| corvus | ianw: the update of system-config happened at 00:00:17; so i also don't have an explanation for how it would have been used in that run. yet it seems the most likely explanation. | 21:30 |
| *** aeng has joined #openstack-infra | 21:30 | |
| *** agopi|brb has quit IRC | 21:31 | |
| ianw | corvus/clarkb: ^^ so that explains i think why the profile sections aren't matching up. personally i think i'd sort the output then cull to N, but it appears to trim to a rand() selection | 21:31 |
| corvus | :( makes the log super hard to read | 21:31 |
| *** agopi|brb has joined #openstack-infra | 21:31 | |
| corvus | ianw: it's not sorted? | 21:31 |
| corvus | ianw: oh, you're saying it's culled, then sorted? | 21:32 |
| pabelanger | I have to step away for family time, but if we want to revert the callback plugins because confusing I am okay with that | 21:32 |
| corvus | pabelanger: i really like the summaries | 21:32 |
| clarkb | corvus: the summaries are nice and come from the other plugin so I think we can just disable the one plugin | 21:33 |
| ianw | corvus: i don't know how they do it, but it appears they don't sort, then cull. in http://people.redhat.com/~iwienand/599943/long.txt if you search for "Add users ---" ... "Delete old users" task doesn't appear in that list, and it's 20 entries long (the default) | 21:33 |
| corvus | oh i thought they were both one | 21:33 |
| * clarkb sorts out which is which | 21:33 | |
| ianw | it's "profile_tasks" and "timer" | 21:34 |
| clarkb | corvus: I think profile_tasks is the one to remove, timer does the summaries | 21:34 |
| ianw | oh, that's what's doing the little summary sections, which i think are quite useful | 21:35 |
| ianw | hrm, maybe you can't have the summary without all the header stuff too | 21:35 |
| *** agopi|brb has quit IRC | 21:37 | |
| corvus | "Playbook run took 0 days, 0 hours, 0 minutes, 14 seconds" <-- is that timer? | 21:37 |
| fungi | okay, done eating, catching up again | 21:37 |
| corvus | and everything else is profile_tasks? | 21:37 |
| *** boden has quit IRC | 21:37 | |
| clarkb | oh that may be, that is unfortunate | 21:38 |
| corvus | if so, the timestamp spam is (for the moment at least) worth suffering through to get the profile info. | 21:38 |
| corvus | "Mashup of 2 excellent original works: https://github.com/jlafon/ansible-profile, https://github.com/junaid18183/ansible_home/blob/master/ansible_plugins/callback_plugins/timestamp.py.old" | 21:38 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Added new endpoint get track tag group allowed tags per Summit https://review.openstack.org/600259 | 21:38 |
| corvus | may i please have the non-mashed-up version? kthx | 21:38 |
| *** kjackal has quit IRC | 21:39 | |
| corvus | from https://docs.ansible.com/ansible/2.5/plugins/callback/profile_tasks.html | 21:39 |
| ianw | i think a pull request for a flag "summary_only" is probably on the cards | 21:40 |
| corvus | ++ | 21:40 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Added new endpoint get track tag group allowed tags per Summit https://review.openstack.org/600259 | 21:40 |
| corvus | "Patches usually take 3 to 7 days to be reviewed" ... apparently enabling cloud resources is the exception to that; those patches may merge in less than 10 minutes. :) | 21:42 |
| *** takamatsu has quit IRC | 21:42 | |
| *** bobh has joined #openstack-infra | 21:43 | |
| clarkb | https://review.openstack.org/#/c/597728/ it works! and is tested now. | 21:44 |
| clarkb | ianw: corvus any reason to not approve the forks fix? | 21:45 |
| *** jamesmcarthur_ has quit IRC | 21:46 | |
| ianw | nope; can monitor runs and see what happens | 21:47 |
| ianw | if nothing else we've got a few more ideas for helping us keep track of it longer term | 21:48 |
| clarkb | ok approved | 21:48 |
| *** wolverineav has joined #openstack-infra | 21:50 | |
| *** jamesmcarthur has joined #openstack-infra | 21:51 | |
| *** rfolco has quit IRC | 21:52 | |
| corvus | oh, run-nodepool didn't land yet. i just approved. | 21:53 |
| corvus | https://review.openstack.org/598403 | 21:53 |
| *** jamesmcarthur has quit IRC | 21:55 | |
| corvus | this happened on ovh-bhs1: http://logs.openstack.org/28/600128/4/check/openstack-infra-multinode-integration-fedora-latest/d0e4793/job-output.txt.gz#_2018-09-05_21_43_25_292172 | 21:55 |
| corvus | 2018-09-05 21:43:26.376876 | secondary | "msg": "No viable v4 or v6 route found to git.openstack.org. The build node is assumed to be invalid." | 21:55 |
| clarkb | corvus: that is our long standing fedora issue I think | 21:56 |
| *** slaweq has quit IRC | 21:56 | |
| *** priteau has quit IRC | 21:56 | |
| corvus | clarkb: can you, uh, remind me of that? | 21:56 |
| corvus | it was on fedora yes | 21:56 |
| clarkb | corvus: well we don't know much, pabelange rthought it was related to when we were restarting unbound to pick up the resolver config changes there so we changed our handler execution order for unbound | 21:57 |
| clarkb | I think pabelanger thought that had improved the problem but ^ implies otherwise | 21:57 |
| clarkb | let me see if I can find that change | 21:57 |
| corvus | hrm. we don't seem to actually record what the error is | 21:59 |
| clarkb | corvus: I think ianw has a change to do that proposed | 21:59 |
| clarkb | which was where the split of inventory copying and host info came out of so we could test that more eaisly | 22:00 |
| clarkb | corvus: https://review.openstack.org/#/c/587246/ is pabelangers change | 22:00 |
| clarkb | corvus: https://review.openstack.org/#/c/576351/ | 22:01 |
| clarkb | base-test should test ^ now | 22:02 |
| clarkb | I think if we recheck we'll be able to test that it doesn't break anything? | 22:02 |
| corvus | clarkb: i think the depends-on caused it to already be tested? | 22:02 |
| clarkb | corvus: it may not have because old validate-host was post merge updates only due to the inventory copy, looking at timestamps I'm not sure the tests that ran there ran in the newer case where validate-host can run regularly? | 22:04 |
| clarkb | hrm though its in zuul-jobs so it must have | 22:04 |
| clarkb | this gets complicated with the relationship between the role and the job, but I think you are right it must've run properly there | 22:04 |
| corvus | clarkb: regardless of where we normally call validate host, the depends-on should have caused that test to run in the openstack-infra-base-integration-* jobs which ran on the change | 22:05 |
| clarkb | we also have gate testing which will run it all through again | 22:06 |
| *** sshnaidm has joined #openstack-infra | 22:06 | |
| clarkb | I've approved it | 22:06 |
| corvus | cool | 22:06 |
| *** bobh has quit IRC | 22:06 | |
| *** sshnaidm is now known as sshnaidm|off | 22:08 | |
| *** anteaya has quit IRC | 22:09 | |
| *** anteaya has joined #openstack-infra | 22:10 | |
| clarkb | 600255 failed a centos puppet check :/ | 22:11 |
| *** slaweq has joined #openstack-infra | 22:11 | |
| corvus | when did devstack branch rocky? | 22:12 |
| ianw | clarkb: i saw that yesterday ... was it 26/27 ? | 22:12 |
| eernst | (sorry I had stepped away for a while -- fungi thanks for the clarification. words matter, and I understand OSF wasn't the right word to use there - thanks for your help and patience :)) | 22:14 |
| clarkb | ianw: http://logs.openstack.org/55/600255/1/check/infra-puppet-apply-4-centos-7/e2174a5/job-output.txt.gz#_2018-09-05_22_05_59_068096 failures copying puppet modules? | 22:14 |
| *** ijw has quit IRC | 22:15 | |
| ianw | clarkb: yeah, so i think that starts at http://logs.openstack.org/55/600255/1/check/infra-puppet-apply-4-centos-7/e2174a5/job-output.txt.gz#_2018-09-05_22_05_48_000957 where xargs runs the tests in parallel | 22:15 |
| *** slaweq has quit IRC | 22:16 | |
| ianw | i suspect that it's a bit racy, or we've got a bit of a thundering heard that sometimes hits a failure | 22:17 |
| *** Emine has quit IRC | 22:17 | |
| clarkb | oh ya you can see multiple hosts do it at the same time based on timestamps. "hosts" | 22:18 |
| *** mriedem has quit IRC | 22:18 | |
| clarkb | I guess rsync isn't safe in parallel | 22:19 |
| clarkb | (seems like we ran into similar copying docs into afs in the post pipeline where rsync uses tmp files that conflict and one half will fail because the tmp file is gone when it goes to copy it) | 22:19 |
| clarkb | fungi: ^ do you remember if there was a workaround for that? | 22:19 |
| ianw | is it loopback? it's not a multinode test is it? | 22:19 |
| clarkb | ianw: correct, one system with many puppet applies against logical hosts | 22:20 |
| clarkb | but reality is all one filesystem on one system | 22:20 |
| ianw | right, so running in parallel probably is of minimal benefit | 22:20 |
| clarkb | it actually does speed up the runs quite a bit since puppet is single threaded | 22:21 |
| clarkb | I wonder if we copy the puppet modules out of band first if that would make the subsequent rsyncs reliable as they should all hash and noop | 22:21 |
| notmyname | does zuul do special things if a job has a certain name pattern? (eg "name: foo-bar-test-base") | 22:21 |
| clarkb | notmyname: no, behavior isn't based on name data | 22:21 |
| clarkb | ianw: does a hack like that seem reasonable to you? | 22:22 |
| *** rh-jelabarre has quit IRC | 22:22 | |
| notmyname | clarkb: thanks. I'm trying to understand why https://review.openstack.org/#/c/600152/3/.zuul.yaml doesn't cause a "swift-dsvm-functional-base" job to run | 22:22 |
| notmyname | oh wait! it's because of the list of gate and check jobs, isn't it? | 22:23 |
| clarkb | ianw: hrm nevermind we already do a single puppet apply before the xargs invocation which should mean all the files are copied already | 22:23 |
| notmyname | so just defining a job doesn't do anything | 22:23 |
| ianw | clarkb: hrm, yes ... but let me find scrollback, i think the one yesterday was a failure to ssh in | 22:23 |
| clarkb | notmyname: correct | 22:23 |
| notmyname | you also have to reference it in a project queue | 22:23 |
| notmyname | clarkb: thanks | 22:23 |
| tonyb | pabelanger: Okay | 22:24 |
| ianw | clarkb: no, http://logs.openstack.org/78/598378/1/gate/infra-puppet-apply-4-centos-7/6bae404/job-output.txt.gz#_2018-09-04_22_58_44_782100 is yesterdays. closer inspection seems to be same issue | 22:25 |
| tonyb | pabelanger, mordred: I'd rather not do it but it needs to be done and if there isn't another person on the hot seat I guess I'll do it if y'all can provide pointers/docs | 22:26 |
| clarkb | tonyb: I'm lacking context, but what needs doing? | 22:26 |
| fungi | clarkb: ianw: yeah by default the tempfiles are created alongside the actual files for some guarantee of atomicity, but that means if you have two rsync runs operating on the same tree and are using --delete or similar, you can end up removing tempfiles for another current run in progress | 22:27 |
| tonyb | clarkb: Running the poll for the T release name. | 22:27 |
| clarkb | fungi: I expect that is what is happening here, but we should be rsyncing after a complete rsync meaning its a noop | 22:27 |
| fungi | there are rsync options to tell it to use a different location for tempfiles. also --delete-after might help | 22:27 |
| tonyb | clarkb: we're pretty close to starting to need that thing and I can't keep using 'train' as a substitute ;P | 22:28 |
| clarkb | tonyb: gotcha | 22:28 |
| fungi | though i guess --delete-after still risks removing the tempfiles just not as much the directories containing them | 22:28 |
| clarkb | tonyb: honestly train is a good choice givne the location | 22:28 |
| clarkb | tonyb: we should make a motion to just vote on that :) | 22:28 |
| tonyb | clarkb: we'll see what the polls say ;P | 22:29 |
| tonyb | clarkb: I'm not sure if it's a TC thing or a board thing. | 22:29 |
| clarkb | I want to say the grizzly exception was a TC thing | 22:29 |
| tonyb | I guess with the TC election comming up we probably won't make a decision until after | 22:30 |
| fungi | tc exception | 22:30 |
| fungi | but also i think train is a foregone conclusion for denver | 22:30 |
| tonyb | okay so I'll run up a motion ;P | 22:31 |
| ianw | fungi: it also appears to only have triggered on centos, so it may be something weird with the rsync there | 22:31 |
| corvus | fungi, tonyb: see the exception after item 4 at https://governance.openstack.org/tc/reference/release-naming.html#release-name-criteria | 22:31 |
| corvus | just add it to the "sounds really cool" section of the etherpad for the tc to consider :) | 22:32 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Check how slow puppet apply testing is when run serially https://review.openstack.org/600270 | 22:32 |
| clarkb | ianw: fungi ^ thats a sanity check that we actually do want to keep running it in parallel | 22:32 |
| corvus | tonyb: and... if you're running the show, you're the one who's responsible for presenting the really cool names to the tc :) | 22:32 |
| tonyb | corvus: there is an etherpad? | 22:32 |
| clarkb | fungi: thing is denver ptg is only ~500 people I guessa fter two the number may go upt to ~700 unique individuals? but name voting is much broader | 22:33 |
| corvus | tonyb: there will be as soon as the election official sets it up | 22:33 |
| clarkb | however only ~200 voted on stein irc | 22:33 |
| corvus | tonyb: the process starts with a change to that file to add T to the table | 22:33 |
| corvus | you can nominate yourself as the coordinator | 22:33 |
| fungi | yeah, for stein we limited voting to technical contributors or something | 22:33 |
| fungi | pabelanger: would likely remember | 22:34 |
| clarkb | stein was open publicly | 22:34 |
| clarkb | so rather tha ngetting an explicit email saying go vote the url just went to hte mailing list | 22:34 |
| fungi | ahh | 22:34 |
| fungi | that's what it was | 22:34 |
| tonyb | Yeah that thing | 22:34 |
| fungi | now i remember, yes | 22:34 |
| tonyb | corvus: Are there any docs on the process? I suspect there is a bunch of stuff that happens behind the scenes that I'm unaware of | 22:35 |
| tonyb | but I can nominate myself | 22:35 |
| clarkb | tonyb: I think the poll itself has flexibility as with pabelanger's for stein | 22:36 |
| clarkb | but then we give the ordered list of nominations to the foundation who hand it to trademark checker lawyers | 22:36 |
| clarkb | and highest pick that comes back clear wins iirc | 22:36 |
| corvus | tonyb: the docs are all https://governance.openstack.org/tc/reference/release-naming.html -- the mechanics are basically that you propose a change to add a new row to the table at the bottom there, and then you set up the etherpad and poll | 22:36 |
| tonyb | clarkb: I ewas thinking about colelcting names, durations communications with trhe OSF fro trademark vetting etc etc | 22:36 |
| tonyb | corvus: Oh okay. | 22:36 |
| *** anteaya has quit IRC | 22:37 | |
| corvus | yeah, the coordinator basically does all the steps in https://governance.openstack.org/tc/reference/release-naming.html#release-naming-process | 22:37 |
| corvus | i guess that should be amended if we want to only send the notification to openstack-dev. | 22:38 |
| tonyb | I'll do the needful this week, and set it up so that the name collection phase matches the time I'm AFK and then pick it back up after that | 22:38 |
| *** anteaya has joined #openstack-infra | 22:38 | |
| corvus | tonyb: cool :) | 22:38 |
| tonyb | I'll make sure that my AFKness is included in the self-nomination so if it's a problem it will be caught then | 22:38 |
| corvus | where's the post-berlin summit? | 22:39 |
| corvus | oh. | 22:40 |
| *** rcernin has joined #openstack-infra | 22:43 | |
| tonyb | corvus: Denver | 22:44 |
| tonyb | corvus: hence train ;P | 22:44 |
| *** r-daneel has quit IRC | 22:45 | |
| *** wolverineav has quit IRC | 22:46 | |
| *** wolverineav has joined #openstack-infra | 22:46 | |
| clarkb | https://review.openstack.org/#/c/598403/9 failing now because limestone_foo is not defined which is correct because now it is nodepool_limestone_foo | 22:49 |
| clarkb | oh I see the bug ugh | 22:49 |
| corvus | yeah, really shoulda merged that change earlier :) | 22:50 |
| *** wolverineav has quit IRC | 22:51 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Add a run-nodepool job https://review.openstack.org/598403 | 22:51 |
| clarkb | thats a rebase for clarity | 22:51 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Add a run-nodepool job https://review.openstack.org/598403 | 22:52 |
| clarkb | and fixed | 22:52 |
| clarkb | ianw: ^ might want to quickly rereview that one so we can get it in | 22:53 |
| clarkb | corvus: I think we are probably at the point of having enough example test infrastructure (for secrets and specific nodes, etc) that we should just start requiring tests in changes | 22:55 |
| corvus | yep | 22:55 |
| *** jamesmcarthur has joined #openstack-infra | 22:57 | |
| *** yamamoto has quit IRC | 22:59 | |
| ianw | clarkb: i wasn't sure if we wanted to do more with that one before merging | 23:01 |
| *** jamesmcarthur has quit IRC | 23:01 | |
| clarkb | ah I think we can merge it now, it fixes what would be an ongoing issue with the config at this point too | 23:01 |
| clarkb | ianw: your fix for the nodepool_ prefix missed an entry (then I missed that in review :( ) | 23:02 |
| ianw | oh i see that's in there, LGTM | 23:03 |
| *** anteaya has quit IRC | 23:04 | |
| *** anteaya has joined #openstack-infra | 23:04 | |
| *** slaweq has joined #openstack-infra | 23:11 | |
| *** agopi|brb has joined #openstack-infra | 23:14 | |
| *** slaweq has quit IRC | 23:15 | |
| *** ijw has joined #openstack-infra | 23:16 | |
| *** ijw has quit IRC | 23:22 | |
| clarkb | the forks fix has entered the gate | 23:24 |
| clarkb | mgagne: fyi there are timeouts deleting instances in inap now | 23:31 |
| clarkb | mgagne: seems like something is unhappy after turning the cloud back on | 23:31 |
| clarkb | mgagne: looks like we have have failed to boot all those nodes which is why they are in a deleting state now | 23:32 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add missing README.rst for roles https://review.openstack.org/600128 | 23:34 |
| pabelanger | tonyb: fungi: clarkb: yah, poll was open public, but results are a private URL. Which, person running has access too while running. Then, at finish, I shared said private url for results | 23:36 |
| tonyb | pabelanger: Thanks. | 23:36 |
| *** r-daneel has joined #openstack-infra | 23:37 | |
| *** owalsh_ has joined #openstack-infra | 23:44 | |
| *** owalsh has quit IRC | 23:48 | |
| *** owalsh- has joined #openstack-infra | 23:48 | |
| *** owalsh_ has quit IRC | 23:51 | |
| openstackgerrit | Merged openstack-infra/system-config master: Fix ansible forks env variable https://review.openstack.org/600255 | 23:53 |
| clarkb | I've approved the run nodepool job change which will also fix nodepool clouds.yaml writing in ansible | 23:55 |
| *** ijw has joined #openstack-infra | 23:57 | |
| clarkb | fungi: I think you share a timezone with mgagne, maybe you can followup with mgagne on the inap failures tomorrow morning? | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!