| *** rascasoft has joined #openstack-infra | 00:02 | |
| *** wolverineav has quit IRC | 00:02 | |
| *** wolverineav has joined #openstack-infra | 00:02 | |
| openstackgerrit | Merged openstack-infra/system-config master: Send readme parameter when creating projects https://review.openstack.org/641851 | 00:03 |
|---|---|---|
| *** rascasoft has quit IRC | 00:08 | |
| corvus | still no change in the status as reported via openstackclient | 00:11 |
| fungi | clarkb: i didn't see anyone volunteer to add a `rm -rf /etc/exim4/paniclog` near the end of the launch script, no | 00:14 |
| clarkb | corvus: did you do a hard reboot? that is with the --hard flag iirc | 00:15 |
| clarkb | its possible we might need to do that instead of the acpi version | 00:15 |
| corvus | clarkb: no | 00:15 |
| corvus | oh, the status changed back to active, let's see if it's better | 00:16 |
| fungi | yeah, i think the normal reboot just sends ctrl-alt-del to the console and hopes for the best | 00:16 |
| corvus | still looks squirrely to me. shall i do --hard? | 00:16 |
| clarkb | corvus: ++ | 00:16 |
| corvus | done | 00:16 |
| corvus | i have a shell now | 00:17 |
| corvus | i don't see any obvious problems in syslog | 00:20 |
| clarkb | corvus: it is running the services I expect it to run too | 00:21 |
| fungi | anybody happen to know whether our ubuntu-bionic images include python2.7 by default? (i know bionic itself has made it optional) | 00:22 |
| clarkb | fungi: pretty sure they do | 00:22 |
| clarkb | we don't have special logic for python versioning the zuul cloner shim so python2 it across the baord iirc | 00:23 |
| fungi | thanks, i'll only prepare a fix for that if upcoming testing proves it an invalid assumption | 00:23 |
| clarkb | once centos8 happesn we can python3 | 00:23 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/openstack-zuul-jobs master: Use ubuntu-xenial explicitly in py35 jobs https://review.openstack.org/641877 | 00:24 |
| fungi | there may be similar places in other repos i need to do the same | 00:24 |
| clarkb | fungi: the end of that diff has py35 and py36 listed won't that try to run all of them on the same host then tox will skip whichever python version isn't present? | 00:25 |
| clarkb | if that is the case, is that intentional? | 00:26 |
| fungi | clarkb: that's bindep profiles not tox envs | 00:26 |
| clarkb | oh | 00:26 |
| fungi | the lower-constraints job uses default python3 and the default nodeset | 00:26 |
| *** bgmccollum has joined #openstack-infra | 00:26 | |
| *** owalsh has joined #openstack-infra | 00:27 | |
| fungi | so if the default nodeset switches to a platform where default python3 is 3.6 then including any available py36 bindep profile is warranted | 00:27 |
| openstackgerrit | Zane Bitter proposed openstack-infra/openstack-zuul-jobs master: Add Python3 project templates for Train release https://review.openstack.org/641878 | 00:27 |
| *** owalsh_ has quit IRC | 00:27 | |
| openstackgerrit | Zane Bitter proposed openstack-infra/openstack-zuul-jobs master: Add Python3 project templates for Train release https://review.openstack.org/641878 | 00:28 |
| fungi | i guess to run a job with one nodeset on certain branches and a different nodeset on other branches i need two job variants one of which has the inverse of the other's branch matchers, right? | 00:29 |
| fungi | (for a job defined in a single-branch repository, that is) | 00:30 |
| corvus | w00t, zuul install on zuul01 has caught up with master | 00:30 |
| fungi | i wonder if i need to care about branches older than stable/newton | 00:32 |
| corvus | i'm going to go ahead and restart all of zuul, mostly because i *think* this'll be the commit we release | 00:33 |
| diablo_rojo | clarkb, I finally went through and changed the topic for all the patches I was sure were from outreachy applicants to 'outreachy' | 00:33 |
| fungi | thanks corvus! that sounds marvellous | 00:34 |
| diablo_rojo | Its like 7 patches or so? in both webclient and regular storyboard | 00:35 |
| corvus | well, apparently i'm not because there is a bunch of release activity happening now. | 00:35 |
| *** rlandy has quit IRC | 00:35 | |
| fungi | ahh | 00:35 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Cleanup exim paniclog on newly launched hosts https://review.openstack.org/641880 | 00:35 |
| clarkb | fungi: ^ tthere we go | 00:35 |
| fungi | thanks clarkb! | 00:36 |
| *** eharney has quit IRC | 00:37 | |
| *** roman_g has quit IRC | 00:38 | |
| corvus | i'll do the restart tomorrow morning | 00:39 |
| *** roman_g has joined #openstack-infra | 00:40 | |
| fungi | clarkb: corvus: looking more closely at the errors we get and moreso the timestamps, i *think* they're coming at log rotation when the time between initial launch and addition to inventory spans one or more logrotate pulses | 00:42 |
| fungi | so it's possible deleting at the end of the launch is too early to help | 00:43 |
| corvus | i think that error should stop when our aliases file is in place | 00:43 |
| fungi | "User 0 set for local_delivery transport is on the never_users list" | 00:43 |
| fungi | yeah, do we not add the aliases until the server is in the inventory:? | 00:43 |
| clarkb | I would expect the base playbook to do that, but it is possible that puppet does it/ | 00:44 |
| corvus | base playbook does it | 00:44 |
| clarkb | if base playbook does it then we do apply that during launch | 00:44 |
| corvus | then... "hrm" i say. | 00:45 |
| fungi | a few of the examples i found had entries in them spanning the first several days the server was online | 00:47 |
| *** wolverineav has quit IRC | 00:49 | |
| fungi | okay, i think it logs an entry for that error each time the server needs to send e-mail | 00:49 |
| fungi | the wiki-dev02.openstack.org server i've booted but not yet added to our static inventory most assuredly does *not* have our aliases added to /etc/aliases yet | 00:49 |
| fungi | its ip address (which is not in dns yet) is 23.253.253.208 | 00:49 |
| *** markvoelker has joined #openstack-infra | 00:50 | |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/openstack-zuul-jobs master: Move zuul-legacy-jobs.yaml jobs to Bionic https://review.openstack.org/641886 | 00:52 |
| *** mriedem_away is now known as mriedem | 00:54 | |
| *** ricolin has joined #openstack-infra | 00:59 | |
| *** wolverineav has joined #openstack-infra | 01:03 | |
| *** mriedem has quit IRC | 01:04 | |
| fungi | gmann: ahh, cool, i was just about to start hacking on a similar change for the openstack-tox abstract job so i'll replicate your pattern from 639096 | 01:06 |
| gmann | fungi: +1. moving towards projects side nodeset removal and few testing patches. then i will shoot those on ML. | 01:09 |
| fungi | i've prepped copies of the base-test and base job changes about to push in a bit, and 641877 is what will keep the py35 jobs running on xenial indefinitely since those will assuredly break on bionic | 01:11 |
| gmann | k | 01:12 |
| *** gyee has quit IRC | 01:15 | |
| *** whoami-rajat has joined #openstack-infra | 01:23 | |
| *** markvoelker has quit IRC | 01:23 | |
| *** sthussey has quit IRC | 01:24 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/openstack-zuul-jobs master: Explicitly pin openstack-tox to xenial for <=rocky https://review.openstack.org/641895 | 01:32 |
| openstackgerrit | Jeremy Stanley proposed opendev/base-jobs master: Test changing the default nodeset to ubuntu-bionic https://review.openstack.org/641896 | 01:33 |
| openstackgerrit | Jeremy Stanley proposed opendev/base-jobs master: Switch default nodeset to ubuntu-bionic https://review.openstack.org/641897 | 01:33 |
| fungi | gmann: there ^ are the other pieces | 01:33 |
| fungi | that last one will be wip until cutover | 01:34 |
| *** rascasoft has joined #openstack-infra | 01:34 | |
| gmann | nice. | 01:35 |
| fungi | the others should in theory be a complete no-op | 01:37 |
| fungi | until the last one merges | 01:37 |
| *** wolverineav has quit IRC | 01:39 | |
| *** wolverineav has joined #openstack-infra | 01:40 | |
| *** rascasoft has quit IRC | 01:40 | |
| gmann | yeah. *-py35 has ubuntu-xenial as explicitly mentioned as nodeset. | 01:41 |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/openstack-zuul-jobs master: Add legacy 3 nodes nodeset based on Ubuntu bionic https://review.openstack.org/641898 | 01:41 |
| *** wolverineav has quit IRC | 01:44 | |
| *** bhavikdbavishi has joined #openstack-infra | 02:11 | |
| *** markvoelker has joined #openstack-infra | 02:20 | |
| *** hwoarang has quit IRC | 02:28 | |
| *** jamesmcarthur has joined #openstack-infra | 02:30 | |
| *** hwoarang has joined #openstack-infra | 02:30 | |
| *** rascasoft has joined #openstack-infra | 02:32 | |
| *** hongbin has joined #openstack-infra | 02:42 | |
| *** roman_g has quit IRC | 02:43 | |
| *** rascasoft has quit IRC | 02:43 | |
| *** jhesketh has quit IRC | 02:45 | |
| *** jhesketh has joined #openstack-infra | 02:47 | |
| *** markvoelker has quit IRC | 02:53 | |
| *** rkukura has quit IRC | 02:54 | |
| *** ramishra has joined #openstack-infra | 02:55 | |
| *** bhavikdbavishi has quit IRC | 02:58 | |
| *** roman_g has joined #openstack-infra | 03:07 | |
| *** apetrich has quit IRC | 03:16 | |
| *** ianw_pto has quit IRC | 03:23 | |
| *** ianw has joined #openstack-infra | 03:23 | |
| *** jbadiapa has quit IRC | 03:24 | |
| *** jbadiapa has joined #openstack-infra | 03:25 | |
| *** jamesmcarthur has quit IRC | 03:27 | |
| *** armax has quit IRC | 03:30 | |
| *** armax has joined #openstack-infra | 03:33 | |
| *** ykarel|away has joined #openstack-infra | 03:36 | |
| *** ykarel|away is now known as ykarel | 03:37 | |
| *** rascasoft has joined #openstack-infra | 03:40 | |
| *** rascasoft has quit IRC | 03:44 | |
| *** bhavikdbavishi has joined #openstack-infra | 03:48 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 03:48 | |
| *** markvoelker has joined #openstack-infra | 03:50 | |
| *** bhavikdbavishi has quit IRC | 03:52 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 03:52 | |
| *** rascasoft has joined #openstack-infra | 03:59 | |
| *** rascasoft has quit IRC | 04:09 | |
| *** markvoelker has quit IRC | 04:23 | |
| *** udesale has joined #openstack-infra | 04:24 | |
| *** whoami-rajat has quit IRC | 04:33 | |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/openstack-zuul-jobs master: Move legacy-periodic-package-stackviz-element to stackviz repo https://review.openstack.org/641923 | 04:44 |
| *** whoami-rajat has joined #openstack-infra | 04:53 | |
| *** hwoarang has quit IRC | 05:02 | |
| *** hwoarang has joined #openstack-infra | 05:08 | |
| *** markvoelker has joined #openstack-infra | 05:20 | |
| *** janki has joined #openstack-infra | 05:34 | |
| *** tkajinam has quit IRC | 05:38 | |
| *** tkajinam has joined #openstack-infra | 05:39 | |
| *** hongbin has quit IRC | 05:42 | |
| *** kjackal has joined #openstack-infra | 05:44 | |
| AJaeger | config-core, could you review https://review.openstack.org/#/c/639018/ , please? | 05:45 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Use ubuntu-xenial explicitly in py35 jobs https://review.openstack.org/641877 | 05:48 |
| *** kjackal has quit IRC | 05:51 | |
| *** markvoelker has quit IRC | 05:53 | |
| openstackgerrit | Riju Khatri proposed openstack-infra/storyboard-webclient master: Make task ordering in Story view selectable https://review.openstack.org/641930 | 05:59 |
| openstackgerrit | Riju Khatri proposed openstack-infra/storyboard-webclient master: Make task ordering in Story view selectable https://review.openstack.org/641930 | 06:04 |
| openstackgerrit | Riju Khatri proposed openstack-infra/storyboard-webclient master: Make task ordering in Story view selectable https://review.openstack.org/641930 | 06:18 |
| *** kjackal has joined #openstack-infra | 06:47 | |
| *** markvoelker has joined #openstack-infra | 06:51 | |
| *** Bhujay has joined #openstack-infra | 06:52 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: tests: remove debugging prints https://review.openstack.org/641942 | 07:00 |
| *** armax has quit IRC | 07:01 | |
| *** wolverineav has joined #openstack-infra | 07:09 | |
| *** ramishra has quit IRC | 07:10 | |
| *** kjackal has quit IRC | 07:13 | |
| *** kjackal has joined #openstack-infra | 07:16 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: switch jobs list to a tree view https://review.openstack.org/633437 | 07:20 |
| *** cjloader has quit IRC | 07:22 | |
| *** kjackal has quit IRC | 07:22 | |
| *** markvoelker has quit IRC | 07:23 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add jobs list filter https://review.openstack.org/633652 | 07:23 |
| *** hwoarang has quit IRC | 07:25 | |
| *** ramishra has joined #openstack-infra | 07:25 | |
| *** pcaruana has joined #openstack-infra | 07:26 | |
| *** pgaxatte has joined #openstack-infra | 07:26 | |
| *** hwoarang has joined #openstack-infra | 07:30 | |
| *** kjackal has joined #openstack-infra | 07:32 | |
| *** ykarel_ has joined #openstack-infra | 07:45 | |
| *** ykarel has quit IRC | 07:46 | |
| *** Bhujay has quit IRC | 07:50 | |
| *** Bhujay has joined #openstack-infra | 07:57 | |
| *** tkajinam has quit IRC | 08:00 | |
| *** ginopc has joined #openstack-infra | 08:01 | |
| *** wolverineav has quit IRC | 08:04 | |
| *** wolverineav has joined #openstack-infra | 08:05 | |
| *** rpittau|afk is now known as rpittau | 08:06 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: switch jobs list to a tree view https://review.openstack.org/633437 | 08:11 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add jobs list filter https://review.openstack.org/633652 | 08:11 |
| *** markvoelker has joined #openstack-infra | 08:20 | |
| *** xek_ has joined #openstack-infra | 08:26 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: Add a subcontroller for Team projects https://review.openstack.org/641963 | 08:26 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: Add UI for making security teams related to projects https://review.openstack.org/641964 | 08:26 |
| *** xek_ has quit IRC | 08:27 | |
| *** xek has joined #openstack-infra | 08:28 | |
| *** Bhujay has quit IRC | 08:31 | |
| *** jpich has joined #openstack-infra | 08:31 | |
| *** rfolco has joined #openstack-infra | 08:36 | |
| *** rfolco|ruck has quit IRC | 08:38 | |
| *** iurygregory|home is now known as iurygregory | 08:40 | |
| *** kjackal has quit IRC | 08:43 | |
| *** kjackal has joined #openstack-infra | 08:43 | |
| *** wolverineav has quit IRC | 08:46 | |
| *** markvoelker has quit IRC | 08:53 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard master: Add a table mapping Teams to Projects https://review.openstack.org/641718 | 08:54 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard master: Add an endpoint for getting Projects related to a Team https://review.openstack.org/641719 | 08:54 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard master: Allow Teams to be filtered by project_id https://review.openstack.org/641720 | 08:54 |
| *** Wryhder has joined #openstack-infra | 09:02 | |
| *** mcgiggler has joined #openstack-infra | 09:03 | |
| *** pcaruana has quit IRC | 09:12 | |
| *** ccamacho has joined #openstack-infra | 09:16 | |
| *** ykarel_ is now known as ykarel|lunch | 09:16 | |
| *** ginopc has quit IRC | 09:18 | |
| *** kjackal has quit IRC | 09:18 | |
| *** ginopc has joined #openstack-infra | 09:24 | |
| *** pcaruana has joined #openstack-infra | 09:27 | |
| *** fdegir has quit IRC | 09:34 | |
| *** ginopc has quit IRC | 09:40 | |
| *** kjackal has joined #openstack-infra | 09:42 | |
| *** ykarel_ has joined #openstack-infra | 09:43 | |
| *** ykarel_ is now known as ykarel | 09:43 | |
| *** ginopc has joined #openstack-infra | 09:44 | |
| *** ykarel|lunch has quit IRC | 09:45 | |
| *** ykarel is now known as ykarel|lunch | 09:46 | |
| *** rcernin has quit IRC | 09:47 | |
| *** fdegir has joined #openstack-infra | 09:48 | |
| *** markvoelker has joined #openstack-infra | 09:51 | |
| *** wolverineav has joined #openstack-infra | 09:57 | |
| *** wolverineav has quit IRC | 10:02 | |
| *** rascasoft has joined #openstack-infra | 10:05 | |
| *** ramishra has quit IRC | 10:05 | |
| *** ykarel|lunch has quit IRC | 10:15 | |
| *** ykarel has joined #openstack-infra | 10:16 | |
| *** jistr is now known as jistr|biab | 10:21 | |
| *** ccamacho has quit IRC | 10:21 | |
| *** markvoelker has quit IRC | 10:23 | |
| *** Wryhder has quit IRC | 10:23 | |
| *** Wryhder has joined #openstack-infra | 10:24 | |
| *** ccamacho has joined #openstack-infra | 10:30 | |
| *** gfidente has joined #openstack-infra | 10:32 | |
| *** electrofelix has joined #openstack-infra | 10:36 | |
| *** ricolin has quit IRC | 10:39 | |
| *** yamamoto has quit IRC | 10:43 | |
| *** ramishra has joined #openstack-infra | 10:48 | |
| *** bhavikdbavishi has quit IRC | 10:51 | |
| *** jistr|biab has quit IRC | 10:51 | |
| *** jistr has joined #openstack-infra | 10:54 | |
| *** udesale has quit IRC | 11:03 | |
| *** udesale has joined #openstack-infra | 11:04 | |
| *** Wryhder has quit IRC | 11:06 | |
| *** luizbag has joined #openstack-infra | 11:06 | |
| *** dtantsur|afk is now known as dtantsur | 11:08 | |
| *** yamamoto has joined #openstack-infra | 11:18 | |
| *** markvoelker has joined #openstack-infra | 11:20 | |
| *** jaosorior has quit IRC | 11:20 | |
| *** yamamoto has quit IRC | 11:25 | |
| *** yamamoto has joined #openstack-infra | 11:26 | |
| *** jaosorior has joined #openstack-infra | 11:32 | |
| *** bhavikdbavishi has joined #openstack-infra | 11:43 | |
| *** raissa has joined #openstack-infra | 11:44 | |
| *** raissa has quit IRC | 11:46 | |
| *** markvoelker has quit IRC | 11:54 | |
| *** panda|rover is now known as panda|rover|lunc | 11:54 | |
| *** gfidente has quit IRC | 12:07 | |
| *** EmilienM is now known as EvilienM | 12:08 | |
| *** tosky has joined #openstack-infra | 12:12 | |
| *** mcgiggler has quit IRC | 12:18 | |
| kashyap | AJaeger: Hi, wonder if you know how can I find the ".zuul.yaml in the base job"? (Referring to: https://review.openstack.org/#/c/638757/) | 12:24 |
| AJaeger | Which part do you have problems with? | 12:37 |
| AJaeger | The file you touch is run as part of a job, that job is defined in the file .zuul.yaml in the devstack repo | 12:38 |
| AJaeger | let me give you a link... | 12:38 |
| AJaeger | kashyap, see http://git.openstack.org/cgit/openstack-dev/devstack/tree/.zuul.yaml#n187 | 12:39 |
| AJaeger | that's the job... | 12:39 |
| kashyap | Ah, sorry, missed to check here (distraction) | 12:39 |
| kashyap | AJaeger: Ah, so instead of the main.yaml, I should add it to the .zuul.yaml | 12:40 |
| kashyap | Or _both_ places? | 12:40 |
| kashyap | (By "it", I mean the content of the patch) | 12:40 |
| AJaeger | kashyap: your patch as is is part 1 - part 2 is adding to zuul.yaml, see the list with files to copy | 12:41 |
| AJaeger | kashyap: line 227, zuul_copy_output is the variable | 12:41 |
| * kashyap looks | 12:41 | |
| AJaeger | you need *both* changes | 12:41 |
| AJaeger | wait... | 12:42 |
| * kashyap waits | 12:42 | |
| AJaeger | I think you can add /var/log/audit/audit.log directly to zuul_copy_output; that single line change might be all that's needed. Please try it - and if you have further questions, about devstack, the #openstack-qa channel is a better place | 12:43 |
| *** gfidente has joined #openstack-infra | 12:45 | |
| *** zbr|ssbarnea has quit IRC | 12:46 | |
| kashyap | Yeah, noted. | 12:46 |
| kashyap | AJaeger: So the current change main.yaml might not even be required, after all? | 12:47 |
| *** zbr has joined #openstack-infra | 12:47 | |
| kashyap | I'll first just put in audit.log to 'zuul_copy_output' variable | 12:47 |
| kashyap | So I've added: | 12:49 |
| kashyap | + '{{ stage_dir }}/audit.log': logs | 12:49 |
| kashyap | To .zuul.yaml; /me posts the patch to see if it gets captured | 12:49 |
| *** kgiusti has joined #openstack-infra | 12:52 | |
| *** iurygregory is now known as iurygregory_mtg | 12:53 | |
| *** rh-jelabarre has joined #openstack-infra | 13:04 | |
| *** bhavikdbavishi has quit IRC | 13:07 | |
| *** janki has quit IRC | 13:07 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Add bionic nodeset for legacy job to switch to bionic https://review.openstack.org/639018 | 13:09 |
| *** eharney has joined #openstack-infra | 13:17 | |
| *** frickler has quit IRC | 13:17 | |
| *** frickler has joined #openstack-infra | 13:18 | |
| AJaeger | kashyap: yes, taht was my suggestion. | 13:18 |
| *** agopi has joined #openstack-infra | 13:19 | |
| kashyap | Noted, thanks | 13:20 |
| *** iurygregory_mtg is now known as iurygregory | 13:24 | |
| *** panda|rover|lunc is now known as panda|rover | 13:25 | |
| *** ramishra has quit IRC | 13:27 | |
| *** yamamoto has quit IRC | 13:27 | |
| *** pcaruana has quit IRC | 13:30 | |
| *** jcoufal has joined #openstack-infra | 13:30 | |
| *** dave-mccowan has joined #openstack-infra | 13:30 | |
| *** rlandy has joined #openstack-infra | 13:32 | |
| *** dave-mccowan has quit IRC | 13:34 | |
| *** mriedem has joined #openstack-infra | 13:38 | |
| *** janki has joined #openstack-infra | 13:40 | |
| *** derekh has joined #openstack-infra | 13:53 | |
| *** yamamoto has joined #openstack-infra | 13:54 | |
| *** bhavikdbavishi has joined #openstack-infra | 13:55 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck master: Add query for nova evacuate --force bug 1819166 https://review.openstack.org/642020 | 14:00 |
| openstack | bug 1819166 in OpenStack Compute (nova) "nova-live-migration evacuation tests fail with "error: unrecognized arguments: --force"" [Critical,In progress] https://launchpad.net/bugs/1819166 - Assigned to sean mooney (sean-k-mooney) | 14:00 |
| *** ccamacho has quit IRC | 14:01 | |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/openstack-zuul-jobs master: Add legacy 3 nodes nodeset based on Ubuntu bionic https://review.openstack.org/641898 | 14:06 |
| *** rfolco is now known as rfolco|ruck | 14:08 | |
| AJaeger | config-core, let's merge the change above as well for bionic move ^ - please review | 14:09 |
| *** bhavikdbavishi has quit IRC | 14:10 | |
| mordred | AJaeger: legacy-ubuntu-bionic-3-node is funny | 14:11 |
| AJaeger | yeah - legacy job for current OS ;( | 14:15 |
| *** kjackal has quit IRC | 14:19 | |
| *** markvoelker has joined #openstack-infra | 14:20 | |
| fungi | "funny" isn't the word i would have chosen | 14:27 |
| fungi | disappointing is closer to it | 14:27 |
| openstackgerrit | Merged openstack-infra/elastic-recheck master: Add query for nova evacuate --force bug 1819166 https://review.openstack.org/642020 | 14:28 |
| openstack | bug 1819166 in OpenStack Compute (nova) "nova-live-migration evacuation tests fail with "error: unrecognized arguments: --force"" [Critical,In progress] https://launchpad.net/bugs/1819166 - Assigned to sean mooney (sean-k-mooney) | 14:28 |
| openstackgerrit | Natal Ngétal proposed openstack/diskimage-builder master: [Configuration] Switch to stestr. https://review.openstack.org/629414 | 14:35 |
| sean-k-mooney | for what its worth i plan to port the os-vif legacy job soon | 14:35 |
| sean-k-mooney | i recently added a non legacy tempest-base jobs so it should be fairly trivail to swap over os-vif-ovs | 14:36 |
| sean-k-mooney | https://github.com/openstack/os-vif/blob/master/.zuul.yaml#L1-L56 | 14:36 |
| *** pcaruana has joined #openstack-infra | 14:37 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Add legacy 3 nodes nodeset based on Ubuntu bionic https://review.openstack.org/641898 | 14:37 |
| sean-k-mooney | one slightly disapoint thing i found was that devstack with linux bridge seamed to not work right on python3 but updating all of them and refining the test they run is on my too list for before the ptg | 14:38 |
| *** jchhatbar has joined #openstack-infra | 14:40 | |
| *** ykarel is now known as ykarel|away | 14:40 | |
| openstackgerrit | Natal Ngétal proposed openstack/diskimage-builder master: [Configuration] Switch to stestr. https://review.openstack.org/629414 | 14:41 |
| *** mcgiggler has joined #openstack-infra | 14:42 | |
| *** jchhatba_ has joined #openstack-infra | 14:42 | |
| *** janki has quit IRC | 14:42 | |
| fungi | sean-k-mooney: any idea what about python 3 breaks devstack with linuxbridge? | 14:44 |
| fungi | i wouldn't have expected any interaction there | 14:45 |
| *** jchhatbar has quit IRC | 14:45 | |
| openstackgerrit | Natal Ngétal proposed openstack/diskimage-builder master: [Configuration] Switch to stestr. https://review.openstack.org/629414 | 14:47 |
| sean-k-mooney | it looked like it installed all the deps in python3 and tried to execute the linux bridge agent with python2 | 14:47 |
| sean-k-mooney | let me see if the logs are still there | 14:47 |
| fungi | ahh, in that case it might be an easy fix in devstack | 14:49 |
| sean-k-mooney | oh it was releated to privsep | 14:49 |
| mordred | fungi, AJaeger: https://review.openstack.org/#/c/632532/ is green again - if you have a sec for a quick review | 14:50 |
| sean-k-mooney | fungi: http://logs.openstack.org/32/639732/3/check/os-vif-linuxbridge/9f6f380/controller/logs/screen-q-agt.txt.gz | 14:50 |
| *** efried is now known as fried_rice | 14:51 | |
| sean-k-mooney | so the privsep helper defaults to python2 even when we install with python3 | 14:51 |
| *** wolverineav has joined #openstack-infra | 14:51 | |
| fungi | ianw: ^ if you're still around, were you involved in the devstack python3 conversion? | 14:52 |
| *** cjloader has joined #openstack-infra | 14:52 | |
| sean-k-mooney | the privesep helpt is created by setup tools right | 14:52 |
| sean-k-mooney | looks like it hardcodes the system python path | 14:54 |
| *** markvoelker has quit IRC | 14:54 | |
| sean-k-mooney | [stack@devstack2 nova]$ cat /usr/bin/privsep-helper | 14:54 |
| sean-k-mooney | #!/usr/bin/python | 14:54 |
| fungi | ahh, yeah, if it's being installed globally and has an explicit shebang, that'll cause trouble | 14:55 |
| sean-k-mooney | well that is still proably easy to fix with sed | 14:55 |
| *** wolverineav has quit IRC | 14:55 | |
| sean-k-mooney | at least in devstack | 14:56 |
| fungi | that either needs to be /usr/bin/python3 or just invoke the helper under an interpreter like `python3 /usr/bin/privsep-helper` instead | 14:56 |
| sean-k-mooney | ya i think there is a config optin for the privsep deamon so we could jsut set it in the python3 jobs | 14:56 |
| fungi | i'm doing a bit of searching to see where it gets called | 14:57 |
| fungi | oh, yeah calling it under the interpreter isn't an option | 14:58 |
| fungi | since the idea is that the privsep-helper executable is whitelisted for running as root | 14:59 |
| fungi | to call it under an interpreter as root you'd need to whitelist the interpreter, and then you could really run just about anything (or at least it becomes even harder to lock down) | 14:59 |
| sean-k-mooney | right so either devstack need to change the path in the privsep-helper | 15:00 |
| sean-k-mooney | or we could pass the interperter as an arg to it | 15:00 |
| fungi | i'm surprised that the shebang references python(2) when installed for python3 | 15:00 |
| fungi | normally our entrypoints arrangement should take care of setting the correct interpreter in the wrapper | 15:01 |
| sean-k-mooney | well it reference system python | 15:01 |
| fungi | as opposed to system python3, yes, but the entrypoints wrapper should set the correct one on installation | 15:01 |
| sean-k-mooney | on ubunut that would be python3 right | 15:01 |
| fungi | nope | 15:01 |
| sean-k-mooney | no i taught ubuntu 18.04 was python 3 only by defualt | 15:02 |
| fungi | /usr/bin/python should *always* refer to python2. for python3 you have to call it explicitly | 15:02 |
| sean-k-mooney | even on distors that dont have python3 | 15:02 |
| fungi | ubuntu 18.04 doesn't provide a python2 by default unless you install it, but they don't link python to python3 | 15:02 |
| sean-k-mooney | oh ok | 15:02 |
| fungi | the only distro i'm aware of which has made that choice is arch linux, and it was against the recommendation of the entire python community | 15:03 |
| sean-k-mooney | im just used to looking at it in tox where python links to the one you asked for | 15:03 |
| fungi | anyway, i'm going to take a quick look at how devstack is installing privsep-helper, and then maybe dig into the packaging of privsep-helper to see what's causing that | 15:03 |
| fungi | yeah, inside a virtualenv which is created with one and only one python interpreter the bin/python is symlinked to whatever interpreter was used to create it even if that's python3 | 15:04 |
| sean-k-mooney | sorry to create more work but i guess its better then this biting use when we drop python 2 support | 15:04 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add flatten checkbox https://review.openstack.org/642047 | 15:04 |
| fungi | absolutely, this is a great catch. thanks for raising it! | 15:04 |
| sean-k-mooney | it was on my todo list to try and fix when i got around to optimising the os-vif jobs next week. | 15:05 |
| fungi | so /usr/local/bin/privsep-helper is what's ending up in the path, looks like, indicating it's probably coming from a pip install | 15:05 |
| sean-k-mooney | it got deferend due to ff | 15:05 |
| sean-k-mooney | yes it comes from privsep | 15:06 |
| sean-k-mooney | https://github.com/openstack/oslo.privsep/blob/master/setup.cfg#L40 | 15:07 |
| fungi | oslo.privsep==1.32.0 in http://logs.openstack.org/32/639732/3/check/os-vif-linuxbridge/9f6f380/controller/logs/pip2-freeze.txt.gz | 15:07 |
| sean-k-mooney | so it generate by setup tools | 15:07 |
| fungi | oslo.privsep==1.32.0 | 15:07 |
| fungi | also in http://logs.openstack.org/32/639732/3/check/os-vif-linuxbridge/9f6f380/controller/logs/pip3-freeze.txt.gz | 15:07 |
| fungi | i suspect what's happening is it's getting installed twice and the second entrypoint wrapper (for python2) is overwriting the first (for python3) | 15:08 |
| sean-k-mooney | it might be related to swift | 15:08 |
| sean-k-mooney | i didnt deisable it but dont they still run on python 2 | 15:08 |
| sean-k-mooney | event when devstack is python 3 | 15:08 |
| sean-k-mooney | oh i have disabled swift already | 15:09 |
| sean-k-mooney | oh its comming form the installatyion of os-vif form git | 15:12 |
| sean-k-mooney | http://logs.openstack.org/32/639732/3/check/os-vif-linuxbridge/9f6f380/controller/logs/devstacklog.txt.gz#_2019-02-27_16_42_48_514 | 15:13 |
| sean-k-mooney | from this http://logs.openstack.org/32/639732/3/check/os-vif-linuxbridge/9f6f380/controller/logs/devstacklog.txt.gz#_2019-02-27_16_42_33_782 | 15:15 |
| *** jchhatba_ has quit IRC | 15:15 | |
| *** janki has joined #openstack-infra | 15:16 | |
| *** jamesmcarthur has joined #openstack-infra | 15:16 | |
| fungi | great catch, so need to make it install os-vif under python3 | 15:17 |
| sean-k-mooney | fungi: ya but its been install via libs form git due to the require project | 15:17 |
| sean-k-mooney | in the zuul job | 15:17 |
| sean-k-mooney | also just before that | 15:18 |
| sean-k-mooney | http://logs.openstack.org/32/639732/3/check/os-vif-linuxbridge/9f6f380/controller/logs/devstacklog.txt.gz#_2019-02-27_16_42_32_859 | 15:18 |
| fungi | "Installing os-vif again without Python 3 enabled" | 15:18 |
| sean-k-mooney | 2019-02-27 16:42:32.854 | + inc/python:python3_enabled:600 : [[ True == \T\r\u\e ]] | 15:18 |
| sean-k-mooney | 2019-02-27 16:42:32.857 | + inc/python:python3_enabled:601 : return 0 | 15:18 |
| fungi | see comment block at http://git.openstack.org/cgit/openstack-dev/devstack/tree/inc/python#n441 | 15:20 |
| *** udesale has quit IRC | 15:21 | |
| *** udesale has joined #openstack-infra | 15:21 | |
| fungi | this should probably move to #openstack-qa, the pattern there means any packages installing entrypoint wrappers are going to end up running under python2 instead of python3 | 15:21 |
| sean-k-mooney | right... so that is not logically correct due to the gloabl privsep-helper | 15:21 |
| sean-k-mooney | ya i can bring it up there or you can if you like. im also on another call at the moment | 15:22 |
| fungi | because the libraries themselves can be installed for multiple python interpreters, but the executables they provide are not going to be globally unique names and so will overwrite each other | 15:22 |
| fungi | sean-k-mooney: no worries, i'll bring it up (though i also have to disappear to run errands in about 5 minutes) | 15:23 |
| *** janki has quit IRC | 15:23 | |
| sean-k-mooney | the ovs job proably would have also exploed for the same reason but i i had other issue in the ovs job so it didint get that far | 15:24 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard master: Add a security flag to Stories https://review.openstack.org/642056 | 15:25 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard master: Add RESTful endpoints for Story permissions https://review.openstack.org/642057 | 15:25 |
| *** jangutter has quit IRC | 15:39 | |
| *** armax has joined #openstack-infra | 15:40 | |
| *** fried_rice is now known as efried_afk | 15:48 | |
| *** yamamoto has quit IRC | 15:48 | |
| *** yamamoto has joined #openstack-infra | 15:49 | |
| *** TheJulia is now known as needssleep | 15:50 | |
| *** markvoelker has joined #openstack-infra | 15:51 | |
| *** yamamoto has quit IRC | 15:51 | |
| *** dtantsur is now known as creepy_owlet | 15:52 | |
| *** ginopc has quit IRC | 15:57 | |
| *** ccamacho has joined #openstack-infra | 15:58 | |
| *** yamamoto has joined #openstack-infra | 16:01 | |
| *** cmurphy is now known as cmorpheus | 16:02 | |
| *** yamamoto has quit IRC | 16:07 | |
| *** bhavikdbavishi has joined #openstack-infra | 16:12 | |
| *** efried_afk is now known as fried_rice | 16:16 | |
| *** sthussey has joined #openstack-infra | 16:19 | |
| *** markvoelker has quit IRC | 16:23 | |
| *** sean-k-mooney has quit IRC | 16:23 | |
| *** roman_g has quit IRC | 16:30 | |
| *** roman_g has joined #openstack-infra | 16:30 | |
| *** adriancz has quit IRC | 16:36 | |
| mriedem | everything in the gate that is co-gating with nova is probably getting kicked out right now, fyi | 16:37 |
| mriedem | http://status.openstack.org/elastic-recheck/#1819166 | 16:37 |
| mriedem | i don't know if we want to talk about bumping https://review.openstack.org/#/c/641986 to the top? | 16:37 |
| mriedem | the nova-live-migration job is 100% fail on master | 16:38 |
| mriedem | without that fix | 16:38 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: Add support for Story permission endpoints https://review.openstack.org/642070 | 16:40 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: WIP: Automatically add security teams to security stories https://review.openstack.org/642071 | 16:40 |
| *** pgaxatte has quit IRC | 16:42 | |
| *** cmoura has quit IRC | 16:46 | |
| clarkb | mriedem: ps2 on that change failed testing | 16:53 |
| clarkb | mriedem: do we want to see it pass on ps3 before pushing to the top of the gate? | 16:53 |
| clarkb | (not sure what our confidence is in that change on ps3) | 16:53 |
| *** iurygregory has quit IRC | 16:55 | |
| mriedem | clarkb: yeah ps2 failed because the --os-compute-api-version option has to come *before* the "evacuate" sub-command, which is what is fixed in PS3 | 16:56 |
| mriedem | so i'm 99.5% sure it'll be ok | 16:57 |
| mriedem | like the usage here says http://logs.openstack.org/86/641986/2/check/nova-live-migration/6f6b678/job-output.txt.gz#_2019-03-08_14_32_57_204517 | 16:57 |
| *** ccamacho has quit IRC | 16:57 | |
| clarkb | mriedem: ok looks like there aer no nova changes ahead in the gate so as long as you haven't approved other changes I think we are set | 16:58 |
| mriedem | ok | 16:58 |
| clarkb | unless the neutron failures are related to this but I don't think they are | 16:58 |
| mriedem | tempest changes run the nova-live-migration job in the check queue.. | 17:00 |
| mriedem | oh but non-voting :/ | 17:00 |
| *** jamesmcarthur_ has joined #openstack-infra | 17:00 | |
| *** jpich has quit IRC | 17:01 | |
| *** e0ne has joined #openstack-infra | 17:03 | |
| *** jamesmcarthur has quit IRC | 17:03 | |
| *** udesale has quit IRC | 17:04 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Only install puppet 4 if not already installed https://review.openstack.org/642080 | 17:07 |
| clarkb | cmorpheus: ^ fyi I think we want that due to the side effects of puppet4 install on the review-dev server | 17:07 |
| mordred | clarkb, corvus: https://review.openstack.org/#/c/632532/ is green - have a sec for a +3? | 17:08 |
| *** e0ne has quit IRC | 17:08 | |
| clarkb | mordred: looking | 17:08 |
| clarkb | mordred: can you check my ansible in the change just above? | 17:08 |
| cmorpheus | clarkb: it's /opt/puppetlabs/bin/puppet | 17:08 |
| clarkb | cmorpheus: it seems like it is actually both | 17:09 |
| cmorpheus | oh | 17:09 |
| cmorpheus | TIL | 17:09 |
| clarkb | and /opt/puppetlabs/bin/puppet is al ink to the other poath | 17:09 |
| clarkb | (so I went with the actual file not the link but both would work) | 17:09 |
| cmorpheus | gotcha | 17:09 |
| clarkb | lrwxrwxrwx 1 root root 20 Jun 12 2018 /opt/puppetlabs/bin/puppet -> ../puppet/bin/puppet | 17:09 |
| *** xek has quit IRC | 17:11 | |
| *** xek has joined #openstack-infra | 17:11 | |
| *** rlandy is now known as rlandy|brb | 17:12 | |
| *** pcaruana has quit IRC | 17:12 | |
| mordred | clarkb: looking | 17:13 |
| mordred | clarkb: do I want to know why installing puppet removes gerrit rc.d files? | 17:13 |
| mordred | +2 from me | 17:14 |
| clarkb | mordred: I didn't want to know myself :/ my hunch is that they call some deb helper function to install rc.d things and it helpfully clears out things it thinks are redundant | 17:15 |
| clarkb | mordred: we have a S04gerrit script from system sysv init compat and puppet installs a S90gerrit | 17:15 |
| clarkb | something sees S90gerrit as redundant in that process and removes it. We shoudl go back through and systemdify that module if we stick with it long enough but for not installing puppet 4 once seems like a good approach | 17:16 |
| mordred | clarkb: fun. I'm guessing no amount of digging further will improve happiness | 17:16 |
| cmorpheus | not rerunning the install_puppet script is a good thing | 17:17 |
| clarkb | ++ | 17:17 |
| *** markvoelker has joined #openstack-infra | 17:20 | |
| *** gyee has joined #openstack-infra | 17:22 | |
| *** gfidente has quit IRC | 17:24 | |
| clarkb | fungi: corvus looking at the root never_users paniclog thing. aliases does have an entry for root pointing to us on health01 (one of the servers that complained). never_users is set to root ( and that is compiled in via an even stronger directive according to the comment above that). Reading our exim role we write the aliases file, then the exim conf, then set the exim restart handler | 17:27 |
| clarkb | my two theories for what is happening are we write an empty root aliases entry on launch because our vars aren't properly available for some reason then the cron job fixes it (more likely given timestamps) or the restart handler runs long enough after exim is installed that for a time we are doing tasks that trigger root emails until that handler runs | 17:28 |
| *** creepy_owlet is now known as dtantsur|afk | 17:29 | |
| clarkb | mordred: ^ for the first theory I'm trying to understand how system-config/playbooks/group_vars makes it into our ansible runs. Is that purely due to the relative path relationship to our playbooks? | 17:31 |
| *** rpittau is now known as rpittau|afk | 17:31 | |
| mordred | yes | 17:31 |
| clarkb | ok os.path.join(SCRIPT_DIR, '..', 'playbooks', playbook) is how we refer to the playbooks in launch node. I wonder if that .. or cwd confuses it | 17:32 |
| clarkb | but if not, that should just work (tm) | 17:33 |
| corvus | clarkb: my experience is that ansible does things relative to the playbook path regardless of the CWD used when running ansible | 17:34 |
| clarkb | exim_sysadmins: "{{ ','.join(sysadmins|default([])) }}" is how that var is defined and sysadmins i defined in /etc/ansible/hosts/group_vars/all.yaml | 17:34 |
| clarkb | possible it is the lookup of sysadmins that is failing | 17:35 |
| clarkb | mordred: we pass an entire config directory via the ansible-playbook -i argument with host and groups and so on. I wonder if that overrides the global settings? | 17:40 |
| mordred | clarkb: they merge | 17:41 |
| mordred | clarkb: so the host and group vars from the inventory sources are merged with the host and group vars adjacent to the playbooks | 17:41 |
| clarkb | ok, the docs totally ignore that use case. And only talk about a single file | 17:41 |
| clarkb | mordred: ya but we have a third set of vars, the global ones in /etc/ansible | 17:42 |
| clarkb | by passing a dir to the -i flag are we replacing /etc/ansible? | 17:42 |
| *** mriedem is now known as mriedem_burgers | 17:43 | |
| clarkb | One way we could test this is to move the sysadmins var into system-config/playbooks/group_vars/all.yaml | 17:43 |
| mordred | I'm sorry - I've stopped being able to follow this - can we back up? | 17:43 |
| clarkb | mordred: sure | 17:43 |
| mordred | what are we passing via -i ? | 17:43 |
| clarkb | mordred: a tmpdir with a hosts file and a groups file (and maybe some other stuff) | 17:43 |
| *** fried_rice is now known as fried_rolls | 17:43 | |
| mordred | clarkb: where are we doing this? | 17:44 |
| clarkb | mordred: in system-config/launch/launch-node.py | 17:44 |
| mordred | thanks. one sec | 17:44 |
| *** derekh has quit IRC | 17:44 | |
| mordred | clarkb: yes - that is almost certainly overriding the existence of /etc/ansible | 17:45 |
| clarkb | mordred: if we switch it to -i $inventory_file we should get back the behavior we want I assume? | 17:45 |
| clarkb | run with a different inventory against our global config | 17:45 |
| mordred | no - I don't believe so | 17:45 |
| clarkb | oh | 17:46 |
| mordred | what we need is a list of inventory sources | 17:46 |
| *** asettle is now known as away | 17:46 | |
| *** away is now known as asettle | 17:46 | |
| mordred | clarkb: /etc/ansible/ansible.cfg has: | 17:46 |
| mordred | inventory=/opt/system-config/inventory/openstack.yaml,/opt/system-config/inventory/groups.yaml,/etc/ansible/hosts/emergency.yaml | 17:46 |
| clarkb | fwiw I don't really want to move sysadmins into the system-cofngi repo as then we get emails from random people's servers set up with our tooling | 17:46 |
| mordred | -i is setting a new value of inventory | 17:46 |
| mordred | we're doing this so that we can run on the new host before adding it to the global inventory - right? | 17:47 |
| clarkb | mordred: yes | 17:47 |
| mordred | how about if we add ,/opt/system-config/inventory/openstack.yaml,/opt/system-config/inventory/groups.yaml,/etc/ansible/hosts/emergency.yaml to the -i | 17:47 |
| corvus | i'm going to restart zuul now | 17:47 |
| mordred | corvus: ++ | 17:47 |
| mordred | clarkb: I haven't tested that the command line will take comma separated list like the config file does - but I don't see any reason why it wouldn't | 17:48 |
| *** panda|rover is now known as panda|rover|baby | 17:48 | |
| clarkb | mordred: that seems like a reasonable thing at first glance. Any concerns with side effects? I think our use of the target var for the hosts entry and only running a small subset of things like base and a cleanup or two should make it safe | 17:48 |
| clarkb | mordred: I don't think base respects {{ target }} though | 17:48 |
| clarkb | we might end up running base against everything and maybe we need to add a --limit? | 17:48 |
| mordred | yeah - I think we should add a limit | 17:49 |
| mordred | which we already have actually | 17:49 |
| *** xek has quit IRC | 17:49 | |
| clarkb | the -l ? ya | 17:49 |
| *** xek has joined #openstack-infra | 17:49 | |
| mordred | yeah | 17:50 |
| *** agopi is now known as agopi|afk | 17:50 | |
| mordred | oh - --help says comma separated will work | 17:50 |
| clarkb | cool feel good to get to the bottom of that :) | 17:50 |
| clarkb | mordred: do you want to push the change or should I? | 17:50 |
| mordred | clarkb: I can push one up | 17:51 |
| *** mcgiggler has quit IRC | 17:51 | |
| *** rlandy|brb is now known as rlandy | 17:51 | |
| *** markvoelker has quit IRC | 17:54 | |
| clarkb | fungi: ^ fyi if you don't want to read all the scrollback the fix is to add more ansible environment stuff to our launch ansible runs | 17:54 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Add global inventory to launch_node https://review.openstack.org/642096 | 17:54 |
| clarkb | fungi: we weren't setting the root alias as the sysadmins var isn't availalbe to our launch script. We then set if after regular ansible cron runs | 17:54 |
| clarkb | mordred: I'm thinking we may still want my change at https://review.openstack.org/#/c/641880/ to clear out any panic log that might happen during our setup? though I suppose it should be totally unnecesasry if we set alias before exim config and exim restart | 17:55 |
| corvus | #status log restarted all of zuul at commit 603ce6f474ef70439bfa3adcaa27d806c23511f7 | 17:57 |
| openstackstatus | corvus: finished logging | 17:57 |
| corvus | re-enqueing | 17:57 |
| mordred | clarkb: yeah - I think maybe let's see if we're still getting paniclogs with the aliases set properly | 17:58 |
| mordred | clarkb: it seems like they're currently serving a purpose - indicating that there is an issue we should solve :) | 17:59 |
| clarkb | mordred: ++ | 17:59 |
| mordred | clarkb: but - if we're still getting them and they're bogus, let's land that for sure | 17:59 |
| clarkb | ya I think the case we'd want that is if there is a race between exim being installed and configuring it where we get a paniclog due to something triggering a root email | 18:00 |
| clarkb | that case may not exist at all | 18:00 |
| clarkb | mordred: also we should get ansible to document this behavior | 18:00 |
| clarkb | "specify inventory host path or comma separated host list. –inventory-file is deprecated" is all the docs say | 18:01 |
| *** mattw4 has joined #openstack-infra | 18:01 | |
| mordred | lovely :) | 18:02 |
| clarkb | corvus: we may want to enqueue https://review.openstack.org/#/c/641986 to the gate since I think our restart kicked it out of check (and its broken all of nova). I don't think it needs to be promoted as there are no other nova changes gating. | 18:02 |
| corvus | clarkb: it's in check now | 18:04 |
| *** electrofelix has quit IRC | 18:04 | |
| clarkb | infra-root can I get a second revoew on https://review.openstack.org/#/c/642080/ thats my last major todo out of putting puppet4 on our dev servers | 18:07 |
| corvus | clarkb: do you know what the test hole is for that nova change? | 18:08 |
| clarkb | corvus: my guess is that the test there only runs on nova changes and not novaclient changes | 18:09 |
| clarkb | then novaclient changed behavior and it broke | 18:09 |
| clarkb | but I don't kow for sure | 18:09 |
| clarkb | mriedem_burgers: ^ | 18:09 |
| *** rkukura has joined #openstack-infra | 18:11 | |
| corvus | https://review.openstack.org/#/c/635131/ did not run nova-live-migration but it also merged 3 weeks ago | 18:12 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Add Zuul project-config repo https://review.openstack.org/642100 | 18:12 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Define a specific Zuul tenant for Zuul project https://review.openstack.org/642101 | 18:12 |
| pabelanger | corvus: toabctl: mordred: clarkb: ^my first attempt at creating zuul specific tenant in zuul | 18:13 |
| clarkb | corvus: we just made releases yesterday | 18:13 |
| clarkb | corvus: possible novaclient was in that big round of release activity you noticed yesterday? | 18:13 |
| pabelanger | I suspect we'll also want an untrusted 'openstack-zuul-jobs' repo there too, at some point | 18:13 |
| jroll | corvus: clarkb python-novaclient was released recently, yeah | 18:13 |
| jroll | (per the comments) | 18:14 |
| jroll | the test must use novaclient from pip, the release started using the new microversion and broke it | 18:14 |
| corvus | clarkb, jroll: that makes sense. in which case, it might be good to put a nova-live-migration-src job on both repos, so we can catch those before release | 18:14 |
| clarkb | ++ | 18:14 |
| jroll | makes sense to me | 18:15 |
| jroll | mriedem_burgers: ^^ | 18:15 |
| *** wolverineav has joined #openstack-infra | 18:17 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Add a soft dependency between gitea build and run https://review.openstack.org/642103 | 18:19 |
| corvus | clarkb, mordred, tobiash, pabelanger, dmsimard: ^ | 18:20 |
| tobiash | yay | 18:21 |
| pabelanger | +2 | 18:21 |
| *** roman_g has quit IRC | 18:22 | |
| *** ykarel|away has quit IRC | 18:22 | |
| clarkb | corvus: fwiw I think that is the feature that tripleo was asking for (for completely different reasons) | 18:23 |
| corvus | clarkb: yeah, it's generally useful in situations where you may or may not build a binary artifact | 18:24 |
| *** eernst has joined #openstack-infra | 18:25 | |
| mordred | corvus: that's super awesome | 18:25 |
| clarkb | in their case they want a soft dependency of their integration jobs on their non integration jobs so that they can optionally not run the not integration jobs aiui | 18:26 |
| corvus | i've rechecked 640903 and 905; if they are green, then i think we're ready for a release | 18:26 |
| clarkb | I don't know why you'd want to run integration jobs if not running unittests but whatever | 18:26 |
| corvus | that is not something we should encourage or support | 18:27 |
| *** eernst has quit IRC | 18:29 | |
| *** eernst has joined #openstack-infra | 18:29 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Add a soft dependency between gitea build and run https://review.openstack.org/642103 | 18:29 |
| *** eernst has quit IRC | 18:30 | |
| corvus | clarkb, pabelanger, tobiash, mordred: ^ revised -- there's a caveat there we'll want to keep in mind. | 18:30 |
| clarkb | ya thats the difference with how tripleo wants to use the feature | 18:31 |
| corvus | i wonder if that's another thing we should consider adding to zuul -- an option to a dependency relationship which says, basically, "if job A runs, forget about the files matcher on job B, always run job B" | 18:31 |
| *** wolverineav has quit IRC | 18:31 | |
| *** jamesmcarthur_ has quit IRC | 18:32 | |
| corvus | or we could look into doing artifact dependencies... | 18:32 |
| mordred | corvus: yeah - that sounds useful/important | 18:32 |
| *** betherly has joined #openstack-infra | 18:34 | |
| *** wolverineav has joined #openstack-infra | 18:35 | |
| *** eernst has joined #openstack-infra | 18:36 | |
| *** rkukura has quit IRC | 18:36 | |
| openstackgerrit | Merged openstack-infra/nodepool master: docker: don't daemonize when starting images https://review.openstack.org/635584 | 18:37 |
| *** betherly has quit IRC | 18:39 | |
| *** eernst has quit IRC | 18:39 | |
| openstackgerrit | Merged openstack-infra/zuul master: tests: remove debugging prints https://review.openstack.org/641942 | 18:48 |
| *** markvoelker has joined #openstack-infra | 18:51 | |
| *** bhavikdbavishi has quit IRC | 18:55 | |
| corvus | huzzah! 903 failed and 905 succeeded as expected! | 18:55 |
| corvus | https://review.openstack.org/640905 is a fully working cross-repo-dependency speculative container execution | 18:56 |
| corvus | i'm going to take a break, and then start working on a release | 18:56 |
| mordred | corvus: huzzah indeed! that's super exciting | 18:57 |
| clarkb | corvus: neat. | 18:57 |
| *** wolverineav has quit IRC | 19:03 | |
| *** wolverineav has joined #openstack-infra | 19:03 | |
| *** wolverineav has quit IRC | 19:06 | |
| *** wolverineav has joined #openstack-infra | 19:06 | |
| clarkb | also I'm happy that my assertion about the command not existing causes a failure is true :) | 19:06 |
| clarkb | fungi: have a sec to review https://review.openstack.org/#/c/642080/1 ? cleans up some puppet-4 stuff | 19:06 |
| *** rfolco|ruck is now known as rfolco|ruck|brb | 19:11 | |
| *** jamesmcarthur has joined #openstack-infra | 19:11 | |
| openstackgerrit | Merged openstack-infra/zuul master: SQL: only create tables in scheduler https://review.openstack.org/610696 | 19:12 |
| *** rkukura has joined #openstack-infra | 19:13 | |
| openstackgerrit | Ankita Bansal proposed openstack-infra/storyboard-webclient master: Adds number of active stories beside repo list in the project_group/id page. A function storyCountActive is written in project_story_list_controller.js and called while fetching the projects list. A HTML tag added in project_search_item.html for the activ https://review.openstack.org/642121 | 19:15 |
| *** mriedem_burgers is now known as mriedem | 19:16 | |
| fungi | okay, i'm back from extended friday lunch errands and almost caught up on irc scrollback (though not e-mail yet) | 19:18 |
| *** diablo_rojo has quit IRC | 19:20 | |
| mriedem | jroll: correct the job uses novaclient from pypi / devstack | 19:20 |
| fungi | clarkb: in regard to the exim paniclog and our /etc/aliases, have you yet looked at a newly-launched server that's not in the static inventory yet? i have one handy (the soon relpacement wiki-dev02.openstack.org isn't in dns yet but is reachable at 23.253.253.208) | 19:21 |
| fungi | if you peek in the aliases file you'll see we don't actually write it during launch | 19:21 |
| fungi | but i'm still reading scrollback and it looks like you may have looked deeper into things | 19:22 |
| clarkb | fungi: yup https://review.openstack.org/#/c/642096/ should be the fix | 19:22 |
| clarkb | basically we don't have our global ansible vars availalbe to launch currently so the sysadmins value isn't found | 19:22 |
| fungi | and now i see a fix has been suggested | 19:22 |
| fungi | makes sense based on what i've seen up to this point | 19:22 |
| *** markvoelker has quit IRC | 19:24 | |
| fungi | approved 642096 and i agree in retrospect 641880 is likely entirely a no-op | 19:24 |
| *** jamesmcarthur has quit IRC | 19:30 | |
| fungi | okay, all caught up in here | 19:31 |
| *** wolverineav has quit IRC | 19:34 | |
| *** wolverineav has joined #openstack-infra | 19:35 | |
| clarkb | we probably want to watch the next launch to be sure that we don't run base on all the things but the limit should address that | 19:35 |
| mnaser | fungi: https://review.openstack.org/#/c/641896/1 do we wanna merge this now? | 19:36 |
| clarkb | mnaser: yes I think we do | 19:36 |
| clarkb | I can approve it now | 19:36 |
| mnaser | cool, i think https://review.openstack.org/#/c/641895/ as well might be good | 19:37 |
| clarkb | then jobs can reparent to base-test and check the results | 19:37 |
| fungi | mnaser: clarkb: yes, the sooner the better | 19:37 |
| fungi | all of the topic:bionic-transition changes should be safe to merge except the one i marked wip | 19:37 |
| clarkb | fungi: all are approved now except that wip change | 19:38 |
| fungi | though 641895 could likely be expanded by puppet, ansible and other teams to add similar branch pins to some of their jobs | 19:38 |
| fungi | i figure between the openstack-tox abstract job and the legacy-base job gmann is working on we should have most stuff covered (the new-style devstack jobs are already taken care of) | 19:39 |
| *** wolverineav has quit IRC | 19:40 | |
| *** jamesmcarthur has joined #openstack-infra | 19:43 | |
| openstackgerrit | Merged opendev/base-jobs master: Test changing the default nodeset to ubuntu-bionic https://review.openstack.org/641896 | 19:49 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Explicitly pin openstack-tox to xenial for <=rocky https://review.openstack.org/641895 | 19:49 |
| clarkb | https://ivanceras.github.io/svgbob-editor/ is a neat diagramming tool | 19:50 |
| clarkb | infra-root ^ will probably aprpeciate that given our use of ascii art | 19:50 |
| fungi | the name makes me think of microsoft bob | 19:50 |
| corvus | mordred, clarkb, fungi: i just thought of a refactor for the buildset registry jobs that will make things simpler; i don't think it requires any changes to zuul, so i'll continue with zuul release prep after lunch, but then i'll work on that refactor. i don't think it's going to be very complex, just rearranging some role rearranging | 19:51 |
| fungi | clarkb: but yes, that looks like an amazing tool | 19:51 |
| clarkb | I'm going to check my zuul logo ascii art in it | 19:51 |
| corvus | clarkb: that is awesome | 19:51 |
| corvus | tobiash: ^ :) | 19:52 |
| fungi | granted some of their examples seem to take advantage of characters outside the 7-bit ascii set | 19:52 |
| clarkb | hrm it doesn't seem to do the inferring with the ascii lines | 19:52 |
| clarkb | so would have to convert to | and _ and so on | 19:53 |
| fungi | i find the circuit diagramming example at the end very compelling | 19:54 |
| corvus | it's a lot faster if you clear out all the stuff from the example | 19:55 |
| fungi | granted the use of + and - for line art lends some confusion in that particular context | 19:55 |
| corvus | https://github.com/ivanceras/svgbob has a cli tool and written in rust | 19:57 |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/openstack-zuul-jobs master: Move zuul-legacy-jobs.yaml jobs to Bionic https://review.openstack.org/641886 | 19:57 |
| corvus | fungi: apparently you're supposed to think "bob ross" not "microsoft bob" | 19:57 |
| corvus | this might be interesting as a sphinx plugin | 19:58 |
| *** jbadiapa has quit IRC | 19:59 | |
| fungi | so true | 20:00 |
| clarkb | I can't make anyting for zuul that looks better than what I've already got. But probably could if I spent more than 5 minutes on it | 20:00 |
| *** luizbag has quit IRC | 20:01 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add global inventory to launch_node https://review.openstack.org/642096 | 20:03 |
| openstackgerrit | Merged openstack-infra/system-config master: Only install puppet 4 if not already installed https://review.openstack.org/642080 | 20:06 |
| *** wolverineav has joined #openstack-infra | 20:06 | |
| *** wolverineav has quit IRC | 20:11 | |
| *** irclogbot_1 has quit IRC | 20:13 | |
| *** markvoelker has joined #openstack-infra | 20:21 | |
| *** rfolco|ruck|brb is now known as rfolco|ruck | 20:21 | |
| *** e0ne has joined #openstack-infra | 20:24 | |
| pabelanger | corvus: clarkb: are we also considering a nodepool release? | 20:26 |
| clarkb | there wad a full nodepool restart not long ago to check openstack sdk compatobility | 20:29 |
| clarkb | and to support provider affinity | 20:29 |
| clarkb | I think it would be ok to release nodepool too | 20:29 |
| corvus | ya | 20:29 |
| pabelanger | great | 20:29 |
| clarkb | Im off to lunch to get out of the house. back after to followup on puppet and python thingd | 20:30 |
| *** xek has quit IRC | 20:37 | |
| *** xek has joined #openstack-infra | 20:38 | |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool master: Remove prelude from AWS release note https://review.openstack.org/642148 | 20:42 |
| *** yamamoto has joined #openstack-infra | 20:49 | |
| *** markvoelker has quit IRC | 20:53 | |
| mordred | corvus: wow. we really can't manage to get the python-base patch landed can we? | 20:54 |
| *** yamamoto has quit IRC | 20:54 | |
| *** kjackal has joined #openstack-infra | 20:55 | |
| mordred | corvus, clarkb: http://logs.openstack.org/32/632532/5/gate/system-config-run-gitea/ca78bee/ara-report/ is looking like it's trying to actually run against the actual gitea hosts | 20:56 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Revert "Docker: use the buildset registry if defined" https://review.openstack.org/642150 | 20:56 |
| *** fried_rolls is now known as fried_rice | 20:56 | |
| openstackgerrit | James E. Blair proposed opendev/base-jobs master: In docker build jobs, run the registry if not running https://review.openstack.org/642151 | 20:56 |
| corvus | mordred: cool, maybe we can continue to use it to test those changes ^ :) | 20:56 |
| mordred | \o/ | 20:56 |
| corvus | mordred: i'll start digging into your link | 20:57 |
| *** slaweq has quit IRC | 20:57 | |
| corvus | oh, sorry, one more patch to write, then i'll dig in | 20:57 |
| *** slaweq has joined #openstack-infra | 20:58 | |
| clarkb | I'll review after lunch | 21:00 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Use the opendev docker build jobs https://review.openstack.org/642152 | 21:00 |
| corvus | there it is ^ | 21:00 |
| corvus | mordred: wow yeah, there should be no gitea07 in there. | 21:01 |
| corvus | mordred: ah i think i get it. this runs after the base playbook, which probably re-bootstrapped fake-bridge enough to overwrite the config and use the real inventory | 21:03 |
| *** e0ne has quit IRC | 21:03 | |
| *** agopi|afk is now known as agopi | 21:03 | |
| mordred | corvus: oh! right | 21:04 |
| corvus | mordred: didn't we land a fix to that though which was supposed to be self testing? | 21:04 |
| mordred | maybe that fix didn't run test gitea? | 21:04 |
| * mordred looking | 21:04 | |
| mordred | corvus: oh - no - the only thing we landed in this area was related to launch-node | 21:06 |
| corvus | mordred: oh, another hypothesis -- that it's not the base playbook run in run-base.yaml that resets the configuration, but rather, the cron job. if this worked once and failed once, that might explain the difference -- whether the cron job ran | 21:06 |
| mordred | corvus: yes. it does in fact make sense | 21:06 |
| mordred | and makes more sense than a patch we landed impacting it | 21:06 |
| corvus | mordred: no i mean -- haven't we seen the test gitea playbook run? | 21:06 |
| corvus | if it has ever worked correctly, then it must be the second hypothesis | 21:07 |
| mordred | corvus: yeah - sorry - that's what I meant | 21:07 |
| mordred | corvus: first hypothesis only makes sense if we landed a patch that changed behavior AND that had a files exclusion causing gitea job to not run | 21:08 |
| mordred | but neither of those things happened - so I'm with 2nd hypothesis | 21:08 |
| mordred | is there a good way to disable cron? | 21:08 |
| corvus | here's a successful run: http://logs.openstack.org/03/642103/2/check/system-config-run-gitea/b9a8f9d/ara-report/result/d4311d2a-b5b5-4326-84da-4af0ee607a2d/ | 21:09 |
| corvus | mordred: hrm. normally it's only a minor nuisance; it shows up in output but doesn't affect results. and it's kind of nice not to have to debug it. | 21:09 |
| corvus | we're walking the walk on testing production here. | 21:10 |
| corvus | er, i mean it's kind of nice not to have to *disable* it | 21:10 |
| corvus | but i guess we could | 21:10 |
| corvus | put in a hostvar to set whether or not to enable cron | 21:11 |
| corvus | http://logs.openstack.org/32/632532/5/gate/system-config-run-gitea/ca78bee/hosts/bridge.openstack.org/ara-report/ | 21:12 |
| corvus | that's from the failing run, and cron did run | 21:12 |
| corvus | the only other idea that springs to mind would be to make a cleaner environment for the test run | 21:12 |
| corvus | mordred: i think you've convinced me that just disabling cron is ok | 21:12 |
| corvus | mordred is a skilled rhetorician | 21:13 |
| *** jamesmcarthur has quit IRC | 21:13 | |
| *** jamesmcarthur has joined #openstack-infra | 21:14 | |
| corvus | mordred: should we do that? you want to patch or shall i? | 21:14 |
| mordred | corvus: yeah - let's do that ... I think while testing real production is important ... | 21:15 |
| mordred | corvus: we're testing a thing here which the cron is bonging | 21:15 |
| mordred | corvus: if you have your eyes on where to put the flag already it would be great if you could - but if you're going to have to dig for it too I can | 21:16 |
| corvus | mordred: i don't, so if you can take it, i'd appreciate it | 21:16 |
| mordred | kk. on it | 21:16 |
| corvus | mordred: just that you'll probably want to put the setting for the gate in system-config/playbooks/zuul/templates/host_vars/bridge.openstack.org.yaml.j2 | 21:17 |
| *** bnemec is now known as beekneemech | 21:18 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Add flag to disable cron for test jobs https://review.openstack.org/642157 | 21:19 |
| mordred | corvus: maybe that'll fix it | 21:19 |
| corvus | mordred: lgtm | 21:21 |
| corvus | mordred: do you think we need to do similar for the cloud-launcher cron? | 21:21 |
| mordred | corvus: I don't think so - it shouldn't be polluting the host | 21:21 |
| corvus | k. couldn't remember if it did any 'pull project-config' or similar things | 21:22 |
| mordred | it might attempt to run some things against some clouds - but it won't have the creds for it to work | 21:22 |
| openstackgerrit | Merged openstack-infra/nodepool master: Remove prelude from AWS release note https://review.openstack.org/642148 | 21:25 |
| *** Wryhder has joined #openstack-infra | 21:26 | |
| corvus | mordred: would you mind reviewing https://review.openstack.org/#/q/status:open+topic:registry ? | 21:26 |
| *** betherly has joined #openstack-infra | 21:26 | |
| *** jamesmcarthur has quit IRC | 21:27 | |
| *** jamesmcarthur has joined #openstack-infra | 21:28 | |
| *** wolverineav has joined #openstack-infra | 21:28 | |
| mordred | corvus: stack looks great to me | 21:28 |
| corvus | mordred: thanks! | 21:29 |
| *** wolverineav has quit IRC | 21:30 | |
| *** betherly has quit IRC | 21:31 | |
| *** wolverineav has joined #openstack-infra | 21:32 | |
| *** wolverineav has quit IRC | 21:32 | |
| *** wolverineav has joined #openstack-infra | 21:32 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul-preview master: Port in changes from the c++ version https://review.openstack.org/641089 | 21:37 |
| *** betherly has joined #openstack-infra | 21:47 | |
| *** diablo_rojo has joined #openstack-infra | 21:47 | |
| *** jamesmcarthur has quit IRC | 21:50 | |
| *** markvoelker has joined #openstack-infra | 21:51 | |
| *** betherly has quit IRC | 21:52 | |
| *** jamesmcarthur has joined #openstack-infra | 21:53 | |
| *** jamesmcarthur has quit IRC | 21:54 | |
| *** Lucas_Gray has joined #openstack-infra | 21:58 | |
| corvus | fungi, clarkb: are you around to +3 https://review.openstack.org/642157 ? | 21:59 |
| clarkb | corvus: I just pulled up your topic:registry changes | 22:00 |
| clarkb | looks like zuul was unhappy with the third change there | 22:00 |
| corvus | clarkb: yeah, that's actually likely fixed by 642157 | 22:00 |
| *** rh-jelabarre has quit IRC | 22:00 | |
| clarkb | cool I've approved that one | 22:01 |
| clarkb | now to review the other stack | 22:01 |
| *** Wryhder has quit IRC | 22:01 | |
| corvus | clarkb: so i think we should land 642157 and the first 2 registry changes, then recheck 642152, and my zuul-preview changes, and 632532 | 22:01 |
| clarkb | corvus: whihc zuul-preview changes? I know about the DNM changes | 22:01 |
| corvus | clarkb: those | 22:01 |
| corvus | just to exercise the new jobs | 22:02 |
| clarkb | gotit | 22:02 |
| *** rh-jelabarre has joined #openstack-infra | 22:03 | |
| clarkb | ok I think things are headed to the gate now and we just have to wait before we recheck | 22:03 |
| corvus | ++ | 22:03 |
| *** kgiusti has left #openstack-infra | 22:04 | |
| clarkb | hrm something is uninstalling puppet4 in addition to installing it | 22:07 |
| clarkb | so my don't install puppet 4 all the time fix isn't working right | 22:07 |
| fungi | corvus: looking | 22:07 |
| clarkb | because puppet 4 has actually been removed | 22:07 |
| corvus | okay, i think docker wants me to buy a new hard drive | 22:07 |
| fungi | seems clarkb already beat me to it | 22:07 |
| *** betherly has joined #openstack-infra | 22:08 | |
| fungi | corvus: what's the provenance of http://files.openstack.org/project/git-test/www/.htaccess (is it in a git repo somewhere i can copy history from, or should i just list you as co-author on a patch introducing it)? | 22:08 |
| *** kjackal has quit IRC | 22:08 | |
| *** jamesmcarthur has joined #openstack-infra | 22:08 | |
| *** wolverineav has quit IRC | 22:08 | |
| mordred | corvus: running rust builds in a docker container via docker build DEFINITELY wants me to buy a new hard drive | 22:09 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Revert "Docker: use the buildset registry if defined" https://review.openstack.org/642150 | 22:09 |
| corvus | fungi: entirely me in emacs directly in afs, so co-author is the way to go | 22:10 |
| fungi | will do, thanks! | 22:10 |
| corvus | who makes the best internal ssd's these days? it's been a while since i've bought one | 22:11 |
| *** betherly has quit IRC | 22:13 | |
| *** EvilienM is now known as EmilienM | 22:16 | |
| fungi | good question. my most recent purchase was a "mushkin pilot" (1tb pcie m.2 ssd) | 22:16 |
| fungi | obtained in october for ~us$240 | 22:17 |
| *** wolverineav has joined #openstack-infra | 22:18 | |
| fungi | apparently their hq is in austin, tx | 22:18 |
| fungi | anyway, it's been performing well so far in a gaming rig which is also doing some virtualization. not sure how it would perform under more severe torture | 22:19 |
| *** rlandy has quit IRC | 22:19 | |
| fungi | granted i don't have any real benchmarks to compare either | 22:19 |
| *** jamesmcarthur has quit IRC | 22:19 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Fix puppet 4 installations https://review.openstack.org/642169 | 22:21 |
| clarkb | cmorpheus: mordred fungi ^ you reviewed the last change and that is the next fix. I expect this will actually fix it | 22:21 |
| fungi | my next-most-recent internal ssd purchase was in 2015, a 240gb "MyDigitalSSD" (msata ssd) for ~us$110 and it's still going strong in my primary workstation | 22:22 |
| mordred | clarkb: oh wow | 22:22 |
| clarkb | mordred: its good that we are working through this on a small number of hosts :) | 22:22 |
| mordred | clarkb: \o/ | 22:22 |
| clarkb | mordred: I expect we'll be pretty confident in the process as soon as we get through that :) | 22:22 |
| mordred | clarkb: it's almost like we've learned our lesson on things in the past | 22:23 |
| *** wolverineav has quit IRC | 22:23 | |
| clarkb | right | 22:23 |
| clarkb | corvus: samsung is who I've been going with lately | 22:23 |
| clarkb | corvus: decent prices for what I'm told is good quality. Both on their sata drives and nvme | 22:23 |
| clarkb | next host upgrade is going nvme for the zoom zooms | 22:24 |
| *** markvoelker has quit IRC | 22:24 | |
| fungi | i've been doing external usb3-powered ssds on my media server, with kernel mdraid mirroring | 22:25 |
| mtreinish | I think all but one of my machines has samsung ssds at this point, I've never had a failure so far | 22:26 |
| * mtreinish just doomed himself | 22:26 | |
| corvus | mtreinish: i assume you have enough drives to have statistically significant numbers :) | 22:26 |
| fungi | found a manufacturer named "vectotech" making 2tb external usb3 ssds, got a couple in 2018 for ~us$400@ | 22:27 |
| dmsimard | there were huge price drops on SSDs and NVMEs around xmas/black friday | 22:27 |
| mtreinish | for SSDs it's not nearly as many. Only 12 between all my boxes | 22:27 |
| dmsimard | I have too many drives now but I've been doing stuff like swapping out 5400rpm spindles out of old laptops for relatives :p | 22:27 |
| clarkb | I think intel still has the longest warranty but they cost a lot more | 22:28 |
| mtreinish | compared to the >50 spinning disks spread throughout my house | 22:28 |
| *** Swami has joined #openstack-infra | 22:28 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add flag to disable cron for test jobs https://review.openstack.org/642157 | 22:28 |
| dmsimard | corvus: https://ca.pcpartpicker.com/products/internal-hard-drive/ is a good place to look -- you see price trends at multiple vendors, $/GB, user reviews, etc | 22:30 |
| *** wolverineav has joined #openstack-infra | 22:32 | |
| *** jtomasek has quit IRC | 22:34 | |
| *** rh-jelabarre has quit IRC | 22:35 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Set up legacy git redirect sites https://review.openstack.org/642173 | 22:35 |
| *** betherly has joined #openstack-infra | 22:50 | |
| *** wolverineav has quit IRC | 22:54 | |
| *** betherly has quit IRC | 22:55 | |
| *** eernst has joined #openstack-infra | 22:58 | |
| *** irclogbot_1 has joined #openstack-infra | 23:01 | |
| *** wolverineav has joined #openstack-infra | 23:01 | |
| *** eernst has quit IRC | 23:02 | |
| *** diablo_rojo has quit IRC | 23:03 | |
| openstackgerrit | Merged opendev/base-jobs master: In docker build jobs, run the registry if not running https://review.openstack.org/642151 | 23:10 |
| *** rascasoft has quit IRC | 23:10 | |
| *** jcoufal has quit IRC | 23:15 | |
| *** eernst has joined #openstack-infra | 23:20 | |
| *** markvoelker has joined #openstack-infra | 23:21 | |
| *** xek has quit IRC | 23:22 | |
| *** eernst has quit IRC | 23:23 | |
| *** eernst has joined #openstack-infra | 23:27 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Use opendev logos https://review.openstack.org/642179 | 23:28 |
| fungi | ooh! fancy | 23:28 |
| corvus | https://screenshots.firefox.com/7uGZTC42mvVafmgz/localhost if you're curious | 23:28 |
| fungi | i am! | 23:28 |
| fungi | or at least i was... | 23:28 |
| fungi | now i'm not though. thanks! | 23:28 |
| corvus | the <h2> under there is too big, but we can fix that later | 23:29 |
| fungi | lgtm | 23:29 |
| corvus | and still need to find where to put the favicon :) | 23:29 |
| fungi | don't ask a web designer | 23:30 |
| fungi | apparently there's all sorts of crazy things they do these days to create iphone-compliant app buttons or tiles or whatever they're called | 23:30 |
| fungi | and if you just stick browser-oriented icons in there, they make funny faces at you | 23:31 |
| corvus | oh yeah, i used an online tool to bundle all that up for zuul's website | 23:31 |
| *** eernst has quit IRC | 23:31 | |
| fungi | it's nuts, isn't it? | 23:31 |
| *** betherly has joined #openstack-infra | 23:32 | |
| corvus | ayep | 23:32 |
| *** eernst has joined #openstack-infra | 23:33 | |
| *** whoami-rajat has quit IRC | 23:33 | |
| fungi | for my personal sites i just do something like <link rel="shortcut icon" href="_static/logo.svg"/> and give up | 23:33 |
| fungi | and assume some day in the distant future, all devices will support svg | 23:34 |
| fungi | and at least in the interim, firefox seems to be fine with that | 23:34 |
| clarkb | Im trying to rememberif the emails I sent had the png/svg type assets in them | 23:36 |
| fungi | i assume so since there's svg in that change | 23:36 |
| *** betherly has quit IRC | 23:36 | |
| fungi | and apparently also a ping | 23:36 |
| *** eernst has quit IRC | 23:37 | |
| *** wolverineav has quit IRC | 23:37 | |
| corvus | clarkb: not that i found, but you sent a pdf, and i turned that into an svg | 23:37 |
| corvus | and then turned the svg into a png | 23:37 |
| clarkb | ah we can probably get james to send the real things along if we want | 23:37 |
| corvus | clarkb: yeah. we can replace them. i suspect they'll be substantially similar, so we can probably land these and swap them out when we get 'em | 23:38 |
| corvus | the pdf was vectorized, so there shouldn't have been any data loss. but if it was an older revision or something, the image could be slightly different. | 23:38 |
| clarkb | ++ | 23:39 |
| *** wolverineav has joined #openstack-infra | 23:39 | |
| *** wolverineav has quit IRC | 23:44 | |
| *** wolverineav has joined #openstack-infra | 23:44 | |
| *** eernst has joined #openstack-infra | 23:44 | |
| *** eernst has quit IRC | 23:44 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Disable ansible cron even more https://review.openstack.org/642181 | 23:45 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add flatten checkbox https://review.openstack.org/642047 | 23:45 |
| corvus | clarkb, fungi, mordred: ^ one more fix needed for the ansible cron (the run gitea job failed again with the same error, i think that'll get it) | 23:45 |
| corvus | clarkb, fungi: also if one of you could add a +2 to https://review.openstack.org/642152 that'd be great; i can continue rechecking it and pushing it through when ready. | 23:46 |
| corvus | i think it works at this point and only ran into the ansible cron issue | 23:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Use the opendev docker build jobs https://review.openstack.org/642152 | 23:48 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Add a soft dependency between gitea build and run https://review.openstack.org/642103 | 23:48 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: DNM: test broken zuul-preview dockerfile https://review.openstack.org/640903 | 23:48 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: DNM: test fixed zuul-preview dockerfile https://review.openstack.org/640905 | 23:48 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Split python-base into its own Dockerfile https://review.openstack.org/632532 | 23:48 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Run python with jemalloc in containers https://review.openstack.org/636017 | 23:48 |
| corvus | that's all the changes rebased and serialized for maximum testing | 23:49 |
| fungi | guess i'll review the new patchest for that one. only got a few lines in | 23:49 |
| corvus | fungi: sorry, was only a rebase | 23:49 |
| fungi | yeah, looks the same. cool | 23:49 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Split python-base into its own Dockerfile https://review.openstack.org/632532 | 23:50 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Run python with jemalloc in containers https://review.openstack.org/636017 | 23:50 |
| *** markvoelker has quit IRC | 23:54 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Set up legacy git redirect sites https://review.openstack.org/642173 | 23:55 |
| *** fried_rice is now known as efried | 23:56 | |
| clarkb | corvus: fungi have a moment for other ansible things https://review.openstack.org/#/c/642169/1 | 23:56 |
| fungi | ja | 23:57 |
| fungi | weird, i could swear i already reviewed half of that one earlier. i must have gotten distracted before i finished | 23:58 |
| *** agopi has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!