| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-accessbot master: accessbot logs : add timestamp and rotate https://review.openstack.org/588106 | 00:00 |
|---|---|---|
| *** dave-mccowan has quit IRC | 00:02 | |
| *** olivierb- has quit IRC | 00:05 | |
| *** rlandy has quit IRC | 00:06 | |
| *** edmondsw has joined #openstack-infra | 00:07 | |
| *** clarkb has quit IRC | 00:09 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Update meetbot name to "openstack" https://review.openstack.org/588107 | 00:10 |
| ianw | infra-root: ^ does anyone know what this is about? did we at some point s/open_stack/openstack/ for the meetbot name? | 00:10 |
| ianw | it goes back at least to the project-config branch | 00:10 |
| *** clarkb has joined #openstack-infra | 00:11 | |
| *** gyee has quit IRC | 00:11 | |
| *** pbourke has quit IRC | 00:12 | |
| *** edmondsw has quit IRC | 00:12 | |
| *** dingyichen has joined #openstack-infra | 00:18 | |
| fungi | ianw: the account name is open_stack | 00:18 |
| fungi | the nick is openstack (no _) | 00:18 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: trigger-readthedocs: Move secret bits into a dict https://review.openstack.org/587767 | 00:19 |
| ianw | fungi: ohh, ok. how do you tell that? not from whois? | 00:20 |
| pleia2 | ianw: /msg nickserv info openstack | 00:20 |
| ianw | ahh, ok, thanks | 00:21 |
| *** hongbin has joined #openstack-infra | 00:22 | |
| *** dave-mccowan has joined #openstack-infra | 00:22 | |
| *** mriedem has quit IRC | 00:29 | |
| *** dave-mccowan has quit IRC | 00:55 | |
| *** EmilienM has quit IRC | 01:02 | |
| *** EmilienM has joined #openstack-infra | 01:03 | |
| *** jangutter has quit IRC | 01:03 | |
| *** jangutter has joined #openstack-infra | 01:09 | |
| *** edmondsw has joined #openstack-infra | 01:29 | |
| *** dave-mccowan has joined #openstack-infra | 01:47 | |
| *** edmondsw has quit IRC | 01:50 | |
| *** edmondsw has joined #openstack-infra | 01:51 | |
| *** dingyichen has quit IRC | 01:52 | |
| *** dingyichen has joined #openstack-infra | 01:53 | |
| *** edmondsw has quit IRC | 01:55 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-accessbot master: Add alumni to accessbot https://review.openstack.org/588115 | 02:04 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Add OpenStack IRC Wall of Fame https://review.openstack.org/588118 | 02:19 |
| *** psachin has joined #openstack-infra | 02:21 | |
| *** e0ne has joined #openstack-infra | 02:23 | |
| *** e0ne has quit IRC | 02:23 | |
| *** witek has quit IRC | 02:25 | |
| *** witek has joined #openstack-infra | 02:27 | |
| *** bobh has joined #openstack-infra | 02:40 | |
| *** bobh has quit IRC | 02:41 | |
| *** bobh has joined #openstack-infra | 02:41 | |
| *** bobh has quit IRC | 02:46 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-accessbot master: accessbot logs : add timestamp and rotate https://review.openstack.org/588106 | 02:48 |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-accessbot master: Add alumni to accessbot https://review.openstack.org/588115 | 02:48 |
| openstackgerrit | Merged openstack-infra/project-config master: readthedocs secret : remove prefix https://review.openstack.org/587771 | 02:51 |
| clarkb | hrm I'm going to ave to rejoin all the channels tomorrow | 03:06 |
| *** edmondsw has joined #openstack-infra | 03:19 | |
| *** roman_g has quit IRC | 03:19 | |
| *** yamamoto has quit IRC | 03:20 | |
| *** xarses has joined #openstack-infra | 03:22 | |
| *** edmondsw has quit IRC | 03:24 | |
| *** dave-mccowan has quit IRC | 03:33 | |
| *** witek has quit IRC | 03:33 | |
| *** udesale has joined #openstack-infra | 03:46 | |
| *** hongbin has quit IRC | 03:46 | |
| *** ramishra has joined #openstack-infra | 03:47 | |
| *** yamamoto has joined #openstack-infra | 03:55 | |
| *** witek has joined #openstack-infra | 03:57 | |
| *** mschuppert has joined #openstack-infra | 04:06 | |
| *** yamamoto has quit IRC | 04:09 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-accessbot master: Add mlock setting and op_channel option https://review.openstack.org/588134 | 04:28 |
| *** Bhujay has joined #openstack-infra | 04:38 | |
| *** yamamoto has joined #openstack-infra | 04:40 | |
| *** yamamoto has quit IRC | 04:47 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul-jobs master: trigger-readthedocs: fix typo https://review.openstack.org/588137 | 04:52 |
| *** yamamoto has joined #openstack-infra | 04:55 | |
| *** janki has joined #openstack-infra | 04:56 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Add OpenStack IRC Wall of Fame https://review.openstack.org/588118 | 04:59 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Enforce channel modes with accessbot https://review.openstack.org/588139 | 04:59 |
| *** trown|outtypewww has quit IRC | 05:02 | |
| *** yamamoto has quit IRC | 05:05 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Add OpenStack IRC Wall of Fame https://review.openstack.org/588118 | 05:05 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Enforce channel modes with accessbot https://review.openstack.org/588139 | 05:05 |
| *** fnordahl has joined #openstack-infra | 05:05 | |
| *** yamamoto has joined #openstack-infra | 05:06 | |
| *** yamamoto has quit IRC | 05:06 | |
| ianw | corvus / mordred : ^ so that little collection of project-config & accessbot changes should, i think help enforce the modes from accessbot and keep a little tighter control on the access lists | 05:08 |
| *** trown has joined #openstack-infra | 05:12 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: trigger-readthedocs: fix typo https://review.openstack.org/588137 | 05:23 |
| *** trown has quit IRC | 05:27 | |
| *** trown|brb has joined #openstack-infra | 05:29 | |
| *** quiquell has joined #openstack-infra | 05:56 | |
| *** ccamacho has joined #openstack-infra | 06:16 | |
| *** udesale has quit IRC | 06:23 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul-jobs master: Debugging for readthedoc web ping https://review.openstack.org/588146 | 06:27 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul-jobs master: Require at least openstacksdk 0.17.1 https://review.openstack.org/588149 | 06:41 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul-jobs master: Fix comparison with wrong mime type https://review.openstack.org/588150 | 06:43 |
| *** xarses has quit IRC | 06:55 | |
| *** ginopc has joined #openstack-infra | 07:00 | |
| quiquell | Hello do we have any issue regarding this ? http://logs.openstack.org/94/587394/2/check/tripleo-ci-centos-7-scenario007-multinode-oooq-container/e33b430/job-output.txt.gz#_2018-08-01_14_44_05_480113 | 07:03 |
| quiquell | Download error on http://mirror.ord.rax.openstack.org/pypi/simple/: [Errno 101] Network is unreachable -- Some packages may not be found! | 07:03 |
| *** rcernin has quit IRC | 07:03 | |
| quiquell | Looks like a provider issue | 07:03 |
| *** snapiri has joined #openstack-infra | 07:30 | |
| *** snapiri has quit IRC | 07:32 | |
| *** snapiri has joined #openstack-infra | 07:32 | |
| *** tosky has joined #openstack-infra | 07:33 | |
| ianw | quiquell: not as far as i've seen at least ... | 07:35 |
| *** electrical_ has quit IRC | 07:36 | |
| *** gouthamr has quit IRC | 07:36 | |
| *** jpich has joined #openstack-infra | 07:38 | |
| *** yamamoto has joined #openstack-infra | 07:41 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul-jobs master: Fixup header/footer https://review.openstack.org/588163 | 07:44 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul-jobs master: Only link timestamps https://review.openstack.org/588164 | 07:44 |
| *** ekhugen has quit IRC | 07:45 | |
| *** Tahvok has quit IRC | 07:45 | |
| *** strigazi has quit IRC | 07:45 | |
| *** SotK has quit IRC | 07:45 | |
| *** flaper87 has quit IRC | 07:46 | |
| *** tbarron has quit IRC | 07:46 | |
| *** mandre_away has quit IRC | 07:46 | |
| *** eandersson has quit IRC | 07:46 | |
| *** Tahvok has joined #openstack-infra | 07:46 | |
| *** zerick has quit IRC | 07:46 | |
| *** mandre has joined #openstack-infra | 07:47 | |
| *** zerick has joined #openstack-infra | 07:47 | |
| *** gtmanfred has quit IRC | 07:47 | |
| *** gtmanfred has joined #openstack-infra | 07:50 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Debugging for readthedoc web ping https://review.openstack.org/588146 | 07:50 |
| *** jpena|off is now known as jpena | 08:12 | |
| *** jlvillal has joined #openstack-infra | 08:29 | |
| *** electrofelix has joined #openstack-infra | 08:37 | |
| *** dingyichen has quit IRC | 08:38 | |
| openstackgerrit | Slawek Kaplonski proposed openstack-infra/project-config master: Don't run ironic-tempest job for irrelevant changes in Neutron https://review.openstack.org/588181 | 08:40 |
| *** derekh has joined #openstack-infra | 08:42 | |
| *** udesale has joined #openstack-infra | 08:46 | |
| *** jbadiapa has quit IRC | 08:47 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Try again with rtd password secret https://review.openstack.org/588182 | 08:47 |
| ianw | AJaeger: thanks :) this is like the worst possible job to debug, as it's not only in the trusted repo but also marked for post-review. makes it quite hard to test :/ | 08:55 |
| AJaeger | ianw: I thought I give you a friendly +2 so that you don't feel so lonely :) | 08:59 |
| AJaeger | yeah, debugging those is tricky | 08:59 |
| *** pcaruana has joined #openstack-infra | 09:00 | |
| openstackgerrit | Merged openstack-infra/project-config master: Try again with rtd password secret https://review.openstack.org/588182 | 09:03 |
| *** SotK has joined #openstack-infra | 09:06 | |
| *** roman_g has joined #openstack-infra | 09:08 | |
| *** Bhujay has quit IRC | 09:11 | |
| *** mschuppert has quit IRC | 09:12 | |
| *** mrsoul has joined #openstack-infra | 09:12 | |
| ianw | it worked! http://logs.openstack.org/ee/ee5167a518de07c325f326df212c92e5c1e786a9/post/trigger-readthedocs-webhook/9a7eb35/ara-report/ | 09:15 |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul-jobs master: Revert "Debugging for readthedoc web ping" https://review.openstack.org/588186 | 09:18 |
| AJaeger | ianw: Yeah! | 09:21 |
| AJaeger | ianw: +2A | 09:23 |
| *** mrsoul is now known as mschuppert | 09:25 | |
| ianw | thanks. tomorrow i'll get a mail together about the transition as we discussed in the meeting | 09:26 |
| ianw | roman_g: if you want to jump the gun, you can do similar to gerrit-dash-creator | 09:27 |
| *** calbers has joined #openstack-infra | 09:27 | |
| *** zoli is now known as zoli|lunch | 09:39 | |
| *** edmondsw has joined #openstack-infra | 09:48 | |
| *** markmcd has quit IRC | 09:56 | |
| *** markmcd has joined #openstack-infra | 10:00 | |
| *** yamamoto has quit IRC | 10:02 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Revert "Debugging for readthedoc web ping" https://review.openstack.org/588186 | 10:04 |
| *** gfidente has joined #openstack-infra | 10:04 | |
| *** tbarron has joined #openstack-infra | 10:06 | |
| *** AhmadM has quit IRC | 10:15 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Fix wrong matched project template https://review.openstack.org/588201 | 10:19 |
| *** yamamoto has joined #openstack-infra | 10:26 | |
| *** dtantsur|afk is now known as dtantsur | 10:32 | |
| *** vivsoni has joined #openstack-infra | 10:39 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack-infra/bindep master: Add extra suse testing of fallback file https://review.openstack.org/588209 | 10:41 |
| *** panda|rover|bbl is now known as panda|rover | 10:47 | |
| *** zoli|lunch is now known as zoli | 11:00 | |
| *** yamamoto has quit IRC | 11:00 | |
| *** jpena is now known as jpena|lunch | 11:04 | |
| *** jamespage has quit IRC | 11:04 | |
| *** fmccarthy has quit IRC | 11:04 | |
| *** rajinir has quit IRC | 11:04 | |
| *** lamt has quit IRC | 11:04 | |
| *** dham1 has quit IRC | 11:04 | |
| *** auggy has quit IRC | 11:04 | |
| *** simondodsley_ has quit IRC | 11:04 | |
| *** zxiiro has quit IRC | 11:04 | |
| *** neith has quit IRC | 11:04 | |
| *** evgenyl_ has quit IRC | 11:04 | |
| *** JpMaxMan has quit IRC | 11:04 | |
| *** viks_ has quit IRC | 11:04 | |
| *** yamamoto has joined #openstack-infra | 11:05 | |
| *** simondodsley_ has joined #openstack-infra | 11:05 | |
| *** zzzeek has quit IRC | 11:07 | |
| *** calbers has quit IRC | 11:08 | |
| *** calbers has joined #openstack-infra | 11:10 | |
| *** zzzeek has joined #openstack-infra | 11:13 | |
| *** rh-jelabarre has joined #openstack-infra | 11:18 | |
| *** priteau has joined #openstack-infra | 11:18 | |
| *** jangutter has quit IRC | 11:24 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add /{tenant}/pipelines route https://review.openstack.org/541521 | 11:25 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack-infra/bindep master: Fix user profile display https://review.openstack.org/584955 | 11:26 |
| *** udesale has quit IRC | 11:27 | |
| *** dave-mccowan has joined #openstack-infra | 11:27 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: scheduler: add job's parent name to the rpc job_list method https://review.openstack.org/573473 | 11:27 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add /{tenant}/labels route https://review.openstack.org/553979 | 11:32 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add /{tenant}/nodes route https://review.openstack.org/553998 | 11:32 |
| openstackgerrit | Merged openstack-infra/project-config master: Add Fluorine functional to grafana and remove fullstack https://review.openstack.org/582749 | 11:33 |
| *** ramishra has quit IRC | 11:43 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: dashboard: add /{tenant}/job.html page to display job details https://review.openstack.org/535545 | 11:44 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: dashboard: add /{tenant}/projects.html web page https://review.openstack.org/537870 | 11:44 |
| *** boden has joined #openstack-infra | 11:56 | |
| *** gfidente has quit IRC | 11:57 | |
| *** ramishra has joined #openstack-infra | 11:58 | |
| *** gfidente has joined #openstack-infra | 12:02 | |
| *** rpioso|afk is now known as rpioso | 12:06 | |
| *** vivsoni_ has joined #openstack-infra | 12:06 | |
| *** vivsoni has quit IRC | 12:07 | |
| *** tpsilva has joined #openstack-infra | 12:15 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: dashboard: add /{tenant}/labels.html web page https://review.openstack.org/553980 | 12:15 |
| *** rfolco|off is now known as rfolco|ruck | 12:15 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: dashboard: add /{tenant}/nodes.html web page https://review.openstack.org/553999 | 12:16 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: dashboard: add jobs graph rendering https://review.openstack.org/537869 | 12:16 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: dashboard: add project pipeline rendering https://review.openstack.org/537871 | 12:17 |
| *** rlandy has joined #openstack-infra | 12:38 | |
| csatari | https://www.openstack.org/summit/vancouver-2018/videos gives a 404. Who can help to fix that? | 12:50 |
| *** udesale has joined #openstack-infra | 12:51 | |
| *** mriedem has joined #openstack-infra | 12:57 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: ansible-role-container-registry: switch to non-pypi jobs https://review.openstack.org/587847 | 12:58 |
| EmilienM | AJaeger: ^ should be good now | 12:59 |
| *** kgiusti has joined #openstack-infra | 12:59 | |
| *** eharney has quit IRC | 12:59 | |
| *** kgiusti has quit IRC | 12:59 | |
| *** kgiusti has joined #openstack-infra | 13:00 | |
| *** zxiiro has joined #openstack-infra | 13:03 | |
| *** gfidente has quit IRC | 13:11 | |
| *** jtomasek-tmp has joined #openstack-infra | 13:12 | |
| *** rh-jelabarre has quit IRC | 13:14 | |
| *** gfidente has joined #openstack-infra | 13:18 | |
| *** jaosorior has quit IRC | 13:20 | |
| *** janki has quit IRC | 13:24 | |
| *** jcoufal has joined #openstack-infra | 13:31 | |
| *** jpena|lunch is now known as jpena | 13:33 | |
| *** jaosorior has joined #openstack-infra | 13:33 | |
| *** boden has quit IRC | 13:34 | |
| mordred | corvus: yes, 2.6.2 is out - and is what is now installed on bride | 13:36 |
| mordred | bridge | 13:36 |
| mordred | not bride | 13:36 |
| zxiiro | I starred a project in storyboard but I don't get emails when a new item is created. Is there a way to get storyboard to email you when stories for a project you are interested in get created? | 13:38 |
| zxiiro | nevermind just as I said that I realized I disabled email notifications. duh | 13:38 |
| *** quiquell is now known as quiquell|off | 13:43 | |
| *** eharney has joined #openstack-infra | 13:45 | |
| *** quiquell|off has quit IRC | 13:48 | |
| evrardjp | hey, I am confused about something in bindep gates. I think it needs more explanation on how things are organised. It seems a variable is overriden for a reason I ignore... | 13:49 |
| evrardjp | anyone up to the task? | 13:49 |
| evrardjp | my patch here: https://review.openstack.org/#/c/588209/ doesn't seem to use the code of bindep itself, but another bindep binary. As you can see here, in the ara log: http://logs.openstack.org/09/588209/1/check/bindep-fallback-opensuse-150/b622ba5/ara-report/result/ea20453b-7256-4f16-a548-c5d30ea623bf/ | 13:50 |
| evrardjp | the bindep search ends up searching /usr/bindep-env/bin/bindep | 13:51 |
| evrardjp | the playbook itself seem to have the right path: https://github.com/openstack-infra/bindep/blob/a6f018dafcec7c22901311b07e62b072a4966544/playbooks/bindep-fallback/run.yaml#L18 | 13:51 |
| evrardjp | but a hound search shows only result for /sr/bindep-env/bin/bindep : http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/site-variables.yaml#n9 | 13:52 |
| evrardjp | I was wondering if there was no precedence issue | 13:52 |
| *** bobh has joined #openstack-infra | 13:52 | |
| *** shachar has joined #openstack-infra | 13:53 | |
| corvus | zxiiro: yeah if you subscribe or star or something the project you should get email | 13:54 |
| *** shachar has quit IRC | 13:54 | |
| corvus | zxiiro: i think if you go to the project list and click the star | 13:55 |
| zxiiro | yep I got that | 13:55 |
| zxiiro | I had "Notifications' unchecked in my profile page which I didn't raelize until now. | 13:55 |
| corvus | zxiiro: that was going to be the next thing i suggested :) | 13:55 |
| corvus | zxiiro: that should work. the only catch is that you won't get email for private stories. that's a known issue. | 13:56 |
| pabelanger | evrardjp: yah, I don't think we can use the bindep role, since we are using site-variables, they cannot be overridden | 13:59 |
| pabelanger | let me confirm | 13:59 |
| evrardjp | ok | 13:59 |
| evrardjp | yeah site-variables seem to override things. | 13:59 |
| pabelanger | yah, that is expected for zuul | 14:00 |
| pabelanger | so, we need to rework playbooks/bindep-fallback/run.yaml and remove dependency on bindep role | 14:01 |
| evrardjp | two ways to fix it: change the bindep role to have bindep_command | default(_bindep_command) and have site-variables using _bindep_command ? | 14:01 |
| evrardjp | or use a different way to do things | 14:01 |
| evrardjp | that's method 2 | 14:01 |
| evrardjp | ok. | 14:01 |
| evrardjp | I can fix this, because it should be simple. | 14:01 |
| evrardjp | Let me add you to the reviews. Okay for you? | 14:02 |
| pabelanger | sure | 14:02 |
| evrardjp | It will be fairly simple... Just removing the role, and directly calling bindep. If you want more fancy things, tell me : ) | 14:02 |
| evrardjp | I will still compare the role and all but I don't expect the role to run many things necessary for this case | 14:02 |
| pabelanger | nope, that should be good | 14:02 |
| mordred | corvus: I have just run ansible-playbook on bridge.o.o pointed at itself and it worked fine - so I think we're in position to iterate further | 14:03 |
| *** janki has joined #openstack-infra | 14:07 | |
| *** ccamacho has quit IRC | 14:07 | |
| *** ccamacho has joined #openstack-infra | 14:07 | |
| *** ccamacho has quit IRC | 14:08 | |
| *** ccamacho has joined #openstack-infra | 14:08 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack-infra/bindep master: Fix bindep path https://review.openstack.org/588253 | 14:13 |
| evrardjp | pabelanger: ^ | 14:13 |
| *** hongbin_ has joined #openstack-infra | 14:16 | |
| evrardjp | ianw: could you re-review https://review.openstack.org/#/c/584955/ , please ? | 14:16 |
| *** boden has joined #openstack-infra | 14:16 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack-infra/bindep master: Fix bindep path https://review.openstack.org/588253 | 14:17 |
| pabelanger | evrardjp: let comment | 14:18 |
| evrardjp | pabelanger: haha sorry I was blind I think you reviewed previous patchset | 14:18 |
| pabelanger | k | 14:19 |
| evrardjp | let me repush things | 14:20 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack-infra/bindep master: Fix bindep path https://review.openstack.org/588253 | 14:20 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid master: Fixed ODIC ImplicitGrant lost session issue https://review.openstack.org/588286 | 14:20 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack-infra/bindep master: Fix bindep path https://review.openstack.org/588253 | 14:20 |
| evrardjp | oh god | 14:20 |
| evrardjp | anyway | 14:20 |
| evrardjp | it should be the good one | 14:20 |
| AJaeger | evrardjp: thanks for fixing the bindep tests! | 14:21 |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-role-puppet master: Reorganize hieradata to match ansible variables https://review.openstack.org/588290 | 14:21 |
| mordred | corvus: I'd like to do that ^^ as the next step, which also will involve moving the directories on puppetmaster | 14:21 |
| evrardjp | AJaeger: anything! ping if you need. I will maybe not refactor all the things though #ENOTIME | 14:22 |
| mordred | but I think if we do that first, then we can transfer the hieradata files over to bridge andhave them work for both ansible-native and ansible-puppet | 14:22 |
| *** dhill_ has quit IRC | 14:25 | |
| *** dhill_ has joined #openstack-infra | 14:26 | |
| *** roman_g has quit IRC | 14:38 | |
| *** rh-jelabarre has joined #openstack-infra | 14:54 | |
| *** bobh has quit IRC | 14:55 | |
| *** efried is now known as efried_afk | 14:55 | |
| openstackgerrit | Merged openstack-infra/openstackid master: Fixed ODIC ImplicitGrant lost session issue https://review.openstack.org/588286 | 14:56 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack-infra/bindep master: Fix bindep path https://review.openstack.org/588253 | 14:58 |
| fungi | csatari: where was that linked from? i can give the site operators a heads up or you can file a bug report at https://bugs.launchpad.net/openstack-org/+filebug | 14:59 |
| *** auristor has quit IRC | 15:00 | |
| fungi | csatari: aha, i see it's a navigation link at the top of https://www.openstack.org/summit/vancouver-2018/ | 15:01 |
| *** gouthamr has joined #openstack-infra | 15:02 | |
| *** ccamacho has quit IRC | 15:05 | |
| * clarkb rejoins all the channels | 15:05 | |
| *** udesale has quit IRC | 15:15 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-role-puppet master: Reorganize hieradata to match ansible variables https://review.openstack.org/588290 | 15:17 |
| mordred | clarkb: when you've rejoined the channels ^^ that is the next thing I'd like to do wrt puppetmaster redux | 15:18 |
| clarkb | mordred: that is a wonderful hack | 15:18 |
| mordred | \o/ | 15:18 |
| clarkb | mordred: be careful applying that to the actual hieradata as I think there is still some cleanup that needs happening there and possibly uncommitted files | 15:19 |
| clarkb | (so maybe rely on what the fs says more than git) | 15:19 |
| mordred | production/fqdn/grafana02.openstack.org.yaml~ | 15:20 |
| mordred | production/group/.eavesdrop.yaml.swp | 15:20 |
| mordred | production/group/review.yaml | 15:20 |
| mordred | that's what git status shows | 15:20 |
| clarkb | mordred: review.yaml probably the important on ethere, maybe we just commit it | 15:20 |
| mordred | (as untracked/unadded) | 15:20 |
| mordred | clarkb: yeah - seems like a good thing to add | 15:21 |
| *** psachin has quit IRC | 15:21 | |
| clarkb | otherwise we still hvae too much stuff checked in and when I get bored I try to pick a new one off the list and clean it up but all the easy stuff is done I think :) | 15:22 |
| mordred | yeah- there's a LOT of stuff in there | 15:22 |
| *** sthussey has joined #openstack-infra | 15:23 | |
| clarkb | mordred: my suggestion for migrating would be to copy everything to he new dirs, leave the old dirs in place and put a "lock" on hiera changes. Merge your change, maybe with puppet disbaled and do a run or two by hand to make sure all is happy, remove old files then copy the lot to bridge | 15:24 |
| *** bobh has joined #openstack-infra | 15:25 | |
| clarkb | but that way we don't race between things merging and hiera contents on disk and can double check it works in small scope before unleashing it on ~100 hosts | 15:25 |
| mordred | clarkb: I was thinking similar - but I was gonna try symlinks instead of copies | 15:25 |
| clarkb | i suppose that should work too | 15:26 |
| corvus | mordred: change lgtm. it promises to be less brain hurt. | 15:26 |
| mordred | clarkb, corvus: http://paste.openstack.org/show/727159/ | 15:27 |
| clarkb | that looks right | 15:28 |
| boden | hate to nag for a review, but it would be great if we could get some movement on https://review.openstack.org/#/c/584498/ so that I can test a RC publish to pypi | 15:29 |
| boden | config-core ^ | 15:29 |
| mordred | then, on bridge.openstack.org, when we copy it over, I think putting it in /etc/ansible/secrets - and removing the production/development subdirs since we don't really use those anymore | 15:30 |
| *** auristor has joined #openstack-infra | 15:31 | |
| clarkb | boden: done, worth noting if yo uare in a time crunch you can make changes like that in your in repo zuul config instead | 15:31 |
| boden | clarkb ack and thanks | 15:31 |
| clarkb | boden: we are slowly pushing that direction in general, just haven't seen a mass move by openstack yet as we are waiting on an api update to zuul to be able to check if projects are configured properly | 15:32 |
| *** amoralej has joined #openstack-infra | 15:34 | |
| boden | clarkb "that direction" being putting more logic in the repo zuul config I assume you mean? if so does that mean in Stein we should expect to be ask to move such logic direction to in-repo? | 15:34 |
| clarkb | mordred: any idea off the top of your head if we can specify a floating IP to use when launching a node? doesn't look like it skimming launch-node.py. I'm sure I could hack it in but maybe I just remove the fip launch-node uses then replace it with the one I want | 15:35 |
| clarkb | (mirror02.us-west-1.packethost.openstack.org got a reverse ptr record and if I can I'd like to just keeo that record. pabelanger fwiw we don't set up reverse dns on mirror nodes in other clouds because typically its not the most straightforward) | 15:36 |
| mordred | clarkb: well, you can definitely do that with nova and I'm pretty sure you can do it with create_server | 15:36 |
| *** sambetts|afk is now known as sambetts | 15:36 | |
| clarkb | mordred: ya I'm just wondering if I need it on first boot and first configuration. I don't think so and I should be able to just swap it after the fact | 15:37 |
| clarkb | as that might be simpler | 15:37 |
| mordred | clarkb: yes, that's right- you should just be able to swap it | 15:37 |
| pabelanger | we could ask them to delete rdns too, don't think that is an issue | 15:37 |
| mordred | the node itself has no knowledge of its NAT ip anyway | 15:37 |
| clarkb | pabelanger: well its more that now that we have it I figure I should take advantage of the work that was done to create the record :) | 15:37 |
| pabelanger | or switch to mirror01 / mirror03 | 15:37 |
| clarkb | mordred: exactly | 15:37 |
| pabelanger | clarkb: ack | 15:38 |
| clarkb | pabelanger: also to avoid another host getting that fip and having wrong rdns | 15:38 |
| mordred | clarkb: it's the one valid production usecase for a NATed ip like this :) | 15:38 |
| clarkb | mordred: ya | 15:38 |
| mordred | clarkb: fwiw, on non-broken openstack clouds you could ALSO do this with a non-nat neutron port | 15:39 |
| clarkb | mordred: that requires you to configure the subnet in a specific way iirc | 15:41 |
| openstackgerrit | Merged openstack-infra/project-config master: add publish-to-pypi to vmware-nsx-tempest-plugin https://review.openstack.org/584498 | 15:41 |
| clarkb | mordred: because fip subnets tend to be allocated in such a way that it is against neutron's rules to direct attach them to a server iirc | 15:41 |
| mordred | yah - but it is possible to have a fixed ip that's not tied to the lifecycle of a given server | 15:41 |
| mordred | clarkb: yes, that's right | 15:41 |
| mordred | that's what I meant by "non-broken" | 15:41 |
| tosky | uh, I have a question about the "architecture" of the jobs | 15:46 |
| mordred | tosky: sup? | 15:47 |
| tosky | sahara-tests (branchless, tempest plugin and more) defines a sahara-tests-tempest job which is used in sahara-test itself and inside sahara.git and python-saharaclient.git (the latter repository uses a derived job) | 15:47 |
| tosky | now I need to specify a certain tempest option only when I test sahara from git (soon rocky), but not on the older stable branches | 15:48 |
| mordred | tosky: you want that behavior to be specified in sahara-tests-tempest itself, yeah, rather than just in the sahara repo | 15:49 |
| tosky | should I simply set that value as False (which keeps the old value) when I use sahara-tests-tempest inside stable/pike and stable/queens? | 15:49 |
| *** hamzy has quit IRC | 15:49 | |
| tosky | and flip to True in sahara-tests.git? | 15:49 |
| tosky | or is it better to specify some overrides directly in sahara-tests for all branches? | 15:49 |
| mordred | tosky: well, you can have multiple variants of the sahara-tests-tempest job in the sahara-tests repo with different explicit branch matchers | 15:50 |
| tosky | mordred: with the same name? | 15:50 |
| tosky | I thought that a variant that needs to be used in a different repository should have a different name | 15:51 |
| mordred | tosky: yes. if you define the job a second time in that same repo with the same name, you'll be defining a variant - this is actually a feature that was pretty much designed to help with that use case | 15:51 |
| mordred | "I want the job to behave differently for stable/rocky than for stable/pike" | 15:51 |
| tosky | oh, ok, I didn't get this part about variants | 15:52 |
| clarkb | looks like I need to delete mirror01 first for quota reasons | 15:53 |
| evrardjp | mordred: a second time in the same name -- within the same branch would work in that case? | 15:53 |
| evrardjp | I thought the jobs with the same name had to be in different code branches. | 15:53 |
| tosky | I thought that you could define variants on the fly in the project: section, but not a new job with the same name | 15:53 |
| mordred | tosky: http://paste.openstack.org/show/727163 | 15:54 |
| mordred | tosky: something like that | 15:54 |
| mordred | evrardjp: jobs with the same name in different branches are implicitly creating a variant with a value in the branches: matcher | 15:55 |
| evrardjp | mordred: gotcha | 15:55 |
| mordred | but you can do the same thing explicitly | 15:55 |
| evrardjp | mordred: that's how it works! | 15:55 |
| evrardjp | *mindblown* | 15:55 |
| evrardjp | Ok on that note, I am gonna refactor some tests. | 15:56 |
| mordred | yay! we have successfully blown a mind for the day- time to take the rest of the day off | 15:56 |
| tosky | mordred: and then the job python-saharaclient-tempest, which inherits from sahara-tests-tempest, will inherit from the variant appropriate for the branch? Great | 15:56 |
| tosky | thank you, that's really useful | 15:56 |
| mordred | tosky: yes. (although pinging corvus just to make sure I'm not lying to you) | 15:56 |
| *** janki has quit IRC | 15:58 | |
| mordred | tosky, evrardjp: https://zuul-ci.org/docs/zuul/user/config.html#attr-job.branches <-- here's a potentially useful docs link | 15:58 |
| evrardjp | mordred: I'd like to work for you then. Sounds like reasonable days. Thanks for the info anyway :) | 15:59 |
| mordred | evrardjp: sure nuff! glad I could help | 15:59 |
| *** ginopc has quit IRC | 16:01 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-openstack_infra_spec_helper master: Run ansible base playbook for puppet tests https://review.openstack.org/588326 | 16:08 |
| *** eandersson has joined #openstack-infra | 16:10 | |
| *** spotz has quit IRC | 16:18 | |
| *** jpich has quit IRC | 16:21 | |
| clarkb | pabelanger: when you rebuilt the mirror recently did the openafs install take forever? its been almost 10 minutes here according ot syslog | 16:21 |
| clarkb | I guess it is compiling things | 16:21 |
| pabelanger | clarkb: yup, takes some time | 16:22 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove various windmill jobs from projects.yaml https://review.openstack.org/587927 | 16:26 |
| openstackgerrit | Merged openstack-infra/project-config master: ansible-role-container-registry: switch to non-pypi jobs https://review.openstack.org/587847 | 16:26 |
| *** rkukura has joined #openstack-infra | 16:27 | |
| clarkb | http://147.75.38.145/ is working, going to attempt fip surgery now | 16:27 |
| *** rlandy is now known as rlandy|brb | 16:28 | |
| *** rkukura has quit IRC | 16:29 | |
| *** jpena is now known as jpena|off | 16:30 | |
| *** amoralej is now known as amoralej|off | 16:31 | |
| *** janki has joined #openstack-infra | 16:31 | |
| *** jpena|off is now known as jpena | 16:31 | |
| *** jpena is now known as jpena|off | 16:32 | |
| *** ramishra has quit IRC | 16:32 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove legacy-muranoclient-dsvm-functional-mysql-backend for muranoclient https://review.openstack.org/586748 | 16:34 |
| mordred | clarkb: https://review.openstack.org/#/c/588290/ is green - you ok with me moving forward with that plan? | 16:34 |
| *** zoli is now known as zoli|gone | 16:35 | |
| *** gyee has joined #openstack-infra | 16:35 | |
| *** zoli|gone is now known as zoli | 16:35 | |
| mordred | infra-root: I have disabled the puppet cron on puppetmaster and am taking the hiera lock | 16:35 |
| clarkb | http://mirror.us-west-1.packethost.openstack.org/ is up on new server with old fip | 16:36 |
| clarkb | swapping fips arond worked fine | 16:36 |
| clarkb | mordred: yes, I +2'd not approving as I think we want to do that with puppet and hiera frozen | 16:37 |
| *** yamamoto has quit IRC | 16:37 | |
| clarkb | mordred: and test that it works before we have to fix 100 services if it doesn't :) | 16:37 |
| mordred | yup | 16:38 |
| mordred | currently waiting for existing puppet runs to stop | 16:38 |
| *** rkukura has joined #openstack-infra | 16:38 | |
| clarkb | mordred: beware running it against puppetmaster to test will reenable puppet cron | 16:39 |
| *** yamamoto has joined #openstack-infra | 16:40 | |
| mordred | clarkb: ++ | 16:40 |
| mordred | clarkb: I also put puppetmaster in the emergency file | 16:40 |
| *** tosky has quit IRC | 16:41 | |
| *** rkukura_ has joined #openstack-infra | 16:45 | |
| *** dtantsur is now known as dtantsur|afk | 16:46 | |
| *** rkukura has quit IRC | 16:46 | |
| *** rkukura_ has quit IRC | 16:46 | |
| fungi | clarkb: i have openafs installed similarly on my (debian) workstation and every kernel update takes ~10 minutes of the apt stdout pausing while the lkm is rebuilt via dkms | 16:47 |
| *** rkukura has joined #openstack-infra | 16:47 | |
| clarkb | fungi: not abnormal then | 16:48 |
| *** janki has quit IRC | 16:52 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Start running jobs on packethost again https://review.openstack.org/588339 | 16:54 |
| clarkb | mordred: fungi ^ I will probably apply that by hand shortly assuming puppet is in a state of flux | 16:54 |
| clarkb | but reviews very much welcome | 16:54 |
| *** yamamoto has quit IRC | 16:55 | |
| pabelanger | +2 | 16:55 |
| mordred | clarkb: still waiting for the last puppet run to stop | 16:59 |
| *** rkukura has quit IRC | 17:00 | |
| *** rkukura has joined #openstack-infra | 17:01 | |
| clarkb | we appaer to have leaked ports that claim to be active and attached to nodepool nodes that don't exist | 17:01 |
| clarkb | odd | 17:01 |
| clarkb | I don't think its a major concern | 17:01 |
| clarkb | I think nodepool doesn't clear these out because they are ACTIVE | 17:01 |
| *** rlandy|brb is now known as rlandy | 17:02 | |
| *** derekh has quit IRC | 17:02 | |
| clarkb | but I kind of want it to run and see if that is the case | 17:03 |
| corvus | mordred: catching up here -- i don't believe you lied to anyone about branches earlier. :) | 17:04 |
| *** apetrich has joined #openstack-infra | 17:08 | |
| mordred | corvus: yay | 17:08 |
| clarkb | mordred: as an fyi I am approving the packethost enablement, then going to add it by hand now | 17:09 |
| corvus | tristanC: looking at that os-loganalyze change you mentioned in #zuul -- are you planning on making os-loganalyze a significant part of your log-classify project? | 17:10 |
| clarkb | corvus: for the currnet code the big thing we rely on in os-loganalyez is filtering out the debug messages when indexing | 17:11 |
| corvus | tristanC: considering that we might stop using it next week, that could be a problem. | 17:11 |
| clarkb | I guess that is going away? | 17:11 |
| *** hamzy has joined #openstack-infra | 17:11 | |
| *** rkukura_ has joined #openstack-infra | 17:11 | |
| clarkb | we can push that filtering futher down the stack if necessary | 17:11 |
| *** rkukura has quit IRC | 17:11 | |
| *** rkukura_ is now known as rkukura | 17:11 | |
| corvus | clarkb: yeah, the severity filtering is entirely server-side. it should probably be in the ingestor. | 17:12 |
| clarkb | corvus: the beneift of that was reducing network overhead | 17:12 |
| clarkb | logs tend to be 90% debug | 17:12 |
| clarkb | but maybe we care less if using distributed swift for file serving | 17:13 |
| clarkb | mordred: is puppet cron disabled at this point? | 17:13 |
| clarkb | eh I'll just put nl02 in emergency file for now | 17:13 |
| corvus | clarkb: okay. well, my goal is to get rid of logs.o.o and serve stuff directly from swift. i'm basically there. if, as a group, we would rather maintain a proxy server to swift, that's fine, but i'm not particularly interested in doing that. we should find out who is going to maintain that. | 17:14 |
| *** efried_afk is now known as efried | 17:14 | |
| clarkb | corvus: I think we can start with filtering on the ingestor side and if thatdoesn't work out go from there | 17:14 |
| corvus | clarkb, tristanC: i just found this change: https://review.openstack.org/579782 and this message, which was only sent to the openstack-dev list (not openstack-infra): http://lists.openstack.org/pipermail/openstack-dev/2018-July/131960.html | 17:14 |
| corvus | that all seems to rely very heavily on osla | 17:15 |
| mordred | clarkb: yes - it's disabled - and puppet/ansible are now not running | 17:15 |
| corvus | clarkb, tristanC: i'm worried that if we proceed with the direction i've been heading with swift logs, that will undercut tristanC's plans for log classification | 17:16 |
| openstackgerrit | Merged openstack-infra/project-config master: Start running jobs on packethost again https://review.openstack.org/588339 | 17:17 |
| mordred | corvus: I think getting the logs into swift is more important in the short/medium term than improving osla - because we're otherwise sitting on the timebomb that is logs.o.o | 17:17 |
| mordred | putting the logs in swift does not prevent adding a future webapp that has a server-side component todo fancier things with the logs | 17:18 |
| clarkb | corvus: after a quick read of that I don't think osla is necessarily required. We currently use elastic-recheck to solicit anomoly reports. This may not be the nest location going forward but I expect we could continue to use it for that purpose if necessary | 17:18 |
| clarkb | then ya we could make a less git involved reporting tool as a followup | 17:19 |
| *** yamamoto has joined #openstack-infra | 17:19 | |
| *** rkukura_ has joined #openstack-infra | 17:21 | |
| *** rkukura has quit IRC | 17:21 | |
| corvus | ok, i'll continue on the path i was on for now, but i think we need to talk with tristanC | 17:21 |
| mordred | ++ | 17:21 |
| clarkb | packethost is running jobs again | 17:22 |
| * mordred is going to eat a sandwich real quick, then will manually test the hieradata change | 17:23 | |
| pabelanger | mordred: I finally replied to your ML post about publication interface | 17:23 |
| *** rkukura has joined #openstack-infra | 17:24 | |
| *** rkukura_ has quit IRC | 17:25 | |
| *** rkukura has quit IRC | 17:25 | |
| *** felipemonteiro has joined #openstack-infra | 17:27 | |
| fungi | now that we're doing supercedent queuing in our post pipeline, do we have a pipeline which will queue a distinct set of builds for every merged ref? | 17:29 |
| fungi | i was about to reply to smcginnis's thread about client-impact notification suggesting not to use a gerrit change-merged hook script, but trying to do that with a zuul job in supercedent post seems like it would get complicated quickly | 17:30 |
| *** yamamoto has quit IRC | 17:34 | |
| *** yamamoto has joined #openstack-infra | 17:35 | |
| *** yamamoto has quit IRC | 17:35 | |
| *** yamamoto has joined #openstack-infra | 17:35 | |
| *** yamamoto has quit IRC | 17:35 | |
| clarkb | logstash says first three jobs to run on packethost were successful | 17:37 |
| clarkb | I'll keep an eye on it | 17:37 |
| clarkb | fungi: I don't think we have a queuefor that unless the new promote queue is not supercedent | 17:37 |
| fungi | oh, good point | 17:39 |
| fungi | i forgot about promote, and it looks like it may do the trick | 17:39 |
| corvus | fungi: we can always add a new pipeline too | 17:39 |
| fungi | sure, i just don't want to clutter zuul with too many pipelines if there is already one which fits the bi;; | 17:39 |
| fungi | bill | 17:39 |
| fungi | oh, promote is also supercedent | 17:40 |
| fungi | fwiw, the misleading phrase in its description also appears in post's description | 17:41 |
| corvus | i think a new pipeline would be fine. probably change-merged + independent for this case. | 17:42 |
| logan- | isn't there a url to download nodepool images? | 17:44 |
| fungi | corvus: as always, the hardest part is coming up with an appropriate name ;) | 17:44 |
| logan- | i was thinking somewhere on nl01.openstack.org but can't find it in my logs | 17:44 |
| corvus | logan-: https://nb01.openstack.org/images/ | 17:44 |
| logan- | nvm | 17:44 |
| logan- | corvus thanks | 17:44 |
| corvus | logan-: (also possibly other nbXX hosts in unpredictable ways) | 17:45 |
| fungi | yeah, nodepool builders build/upload images, nodepool launchers boot/delete nodes from them | 17:45 |
| clarkb | logan-: also nb02.openstack.org they do distributed builds and host the images they built locally | 17:45 |
| logan- | thanks! | 17:46 |
| fungi | though they all build basically the same images (processor architecture aside) | 17:46 |
| corvus | though it looks like 01 and 02 have settled into a fairly regular pattern | 17:46 |
| mordred | infra-root: ok - wish me luck, I'm going to move the files in hieradata and then run ansible by hand | 17:47 |
| fungi | so, e.g., if you download images from nb03 they'll be amd64/aarch64 | 17:47 |
| corvus | 01 and 02 are both capable of building all the x86 images; they race for which one builds which each time. 03 are.. that, yes. | 17:48 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Require at least openstacksdk 0.17.1 https://review.openstack.org/588149 | 17:48 |
| corvus | so you may have to look at both 01 and 02 to find, say, the latest x86 fedora | 17:48 |
| SpamapS | What's a good channel to talk about pbr/pbrx issues? | 17:48 |
| logan- | btw still seeing no api activity from openstack's nodepool on limestone http://grafana.openstack.org/d/WFOSH5Siz/nodepool-limestone?orgId=1 is there anything I can help with on that? i checked the logs the other day when pabelanger was looking into it and saw no hits in haproxy after Jul 30 10:57:39 CDT | 17:48 |
| SpamapS | mordred: ^ ? | 17:48 |
| clarkb | logan-: I'll take a look at that since I've already got a bunch of that paged in for packethost | 17:48 |
| fungi | SpamapS: #openstack-oslo officially, i think? but here is probably fine too | 17:48 |
| pabelanger | logan-: I think we wedged nodepool | 17:49 |
| pabelanger | but haven't confirmed | 17:49 |
| mordred | SpamapS: here - or #zuul - it doesn't really have a home-home yet | 17:51 |
| fungi | ahh, yeah pbr is oslo but pbrx is still unofficial i suppose | 17:52 |
| corvus | we all sort of leave bowls of food out on the porch for it | 17:52 |
| fungi | and booze | 17:53 |
| fungi | often find it passed out on somebody's sofa for extended periods | 17:53 |
| SpamapS | ok, well this seems like pbr, not pbrx | 17:53 |
| SpamapS | I can `pip install -e .`, but not `pip install .`, with this repo I recently created http://paste.openstack.org/show/727166/ | 17:54 |
| SpamapS | now, the python that I'm trying to pbr is actually a few levels under the repo (it's actually a pseudo-mono-repo) | 17:54 |
| pabelanger | clarkb: corvus: logan-: we didn't have properly logging setup for nodepool for openstacksdk, so hard to see what happened to API calls. It should be proper now, so we should at least restart nodepool services to pick up that logging change | 17:54 |
| clarkb | pabelanger: should be safe to restart too since we haven't really merged stuff since the release I don't think | 17:55 |
| SpamapS | http://paste.openstack.org/ <-- install -e | 17:56 |
| clarkb | yup two changes, neither of which should touch zk | 17:56 |
| clarkb | I can restart nl02 in a few | 17:56 |
| pabelanger | clarkb: agree | 17:56 |
| mordred | SpamapS: pbr does not support multiple python deliverables in a single repo | 17:57 |
| SpamapS | mordred: oh good, a reason to break out of the mono repo ;) | 17:57 |
| mordred | SpamapS: :) glad I could help | 17:57 |
| SpamapS | I did this to myself ;) | 17:58 |
| mordred | SpamapS: you have zuul - you have the power to cease being shackled by the monorepo | 17:58 |
| SpamapS | I wonder how much of the monorepo craze is reinforced by the GitHub cheapest private repo plan limiting to 5 private repos. ;) | 17:58 |
| clarkb | nodepool launcher on nl02 restarted | 17:58 |
| fungi | yeah, openstackland follows a strict model of one-package-one-repo | 17:58 |
| SpamapS | mordred: I do not have zuul yet. :-/ | 17:58 |
| fungi | which i rather prefer anyway | 17:58 |
| mordred | SpamapS: well, but you personally grok zuul | 17:58 |
| mordred | SpamapS: so you have zuul, even if you aren't using it yet :) | 17:59 |
| SpamapS | Yeah I know the magic of having things in their own repos. | 17:59 |
| pabelanger | clarkb: great | 17:59 |
| pabelanger | and limestone working again it seems | 17:59 |
| logan- | woot | 17:59 |
| SpamapS | mordred: k well I'll just back away slowly from both issues and see what people want to do with it. | 17:59 |
| logan- | thanks clarkb / pabelanger :) | 17:59 |
| clarkb | pabelanger: logan- ya all deleting nodes actually were deleted and new nodes booting now | 17:59 |
| clarkb | logan-: pabelanger if it happens again I guess hope is we have logs to debug it then | 17:59 |
| clarkb | I'll work on restarting the other launchers if this one continues to look happy | 18:00 |
| clarkb | that way they all hvae the logging | 18:00 |
| pabelanger | hopefully | 18:00 |
| *** yamamoto has joined #openstack-infra | 18:01 | |
| mordred | SpamapS: fwiw, adding more flexibility to pbrx in terms of getting it to be able to figure out what entrypoints are without pbr/setup.cfg would be doable/acceptable. adding more flexible repo config options to pbr - less so | 18:01 |
| fungi | what are the odds of pbr growing a compatibility feature to read the setuptools setup.cfg variant for defining entrypoints? | 18:02 |
| *** electrofelix has quit IRC | 18:02 | |
| mordred | there isn't one | 18:02 |
| mordred | sorry - too few words | 18:02 |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config master: Add openstack/os-ryu to neutron https://review.openstack.org/588355 | 18:02 |
| mordred | setuptools setup.cfg does not support specifying entrypoints at all | 18:02 |
| *** rcarrillocruz has joined #openstack-infra | 18:03 | |
| fungi | did they put those somewhere else? or setuptools just doesn't have declarative configuration (yet) for entrypoints at all? | 18:03 |
| mordred | the second thing | 18:03 |
| mordred | and setup.cfg in setuptools isn't _really_ declarative config - it's a way to specify default values to command line options | 18:03 |
| fungi | okay. for some reason i thought somebody said they'd added entrypoints definitions but done it in a different way than pbr | 18:03 |
| mordred | fungi: it is possible they have done that and have not documented it - or didn't document it in the docs I was reading | 18:04 |
| clarkb | fungi: they added setup.cfg as a supported thing and then made it incomaptible with pbr and removed all the useful functionality | 18:04 |
| fungi | oh, i didn't realize setuptools setup.cfg was mapped to its cli rather than to setup function arguments | 18:04 |
| mordred | if they have added it and I missed it, or if they do add it- I would *definitely* support teaching pbrx how to read it | 18:04 |
| mordred | but best I can tell the setuptools setup.cfg missed the forest for the trees | 18:05 |
| clarkb | oui | 18:05 |
| fungi | too bad | 18:05 |
| *** yamamoto has quit IRC | 18:05 | |
| clarkb | anyone uncomfortable with me saying fedora 28 can be supported by infra for the life of the distro release as long as people show up to keep it working when it breaks? | 18:06 |
| *** pblaho has quit IRC | 18:07 | |
| clarkb | logan-: pabelanger we hvae ready and in use nodes in limestone now | 18:08 |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-role-puppet master: Reorganize hieradata to match ansible variables https://review.openstack.org/588290 | 18:12 |
| mordred | clarkb, corvus, fungi: hieradata reorg worked - except there was one small update I needed to make in that ^^ | 18:12 |
| *** felipemonteiro has quit IRC | 18:12 | |
| mordred | I ran ansible+puppet against review-dev01.openstack.org | 18:12 |
| mordred | the hieradata files copied over and things seem to have worked properly | 18:12 |
| mordred | but if anyone else wants to verify that | 18:12 |
| clarkb | mordred: I see a happy puppet run a minute ago. Service is up and running | 18:14 |
| mordred | clarkb: and I can still log in and sudo | 18:14 |
| clarkb | mordred: maybe do a handful of others in foreground that would be noticeable if they derped. review, gitNN, zuul01? | 18:15 |
| clarkb | mordred: oh review-dev01 has the old hiera data in place still so potentially is happy due to that | 18:15 |
| clarkb | mordred: maybe rerun on review-dev01 after moving the old dirs aside? | 18:15 |
| mordred | clarkb: kk. will do | 18:15 |
| clarkb | otherwise we might not realize its broken until we boot a new server or try to updat ea hiera values | 18:16 |
| *** sambetts is now known as sambetts|afk | 18:16 | |
| mordred | running review-dev01 again | 18:16 |
| mordred | clarkb: should we put in a 'remove old dirs' stanza in ansible-role-puppet ? | 18:17 |
| mordred | clarkb: done running | 18:17 |
| clarkb | mordred: maybe? I'm not super concerned about it if we work when they are removed | 18:17 |
| *** gfidente has quit IRC | 18:17 | |
| mordred | k. that seems to have worked | 18:17 |
| mordred | shall I try review ? | 18:17 |
| clarkb | yes seems to have nooped and service is still running on review-dev | 18:18 |
| clarkb | mordred: I think we should try it on some of the more noticeable services in the foreground | 18:18 |
| clarkb | will make it easier to debug | 18:18 |
| mordred | k. starting with review | 18:18 |
| clarkb | so ++ | 18:18 |
| mordred | review seems to have not derped | 18:19 |
| clarkb | service is stil lrunning and talking to my web browser at least :) | 18:20 |
| *** rcarrillocruz has quit IRC | 18:20 | |
| clarkb | mordred: ya syslog reports a clean puppet update | 18:21 |
| mordred | clarkb: woot. lemme do git* | 18:21 |
| clarkb | mordred: maybe the thing to is just do a one off cleanup of the extra dirs in hieradata once we are happily migrated | 18:21 |
| mordred | ++ | 18:21 |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config master: Add openstack/os-ryu to neutron https://review.openstack.org/588355 | 18:23 |
| fungi | need to go run some errands, gonna grab a late lunch while i'm out so might be a couple hours | 18:23 |
| fungi | but will be back by probably 20:30z | 18:23 |
| fungi | the variable reorg for the puppet role lgtm after clarkb reminded me we're on a fork anyway | 18:24 |
| fungi | i didn't approve as i assume you're still wanting to test a little longer | 18:24 |
| mordred | yah- should be good to land soon | 18:25 |
| mordred | clarkb: kk. git* seems to have been fine | 18:27 |
| clarkb | we install python2 on our test images so that ansible can run there right? | 18:35 |
| clarkb | ps seems to confirm | 18:36 |
| mordred | clarkb: you mean like for images where they come wiht python3 instead? | 18:37 |
| clarkb | mordred: yes | 18:37 |
| clarkb | specifically for our nodepool images | 18:38 |
| mordred | I think python3 support is far enough along in upstream ansible that we could start considering not installing python2 on python3 native images and setting ansible_python_interpreter accordingly | 18:38 |
| clarkb | we have python installed and ansible runs under that when jobs run | 18:38 |
| mordred | but that's a project for the future :) | 18:38 |
| clarkb | ah ok, we aren't doing that yet but we could consider it | 18:38 |
| corvus | mordred: i guess we would need to plumb that through nodepool/zk/zuul ? | 18:38 |
| mordred | yah | 18:38 |
| mordred | corvus: yah - definitely not a thing to jump in to... | 18:38 |
| corvus | like, that would be a label attribute in nodepool that it would have to tell zuul to put in the inventory... | 18:38 |
| mordred | but I've actually been doing bridge.o.o with python3 even for ansible | 18:38 |
| corvus | mordred: yeah, i did the same with my exim test | 18:39 |
| corvus | ansible_python_interpreter: python3 | 18:39 |
| mordred | ++ | 18:39 |
| clarkb | could we just have zuul make it try python3 if available and fallback to python2 if not? | 18:39 |
| clarkb | like runtime test | 18:39 |
| mordred | it's an ansible thing | 18:39 |
| mordred | so we woldn't have a great place to do the runtime test | 18:39 |
| corvus | clarkb: like this: http://paste.openstack.org/show/727171/ | 18:40 |
| corvus | that's the inventory i used | 18:40 |
| clarkb | zuul could do a pre ansible ssh in and check for python2 vs python3 on disk? | 18:40 |
| clarkb | then configure ansible accordingly | 18:40 |
| pabelanger | you could use the raw module for that, in ansible | 18:40 |
| pabelanger | but, tricky depending on OS | 18:41 |
| mordred | yah - I think it would be a lot of work to do - even in a pre-playbook | 18:41 |
| clarkb | or maybe we drop centos support and just python3 >_> | 18:41 |
| mordred | :) | 18:41 |
| pabelanger | zing! | 18:42 |
| mordred | corvus, clarkb, pabelanger: I've done review, review-dev and git0* and all seems fine | 18:42 |
| corvus | clarkb: that's putting a lot of logic about the nodes in zuul; i think metadata in nodepool would be a better fit -- we already have nodepool tell zuul which connection plugin to use | 18:42 |
| mordred | any others we want to expicitly do? | 18:42 |
| clarkb | corvus: thats a good point re connection plugin | 18:42 |
| pabelanger | corvus: Yah, like the idea of metadata in nodepool | 18:42 |
| clarkb | mordred: zuul was the last one I listed earlier, specificll zuul01.o.o | 18:42 |
| mordred | oh - yeah | 18:42 |
| mordred | one sec - doing that one | 18:42 |
| clarkb | corvus: we can default it to python3 then override it for centos only :) | 18:42 |
| corvus | clarkb: i like your optimism :) | 18:43 |
| mordred | ran on zuul01 - all seeems well | 18:44 |
| corvus | it's sandwich time for me | 18:47 |
| mordred | clarkb: I think let's land the ansible-role-puppet change | 18:50 |
| clarkb | mordred: if this is the direction we are going we need to take the jump at some point | 18:50 |
| mordred | clarkb: then I can run through the playbooks from run_all.sh by hand | 18:51 |
| clarkb | and we've tested it on a representative sample of important services | 18:51 |
| clarkb | all that to say yes probably best to keep going and merge it | 18:51 |
| mordred | then start transferring secrets and stuff over to bridge | 18:51 |
| mordred | cool. hitting the button | 18:51 |
| mordred | clarkb: if we don't watch out, we could be transitioned to bridge this week - and have our first non-puppeted server :) | 18:52 |
| mordred | (or, rather, our first non-puppeted server since 2010) | 18:52 |
| clarkb | we are going to hvae to double account the hiera data for a bit I expect | 18:52 |
| clarkb | but maybe we don't really need to worry until we transition an existing node over then data goes from puppetmaster to bridge | 18:53 |
| mordred | clarkb: yah - although I think we can keep that period low | 18:53 |
| mordred | yup | 18:53 |
| clarkb | mordred: silly feature request but ascii captains chair for bridge.o.o motd >_> you know for when you get bored | 19:01 |
| mordred | clarkb: hahahah. yeah | 19:03 |
| clarkb | nl02 continues to look happy I'm going to restart launchers on nl01 03 and 04 now | 19:11 |
| openstackgerrit | Jill Rouleau proposed openstack-infra/project-config master: Add Tripleo Ansible repo https://review.openstack.org/583415 | 19:14 |
| clarkb | all done, nodepool==3.2.1.dev3 # git sha 6c97e86 is what we are running on the 4 launchers now | 19:15 |
| mordred | woot | 19:16 |
| clarkb | corvus: I am going to sandwich soon myself. Can you look over https://etherpad.openstack.org/p/project-renames-2018-08-03 when you have a moment | 19:16 |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config master: Add openstack/os-ryu to neutron https://review.openstack.org/588355 | 19:18 |
| openstackgerrit | Merged openstack-infra/ansible-role-puppet master: Reorganize hieradata to match ansible variables https://review.openstack.org/588290 | 19:24 |
| clarkb | mordred: ^ | 19:25 |
| mordred | clarkb: ok. here goes nothing | 19:25 |
| mordred | clarkb: I am now running through the playbooks in run_all.sh one at a time by hand | 19:26 |
| mordred | and have removed puppetmaster from the emergency file | 19:27 |
| clarkb | ok that will update puppet master and reenable cron I think | 19:27 |
| mordred | yah | 19:27 |
| mordred | currently it's updating system-config and the ansible modules - which should get the newest ansible-role-puppet | 19:27 |
| clarkb | the cron will probably try running in 2 minuts | 19:28 |
| clarkb | not sure if that is desireable | 19:28 |
| mordred | oh - I deleted the cron job from crontab | 19:28 |
| clarkb | mordred: it will add it back though | 19:28 |
| clarkb | I think | 19:28 |
| mordred | it will - but not yet | 19:28 |
| clarkb | ok | 19:29 |
| mordred | that happens when we get to remote_puppet_else | 19:29 |
| clarkb | ah | 19:29 |
| mordred | (I only know that because I dug through looking just a bit ago :) ) | 19:29 |
| mordred | I've run the playbook that updates system-config and the ansible modules | 19:29 |
| mordred | I'm now going to re-run kick on review-dev just to make sure that didn't bork something | 19:30 |
| *** rpioso is now known as rpioso|afk | 19:30 | |
| mordred | seems to have gonefine | 19:31 |
| clarkb | service still running | 19:31 |
| mordred | clarkb: we have a playbook called update_puppet_version.yaml that runs on 'puppet4' hosts | 19:33 |
| mordred | clarkb: but we don't have any hosts in the puppet4 group | 19:33 |
| mordred | is that just a future-looking thing? | 19:33 |
| clarkb | mordred: correct, that was future looking | 19:33 |
| mordred | kk. cool | 19:33 |
| mordred | it currently continues to do nothing | 19:33 |
| clarkb | mordred: right now I think cmurphy|vacation's game plan is get everything using puppet4 parser on puppet 3 (or maybe some set) then update to puppet 4 on those nodes | 19:33 |
| mordred | ++ | 19:33 |
| mordred | now doing remote_puppet_git.yaml | 19:34 |
| mordred | clarkb: I was wrong - cron job is re-enabled in remote_puppet_git.yaml - but it's still all good | 19:36 |
| clarkb | ok | 19:37 |
| mordred | clarkb: ok. git*, review and zuul have all been done now | 19:37 |
| clarkb | mordred: I'm going to remove nl02 from emergecny file, that won't interfere with you right? | 19:41 |
| mordred | clarkb: nope - not at all | 19:41 |
| mordred | clarkb: I've run everything except for _else | 19:41 |
| mordred | clarkb: the cronjob is gonna pick that up in 4 minutes - so i'm just gonna let it do its thing | 19:41 |
| clarkb | cool, I have put nl02 back into the rotation | 19:42 |
| *** eharney has quit IRC | 19:44 | |
| *** apetrich has quit IRC | 19:47 | |
| mnaser | clarkb: https://review.openstack.org/#/c/587790 if you want/can +A that | 19:47 |
| clarkb | mnaser: done | 19:49 |
| * fungi got his sandwich and snuck in some grocery shopping while the tourists weren't looking. back to breaking things! | 19:56 | |
| mordred | infra-root: the great hiera reorg of 2018 is complete. | 19:58 |
| pabelanger | woot | 19:59 |
| clarkb | I should make a sandwich | 19:59 |
| fungi | with much less fanfare than anticipated | 19:59 |
| fungi | clarkb: yes, today seems to be all about sandwiches | 20:00 |
| fungi | mine was a rare grilled tuna steak with jerk paste | 20:00 |
| * mordred had leftover chicken in a tortilla | 20:00 | |
| fungi | it's a form of sandwich! | 20:01 |
| *** zul has quit IRC | 20:01 | |
| clarkb | I've got brie and ham and sourdough | 20:01 |
| pabelanger | clarkb: speaking of fedora-28, I'll push again on removing fedora-27. Still a few projects using it | 20:01 |
| fungi | pabelanger: but what about the proposed maintenance duration. does that sound viable? | 20:01 |
| *** jcoufal has quit IRC | 20:01 | |
| fungi | my biggest concern is that they'll need to perform significant overhaul to at least their stable branches after release to move jobs from fedora28 to $whatever | 20:02 |
| pabelanger | fungi: my main concern is when we want to delete fedora-28, if centos-8 isn't out by then, need a plan to move to fedora-30 | 20:02 |
| openstackgerrit | Merged openstack-infra/project-config master: Add AJaeger to IRC operator list https://review.openstack.org/587790 | 20:03 |
| pabelanger | fungi: yah, I would suggest we remove then before stable branch, if no centos-8 | 20:03 |
| corvus | mozarella, fennel, and candied lemon peel | 20:04 |
| fungi | ooh! | 20:04 |
| corvus | yeah, i wasn't sure about it, but lemon + mozzarella is totally a thing. | 20:05 |
| fungi | sounds like an amazing twist on a grilled cheese sandwich | 20:05 |
| *** rkukura has joined #openstack-infra | 20:05 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Add HTMLify logs role https://review.openstack.org/588105 | 20:06 |
| mordred | infra-root: /root on puppetmaster has been rsync'd to /root on bridge - and /etc/puppet/hieradata has been rsynced to /etc/ansible/secrets on bridge | 20:11 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Add HTMLify logs role https://review.openstack.org/588105 | 20:12 |
| pabelanger | dmsimard: mind looking at https://review.openstack.org/588368/ moves ARA to fedora-latest (28) | 20:14 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient master: Don't show underline when hovering on task titles https://review.openstack.org/511246 | 20:14 |
| *** jcoufal has joined #openstack-infra | 20:15 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient master: Use cursor when hovering over a read-only card https://review.openstack.org/511247 | 20:15 |
| *** masayukig has quit IRC | 20:18 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Add a stub inventory file to suck in secrets https://review.openstack.org/588377 | 20:19 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove (legacy-)fedora-27 nodesets https://review.openstack.org/588378 | 20:20 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove (legacy-)fedora-27 nodesets https://review.openstack.org/588378 | 20:22 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Install and configure ansible on bridge https://review.openstack.org/587985 | 20:25 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Add an Ansible role to configure exim https://review.openstack.org/588089 | 20:25 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove (legacy-)fedora-27 nodesets https://review.openstack.org/588378 | 20:26 |
| *** bobh has quit IRC | 20:27 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Install and configure ansible on bridge https://review.openstack.org/587985 | 20:28 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Add an Ansible role to configure exim https://review.openstack.org/588089 | 20:28 |
| *** sambetts|afk has quit IRC | 20:28 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove (legacy-)fedora-27 nodesets / jobs https://review.openstack.org/588378 | 20:31 |
| corvus | clarkb: if i'm adding oslo severity support to log processor to filter out debug lines, do you want me to also keep the ?level=INFO query parameter (which will still work as long as osla is used), or drop it? | 20:33 |
| corvus | (to clarify -- should the log processor continue to add ?level=INFO to the urls it generates?) | 20:33 |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-log_processor master: Add severity info to logstash and filter out DEBUG lines https://review.openstack.org/588383 | 20:34 |
| corvus | clarkb: ^ that leaves the parameter in place. it's easy to remove it if we want. | 20:34 |
| corvus | also, as a bonus, severity will be added to logstash as a queriable field | 20:35 |
| *** rh-jelabarre has quit IRC | 20:35 | |
| mordred | corvus: ok. I rebased and squashed just a little bit - but I think we're ready to stich the exim role into the base playbook | 20:38 |
| clarkb | corvus: ya I think leave it for now | 20:38 |
| clarkb | then we can go back an forth easily | 20:38 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Gate zuul-job on fedora-latest https://review.openstack.org/581117 | 20:39 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Remove fedora-27 jobs https://review.openstack.org/588386 | 20:39 |
| corvus | mordred: should i start reviewing that stack? | 20:40 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove (legacy-)fedora-27 nodesets / jobs https://review.openstack.org/588378 | 20:40 |
| *** hamzy has quit IRC | 20:40 | |
| mordred | corvus: yes - it is ready | 20:40 |
| mordred | corvus: and I have confirmed that ansible runs on bridge have access to the variables in /etc/ansible/secrets now | 20:41 |
| mordred | corvus: so sysadmins should be in-scope for the base playbok | 20:41 |
| corvus | heh, i feel like i'v seen a big chunk of launch-node-ansible in some other ansible running program... | 20:41 |
| mordred | corvus: ikr? | 20:41 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Delete legacy-tempest-dsvm-neutron-full-fedora-27 https://review.openstack.org/588387 | 20:45 |
| corvus | mordred: i don't understand secrets.ini in 587985. where it comes from, what it contains, etc. | 20:46 |
| corvus | er, 'secret.ini' sorry | 20:46 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Remove legacy-tempest-dsvm-neutron-full-fedora-27 job https://review.openstack.org/588388 | 20:47 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Delete legacy-tempest-dsvm-neutron-full-fedora-27 https://review.openstack.org/588387 | 20:48 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove (legacy-)fedora-27 nodesets / jobs https://review.openstack.org/588378 | 20:48 |
| mordred | corvus: it's ... it's a hack | 20:49 |
| *** jcoufal has quit IRC | 20:49 | |
| mordred | corvus: host_vars and group_vars directories are loaded from dirs adjacent to inventory sources, but there's no way to just say "hey, please also load variables from this directory" | 20:49 |
| *** tosky has joined #openstack-infra | 20:50 | |
| mordred | corvus: so I stuck that file in there, which basically just sets the connection to local for bridge - to get the variable loader to see those directories | 20:50 |
| *** bobh has joined #openstack-infra | 20:51 | |
| mordred | corvus: we coudl also just put those host_vars/group_vars dirs underneath /etc/ansible/hosts | 20:51 |
| mordred | if you think that would make more sense | 20:51 |
| corvus | mordred: so, at least initially, this is set up this way because host_vars and group_vars are in a git repo, so it's one directory level too far down for them to be found automatically? | 20:53 |
| corvus | mordred: to resolve that, you're adding a second inventory file in the root of the git repo, so that it finds those dirs? | 20:54 |
| mordred | not quite - if we moved the git repo to be /etc/ansible/hosts so that host_vars and group_vars were siblings of openstack.yaml and groups.yaml it would totaly work | 20:55 |
| corvus | mordred: we'd have to either check those files in or .gitignore them and copy them into the git repo root, right? | 20:55 |
| mordred | yes. and ansibleis currently writing those files out, so i think .gitignore would be the better chjoice | 20:56 |
| corvus | mordred: you said "not quite" -- what am i missing from my summary? | 20:56 |
| mordred | line 29 https://review.openstack.org/#/c/587985/4/playbooks/roles/install-ansible/tasks/main.yaml | 20:56 |
| mordred | corvus: oh - just it wasn't about depth- it was that /etc/ansible/secrets isn't a thing anything knows to look beneath | 20:57 |
| mordred | so the secret.ini was just a way to make it a directoy added to the vars search path | 20:57 |
| mordred | the more I say it out loud the more I think it's too rube goldberg | 20:57 |
| mordred | and we shoudl just move them into /etc/ansible/hosts and add .gitignore entries | 20:58 |
| corvus | mordred: what made you go with the secrets approach versus the other? | 20:58 |
| *** priteau has quit IRC | 20:59 | |
| corvus | i'm wondering if there are advantages to the secrets path | 20:59 |
| mordred | corvus: feeling weird about having ansible write files to the inside of a git directory that holds precious info ... of course, then I have ansible write secret.ini - so I think I was just being crazy | 20:59 |
| corvus | line 29 does seem very similar to line 42 | 20:59 |
| mordred | yah | 20:59 |
| mordred | how about I make that change and push up a new copy | 21:00 |
| corvus | mordred: one last question -- where do openstack.yaml, groups.yaml and secret.ini come from? | 21:00 |
| mordred | corvus: from the files dir of that install-ansible role | 21:00 |
| corvus | oh, ha i see them now, missed it earlier | 21:00 |
| corvus | mordred: ok. either way sounds fine to me. i think i agree with you that the other approach (no secrets) may be the easier to reason about. | 21:01 |
| mordred | yeah. I think it requires less explanation | 21:02 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Install and configure ansible on bridge https://review.openstack.org/587985 | 21:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Add an Ansible role to configure exim https://review.openstack.org/588089 | 21:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Update install_modules to not need puppet https://review.openstack.org/588394 | 21:09 |
| mordred | clarkb, corvus: ^^ we're gonna need that too | 21:09 |
| corvus | mordred: +2s all the way from me | 21:10 |
| mordred | corvus: woot! | 21:11 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Rename update_puppet to update-system-config https://review.openstack.org/588396 | 21:13 |
| mordred | corvus: wanna look at one more? | 21:13 |
| clarkb | Ill take a look in a few. Moving my desk to accomodate parents that arrive this evening | 21:15 |
| corvus | clarkb: *you're* supposed to sleep under the desk and give *them* the bed. | 21:15 |
| *** rfolco|ruck is now known as rfolco|off | 21:15 | |
| mordred | I always picture clarkb just sleeping at the laptop, somehow still responding to things on irc | 21:16 |
| mordred | well, hrm. the word "always" there implies a much larger amount of time spent imagining clarkb sleeping | 21:17 |
| * mordred backs slowly out of the room | 21:17 | |
| *** dmsimard has quit IRC | 21:24 | |
| *** boden has quit IRC | 21:25 | |
| *** mriedem is now known as mriedem_afk | 21:28 | |
| *** dmsimard has joined #openstack-infra | 21:32 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Fix root ssh key entry for ansible https://review.openstack.org/588397 | 21:34 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: Update fontawesome to version 5 https://review.openstack.org/545676 | 21:36 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: Make board and worklist icons unique https://review.openstack.org/545677 | 21:36 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: Convert less to scss https://review.openstack.org/379595 | 21:36 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: Redesign the sidebar to neaten code and improve contrast https://review.openstack.org/549010 | 21:36 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: Reduce the number of items in the sidebar https://review.openstack.org/549059 | 21:36 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: Make the page background less bright https://review.openstack.org/549210 | 21:36 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: Add a drop shadow beneath the header navbar https://review.openstack.org/549211 | 21:36 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: Add shadow to board lanes https://review.openstack.org/549212 | 21:36 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: Redesign dashboard to reduce clutter https://review.openstack.org/549333 | 21:36 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Fix some little ansible issues https://review.openstack.org/588397 | 21:37 |
| mordred | corvus: sorry - one more patch of fixes ^^ I ran base.yaml and bridge.yaml on bridge and those are the things that shook out | 21:39 |
| corvus | mordred: lgtm | 21:44 |
| mordred | clarkb: I'm gonna step away for a bit ... I believe all of those changes are safe to land | 21:49 |
| *** bobh has quit IRC | 21:53 | |
| clarkb | mordred: ok I have a desk again and am about to take a look | 21:59 |
| clarkb | this is not a small set of changes :) | 22:01 |
| clarkb | I might need a drink before I dig in | 22:03 |
| clarkb | mordred: when you have a sec, none of these things should run and affect anything but the bridge node itself right now right? | 22:03 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid master: Fixed typo on logout from IDP https://review.openstack.org/588402 | 22:09 |
| *** kgiusti has left #openstack-infra | 22:10 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Swift logs: don't allow links outside of the supplied path https://review.openstack.org/587580 | 22:19 |
| *** rcernin has joined #openstack-infra | 22:32 | |
| *** hongbin_ has quit IRC | 22:39 | |
| *** jtomasek_ has joined #openstack-infra | 22:45 | |
| *** jtomasek-tmp has quit IRC | 22:46 | |
| *** rlandy is now known as rlandy|bbl | 22:50 | |
| *** bobh has joined #openstack-infra | 22:52 | |
| *** tpsilva has quit IRC | 22:53 | |
| clarkb | mordred: ok I +2'd most of the stack. I didn't get into the exim change beacuse exim boggles my mind and my +2 probably doesn't mean much thee | 22:56 |
| clarkb | maybe fungi wants to review that one https://review.openstack.org/#/c/588089/6 fwiw | 22:56 |
| corvus | i'm happy to answer questions about the exim change | 22:57 |
| corvus | also, maybe we should have a 10 minute exim 101 chat at the ptg? i promise it's super friendly to use :) | 22:57 |
| corvus | (routers decide where mail goes, transports get it there. done!) | 22:58 |
| corvus | anyway, that change is basically a port of our puppet-exim module, but without all the weird stuff. | 22:58 |
| clarkb | ++++++ | 22:58 |
| clarkb | I actually would be really happy for that | 22:58 |
| corvus | cool, let's do it :) | 22:58 |
| clarkb | mordred: I did leave commenst and notes where I noticed things | 22:59 |
| clarkb | mordred: I don't think we need to address them all up front | 22:59 |
| clarkb | but stuff to consider in general | 22:59 |
| *** tosky has quit IRC | 22:59 | |
| fungi | looking at 588089 now | 23:01 |
| *** mschuppert has quit IRC | 23:04 | |
| *** bobh has quit IRC | 23:04 | |
| clarkb | it is nearing EOD for most of us, any last minute pre project renaming items I/we should double check? | 23:06 |
| clarkb | fungi: the playbook should handle a rename from openstack-attic/ to openstack/ right? | 23:06 |
| fungi | yep, we just need to be careful to undo the read-only state | 23:07 |
| fungi | since manage-projects will be unable to push an updated acl | 23:07 |
| fungi | i show 16:00 utc on my calendar for maintenance start. is that still the plan? | 23:08 |
| clarkb | fungi: yup | 23:08 |
| *** edmondsw has quit IRC | 23:08 | |
| clarkb | once renaming is over I'm also going to try and get packethost max-servers bumped up to 100 again assuming it continues to look good there | 23:14 |
| clarkb | so far no error node launch attempts | 23:14 |
| clarkb | fungi: I notice that the playbook already includes reindexing, so I think we can take that off of the etherpad | 23:15 |
| fungi | right, it'll initiate the online reindex once the api is responding, i think? | 23:17 |
| fungi | we can check that in the process queue and log anyway | 23:18 |
| ianw | infra-root: if anyone is around to approve the rtd switch, that would be good https://review.openstack.org/#/c/583834/ . i can then validate the template job and send out notification | 23:21 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: gerrit-dash-creator: revert to readthedocs template https://review.openstack.org/588410 | 23:34 |
| *** sthussey has quit IRC | 23:35 | |
| pabelanger | ianw: have we tested trigger-readthedocs-webhook yet? | 23:40 |
| ianw | pabelanger: yep, links in my comments in the patch :) | 23:40 |
| ianw | once switched, https://review.openstack.org/#/c/588409/ should be a complete example of what has to happen | 23:41 |
| pabelanger | wfm +3 | 23:42 |
| ianw | thanks, i'll validate again and send out a mail | 23:42 |
| ianw | and be glad to not be hacking on post-review + secret jobs! they're tricky to get right | 23:42 |
| pabelanger | indeed | 23:43 |
| pabelanger | ianw: I've started pushing on removing fedora-27 again: https://review.openstack.org/#/q/topic:fedora-latest | 23:43 |
| pabelanger | once we land those, we can remove it from nodepool | 23:43 |
| pabelanger | ianw: also, be sure to checkout infra ML for fedora-28 request | 23:43 |
| ianw | yeah saw that, will check in on it today | 23:45 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Use webhook update for docs-on-readthedocs https://review.openstack.org/583834 | 23:45 |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul-jobs master: Swift logs: don't allow links outside of the supplied path https://review.openstack.org/587580 | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!