Monday, 2018-01-15

-openstackstatus- NOTICE: The logs.openstack.org filesystem has been restored to full health. We are attempting to keep logs uploaded between the prior alert and this one, however if your job logs are missing please issue a recheck.04:46
*** ChanServ changes topic to "The logs.openstack.org filesystem has been restored to full health. We are attempting to keep logs uploaded between the prior alert and this one, however if your job logs are missing please issue a recheck."04:46
*** ChanServ changes topic to "OpenStack & Chef | chef.io/openstack | bit.ly/os-chef-wiki | bit.ly/os-gerrit-inbox | bit.ly/os-chef-repo | bit.ly/os-chef-meetings-logs | bit.ly/os-chef-meeting-agendas | bit.ly/stackalytics-chef"04:52
*** os-chef-bot has quit IRC06:25
*** os-chef-bot has joined #openstack-chef07:40
openstackgerritMerged openstack/cookbook-openstack-ops-database master: ops-database refactor for Pike and Chef 13  https://review.openstack.org/52305013:13
openstackgerritMerged openstack/cookbook-openstack-ops-database master: Add receipes for mariadb cluster deployment  https://review.openstack.org/52981913:13
*** openstackgerrit has quit IRC13:18
sc`my dev lab won't be back in full function until early next month, when i hope to have more time to put forth to queens14:07
sc`frickler: from my own testing on bare metal, package_overrides existing did nothing one way or the other so long as the apt.conf.d file was emitted. initially, i blanked them all out14:37
sc`i had more trouble out of the attribute until i made it a config, between chef 12 and 1314:38
sc`i meant to direct that to jklare14:39
sc`E_NOSLEEP14:39
sc`jklare: i'm inclined to just delete the whole conditional if nothing is using it. apt is quite happy with the config file in testing14:41
sc`all of this madness with apt.conf.d and package_overrides came about from trying to drop old cookbook cruft, like apt since it was rolled into chef-client14:45
sc`both apt and yum are in chef-client as of late 12, so including them is more misleading than excising14:46
sc`people would expect include_recipe 'apt' to work because it's there, but it does nothing now. it used to run apt-get -q update14:47
jklaresc` i am a little confused now15:20
sc`i know. i was, too. see my comments on 52303015:21
sc`both apt cache updating and package installation had problems between chef 12 and 13. one of the sticking points was single versus double quotes in ruby, and switching chef versions made that difficult to debug and converge15:22
sc`the patches as they sit in gerrit attempt to make apt easier to maintain and debug15:23
sc`all of my 'refactor' changes contain about two or three years' worth of chef deprecations, because of how 12 to 13 was15:26
sc`i want to get kitchen working as a third-party ci15:27
sc`i feel like that's our path to delightful15:27
sc`the outcome of all of these changes is that the cookbooks will test with tempest for every chef run, be it openstack ci or local testing15:42
jklaresc` still confused15:47
sc`about?15:47
jklaresc` wouldnt it be easier to use these attributes? https://github.com/chef-cookbooks/apt/blob/v6.1.4/templates/10dpkg-options.erb15:47
jklareand bump the apt version to 615:47
sc`if that cookbook actually did something, sure. however, apt and yum are rolled up into chef core15:47
jklaremaybe i missed the announcement about the apt cookbook beeing deprecated15:48
jklarei mean a big part of the apt libs were moved to chef core15:49
jklarebut not everything15:49
jklaree.g. these config files15:49
jklareor the whole configuration and unattended upgrades part15:49
jklareas well as the apt_preferences resource15:50
jklareis that all going to be included in chef13?15:50
sc`it is in chef 13, yes15:50
sc`https://docs.chef.io/resource_apt_preference.html15:50
sc`apt_preferences was included in 13.315:50
sc`2.3.4 is what i developed on, and it has at least 13.415:51
sc`chefdk 2.3.4 that is15:51
jklareah ok15:52
sc`it was confusing to me until i had all of the changes staged locally15:52
sc`i'm going to admit: i have a lot of wip cruft where i would attack the problem from different angles, until i came to what i proposed to gerrit15:54
sc`there are a few weeks' worth of now throwaway changes here and there15:55
sc`but that's how i derived on what i proposed15:55
sc`node.foo.bar => node['foo']['bar'] was the most widespread, and obscured a lot of visibility with tooling15:57
sc`https://github.com/chef/chef/tree/master/lib/chef/resource has apt_package, apt_preference, apt_repository, apt_update, yum_repository and yum_package15:59
jklareok16:00
jklarebut as long as any of our cookbooks (or the dependencies) include the apt cookbook, we will generate 2 files containing apt dpkg options in /etc/apt/apt.conf.d/16:01
jklarewhich might also cause some trouble16:01
sc`then that would be suboptimal16:01
jklarenot sure how these files are merged16:01
jklareso i would think we try to remove the "include_recipe 'apt'" from out cookbooks in favor of the apt_update resource16:02
jklarebut for the dpkg config i would prefere to use the attributes from the apt cookbook16:03
sc`i've looked through all 12 cookbooks and the only one that does include it is openstack-common::default16:03
sc`523030 replaces that with apt_update16:04
jklareok16:04
sc`the way that chef 13 includes the resources, the corresponding ones in the apt and yum cookbooks no-op16:05
sc`~16:07
sc`hi kitty16:07
jklareso after removing apt from the metadata there, does your Berksfile.lock in the test env still include the apt cookbook?16:17
jklareso does someone else pull it in?16:17
sc`mariadb pulls it in, but mariadb is overdue for some love16:17
sc`i checked the dep graph after all changes were staged16:17
sc`the end outcome is to remove build-essential, in the chef community16:18
sc`https://www.dropbox.com/s/pr6hdqnnm7belih/chef_openstack_20171112_noconstraints.png?dl=0 per the last berks viz i ran (this is roughly when i was able to converge without depending on apt or yum directly)16:24
sc`ceph and mariadb are the ones that pull in apt16:25
sc`that's actually a bit stale, since i removed ceph from openstack-block-storage. i meant to open a blueprint for changing it to the more alive version16:27
sc`https://github.com/ceph/ceph-chef is the alive fork of the ceph cookbook16:27
sc`of course, even there, it's not chef 13 ready16:27
sc`one indicator is metadata.rb - current fc will want a slightly different syntax for the license string16:29
sc`it won't even converge on a chef 13 client due to method versus bracket syntax, so no sense in including it, or any of the cookbooks that stopped working with chef 1316:33
jklare:)16:33
jklarewe use our own fork and have recently patched it for chef 1316:34
jklarehttps://github.com/cloudbau/ceph-cookbook16:34
jklarebut there are a lot of patches in this one, since the original one has not been maintained for quite some time16:34
jklarei will check if we can push the chef13 changes to the one you mentioned16:35
sc`https://www.dropbox.com/s/5trfhlis1yumtmg/chef_openstack_20180115.png?dl=0 here's how the dep graph looks as of this morning, including the changes in gerrit16:39
sc`compute still has a depends on the old ceph cookbook16:40
sc`mariadb is the one that needs the most work to clean up the graph16:44
jklareyeah, i think the mariadb cookbook is just slightly better maintained than the percona one :)16:47
sc`it has more recent eyes, at least16:47
sc`i'm basing that on activity less than a week ago on https://github.com/sous-chefs/mariadb/issues/18616:48
sc`it's an acknowledgement, but activity regardless16:48
sc`i'm holding myself from that rabbit hole because it will certainly overextend me to cover that cookbook in addition to the other things i do16:49
sc`maintaining cookbooks is basically my side piece. it doesn't get the utmost priority16:53
*** openstackgerrit has joined #openstack-chef17:05
openstackgerritSamuel Cassiba proposed openstack/cookbook-openstack-compute master: Dropped legacy Ceph cookbook  https://review.openstack.org/53374017:05
sc`another thing i'm doing is trying to make it so the cookbooks come from supermarket for the point of entry, and not from a bunch of local git repos with sparse breadcrumbs17:10
sc`kitchen + supermarket makes kicking the tires easy, which is what's needed in openstack at large17:12
sc`extending that to third-party ci of some sort, it makes automated scenario-based testing less painful17:20
sc`by that same token, pipelining can eventually be set up using stove to deliver updates directly to supermarket. i don't imagine it's a huge amount of code to do it, but haven't allocated time to it because of chef 1317:25
sc`the added bonus is that it becomes a measure of activity that one can follow17:26
-openstackstatus- NOTICE: Zuul has been restarted and has lost queue contents; changes in progress will need to be rechecked.18:22

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!