Wednesday, 2019-01-30

*** hamzaachi has quit IRC00:01
*** sdake has quit IRC00:19
*** iniazi_ has quit IRC00:27
*** iniazi has quit IRC00:27
*** sdake has joined #openstack-kolla00:28
*** iniazi has joined #openstack-kolla00:29
*** iniazi_ has joined #openstack-kolla00:29
*** wolverineav has joined #openstack-kolla00:29
*** chrizl has quit IRC00:33
*** Sravan has quit IRC00:33
*** Sravan has joined #openstack-kolla00:34
*** Sravan has quit IRC00:41
*** Sravan has joined #openstack-kolla00:43
*** Sravan has quit IRC00:51
*** Sravan has joined #openstack-kolla00:54
*** Sravan has quit IRC01:00
*** Sravan has joined #openstack-kolla01:01
*** hamzy has joined #openstack-kolla01:04
*** Sravan has quit IRC01:08
*** Sravan has joined #openstack-kolla01:08
*** sdake has quit IRC01:19
*** Sravan has quit IRC01:21
*** sdake has joined #openstack-kolla01:22
*** Sravan has joined #openstack-kolla01:26
*** iniazi has quit IRC01:33
*** iniazi_ has quit IRC01:33
*** iniazi_ has joined #openstack-kolla01:38
*** iniazi has joined #openstack-kolla01:38
*** Sravan has quit IRC01:39
*** Sravan has joined #openstack-kolla01:40
*** wolverineav has quit IRC01:43
*** wolverineav has joined #openstack-kolla01:44
*** wolverineav has quit IRC01:48
*** _fragatina has quit IRC02:05
*** _fragatina has joined #openstack-kolla02:06
*** _fragatina has quit IRC02:07
*** wolverineav has joined #openstack-kolla02:14
*** wolverineav has quit IRC02:18
*** TxGirlGe_ has quit IRC02:28
*** wolverineav has joined #openstack-kolla02:30
*** wolverineav has quit IRC02:39
*** Sravan has quit IRC02:39
*** wolverineav has joined #openstack-kolla02:40
*** iniazi_ has quit IRC02:42
*** iniazi has quit IRC02:42
*** iniazi_ has joined #openstack-kolla02:46
*** iniazi has joined #openstack-kolla02:46
*** sdake has quit IRC03:00
*** wolverineav has quit IRC03:02
*** skramaja has joined #openstack-kolla03:32
*** ykarel|away has joined #openstack-kolla03:43
*** wolverineav has joined #openstack-kolla03:43
*** wolverineav has quit IRC03:47
*** wolverineav has joined #openstack-kolla03:47
*** owalsh_ has joined #openstack-kolla03:58
*** owalsh has quit IRC04:01
*** k_mouza has joined #openstack-kolla04:07
*** k_mouza has quit IRC04:11
jschlueterINFO:kolla.common.utils.xtrabackup:GPG key retrieval failed: [Errno 14] curl#37 - "Couldn't open file /etc/pki/rpm-gpg/RPM-GPG-KEY-Percona"04:15
jschlueterI'm seeing this failure in several jobs04:15
jschlueterhttp://logs.openstack.org/40/633740/1/check/kolla-build-oraclelinux-source/76a26bb/logs/build/000_FAILED_xtrabackup.txt.gz04:16
*** Sravan has joined #openstack-kolla04:42
*** ykarel|away has quit IRC05:20
*** Sravan has quit IRC05:20
*** janki has joined #openstack-kolla05:21
*** _fragatina has joined #openstack-kolla05:23
*** _fragatina has quit IRC05:24
*** _fragatina has joined #openstack-kolla05:24
*** Sravan has joined #openstack-kolla05:24
*** ykarel|away has joined #openstack-kolla05:32
*** ykarel|away is now known as ykarel05:33
*** _fragatina has quit IRC05:46
*** _fragatina has joined #openstack-kolla05:46
*** hamzaachi_ has quit IRC06:29
*** Luzi has joined #openstack-kolla06:59
*** Sravan has quit IRC07:01
*** cah_link has joined #openstack-kolla07:05
*** Sravan has joined #openstack-kolla07:05
*** Sravan has quit IRC07:09
*** radeks_ has joined #openstack-kolla07:11
*** mandre|off is now known as mandre07:12
*** radeks_ has quit IRC07:17
*** radeks_ has joined #openstack-kolla07:23
*** ykarel is now known as ykarel|lunch07:30
*** gkadam has joined #openstack-kolla07:51
*** pcaruana has joined #openstack-kolla08:11
*** ykarel|lunch is now known as ykarel08:22
*** Sravan has joined #openstack-kolla08:22
*** Sravan has quit IRC08:27
*** rgogunskiy has joined #openstack-kolla08:32
*** gkadam has quit IRC08:42
*** gfidente has joined #openstack-kolla09:20
*** k_mouza has joined #openstack-kolla09:21
*** k_mouza has quit IRC09:22
*** k_mouza has joined #openstack-kolla09:23
*** Sravan has joined #openstack-kolla09:24
*** wolverineav has quit IRC09:26
*** Sravan has quit IRC09:29
*** dciabrin has joined #openstack-kolla09:34
*** wolverineav has joined #openstack-kolla09:35
*** robbbe has joined #openstack-kolla09:44
mgoddardmorning all09:55
*** iniazi_ has quit IRC09:57
*** iniazi has quit IRC09:57
*** shyamb has joined #openstack-kolla09:58
*** owalsh_ is now known as owalsh10:03
*** iniazi has joined #openstack-kolla10:03
*** iniazi_ has joined #openstack-kolla10:03
openstackgerritMartin André proposed openstack/kolla master: Fix address to percona GPG key  https://review.openstack.org/63390610:12
*** shyamb has quit IRC10:13
*** shyamb has joined #openstack-kolla10:13
mandrelet see if ^^ fixes the build for the xtrabackup image10:13
mnasiadkamorning10:15
mnasiadkagood news is skydive finally fixed the agent to fix zombies problem... I'm waiting for a release and then we can finally fix it in kolla also...10:16
adrianrezamnasiadka: yes I saw that bug is closed in upstream skydive, I'm waiting also for the release10:19
*** sshnaidm has quit IRC10:19
mnasiadkaadrianreza: and the prometheus stuff, I see we still have like 1.6, bumping up to 2.x will require some tests to check if we don't use some of the backwards incompatible stuff ;)10:20
mnasiadkaadrianreza: so will try to test it today10:20
mgoddardmandre: there is also an issue with monasca-grafana: http://logs.openstack.org/03/625003/1/gate/kolla-build-centos-source/9b2454e/logs/build/000_FAILED_monasca-grafana.txt.gz10:21
mgoddardmandre: I have a fix for centos, just looking at ubuntu. We might need to combine patches to get it through the gate10:22
adrianrezamnasiadka: yes I've tested the new version and get some error with latest version flag10:23
adrianrezamnasiadka: I modified some flag here https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/prometheus/templates/prometheus-server.json.j210:23
mandremgoddard: indeed, I was looking into it - did you push your patch already?10:23
mgoddardmandre: not yet, just testing ubuntu10:24
mandremgoddard: ack, what did you do? install rake or pin the gems?10:24
mgoddardguess we should coordinate no IRC more :)10:24
mandremgoddard: haha yeah :)10:25
mgoddardI installed rubygem-rake on centos10:25
mnasiadkaadrianreza: yeah, log.format has been remove10:25
adrianrezamnasiadka: the latest version used --config rather than -config, "command": "/opt/prometheus/prometheus --config.file /etc/prometheus/prometheus.yml --web.listen-address {{ api_interface_address }}:{{ prometheus_port }} --log.format logfmt --storage.tsdb.path /var/lib/prometheus --storage.tsdb.retention=60d"10:25
mandremgoddard: if possible I'd like to avoid installing rake for binary distros10:26
*** sshnaidm has joined #openstack-kolla10:26
adrianrezamnasiadka: yes, but now I used the latest version for prometheus-server, node-exporter, and alertmanager. I rebuild my own image and everything is good so far10:27
mnasiadkaadrianreza: thanks, will do some testing on my own and push the code10:27
mgoddardmandre: why? isn't it required to build the gem?10:27
mandremgoddard: was monasca-grafana failing for source build only or also binary?10:27
mgoddardmandre: only saw gate failures, so no binary jobs were run. The Dockerfile is the same for source and binary since it's not python10:28
mandremgoddard: build tools like rake should be restricted to images where we build something, in theory we should avoid pulling anything that is not packaged for binary distros10:28
mandrethat's something I'd like to fix10:28
mgoddardmandre: at the moment the monasca-grafana image is very much a source image - it runs gem install, npm install, go run build.go, etc10:31
adrianrezamnasiadka: this is for prometheus-node-exporter.json.j2, "command": "/opt/node_exporter/node_exporter --path.procfs /host/proc --path.sysfs /host/sys --web.listen-address {{ api_interface_address }}:{{ prometheus_node_exporter_port }}"10:31
mgoddardmandre: we don't skip that image for binary builds, I suppose we could do10:31
adrianrezamnasiadka: I checked in master branch, I think prometheus-server.json.j2, prometheus-node-exporter.json.j2, and prometheus-mysqld-exporter.json.j2 need some new flags if we want update it to latest version10:33
mandremgoddard: yep, we should add guards to skip monasca-grafana for binary builds10:34
mgoddardthere are probably other such monasca images if you want to be strict about that10:35
mandremgoddard: what do you think of adding a gate check to ensure there is no pip install, gem install, npm install or anything like that for binary builds?10:36
mandreit has bothered me for long enough that I want to fix it :)10:36
mgoddardmandre: I think it would be interesting to at least know where the culprits are. It's not something that bothers me too much though :)10:37
mgoddardI tend to use binary builds right now, but would like to switch to source10:37
mandremgoddard: for us it's a big problem, we need control over what gets in the image10:41
mgoddardmandre: yeah I can understand it's an issue for RH10:41
mandremgoddard: it's an issue for anyone that needs to support a product10:42
mandrehow can you tell the code from a random gem is ok? or install anything from untrusted source?10:43
mgoddardmandre: you could add a check for 'source' to the macros for pip install etc10:43
mgoddardmandre: it's true, there is always a certain amount of trust in open source. RH Customers have to trust RH10:44
mandremgoddard: I was more thinking about generating the templates for binary distros, and grep for offending instructions such as npm, pip, git, wget...10:45
*** priteau has joined #openstack-kolla10:46
mgoddardmandre: that would be a good final catch, but the macro method would catch things up front, and prevent people from adding things in the first place10:46
mgoddardmandre: we could add an install_url macro and convert our many curls to use it10:47
mgoddardmandre: it's annoying to have blocking checks that are run only in the gate10:47
mandremgoddard: nah it would run in check and gate, and we can make it run as part of the pep8 check so you don't have to wait for the full image build10:49
*** Sravan has joined #openstack-kolla10:49
mgoddardmandre: s/gate/CI/ in my last msg10:50
mgoddardpep8 could work I suppose10:50
*** cah_link has quit IRC10:50
mgoddardalthough that's normally more about code style checks10:50
mandremgoddard: I'll try to propose a patch for it, see how bad the situation really is :)10:51
mandremgoddard: we tend to abuse the pep8 job to check for all code conformance, it would fit IMO10:52
mgoddardmandre: go for it10:52
mandreas long as pep8 job remains quick, we should be good I think10:52
*** Sravan has quit IRC10:54
*** cah_link has joined #openstack-kolla10:58
*** wolverineav has quit IRC10:59
*** iniazi_ has quit IRC11:07
*** iniazi has quit IRC11:07
*** shyamb has quit IRC11:15
*** iniazi has joined #openstack-kolla11:19
*** iniazi_ has joined #openstack-kolla11:19
mgoddardmandre: looks like xtrabackup fix doesn't work (testing locally)11:37
mandremgoddard: hmm crap11:37
mandremgoddard: The GPG keys listed for the "Percona-Release YUM repository - x86_64" repository are already installed but they are not correct for this package.11:38
mandreif percona signs the packages with an unknown key, there's not much we can do beside adding xtrabackup image to known failures list11:40
*** k_mouza_ has joined #openstack-kolla11:41
*** k_mouza has quit IRC11:45
mandremgoddard: https://jira.percona.com/browse/PT-1685 provides some info on how to workaround the issue, I'm going to copy the new key into the image11:45
*** k_mouza_ has quit IRC11:46
*** k_mouza has joined #openstack-kolla11:47
*** k_mouza has quit IRC11:47
*** k_mouza has joined #openstack-kolla11:48
mgoddardmandre: just tried that workaround, seems to work11:50
mgoddardmandre: I will update your review with the monasca-grafana fix, so can you pull down before updating for xtrabackup?11:53
*** sdake has joined #openstack-kolla12:03
openstackgerritMark Goddard proposed openstack/kolla master: Fix broken xtrabackup and monasca-grafana images  https://review.openstack.org/63390612:03
*** shyamb has joined #openstack-kolla12:07
*** gkadam has joined #openstack-kolla12:08
*** gkadam is now known as gkadam-bmgr12:19
*** janki has quit IRC12:21
*** shyamb has quit IRC12:24
*** shyamb has joined #openstack-kolla12:25
*** shyamb has quit IRC12:30
openstackgerritMartin André proposed openstack/kolla master: Fix broken xtrabackup and monasca-grafana images  https://review.openstack.org/63390612:32
*** k_mouza has quit IRC12:37
*** sdake has quit IRC12:43
*** sdake has joined #openstack-kolla12:46
openstackgerritMartin André proposed openstack/kolla master: Fix broken xtrabackup and monasca-grafana images  https://review.openstack.org/63390612:54
*** ykarel is now known as ykarel|away13:17
*** iniazi has quit IRC13:25
*** iniazi_ has quit IRC13:25
*** iniazi has joined #openstack-kolla13:27
*** iniazi_ has joined #openstack-kolla13:27
*** _fragatina has quit IRC13:38
*** _fragatina has joined #openstack-kolla13:38
*** rgogunskiy has quit IRC13:47
*** pcaruana has quit IRC13:50
*** ykarel|away has quit IRC13:56
*** pcaruana has joined #openstack-kolla13:57
*** janki has joined #openstack-kolla14:03
*** vabada_ has quit IRC14:05
*** dave-mccowan has joined #openstack-kolla14:11
*** dave-mccowan has quit IRC14:16
*** sdake has quit IRC14:20
*** ykarel|away has joined #openstack-kolla14:29
*** iniazi has quit IRC14:31
*** iniazi_ has quit IRC14:31
*** sdake has joined #openstack-kolla14:34
*** k_mouza has joined #openstack-kolla14:35
*** iniazi has joined #openstack-kolla14:35
*** iniazi_ has joined #openstack-kolla14:35
*** ykarel|away is now known as ykarel14:36
*** skramaja has quit IRC14:42
*** mchlumsky has joined #openstack-kolla14:43
*** mjturek has joined #openstack-kolla14:44
*** mjturek has quit IRC14:48
*** sdake has quit IRC14:49
*** sdake has joined #openstack-kolla14:55
openstackgerritMartin André proposed openstack/kolla master: Add script to check for forbidden instructions  https://review.openstack.org/63397115:04
openstackgerritMartin André proposed openstack/kolla master: Add script to check for forbidden instructions  https://review.openstack.org/63397115:08
*** sdake has quit IRC15:11
*** k_mouza has quit IRC15:13
*** sdake has joined #openstack-kolla15:13
openstackgerritMartin André proposed openstack/kolla master: Fix broken xtrabackup and monasca-grafana images  https://review.openstack.org/63390615:15
*** dciabrin has quit IRC15:15
*** dciabrin has joined #openstack-kolla15:16
*** TxGirlGeek has joined #openstack-kolla15:16
*** Luzi has quit IRC15:18
openstackgerritMartin André proposed openstack/kolla master: Add script to check for forbidden instructions  https://review.openstack.org/63397115:22
*** TxGirlGeek has quit IRC15:28
*** wolverineav has joined #openstack-kolla15:36
*** iniazi has quit IRC15:40
*** iniazi_ has quit IRC15:40
*** wolverineav has quit IRC15:41
*** janki has quit IRC15:47
*** iniazi has joined #openstack-kolla15:51
*** iniazi_ has joined #openstack-kolla15:51
*** gkadam-bmgr has quit IRC15:57
*** pcaruana has quit IRC16:01
*** _fragatina has quit IRC16:01
*** sdake has quit IRC16:14
*** pcaruana has joined #openstack-kolla16:17
*** sdake has joined #openstack-kolla16:22
*** robbbe has quit IRC16:27
*** TxGirlGeek has joined #openstack-kolla16:31
*** pcaruana has quit IRC16:45
*** k_mouza has joined #openstack-kolla16:47
*** sdake has quit IRC16:51
*** TxGirlGeek has quit IRC16:56
*** TxGirlGeek has joined #openstack-kolla16:57
*** k_mouza_ has joined #openstack-kolla16:57
*** iclon has quit IRC16:57
*** iclon has joined #openstack-kolla16:59
*** k_mouza has quit IRC16:59
*** sdake has joined #openstack-kolla17:00
*** radeks_ has quit IRC17:02
*** radeks_ has joined #openstack-kolla17:02
*** ykarel is now known as ykarel|away17:03
*** _fragatina has joined #openstack-kolla17:06
*** priteau has quit IRC17:08
*** k_mouza_ has quit IRC17:15
*** wolverineav has joined #openstack-kolla17:30
*** wolverineav has quit IRC17:34
openstackgerritMartin André proposed openstack/kolla master: Allow running more commands dockerless  https://review.openstack.org/63401717:50
*** robbbe has joined #openstack-kolla17:51
*** Sravan has joined #openstack-kolla17:54
*** Sravan has quit IRC17:55
openstackgerritMartin André proposed openstack/kolla master: Do not gem install for binary type  https://review.openstack.org/63401918:12
*** wolverineav has joined #openstack-kolla18:13
*** wolverineav has quit IRC18:15
*** shardy has quit IRC18:15
*** wolverin_ has joined #openstack-kolla18:15
*** wolverin_ has quit IRC18:15
*** wolverineav has joined #openstack-kolla18:16
*** dciabrin has quit IRC18:16
*** dciabrin has joined #openstack-kolla18:16
*** pcaruana has joined #openstack-kolla18:17
*** Sravan has joined #openstack-kolla18:20
*** robbbe has quit IRC18:21
*** robbbe has joined #openstack-kolla18:23
*** sshnaidm is now known as sshnaidm|afk18:25
*** wolverineav has quit IRC18:27
*** iniazi_ has quit IRC18:27
*** iniazi has quit IRC18:27
*** wolverineav has joined #openstack-kolla18:31
*** Sravan has quit IRC18:32
*** Sravan has joined #openstack-kolla18:33
*** iniazi_ has joined #openstack-kolla18:50
*** iniazi has joined #openstack-kolla18:50
*** TxGirlGeek has quit IRC18:50
*** TxGirlGeek has joined #openstack-kolla18:51
*** wolverineav has quit IRC18:53
*** wolverineav has joined #openstack-kolla18:53
*** priteau has joined #openstack-kolla18:55
*** wolverineav has quit IRC18:56
*** wolverineav has joined #openstack-kolla18:56
*** Sravan has quit IRC18:56
*** Sravan has joined #openstack-kolla18:58
*** TxGirlGeek has quit IRC19:00
*** TxGirlGeek has joined #openstack-kolla19:03
*** Sravan has quit IRC19:03
*** ykarel|away has quit IRC19:05
*** Sravan has joined #openstack-kolla19:05
*** Sravan has quit IRC19:09
*** Sravan has joined #openstack-kolla19:09
*** robbbe has quit IRC19:11
*** wolverineav has quit IRC19:24
*** wolverineav has joined #openstack-kolla19:32
*** wolverineav has quit IRC19:37
*** Sravan has quit IRC19:40
*** Sravan has joined #openstack-kolla19:42
*** cah_link has quit IRC19:43
*** wolverineav has joined #openstack-kolla19:49
*** iniazi_ has quit IRC19:53
*** iniazi has quit IRC19:53
*** chrizl has joined #openstack-kolla19:55
*** chrizl has quit IRC19:59
*** priteau has quit IRC20:01
*** sdake has quit IRC20:06
*** sdake has joined #openstack-kolla20:06
*** iniazi has joined #openstack-kolla20:07
*** iniazi_ has joined #openstack-kolla20:07
*** Sravan has quit IRC20:16
*** Sravan has joined #openstack-kolla20:19
*** negronjl has quit IRC20:21
*** Sravan has quit IRC20:26
*** negronjl has joined #openstack-kolla20:27
*** sdake has quit IRC20:39
*** Sravan has joined #openstack-kolla20:39
*** sdake has joined #openstack-kolla20:42
*** sdake has quit IRC20:44
*** sdake has joined #openstack-kolla20:46
*** Sravan has quit IRC20:47
*** Sravan has joined #openstack-kolla20:47
*** gfidente has quit IRC20:48
*** Sravan has quit IRC20:55
*** wolverineav has quit IRC20:59
*** Sravan has joined #openstack-kolla21:01
*** sdake has quit IRC21:01
*** sdake has joined #openstack-kolla21:02
*** k_mouza has joined #openstack-kolla21:02
*** k_mouza has quit IRC21:06
*** Sravan has quit IRC21:06
*** wolverineav has joined #openstack-kolla21:07
*** radeks_ has quit IRC21:19
*** sdake has quit IRC21:38
*** sdake has joined #openstack-kolla21:49
*** openstackgerrit has quit IRC21:50
*** ianw_pto is now known as ianw21:59
*** Sravan has joined #openstack-kolla22:00
*** Sravan has quit IRC22:03
*** Sravan has joined #openstack-kolla22:03
*** Sravan has quit IRC22:12
*** Sravan has joined #openstack-kolla22:14
*** Sravan has quit IRC22:23
*** Sravan has joined #openstack-kolla22:30
*** Sravan has quit IRC22:39
*** Sravan has joined #openstack-kolla22:42
*** sdake has quit IRC23:01
*** Sravan has quit IRC23:08
*** Sravan has joined #openstack-kolla23:12
*** Sravan has quit IRC23:15
*** wolverineav has quit IRC23:15
*** wolverineav has joined #openstack-kolla23:20
*** wolverineav has quit IRC23:25
*** sdake has joined #openstack-kolla23:29
*** wolverineav has joined #openstack-kolla23:31
*** sdake has quit IRC23:33
*** Sravan has joined #openstack-kolla23:39
*** Sravan has quit IRC23:44
*** Sravan has joined #openstack-kolla23:50

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!