*** hongbin has quit IRC | 00:00 | |
*** aeng has quit IRC | 00:02 | |
openstackgerrit | Jamie Lennox proposed openstack-infra/zuul feature/zuulv3: Allow loading additional variables file for site config https://review.openstack.org/447734 | 00:02 |
---|---|---|
clarkb | kevinbenton: for 204 it doesn't appear that zuul got the approval message. Zuul should post a comment removing the jenkins +1 when approval is made there | 00:03 |
clarkb | kevinbenton: and that roughly happens when the other one was approved so I think similar issue | 00:03 |
*** dingyichen has joined #openstack-infra | 00:03 | |
clarkb | was zuul off at that time? | 00:03 |
kevinbenton | clarkb: it may have been, i think it was last friday | 00:03 |
clarkb | kevinbenton: in any case I thnk the easy fix is to reapprove them, just add your approval vote to each | 00:03 |
*** rook-ugh is now known as rook | 00:03 | |
kevinbenton | clarkb: ack | 00:03 |
clarkb | rechecking doesn't work because gerrit doesn't emit vote number data on events when that number doesn't change :/ | 00:03 |
clarkb | so jenkins +1 happening again emits a pretty useless event that zuul can't action on (its somethign that newer gerrit should fix for us) | 00:04 |
*** ZZelle has quit IRC | 00:04 | |
kevinbenton | clarkb: perfect. that did the trick | 00:05 |
kevinbenton | clarkb: we have a new gerrit in the cards? | 00:05 |
*** ijw has joined #openstack-infra | 00:05 | |
clarkb | kevinbenton: we are slowly working on it and by we I mostly mean zaro | 00:05 |
clarkb | which reminds me thats on my list of things to catch up on and help with | 00:05 |
kevinbenton | clarkb: how much does gertty beat the crap out of gerrit? | 00:07 |
clarkb | kevinbenton: I don't think too badly, its uses a single connection mostly, just like your web browser | 00:07 |
clarkb | the initial cache update can hit it pretty hard but once thats done it should be pretty cheap | 00:07 |
kevinbenton | clarkb: i can't help but wonder if me running gertty makes me responsible for 50% of the queries :P | 00:07 |
kevinbenton | (particularily being subscribed to both nova and neutron) | 00:07 |
*** wolverin_ has quit IRC | 00:09 | |
*** mat128 has joined #openstack-infra | 00:10 | |
*** mat128 has quit IRC | 00:11 | |
*** mat128 has joined #openstack-infra | 00:12 | |
*** mtanino has joined #openstack-infra | 00:14 | |
*** wolverineav has joined #openstack-infra | 00:18 | |
*** aeng has joined #openstack-infra | 00:19 | |
*** tosky has quit IRC | 00:20 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Create PReP boot partition for PPC https://review.openstack.org/447739 | 00:21 |
*** baoli has joined #openstack-infra | 00:22 | |
*** wolverineav has quit IRC | 00:22 | |
*** sflanigan_afk has joined #openstack-infra | 00:23 | |
*** masber has joined #openstack-infra | 00:24 | |
*** baoli has quit IRC | 00:26 | |
*** armax has quit IRC | 00:26 | |
*** amotoki has joined #openstack-infra | 00:26 | |
*** ym200 has quit IRC | 00:27 | |
*** ym200 has joined #openstack-infra | 00:28 | |
*** funzo has quit IRC | 00:30 | |
*** vhosakot_ has joined #openstack-infra | 00:31 | |
*** xarses_ has joined #openstack-infra | 00:32 | |
*** aeng has quit IRC | 00:33 | |
*** vhosakot has quit IRC | 00:33 | |
*** andreww has joined #openstack-infra | 00:33 | |
*** xarses_ has quit IRC | 00:34 | |
*** xarses_ has joined #openstack-infra | 00:34 | |
*** gcb_ has quit IRC | 00:35 | |
*** zul has quit IRC | 00:36 | |
*** andreww has quit IRC | 00:38 | |
*** wolverineav has joined #openstack-infra | 00:38 | |
*** xarses_ has quit IRC | 00:39 | |
*** andreww has joined #openstack-infra | 00:39 | |
*** mtanino has quit IRC | 00:39 | |
*** andreww has quit IRC | 00:39 | |
*** andreww has joined #openstack-infra | 00:40 | |
*** andreww has quit IRC | 00:40 | |
*** gyee_ has quit IRC | 00:40 | |
*** zul has joined #openstack-infra | 00:41 | |
*** andreww has joined #openstack-infra | 00:41 | |
*** mat128 has quit IRC | 00:41 | |
*** gongysh has quit IRC | 00:42 | |
*** wolverineav has quit IRC | 00:42 | |
*** neiljerram has quit IRC | 00:44 | |
fungi | #status log LP bugs for monasca migrated to openstack/monasca-api in StoryBoard, defcore to openstack/defcore, refstack to openstack/refstack | 00:44 |
openstackstatus | fungi: finished logging | 00:44 |
*** ym200 has quit IRC | 00:45 | |
*** aeng has joined #openstack-infra | 00:45 | |
*** ym200 has joined #openstack-infra | 00:45 | |
*** ym200 has quit IRC | 00:46 | |
*** ym200 has joined #openstack-infra | 00:46 | |
*** ym200 has quit IRC | 00:48 | |
*** ym200 has joined #openstack-infra | 00:49 | |
*** adrian_otto has quit IRC | 00:50 | |
*** sbezverk has joined #openstack-infra | 00:52 | |
sbezverk | Hello, I need to disable echo "0" > /proc/sys/net/bridge/bridge-nf-call-iptables on vm where we runb one specific job. It seems I am not allowed to do that. any guidance you can provide to disable it? | 00:53 |
*** mat128 has joined #openstack-infra | 00:54 | |
fungi | sbezverk: a link to the error in a job log would help. there could be a number of reasons depending on how and when you're trying to call that | 00:55 |
sbezverk | fungi: sure thing, let me get it.. | 00:56 |
sbezverk | fungi: here you go http://logs.openstack.org/50/441550/94/experimental/gate-kolla-kubernetes-deploy-centos-source-3-ironic-nv/39ea7d3/console.html#_2017-03-21_00_41_26_838459 | 00:56 |
*** ym200 has quit IRC | 00:58 | |
*** ym200 has joined #openstack-infra | 00:59 | |
clarkb | sbezverk: you would just remove the line from whatever code runs that? also fwiw sudo echo "0" > /some/file doesn't write the 0 to the file with root perms | 00:59 |
fungi | but also it says that doesn't exist... are you sure it's valid with centos 7? | 00:59 |
fungi | clarkb: is right about the redirect with sudo though | 00:59 |
sbezverk | fungi: it is working perfectly fine on my local machine | 00:59 |
fungi | i usually do something like sudo sh -c 'echo 0 > /proc/sys/...' | 01:00 |
fungi | or you can sudo tee or a bunch of other alternatives | 01:00 |
sbezverk | fungi: I can try that, thank you! | 01:00 |
clarkb | sbezverk: when you say you need to disable echo "0" > /foo that means you want to stop executing that code or do you mean that you need to write a 0 there? | 01:01 |
sbezverk | clarkb: writing 0 to that location will disable iptables filtering linux bridge | 01:02 |
clarkb | sbezverk: and taht is what you want to do? | 01:02 |
clarkb | or do you want to stop disabling the setting of that value? | 01:03 |
*** mriedem has quit IRC | 01:03 | |
*** stakeda has joined #openstack-infra | 01:04 | |
sbezverk | clarkb: I want to disable iptables filtering on linux bridges.. on my system echo 0 to blah produces desired effect | 01:04 |
clarkb | gotcha, just making sure I parsed your earlier question properly | 01:04 |
sbezverk | clarkb: fungi: still the same :( http://logs.openstack.org/50/441550/96/experimental/gate-kolla-kubernetes-deploy-centos-source-3-ironic-nv/fdd23b2/console.html#_2017-03-21_01_04_38_106391 | 01:05 |
*** krtaylor has joined #openstack-infra | 01:06 | |
clarkb | sbezverk: ya thats the separate issue of the file not existing on that centos host | 01:06 |
sbezverk | it seems that folder is not available inside vm | 01:06 |
fungi | sbezverk: is that in a chroot without /proc mounted maybe? or dependent on a particular lkm being modprobed? | 01:06 |
clarkb | I can confirm its there on a random centos7 host booted in rax | 01:07 |
sbezverk | fungi: sorry I cannot answer that, it is vm we get to run gate job.. | 01:07 |
clarkb | http://logs.openstack.org/50/441550/96/experimental/gate-kolla-kubernetes-deploy-centos-source-3-ironic-nv/fdd23b2/console.html#_2017-03-21_01_04_32_401723 another thing I notice | 01:08 |
fungi | sbezverk: sure, but since its a kolla job i don't rule out the possibility that your jobs might do things in a chroot or container on that vm, so i asked | 01:08 |
*** Julien-zte has joined #openstack-infra | 01:08 | |
* clarkb checks on osic where the job failed | 01:08 | |
clarkb | its there on random centos7 host I grabebd (I copy pasted the filepath from the job even | 01:10 |
sbezverk | clarkb: I see the same error on all job, the error you mentioned above we saw before, just did not have a chance top fix it | 01:12 |
*** mriedem has joined #openstack-infra | 01:12 | |
*** yamamoto has joined #openstack-infra | 01:12 | |
sbezverk | fungi: at that moment no fancy stuff is done, basic env prepping | 01:12 |
clarkb | that function needs indentation... | 01:13 |
fungi | does adding an ls of that path in the job work, i wonder | 01:13 |
sbezverk | fungi: check this oout http://logs.openstack.org/50/441550/97/check/gate-kolla-kubernetes-deploy-centos-binary-2-iscsi-nv/3ee338d/console.html#_2017-03-21_01_12_20_245306 | 01:14 |
sbezverk | fungi: ls shows that bridge and further down is not there | 01:15 |
clarkb | ya I am wondering if you are just missing a required kernel module or similar | 01:15 |
clarkb | and whatever job is running on the hosts I am checking have that loaded | 01:15 |
*** jamielennox is now known as jamielennox|away | 01:16 | |
*** liujiong has joined #openstack-infra | 01:16 | |
sbezverk | clarkb: it is really strange, it allows us to create bridges, which normally would mean that kernel module for bridging is loaded, no? | 01:17 |
clarkb | bridge 107106 1 br_netfilter is loaded where I checked | 01:18 |
clarkb | sbezverk: I don't know | 01:18 |
clarkb | but its something to check since procfs is populated by the kernel modules | 01:18 |
clarkb | its possible you need br_netfilter ? | 01:19 |
sbezverk | clarkb: will try to add it | 01:19 |
clarkb | so brctl works because bridge is there but br_netfilter isn't or something like that | 01:19 |
clarkb | sbezverk: I would lsmod and check for those two modules | 01:19 |
clarkb | I would test unloading them but I am actually currently using them for local VMs | 01:20 |
clarkb | and finally while throwing ideas out there maybe just edit your iptables rules instaed? | 01:21 |
openstackgerrit | Brian Moss proposed openstack-infra/infra-manual master: Adding instructions for rebasing https://review.openstack.org/447341 | 01:24 |
*** pleia2_ is now known as pleia2 | 01:25 | |
sbezverk | clarkb: it looks lile loading br_netfilter did the trick, thank you very much. | 01:25 |
*** jamielennox|away is now known as jamielennox | 01:28 | |
*** Apoorva has quit IRC | 01:28 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Create PReP boot partition for PPC https://review.openstack.org/447739 | 01:31 |
*** Sukhdev_ has quit IRC | 01:31 | |
*** mozart89 has joined #openstack-infra | 01:31 | |
*** funzo has joined #openstack-infra | 01:31 | |
*** ym200 has quit IRC | 01:33 | |
*** ym200 has joined #openstack-infra | 01:34 | |
*** ym200 has quit IRC | 01:34 | |
*** ym200 has joined #openstack-infra | 01:34 | |
*** yanyanhu has joined #openstack-infra | 01:34 | |
*** dimtruck is now known as zz_dimtruck | 01:35 | |
*** ym200 has quit IRC | 01:35 | |
*** kaisers1 has joined #openstack-infra | 01:35 | |
*** funzo has quit IRC | 01:35 | |
*** ym200 has joined #openstack-infra | 01:36 | |
*** rfolco has joined #openstack-infra | 01:36 | |
*** ym200 has quit IRC | 01:36 | |
*** kaisers has quit IRC | 01:37 | |
*** claudiub has quit IRC | 01:37 | |
*** ym200 has joined #openstack-infra | 01:38 | |
*** rhallisey has quit IRC | 01:39 | |
*** ym200 has quit IRC | 01:40 | |
*** ym200 has joined #openstack-infra | 01:41 | |
*** ym200 has quit IRC | 01:42 | |
*** ym200 has joined #openstack-infra | 01:42 | |
*** ym200 has quit IRC | 01:42 | |
*** skelso has joined #openstack-infra | 01:46 | |
*** skelso has quit IRC | 01:48 | |
*** JDub has joined #openstack-infra | 01:48 | |
*** gongysh has joined #openstack-infra | 01:50 | |
*** yanyanhu has quit IRC | 01:51 | |
*** knangia has quit IRC | 01:51 | |
*** skelso has joined #openstack-infra | 01:53 | |
*** JDub has quit IRC | 01:56 | |
*** yanyanhu has joined #openstack-infra | 01:57 | |
*** zhurong has joined #openstack-infra | 01:57 | |
*** pramodrj07 has joined #openstack-infra | 01:59 | |
*** pramodrj07 has quit IRC | 02:01 | |
*** MasterOfBugs has quit IRC | 02:02 | |
*** ijw has quit IRC | 02:06 | |
*** tphummel has joined #openstack-infra | 02:08 | |
*** mriedem has quit IRC | 02:14 | |
*** adrian_otto has joined #openstack-infra | 02:15 | |
*** gouthamr has joined #openstack-infra | 02:15 | |
*** EricGonczer_ has quit IRC | 02:19 | |
*** vhosakot_ has quit IRC | 02:22 | |
*** vhosakot has joined #openstack-infra | 02:23 | |
*** vhosakot has quit IRC | 02:27 | |
*** zz_dimtruck is now known as dimtruck | 02:32 | |
*** funzo has joined #openstack-infra | 02:32 | |
*** vhosakot has joined #openstack-infra | 02:33 | |
*** funzo has quit IRC | 02:37 | |
*** yamamoto has quit IRC | 02:41 | |
*** winggundamth has joined #openstack-infra | 02:42 | |
*** hongbin has joined #openstack-infra | 02:47 | |
*** yamamoto has joined #openstack-infra | 02:48 | |
*** yanyanhu has quit IRC | 02:48 | |
*** _Cyclone_ has quit IRC | 02:49 | |
*** yanyanhu has joined #openstack-infra | 02:53 | |
*** masber has quit IRC | 02:54 | |
*** nicolasbock has quit IRC | 03:02 | |
*** zhurong has quit IRC | 03:05 | |
*** adrian_otto has quit IRC | 03:06 | |
*** rlandy has quit IRC | 03:06 | |
*** rfolco has quit IRC | 03:06 | |
*** rfolco has joined #openstack-infra | 03:13 | |
*** rfolco has quit IRC | 03:13 | |
*** masber has joined #openstack-infra | 03:15 | |
dmsimard | If any core happens to be around, we need to start mirroring Ubuntu Cloud Archive Pike repositories: https://review.openstack.org/#/c/447478/ | 03:15 |
*** gcb has joined #openstack-infra | 03:15 | |
*** gildub has quit IRC | 03:15 | |
*** spzala has joined #openstack-infra | 03:19 | |
*** dimtruck is now known as zz_dimtruck | 03:21 | |
*** zhurong has joined #openstack-infra | 03:22 | |
*** armax has joined #openstack-infra | 03:24 | |
*** skelso has quit IRC | 03:24 | |
*** skelso has joined #openstack-infra | 03:25 | |
*** yamamoto has quit IRC | 03:25 | |
*** dingyichen has quit IRC | 03:25 | |
openstackgerrit | Manjeet Singh Bhatia proposed openstack-infra/reviewday master: Append a new section to neutron dashboard https://review.openstack.org/439114 | 03:27 |
openstackgerrit | Manjeet Singh Bhatia proposed openstack-infra/reviewday master: Append a new section to neutron dashboard https://review.openstack.org/439114 | 03:29 |
*** dave-mccowan has quit IRC | 03:29 | |
*** dingyichen has joined #openstack-infra | 03:29 | |
*** adrian_otto has joined #openstack-infra | 03:32 | |
*** funzo has joined #openstack-infra | 03:33 | |
*** funzo has quit IRC | 03:37 | |
*** links has joined #openstack-infra | 03:44 | |
*** yamahata has quit IRC | 03:47 | |
*** sree has joined #openstack-infra | 03:50 | |
*** mat128 has quit IRC | 03:57 | |
*** hongbin has quit IRC | 04:02 | |
*** stakeda has quit IRC | 04:03 | |
*** aeng has quit IRC | 04:04 | |
*** spzala has quit IRC | 04:05 | |
*** adrian_otto has quit IRC | 04:06 | |
*** adrian_otto has joined #openstack-infra | 04:07 | |
*** ihrachys has joined #openstack-infra | 04:07 | |
*** gildub has joined #openstack-infra | 04:09 | |
*** yamamoto has joined #openstack-infra | 04:09 | |
*** skelso has quit IRC | 04:11 | |
*** jamielennox is now known as jamielennox|away | 04:12 | |
*** zhurong has quit IRC | 04:12 | |
*** gildub has quit IRC | 04:13 | |
*** shu-mutou-AWAY is now known as shu-mutou | 04:15 | |
*** d0ugal has quit IRC | 04:16 | |
*** d0ugal has joined #openstack-infra | 04:17 | |
*** aeng has joined #openstack-infra | 04:21 | |
*** psachin has joined #openstack-infra | 04:27 | |
*** gildub has joined #openstack-infra | 04:29 | |
*** adrian_otto has quit IRC | 04:29 | |
*** funzo has joined #openstack-infra | 04:34 | |
*** tonytan4ever has quit IRC | 04:37 | |
*** aeng has quit IRC | 04:38 | |
*** funzo has quit IRC | 04:39 | |
*** ramishra has joined #openstack-infra | 04:45 | |
*** saibarspeis has joined #openstack-infra | 04:46 | |
*** spzala has joined #openstack-infra | 04:47 | |
*** spzala has quit IRC | 04:51 | |
*** anilvenkata has joined #openstack-infra | 04:52 | |
*** jaypipes has quit IRC | 04:57 | |
*** jaypipes has joined #openstack-infra | 04:57 | |
*** aeng has joined #openstack-infra | 04:59 | |
*** yamahata has joined #openstack-infra | 05:00 | |
*** zhurong has joined #openstack-infra | 05:00 | |
openstackgerrit | Merged openstack-infra/system-config master: Add support for mirroring the new Pike UCA repos https://review.openstack.org/447478 | 05:01 |
*** tphummel has quit IRC | 05:01 | |
*** gouthamr has quit IRC | 05:03 | |
*** aeng has quit IRC | 05:06 | |
*** chuckC_ has joined #openstack-infra | 05:06 | |
*** arxcruz has joined #openstack-infra | 05:08 | |
*** spzala has joined #openstack-infra | 05:11 | |
*** spzala has quit IRC | 05:15 | |
*** esikache1 has joined #openstack-infra | 05:16 | |
*** dhajare has joined #openstack-infra | 05:20 | |
*** aeng has joined #openstack-infra | 05:24 | |
*** masahito has joined #openstack-infra | 05:25 | |
*** cshastri has joined #openstack-infra | 05:25 | |
*** dhajare has quit IRC | 05:25 | |
*** prateek has joined #openstack-infra | 05:27 | |
*** aeng has quit IRC | 05:30 | |
*** ihrachys has quit IRC | 05:32 | |
*** funzo has joined #openstack-infra | 05:36 | |
*** nadya has joined #openstack-infra | 05:36 | |
*** nadya has quit IRC | 05:39 | |
*** zhurong has quit IRC | 05:40 | |
*** funzo has quit IRC | 05:40 | |
*** vikrant has joined #openstack-infra | 05:41 | |
*** dhajare has joined #openstack-infra | 05:42 | |
*** masahito has quit IRC | 05:43 | |
*** andreww has quit IRC | 05:43 | |
*** rcernin has joined #openstack-infra | 05:43 | |
*** aeng has joined #openstack-infra | 05:43 | |
*** Julien-zte has quit IRC | 05:48 | |
*** markvoelker has quit IRC | 05:53 | |
*** mozart89|2 has joined #openstack-infra | 05:53 | |
*** Julien-zte has joined #openstack-infra | 05:56 | |
*** claudiub has joined #openstack-infra | 05:57 | |
*** rcernin has quit IRC | 05:57 | |
*** knangia has joined #openstack-infra | 06:02 | |
*** Wei_Liu has quit IRC | 06:07 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Create dir on subnode for copying deploy.env https://review.openstack.org/447849 | 06:07 |
*** Wei_Liu has joined #openstack-infra | 06:07 | |
*** Julien-zte has quit IRC | 06:09 | |
*** dhajare has quit IRC | 06:12 | |
*** vsaienko has joined #openstack-infra | 06:13 | |
*** adriant has quit IRC | 06:14 | |
*** vsaienko has quit IRC | 06:18 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Support report by periodic multinode jobs https://review.openstack.org/447860 | 06:19 |
*** esikache1 has quit IRC | 06:23 | |
*** esikachev has joined #openstack-infra | 06:23 | |
*** dhajare has joined #openstack-infra | 06:25 | |
openstackgerrit | toan.t.pham proposed openstack-infra/jenkins-job-builder master: Add folder create for cloudbee folder jobs https://review.openstack.org/438795 | 06:26 |
*** bhavik1 has joined #openstack-infra | 06:29 | |
*** jbadiapa has joined #openstack-infra | 06:30 | |
*** kornicameister has joined #openstack-infra | 06:31 | |
*** jaosorior has joined #openstack-infra | 06:31 | |
*** yolanda has quit IRC | 06:32 | |
*** alexchadin has joined #openstack-infra | 06:32 | |
*** kornicameister has quit IRC | 06:35 | |
*** Wei_Liu1 has joined #openstack-infra | 06:35 | |
*** Wei_Liu has quit IRC | 06:36 | |
*** Wei_Liu1 is now known as Wei_Liu | 06:36 | |
*** funzo has joined #openstack-infra | 06:36 | |
*** funzo has quit IRC | 06:41 | |
*** psachin_ has joined #openstack-infra | 06:44 | |
*** psachin has quit IRC | 06:46 | |
*** yolanda has joined #openstack-infra | 06:46 | |
*** mozart89|2 has quit IRC | 06:49 | |
*** markvoelker has joined #openstack-infra | 06:54 | |
*** Julien-zte has joined #openstack-infra | 06:54 | |
*** Julien-z_ has joined #openstack-infra | 06:57 | |
*** markvoelker has quit IRC | 06:58 | |
*** Julien-zte has quit IRC | 06:59 | |
*** amotoki_ has joined #openstack-infra | 07:00 | |
*** tuanluong has joined #openstack-infra | 07:00 | |
*** david-lyle has quit IRC | 07:02 | |
*** amotoki has quit IRC | 07:03 | |
*** vhosakot has quit IRC | 07:03 | |
*** Julien-z_ has quit IRC | 07:07 | |
*** pgadiya has joined #openstack-infra | 07:08 | |
*** pgadiya has quit IRC | 07:08 | |
*** andreas_s has joined #openstack-infra | 07:08 | |
*** pgadiya has joined #openstack-infra | 07:09 | |
*** amotoki has joined #openstack-infra | 07:18 | |
*** Wei_Liu has quit IRC | 07:18 | |
*** spzala has joined #openstack-infra | 07:18 | |
*** aviau has quit IRC | 07:20 | |
*** aviau has joined #openstack-infra | 07:20 | |
*** amotoki_ has quit IRC | 07:21 | |
*** Wei_Liu has joined #openstack-infra | 07:22 | |
*** e0ne has joined #openstack-infra | 07:22 | |
*** jtomasek has quit IRC | 07:23 | |
*** spzala has quit IRC | 07:23 | |
*** mozart89 has quit IRC | 07:24 | |
*** mozart89 has joined #openstack-infra | 07:25 | |
*** Julien-zte has joined #openstack-infra | 07:26 | |
*** ym200 has joined #openstack-infra | 07:27 | |
*** ym200 has quit IRC | 07:32 | |
*** Wei_Liu1 has joined #openstack-infra | 07:34 | |
*** tesseract has joined #openstack-infra | 07:35 | |
*** Wei_Liu has quit IRC | 07:35 | |
*** Wei_Liu1 is now known as Wei_Liu | 07:35 | |
*** funzo has joined #openstack-infra | 07:37 | |
jiaohaolin1 | hey guys, the wiki seems broken | 07:41 |
jiaohaolin1 | https://wiki.openstack.org/ | 07:41 |
*** funzo has quit IRC | 07:42 | |
jiaohaolin1 | Sorry! This site is experiencing technical difficulties.Try waiting a few minutes and reloading.(Cannot access the database) | 07:42 |
*** e0ne has quit IRC | 07:43 | |
*** spzala has joined #openstack-infra | 07:43 | |
*** ssbarnea has joined #openstack-infra | 07:44 | |
*** ym200 has joined #openstack-infra | 07:45 | |
*** psachin_ has quit IRC | 07:47 | |
*** spzala has quit IRC | 07:48 | |
*** Wei_Liu1 has joined #openstack-infra | 07:48 | |
*** Wei_Liu has quit IRC | 07:49 | |
*** Wei_Liu1 is now known as Wei_Liu | 07:49 | |
*** ralonsoh has joined #openstack-infra | 07:49 | |
*** spzala has joined #openstack-infra | 07:50 | |
*** ym200 has quit IRC | 07:50 | |
*** nadya has joined #openstack-infra | 07:50 | |
*** matrohon has joined #openstack-infra | 07:51 | |
*** markus_z has joined #openstack-infra | 07:52 | |
*** spzala has quit IRC | 07:54 | |
*** psachin_ has joined #openstack-infra | 07:59 | |
*** zzzeek has quit IRC | 08:00 | |
*** zzzeek has joined #openstack-infra | 08:00 | |
*** sree_ has joined #openstack-infra | 08:01 | |
*** sree_ is now known as Guest29284 | 08:01 | |
*** spzala has joined #openstack-infra | 08:02 | |
*** ym200 has joined #openstack-infra | 08:03 | |
*** sree has quit IRC | 08:04 | |
*** martinkopec has joined #openstack-infra | 08:04 | |
openstackgerrit | Witold Bedyk proposed openstack-infra/project-config master: Use StoryBoard for python-monascaclient https://review.openstack.org/447932 | 08:05 |
*** florianf has joined #openstack-infra | 08:05 | |
*** gibi has joined #openstack-infra | 08:06 | |
*** shardy has joined #openstack-infra | 08:07 | |
*** spzala has quit IRC | 08:07 | |
*** ym200 has quit IRC | 08:08 | |
openstackgerrit | venkata anil proposed openstack-infra/devstack-gate master: Set agent modes for DVR+HA multinode job https://review.openstack.org/383827 | 08:08 |
*** matrohon has quit IRC | 08:09 | |
*** pcaruana has joined #openstack-infra | 08:11 | |
*** shu-mutou is now known as shu-mutou-AWAY-u | 08:11 | |
*** shu-mutou-AWAY-u is now known as shu-mutou-AWAY | 08:12 | |
*** ym200 has joined #openstack-infra | 08:24 | |
*** shardy has quit IRC | 08:24 | |
openstackgerrit | Merged openstack-infra/project-config master: Add releasenotes job for kuryr https://review.openstack.org/440676 | 08:26 |
yolanda | #status alert Wiki is broken with database problems, we are working to resolve it | 08:28 |
openstackstatus | yolanda: sending alert | 08:28 |
*** ym200 has quit IRC | 08:28 | |
openstackgerrit | Merged openstack-infra/project-config master: Make Zaqar Swift gate voting https://review.openstack.org/447719 | 08:28 |
*** e0ne has joined #openstack-infra | 08:30 | |
-openstackstatus- NOTICE: Wiki is broken with database problems, we are working to resolve it | 08:31 | |
*** knangia has quit IRC | 08:31 | |
*** ChanServ changes topic to "Wiki is broken with database problems, we are working to resolve it" | 08:31 | |
openstackgerrit | Thomas Herve proposed openstack-infra/project-config master: Disable swift on heat python3 gate (again) https://review.openstack.org/447947 | 08:31 |
*** matrohon has joined #openstack-infra | 08:32 | |
*** dingyichen has quit IRC | 08:33 | |
*** jpich has joined #openstack-infra | 08:34 | |
*** zhurong has joined #openstack-infra | 08:35 | |
*** matrohon has quit IRC | 08:36 | |
yolanda | #success Wiki problems have been fixed, it's up and running | 08:36 |
openstackstatus | yolanda: Added success to Success page | 08:36 |
yolanda | #status ok Wiki problems have been fixed, it's up and running | 08:37 |
openstackstatus | yolanda: sending ok | 08:37 |
*** funzo has joined #openstack-infra | 08:38 | |
*** panda|off is now known as panda|pto | 08:38 | |
*** spzala has joined #openstack-infra | 08:38 | |
AJaeger | thanks, yolanda ! | 08:38 |
*** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/" | 08:39 | |
-openstackstatus- NOTICE: Wiki problems have been fixed, it's up and running | 08:39 | |
*** dizquierdo has joined #openstack-infra | 08:40 | |
yolanda | i wonder if something had changed recently, mysql was struggling, could not start due to apparmor conflicts | 08:40 |
*** amoralej|off is now known as amoralej | 08:41 | |
*** spzala has quit IRC | 08:42 | |
openstackstatus | yolanda: finished sending ok | 08:43 |
*** funzo has quit IRC | 08:43 | |
openstackgerrit | Merged openstack-infra/project-config master: Swith Heat amqp job to Ubuntu https://review.openstack.org/446929 | 08:44 |
openstackgerrit | Merged openstack-infra/project-config master: Add repo for VM/Baremetal working group https://review.openstack.org/446703 | 08:45 |
*** hashar has joined #openstack-infra | 08:45 | |
openstackgerrit | Merged openstack-infra/project-config master: Add monitorstack project for OpenStack-Ansible https://review.openstack.org/444326 | 08:46 |
*** ym200 has joined #openstack-infra | 08:47 | |
openstackgerrit | Merged openstack-infra/project-config master: Standalone Docker Machine driver for OpenStack https://review.openstack.org/446586 | 08:48 |
openstackgerrit | Merged openstack-infra/project-config master: End Project Gating for python-k8sclient https://review.openstack.org/447635 | 08:49 |
openstackgerrit | Merged openstack-infra/project-config master: Run separate jobs for py2 and py3 d-g unittests https://review.openstack.org/447641 | 08:50 |
openstackgerrit | Merged openstack-infra/project-config master: layout/tripleo: remove panko from scenario002 https://review.openstack.org/444535 | 08:50 |
openstackgerrit | Merged openstack-infra/project-config master: layout/tripleo: run upgrade job in tripleo-common https://review.openstack.org/445610 | 08:51 |
openstackgerrit | Merged openstack-infra/project-config master: Remove Gnocchi doc publishing on docs.o.o https://review.openstack.org/447450 | 08:52 |
*** ym200 has quit IRC | 08:52 | |
openstackgerrit | Merged openstack-infra/project-config master: Fix tempest-dsvm-neutron-multinode-full job VNC console settings https://review.openstack.org/444164 | 08:54 |
*** markvoelker has joined #openstack-infra | 08:55 | |
openstackgerrit | Kevin Benton proposed openstack-infra/irc-meetings master: Adjust time of neutron meeting and neutron-drivers https://review.openstack.org/447961 | 08:59 |
*** rossella_s has joined #openstack-infra | 09:00 | |
*** markvoelker has quit IRC | 09:00 | |
*** pgadiya has quit IRC | 09:01 | |
*** openstackgerrit has quit IRC | 09:03 | |
*** pgadiya has joined #openstack-infra | 09:04 | |
*** ym200 has joined #openstack-infra | 09:11 | |
*** mhickey has joined #openstack-infra | 09:12 | |
*** dtantsur|afk is now known as dtantsur | 09:13 | |
*** ym200 has quit IRC | 09:16 | |
*** openstackgerrit has joined #openstack-infra | 09:17 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/447967 | 09:17 |
openstackgerrit | Merged openstack-infra/irc-meetings master: Adjust time of neutron meeting and neutron-drivers https://review.openstack.org/447961 | 09:18 |
jpich | AJaeger: Good morning! I'm still looking into the tripleo-ui translation job issues. I'm moderately confident the patch that merged yesterday should fix it, however it doesn't look like the post job ran afterwards, looking at http://status.openstack.org/openstack-health/#/job/tripleo-ui-upstream-translation-update ... I thought there should be a new entry there whenever a patch merges? | 09:19 |
*** nadya has quit IRC | 09:21 | |
*** spzala has joined #openstack-infra | 09:26 | |
*** matrohon has joined #openstack-infra | 09:29 | |
*** ym200 has joined #openstack-infra | 09:29 | |
*** spzala has quit IRC | 09:31 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: test containers with single-nic-vlan https://review.openstack.org/447973 | 09:32 |
*** ym200 has quit IRC | 09:33 | |
AJaeger | jpich: that looks indeed strange, let me check... | 09:34 |
jpich | AJaeger: Thanks! | 09:35 |
*** ociuhandu has joined #openstack-infra | 09:35 | |
AJaeger | jpich: hash of last commit of repo gives you this log file: http://logs.openstack.org/ad/ad6314526b80f656b4807ed0f537f3a089c9b87c/ - so let's look at http://logs.openstack.org/ad/ad6314526b80f656b4807ed0f537f3a089c9b87c/post/tripleo-ui-upstream-translation-update/7c973ec/ | 09:36 |
AJaeger | "ValueError: No JSON object could be decoded" | 09:36 |
AJaeger | but that is in our CI scripts. | 09:36 |
AJaeger | ianychoi: ^ | 09:36 |
*** derekh has joined #openstack-infra | 09:36 | |
jpich | Oh, I see | 09:37 |
*** spzala has joined #openstack-infra | 09:38 | |
*** funzo has joined #openstack-infra | 09:39 | |
*** nadya has joined #openstack-infra | 09:42 | |
*** jtomasek has joined #openstack-infra | 09:42 | |
*** spzala has quit IRC | 09:43 | |
*** funzo has quit IRC | 09:43 | |
*** flepied has quit IRC | 09:48 | |
jpich | AJaeger, ianychoi: I wonder if that error may have been transient, it seems to work fine now when I try the script locally | 09:49 |
*** ym200 has joined #openstack-infra | 09:50 | |
*** bhavik1 has quit IRC | 09:52 | |
AJaeger | jpich: run "git pull" in the repo and it will fail. I know what's broken... | 09:52 |
jpich | Oh, I hadn't refreshed that repo for a while indeed | 09:54 |
*** tosky has joined #openstack-infra | 09:54 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Fix query-zanata https://review.openstack.org/447982 | 09:54 |
AJaeger | jpich, ianychoi ^ | 09:54 |
*** ym200 has quit IRC | 09:54 | |
AJaeger | yolanda: could you review the change above to unbreak translation sync, please? ^ | 09:54 |
yolanda | sure | 09:55 |
jpich | AJaeger: I will pull and test as well, thank you for looking into this! You seem to have an empty comment line in there FWIW :) | 09:55 |
*** markvoelker has joined #openstack-infra | 09:56 | |
*** s-shiono_ has quit IRC | 09:56 | |
AJaeger | thanks, fixing | 09:57 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Fix query-zanata https://review.openstack.org/447982 | 09:58 |
AJaeger | jpich: so, health at no data since the script failed far earlier. | 09:59 |
*** gildub has quit IRC | 09:59 | |
*** markvoelker has quit IRC | 10:00 | |
*** pgadiya has quit IRC | 10:02 | |
*** zhurong has quit IRC | 10:05 | |
*** neiljerram has joined #openstack-infra | 10:06 | |
*** ym200 has joined #openstack-infra | 10:07 | |
AJaeger | yolanda: could you +2 again, please? Just fixed layout. Thanks! | 10:08 |
*** nicolasbock has joined #openstack-infra | 10:08 | |
*** liujiong_lj has joined #openstack-infra | 10:09 | |
yolanda | done | 10:09 |
AJaeger | thanks | 10:09 |
* AJaeger will self +2A change 447982 since currently pushing to zanata is completely broken | 10:09 | |
*** liujiong has quit IRC | 10:09 | |
*** Julien-zte has quit IRC | 10:10 | |
*** yanyanhu has quit IRC | 10:11 | |
AJaeger | jpich: once this is merged, it needs an hour to be acitive - so you need to get something else merged to triplo-ui afterwards to see that your fix worsk. Thanks for alerting us of the issue! | 10:12 |
*** ym200 has quit IRC | 10:12 | |
*** liujiong_lj has quit IRC | 10:12 | |
openstackgerrit | Merged openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/447967 | 10:13 |
jpich | AJaeger: And thank you for fixing it! I'll see if there's something simple I can encourage people to merge :) | 10:13 |
*** jaosorior is now known as jaosorior_brb | 10:14 | |
*** spzala has joined #openstack-infra | 10:15 | |
*** pgadiya has joined #openstack-infra | 10:16 | |
*** amotoki has quit IRC | 10:17 | |
*** spzala has quit IRC | 10:19 | |
*** Julien-zte has joined #openstack-infra | 10:22 | |
*** flepied has joined #openstack-infra | 10:23 | |
*** zhurong has joined #openstack-infra | 10:24 | |
openstackgerrit | Merged openstack-infra/project-config master: Fix query-zanata https://review.openstack.org/447982 | 10:24 |
*** gcb has quit IRC | 10:26 | |
*** ccamacho has joined #openstack-infra | 10:27 | |
*** gcb has joined #openstack-infra | 10:28 | |
*** jamielennox|away is now known as jamielennox | 10:30 | |
*** ym200 has joined #openstack-infra | 10:31 | |
*** skelso has joined #openstack-infra | 10:32 | |
*** yamahata has quit IRC | 10:32 | |
*** winggundamth has quit IRC | 10:34 | |
*** ym200 has quit IRC | 10:35 | |
*** gcb has quit IRC | 10:37 | |
*** kaisers1 has quit IRC | 10:38 | |
*** alexchadin has quit IRC | 10:39 | |
*** funzo has joined #openstack-infra | 10:39 | |
*** e0ne has quit IRC | 10:42 | |
*** jkilpatr has quit IRC | 10:44 | |
*** e0ne has joined #openstack-infra | 10:44 | |
*** funzo has quit IRC | 10:44 | |
*** shardy has joined #openstack-infra | 10:45 | |
*** gildub has joined #openstack-infra | 10:47 | |
*** wolverineav has joined #openstack-infra | 10:48 | |
*** ym200 has joined #openstack-infra | 10:49 | |
*** spzala has joined #openstack-infra | 10:51 | |
*** ym200 has quit IRC | 10:53 | |
*** wolverineav has quit IRC | 10:53 | |
*** kaisers has joined #openstack-infra | 10:53 | |
*** alexchadin has joined #openstack-infra | 10:54 | |
*** esikachev has quit IRC | 10:54 | |
*** spzala has quit IRC | 10:56 | |
*** e0ne has quit IRC | 10:56 | |
*** gcb has joined #openstack-infra | 10:56 | |
*** faizy has joined #openstack-infra | 10:56 | |
*** gcb has quit IRC | 10:57 | |
*** gcb has joined #openstack-infra | 10:57 | |
*** faizy has quit IRC | 10:59 | |
*** faizy has joined #openstack-infra | 11:00 | |
*** alexchadin has quit IRC | 11:01 | |
*** alexchadin has joined #openstack-infra | 11:01 | |
*** jkilpatr has joined #openstack-infra | 11:02 | |
*** e0ne has joined #openstack-infra | 11:03 | |
*** wolverineav has joined #openstack-infra | 11:04 | |
*** matrohon has quit IRC | 11:05 | |
*** jamielennox is now known as jamielennox|away | 11:05 | |
*** gcb has quit IRC | 11:06 | |
*** alexchadin has quit IRC | 11:06 | |
*** ym200 has joined #openstack-infra | 11:07 | |
*** wolverineav has quit IRC | 11:09 | |
*** sdague__ is now known as sdague | 11:09 | |
*** skelso has quit IRC | 11:11 | |
*** ym200 has quit IRC | 11:12 | |
*** jamielennox|away is now known as jamielennox | 11:12 | |
ianychoi | AJaeger, thanks for fixing https://review.openstack.org/#/c/447982/ -> It was because of my last patch: https://review.openstack.org/#/c/447178/ | 11:12 |
openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config master: Add neutron job with ryu master https://review.openstack.org/445262 | 11:13 |
*** Wei_Liu has quit IRC | 11:16 | |
*** wolverineav has joined #openstack-infra | 11:16 | |
*** gcb has joined #openstack-infra | 11:20 | |
*** wolverineav has quit IRC | 11:21 | |
*** faizy_ has joined #openstack-infra | 11:24 | |
*** dizquierdo has quit IRC | 11:25 | |
*** dizquierdo has joined #openstack-infra | 11:25 | |
*** faizy has quit IRC | 11:25 | |
*** ym200 has joined #openstack-infra | 11:26 | |
*** ym200 has quit IRC | 11:30 | |
*** jamespage has quit IRC | 11:31 | |
*** jamespage has joined #openstack-infra | 11:31 | |
*** gongysh has quit IRC | 11:33 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: tripleo: exclude reno jobs before Ocata https://review.openstack.org/447602 | 11:34 |
*** askb has quit IRC | 11:35 | |
*** amotoki has joined #openstack-infra | 11:36 | |
*** ldnunes has joined #openstack-infra | 11:39 | |
*** dizquierdo is now known as dizquierdo_afk | 11:40 | |
*** ym200 has joined #openstack-infra | 11:41 | |
*** ym200 has quit IRC | 11:41 | |
*** kornicameister has joined #openstack-infra | 11:42 | |
*** ym200 has joined #openstack-infra | 11:43 | |
*** Julien-zte has quit IRC | 11:44 | |
AJaeger | ianychoi: yeah, figured that one out | 11:45 |
openstackgerrit | Attila Darazs proposed openstack-infra/project-config master: Add tripleo-quickstart* repos to the tripleo group https://review.openstack.org/448024 | 11:47 |
*** faizy_ has quit IRC | 11:48 | |
*** rfolco has joined #openstack-infra | 11:49 | |
*** lucasagomes is now known as lucas-brb | 11:50 | |
*** yolanda has quit IRC | 11:52 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create zuul_workspace_root job variable https://review.openstack.org/441441 | 11:53 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Organize playbooks folder https://review.openstack.org/441547 | 11:53 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add net-info to bootstrap role https://review.openstack.org/441617 | 11:53 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add revoke-sudo role and update tox jobs https://review.openstack.org/441467 | 11:53 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create tox-tarball job https://review.openstack.org/441609 | 11:53 |
*** yolanda has joined #openstack-infra | 11:54 | |
*** pgadiya has quit IRC | 11:57 | |
*** aysyd has joined #openstack-infra | 11:57 | |
*** vsaienko has joined #openstack-infra | 11:57 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add ansible-lint to tox (pep8) https://review.openstack.org/438276 | 11:58 |
*** dizquierdo_afk is now known as dizquierdo | 11:59 | |
*** stevejims has joined #openstack-infra | 11:59 | |
openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Add dracut-regenerate elements https://review.openstack.org/447047 | 12:01 |
pabelanger | AJaeger: So, if you have some time: 447089 might be good for you to review | 12:01 |
pabelanger | AJaeger: since you just spend time removing all the tox-db jobs :D | 12:01 |
*** skelso has joined #openstack-infra | 12:01 | |
stevejims | hi, anyone able to answer a question about launchpad -> storyboard migration? | 12:01 |
*** radez` is now known as radez | 12:01 | |
AJaeger | pabelanger: why add them back again? | 12:01 |
pabelanger | AJaeger: hopefully the review will make sense, but created a base playbook to setup the database in ansible | 12:02 |
*** alexchadin has joined #openstack-infra | 12:03 | |
pabelanger | AJaeger: it something I think we'll bikeshed today | 12:03 |
AJaeger | pabelanger: WE don't need that IMHO. | 12:03 |
*** tuanluong has quit IRC | 12:03 | |
AJaeger | we have extra-test-setup macro for this in project-config and I suggest to support that logic instead. | 12:04 |
*** ym200 has quit IRC | 12:05 | |
*** ym200 has joined #openstack-infra | 12:06 | |
pabelanger | right, there is going to be a few way to do this in zuulv3 | 12:08 |
*** pgadiya has joined #openstack-infra | 12:08 | |
pabelanger | the first question, do we as openstack-infra want to support a playbook to setup database things for jobs | 12:09 |
pabelanger | because, it would be possible for a project to have there own .zuul.yaml with creates a tox-db-py27 job as I just did^ | 12:09 |
pabelanger | this moves the tools/test.sh script to a playbook too | 12:10 |
*** rossella_s has quit IRC | 12:11 | |
AJaeger | yes, that's all possible. Part of the move away from db jobs was that we document to developer how to setup their own systems. A playbook would do that as well but would mean another language to learn. A shell script is far simpler here... | 12:11 |
pabelanger | yes, but in zuulv3, we'll expect jobs to also write playbooks in ansible | 12:12 |
pabelanger | let me do this | 12:12 |
AJaeger | Let's discuss another time... | 12:12 |
*** rossella_s has joined #openstack-infra | 12:12 | |
pabelanger | I'll port the extra-test-setup logic into ansible now | 12:12 |
pabelanger | and we can discuss | 12:12 |
AJaeger | thanks. That'S something we should do anyhow. | 12:12 |
AJaeger | ok, until later... | 12:12 |
openstackgerrit | Merged openstack-infra/shade master: add separate releasenotes build https://review.openstack.org/446658 | 12:14 |
*** rhallisey has joined #openstack-infra | 12:19 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Switch trunk/cbs/buildlogs to use https https://review.openstack.org/448041 | 12:20 |
*** gcb has quit IRC | 12:20 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create extra-test-setup role https://review.openstack.org/448042 | 12:20 |
*** gcb has joined #openstack-infra | 12:21 | |
pabelanger | AJaeger: ^JJB way for ansible | 12:23 |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: Switch trunk/cbs/buildlogs to use https https://review.openstack.org/448047 | 12:24 |
openstackgerrit | Merged openstack-infra/shade master: Convert test_identity_roles to requests mock https://review.openstack.org/445673 | 12:26 |
*** EricGonczer_ has joined #openstack-infra | 12:27 | |
*** Guest29284 has quit IRC | 12:27 | |
*** sree has joined #openstack-infra | 12:28 | |
*** sree_ has joined #openstack-infra | 12:30 | |
*** gildub has quit IRC | 12:30 | |
*** sree_ is now known as Guest76978 | 12:30 | |
*** Guest76978 has quit IRC | 12:31 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Fix test_node_assignment_at_quota https://review.openstack.org/447630 | 12:32 |
*** sree has quit IRC | 12:32 | |
*** sree has joined #openstack-infra | 12:32 | |
*** pradk has joined #openstack-infra | 12:32 | |
*** dave-mccowan has joined #openstack-infra | 12:36 | |
*** sree has quit IRC | 12:37 | |
*** kgiusti has joined #openstack-infra | 12:37 | |
*** ym200 has quit IRC | 12:38 | |
*** rlandy has joined #openstack-infra | 12:38 | |
*** jaosorior_brb is now known as jaosorior | 12:38 | |
*** ym200 has joined #openstack-infra | 12:39 | |
*** zhurong has quit IRC | 12:39 | |
markus_z | frickler: AJaeger: yolanda: The VNC issue isn't fully resolved: https://bugs.launchpad.net/nova/+bug/1669468 | 12:41 |
openstack | Launchpad bug 1669468 in OpenStack Compute (nova) "tempest.api.compute.servers.test_novnc.NoVNCConsoleTestJSON.test_novnc fails intermittently in neutron multinode nv job" [Medium,In progress] - Assigned to Markus Zoeller (markus_z) (mzoeller) | 12:41 |
*** funzo has joined #openstack-infra | 12:41 | |
markus_z | The values are correct, but the order of localrc variables isn't correct. I added it as comment to the bug report. | 12:42 |
AJaeger | markus_z: best discuss with sdague | 12:42 |
markus_z | I'm clueless how to influence the order of localrc variables. | 12:42 |
*** matrohon has joined #openstack-infra | 12:42 | |
frickler | markus_z: hmm, I read something about neutron also needing to set local.conf stuff late, let me dig a bit | 12:42 |
sdague | markus_z: what's going on? | 12:43 |
markus_z | sdague: This change https://review.openstack.org/#/c/444164/6 tried to solve intermittent VNC issues in multinode jobs. | 12:43 |
markus_z | Somehow the localrc gets build with "VNCSERVER_PROXYCLIENT_ADDRESS=$HOST_IP" first, and then "HOST_IP=158.69.78.119". which doesn't work. | 12:44 |
*** gordc has joined #openstack-infra | 12:45 | |
markus_z | "doesn't work" means is sets an empty value. The bug report contains more info. | 12:45 |
*** trown|outtypewww is now known as trown | 12:45 | |
markus_z | http://logs.openstack.org/76/400876/31/check/gate-tempest-dsvm-neutron-multinode-full-ubuntu-xenial-nv/63d2bdd/logs/subnode-2/local.conf.txt.gz | 12:46 |
*** funzo has quit IRC | 12:46 | |
sdague | markus_z: it's only the subnode that has this issue, right? | 12:46 |
markus_z | sdague: yes, the controller node sets it up correctly. | 12:47 |
*** EricGonczer_ has quit IRC | 12:47 | |
sdague | markus_z: it's because of this line https://github.com/openstack-infra/devstack-gate/blob/ed2ed82338286f96cf7c017de30634757ea2d185/devstack-vm-gate.sh#L204 | 12:48 |
*** markvoelker has joined #openstack-infra | 12:48 | |
*** EricGonczer_ has joined #openstack-infra | 12:48 | |
*** dprince has joined #openstack-infra | 12:48 | |
markus_z | sdague: Ah, it appends it always at the end? | 12:49 |
*** dave-mccowan has quit IRC | 12:49 | |
*** rhallisey has quit IRC | 12:49 | |
*** Julien-zte has joined #openstack-infra | 12:50 | |
sdague | markus_z: yes | 12:51 |
*** rhallisey has joined #openstack-infra | 12:51 | |
frickler | sdague: so if we would add a dummy line earlier, would it replace that instead of adding at the end? | 12:51 |
sdague | no | 12:52 |
sdague | the local section opperates in append only mode because it's really executable shell | 12:52 |
sdague | let me try something... | 12:52 |
markus_z | sdague: sure? I think it does: https://github.com/openstack-dev/devstack/blob/dec121114c3ea6f9e515a452700e5015d1e34704/inc/ini-config#L436 | 12:52 |
markus_z | It does an inline "sed": https://github.com/openstack-dev/devstack/blob/dec121114c3ea6f9e515a452700e5015d1e34704/inc/ini-config#L338 | 12:53 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Add libffi development headers to bindep https://review.openstack.org/448076 | 12:53 |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Fix test_node_assignment_at_quota https://review.openstack.org/447630 | 12:55 |
*** mriedem has joined #openstack-infra | 12:56 | |
*** kencjohnston_ has quit IRC | 12:56 | |
*** cshastri has quit IRC | 12:56 | |
openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate master: Set HOST_IP for subnode first https://review.openstack.org/448078 | 12:57 |
*** markmcd has quit IRC | 12:57 | |
sdague | markus_z: we aren't using that | 12:57 |
*** shardy has quit IRC | 12:57 | |
*** dave-mccowan has joined #openstack-infra | 12:57 | |
sdague | markus_z: https://github.com/openstack-infra/devstack-gate/blob/873e8e5ea0b1b0a1f1544586c08741dee0f672d0/devstack-vm-gate.sh#L40-L44 | 12:57 |
openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci master: Do not merge: Test python-heat-agents package build https://review.openstack.org/439178 | 12:58 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Testing novajoin authtoken https://review.openstack.org/446348 | 12:58 |
*** markmcd has joined #openstack-infra | 12:58 | |
*** jcoufal has joined #openstack-infra | 12:58 | |
markus_z | sdague: Ah, didn't know that, thanks. | 12:59 |
fungi | yolanda: what did you end up doing to clear the issue with the wiki? | 13:00 |
fungi | yolanda: as for package upgrades, the following got upgraded today on that server at 06:36 utc: libc-bin libc-bin libc-bin libc-dev-bin libc6 libc6-dev libfreetype6 libgnutls-openssl27 libgnutls26 man-db multiarch-support | 13:01 |
fungi | er, i guess i got a couple repeats in there | 13:01 |
*** gouthamr has joined #openstack-infra | 13:02 | |
*** gongysh has joined #openstack-infra | 13:02 | |
*** ym200 has quit IRC | 13:03 | |
fungi | yolanda: you said something about mysql being a problem an not starting, but we don't use a local mysql for that service (it's all in a trove db) | 13:03 |
*** shardy has joined #openstack-infra | 13:03 | |
*** rosmaita_ is now known as rosmaita | 13:04 | |
*** ym200 has joined #openstack-infra | 13:04 | |
*** kornicameister has quit IRC | 13:04 | |
*** eharney has joined #openstack-infra | 13:05 | |
yolanda | fungi, oh... so thee was a mysql service running there, but when i restarted it didn't come back. So i fixed and it came up cleanly, that's why i thought it was the failure. But i also did a restart of apache, so maybe that was the real failure... | 13:05 |
*** kornicameister has joined #openstack-infra | 13:05 | |
fungi | agreed, apache seems far more likely to have been the culprit | 13:05 |
*** baoli has joined #openstack-infra | 13:06 | |
*** baoli has quit IRC | 13:06 | |
*** markmcd has quit IRC | 13:06 | |
fungi | well, anyway, thanks for getting things going again | 13:06 |
*** Goneri has joined #openstack-infra | 13:06 | |
*** gongysh has quit IRC | 13:07 | |
sdague | markus_z: ok, can you see if that https://review.openstack.org/448078 fixes things? | 13:07 |
*** baoli has joined #openstack-infra | 13:08 | |
frickler | sdague: can one have a nova patch depend on your change to test it or will it need to be merged first? | 13:08 |
markus_z | sdague: I have to wait until its multinode job is executed, right? Or is there another way to test it? | 13:08 |
yolanda | fungi yes, looks like, although apache error logs did not show any problem | 13:08 |
*** baoli has quit IRC | 13:09 | |
sdague | markus_z: yeh, probably just wait and keep an eye on it | 13:09 |
*** baoli has joined #openstack-infra | 13:09 | |
markus_z | sdague: yep, will do that. | 13:09 |
*** eroux has joined #openstack-infra | 13:10 | |
*** ym200 has quit IRC | 13:10 | |
*** mdrabe has joined #openstack-infra | 13:11 | |
*** EricGonczer_ has quit IRC | 13:11 | |
*** markmcd has joined #openstack-infra | 13:11 | |
*** mat128 has joined #openstack-infra | 13:11 | |
*** alexchadin has quit IRC | 13:11 | |
*** ym200 has joined #openstack-infra | 13:12 | |
*** gongysh has joined #openstack-infra | 13:12 | |
*** funzo has joined #openstack-infra | 13:13 | |
*** lucas-brb is now known as lucasagomes | 13:14 | |
*** gongysh has quit IRC | 13:15 | |
*** ym200 has quit IRC | 13:16 | |
*** ym200 has joined #openstack-infra | 13:17 | |
*** eroux has quit IRC | 13:19 | |
*** ramishra has quit IRC | 13:19 | |
*** rhallisey has quit IRC | 13:20 | |
*** anilvenkata has quit IRC | 13:20 | |
*** dtantsur is now known as dtantsur|bbl | 13:20 | |
*** amoralej is now known as amoralej|lunch | 13:20 | |
*** rhallisey has joined #openstack-infra | 13:21 | |
*** wolverineav has joined #openstack-infra | 13:23 | |
*** links has quit IRC | 13:24 | |
*** jamesdenton has joined #openstack-infra | 13:25 | |
*** prateek has quit IRC | 13:25 | |
*** ihrachys has joined #openstack-infra | 13:26 | |
*** wolverin_ has joined #openstack-infra | 13:26 | |
*** wolverineav has quit IRC | 13:28 | |
*** jtomasek has quit IRC | 13:29 | |
*** pgadiya has quit IRC | 13:30 | |
*** faizy_ has joined #openstack-infra | 13:31 | |
*** sekelso has joined #openstack-infra | 13:33 | |
*** faizy__ has joined #openstack-infra | 13:33 | |
*** skelso has quit IRC | 13:35 | |
*** mdrabe has quit IRC | 13:36 | |
*** faizy_ has quit IRC | 13:36 | |
*** mdrabe has joined #openstack-infra | 13:37 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: DONT REVIEW: test consistent repo https://review.openstack.org/447522 | 13:38 |
*** sekelso has quit IRC | 13:38 | |
openstackgerrit | Mikhail S Medvedev proposed openstack/diskimage-builder master: [DNM] Test boot partition code https://review.openstack.org/448099 | 13:39 |
openstackgerrit | Monty Taylor proposed openstack/os-client-config master: Add designateclient to constructors list https://review.openstack.org/448100 | 13:39 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: DONT REVIEW: test consistent repo https://review.openstack.org/447522 | 13:39 |
*** adrian_otto has joined #openstack-infra | 13:40 | |
*** eroux has joined #openstack-infra | 13:42 | |
*** ym200 has quit IRC | 13:42 | |
*** jtomasek has joined #openstack-infra | 13:43 | |
*** ym200 has joined #openstack-infra | 13:43 | |
*** rwsu has quit IRC | 13:45 | |
*** ym200 has quit IRC | 13:47 | |
*** ym200 has joined #openstack-infra | 13:48 | |
*** dizquierdo has quit IRC | 13:49 | |
openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci master: Replace "ara generate" by "ara generate html" https://review.openstack.org/448108 | 13:51 |
*** faizy__ has quit IRC | 13:51 | |
*** tonytan4ever has joined #openstack-infra | 13:51 | |
*** amoralej|lunch is now known as amoralej | 13:53 | |
*** mat128 has quit IRC | 13:55 | |
*** spzala has joined #openstack-infra | 13:55 | |
*** tosky has quit IRC | 13:55 | |
openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Add libffi development headers to bindep https://review.openstack.org/448076 | 13:56 |
*** bh526r has joined #openstack-infra | 13:57 | |
*** adrian_otto has quit IRC | 13:58 | |
*** kornicameister has quit IRC | 13:58 | |
*** ZZelle_ has left #openstack-infra | 13:59 | |
*** mtanino has joined #openstack-infra | 13:59 | |
*** ZZelle has joined #openstack-infra | 13:59 | |
*** ZZelle is now known as Guest93672 | 14:00 | |
*** tosky has joined #openstack-infra | 14:01 | |
*** Guest93672 is now known as ZZelle__ | 14:01 | |
openstackgerrit | Merged openstack-infra/project-config master: Enable Images v1 API for glanceclient tests https://review.openstack.org/446627 | 14:01 |
*** tphummel has joined #openstack-infra | 14:04 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Get rid of magnumclient dependency https://review.openstack.org/447578 | 14:04 |
*** ZZelle__ is now known as ZZelle_ | 14:04 | |
*** rbrndt has joined #openstack-infra | 14:07 | |
*** xarses has quit IRC | 14:08 | |
*** saibarspeis has quit IRC | 14:12 | |
openstackgerrit | Roman Podoliaka proposed openstack-infra/project-config master: placement-osc-plugin: an OSC plugin for Placement service https://review.openstack.org/448115 | 14:14 |
frickler | sdague: markus_z: http://logs.openstack.org/78/448078/1/check/gate-tempest-dsvm-neutron-multinode-full-ubuntu-xenial-nv/3e60914/logs/subnode-2/local.conf.txt.gz lgtm | 14:17 |
*** chlong has joined #openstack-infra | 14:18 | |
*** knangia has joined #openstack-infra | 14:19 | |
*** zz_dimtruck is now known as dimtruck | 14:20 | |
*** jkilpatr has quit IRC | 14:21 | |
*** burgerk has joined #openstack-infra | 14:22 | |
*** sekelso has joined #openstack-infra | 14:22 | |
*** nadya has quit IRC | 14:24 | |
*** chlong has quit IRC | 14:24 | |
*** EricGonczer_ has joined #openstack-infra | 14:24 | |
sc` | AJaeger: thanks for -wf that patch. i was in the midst of my morning tea | 14:29 |
*** sekelso has quit IRC | 14:29 | |
AJaeger | ;) | 14:31 |
*** alexchadin has joined #openstack-infra | 14:31 | |
*** admcleod has joined #openstack-infra | 14:33 | |
*** hashar has quit IRC | 14:33 | |
*** eharney has quit IRC | 14:33 | |
*** fguillot has joined #openstack-infra | 14:34 | |
*** jkilpatr has joined #openstack-infra | 14:34 | |
*** eranrom has quit IRC | 14:35 | |
*** hashar has joined #openstack-infra | 14:35 | |
*** vikrant has quit IRC | 14:36 | |
*** eranrom has joined #openstack-infra | 14:36 | |
markus_z | frickler: yep, that's it +1 | 14:37 |
*** diltram has quit IRC | 14:37 | |
*** e0ne has quit IRC | 14:37 | |
*** pblaho has quit IRC | 14:39 | |
ym200 | i am at X version of mitaka release how can i go to X + 1 | 14:39 |
ym200 | can someone suggest | 14:39 |
breton | ttx: could you please confirm that a mail to openstack-dev-owner@ with subject "Issues with sending" was received? | 14:40 |
ym200 | say i am at 13.X.X | 14:40 |
ym200 | & if i wanna go to 13.y.y | 14:40 |
*** eranrom has quit IRC | 14:41 | |
*** eranrom has joined #openstack-infra | 14:41 | |
sc` | frickler: AJaeger: i had node-release in there before submitting the change to gerrit, but tox kept failing due to ignorance. does node still need to exist in that case? | 14:41 |
*** esikachev has joined #openstack-infra | 14:41 | |
*** mat128 has joined #openstack-infra | 14:42 | |
*** beslemon has joined #openstack-infra | 14:43 | |
*** marst has quit IRC | 14:43 | |
*** marst has joined #openstack-infra | 14:43 | |
sc` | i've been reading every bit of yaml and code i could find to better understand things. i've only been working with this part of things for a few weeks, so there are deficiencies in understanding | 14:44 |
*** ociuhandu has quit IRC | 14:44 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: test new ovb with images building https://review.openstack.org/445228 | 14:45 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: New ovb playbook and settings https://review.openstack.org/431567 | 14:45 |
*** eharney has joined #openstack-infra | 14:47 | |
*** andreas_s has quit IRC | 14:47 | |
*** marst has quit IRC | 14:48 | |
*** e0ne has joined #openstack-infra | 14:48 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Bring back postci log https://review.openstack.org/448135 | 14:49 |
*** david-lyle has joined #openstack-infra | 14:49 | |
*** esikache1 has joined #openstack-infra | 14:49 | |
*** mdrabe has quit IRC | 14:50 | |
*** hongbin has joined #openstack-infra | 14:50 | |
AJaeger | sc`: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/projects.yaml#n3703 - check for example '{pipeline}-tempest-dsvm-multinode-full-{node-release}{suffix}': | 14:51 |
AJaeger | and see how it's defined in devstack-gate.yaml as well | 14:52 |
ttx | breton: hmm, no | 14:52 |
breton | ttx: :( | 14:52 |
*** esikachev has quit IRC | 14:52 | |
breton | ttx: i will send it to knelson at openstack.org and thierry at openstack.org then | 14:53 |
AJaeger | ym200: better ask on #openstack channel. This channel is for infrastructure for CI and development. | 14:53 |
*** psachin_ has quit IRC | 14:53 | |
*** marst has joined #openstack-infra | 14:54 | |
*** faizy has joined #openstack-infra | 14:57 | |
*** armax has quit IRC | 14:57 | |
*** mdrabe has joined #openstack-infra | 14:58 | |
*** numans has joined #openstack-infra | 14:58 | |
*** xarses has joined #openstack-infra | 14:59 | |
sc` | AJaeger: thanks for the pointers. one of these days, it might actually work | 15:00 |
AJaeger | and thanks to frickler for noticing that it was wrong | 15:01 |
*** dave-mccowan has quit IRC | 15:02 | |
sc` | indeed :D | 15:02 |
*** esikache1 has quit IRC | 15:02 | |
fungi | ym200: i think you found the wrong channel. this is where we maintain the community infrastructure (mailing lists, continuous integration, wiki, et cetera) | 15:03 |
*** vsaienko has quit IRC | 15:03 | |
fungi | ym200: you might want to try asking general openstack-software-related questions in #openstack instead | 15:03 |
*** vsaienko has joined #openstack-infra | 15:07 | |
*** ym200 has quit IRC | 15:09 | |
*** david-lyle has quit IRC | 15:09 | |
*** ociuhandu has joined #openstack-infra | 15:10 | |
*** xarses_ has joined #openstack-infra | 15:10 | |
*** faizy has quit IRC | 15:10 | |
*** faizy has joined #openstack-infra | 15:11 | |
*** ym200 has joined #openstack-infra | 15:11 | |
*** claudiub|2 has joined #openstack-infra | 15:13 | |
*** dtantsur|bbl is now known as dtantsur | 15:14 | |
*** pblaho has joined #openstack-infra | 15:14 | |
*** claudiub has quit IRC | 15:14 | |
*** faizy_ has joined #openstack-infra | 15:14 | |
*** david-lyle has joined #openstack-infra | 15:15 | |
clarkb | is lists unhappy? (just noticing I haven't had a -dev email in about 10 hours) | 15:16 |
clarkb | and we did poke at it yesterday | 15:16 |
clarkb | jeblair: fungi ^ | 15:16 |
*** baoli has quit IRC | 15:17 | |
*** sekelso has joined #openstack-infra | 15:17 | |
*** faizy__ has joined #openstack-infra | 15:17 | |
fungi | clarkb: i was thinking volume was lowish this morning | 15:17 |
fungi | i wonder if unattended upgrades kicked in and "restarted" services without us having reenabled them | 15:17 |
AJaeger | latest email "Tue Mar 21 06:13:49 UTC 2017" | 15:18 |
fungi | that looks like the right timeframe | 15:18 |
*** faizy has quit IRC | 15:18 | |
*** xarses_ has quit IRC | 15:18 | |
fungi | exim is listening on 25/tcp | 15:18 |
AJaeger | clarkb: send a test mail ? | 15:19 |
*** xarses_ has joined #openstack-infra | 15:19 | |
*** xarses_ has quit IRC | 15:19 | |
numans | Hi Infra team, I have been trying to fix a CI failure for networking-ovn. I am not able to reproduce it locally. Is it possible for me to get access to the VM in the infra where the issue is seen - https://review.openstack.org/#/c/447756/ | 15:19 |
*** martinkopec has quit IRC | 15:19 | |
*** xarses_ has joined #openstack-infra | 15:19 | |
fungi | oldest message in the deferral queue is 10 hours | 15:19 |
clarkb | numans: have you tried running http://logs.openstack.org/56/447756/2/check/gate-tempest-dsvm-networking-ovn-ovs-master/a10e1f8/logs/reproduce.sh ? | 15:20 |
jeblair | clarkb: looking | 15:20 |
clarkb | AJaeger: ya though I expect many others have already sent email through my early morning because seems like -dev never stops | 15:20 |
jeblair | mailman isn't running | 15:20 |
*** faizy_ has quit IRC | 15:20 | |
*** faizy__ has quit IRC | 15:21 | |
fungi | that'd do it | 15:21 |
numans | clarkb, no. I havent tried it. thanks for pointing me out | 15:21 |
clarkb | numans: the comment at the beginning of the file should tell you what is required to get that going | 15:21 |
openstackgerrit | Roman Podoliaka proposed openstack-infra/project-config master: placement-osc-plugin: an OSC plugin for Placement service https://review.openstack.org/448115 | 15:21 |
*** faizy__ has joined #openstack-infra | 15:21 | |
numans | clarkb, on to it. thanks. | 15:21 |
clarkb | jeblair: fungi we haev our snapshot now so we can probably return the cron and service enablement at this point (enabling puppet may do it automatically for us) | 15:21 |
*** florianf has quit IRC | 15:22 | |
fungi | jeblair: dpkg.log indicates unattended upgrades upgraded mailman at 2017-03-21 06:44:29 utc | 15:22 |
jeblair | what luck. :) | 15:22 |
*** dave-mccowan has joined #openstack-infra | 15:22 | |
fungi | indeed :/ | 15:22 |
jeblair | it's started, i'm finishing cleanup | 15:23 |
fungi | thanks! | 15:23 |
AJaeger | numans: that failure looks unrelated to your changes. I know that eventlet was updated today to 0.20.1 and it caused problems elsewhere. Double check eventlet versions in gate and your local setup. | 15:23 |
fungi | 2017-03-21 06:44:29 upgrade mailman 1:2.1.14-3ubuntu0.2 1:2.1.14-3ubuntu0.4 | 15:23 |
*** shardy is now known as coding_shardy | 15:23 | |
*** faizy__ has quit IRC | 15:24 | |
numans | AJaeger, ack. I will do that. thanks | 15:24 |
jeblair | clarkb, fungi: bup cron, exim/mailman init scripts, and puppet emergency file all restored | 15:24 |
clarkb | and I got a bunch of -dev mail so that looks happy | 15:24 |
*** faizy__ has joined #openstack-infra | 15:24 | |
mordred | \o/ | 15:24 |
jeblair | exim -bpc | 15:24 |
jeblair | 5175 | 15:24 |
jeblair | if you want to watch the queue numbers, btw. | 15:24 |
*** vsaienko has quit IRC | 15:25 | |
* fungi shakes fist at ubuntu package maintainers for not updating /usr/share/doc/mailman/changelog.Debian.gz on latest patch update | 15:25 | |
*** vsaienko has joined #openstack-infra | 15:25 | |
fungi | though it shows at http://changelogs.ubuntu.com/changelogs/pool/main/m/mailman/mailman_2.1.14-3ubuntu0.4/changelog | 15:26 |
*** faizy__ has quit IRC | 15:26 | |
clarkb | one thing I checked was that http://lists.openstack.org was up and happy and it was. Guessing that that doesn't actually require daemon to serve content just update content? | 15:27 |
*** faizy__ has joined #openstack-infra | 15:27 | |
*** florianf has joined #openstack-infra | 15:27 | |
jeblair | yeah, it's all cgi (or equivalent) i think | 15:27 |
fungi | yeep | 15:27 |
sdague | clarkb / fungi / jeblair - https://review.openstack.org/#/c/448078/ - should fix an issue for subnode set | 15:28 |
sdague | devstack-gate change | 15:28 |
fungi | anyway, nice to see ubuntu still applying security fixes to the version of mailman in precise, even if it took us by surprise | 15:28 |
clarkb | fungi: maybe our conversation about it yesterday made them go "wow people still use that? OK lets fix it" | 15:29 |
clarkb | :) | 15:29 |
*** matrohon has quit IRC | 15:29 | |
*** esikache1 has joined #openstack-infra | 15:29 | |
*** faizy__ has quit IRC | 15:29 | |
*** faizy__ has joined #openstack-infra | 15:30 | |
openstackgerrit | Roman Podoliaka proposed openstack-infra/project-config master: placement-osc-plugin: an OSC plugin for Placement service https://review.openstack.org/448115 | 15:32 |
fungi | sdague: looks like frickler left an inline question | 15:32 |
*** jrist has quit IRC | 15:33 | |
*** hieulq_ has joined #openstack-infra | 15:33 | |
clarkb | I +2'd but didn't approve in case my responset o frickler was incorrect | 15:33 |
clarkb | sdague: ^ so maybe take a look and self approve if happy with it ? | 15:34 |
sdague | clarkb: no, I think it's correct | 15:35 |
sdague | my response was similar | 15:35 |
sdague | once the f25 job fails and times out, it will get to the gate, that's the only thing holding it back | 15:35 |
clarkb | I briefly looked at that last week and it appears that libvirt just doesn't work? | 15:36 |
clarkb | lots of things crash hard there | 15:36 |
sdague | so, the f25 job is basically always going to a full timeout | 15:36 |
*** andreww has joined #openstack-infra | 15:36 | |
sdague | that feels like we should move it to experimental to keep it from slowing things down | 15:36 |
openstackgerrit | Thomas Goirand proposed openstack-infra/system-config master: Do not install from puppetlab for deb https://review.openstack.org/445813 | 15:36 |
clarkb | ya thats probably a decent way to balance wanting to get f25 working and everything else while it doesn't | 15:37 |
sdague | any idea if anyone is looking at it? | 15:37 |
clarkb | then switch it if/when it is useable | 15:37 |
clarkb | sdague: typically ianw has been on that | 15:37 |
clarkb | but EmilienM more recently too I think | 15:37 |
clarkb | (not sure if either is actively addressing the current fails though) | 15:37 |
fungi | moving nonvoting jobs to experimental when they're 100% failures seems like the right move to me | 15:37 |
fungi | easy to repro | 15:37 |
fungi | no need to waste resources and, more importantly, turn-around time on results for the other jobs | 15:38 |
EmilienM | clarkb: what's up? | 15:38 |
jeblair | sdague, clarkb: belated +2, thanks for the answers :) | 15:38 |
*** adrian_otto has joined #openstack-infra | 15:39 | |
clarkb | EmilienM: fedora 25 + devstack + tempest is not working | 15:39 |
*** xarses has quit IRC | 15:39 | |
clarkb | EmilienM: it sets up a cloud but once tempest starts running many things fail and break then eventually the job times out | 15:39 |
jeblair | clarkb, fungi: queue is trending down now fram a high of 19 or 20k or so. at 16.6k. | 15:39 |
*** annegentle has joined #openstack-infra | 15:39 | |
EmilienM | clarkb: what version of qemy? | 15:39 |
clarkb | EmilienM: whatever comes with f25 | 15:39 |
EmilienM | qemu* | 15:40 |
*** jrist has joined #openstack-infra | 15:40 | |
clarkb | EmilienM: I haven't actually debugged it much beyond "yup its broken" and not something silly easy to fix | 15:40 |
EmilienM | clarkb: I haven't followed devstack jobs recently | 15:40 |
openstackgerrit | Stephen Finucane proposed openstack-dev/cookiecutter master: Remove MANIFEST.in https://review.openstack.org/448163 | 15:40 |
openstackgerrit | Stephen Finucane proposed openstack-dev/cookiecutter master: Remove 'build_releasenotes' https://review.openstack.org/448164 | 15:40 |
openstackgerrit | Stephen Finucane proposed openstack-dev/cookiecutter master: Bump pbr to 2.0, Sphinx to 1.5 https://review.openstack.org/448165 | 15:40 |
EmilienM | it sounds like fedora jobs don't get much love | 15:40 |
openstackgerrit | Stephen Finucane proposed openstack-dev/cookiecutter master: Use Sphinx 1.5 warning-is-error https://review.openstack.org/448166 | 15:40 |
openstackgerrit | Sean Dague proposed openstack-infra/project-config master: move fedora 25 to experimental on d-g and devstack https://review.openstack.org/448167 | 15:40 |
sdague | clarkb / jeblair https://review.openstack.org/448167 - that does the move | 15:41 |
jeblair | pabelanger: fyi ^ | 15:41 |
EmilienM | I don't think we should keep fedora jobs | 15:42 |
EmilienM | and rather keep gate-tempest-dsvm-neutron-full-centos-7-nv | 15:42 |
EmilienM | centos7 is much more reliable | 15:42 |
pabelanger | jeblair: no objection | 15:42 |
Shrews | clarkb: i believe i have satisified your requirements for the test in https://review.openstack.org/447630 | 15:43 |
sdague | pabelanger: if someone wants to fix it, it's cool to bring it back to the check queue, but it seems to be quite hard on the failure side | 15:43 |
clarkb | Shrews: cool will take a look | 15:43 |
ttx | breton: now I received both :) | 15:44 |
pabelanger | sdague: seems reasonable | 15:44 |
openstackgerrit | Ramy Asselin proposed openstack-infra/system-config master: Jeepyb also needs the committer e-mail in gerrit https://review.openstack.org/448168 | 15:44 |
*** yamahata has joined #openstack-infra | 15:45 | |
*** sekelso has quit IRC | 15:45 | |
openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Add dracut-regenerate elements https://review.openstack.org/447047 | 15:46 |
*** sekelso has joined #openstack-infra | 15:46 | |
*** annegentle has quit IRC | 15:46 | |
*** annegentle has joined #openstack-infra | 15:47 | |
fungi | ttx: a mishap related to our server upgrade testing for the listserv resulted in it queuing up inbound messages for 10-11 hours | 15:47 |
fungi | breton: ^ sorry about that!~ | 15:48 |
openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Add dracut-regenerate elements https://review.openstack.org/447047 | 15:49 |
*** armax has joined #openstack-infra | 15:49 | |
*** rkukura has quit IRC | 15:50 | |
*** xarses_ has quit IRC | 15:50 | |
* clarkb is going to pop out now for breakfast and other morning things. Back in a bit. | 15:51 | |
openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Fix test_node_assignment_at_quota https://review.openstack.org/447630 | 15:51 |
*** adrian_otto has quit IRC | 15:52 | |
clarkb | sdague: oh before I go, thoughts on https://review.openstack.org/#/c/447119/ ? it seems to have some affect on total memory used according to dstat but I think I need more run numbers to say that with confidence | 15:52 |
*** vsaienko has quit IRC | 15:52 | |
clarkb | sdague: thats the enable KSM in our test hypervisors change | 15:52 |
*** hamzy has quit IRC | 15:53 | |
sdague | ok | 15:53 |
sdague | where are all the mem tracker patches atm? | 15:53 |
*** vsaienko has joined #openstack-infra | 15:54 | |
*** david-lyle has quit IRC | 15:54 | |
clarkb | I'm not sure about mem tracker. Have relied on dstat more since for ksm at least I think it gives a better vuew (rss isnt affected by ksm aiui) | 15:56 |
*** dizquierdo has joined #openstack-infra | 15:56 | |
openstackgerrit | Gage Hugo proposed openstack-dev/pbr master: Add Changelog build handling for invalid chars https://review.openstack.org/439897 | 15:56 |
*** bhavik1 has joined #openstack-infra | 15:56 | |
*** david-lyle has joined #openstack-infra | 16:01 | |
sdague | yeh, that's fine, just the memtracker was going to answer the mlock question | 16:01 |
*** adrian_otto has joined #openstack-infra | 16:01 | |
openstackgerrit | Merged openstack-infra/project-config master: move fedora 25 to experimental on d-g and devstack https://review.openstack.org/448167 | 16:01 |
sdague | and while it's fine to nibble around the edges here, until someone gets into the python process weight issue... there isn't a whole lot of progress to be made | 16:01 |
*** xarses has joined #openstack-infra | 16:03 | |
*** xarses has quit IRC | 16:03 | |
*** xarses has joined #openstack-infra | 16:04 | |
fungi | if anything, slimming kernel memory overhead and mysql may just be postponing the pain needed for various teams to actually dig deeper on improving openstack service footprints | 16:04 |
*** xarses has quit IRC | 16:04 | |
*** xarses has joined #openstack-infra | 16:05 | |
bkero | Are you suggesting our software may be heavy? | 16:05 |
fungi | especially given it's still early in teh cycle, and a bunch of projects put off implementation of major features last cycle to help with stabilization | 16:05 |
fungi | expecting this to get worse (leading up to pike feature freeze) before it gets better | 16:06 |
*** ym200 has quit IRC | 16:06 | |
*** ym200 has joined #openstack-infra | 16:07 | |
clarkb | yup I completely agree | 16:07 |
*** isaacb has joined #openstack-infra | 16:07 | |
*** isaacb_ has joined #openstack-infra | 16:07 | |
clarkb | but at lwast this way I can tell then " we did our part on the infrastructure side, now we really need you to do yours " | 16:08 |
*** isaacb_ has left #openstack-infra | 16:08 | |
*** ym200 has quit IRC | 16:09 | |
*** vsaienko has quit IRC | 16:09 | |
*** mozart89 has quit IRC | 16:09 | |
*** ym200 has joined #openstack-infra | 16:09 | |
*** spzala has quit IRC | 16:10 | |
*** rossella_s has quit IRC | 16:11 | |
*** vsaienko has joined #openstack-infra | 16:11 | |
*** rossella_s has joined #openstack-infra | 16:12 | |
*** amotoki has quit IRC | 16:13 | |
fungi | that won't stop most teams from just asking us to give them instances with more ram | 16:14 |
fungi | people, developers in particular though, have become accustomed to ever increasing inefficiency on the assumption it's easier to just keep throwing more and more hardware at the problem | 16:16 |
*** soliosg1 has quit IRC | 16:16 | |
fungi | now that moore's law is dead, maybe we'll see that trend begin to reverse a little | 16:17 |
*** beslemon has quit IRC | 16:18 | |
*** hieulq_ has quit IRC | 16:20 | |
*** e0ne has quit IRC | 16:20 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Updated feedback validation rules https://review.openstack.org/448184 | 16:21 |
openstackgerrit | Merged openstack-infra/openstackid-resources master: Updated feedback validation rules https://review.openstack.org/448184 | 16:25 |
*** leong has joined #openstack-infra | 16:26 | |
*** dhajare has quit IRC | 16:26 | |
*** ym200 has quit IRC | 16:27 | |
leong | hi, is there an etherpad api that we can use for etherpad.openstack.org? | 16:27 |
*** ym200 has joined #openstack-infra | 16:28 | |
*** jaosorior has quit IRC | 16:29 | |
jeblair | fungi, clarkb: i'm thinking of ccing the openstack-dev list on my encryption email to get more eyes on it. good idea? how should i [tag] it? | 16:29 |
*** erikwilson has quit IRC | 16:29 | |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Only force http for repos that allow it https://review.openstack.org/448187 | 16:29 |
fungi | leong: you can try http://etherpad.org/doc/v1.5.1/#index_http_api | 16:30 |
*** Julien-zte has quit IRC | 16:30 | |
*** Julien-zte has joined #openstack-infra | 16:30 | |
fungi | leong: obviously any methods which require an api key won't work, but i don't know whether our apache proxy plumbs through enough of the url pattern to allow anonymous methods to still work | 16:31 |
*** Julien-zte has quit IRC | 16:31 | |
fungi | jeblair: [infra][security] maybe? | 16:31 |
*** Julien-zte has joined #openstack-infra | 16:32 | |
*** Julien-zte has quit IRC | 16:32 | |
*** Julien-zte has joined #openstack-infra | 16:32 | |
*** Julien-zte has quit IRC | 16:32 | |
*** alexchadin has quit IRC | 16:33 | |
*** Julien-zte has joined #openstack-infra | 16:33 | |
*** soliosg has left #openstack-infra | 16:33 | |
*** Julien-zte has quit IRC | 16:33 | |
fungi | i skimmed official tags for the ml and those were the only two which jumped out at me as applicable | 16:34 |
jeblair | fungi: cool, thanks. | 16:34 |
*** Julien-zte has joined #openstack-infra | 16:34 | |
*** Julien-zte has quit IRC | 16:34 | |
fungi | [security] gets us (hopefully) some crypto-minded people paying attention who might not otherwise | 16:34 |
*** Julien-zte has joined #openstack-infra | 16:35 | |
*** Julien-zte has quit IRC | 16:35 | |
*** Julien-zte has joined #openstack-infra | 16:36 | |
leong | fungi: thanks, will give that a try... | 16:36 |
*** dizquierdo has quit IRC | 16:36 | |
*** nadya has joined #openstack-infra | 16:36 | |
fungi | leong: https://etherpad.openstack.org/api/ gives me {"currentVersion":"1.2.12"} so i guess it works, but you probably want to poke around http://etherpad.org/doc/ for the correct release before assuming the api methods listed are correct | 16:37 |
fungi | leong: this is the version you want i guess http://etherpad.org/doc/v1.2.12/#index_http_api | 16:38 |
*** isaacb has quit IRC | 16:38 | |
*** stevejims has quit IRC | 16:38 | |
*** markus_z has quit IRC | 16:39 | |
*** faizy__ has quit IRC | 16:40 | |
*** soliosg has joined #openstack-infra | 16:41 | |
openstackgerrit | Manjeet Singh Bhatia proposed openstack-infra/reviewday master: Append a new section to neutron dashboard https://review.openstack.org/439114 | 16:41 |
*** mozart89|2 has joined #openstack-infra | 16:42 | |
*** sekelso has quit IRC | 16:43 | |
*** jpich has quit IRC | 16:43 | |
sbezverk | fungi: good morning, need a bit of help. would you have a couple of minutes to chat? | 16:43 |
*** jcoufal has quit IRC | 16:43 | |
*** Apoorva has joined #openstack-infra | 16:43 | |
*** ym200 has quit IRC | 16:43 | |
*** ym200 has joined #openstack-infra | 16:44 | |
fungi | sbezverk: i can make time briefly, but need to go run some errands in just a bit. is this related to your kernel module issues earlier? | 16:45 |
*** esikachev has joined #openstack-infra | 16:46 | |
openstackgerrit | Manjeet Singh Bhatia proposed openstack-infra/reviewday master: Append a new section to neutron dashboard https://review.openstack.org/439114 | 16:47 |
sbezverk | fungi: no that thing is fixed :) I am debugging VM I bring up using ironic and kolla-kubernetes (at the gate) and it looks ok, but I need to get from that VM even BIOS messages, do you know a way to do it? capturing console to the file has only OS realted messages and not whole thing | 16:47 |
*** bhavik1 has quit IRC | 16:48 | |
*** ym200 has quit IRC | 16:48 | |
fungi | sbezverk: no clue. i think the virtual "bios" used for these may be all over the map given the diversity of hypervisors we have at various providers | 16:49 |
*** Daviey_ is now known as Daviey | 16:49 | |
*** rkukura has joined #openstack-infra | 16:49 | |
*** esikache1 has quit IRC | 16:49 | |
*** jcoufal has joined #openstack-infra | 16:49 | |
fungi | sbezverk: or are you talking about a vm nested in the vm where the job itself runs? | 16:49 |
*** ym200 has joined #openstack-infra | 16:49 | |
sbezverk | fungi: right it is nested VM I defined with virsh inside of gate VM | 16:50 |
sbezverk | whcih I use like "baremetal" node | 16:50 |
fungi | sbezverk: no clue, i don't generally work with openstack at that level but you might try asking in #openstack-qa since the devstack maintainers may have some ideas (or maybe #openstack-nova even?) | 16:50 |
clarkb | ya danpb is probably a good one to ask | 16:51 |
Daviey | fungi / sbezverk: I think the issue is that currently only the tty is being logged to a txt file. With the qemu console being on a VNC connection. So either, someone from infra could screenshot that.. Or sbezverk could change it to dump the qemu console (pre-kernel) to txt file. | 16:51 |
fungi | right, this is probably a hypervisor internals question really | 16:51 |
*** jkilpatr_ has joined #openstack-infra | 16:51 | |
fungi | Daviey: not sure what screen would screenshot the nested vnc console (if vnc console support is even being enabled in that job) | 16:52 |
Daviey | fungi: Qemu + VNC is default, no? | 16:52 |
Daviey | unless -nographic is being added to the cmd line? | 16:53 |
fungi | Daviey: in kolla? no idea | 16:53 |
Daviey | fungi: this is a qemu problem... not really kolla specific i don't think | 16:53 |
fungi | does that cause the vnc session of the nested vm to be automatically displayed to the outer vm's virtual console? | 16:53 |
*** jkilpatr has quit IRC | 16:54 | |
sbezverk | fungi: in my local test bed exact the same config works fine with the same level of nesting | 16:54 |
*** pblaho has quit IRC | 16:54 | |
fungi | or, i guess it causes vmc to listen on a local network socket provided by the hypervisor, right? | 16:54 |
fungi | vnc | 16:54 |
sbezverk | fungi: when I connect to vnc console I see everything | 16:54 |
Daviey | right | 16:54 |
*** jordanP has joined #openstack-infra | 16:54 | |
Daviey | vncviewer 127.0.0.1:0 | 16:54 |
*** trown is now known as trown|lunch | 16:55 | |
*** jaosorior has joined #openstack-infra | 16:55 | |
fungi | got it. so the job could call vmcviewer with some option to dump a video stream to disk? | 16:55 |
sbezverk | Daviey: so if vnc can capture those messages I do not see why log cannot | 16:55 |
fungi | why do i keep typing vmc? | 16:55 |
*** rkukura has quit IRC | 16:55 | |
*** rkukura has joined #openstack-infra | 16:56 | |
Daviey | sbezverk: I *think* you are only logging once the kernel has started.. You need qemu to output everything it sees (rather than use vnc), which is independent of the kernel tty | 16:56 |
fungi | vnc is pixel-oriented so can't just write text-mode i guess | 16:56 |
fungi | or can it? | 16:56 |
Daviey | fungi: because you are thinking about the weather? | 16:56 |
fungi | Daviey: probably | 16:56 |
Daviey | (visual meteorological conditions) | 16:56 |
*** nadya has quit IRC | 16:56 | |
fungi | it's cool and sunny here | 16:57 |
Daviey | sbezverk: if -nographic is added to the qemu process, then what would have been put on VNC will be in ncurses instead | 16:57 |
*** coding_shardy is now known as shardy | 16:57 | |
fungi | oh, that's handy | 16:57 |
sbezverk | Daviey: since I use virsh to define how do I define this mode there? do you know from the top of your head? | 16:58 |
Daviey | umm | 16:59 |
*** ociuhandu has quit IRC | 16:59 | |
*** dizquierdo has joined #openstack-infra | 17:00 | |
Daviey | sbezverk: you might be able to use <console type='file'> ... ? | 17:02 |
clarkb | sbezverk: it might also help to know what information you are hoping to find? is there something specific that could potentially be retrieved some other way? | 17:02 |
sbezverk | Daviey: that is what I have | 17:03 |
sbezverk | clarkb: the same code works in my test bed and itdoes not at the gate. baremetal VM by some reason does not callback to ironic-api | 17:04 |
sbezverk | clarkb: since all possibilities were eliminated from code perspective I need to see the console output of that vm to see where it gets stuck | 17:05 |
sbezverk | clarkb: in my test bed for debugging I was using vnc where I could every aspect of that vm | 17:05 |
jroll | sbezverk: link to the gate logs? | 17:05 |
*** yee379 has quit IRC | 17:06 | |
* jroll can point out some debugging help | 17:06 | |
*** yee379 has joined #openstack-infra | 17:06 | |
clarkb | sbezverk: and haev you tried using reproduce.sh | 17:06 |
clarkb | (basically same set of suggestions as yesterday for the kernel module, start with reproducing the gate job and see what happens) | 17:06 |
sbezverk | jroll: here you go http://logs.openstack.org/50/441550/100/experimental/gate-kolla-kubernetes-deploy-centos-source-3-ironic-nv/830318b/console.html | 17:07 |
sbezverk | clarkb: never use reproduce before.. | 17:07 |
jroll | oh my, this is much different than ironic setup :( | 17:07 |
sbezverk | jroll: it is ironic running on kubernetes cluster | 17:08 |
clarkb | oh there is no reproduce.sh | 17:08 |
jroll | sbezverk: I mean in terms of logs and such | 17:08 |
clarkb | in that case I would suggest starting with a bit mroe of the prior art that has come before you | 17:08 |
*** vsaienko has quit IRC | 17:09 | |
jroll | sbezverk: I'll just leave you with this, then, https://docs.openstack.org/developer/ironic/deploy/troubleshooting.html#retrieving-logs-from-the-deploy-ramdisk | 17:09 |
clarkb | sbezverk: basically its a script that devstack-gate writes out that reproduces a devstack-gate run | 17:09 |
jroll | sbezverk: also <console type='file'> can be helpful | 17:09 |
clarkb | sbezverk: it is very handy for reproducing failures | 17:09 |
*** vhosakot has joined #openstack-infra | 17:09 | |
*** ociuhandu has joined #openstack-infra | 17:10 | |
*** claudiub|2 has quit IRC | 17:10 | |
*** nadya has joined #openstack-infra | 17:11 | |
*** nadya has quit IRC | 17:11 | |
sbezverk | jroll: I use it and it dumps ONLY OS messages, so when VM is in BIOS stage or pxe booting nothing shows up | 17:12 |
*** baoli has joined #openstack-infra | 17:12 | |
*** vsaienko has joined #openstack-infra | 17:12 | |
sbezverk | clarkb: running devstack on kube cluster is even more challenge than figuring out my vm issue, that would be plan Z ;) | 17:12 |
jroll | sbezverk: that's odd, ironic jobs get everything, like http://logs.openstack.org/04/439404/5/check/gate-tempest-dsvm-ironic-ipa-partition-bios-pxe_ipmitool-tinyipa-ubuntu-xenial/c8a1837/logs/ironic-bm-logs/node-0_console_2017-03-21-06:01:05.txt.gz | 17:13 |
clarkb | sbezverk: you don't need to run devstack at all | 17:13 |
clarkb | sbezverk: devstack-gate is its own thing (and possibly poorly named) but it knows how to do things like reproduce itself, test itself, setup all the git repos properly, etc | 17:13 |
clarkb | its a bootstrapping framework, no devstack required | 17:14 |
sbezverk | jroll: that looks exactly what I need | 17:14 |
sbezverk | jroll: how do you collect it or define your vm? | 17:14 |
*** ociuhandu has quit IRC | 17:14 | |
jroll | sbezverk: https://github.com/openstack/ironic/tree/master/devstack/tools/ironic | 17:14 |
sbezverk | clarkb: I see what you mean, sorry I misunderstood you | 17:14 |
jroll | sbezverk: look at scripts/configure-vm.py and templates/vm.xml | 17:14 |
*** Hal has quit IRC | 17:15 | |
*** Qiming has quit IRC | 17:15 | |
sbezverk | jroll" this looks interesting <bios useserial='yes'/> | 17:17 |
*** esikachev has quit IRC | 17:17 | |
*** esikache1 has joined #openstack-infra | 17:17 | |
sbezverk | jroll: but I do not see how console is defined, it seems rendered | 17:17 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Remove ZooKeeperConnectionConfig class https://review.openstack.org/447683 | 17:18 |
jroll | sbezverk: https://github.com/openstack/ironic/blob/master/devstack/lib/ironic#L1365-L1372 | 17:19 |
jroll | sbezverk: and https://github.com/openstack/ironic/blob/master/devstack/tools/ironic/scripts/create-node.sh | 17:19 |
sbezverk | jroll: nvm I found it, it is almost like I have with exception bios use serial | 17:19 |
jroll | it's complex but that's about everything | 17:19 |
* jroll brb | 17:19 | |
*** Qiming has joined #openstack-infra | 17:19 | |
*** baoli has quit IRC | 17:19 | |
openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Add dracut-regenerate elements https://review.openstack.org/447047 | 17:20 |
*** tinwood_ is now known as tinwood | 17:22 | |
*** vsaienko has quit IRC | 17:22 | |
*** vsaienko has joined #openstack-infra | 17:24 | |
*** pblaho has joined #openstack-infra | 17:24 | |
*** baoli has joined #openstack-infra | 17:24 | |
*** ociuhandu has joined #openstack-infra | 17:25 | |
*** pbourke_ is now known as pbourke | 17:25 | |
*** hamzy has joined #openstack-infra | 17:26 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Remove ZooKeeperConnectionConfig class https://review.openstack.org/447683 | 17:27 |
*** nadya has joined #openstack-infra | 17:27 | |
*** spzala has joined #openstack-infra | 17:27 | |
*** mhickey has quit IRC | 17:27 | |
*** flwang has quit IRC | 17:27 | |
*** hashar has quit IRC | 17:28 | |
*** witek has quit IRC | 17:31 | |
sbezverk | jroll: thanks very much, that did the trick!! | 17:31 |
*** chuckC_ has quit IRC | 17:32 | |
*** spzala has quit IRC | 17:32 | |
*** rfolco has quit IRC | 17:32 | |
jroll | sbezverk: awesome :) | 17:33 |
*** annegentle has quit IRC | 17:33 | |
hamzy | heya I have a question about https://review.openstack.org/#/c/427255/ I keep running into timeout problems. For example, http://logs.openstack.org/55/427255/13/check/gate-openstack-ansible-openstack-ansible-aio-ubuntu-xenial/077687b/console.html "Request Time-out: Your browser didn't send a complete request in time." and http://logs.openstack.org/55/427255/13/check/gate-openstack-ansible-openstack-ansible-aio-ubuntu-xenial/d818461/console.html "WARNIN | 17:35 |
hamzy | G [tempest.lib.common.ssh] Failed to establish authenticated ssh connection to cirros@172.29.249.122" | 17:35 |
openstackgerrit | Merged openstack-infra/devstack-gate master: Set HOST_IP for subnode first https://review.openstack.org/448078 | 17:35 |
*** rwsu has joined #openstack-infra | 17:36 | |
*** manjeets has joined #openstack-infra | 17:37 | |
*** david-lyle_ has joined #openstack-infra | 17:37 | |
manjeets | https://review.openstack.org/#/c/400227/ | 17:37 |
fungi | mordred: looks like we may have yet another gerrit acl manage-projects is failing to apply... http://lists.openstack.org/pipermail/openstack-dev/2017-March/114407.html (the change merged yesterday but still doesn't seem to match what's live in gerrit) | 17:37 |
manjeets | is waiting reviews and without it pep8 is broken | 17:38 |
* fungi heads out to run errands, back in time to run infra meeting at 19:00z | 17:38 | |
*** david-lyle has quit IRC | 17:38 | |
*** spzala has joined #openstack-infra | 17:38 | |
*** ssbarnea has quit IRC | 17:38 | |
*** lucasagomes is now known as lucas-afk | 17:38 | |
pabelanger | apparently forumtopics.o.o is a thing | 17:39 |
mordred | fungi: BLERG | 17:39 |
pabelanger | but not in system-config | 17:39 |
*** flwang has joined #openstack-infra | 17:39 | |
pabelanger | :( | 17:39 |
fungi | pabelanger: it's a foundation instance, not in the openstackci tenant | 17:39 |
fungi | pabelanger: is it misbehaving in a way that needs to be silenced? i can look into it when i get back | 17:40 |
pabelanger | fungi: no, was just curious what is was. | 17:40 |
*** yamahata has quit IRC | 17:40 | |
*** spzala has quit IRC | 17:41 | |
*** spzala has joined #openstack-infra | 17:41 | |
openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: WIP: create a README_LOGS to document log files https://review.openstack.org/447653 | 17:42 |
openstackgerrit | Merged openstack-infra/reviewday master: setup.py has a tox error, making reviewday fail gating https://review.openstack.org/400227 | 17:43 |
*** jtomasek has quit IRC | 17:43 | |
jordanP | mordred, https://github.com/openstack-infra/shade/blob/master/shade/openstackcloud.py#L5648 means that when we call delete_server(..., wait=True) we will hit the nova api as hard as possible | 17:46 |
*** rbrndt has quit IRC | 17:46 | |
*** florianf has quit IRC | 17:46 | |
jordanP | because by default self._SERVER_AGE = 0 | 17:47 |
openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Handle the 'all' group in callback. https://review.openstack.org/446749 | 17:47 |
*** trown|lunch is now known as trown | 17:47 | |
*** tonytan4ever has quit IRC | 17:47 | |
mordred | jordanP: yes - you are quite right | 17:48 |
*** beagles is now known as beagles_lunch | 17:48 | |
*** florianf has joined #openstack-infra | 17:48 | |
*** tonytan4ever has joined #openstack-infra | 17:48 | |
mordred | jordanP: there are several bad edgecases in the overlap of our cache vs. no-cache codepaths | 17:48 |
mordred | jordanP: perhaps for now we should have that loop do wait=self._SERVER_AGE or 2 ... or something like that to keep deletes from ddos-ing? | 17:49 |
jordanP | mordred, what's the best patch ? set wait=1 instead | 17:49 |
jordanP | ok, I'll do that | 17:49 |
jordanP | 2 seems very good | 17:49 |
mordred | jordanP: a thing to double-check for is that it doesn't cause the unittests to balloon in time- if it does, we may also want to set SERVER_AGE in them if we aren't already | 17:50 |
mordred | thanks! | 17:50 |
clarkb | the task manager delay will still be in effect if used though | 17:50 |
*** derekh has quit IRC | 17:50 | |
*** leong has quit IRC | 17:51 | |
jordanP | mordred, time.sleep should be mocked in unittests, it's a good rule for unit testing | 17:51 |
mordred | jordanP: ++ | 17:51 |
jordanP | but yeah, I'll look at it | 17:51 |
clarkb | so in theory there is a queueing mechanism set to request lower than dos threshold | 17:51 |
mordred | clarkb: yah. if you're using task_manager you're likely a much more advanced user though who is also setting cache times | 17:51 |
mordred | for folks using shade on command line or in ansible - this could be unfriendly :) | 17:51 |
*** ralonsoh has quit IRC | 17:52 | |
openstackgerrit | Manjeet Singh Bhatia proposed openstack-infra/project-config master: Forcing tempest concurrency https://review.openstack.org/447628 | 17:53 |
*** adreznec has quit IRC | 17:55 | |
*** annegentle has joined #openstack-infra | 17:56 | |
*** florianf has quit IRC | 17:56 | |
breton | ttx: fungi: thanks for fixing the ML | 17:56 |
*** adreznec has joined #openstack-infra | 17:57 | |
*** jaosorior has quit IRC | 17:57 | |
clarkb | ttx: fungi EmilienM so if I put a forum session idea on the etherpad that was sent out I now need to transfer it to forumtopics.o.o? | 17:58 |
openstackgerrit | Jordan Pittier proposed openstack-infra/shade master: delete_server: make sure we sleep a bit when waiting for srv deletion https://review.openstack.org/448215 | 17:58 |
*** dtantsur is now known as dtantsur|afk | 17:58 | |
*** mtanino has quit IRC | 17:58 | |
*** esikache1 has quit IRC | 17:58 | |
EmilienM | clarkb: yes | 17:59 |
*** rwsu has quit IRC | 17:59 | |
*** spzala has quit IRC | 17:59 | |
clarkb | why'd we send out the etherpad with a call for suggestions then... /me goes to dig up etherpad and move bits around | 18:00 |
*** rwsu has joined #openstack-infra | 18:00 | |
*** flepied has quit IRC | 18:00 | |
*** spzala has joined #openstack-infra | 18:01 | |
EmilienM | clarkb: AFIK the f.o.o tool wasn't ready until yesterday or so | 18:03 |
*** spzala has quit IRC | 18:05 | |
*** esikache1 has joined #openstack-infra | 18:05 | |
*** spzala has joined #openstack-infra | 18:07 | |
*** xyang1 has joined #openstack-infra | 18:08 | |
openstackgerrit | Manjeet Singh Bhatia proposed openstack-infra/devstack-gate master: Do not merge experimental https://review.openstack.org/448218 | 18:09 |
*** electrofelix has quit IRC | 18:09 | |
*** esikache1 has quit IRC | 18:10 | |
*** dprince has quit IRC | 18:10 | |
*** spzala has quit IRC | 18:10 | |
*** spzala has joined #openstack-infra | 18:10 | |
*** sekelso has joined #openstack-infra | 18:11 | |
mordred | jordanP: I may be a dork - my first thought on reading that commit message, even though we'd just spoken, was "why are we deleting SRV records" :) | 18:11 |
*** ym200 has quit IRC | 18:11 | |
*** mtanino has joined #openstack-infra | 18:11 | |
jordanP | mordred, yeah I was afraid of the max commit title length | 18:11 |
*** ym200 has joined #openstack-infra | 18:12 | |
*** skelso has joined #openstack-infra | 18:12 | |
openstackgerrit | Jordan Pittier proposed openstack-infra/shade master: delete_server: make sure we sleep a bit when waiting for server deletion https://review.openstack.org/448215 | 18:12 |
*** ociuhandu has quit IRC | 18:14 | |
*** skelso has quit IRC | 18:14 | |
*** skelso has joined #openstack-infra | 18:14 | |
*** sekelso has quit IRC | 18:15 | |
openstackgerrit | Jordan Pittier proposed openstack-infra/shade master: wait_for_server: ensure we sleep a bit when waiting for server https://review.openstack.org/448220 | 18:15 |
jordanP | so there was another occurence of the very same issue. But I am not going to fix it everywhere, only where I need it for now | 18:16 |
jordanP | still working on my patch to shade, the one with a flaky functional test | 18:16 |
*** skelso has quit IRC | 18:16 | |
*** shardy has quit IRC | 18:18 | |
*** bh526r has quit IRC | 18:18 | |
*** pvaneck has joined #openstack-infra | 18:20 | |
*** rossella_s has quit IRC | 18:23 | |
*** esikache1 has joined #openstack-infra | 18:24 | |
*** weshay_sick is now known as weshay_brb | 18:25 | |
*** yamahata has joined #openstack-infra | 18:27 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create extra-test-setup role https://review.openstack.org/448042 | 18:27 |
*** spzala has quit IRC | 18:27 | |
*** esikache1 has quit IRC | 18:28 | |
clarkb | mnaser: pabelanger beacuse the dhcp vs not dhcp thing keeps coming up, did we determine what the issue was with eth1 config in rax? | 18:29 |
*** yamahata has quit IRC | 18:31 | |
*** tesseract has quit IRC | 18:31 | |
*** yamahata has joined #openstack-infra | 18:31 | |
*** esikache1 has joined #openstack-infra | 18:31 | |
pabelanger | clarkb: so, talked to mnaser on the weekend, I think we can add logic to systemd service for glance to restart the service on failure | 18:32 |
pabelanger | as it looks like chkconfig is bombing due to race | 18:32 |
pabelanger | not glean | 18:32 |
*** stevejims has joined #openstack-infra | 18:33 | |
*** ssbarnea has joined #openstack-infra | 18:33 | |
clarkb | so glean's units are running before chkconfig can properly configure them? | 18:33 |
*** flepied has joined #openstack-infra | 18:33 | |
*** beagles_lunch is now known as beagles | 18:33 | |
*** eroux has quit IRC | 18:34 | |
*** spzala has joined #openstack-infra | 18:34 | |
pabelanger | clarkb: something something systemd? If you look at a log, systemd will redirect to chkconfig because networking.service is not there? And since both eth1 and eth0 run at the same time, eth1 looks to fail to symlink something | 18:34 |
pabelanger | so, we could serialize systemd some how, not sure | 18:34 |
pabelanger | or restart service on failure | 18:34 |
clarkb | I see, I'd likely have to draw a graph of execution order to understand it myself | 18:35 |
*** baoli has quit IRC | 18:35 | |
*** eroux has joined #openstack-infra | 18:36 | |
*** baoli has joined #openstack-infra | 18:36 | |
clarkb | systemd-analyze might help me there | 18:36 |
clarkb | I may try generating a graph on a rax host later today | 18:36 |
*** rbrndt has joined #openstack-infra | 18:37 | |
*** Sukhdev has joined #openstack-infra | 18:38 | |
*** esikache1 has quit IRC | 18:38 | |
*** spzala has quit IRC | 18:38 | |
*** pcaruana has quit IRC | 18:39 | |
*** ym200 has quit IRC | 18:40 | |
*** tosky has quit IRC | 18:40 | |
*** zara_the_lemur__ has joined #openstack-infra | 18:41 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create extra-test-setup role https://review.openstack.org/448042 | 18:41 |
*** weshay_brb is now known as weshay | 18:42 | |
*** rwsu has quit IRC | 18:42 | |
*** dhajare has joined #openstack-infra | 18:43 | |
*** dprince has joined #openstack-infra | 18:43 | |
*** david-lyle_ has quit IRC | 18:46 | |
*** armax has quit IRC | 18:49 | |
*** rkukura has quit IRC | 18:49 | |
*** rockyg has joined #openstack-infra | 18:50 | |
openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Add dracut-regenerate elements https://review.openstack.org/447047 | 18:55 |
jhesketh | Morning | 18:58 |
*** mat128 has quit IRC | 18:59 | |
*** ociuhandu has joined #openstack-infra | 18:59 | |
*** rbrndt has quit IRC | 18:59 | |
AJaeger | morning, jhesketh | 19:00 |
jhesketh | o/ | 19:00 |
*** nadya has quit IRC | 19:00 | |
openstackgerrit | Jordan Pittier proposed openstack-infra/shade master: attach_volume should always return a vol attachment. https://review.openstack.org/434964 | 19:01 |
*** ym200 has joined #openstack-infra | 19:01 | |
fungi | it's that (weekly infra team meeting) time again! find us in #openstack-meeting for the next hour | 19:02 |
*** annegentle has quit IRC | 19:02 | |
*** esikache1 has joined #openstack-infra | 19:06 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Fix hostname issue with nodepool integration job https://review.openstack.org/448239 | 19:08 |
*** dharinic is now known as dharinic|lunch | 19:09 | |
*** dhajare has quit IRC | 19:09 | |
*** rkukura has joined #openstack-infra | 19:11 | |
*** rwsu has joined #openstack-infra | 19:12 | |
*** bswartz has quit IRC | 19:13 | |
*** chlong has joined #openstack-infra | 19:13 | |
*** spzala has joined #openstack-infra | 19:13 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Fix hostname issue with nodepool integration job https://review.openstack.org/448239 | 19:14 |
*** spzala has quit IRC | 19:15 | |
*** spzala has joined #openstack-infra | 19:15 | |
*** beslemon has joined #openstack-infra | 19:15 | |
*** rwsu has quit IRC | 19:17 | |
*** tosky has joined #openstack-infra | 19:18 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Create PReP boot partition for PPC https://review.openstack.org/447739 | 19:20 |
*** annegentle has joined #openstack-infra | 19:22 | |
*** gyee has joined #openstack-infra | 19:26 | |
*** jordanP has quit IRC | 19:28 | |
*** rfolco has joined #openstack-infra | 19:29 | |
*** dizquierdo has quit IRC | 19:29 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] Test boot partition code https://review.openstack.org/448099 | 19:31 |
*** MasterOfBugs has joined #openstack-infra | 19:36 | |
*** ym200 has quit IRC | 19:36 | |
*** ym200 has joined #openstack-infra | 19:38 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Create PReP boot partition for PPC https://review.openstack.org/447739 | 19:39 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] Test boot partition code https://review.openstack.org/448099 | 19:39 |
*** stevejims has quit IRC | 19:41 | |
*** amoralej is now known as amoralej|off | 19:44 | |
*** rhallisey has quit IRC | 19:45 | |
*** dharinic|lunch is now known as dharinic | 19:46 | |
openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Allow github trigger to match on branches/refs https://review.openstack.org/445625 | 19:48 |
openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Better merge message for GitHub pull reqeusts https://review.openstack.org/445644 | 19:48 |
openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Set filter according to PR/Change in URL https://review.openstack.org/446782 | 19:48 |
openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Support for dependent pipelines with github https://review.openstack.org/445292 | 19:48 |
openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: GitHub file matching support https://review.openstack.org/446113 | 19:48 |
openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Log GitHub API rate limit https://review.openstack.org/446150 | 19:48 |
openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Query changes only via relevant sources https://review.openstack.org/448257 | 19:48 |
*** rhallisey has joined #openstack-infra | 19:48 | |
*** MasterOfBugs has quit IRC | 19:52 | |
*** rockyg has quit IRC | 19:52 | |
*** hashar has joined #openstack-infra | 19:53 | |
*** esikache1 has quit IRC | 19:54 | |
*** spzala has quit IRC | 19:54 | |
*** rockyg has joined #openstack-infra | 19:55 | |
*** mat128 has joined #openstack-infra | 19:57 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Create PReP boot partition for PPC https://review.openstack.org/447739 | 19:59 |
*** claudiub|2 has joined #openstack-infra | 19:59 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] Test boot partition code https://review.openstack.org/448099 | 20:00 |
*** dave-mccowan has quit IRC | 20:02 | |
*** matrohon has joined #openstack-infra | 20:02 | |
*** armax has joined #openstack-infra | 20:02 | |
*** rbrndt has joined #openstack-infra | 20:03 | |
*** rbrndt has quit IRC | 20:03 | |
*** e0ne has joined #openstack-infra | 20:04 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create zuul_workspace_root job variable https://review.openstack.org/441441 | 20:06 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Organize playbooks folder https://review.openstack.org/441547 | 20:06 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add net-info to bootstrap role https://review.openstack.org/441617 | 20:06 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add ansible-lint to tox (pep8) https://review.openstack.org/438276 | 20:06 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add revoke-sudo role and update tox jobs https://review.openstack.org/441467 | 20:06 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create tox-tarball job https://review.openstack.org/441609 | 20:07 |
*** zara_the_lemur__ has left #openstack-infra | 20:07 | |
*** MasterOfBugs has joined #openstack-infra | 20:11 | |
*** sshnaidm is now known as sshnaidm|afk | 20:16 | |
*** pbourke has quit IRC | 20:16 | |
*** vsaienko has quit IRC | 20:17 | |
breton | well, i've just got fifth mail "Thank you for registering for the OpenStack Summit" :) | 20:17 |
*** priteau has joined #openstack-infra | 20:18 | |
breton | and it says that i don't have "have an OpenStack Community Account or OpenStack Foundation " | 20:19 |
breton | Membership | 20:19 |
breton | which is true | 20:19 |
breton | but 5 times | 20:19 |
*** chlong has quit IRC | 20:21 | |
pabelanger | breton: as did I | 20:21 |
*** rhallisey has quit IRC | 20:22 | |
clarkb | breton: did you just register? | 20:23 |
clarkb | pabelanger: ^ you too I guess | 20:23 |
pabelanger | clarkb: no, I registered at PTG | 20:23 |
clarkb | pabelanger: but emails just came in today? | 20:23 |
* clarkb trying to collect data so can pass it along | 20:23 | |
pabelanger | clarkb: right, 53 mins go | 20:23 |
clarkb | pabelanger: and you got 5 of them too? | 20:24 |
pabelanger | clarkb: just 4 currently | 20:24 |
pabelanger | last was 8min ago | 20:24 |
clarkb | cool, will pass it along and see if we can sort it out | 20:24 |
clarkb | will let you know if I leanr anything | 20:24 |
*** clenimar has joined #openstack-infra | 20:26 | |
breton | clarkb: same as pabelanger, registered at the PTG | 20:26 |
*** jkilpatr_ has quit IRC | 20:28 | |
clarkb | breton: pabelanger I am passing info along, they aren't sure what is causing it just yet but are looking into it | 20:30 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Create PReP boot partition for PPC https://review.openstack.org/447739 | 20:30 |
priteau | Hello. I am not sure who to ping, I just noticed https://groups.openstack.org is throwing a database access error | 20:30 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] Test boot partition code https://review.openstack.org/448099 | 20:31 |
*** esikache1 has joined #openstack-infra | 20:31 | |
pabelanger | checking groups.o.o | 20:32 |
pabelanger | not sure if that is a local DB or trove | 20:32 |
*** dave-mccowan has joined #openstack-infra | 20:32 | |
clarkb | priteau: this is probably a good place | 20:32 |
clarkb | fungi: ^ aware of any changes to groups? | 20:33 |
openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: WIP: Add lvm management to diskimage-builder https://review.openstack.org/444403 | 20:34 |
fungi | no, though it may be a trove maintenance in rackspace? i'd check the openstackci tenant tickets if it weren't for the tc meeting | 20:34 |
fungi | given the wiki had trouble earlier today | 20:34 |
pabelanger | ya, looks like groups.o.o is using trove | 20:34 |
clarkb | I am able to connect to the db instance from the groups server | 20:35 |
clarkb | and the groups db is there | 20:35 |
pabelanger | clarkb: and just got 5th email | 20:37 |
clarkb | wondering if apache/php has cached some bad ip addr info or something | 20:37 |
*** kgiusti has left #openstack-infra | 20:37 | |
clarkb | and they moved the trove server? | 20:37 |
pabelanger | didn't yolanda restart apache this morning | 20:37 |
pabelanger | which fixed up the wiki | 20:37 |
clarkb | pabelanger: breton looks like they just spotted the issue with the emails and it should be fixed soon | 20:37 |
clarkb | pabelanger: fungi ya based on my direct testing of mysql conectivity I think that may be our next step here | 20:38 |
clarkb | since it appears to all work and be happy if I connect to it | 20:38 |
pabelanger | seems reasonable | 20:38 |
clarkb | fungi: ^ any last minute objection before I do that? | 20:38 |
fungi | clarkb: no objection, do the thing | 20:38 |
*** esikache1 has quit IRC | 20:38 | |
clarkb | its back | 20:39 |
clarkb | priteau: thank you for letting us know, can you check that the service is doing what you were hoping it would do now? | 20:39 |
priteau | Thank you clarkb & fungi! | 20:39 |
priteau | It looks good now here | 20:39 |
openstackgerrit | K Jonathan Harker proposed openstack-infra/zuul feature/zuulv3: Perform pre-launch merge checks https://review.openstack.org/446275 | 20:41 |
*** gildub has joined #openstack-infra | 20:41 | |
*** esikache1 has joined #openstack-infra | 20:42 | |
openstackgerrit | Mikhail S Medvedev proposed openstack/diskimage-builder master: Create PReP boot partition for PPC https://review.openstack.org/447739 | 20:43 |
*** ym200 has quit IRC | 20:43 | |
openstackgerrit | Mikhail S Medvedev proposed openstack/diskimage-builder master: [DNM] Test boot partition code https://review.openstack.org/448099 | 20:44 |
*** jkilpatr has joined #openstack-infra | 20:44 | |
*** ym200 has joined #openstack-infra | 20:44 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create zuul_workspace_root job variable https://review.openstack.org/441441 | 20:45 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Organize playbooks folder https://review.openstack.org/441547 | 20:45 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add net-info to bootstrap role https://review.openstack.org/441617 | 20:45 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add ansible-lint to tox (pep8) https://review.openstack.org/438276 | 20:45 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add revoke-sudo role and update tox jobs https://review.openstack.org/441467 | 20:45 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create tox-tarball job https://review.openstack.org/441609 | 20:45 |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Create extra-test-setup role https://review.openstack.org/448042 | 20:45 |
*** esikache1 has quit IRC | 20:47 | |
*** chlong has joined #openstack-infra | 20:48 | |
pabelanger | clarkb: fungi: neat, cacti.o.o has the same database issue is seems | 20:48 |
clarkb | nice | 20:48 |
pabelanger | going to restart apache now | 20:49 |
clarkb | kk | 20:49 |
pabelanger | restarted | 20:49 |
pabelanger | and back | 20:49 |
fungi | pabelanger: i wonder how gerrit escaped this | 20:49 |
fungi | cacti has a trove db? | 20:49 |
clarkb | fungi: I think java is better at noticing and reconnecting than php? | 20:49 |
pabelanger | fungi: apparently it does, but it also has mysql running locally | 20:50 |
pabelanger | not sure why that is | 20:50 |
pabelanger | Ya, setup for trove in /etc/cacti | 20:51 |
openstackgerrit | Manjeet Singh Bhatia proposed openstack-infra/reviewday master: Append a new section to neutron dashboard https://review.openstack.org/439114 | 20:51 |
openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: WIP: create a README_LOGS to document log files https://review.openstack.org/447653 | 20:51 |
*** e0ne has quit IRC | 20:53 | |
*** jerryz has joined #openstack-infra | 20:53 | |
*** trown is now known as trown|outtypewww | 20:54 | |
*** priteau_ has joined #openstack-infra | 20:55 | |
*** priteau has quit IRC | 20:59 | |
*** beslemon_ has joined #openstack-infra | 21:01 | |
*** beslemon has quit IRC | 21:02 | |
*** eroux has quit IRC | 21:02 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Create PReP boot partition for PPC https://review.openstack.org/447739 | 21:05 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] Test boot partition code https://review.openstack.org/448099 | 21:06 |
clarkb | pabelanger: fungi guessing we half did a migration to trove and never removed the old local db? | 21:07 |
pabelanger | maybe? | 21:07 |
pabelanger | will have to go back and check system-config | 21:07 |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: puppet/tripleo: stop testing Puppet 3 in Pike and beyond https://review.openstack.org/448280 | 21:08 |
*** Goneri has quit IRC | 21:09 | |
*** aysyd has quit IRC | 21:09 | |
*** Apoorva has quit IRC | 21:10 | |
fungi | clarkb: possible, yes | 21:10 |
*** dimtruck is now known as zz_dimtruck | 21:10 | |
*** Apoorva has joined #openstack-infra | 21:10 | |
*** esikache1 has joined #openstack-infra | 21:11 | |
zigo | pabelanger: Hi there! | 21:12 |
zigo | pabelanger: I tried to hardcode /etc/puppet/modules in install_modules.sh of system-config, but then the script doesn't even attempt to download puppet modules. | 21:12 |
zigo | So I'm not sure what to do now... :/ | 21:12 |
zigo | Any iea? | 21:12 |
zigo | idea | 21:12 |
pabelanger | zigo: log file? | 21:13 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Create PReP boot partition for PPC https://review.openstack.org/447739 | 21:13 |
pabelanger | zigo: it will git clone the modules | 21:14 |
zigo | pabelanger: http://sid.gplhost.com/os/build-image.log.txt | 21:14 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] Test boot partition code https://review.openstack.org/448099 | 21:14 |
zigo | pabelanger: That's with the hardcoding of things... | 21:14 |
pabelanger | zigo: I see them getting cloned into /usr/share/puppet/modules still | 21:15 |
*** cody-somerville has joined #openstack-infra | 21:15 | |
*** esikache1 has quit IRC | 21:15 | |
*** ldnunes has quit IRC | 21:16 | |
zigo | pabelanger: I don't... | 21:16 |
pabelanger | zigo: grep install_modules.sh | 21:16 |
zigo | It used to be "Cloning into", now it's printing that at all. | 21:16 |
pabelanger | Cloning into '/usr/share/puppet/modules/mysql_backup'... | 21:17 |
*** ym200 has quit IRC | 21:17 | |
pabelanger | am I looking at the wrong log? | 21:17 |
*** ym200 has joined #openstack-infra | 21:17 | |
zigo | pabelanger: I can't see "Cloning into '/usr/share/puppet/modules/mysql_backup'" | 21:18 |
zigo | Did you refresh your browser content ? | 21:18 |
pabelanger | yup | 21:19 |
pabelanger | downloading file locally too | 21:19 |
zigo | pabelanger: It seems to me you got an old version or something. Grepping -i for "cloning" doesn't show that line for me. | 21:20 |
*** ihrachys has quit IRC | 21:21 | |
pabelanger | zigo: set -xe for install_roles.sh and see what is going on | 21:21 |
*** tonytan4ever has quit IRC | 21:21 | |
pabelanger | possible issue with your new code | 21:21 |
zigo | pabelanger: Ok, will do, and will revert my patch of install_modules.sh | 21:22 |
*** tonytan4ever has joined #openstack-infra | 21:22 | |
zigo | Or shouldn't I ? | 21:22 |
pabelanger | zigo: give me a few days, I'll try and spin up a sid locally | 21:23 |
*** david-lyle has joined #openstack-infra | 21:23 | |
*** esikache1 has joined #openstack-infra | 21:24 | |
zigo | pabelanger: Where is install_roles.sh ? I can't find it neither in project-config or system-config ... | 21:24 |
pabelanger | zigo: oh, sorry. install_modules.sh | 21:24 |
pabelanger | in system-config | 21:24 |
pabelanger | zigo: the fix is to update /etc/puppet/puppet.conf and set the proper basemodule path | 21:24 |
pabelanger | you can likely use sed -i, like we do for templatedir | 21:25 |
pabelanger | but only do it for sid | 21:25 |
*** gildub has quit IRC | 21:25 | |
zigo | pabelanger: I don't see any "basemodule path" in the default puppet package's /etc/puppet/puppet.conf | 21:25 |
pabelanger | zigo: what do you have? | 21:26 |
zigo | Let me purge and reinstall the puppet package, just to make sure. | 21:26 |
zigo | pabelanger: http://paste.openstack.org/show/603688/ | 21:27 |
pabelanger | zigo: have to run, but will look and comment | 21:27 |
zigo | Thanks. | 21:28 |
*** ym200 has quit IRC | 21:28 | |
*** gildub has joined #openstack-infra | 21:32 | |
*** zz_dimtruck is now known as dimtruck | 21:34 | |
*** sree has joined #openstack-infra | 21:34 | |
*** annegentle has quit IRC | 21:34 | |
*** Jeffrey4l_ has quit IRC | 21:35 | |
openstackgerrit | Luz Cazares proposed openstack-infra/project-config master: Add refstack py35 functional test gate job https://review.openstack.org/448292 | 21:36 |
*** annegentle has joined #openstack-infra | 21:37 | |
*** neiljerram has quit IRC | 21:37 | |
*** alex_xu has quit IRC | 21:37 | |
*** ijw has joined #openstack-infra | 21:38 | |
*** alex_xu has joined #openstack-infra | 21:38 | |
*** gildub has quit IRC | 21:38 | |
*** sree has quit IRC | 21:38 | |
*** esikache1 has quit IRC | 21:41 | |
*** tonytan4ever has quit IRC | 21:42 | |
*** burgerk has quit IRC | 21:43 | |
*** esikache1 has joined #openstack-infra | 21:43 | |
openstackgerrit | Thomas Goirand proposed openstack-infra/system-config master: Do not install from puppetlab for deb https://review.openstack.org/445813 | 21:46 |
*** Jeffrey4l_ has joined #openstack-infra | 21:48 | |
*** gouthamr has quit IRC | 21:48 | |
*** xarses has quit IRC | 21:49 | |
*** xarses has joined #openstack-infra | 21:49 | |
*** esikache1 has quit IRC | 21:51 | |
*** marst has quit IRC | 21:51 | |
*** dprince has quit IRC | 21:54 | |
*** jcoufal has quit IRC | 21:55 | |
*** fguillot has quit IRC | 21:56 | |
*** ijw has quit IRC | 21:58 | |
*** ijw has joined #openstack-infra | 21:59 | |
*** matrohon has quit IRC | 22:00 | |
*** mat128 has quit IRC | 22:00 | |
*** annegentle has quit IRC | 22:00 | |
*** ssbarnea has quit IRC | 22:03 | |
*** mdrabe has quit IRC | 22:04 | |
*** gordc has quit IRC | 22:06 | |
*** ijw has quit IRC | 22:08 | |
*** Qiming has quit IRC | 22:09 | |
*** vhosakot has quit IRC | 22:09 | |
*** Qiming has joined #openstack-infra | 22:12 | |
*** beslemon_ has quit IRC | 22:13 | |
*** EricGonczer_ has quit IRC | 22:16 | |
*** baoli has quit IRC | 22:18 | |
*** jamesdenton has quit IRC | 22:19 | |
*** jaypipes has quit IRC | 22:22 | |
*** chlong has quit IRC | 22:27 | |
*** dimtruck is now known as zz_dimtruck | 22:29 | |
*** xyang1 has quit IRC | 22:31 | |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: Split multinode_setup.sh out into its own script for use with quickstart https://review.openstack.org/448302 | 22:36 |
*** adrian_otto has quit IRC | 22:44 | |
*** maratoid_ has joined #openstack-infra | 22:46 | |
mwhahaha | don't suppose anyone is around to merge https://review.openstack.org/#/c/447602/ as it's kinda blocking our newton gates | 22:51 |
*** adriant has joined #openstack-infra | 22:52 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Create PReP boot partition for PPC https://review.openstack.org/447739 | 22:53 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] Test boot partition code https://review.openstack.org/448099 | 22:53 |
clarkb | mwhahaha: done (-1'd for regex issue) | 22:53 |
*** eharney has quit IRC | 22:54 | |
* mwhahaha sighs ಠ_ಠ | 22:54 | |
openstackgerrit | Alex Schultz proposed openstack-infra/project-config master: tripleo: exclude reno jobs before Ocata https://review.openstack.org/447602 | 22:55 |
*** david-lyle has quit IRC | 22:57 | |
*** _d34dh0r53_ has joined #openstack-infra | 23:00 | |
*** _d34dh0r53_ has quit IRC | 23:00 | |
*** Apoorva_ has joined #openstack-infra | 23:01 | |
*** Apoorva has quit IRC | 23:03 | |
*** cloudkiller has joined #openstack-infra | 23:04 | |
*** _d34dh0r53_ has joined #openstack-infra | 23:04 | |
*** eglute_s has joined #openstack-infra | 23:04 | |
*** gildub has joined #openstack-infra | 23:06 | |
*** harlowja has quit IRC | 23:06 | |
openstackgerrit | Jamie Lennox proposed openstack-infra/zuul feature/zuulv3: Re-add the ability to set username on zuul-executor https://review.openstack.org/446308 | 23:07 |
*** eglute_s has quit IRC | 23:07 | |
*** cloudkiller has quit IRC | 23:07 | |
*** _d34dh0r53_ has quit IRC | 23:07 | |
*** mozart89|2 has quit IRC | 23:12 | |
*** andreww has quit IRC | 23:13 | |
*** xarses has quit IRC | 23:13 | |
*** priteau_ has quit IRC | 23:15 | |
*** priteau has joined #openstack-infra | 23:15 | |
jeblair | omg i hope we get to zuulv3 before that wraps around to 5 lines. | 23:16 |
openstackgerrit | Merged openstack-infra/project-config master: tripleo: exclude reno jobs before Ocata https://review.openstack.org/447602 | 23:20 |
clarkb | mwhahaha: ^ | 23:21 |
mwhahaha | clarkb: thanks | 23:21 |
*** rwsu has joined #openstack-infra | 23:22 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Create PReP boot partition for PPC https://review.openstack.org/447739 | 23:31 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] Test boot partition code https://review.openstack.org/448099 | 23:31 |
*** cloudkiller has joined #openstack-infra | 23:34 | |
*** eglute_s has joined #openstack-infra | 23:34 | |
*** priteau has quit IRC | 23:34 | |
*** _d34dh0r53_ has joined #openstack-infra | 23:34 | |
*** jamielennox is now known as jamielennox|away | 23:35 | |
*** mtanino has quit IRC | 23:38 | |
*** jamielennox|away is now known as jamielennox | 23:39 | |
*** priteau has joined #openstack-infra | 23:41 | |
*** priteau has quit IRC | 23:46 | |
*** _d34dh0r53_ has quit IRC | 23:46 | |
*** eglute_s has quit IRC | 23:46 | |
*** cloudkiller has quit IRC | 23:46 | |
*** cloudkiller has joined #openstack-infra | 23:47 | |
*** _d34dh0r53_ has joined #openstack-infra | 23:47 | |
*** eglute_s has joined #openstack-infra | 23:47 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Create PReP boot partition for PPC https://review.openstack.org/447739 | 23:49 |
*** irtermite has quit IRC | 23:50 | |
*** eglute has quit IRC | 23:50 | |
*** cloudnull has quit IRC | 23:50 | |
*** d34dh0r53 has quit IRC | 23:50 | |
*** cloudkiller is now known as cloudnull | 23:50 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] Test boot partition code https://review.openstack.org/448099 | 23:50 |
*** notmyname has quit IRC | 23:50 | |
*** bswartz has joined #openstack-infra | 23:52 | |
*** notmyname has joined #openstack-infra | 23:54 | |
*** askb has joined #openstack-infra | 23:55 | |
*** rockyg has quit IRC | 23:55 | |
*** hashar has quit IRC | 23:56 | |
openstackgerrit | Morgan Fainberg proposed openstack-infra/shade master: Convert test_role_assignments to requests mock https://review.openstack.org/448313 | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!