Tuesday, 2014-11-25

mordredTheJulia: the 7 is _always_ an accident00:00
*** david-lyle is now known as david-lyle_afk00:17
*** rushiagr_away is now known as rushiagr00:17
*** penick has quit IRC00:20
*** pradeep1 has quit IRC00:20
*** penick has joined #tripleo00:24
*** rushiagr is now known as rushiagr_away00:28
*** prad has quit IRC00:28
*** vinsh has joined #tripleo00:31
*** penick has quit IRC00:33
*** zhenzanz has joined #tripleo00:42
*** zhenzanz_ has joined #tripleo00:43
*** david-lyle_afk has quit IRC00:45
*** zhenzanz has quit IRC00:47
*** zhenzanz_ is now known as zhenzanz00:47
*** avozza is now known as zz_avozza01:05
*** marun has joined #tripleo01:08
*** ChuckC has quit IRC01:12
*** wuhg has joined #tripleo01:14
*** ChuckC has joined #tripleo01:18
*** ChuckC has quit IRC01:22
*** ChuckC has joined #tripleo01:23
*** weshay has joined #tripleo01:34
*** pradeep has joined #tripleo01:35
*** weshay has quit IRC01:54
*** nosnos has joined #tripleo02:01
*** zhenzanz_ has joined #tripleo02:03
*** zhenzanz has quit IRC02:04
*** zhenzanz_ is now known as zhenzanz02:04
*** pradeep has quit IRC02:09
*** jiangfei has quit IRC02:12
*** jiangfei has joined #tripleo02:13
*** jiangfei has quit IRC02:13
openstackgerritRichard Su proposed openstack/tripleo-image-elements: Wait for tuskar-api to start up  https://review.openstack.org/13581402:15
*** rwsu has quit IRC02:16
*** cwolferh has quit IRC02:31
*** jerryz has joined #tripleo02:34
*** ramishra has joined #tripleo02:36
*** vipul has quit IRC02:43
openstackgerritMerged openstack/diskimage-builder: Check python with flake8 instead of dib-lint  https://review.openstack.org/13498202:56
*** yamahata has joined #tripleo02:57
openstackgerritMerged openstack/diskimage-builder: Make some pkg-map errors soft  https://review.openstack.org/13557702:57
*** zhenzanz has quit IRC03:03
*** zhenzanz has joined #tripleo03:08
*** zhenzanz_ has joined #tripleo03:11
*** zhenzanz has quit IRC03:13
*** zhenzanz_ is now known as zhenzanz03:14
*** jerryz has quit IRC03:27
*** nosnos has quit IRC03:29
*** pradeep has joined #tripleo03:50
*** untriaged-bot has joined #tripleo04:00
untriaged-botUntriaged bugs so far:04:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139121804:00
uvirtbotLaunchpad bug 1391218 in tripleo "Configuration Dependent on HAProxy" [Undecided,In progress]04:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/138706104:00
uvirtbotLaunchpad bug 1387061 in tripleo "deploy under cloud failure due to pacemaker " [Undecided,New]04:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139364304:00
uvirtbotLaunchpad bug 1393643 in tripleo "haproxy start failed loop with 'Starting proxy horizon: cannot bind socket'" [Undecided,New]04:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139141204:00
uvirtbotLaunchpad bug 1391412 in tripleo "devtest  deploy overcloud successfully,but there have one baremetal in  Maintenance state" [Undecided,New]04:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/138748704:00
uvirtbotLaunchpad bug 1387487 in tripleo "tripleo-image-elements/elements/tuskar-ui /os-refresh-config /post-configure.d/101-tuskar-ui  needs authentication from Keystone" [Undecided,New]04:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139330404:00
uvirtbotLaunchpad bug 1393304 in tripleo "create-nodes failure for customised pool" [Undecided,New]04:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/139165604:00
uvirtbotLaunchpad bug 1391656 in diskimage-builder "There is no way to customize the installation of the bootloader" [Undecided,New]04:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139329804:00
uvirtbotLaunchpad bug 1393298 in tripleo "keepalived VRRP_Script(chk_haproxy) timed out" [Undecided,In progress]04:00
*** untriaged-bot has quit IRC04:00
*** nosnos has joined #tripleo04:03
*** pensu has joined #tripleo04:12
*** julim has quit IRC04:18
*** jerryz has joined #tripleo04:28
*** vipul has joined #tripleo04:28
*** subscope_ has joined #tripleo04:55
*** subscope_ has quit IRC05:25
*** vinsh has quit IRC05:27
*** nosnos has quit IRC05:30
*** nosnos_ has joined #tripleo05:30
*** pradeep has quit IRC05:59
tchaypoI went to bed at 10pm, gfidente 's time. I'm online at 7am gfidente 's time. in between, he's had time to look at https://review.openstack.org/136894 and comment that he isn't seeing the reported problem. I'm adding another person to my "apparently doesn't sleep" list.06:02
tchaypogreghaynes: multiple devtest runs - in sequence or in parallel?06:03
greghaynesparallel06:03
tchaypoI'm going to assume in parallel, and it shouldn't be too tricky, we implicitly support this because it's used in CI06:03
greghaynes:D06:03
tchaypothere's some point where you provide an "env number" or something and it creates seed$ENV_NUM06:03
tchaypoand the baremetal bridges get numbered too06:04
tchaypothe one tricky part is that i had a change that had something to do with trying to be more explicit about where configs were read from, but it got voted down, so from memory there's still a secretive read from $PWD06:05
tchayposo you'll need to put your local env files and stuff in different directories and make sure you run from the right place06:05
greghaynesok, but sounds like a totally reasonable thing to try06:05
tchaypoyeah, totes.06:06
tchaypoif you have enough RAM of course06:06
tchaypoI *may* have done it once on my 32Gb machine06:07
StevenKYou might need two $TRIPLEO_ROOT's too06:07
StevenKs/two/n/06:07
greghaynesthis one has 64gb so I think I can get away with 206:07
StevenKgreghaynes: HA or non-HA?06:08
greghaynesIdeally HA but doesnt really matter, I just want to find a way to dev more things at once06:08
greghaynesI think HA is under 32gb still06:09
StevenK64G gives you 4 at 15G each06:09
StevenK(non-HA, 5 VMs per test environment)06:10
jerryztchaypo: 5am-9am was the sleep i got. i need some of my wife's time-zone anti-wrinkle eye cream.06:10
greghaynestchaypo: did you see my comments about the local_ip thing06:12
greghaynesI need to dig more into it, but it seems out upstart script isnt correctly detecting that service failing to start06:12
greghaynes(or if someone else wants to dig more thatd be awesome)06:12
greghaynesfixing this would make our CI detect this fail which would be awesome06:13
tchaypogreghaynes: comments where? Nothing on the review06:13
tchaypoOh, i did see your comments about upstart, yes.06:14
greghaynesjust in backlog06:14
tchaypoSo how should we detect that? It sounds like there's a lot of exec to track06:14
StevenKUpstart uses ptrace to follow forks, so it should deal with double and triple fork()s, I thought06:15
greghaynesuhh, its a bit beyond my upstart skills... but essentially we need to either be smart about telling upstart what PID to track or telling it the right number of forks to expect06:15
greghaynes*shrug*06:16
greghaynesits pretty easy to debug though - just run devtest and in the overcloud youll see service neutron-openvswitch-agent status show it as running but the pid it says has exited already06:17
* greghaynes -> bed06:18
*** killer_prince is now known as lazy_prince06:18
tchayponight greghaynes06:19
*** ifarkas has joined #tripleo06:19
*** rushiagr_away is now known as rushiagr06:19
* tchaypo kicks off a devtest run06:24
*** k4n0 has joined #tripleo06:24
*** nosnos_ has quit IRC06:34
*** nosnos has joined #tripleo06:34
*** ifarkas has quit IRC06:39
openstackgerritLadislav Smola proposed openstack/tripleo-incubator: Switch to os-cloud-config register-endpoints  https://review.openstack.org/11384106:51
*** pradeep has joined #tripleo07:04
*** mrunge has joined #tripleo07:07
*** cody-somerville has quit IRC07:09
*** dshulyak_ has joined #tripleo07:21
*** cody-somerville has joined #tripleo07:22
*** cody-somerville has joined #tripleo07:22
tchaypojerryz: I can't fetch your patch07:33
tchaypofatal: Couldn't find remote ref refs/changes/94/136894/207:33
tchaypoDid you somehow upload it as a draft or something?07:34
tchayponope07:37
tchaypoit fetch https://review.openstack.org/openstack/tripleo-heat-templates refs/changes/94/136894/2 && git checkout FETCH_HEAD07:37
tchaypoworks07:37
*** jtomasek has joined #tripleo07:37
tchaypowith an extra g on the front07:37
tchaypo... because that's in t-h-t and i was previously trying to pull it into incubator. well done me!07:38
*** panda has quit IRC07:41
*** panda has joined #tripleo07:42
*** pradeep has quit IRC07:49
*** rdopiera has joined #tripleo07:51
*** pradeep has joined #tripleo07:55
*** jprovazn has joined #tripleo07:57
*** jcoufal has joined #tripleo08:00
*** athomas has joined #tripleo08:05
*** lucasagomes has joined #tripleo08:06
*** lucasagomes has quit IRC08:06
*** lucasagomes has joined #tripleo08:07
*** ifarkas has joined #tripleo08:10
*** dtantsur has joined #tripleo08:10
*** dtantsur has quit IRC08:11
*** dtantsur_ has joined #tripleo08:11
*** dtantsur_ is now known as dtantsur08:11
*** bvandenh has joined #tripleo08:15
*** jistr has joined #tripleo08:18
GheRiveromorning all08:20
openstackgerritMerged openstack/tripleo-image-elements: Set explicit route for VIPs  https://review.openstack.org/13561008:30
openstackgerritMerged openstack/tripleo-image-elements: Migrate ironic-conductor to svc-map  https://review.openstack.org/13602108:31
openstackgerritMerged openstack/tripleo-image-elements: Migrate heat-engine element to svc-map  https://review.openstack.org/13407908:31
openstackgerritMerged openstack/tripleo-image-elements: Migrate keystone to svc-map  https://review.openstack.org/13609708:32
*** pradeep1 has joined #tripleo08:33
*** pradeep has quit IRC08:33
*** bvandenh has quit IRC08:36
*** jiangfei has joined #tripleo08:47
*** mkerrin has quit IRC08:48
*** bvandenh has joined #tripleo08:52
*** dshulyak_ has quit IRC08:54
*** regebro has joined #tripleo08:57
*** zhenzanz has quit IRC09:03
*** jang1 has joined #tripleo09:07
*** yamahata has quit IRC09:11
*** derekh has joined #tripleo09:14
*** jistr has quit IRC09:33
*** sirushti has left #tripleo09:33
*** pradeep1 has quit IRC09:35
*** pradeep has joined #tripleo09:36
*** pensu has quit IRC09:49
*** zz_avozza is now known as avozza09:57
*** untriaged-bot has joined #tripleo10:00
untriaged-botUntriaged bugs so far:10:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139121810:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/138706110:00
uvirtbotLaunchpad bug 1391218 in tripleo "Configuration Dependent on HAProxy" [Undecided,In progress]10:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139364310:00
uvirtbotLaunchpad bug 1387061 in tripleo "deploy under cloud failure due to pacemaker " [Undecided,New]10:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139141210:00
uvirtbotLaunchpad bug 1393643 in tripleo "haproxy start failed loop with 'Starting proxy horizon: cannot bind socket'" [Undecided,New]10:00
uvirtbotLaunchpad bug 1391412 in tripleo "devtest  deploy overcloud successfully,but there have one baremetal in  Maintenance state" [Undecided,New]10:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/138748710:00
uvirtbotLaunchpad bug 1387487 in tripleo "tripleo-image-elements/elements/tuskar-ui /os-refresh-config /post-configure.d/101-tuskar-ui  needs authentication from Keystone" [Undecided,New]10:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139330410:00
uvirtbotLaunchpad bug 1393304 in tripleo "create-nodes failure for customised pool" [Undecided,New]10:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/139165610:00
uvirtbotLaunchpad bug 1391656 in diskimage-builder "There is no way to customize the installation of the bootloader" [Undecided,New]10:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139329810:00
uvirtbotLaunchpad bug 1393298 in tripleo "keepalived VRRP_Script(chk_haproxy) timed out" [Undecided,In progress]10:00
*** untriaged-bot has quit IRC10:00
*** jistr has joined #tripleo10:03
openstackgerritMerged openstack/tripleo-image-elements: Migrate keepalived to svc-map  https://review.openstack.org/13604510:04
*** pensu has joined #tripleo10:04
*** nosnos has quit IRC10:08
*** nosnos has joined #tripleo10:09
*** mkerrin has joined #tripleo10:11
*** jp_at_hp has joined #tripleo10:16
*** rlandy has joined #tripleo10:33
* tchaypo packs for train10:34
gfidentehuh :)10:34
tchaypowill be back online from the train wifi after ~2pm10:34
gfidenteleading where?10:34
tchaypostuttgart -> Frankfurt today10:35
gfidenteoh10:35
gfidenteis it sunny at least?10:36
*** blinky_ghost has joined #tripleo10:38
openstackgerritGhe Rivero proposed openstack/diskimage-builder: Warning when using pypi element without a mirror  https://review.openstack.org/13531610:41
*** akrivoka has joined #tripleo11:12
*** k4n0 has quit IRC11:20
*** akrivoka has quit IRC11:42
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add ceph-source.yaml to overcloud.yaml Makefile target  https://review.openstack.org/13702811:53
*** akrivoka has joined #tripleo11:54
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add ceph-source.yaml to the overcloud.yaml Makefile target  https://review.openstack.org/13702811:55
openstackgerritGiulio Fidente proposed openstack/tripleo-image-elements: Add Ceph elements useful to configure monitors and OSDs  https://review.openstack.org/13702912:00
openstackgerritGiulio Fidente proposed openstack/tripleo-incubator: Add support for CEPHSTORAGESCALE to devtest  https://review.openstack.org/13703112:02
gfidente^^ guys it seems I set the wrong topic on these submissions but they are related to https://blueprints.launchpad.net/tripleo/+spec/tripleo-kilo-cinder-ha12:04
*** sirushti has joined #tripleo12:04
*** pblaho has joined #tripleo12:13
*** rhallisey has joined #tripleo12:15
*** rhallisey has quit IRC12:18
*** rhallisey has joined #tripleo12:19
*** rbrady-afk is now known as rbrady12:24
openstackgerritMerged openstack/diskimage-builder: Fail helpfully if no elements are specified  https://review.openstack.org/13645012:29
*** pradeep has quit IRC12:32
*** jistr is now known as jistr|english12:32
blinky_ghostlsmola: good morning12:35
lsmolablinky_ghost: hello12:35
blinky_ghostlsmola: I'm deploying the overcloud controller node. I see some DB connections errors in ceilometer. Checking the file ceilometer.conf I see this: "connection=mysql://ceilometer:unset@192.0.2.64/ceilometer" Should it set the password?12:36
lsmolablinky_ghost: you have to set the password in service configuration12:37
lsmolablinky_ghost: but this one is DB, hm12:37
lsmolablinky_ghost: well that should be in service configuration too, as Ceilometer password, AFAIK12:38
blinky_ghostlsmola: I see that it generated the password but it's not filling up in the conf. Nova same thing: connection=mysql://nova:unset@192.0.2.64/nova12:39
blinky_ghostlsmola: I'll try to fill up the password before deploying to see if it changes anything12:40
lsmolablinky_ghost: hm I see this is hardcoded in the template https://github.com/openstack/tripleo-heat-templates/blob/master/controller.yaml#L45312:40
lsmolablinky_ghost: the generated password is used only here https://github.com/openstack/tripleo-image-elements/blob/master/elements/ceilometer/os-apply-config/etc/ceilometer/ceilometer.conf#L7512:40
lsmolablinky_ghost: as the service password12:40
*** jdob has joined #tripleo12:41
*** weshay has joined #tripleo12:42
blinky_ghostlsmola:  so it's a bug?12:42
lsmolablinky_ghost: it's also in original templates https://github.com/openstack/tripleo-heat-templates/blob/master/controller.yaml#L45312:43
lsmolablinky_ghost: give me a sec to figure it out12:45
blinky_ghostlsmola: the "unset" value is also in the other services, "heat, nova, keystone"12:46
blinky_ghostlsmola: ok thanks12:46
lsmolablinky_ghost: yeah I see that12:46
lsmolablinky_ghost: well that definitely doesn't seem to be right12:46
lsmolablinky_ghost: to have password to all db's 'unset' :-)12:47
lsmolablinky_ghost: but that doesn't explain the connection error12:48
blinky_ghostlsmola: TRACE ceilometer DBConnectionError: (OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.64' (113)")12:49
lsmolalifeless: we are not generating db passwords? ^12:49
lsmolablinky_ghost: and can you do that manually?12:49
blinky_ghostlsmola: yes I seem to have another error with keepalived, I cannot access that ip12:50
lsmolablinky_ghost: ah, ok12:50
sdakemorning12:53
blinky_ghostlsmola: I have this in keepalived12:53
blinky_ghostlsmola:     virtual_ipaddress {12:53
blinky_ghost           192.0.2.64 dev br-ex12:53
blinky_ghost           192.0.2.63 dev int_public12:53
blinky_ghost      }12:53
*** jcoufal has quit IRC12:56
*** jcoufal has joined #tripleo12:57
jprovaznblinky_ghost: Hi, can you check if mysql is really running? (e.g. "mysql -u root" on one of nodes) and if other load-balanced services are not accessible too (e.g. "nova --debug list")12:59
jprovaznblinky_ghost: also can you see 192.0.2.64 in output of "ip addr" on your controller node?13:00
blinky_ghostjprovazn: mysql is running but the virtual ips are not.13:01
blinky_ghostjprovazn: I see this:  Keepalived_vrrp[15210]: Default interface eth0 does not exist and no interface specified. ...ress.13:01
blinky_ghostNov 25 07:54:50 ov-4j2jqzcmvxu-0-rxu4gs3amdly-controller-rnaf5rlxk2sq.novalocal Keepalived_vrrp[15210]: Configuration error: VRRP definition must belong to an interface13:01
blinky_ghostNov 25 07:54:50 ov-4j2jqzcmvxu-0-rxu4gs3amdly-controller-rnaf5rlxk2sq.novalocal Keepalived_vrrp[15210]: Default interface eth0 does not exist and no interface specified. ...ress.13:01
blinky_ghostNov 25 07:54:50 ov-4j2jqzcmvxu-0-rxu4gs3amdly-controller-rnaf5rlxk2sq.novalocal Keepalived_vrrp[15210]: VRRP_Instance(VI_1) Unknown interface !13:01
openstackgerritMerged openstack/tuskar-ui: Fix the progress js  https://review.openstack.org/13642513:02
*** ramishra has quit IRC13:03
*** morazi has joined #tripleo13:04
jprovaznblinky_ghost: can you paste whole keepalived.conf and "ip addr" output?13:05
jprovaznlooks like wring interface name was used maybe?13:05
*** sirushti has left #tripleo13:05
*** dprince has joined #tripleo13:06
openstackgerritNicholas Randon proposed openstack/tripleo-image-elements: Split RabbitMQ actions out of startup script  https://review.openstack.org/13424913:19
tchaypoand our train is delayed 80 minutes, meaning we'll miss our connection, meaning i'm now working on an alternate route..13:27
*** pradeep has joined #tripleo13:39
*** nosnos has quit IRC13:48
*** nosnos has joined #tripleo13:49
*** jprovazn has quit IRC13:49
*** bvandenh has quit IRC13:53
*** nosnos has quit IRC13:54
*** yamahata has joined #tripleo13:58
*** jcoufal has quit IRC14:03
*** jcoufal has joined #tripleo14:04
*** bvandenh has joined #tripleo14:08
*** pensu has quit IRC14:09
*** jistr|english is now known as jistr14:13
*** jprovazn has joined #tripleo14:13
*** rushiagr is now known as rushiagr_away14:24
openstackgerritDerek Higgins proposed openstack/tripleo-image-elements: Add bandersnatch element  https://review.openstack.org/13708314:32
*** jesusaurus has quit IRC14:35
*** pradeep1 has joined #tripleo14:36
*** pradeep has quit IRC14:39
blinky_ghostjprovazn: it's seems it's working now, I using the wrong interface name14:44
jprovaznblinky_ghost, ah, glad it works now14:45
blinky_ghostjprovazn: now I cannot login horizon dashboard trying to figure out what's wrong :)14:46
*** rushiagr_away is now known as rushiagr14:51
*** jcoufal_ has joined #tripleo14:53
*** jcoufal has quit IRC14:53
*** jcoufal_ has quit IRC14:54
*** jcoufal has joined #tripleo14:54
*** jesusaurus has joined #tripleo14:58
*** tzumainn has joined #tripleo15:02
*** yamahata has quit IRC15:08
*** yamahata has joined #tripleo15:16
openstackgerritstephen-mulcahy proposed openstack/tripleo-image-elements: Add new nscd element  https://review.openstack.org/13709915:26
openstackgerritAna Krivokapic proposed openstack/tuskar-ui: Make all node forms update on IP change  https://review.openstack.org/13640715:31
*** rwsu has joined #tripleo15:31
rdopieraakrivoka: about that patch ^^15:34
rdopieraakrivoka: https://review.openstack.org/#/c/136407/2/tuskar_ui/infrastructure/templates/infrastructure/nodes/_nodes_formset_form.html15:34
rdopieraakrivoka: is there any particular reason why you moved the 'var $nav_link' line?15:34
akrivokardopiera: yeah, that solved the problem :D15:35
akrivokardopiera: don't ask me why15:35
* rdopiera scratches his head15:35
rdopieraoh well15:36
rdopieraas long as it works...15:36
akrivokalol15:36
*** pradk has joined #tripleo15:39
*** vinsh has joined #tripleo15:42
*** jehb_ has joined #tripleo15:42
*** sdake has quit IRC15:51
blinky_ghostlsmola: I've made some progress, I've managed to deploy the overcloud and get to the login interface. I had to change ALLOWED_HOSTS = ['*'] in horizon to access to the interface. Then I couldn't login so put selinux=permissive and rebooted the controller. The problem is that when I reboot the controller it uses br-ex in the interface em2 that binds openstack services and fails to get ip from dhcp. If I delete the br-ex I can get ip again.15:52
openstackgerritDmitry Tantsur proposed openstack/diskimage-builder: Add element for hardware discovery ramdisk for ironic-discoverd  https://review.openstack.org/12215115:52
*** avozza is now known as zz_avozza15:53
jerryzderekh, tchaypo: ping?15:54
dtantsurmarios_, hey, I revived https://review.openstack.org/#/c/122151/ mind having a look?15:54
*** sdake has joined #tripleo15:55
*** sdake has quit IRC15:55
*** sdake has joined #tripleo15:55
*** daneyon has joined #tripleo15:56
*** jtomasek has quit IRC15:57
*** untriaged-bot has joined #tripleo16:00
untriaged-botUntriaged bugs so far:16:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139121816:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/138706116:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139364316:00
uvirtbotLaunchpad bug 1391218 in tripleo "Configuration Dependent on HAProxy" [Undecided,In progress]16:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139141216:00
uvirtbotLaunchpad bug 1387061 in tripleo "deploy under cloud failure due to pacemaker " [Undecided,New]16:00
uvirtbotLaunchpad bug 1393643 in tripleo "haproxy start failed loop with 'Starting proxy horizon: cannot bind socket'" [Undecided,New]16:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/138748716:00
uvirtbotLaunchpad bug 1391412 in tripleo "devtest  deploy overcloud successfully,but there have one baremetal in  Maintenance state" [Undecided,New]16:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139330416:00
uvirtbotLaunchpad bug 1387487 in tripleo "tripleo-image-elements/elements/tuskar-ui /os-refresh-config /post-configure.d/101-tuskar-ui  needs authentication from Keystone" [Undecided,New]16:00
uvirtbotLaunchpad bug 1393304 in tripleo "create-nodes failure for customised pool" [Undecided,New]16:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/139165616:00
uvirtbotLaunchpad bug 1391656 in diskimage-builder "There is no way to customize the installation of the bootloader" [Undecided,New]16:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139329816:00
uvirtbotLaunchpad bug 1393298 in tripleo "keepalived VRRP_Script(chk_haproxy) timed out" [Undecided,In progress]16:00
*** untriaged-bot has quit IRC16:00
openstackgerritMerged openstack/tuskar-ui: Make all node forms update on IP change  https://review.openstack.org/13640716:02
tchaypojerryz: yo16:02
*** pradeep has joined #tripleo16:03
tchaypojerryz: just getting from train to hotel, will be properly online shortly16:03
*** jprovazn is now known as jprovazn_ffl16:03
*** jprovazn_ffl is now known as jprovazn_bbl16:03
marios_dtantsur: seem to be stuck in calls this afternoon, will try later or tomorrow am16:03
dtantsurcool thanks!16:04
*** pradeep1 has quit IRC16:04
openstackgerritstephen-mulcahy proposed openstack/tripleo-image-elements: Add new nscd element  https://review.openstack.org/13709916:05
*** dshulyak_ has joined #tripleo16:09
*** pradeep1 has joined #tripleo16:13
*** pradeep has quit IRC16:14
*** radez is now known as radez_g0n316:17
*** ramishra has joined #tripleo16:19
*** pradeep has joined #tripleo16:20
*** pradeep1 has quit IRC16:22
*** pradeep1 has joined #tripleo16:25
*** dsneddon has joined #tripleo16:27
*** pradeep has quit IRC16:28
jerryztchaypo: where do you set the maxconn for rabbitmq in haproxy.cfg at hp1 or hp2 region, where i believe there are plenty machines that can generate over 150 sessions.16:29
jerryztchaypo: i didn't see maxconn set for rabbitmq in overcloud.yaml though haproxy element provides the flexiblity to configure it16:32
*** kfox1111 has joined #tripleo16:43
kfox1111dib question. Has anyone build a software raid element for the root partition?16:43
*** dkehn has quit IRC16:44
*** zz_avozza is now known as avozza16:46
*** dkehn has joined #tripleo16:46
*** dtantsur has quit IRC16:52
*** radez_g0n3 is now known as radez16:56
*** ifarkas has quit IRC16:56
*** kfox1111 has quit IRC16:57
*** lucasagomes has quit IRC16:58
*** athomas has quit IRC16:59
*** pensu has joined #tripleo17:01
*** rdopiera has quit IRC17:02
*** jtomasek has joined #tripleo17:02
openstackgerritJerry Zhao proposed openstack/tripleo-heat-templates: bump up the number of sesson limit for rabbitmq  https://review.openstack.org/13714217:07
*** julim has joined #tripleo17:07
gfidenteguys, I submitted a number of changes to implement he cinder/ha spec17:12
gfidentebut the spec itself isn't approved yet17:13
gfidenteso any up (or down?) vote there would be useful17:13
*** yamahata has quit IRC17:14
*** StevenK has quit IRC17:18
openstackgerritDan Prince proposed openstack/tripleo-image-elements: Nova: don't hard code block_migration_flag  https://review.openstack.org/13714317:19
*** StevenK has joined #tripleo17:20
*** bvandenh has quit IRC17:24
*** derekh has quit IRC17:25
*** jtomasek has quit IRC17:26
openstackgerritJerry Zhao proposed openstack/tripleo-image-elements: move maxconn from each backend to the overall configuration  https://review.openstack.org/13714817:27
openstackgerritDan Prince proposed openstack/tripleo-incubator: Configure Cinder Volume service v2 endpoints  https://review.openstack.org/13715017:30
openstackgerritDan Prince proposed openstack/tripleo-incubator: Configure Cinder Volume service v2 endpoints  https://review.openstack.org/13715017:32
openstackgerritDaneyon Hansen proposed stackforge/kolla: Adds Neutron Networking Support  https://review.openstack.org/13506017:33
*** lazy_prince is now known as killer_prince17:36
openstackgerritDan Prince proposed openstack/tripleo-image-elements: Switch Nova to the Cinder v2 API  https://review.openstack.org/13715117:39
*** dkehn has quit IRC17:39
*** jcoufal has quit IRC17:40
*** dkehn has joined #tripleo17:41
*** pradeep1 has quit IRC17:42
*** wuhg has quit IRC17:43
*** jerryz has quit IRC17:49
*** jerryz has joined #tripleo17:49
*** jistr has quit IRC17:52
tchaypookay. finally i am in my hotel17:52
tchaypoonly a few hours late, thanks deutschbahn!17:53
openstackgerritMerged openstack/os-collect-config: Add unit test for heat_local  https://review.openstack.org/12101517:53
*** jerryz has quit IRC17:53
tchaypojerryz: so, I don’t oppose this particular change (although spamaps may feel differently), but I do feel like it’s a great example of one of the problems we have with tripleo - if we’re note careful we are going to end up with every single config option for every single thing we can configure defined in the heat templates17:55
tchaypoI feel like this (and the other things in the “options” block there) are good candidates for things we could put in pass-through config17:56
tchaypobut I’m not 100% clear on how to implement that17:56
*** akrivoka has quit IRC17:58
*** rushiagr is now known as rushiagr_away17:59
*** avozza is now known as zz_avozza18:04
*** rhallisey has quit IRC18:06
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Implement a Puppet overcloud compute config  https://review.openstack.org/13030418:09
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Drive network configuration via software config  https://review.openstack.org/13062418:09
dprinceEmilienM: hi, I just implemented and tested a bunch of the Puppet Nova suggestions we talked about here: https://review.openstack.org/#/c/130304/6/puppet_manifests/overcloud_compute.pp,cm18:10
EmilienMdprince: o/18:10
EmilienMlooking right now.18:10
dprinceEmilienM: Augeas is gone, ML2 is in. Got rid of some other crufty stuff.18:10
dprinceEmilienM: still some things for parity but much cleaner I think18:11
EmilienMyeah18:11
EmilienMlet me review it18:11
dprinceEmilienM: setting migration_support=true instead of all the manual stuff I was doing was the ticket18:11
EmilienMdprince: +118:12
* dprince notes that it had been a year since he had mucked about Puppet things18:12
*** pblaho has quit IRC18:16
*** pblaho has joined #tripleo18:16
*** rhallisey has joined #tripleo18:21
*** pblaho has quit IRC18:22
*** cwolferh has joined #tripleo18:26
dprincetchaypo: should we update os-net-config so that default routes don't require the ip_netmask?18:27
dprincetchaypo: https://review.openstack.org/#/c/135727/318:27
dprincedsneddon: ^^18:27
dsneddonlooking18:28
dsneddonYes, I think that makes sense. Netmask should not be required.18:29
dprincedsneddon: I agree, you want to file a ticket and take this perhaps? (https://launchpad.net/os-net-config)18:31
dsneddondprince, sounds good, will do.18:31
*** dshulyak_ has quit IRC18:31
dprincedsneddon: I'd mark that as high, seems like quite an oversite on my part18:32
dsneddondprince, basically, just add the logic that netmask is inferred if default: true?18:32
*** ramishra has quit IRC18:33
dprincedsneddon: yes, that sounds reasonable to me18:34
*** penick has joined #tripleo18:34
*** rushiagr_away is now known as rushiagr18:36
daneyonlarsks: take a look at https://github.com/GoogleCloudPlatform/kubernetes/issues/1307 re kolla networking changes.18:37
tchaypodprince: as it happens, i have a change in review for doing exactly that18:39
dprincetchaypo: Great!18:40
tchaypohttps://review.openstack.org/#/c/136558/18:40
dprincedsneddon: ^^ sounds like we got it18:41
dsneddonbingo, thanks tchaypo18:41
tchaypoi had to add it to the config as well, because i couldn’t figure out how to install os-net-config from git on my test machine, and it was late at night, and i rammed that in just to get me through till awake hours18:41
tchaypothen the next morning I realised that change couldn’t be tested because our test environment doesn’t install from git either18:41
tchaypohttps://review.openstack.org/#/c/136811/18:42
tchayposorry for stealing work from you dsneddon ;)18:42
tchaypobut at least this way you get to find something more interesting to do :)18:42
dsneddontchaypo, one thing, though, is that your change might not do the right thing if default: true and an incorrect netmask is used.18:42
dsneddonAt least, it won't correct it.18:42
tchaypowell, you do still get to review and pick holes in my changes18:43
tchaypobut that’s more fun, right?18:43
dsneddonthe seats in the peanut gallery are very comfortable18:43
tchaypoI just noticed that jenkins gave a -1 to https://review.openstack.org/#/c/136811/18:44
tchaypoI’m assuming that must be because of the NOT_REGISTEREDs18:44
greghaynestchaypo: you asked about plans for https://review.openstack.org/#/c/132633/. I was thinking of switching it to be a blacklist instead of a whitelist18:44
greghaynesunfortunately its less important than fixing our upstart script for neutron-ovs-agent and then some tls stuff so :/18:44
tchaypogreghaynes: in that case, would you mind abandoning it?18:45
tchaypoit’s sitting in my list of “stuff you commented on once and shall be nagged about forever"18:45
*** jprovazn_bbl is now known as jprovazn18:45
greghaynesor how about wip18:45
tchaypomeh. Anywhere wip would hide it is somewhere I’d also be hiding anything with a -218:46
tchaypowip would still show it on the default dashboard18:46
greghayneslifeless: https://review.openstack.org/#/c/132633/18:46
greghayneslifeless: hopefully you havent left for vacation already18:47
tchaypodsneddon: so when you say that it “might not do the right thing if default: true and an incorrect netmask is used” - I’m not sure i understand you18:47
larsksdaneyon: Thanks for the pointer. Isee that discussions has been going on for a while :)18:47
tchaypoto me it look as though both code paths get the same amount of validation - i.e., none unless it’s hidden inside the netaddr.IPNetwork() they both call18:47
daneyonlarsks: yup. I'm weeding through it now.18:48
dprincetchaypo: I marked it as a WIP because it would break CI18:48
dprincetchaypo: +1 for your openstack-infra change, best I can do there to push that along18:48
tchaypodsneddon: i think maybe you mean that if someone provides default: true and also use a net mask other than 0.0.0.0/0, we’ll pass through their erroneous netmask?18:48
dsneddontchaypo, If route.default is true but there is a netmask as well (say /8), you pass it on18:48
tchaypoyeah, that’s true. I wasn’t sure how to handle that.18:49
tchaypoI’d be happy to change the first test to just “if route.default” if you think it makes things less surprising18:50
dprincetchaypo/dsneddon: I commented on the review but if we do decide to do any validation here it might be nice if it lived in the object model and not in the providers (eni,ifcfg)18:50
dsneddonYour way might actually be less dangerous, now that I think about it.18:50
dsneddonBecause we wouldn't want something that was a route to 10.0.0.0/8 to suddenly turn into a default route just because it was marked default18:51
dsneddondprince, I agree that validation should live in the object model18:53
tchaypoI agree that any validation we do should be done once rather than once per provider; I’m not convinced we should be validating though. I feel like it’s the kind of thing where if it wasn’t what the user wanted they’ll notice soon enough through other means; whereas if it was what they wanted i’d like to keep out of their way. At most I think we18:54
tchayposhould log a WARN saying that this seems unexpected, we don’t know what to do, so we’re ignoring the strange input18:54
*** jp_at_hp has quit IRC18:54
*** penick has quit IRC18:54
dsneddontchaypo, In this case the minimal validation that netaddr does is proper and I think the change looks good as-is. Thanks.18:57
tchaypovery well, I shall leave it alone :)18:57
*** jtomasek has joined #tripleo18:58
*** zz_avozza is now known as avozza18:59
*** rwsu has quit IRC19:07
*** cwolferh has quit IRC19:08
*** penick has joined #tripleo19:08
*** jistr has joined #tripleo19:09
*** pensu has quit IRC19:20
*** blinky_ghost has quit IRC19:27
*** dshulyak_ has joined #tripleo19:27
*** jtomasek has quit IRC19:28
*** avozza is now known as zz_avozza19:34
*** cwolferh has joined #tripleo19:37
openstackgerritMerged openstack/os-cloud-config: Updated from global requirements  https://review.openstack.org/13597019:39
*** ChuckC has quit IRC19:40
*** penick has quit IRC19:49
*** penick has joined #tripleo19:49
*** penick has quit IRC19:51
*** penick has joined #tripleo19:52
openstackgerritMerged openstack/tripleo-image-elements: Install os clients from git  https://review.openstack.org/13308219:53
*** dshulyak_ has quit IRC19:59
*** ChuckC has joined #tripleo20:01
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Compute nodes don't need nova_dsn  https://review.openstack.org/13718320:03
openstackgerritMerged openstack/tripleo-incubator: Configure Cinder Volume service v2 endpoints  https://review.openstack.org/13715020:04
openstackgerritDan Prince proposed openstack/tripleo-image-elements: Only configure Neutron DB connection if it is set  https://review.openstack.org/13719020:11
greghaynesSpamapS: Hey, youre an upstarter, you around?20:12
greghaynesSpamapS: Re: bug in topic20:12
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Compute nodes don't need nova_dsn  https://review.openstack.org/13718320:17
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Compute nodes don't need neutron_dsn  https://review.openstack.org/13719220:17
*** rushiagr is now known as rushiagr_away20:22
*** rwsu has joined #tripleo20:22
openstackgerritgreghaynes proposed openstack/tripleo-image-elements: Longer upstart sleep for neutron-ovs-agent  https://review.openstack.org/13719520:23
greghaynestchaypo: ^20:23
greghaynesSpamapS: ^ is horrible so hopefully you (or someone) has ideas on a better solution20:23
tchaypoheh20:24
tchaypoi have not had time to look at that20:24
tchaypo“just do a devtest run and look at the overcloud” you said20:24
greghaynesthat should "fix" it so CI will now be failing20:24
greghayneser, sorry, I meant undercloud20:24
greghaynes:/20:24
greghaynesor overcloud if you make no undercloud20:24
tchaypoi hadn’t used my test machine for about 3 months so i had to first of all give it a general sweep20:24
greghaynesah20:24
tchaypoand now I’m having this *fun* situation where the pxe_ssh driver confirms that it’s still running, then runs virsh destroy20:25
tchaypothat fails, seemingly because the vm just died - so the pxe_ssh driver throws an error and dies20:25
openstackgerritMerged openstack/tripleo-image-elements: os-net-config: use package-installs  https://review.openstack.org/13458420:25
tchaypoyou know how we have that issue in CI where nodes get stuck in a delete state? this seems similar20:26
tchaypohttps://www.irccloud.com/pastebin/wo4pMsoY20:26
greghaynesdprince: If youre doing package-installs stuff maybe have another look at https://review.openstack.org/#/c/134917/ ?20:26
greghaynesI think its pretty much ready now20:26
greghaynesalthough im still fine with switching stuff to old style because its pretty easy to write a script to convert all the old style -> new20:27
tchaypohttps://www.irccloud.com/pastebin/lGDnVxN420:27
openstackgerritgreghaynes proposed openstack/tripleo-image-elements: Longer upstart sleep for neutron-ovs-agent  https://review.openstack.org/13719520:27
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Set default network interfaces to nic1  https://review.openstack.org/13719620:27
*** ChuckC_ has joined #tripleo20:28
dprincegreghaynes: ack, you are inqueue. I've got to run out now but I'll have a look20:28
*** dprince has quit IRC20:29
*** daneyon has quit IRC20:30
*** ChuckC has quit IRC20:32
*** mrunge has quit IRC20:33
*** jistr has quit IRC20:41
lifelessgreghaynes: I left for vacation my EOD monday20:59
*** julim has quit IRC21:01
greghayneslifeless: ah, well enjoy :)21:03
lifelessgreghaynes: I've lifted the-221:03
greghayneseven better21:03
*** rlandy has quit IRC21:04
*** jdob has quit IRC21:11
*** jehb_ has quit IRC21:18
*** jprovazn has quit IRC21:21
openstackgerritFrederic Lepied proposed openstack/diskimage-builder: disk-image-create: fix test when no argument is given.  https://review.openstack.org/13721421:28
openstackgerritMerged openstack/tripleo-image-elements: Add package support to ceilometer-alarm-evaluator  https://review.openstack.org/13484621:33
*** Marga_ has joined #tripleo21:49
openstackgerritGiulio Fidente proposed openstack/tripleo-incubator: Add support for CEPHSTORAGESCALE to devtest  https://review.openstack.org/13703121:51
*** untriaged-bot has joined #tripleo22:00
untriaged-botUntriaged bugs so far:22:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139121822:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/138706122:00
gfidenteis there a bug tracking the issue where overcloud guest is not pingable?22:00
uvirtbotLaunchpad bug 1391218 in tripleo "Configuration Dependent on HAProxy" [Undecided,In progress]22:00
uvirtbotLaunchpad bug 1387061 in tripleo "deploy under cloud failure due to pacemaker " [Undecided,New]22:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139364322:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139141222:00
uvirtbotLaunchpad bug 1393643 in tripleo "haproxy start failed loop with 'Starting proxy horizon: cannot bind socket'" [Undecided,New]22:00
uvirtbotLaunchpad bug 1391412 in tripleo "devtest  deploy overcloud successfully,but there have one baremetal in  Maintenance state" [Undecided,New]22:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/138748722:00
uvirtbotLaunchpad bug 1387487 in tripleo "tripleo-image-elements/elements/tuskar-ui /os-refresh-config /post-configure.d/101-tuskar-ui  needs authentication from Keystone" [Undecided,New]22:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139330422:00
uvirtbotLaunchpad bug 1393304 in tripleo "create-nodes failure for customised pool" [Undecided,New]22:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/139165622:00
uvirtbotLaunchpad bug 1391656 in diskimage-builder "There is no way to customize the installation of the bootloader" [Undecided,New]22:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/139329822:00
uvirtbotLaunchpad bug 1393298 in tripleo "keepalived VRRP_Script(chk_haproxy) timed out" [Undecided,In progress]22:00
*** untriaged-bot has quit IRC22:00
gfidentethat went in between the bot messages :)22:00
gfidenteso ... is there a bug tracking the issue where overcloud guest is not pingable?22:01
*** rhallisey has quit IRC22:08
openstackgerritMerged openstack/tripleo-image-elements: Disable save of iptables on package install  https://review.openstack.org/13572222:08
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Rename BLOCKSTORAGE into CINDERSTORAGE to be consistent with others  https://review.openstack.org/13688222:15
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add ceph-source.yaml to the overcloud.yaml Makefile target  https://review.openstack.org/13702822:16
openstackgerritMerged openstack/diskimage-builder: Update RHEL Registration  https://review.openstack.org/13575722:17
*** Hefeweizen has joined #tripleo22:22
openstackgerritPradeep Kilambi proposed stackforge/kolla: Fix to not fork mongod so mongodb container works as expected  https://review.openstack.org/13723022:23
openstackgerritPradeep Kilambi proposed stackforge/kolla: Fix to not fork mongod so mongodb container works as expected  https://review.openstack.org/13723022:23
*** daneyon has joined #tripleo22:31
openstackgerritMerged openstack/tripleo-image-elements: Switch Nova to the Cinder v2 API  https://review.openstack.org/13715122:31
*** rwsu has quit IRC22:33
openstackgerritgreghaynes proposed openstack/tripleo-image-elements: Longer upstart sleep for neutron-ovs-agent  https://review.openstack.org/13719522:53
*** daneyon_ has joined #tripleo22:53
*** daneyon has quit IRC22:55
*** pradk has quit IRC22:57
*** daneyon_ has quit IRC22:59
*** daneyon has joined #tripleo22:59
*** daneyon_ has joined #tripleo23:00
ccrouchrbrady: ha!23:01
ccrouch(4:47:38 PM) openstackgerrit: Jason Dunsmore proposed openstack/heat: Encrypt Heat template hidden parameters  https://review.openstack.org/9790023:01
ccrouchperfect timing :-), though doesnt help for juno obviously23:02
*** jang1 has quit IRC23:02
*** daneyon has quit IRC23:03
*** gfidente has quit IRC23:12
*** daneyon has joined #tripleo23:17
*** daneyon_ has quit IRC23:21
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add new package-installs system  https://review.openstack.org/13491723:30
greghaynesslagle: nice finds :)23:30
greghaynesI should stop living in the past (2012)23:30
*** daneyon_ has joined #tripleo23:30
*** daneyon has quit IRC23:33
rbradyccrouch: good find23:36
daneyon_larsks: seems like flannel is the way to go. recommended by brendanburns and thokin.23:37
*** yuanying_ has joined #tripleo23:50
greghaynestchaypo: is https://review.openstack.org/#/c/136894/ jerryz?23:50
greghaynesI think I might just upload a new rev of that patch because we should really merge it ASAP23:52
*** yuanying has quit IRC23:54
openstackgerritgreghaynes proposed openstack/tripleo-heat-templates: Fix empty local_ip in ml2_conf.ini on undercloud  https://review.openstack.org/13689423:54
*** penick has quit IRC23:58
*** vinsh has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!