Tuesday, 2014-02-25

*** e0ne has quit IRC00:01
*** e0ne has joined #tripleo00:01
* SpamapS -> kids00:02
*** e0ne has quit IRC00:06
*** edmund has quit IRC00:07
lifelesstchaypo: ?00:07
*** sdake_ has quit IRC00:08
*** saurabhs has joined #tripleo00:11
tchaypoah. I misread StevenK saying "which devtest.sh itself does" as "which devtest_setup.sh itself does"00:12
*** cd-undercloud has joined #tripleo00:14
cd-undercloud************** overcloud complete status=1 ************00:14
*** cd-undercloud has quit IRC00:14
*** weshay has joined #tripleo00:16
lifelessok lunch00:20
lifelessthen emails00:20
lifelessthen poke at xtradb00:20
*** cody-somerville has joined #tripleo00:24
*** CaptTofu has quit IRC00:25
*** matsuhashi has joined #tripleo00:25
*** cadenzajon has quit IRC00:27
openstackgerritGregory Haynes proposed a change to openstack/diskimage-builder: Bash eval the lines in source-repository scripts  https://review.openstack.org/7605000:30
*** saurabhs has left #tripleo00:30
*** sdake_ has joined #tripleo00:34
*** CaptTofu has joined #tripleo00:34
*** sdake_ has quit IRC00:38
*** sdake_ has joined #tripleo00:38
*** sdake_ has quit IRC00:38
*** sdake_ has joined #tripleo00:38
*** cd-undercloud has joined #tripleo00:40
cd-undercloud************** overcloud complete status=128 ************00:40
*** cd-undercloud has quit IRC00:40
*** edmund has joined #tripleo00:41
*** shakayumi has quit IRC00:42
*** derekh has quit IRC00:43
*** spzala has quit IRC00:47
lifelessok good we're seeing seeds passing now00:55
lifelessyayayayayay00:55
*** lifeless changes topic to "tripleo-cd running preserve-ephemeral WIP patches and https://review.openstack.org/#/c/62042/ | Using OpenStack to deploy OpenStack;meetings Tuesday 1900 UTC in #openstack-meeting-alt"00:55
*** e0ne has joined #tripleo00:59
*** e0ne has quit IRC01:04
*** epim has quit IRC01:06
*** CaptTofu has quit IRC01:09
*** CaptTofu has joined #tripleo01:11
* tchaypo -> lunch01:13
*** cd-undercloud has joined #tripleo01:18
cd-undercloud************** overcloud complete status=1 ************01:18
*** cd-undercloud has quit IRC01:18
*** cd-undercloud has joined #tripleo01:19
cd-undercloud************** overcloud complete status=6 ************01:19
*** cd-undercloud has quit IRC01:19
openstackgerritlifeless proposed a change to openstack/diskimage-builder: Better apt-sources docs.  https://review.openstack.org/7303501:31
lifelessruh roh01:34
lifelessarping 10.10.16.13501:34
lifelessARPING 10.10.16.13501:34
lifeless01:34
lifelessnada01:34
lifelessnot a good sign01:34
lifeless[14469.668916] hpsa 0000:06:00.0: cmd_alloc returned NULL!01:35
lifeless[14641.021518] hpsa 0000:06:00.0: cmd_alloc returned NULL!01:35
lifeless[16019.510775] hpsa 0000:06:00.0: cmd_alloc returned NULL!01:36
lifeless[16151.585030] hpsa 0000:06:00.0: cmd_alloc returned NULL!01:36
lifeless[17776.763215] mlx4_en: eth2:   frag:0 - size:1526 prefix:0 align:0 stride:153601:36
lifelessraah where is my HA overcloud so I can just terminate this bad node :(01:36
*** xuhanp has joined #tripleo01:40
*** nosnos has joined #tripleo01:44
lifelessoh yay01:45
lifelessold bios.01:45
lifelessNg: where do you suppose we get bios updates from :)01:47
lifelessNg: https://trello.com/c/dOBapkt0/103-ci-overcloud-controller-unstable-due-to-old-bios01:47
lifelessand now01:49
lifeless[17776.602976] ------------[ cut here ]------------01:49
lifeless[17776.602993] WARNING: CPU: 0 PID: 0 at /build/buildd/linux-3.11.0/net/sched/sc01:49
lifelessh_generic.c:260 dev_watchdog+0x26a/0x280()01:49
lifeless[17776.602996] NETDEV WATCHDOG: eth2 (mlx4_core): transmit queue 3 timed out01:49
lifelessleast it rebooted ok this time01:52
*** rsacharya has joined #tripleo01:56
openstackgerritRichard Su proposed a change to openstack/tripleo-image-elements: Update selinux policies for mysqld  https://review.openstack.org/7460701:59
*** e0ne has joined #tripleo01:59
*** rsacharya has quit IRC02:02
*** rsacharya_ has joined #tripleo02:02
*** e0ne has quit IRC02:04
*** noslzzp has quit IRC02:04
*** rsacharya_ has quit IRC02:08
*** rsacharya_ has joined #tripleo02:10
jog0lifeless: this is why cloud instances are so great, you don't have to deal with hardware issues, too bad we are building the cloud so we have to deal with them anyway02:11
*** killer_prince has joined #tripleo02:11
*** cd-undercloud has joined #tripleo02:12
cd-undercloud************** overcloud complete status=1 ************02:12
*** cd-undercloud has quit IRC02:12
*** cd-undercloud has joined #tripleo02:14
cd-undercloud************** overcloud complete status=7 ************02:14
*** cd-undercloud has quit IRC02:14
lifelessjog0: welcome to inception02:15
*** rsacharya_ has quit IRC02:17
*** rsacharya_ has joined #tripleo02:18
*** newell has quit IRC02:23
*** ramishra has joined #tripleo02:26
*** rsacharya_ has quit IRC02:26
*** rsacharya_ has joined #tripleo02:28
*** kiall has joined #tripleo02:29
*** rsacharya_ has quit IRC02:36
*** rsacharya_ has joined #tripleo02:36
*** rsacharya_ has quit IRC02:39
*** rsacharya_ has joined #tripleo02:40
*** rsacharya_ has quit IRC02:44
*** rsacharya_ has joined #tripleo02:45
*** rsacharya_ has quit IRC02:45
*** rsacharya_ has joined #tripleo02:46
*** matsuhashi has quit IRC02:50
*** rsacharya_ has quit IRC02:55
*** matsuhashi has joined #tripleo02:55
*** e0ne has joined #tripleo02:59
*** cd-undercloud has joined #tripleo02:59
cd-undercloud************** overcloud complete status=1 ************02:59
*** cd-undercloud has quit IRC02:59
*** ccrouch has joined #tripleo03:02
*** e0ne has quit IRC03:04
StevenKlifeless: Can you peer at https://review.openstack.org/#/c/74916/ so I can rebase its needed branch against master ?03:05
openstackgerritA change was merged to openstack/tripleo-incubator: Use a variable for the vm name in create-nodes  https://review.openstack.org/7491603:09
*** weshay has quit IRC03:12
*** jcooley_ has quit IRC03:16
*** vkozhukalov_ has joined #tripleo03:20
*** matsuhashi has quit IRC03:23
*** cd-undercloud has joined #tripleo03:36
cd-undercloud************** overcloud complete status=1 ************03:36
*** cd-undercloud has quit IRC03:36
*** sdake__ has joined #tripleo03:40
*** sdake__ has quit IRC03:40
*** sdake__ has joined #tripleo03:40
*** sdake_ has quit IRC03:42
*** CaptTofu has quit IRC03:46
*** akuznetsov has quit IRC03:58
*** e0ne has joined #tripleo03:59
*** jp_at_hp1 has quit IRC04:03
*** e0ne has quit IRC04:04
*** jcooley_ has joined #tripleo04:08
*** cd-undercloud has joined #tripleo04:17
cd-undercloud************** overcloud complete status=6 ************04:17
*** cd-undercloud has quit IRC04:17
*** ramishra has quit IRC04:25
openstackgerritlifeless proposed a change to openstack/tripleo-image-elements: Use local apt and pypi mirror for tripleo-cd/  https://review.openstack.org/7574604:26
*** cd-undercloud has joined #tripleo04:29
cd-undercloud************** overcloud complete status=128 ************04:29
*** cd-undercloud has quit IRC04:29
openstackgerritSteve Kowalik proposed a change to openstack/tripleo-incubator: Store node details in the JSON datafile  https://review.openstack.org/7314504:29
*** matsuhashi has joined #tripleo04:31
*** dshurtle has quit IRC04:32
*** jcooley_ has quit IRC04:32
*** jcooley_ has joined #tripleo04:33
*** ramishra has joined #tripleo04:33
*** sdake__ has quit IRC04:39
*** jcooley_ has quit IRC04:41
*** dkehn__ has joined #tripleo04:44
*** dkehn__ has quit IRC04:46
*** jcooley_ has joined #tripleo04:46
*** dkehn__ has joined #tripleo04:46
*** akuznetsov has joined #tripleo04:47
*** dkehn has quit IRC04:47
*** dkehn_ has quit IRC04:47
*** dkehn has joined #tripleo04:49
*** dkehn__ is now known as dkehn_04:49
*** akuznetsov has quit IRC04:49
*** akuznetsov has joined #tripleo04:51
*** akuznetsov has quit IRC04:52
*** jcooley_ has quit IRC04:58
*** jcooley_ has joined #tripleo04:59
*** e0ne has joined #tripleo04:59
*** jcooley_ has quit IRC05:03
*** e0ne has quit IRC05:04
*** cd-undercloud has joined #tripleo05:04
cd-undercloud************** overcloud complete status=7 ************05:04
*** cd-undercloud has quit IRC05:04
tchaypoI'm running devtest_seed, and it's downloading a ton of stuff from archive.ubuntu.com. I'd like to make it use internode's mirror instead05:05
*** akuznetsov has joined #tripleo05:05
StevenKtchaypo: export DIB_DISTRIBUTION_MIRROR into your environment05:06
StevenKtchaypo: For example, I use export DIB_DISTRIBUTION_MIRROR=http://silver/ubuntu05:07
tchaypothat makes sense, because I had figured out it was probably disk-image-builder that was pulling stuff down05:08
StevenKtchaypo: elements/ubuntu/pre-install.d/01-set-ubuntu-mirror in dib for the gory details05:08
*** jcooley_ has joined #tripleo05:11
tchaypohidden under ~/.cache/tripleo, to make it easy to find05:13
StevenKtchaypo: .cache/tripleo is for devtest, I have an entire openstack checkout in ~/openstack05:14
*** akuznetsov has quit IRC05:17
tchaypomore notes for https://etherpad.openstack.org/p/tripleo-newdev-notes :)05:21
tchaypothanks StevenK05:21
StevenKtchaypo: I have a script from mikal that will checkout an entire tree if you wish05:22
lifelessmordred, no?05:22
StevenKI got it from mikal at the Openstack hacking in Perth. Not sure if he wrote it, or got it from someone else05:23
tchaypocan't hurt05:30
tchaypoI probably won't use it today, but I'll want it eventually05:30
StevenKtchaypo: http://paste.openstack.org/show/69276/05:33
*** akuznetsov has joined #tripleo05:33
StevenKlifeless: Can I see virsh dumpxml <one random node name> | grep 'mac address' so I can work out how to munge the awk in ensure-test-env?05:34
StevenKOr we just teach create-nodes to do that with a flag05:35
*** killer_prince is now known as lazy_prince05:35
StevenKWhich I like better05:35
lifelessStevenK: ensure-test-env ?05:36
lifelessStevenK: oh, in toci ?05:36
lifelessStevenK: make it call devtest_testenv.sh instead.05:36
lifelessStevenK: mucho grando better05:36
StevenKlifeless: create-nodes will still need to learn about multi-MAC machines05:38
*** cd-undercloud has joined #tripleo05:40
cd-undercloud************** overcloud complete status=1 ************05:40
*** cd-undercloud has quit IRC05:40
lifelessStevenK: not yet though05:41
lifelessStevenK: we may have crossed wires of course05:41
lifelessStevenK: perhaps you give me context and I give you unfiltered opinions?05:42
*** akuznetsov has quit IRC05:42
StevenKlifeless: I'm hacking toci to add nodes:[], and I'm glaring at the section that populates node-macs in the JSON. I'd prefer create-nodes to do everything, but that requires either going through the JSON and replacing, or teaching create-nodes that some nodes may have multiple MACs.05:43
lifelessStevenK: but toci doesn't create multi-mac nodes.05:44
StevenKlifeless: You mentioned multi MAC nodes when I showed you the JSON dump. I guess I then assumed that toci must be that, then.05:45
*** sseago_ has joined #tripleo05:45
*** CaptTofu has joined #tripleo05:47
*** saurabhs has joined #tripleo05:47
*** CaptTofu has quit IRC05:52
*** edmund has quit IRC05:53
*** killer_prince has joined #tripleo05:53
lifelessStevenK: ah, so no05:57
lifelessStevenK: toci creates a seed which isn't in the nodes list, but has 2 interfaces05:57
lifelessStevenK: and other than a) making many environments and b) registering them with the neutron + broker is c) identical to devtest_testenv, which is why I say05:58
lifelessit should just call devtest_testenv05:58
lifelessthat said, the schema for this needs to be multimac from the get got05:58
lifelessbecause physical machines are the N-mac case05:58
*** coolsvap has joined #tripleo05:58
*** e0ne has joined #tripleo05:59
StevenKlifeless: Switching toci to using testenv requires changes to it too, since for example, the seed two interfaces thing06:00
*** jcooley_ has quit IRC06:01
*** e0ne has quit IRC06:04
lifelessStevenK: yes06:04
lifelessStevenK: though create-seed-vm creates a vm with two interfaces as well06:05
lifelessStevenK: so I'm not sure that thats a good example of the needed changes :)06:05
*** cd-undercloud has joined #tripleo06:17
cd-undercloud************** overcloud complete status=1 ************06:17
*** cd-undercloud has quit IRC06:17
*** cd-undercloud has joined #tripleo06:18
cd-undercloud************** overcloud complete status=7 ************06:18
*** cd-undercloud has quit IRC06:18
*** saju_m has joined #tripleo06:21
*** ramishra has quit IRC06:21
*** saju_m has quit IRC06:29
*** saurabhs has quit IRC06:30
*** saju_m has joined #tripleo06:42
*** vkozhukalov_ has quit IRC06:48
*** ramishra has joined #tripleo06:53
*** mrunge has joined #tripleo06:55
*** ifarkas has joined #tripleo06:56
*** e0ne has joined #tripleo06:59
*** CaptTofu has joined #tripleo07:00
*** e0ne has quit IRC07:04
*** cd-undercloud has joined #tripleo07:05
cd-undercloud************** overcloud complete status=1 ************07:05
*** cd-undercloud has quit IRC07:05
*** CaptTofu has quit IRC07:06
*** cd-undercloud has joined #tripleo07:07
cd-undercloud************** overcloud complete status=128 ************07:07
*** cd-undercloud has quit IRC07:07
*** jprovazn has joined #tripleo07:10
*** marun has quit IRC07:11
*** saju_m has quit IRC07:13
*** saju_m has joined #tripleo07:13
*** cd-undercloud has joined #tripleo07:19
cd-undercloud************** overcloud complete status=128 ************07:19
*** cd-undercloud has quit IRC07:19
openstackgerritRichard Su proposed a change to openstack/tripleo-image-elements: rsync configurations to support multi-node swift  https://review.openstack.org/7610507:20
*** vkozhukalov_ has joined #tripleo07:37
*** lsmola has joined #tripleo07:39
*** jcooley_ has joined #tripleo07:44
*** sheep_ has joined #tripleo07:47
*** gcha has joined #tripleo07:48
*** sheep_ is now known as rdopieralski07:49
*** cd-undercloud has joined #tripleo07:51
cd-undercloud************** overcloud complete status=128 ************07:51
*** cd-undercloud has quit IRC07:51
*** rcarrillocruz1 has joined #tripleo07:53
*** pblaho has joined #tripleo07:53
*** bauzas has joined #tripleo07:54
*** rcarrillocruz has quit IRC07:55
*** e0ne has joined #tripleo07:59
jprovaznlifeless, SpamapS: Hi, I'm going to improve the script which joins a node into rabbitmq cluster and which addresses SpamapS comment here: https://review.openstack.org/#/c/75685/ . Does this make sense to you? http://paste.openstack.org/show/69307/08:00
*** e0ne has quit IRC08:04
*** ramishra has quit IRC08:07
rpodolyakamorning all08:16
*** rlandy has joined #tripleo08:19
*** jistr has joined #tripleo08:19
*** jcoufal has joined #tripleo08:21
*** cd-undercloud has joined #tripleo08:23
cd-undercloud************** overcloud complete status=1 ************08:23
*** cd-undercloud has quit IRC08:23
openstackgerritMarios Andreou proposed a change to openstack/tuskar: Handle overcloud-block-storage in heat template  https://review.openstack.org/7496908:28
marioslsmola: should be good to go ^^^08:29
*** akuznetsov has joined #tripleo08:30
lsmolamarios: will check it out08:30
*** jcooley_ has quit IRC08:34
*** hashar has joined #tripleo08:37
openstackgerritA change was merged to openstack/tripleo-image-elements: Configure horizon when using /etc/apache2.  https://review.openstack.org/7445508:43
*** ramishra has joined #tripleo08:45
marioslsmola: the UI fix you made for block-storage seems to be working too http://i.imgur.com/0aaHSNk.png08:48
lsmolamarios: cool08:48
lsmolamarios: though we could probable rename the default image-name to overcloud-block-storage08:50
lsmolamarios: but that is not important for now I guess08:50
*** vkozhukalov_ has quit IRC08:53
*** ifarkas has quit IRC08:58
Ngmorning08:58
*** cd-undercloud has joined #tripleo09:01
cd-undercloud************** overcloud complete status=1 ************09:01
*** cd-undercloud has quit IRC09:01
*** ifarkas has joined #tripleo09:01
*** CaptTofu has joined #tripleo09:02
*** akuznetsov has quit IRC09:03
*** akuznetsov has joined #tripleo09:04
*** CaptTofu has quit IRC09:06
*** jcooley_ has joined #tripleo09:10
*** e0ne has joined #tripleo09:11
*** derekh has joined #tripleo09:17
*** lucasagomes has joined #tripleo09:22
*** athomas has joined #tripleo09:23
*** xuhanp has quit IRC09:25
*** pbelanyi has joined #tripleo09:26
*** jcooley_ has quit IRC09:27
*** akrivoka has joined #tripleo09:29
*** matsuhashi has quit IRC09:31
openstackgerritLadislav Smola proposed a change to openstack/tripleo-heat-templates: Different Flavors for Tuskar roles  https://review.openstack.org/7589509:32
*** matsuhashi has joined #tripleo09:34
*** bauzas has quit IRC09:34
*** cd-undercloud has joined #tripleo09:34
cd-undercloud************** overcloud complete status=1 ************09:34
*** cd-undercloud has quit IRC09:34
*** lsmola has quit IRC09:37
*** dtantsur has joined #tripleo09:47
*** jcoufal has quit IRC09:49
*** jp_at_hp has joined #tripleo09:51
*** martyntaylor has joined #tripleo09:53
*** bauzas has joined #tripleo09:53
*** lsmola has joined #tripleo09:53
*** matsuhashi has quit IRC09:59
*** matsuhashi has joined #tripleo09:59
openstackgerritDmitry Tantsur proposed a change to openstack/tuskar-ui: Update overcloud role page according to wireframes  https://review.openstack.org/7581210:00
*** jtomasek has joined #tripleo10:00
*** lsmola has quit IRC10:06
*** coolsvap has quit IRC10:06
*** lucasagomes_ has joined #tripleo10:12
*** cd-undercloud has joined #tripleo10:12
cd-undercloud************** overcloud complete status=1 ************10:12
*** cd-undercloud has quit IRC10:12
*** lucasagomes has quit IRC10:13
*** lucasagomes_ is now known as lucasagomes10:13
*** nosnos has quit IRC10:14
*** rcarrillocruz has joined #tripleo10:14
*** rcarrillocruz1 has quit IRC10:17
*** lazy_prince has quit IRC10:17
*** matsuhashi has quit IRC10:17
*** lsmola has joined #tripleo10:20
*** CaptTofu has joined #tripleo10:23
*** lazy_prince has joined #tripleo10:26
*** vkozhukalov_ has joined #tripleo10:30
*** akuznetsov has quit IRC10:31
*** rlandy_ has joined #tripleo10:34
*** akuznetsov has joined #tripleo10:34
*** coolsvap has joined #tripleo10:36
*** rcarrillocruz1 has joined #tripleo10:36
*** boris-42_ has quit IRC10:37
*** rlandy has quit IRC10:38
*** rcarrillocruz has quit IRC10:38
*** lazy_prince has quit IRC10:42
*** d0ugal has quit IRC10:42
*** d0ugal has joined #tripleo10:44
*** d0ugal has joined #tripleo10:44
*** cd-undercloud has joined #tripleo10:49
cd-undercloud************** overcloud complete status=1 ************10:49
*** cd-undercloud has quit IRC10:49
*** rlandy_ has quit IRC10:51
*** cd-undercloud has joined #tripleo10:52
cd-undercloud************** overcloud complete status=128 ************10:52
*** cd-undercloud has quit IRC10:52
openstackgerritJan Provaznik proposed a change to openstack/tripleo-image-elements: Update openstack config files to support rabbitmq cluster  https://review.openstack.org/6839310:57
openstackgerritJan Provaznik proposed a change to openstack/tripleo-image-elements: Fix rabbitmq env file name and log path  https://review.openstack.org/7023610:57
openstackgerritJan Provaznik proposed a change to openstack/tripleo-image-elements: Add cluster support for rabbitmq element  https://review.openstack.org/6839210:57
*** rlandy_ has joined #tripleo11:04
*** ramishra has quit IRC11:05
*** ramishra has joined #tripleo11:05
*** ifarkas has quit IRC11:06
*** ifarkas has joined #tripleo11:08
*** jp_at_hp has quit IRC11:08
openstackgerrityangxurong proposed a change to openstack/tuskar: Replace uuidutils.generate_uuid() with str(uuid.uuid4())  https://review.openstack.org/7615811:09
*** ramishra has quit IRC11:11
*** jp_at_hp has joined #tripleo11:12
openstackgerritRadomir Dopieralski proposed a change to openstack/tuskar-ui: Refactor the overcloud views tests  https://review.openstack.org/7616111:27
*** cd-undercloud has joined #tripleo11:32
cd-undercloud************** overcloud complete status=1 ************11:32
*** cd-undercloud has quit IRC11:32
*** ramishra has joined #tripleo11:33
*** boris-42_ has joined #tripleo11:38
*** jcooley_ has joined #tripleo11:41
*** hashar has quit IRC11:45
*** jcoufal has joined #tripleo11:46
*** jcooley_ has quit IRC11:48
*** rbrady-afk is now known as rbrady11:52
openstackgerrityangxurong proposed a change to openstack/tuskar: Replace uuidutils.generate_uuid() with str(uuid.uuid4())  https://review.openstack.org/7615811:59
openstackgerritDerek Higgins proposed a change to openstack-infra/tripleo-ci: Allow the testenv client to dictate the worker timeout  https://review.openstack.org/7617112:03
openstackgerritDerek Higgins proposed a change to openstack-infra/tripleo-ci: Set the worker timeout  https://review.openstack.org/7617212:03
openstackgerritDerek Higgins proposed a change to openstack-infra/tripleo-ci: Kill commands that outlive test env  https://review.openstack.org/7540212:03
*** gcha has quit IRC12:05
*** markmc has joined #tripleo12:06
*** cd-undercloud has joined #tripleo12:08
cd-undercloud************** overcloud complete status=1 ************12:08
*** cd-undercloud has quit IRC12:08
*** ccorrigan has joined #tripleo12:09
openstackgerritLadislav Smola proposed a change to openstack/tuskar-ui: Showing correctly errors from API  https://review.openstack.org/7617512:12
*** rlandy__ has joined #tripleo12:17
*** rlandy_ has quit IRC12:18
*** rlandy__ is now known as rlandy12:20
*** mrunge has quit IRC12:28
openstackgerritA change was merged to openstack/tuskar: Update config generator from Oslo  https://review.openstack.org/7522512:32
openstackgerritA change was merged to openstack/tuskar: Replace uuidutils.generate_uuid() with str(uuid.uuid4())  https://review.openstack.org/7615812:34
*** hashar has joined #tripleo12:35
*** ramishra has quit IRC12:35
*** hashar_ has joined #tripleo12:38
*** cd-undercloud has joined #tripleo12:39
cd-undercloud************** overcloud complete status=128 ************12:39
*** cd-undercloud has quit IRC12:39
*** killer_prince has quit IRC12:39
*** lucasagomes is now known as lucas-hungry12:39
*** hashar has quit IRC12:41
openstackgerritLadislav Smola proposed a change to openstack/tuskar-ui: Showing correctly errors from API  https://review.openstack.org/7617512:42
*** cd-undercloud has joined #tripleo12:42
cd-undercloud************** overcloud complete status=128 ************12:42
*** cd-undercloud has quit IRC12:42
*** hashar_ has quit IRC12:45
openstackgerritZhongyue Luo proposed a change to openstack/tuskar: Remove uuidutils  https://review.openstack.org/7618112:45
*** hashar has joined #tripleo12:45
openstackgerritZhongyue Luo proposed a change to openstack/tuskar: Update context from Oslo  https://review.openstack.org/7618212:51
*** ramishra has joined #tripleo12:56
openstackgerritLadislav Smola proposed a change to openstack/tuskar-ui: Showing correctly errors from API  https://review.openstack.org/7617512:56
*** ohadlevy_ is now known as ohadlevy12:59
*** ohadlevy has quit IRC12:59
*** ohadlevy has joined #tripleo12:59
openstackgerritDmitry Tantsur proposed a change to openstack/tuskar-ui: Manage image ID's for node profile  https://review.openstack.org/7582313:03
*** coolsvap has quit IRC13:04
*** weshay has joined #tripleo13:05
*** cd-undercloud has joined #tripleo13:11
cd-undercloud************** overcloud complete status=1 ************13:11
*** cd-undercloud has quit IRC13:11
*** cd-undercloud has joined #tripleo13:13
cd-undercloud************** overcloud complete status=7 ************13:13
*** cd-undercloud has quit IRC13:13
*** andreaf has joined #tripleo13:18
rcarrillocruz1hey guys, just pulled tripleo-incubator from github and triggered devtest.sh , getting this error :13:19
rcarrillocruz1Feb 25 13:18:25|00030|reconnect|WARN|unix:/var/run/openvswitch/db.sock: connecti13:19
rcarrillocruz1on attempt failed (No such file or directory)13:19
rcarrillocruz1i manually started openvswitch (even though i guess the script should) but same thing13:19
rcarrillocruz1what am I missing?13:19
*** geerdest has joined #tripleo13:20
*** rcarrillocruz1 is now known as rcarrillocruz13:23
openstackgerritMarios Andreou proposed a change to openstack/tuskar: Handle overcloud-block-storage in heat template  https://review.openstack.org/7496913:23
*** CaptTofu has quit IRC13:24
slaglederekh: do we know what the cause of this error is? http://logs.openstack.org/31/75831/4/check-tripleo/check-tripleo-undercloud-precise/3af8a57/console.html13:28
slagletime out waiting for nova list from the seed13:28
*** jcooley_ has joined #tripleo13:31
GheRiverorcarrillocruz: it could be that the kernel module didnt get installed/compiled properly13:34
*** jdob has joined #tripleo13:34
*** lblanchard has joined #tripleo13:36
*** jcooley_ has quit IRC13:38
lsmolaslagle: hello, can I have a quick question?13:38
slaglelsmola: sure, go4it13:42
lsmolaslagle: it's about my comment, do you know why it wasn't enough to have ComputeFlavor in compute template?13:42
lsmolaslagle: cause e.g. for BlockStorageImage it does work fine I assume, as marios was able to build it13:43
lsmolaslagle: so it left me little confused :-)13:44
slaglelsmola: i assume it's b/c nova-compute-instance.yaml get's included by a FileInclude, and it's not actually passed as a parameter to merge.py13:46
slagleand merge.py is responsible for consolidating the template parameters13:47
lsmolaslagle: hm, ok13:47
slagleso...all parameters from nova-compute-instance.yaml need to also be in overcloud-source.yaml13:47
lsmolaslagle: so should it be a bug? cause it would seem that we have to duplicate all compute paramters to overcloud template13:47
lsmolaslagle: ok13:47
lsmolaslagle: ok, thanks, at least it is clear to me now :-)13:49
*** saju_m has quit IRC13:50
*** lucas-hungry is now known as lucasagomes13:52
*** cd-undercloud has joined #tripleo13:53
cd-undercloud************** overcloud complete status=1 ************13:53
*** cd-undercloud has quit IRC13:53
*** edmund has joined #tripleo13:56
*** dprince has joined #tripleo13:56
openstackgerritLadislav Smola proposed a change to openstack/tuskar: Better error handling of Overcloud actions  https://review.openstack.org/7620713:59
*** gcha has joined #tripleo14:00
*** tzumainn has quit IRC14:01
*** tzumainn has joined #tripleo14:02
slaglelsmola: i don't think it's a bug14:03
slagleit's "how it works" :)14:03
lsmolaslagle: :-) ok14:03
derekhslagle: I've been looking into it a bit https://bugs.launchpad.net/tripleo/+bug/1284054 , I think things just run a bot slower on testenv when we're running a lot of jobs at the same time, see comparison times in the bug to my local tests, short term we could up the ammount of time we wait for14:06
derekhslagle: I was thinging of doing that until we figure out if we can imporve elsewhere14:07
derekhslagle: I can see what would be appropriate and submit it14:07
*** boris-42_ has quit IRC14:10
*** nijaba has joined #tripleo14:11
*** nijaba has quit IRC14:11
*** nijaba has joined #tripleo14:11
slaglederekh: ok, thx! i should've searched bugs :)14:16
*** markmc has quit IRC14:16
openstackgerritA change was merged to openstack/tripleo-incubator: devtest_overcloud: No need to set NODE_ARCH twice  https://review.openstack.org/7508314:17
*** cd-undercloud has joined #tripleo14:17
cd-undercloud************** overcloud complete status=128 ************14:17
*** cd-undercloud has quit IRC14:17
*** markmc has joined #tripleo14:19
*** pbelanyi_ has joined #tripleo14:19
*** pbelanyi has quit IRC14:19
*** edmund has quit IRC14:20
openstackgerritLadislav Smola proposed a change to openstack/tuskar: Better error handling of Overcloud actions  https://review.openstack.org/7620714:22
*** edmund has joined #tripleo14:23
openstackgerritDerek Higgins proposed a change to openstack/tripleo-incubator: Increase time waiting for nova to initialize  https://review.openstack.org/7621214:23
*** pblaho has quit IRC14:24
slagledprince: ping, ? about the configs under /usr/share/glance14:24
dprinceslagle: yes, lets talk about that...14:25
openstackgerritA change was merged to openstack/tuskar: Remove uuidutils  https://review.openstack.org/7618114:26
slagledprince: so...the thing is, i don't want any of the configs under /usr/share/glance really getting used for tripleo14:26
slagleonly the stuff under /etc/glance14:26
slaglewhich is why i proposed the "symlink" fix14:26
slaglebut, tbh, i'm not sure i like that either14:26
dprinceslagle: but this isn't really your choice is it :)14:26
slagledprince: b/c it's packaged you mean?14:27
dprinceslagle: what I mean is the Fedora/RHEL packages already decided to go and patch oslo-config to do this... so why not use that. Or... better yet talk them into just using /etc/glance instead?14:27
*** jcooley_ has joined #tripleo14:28
slagledprince: sure, i just don't understand why they went this route, but i can ask14:29
slagledprince: do we expect people to modify the files /usr/share/glance?14:29
slagleor, copy to /etc/glance, then modify?14:29
dprinceslagle: I think the arguement is paste files aren't config files so they shouldn't go in etc.14:29
slagleeither way, i don't get the intent14:29
dprinceslagle: And I agree with them on that front. I'm convinced many projects in OpenStack (Swift, Keystone, Glance for example) have set quite a bad example on this front...14:30
slagledprince: that, i can maybe buy. but, the real issue is /usr/share/glance/glance-api-dist.conf (the non-paste ones)14:30
slaglethe values in that file are used unless you override them in /etc/glance/glance-api.conf14:31
markmcslagle, /usr/share/glance/*.conf are for distro defaults14:31
markmcslagle, you should never change those files14:31
dprinceyep.14:31
dprincewe just shouldn't need to worry about them.14:31
markmcslagle, the idea is that an empty /etc/glance/*.conf should work as a good starting point14:31
slagleok. so, sounds like for tripleo we need to add overrides to our templates /etc/glance/glance-api.conf if we don't want the values from /usr/share/glance/* taking effect14:32
dprinceslagle: yes.14:33
markmcright, /etc/ is just for overriding the defaults in /usr14:33
slaglee.g., we need a notifier_strategy=default in the tripleo template, b/c otherwise it's set to qpid from the /usr/share/glance stuff14:33
slagleok, i think this is making sense now14:33
markmcenabling qpid notifications seems like a strange distro default14:34
markmcI'd file a (fedora/RDO) bug on that14:34
slaglei guess we assume no one would try installing it alongside rabbit :)14:34
slaglei can file it14:34
markmcno, fedora does change the default to qpid14:34
markmcbut to enable notifications by default is what's strange14:35
slagleoh14:35
*** julim has joined #tripleo14:36
*** jcooley_ has quit IRC14:36
*** sseago_ has quit IRC14:45
mordredmarkmc: htey there!14:45
*** geerdest has quit IRC14:45
markmcmordred, howdy :)14:45
mordredmarkmc: I'm not usually ina friendly timezone with you14:46
*** geerdest has joined #tripleo14:46
markmcmordred, I actually don't know what timezone I'm in14:46
markmcmordred, somewhere in the middle of the atlantic, on my way to NYC14:46
mordredmarkmc: oh my14:47
markmcmordred, where are you, then?14:47
markmcmordred, what's your plan next week, btw? Going to the tripleo meetup monday?14:47
mordredmarkmc: well, I just got to germany - so I know what timezone I'm in physcally  -but I have no idea where I am psychically14:47
mordredmarkmc: yes - you?14:48
markmcmordred, yeah, I'll be there monday and wednesday14:48
mordredcool14:48
mordredyeah. tuesday. yay meetings14:48
markmcmordred, some fantastic, exciting event on tuesday14:48
* markmc can't recall14:48
mordredmarkmc: it's gonna be so much fun I'm expecting to black out from excitement14:48
*** cd-undercloud has joined #tripleo14:53
cd-undercloud************** overcloud complete status=1 ************14:53
*** cd-undercloud has quit IRC14:53
*** sballe_ has joined #tripleo14:54
*** pbelanyi_ is now known as pbelanyi14:55
*** sballe has quit IRC14:57
*** sseago_ has joined #tripleo14:58
*** Guest50062 is now known as sbadia15:01
*** dtantsur has quit IRC15:03
openstackgerritRyan Brady proposed a change to openstack/tripleo-image-elements: Adds nfs-server element  https://review.openstack.org/7471215:06
*** rsacharya_ has joined #tripleo15:08
*** edmund has quit IRC15:11
*** edmund has joined #tripleo15:12
*** edmund has quit IRC15:13
*** cd-undercloud has joined #tripleo15:17
cd-undercloud************** overcloud complete status=6 ************15:17
*** cd-undercloud has quit IRC15:17
*** cd-undercloud has joined #tripleo15:19
cd-undercloud************** overcloud complete status=7 ************15:19
*** cd-undercloud has quit IRC15:19
*** rdopieralski has quit IRC15:20
*** dtantsur has joined #tripleo15:20
openstackgerritRyan Brady proposed a change to openstack/tripleo-heat-templates: Adds block-storage-nfs template  https://review.openstack.org/7501715:22
*** CaptTofu has joined #tripleo15:25
*** boris-42_ has joined #tripleo15:26
*** boris-42_ has quit IRC15:27
*** markmc has quit IRC15:29
*** ramishra has quit IRC15:29
*** CaptTofu has quit IRC15:30
*** coolsvap has joined #tripleo15:30
*** gcha has quit IRC15:32
*** matty_dubs|gone is now known as matty_dubs15:34
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Config defaults for glance  https://review.openstack.org/7623815:34
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Add fedora-rdo-icehouse element  https://review.openstack.org/7341115:34
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Fix typo  https://review.openstack.org/7365515:34
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Move 99-neutronclient under neutron-source-install  https://review.openstack.org/7471715:34
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Add missing +x  https://review.openstack.org/7449515:34
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Add create-dir service for neutron ovs agent  https://review.openstack.org/7366015:34
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Install lvm2 package for cinder  https://review.openstack.org/7365615:34
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Common cinder install code  https://review.openstack.org/7365715:34
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Use os-svc-restart for cinder-api  https://review.openstack.org/7365815:34
openstackgerritJames Slagle proposed a change to openstack/tripleo-image-elements: Remove unneeded chown of /var/run/nova  https://review.openstack.org/7365915:34
openstackgerritDan Prince proposed a change to openstack/tripleo-incubator: Add FAIL_MATCH_OUTPUT to wait_for...  https://review.openstack.org/7624015:36
openstackgerritDan Prince proposed a change to openstack/tripleo-incubator: Make heat stack-create waits fail fast  https://review.openstack.org/7624115:36
slagledprince: ok, i was able to abandon my other 2 glance patches and just go with this: https://review.openstack.org/7623815:37
*** edmund has joined #tripleo15:43
*** cody-somerville has quit IRC15:44
dprinceslagle: cool, I like this better...15:45
*** CaptTofu has joined #tripleo15:46
*** jistr has quit IRC15:49
openstackgerritMichael Kerrin proposed a change to openstack/tripleo-incubator: Add mechanism for wait_for command to bail out on an unrecoverable error  https://review.openstack.org/7624615:58
*** jcoufal has quit IRC15:59
*** ramishra has joined #tripleo16:00
*** jcoufal has joined #tripleo16:02
*** cd-undercloud has joined #tripleo16:03
cd-undercloud************** overcloud complete status=1 ************16:03
*** cd-undercloud has quit IRC16:03
*** jtomasek has quit IRC16:04
*** sseago_ has quit IRC16:05
*** cd-undercloud has joined #tripleo16:06
cd-undercloud************** overcloud complete status=128 ************16:06
*** cd-undercloud has quit IRC16:06
*** mkerrin has joined #tripleo16:08
*** jtomasek has joined #tripleo16:17
*** sseago_ has joined #tripleo16:17
*** jcooley_ has joined #tripleo16:18
openstackgerritDmitry Tantsur proposed a change to openstack/tuskar-ui: Manage image ID's for node profile  https://review.openstack.org/7582316:23
jdobslagle (or anyone else): I'm seeing https://gist.github.com/jdob/9212245 when running install-dependencies on a new tripleo setup, any ideas off the top of your head?16:23
*** rcarrillocruz1 has joined #tripleo16:25
*** ramishra has quit IRC16:26
dprincejob: I hit that issue this weekend and a quick yum install libffi-devel fixed it.16:26
*** rcarrillocruz has quit IRC16:26
*** ramishra has joined #tripleo16:26
jdobah, devel, lemme try that16:26
jdobdprince: seemed to have worked, thanks :D16:28
dprincejob: perhaps we need to add that to the install-dependencies list...16:29
dprincejdob: ^^16:29
jdobya, agreed, I'm making notes as I go, I'll address them when I'm done16:29
*** ramishra has quit IRC16:31
dprincejdob: That change should already be in the latest install-dependencies now though. The only reason I hit it was because I don't run install-dependencies on my dev box every day... so I just needed to catch up.16:32
dprincejdob: see commit 6db4838b659e8b26c8608390a306cc74a85b8f8616:32
jdobthe instructions i'm going from are using git checkout undercloud-config-drive, so maybe it needs to be cherry picked into there16:33
jdobi'd need to get a better feel for what that branch represents16:33
*** akuznetsov has quit IRC16:35
*** UtahDave has joined #tripleo16:37
*** cd-undercloud has joined #tripleo16:41
cd-undercloud************** overcloud complete status=128 ************16:41
*** cd-undercloud has quit IRC16:41
*** rsacharya_ has quit IRC16:42
*** rcarrillocruz has joined #tripleo16:46
*** rcarrillocruz1 has quit IRC16:46
*** rsacharya_ has joined #tripleo16:47
tteggelease16:47
tteggelwrong window16:48
*** cody-somerville has joined #tripleo16:54
SpamapSo/16:59
*** boris-42_ has joined #tripleo17:00
*** pbelanyi has quit IRC17:00
*** sballe_ has quit IRC17:01
*** jtomasek has quit IRC17:04
*** bauzas has quit IRC17:04
*** hashar has quit IRC17:10
*** matty_dubs is now known as matty_dubs|lunch17:11
*** marun has joined #tripleo17:14
*** cd-undercloud has joined #tripleo17:15
cd-undercloud************** overcloud complete status=1 ************17:15
*** cd-undercloud has quit IRC17:15
*** cadenzajon has joined #tripleo17:15
*** akuznetsov has joined #tripleo17:18
*** hashar has joined #tripleo17:19
*** e0ne has quit IRC17:23
openstackgerritDerek Higgins proposed a change to openstack-infra/tripleo-ci: Add waitcondition on test environments  https://review.openstack.org/7626417:24
*** akuznetsov has quit IRC17:24
*** martyntaylor has quit IRC17:25
*** akuznetsov has joined #tripleo17:26
openstackgerritLadislav Smola proposed a change to openstack/tuskar: Create stack in right order  https://review.openstack.org/7626717:27
*** jcoufal has quit IRC17:30
*** saurabhs has joined #tripleo17:31
*** jcoufal has joined #tripleo17:31
*** lazy_prince has joined #tripleo17:31
*** lazy_prince is now known as killer_prince17:31
openstackgerritDan Prince proposed a change to openstack/tripleo-incubator: Make heat stack-create waits fail fast  https://review.openstack.org/7624117:34
openstackgerritDan Prince proposed a change to openstack/tripleo-incubator: Add FAIL_MATCH_OUTPUT to wait_for...  https://review.openstack.org/7624017:34
*** Kim-Chi-San has quit IRC17:34
*** cd-undercloud has joined #tripleo17:35
cd-undercloud************** overcloud complete status=1 ************17:35
*** cd-undercloud has quit IRC17:35
*** dkehn_ has quit IRC17:37
*** Kim-Chi-San has joined #tripleo17:37
*** killer_prince has quit IRC17:38
*** bauzas has joined #tripleo17:38
*** dkehn has quit IRC17:39
*** dkehn has joined #tripleo17:40
*** jprovazn has quit IRC17:42
*** dkehn_ has joined #tripleo17:42
*** derekh has quit IRC17:44
*** killer_prince has joined #tripleo17:45
openstackgerritTrent Geerdes proposed a change to openstack/tripleo-image-elements: linking to debian apache site config more like debian  https://review.openstack.org/7628117:46
*** matty_dubs|lunch is now known as matty_dubs17:47
*** akuznetsov has quit IRC17:50
*** killer_prince has quit IRC17:51
*** cd-undercloud has joined #tripleo17:54
cd-undercloud************** overcloud complete status=1 ************17:54
*** cd-undercloud has quit IRC17:54
*** dkehn__ has joined #tripleo17:55
*** dkehn has quit IRC17:57
*** dkehn_ has quit IRC17:57
slaglethis needs review if any other cores around: https://review.openstack.org/#/c/76212/17:58
*** killer_prince has joined #tripleo17:58
*** dkehn has joined #tripleo17:58
slagleshould help with some of the CI failures17:59
*** dkehn__ is now known as dkehn_17:59
*** akuznetsov has joined #tripleo18:02
*** athomas has quit IRC18:04
*** dkehn__ has joined #tripleo18:04
*** athomas has joined #tripleo18:04
*** CaptTofu_ has joined #tripleo18:04
*** CaptTofu has quit IRC18:04
*** dkehn_ has quit IRC18:07
*** athomas has quit IRC18:07
*** edmund has quit IRC18:08
*** martyntaylor has joined #tripleo18:09
*** hashar has quit IRC18:09
*** dprince_ has joined #tripleo18:09
*** dkehn_ has joined #tripleo18:10
dprince_slagle: so should wait_for look at stderr as well?18:11
dprince_slagle: My initial take was yes...18:11
slagledprince_: i'd prefer if it did, but if you use wait_for that with a command that already redirects stderr, it won't work right?18:12
slaglethat's basically what mkerrin showed there in the comment18:13
dprince_slagle: Nah. I was just being stupid18:13
dprince_slagle: I removed the eval (for no good reason)18:13
dprince_slagle: so if I put back the eval, which was missing in patchset 1 then we'll be fine18:13
slagleah, ok18:13
slaglethen yea, i'd like to see it check stderr18:14
*** athomas has joined #tripleo18:16
openstackgerritDan Prince proposed a change to openstack/tripleo-incubator: Make heat stack-create waits fail fast  https://review.openstack.org/7624118:18
openstackgerritDan Prince proposed a change to openstack/tripleo-incubator: Add FAIL_MATCH_OUTPUT to wait_for...  https://review.openstack.org/7624018:18
*** rlandy has quit IRC18:19
*** tzumainn has quit IRC18:19
*** tzumainn has joined #tripleo18:20
*** rlandy has joined #tripleo18:20
*** dkehn has quit IRC18:20
*** jcoufal has quit IRC18:21
*** dprince has quit IRC18:22
*** jrist_ has joined #tripleo18:25
SpamapSslagle: https://review.openstack.org/#/c/75071/ .. I don't think /tmp/get-pip.py will exist if you've asked for a package install, will it?18:30
*** julim has quit IRC18:31
*** julim has joined #tripleo18:31
*** cody-somerville has quit IRC18:32
*** andreaf has quit IRC18:32
*** vkozhukalov_ has quit IRC18:34
*** cd-undercloud has joined #tripleo18:35
cd-undercloud************** overcloud complete status=1 ************18:35
*** cd-undercloud has quit IRC18:35
*** andreaf has joined #tripleo18:36
saurabhsHi I had a doubt around using mustache through os-apply-config. If lets say I have a parameter in config which I want to override if there is a value specified in template, but if no value is specified I want to use some default value for it. How to achieve this through  mustache?18:36
saurabhs{{#trove.debug}}18:37
saurabhsdebug = {{trove.debug}}18:37
saurabhs{{/trove.debug}}18:37
SpamapS{{^trove.debug}}debug=False{{/trove.debug}}18:37
saurabhsSpamapS: thanks18:37
saurabhswhat is difference between ^trove.debug and #trove.debug18:38
SpamapSsaurabhs: ^ is "if this value is false"18:38
SpamapSsaurabhs: # is "if this value is true"18:38
SpamapShttp://mustache.github.io/mustache.5.html <-- in case you hadn't found this yet18:39
*** akuznetsov has quit IRC18:39
saurabhsSpamapS : Thanks18:39
*** jang1 has joined #tripleo18:40
lifelessmorning18:44
lifelessdid we have another CI outage?18:44
openstackgerritJon-Paul Sullivan proposed a change to openstack/diskimage-builder: Enable simple modification of git repo location  https://review.openstack.org/7479118:45
lifelesssaurabhs: note for the trove example there, that we'd usually just set the explicit value and let the default in trove take over when its not specified18:46
lifelessalso, undercloud and above jobs are failing in CI, so theres been a regression overnight18:47
SpamapSlifeless: tripleo-cd failed because of a 50018:48
dprince_SpamapS/lifeless: Yes. I saw this 'Failed to fetch http://nova.clouds.archive.ubuntu.com/ubuntu/pool/main/libf/libffi/libffi-dev_3.0.11~rc1-5_amd64.deb  Temporary failure resolving 'nova.clouds.archive.ubuntu.com''18:51
*** andreaf_ has joined #tripleo18:51
lifelessSpamapS: you wanted my advocacy with heat about that right ?18:51
saurabhslifeless: yes, thats exactly what I wanted to achieve. so it will look like this18:51
saurabhs{{^trove.debug}}18:51
saurabhsdebug=False18:51
saurabhs{{/trove.debug}}18:51
saurabhs{{#trove.debug}}18:51
saurabhsdebug = {{trove.debug}}18:51
saurabhs{{/trove.debug}}18:51
lifelesssaurabhs: you can do that yes; I'm just saying for OpenStack projects that have sane defaults you only need the {{#... clause18:52
lifelesssaurabhs: because the {{^... clause is the same as not having the option there at all.18:52
lifelessdprince_: interesting18:52
lifelessdprince_: nova.clouds.archive.ubuntu.com is a new host on me18:52
lifelessdprince_: but it appears to be a real thing!18:53
*** lucasagomes has quit IRC18:53
dprince_lifeless: it was trying to install the new libffi package...18:53
*** andreaf has quit IRC18:53
dprince_lifeless: honestly, perhaps we should run our own (local) mirror18:53
lifelessdprince_: yeah, we had all three jobs green yesterday even with the new libffi18:53
lifelessdprince_: that looks like a DNS error18:53
lifelessdprince_: we currently use the google DNS resolver, no cloud infra caching resolver.18:54
lifelessdprince_: that said I totally agree, let me add DNS to the list of services we need18:54
*** jistr has joined #tripleo18:54
lifelessNg: did you see https://trello.com/c/dOBapkt0/103-ci-overcloud-controller-unstable-due-to-old-bios18:54
lifelessdprince_: so I have https://trello.com/c/xgto7r04/101-add-pypi-and-distro-mirrors-to-cd-undercloud-s as a thing already18:55
SpamapSlifeless: about the 500's being ignored, yeah.18:55
dprince_lifeless: cool18:55
lifelessdprince_: but i wonder whether we should run independent ones in each overcloud18:55
SpamapSlifeless: OR we need to prioritize update retry.18:55
dprince_lifeless: yep, my thoughts as well.18:55
lifelessdprince_: e.g. I've manually set pypi and distro mirrors up on cd-undercloud18:55
dprince_lifeless: the more local the better18:55
SpamapSlifeless: because that is the current objection.. that we shouldn't ignore or retry on a micro level, we should just force users to retry whenever unexpected things happen.18:56
lifelessdprince_: its about 200GB of data all told, so non-trivial. I guess I"m thinking we want it to be an optional thing so we don't mirror all that data in every CI job18:56
lifelessSpamapS: right, because users like writing while true loops in bash18:56
*** rpodolyaka1 has joined #tripleo18:56
*** jcoufal has joined #tripleo18:56
lifelessSpamapS: so, start the topic and invoke me :)18:56
dprince_lifeless: I don't think we need to mirror everything. Just the binary packages (skip source, etc)18:57
dprince_lifeless: I haven't checked, just saying it might be toned down a bit18:57
SpamapSlifeless: indeed, I'll be pushing that concurrently with graceful rebuild18:58
lifelessdprince_: added a checklist on https://trello.com/c/xgto7r04/101-add-pypi-and-distro-mirrors-to-cd-undercloud-s18:58
lifelessdprince_: see if that summary works for you18:58
lifelessdprince_: its 50GB for binary ubuntu one arch one release18:58
lifelessdprince_: then we'll add however much for fedora18:59
slagleSpamapS: /tmp/get-pip.py would exist, there's nothing there to turn it off18:59
lifelessdprince_: then pypi18:59
slagleSpamapS: 01-install-pip-and-virtualenv would need to be under a install.d/pip-and-virtualenv-source-install directory, then we could disable it18:59
dprince_lifeless: Right, but the Fedora mirror only needs to run in the Fedora rack.19:00
SpamapSslagle: Oh I thought that if you chose a package install the source-repositories bit wouldn't even download things.19:00
lifelessdprince_: we'll be running both ubuntu and fedora in both regions as CI jobs, no ?19:00
lifelessdprince_: otherwise we don't get multi vendor redundancy on any job19:00
*** jp_at_hp has quit IRC19:01
lifelessdprince_: I agree that the CD clouds in each rack will be different distros - that gets us yet more CD coverage19:01
lifelessdprince_: but only mirroring fedora into the RH region will leave ubuntu CI jobs subject to vaguaries of network glitches etc19:01
*** cd-undercloud has joined #tripleo19:01
cd-undercloud************** overcloud complete status=7 ************19:01
*** cd-undercloud has quit IRC19:01
SpamapScurl: (7) couldn't connect to host19:02
SpamapSdib-run-parts Tue Feb 25 19:00:24 UTC 2014 Running /tmp/image.1jDMKvGi/hooks/root.d/10-cache-ubuntu-tarball19:02
lifelesswhups meeting time19:02
*** dkehn_ is now known as dkehn19:02
*** dkehn__ is now known as dkehn_19:03
slagleSpamapS: oh, i see what you mean19:03
slagleSpamapS: yea, i think that would disable the download. would need to try it19:03
*** rsacharya_ is now known as rsacharya19:03
*** cadenzajon_ has joined #tripleo19:04
SpamapSslagle: I am not familiar with the procedure to test that, or I'd do it myself. Could you try it and then post results on that review?19:06
*** pblaho has joined #tripleo19:06
slagleSpamapS: definitely19:07
*** cadenzajon has quit IRC19:07
SpamapSslagle: ty19:07
*** tteggel has quit IRC19:09
openstackgerritA change was merged to openstack/tripleo-incubator: Increase time waiting for nova to initialize  https://review.openstack.org/7621219:11
*** tteggel has joined #tripleo19:14
dprince_lifeless: what IP traffic ports are open on the HP public vlan? *?19:19
lifelessdprince_: at the infrastructure layer? everything.19:20
*** edmund has joined #tripleo19:22
*** cwolferh_ has quit IRC19:23
*** jtomasek has joined #tripleo19:23
*** cwolferh has joined #tripleo19:24
*** cwolferh has quit IRC19:24
*** cwolferh has joined #tripleo19:24
*** sdake_ has joined #tripleo19:28
*** cody-somerville has joined #tripleo19:29
openstackgerritRyan Brady proposed a change to openstack/tripleo-image-elements: Adds NFS backend support for cinder-volume  https://review.openstack.org/7456319:34
*** andreaf_ has quit IRC19:34
openstackgerritRyan Brady proposed a change to openstack/tripleo-heat-templates: Adds block-storage-nfs template  https://review.openstack.org/7501719:35
SpamapSNFS: for when you want the oldest most broken part of unix to pollute your shiny new cloud.19:36
SpamapSrbrady: sorry.. I can't resist picking on NFS.. it picked on me for so long..19:36
rbradySpamapS: no worries.19:37
openstackgerritRyan Brady proposed a change to openstack/tripleo-image-elements: Adds nfs-server element  https://review.openstack.org/7471219:39
*** andreaf has joined #tripleo19:39
rbradySpamapS: because of your fondness of NFS, I would be honored if you would review as soon as jenkins gives me the all clear. :)19:40
SpamapSrbrady: hah, yeah you're behind a few other patches but I'll be doing some reviews later today for sure.19:47
*** andreaf has quit IRC19:48
lifelessSpamapS: https://review.openstack.org/#/c/73045/219:54
saurabhsmysql and rabbitmq  elements in in tripleo-image-elements do not build cluster right? are we supporting clustered deployment of these component for overcloud deployment?19:55
SpamapSsaurabhs: the work to add clustering is in progress.19:56
greghaynessaurabhs: theres patches being worked on for that19:56
greghaynesI think the rabbit one landed already, actually19:56
*** pblaho has quit IRC19:57
*** boris-42_ is now known as boris-4219:58
*** jdob_ has joined #tripleo20:00
*** cd-undercloud has joined #tripleo20:00
cd-undercloud************** overcloud complete status=1 ************20:00
*** cd-undercloud has quit IRC20:00
SpamapSgreghaynes: rabbit has master selection issues I think.. so we may have more to do there.20:01
cody-somervilleHas Yahoo not been able to secure room for Monday?20:01
greghaynesAh, that it does20:01
* cody-somerville hasn't heard from them.20:01
*** rlandy has quit IRC20:01
lifelesscody-somerville: they sent mail to the thread on -dev/-operators yesterday20:01
*** andreaf has joined #tripleo20:01
slaglecody-somerville: see Sean Roberts email to -dev20:01
slagleon the thread about co-mingling with the operators20:02
SpamapScody-somerville: if not.. http://jdvhotels59-px.trvlclick.com/hotels/california/silicon-valley-hotels/wild-palms-hotel/services-and-amenities ... poolside hackathon!20:02
lifelessIIRC we stayed there one UDS20:02
*** jistr has quit IRC20:02
tchaypoah, we're going to have shuttles from the hotel to $venue? excellent20:05
Nglifeless: oh shit, we totally did. IIRC the only things in walking distance are a gas station, a Wendy's, a steak house and a car dealership20:09
greghaynes:/20:09
*** boris-42 has quit IRC20:10
greghaynesgoogle maps agrees20:10
lifelessNg: time for a test drive20:10
*** boris-42 has joined #tripleo20:10
lifelessNg: I need your help20:10
lifelessNg: read the meeting minutes :)20:10
lifelessNg: specifically around the broken ci overcloud control node but more generally we need to get the bad machines all jirad up and fixed20:10
*** vkozhukalov_ has joined #tripleo20:12
Nglifeless: okidoke, I have not been doing a good job of staying on top of that, I will get on the case20:13
openstackgerritTzu-Mainn Chen proposed a change to openstack/tuskar-ui: Add overcloud_role method to Node  https://review.openstack.org/7634820:14
*** coolsvap has quit IRC20:16
*** cadenzajon has joined #tripleo20:17
*** boris-42 has quit IRC20:19
*** boris-42 has joined #tripleo20:19
*** cadenzajon_ has quit IRC20:20
*** rcarrillocruz1 has joined #tripleo20:21
*** rcarrillocruz has quit IRC20:22
*** boris-42 has quit IRC20:23
*** boris-42_ has joined #tripleo20:23
*** epim has joined #tripleo20:26
*** d0ugal has quit IRC20:27
*** boris-42_ is now known as boris-4220:29
*** sballe has joined #tripleo20:31
*** d0ugal has joined #tripleo20:32
*** d0ugal has joined #tripleo20:32
*** jdob_ has quit IRC20:32
*** andreaf has quit IRC20:33
lifelessNg: I'm wondering where we get bios updates from, for the controller node20:34
lifelessNg: thanks20:34
*** sballe has quit IRC20:34
*** sballe has joined #tripleo20:35
Nglifeless: I expect the answer to be "DC Ops will do it for you"20:36
lifelessNg: heh, ok.20:37
lifelessso I suspect we actually need to look in syslog / dmesg for such warnings systematically, eventually20:37
lifelessI'll file a low pri bug about that20:37
slaglelifeless: can i get a review on this when you have a chance? https://review.openstack.org/#/c/76238/ (i abandoned the other 2 patches that had the symlink hackery for glance package support)20:41
lifelessslagle: so the distro packages edit the code to change defaults ?20:41
lifeless(just wanting to understand how the interaction happens...)20:41
slaglelifeless: no, the distro packages drop files under /usr/share/glance for the defaults20:41
slaglethat's what we're overriding, the values from those files20:41
lifelesshow do the files get picked up ?20:41
slaglepatches to oslo.config20:42
lifelessahha!20:42
lifelessso 'yes' :)20:42
slagleyea20:42
lifelessthinking out loud here20:42
slaglethe idea is that the distro defaults for the packaged glance live under /usr/share/glance. There's also packaged files under /etc/glance, which o-a-c happily overwrites (as it should). It just needs to be a bit more complete in what it overwrites to turn off more stuff from /usr/share/glance20:45
lifelesssorry, multiplexing 4 conversations20:45
lifelesswhat I don't like is that we trimmed our config files to only set things when the default upstream is wrong.20:46
lifelessAnd now we're setting things because an intermediary-for-the-code has decided the upstream default is wrong.20:46
lifelessThat doesn't make a whole lot of sense to me.20:46
slaglei mostly agree, i don't know why this was done20:47
slaglei can circle back and have that conversation, but the likelyhood of getting any glance package we can use is slim to none20:47
*** epim has quit IRC20:48
slaglew/o these changes i mean20:48
openstackgerritGregory Haynes proposed a change to openstack/tripleo-image-elements: Use xtradb-cluster in place of mysql  https://review.openstack.org/7554020:48
lifelessslagle: we could delete the culprit files?20:50
*** rsacharya has quit IRC20:50
slaglelifeless: we could...but rpm -V wouldn't be happy. that's what i was trying to avoid20:51
*** weshay has quit IRC20:51
lifelessslagle: does -V look for the file, or for the file being altered at all ?20:51
lifelessslagle: e.g. could we truncate the file ?20:51
slaglelifeless: both20:51
slaglefor files marked config, altered files are ok and expected20:51
lifelessslagle: alternatively, can we add a config option to override the patch to oslo.config20:51
slaglebut the files under /usr/share/glance are meant to be static20:52
slaglethey aren't marked config20:52
lifelessgotchya20:52
lifelessdpkg does similar, though you can tell it you're overriding things20:52
*** rpodolyaka1 has quit IRC20:53
*** sballe has quit IRC20:53
*** sballe has joined #tripleo20:55
*** ifarkas has quit IRC20:55
*** rsacharya_ has joined #tripleo20:55
ccrouch(2:05:38 PM) tchaypo: ah, we're going to have shuttles from the hotel to $venue? excellent20:56
ccrouchi seemed to have missed that memo, can you link me to info on the shuttles?20:56
*** cwolferh has quit IRC20:58
*** cwolferh has joined #tripleo20:58
openstackgerritBen Nemec proposed a change to openstack/tripleo-image-elements: WIP: Add lint script for elements  https://review.openstack.org/7635920:59
bnemecSpamapS: ^ Sounds like you might be interested in something like that20:59
*** d0ugal has quit IRC21:00
*** hashar has joined #tripleo21:01
*** sballe has quit IRC21:03
lifelessslagle: so I'm not sure what to do here21:03
*** sballe has joined #tripleo21:03
lifelessslagle: it seems clear to me that the bug is in the package, shipping non-upstream code21:04
*** rcarrillocruz has joined #tripleo21:04
*** rcarrillocruz1 has quit IRC21:05
*** dprince_ has quit IRC21:06
*** rcarrillocruz1 has joined #tripleo21:12
*** rcarrillocruz has quit IRC21:13
ccrouchbnemec: HACKING for dib elements, I like it! :-)21:15
*** sballe has quit IRC21:15
*** sballe has joined #tripleo21:15
*** sballe has quit IRC21:16
*** sballe has joined #tripleo21:16
bnemecccrouch: The more automated the reviews, the better. :-)21:19
*** julim has quit IRC21:23
slaglelifeless: i can file bugs against the rdo package, see if we can get fix21:24
slaglelifeless: in the meantime, we can go fwd with this review as-is and doc the bug, or i can change it up to delete the packaged files (i'm not sure if that will work, but I can try it)21:25
lifelessslagle: will give it 100% cpu a bit later today and comment for you21:25
lifelessslagle: (still multiplexing :()21:25
slaglek, thx.21:25
*** saurabhs has quit IRC21:28
*** saurabhs has joined #tripleo21:34
*** cd-undercloud has joined #tripleo21:36
cd-undercloud************** overcloud complete status=1 ************21:36
*** cd-undercloud has quit IRC21:36
*** cody-somerville has quit IRC21:36
*** saurabhs has quit IRC21:47
*** saurabhs has joined #tripleo21:50
* SpamapS returns21:50
SpamapSbnemec: I _love_ the idea.21:51
*** cody-somerville has joined #tripleo21:51
*** cody-somerville has quit IRC21:51
*** cody-somerville has joined #tripleo21:51
SpamapSbnemec: note that I wrote one that pulls yaml out of README.md and tries to apply templates using it..21:51
SpamapSbnemec: we should definitely combine the efforts :)21:51
bnemecSpamapS: Works for me. :-)21:51
SpamapSthat one is lost to the sands of time.. will have to go dig it out21:51
SpamapSGot caught up in working on it, and forgot to write tests.. and.. some people think tests are a good idea.21:52
* SpamapS looks in mirror, sees one of those people21:52
*** jdob has quit IRC21:52
*** akrivoka has quit IRC21:52
*** cadenzajon has quit IRC21:53
*** jcoufal has quit IRC21:54
lifelessI need a name21:55
lifelessuhm21:55
lifelessos-cloud-init ?21:55
lifelesssomething to pull the initialize-a-heat-deployed-cloud code into21:55
lifelessos-cloud-setup ?21:55
lifelessos-setup-cloud?21:55
*** jcoufal has joined #tripleo21:56
SpamapSslagle: does rpm have something like dpkg-divert .. which allows administrators of debian/ubuntu systems to rename packaged files without perturbing the package manager.21:57
SpamapSlifeless: os-cloud-config would keep with the os-*-config pattern21:57
SpamapSlifeless: but I'm not entirely sure this actually does fit with that pattern.21:58
*** epim has joined #tripleo22:03
*** epim_ has joined #tripleo22:03
lifelessSpamapS: ok so, heat man22:05
lifelessSpamapS: a week ago you ran out saying something about Ireland...22:05
lifelessSpamapS: do I need to sit on you and say 'no moving until we have graceful...' ?22:05
SpamapShaha22:06
SpamapSlifeless: I've been blocked on stevebaker saying he thinks it will be doable with the software config types (and without HOT)22:07
SpamapSlifeless: and we are going to chat about it today.22:07
*** epim has quit IRC22:07
*** epim_ is now known as epim22:07
hewbroccaSpamapS: It does not, I'm fairly certain (rpm)22:07
slagleSpamapS: not that i know of22:08
stevebakerSpamapS, lifeless, so take a look at https://review.openstack.org/#/c/67624/ and https://review.openstack.org/#/c/74206/22:08
stevebakerSpamapS, lifeless, my next task will be to get structured config tested and working - hopefully today or tomorrow22:09
stevebakerI need to go now22:10
*** cd-undercloud has joined #tripleo22:10
cd-undercloud************** overcloud complete status=1 ************22:10
*** cd-undercloud has quit IRC22:10
SpamapShewbrocca: that's unfortunate. :-/22:11
*** saurabhs has quit IRC22:11
SpamapSsuch a simple thing22:11
*** sballe has quit IRC22:11
SpamapSstevebaker: will look soon22:11
*** sballe has joined #tripleo22:12
*** lblanchard has quit IRC22:13
SpamapSlifeless: btw, the current tripleo-cd cloud is not from a 500, but from the rebuild failing to PXE boot any machines.22:14
SpamapSs/tripleo-cd cloud/tripleo-cd fail/22:14
*** ccrouch has quit IRC22:15
*** victor_lowther__ has quit IRC22:15
*** victor_lowther__ has joined #tripleo22:16
*** victor_lowther__ is now known as victor_lowther22:16
*** hashar has quit IRC22:16
*** jcoufal has quit IRC22:17
lifelessSpamapS: are you investigating ?22:20
*** jcoufal has joined #tripleo22:20
*** saurabhs has joined #tripleo22:20
*** newell has joined #tripleo22:22
hewbroccaSpamapS: heh... our support guys would resign en masse if we tried to get that into RPM22:22
lifelessso, would save you some money22:25
lifelessWould you like a patch ? :)22:26
hewbroccaheh22:29
greghayneslifeless: poke about tripleo lp group approvals22:29
lifelessthnks22:32
lifelessdone22:32
greghaynes\O/ ty22:32
SpamapShewbrocca: Really? It seems like they'd rather have a breadcrumb than a hole in the filesystem.22:32
bnemecDo we have the prereqs for running devtest documented anywhere?  Like passwordless sudo and !requiretty?22:34
lifelessbnemec: they aren't requirements :)22:34
bnemecJust wondering because I'm trying to run devtest.sh on a fresh install and hit the requiretty thing.22:34
lifelessbnemec: more context please?22:35
bnemeclifeless: Well, okay, without passwordless sudo you'd have to run as root though, right?22:35
*** saurabhs has quit IRC22:35
bnemeclifeless: Just ran devtest.sh --trash-my-machine on a new box and it failed due to Fedora requiring a tty by default.22:35
lifelessbnemec: I don't have passwordless sudo22:36
lifelessbnemec: and I run devtest all the time22:36
lifelessbnemec: I get prompted, I type my password in22:36
lifelessbnemec: where did it fail ?22:36
lifelessbnemec: we use sudo from many place22:36
lifelessin soviet russia, verb does you22:36
bnemeclifeless: After adding my user to libvirtd22:37
bnemeclibvirtd:x:1001:bnemec22:37
bnemecadding bnemec to group libvirtd22:37
bnemecsudo: sorry, you must have a tty to run sudo22:37
bnemec^Last three lines in console.22:37
lifelessok, so ugh, I still hate that we have to do that22:37
lifelessuhm22:37
bnemecYeah22:37
lifelesshow were you logged into the box?22:38
bnemecIt trips me up regularly on new systems.22:38
bnemecJust an ssh session.22:38
lifelesswhat I'm getting at here is that there is a difference between the automation that drives image builds and deploys22:38
*** CaptTofu_ has quit IRC22:38
lifelessand what we do to an admins local machine22:38
lifelessthe former I would say 'file a bug and fix it'22:38
lifelessthe latter we need to be more cautious about22:38
lifelessin this case, How about adding a 'sudo echo 'sudo has to work'' to the stop of install-dependencies22:39
lifelesss/stop/top/22:39
rbradybnemec: I use this on new systems http://paste.openstack.org/show/69579/22:39
bnemecrbrady: Right, I can fix this for myself, but it's a bad introduction to devtest for anyone running on Fedora.22:40
*** saurabhs has joined #tripleo22:41
rbradybnemec: how far did you get?22:41
*** victor_lowther has quit IRC22:41
bnemeclifeless: Oddly enough, I'm pretty sure sudo works fine everywhere else.  It's just this one after the libvirtd group add that causes issues.  I wonder if there's a way around that...22:41
bnemecrbrady: Not far. :-)22:41
bnemecIt blows up in install-dependencies.22:41
lifelesswe could remove the code22:42
bnemecI have no idea how six virtual desktops on two 1080P monitors is not enough desktop space, but it's not enough. :-022:42
lifelessand instead assert that its not configured correctly22:42
*** victor_lowther__ has joined #tripleo22:43
bnemeclifeless: Maybe add them to the group and then print a message that they need to log back in?22:43
lifelessbnemec: we already do that22:43
lifelessbnemec: I mean, we can avoid the sudo entirely right?22:43
lifelessbnemec: but I think we have more sudos ininstall-dependencies anyway22:44
lifelessso its a bit moot22:44
bnemeclifeless: Oh, I see.  sudo is blowing up after the sudo su -l in install-dependencies.22:44
bnemecSo it's nested sudo that's broken. :-)22:44
bnemec(I think)22:44
*** saurabhs has quit IRC22:45
*** jcoufal has quit IRC22:46
*** weshay has joined #tripleo22:46
*** martyntaylor has quit IRC22:47
*** cd-undercloud has joined #tripleo22:47
cd-undercloud************** overcloud complete status=1 ************22:47
*** cd-undercloud has quit IRC22:47
*** ccrouch has joined #tripleo22:49
*** cody-somerville has quit IRC22:49
bnemecOkay, yeah.  After sudo su -l bnemec -c "PATH=$PATH $0" the subsequent sudos will fail on Fedora.22:54
lifelessyay bug22:56
*** vkozhukalov_ has quit IRC22:57
StevenKbnemec: sudo su? :-(22:57
bnemecStevenK: Yeah, we're trying to pick up the new group the current user was just added to: https://github.com/openstack/tripleo-incubator/blob/master/scripts/install-dependencies#L12822:58
StevenKOh22:58
StevenKbnemec: Right, but your euid should be 0, so sudo -u $USER $0 should work, no?22:59
StevenKYou may want $@22:59
bnemecStevenK: Not sure.  I'll have to play around with it a little.23:01
StevenKbnemec: So there are reasons to use sudo su, but most of them are bad. Try straight sudo if you can.23:02
bnemecStevenK: Still failing on the tty error. :-(23:04
bnemecWondering if there's a way to make the exec maintain the tty.23:04
bnemecSeems like there should be.23:04
*** openstack has joined #tripleo23:06
*** rbrady is now known as rbrady-afk23:06
*** matty_dubs is now known as matty_dubs|gone23:12
greghaynes\O/ ty23:24
greghaynesoops23:24
* greghaynes shakes fist at up arrow key23:24
*** cd-undercloud has joined #tripleo23:26
cd-undercloud************** overcloud complete status=1 ************23:26
*** cd-undercloud has quit IRC23:26
*** weshay has quit IRC23:32
*** ramishra has joined #tripleo23:49
bnemecHuh.  Does the libvirtd group add work for anyone?  The exec only re-runs install-dependencies, so when you get back to devtest_setup after it completes you've lost the group again.23:52
tchayposo if I'm turning up to beg for a token, I probably want at least jeans and a collared shirt23:53
bnemecI found a solution to the tty error, but then it promptly failed on a libvirt permission error.23:53
*** epim has quit IRC23:56
*** cd-undercloud has joined #tripleo23:59
cd-undercloud************** overcloud complete status=1 ************23:59
*** cd-undercloud has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!