Thursday, 2016-05-05

openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272500:04
*** chem has quit IRC00:06
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272500:36
*** apetrich has joined #tripleo00:36
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272500:40
*** dmacpher has quit IRC00:46
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272500:46
openstackgerritMerged openstack/tripleo-quickstart: use yaml blocks for really long strings  https://review.openstack.org/31097900:53
openstackgerritMerged openstack/tripleo-quickstart: lots and lots of comments (1/2)  https://review.openstack.org/31098000:53
openstackgerritMerged openstack/tripleo-quickstart: lots and lots of comments (2/2)  https://review.openstack.org/31098100:53
*** apetrich has quit IRC00:55
*** absubram has joined #tripleo00:57
*** thrash is now known as thrash|g0ne01:04
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272501:10
*** absubram has quit IRC01:12
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272501:24
*** julim has joined #tripleo01:45
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272502:03
*** jaosorior has joined #tripleo02:28
*** dixiaoli has joined #tripleo02:29
openstackgerritMerged openstack-infra/tripleo-ci: Enable undercloud ssl on nonha job  https://review.openstack.org/27374302:33
*** tzumainn has quit IRC02:35
*** dmacpher has joined #tripleo02:36
*** yamahata has quit IRC02:42
*** jaosorior has quit IRC02:48
*** shivrao has quit IRC02:56
*** fragatina has quit IRC03:17
*** cwolferh has quit IRC03:26
*** shivrao has joined #tripleo03:36
*** panda has quit IRC03:41
*** panda has joined #tripleo03:43
*** cwolferh has joined #tripleo03:48
*** dixiaoli has quit IRC03:48
*** pleia2 has quit IRC03:51
*** dixiaoli has joined #tripleo04:00
*** liverpooler has quit IRC04:19
*** masco has joined #tripleo04:37
*** fragatina has joined #tripleo04:39
*** fragatin_ has joined #tripleo05:04
*** fragatina has quit IRC05:08
*** oshvartz has joined #tripleo05:13
*** fabbione has quit IRC05:14
*** fabbione has joined #tripleo05:15
*** ifarkas has quit IRC05:22
*** olap has quit IRC05:24
openstackgerritMichael Chapman proposed openstack/puppet-tripleo: Add neutron profiles  https://review.openstack.org/29343605:45
*** cwolferh has quit IRC05:58
*** openstackgerrit has quit IRC06:03
*** openstackgerrit has joined #tripleo06:03
*** liverpooler has joined #tripleo06:05
*** fragatin_ has quit IRC06:07
*** saneax_AFK is now known as saneax06:12
*** shivrao has joined #tripleo06:16
*** itamarl has joined #tripleo06:17
*** pkovar has joined #tripleo06:17
*** shivrao_ has joined #tripleo06:17
*** shivrao has quit IRC06:20
*** shivrao_ is now known as shivrao06:20
*** gbraad has joined #tripleo06:21
*** stendulker has joined #tripleo06:33
*** dbecker has joined #tripleo06:33
openstackgerritMerged openstack/instack-undercloud: Add dib-lint to pep8 tox job  https://review.openstack.org/30652106:39
openstackgerritMerged openstack/diskimage-builder: Add documentation for dib-lint  https://review.openstack.org/31167106:43
*** tesseract has joined #tripleo06:44
*** tesseract is now known as Guest2128806:45
openstackgerritMerged openstack/puppet-tripleo: Create dbs in step 3 for the roles  https://review.openstack.org/31249606:47
*** cwolferh has joined #tripleo06:47
*** dsariel has joined #tripleo06:58
*** olap has joined #tripleo07:00
*** jprovazn has joined #tripleo07:07
*** rasca has quit IRC07:07
*** rasca has joined #tripleo07:08
*** apetrich has joined #tripleo07:10
*** shivrao has quit IRC07:11
*** apetrich has quit IRC07:11
*** apetrich has joined #tripleo07:11
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: WIP: Composable roles NTP  https://review.openstack.org/31042107:12
*** dmacpher has quit IRC07:14
*** dtantsur|afk is now known as dtantsur07:15
*** paramite has joined #tripleo07:15
*** athomas has joined #tripleo07:21
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Fix validation for stable branch  https://review.openstack.org/31235007:25
*** devvesa has joined #tripleo07:27
*** paramite has quit IRC07:30
*** aufi has joined #tripleo07:31
*** shardy has joined #tripleo07:37
*** shardy has quit IRC07:38
*** shardy has joined #tripleo07:38
*** zoli_gone-proxy is now known as zoliXXL07:38
*** zoliXXL is now known as zoli|wfh07:40
*** ifarkas has joined #tripleo07:40
*** masco has quit IRC07:41
*** mikelk has joined #tripleo07:41
*** paramite has joined #tripleo07:44
zoli|wfhgood morning07:47
*** jpena|off is now known as jpena07:48
*** gfidente has joined #tripleo07:49
*** gfidente has quit IRC07:49
*** gfidente has joined #tripleo07:49
shadowerew07:49
shadowersorry, wrong window07:50
*** dbecker has quit IRC07:54
*** dmk0202 has joined #tripleo07:57
*** mcornea has joined #tripleo07:59
*** dmk0202 has quit IRC08:03
*** mbound has joined #tripleo08:10
*** dmk0202 has joined #tripleo08:11
*** florianf has joined #tripleo08:14
*** florianf has quit IRC08:14
*** dbecker has joined #tripleo08:14
openstackgerritMerged openstack/tripleo-heat-templates: Leave start/stop/restart for Keystone and Glance in charge to the role  https://review.openstack.org/31093608:17
*** lucas-afk is now known as lucasagomes08:19
*** florianf has joined #tripleo08:21
*** derekh has joined #tripleo08:23
*** dtantsur is now known as dtantsur|brb08:33
*** ohamada has joined #tripleo08:33
*** jistr has joined #tripleo08:34
shardyderekh: Hey, is there a file containing the hashes used for each periodic job?08:48
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Stop destroying VM's that don't exist  https://review.openstack.org/31286308:49
shardyI'd like to write a script that proposes a release of all-the-things based on the output of a selected passing job08:49
derekhshardy: each periodic job after it runs posts results to the mirror server, then the promote script runs hourly to check the most recent results and promotes if it finds passes for all the jobs using the same trunk repository08:52
derekhshardy: here is the promote script http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/mirror-server/promote.sh08:52
derekhshardy: could what your trying to do be put into that script or may run on that server where the results are?08:53
derekhshardy: alternatively you down to scraping the results on periodic jobs from the log server, like this08:54
derekhshardy: https://review.openstack.org/#/c/308865/08:54
derekhshardy: if your trying to make sense of that promote script send me a key and I'll add you to the mirror server so you can look around08:54
*** electrofelix has joined #tripleo08:56
shardyderekh: thanks, that helps - I guess all I really need is the delorean hash from logs.openstack then I can work backwards from that09:00
*** hjensas has quit IRC09:04
*** nijaba_ has quit IRC09:05
*** nijaba has joined #tripleo09:07
*** mkovacik has joined #tripleo09:08
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: WIP: Composable roles NTP  https://review.openstack.org/31042109:10
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: WIP: Puppet manifest to configure NTP as a composable service  https://review.openstack.org/31072509:11
*** rasca has quit IRC09:13
*** Slower has quit IRC09:15
*** Slower has joined #tripleo09:22
*** rasca has joined #tripleo09:27
*** florianf has quit IRC09:27
*** sambetts|afk is now known as sambetts09:40
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: WIP: Composable roles NTP: THT  https://review.openstack.org/31042109:42
*** leanderthal has quit IRC09:43
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: WIP: Composable roles NTP: PT  https://review.openstack.org/31072509:43
openstackgerritCarlos Camacho proposed openstack/tripleo-docs: WIP: Composable roles NTP: TD  https://review.openstack.org/31151209:45
*** rasca has quit IRC09:47
openstackgerritMiles Gould proposed openstack/tripleo-common: Import initial_state logic from tripleoclient  https://review.openstack.org/30952109:49
*** dtantsur|brb is now known as dtantsur09:51
*** tosky has joined #tripleo09:53
openstackgerritMarios Andreou proposed openstack/puppet-tripleo: Adds the base and pacemaker profile for the memcached service  https://review.openstack.org/31287709:53
*** hjensas has joined #tripleo09:55
*** rasca has joined #tripleo09:55
derekhshardy: actually wouldn't it be enough to just look at http://trunk.rdoproject.org/centos7/current-tripleo/delorean.repo , if we have promoted then the would imply the periodic jobs passed09:58
*** stendulker_ has joined #tripleo09:59
shardyderekh: heh, yeah I guess it would - I must need a coffee :)09:59
derekhshardy: ;-)10:00
derekhshardy: FYI, we promoted last night , 2 nights in a row, this craziness is unheard of10:02
* shardy falls off chair10:02
shardy\o/10:02
*** stendulker has quit IRC10:02
derekhIf we still had a status page for the periodic jobs imagine this as a row of 5 green jobs10:03
derekh[derekh@Tea540 i]$ ./check-jobs.sh10:03
derekhhttp://logs.openstack.org/periodic/periodic-tripleo-ci-f22-nonha/0e8b216/console.html 2016-05-05 07:45:33.388 | Finished: SUCCESS10:03
derekhhttp://logs.openstack.org/periodic/periodic-tripleo-ci-f22-ha/a350474/console.html 2016-05-05 08:18:49.669 | Finished: SUCCESS10:03
derekhhttp://logs.openstack.org/periodic/periodic-tripleo-ci-f22-upgrades/842e7f7/console.html 2016-05-05 08:43:48.216 | Finished: SUCCESS10:03
derekhhttp://logs.openstack.org/periodic/periodic-tripleo-ci-f22-ha-mitaka/32c25c5/console.html 2016-05-05 08:06:37.539 | Finished: SUCCESS10:03
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates: Add ability to use NFS as a backend of nova instances  https://review.openstack.org/31054410:03
derekhhttp://logs.openstack.org/periodic/periodic-tripleo-ci-f22-ha-liberty/6338b69/console.html 2016-05-05 08:11:17.954 | Finished: SUCCESS10:03
*** stendulker_ has quit IRC10:05
*** mgould has joined #tripleo10:06
*** aufi has quit IRC10:09
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: WIP: Composable roles NTP: PT  https://review.openstack.org/31072510:10
*** aufi has joined #tripleo10:15
*** rasca has quit IRC10:27
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart: Fix validate issue introduced in 5c676335  https://review.openstack.org/31288910:28
trown|outtypewwwshardy: even better than looking at http://trunk.rdoproject.org/centos7/current-tripleo/delorean.repo would be http://trunk.rdoproject.org/centos7/current-tripleo/versions.csv10:32
trown|outtypewwwit has all of the git hashes in there10:32
trown|outtypewwwalso woot on all 5 periodic jobs passing... its been a while since that happened10:32
shardytrown|outtypewww: thanks, that's exactly what I was after10:34
*** rasca has joined #tripleo10:34
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Fix validation for stable branch  https://review.openstack.org/31235010:40
*** mgould has quit IRC10:43
*** dsariel has quit IRC10:44
openstackgerritMerged openstack/tripleo-quickstart: Fix validate issue introduced in 5c676335  https://review.openstack.org/31288910:49
cmyster7/10:50
*** mgould has joined #tripleo10:51
*** MaxPC has joined #tripleo10:51
*** hewbrocca-afk is now known as hewbrocca10:56
*** rasca has quit IRC10:59
*** rasca has joined #tripleo10:59
*** rasca has quit IRC11:01
*** rasca has joined #tripleo11:05
*** links has joined #tripleo11:05
*** dsariel has joined #tripleo11:11
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Adds memcached as a composable service  https://review.openstack.org/31289911:13
*** rhallisey has joined #tripleo11:22
*** pkovar has quit IRC11:22
*** jprovazn has quit IRC11:23
*** masco has joined #tripleo11:34
*** thrash|g0ne is now known as thrash11:36
rookshardy so, scaling things out we are at 270 compute nodes, going to 280 the update fails, heat stack-list returns, however heat resource-list -n5 overcloud gets a RPC timeout11:45
rookshardy: I have increased the rpc timeout from 600 to 100011:45
*** jprovazn has joined #tripleo11:46
*** Goneri has quit IRC11:47
*** masco has quit IRC11:49
rookshardy: reviewing the heat-engine log, i see that nodes are being updated? even though the deployment is marked as update_failed11:51
rook2016-05-05 12:15:33.371 6264 INFO heat.engine.service [req-a83dc606-3c6b-45c2-88da-1d9c30cfe00b - -] Service d272d2e2-f318-45e4-8063-f1ccdad11454 is updated11:51
rookshardy: ^ example of what I am seeing in the heat-engine log11:52
*** weshay has joined #tripleo11:53
*** links has quit IRC11:53
rookshardy well, ignore the above after the 8th try I got the output I was looking for.. no more RPC timeouts :)11:54
*** zoli|wfh is now known as zoli|PTO11:59
rookshardy here is what I am seeing (after the update_failed -- and restarting heat-engine)  https://gist.github.com/jtaleric/cb7c43eedd123d1d6fd2fa35c5060c0412:00
rookit seems that each heat-engine worker process is still working on updating?12:00
*** saneax is now known as saneax_AFK12:02
*** pkovar has joined #tripleo12:04
*** paramite has quit IRC12:06
rook^^ could verywell be a normal operation, but i have never really seen this12:07
*** saneax_AFK is now known as saneax12:08
*** jayg|g0n3 is now known as jayg12:13
*** tzumainn has joined #tripleo12:13
*** ccamacho is now known as ccamacho|lunch12:13
*** dprince has joined #tripleo12:15
*** rodrigods has quit IRC12:17
*** rodrigods has joined #tripleo12:18
*** fultonj has joined #tripleo12:21
*** pradk has joined #tripleo12:23
*** dmacpher has joined #tripleo12:31
pabelangermorning12:35
pabelangerwhere / how is the instack.qcow2 image build?12:35
pabelangerhttp://192.168.1.101/builds/current-tripleo/instack.qcow212:35
slagleit's built by our periodic job12:36
slaglenightly, assuming the job passes12:36
pabelangerI'd like to see about changing the format to something other then qcow2, since centos7 does not support nbd, I cannot mount it without updating my kernel12:36
pino|worknbd is not supported?12:38
pabelangerno12:38
pino|workhm weird, nbd is kept enabled in qemu and libguestfs12:39
pabelangerhttp://logs.openstack.org/56/312656/2/experimental-tripleo/gate-tripleo-ci-centos-7-nonha/2629dde/console.html#_2016-05-05_01_36_56_97312:39
pabelangerI could be wrong, but cannot modprobe nbd12:40
pino|workhm curious12:41
pino|worksadly you are right :/12:41
pino|work# CONFIG_BLK_DEV_NBD is not set12:41
pabelangerYup12:41
pabelangerfigure switching to a raw image, is the only option at this point12:42
pabelangeror moving to ubuntu-trusty12:42
slaglewhy do you need to mount it?12:42
pabelangerI have no idea :)12:42
pabelangertripleo-ci does some magic I think12:42
pabelangeradds missing bits or SSH keys?12:42
slagleoh is that happening in one of the tripleo-ci scripts?12:42
pabelangeryes12:43
shardyderekh: ^^ ?12:43
*** jpena is now known as jpena|lunch12:43
pabelangertoci_instack.sh12:43
slagleyea, i see to inject the repos12:43
pino|workyou could use libguestfs ...12:44
pabelangerwill have to see how that works12:44
slaglemaybe, but we are already running in virt12:44
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272512:45
pabelangergoing raw first, see if that works12:45
slagleyou ought to be able to just convert to raw, mount, then convert back12:46
*** jcoufal has joined #tripleo12:46
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Use the overcloud full images from the cache  https://review.openstack.org/31239712:46
derekhpabelanger: ^^ there's another one, sorry :-(12:47
pabelangerderekh: does switching to .raw impact tripleo CI?12:48
derekhpabelanger: as in converting and then converting back? guess the main impact would be the time it takes12:50
pabelangerderekh: or generating a raw in your periodic job12:50
EmilienMhello ooo12:52
*** morazi has joined #tripleo12:53
pabelangeris there anything else using the instack.qcow2 image?12:55
derekhpabelanger: we'd have to change the xml definition on the virsh seed domains, which should be ok I think12:56
derekhpabelanger: their  currently <driver name='qemu' type='qcow2' cache='unsafe'/>12:56
*** rbrady has joined #tripleo12:56
derekhpabelanger: nothing else uses it the daily jobs use the one that was created when the last periodic job passed12:56
derekhpabelanger: did you meant to run losetup here? https://review.openstack.org/#/c/312725/15/scripts/common_functions.sh12:57
*** trown|outtypewww is now known as trown12:58
openstackgerritJames Slagle proposed openstack/instack-undercloud: Use tripleo::selinux  https://review.openstack.org/31056512:59
openstackgerritJames Slagle proposed openstack/instack-undercloud: Move persistent journal to puppet  https://review.openstack.org/31056412:59
openstackgerritJames Slagle proposed openstack/instack-undercloud: Use enable-packages-install element  https://review.openstack.org/26382912:59
openstackgerritJames Slagle proposed openstack/instack-undercloud: Don't use os-cloud-config/common-venv elements  https://review.openstack.org/30855012:59
openstackgerritJames Slagle proposed openstack/instack-undercloud: Create firewall rules with puppet  https://review.openstack.org/30837412:59
openstackgerritJames Slagle proposed openstack/instack-undercloud: Move parts of undercloud-install to puppet  https://review.openstack.org/31293112:59
openstackgerritJames Slagle proposed openstack/instack-undercloud: Don't use ironic-conductor element  https://review.openstack.org/31293212:59
*** mbound has quit IRC12:59
*** tosky_ has joined #tripleo13:00
*** tosky has quit IRC13:03
pabelangerderekh: Ya, I did.13:04
*** hjensas has quit IRC13:04
EmilienMshardy: hi! how do you want to tag puppet-tripleo?13:04
openstackgerritJames Slagle proposed openstack/puppet-tripleo: Add tripleo::selinux  https://review.openstack.org/30940813:05
openstackgerritJames Slagle proposed openstack/puppet-tripleo: Add dport/sport parameter to firewall rule  https://review.openstack.org/30835813:05
sshnaidm_derekh, hi, could you please look today at tempest patch please? https://review.openstack.org/#/c/295844/  thanks13:08
*** sshnaidm_ is now known as sshnaidm13:08
*** akuznetsov has joined #tripleo13:08
derekhsshnaidm: looking13:09
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272513:09
openstackgerritLars Kellogg-Stedman proposed openstack/tripleo-quickstart: fix some formatting errors in our inventory template  https://review.openstack.org/31293813:10
shardyEmilienM: Hi!  We've switched to tagging all other tripleo releases via openstack/releases - are you planning to do the same for the other puppet-* releases?13:13
*** Goneri has joined #tripleo13:13
EmilienMshardy: yes13:13
*** rbrady has quit IRC13:13
EmilienMshardy: starting from newton13:13
*** rbrady_ has joined #tripleo13:13
shardyEmilienM: Ok, I'll add the deliverable and propose an initial release13:14
EmilienMshardy: are you going to do it for mitaka?13:14
trownd0ugal: can we merge https://review.openstack.org/#/c/290468/ ?13:14
EmilienMI'm not sure I need to do it13:14
shardyEmilienM: I was just going to propose an initial release under the _independent category, then we'll propose our first newton release for n-1 in a few weeks time, e.g for all tripleo deliverables13:15
shardyhopefully by then our cycle-trailing tag will also have merged13:15
EmilienMshardy: cool13:15
shardyEmilienM: to clarify, is the request here actually for a release from stable/mitaka?13:16
EmilienMshardy: the email was about a tag that is useful for packaging people13:16
openstackgerritMerged openstack-infra/tripleo-ci: Tempest for tripleo CI  https://review.openstack.org/29584413:17
shardyEmilienM: Ok, so I guess for stable/mitaka then trown can possibly clarify13:17
shardyEmilienM: in that case perhaps we just push the tag and I'll align with openstack/releases from there onwards13:18
*** rook has quit IRC13:18
trownIm lost... what email?13:18
shardyassuming the acl's allow it - project-config doesn't have an acl-config for puppet-tripleo13:18
*** yamahata has joined #tripleo13:18
*** rook has joined #tripleo13:18
shardytrown: there was an email from Fred asking for a release from puppet-tripleo13:18
shardyturns out we've never tagged one13:18
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Deploy RabbitMQ as a composable role  https://review.openstack.org/31186313:19
trownshardy: ah ok, I would guess it would only be needed for master... mitaka and earlier is still OPM13:19
shardytrown: Ok, thanks, that's easier then I guess, I'll just propose the release and deliverables to the releases repo13:20
trownshardy: it would be good to include puppet-tripleo in your list for automated releases from versions.csv too13:20
shardytrown: any suggestion how we pick an initial release version, e.g there are prior branches so I'm not sure if a 1.0.0 release makes sense13:20
trownespecially with composable roles need that package in sync with tripleo-heat-templates13:21
*** ccamacho|lunch is now known as ccamacho13:21
shardytrown: Yeah, that's my intention, sort these gaps in the openstack/releases setup, then have a versions_to_release.py which auto-mangles the versions.csv into openstack/releases13:21
*** lblanchard has joined #tripleo13:21
trownsweet!13:22
shardyso at any time we can declare a release of all pieces (at least those following the cycle-trailing model) based on a good periodic job13:22
trownshardy: as far as versioning... pbr pick 0.0.1 since we have no tags, I think 1.0.0 is fine for master13:22
shardytrown: ack, thanks - I'll go with that then13:23
trownsince the previous branches were not really released13:23
derekhsshnaidm: +2, thanks for sticking with it13:23
sshnaidmderekh, great, thanks!13:23
rookshardy: so those updates that hit the heat-engine log, those are totally normal? /me doesn't have another tripleo deployment to compare13:24
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with periodic jobs  https://review.openstack.org/29703813:26
openstackgerritMerged openstack/tripleo-common: Example yaml for building images  https://review.openstack.org/29046813:26
*** itamarl has quit IRC13:26
*** ohamada has quit IRC13:28
*** mbound has joined #tripleo13:28
*** yamahata has quit IRC13:30
*** yamahata has joined #tripleo13:30
*** akshai has joined #tripleo13:31
shardyEmilienM, trown: https://review.openstack.org/312947 proposed to openstack/releases13:31
shardyrook: soory, which logs are you referring to?13:32
openstackgerritRyan Brady proposed openstack/tripleo-common: [WIP]Adds Ironic Workflows  https://review.openstack.org/30020013:32
trownshardy: looks good13:33
EmilienMshardy: why bbe7f42cfdaaf8c5398ffd00b1ca77d2ec7a02bf ?13:33
shardyEmilienM: it says in the commit message, it's what current-tripleo is currently set to13:33
EmilienM(just a random question)13:33
EmilienMok13:33
shardye.g what passed our last periodic CI run13:33
EmilienMexcellent13:33
EmilienMshardy: maybe I should do the same for our mitaka release (it was 8.0.0) for the 27 modules?13:34
shardyEmilienM: honestly I'm not sure - TripleO doesn't have any mitaka deliverables, so I'm just going to adopt the new process for Newton I think13:35
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272513:35
EmilienMok, it makes sense13:35
*** hjensas has joined #tripleo13:35
*** hjensas has joined #tripleo13:35
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Fix validation for stable branch  https://review.openstack.org/31235013:39
rookshardy: https://gist.github.com/jtaleric/cb7c43eedd123d1d6fd2fa35c5060c0413:40
rookshardy: i just see this on a idle undercloud13:40
rookover and over again, didn't know if that was normal or if I should wait for these updates to complete13:41
ayoungEmilienM, I know you were working on Fernet support in OOO.  Do you have something I can look at?13:43
shardyrook: It's fine to ignore them - it's updating some data which is accessed via heat-manage service list13:43
ayoungI know how to set it up manually, but I want to be sure we cover the redeploy case13:43
shardybasically just a liveness check - we could probably drop that log to debug13:44
rookshardy++13:44
rookshardy: want me to push a patch for that?13:44
EmilienMayoung: so I finished the work in puppet-keystone to make it 100% automatic, it works but it's not yet tested in puppet CI (this patch: https://review.openstack.org/#/c/305451/ will test it) because we don't test Newton packaging yet, we're blocked by https://etherpad.openstack.org/p/delorean_master_current_issues13:44
shardyrook: sure, thanks!13:44
EmilienMayoung: but you can already patch tripleo and deploy fernets, see https://review.openstack.org/#/c/305451/13/manifests/keystone.pp L58 and 59, it will do the job for you13:45
ayoungEmilienM, OK so there are 3 points that need testing.13:45
ayoung1.  Initialize the Key repo13:45
ayoung2. Set the token provider13:45
ayoung3.  Key rotation13:45
ayoungI suspect 1 and 2 are covered.  Is 3?13:45
*** fragatina has joined #tripleo13:45
EmilienM1) and 2) are already supported by puppet-keystone13:45
EmilienM3), no. How to do it? a crontab? that purge the dir and regenerate witht he keystoen-manage CLI?13:46
EmilienMwe can easily do it in puppet-keystone13:46
ayoungEmilienM, so... before we get there, lets talk HA13:46
ayoungIn order to generate a key repo I run the keystone-manage command on each Keystone server13:46
ayoungbut then we need to et the keys from that server to the other servers, so they can all validate each others tokens13:47
ayoungor we can generate the key on one server and share...roughly the same13:47
EmilienMoh13:47
EmilienMso we need to upload the keys somewhere13:47
EmilienMand download them on the nodes13:47
ayoungEmilienM, and ideally not store them, just transfer node to node13:47
*** openstackgerrit has quit IRC13:47
EmilienMsince tripleo does not use puppetDB, there is no way to do it via Puppet13:47
EmilienMdprince: thoughts ^?13:48
*** openstackgerrit has joined #tripleo13:48
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/all_nodes/mac_hostname.yaml13:49
dprinceEmilienM: we can drive this w/ Heat if we need to. Create a software deployment (script) that runs keystone-manage... and then harvest the output as a script software deployment variable13:49
dprinceoutput rather13:50
shardyEmilienM, ayoung: You can run a software deployment over all nodes (or, just all controllers by the sounds of it)13:50
dprinceyep, there you go. Shardy just gave you the example you'd need here13:50
shardythe pass the output of that into another deployment, which can potentially update the hieradata (or do something else with the data)13:50
dprinceEmilienM: don't even say the word "puppetDB" again man :)13:50
EmilienM:-O13:51
EmilienMpuppetdb puppetdb puppetdb13:51
* hewbrocca cringes13:51
ayoungdprince, I assume that Heat is playing the role that PuppetDB plays in their deployments, at least for the executor, and that swift will, eventually be the datastore13:51
EmilienMok so we need to run the keystone-manage on one node, at step 2 or 3 and then export the keys at step 4 on the other nodes13:51
ayoungEmilienM, technically we can run it anywhere, as it does two things13:52
ayoung1.  Creates the repor (directory) with the right permissions13:52
ayoung2.  Generates the Key13:52
ayoungif you run it on, say, the controller1, then you could copy the whole directory, perms and all, to controller213:52
*** olap has quit IRC13:53
ayoungor, if you did it on the undercloud, you could copy it down, but then your undercloud and overcloud would share signing keys, which is not good13:53
*** athomas has quit IRC13:53
*** jpena|lunch is now known as jpena13:53
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: WIP: Composable roles NTP: PT  https://review.openstack.org/31072513:54
sshnaidmweshay, oh, forgot to mention in mtg: I'll start doing also elastic recheck for CI and will integrate links to logstash to my dashboard, so you will see patterns trends in kibana13:55
ayoungdprince, EmilienM I've been working with the assumption that, if Puppet manages a file, and I edit that file, a redeploy will wipe it out, where as if Puppet does not manage the file, it will be ignored.  With  a software deployment those files are packaged up into a tarball, stored, and redeployed.13:55
ayoungSo I don't really want to store Keys,  just want them to be in encrypted memory.  Let me see if I can find some docs on how other people are doing rotation13:56
weshaysshnaidm, nice hrybacki ^13:56
hrybacki++!13:57
*** ppradhan has joined #tripleo14:00
*** athomas has joined #tripleo14:00
sshnaidmbnemec, hi14:04
*** larstobi has quit IRC14:04
ayoungThe only Key sharing algorithms I know use PKI.  I don't want to reinvent that.14:04
*** larstobi has joined #tripleo14:05
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add install-bin element  https://review.openstack.org/31164614:05
*** bvandenh has joined #tripleo14:06
*** rbrady_ has quit IRC14:06
*** rbrady has joined #tripleo14:06
*** akuznetsov has quit IRC14:07
*** links has joined #tripleo14:07
EmilienMayoung: rotation could be done with a shell script that runs in crontab14:07
EmilienMbut I'm afraid it could lead to race conditions, because I presume you need to restart keystone14:07
ayoungEmilienM, no need to restart14:08
ayoungEmilienM, its the transport of the key that is the problem14:08
EmilienMok14:08
ayoungEmilienM, the only Key sharing algorithms I know of use asymmetric crypto.  Trying not to create a solution harder than the problem here.14:08
*** mgould is now known as mgould|afk14:10
openstackgerritLars Kellogg-Stedman proposed openstack/tripleo-quickstart: remove old inventory file when running quickstart.sh  https://review.openstack.org/31297814:10
ayoungEmilienM, there is a standard called PKCS12 which might work, but then we need a way to distribute the public keys, and associate them with the servers.14:11
openstackgerritDmitry Tantsur proposed openstack/tripleo-docs: Document accessing stored introspection ramdisk logs  https://review.openstack.org/31297914:12
pabelangerboo14:12
pabelanger2016-05-05 13:49:06.750 | qemu-img: error while writing sector 38254848: No space left on device14:12
*** bvandenh has quit IRC14:12
pabelangerlooks like we only have 20GB HDD in tripleo ci?14:13
openstackgerritMerged openstack/tripleo-quickstart: fix some formatting errors in our inventory template  https://review.openstack.org/31293814:13
openstackgerritJames Slagle proposed openstack/puppet-tripleo: Add tripleo::selinux  https://review.openstack.org/30940814:14
openstackgerritJames Slagle proposed openstack/puppet-tripleo: Add dport/sport parameter to firewall rule  https://review.openstack.org/30835814:14
*** larstobi has quit IRC14:14
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272514:15
*** links has quit IRC14:16
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add tinycorelinux element  https://review.openstack.org/31164714:16
slagleEmilienM: how can i run the tests locally for puppet-tripleo?14:16
slagleEmilienM: i assume i need to setup rake somehow14:16
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add tinycorelinux element  https://review.openstack.org/31164714:17
EmilienMslagle: gem install bundler --no-rdoc --no-ri --verbose && bundle install && bundle exec rake spec "SPEC_OPTS=--format documentation  --trace14:18
openstackgerritRyan Hallisey proposed openstack/tripleo-heat-templates: Combine parameter_default fields  https://review.openstack.org/31298814:18
*** absubram has joined #tripleo14:18
openstackgerritDmitry Tantsur proposed openstack/tripleo-docs: Document accessing stored introspection ramdisk logs  https://review.openstack.org/31297914:19
EmilienMslagle: we're documented it in our official doc: https://review.openstack.org/#/c/311161/ but it was in the wiki https://wiki.openstack.org/wiki/Puppet/Unit_testing14:19
*** tosky_ has quit IRC14:22
pabelangerPlease take a moment to look at https://review.openstack.org/31299214:22
pabelangerI'm bumping the requirements for the centos-7 jenkins slave to m1.large, to get more HDD.  We're only launching a single node ATM14:23
*** tosky_ has joined #tripleo14:23
slagleEmilienM: alright, will give it a go, thx14:24
pabelangerderekh: ^14:25
*** liverpooler has quit IRC14:25
*** krotscheck has quit IRC14:27
derekhpabelanger: yup14:28
derekh| f25291f6-e269-45ed-b5a7-58de2ef53f9a | h1.ci     | 8192      | 20   | 0         |      | 1     | 1.0         | True      |14:28
*** jistr has quit IRC14:29
*** StevenK has quit IRC14:29
derekhpabelanger: how short are we?14:29
openstackgerritgreghaynes proposed openstack/diskimage-builder: Split pip out of pip-and-virtualenv  https://review.openstack.org/31165114:30
adarazstrown: do you have a minute to discuss this idea about using virt-customize to install the to-be-gated rpms on undercloud/overcloud images?14:30
pabelangerderekh: not sure, we likely need to double it. With centos-7 we cache a lot of things onto the HDD. I think we are using 14GB out of box14:31
trownadarazs: sure14:31
adarazstrown: The problem is that fetching and then uploading & starting the  undercloud VM is all done in quickstart's setup/undercloud role. So I  would need to add some logic there.14:31
openstackgerritMerged openstack/tripleo-quickstart: remove old inventory file when running quickstart.sh  https://review.openstack.org/31297814:32
pabelangerderekh: 80GB is what we use for all other clouds14:32
adarazstrown: now it's not clear to me how that could be done in a tidy way that sticks... I can imaging introducing a setting with a list of rpms that we 1) copy over with virt-customize and then 2) run a shell script that yum installs them from the local machine. do you have some better idea?14:32
greghaynesIf only we had some tool that could perform those types of operations when making an image14:33
*** krotscheck has joined #tripleo14:33
trownif only that tool wasnt an insecure mess of bash...14:33
greghaynesgreat, use virt-dib, be done14:34
adarazswhat are we talking about? did I step into some dib? :)14:34
adarazs+flame14:34
trownadarazs: anyways ... trolling aside, I am thinking on it14:34
pabelangergreghaynes: trown: it should be noted, ianw has a patch up to use virt-sysprep with diskimage-builder: https://review.openstack.org/#/c/307588/ So that's something for libguestfs14:36
derekhpabelanger: soo, we god plenty of space right now to bump up the disk space in the flavor, but this may come back and bit us in the ass soon14:36
derekhpabelanger: as we should be soon adding SSD'd to the nodes, these are smaller14:37
*** jkraj has joined #tripleo14:37
adarazstrown: I got to the point where I have a directory with the built rpms. we can create a repo and adjust priorities and then run a yum update on the image with that virt-customize, that should do the trick, but it's going to be quite a few tasks within that undercloud setup part.14:38
pabelangerderekh: I'm not sure how much space the bootstrap process needs for triplo-ci.  But the centos-7 images do require more space because we are caching things to the HDD.14:38
EmilienMdprince: sorry wrong channel: for the composable roles, I'm wondering if haproxy/keepalived need to be collocated14:39
trownadarazs: I think we could split those tasks into their one yml and conditionally include it after https://github.com/openstack/tripleo-quickstart/blob/master/playbooks/roles/libvirt/setup/undercloud/tasks/main.yml#L2814:39
derekhpabelanger: 200G per compute node, although we could use them as a cache for the spinning disks, e.g. dm-cache or Bcache14:39
trownadarazs: that kind of loses the ability to have it in its own role though... which would be ideal14:40
openstackgerritDan Prince proposed openstack/instack-undercloud: TripleO common for custom Mistral actions  https://review.openstack.org/31078214:40
trownadarazs: although creating the packages/repos with dlrn could still be its own role, we could just have arbitrary injection of extra repos/packages in libvirt/setup14:40
pabelangerderekh: how many compute nodes do you have? that means using todays flavor, 10 jenkins slave per compute node?14:41
dprinceEmilienM: they probably always will be, but they can be separate templates right?14:41
EmilienMdprince: they are not in THT, only p-tripleo14:42
EmilienMin loadbalancer.pp14:42
EmilienMI wonder if we need to split14:42
dprinceperhaps?14:42
dprinceEmilienM: what do you think?14:42
dprincesplit it?14:43
adarazsyeah, that makes sense. I'll draft something up.14:43
derekhpabelanger: 1114:43
adarazstrown: ^14:43
EmilienMdprince: I don't think we need an immediate split now. Services are collocated anyway, AFIK. Though HApoxy needs to move our in a specific role14:43
dprinceEmilienM: sure, agree we don't get a lot for splitting them immediately14:44
dprinceEmilienM: perhaps it makes more sense to split when we think of containers though? and container management, etc.14:44
dprinceEmilienM: but we can put it off for now perhaps14:44
trownadarazs: awesome thanks!14:44
EmilienMdprince: right14:44
EmilienMdprince: first we need to move all puppet code from tht to pup-ooo14:45
pabelangerderekh: okay, so we do need a conversation around HDD and jenkins slave then.  But maybe not today.  Is there any downside on bumping the centos-7 image to use 80GB today to unblock my testing?14:45
*** mgould|afk is now known as mgould14:46
derekhpabelanger: nope, it should be ok right now, I'm just reluctant to do it as we may not be able to switch back14:46
derekhpabelanger: I could change it now so long as were ok to change it back once the testing has finished,14:46
derekhpabelanger: then we can chat about what to do long term14:46
*** ramishra has quit IRC14:47
pabelangerderekh: I'm going to see if I can purge the git cache in the mean time to reclaim some HDD on the 20GB partition14:48
derekhpabelanger: so you want me to leave the flavor @ 20G for now?14:49
*** veteran has joined #tripleo14:49
*** ramishra has joined #tripleo14:49
pabelangerderekh: We can likely just update nodepool to use the m1.large: https://review.openstack.org/#/c/312992/14:50
dtantsurtrown, hey, how do I quickly know which DIB elements are used for RDO IPA build?14:50
pabelangerderekh: then, revert / reduce once we are happy with the new flavor size14:50
pabelangerderekh: we are also only running a single centos-7 node ATM14:50
derekhpabelanger: ok, sounds good to me14:50
*** absubram has quit IRC14:51
*** jistr has joined #tripleo14:51
pabelangerderekh: if you don't mind +1, I can reference tripleo is okay with the change in openstack-infra14:51
adarazstrown: any preference or pitfalls regarding "createrepo, add .repo file, tweak priorities (is everything still priority=1?), yum update"? alternatively we can do "yum install /path/to/localrpm" or "rpm --install --force", not sure which one would cause the least amount of trouble. :)14:52
trowndtantsur: right now... probably only can RTS... https://github.com/redhat-openstack/ansible-role-tripleo-image-build/blob/master/tasks/dib_build.yml#L52-L5714:52
trowndtantsur: need to log that info in the job that produces them14:52
derekhpabelanger: done14:52
pabelangerderekh: danke14:53
dtantsurtrown, thanks!14:53
trownadarazs: I like the first option14:53
trownadarazs: we should fix the repo priorities in RDO too to make that better (ie have the delorean.repo as 10 and deps repo as 20 so it is easy to put stuff in between)14:54
adarazstrown: yeah, but I guess it's still priority=1, so I will need to tweak them as before :)14:55
trownadarazs: yep, I am fine with that, or you could put a patch up for dlrn :)14:56
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Increase timeout and logging for crm_resource  https://review.openstack.org/31301114:57
pandatrown: any reason why fetch_image is done manually from get to checksum instead of using get_url ansible module ?14:57
trownadarazs: acutally that is probably still an "and", since old repos still would have old priorities14:57
adarazsyep14:57
trownpanda: here: https://github.com/openstack/tripleo-quickstart/blob/master/playbooks/roles/libvirt/setup/undercloud/tasks/fetch_image.yml#L42 ?14:58
*** ayoung has quit IRC14:59
pandatrown: yep14:59
trownpanda: I think that get_url will not register the contents of a url in a fact?14:59
*** derekh has quit IRC14:59
trownpanda: so I think it would require two tasks instead of one to get the md5 sum then read it in as a fact15:01
pandatrown: mh, I was wondering more about https://github.com/openstack/tripleo-quickstart/blob/master/playbooks/roles/libvirt/setup/undercloud/tasks/fetch_image.yml#68, once you download the checksum, you can pass it to get_url and it automatically validates.15:01
openstackgerritMerged openstack/tripleo-heat-templates: Remove calls to ::mysql from the manifests  https://review.openstack.org/31087915:02
trownpanda: ah ya, the curl command that actually gets the image is special :)... get_url does not retry w/resume, so if a download is interrupted it just fails and you have to start over15:02
*** jaosorior has joined #tripleo15:02
trownpanda: which is clearly not ideal with slow connections15:03
pandatrown: IT DOESN'T ?15:03
*** mbound has quit IRC15:03
adarazspanda, trown: also get_url seemed quite unreliable in the past to me on a number of occasions... times out when wget/curl had no problems downloading.15:03
pandatsk tsk. bad get_url.15:04
trownpanda: ya, early on in the life of quickstart it was pretty unusable because of that... Had to have long instructions about manually downloading the image and passing it in via file:// url15:04
pandaadarazs: I have a very slow connection, and curl times out twice before getting 2.4G of image :(15:04
*** absubram has joined #tripleo15:05
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272515:05
*** jaosorior has quit IRC15:06
*** mbound has joined #tripleo15:09
pandaweird get_url uses python urllib2. didn't know it was so unreliable .. ok, back to main task.15:10
trownlarsks: mind putting your thoughts into https://bugs.launchpad.net/tripleo-quickstart/+bug/1570289 ?15:13
openstackLaunchpad bug 1570289 in tripleo-quickstart "Use a more explicit method for teardown" [Critical,Triaged]15:13
*** aufi has quit IRC15:13
*** r-mibu has quit IRC15:13
*** r-mibu has joined #tripleo15:13
*** oshvartz has quit IRC15:14
*** pleia2 has joined #tripleo15:15
openstackgerritBrad P. Crochet proposed openstack/puppet-tripleo: Add Heat profiles  https://review.openstack.org/31301915:18
*** julim has quit IRC15:22
*** colonwq has quit IRC15:23
*** ifarkas has quit IRC15:23
*** colonwq has joined #tripleo15:24
*** julim has joined #tripleo15:24
*** thrash is now known as thrash|mtg15:25
*** ohamada has joined #tripleo15:25
*** absubram has quit IRC15:26
*** rbrady_ has joined #tripleo15:27
*** absubram has joined #tripleo15:27
*** rbrady has quit IRC15:27
*** bvandenh has joined #tripleo15:29
*** ayoung has joined #tripleo15:32
*** yamahata has quit IRC15:33
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add install-bin element  https://review.openstack.org/31164615:34
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add tinycorelinux element  https://review.openstack.org/31164715:35
openstackgerritgreghaynes proposed openstack/diskimage-builder: Split pip out of pip-and-virtualenv  https://review.openstack.org/31165115:35
*** bvandenh has quit IRC15:38
*** dmk0202 has quit IRC15:38
larskstrown: some thoughts posted.  they are not as organized as I would have liked, but I wanted to put them down before I have to disappear on some errands for a bit.15:41
trownlarsks: thanks!15:41
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272515:42
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Add loadbalancer profile for ha & non-ha  https://review.openstack.org/31302615:42
pabelangeris the instack.qcow2 image public?15:42
pabelangerI'd like to get a copy if possible15:42
*** rbrady_ has quit IRC15:45
*** rbrady has joined #tripleo15:46
*** mikelk has quit IRC15:46
*** ayoung has quit IRC15:46
*** Guest21288 has quit IRC15:46
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Deploy Loadbalancer as a composable role  https://review.openstack.org/31302915:47
*** pkovar has quit IRC15:50
*** akshai has quit IRC15:58
*** akshai has joined #tripleo15:59
*** saneax is now known as saneax_AFK15:59
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272516:00
pandatrown: there is not image cache update right ? we are not checking if the latest image is really the latest image available in repo16:01
trownpanda not sure what you mean? whether to download a new image if one exists in cache is an optional behavior16:02
*** thrash|mtg is now known as thrash16:02
trownpanda: this task https://github.com/openstack/tripleo-quickstart/blob/master/playbooks/roles/libvirt/setup/undercloud/tasks/fetch_image.yml#L24-L3316:03
trownpanda: checks if the config use_config_image=true and an image is in cache, and does not fetch a new image in that case16:03
trownuse_cached_image rather16:04
*** dtantsur is now known as dtantsur|afk16:04
pandatrown: I mean, there is nothing that checks if the image in the cache is obsoleted and downloads a newer one16:05
trownpanda: if !(use_cached_image and image exists) then we check if it matches the latest image and download if not16:06
*** derekh has joined #tripleo16:06
trownpanda: ya, that is the next block16:06
derekhusing the overcloud-full image from cache https://review.openstack.org/#/c/312397/16:07
trownuse_cached_image determines that behavior... whether we want to always update cache, or always try to use what we have16:07
pandatrown: ah, there it is ...16:07
trownderekh: 80 minutes for nonha :)16:07
derekhtrown: I woun't be surprised is it is below an hour over night (but thats not much help most of the time)16:08
derekh*woudn't16:08
derekh*wouldn't16:09
* derekh keeps adding letters one at a time until it looks corect16:09
derekh*correct16:09
trownlol16:09
*** yamahata has joined #tripleo16:10
trownderekh: what about python-tripleoclient/tripleo-common? if we use those to build the IPA and overcloud images we cant use the cached images for changes to those16:10
trownwhich is a bit unfortunate, given the majority of changes to those repos are not related to image building16:11
sshnaidmtrying to revive elastic recheck for CI, need your opinion: https://review.openstack.org/#/c/312985/ https://review.openstack.org/#/c/313038/16:11
derekhtrown: hmm,  I'll update the patch to filter those out for now , in the long term maybe we could restrict it to a sub directory or something16:14
trownderekh: k, one other thing... do we use any elements from instack-undercloud when building overcloud-full.... I seem to remember us doing that in the past16:17
trownbut maybe that was rdo-management stuff16:18
*** egafford has quit IRC16:19
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Use the overcloud full images from the cache  https://review.openstack.org/31239716:19
pabelangerIs there dns issues in tripleo-ci?16:19
pabelangerseeing the following16:19
pabelanger2016-05-05 16:07:48.802 | git.openstack.org: Name or service not known16:19
pabelangerhappens every 4-5 rechecks16:19
derekhtrown: not that I can think of, gotta catch a train will check in a bit16:20
pabelangerhttp://logs.openstack.org/56/312656/2/experimental-tripleo/gate-tripleo-ci-centos-7-nonha/cd0e25d/console.html16:20
*** noslzzp has quit IRC16:20
*** lucasagomes is now known as lucas-afk16:20
derekhpabelanger: yes, but pointing at the local dns server should work ok, or at least it has been for us16:21
derekhpabelanger: http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_instack.sh#n21716:21
derekhpabelanger: gotta run16:21
*** noslzzp has joined #tripleo16:21
*** derekh has quit IRC16:22
bnemecpabelanger: I'm only seeing a couple of those failures in the past two days: http://logstash.openstack.org/#/dashboard/file/logstash.json?query=build_name:%20*tripleo-ci*%20AND%20build_status:%20FAILURE%20AND%20%28message:%20\%22Name%20or%20service%20not%20known\%22%20OR%20message:%20\%22fatal:%20The%20remote%20end%20hung%20up%20unexpectedly\%22%2916:22
bnemecYou may have just won the network glitch lottery.16:22
*** trown is now known as trown|lunch16:25
*** noslzzp has quit IRC16:25
*** noslzzp has joined #tripleo16:26
*** devvesa has quit IRC16:28
*** dbecker has quit IRC16:28
openstackgerritSteven Hardy proposed openstack/tripleo-common: WIP mistral workflow to deploy nodes without nova  https://review.openstack.org/31304816:28
hrybackiweshay: can I get your review on https://review.gerrithub.io/#/c/273711/ por favor?16:28
shardydprince: ^^ FYI - it's not yet working, I'm having some issues getting DHCP working16:28
weshayhrybacki, did you adjust the setup.cfg to drop in the playbook?16:29
*** oshvartz has joined #tripleo16:29
hrybackiweshay: nope, good catch16:29
hrybackithx16:29
dprinceshardy: ack, will have a look16:29
pabelangerbnemec: ack, thanks16:30
shardydprince: I'm dropping off for the day soon, if you feel like hacking on it, you're welcome to push fixes ;)16:30
dprinceshardy: cool16:31
hrybackiweshay:  wait do you mean in the ansible-role-tripleo-collect-logs repo? It has the [files] section setup like the rest of the role repos afaik16:31
weshaythe setup.cfg for collect logs should drop that playbook into .cat/playbooks16:32
hrybackiweshay: I think i have it set up correctly: https://paste.fedoraproject.org/363036/24660321/16:34
weshayhrybacki, I'm suggesting that.. the role be responsible for adding the playbook https://github.com/redhat-openstack/ansible-role-tripleo-collect-logs/blob/master/setup.cfg16:35
weshaydon't see it there16:35
hrybackiwouldn't that assume that the role be run solely with CAT though?16:35
* hrybacki thought we pushed that responsibility to the deploy.sh script16:36
*** zeroshft has joined #tripleo16:37
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272516:43
*** akshai has quit IRC16:44
weshayhrybacki, hrm.. yes16:44
bnemecdprince: Are the graphite metrics available anywhere?16:44
bnemecI can't find anything on the server we're uploading them to.16:45
dprincebnemec: https://23.253.94.71/16:45
bnemecAh, https16:45
dprincebnemec: I don't have a proper cert mind you.16:45
dprincebut there is some stuff there16:45
bnemecdprince: Thanks16:45
hrybackiapetrich: any idea why this job is failing to populate the virthost inventory? https://ci.centos.org/job/tripleo-gate-cat/19/console16:45
hrybackiapetrich: nvm, gate needs the ansilbe-role-tripleo-collect-logs repo added to it probably16:46
apetrichhrybacki, just a second just hit my head16:46
apetrichneed ice16:47
hrybacki:(16:47
*** akshai has joined #tripleo16:47
*** dprince has quit IRC16:48
apetrichhrybacki, back16:48
apetrichoh ok16:48
hrybackiyeah, just missing the repo in the configuration16:48
apetrichhrybacki, could you have a look at https://review.gerrithub.io/#/c/275179/ and https://review.gerrithub.io/#/c/275111/16:48
apetrichhrybacki, with those in I can have the collect logs working16:49
apetrichweshay, ^^16:49
* hrybacki nods16:49
* hrybacki looks16:49
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272516:49
apetrichweshay, and that's extra important because the change to the requirments.txt add the collect logs so gate is broken16:50
*** akshai has quit IRC16:52
*** akshai has joined #tripleo16:54
shardyEmilienM: Hey FYI https://review.openstack.org/#/c/312947 has a validate failure which I think will affect all puppet module releases16:57
shardyI think we may need to add puppet-tarball-jobs to the validate check, but I'm not familiar with what that does (and puppet-tripleo doesn't currently have it), so any feedback on that would be good16:58
*** ccamacho has quit IRC16:58
*** hewbrocca is now known as hewbrocca-afk16:59
*** mbound has quit IRC17:01
EmilienMshardy: I'm already working on tarballs for puppet modules with pabelanger17:02
EmilienMshardy: see http://tarballs.openstack.org/17:02
*** mbound has joined #tripleo17:02
EmilienMshardy: we're finishing the work today with tags17:02
EmilienMonce its in place, I'll push a metadata.json in puppet-tripleo17:03
EmilienMso we can create a tarball for it and start releasing it17:03
shardyEmilienM: Ok, thanks - we'll also need to add puppet-tarball-jobs in the zuul layout for puppet-tripleo, and modify the openstack/releases project_config.py I think17:04
EmilienMshardy: I'll take care of it17:04
shardyEmilienM: thanks! :)17:04
EmilienMnot openstack/releases though17:04
EmilienMonly zuul17:04
shardyEmilienM: sure, I can do that in my existing patch when the zuul layout is fixed17:04
shardyOr propose another one17:05
EmilienMshardy: why project_config.py ?17:05
shardyEmilienM: thats got a conditional which forces you to choose either openstack-server-release-jobs or publish-to-pypi17:06
shardyI asssume we'll need to add puppet-tarball-jobs to that list?17:06
EmilienMoh right17:06
weshaytrown|lunch, question when you get back.. should we require folks who want to use localhost to specify the ip or fqdn of the localhost so that ansible doesn't get confused where it's running from and to?17:06
*** fragatina has quit IRC17:07
*** fragatina has joined #tripleo17:07
*** shardy has quit IRC17:07
*** veteran has quit IRC17:08
*** oshvartz has quit IRC17:08
*** gfidente has quit IRC17:08
EmilienMah, shardy left. For the record: https://review.openstack.org/31306317:09
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: add metadata.json file  https://review.openstack.org/31306817:14
apetrichhrybacki, answered the comment thanks for the review17:14
EmilienMand this one ^17:14
openstackgerritJames Slagle proposed openstack/puppet-tripleo: Add tripleo::selinux  https://review.openstack.org/30940817:17
openstackgerritJames Slagle proposed openstack/puppet-tripleo: Add dport/sport parameter to firewall rule  https://review.openstack.org/30835817:17
*** jistr has quit IRC17:17
*** fragatina has quit IRC17:18
pabelangerokay, need some triplo-ci help. Not sure what the following means: http://logs.openstack.org/56/312656/2/experimental-tripleo/gate-tripleo-ci-centos-7-nonha/244429d/console.html#_2016-05-05_17_15_39_85117:19
openstackgerritJames Slagle proposed openstack/puppet-tripleo: Add tripleo::selinux  https://review.openstack.org/30940817:19
pabelangererror: Failed to start domain seed_217:19
slaglethe problem is on the next line: seed_2.qcow2: not in qcow2 format17:20
pabelangerhow is seed_2.qcow2 generated?17:21
slagleit's instack.qcow217:21
pabelangerHmm17:21
pabelangerqemu-img convert /opt/stack/new/instack.raw /opt/stack/new/instack.qcow217:22
pabelangermaybe I need more flags17:22
*** athomas has quit IRC17:23
slagle-O qcow217:23
slaglei dont think it's smart enough to interpret based on filename extension17:24
*** saneax_AFK is now known as saneax17:24
pabelangerya, adding that now17:24
*** cebreidian has quit IRC17:24
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272517:24
*** trown|lunch is now known as trown17:25
trownweshay: I think there is some logic in tripleo-quickstart for using localhost... whether it works right is another matter17:25
trownweshay: I would prefer that `quickstart.sh localhost` just worked, and maybe even if no hostname is specified it uses that by default17:26
weshaytrown, well.. I'm more confident if they use an ip or fqdn17:26
weshayhrm.. maybe we switch it if we detect localhost17:26
weshayswitch to the ip17:26
weshaymaybe I need to try this myself a bit more17:26
*** mbound has quit IRC17:27
trownweshay: I wonder if it would be as simple as just doing `if [ $VIRTHOST -eq localhost ]; then export VIRTHOST=127.0.0.1; fi`17:27
trownso we get around the ansible keywordness of localhost17:28
weshayya17:28
*** mbound has joined #tripleo17:28
*** mbound has quit IRC17:28
weshayshould be the same as $ip17:28
weshaywill try that17:28
pabelangerkeep in mind, ansible 2.0 will still us local_connection if you specific 127.0.0.1 / localhost. You'll need to bump to 127.0.0.2 if you want to actually SSH into localhost17:29
pabelangerlearned that the hard way17:29
weshayha.. holycrap.. never knew about .217:30
*** jpena is now known as jpena|off17:31
pabelangerIts 127.0.0.0/8 so you have a lot of choices :)17:31
weshaythanks pabelanger17:33
hrybackiapetrich: thanks, first patch lgtm. reviewing second now17:33
*** ayoung has joined #tripleo17:33
trownI think we want local_connection though... I think it is just our inventory that gets a little funky with localhost...17:33
* trown cant remember exactly what goes wrong though...17:34
trownmay need to summon larsks17:34
ayoungOOOqs question17:34
ayoungtrown, was that response to me?  My connection dropped17:34
trownayoung: missing your question17:35
ayoungtrown, not sure if my question went through.  It was17:35
ayounglarsks, trown is there really any reason to split the undercloud vm definition(S) from the overcloud vm?  COuld we merge the undercloud into the overcloud, with the exception of adding the undercloud to the public network?17:35
ayoungThe overcloud section already has code to handle different flavors etc.17:35
ayoungand I don't really want to wrestle with converting all  the undercloud_node  references into undercloud_node lists17:36
trownayoung: hmm.. maybe not, but that is a pretty big refactor17:38
trownayoung: https://github.com/openstack/tripleo-quickstart/blob/master/playbooks/roles/libvirt/setup/undercloud/tasks/main.yml#L1-L119 all needs to happen before defining the undercloud vm17:38
ayoungtrown, isn;t that duplicating what needs to happend for an overcloud one, though?17:38
trownmost of that does not strictly speaking have to happen before defining overcloud vms... but some of it does17:39
trowns/before/after/ in that last statement...17:39
* trown kicks brain17:39
ayoungtrown, now there is an interesting mental image17:40
*** egafford has joined #tripleo17:40
trownayoung: only a few things are the same... getting macs... actually defining the vm, but fetching the image, customizing it, and booting it up are all undercloud specific things17:40
ayoungOK, I should look at the two task files side by side to see the diffs17:41
ayoungtrown, OK, so here is what I need:  1 VM, on the external network, that is provisioned with the BaseOS.  It can be smallish, not nearly as big as a controller or undercloud.  The undercloud nodes, when booted need to be able to talk to it, too.17:44
ayoungWhen I am done, the VM should be running, just like the undercloud17:44
ayoungand the ssh setup to get into the undercloud VM should be duplicated to get me into this vm17:44
openstackgerritMarios Andreou proposed openstack/tripleo-common: WIP - Adds a simple utility mistral worfklow for your undercloud  https://review.openstack.org/31308417:45
ayoungtrown, so I have three choices:  I can hack the current undercloud role, I can tack this on to the overcloud role, or I could create a separate role17:47
ayoungtrown, lets say I make a separate role.  How do we avoid code duplication?17:47
*** dprince has joined #tripleo17:48
*** akrivoka has quit IRC17:49
*** zoli|PTO is now known as zoli_gone-proxy17:49
trownayoung: I think there are like 4 tasks needed... so not really all that worried about code duplication17:50
trownayoung: I think separate role is the way to go, then just add it here https://github.com/openstack/tripleo-quickstart/blob/master/playbooks/quickstart.yml#L2717:50
*** shivrao has joined #tripleo17:52
*** ohamada has quit IRC17:53
larskstrown: what was the question (re: maybe need to summon /me)?17:54
ayoungtrown will do17:54
trownlarsks: it was wrt running quickstart.sh against localhost17:56
larsksThat should work, pretty much.17:56
*** StevenK has joined #tripleo17:56
bandiniit did work at a certain point in time, I used it17:56
*** tosky_ has quit IRC17:56
larsksYeah, see! :)17:57
trownya I just cant remember exactly what magic we needed17:57
larsksI don't think we need any magic.17:57
trownalso I think it does not now... everything breaks without CI ;p17:57
larsksLet me give a shot Right Now.17:57
ayoung"everything breaks without CI"  trown I'm quoting you.17:57
hrybackimatbu: not sure what channged but can't seem to get the new art-tempest changes to run against the undercloud: https://paste.fedoraproject.org/363079/47104014/17:57
*** electrofelix has quit IRC17:59
ayoungtrown, I think I need to do everything that is in the undercloud role.  http://git.openstack.org/cgit/openstack/tripleo-quickstart/tree/playbooks/roles/libvirt/setup/undercloud/tasks18:02
larskstrown: well, trying to run on my centos box right now, I'm getting a python dependency problem: ERROR! Unexpected Exception: (setuptools 0.9.8 (/home/lars/tripleo-quickstart/work/lib/python2.7/site-packages), Requirement.parse('setuptools>=11.3'))18:03
* larsks investigates.18:03
ayoungIncluding all the ssh config, which is handled by that role.  THe VM work needs to be lists, and I need to separate the two, but I think I need to work within the confines of the undercloud role, or split out the common pieces.18:03
trownlarsks: oh ya.. I think that happens just from CentOS whether localhost or not... because old setuptools package tehre18:03
trownsomeone reported that on #rdo...18:04
larsksYeah.  Although I figured running from a virtualenv would avoid that.18:04
* trown looks if they made a bug18:04
*** coolsvap has quit IRC18:08
*** jschlueter has joined #tripleo18:09
*** fragatina has joined #tripleo18:12
larskstrown: hey, guess who found an ansible bug!18:12
trownhmm... the same one who files all the ansible bugs for tripleo-quickstart?18:15
larsks...or at least, what looks like a difference of behavior between 2.0.0.0 and 2.0.1.0, affecting fact gathering on localhost.18:15
larsksI am still trying to figure out the details.18:15
larsks...and without successful fact gathering, the "package" module doesn't work.18:16
trownright18:18
*** mgould has quit IRC18:18
*** Nakato has quit IRC18:19
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Calculate deployment times for the Heat resources  https://review.openstack.org/31309718:21
*** Nakato has joined #tripleo18:22
*** jprovazn has quit IRC18:24
*** mcornea has quit IRC18:29
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: [WIP] rework quickstart.sh to enable upstream, downstream and other playbooks  https://review.openstack.org/31310118:29
trownweshay: how did you submit a patch that is already in conflict :P18:30
weshayha18:30
weshayit touches a lot18:30
trownI guess because it touches every file in the repo :P18:30
*** eil397 has joined #tripleo18:31
*** sambetts is now known as sambetts|afk18:31
weshaytrown, I can handle the rename in a diff patch too18:32
larsksweshay: I think that may be too much stuff shoved into one patch.  Can we split that up a bit?18:33
trownweshay: mind filing a launchpad for that too? would be good to have for a change that big I think18:33
weshayaye18:33
openstackgerritTzu-Mainn Chen proposed openstack/tripleo-common: Add TripleO Mistral documentation  https://review.openstack.org/31310918:41
openstackgerritTzu-Mainn Chen proposed openstack/tripleo-common: Add TripleO Mistral documentation  https://review.openstack.org/31310918:44
*** hjensas has quit IRC18:47
pabelangerhow long does it take for gate-tripleo-ci-f22-nonha to usually run?18:48
*** dmacpher is now known as dmacpher-afk18:48
pabelangerI think I got gate-tripleo-ci-centos-7-nonha working correctly it is up to 45mins18:48
*** mcornea has joined #tripleo18:58
*** noslzzp has quit IRC19:00
slaglelately it's been taking anywhere from 80-120 minutes19:01
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: move most things out from the playbooks dir, and use config for release info  https://review.openstack.org/31311619:02
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: add metadata.json file  https://review.openstack.org/31306819:04
EmilienMslagle, pabelanger: we need to compare both flavors19:04
EmilienMthe job is not at 1 hr 18 min and not finished yet19:05
EmilienMso we're close to the end19:05
*** ccamacho has joined #tripleo19:06
EmilienMccamacho: hey! I updated https://etherpad.openstack.org/p/tripleo-composable-roles-work with your patches, feel free to use it for your future patches on that topic!19:07
*** akshai has quit IRC19:14
*** akshai has joined #tripleo19:14
*** mkovacik has quit IRC19:15
trownweshay: larsks can we merge https://review.openstack.org/#/c/312730 before starting down the massive refactor path?19:16
pabelangerEmilienM: agreed. Was just looking to see what the average was19:16
pabelangerEmilienM: centos-7 going to be a little longer since we have to convert qcow2 images19:16
pabelangerbut that could be address if raw format was supported19:16
*** dsariel has quit IRC19:18
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: move most things out from the playbooks dir, and use config for release info  https://review.openstack.org/31311619:19
larskstrown: don't know how strongly you feel about this, but all the other undercloud-scripts tagged tasks are in main.yml, not in post-install.  Can we move this template task out of the post-install?  I feel like we are leaking a tag.19:19
EmilienMpabelanger: that's a good news, so everything is virtualized in one vm?19:20
trownlarsks: ya or maybe it should go in overcloud... since it is really overcloud deploy related19:20
pabelangerEmilienM: well, it hasn't failed yet. So I think I got all the tripleo-ci bits working under centos-719:21
trownwith a tag of overcloud-scripts19:21
EmilienMpabelanger: but you run overcloud using tripleo cloud? what is running in the vm?19:21
pabelangerEmilienM: no, this is just the default gate-tripleo-ci-f22-nonha job but using centos-7 as the launch node19:21
pabelangerI don't actually know what the jobs does19:22
pabelangerfirst step, replace fedora-22 with centos-719:22
pabelangerthen, see how to help run tripleo stuff on other clouds19:22
-openstackstatus- NOTICE: Gerrit is restarting to address performance issues related to a suspected memory leak19:22
EmilienMpabelanger: ok cool19:22
trownthe launch node is just the jenkins slave ya?19:23
pabelangerFrom what I see ya19:23
pabelangersome other magic, but only had to deal with qcow2 mount not support on centos719:24
*** trown is now known as trown|outtypewww19:26
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart: Explicit Teardown and accessories changes  https://review.openstack.org/31312719:28
panda... two minutes too late19:28
*** akshai has quit IRC19:29
*** trown|outtypewww is now known as trown19:29
trownlarsks: what if we just tag it overcloud-scripts and leave it where it is?19:29
larskstrown: waaaaaa, but it's in a role called "undercloud".19:30
*** akshai has joined #tripleo19:30
*** noslzzp has joined #tripleo19:30
larskstrown: but honestly, if it needs to go in to make things work right now, I don't really feel strongly.  We can always move/retag it later.19:30
trownlarsks: well... the undercloud-post role is what prepares the undercloud to run the deploy... it could just as easily be called overcloud-pre19:31
trownlarsks: k, since it fixes a legit blocker bug for people following default instructions I think we should merge as is and think about it later :)19:31
*** noslzzp has quit IRC19:32
pandaaaa too many changess19:32
larsksmerge away!19:32
larskspanda: in general, or are you just looking at weshay's patch :)19:32
trownpanda: I will check out your patch this evening (assuming I am not at labor and delivery)19:32
*** noslzzp has joined #tripleo19:32
*** trown is now known as trown|outtypewww19:32
weshaywhat's the full gate trigger.. full_check ?19:33
pandatrown|outtypewww: np, I still have to test it thoroughly19:33
trown|outtypewwwweshay: full-ci-check19:33
weshaythanks19:33
trown|outtypewwwnow I am really out :)19:33
*** hjensas has joined #tripleo19:33
*** hjensas has quit IRC19:33
*** hjensas has joined #tripleo19:33
larskstrown|outtypewww: see ya...19:33
pandalarsks: mine, weshay's, everything, too many changes.19:34
openstackgerritMerged openstack/tripleo-quickstart: Template network-environment.yml with undercloud-scripts tag  https://review.openstack.org/31273019:34
weshaythere really isn't much to my change19:34
larsksweshay: I know, it just looks scary :)19:35
larsksBut there are a few unrelated things smooshed together there.19:35
ayoungYay I can go back to master!19:35
weshaylarsks, this one cleaner https://review.openstack.org/#/c/313116/19:35
weshayI can hack out the .gitignore and requirements change19:36
larsksweshay: I probably wouldn't have included the last two bullet points in that patch.  Without those, it is effectively "reorganize"...19:36
larsksyeah.19:36
weshaylarsks, I need the collect-logs chagne19:36
weshaychange19:36
weshayor it fails19:37
larsksOkay, fair enough.  I hadn't looked closely, and it just sounded from the commit message that it was a separate thing.19:37
weshayya.. will remove it19:37
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Use new redis profiles  https://review.openstack.org/31273219:38
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: move most things out from the playbooks dir, and use config for release info  https://review.openstack.org/31311619:39
openstackgerritPradeep Kilambi proposed openstack/puppet-tripleo: Add redis profile  https://review.openstack.org/30475419:39
*** panda has quit IRC19:41
*** panda has joined #tripleo19:42
jschlueterok issue I just hit with quickstart is that everytime I run deploy it blows away and re-creates /home/stack which is where the images files are downloaded to ... so it has to re-download them every time ...19:42
jschlueterwhat am I doing wrong while testing out my own setup to make tripleo-quickstart used by (ci-ansible-triple) do teardown but not blow away my oooq_cache19:44
jschlueterweshay: ^^19:45
* weshay looks19:46
larsksjschlueter: you can point image_cache_dir somewhere outside of /home/stack, or you can run things without using quickstart.sh.19:46
larsksjschlueter: I just dropped a world-writeable cache directory in /home/cache and use that.19:47
*** absubram has quit IRC19:47
weshayah ya.. the volume pool is nuked19:47
larsksweshay: no, not the volume pool,  the cache directory.19:47
larskslosing the volume pool is okay.19:47
weshayk looking19:47
jschlueterlarsks: tips for going about doing that?19:48
larsksjschlueter: copy playbooks/centosci/minimal.yml to, say, config.yml, add "image_cache_dir: /path/to/some/directory" to that file, and use it like "sh quickstart.sh -c config.yml ...".19:48
jschlueterI'm liking the move image_cache_dir but where do I configure that? docs to read? config file to tweak?19:48
weshayjschlueter, actually the easiest way.. imho.. is to do this19:49
weshaydownload the image manually..19:49
jschlueterI have the image available locally now I saved it off19:49
weshayand pass a -e on the command line w/ image_url:file:///root/foo.qcow219:49
pabelangerwoot19:50
jschlueterweshay: ack19:50
pabelangergate-tripleo-ci-centos-7-nonha SUCCESS in 1h 48m 54s19:50
larsksjschlueter: I generally avoid quickstart.sh in preference for something like https://gist.github.com/larsks/d5718949e2719173d0487745a97b382f, which skips the provisioning and environment setup steps and just set ups the guests and runs the tripleo deployment.19:50
weshaypabelanger, are you enabling tripleo ci on ci.centos?19:50
pabelangerweshay: I haven't signed up for any work to do that :)19:51
larsksThe quickstart, since it's designed to start from zero, performs several steps that are really only necessary once (like installing packages, setting up libvirt networking...)19:51
pabelangerweshay: what would need to be done?19:51
weshaypabelanger, we're working on that now.. just checking if we had crossed streams19:52
larsksjschlueter: there are some patches under review right now that will make some of the teardown behavior optional, so quickstart won't try to nuke everything first.19:52
weshaythird party that is19:52
jschlueterlarsks: ack ... I'm still trying to get first install to complete, running into networking issues19:52
* weshay was confused by <pabelanger> gate-tripleo-ci-centos-7-nonha SUCCESS in 1h 48m 54s19:52
larsksjschlueter: still the vpn stuff?  I can take a look now if you'd like.19:52
*** absubram has joined #tripleo19:52
jschlueterlarsks: I'm good with some of the teardown as I'm have instances still up and running from failed run19:52
jschlueterlarsks: sure let me see where it's at19:53
weshayjschlueter, so look at .cat/config/rhos-7.0.4.yml19:53
weshayjschlueter, you can change the image_url setting there manually19:53
*** shivrao has quit IRC19:53
weshayjschlueter, point it at a file19:53
*** dprince has quit IRC19:54
jschlueterweshay: ack will try that next19:54
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add tinycorelinux element  https://review.openstack.org/31164719:55
openstackgerritgreghaynes proposed openstack/diskimage-builder: Split pip out of pip-and-virtualenv  https://review.openstack.org/31165119:55
Sloweranyone know how heat links a 'group' in a structured config to a specific hook?19:57
slagleSlower: that should be in 55-heat-config: https://github.com/openstack/heat-templates/blob/master/hot/software-config/elements/heat-config/os-refresh-config/configure.d/55-heat-config19:59
slaglec20:00
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272520:01
Slowerslagle: thanks I'll check it out20:01
pabelangerokay, that should support both fedora-22 and centos-7 ^20:01
pabelangertesting again20:01
*** shivrao has joined #tripleo20:03
pandalarsks: I put general comments in the bug page, and copied specific part to reply to your concerns in gerrit. I'm always confused on when to use one or another to comment ..20:04
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Use new redis profiles  https://review.openstack.org/31273220:06
larskspanda: I generally ignore the bugs for discussing reviews, but I will check both spots.  Thanks.20:08
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: move most things out from the playbooks dir, and use config for release info  https://review.openstack.org/31311620:08
*** ayoung has quit IRC20:10
*** jkraj has quit IRC20:11
Slowerslagle: hrrm, well.. that's hmm dense :)20:12
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart: Explicit Teardown and accessories changes  https://review.openstack.org/31312720:12
Slowerslagle: is it getting it from the config? (which appears to be the whole template?)20:12
Slowerslagle: or is it just based on the script name somehow?20:12
SlowerI'm not seeing it I guess is what i'm saying20:12
weshayI wonder what tearing down libvirt buys at all .. panda?20:13
weshayvs.. just killing the guests themselves20:13
slagleSlower: yea so in invoke_hook, the "c" parameter is a dict representation of the SoftwareConfig20:14
*** rhallisey has quit IRC20:14
*** rhallisey has joined #tripleo20:14
*** rhallisey has quit IRC20:14
openstackgerritBen Swartzlander proposed openstack/tripleo-heat-templates: Enable Manila integration  https://review.openstack.org/18813720:15
*** rhallisey has joined #tripleo20:15
pabelangerweshay: Ah, let me know if I can help20:16
slagleSlower: then it's going to look for a matching hook under /var/lib/heat-config/hooks/20:17
weshaypabelanger, k will do.. atm we're focused on a ansible-role to build gerrit changes w/ a local delorean20:17
pabelangerweshay: my goal is to remove fedora-22 from the gate. And get tripleo on the same images we use for jenkins slaves20:17
slagleSlower:  so if the group were "puppet", it would look for /var/lib/heat-config/hooks/puppet, and run that20:17
slagleSlower: what is the group type you're using?20:17
openstackgerritBen Swartzlander proposed openstack/tripleo-heat-templates: Enable Manila integration  https://review.openstack.org/18813720:18
pandaweshay: maybe if you want to test a different network configuration on the same virthost just tearing down the domains is not enough20:19
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished  https://review.openstack.org/29732820:19
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test overcloud deletion in periodic job  https://review.openstack.org/29676520:19
openstackgerritBen Swartzlander proposed openstack/tripleo-heat-templates: Enable Manila integration  https://review.openstack.org/18813720:19
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272520:25
*** jayg is now known as jayg|g0n320:26
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave  https://review.openstack.org/31272520:28
*** dmk0202 has joined #tripleo20:29
-openstackstatus- NOTICE: Gerrit is restarting to revert incorrect changes to test result displays20:30
*** shivrao has quit IRC20:38
*** mcornea has quit IRC20:38
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: move most things out from the playbooks dir, and use config for release info  https://review.openstack.org/31311620:40
openstackgerritMerged openstack/instack-undercloud: Use enable-packages-install element  https://review.openstack.org/26382920:40
*** shivrao has joined #tripleo20:43
openstackgerritBen Swartzlander proposed openstack/tripleo-heat-templates: Add integration with NetApp Manila driver  https://review.openstack.org/18813820:43
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Calculate deployment times for the Heat resources  https://review.openstack.org/31309720:44
openstackgerritBen Swartzlander proposed openstack/tripleo-heat-templates: Add integration with NetApp Manila driver  https://review.openstack.org/18813820:48
Slowerslagle: ok got it20:48
Slowerslagle: that's pretty easy then20:48
openstackgerritBen Swartzlander proposed openstack/tripleo-heat-templates: Enable Manila integration  https://review.openstack.org/18813720:49
openstackgerritBen Swartzlander proposed openstack/tripleo-heat-templates: Add integration with NetApp Manila driver  https://review.openstack.org/18813820:49
openstackgerritimain proposed openstack/tripleo-common: WIP: Replace docker compose hook with a straight docker one.  https://review.openstack.org/31272320:49
*** egafford has quit IRC20:50
*** lblanchard has quit IRC20:54
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: allow for individual ansible parameters to be overriden outside of a config file  https://review.openstack.org/31315520:56
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: fix white space in quickstart.sh  https://review.openstack.org/31315620:58
*** mbound has joined #tripleo21:01
openstackgerritimain proposed openstack/tripleo-heat-templates: Use docker-cmd hook.  https://review.openstack.org/31315821:03
hrybackiweshay: apetrich we really need to get collect-logs running for the cat gate21:03
hrybackihaving local failures validating tripleo deployments w/ cat and I think the gate is failing in the same way (it's failing on the same task) but logs would help a lot21:04
*** saneax is now known as saneax_AFK21:05
*** rcernin has joined #tripleo21:05
apetrichhrybacki, weshay they have the votes I think we can merge it. it has been working consistently on my poc21:05
apetrichhrybacki, if you need now you can use my poc21:06
apetrichhrybacki, recheck now and it will run on the poc with logs21:07
hrybackiwill do, thanks apetrich !21:08
hrybackiapetrich: should I 'recheck' in the gerrit comment or 'retrigger' via the job itself to hit your poc?21:08
apetrichhrybacki, recheck should do it21:08
apetrichhrybacki, it's running21:10
hrybackiperfect21:10
apetrichhttps://ci.centos.org/view/rdo/view/promotion-pipeline/job/poc-apetrich_CAT-gate/91/21:10
hrybackiI shot out an email with a bit more info too21:10
apetrichplease disable the poc when done21:10
* hrybacki nods21:10
apetrichotherwise it hogs :)21:10
*** yamahata has quit IRC21:13
hrybackiapetrich: gotta go prep for tonight's event. Will log on and disable the gate after the build finishes though (~1 hour)21:14
apetrichhrybacki, we can disable now it will keep running21:15
hrybackilearn something new every day21:15
hrybackidisabled21:15
hrybackio/21:15
*** hrybacki is now known as hrybacki|gone21:15
jschlueterlarsks++21:16
*** shivrao has quit IRC21:17
*** shivrao_ has joined #tripleo21:17
*** yamahata has joined #tripleo21:18
*** mbound has quit IRC21:24
apetrichweshay, thanks for the merge21:32
weshayapetrich, aye.. can you push or you need me?21:32
apetrichweshay, pushing now21:32
apetrichI can do21:32
pabelangerlooking for some help on why this job failed: http://logs.openstack.org/25/312725/27/check-tripleo/gate-tripleo-ci-f22-nonha/1094c5e/console.html21:34
pabelangerI think it is just a timeout for something21:35
weshaypabelanger, it failed right after the overcloud images were uploaded to glance21:38
weshaymaybe it got a bad return code from it21:38
pabelangerweshay: okay, some something not related to the patch.  Since it was still setting up the overcloud right?21:39
*** Goneri has quit IRC21:39
weshaynot sure what the patch was from the log, but the overcloud images were built, uploaded.. then boom21:44
pabelangerokay, let me see if the other jobs pass first, then I'll recheck21:45
larskstrown|outtypewww: when you're back, I was able to figure out a  reproducer for the latest ansible bug: https://github.com/ansible/ansible/issues/1574421:46
*** cwolferh has quit IRC21:48
*** jdob has quit IRC21:50
*** thrash is now known as thrash|g0ne21:56
*** ppradhan has quit IRC21:58
*** ayoung has joined #tripleo22:03
*** cwolferh has joined #tripleo22:06
*** MaxPC has quit IRC22:07
*** ccamacho has quit IRC22:07
*** ccamacho has joined #tripleo22:09
*** akshai has quit IRC22:12
*** MaxPC has joined #tripleo22:12
*** absubram has quit IRC22:22
*** jcoufal has quit IRC22:26
*** rcernin has quit IRC22:29
*** fragatin_ has joined #tripleo22:37
*** fragatina has quit IRC22:41
*** jcoufal has joined #tripleo22:47
*** zeroshft_ has joined #tripleo22:47
*** zeroshft_ has quit IRC22:48
*** jcoufal has quit IRC22:49
*** rhallisey has quit IRC22:50
*** david-lyle has quit IRC22:51
*** zeroshft has quit IRC22:51
*** david-lyle has joined #tripleo22:53
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: Initial support for centos-7 jenkins slave  https://review.openstack.org/31272522:55
pabelangerSuccess, ready for some review for centos-7 jenkins slave ^22:56
*** david-lyle has quit IRC22:58
EmilienMpabelanger: congrats22:59
*** saneax_AFK is now known as saneax23:03
*** ayoung has quit IRC23:07
*** apetrich has quit IRC23:10
*** krotscheck has quit IRC23:31
*** krotscheck has joined #tripleo23:31
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Update the cistatus report  https://review.openstack.org/31318923:32
*** dmk0202 has quit IRC23:42
*** dtantsur|afk has quit IRC23:47
*** morazi has quit IRC23:48
*** ayoung has joined #tripleo23:53
*** eil397 has quit IRC23:56
*** noslzzp has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!