Monday, 2016-07-11

*** apetrich has quit IRC00:02
*** apetrich has joined #tripleo00:07
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028100:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]00:10
*** lblanchard has joined #tripleo00:24
*** limao has joined #tripleo00:32
*** coolsvap has joined #tripleo00:35
*** dmacpher has joined #tripleo00:42
*** social has quit IRC00:48
*** shivrao has quit IRC00:54
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028101:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]01:10
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477701:18
*** lblanchard has quit IRC01:29
*** limao has quit IRC01:32
*** limao has joined #tripleo01:33
*** akshai has quit IRC01:56
dsariel_hi, are there any pointers exist to best practices of hardware/system/triplleO configuration to boost TripleO performance?01:56
*** akshai has joined #tripleo02:06
*** akshai_ has joined #tripleo02:07
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028102:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]02:10
*** akshai has quit IRC02:10
*** dsariel_ has quit IRC02:10
*** dsariel has quit IRC02:11
*** ramishra has joined #tripleo02:27
*** ramishra has quit IRC02:42
*** ramishra has joined #tripleo02:43
*** ramishra has quit IRC03:02
*** ramishra has joined #tripleo03:03
*** chandankumar has joined #tripleo03:03
*** coolsvap has quit IRC03:04
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028103:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]03:10
*** myoung has joined #tripleo03:10
*** ramishra has quit IRC03:10
*** ramishra has joined #tripleo03:12
*** limao has quit IRC03:13
*** myoung has quit IRC03:14
*** coolsvap has joined #tripleo03:17
*** shivrao has joined #tripleo03:17
*** julim has quit IRC03:22
*** ramishra has quit IRC03:28
*** ramishra has joined #tripleo03:33
*** ramishra has quit IRC03:38
*** ramishra has joined #tripleo03:40
*** limao has joined #tripleo04:05
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028104:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]04:10
*** chandankumar has quit IRC04:29
*** akshai_ has quit IRC04:30
*** akshai has joined #tripleo04:30
*** akshai has quit IRC04:39
openstackgerritBabu Shanmugam proposed openstack/puppet-tripleo: Add OVN support for neutron profile  https://review.openstack.org/31487504:42
*** oshvartz has quit IRC04:49
*** masco has joined #tripleo05:06
*** skramaja has joined #tripleo05:07
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028105:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]05:10
*** ooolpbot has quit IRC05:10
*** pcaruana has quit IRC05:17
*** numans has joined #tripleo05:20
*** saneax_AFK is now known as saneax05:30
saneaxHi All05:31
*** sanjayu|AFK is now known as sanjayu05:43
*** dsariel has joined #tripleo05:47
*** dsariel_ has joined #tripleo05:47
openstackgerritSaravanan KR proposed openstack/os-net-config: WIP: Add support for OVS DPDK Bridge and Port  https://review.openstack.org/33869405:54
*** chandankumar has joined #tripleo06:01
*** pgadiya has joined #tripleo06:02
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028106:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]06:10
*** ramishra has quit IRC06:18
*** ramishra has joined #tripleo06:20
*** shivrao has quit IRC06:20
*** leanderthal|afk is now known as leanderthal06:20
*** rcernin has joined #tripleo06:23
*** akuznetsov has joined #tripleo06:24
*** tremble has joined #tripleo06:24
*** rasca has joined #tripleo06:30
*** tremble has quit IRC06:40
*** dmacpher has quit IRC06:44
*** anshul has joined #tripleo06:45
*** ohamada has joined #tripleo06:46
*** ohamada has quit IRC06:48
*** ohamada has joined #tripleo06:49
*** pcaruana has joined #tripleo06:51
*** anshul has quit IRC06:54
*** oshvartz has joined #tripleo06:58
*** limao has quit IRC07:02
*** limao has joined #tripleo07:03
*** coolsvap has quit IRC07:05
*** coolsvap has joined #tripleo07:06
*** ebarrera has joined #tripleo07:07
*** tesseract- has joined #tripleo07:08
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028107:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]07:10
*** anshul has joined #tripleo07:11
*** anshul has quit IRC07:12
*** anshul has joined #tripleo07:12
*** anshul has quit IRC07:21
*** anshul has joined #tripleo07:21
*** liverpooler has joined #tripleo07:25
*** aufi has joined #tripleo07:30
*** zoli_gone-proxy is now known as zoliXXL07:33
*** anshul has quit IRC07:33
*** anshul has joined #tripleo07:34
*** jpich has joined #tripleo07:39
*** zoliXXL is now known as zoli|wfh07:39
zoli|wfhgood morning07:40
*** ifarkas has joined #tripleo07:40
*** fragatina has joined #tripleo07:40
*** fragatina has quit IRC07:46
*** fragatina has joined #tripleo07:46
*** coolsvap has quit IRC07:49
*** hjensas has joined #tripleo07:50
*** hjensas has joined #tripleo07:50
*** jtomasek has quit IRC07:52
*** mcornea has joined #tripleo07:52
*** akuznetsov has quit IRC07:55
*** lucas|afk is now known as lucasagomes07:58
*** coolsvap has joined #tripleo08:00
openstackgerritJulie Pichon proposed openstack/python-tripleoclient: [WIP] Add 'openstack overcloud node import' command  https://review.openstack.org/33972708:00
openstackgerritJulie Pichon proposed openstack/python-tripleoclient: Add 'openstack overcloud node introspect' command  https://review.openstack.org/33659508:00
openstackgerritJulie Pichon proposed openstack/python-tripleoclient: Add 'openstack overcloud node provide' command  https://review.openstack.org/33441108:00
*** ramishra has quit IRC08:06
*** jistr has quit IRC08:06
*** jistr has joined #tripleo08:07
*** ramishra has joined #tripleo08:08
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028108:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]08:10
*** jistr has quit IRC08:11
*** jistr has joined #tripleo08:11
remix_aueihello, is there any doc on how to make planned maintenance on a controller node that has been deployed?08:11
remix_aueii have a 3 node controller cluster and i want to stop one node for some time to make some hardware upgrades08:12
*** remix_auei is now known as remix_tj08:14
*** derekh has joined #tripleo08:14
*** shardy has joined #tripleo08:14
derekhsshnaidm|afk: we can now use the same image that infra uploads to our cloud, I'm going to edit the instuctions on the etherpad08:16
*** sshnaidm|afk is now known as sshnaidm08:16
sshnaidmderekh, ok, great08:16
shardy'morning all08:20
*** electrofelix has joined #tripleo08:21
*** hewbrocca is now known as hewbrocca-afk08:22
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Change username from stack to $USER in tempest  https://review.openstack.org/33911808:22
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE TESTING  https://review.openstack.org/31643608:26
*** myoung has joined #tripleo08:29
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE TESTING  https://review.openstack.org/31643608:29
*** myoung is now known as myoung|afk08:30
*** dbecker has joined #tripleo08:30
*** mgould|afk is now known as mgould08:37
*** pblaho has joined #tripleo08:39
*** tosky has joined #tripleo08:47
*** gfidente has joined #tripleo08:50
*** hewbrocca-afk is now known as hewbrocca08:53
*** chem``` has joined #tripleo08:53
*** chem``` is now known as chem08:54
*** dtantsur|afk is now known as dtantsur08:56
*** chem`` has quit IRC08:57
shardyTwo THT reviews required to close this bug https://review.openstack.org/#/q/topic:bug/159572209:03
*** anshul has quit IRC09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028109:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]09:10
gfidenteshardy though if as per commit message 4hrs is too long09:11
gfidentewhy do we want it to default to 4hrs?09:11
openstackgerritGiulio Fidente proposed openstack/python-tripleoclient: Install Ansible and the Heat's Ansible hook in the overcloud-full image  https://review.openstack.org/33957709:13
shardygfidente: because it matches the current default stack timeout, and we don't yet know a better default value09:14
derekhshardy: did you get a chance to look into the probably with the non HA job on friday?09:15
derekhshardy: looks like a problem starting ceph09:15
shardyderekh: Hey, I didn't manage to reproduce locally after updating all-the-things, but I didn't add a ceph OSD node09:16
gfidenteshardy so I thought we'd want it to be shorter09:16
shardywill try that now09:16
gfidenteotherwise we could end up with heat killing the deployment and orc still stuck within its 4hrs09:16
openstackgerritMerged openstack/tripleo-heat-templates: Template param for what command occ runs  https://review.openstack.org/33738409:16
shardygfidente: we probably will, but we'd need to gather some averages from CI to ensure the timeout is well above the longest possible o-r-c/deployment time09:16
shardywell o-r-c would still time out wouldn't it?09:17
derekhshardy: ok, trying to reproduce it here now also09:18
shardywe need to set that to something like double the longest puppet deployment observed in CI, over a large number of runs09:18
shardymaybe already have that data in the graphite server dprince is running09:19
*** anshul has joined #tripleo09:19
shardygfidente: I agree it's not a good default, but it is safe, and it makes the value configurable, so I was thinking it's OK to fine-tune the value in a subsequent patch09:19
gfidenteshardy ack09:20
gfidentemy point is that heat would wait 4hrs for the entire deployment to complete so each execution of orc it's supposed to take less09:21
*** chandankumar has quit IRC09:22
shardygfidente: Yes, but that's the current behavior anyway09:22
shardythe main improvement here is it's now configurable, and o-r-c won't still be hung after the heat stack gets cancelled due to a timeout09:23
shardywhich, presumably, means all subsequent updates are broken until the nodes are rebooted09:23
gfidenteyeah09:23
d0ugalWhy are they all nonha or ha but never both? http://tripleo.org/cistatus.html09:24
shardygfidente: another optimization we might make is to have a way to have o-r-c get stopped when a stack timeout happens09:24
shardythen o-r-c would stop exactly when the stack timeout occurs09:25
shardybut that's not possible with the simple timeout value approach these patches implement09:25
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo: Fix retrieval of hostname fact based on network.  https://review.openstack.org/33273609:25
shardyd0ugal: because nonha is broken09:25
d0ugalshardy: aha :)09:26
derekhd0ugal: when I switched the jobs over the rh2, we had to choose a subset of jobs (for capacity reasons), For the tripleo projects I kept the HA job and got rid of the rest,09:26
derekhd0ugal: For the non tripleo projects, these had just been running a nonha job, so I left them as is09:26
d0ugalderekh: cool, makes sense. thanks09:26
derekhd0ugal: it have been better to just use  HA test everywhere ...not sure09:28
openstackgerritMerged openstack/tripleo-heat-templates: Set os-refresh-config timeout to 4 hours  https://review.openstack.org/33738509:30
*** anshul has quit IRC09:32
gfidentemarios you checked this before https://review.openstack.org/#/c/338847/ , passed CI now but had to change it slightly09:33
shardyWe're nearly ready to cut the newton-2 milestone release :)09:33
shardyhttps://launchpad.net/tripleo/+milestone/newton-209:33
shardygreat work everyone! :)09:33
mariosgfidente: ack, was looking at https://review.openstack.org/#/c/335429 first09:34
*** coolsvap has quit IRC09:34
*** coolsvap has joined #tripleo09:35
gfidentemarios thanks :)09:38
*** florianf has joined #tripleo09:40
*** akrivoka has joined #tripleo09:40
hewbroccawahey!09:40
*** anshul has joined #tripleo09:45
*** pbourke has joined #tripleo09:46
mariosgfidente: good to land them?09:47
pbourkehi, is it possible to install packages with disk-image-builder?09:47
mariosgfidente: i +2 they lgtm09:47
gfidenteI will remember to ask you things only on monday09:49
derekhpbourke: you could write an element to install packages or pass in the -p flag to the command i.e. -p package[,package,package]09:51
*** anshul has quit IRC09:51
*** anshul has joined #tripleo09:51
pbourkederekh: -p sounds what Im after09:51
pbourkederekh: is this a common pattern?09:51
derekhpbourke: I don't think its something we currently call in tripleo but I wouldn't see it as an antipattern09:53
pbourkederekh: ok thanks09:54
*** fragatina has quit IRC09:54
derekhnp09:54
*** pkovar has joined #tripleo09:54
*** fragatina has joined #tripleo09:58
shardypbourke: note that if you're adding elements for tripleo (vs driving d-i-b directly, we have a --builder-extra-args option that helps with that:10:03
shardyhttp://docs.openstack.org/developer/tripleo-docs/advanced_deployment/build_single_image.html#building-a-single-image10:03
*** fragatina has quit IRC10:05
shardyccamacho: Hey FYI I think deployment of gnocchi is failing in https://review.openstack.org/#/c/31841310:07
shardyso probably recheck's won't help10:07
*** anshul has quit IRC10:07
*** anshul has joined #tripleo10:07
ccamachoshardy, yeahp I tried to recheck sometimes as locally was working, now im reading logs to see whats going on :)  thanks!10:08
shardyccamacho: cool, maybe you need to update puppet-tripleo locally to reproduce?10:09
*** fragatina has joined #tripleo10:09
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028110:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]10:10
ccamachoshardy, that's the thing the puppet-tripleo patch is already merged, mmm I'm deploying master using the THT submission.. I think the issue is that somewhere I'm passing an empty parameter to the puppet-tripleo code..10:12
*** anshul has quit IRC10:13
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Add hyperconverged Ceph to the OVB/HA job  https://review.openstack.org/33808810:15
*** anshul has joined #tripleo10:19
*** rodrigods has quit IRC10:21
*** rodrigods has joined #tripleo10:21
*** abehl has joined #tripleo10:24
*** anshul has quit IRC10:24
*** mvc has joined #tripleo10:26
openstackgerritMerged openstack/tripleo-heat-templates: Pass MysqlVirtualIP without brackets to EndpointMap  https://review.openstack.org/33884710:26
*** mvc has quit IRC10:27
*** limao has quit IRC10:28
*** zoli|wfh is now known as zoli|lunch10:30
*** fragatina has quit IRC10:30
*** fragatina has joined #tripleo10:31
*** anshul has joined #tripleo10:31
openstackgerritMerged openstack/tripleo-heat-templates: Move keystone::db data within service template  https://review.openstack.org/33542910:32
openstackgerritMerged openstack/tripleo-heat-templates: Move glance::db data within service template  https://review.openstack.org/33543010:32
*** abehl has quit IRC10:32
openstackgerritMerged openstack/tripleo-heat-templates: Move cinder::db data within service template  https://review.openstack.org/33543110:33
openstackgerritMerged openstack/tripleo-heat-templates: Move heat::db data within service template  https://review.openstack.org/33543410:42
openstackgerritMerged openstack/tripleo-heat-templates: Move sahara::db data within service template  https://review.openstack.org/33543610:42
openstackgerritMerged openstack/tripleo-heat-templates: Move neutron::db data within service template  https://review.openstack.org/33543810:44
*** anshul has quit IRC10:45
*** pino|work has quit IRC10:46
*** adarazs is now known as adarazs_lunch10:49
*** lucasagomes is now known as lucas-hungry10:56
*** abehl has joined #tripleo10:57
*** jrist_ has joined #tripleo10:57
*** abehl has quit IRC10:59
*** abehl has joined #tripleo10:59
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Move gnocchi clustercheck to step 5  https://review.openstack.org/34030111:02
openstackgerritMerged openstack/instack-undercloud: Make Ironic httpd port configurable via hiera  https://review.openstack.org/33977711:04
*** jrist_ has quit IRC11:04
*** abehl has quit IRC11:04
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Gnocchi composable roles  https://review.openstack.org/31841311:04
*** milan has joined #tripleo11:05
hewbroccaderekh: hey, the rack should be coming back on line pretty soon, shouldn't it?11:05
derekhhewbrocca: its ready to be started on since friday, but besides verifying that nothing feel off I havn't started any redeploy yet11:06
hewbroccathat is very good news11:08
hewbroccaand they got all the busted dracs fixed too I think, right zoli|lunch ?11:08
derekhhewbrocca: I think the bastion is the only one still outstanding11:09
hewbroccaand it needs a whole new motherboard, doesn't it?11:09
derekhhewbrocca: zoli|lunch this week would be a good time to do it11:09
derekhhewbrocca: I'm not sure11:09
hewbroccaIt sure would, I wonder what the status is on that ticket11:09
hewbroccaI'll go over and ask zoli|lunch when he gets back11:09
derekhhewbrocca: ack]11:10
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028111:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]11:10
hewbroccahmmph why is this ^^^ yelling at us11:11
shardyhewbrocca: neutron broke our mitaka CI job11:12
derekhhewbrocca: because the mitaka job has a regression since (thursday? I think)11:12
shardyI think we're just waiting on a neutron patch to land atm11:12
hewbroccaahh11:13
derekhhewbrocca: I've submitted a revert to the stable neutron banch https://review.openstack.org/#/c/340271/11:13
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477711:13
hewbroccaTripleO CI: Catching Every. Single. Damn. Neutron bug, since 201411:14
derekhlol11:14
hewbroccaThe Neutron guys should give us a medal, honestly11:14
shardyhehe :)11:14
*** jrist_ has joined #tripleo11:15
ccamachoslagle, good morning! I tried to download the last week session to upload it to YouTube, but the link wasn't working. Do you have it available?11:16
slagleccamacho: no; the link from bluejeans is the only link11:16
slagleccamacho: how wasn't it working?11:16
slagledid i put the right link in the etherpad? :)11:17
*** abehl has joined #tripleo11:17
ccamachoslagle in the weekend I was getting an "ups" message.. Now it is working but no download button.11:17
slagleccamacho: the download button is the down facing error on the Chapter 1 thumbnail11:18
slagles/error/arrow11:18
slaglei have it downloaded, i just need to do the upload11:18
slaglei was going to do it friday night, but we lost power out here in the sticks11:19
*** jrist_ has quit IRC11:20
ccamachoslage aaa ok, np then :) But it was weird as when clicking the link it was an error message from bluejeans, but np as you already have it :)11:20
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477711:20
*** jrist_ has joined #tripleo11:20
ccamachos/slage/slagle11:20
*** jrist_ has quit IRC11:20
*** jtomasek_ has joined #tripleo11:22
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Use already Deployed/Installed servers  https://review.openstack.org/22277211:22
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477711:24
*** osp has joined #tripleo11:26
*** dtrainor has joined #tripleo11:27
slagleccamacho: i've got it uploading now11:31
ccamachoslagle++11:31
*** abehl has quit IRC11:32
*** florianf has quit IRC11:33
*** dtrainor has quit IRC11:37
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Use venv for all tempest commands  https://review.openstack.org/33911811:39
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE TESTING  https://review.openstack.org/31643611:40
*** rbartal has joined #tripleo11:42
*** jtomasek_ has quit IRC11:44
*** chandankumar has joined #tripleo11:44
derekhslagle: btw, you can now use the infra centos7 image on rh2, or download it11:48
derekhslagle: you have to boot it with --config-drive=True and ssh in as root11:48
*** zoli|lunch is now known as zoli|wfh11:48
derekhslagle: some info here https://etherpad.openstack.org/p/tripleo-ci-devenvs11:48
*** pino|work has joined #tripleo11:50
zoli|wfhhewbrocca, yes, all the iDRACs are OK now - except the one in U37 (I'll involve Dell support ibn coming days - it seems that we cannot sort it our with Fernando)11:50
hewbroccazoli|wfh: cool -- u37 is the bastion host, is it?11:51
zoli|wfhexactly11:51
zoli|wfhI have to "make some noise" about bastion - case has been opened some time ago - no update at all11:51
hewbroccazoli|wfh: good man11:51
derekhzoli|wfh: I thought U1 was the bastion11:52
zoli|wfhderekh, U1 is the bastion11:53
zoli|wfhU37 was (still is :)) one of the hosts with non-responsive iDRAC11:53
zoli|wfhtogether with U09, 12 and 4011:54
hewbroccaoh, my mistake11:54
derekhack11:55
rbartalHi all, I'm trying to write automatic test for openstack command, and need some example, does anyone have example of using tripleclient in python script I can look at?11:56
*** florianf has joined #tripleo12:03
*** adarazs_lunch is now known as adarazs12:03
*** jrist_ has joined #tripleo12:04
*** dtrainor has joined #tripleo12:04
EmilienMhello12:04
*** lucas-hungry is now known as lucasagomes12:10
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028112:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]12:10
*** bfournie has quit IRC12:11
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477712:12
*** trown|outtypewww is now known as trown12:12
*** jayg|g0n3 is now known as jayg12:12
*** weshay has joined #tripleo12:14
openstackgerritAdriano Petrich proposed openstack/tripleo-quickstart: Add an optional extra parameter for upgrades  https://review.openstack.org/34033612:14
*** dtrainor has quit IRC12:15
*** dtrainor has joined #tripleo12:15
openstackgerritJames Slagle proposed openstack/instack-undercloud: Ensure /etc/puppet/hieradata exists  https://review.openstack.org/34033712:17
*** coolsvap has quit IRC12:18
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Configure a different port for httpd ipxe  https://review.openstack.org/34033912:20
slaglederekh: ^12:20
slaglei tested that in my multinode patch as well, and it works12:20
*** ccamacho is now known as ccamacho|lunch12:21
dsariel_hi,  I'm going to buy a desktop with 64 GB RAM and 512 GB SSD to play with TripleO. E.g to deploy 2 overclouds to compare. Are there any pointers exist to best practices of hardware/system/triplleO configuration to boost TripleO performance12:21
*** pino|work has quit IRC12:22
*** rhallisey has joined #tripleo12:23
slagleccamacho|lunch: the upload is done12:24
sshnaidmderekh, when I use image from tripleo, I can't log in to undercloud: Permission denied (publickey). , which user is user there?12:26
*** pradk has joined #tripleo12:26
slagleccamacho|lunch: also for some reason the TripleO pages was showing in spanish for me on youtube, so i switched the langauge to English in the settings12:26
shardydsariel_: No docs re hardware that I'm aware of, but FWIW SSD and lots of RAM is a good starting point12:27
slaglei am trying to brush up on my spanish, but am still a little rusty :)12:27
*** pino|work has joined #tripleo12:27
shardydsariel_: re comparing overclouds, note that at present we don't support multiple overclouds with one undercloud12:28
EmilienMshardy: hello sir! how are we for a release today?12:29
*** sshnaidm is now known as sshnaidm|afk12:29
shardyEmilienM: Hi!  I think we're good, I've deferred everything except composable-services-within-roles in launchpad12:29
shardyI was about to check if we've had another successful promotion since friday12:29
pradkcan we merge this please https://review.openstack.org/#/c/339553/12:30
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Move ironic::db data within service template  https://review.openstack.org/33645112:30
shardypradk: we can, but we should probably move that hieradata to the swift-proxy service template (I missed this when creating that)12:31
shardyI'll post a follow-up that fixes that12:31
shardyapproved12:31
pradkshardy, i need to backport thids to mitaka .. i can do a follow up patch12:32
pradkthx12:32
shardypradk: ack, thanks!12:32
pradkalso this keeps failing ci - https://review.openstack.org/#/c/339085 any known issues with mitaka ci ?12:33
pradkits a backport and should not impact much12:33
pradkthe error seems to be in starting neutron server in the logs12:33
shardypradk: bug #160028112:34
openstackbug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged] https://launchpad.net/bugs/160028112:34
shardywe're waiting for a regression in neutron to be fixed12:34
pradkah ok12:34
EmilienMshardy: what is the csv file url again?12:34
*** chandankumar_ has joined #tripleo12:35
shardyhttp://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-master-tripleo//versions.csv12:35
shardyEmilienM: ^^12:35
EmilienMok thx for confirming12:35
*** jdob has joined #tripleo12:36
*** chandankumar has quit IRC12:37
shardyderekh: Hey the date on that versions.csv is last Wednesday, is that right?12:37
shardyI thought we had a good promotion on Friday?12:37
shardyEmilienM: I'd maybe hold on for a few mins until we can confirm this with derekh12:38
openstackgerritMerged openstack/tripleo-heat-templates: Include bulk in swift proxy pipeline  https://review.openstack.org/33955312:38
EmilienMshardy: ok12:38
EmilienMshardy: https://dashboards.rdoproject.org/rdo-dev is also helpful12:39
shardyEmilienM: cool!  I didn't know about that one :)12:39
shardywe should have something similar on tripleo.org so we can more easily see the status of all the periodic jobs12:40
dsariel_shardy, thanks :-)12:42
*** bfournie has joined #tripleo12:44
*** rlandy has joined #tripleo12:44
shardydsariel_: one other suggestion, if possible stick with CentOS7 for the host OS, other combinations (e.g RHEL, Fedora) can be made to work, but they're more likely to cause you issues12:44
EmilienMshardy: https://review.openstack.org/#/c/340350/ ready for review12:46
*** pradk has quit IRC12:47
*** bfournie has quit IRC12:48
dsariel_shardy, oh thanks, but I need triple O for downstream so RHEL is the must.12:49
*** chandankumar_ has quit IRC12:50
shardydsariel_: Ah, if you're testing the downstream builds that will be fine I'm sure, we just don't CI test upstream builds on it12:50
shardydsariel_: Ah, if you're testing the downstream builds that will be fine I'm sure, we just don't CI test upstream builds on it12:50
shardyoops12:51
*** dprince has joined #tripleo12:53
*** zephcom has quit IRC12:53
shardyEmilienM: thanks, looks good - it's a shame we don't have a more recent promote though as there's a few things I'll have to move out of n-2 into n-3 in launchpad12:55
shardyI guess it could be rebased tomorrow if it's not approved and the periodic job passes12:55
shardyI'm not sure if the osc-lib issue is the only problem tho12:55
*** weshay is now known as weshay_mtg12:55
EmilienMshardy: osc client is broken12:55
EmilienMit is for Puppet OpenStack CI12:56
EmilienMI'm sure this is the same problem in tripleo12:56
*** zephcom has joined #tripleo12:56
shardyEmilienM: Yeah - if we can fix that via the specfile revert proposed by apevec, perhaps we'll get a periodic job pass tonight12:56
shardythen we could release with a much newer puppet-tripleo, t-h-t and tripleoclient12:57
shardynot a big deal if we have to go with this tho I guess12:57
* shardy doesn't like deferring completed things to the next milestone ;)12:57
derekhslagle: +212:57
*** akshai has joined #tripleo12:57
*** masco has quit IRC12:59
derekhshardy: we promoted on thursady night / friday morning is when the promotion happened, but the repo it actually promoted was from wednesday12:59
EmilienMI don't think it's a big deal now, it's just a milestone12:59
EmilienMit will be more critical by the end of Newton12:59
shardyderekh: Ah, Ok that explains it, thanks for confirming13:00
*** fpan has joined #tripleo13:00
*** zaneb has joined #tripleo13:01
shardyEmilienM: Yeah, not a big deal, I just wanted to maximize the number of completed blueprints in n-2, because we released with zero in n-113:02
shardyIt'll be two in n-2 which is an improvement I guess13:03
EmilienMshardy: right, this cycle is really busy13:03
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Bump up the number of OVB env workers available  https://review.openstack.org/34035913:03
shardythere will be 15 remaining for n-3, so I'm going to have to start deferring stuff to beyond newton13:03
shardywhich I was hoping to avoid :)13:03
shardyEmilienM: what should we do about composable-services-within-roles?  Shall I defer that to n-3, as it's probably nearly complete, but there's a number of remaining patches?13:04
EmilienMnewton was very tricky because of the composable roles thing13:04
EmilienMshardy: yes a few number of things13:04
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Bump up the number of OVB env workers available  https://review.openstack.org/34035913:04
shardythe other option is to close the BP (because we've landed the composable architecture now)13:04
EmilienMthe composable architecture is done13:04
shardyand raise bugs for the remaining services that need work on conversion to the new model13:05
EmilienMthe implementation is almost done13:05
EmilienMthe next step is what you're prototyping13:05
EmilienMshardy: +113:05
shardyEmilienM: Yeah, that's got a separate bp custom-roles13:05
derekhFix (I think) for testenv env timeouts here, no need to wait for CI https://review.openstack.org/#/c/34035913:05
*** rbrady has joined #tripleo13:05
shardyso perhaps I'll mark the composable-services-within-roles complete and we can follow up with bugs for specific services13:06
*** sshnaidm|afk is now known as sshnaidm13:06
EmilienMshardy: wfm13:06
openstackgerritMerged openstack/instack-undercloud: Increase swift-proxy node_timeout  https://review.openstack.org/33845613:06
*** jdob has quit IRC13:06
*** jdob has joined #tripleo13:07
hewbroccaOut of curiosity, what percentage of the total specific services are we still working on?13:07
hewbroccaIt sounds to me like we have the lion's share complete13:08
*** anshul has joined #tripleo13:08
shardyhewbrocca: Yeah, I think we must have at least 80% done now, but tracking it in the etherpad has ended up being a bit unweildy due to the number of services/patches13:09
shardyI'm hoping switching to bugs per-service will allow me to give you a more accurate answer to that question ;)13:09
hewbrocca*nod*13:09
hewbroccayeah the etherpad has kinda outgrown its usefulness :)13:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028113:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]13:10
shardyIt looks like that one blueprint has tracked over 80 patches13:10
hewbroccablearrgh13:12
hewbroccathat's kind of the example case for a blueprint that was too big to begin with :)13:12
*** myoung|afk is now known as myoung13:13
*** julim has joined #tripleo13:13
EmilienMshardy: any chance to look ceilometer? https://review.openstack.org/#/c/333498/13:17
*** jdob has quit IRC13:17
*** jdob has joined #tripleo13:17
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Bump up the number of OVB env workers available  https://review.openstack.org/34035913:17
EmilienMhewbrocca, shardy: yes this blueprint could have been splited, but really what matters is that we moved everything. It was really tricky and painful, so hopefully we won't have to do this anymore.13:17
*** fzdarsky has joined #tripleo13:18
hewbroccaYes indeed13:18
EmilienMshardy: they don't want the revert13:19
EmilienMI tried...13:19
EmilienMshardy: /me tryin gagain on #openstack-sdks13:20
derekh<sshnaidm> derekh, when I use image from tripleo, I can't log in to undercloud: Permission denied (publickey). , which user is user there?13:20
derekhsshnaidm: root13:20
sshnaidmderekh, that only one I didn't try :)13:20
shardyEmilienM: Ok (*sigh*) - I guess they're going to have to fix it somehow tho, we can probably go with the RDO package revert in the meantime13:21
*** pgadiya has quit IRC13:21
derekhsshnaidm: ya, its a little unorthodoxed , but its was the only option  https://review.openstack.org/#/c/339856/ and https://review.openstack.org/#/c/339855/13:22
*** ccamacho|lunch is now known as ccamacho13:22
*** apetrich_ has joined #tripleo13:23
*** egafford has joined #tripleo13:23
*** lblanchard has joined #tripleo13:24
*** apetrich has quit IRC13:25
trownshardy: ya, we are having some issues with some projects that do not share the philosophy that master should be kept working13:26
gfidentederekh sshnaidm do you guys know if we ever thought/tried switching the CI image building to the new yaml descriptor mechanism?13:26
trownshardy: they think we should only consume releases13:26
trownshardy: there are some proposals to deal with that more gracefully in RDO, but for the interim we just have to carry reverts in RDO packaging when one of those projects breaks master13:27
sshnaidmgfidente, sorry, I don't know about this13:27
derekhgfidente: there is a patch somewhere, ..looking13:28
gfidentederekh ah cool13:28
gfidentedoes it need love/votes?13:28
derekhgfidente: this one https://review.openstack.org/#/c/336312/13:29
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Repurpose KeystoneWorkers add keystone::wsgi::apache::threads  https://review.openstack.org/33647213:31
derekhgfidente: the nonha job has been failing for a few days now, looks like a ceph problem, any idea what might be going on?13:31
gfidentederekh nonha?13:32
derekhgfidente: ya, the left hand column here http://tripleo.org/cistatus.html13:33
derekhgfidente: its running on all of the puppet modules13:33
*** panda|afk is now known as panda13:33
*** anshul has quit IRC13:35
shardytrown: ack, that is disappointing to hear, but I guess we'll just have to work around it13:39
*** anshul has joined #tripleo13:43
gfidentederekh ah found it, looking13:44
gfidentegoing to build locally to see if I can find anything13:45
derekhgfidente: ok13:47
gfidenteweird it says there was no systemctl unit13:49
*** r-mibu has quit IRC13:49
*** tosky has quit IRC13:50
*** Goneri has joined #tripleo13:50
*** rbrady has quit IRC13:51
*** r-mibu has joined #tripleo13:54
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477713:54
*** zoli|wfh is now known as zoli|mtg13:55
*** rbrady has joined #tripleo13:55
*** pradk has joined #tripleo13:57
pbourkederekh: another question for disk-image-builder, is it possible to do things like editing a systemd file, ading a user to a group etc? Or do people have to write their own elements for these?14:02
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Include bulk in swift proxy pipeline  https://review.openstack.org/34038514:03
*** anshul has quit IRC14:05
*** liverpooler has quit IRC14:08
*** jcoufal has joined #tripleo14:09
derekhpbourke: for that you would need an element or if the extra package your hoping to install requires those things then it might be more suitable as part of the package itself14:09
pandaderekh: how can I get credentials for rh2 ?14:10
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028114:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]14:10
openstackgerritDerek Higgins proposed openstack/tripleo-heat-templates: Add a second proxy-logging middleware entry to swift-proxy  https://review.openstack.org/34038914:11
derekhpanda: I can send them to you, but please keep usage to things specifically to reproduce CI problems not general purpose dev14:12
pandaderekh: my first task is just to learn how things are working. Second task is fixing bugs. Third task is profit. If you want and have time to walk me through that would be great.14:14
*** aufi has quit IRC14:16
derekhpanda: sure, I've sent you a mail with an etherpad that should get you started, if its lacking just ping me here and we can update the etherpad as we go along14:18
*** anshul has joined #tripleo14:18
pandaderekh: thanks14:20
*** anshul has quit IRC14:22
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Re-enable Ceilometer composable roles for controller  https://review.openstack.org/33349814:27
*** zaneb has quit IRC14:29
EmilienMpradk: last comment on https://review.openstack.org/#/c/333498/14:29
pradkEmilienM, hmm we could.. that would mean we need map_merge, i can look into it if you feel strongly about it14:30
*** fragatina has quit IRC14:32
*** fragatina has joined #tripleo14:33
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Add Aodh composable roles  https://review.openstack.org/33355614:33
EmilienMpradk: yes, this is a central agent specific bit, no need to put it in base14:34
pradkEmilienM, kk i'll update it14:34
EmilienMpradk: thanks, after that I think we're good14:34
EmilienMpradk: I'm looking at the gnocchi patch why it fails now14:35
EmilienMpradk: gnocchi db sync fails http://logs.openstack.org/13/318413/56/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/f985af7/logs/postci.txt.gz#_2016-07-11_12_20_25_00014:36
pradkEmilienM, i think thats due to where we're doing db sync .. see ccamacho's fix https://review.openstack.org/#/c/340301/14:37
pradkdoes it still fail with his fix?14:37
*** chandankumar has joined #tripleo14:38
pradkEmilienM, is there any way to access gnocchi logs in ci?14:38
pradkEmilienM, we use to be able to14:38
ccamachopradk EmilienM, yeahp, and after fixing it I think the mysql and the gnocchi service are living in different places im hitting this http://paste.openstack.org/show/529713/  Im currently rebuilding my env to launch a 3 controller overcloud because I can not reproduce it locally14:40
shardyCongratulations everyone, newton-2 has been released :)14:41
shardyhttps://launchpad.net/tripleo/+milestone/newton-214:41
EmilienMccamacho: it still fails14:41
pradkhmm Access denied for user 'gnocchi'@'192.0.2.614:41
EmilienMshardy: yeah!14:41
shardyThanks for preparing the release patch EmilienM :)14:41
pradkyay!14:41
EmilienMshardy: my pleasure14:41
ccamachopradk to see the submission logs im doing this, http://paste.openstack.org/show/529762/14:41
EmilienMshardy: FYI, we also releases N2 for 30 Puppet modules14:41
shardyexcellent14:42
EmilienMreleased*14:42
shardynow to focus on the remaining n-3 stuff ;)14:42
hewbroccawoop woop newton2!14:42
EmilienMccamacho: ::gnocchi::db::mysql is required at step 2 IIRC14:42
*** weshay_mtg is now known as weshay14:43
pradkmay be we keep db::sync in step 314:43
pradkand move galera alone14:44
ccamacho EmilienM ACK I will check it14:44
*** dbecker has quit IRC14:45
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Move gnocchi clustercheck to step 5  https://review.openstack.org/34030114:47
*** dbecker has joined #tripleo14:48
EmilienMshardy: so what needs to be moved: ceilometer, gnocchi (both WIP by ccamacho pradk and me), some bits from nova/neutron (WIP by dprince and me), some galera bits14:49
*** tosky has joined #tripleo14:49
*** tosky has quit IRC14:50
shardyEmilienM: ack - would you mind raising a bug for each missing thing, and link any under review patches?14:50
EmilienMsure thing14:51
*** oshvartz has quit IRC14:51
*** tosky has joined #tripleo14:51
shardyif we target those at n-3 we can hopefully track them more easily that the etherpad14:51
shardythan the etherpad14:51
shardydprince: Hey, I think we can probably go ahead and land https://review.openstack.org/#/c/322612/ and https://review.openstack.org/#/c/327780 ?14:52
shardyI've locally tested and +2'd them both14:53
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Re-enable Ceilometer composable roles for controller  https://review.openstack.org/33349814:53
EmilienMpradk: just amending commit message ^14:53
shardyI'd like to fix the hang on error problem I hit last week, but we can do that as a followup I think14:53
shardybe good to get the mistral API coverage increasing in CI :)14:53
dprinceshardy: looking... in a meeting today and tomorrow so I may be slow14:54
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Move gnocchi clustercheck to step 5  https://review.openstack.org/34030114:55
shardydprince: no rush, it's just the first two patches in the tripleoclient series switching to mistral14:55
shardydprince: I'm keen to get the overcloud deploy converted ASAP because I need to wire in jinja2 templating for custom-roles14:55
d0ugal+114:55
shardyI think d0ugal was looking into that14:55
d0ugalshardy: with rbrady's help14:55
shardyd0ugal: hey, I don't see any patches, did you managed to rebase/test the stuff from dprince's github branch?14:55
dprinceshardy: yes, very exciting times finally :)14:55
*** rbrady has quit IRC14:56
d0ugalshardy: rbrady has been working on it, so don't want to duplicate effort but ready to help if I can14:56
shardyd0ugal: Ok, no worries14:56
shardyI think I looked at the tripleo-common part of that last week14:57
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Gnocchi composable  roles  https://review.openstack.org/31841314:57
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Add Aodh composable roles  https://review.openstack.org/33355614:57
gfidentejistr I think $::processorcount comes as a fact not in hiera14:57
EmilienMpradk: same here, just commit message ^14:57
pradkkk14:57
dprinced0ugal: hi, so I'm working on a patch to python-zaqarclient that will move the base WebsocketClient there. What are your thoughts on this?14:57
jistrgfidente: yea i know, but still the question remains valid i think14:57
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Gnocchi composable  roles  https://review.openstack.org/31841314:57
EmilienMccamacho: same here, commit message ^14:58
gfidentejistr right better to test it anyway14:58
d0ugalshardy: Yeah, so my current issue is that I can't figure out how to use the WIP workflows.14:58
gfidentewe can probably check ci job stuff14:58
d0ugalshardy: Which might be an issue with me, but I think some combination of these is needed: https://review.openstack.org/#/q/status:open+project:openstack/tripleo-common+owner:%22Ryan+Brady+%253Crbrady%2540redhat.com%253E%2214:58
dprinced0ugal: I'd like to use the WebsocketClient from other projects in tripleo too14:58
*** mvc has joined #tripleo14:58
*** zoli|mtg is now known as zoli|wfh14:59
jistrgfidente, marios: hiera docs say that the '$' shouldn't be there for puppet vars, which made me wonder -- maybe it shouldn't be there for facts either?14:59
d0ugaldprince: +1, that sounds like a good idea.14:59
EmilienMshardy: https://bugs.launchpad.net/tripleo/+bugs?field.tag=composable-roles14:59
EmilienMshardy: I'll add the tags for all missing work15:00
d0ugaldprince: I guess we might need to move this back out then: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/plugin.py#L124-L13615:00
d0ugaldprince: as that is the only bit specific to our workflows15:00
numansdprince, Hi, can you please review this when you get some time. You had given +2 before - https://review.openstack.org/#/c/320531/15:01
*** lucasagomes has quit IRC15:01
shardyEmilienM: thanks!15:01
dprinced0ugal: yes, the generic version I am making doesn't have that15:02
dprinced0ugal, shardy: I've got os-collect-config working with zaqarwebsockets finally15:02
mvcHi all, I have been looking into the documentation but I haven't been able to find out if is possible to deploy tripleo undercloud in VM and overcloud in baremetal machines. Based on the docs it should be possible if VM and BM share the same network segment. Is that assumption okay?15:02
d0ugaldprince: Thanks for the reviews btw15:03
*** jeckersb_gone is now known as jeckersb15:03
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Re-enable Ceilometer composable roles for controller  https://review.openstack.org/33349815:03
dprinced0ugal, shardy: I'd like to consider switching to that as a default instead of Swift even... because of the improved polling15:03
pradkEmilienM, moved coordination url to central agent ^^15:03
dprinced0ugal: also, this https://review.openstack.org/#/c/339215/15:04
EmilienMpradk: ++15:04
d0ugaldprince: sorry, switch to what instead of Swift?15:04
dprinced0ugal: getting the Websocket keystone endpoint will make our code better15:04
*** rbartal has quit IRC15:04
shardydprince: ack, we could consider using zaqar for both metadata and signals back to heat I think15:04
dprinced0ugal: switch os-collect-config to use zaqar websockets instead of polling swift15:04
shardymvc: yes that should work, we just don't have that combination well documented atm15:04
d0ugaldprince: oh, yeah, that would be good. I didn't know it polled switch15:05
hewbroccaWe've always said we wanted to use zaqar for this...15:05
d0ugaldprince: Change looks good, I can't +2 it tho :(15:05
dprinced0ugal: now that I figured out websockets I just couldn't help myself from using it in a few extra places15:05
hewbroccachuckle15:05
dprinced0ugal: ack, just wanted you to be aware of the incoming endpoint15:05
*** rbrady has joined #tripleo15:05
d0ugaldprince: +1, they are really neat. I've never really used them from Python before which is cool.15:05
d0ugaloops, I am not allowed but I almost +1 workflow'ed that change by mistake.15:06
*** lucasagomes has joined #tripleo15:06
dprinceshardy: you might review this then https://review.openstack.org/#/c/339215/. It will help us improve our websocket client code15:07
openstackgerritMartin André proposed openstack/instack-undercloud: Add tripleo deployment config file paths to hiera  https://review.openstack.org/32901615:07
openstackgerritMartin André proposed openstack/instack-undercloud: Introduce 'enable_validations' option  https://review.openstack.org/32289315:07
EmilienMgfidente: fyi, I'm taking care of https://bugs.launchpad.net/tripleo/+bug/160185315:08
openstackLaunchpad bug 1601853 in tripleo "Enable MySQL profiles" [High,New] - Assigned to Emilien Macchi (emilienm)15:08
EmilienMgfidente: it wasn't wip, right?15:08
gfidenteEmilienM go ahead I think now that the submission to relocate galera-ready merged it should be approachable15:09
EmilienMok15:09
*** ebarrera has quit IRC15:10
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028115:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]15:10
*** sanjayu is now known as sanjayu|AFK15:11
shardyEmilienM: FYI I added https://bugs.launchpad.net/tripleo/+bug/1601857 to track the ringbuilder patches I have WIP15:13
openstackLaunchpad bug 1601857 in tripleo "Convert Swift ringbuilder to composable services format" [High,In progress] - Assigned to Steven Hardy (shardy)15:13
*** zaneb has joined #tripleo15:13
openstackgerritMerged openstack/tripleo-puppet-elements: Support for the OpenvSwitch OVN Controller  https://review.openstack.org/32053115:14
ccamachoEmilienM quick question, this https://review.openstack.org/#/c/335499/ for Horizon was working and does not have pacemaker, passing CI, I have addressed (I think) your comment on the puppet-tripleo part when having some time can you check it?!15:14
derekhbnemec: if you has a minutes can you look over the sanity of https://review.openstack.org/#/c/340359/15:14
EmilienMshardy: ack. There is more than that, also all dprince and I work about nova/neutron that is not finished15:14
*** pcaruana has quit IRC15:15
EmilienMccamacho: I will, I'm now working on galera profiles...15:15
ccamachoEmilienM np15:15
dprinceEmilienM: looking into the CI failure again now15:15
dprinceEmilienM: I may be slow today but I will do what I can to move it forwards15:15
bnemecderekh: I've actually got that open on my screen right now. :-)15:15
derekhbnemec: nice15:15
*** numans has quit IRC15:16
bnemecderekh: Although I've had it open for almost an hour and haven't actually voted yet.15:16
*** ebalduf has joined #tripleo15:16
derekhbnemec: take your time, its monday15:17
derekhbnemec: unfortunately this will also mean we may at times be using quota up that isn't being used15:17
derekhbnemec: medium term I think we can do way better15:18
derekhbnemec: by requesting the testenv after the image build15:18
derekhbnemec: But I'll wait until after mutinode stuff has landed to avoid the rebase being a pain in the ass15:19
bnemecderekh: Ah, interesting.  Makes sense since we're using the Jenkins slave as the undercloud we don't need the full env until we're actually ready to register nodes.15:20
*** saneax is now known as saneax_AFK15:20
mariosjistr: sry man, calls15:21
bnemecAnd slagle's got nothing better to do than rebase his patches, so I'm sure he won't mind. :-P15:21
derekhbnemec: exactly, in theory we should then be able to pack a lot more into the cloud, assuming different jobs are all at different stages but that might effect reliability so we'll take that slowly15:22
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates: Add hyperconverged-ceph environment to include CephOSD on computes  https://review.openstack.org/33811315:23
bnemecderekh: Yeah.  Like I said on the review, I think we've got some leeway on rh2 capacity right now so we should be able to pack more in anyway.15:24
bnemecThe faster boxes are still criminally underutilized.15:24
openstackgerritRyan Brady proposed openstack/tripleo-common: Adds action for template processing  https://review.openstack.org/33761515:24
derekhbnemec: yup15:24
openstackgerritMerged openstack/instack-undercloud: Create a Keystone endpoint for Zaqar websockets  https://review.openstack.org/33921515:28
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Move gnocchi clustercheck to step 2  https://review.openstack.org/34030115:28
shardyjrist_: Hey, is there a high-res/SVG version of your tripleowl v2.0 around anywhere?15:29
shardythere's a discussion re project mascots on openstack-dev, and I'd like to propose we keep that one :)15:30
*** rajinir has joined #tripleo15:30
*** dsariel_ has quit IRC15:31
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates: Add hyperconverged-ceph environment to include CephOSD on computes  https://review.openstack.org/33811315:31
*** tosky has quit IRC15:32
*** dsariel has quit IRC15:32
openstackgerritMerged openstack/python-tripleoclient: Use Mistral for baremetal registration  https://review.openstack.org/32261215:33
d0ugal\o/15:33
*** mvc has quit IRC15:33
hewbroccaThere definitely is but I don't have the URL handy.15:33
shardynvm, I've replied and someone can follow up with a link to the SVG15:34
d0ugalshardy: https://github.com/openstack/tripleo-ui/blob/master/src/img/tripleo-owl.svg15:34
shardyPretty cool, OpenStack foundation ratified TripleOwl! :)15:34
shardyd0ugal: thanks!15:35
hewbroccaNICE15:36
hewbroccajrist: #winning15:36
hewbroccaalso dprince and his kids for having the owl idea in the first place15:36
jrist_shardy: yes15:37
d0ugaloh, that is great!15:37
jrist_http://wixagrid.com/tripleo/ shardy15:37
*** leanderthal is now known as leanderthal|afk15:37
dprinceshardy: ratified, cool man15:38
d0ugaljrist_: Would be good to add them to tripleo.org15:38
d0ugalNot sure how we do that :)15:38
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Add MySQL profiles  https://review.openstack.org/34044415:39
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Move nova::db data within service template  https://review.openstack.org/33556115:44
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates: This change adds the CephClientKey parameter to puppet-ceph-devel.yaml and storage-environment.yaml environment files.  https://review.openstack.org/34044715:44
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Move nova::db data within service template  https://review.openstack.org/33556115:44
greghaynesSpamapS: Hey, I am tracking down some annoying behavior of the -minimal images which is due to the fact that debootstrap does not support using multiple mirrors (and therefore backports/updates)15:44
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Move MySQL Galera within composable services  https://review.openstack.org/34044815:44
greghaynesSpamapS: and I think I need some deb fu15:45
EmilienMgfidente, shardy: can you give early feedback on https://review.openstack.org/340448 and https://review.openstack.org/340444 please? Note I didn't move parameters yet, just puppet code.15:45
*** aufi has joined #tripleo15:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Move MySQL Galera within composable services  https://review.openstack.org/34044815:46
greghaynesSpamapS: Basically what goes on is we debootstrap without backports/updates, then we upgrade everything so we have two copies of a lot of stuff (and waste a ton of time). apt-get autoremove doesnt actually remove the original copy (I think because it notices we arent running the most recent kernel that we upgraded to)15:46
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates: Missing CephClientKey parameter in puppet-ceph-devel and storage-environment  https://review.openstack.org/34044715:46
greghaynesSpamapS: so over time our -minimal images just get bigger and bigger15:46
gfidentemcornea ^^ that is nice15:50
gfidentethanks15:50
gfidentewe could explain the commit it's needed when not passing ceph scale15:50
gfidenteas the client won't generate those keys15:50
mcorneagfidente: ack, updating15:51
gfidenteat the same time, sounds like we can also make the client always generate those because it uses parameter_defaults now15:51
gfidentecommenting this on the BZ15:51
jrist_d0ugal: they are15:51
jrist_d0ugal: well the logo on tripleo.org is svg15:51
*** dtantsur is now known as dtantsur|bbl15:52
d0ugaljrist_: ah okay, tripleo.org/logos would be nice tho'15:52
SpamapSgreghaynes: autoremove is pretty dumb15:54
SpamapSgreghaynes: it's only recently that it knew how to remove kernels at all.15:54
*** lucasagomes is now known as lucas-afk15:55
SpamapSgreghaynes: so I suggest we just assert the one kernel we want.15:55
greghaynesSpamapS: Meaning find the most recent after an upgrade and uninstall the other?15:57
greghaynesSpamapS: Something else I am looking at is making ubuntu-minimal install the correct thing from the outset15:57
greghaynesSpamapS: and that led me to wondering - do you know what germinate is fed in to for making the upstream images?15:58
SpamapSyes, the seeds15:59
greghaynesI mean, what actually reads in the germinate output15:59
greghaynesand grabs the debs it says should go in to an image15:59
SpamapSOh, what goes from germinate -> qcow2?15:59
*** tosky has joined #tripleo15:59
greghaynesyea15:59
SpamapSI believe that is "canonical's special sauce"16:00
greghaynes$secret_sauce?16:00
greghayneshaha16:00
greghaynesok16:00
SpamapSbut IIRC, it involves vm-builder16:00
EmilienMccamacho: ok looking now16:01
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Gnocchi composable  roles  https://review.openstack.org/31841316:02
EmilienMccamacho: rebasing to have your patch in puppet-tripleo ^16:03
ccamachoEmilienM thanks!16:03
EmilienMccamacho: reviewing horzon now16:03
EmilienMccamacho: it looks good for a first iteration. We can improve the networking params later16:05
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates: Missing CephClientKey parameter in puppet-ceph-devel and storage-environment  https://review.openstack.org/34044716:05
EmilienMto make them composable or something16:05
EmilienMccamacho: did you test it?16:05
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Use already Deployed/Installed servers  https://review.openstack.org/22277216:05
ccamachoEmilienM, Yeahp, and created this blog entry as I never did it before http://www.anstack.com/blog/2016/07/02/ssh-multi-hop-tripleo.html :)16:06
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477716:06
EmilienM\o/16:06
*** rwsu has joined #tripleo16:06
EmilienMgfidente: can you review https://review.openstack.org/#/c/335506/ please?16:06
EmilienMor shardy (it's horizon composable)16:06
gfidenteEmilienM derekh so the nonha failure is due to the change in puppet-ceph for jewel16:08
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Add MySQL profiles  https://review.openstack.org/34044416:09
EmilienMwhat?16:09
EmilienMgfidente: we are bumping puppet-ceph16:09
EmilienMhttps://review.openstack.org/#/c/314311/16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028116:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]16:10
EmilienMgfidente: we are pinning I mean16:10
*** jcoufal has quit IRC16:11
*** dprince has quit IRC16:11
*** fzdarsky is now known as fzdarsky|lunch16:11
*** jcoufal has joined #tripleo16:13
openstackgerritMerged openstack/python-tripleoclient: Use Mistral for baremetal introspection  https://review.openstack.org/32778016:13
d0ugal\o/16:14
derekhEmilienM: we're not pinning anything at the moment in tripleo-ci16:15
EmilienMderekh: so what does https://review.openstack.org/#/c/314311/ ?16:16
*** fzdarsky|lunch has quit IRC16:16
shardyhttps://github.com/openstack/tripleo-puppet-elements/blob/master/elements/puppet-modules/source-repository-puppet-modules#L7 specifies the stable/hammer branch?16:16
EmilienMI thought it would16:17
gfidenteEmilienM yeah the pinning isn't effective16:17
shardydid we switch to using puppet modules from package via delorean-current?16:17
derekhEmilienM: shardy crap, I think the chaching logic in tripleo-ci stomps over it16:18
*** akrivoka has quit IRC16:18
shardyoops16:18
EmilienM:( sorry16:18
EmilienMI didn't see it16:18
shardywe probably should start consuming the packaged modules anyway16:19
EmilienMbut yeah, puppet-ceph/master is now deploying Jewel16:19
EmilienMwe're on the edge!16:19
shardyhow much work is involved in just making jewel work?16:19
shardygfidente: have you looked into that?16:19
shardyI know some folks want TripleO support for that anyway16:19
gfidenteEmilienM shardy so currently the problem is that the packages we have in centos don't ship a systemd unit16:20
gfidentewhile the module assumes if the provider is systemd there will be a ceph unit16:20
*** dbecker has quit IRC16:20
EmilienMPuppet CI is deploying Ceph Jewel with buildlogs.centos.org/centos/7/storage/x86_64/ceph-jewel/16:21
EmilienMmaybe we could use it ^16:21
gfidenteyeah it's using the jewel builds16:22
EmilienMthough I reported https://bugzilla.redhat.com/show_bug.cgi?id=135448816:22
openstackbugzilla.redhat.com bug 1354488 in Build "Multiple SElinux alerts" [Unspecified,Assigned] - Assigned to branto16:22
EmilienM26 SElinux issues :)16:22
shardyouch16:22
*** dtrainor has quit IRC16:22
EmilienMbut maybe related to our way to deploy Ceph;16:22
EmilienMso might be easy to fix16:22
EmilienManyway, Jewel is current LTS, we should use it asap I would say16:22
EmilienMshould we pin it in tripleo ci repo?16:23
gfidente<EmilienM> but maybe related to our way to deploy Ceph ?16:24
*** cwolferh has joined #tripleo16:24
*** jrist_ has quit IRC16:24
derekhSo whats happening in the nonha job is that we do through all the puppet modules in /opt/stack/new/puppet-*16:25
*** jpich has quit IRC16:25
*** ebarrera has joined #tripleo16:25
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates: Add environment file to enable DVR  https://review.openstack.org/33214716:25
derekhand set the REPOREF to whatever zuul put there, see create_dib_vars_for_puppet here http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/common_functions.sh#n27616:25
*** florianf has quit IRC16:25
derekhthis overrides whatever is in source-repository-puppet-modules16:26
derekhEmilienM: ^^ so ya, I think for the onha job to pass today we gotta pin it there, this is only a problem in ci I think16:26
derekh*nonha16:26
gfidenteEmilienM derekh on the other hand, we'll want to test jewel so I think we want to be able to checkout hammer/master version of puppet-ceph in the stable/master jobs16:27
*** rhallisey has quit IRC16:28
*** dmsimard1 has joined #tripleo16:28
*** dmsimard1 is now known as dmsimard|mtl16:28
*** trown is now known as trown|lunch16:31
derekhgfidente: for the stable branches we're using the packaged puppet modules, so I think its only master we're concerned with16:31
EmilienMFor Hammer, we should use puppet-ceph 1.0.0 https://github.com/openstack/puppet-ceph/releases/tag/1.0.016:32
EmilienMwhich is the stable/hammer16:33
EmilienMfor Jewel, we can deploy master and / or 2.0.0 or 2.1.016:33
gfidenteyeah the problem is that which version we should use is coupled with the version of ceph, not with the version of tripleo16:33
gfidentewhich means in mitaka you can only use hammer and in newton you can only use jewel16:34
EmilienMright, puppet-ceph is coupled with the version of Ceph.16:34
EmilienMgfidente: that's false16:34
EmilienMyou can use hammer in whatever OpenStack release you want16:34
gfidenteright but you need to have the older version of the module16:35
EmilienMjust use stable/hammer16:35
EmilienMit's not an abandonned branch, just a stable one16:35
EmilienMbut you can deploy newton & hammer, it will works fine16:35
gfidenteyes I think we haven't hit this before because the other puppet-modules for the openstack services are branched with the openstack releases16:36
EmilienMsince last week, Puppet OpenStack CI is deploying Jewel16:36
*** yamahata has joined #tripleo16:37
EmilienMand it works perfectly fine module the SElinux alerts that we are currently ignoring16:37
EmilienMmodulo*16:37
gfidentederekh EmilienM so it sounds like what we aim at as shardy pointed is to have jewel in tripleo/master16:37
*** lucas-afk is now known as lucasagomes16:37
gfidentewhat do you think?16:39
EmilienMmaybe we can just deploy buildlogs.centos.org/centos/7/storage/x86_64/ceph-jewel/ in our CI16:39
EmilienMshort term: pin puppet-ceph to stable/hammer in tripleo-ci16:40
gfidentethough people deploying tripleo on centos will fail until jewel gets into the centos repos16:40
EmilienMmiddle term use: buildlogs.centos.org/centos/7/storage/x86_64/ceph-jewel/16:40
EmilienMgfidente: this is a centos repo, I don't get your sentence16:40
EmilienMoutside tripleo-ci?16:41
gfidenteoutside tripleo-ci yes16:41
EmilienMgfidente: so we need it in RDO?16:41
*** ohamada has quit IRC16:42
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Bump up the number of OVB env workers available  https://review.openstack.org/34035916:43
EmilienMderekh, gfidente: I'm afk for lunch - let me know how I can help with the puppet-ceph thing. Sounds like we have 2 options...16:45
*** tesseract- has quit IRC16:49
gfidenteEmilienM derekh so I want to push a change to enable centos' storage repo to install jewel16:50
gfidenteas that seems the most useful approach for the future16:51
gfidenteas it will allow us to test puppet-ceph/master as well16:51
*** rcernin has quit IRC16:51
derekhgfidente: I'm not familiar with ceph at all but if you push the patch we can see if it works at least16:51
gfidenteright, doing it now16:51
*** dsariel has joined #tripleo16:51
*** dsariel_ has joined #tripleo16:52
gfidenteand it should work as puppet-ceph/ci is using it already as pointed by EmilienM16:52
gfidentethen the actual issue with ci not pinning to the module version should be fixed as well but we won't need it for ceph16:52
*** ebarrera has quit IRC16:54
EmilienMfor mitaka/liberty -> pin to stable/hammer16:54
EmilienMfor master -> don't pin (jewel)16:54
EmilienMis it good?16:54
*** dtantsur|bbl is now known as dtantsur16:55
gfidenteEmilienM yeah and I will use ceph-hammer repos instead of epel for tripleo mitaka/liberty as well16:55
gfidenteso that is should always match the version expected by the module16:56
EmilienMsounds good16:57
*** bfournie has joined #tripleo16:58
*** fzdarsky|lunch has joined #tripleo17:05
*** fragatina has quit IRC17:05
*** mcornea has quit IRC17:06
*** bfournie has quit IRC17:06
*** fzdarsky|lunch is now known as fzdarsky17:07
*** fzdarsky is now known as fzdarsky|lunch17:07
*** fzdarsky|lunch is now known as fzdarsky17:07
*** dprince has joined #tripleo17:08
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028117:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]17:10
*** shivrao has joined #tripleo17:11
EmilienMderekh: do we still need the alert ^ ?17:11
derekhEmilienM: the fix just merged in the last hour, so jobs should start passing once the new package is in the trunk repository17:12
*** apetrich_ has quit IRC17:12
EmilienMok17:12
derekhEmilienM: I'm signing off now but once you see a passing mitaka job it can be closed17:12
EmilienMderekh: ack17:13
*** derekh has quit IRC17:13
*** ebarrera has joined #tripleo17:15
*** apetrich_ has joined #tripleo17:16
*** rasca has quit IRC17:16
*** rasca has joined #tripleo17:17
*** ebarrera has quit IRC17:20
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Use already Deployed/Installed servers  https://review.openstack.org/22277217:20
*** apetrich_ has quit IRC17:22
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477717:22
*** apetrich_ has joined #tripleo17:26
*** yamahata has quit IRC17:30
*** akshai has quit IRC17:31
*** fragatina has joined #tripleo17:31
*** akshai has joined #tripleo17:31
*** aufi has quit IRC17:34
*** sshnaidm is now known as sshnaidm|afk17:36
*** panda is now known as panda|afk17:38
*** pcaruana has joined #tripleo17:39
*** pkovar has quit IRC17:42
*** trown|lunch is now known as trown17:47
*** tbonds has quit IRC17:49
*** athomas has quit IRC17:51
*** yamahata has joined #tripleo17:51
*** tosky has quit IRC17:53
*** dsariel_ has quit IRC17:57
*** dsariel has quit IRC17:57
openstackgerritMerged openstack/tripleo-heat-templates: Move ironic::db data within service template  https://review.openstack.org/33645117:58
*** dtantsur is now known as dtantsur|afk18:01
*** ifarkas has quit IRC18:01
*** mgould is now known as mgould|afk18:01
openstackgerritMerged openstack/tripleo-heat-templates: neutron: remove tenant MTU configuration options  https://review.openstack.org/32592618:03
dprinceEmilienM: I will rebase the compute neutron patches. I want to change the resource_registry names to better align with the DVR patch from brent18:05
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028118:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]18:10
openstackgerritSteven Hardy proposed openstack/tripleo-docs: Remove RHEL from tripleo-docs  https://review.openstack.org/34050318:13
shardyAll, interested in feedback re ^^18:13
shardyI've got feedback that upstream builds don't work on RHEL anymore, which isn't surprising given we're only CI testing against CentOS repos18:14
shardyIMO it's probably best to just focus the upstream docs on what we actually CI test18:14
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Install Ceph Hammer and/or Jewel from CentOS Storage SIG repos  https://review.openstack.org/34050418:14
shardynext step will be to figure out how we wire the repo related docs in to reflect what's tested in CI18:14
shardy(e.g have tripleo.sh consume some docs markup or something)18:15
*** lucasagomes is now known as lucas|afk18:15
bnemecshardy: My proposal is to stop writing out repo docs long hand and have everyone use the same tool to enable repos: http://lists.openstack.org/pipermail/openstack-dev/2016-June/097221.html18:17
bnemecThat also avoids the case (like we just had) where the user docs are broken for two weeks because no developers use them.18:17
shardybnemec: ack, yeah that also would work, sorry I do remember that message now18:18
shardybnemec: this is more of a first step e.g don't document platforms we no longer test at all18:18
shardythen we can document the one we do better for sure18:18
slagledoes rdo claim to work on rhel?18:19
EmilienMdprince: ok18:19
*** zoli|wfh is now known as zoli|gone18:19
bnemecshardy: Yeah, I'm not opposed to that.  Just taking every opportunity I can to pimp out the tool because it's been kind of damned with faint praise so far. :-)18:19
EmilienMdprince: it failed CI though, have you seen the failure?18:20
bnemecAnd we keep running into situations where it would have helped.18:20
shardybnemec: I think I'd be more keen on it if it wasn't yet another CLI interface, what if we had openstack undercloud repo setup?18:20
*** zoli|gone is now known as zoli_gone-proxy18:20
shardyI'm kind of sad about the image building divergence18:20
bnemecshardy: It has to be standalone because it needs to be used before OpenStack packages are available.18:21
shardyhmm, yeah good point ;)18:21
*** electrofelix has quit IRC18:21
shardyslagle: actually I think it's centos only too18:21
slagleshardy: the wiki still claims rhel, was just checking18:22
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Install Ceph Hammer and/or Jewel from CentOS Storage SIG repos  https://review.openstack.org/34050418:22
gfidentetty tomorrow guys18:22
*** gfidente has quit IRC18:22
shardyslagle: my point was really that nobody is testing some of the stuff we document for RHEL anywhere downstream, because folks are switching to different (as yet undocumented in tripleo-docs) tools18:22
slaglethey are?18:22
slagleoh, quickstart?18:23
shardyslagle: quickstart and the image buider thing18:23
shardywhich is apparently deprecating the old image building CLI18:23
slagleshardy: i guess i'm wondering what the message is...do we still support rhel?18:23
slaglewe have a lot of rhel-only stuff in tree18:23
shardyslagle: I've got no problem with rhel integration, it's documenting things which aren't tested, thus by definition don't ever work18:24
shardyI've got folks following those docs then emailing me asking why they don't work :(18:24
*** fragatina has quit IRC18:24
shardynow there are downstream docs covering builds targetted at RHEL, I'm just thinking it's easier to pull the stuff we don't test from the docs18:25
slagleok, so there exists an alternative somewhere, if we remove these?18:25
shardyhaving rhel stuff in t-h-t is no different from all the other vendor specific stuff we have in there18:25
shardyslagle: well there are pretty comprehensive docs for OSP director, which is actually tested on RHEL18:25
shardyI guess the alternative is to wire in a RHEL CI job, but I'm not sure how feasable that is18:27
bnemecPretty sure it would have to be third-party CI.18:27
shardyyeah18:27
slagleshardy: i guess i don't think that "not tested" = "doesnt work"18:28
slaglewhile in this case, it may certainly be true18:28
shardyslagle: by definition, anything not tested regularly ends up broken18:28
slagleyes, but not just rhel18:29
shardylook at our CI, it breaks almost every day, often due to packaging/dependency issues18:29
slaglei guess the point is...are we removing them b/c they're broken, or b/c we intend not to support rhel any longer18:29
*** tbonds has joined #tripleo18:29
shardyslagle: my argument is we don't actively support RHEL for upstream builds, because it's never tested on that platform anymore18:29
shardyso we either automate testing (even a periodic third-party job would be fine I guess), or remove the docs18:30
bnemecTechnically I don't know that RHEL has ever been meaningfully supported upstream.18:30
shardymy main motivation here is just to enable an easier path for new contributors18:30
bnemecThe RHEL docs are an artifact of when instack-undercloud was being developed downstream.18:30
shardybnemec: exactly18:30
shardyat one time, folks were testing closely related builds on both platforms, but the test workflows have diverged significantly since then18:31
*** bfournie has joined #tripleo18:32
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477718:35
jeckersbtrown: trying to do devmode quickstart, always fails when trying to inject the additional images into the undercloud18:35
jeckersbknown bug? unknown bug?  me being dumb?18:35
jeckersblooks like it never downloads them before it tries to shove them into the image18:37
jeckersbi could just grab them manually although i'm guessing that's not quite expected18:37
trownjeckersb: let me give it a whirl, that is certainly not expected behavior :)18:37
jeckersbtrown: ok cool... if it's broken for you too i'd like to try to fix it just so i can learn how18:38
trownjeckersb: woot, thanks!18:40
jeckersbbit by bit i am understanding how this rube goldberg machine works :)18:40
trownjeckersb: I am trying to rework that part of quickstart to just download an overcloud-full image do some basic conversion steps on it, and then inject the original overcloud-full and IPA images back in18:41
trownbecause tripleo is no longer producing an undercloud image, so the one we have will just keep getting older18:41
jeckersbmakes sense to me!18:41
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Mitaka CI test  https://review.openstack.org/34051118:42
*** akshai has quit IRC18:47
trownjeckersb: are you passing in "--release master-tripleo"?18:47
jeckersbtrown: yep, copy/pasted out of the README18:48
jeckersbbash quickstart.sh --config config/general_config/devmode.yml             --release master-tripleo             $VIRTHOST18:48
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477718:48
trownk... my run just got past that point18:48
trownjeckersb: could you try with "--teardown all"?18:49
jeckersbsure18:50
*** akshai has joined #tripleo18:50
jeckersbtrown: and make sure you don't already have /home/stack/.quickstart/ironic-python-agent.initramfs and similar on virthost beforehand18:51
jeckersbpossibly you have old copies of that around or something?18:51
jeckersb(i'm not entirely sure how it all works so maybe that is already taken care of)18:51
dprincebeagles: hi, would you be okay if I switched the names here a bit https://review.openstack.org/#/c/332147/6/overcloud-resource-registry-puppet.yaml18:52
trownjeckersb: I ran with "--teardown all", as that will completely delete the stack user and recreate it18:52
jeckersbok18:52
dprincebeagles: specifically, to ComputeNeutronL3Agent instead of ComputeL3Agent18:52
jeckersbtrown: i am guessing that completely wipes /home/stack as well18:52
trownjeckersb: but you may be on to something none the less... the image cache is in a neutral location18:52
trown/var/lib/oooq_image/ by default18:52
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable OpenContrail compute plugin  https://review.openstack.org/33848018:53
trownoooq_images rather18:53
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable Neutron Core Compute Plugin  https://review.openstack.org/33831518:53
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable Nuage Compute Plugin  https://review.openstack.org/33847718:53
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable Plumgrid compute plugin  https://review.openstack.org/33847918:53
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable Midonet compute plugin  https://review.openstack.org/33847818:53
jeckersbyeah something along those lines18:53
dprincebeagles: I left a comment on the patch18:55
trownhmm or not, it is https://github.com/openstack/tripleo-quickstart/blob/master/roles/common/defaults/main.yml#L8 deleting that and rerunning18:55
*** dsneddon_ has joined #tripleo18:58
jeckersbmine is still going but i see latest-ipa_images.tar under /var/cache18:59
jeckersbso it's at least pulled it down to there18:59
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Add Aodh composable roles  https://review.openstack.org/33355619:00
* jeckersb impatiently waits19:00
trownya it is taking much longer now that it is actually downloading the image19:00
beaglesdprince: absolutely fine with that :)19:01
beaglesdprince: I'll fix19:01
dprincebeagles: awesome, thanks man19:02
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Add Aodh composable roles  https://review.openstack.org/33355619:03
jeckersbtrown: hm appears to be working for me this time19:04
jeckersbapparently the teardown fixed it19:04
trownjeckersb: interesting... the explicit teardown thing is relatively new, and not well tested in CI (the CI nodes are clean to start)19:05
EmilienMdprince: did you look failures in https://review.openstack.org/338315 ?19:05
dprinceEmilienM: I did, I am. Sadly my undercloud fails to install due to keystone puppet issues :/19:06
dprinceEmilienM: the rebase was to rename, the variable and fix merge conflicts only. No other changes yet19:07
dprincebeagles: I aligned my variable here to match what you are doing as well https://review.openstack.org/#/c/338315/10/overcloud-resource-registry-puppet.yaml19:07
beaglesdprince: ack19:08
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028119:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]19:10
*** chandankumar has left #tripleo19:11
*** dhill_ has joined #tripleo19:12
EmilienMdprince: can you look https://review.openstack.org/#/c/333498/ ?19:13
dprinceEmilienM: ha, so the reason I never review that is it shows up in my reviews :)19:16
dprinceEmilienM: I will, yes19:16
EmilienM:)19:16
*** apetrich_ has quit IRC19:16
EmilienMdprince: your patch for neutron/compute worries me I tested it and it fails19:16
EmilienMsee http://logs.openstack.org/15/338315/9/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/768e454/logs/overcloud-novacompute-0/var/log/nova/nova-compute.txt.gz#_2016-07-10_22_17_25_80719:17
dprinceEmilienM: don't worry. fix it19:17
dprinceEmilienM: possible there is a subtle change we need to make in puppet-tripleo still19:17
dprinceEmilienM: like I said, I started looking and then got interrupted19:17
EmilienMok19:17
EmilienMno prob you're busy :)19:17
dprinceEmilienM: I think the heat code is good, or at least close19:17
*** apetrich_ has joined #tripleo19:18
dprinceEmilienM: note, my approach was the same as what beagles did for DVR here https://review.openstack.org/#/c/333498/19:18
dprinceEmilienM: so I like that the composable approaches are aligning well to enable new features like DVR19:18
EmilienMdprince: right19:19
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Ceilometer Compute Agent composable service  https://review.openstack.org/33180219:20
dprinceEmilienM: using trunk. The error I hit in the undercloud is this:19:21
dprinceEmilienM: Could not evaluate: Execution of '/bin/openstack domain list --quiet --format csv' returned 119:21
dprinceEmilienM: any idea on what changed? No worries if you don't just thought maybe you saw something similar w/ puppet CI19:21
dprinceEmilienM: perhaps an openstackclient related breakage?19:22
dprinceEmilienM: I'd be curious to see if puppet-keystone passed w/ RDO trunk19:22
openstackgerritMerged openstack/instack-undercloud: Properly set undercloud_service_certificate when file exists  https://review.openstack.org/33790419:23
EmilienMdprince: we are blocked on this thing since Thursday.19:23
EmilienMdprince: https://etherpad.openstack.org/p/delorean_master_current_issues19:23
EmilienMwe'll need https://review.openstack.org/#/c/329189/ to land19:23
EmilienMit's blocking TripleO promotion and Puppet CI19:23
dprinceEmilienM: that is old though. I thought we pinned to avoid it?19:24
dprinceEmilienM: oh well. if this is the same thing that is sad... Its been a month19:25
EmilienMit's another thing19:25
EmilienMwe used to pin and went back on master when it was fixed19:25
EmilienMand it broke again last week19:25
EmilienMit's not the same thing you think19:25
EmilienMit's something newer19:25
dprinceright, so is there a new bug? or patch?19:25
EmilienMit's a new bug and it was a lot of patches to fix it and the last one will be https://review.openstack.org/#/c/329189/19:26
EmilienMbut before this one, they did a bunch of things19:26
EmilienMbetween os-lib and osc19:26
EmilienMbut to land this patch, we'll need https://review.openstack.org/#/c/340431/ first19:27
EmilienMit's a mess, yes19:27
dprinceugh, yeah19:27
dprincethis is what happens when you don't revert19:27
EmilienMdprince: https://review.openstack.org/#/c/339554/19:27
EmilienMI proposed the revert ^19:27
dprincelike the intial breakage should have just been reverted... instead of all this19:27
EmilienMthey didn't accept it19:27
EmilienManything else? lol19:27
dprinceEmilienM: push harder19:28
dprinceEmilienM: :)19:28
EmilienMI'm done here, now I'm waiting for the patch to land19:28
EmilienMdprince: what do you prefer for pacemaker service bits: manifests/profile/base/pacemaker.pp or manifests/profile/pacemaker/pacemaker.pp or something else?19:30
EmilienMI like manifests/profile/base/pacemaker.pp19:30
EmilienMit just aims to deploy pacemaker itself, not all the resources19:30
dprinceEmilienM: base/pacemaker.pp is fine19:31
EmilienMk19:31
*** rcernin has joined #tripleo19:32
*** bfournie has quit IRC19:32
*** akshai has quit IRC19:32
*** akshai has joined #tripleo19:36
openstackgerritMerged openstack/os-cloud-config: Updated from global requirements  https://review.openstack.org/33233319:38
*** panda|afk is now known as panda19:40
*** jcoufal_ has joined #tripleo19:40
openstackgerritMerged openstack/os-collect-config: Updated from global requirements  https://review.openstack.org/32484419:41
*** jcoufal has quit IRC19:43
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Implement Pacemaker service profile  https://review.openstack.org/34054719:47
jeckersbgrrr my db syncs are timing out again...19:49
jeckersbslagle: is there anything like the "puppet module hacking" steps from the deep dive, except for the undercloud instead of the overcloud?19:50
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Composable Pacemaker service  https://review.openstack.org/34054819:51
trownjeckersb: for the undercloud you can just hack directly on the puppet modules in /etc/puppet19:51
trownthe overcloud case is unique because hacking on the modules inside the overcloud image is a bit painful, so instead we use that mechanism from the deep dive to push hacked modules from the undercloud19:53
*** trozet has quit IRC19:54
jeckersbtrown: so basically just edit them in place and then re-run undercloud-install.sh ?19:54
trownjeckersb: yep19:54
jeckersbawesome19:55
slagleBOOM19:59
slaglehttp://logs.openstack.org/77/324777/67/experimental/gate-tripleo-ci-centos-7-nonha-multinode/704439f/19:59
EmilienMdprince: I let you final +A on https://review.openstack.org/#/c/333498/ so you can have the last eye ;-)20:00
jeckersbslagle: is that splitting the controller services apart to multiple nodes?20:00
EmilienMslagle: you got it?????20:00
slagleEmilienM: yep, with the ping test :)20:01
EmilienM1h05min -> excellent !20:01
EmilienMslagle: wow man20:01
EmilienMthat's a very very good news for us20:01
*** jayg is now known as jayg|g0n320:01
dprinceEmilienM: +220:03
dprinceslagle: nice work man20:03
EmilienMyeah, congrats20:03
EmilienMslagle: do you need some reviews ?20:03
slaglei always need reviews :) i need to remove some debugging info from the tripleo-ci patch though20:04
jeckersbtrown: ok next question... even if i update the puppet modules inplace on the undercloud, there's still a handful of other tasks that quickstart would have run, had it succeeded20:04
jeckersbtrown: and if i just run quickstart again, it's going to wipe out the changes that i made to the undercloud, no?20:05
jeckersb(blow it away and re-image it)20:05
*** akshai has quit IRC20:05
trownjeckersb: ya, you wouldnt want to run quickstart again, just the undercloud install from the undercloud itself20:06
dprinceslagle: any reason you didn't put the environment file in environments here? https://review.openstack.org/#/c/222772/2020:07
dprinceslagle: besides a common directory for all environments we don't have a good mechanism to identify them...20:07
*** akshai has joined #tripleo20:08
*** trozet has joined #tripleo20:08
slagledprince: not really, i can move it np20:09
dprinceslagle: cool, I looking now but if you do that and EmilienM is still okay I think we could land it20:09
dprinceslagle: I honestly thought it already landed20:09
dprinceslagle: its time...20:09
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028120:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]20:10
EmilienMdprince: I'm ok20:14
*** pcaruana has quit IRC20:17
*** sambetts is now known as sambetts|afk20:17
*** lblanchard has quit IRC20:18
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Use already Deployed/Installed servers  https://review.openstack.org/22277220:20
*** fzdarsky has quit IRC20:21
EmilienMdprince: feel free to +A ^20:21
dprinceslagle: +2 from me. if CI passes again please feel free to send it20:22
openstackgerritMerged openstack/python-tripleoclient: Deprecate fedora-user image type  https://review.openstack.org/33177320:22
openstackgerritMerged openstack/tripleo-heat-templates: Re-enable Ceilometer composable roles for controller  https://review.openstack.org/33349820:23
EmilienMpradk: /me rebasing gnocchi, I'll let you rebase aodh20:24
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477720:24
pradkEmilienM, yep on it20:24
*** dmsimard|mtl has quit IRC20:26
*** julim has quit IRC20:27
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Gnocchi composable roles  https://review.openstack.org/31841320:27
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Composable Pacemaker service  https://review.openstack.org/34054820:28
*** fzdarsky has joined #tripleo20:31
*** julim has joined #tripleo20:32
*** fragatina has joined #tripleo20:36
*** julim has quit IRC20:37
*** chem has quit IRC20:42
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Add Aodh composable roles  https://review.openstack.org/33355620:50
*** dprince has quit IRC20:51
sshnaidm|afkEmilienM, dprince hi, can you please merge this today? https://review.openstack.org/#/c/339118/  it will enable tempest jobs again20:52
openstackgerritMerged openstack/tripleo-heat-templates: Combine parameter_default fields  https://review.openstack.org/31298820:52
*** egafford has left #tripleo20:53
*** egafford has joined #tripleo20:53
*** trown is now known as trown|outtypewww20:57
*** Goneri has quit IRC20:57
*** panda is now known as panda|zZ21:02
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Composable Horizon service - puppet-tripleo  https://review.openstack.org/33550621:02
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates: Add environment file to enable DVR  https://review.openstack.org/33214721:05
*** apetrich_ has quit IRC21:06
*** apetrich_ has joined #tripleo21:08
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Add MySQL profiles  https://review.openstack.org/34044421:09
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Move MySQL Galera within composable services  https://review.openstack.org/34044821:10
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/160028121:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1600281 in tripleo "ImportError: No module named api" [Critical,Triaged]21:10
*** bfournie has joined #tripleo21:16
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Composable Horizon service - tripleo-heat-templates  https://review.openstack.org/33549921:18
EmilienMccamacho: rebased ^21:18
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Composable Zaqar services  https://review.openstack.org/33168221:19
*** akshai has quit IRC21:21
openstackgerritMerged openstack/puppet-tripleo: Add ironic inspector as a terminated HAProxy endpoint  https://review.openstack.org/33264021:23
*** jistr has quit IRC21:24
*** jcoufal_ has quit IRC21:29
*** apetrich_ has quit IRC21:32
*** jcoufal has joined #tripleo21:33
*** apetrich_ has joined #tripleo21:35
*** jcoufal has quit IRC21:39
*** apetrich_ has quit IRC21:40
*** mbound has joined #tripleo21:41
*** apetrich_ has joined #tripleo21:42
*** shardy has quit IRC21:44
*** ccamacho has quit IRC21:45
*** jrist has quit IRC21:47
*** akshai has joined #tripleo21:48
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Gnocchi composable roles  https://review.openstack.org/31841321:50
*** akshai_ has joined #tripleo21:51
*** trozet has quit IRC21:52
*** akshai has quit IRC21:54
*** tzumainn has joined #tripleo22:00
*** penick has joined #tripleo22:01
*** bfournie has quit IRC22:10
*** dsneddon_ has quit IRC22:11
*** fzdarsky has quit IRC22:13
*** apetrich_ has quit IRC22:16
*** apetrich_ has joined #tripleo22:16
*** fpan has quit IRC22:24
*** tzumainn has quit IRC22:26
*** pradk has quit IRC22:40
*** dbecker has joined #tripleo22:44
*** yamahata has quit IRC22:45
*** apetrich_ has quit IRC22:46
*** egafford has quit IRC22:46
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477722:47
*** apetrich_ has joined #tripleo22:48
*** spredzy has quit IRC22:51
*** spredzy has joined #tripleo22:53
*** mbound has quit IRC22:53
*** limao has joined #tripleo22:55
*** egafford has joined #tripleo23:03
*** limao has quit IRC23:05
*** limao has joined #tripleo23:05
*** yamahata has joined #tripleo23:11
*** saneax_AFK is now known as saneax23:14
*** dbecker has quit IRC23:15
*** egafford has quit IRC23:22
*** apetrich_ has quit IRC23:28
*** apetrich_ has joined #tripleo23:32
*** rdo has quit IRC23:35
*** penick has quit IRC23:36
*** limao has quit IRC23:40
*** apetrich_ has quit IRC23:42
*** apetrich_ has joined #tripleo23:42
*** rcernin has quit IRC23:43
*** akshai_ has quit IRC23:50
*** akshai has joined #tripleo23:50
*** julim has joined #tripleo23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!