DW Export User Guide
DW Export User Guide
Warning: This document is protected by copyright law and international treaties. Unauthorised reproduction of this document, or any portion of it, may
result in severe and criminal penalties, and will be prosecuted to the maximum extent possible under law.
Table of Contents
Introduction 3
Purpose of this Guide 3
Intended Audience 3
Application Overview 4
Installation Guide 5
Pre-Installation 5
Identifying Main GL and PL Reports 5
Post-Installation 5
Data Extract 6
Data exported from T24 into Insight /Insight Risk 13
DW EXPORT records to be configured for Insight 17
Additional DW EXPORT tables in Temenos Insight 18
DW EXPORT records to be configured for Insight Risk 20
Configuration and Creation of CRB files 21
Mode of Extraction 25
Online Extraction TSA.SERVICE record 25
COB Extraction 25
DW Export API Records 27
Other Records 27
Automated tool to configure DW Export utility 29
Prerequisites 29
MERGE.COMPANY in DW.EXPORT 31
Parallel Extraction in DW.EXPORT 32
Configure DW.EXPORT 32
Configure BATCH 33
Configure BATCH.NEW.COMPANY 34
FAQs 37
The following sections in this document provide all the details about the installation (pre and post) processes of DW Export utility and the con-
figuration involved to extract data using DW.EXPORT application.
Intended Audience
This guide is intended for the use of generic users/business users who implement and use DW.EXPORT application.
DW.EXPORT is a T24 application which stores all the tables required and extracted for TEMENOS Insight and Insight Risk products. The files
that are going to be extracted as part of DW Export need to be stored as data records to ensure that further extractions do not require any com-
plex coding changes and can be managed using data records.
As part of post-installation setup, the user should perform the basic steps listed in the following sections for extracting the requisite data from
T24.
Currently the DW.EXPORT utility supports only UTF-16E format and stores the extracted files as .CSV files in the local directory with a delim-
iter “~” configured at lead company level. User can transfer the created files to another location.
Pre-Installation
Setting up the System
The first prerequisite for DW Export utility is to install the DW product.
Note: User should get the DW license code from the Licensing team..
After the installation of DW product in SPF and COMPANY record, the T24.UPGRADE online service needs to be run to release base appli-
cations including DW.EXPORT, DW.EXPORT.PARAM and pre-configured standard DW.EXPORT records. These records are required for both
Insight and Insight Risk, and the related data records such as EB.API records for SELECT and PROCESS APIs, BATCH and TSA.SERVICE rec-
ords etc.,
Now, the latest update for DW_BiExport component should be downloaded from TCSP portal to get all the latest fixes related to the DW.E-
XPORT application. Install these updates using the T24.UPDATE service.
Ensure to authorise the following data records after installing the latest update.
l STANDARD SELECTION
l EB.ERROR
l EB.API
l TSA.WORKLOAD.PROFILE
l TSA.SERVICE
l BATCH
l DW.EXPORT
Post-Installation
Setting up DW.EXPORT
All T24 applications require a standard Insight system build. The Insight Risk product will be released in the DW.EXPORT application as part
of the installation of the DW package. They just need to be input and authorised. User needs to create and configure only one additional
extract, that is, CRB Extract Records for main GL and PL reports. The configuration process for the CRB extract is explained later in this doc-
ument.
The following two steps should be followed to configure the extract of a file in the data extract.
1. Individually open the default list of records released in DW.EXPORT in “INPUT” mode and then commit them. Replace the ‘SYSTEM
FIELD’ in FIELD.NAME with the actual field name and ensure that the TAKEOVER field is set as BULK for the required files.
2. Configure DW.EXPORT.PARAM for all the lead companies for which the extract needs to be run. The extract path for each lead com-
pany is setup separately to indicate where the CSV files should be generated and stored. The required DW.EXPORT records for the cur-
rent lead company should be input in FILE.NAME by multi-valuing or using the ‘ALL’ option. This will populate all the DW.EXPORT
records with TAKEOVER is not null. This record must be configured for each lead company.
The following screen shot illustrates the configuration of a company level record and the required fields to be configured in the record. In a
multi-book environment, this record needs to be created and configured only at the lead company level.
As illustrated in the example, the path name where the file needs to be extracted should be specified on the field FILE.PATHNAME, and it
must be entered for all the T24 files that are going to be extracted for the current company in FILE.NAME by multi-valuing it.
Optionally, the user can specify a transfer routine in the field TRANSFER.RTN to transfer the CSV files into Insight/Insight Risk Server in
binary mode. There is sample transfer routine DW.TRANSFER.ROUTINE that has been released along with the DW Export utility. Using the
sample as a guide, the user can write their own ftp transfer routine.
The following are steps involved in CATEG.ENTRY and ACCT.ACTIVITY extractions (these procedures are required only for Insight).
CATEG.ENTRY Extract
For Monthly Extract
After the first successful data extraction, all subsequent extracts are carried out daily using the above monthly extract setup. Following are the
settings for daily extraction.
ACCT.ACTIVITY Extract
By default, the ACCT.ACTIVITY file will be extracted every month. If the extract for ACCT.ACTIVITY file needs to be performed for a specific
month, then enter the specific year and month (YYYYMM) in the YEAR.MONTH field.
Starting from the R11 release, T24 supports the following extraction types:
1. Daily Extract
2. Incremental Extract
3. Bulk Extract
4. Online Extract
The first three extracts are considered as offline extracts and the last one is considered as an online/real time extract.
Daily Extract
Daily Extract is the customized selection for T24 tables. If a file needs to be extracted as DAILY, then it is based on the CONCAT file defined in
EXTRACT.FILE in DW.EXPORT. Selection will automatically be done based on EXTRACT.FILE, but user should have PROCESS API to han-
dle this properly.
For example, STMT.ENTRY, RE.CONSOL.SPEC.ENTRY and CATEG.ENTRY files can be extracted through the DAILY extract.
Incremental Extract
The Incremental extract is used to extract the records that were amended or updated in the previous day or newly introduced in the specific
T24 file. To do this type of extract, set the TAKEOVER field to INCREMENTAL in the DW.EXPORT record. This is mainly used to improve
the performance of extracting from T24 and importing into Insight for Banks with huge volumes of data. For example, the CUSTOMER file
could be extracted as incremental. For the incremental extract, the field INCR.KEY.FIELD is mandatory and must be a valid unique field from
CUSTOMER table.
Bulk Extract
The Bulk Extract will extract all the records from a T24 table. For the initial extract, all the DW records will be configured as BULK in the
TAKEOVER field.
The exceptions are STMT.ENTRY and RE.CONSOL.SPEC.ENTRY. These files will always be DAILY; ACCT.ACTIVITY will only be extracted
monthly using the YEAR.MONTH field. CATEG.ENTRY will initially extract the entire month and then from the next day onwards, it will be a
DAILY extract.
Online Extract
The Online extract is also called the Real Time extract. It will capture the transactions that are configured for online extract, and directly update
the target database on the Insight server for those real time transactions once they are authorised inT24.
There is an online auto service for the online extract. It will be run in phantom mode to pick up those online transactions. To do this type of
extract, the TAKEOVER field should be set as ONLINE.
For example, STMT.ENTRY and ACCOUNT file to capture the real time account movements with transaction codes etc.
To enable real time and continuous extract, old ETL can be used to do few configurations and external .jar files can be used to upload into exter-
nal database. Refer Data Warehousing user guide to setup CLASSPATH for the jar files in .profile or remote.cmd and ensure to set up con-
nection properties in dwUtils.properties as below.
1. The ENABLE field should be set to NO in DW.EXTRACT.PARAM for the SYSTEM record. This enables T24 to
switch off the legacy ETL Tool using DW.EXTRACT.
4. Set TAKEOVER field and Online target table for the required files at DW.EXPORT level to upload the real time
transactions to the target database as shown below.
5. Start the DW.EXPORT.ONLINE service, which will upload the data into Insight Server directly.
CRB Extracts
CRB Extracts need to be configured by the bank in DW.EXPORT. The CRB report is a standard T24 GL reconciliation report. Refer “Con-
figuration and Creation of CRB files” section if the bank has not yet configured these as it is a pre-requisite to setup DW.EXPORT. For a given
CRB report, DW.EXPORT needs to be configured as follows:
The SEL.COMPANY field needs to be specified with the lead company ID as it will be set up for other DW.EXPORT records.
ID Extract Details
ACCOUNT This will extract interest and charges that have been collected from the cus-
tomer on the COB date. This record only needs to be set up, if consolidation
has been set up for CATEG.ENTRY records in job IC.COB otherwise the
CATEG.ENTRY records will extract this information.
ACCT.ACTIVITY Extract contains details of each Account for each month in which there has
been any Activity over the Account, used to calculate interest and charges,
Total Debit and Credit Turnover, Total number of entries with each different
Transaction Code processed, and the total value of the entries with each
Transaction Code. These details are held in the record for the month in
which the entries are processed, regardless of the Value Dates of the entries
ACCT.CAPITALISATION The purpose of this table is to specify the next date and subsequent
frequency of application of debit and credit interest for a specific Account
AM.VEH Valuation of portfolio at each month for last working day. Extract details
include information about Asset and Sub-Asset type.
CATEG.ENTRY Extract information will be used as a basis for P & L information, it con-
tains information such as Transaction Code, PL Category( Interest Income /
Expense / Fees etc.,), Account officer, Product Category, Amount in Local
currency, Customer ID etc.,
The use of these codes together with personal Customer characteristics (for
example: Residence, Status, Industry and Sector codes etc.,) will enable the
bank to produce balance sheets and returns reflecting a co-ordinated and
structured view of its operation by directing business transactions to their
appropriate place on the report.
COLLATERAL This file is used to record the details of collateral submitted by a customer,
the value of collateral, and optionally, to link it directly to a customer's sup-
porting deal elsewhere in the system.
COLLATERAL.RIGHT The collateral right file is used to record the status of a right of security and
to indicate against which customer outstanding, the right applies.
COLLATERAL.TYPE This file is used to define classes of collateral object such as buildings,
stocks, guarantees (or subdivisions thereof).
COMPANY Extract information detail about the company level parameter setup which
includes information about various applications attached to the company,
Default Local Currency, Financial Year End, Holiday Details and the
Default currency rate conversion etc., This information is common for LEAD
and Branch company. A Branch company is linked to a Lead company and
uses the same data files as its Lead company with the exception of financial
reporting files.
CURRENCY.MARKET Extract information provides list of currency market (for example: Cash Mar-
ket, Money Market, Bond Market etc.). The markets defined on this table are
used to identify the correct exchange and revaluation rates to be applied to
each Currency.
CUSTOMER Extract provides basic information about a customer such as Customer ID,
Mnemonic, Country, Nationality, Residence, Sector, Industry, Language,
Customer Liability, Account Officer etc.; Details in the Customer base record
are descriptive and not financial.
CUSTOMER.STATUS Extract information provides information about the customer based on the
internal rating that can be assigned to a customer in order to know the
credit worthiness of a customer (for example: AA, AA+ , B, BB+ etc.,)
DATES A Date record exists for each company. This record contains the run dates
for the previous, the current and the next working.
DEPT.LEVEL Extract provides information about the hierarchy of the organisation like
Board, Management, Divisional, etc.
EB.RATING Extract provides external rating codes assigned by the External Rating
Agency, This helps to identify the external market credibility / performance
by the customer.
EB.RATING.AGENCY Extract provides list of external rating agencies and their codes.
GEOGRAPHIC.BLOCK Extract provides information about list of countries attached within that
Geographical Block.
GROUP CAPITALISATION The purpose of this table is to specify the next date and subsequent
frequency of application of debit and credit interest for a group of Accounts.
INDUSTRY Extract provides list of industries and their codes. Information is useful
when we analyse the profitability / Exposure of a customer based upon the
industry.
INTEREST.BASIS Extract provides List of Interest Basis, forms the basis in calculating the
Interest.
LIMIT The Limit System is designed to monitor the availability and utilisation of
Limits. Customer Limits are monitored in real-time. Back end reports are
used to monitor Limits for Commodities, Countries, Country Groups and
Currencies.
LIMIT.REFERENCE A Limit Reference is a numeric code which defines a type of Limit. For those
cases where it may be necessary to sub-divide a Limit Reference, a hierarchy
can be defined. A hierarchy can consist of up to three levels such as Global
Limit, Product Limit and Sub product Limit.
LIMIT.TXNS System will not extract all LIMIT.TXNS, but extract those LIMIT ids along
with contract information which is directly linked to COLLATERAL.RIGHT.
LN.ASSET.CLASS Provides information about the asset class such as Performing, Non-Per-
forming which is used as a basis to allocate provisions for the assets held in
the books
RE.CRF.XXXX This is a CRB file extract where XXXX is T24 GENERAL LEDGER Report
name
RE.STAT.REP.LINE Information about the definition of the content of a report line. It also holds
the details for line narratives, sub headings, totalling for each report and
control of spacing (empty lines) before and after lines and totals
RELATION The Relation table is used to specify the various types of relation that could
exist between Customers. The purpose of identifying such relationship codes
is to provide the bank with the ability to "group" various clients together for
reporting or information purposes
SC.FUND.FLOW Extract information contains details of security and fund flow information.
SEC.ACC.MASTER This file contains information relating to a customer’s security account (port-
folio). Any number of portfolios may be opened for a given client, each
uniquely identified by a separate suffix.
SECTOR Provides list of Sector codes which can be assigned to each Customer record
to group them into broad classifications such as Private Sector, Public Sec-
tor, Corporate, Banks etc.
SECURITY.MASTER This file is used to record and maintain details of all securities opened
within the Securities module. Comprehensive information relating to each
Security, along with the conditions applicable to it, is stored in this file.
SECURITY.POSITION This file provides information of security cash flows for Market Risk.
STMT.ENTRY The STMT.ENTRY file contains the debit and credit entries that are passed
over any accounts. And all the debit and credit entries raised as on Yes-
terday will be extracted used in Insight.
TARGET Target codes defined on this table are assigned to Customer records of T24
to indicate how the Customer fits in with the Bank's overall marketing
strategy. For example: HNI, Prime customer etc.,
TRANSACTION The Transaction Table contains information about all the Transaction Codes
which may be used within T24. The Transaction codes contain and identify
important processing conditions which will be defaulted by the Applications
if no other input has been entered at the transaction level.
USER This file is used by the Security Management System to control who has
access to T24., when and to what information and facilities
ACCOUNT Monthly Optional, to be turned on only when the detail entries update of
netted CATEG.ENTRY is switched off.
ACCT.CAPITALISATION Daily
CATEG.ENTRY Monthly/Daily First time alone this file should be extracted with YEAR.MONTH of
current month along with select API and TAKEOVER as Y, from next
day onwards TAKE.OVER to be set as N and select API to be
removed
CATEGORY Daily
COMPANY Daily
COUNTRY Daily
COUNTRY.GROUP Daily
CURRENCY Daily
CURRENCY.MARKET Daily
CUSTOMER Daily
CUSTOMER.STATUS Daily
DATES Daily
DEPT.ACCT.OFFICER Daily
DEPT.LEVEL Daily
EB.RATING Daily
EB.RATING.AGENCY Daily
GEOGRAPHIC.BLOCK Daily
GLOBAL.CUSTOMER Daily
GROUP.CAPITALISATION Daily
INDUSTRY Daily
INTEREST.BASIS Daily
LIMIT Daily
LIMIT.REFERENCE Daily
LN.ASSET.CLASS Daily
RELATION Daily
RE.CONSOL.SPEC.ENTRY Daily
RE.STAT.REP.LINE Daily
SECTOR Daily
STMT.ENTRY Daily
TARGET Daily
TRANSACTION Daily
USER Daily
RE.CRF.XXGL Daily This record needs to be configured manually for master GL report in
T24 system, where XXGL is General Ledger report name (Man-
datory)
RE.CRF.XXPL Daily This record needs to be configured manually for master PL report in
T24 system, where XXPL is Profit and Loss report name (Optional)
Insight PWM
AM.VEH Daily Available for Insight PWM and to be turned ON this file only if AM
product is installed
POSITION AC Daily
BL.BILL BL Daily
BL.REGISTER BL Daily
BL.TYPE BL Daily
CUST.DOCUMENT DM Daily
DE.ADDRESS DE Daily
DEALER.DESK FX Daily
FOREX FX Daily
ACCOUNT.CREDIT.INT IC Daily
ACCOUNT.DEBIT.INT IC Daily
LC.TYPES LC Daily
LETTER.OF.CREDIT LC Daily
DRAWINGS LC Daily
LD.LOANS.AND.DEPOSITS LD Daily
LMM.SCHEDULES LM Daily
MD.DEAL MD Daily
MG.MORTGAGE MG Daily
MM.MONEY.MARKET MM Daily
PD.BALANCES PD Daily
ENTITLEMENT SC Daily
SEC.TRADE SC Daily
ASSET.TYPE SC Daily
SUB.ASSET.TYPE SC Daily
ACCT.GEN.CONDITION ST Daily
BASIC.INTEREST ST Daily
FT.COMMISSION.TYPE ST Daily
PERIODIC.INTEREST ST Daily
STANDING.ORDER ST Daily
Credit Risk
The Banks that have not configured the CRB flat files generation should follow the below steps to configure and create CRB flat files for the
CRB Extract:
l First, the Banks have to decide the GL and PL reports that need to be extracted as part of CRB extract for Insight.
l Whether the Bank wants to generate direct CSV files or CRB flat files (FXXX.RE.CRF.YYYY)Å and then CSV files
through the existing report job of RE.OUTPUT.EXTRACT. The RE.EXTRACT.PARAMS must be configured accord-
ingly for those reports.
Where XXX is the company mnemonic and YYYY is the standard T24 report available in RE.STAT.REPORT.HEAD
application.
l There are two new fields viz., CRB.FILE.LEVEL and CSV.FILE.FORMAT introduced in RE.EXTRACT.PARAMS appli-
cation to achieve this.
l There are two new fields viz., CRB.FILE.LEVEL and CSV.FILE.FORMAT introduced in RE.EXTRACT.PARAMS appli-
cation to achieve this.
l Direct CSV files – Option 3: New option available from R11 to generate the CSV files directly from reporting job
instead of generating normal CRB flat files, and then generating the CSV files.
l After setting up the above two parameters, attach the RE.EXTRACT.FILE file record ID in the DATA field for the
job RE.OUTPUT.EXTRACT in the batch record of RE.PRINT.DEAL.RPT if CRB flat files are going to be generated
as part of COB and based on the setup RE.EXTRACT.PARAMS configured with either Option 1 or Option 2 as
above.
l To generate the CRB flat files online, start the service RE.RETURN.EXTRACT along with TSM records in TSA.SER-
VICE.
l If T24 data is going to be extracted as part of online service, configure the DW batch record as below (For exam-
ple MBGL report is configured for Direct CSV files).
1. Online Extraction
2. COB Extraction
Start the TSA.SERVICE record and also ensure that TSA.WORKLOAD.PROFIE is linked properly.
TSA.WORKLOAD.PROFILE
TSA.WORKLOAD.PROFILE record for this service must be created with as many agents as required, and linked to the TSA Service record
DW.EXPORT.SERVICE.
COB Extraction
The batch records <XYZ>/DW.EXPORT.DETAILS will be released as part of DW.EXPORT utility, where <XYZ> are the lead company mne-
monic to do extract as part of COB.
Ensure the frequency is set to Daily for the jobs DW.EXPORT.CLEAR and DW.EXPORT.INFO in DW.EXPORT.DETAILS as shown below
from Adhoc, so that the generation of CSV files will be run as part of COB, and then there will be no need to run DW.EXPORT.SERVICE.
In the DW.EXPORT application, two APIs can be attached. First API is SELECT API which is used to select the records with some selection
criteria if bank needs; second API is PROCESS API which is used to process the selected records one by one. These APIs should be defined in
EB.API record with SOURCE.TYPE as BASIC. These are provided with some sample API and examples as follows.
SELECT API
SUBROUTINE DW.XX.SELECT.API (FILE.NAME, R.DW.EXPORT, REC.LIST)
Incoming Parameters
FILE.NAME -The name of the file that is going to be extracted as CSV file through DW.EXPORT. For example: CATEG.ENTRY, RE.CRF.MBGL
(where MBGL is GL report head), CUSTOMER, etc.
R.DW.EXPORT - Holds the whole DW.EXPORT record (dynamic array) for the file in FILE.NAME.
Outgoing Parameters
REC.LIST -The selected record id list, the record ids should be separated by FM marker. For example, 1000: FM: 1001: FM etc.
If any select routine have not been attached, all the records will be selected and converted into CSV files by default.
PROCESS API
SUBROUTINE DW.XX.PROCESS.API (FILE.NAME, R.DW.EXPORT, T.BI.ID, T.ROW)
Incoming Parameters
FILE.NAME -The name of the file that is going to extracted as CSV file thro DW.EXPORT, For example, CATEG.ENTRY, RE.CRF.MBGL
(where MBGL is GL report head), CUSTOMER etc.,
R.DW.EXPORT - Holds the whole DW.EXPORT record (dynamic array) for the file in FILE.NAME
Outgoing Parameters
T.ROW -Holds the actual records with field values in the same order that are defined in FILED.NAME of DW.EXPORT record and these
should be separated by FM marker.
Note: By default, this will extract all the fields, whether you define the fields in FIELD.NAME or not in DW.EXPORT,
unless we have any process routine to extract some specific fields values.
Other Records
AC.BALANCES.TYPE
The AA contract exposures are extracted from the t24 application EB.CONTRACT.BALANCES, in that it is bucketed into various AA Soft Asset
types. These Asset types could be that of Principle asset type and Interest/Charge/Fees/Commission Asset types. During Data load in Insight
Risk, System loads the consolidated soft asset Exposures, both Principal and Interest together and updates the transaction table. For the con-
solidation process, Parent Consolidation column is used to consolidate the AA Principle asset type Exposures at the time of data load process.
AA soft asset types are extracted from AC.BALANCE.TYPE and updated in the Asset_Types_T24 table. IN DW.EXPORT, AC.BALANCE.TYPE
record is used to interface the soft asset types into Asset-types-t24 table.
‘PVAD.POST.PROV.AMT’ is the field which is holds the Provision amount in contract currency for each contract if it has provision. And the
‘PVAD.POST.PROV.AMT.LCY’ is holds the Local currency value for provisions if contract currency is not same as reporting currency (Foreign
currency contracts) else it holds null value.
Using Automated tool, user can automatically configure for all the records in DW.EXPORT file along with the RE.EXTRACT.PARAMS and
RE.RETURN.EXTRACT files for the GL and the PL CRB reports extracts and setup the same in DW.EXPORT after installing the DW product
and DW Export utility in T24 system.
The automated tool posts set of questions to the user who is configuring the DW Export utility. Based on the inputs given by the user, the sys-
tem configures the DW.EXPORT records along with RE.EXTRACT.PARAMS and RE.RETURN.EXTRACT records for CRB reports of both GL
and PL reports.
This automated configuration utility should only be run from T24 mainline prompt in classic session by typing ˜DW.EXTRACT.CONFIGURE”.
Prerequisites
Make sure that the following files which were released as part of DW product are authorised.
BNK-./DwExport-BNK,GB1-./DwExport-GB1 where BNK and GB1 are the company mnemonics and then a "-" followed by the path.
Separate each company’s path with a comma (,). Underscore (_) is not allowed in the path.
8. Enter the Year and Month based on which CATEG.ENTRY and ACCT.ACTIVITY records will be extracted?
CATEG.ENTRY will be extracted for the year and month (if monthly extract is specified) specified and ACCT.ACTIVITY will be
extracted for the specified year and month and the previous month.
Enter a valid YEAR and MONTH value, the format is YYYYMM, it will not be validated here.
Enter how CATEG.ENTRY records should be extracted? Full extract, Month data or Daily data
Enter 1 for full extract (all the CATEG.ENTRY files will be extracted).
Enter 2 for month extract (CATEG.ENTRY generated in the YEAR and MONTH specified will be extracted).
Configuring DW.EXPORT...
Note: Two CRB reports need to be configured for Insight - one is for General Ledger and another one is for Profit
and Loss report. Both should be included in DW.EXPORT. For example: MBGL -GL Report, PMPL - P&L Report.
In an Extended Multi Company Setup, there can be multiple lead companies, and each lead company can have multiple books. In such a setup,
if the records of different lead companies and their books are to be extracted as one consolidated file, the Merge Company option can be used.
However, this is possible only for lead companies that share the CUSTOMER and CURRENCY files.
Users are allowed to configure the MERGE.COMPANY even if the currency files are not shared and all the LEAD.COMPANY have the same
local currency (base currency). MERGE.COMPANY cannot be configured if the LOCAL.CURRENCY across the LEAD.COMPANY is different.
Users are allowed to configure the MERGE.COMPANY if the LOCAL.CURRENCY is the same while the CURRENCY.COMPANY is not same as
the Master Company. A consolidated report can be generated for all the lead companies if the base/local currency are same across the lead com-
panies and all the respective currency rates are equal. The currency rates are loaded from a single data source.
In order to consolidate the records of companies US0010001 (BNK) and US001002 (BK2), the merge company’s id is specified in MERGE.CO-
MPANY field of DW.EXPORT.PARAM record.
It can be seen that the CURRENCY and CUSTOMER files are shared between these companies, which is a pre-requisite for Merge Company
extraction.
After specifying the MERGE.COMPANY in DW.EXPORT.PARAM, the DW.EXPORT.SERVICE will be run to extract the CSV files.
Note: If the Merge Company has got branches, the Branch Mnemonic will be updated in BRANCH_CO_MNE field
and the primary lead company mnemonic will be updated in the LEAD_CO_MNE.
The Parallel Extraction process is performed in DW.EXPORT by running multiple BATCH processes for data extraction in parallel.
Configure DW.EXPORT
A set of new fields are introduced in DW.EXPORT application which are used for the Parallel Extraction.
The following table explains the new fields introduced in DW.EXPORT that are used for Parallel Extraction
BULK_NO This field is used to specify number of records to be extracted in one single session, so that sequential file I/O will be
reduced to improve the performance
BBL_CALL This field is used to call the BATCH.BUILD.LIST to flush out the values in memory and the record ids bulked will be
written into JOB.LIST physically.
Specify the Table for Parallel Extraction in the DATA field of the BATCH record..
When multiple T24 tables are to be specified in one BATCH record, the table names can be specified in a list record of &SAVEDLISTS& and
the list name can be specified in the DATA field.
Once the BATCH records are configured, corresponding TSA.SERVICE records has to be created for the BATCH records, and SERV-
ICE.CONTROL field should set to START.
Configure BATCH.NEW.COMPANY
Every new BATCH record that has been created should have a corresponding record in BATCH.NEW.COMPANY application. The name of this
record should be identical to that of the BATCH without the Mnemonic. The system will use these records to create branch specific records
when new branches are added to the system.
1. Daily extract is configured for STMT.ENTRY, CATEG.ENTRY and RE.CONSOL.SPEC.ENTRY in DW.EXPORT. However, the cor-
responding CSV files do not have any data. What could be the possible cause?
The field ENT.TODAY.UPDATE in the SYSTEM record of ACCOUNT.PARAMETER is set to NO. This must be changed to ˜YES” in
order to enable the updates to related tables that support daily extraction.
2. Does DW process clear the data in the export directory (configured in FILE.PATHNAME) automatically?
Yes, whenever the DW process starts, the primary step is to clear the export directory. Hence no manual intervention is required.
3. What is the performance benchmark of DW jobs, what is the idle number of agents which should be assigned to the DW.E-
XPORT.SERVICE?
The DW extraction process has been fine tuned out of box. When the extraction is performed as part of COB, it would use the agents
that are allocated to the COB, and takes the nominal time to complete the process.
When the process is disabled from COB and the online service DW.EXPORT.SERVICE is chosen for extraction, the bank IT team has
to test the performance of DW.EXPORT.SERVICE by assigning the number of agents from a minimum to the maximum value, which is
normally used by COB.
Based on the results, the bank IT team would need to setup the performance benchmark of service specific to the bank.
4. Does assigning the more number of agents to DW service causes the locking issues?
No, it will not cause any locking issues.
5. Does running the DW service causes any locking issues on application files while the bank is started operating the business?
No, it will not cause any locking issues on applications files. Therefore it can be run in parallel.
6. Is there a way to reset the DW.EXPORT.SERVICE when it stops abnormally, which avoids the process of restoring the pre data back
up?
Note: This is not the recommended option to the Bank; only experienced users can perform these steps as
incorrect usage can result in data loss.
7. Is there any process available to reconcile the HASH_TOTAL.csv file without doing manual check up on HASH_TOTAL figures?
Currently, there is no automated process to reconcile the HASH_TOTAL figures, it must be done manually.
9. Typing each FIELD.NAME is too tedious, while creating a record in DW.EXPORT. Is there a short-cut to include all field names in the
table?
Use the keyword ˜SYSTEM FIELD in the FIELD.NAME field and commit the record, the system will automatically include all the
fields in the extraction.
12. Is it possible to have different set of extracts from the same table?
Yes, from R11 onwards, different sets of extract are possible for the same table. The record in DW.EXPORT should be of the format
<table name>-<user defined string>.For example: ACCOUNT-HIS
14. Is it possible to extract data from a New Table in T24 using DW.EXPORT?
a. Yes, data can be extracted from any table in T24. The New Table should be specified as a new record in
DW.EXPORT application. Follow these steps to add a new table.
b. Create a new record in DW.EXPORT with the new tables name
i. Commit the Record and run the extraction process. The table will be extracted as a separate CSV file.
15. My DW.EXPORT process terminated abnormally. On restart, “_ Fatal error in OPF error NO FILE.CONTROL RECORD” error
occurred. How to fix this?
There could be many causes for abnormal process termination. This should be analysed by Temenos Support to identify the root cause
and provide a solution. Log an issue with TCSP Portal
16. Is it possible to automate transfer of extracts to Insight server using SFTP? If yes, how?
Yes, the transfer can be automated using SFTP. A sample SFTP routine is provided by Temenos. However, this is not a complete ftp
solution; hence the bank should own the routine and can do any changes to that routine to incorporate more securities in the transfer
process.
17. When the extract is transferred from T24 to Insight server, which transfer mode should be chosen for “ASCII or Binary"?
While transferring data from T24 to Insight Server using FTP, always ˜Binary mode” should be used.
18. Under debug mode, when tSA agents are started, it stops without extracting any data. Which are the areas that need to check?
Check if TAKEOVER field is set or not for all the record configured in DW.EXPORT
Check if the BATCH job DW.EXPORT.INFO is set to ˜D in BATCH record DW.EXPORT.DETAILS for COB or DW.E-
XPORT.SERVICE for online service.
19. DW.EXPORT extracted all data but HASH_TOTAL.csv is missing. What could have gone wrong?
The DW.EXPORT.SERVICE could have stopped abnormally. In such case, refer question 7 to reset the DW.EXPORT.SERVICE and
run the service again.
20. RE.CRF record(s) is correctly setup as per the user guide. But the extract file is not being generated. What could be the root cause?
21. Is it possible to use Daily extract for any T24 Table that has got a Concat file?
Yes, by specifying a valid CONCAT file for the table, daily extract can be performed for any T24 table.
•Note:Two CRB reports need to be configured for Insight “ one is for General Ledger and another one is for Profit
and Loss report. Both should be included in DW.EXPORT. For example MBGL “ GL Report, PMPL “ P&L Report.
…Where XXX is the company mnemonic and YYYY is the standard T24 report available in RE.STAT.REPORT.HEAD
application.