Source to Target Data Mapping Document

1. Introduction

This document details how data fields from the source system (SharePoint) map to
the corresponding fields in the target system (new MEA database). It includes
transformation rules, data type conversions, and any data cleansing or enrichment
logic.

2. Source System: SharePoint

● The source system is the existing MEA application built on SharePoint.
● Data resides in a SQL Server database (SharePoint content database).
● A separate analysis of the SharePoint database schema will be required to get
the source table and column names. This document will use generic source
names like [SourceTable] and [SourceColumn].
3. Target System: New MEA Database
● The target system is a new database built on MS SQL Server.
● The database schema is defined in the "MEA Data Dictionary.xlsx - Entities.csv"
file.
4. Data Mapping

The following table provides a detailed mapping of source to target data fields.

Target Target Target Source Source Source Transf Notes

Entity Attribu Data Table Colum Data ormati
te Type n Type on
Rules

Party PartyID INT [Sourc [Sourc INT Direct

eTable: eColu mappin
UserPr mn: g
ofiles] UserID]

Name VARCH [Sourc [Sourc NVARC Direct

AR(255 eTable: eColu HAR mappin
) UserPr mn: g
ofiles] FullNa
me]
 Email VARCH [Sourc [Sourc NVARC Direct
AR(255 eTable: eColu HAR mappin
) UserPr mn: g
ofiles] Email]

PartyT INT [Sourc [Sourc NVARC Map

ypeID eTable: eColu HAR UserTy
UserPr mn: pe to
ofiles] UserTy PartyT
pe] ypeID
(lookup
table in
target)

Phone VARCH [Sourc [Sourc NVARC Direct

AR(20) eTable: eColu HAR mappin
UserPr mn: g
ofiles] WorkP
hone]

Status VARCH [Sourc [Sourc NVARC Map

AR(50) eTable: eColu HAR Status
UserPr mn: to
ofiles] Status] Party
Status
(lookup
table in
target)

PartyR PartyR INT [Sourc [Sourc INT Direct

ole oleID eTable: eColu mappin
UserRo mn: g
les] UserRo
leID]

PartyID INT [Sourc [Sourc INT Direct

eTable: eColu mappin
UserRo mn: g
les] UserID]

RoleTy INT [Sourc [Sourc NVARC Map

peID eTable: eColu HAR RoleNa
UserRo mn: me to
les] RoleNa RoleTy
me] peID
 (lookup
table in
target)

Discipli INT [Sourc [Sourc NVARC Map

neID eTable: eColu HAR Discipli
UserRo mn: ne to
les] Discipli Discipli
ne] neID
(lookup
table in
target)

StartD DATE [Sourc [Sourc DATETI Conver

ate eTable: eColu ME t to
UserRo mn: DATE
les] StartD
ate]

EndDat DATE [Sourc [Sourc DATETI Conver

e eTable: eColu ME t to
UserRo mn: DATE
les] EndDat
e]

PartyR PartyR INT [Sourc [Sourc INT Direct

elation elation eTable: eColu mappin
ship shipID UserRe mn: g
lations Relatio
hips] nshipID
]

FromP INT [Sourc [Sourc INT Direct

artyRol eTable: eColu mappin
eID UserRe mn: g
lations FromU
hips] serRole
ID]

ToPart INT [Sourc [Sourc INT Direct

yRoleID eTable: eColu mappin
UserRe mn: g
lations ToUser
hips] RoleID]
 Relatio INT [Sourc [Sourc NVARC Map
nshipT eTable: eColu HAR Relatio
ypeID UserRe mn: nshipT
lations Relatio ype to
hips] nshipT Relatio
ype] nshipT
ypeID
(lookup
table in
target)

Discipli Discipli INT [Sourc [Sourc INT Direct

ne neID eTable: eColu mappin
Discipli mn: g
nes] Discipli
neID]

Discipli VARCH [Sourc [Sourc NVARC Direct

neNam AR(255 eTable: eColu HAR mappin
e ) Discipli mn: g
nes] Discipli
neNam
e]

Descri TEXT [Sourc [Sourc NTEXT Direct

ption eTable: eColu mappin
Discipli mn: g
nes] Descri
ption]

Manag INT [Sourc [Sourc INT Direct

erRoleI eTable: eColu mappin
D Discipli mn: g
nes] Manag
erRoleI
D]

Compe Compe INT [Sourc [Sourc INT Direct

tency tencyI eTable: eColu mappin
D Compe mn: g
tencies Compe
] tencyI
D]

Compe VARCH [Sourc [Sourc NVARC Direct

 tencyN AR(255 eTable: eColu HAR mappin
ame ) Compe mn: g
tencies Compe
] tencyN
ame]

Descri TEXT [Sourc [Sourc NTEXT Direct

ption eTable: eColu mappin
Compe mn: g
tencies Descri
] ption]

Profici INT [Sourc [Sourc NVARC Map

encyLe eTable: eColu HAR Profici
velID Compe mn: encyLe
tencies Profici vel to
] encyLe Profici
vel] encyLe
velID
(lookup
table in
target)

Discipli INT [Sourc [Sourc INT Direct

neID eTable: eColu mappin
Compe mn: g
tencies Discipli
] neID]

PartyC PartyC INT [Sourc [Sourc INT Direct

ompet ompet eTable: eColu mappin
ency encyID UserCo mn: g
mpete UserCo
ncies] mpete
ncyID]

PartyID INT [Sourc [Sourc INT Direct

eTable: eColu mappin
UserCo mn: g
mpete UserID]
ncies]

Compe INT [Sourc [Sourc INT Direct

tencyI eTable: eColu mappin
D UserCo mn: g
 mpete Compe
ncies] tencyI
D]

LevelA VARCH [Sourc [Sourc NVARC Direct

chieve AR(50) eTable: eColu HAR mappin
d UserCo mn: g
mpete LevelA
ncies] chieve
d]

Certific INT [Sourc [Sourc INT Direct

ationID eTable: eColu mappin
UserCo mn: g
mpete Certific
ncies] ationID
]

Validat INT [Sourc [Sourc INT Direct

edBy eTable: eColu mappin
UserCo mn: g
mpete Validat
ncies] edBy]

Certific Certific INT [Sourc [Sourc INT Direct

ation ationID eTable: eColu mappin
Certific mn: g
ations] Certific
ationID
]

Certific VARCH [Sourc [Sourc NVARC Direct

ationN AR(255 eTable: eColu HAR mappin
ame ) Certific mn: g
ations] Certific
ationN
ame]

Issued INT [Sourc [Sourc INT Direct

ByID eTable: eColu mappin
Certific mn: g
ations] Issued
ByID]

Issued DATE [Sourc [Sourc DATETI Conver

 Date eTable: eColu ME t to
Certific mn: DATE
ations] Issued
Date]

Expiry DATE [Sourc [Sourc DATETI Conver

Date eTable: eColu ME t to
Certific mn: DATE
ations] Expiry
Date]

Linked INT [Sourc [Sourc INT Direct

Compe eTable: eColu mappin
tencyI Certific mn: g
D ations] Compe
tencyI
D]

StatusI INT [Sourc [Sourc INT Direct

D eTable: eColu mappin
Certific mn: g
ations] StatusI
D]

Task TaskID INT [Sourc [Sourc INT Direct

eTable: eColu mappin
Tasks] mn: g
TaskID]

TaskNa VARCH [Sourc [Sourc NVARC Direct

me AR(255 eTable: eColu HAR mappin
) Tasks] mn: g
TaskNa
me]

Descri TEXT [Sourc [Sourc NTEXT Direct

ption eTable: eColu mappin
Tasks] mn: g
Descri
ption]

Assign INT [Sourc [Sourc INT Direct

edEmpl eTable: eColu mappin
oyeeID Tasks] mn: g
Assign
 edToU
serID]

Requir INT [Sourc [Sourc INT Direct

edCom eTable: eColu mappin
petenc Tasks] mn: g
yID Requir
edCom
petenc
yID]

StatusI INT [Sourc [Sourc INT Direct

D eTable: eColu mappin
Tasks] mn: g
StatusI
D]

StartD DATE [Sourc [Sourc DATETI Conver

ate eTable: eColu ME t to
Tasks] mn: DATE
StartD
ate]

DueDat DATE [Sourc [Sourc DATETI Conver

e eTable: eColu ME t to
Tasks] mn: DATE
DueDat
e]

Project INT [Sourc [Sourc INT Direct

ID eTable: eColu mappin
Tasks] mn: g
Project
ID]

PartyA PartyA INT [Sourc [Sourc INT Direct

ssignm ssignm eTable: eColu mappin
ent entID PartyA mn: g
ssignm PartyA
ents] ssignm
entID]

PartyR INT [Sourc [Sourc INT Direct

oleID eTable: eColu mappin
PartyA mn: g
 ssignm PartyR
ents] oleID]

TaskID INT [Sourc [Sourc INT Direct

eTable: eColu mappin
PartyA mn: g
ssignm TaskID]
ents]

Compe INT [Sourc [Sourc INT Direct

tencyI eTable: eColu mappin
D PartyA mn: g
ssignm Compe
ents] tencyI
D]

Assign INT [Sourc [Sourc INT Direct

edBy eTable: eColu mappin
PartyA mn: g
ssignm Assign
ents] edByID
]

Project Project INT [Sourc [Sourc INT Direct

ID eTable: eColu mappin
Project mn: g
s] Project
ID]

Project VARCH [Sourc [Sourc NVARC Direct

Name AR(255 eTable: eColu HAR mappin
) Project mn: g
s] Project
Name]

Discipli INT [Sourc [Sourc INT Direct

neID eTable: eColu mappin
Project mn: g
s] Discipli
neID]

StartD DATE [Sourc [Sourc DATETI Conver

ate eTable: eColu ME t to
Project mn: DATE
s] StartD
 ate]

EndDat DATE [Sourc [Sourc DATETI Conver

e eTable: eColu ME t to
Project mn: DATE
s] EndDat
e]

AuditL AuditID INT [Sourc [Sourc INT Direct

og eTable: eColu mappin
AuditL mn: g
ogs] AuditID
]

EntityT VARCH [Sourc [Sourc NVARC Direct

ype AR(255 eTable: eColu HAR mappin
) AuditL mn: g
ogs] EntityT
ype]

EntityI INT [Sourc [Sourc INT Direct

D eTable: eColu mappin
AuditL mn: g
ogs] EntityI
D]

Action VARCH [Sourc [Sourc NVARC Direct

AR(255 eTable: eColu HAR mappin
) AuditL mn: g
ogs] Action]

Perfor INT [Sourc [Sourc INT Direct

medBy eTable: eColu mappin
AuditL mn: g
ogs] Perfor
medBy
]

Timest DATETI [Sourc [Sourc DATETI Direct

amp ME eTable: eColu ME mappin
AuditL mn: g
ogs] Timest
amp]

Integra SyncID INT [Sourc [Sourc INT Direct

 tionSyn eTable: eColu mappin
c Integra mn: g
tionSyn SyncID
cs] ]

EntityT VARCH [Sourc [Sourc NVARC Direct

ype AR(255 eTable: eColu HAR mappin
) Integra mn: g
tionSyn EntityT
cs] ype]

EntityI INT [Sourc [Sourc INT Direct

D eTable: eColu mappin
Integra mn: g
tionSyn EntityI
cs] D]

LastSy DATETI [Sourc [Sourc DATETI Direct

ncTime ME eTable: eColu ME mappin
stamp Integra mn: g
tionSyn LastSy
cs] ncTime
stamp]

SyncSt VARCH [Sourc [Sourc NVARC Direct

atus AR(50) eTable: eColu HAR mappin
Integra mn: g
tionSyn SyncSt
cs] atus]

ErrorD TEXT [Sourc [Sourc NTEXT Direct

etails eTable: eColu mappin
Integra mn: g
tionSyn ErrorD
cs] etails]

5. Lookup Table Mapping

The following tables describe how values in the source system will be mapped to the
lookup tables in the target system.
● PartyType Mapping
 Source Value Target Value Target Value
([SourceTable: (PartyType.PartyTypeNa (PartyType.PartyTypeID)
UserProfiles]. me)
[SourceColumn:
UserType])

Employee Employee 1

Contractor Contractor 2

● RoleType Mapping

Source Value Target Value Target Value

([SourceTable: (RoleType.RoleTypeNam (RoleType.RoleTypeID)
UserRoles]. e)
[SourceColumn:
RoleName])

Manager Manager 1

Engineer Engineer 2

● Discipline Mapping

Source Value Target Value Target Value

([SourceTable: (Discipline.DisciplineNa (Discipline.DisciplineID)
UserRoles]. me)
[SourceColumn:
Discipline])

Electrical Electrical 1

Mechanical Mechanical 2
● ProficiencyLevel Mapping

Source Value Target Value Target Value

([SourceTable: (ProficiencyLevel.Profici (ProficiencyLevel.Profici
Competencies]. encyLevelName) encyLevelID)
[SourceColumn:
ProficiencyLevel])

Basic Basic 1

Intermediate Intermediate 2

Advanced Advanced 3

● RelationshipType Mapping
| Source Value ([SourceTable: UserRelationships].[SourceColumn:
RelationshipType]) | Target Value (RelationshipType.RelationshipTypeName) |
Target Value (RelationshipType.RelationshipTypeID) |
| --- | --- | --- |
| Reports To | Reports To | 1 |
| Manages | Manages | 2 |
||||
● Status Mapping

Source Value ([SourceTable: Target Value (Party.Status)

UserProfiles].[SourceColumn: Status])

Active Active

Inactive Inactive

5. Data Cleansing and Transformation Rules

● Data Type Conversions: Convert data types as necessary (e.g., NVARCHAR to
INT, DATETIME to DATE).
● Data Truncation: Truncate data that exceeds the length of the target field.
● Data Standardization: Standardize data formats (e.g., phone numbers,
addresses).
● Data Cleansing: Remove invalid or inconsistent data.
● Null Value Handling: Define how null values in the source system will be handled
in the target system (e.g., default values, null).
● Unstructured Data: Unstructured data, such as uploaded certificates, will be
migrated to the appropriate location in the target system. The specific
transformation will depend on how these files are stored and referenced in
SharePoint.
6. Assumptions
● The source SharePoint database schema is available and accessible for analysis.
● All necessary lookup tables exist in the target database.
● Data quality issues in the source system will be addressed as part of the data
cleansing process.
7. Next Steps
● Perform a detailed analysis of the source SharePoint database schema.
● Finalize the source table and column names in this document.
● Validate the mapping rules with business stakeholders.
● Develop ETL processes (SSIS packages) based on this mapping document.