Scribd
Upload
142 views

Data Engineering Exp PDF

The document provides a job description for a Data Engineer Expert position. The primary responsibilities of the role include building massive data reservoirs and data processing systems, ensuring data is accessible and optimized for business use, and assisting data scientists. The ideal candidate has 7 years of experience in fields like computer science or software engineering, expertise in programming languages like Python and databases like Hadoop and SQL Server, and experience designing data pipelines and processing large datasets.

Uploaded by

abdallah
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
142 views

Data Engineering Exp PDF

The document provides a job description for a Data Engineer Expert position. The primary responsibilities of the role include building massive data reservoirs and data processing systems, ensuring data is accessible and optimized for business use, and assisting data scientists. The ideal candidate has 7 years of experience in fields like computer science or software engineering, expertise in programming languages like Python and databases like Hadoop and SQL Server, and experience designing data pipelines and processing large datasets.

Uploaded by

abdallah
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 2

Privacy Level: NOT TO BE SHOWN OUTSIDE JTG GROUP

Career and Manpower Planning Author: GQA&P Team


Job Description Form SS/HR-QP05-F02 Rev.: 1.1 Aug. 2013

Job Description
Revision no.: Last Revision date: / /2020
Job Details:
Position Name: Data Engineer Expert
FT Code:
Unit: Information Technology and Networks
Directorate: CITNO Deputy
Department: Data & System Architecture Department
Reporting to: Data Engineering Team Leader
Range of Subordinates' number: 0
Mission:
(Define the primary mission of the job in one or two sentences)
- Responsible for understanding business needs & rules in terms of reporting and analytics
and for translating these needs into comprehensive data definitions, data models and data
quality requirements.
- day to day job, the data engineer relies on a thorough understanding of the business
processes and its underlying data in order to translate raw data into actionable information
and insights.
Key Accountabilities:
(Describe the important end result of the job, WHAT & WHY. Suggested 8 – 16 ideal responsibility)
- Build massive reservoirs for big data, develop, construct, test and maintain architectures
such as databases and large-scale data processing systems.
- Build and maintain in depth knowledge of the data and its availability and use in a business
context .
- Master data ingestion techniques (functional mapping source-target) and structure the data
into comprehensive models (logical data models) .
- Make sure data is easily accessible, works smoothly, and their goal is optimizing the
performance of their company’s big data ecosystem .
- Assure that data processes are auditable and legal, and quality and security compliant,
- Can assist Data Scientists (DS) in preparing and processing the data sets they need to run
their experiments.
- Responsible for contributing to the selection of fit to purpose tools supporting reporting and
analytics capabilities .
Qualifications & Competencies:
(Define the needed education, experience, knowledge & skills necessary to perform job)
Education & Experience:
- Computer Science, Software engineering or MIS BA degree.
- total experience 7 years
- Experience with object-oriented/object function scripting languages: Python, Java,, Scala is
amust .
- Clear hands-on mastery in big database systems - Hadoop ecosystem,and realtional
database system(Oracle , Sql Server)
- Create and maintain optimal data pipeline architecture,
- Assemble large, complex data sets that meet functional / non-functional business
requirements.
- experience building/operating highly available, distributed systems of data extraction,
ingestion, and processing of large data sets.

Page 1/2
Privacy Level: NOT TO BE SHOWN OUTSIDE JTG GROUP
Career and Manpower Planning Author: GQA&P Team
Job Description Form SS/HR-QP05-F02 Rev.: 1.1 Aug. 2013

Competencies:
- Working with Etl&Elt tools like (ODI , INFORMATICA) is plus .
- Telecom industry knowledge is preferable .
- Experience with stream-processing systems: Storm, Spark-Streaming,kafka,flume
- Following Agile development process

Approval and acknowledgment:


Title Date Signature Remarks
HR Development
/ /
Directorate:
Concerned HRBP: / /
Direct Manager of the
/ /
position:
Concerned N-1
/ /
Manager /Director:
Concerned Employee: / /

Page 2/2

You might also like