Scribd
Upload
28 views2 pages

Job Information - Data Engineer

Uploaded by

vigneshvkyyyy
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
28 views2 pages

Job Information - Data Engineer

Uploaded by

vigneshvkyyyy
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 2

Job Information

Data Engineer II (Level 5)

Key job responsibilities

• Develop end to end scalable data infrastructure and data pipelines


• Develop data products, deploy highly performant solutions, build data infrastructure leveraging
AWS services (such as EC2, Redshift, EMR, Lambda, Quicksight etc.)
• Improve existing solutions and recommend data architecture to improve scale, quality,
timeliness, coverage, monitoring and security.
• Develop new data models and end to data pipelines.
• Lead design reviews for other Data Engineers on the team and actively participate in design
reviews of related tech products.
• Provide technical and thought leadership for Data Engineering and Business Intelligence
• Create and implement Data Governance strategy for mitigating privacy and security risks
• Design, implement, and support a platform providing secured access to large datasets.
• Interface with auditing and controllership customers, gathering requirements and delivering
complete data solutions.
• Develop ETL pipeline that links various datasets that could serve the analysis objectives in the
most efficient way
• Analyze and solve problems at their root, stepping back to understand the broader context.

Basic qualifications

• 3+ years of data engineering experience


• Experience with data modeling, warehousing and building ETL pipelines
• Experience with SQL
• Experience in at least one modern scripting or programming language, such as Python, Java,
Scala, or NodeJS
• Design & Implementation of automated data contract and data quality enforcement
mechanisms
• Expertise at least in 1 data Orchestration tool
• Working experience in CDK
• Experience in discovering business requirements and creating insightful dashboards tailored for
various levels of the organization, including senior leadership.
• The successful candidate will be able to deliver products that exceed customer satisfaction,
ensure data accuracy and completeness, automate manual tasks and develop efficient data
pipelines.

Preferred qualifications

• Bachelor's degree
• Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
• Experience as a data engineer or related specialty (e.g., software engineer, business intelligence
engineer, data scientist) with a track record of manipulating, processing, and extracting value
from large datasets
• Experience building/operating highly available, distributed systems of data extraction, ingestion,
and processing of large data sets
• Experience with distributed systems as it pertains to data storage and computing
• Knowledge of software engineering best practices across the development lifecycle, including
agile methodologies, coding standards, code reviews, source management, build processes,
testing, and operations
• Proven success in communicating with users, other technical teams, and senior management to
collect requirements, describe data modeling decisions and data engineering strategy
• Strong understanding and experience with DBMS internals.
• Strong understanding of system performance and scaling
• Knowledge on LLM and Gen Ai.

You might also like