Scribd Logo
Upload

Welcome to Scribd!

  • 4 views

    Job Information - Data Engineer

    Uploaded by

    vigneshvkyyyy

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd

    Job Information - Data Engineer

    Uploaded by

    vigneshvkyyyy
    4 views2 pages

    Original Title

    Job Information_Data Engineer

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    4 views2 pages

    Job Information - Data Engineer

    Uploaded by

    vigneshvkyyyy

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    of 2

    Job Information

    Data Engineer II (Level 5)

    Key job responsibilities

    • Develop end to end scalable data infrastructure and data pipelines


    • Develop data products, deploy highly performant solutions, build data infrastructure leveraging
    AWS services (such as EC2, Redshift, EMR, Lambda, Quicksight etc.)
    • Improve existing solutions and recommend data architecture to improve scale, quality,
    timeliness, coverage, monitoring and security.
    • Develop new data models and end to data pipelines.
    • Lead design reviews for other Data Engineers on the team and actively participate in design
    reviews of related tech products.
    • Provide technical and thought leadership for Data Engineering and Business Intelligence
    • Create and implement Data Governance strategy for mitigating privacy and security risks
    • Design, implement, and support a platform providing secured access to large datasets.
    • Interface with auditing and controllership customers, gathering requirements and delivering
    complete data solutions.
    • Develop ETL pipeline that links various datasets that could serve the analysis objectives in the
    most efficient way
    • Analyze and solve problems at their root, stepping back to understand the broader context.

    Basic qualifications

    • 3+ years of data engineering experience


    • Experience with data modeling, warehousing and building ETL pipelines
    • Experience with SQL
    • Experience in at least one modern scripting or programming language, such as Python, Java,
    Scala, or NodeJS
    • Design & Implementation of automated data contract and data quality enforcement
    mechanisms
    • Expertise at least in 1 data Orchestration tool
    • Working experience in CDK
    • Experience in discovering business requirements and creating insightful dashboards tailored for
    various levels of the organization, including senior leadership.
    • The successful candidate will be able to deliver products that exceed customer satisfaction,
    ensure data accuracy and completeness, automate manual tasks and develop efficient data
    pipelines.

    Preferred qualifications

    • Bachelor's degree
    • Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
    • Experience as a data engineer or related specialty (e.g., software engineer, business intelligence
    engineer, data scientist) with a track record of manipulating, processing, and extracting value
    from large datasets
    • Experience building/operating highly available, distributed systems of data extraction, ingestion,
    and processing of large data sets
    • Experience with distributed systems as it pertains to data storage and computing
    • Knowledge of software engineering best practices across the development lifecycle, including
    agile methodologies, coding standards, code reviews, source management, build processes,
    testing, and operations
    • Proven success in communicating with users, other technical teams, and senior management to
    collect requirements, describe data modeling decisions and data engineering strategy
    • Strong understanding and experience with DBMS internals.
    • Strong understanding of system performance and scaling
    • Knowledge on LLM and Gen Ai.

    You might also like