JD DP IN SE 03 ETL DWH Dev Limendo India
JD DP IN SE 03 ETL DWH Dev Limendo India
JD DP IN SE 03 ETL DWH Dev Limendo India
• Design data storage systems, collect, process and transform data for
storage. Involve in data collection decisions, apply best practices in
managing data, make choices based on type of data for appropriate
storage, processing and retrieval. Ensure infrastructure availability and
optimization.
• Build/Design or Create Data Warehouse or Data Lakes, manage
heterogenous data across various sources, analyze data, uncover insights
and enable use of data for further processing, identify missing data and
take suitable action. Classify, clean and process data for use in
downstream processes and applications. Ensure data quality.
• Perform tests and troubleshoot Data Warehouse or Data Lakes, take
action to continuously improve data collection, data processing, data
transformation and data storage required for business. Perform
exploratory data analysis as required.
• Create data visualizations for defined audience, enable sense making and
augment use of data for business decision making and identify data
monetization opportunities.
• Build/develop, modify/extend downstream applications that generate
data, automate application testing and embrace tasks and assignments
across the software life cycle and data life cycle.
• Contribute to development and engineering of existing products, deliver
mission critical software across multiple industry verticals. Work with
partners, collaborators and cross functional, distributed teams in an agile
setting. Champion innovation for our products and customers through
participation in ideation, prototyping and validating product fit
• Design, develop and modify data systems, using scientific analysis and
mathematical models to predict and measure outcome and
consequences of design
• Develop and direct data system testing and validation procedures,
programming, and documentation, analyze information to determine,
recommend, and plan data system reports and layouts, and modifications
• Build the infrastructure required for optimal extraction, transformation,
and loading of data from a wide variety of data sources using SQL and
AWS ‘big data’ technologies
• Writing Complex SQL queries, sub-queries and complex joins
• Azure/AWS Pipeline knowledge to develop ETL for data movement,
experience to map the source to target rules and fields (Redshift or
Snowflake)
• Implement natural keys, surrogate keys, SCD, SCD2 into the data
warehouse to support history, automated triggers to take snapshots,
history maintenance, automated triggers to take backup and re-store in
case of failures
• Translate business requirements, design jobs for data migration from
various data sources, RDBMS design, development and performance
tuning, experience with MS SQL Server 2014 database technologies and
ETL best practices with MS SQL Server
• Using Business Intelligence Development Studio to build SSIS packages
• Excellent troubleshooting & optimization skills: interpreting ETL logs,
performing data validation, dissecting SSIS code, understanding the
benefits and drawbacks of parallelism, experience with change data
capture, using expressions, scoping of variables, commonly used
transforms, event handlers and logging providers, ability to understand
and optimize the surrogate key generation and inconsistent data type
handling.
Nice to have