Scribd
Upload
21 views2 pages

Shubham Resume 23 - 09 - 2024-12-1-2

Shubham Mali is a Data Engineer with over a year of experience in developing data pipelines using various tools such as ADF, Synapse, and Snowflake, and is proficient in Python and SQL. He has a strong educational background with a B.Tech degree and holds a certification as a Microsoft Fabric Analytics Engineer. Currently working at PibyThree Consulting Services, he has experience in managing data workflows, optimizing data storage, and implementing data processing solutions.

Uploaded by

khuranasameer771
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
21 views2 pages

Shubham Resume 23 - 09 - 2024-12-1-2

Shubham Mali is a Data Engineer with over a year of experience in developing data pipelines using various tools such as ADF, Synapse, and Snowflake, and is proficient in Python and SQL. He has a strong educational background with a B.Tech degree and holds a certification as a Microsoft Fabric Analytics Engineer. Currently working at PibyThree Consulting Services, he has experience in managing data workflows, optimizing data storage, and implementing data processing solutions.

Uploaded by

khuranasameer771
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 2

Shubham Mali

DATA ENGINEER

Profile Summary
Data Engineer with over 1 year of experience in developing and managing data pipelines using ADF, Synapse, MS
Databricks, MS Fabric, and Snowflake. Proficient in Python, SQL, Snowpark, PySpark, Spark SQL, and data warehousing
for scalable processing and storage. Knowledgeable in Medallion Architecture and Slowly Changing Dimensions.
Passionate about delivering scalable data solutions and driving business insights through data.

SKILLS

• Data Warehousing • Medallion Architecture


• MS Azure
• Cloud Computing • SCD types
• Snowflake
• Databricks • Python Programming • ETL/ELT Processes
• MS Fabric • SQL • Azure Synapse
• MS SQL Server • Pyspark • Azure Data Factory
• Snowpark • Azure Storage

Certifications
• Microsoft Fabric Analytics Engineer - Verify

Soft Skills
• Communication
• Team Work • Dynamic Frameworks
• Problem Solving

Education
• B.TECH 9.28/10 2019 – 2023
• Percentage : 80.71%
• SKN Sinhgad College of Engineering Pandharpur

Languages
• English
• Marathi
• Hindi
P r o f e s s i o n a l Wo r k E x p e r i e n c e

PibyThree Consulting Services Pvt. Ltd.


Associate Software Engineer : October2023 – Current

MS Azure:
• Utilized Azure Data Factory to develop and orchestrate data workflows, including data flows for ETL processes.
• Managed Azure Synapse Analytics, leveraging both serverless and dedicated SQL pools for scalable data
processing and analysis.
• Worked with Azure SQL Database for efficient application data storage and retrieval, ensuring high availability
and performance.
• Integrated Azure Blob Storage and Azure Data Lake Storage for optimized data storage solutions, facilitating
effective data management and accessibility.

Snowflake:
• Managed account and role permissions to ensure secure access and compliance.
• Designed and implemented various table types and views to optimize data storage and retrieval.
• Developed dynamic stored procedures using SQL and Snowpark Python for efficient data processing.
• Loaded data from multiple stages, including internal and external stages, to facilitate seamless data integration.
• Integrated external access via Snowflake's External Network Access for secure data sharing and collaboration.
• Knowledge of Snowflake macro-partitions, Streams and tasks.

MS Databricks:
• Developed dynamic data pipelines using PySpark and Spark SQL to load and transform Salesforce data.
• Implemented dynamic architecture for SCD, aggregations, transformations, and fact tables.
• Maintained Medallion architecture (Bronze, Silver, Gold) for data quality and lineage

MS Fabric :
• Built dynamic data pipelines similar to MS Databricks, with additional integration of Azure Data Factory for
orchestration and workflow automation.
• Applied the same architecture principles for SCD, aggregations, transformations, and fact tables, ensuring data
consistency and quality.

MS SQL Server:
• Created dynamic and complex stored procedures for automatic generation of merge and insert statements
using metadata.
• Conducted testing and validation of data to ensure accuracy and consistency within the database.
• Optimized stored procedures for performance and scalability, enhancing overall database efficiency.

Contacts
Mobile: +91 7558216770
Email: [email protected]
LinkedIn:
Current Address: Pune, Maharashtra, India
Permanent Address: At post Anjansonda, Ta. Bhoom, Dist. Dharashiv, Maharashtra, India

You might also like