What you'll do:
The Data Engineer will play a vital role for Digital Finance and Innovation (DFI) team wherein the candidate will contribute in terms of creating the commercial data platform for DFI, data management, data pipeline creation, ensuring data quality & integrity, support data analytics, ensure performance and scalability of current and future data models. This role will be part of DFI wherein the person need to closely work with group's data architecture & data platform team, product owner team and project management team to ensure we develop DFI commercial data platforms in accordance with group's best practices.
• Responsible for Creation of ETL Pipelines in Pyspark and SQL in Azure and Snowflake.
• Responsible for designing and building new Data Models and optimizing existing data models.
Want more jobs like this?
Get Data and Analytics jobs in Pune, India delivered to your inbox every week.
• Exploit elasticity and agility of the cloud.
• Ownership of physical Data models of serving layer
• Responsible and accountable for pipelines reliability and availability.
• Responsible of Data analysis for troubleshooting and exploration
• Understand the meaning, domain and the context of the data.
• Documentation of the code
• DevOps and code migration to higher environment
• Collaborate with Product Owner and Scrum master to understand the requirement and convert the requirement into technology deliverables
• Assist other team members and ensure team's success.
Qualifications:
- BE in Computer Science, Electrical , Electronics/ Any other equivalent Degree
- 5- 9 Years of exp in pyspark or python technology
Skills:
PySpark, Spark SQL, Serverless SQL pool, Dedicated SQL pools, Data warehousing, Data modeling, Azure Cloud
Team player, collaboration, good communication skills