The Consulting Data Engineer role requires experience in both traditional warehousing technologies (e.g. Teradata, Oracle, SQL Server) and modern database/data warehouse technologies (e.g., AWS Redshift, Azure Synapse, Google Big Query, Snowflake), as well as expertise in ETL tools and frameworks (e.g. SSIS, Azure Data Factory, AWS Glue, Matillion, Talend), with a focus on how these technologies affect business outcomes. This person should have experience with both on-premise and cloud deployments of these technologies and in transforming data to adhere to logical and physical data models, data architectures, and engineering a dataflow to meet business needs. This role will support engagements such as data lake design, data management, migrations of data warehouses to the cloud, and database security models, and ideally should have experience in a large enterprise in these areas.
Want more jobs like this?
Get Data and Analytics jobs in Gurgaon, India delivered to your inbox every week.
Essential Functions
•
Develops high performance distributed data warehouses, distributed analytic systems and cloud architectures
•
Participates in developing relational and non-relational data models designed for optimal storage and retrieval
•
Develops, tests, and debugs batch and streaming data pipelines (ETL/ELT) to populate databases and object stores from multiple data sources using a variety of scripting languages; provide recommendations to improve data reliability, efficiency and quality
•
Works along-side data scientists, supporting the development of high-performance algorithms, models and prototypes
•
Implements data quality metrics, standards, guidelines; automates data quality checks / routines as part of data processing frameworks; validates flow of information
•
Ensures that Data Warehousing and Big Data systems meet business requirements and industry practices including but not limited to automation of system builds, security requirements, performance requirements and logging/monitoring requirements
Experience as a key player in developing an enterprise data warehouse
Knowledge, Skills, and Abilities
•
Ability to translate a logical data model into a relational or non-relational solution
•
Expert in one or more of the following ETL tools: SSIS, Azure Data Factory, AWS Glue, Matillion, Talend, Informatica, Fivetran
•
Hands on experience in setting up End to End cloud based data lakes
•
Hands-on experience in database development using views, SQL scripts and transformations
•
Ability to translate complex business problems into data-driven solutions
•
Working knowledge of reporting tools like Power BI , Tableau etc
•
Ability to identify data quality issues that could affect business outcomes
•
Flexibility in working across different database technologies and propensity to learn new platforms on-the-fly
•
Strong interpersonal skills
•
Team player prepared to lead or support depending on situation"