Summary

As a Data Engineer you will work with Architects and builds data intensive products, platforms, and leveraging data engineering best practices and strength in data ingestion, extraction, and highly scalable data management systems.

About the Role

Where data is the primary challenge (quantity of data, the complexity of data, or the speed at which it is changing), focusing on increasing business value, enhancing BR decision-making and enabling a data-centric culture by

• designing and implementing data-intensive products, platforms, pipelines, and systems
• sharing data-intensive expertise, tools, and techniques
• implementing and improving the health, security, integrity, and quality of our interconnected data ecosystem

• Build and deploy production systems for scientists who have high expectations for quality, turnaround, performance and reliability.
• Create and promote reusable and interoperable systems and the efficient reuse of software and data between disparate systems within BR.
• Create or enhance a reusable, reliable, observable platform for ingesting a large number of heterogeneous data sets from numerous disparate sources, including all of the major cloud providers
• Integrate professional data engineering practices as appropriate into the front lines of BR science groups and inspire others within the engineering community to emulate these practices.
• Ensure adherence to Novartis global Information Security and Quality standards and policies for all products/services.
• If applicable, ensure Regulatory Compliance (e.g. GLP & GCP) standards and policies for GxP products/services.

• Significant experience building commercial-quality cloud-based solutions at scale, and leading teams in the design and implementation of creative solutions to difficult computational problems
• Strength in programming in scalable data processing engines, data ingestion, modeling, extraction, metadata, and highly scalable data management systems
• Significant experience building ETL pipelines using cloud-centric technologies
• Interest in intersection between the life sciences and computer science
• Excellent interpersonal skills with the ability to create and influence initiatives in a matrix environment that lead to new levels of organizational impact
• Self-directed and capable of working effectively in a dynamic environment
• Able to debug independently
• Able to work independently while consulting and informing the broader team
• Linux, shell scripts / bash
• Javascript / Typescript / Node.js
• Fluency with Python a plus

• Experience following standard SDLC practices, including build platforms (Jenkins) and source repositories (Git)
• Experience building restful APIs
• Experience using browser developer tools, such as Postman
• Networking (AWS and traditional)
• AWS technologies such as EC2, S3, Lambda
• Basic statistics / numeral literacy
• Nice to have:
  • Databricks and Pyspark
  • Snowflake