We are looking for an exceptional Lead Data DevOps Engineer to join our Data Consumption (End-to-End) team and play a vital role.
In this role, you will interact mainly with Databricks, Unity Catalog, SQL, Python, and CI/CD tools. Your primary responsibilities will include developing and deploying trusted access and governance frameworks, enhancing audit logging processes, and collaborating with domain experts to develop cutting-edge data solutions.
#LI-DNI
Responsibilities
- Sustain and enhance Databricks Unity Catalog with intricate authorization settings for comprehensive global access management
- Establish systems for traceable and auditable data access utilizing sophisticated platform logging methods
- Streamline repetitive data-related operations through CI/CD pipelines
- Ensure smooth coordination with other development teams
- Develop and maintain Python and SQL codebases for reliable data access systems
- Collaborate with domain experts to integrate business logic into solution frameworks
Want more jobs like this?
Get jobs in Entroncamento, Portugal delivered to your inbox every week.
- 5+ years of experience in Data DevOps engineering
- 1+ years of applicable leadership experience
- Competency in Databricks, Unity Catalog, SQL, Python
- Proficiency with CI/CD tools, with an emphasis on Azure DevOps
- Familiarity with Azure Data Platform and core cloud concepts including data storage, compute, and security
- Understanding of design patterns, microservice architecture, network authentication, and security systems
- Background in managing large-scale data projects and following data engineering best practices
- Skills in effective teamwork for seamless execution collaboration
- Flexibility to develop solutions that meet business requirements and integrate with existing systems
- Expertise in collaborating with domain specialists to incorporate business logic into designs
- Experience with Agile and Scrum methodologies
- Strong communication capabilities for efficient stakeholder interaction
- A proactive and service-focused approach emphasizing continual enhancement
- Competitive compensation depending on experience and skills
- Variety of projects within one company
- Being a part of a project following engineering excellence standards
- Individual career path and professional growth opportunities
- Internal events and communities
- Flexible work hours