We are seeking a dynamic Senior Data DevOps Engineer to become an integral part of our Data Consumption (End-to-End) team.
In this role, you will primarily engage with Databricks, Unity Catalog, SQL, Python, and CI/CD tools. The focus is on crafting and implementing trusted access and governance frameworks, elevating audit logging traceability, and merging efforts with domain experts to forge innovative data solutions.
#LI-DNI
Responsibilities
- Implement and sustain Databricks Unity Catalog with detailed authorization settings for global access management
- Deploy traceable and auditable data access systems using advanced platform logging techniques
- Automate recurrent data-related tasks using CI/CD pipelines
- Facilitate seamless integration with other development teams
- Design, construct, and manage Python and SQL code for trustworthy data access solutions
- Engage with domain experts to incorporate business logic into solution designs
Want more jobs like this?
Get jobs in Entroncamento, Portugal delivered to your inbox every week.
- 3+ years of experience in Data DevOps
- Proficiency in Databricks, Unity Catalog, SQL, Python
- Hands-on proficiency in using CI/CD tools, with a preference for Azure DevOps
- Understanding of Azure Data Platform and fundamental cloud concepts including data storage, compute, and security
- Knowledge in design patterns, microservice architecture, network authentication, security systems
- Familiarity with managing large-scale data projects and adherence to data engineering best practices
- Effective teamwork capabilities for smooth implementation coordination
- Capability to devise solutions meeting business needs and ensuring compatibility with existing systems
- Collaboration skills with domain specialists to embed business logic into designs
- Agile and Scrum methodology experience
- Strong communication skills for effective stakeholder engagement
- Proactive and service-oriented mindset with a focus on continuous improvement
- Competitive compensation depending on experience and skills
- Variety of projects within one company
- Being a part of a project following engineering excellence standards
- Individual career path and professional growth opportunities
- Internal events and communities
- Flexible work hours