We are searching for a Lead Data Software Engineer to maintain and enhance our current data systems, implement upcoming changes, and develop improvements for our Data Platform to meet increasing consumption demands.
The ideal candidate will possess expertise in handling complex datasets and experience with the Azure cloud stack.
#LI-DNI
Responsibilities
- Maintain and enhance existing data systems
- Develop improvements for the existing Data Platform
- Implement upcoming modifications for growing consumption needs and ingestion
- Manage complex datasets, including the creation of new ones from scratch
- Collaborate on complex projects with senior team members, with a focus on adding large datasets
- Adapt to emerging tools and methodologies in the technological landscape
Want more jobs like this?
Get jobs in Entroncamento, Portugal delivered to your inbox every week.
- 5+ years of experience in Data Software Engineering
- 1+ years of relevant leadership experience
- Proficiency in PySpark
- Knowledge of the Azure cloud stack, including Azure Data Factory, Azure Kubernetes Services, and Azure Key Vault
- Proficiency in Azure Databricks
- Capability to work with large and complex datasets
- Background in Azure Event Hub, Azure Storage Account, and Azure ML Studio
- Familiarity with Terraform, Grafana, and RESTful Systems
- Understanding of Data Vault Modeling, Data Mesh, and Domain Driven Design/Architecture
- Competence in Microservice Architecture
- Skills in collaborative work with various stakeholders
- Fluent English communication skills at a B2+ level
- Background in Azure Analytics Engineering
- Understanding of DevOps practices
- Competitive compensation depending on experience and skills
- Variety of projects within one company
- Being a part of a project following engineering excellence standards
- Individual career path and professional growth opportunities
- Internal events and communities
- Flexible work hours