We are seeking a Lead Data Software Engineer to join our team.
In this role, you will apply your knowledge of data engineering to design and maintain scalable data solutions. You will collaborate with clients to ensure data security and operational excellence while utilizing platforms such as Amazon Web Services and Databricks.
#LI-DNI
Responsibilities
- Design extensible data models with adaptable schemas
- Implement data storage systems leveraging Amazon S3 and Delta tables
- Apply principles of data security and privacy across all initiatives
- Use Spark and Databricks with PySpark for efficient data processing
- Oversee pipeline orchestration using Amazon Managed Workflows for Apache Airflow
- Adhere to operational excellence strategies throughout all processes
- Collaborate with team members to foster teamwork and knowledge exchange
- Communicate clearly and effectively with stakeholders in English
- Maintain thorough documentation and structured project tracking
- Take responsibility for assigned projects and deliver within deadlines
Want more jobs like this?
Get Data and Analytics jobs in Entroncamento, Portugal delivered to your inbox every week.
- 5+ years of relevant experience in data software engineering
- Proven leadership background in managing cross-functional teams
- Background in data modeling and storage-focused projects
- Proficiency in Amazon Web Services usage
- Competency in Databricks and PySpark applications
- Understanding of pipeline orchestration with Airflow
- English proficiency at B2 level
- Amazon Managed Workflows for Apache Airflow certification
- Competitive compensation depending on experience and skills
- Variety of projects within one company
- Being a part of a project following engineering excellence standards
- Individual career path and professional growth opportunities
- Internal events and communities
- Flexible work hours