We are seeking a Chief Data Software Engineer to join our team.
In this role, you will apply your expertise in data engineering to develop and oversee efficient data solutions. You will collaborate with clients to uphold data security and operational efficiency while working with tools like Amazon Web Services and Databricks.
#LI-DNI
Responsibilities
- Design extensible schema for data models
- Implement data storage systems using Amazon S3 and Delta tables
- Apply principles of data security and privacy across all initiatives
- Utilize Spark and Databricks with PySpark for processing large datasets
- Oversee pipeline orchestration with Amazon Managed Workflows for Apache Airflow
- Ensure compliance with operational excellence standards
- Engage with team members to share ideas and responsibilities
- Maintain clear communication with stakeholders in English
- Keep organized documentation and closely track projects
- Take responsibility for projects and meet firm timelines
Want more jobs like this?
Get Software Engineering jobs in Entroncamento, Portugal delivered to your inbox every week.
- At least 7 years of experience in data software engineering
- Demonstrated leadership ability in cross-functional teams
- Background in data modeling and storage solutions
- Proficiency in Amazon Web Services
- Skills in Databricks and PySpark
- Understanding of pipeline orchestration processes with Airflow
- English language proficiency at a B2 level
- Amazon Managed Workflows for Apache Airflow certification
- Competitive compensation depending on experience and skills
- Variety of projects within one company
- Being a part of a project following engineering excellence standards
- Individual career path and professional growth opportunities
- Internal events and communities
- Flexible work hours