What great looks like in this role

Our ideal candidate is someone who enjoys designing, building and delivering complex systems. You love coding and revel in finding elegant solutions to difficult problems. You understand the challenges of handling data at scale and are always looking for opportunities to leverage open-source tools to accelerate development. You are passionate about learning new technologies, are team orientated and a strong communicator.

Objectives of the role

• Design, develop and deliver scalable, robust and highly re-usable components in the cloud
• Participate in all aspects of development from design to delivery, acting as both developer and component lead
• Interact closely with data users, including data engineers and data scientists to understand & refine requirements
• Develop code, write unit tests and conduct code reviews
• Debug and troubleshoot problems in code and data pipelines
• Evaluate and recommend tools, technologies, processes and reference architectures
• Identify areas for process improvement and automation
• Collaborate closely with developers and provide mentorship as appropriate
• Work in Agile development environment, attending daily stand-up meetings and delivering incremental improvements.

• Bachelor's degree in computer science or engineering or a related field
• 5+ Years of experience programming in Python or Java.
• 3+ Years of experience in design and development of data integration and ETL
• 3+ years of experience working with a scalable data warehouse
• Strong Expertise in writing and understanding complex SQL queries

• Experience working with big data platforms
• Knowledge of data warehousing concepts and best practices.
• 2 year developing ELT/ETL pipelines using software like Apache Airflow, AWS Glue, or Informatica.
• Streaming experience using streaming technologies such as Apache Kafka, Apache Spark Streaming or Apache Flink
• Knowledge about CI/CD practices
• Experience working on a Cloud platform