As a Senior Data Engineer, you will play a leading role in designing, building, and optimizing our data infrastructure, ensuring that it supports the advanced analytics need of the bank. You will oversee a team of data engineers, working closely with data analysts, DevOps team, infrastructure engineers, and other stakeholders to deliver high-quality data solution.
#LI-DNI
Responsibilities
- Lead the design, development and implementation of data pipelines, transformations and aggregations to support analytics and machine learning initiatives
- Optimize Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch
- Design and deploy data engineering solutions on OpenShift using containerization and orchestration techniques
- Implement and maintain CI/CD pipelines for data engineering workflows, ensuring platform stability and efficient resource utilization
- Stay abreast of emerging technologies and best practices in data engineering and DevOps
- Collaborate with cross-functional teams to define data requirements and translate them into robust and scalable solutions
- Mentor and guide junior team members, fostering a culture of continuous learning and innovation
Want more jobs like this?
Get jobs in Singapore delivered to your inbox every week.
- Bachelor's degree in Computer Science, Data Engineering, Information Technology, or a related field
- 7+ years of experience as a Data Engineer with expertise in Hadoop, Spark, and related technologies (HDFS, Hive, Ranger)
- Strong proficiency in Spark, Python, Scala, or Java for data engineering tasks
- Experience with containerization (Docker, Kubernetes) and orchestration platforms like OpenShift
- Knowledge of DevOps practices, CI/CD pipelines, and automation tools (Jenkins, Ansible, BitBucket)
- Strong problem-solving, troubleshooting, and communication skills
- Ability to work effectively in a fast-paced, collaborative environment
- Experience with monitoring and logging tools (Grafana, Prometheus, Splunk) is a plus
- Experience with cloud platforms (AWS, Azure, GCP) is a plus
- By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023
- Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
- You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
- We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
- At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us
- EPAM is a leading global provider of digital platform engineering and development services. EPAM has been expanding in Singapore since 2013 and delivering the best solutions to our customers. As a recognized leader, EPAM Singapore achieved Great Place to Work® Certification in 2023 and is committed to providing our team with inspiring careers.
- You will have the opportunity to work with fellow talented technologists and accelerate your career by participating in our numerous upskilling, training, and certification programs. That is why EPAM Singapore was awarded Gold for Best In-House Certification Programmes in the Employee Experience Awards 2023 and Silver in the SkillsFuture Employers Awards 2022 for our efforts in championing employees' skills development and building a lifelong learning culture at the workplace. You can also look forward to developing holistically with the multiracial festivals and various wellness and cultural activities organized by our passionate colleagues here.