We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have proven experience managing data engineering jobs in a big data environment, such as the Cloudera Data Platform.
You will be responsible for designing, building, maintaining and supporting big data platforms.
#LI-DNI
Responsibilities
- Manage the daily operations of our big data platform, ensuring high availability, reliability and performance
- Proactively monitor platform services, components and clusters to identify and resolve potential issues
- Oversee platform configuration, upgrades and patching, keeping all services up-to-date
- Collaborate with technical teams to ensure seamless deployment and adoption of new solutions for data ingestion, processing, and workflows
- Maintain comprehensive documentation of platform configuration, troubleshooting steps and incident resolution
- Continuously monitor for and address platform security vulnerabilities, implementing patching strategies to maintain a secure environment
- Develop automation scripts to streamline administrative tasks, monitor platform health and ensure operational consistency
- Ensure smooth IT solution operations and service levels, and provide production support
Want more jobs like this?
Get jobs in Singapore delivered to your inbox every week.
- Bachelor's degree in Information Technology or a related field
- 9+ years of extensive experience in software development
- Hands-on experience and deep understanding of Cloudera Data Platform components, including HDFS, YARN, Hive, Spark, Impala, Ranger, as well as operating systems, security, and networking
- Practical experience with monitoring tools such as Cloudera Manager, Zabbix, Grafana, Splunk, and Syslog-NG
- Familiarity with middleware applications (e.g., Informatica, Denodo) and proficiency in scripting languages (Bash, Python, or Shell) for automation tasks
- Ability to effectively troubleshoot complex technical issues, ranging from system resource problems to application stack traces
- Excellent communication skills to facilitate effective collaboration with cross-functional teams
- Ability to perform effectively under pressure and manage critical incidents
- Experience with cloud technologies, particularly AWS or Azure
- Experience implementing highly available, performant, and secure systems across various data center configurations, including hybrid cloud environments
- Cloudera Certified Administrator certification or a similar credential
- By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023
- Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
- You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
- We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
- At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us
- EPAM is a leading global provider of digital platform engineering and development services. EPAM has been expanding in Singapore since 2013 and delivering the best solutions to our customers. As a recognized leader, EPAM Singapore achieved Great Place to Work® Certification in 2023 and is committed to providing our team with inspiring careers.
- You will have the opportunity to work with fellow talented technologists and accelerate your career by participating in our numerous upskilling, training, and certification programs. That is why EPAM Singapore was awarded Gold for Best In-House Certification Programmes in the Employee Experience Awards 2023 and Silver in the SkillsFuture Employers Awards 2022 for our efforts in championing employees' skills development and building a lifelong learning culture at the workplace. You can also look forward to developing holistically with the multiracial festivals and various wellness and cultural activities organized by our passionate colleagues here.