Introduction
At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk

Your Role and Responsibilities

• Leading across both BaaS and EaaS. Driving the future roadmap - how can we improve? How can we extend what we are doing to handle use cases beyond C2J and Code Explanation?
• Keep abreast of technological advances in the area of benchmarking and evaluation in GenAI and adopt our framework and processes to take advantage.
• You will be responsible to incrementally improving our measurement and analysis over time.
• As a senior leader, you will contribute to the design of the evaluation and benchmarking strategy and provide ongoing analysis and metrics on current performance. This may include proving updates to senior management.
• You will be responsible for advancing techniques used to evaluate performance as well as metrics.
• Drive efficiencies in the current process.
• Be able to co-ordinate work across the teams in Haifa doing the evaluators, the language specialists, and teams in UK and US.

• 10+ Years of experience
• Experience with software build technologies
• Experience in creating, modernising and supporting robust CI/CD pipelines
• Strong Automation and CI/CD skill set (Eg:Tekton)
• Strong hands-on experience in Java
• Hand on experience on Golang or Python
• Experience on Containerisation and Kubernetes (Some knowledge of deployments, Statefulsets, PVC, etc)
• Experience in developing automation strategies and designing automated systems that meet the specific requirements of the organization.
• Understanding of test automation frameworks and integrations with multiple tools.
• Strong communication, logical thinking, and analytical skills.
• Experience setting architecture direction and driving improvements into the technology/processes,"

• Z experience - Cobol, JCL, CICS, DB2
• Agile Development Model awareness & experience (edited)