Lead SW Engineer - Java/Python, Opensearch, Hadoop, Docker, Kuberenetes

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

We are seeking a highly skilled and experienced Lead Software Engineer to join Real Time Data Analytics team solving real time data problem. The ideal candidate will possess a strong background in data pipeline development with strong programming and architecture design experience in hybrid infrastructure. This role will involve working on various data engineering tasks, including data collection, data parsing and pipeline coding with detail visualization understanding.

Key Responsibilities

• Develop and maintain data pipelines for data collection (logs, application data etc.)  and parsing.
• Create and manage visualization dashboards using tools such as Splunk, Elastic, Superset, etc.
• Write efficient and scalable code in Python and Java to support data engineering projects.
• Utilize SQL for data analytics and reporting tasks.
• Design and develop solutions using OpenSearch/Elastic technologies.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions.
• Ensure data integrity, quality, and security throughout the data lifecycle.

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications

Basic Qualifications:-

• 13+ years of relevant work experience with a Bachelor’s Degree or at least 10 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 4 years of work experience with a PhD, OR 13+ years of relevant work experience.

Preferred Qualifications:-

• Bachelor’s degree in Computer Science, Engineering or any related field with minimum 13 years of work experience
• 10+ years of experience in Python and Java programming.
• 5+ years of experience in OpenSearch/Elastic engineering and development.
• 5+ years of experience in Cloud Applications.
• 3+ years of experience with visualization dashboard tools (Splunk, Elastic, Superset, etc.).
• 10+ years of experience working in a Linux or Unix environment.
• 10+ years of experience in data analytics, including proficiency in SQL.
• 1+ year of experience in Rust programming is highly preferred.
• Strong problem-solving skills with attention to detail.
• Excellent Communication and Collaboration skills.
• Experience with Cloud-based Data Engineering solutions is preferred.
• Experience with Big Data Technologies such as Hadoop, Kafka and Spark are preferred
• Knowledge in Generative AI or Generative AI tools is preferred.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.