Job Description
Title - Python/Pyspark Developer
We are seeking a Senior Data Engineer with extensive experience in data integration analytical skills and data management.
The ideal candidate will have a strong background in Spark Python Scala and Unix along with hands-on development experience.
Exposure to object storage as well as a good understanding of data governance lineage and metadata management is essential.
Familiarity with GL finance and regulatory reporting will be considered a significant plus.
Key Responsibilities:
- Design and develop data integration workflows using PySpark Optimize data processes in SQL Server and manage database performance.
- Utilize Autosys for job scheduling and monitoring.
- Collaborate with cross-functional teams to implement data governance and lineage solutions.
- Develop and maintain stored procedures and perform ETL operations.
- Leverage Spark and object storage technologies for big data solutions.
- Ensure compliance with regulatory reporting requirements.
Want more jobs like this?
Get jobs in Atlanta, GA delivered to your inbox every week.
Qualifications:
- Bachelor s degree in computer science Information Technology or a related field.
- 12+ years of experience in data engineering with a focus on Spark Python and Scala.
- Strong knowledge of Unix/Linux operating systems.
- Proficiency in developing stored procedures and ETL processes.
- Understanding of data governance frameworks and metadata management.
- Familiarity with GL finance and regulatory reporting is a plus.
- Excellent problem-solving and communication skills.
Life at Capgemini
Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:
- Flexible work
- Healthcare including dental, vision, mental health, and well-being programs
- Financial well-being programs such as 401(k) and Employee Share Ownership Plan
- Paid time off and paid holidays
- Paid parental leave
- Family building benefits like adoption assistance, surrogacy, and cryopreservation
- Social well-being benefits like subsidized back-up child/elder care and tutoring
- Mentoring, coaching and learning programs
- Employee Resource Groups
- Disaster Relief
Disclaimer
Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.
Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please get in touch with your recruiting contact.
Click the following link for more information on your rights as an Applicant http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law