We're looking for a Lead Data Software Engineer who's passionate about building efficient data integration and processing pipelines to support enterprise data products, driving innovation in architecture, data modeling, and development leadership.
Our client is migrating from Azure Synapse DWH to a modern data platform architecture leveraging Databricks with DLT and Dremio for advanced semantics and experimentation. The initiative also involves data remodeling into domain-driven design and rationalizing PowerBI reports with new platform integration.
#LI-DNI
Responsibilities
- Implement architecture and low-level feature design
- Guide and lead a development team through all project phases
- Lead ETL design, data modeling, and implementation activities
- Coordinate code management, release management, and deployment activities
- Write performant ETL pipelines using Databricks Medallion architecture and DLT
- Integrate ETL pipelines with custom Data Quality components
- Configure Dremio and implement the required semantic layer for migrated PowerBI reports
Want more jobs like this?
Get Data and Analytics jobs in Río Grande, Mexico delivered to your inbox every week.
- 5+ years of working experience in software engineering or data engineering roles
- Skills in leading development teams, with over 1 year of experience
- Expertise in Azure Databricks, including DLT and Unity Catalog
- Proficiency in PySpark or a combination of Spark experience and strong Python fundamentals
- Background in Azure Synapse and transitioning data platforms to modern architectures
- Understanding of ETL processes, data integration, and domain-driven design principles
- Familiarity with configuring and implementing semantic layers, particularly using Dremio
- Capability to optimize and manage large-scale data processing pipelines
- English proficiency at a B2+ level
- Showcase of expertise in Dremio for ad-hoc analytics and experimentation
- Qualifications in implementing Data Quality modules within pipeline architectures
- Understanding of PowerBI report rationalization and repointing
- Career plan and real growth opportunities
- Unlimited access to LinkedIn learning solutions
- International Mobility Plan within 25 countries
- Constant training, mentoring, online corporate courses, eLearning and more
- English classes with a certified teacher
- Support for employee's initiatives (Algorithms club, toastmasters, agile club and more)
- Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
- Flexible work schedule and dress code
- Collaborate in a multicultural environment and share best practices from around the globe
- Hired directly by EPAM & 100% under payroll
- Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
- Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
- 13 % employee savings fund, capped to the law limit
- Grocery coupons
- 30 days December bonus
- Employee Stock Purchase Plan
- 12 vacations days plus 4 floating days
- Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)
- Monthly non-taxable amount for the electricity and internet bills
By applying to our role, you are agreeing that your personal data may be used as in set out in EPAM's Privacy Notice and Policy.