Sr.Data Engineer

IBM's global internal real estate portfolio,
including properties, space, leases, energy
consumption, construction/renovation projects,
and environmental compliance.
Responsibilities:
• Manage integrations for data ingestion
from multiple source systems via APIs,
queries, and Apache Spark and Airflow
workflows. Launch Spark jobs in Airflow
as needed.
• Support data transformations and
aggregations in a Cloud Object Storage
(COS) integration zone, and subsequent
data feeds to a DB2 warehouse.
• Maintain a Cirrus platform hosting Cloud
Object Storage, along with inbound &
outbound data flows. Initiate activities
such as opening firewall flows, defining
entitlements, and managing roles & user
access as needed. Identify and perform
other activities required to ensure
reliable operation of the cluster,
• Identify and promptly address issues
with data and integrations. Implement
and optimize monitoring, and
troubleshoot errors through in-depth
reviews of logs, code, data, and
integration components.
• Document and share data architectures
and flows (including schemas, tables,
queries, and scheduled activities) with
data analysts and Cognos developers.
• Develop new capabilities for data
ingestion and transformation as needed.
Create algorithms, develop new transfers
using Spark/Airflow, APIs, SQL, etc.
Perform comprehensive testing of individual components as well as end-toend
solution.

Required education

Bachelor's Degree

Preferred education

Master's Degree

Required technical and professional expertise

5+ years of experience with managing
data warehouses and integration
solutions
• API integration experience
• Apache Spark and Airflow experience
• SQL development, relational database
table structure, and database design
• Expertise in working with structured and
unstructured data
• Excellent communication skills (written
and verbal). Able to clearly communicate
with leadership and colleagues about
technical capabilities, limitations, issues,
and recommendations.
• Highly organized, detail oriented,
independent, and resourceful.
• Able to manage complex technical
projects with diverse global stakeholders
and detailed, interdependent
requirements
• Experience with Agile practices and
associated tools, including Jira

Preferred technical and professional experience

Cognos Analytics experience, including
creating/maintaining data modules and
developing reports & dashboards
• Javascript development experience
• BS or BA in a related discipline

ABOUT BUSINESS UNIT

The IBM Finance organization is responsible for driving enterprise performance and transformation. We are the financial stewards of IBM, delivering IBM's financial strategy, developing new business models, and mitigating enterprise risk. Do you have a passion for creating business value? Join our team in accounting, financial planning, pricing, business controls, tax, treasury, business development (acquisitions & divestitures), and global financing.

YOUR LIFE @ IBM

In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.

Being an IBMer means you'll be able to learn and develop yourself and your career, you'll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.

Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.

Are you ready to be an IBMer?

ABOUT IBM

IBM's greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.

Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we're also one of the biggest technology and consulting employers, with many of the Fortune 50 companies relying on the IBM Cloud to run their business.

At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it's time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.

OTHER RELEVANT JOB DETAILS

When applying to jobs of your interest, we recommend that you do so for those that match your experience and expertise. Our recruiters advise that you apply to not more than 3 roles in a year for the best candidate experience. For additional information about location requirements, please discuss with the recruiter following submission of your application.