Data Engineering Consultant
Leading organisations - corporations, non-profits, government departments, look to Avanade to help them make the most of their investment in Microsoft and to push the boundaries of digital innovation. The result? Interesting work that is well supported, always evolving and sure to keep you engaged and interested. Together we go beyond.
Come join us
As a Data Engineering Consultant at Avanade, you will collect, aggregate, store, and reconcile data in support of Client business decisions. You will help design and build data pipelines, data streams, reporting tools, information dashboards, data service APIs, data generators and other end-user information portals and insight tools. You will be a critical part of the data supply chain, ensuring that stakeholders can access and manipulate data for routine and ad hoc analysis to drive business outcomes using Advanced Analytics
Want more jobs like this?
Get jobs delivered to your inbox every week.
What you'll do
• Translate business requirements to technical solutions leveraging strong business acumen.
• Analyze current business practices, processes and procedures as well as identifying future business opportunities for leveraging Microsoft Azure Data & Analytics PaaS services
• Support the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments
• Deliver architectures for transformations and modernizations of enterprise data solutions using Azure cloud data technologies
• Design and Build Modern Data Pipelines and Data Streams
• Design and Build Data Service APIs
• Develop and maintain data warehouse schematics, layouts, architectures and relational/non-relational databases for data access and Advanced Analytics
• Expose data to end users using PowerBI, Azure API Apps or any other modern visualization platform or experience
• Implement effective metrics and monitoring processes
• Travel as needed.
Skills & Experiences
About you
• You have demonstrated experience with turning business use cases and requirements to technical solutions.
• you likely possess a Bachelor's degree in Computer Science, Information Technology, Business or another related field. An equivalent combination of education and experience will also suffice.
• you likely have 2-4+ years of relevant professional experience
Technical Characteristics desired for this role
• Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows.
• The ability to apply such methods to solve business problems using one or more Azure Data and Analytics services in combination with building data pipelines, data streams, and system integration.
• Mastery of .NET C# and T-SQL and familiarity with Python and Spark is required
• Knowledge of Azure Data Factory, Azure Data Lake, Azure Databricks, Azure SQL DW, Azure SQL, and Azure App Service
• Azure HDInsight + Spark, Azure Cosmos DB, Azure Stream Analytics, Azure IOT Hub, and Azure Event Hub is a plus
• preparing data for Data Science and Machine Learning
• Experience preparing data for use in Azure Machine Learning is a plus.
• Demonstrated experience preparing data and building data pipelines for AI Use Cases (text, voice, image, etc.)
• Designing and building Data Pipelines using streams of IOT data.
• Knowledge of Lambda and Kappa architecture patterns.
• Knowledge of Master Data Management (MDM) and Data Quality tools and processes
• Strong team collaboration and experience working with remote teams.
• Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code fundamentals.
• Working experience with Visual Studio, PowerShell Scripting, and ARM templates
• Knowledge of Jupyter Notebooks or Databricks Notebooks for Python development is a plus
• Experience with Git and Azure DevOps is a must.
Certifications
• Microsoft Certified: Azure Data Engineer Associate
Enjoy your career
Some of the best things about working at Avanade
* Opportunity to work for Microsoft's Global Alliance Partner of the Year (14 years in a row), with exceptional development and training (minimum 80 hours per year for training and paid certifications)
* Real-time access to technical and skilled resources globally
* Dedicated career advisor to encourage your growth
* Engaged and helpful coworkers genuinely interested in you
Find out more about some of our benefits [1] here.
A great place to work
As you bring your skills and abilities to Avanade, you'll get distinctive experiences, limitless learning, and ambitious growth in return. As we continue to build our diverse and inclusive culture, we become even more innovative and creative, helping us better serve our clients and communities. You'll join a community of smart, supportive collaborators to lift, mentor, and guide you, and to lean on your expertise. You get a company purpose-built for business-critical, leading-edge technology solutions, committed to improving the way humans work, interact, and live. It's all here, so take a closer look!
Together we do what matters.
We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Visit our [2] Inclusion & Diversity page.
Create a future for our people that focuses on
• Expanding your thinking
• Experimenting courageously
• Learning and pivoting
Inspire greatness in our people by
• Empowering every voice
• Encouraging boldness
• Celebrating progress
Accelerate the impact of our people by
• Amazing the client
• Prioritizing what matters
• Acting as one
Learn more
To learn more about the types of projects our Analytics team works on, check out the following case study:
* [3] HUB International Clients get predictive insights for better business decisions- Avanade
Interested in knowing what's going on inside Avanade? Check out our blogs:
* [4] Avanade Insights - exchange ideas that drive tomorrow's innovation
* [5] Inside Avanade - explore what life is like working at Avanade
References
Visible links
1. https://www.avanade.com/en-gb/career/benefits
2. https://www.avanade.com/en-us/about-avanade/inclusion-and-diversity
3. http://file:///C:/Users/razan.katesh/Documents/Avanade%20UAE%20phone%20screen%20-%20Joseph%20Haddad.docx
4. https://www.avanade.com/en/blogs/avanade-insights
5. https://www.avanade.com/en/blogs/inside-avanade