POSITION AVAILABLE

Data Engineer, IBM Corporation, Plano, TX: Gather data from internal or external sources regardless of format (database, flat files, csv, delta, Parque) and ingest that data into whatever system of environment the company is using. Execute validation of the incoming data to identify the type of data and the issues with the data as a whole or elements of the data. Transform that data into features that are more useful for the downstream elements that depend on those features, which could be models or dashboard or other data dependent applications. Productionize the process for the data to be available at scale and make it available in a feature store, database, or other construct to low latency access to it. Build and support all the elements in the workflow using various tools, schedulers, data monitors and trackers. Write production quality code that is well structured and document for easy maintenance and transfer to other developers and maintainers. Work closely with other skilled practitioners across many skill sets. Work closely with data architects to determine what data management systems are appropriate. Work with data scientists to determine which data are needed for analysis. Work effectively with business analysts to understand how best to support their data needs and assure accuracy in the results that they are reporting. Wrestle with problems associated with database integration and messy, unstructured data sets. Utilize: PySpark/Python, Cloud Services, SQL, Data Visualization, Machine Learning, Data Warehouse and Data Architecture. Required: Bachelor's degree or equivalent in Computer Science, Data Science, Engineering or related and one (1) year of experience as a Data Engineer or related. One (1) year of experience must include utilizing PySpark/Python, Cloud Services, SQL, Data Visualization, Machine Learning, Data Warehouse and Data Architecture. $124,836.00 to 138,100.00 per year. Full time. WJ171a.