Job Purpose
The position of the RTOC Engineer will be responsible for designing, building, and maintaining the infrastructure that supports data generation, storage, and retrieval. This role involves working closely with operations and other stakeholders to ensure that data pipelines are efficient, reliable, and scalable.
The RTOC Engineer will also be tasked with optimizing data flow and collection processes, implementing data governance policies, and ensuring the integrity and security of data throughout its lifecycle.
The ideal candidate will have a strong background in data management, data warehousing, and data integration. You will be responsible for designing, developing, and maintaining data pipelines to support our data-driven decision-making processes.
Roles & Responsibilities
OPERATIONS
Design, develop, and maintain scalable data pipelines and architectures
Implement data integration solutions to consolidate data from various sources
Optimize data workflows for performance and reliability
Collaborate with data scientists and analysts to understand data requirements and deliver solutions
Ensure data quality and consistency across all data platforms
Monitor and troubleshoot data pipeline issues
Stay up to date with the latest industry trends and technologies in data engineering
Operate and maintain the MPD Center of Excellence remote operations centre
Oversee and support development of satellite sites
COMMUNICATION
Maintains effective communications with all key stakeholders both internal and where appropriate external
Supervisors & Managers should clearly communicate expectations, roles, and responsibilities to their reports
Clearly communicate analytic solutions, including information such as explanations of models and the quality of models developed, to both internal and external stakeholders
Experience & Education
REQUIRED
Bachelor's degree in an Engineering or Scientific discipline or equivalent experience
Minimum 10+ years related experience
Minimum 5+ years' experience specifically towards MPD applications
Minimum 5+ years' experience assisting in the development of condition base monitoring capability or systems
PREFERRED
Knowledge, Skills & Abilities
REQUIRED
Strong experience applying data science to create ML, AI, and analytics solutions that can be deployed on the cloud, on premise, or at the edge
Experience with data science tools such as Databricks, Jupyter Notebooks, Spark, Pandas, NumPy, Matplotlib, ggplot2, Tidyverse, data.table and markdown
Good knowledge of Python or R and various ML libraries and packages such as Keras, PyTorch, Theano, TensorFlow and Scikit-learn
Good understanding of different data types such as time-series, structured, unstructured, etc.
Experience with NoSQL databases such as Cassandra, Mongo, Hadoop, etc.
PREFERRED
Knowledge of tools and platforms provided by various cloud providers such as AWS, Azure, and GCP
Knowledge of analytic visualization tools such as Plotly Dash, Tableau, or PowerBI
Knowledge of orchestration tools such as Prefect, Luigi, and other cloud vendor solutions
Experience with Big Data and streaming data
Experience with Natural Language Processing
Experience with MATLAB and Excel. JD Specific
Travel Requirement:
This role may require domestic and potentially international travel of up to: <10%
#LI-JA1