Research Engineer II (Computer Science/Electrical Engineering)

The Energy Research Institute @ NTU (ERIAN) invites applications for the position of Research Engineer II. 

Key Responsibilities: 
 

Data Engineer (Big Data & IoT) for Data fusion project

Job Requirements:

• B.E. / B.Tech / MTech (Computer Science/Electrical Engineering) from a reputed institute
• Must have a minimum 3 years of hands-on experience in building the data pipeline using Python, Kafka & Spark
• Must have solid concepts on IoT & Sensors
• Must have experience in pulling data from Gateways / Edge Devices
• Must have done minimum 2 end to end Big Data Pipeline implementations, either on cloud or on-premise
• Experience in configuring or developing custom code components for data ingestion, data processing, and data provisioning, using Big data & distributed computing platforms such as Python Spark, and Cloud platforms such as AWS or Azure.
• Must have hands-on knowledge of Spark RDD, DataFrame, MLLib and Streaming API
• Must have solid experience in advance python programming
• Knowledge of Python ML will be an added advantage
• Proficiency in data modelling, for both structured and unstructured data, for various layers of storage
• Must have ability to collaborate closely with business analysts, architects, and client stakeholders to create technical specifications.
• Must have expertise in building the CI / CD Pipeline & Automatics deployment of jobs

Skills and Proficiency

• Solid Python Programming skills
• Spark, Kafka, Spark RDD, Streaming API
• Pandas, Numpy, MatplotLib, Scikit-learn
• Git-lab, CI / CD Pipeline
• Docker
• Excellent Communication Skills

​

We regret that only shortlisted candidates will be notified.

Hiring Institution: NTU

In line with Singapore’s nationwide Vaccination-Differentiated Safe Management Measures (VDS), employees must be fully vaccinated to return to the workplace, unless certified to be medically ineligible. For Information on VDS, please click here .