Research Engineer II (Computer Science/Electrical Engineering)
Nanyang Technological University
The Energy Research Institute @ NTU (ERIAN) invites applications for the position of Research Engineer II.
Key Responsibilities:
Data Engineer (Big Data & IoT) for Data fusion project
Job Requirements:
- B.E. / B.Tech / MTech (Computer Science/Electrical Engineering) from a reputed institute
- Must have a minimum 3 years of hands-on experience in building the data pipeline using Python, Kafka & Spark
- Must have solid concepts on IoT & Sensors
- Must have experience in pulling data from Gateways / Edge Devices
- Must have done minimum 2 end to end Big Data Pipeline implementations, either on cloud or on-premise
- Experience in configuring or developing custom code components for data ingestion, data processing, and data provisioning, using Big data & distributed computing platforms such as Python Spark, and Cloud platforms such as AWS or Azure.
- Must have hands-on knowledge of Spark RDD, DataFrame, MLLib and Streaming API
- Must have solid experience in advance python programming
- Knowledge of Python ML will be an added advantage
- Proficiency in data modelling, for both structured and unstructured data, for various layers of storage
- Must have ability to collaborate closely with business analysts, architects, and client stakeholders to create technical specifications.
- Must have expertise in building the CI / CD Pipeline & Automatics deployment of jobs
Skills and Proficiency
- Solid Python Programming skills
- Spark, Kafka, Spark RDD, Streaming API
- Pandas, Numpy, MatplotLib, Scikit-learn
- Git-lab, CI / CD Pipeline
- Docker
- Excellent Communication Skills
We regret that only shortlisted candidates will be notified.
Hiring Institution: NTU
In line with Singapore’s nationwide Vaccination-Differentiated Safe Management Measures (VDS), employees must be fully vaccinated to return to the workplace, unless certified to be medically ineligible. For Information on VDS, please click here .
View or Apply
To help us track our recruitment effort, please indicate in your cover/motivation letter where (jobs-near-me.eu) you saw this job posting.</strong