Data Engineer
NTT DATA · Singapore
Skills in this posting
The posting
Requirements
Bachelor's degree in Computer Science or a related field.
At least 7 years of IT experience of which at least 5 years' experience in similar role, ideally in a Big Data tools
Proficient understanding of distributed computing principles
Strong experience of Hadoop, Spark, Iceberg and Spring Boot
Experience with building stream-processing systems, using solutions such as Spark-Streaming
Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
Experience with integration of data from multiple data sources
Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
Knowledge of various ETL techniques and frameworks
Experience with various messaging systems, such as Kafka or RabbitMQ
Knowlege with Big Data ML toolkits, such as Mahout, SparkML, or H2O
Good understanding of Lambda Architecture, along with its advantages and drawbacks
Originally posted on Himalayas
The PivotHop read
- What a data engineer actually earnsmedian, seniority, by country
- What data engineers do insteadevery measured route out
- Data Architect → Data Engineer48% readiness
- Data Analyst → Data Engineer24% readiness
- All open data engineer rolesthe full board
Where these skills also reach
- 212 open data architect roles89% readiness from data engineer
- 176 open database administrator roles63% readiness from data engineer
- 2484 open solutions architect roles56% readiness from data engineer
- 1359 open data analyst roles51% readiness from data engineer
More data engineer roles
Backfilled listing, refreshed with the nightly scrape; the employer has not claimed it yet. Are you the employer? Claim this listing and it can be featured to the candidates whose skills already reach it, first month free.