Data Engineer

Project Desciption

We are looking for #DataEngineers having 5+ years of experience with strong hands-on experience in developing #scalable #BigData applications or solutions on distributed platforms and good #datavisualization experienced #BigData Engineers with experience in #Spark, #Hive, #Kafka, #Sql, and #HLD

The purpose of this role is to explore various internal and external data sources, integrate those data sources and prepare data for consumption in a lakehouse. He / She also captures, transforms and stores clean data, leaving it ready for consumption. We looking for:

·         A developer able to create state of the art data applications using Python and SQL;

·         Understanding of Spark internals and performance tuning

·         Experienced in Agile/Scrum methodologies and collaboration with cross-functional teams

·         Deep knowledge of machine learning, statistics and optimization

·         Advanced knowledge of statistical techniques, data mining, machine learning (regression, decision trees, clustering, random forests, generalized linear models, etc.)