Data Engineer

Herzliya
Posted 2 years ago

The Data Engineering department is responsible for full-stack design and development of the company’s central data & ML services and business platforms.

The department is responsible for the overall projects, design, architecture and development of huge scale and very challenging cloud-based Big Data, machine learning and business applicative platforms for ensuring excellence in the performance of business aspects including games & product design, marketing, retention, monetization, etc.

Department solutions support the optimization of the company’s overall business performance.

Job responsibilities:

  • Lead the data solution, technical design and development for our data platform
  • Work closely with the product and infrastructure R&D teams to deliver the best data solution and insights over billions of daily events
  • Design, Develop and Operate the data pipelines required for optimal extraction, transformation, and loading (ETL) of data from a wide variety of data sources using distributed processing engines such as Apache Spark and Apache Beam
  • Work closely with the data science and ML engineers to develop and implement the ML framework and data features
  • Explore and deploy new data technologies to support our data platform

Requirements:

  • 2+ years of hands-on experience writing complex ETL pipelines using parallel processing engine (Spark/MapReduce/Beam etc) – Must
  • 4+ years of hands-on experience in Scala/Java/Python – Must
  • Expert in writing efficient sql queries and optimize performance (Impala/SparkSQL/BigQuery etc) – Must
  • Excellent understanding of development methodologies, paradigms (OOP, FP) and test driven environment – Must
  • You can write Technical Designs and turn business requirements to technical solutions
  • Team player with a can-do attitude – Must!
  • Bachelor’s degree in Computer Science or related – Must

Advantages:

  • Experience working on cloud solutions (GCP a big advantage) – a plus
  • Knowledge in Qlik Sense/Looker/Tableau or other visualization solutions – a plus
  • Experience working with notebook solutions (Jupyter, Zeppelin) – a plus
  • Experience with building Machine Learning solutions – a plus
  • Experience working in Agile Scrum methodologies – a plus

Job Features

Job CategoryJava, Python, Scala

Apply Online