Job Description:
Take a major role in designing, architecting, and selecting technology for the next generation of the Data platform.
You will recruit, establish, and manage a data engineering team responsible for all the data (Customer and business data), including Data Integrity, Data integrations, Pipelines, Data transformation, Data aggregation, Reports, Insights, Events, Monitoring, etc.
You will define working methodology, KPIs for measuring success, and quality control measures.
Design data profiling and monitoring to identify anomalies and maintain data integrity.
Work closely with our AI and data scientists team, responsible for developing algorithms, analytical rules, and LLM/ML data models.
Additional Positions:
Job Qualifications:
BSc in Computer Science or equivalent.
7+ years of experience as a Data Engineer
3+ years experience as a Data Engineering Manager
Experience in building Data infrastructure.
Experience and familiarity with the following tools:
Big-data query engines (Spark, Databricks, Presto)
Data lakes and data Lakehouse architecture
Familiarity with Azure data stack - advantage.
Experience creating and optimizing big data processes, pipelines, and architectures on cloud-native environments (Spark/Databricks).
Proficiency with SQL, Python, and one of Java/Scala/CPP.
Understanding of how to build robust and reliable solutions
Familiarity with cloud Databases (Snowflake-Advantage)
Have a strong analytical mind with proven problem-solving abilities
Company Occupation:
High Tech