Job Description:
Responsibilities
" Designing, architecting, implementing, and supporting our data pipelines and processing flows.
" Collaborate with analytics department to analyze and understand data sources.
" Provide insights and guidance on database technology and data modeling best practices.
" insure the maintenance of data integrity, managing data and analysis flows with attention to detail and high responsibility.
" implementing algorithms with our data scientists.
Job Qualifications:
" BSc/BA in Computer Science or similar.
" At least 5 years proven experience as a Big Data Engineer.
" At least 3 years of experience with Python.
" Experience with both SQL and NoSQL databases, including Elastic Search, Splunk, MongoDB.
" Experience with processing of large data sets.
" Experience with Linux environment.
" Experience with software design and development in a test-driven environment.
Advantages:
" Experience with AirFlow.
" Experience with Nifi.
" Previous experience in the cybersecurity industry or in elite technology units in IDF.
" Experience with OpenShift, S3, AWS, Docker, Kubernetes, Java and TypeScript.
" Experience working with CI/CD software (Jenkins, GitLab).
Company Occupation:
High Tech
Company Size:
Large (150+)