Data Engineer
- Data
- Tel Aviv
- Full-time
Description
Join us in transforming the banking industry with cutting-edge technology.
We are currently looking for a Data Engineer to join our Big Data team.
This role offers an exciting and diverse opportunity, involving the development of data product processes and dashboards within a cutting-edge technological environment.
Responsibilities
- Design, build, and maintain scalable and reliable data pipelines.
- Develop efficient ETL/ELT processes using Python.
- Enrich and integrate data from multiple sources via RESTful APIs.
- Work with PostgreSQL and other data stores to model, ingest, and serve structured data.
- Build and manage infrastructure on AWS.
- Ensure high data quality, reliability, and security across all systems.
- Implement and maintain CI/CD pipelines for data workflows.
- Collaborate cross-functionally with data scientists, analysts, and product teams.
Requirements
- 5+ years of experience as a Data Engineer or in a similar role.
- Expert in Python and its ecosystem for data processing.
- Hands-on experience with Apache Kafka, Apache NiFi, Apache Airflow, and PostgreSQL in production.
- Strong understanding of REST APIs (consuming and integrating).
- Experience with SQL & NoSQL databases (e.g., PostgreSQL, Oracle, MongoDB, DynamoDB, Cassandra).
- Familiarity with data warehouse platforms (e.g., Redshift, BigQuery, Snowflake).
- Solid experience with AWS services relevant to data engineering.
- Experience with containerization technologies like Docker.
- Proficiency in building and deploying data solutions with CI/CD pipelines.
- Understanding of data governance, privacy, and security best practices.
Nice to Have:
- Applicative DBA experience with relational databases (e.g., PostgreSQL, MySQL).