Dataroid is in search of a Senior Data Engineer who will be responsible for designing and building large-scale resilient data pipelines, ensuring high performance, scalability, and seamless integration with various frameworks.
Key Responsibilities
- Design and build large-scale resilient data pipelines using various frameworks like Apache Spark, Apache Flink, Kafka etc.
- Write well designed, reusable, testable, secure and scalable high-quality code
- Collaborate with cross-functional teams
- Discover, learn and implement new technologies
Qualifications & Experience
- BSc/MSc/PhD degree in Computer Science or a related field or equivalent work experience
- 5+ years of experience in Data Engineering or similar role
- Strong experience with data modeling and ETL/ELT practices
- Proficiency in one or more high-level Python or Java based batch and/or stream processing frameworks such as Apache Spark, Apache Flink or Kafka Streams
- Strong experience with relational and non-relational data stores, key-value stores and search engines (PostgreSQL, ScyllaDB, Druid, ClickHouse, Redis, Hazelcast, Elasticsearch etc.)
- Experience with data workflow orchestration tools like Airflow or dbt
- Deep understanding of storage formats such as Parquet, ORC and/or Avro
- Proficiency with Python or Java
- Strong experience with distributed systems and concurrent programming
- Experience with distributed storage systems like HDFS and/or S3
- Familiarity with data lake and data warehouse solutions including Hive, Iceberg and/or Delta Lake
- Proficiency in code versioning tools such as Git
- Strong sense of analytical thinking and problem-solving skills
- Strong verbal and written communication skills
Nice to have
- Familiarity with containerization & orchestration - Docker and/or Kubernetes
- Familiarity with generative models and a strong enthusiasm for generative AI, large language models (LLMs) and the agentic world
- Prior experience with SCRUM/Agile methodologies
🌟Great Compensation & Benefits: We provide an attractive compensation package, including private health insurance, company-supported pension plans, meal vouchers, commute assistance, remote work benefits, and a paid day off for your birthday. 💻Enhanced Workdays: Enjoy the flexibility of adaptable working hours. We offer online events, inspiring guest speakers, office snacks, a culture that limits unnecessary meetings, and many other perks designed to make your weekdays more enjoyable. 📚Growth & Learning: Your development is our priority, with access to premier online learning platforms like Udemy, digital libraries, and tailored training programs to support your career journey. 🚀Thriving Community: Be part of a vibrant and close-knit team that values connection. Enjoy happy hours, workshops, seasonal celebrations, and other events that bring us together. 🎯Open Dialogue: Our flat organizational structure fosters direct and transparent communication. Your ideas and feedback are always welcome, ensuring your voice is heard and valued. FIND MORE ABOUT US 🔎 Our career page: https://www.dataroid.com/careers/ Our company page: https://www.dataroid.com/ We will process your personal data as part of our recruitment procedures. To find out more, please consult our Candidate Privacy Notices.
İşi Bildir