Data Engineer - Production Monitoring & Data Validation

Join IDstar Cipta Technology as a Data Engineer and play a pivotal role in ensuring the reliability, accuracy, and efficiency of our data infrastructure. In this dynamic position, you will monitor production data processes, troubleshoot incidents, and perform rigorous data validation to maintain the integrity of our systems. Based in Jakarta Selatan, you'll be part of a team that drives innovation and ensures seamless data operations.

As a Data Engineer, you'll work closely with cross-functional teams to design, implement, and optimize data pipelines. You'll leverage tools like Apache Airflow, Spark, and Kafka to automate and streamline data processes, ensuring high performance and scalability. This role offers a unique opportunity to grow within a company that values cutting-edge technology and a collaborative work environment.

📋 Tanggung Jawab Pekerjaan

Key Responsibilities:

• Monitor and manage production data processes to ensure reliability and accuracy.
• Troubleshoot and resolve data-related incidents promptly.
• Perform rigorous data validation to maintain the integrity of our systems.
• Design, implement, and optimize data pipelines using tools like Apache Airflow, Spark, and Kafka.
• Collaborate with cross-functional teams to ensure seamless data operations.
• Implement best practices for data security and compliance.
• Stay updated with the latest industry trends and technologies.
• Provide technical guidance and support to junior team members.

🎓 Kualifikasi & Syarat

Kualifikasi & Syarat:

• Bachelor's degree in Computer Science, Data Engineering, or a related field.
• 3-5 years of experience in data engineering, with a strong background in data validation and monitoring.
• Proficiency in tools like Apache Airflow, Spark, and Kafka.
• Experience with cloud platforms such as AWS or GCP is a plus.
• Strong problem-solving skills and attention to detail.
• Excellent communication and teamwork skills.
• Familiarity with SQL and NoSQL databases.
• Ability to work in a fast-paced, dynamic environment.

🛠️ Keahlian

Lowongan Terkait