Engineer (Data Engineer : Quality Statistics and Benchmarking Management)

Job Summary

We are seeking a highly motivated and experienced Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure, ensuring the availability and integrity of data for analysis and reporting. You will work closely with cross-functional teams to understand their data needs and create scalable solutions for data collection, transformation, and storage. If you are passionate about data and enjoy solving complex data engineering challenges.

Job Description

Responsibilities:

• Design, develop, and maintain robust data pipelines to extract, transform, and load (ETL) data from various sources such as crowdsourcing data, test tool, network statistics, application log etc. Also develop and maintain data models and warehouses.
• Implement processes and systems to automate data processing tasks.
• Optimize data storage, ensuring data integrity and reliability while managing scalability and performance.
• Collaborate with data scientists and analysts to understand their data needs and design and implement data pipelines that meet those needs.
• Write and maintain documentation for data pipelines and data models.
• Troubleshoot data-related issues, investigate data anomalies, and perform root cause analysis.
• Implement data security and access controls to protect sensitive data.
• Stay up-to-date on the latest data engineering technologies and trends.
• Ensure data compliance with relevant regulations and industry standards.

Qualifications:

• Bachelor's degree in Computer Engineering, Computer Science, Information Technology, or a related field. Master’s degree is a plus.
• 0–3 years of experience as a Data Engineer.
• Knowledge and skill of database systems (SQL and NoSQL).
• Strong programming skills in languages like Python, Java, or Scala.
• Experience with data processing frameworks such as Apache Spark and Apache Hadoop.
• Knowledge of data visualization tools (e.g., Tableau, Power BI).
• Experience with data quality and integrity tools and techniques is a plus.
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork abilities.
• Ability to work in a fast-paced, agile environment.
• Strong knowledge of data security and privacy practices.
• Self-motivated with a passion for data and a proactive attitude.