senior data engineer

توضیحات آگهی

At Azki s Data Team we are looking for a responsible and skilled problem solver to help us design build and scale reliable data infrastructure that powers analytics products and business decisions Responsibilities Work closely with data team members and other teams to design and implement scalable data pipelines Build maintain and optimize data processing workflows using Kafka Spark Scala Python and MySQL ClickHouse Ensure data quality integrity and availability across our data platforms Develop and manage data models and storage solutions that support analytical and product use cases Automate data ingestion transformation and delivery processes Monitor and improve the performance of pipelines and queries in ClickHouse MySQL and other systems Collaborate with analysts data scientists and product teams to enable self service analytics through tools like Metabase and Zeppelin Contribute to the evolution of Azki s data platform architecture ensuring scalability security and reliability Required Skills At least 5 years of relevant experience in data engineering or backend data infrastructure Strong skills in SQL and experience with databases such as MySQL and ClickHouse Hands on experience with streaming and batch processing systems Kafka Spark Proficiency in both Scala and Python for data engineering and pipeline development Solid understanding of data modeling ETL processes and data warehousing concepts Experience with workflow orchestration and version control e g Airflow GitLab Strong problem solving skills with the ability to design and implement robust scalable data solutions Effective communication and teamwork skills for working with cross functional teams Strong proficiency in Linux environments including shell scripting system monitoring and troubleshooting Hands on experience with Docker for containerization and deployment of data services Preferred Optional Skills Experience in mentoring and supporting team members in their career growth including close collaboration and pair work to improve project outcomes Familiarity with data visualization and BI tools such as Metabase Knowledge of best practices for data security governance and compliance تهران تهران ساعی توانیر تمام وقت ازکی کارشناس ارشد جنسیت تفاوتی ندارد اینترنت تجارت الکترونیک خدمات آنلاین