صاحب العمل نشط
Sound knowledge and work experience with SQLs
Working experience with Kafka (end to end implementation and support)
Experience with spark and Spark Streaming (either python or scala is MUST)
Ability to integrate different components in a streaming datapipeline.
Sound knowledge on AWS (data related) components, ex: AWS kafka, AWS Airflow, AWS S3, AWS EMR etc.
Should be able to Design and Develop Streaming pipelines with Kafka by developing publisher and subscriber scripts.
Able to troubleshoot data issues and suggest fixes by monitoring cloudwatch and other AWS logs.
دوام كامل