Data Engineer
نُشرت في :
11-09-2024
صاحب العمل نشط
حالة تأهب وظيفة
سيتم تحديثك بأحدث تنبيهات الوظائف عبر البريد الإلكترونيValid email field required
أرسل الوظائف
شارك هذه الوظيفة
أرسل لي وظائف مشابهة
حالة تأهب وظيفة
سيتم تحديثك بأحدث تنبيهات الوظائف عبر البريد الإلكترونيValid email field required
أرسل الوظائف
الوصف الوظيفي
Key Responsibilities:
Functional
- Solve challenging problems using python coding skills.
- Design build and launch new data extraction transformation & loading processes in production.
- Web crawling data cleaning data annotation data ingestion and data processing.
- Reading and collating complex data sets.
- Creating and maintaining data pipelines.
- Continual focus on process improvement to drive efficiency and productivity within the team.
- Use of Python SQL ES Shell etc. to build the infrastructure required for optimal extraction transformation and loading of data.
- Provide insights into key business performance metrics by building analytical tools that utilize the data pipeline.
- Support the wider business with their data needs on an ad hoc basis.
- Comply with QHSE (Quality Health Safety and Environment) Business Continuity Information Security Privacy Risk Compliance Management and Governance of Organizations policies procedures plans and related risk assessments.
Qualifications
Requirements:
- Bachelors degree in computer engineering Computer Science or Electrical Engineering and Computer Sciences.
- 3 years of programming experience solid coding skills in Python Shell and Java
- Good corporate capacity good communication skills.
- Experience with Web crawling cleaning.
- Experience with solution architecture data ingestion query optimization data segregation ETL ELT AWS EC2 S3 SQS lambda Elastic Search Redshift CI/CD frameworks and workflows.
- Working knowledge of data platform concepts data lake data warehouse ETL big data processing (designing and supporting variety/velocity/volume) real time processing architecture for data platforms scheduling and monitoring of ETL/ELT jobs
- PostgreSQL and programming (preferably Java Python) proficiency in understanding data entity relationships structured & unstructured data SQL and NoSQL databases
- Knowledge of best practice in optimizing columnar and distributed data processing system and infrastructure
- Experienced in designing and implementing dimensional modelling
- Knowledge of machine learning and data mining techniques in one or more areas of statistical modelling text mining and information retrieval.
- Develop and maintain scalable data pipelines and systems on Azure
- Extensive experience with Azure cloud services
Ideally youll also need
- Indepth market and domain knowledge
- A passion for constant improvement
- An innovative and creative approach to problemsolving
- Excellent communication skills
Remote Work :
No
نوع التوظيف
دوام كامل
المهارات المطلوبة
الإبلاغ عن هذه الوظيفة
إخلاء المسؤولية: د.جوب هو مجرد منصة تربط بين الباحثين عن عمل وأصحاب العمل. ننصح المتقدمين بإجراء بحث مستقل خاص بهم في أوراق اعتماد صاحب العمل المحتمل.
نحن نحرص على ألا يتم طلب أي مدفوعات مالية من قبل عملائنا، وبالتالي فإننا ننصح بعدم مشاركة أي معلومات شخصية أو متعلقة بالحسابات المصرفية مع أي طرف ثالث. إذا كنت تشك في وقوع أي احتيال أو سوء تصرف، فيرجى التواصل معنا من خلال تعبئة النموذج الموجود على الصفحة اتصل بنا
