Senior Data Engineer

Qualifications

Skills and attributes to success

• Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience.
• 5+ years of experience in a Data Engineering role.
• Proficiency in SQL and programming languages like Python, Java, and Scala.
• Hands-on experience with big data technologies like Hadoop, Spark and Flink.
• Familiarity with machine learning frameworks such as TensorFlow, PyTorch, or similar.
• Strong understanding of data warehousing concepts, ETL processes, and data modeling.
• Experience with API development and integration with data services.
• Experience with cloud platforms like AWS, GCP.
• Knowledge in DevOps, CI/CD methods, and containerization technologies like Docker or Kubernetes.
• Experience with real-time data processing.
  

Technical stack

• Programming Languages: Python, Java, Scala, SQL, Bash
• Big Data Technologies: Hadoop, Spark, Flink
• Databases: MySQL, PostgreSQL, MongoDB, Cassandra, HBase, Redis
• Cloud Platforms: Azure
• API Development: RESTful APIs, GraphQL, OpenAPI
• Data Services: Kafka, RabbitMQ
• Containers: Docker, Kubernetes