Brigi Meeha J

Brigi Meeha J

Data Engineer
India
Tamil, English

About Me

I am an aspiring Data Engineer and M.Sc. Information Technology student passionate about designing scalable data solutions and enabling data-driven decision-making. My interests lie in data pipeline development, cloud da…

Experience

Deep Learning Intern

Edge Matrix Corporation
Apr 2024 - Jun 2024 · 2 months

Designed and implemented scalable ETL pipelines in GCP to ingest and transform solar trading data from PV meters, TES, and weather APIs.
Built workflows with Cloud Data Fusion, applied transformations, ensured data quality, and loaded into BigQuery while securing sensitive data with masking and validation.
Created Looker Studio dashboards and automated workflows with Cloud Composer to optimize pipeline reliability and reduce downtime.
Troubleshoot and optimize broken pipelines, minimizing data latency and ensuring uninterrupted delivery.

Deep Learning Intern

Edge Matrix Corporation
Apr 2024 - Jun 2024 · 2 months

Designed and implemented scalable ETL pipelines in GCP to ingest and transform solar trading data from PV meters, TES, and weather APIs., Built workflows with Cloud Data Fusion, applied transformations, ensured data quality, and loaded into BigQuery while securing sensitive data with masking and validation., Created Looker Studio dashboards and automated workflows with Cloud Composer to optimize pipeline reliability and reduce downtime., Troubleshooted and optimized broken pipelines, minimizing data latency and ensuring uninterrupted delivery.

PROJECTS

Automated Financial Intelligence Pipeline: From Ingestion to Analytics

N/A Not Applicable
Duration : 31-May-2025 - 30-Aug-2025

Developed an end-to-end automated data warehousing and analytics pipeline designed to process, transform, and manage large-scale financial and stock market datasets efficiently. The project emphasized scalability, automation, and data governance, showcasing expertise in modern data engineering tools such as Apache Airflow, dbt, and Snowflake.Designed a scalable ETL architecture that ingests raw financial data from multiple sources into Snowflake, enabling structured and reliable data storage optimized for analytics.Implemented transformation logic using dbt (Data Build Tool), creating modular and reusable SQL models with dependency tracking, version control, and automated testing for data quality and consistency.Configured Airflow DAGs for automated pipeline orchestration, scheduling, and monitoring, ensuring seamless data flow from ingestion to analytics-ready stages with minimal manual intervention.Established data governance and validation frameworks, including schema checks, data freshness validation, and model documentation, to maintain data reliability, traceability, and auditability.Optimized query performance and transformation efficiency by applying incremental materializations, partitioning strategies, and warehouse tuning in Snowflake.Delivered analytics-ready datasets and insights that support decision-making dashboards and financial intelligence reporting, demonstrating the pipeline’s real-world business applicability.This project strengthened my proficiency in ETL pipeline design, workflow automation, and cloud-based data warehousing, while enhancing my understanding of orchestration frameworks, CI/CD for data models, and production-grade analytics infrastructure.

Skills

Python SQL Java HTML CSS dbt Grafana MySQL Flask Power BI Apache Airflow MinIO Kafka REST API Hadoop Apache Spark Docker Kubernetes Google Cloud Platform (GCP) Snowflake BigQuery Cloud Data Fusion Bigtable Looker Studio Vertex AI Vision API Jinja YAML
Report this Profile?