Data Engineer | ETL/ELT pipelines | PySpark and Databricks | Azure, AWS and Snowflake
M.S. in Data Science, University of Massachusetts Dartmouth (May 2026). I build batch and streaming data pipelines, lakehouse tables and the data quality checks around them, mostly for insurance and healthcare data.
| Area | Tools |
|---|---|
| Languages | SQL, Python (pandas), PySpark, Spark SQL, Bash |
| Azure | Data Factory, Databricks, ADLS Gen2, Delta Lake, Unity Catalog, Key Vault |
| AWS | S3, Glue, Lambda, Athena, EMR, Kinesis, IAM |
| Warehousing and modeling | Snowflake, SQL Server, dbt, Medallion Architecture, SCD Type 1/2 |
| Orchestration and CI/CD | Apache Airflow, GitHub Actions, Terraform |
| Analytics and ML | Power BI, Tableau, PyTorch, Hugging Face Transformers |
| Project | What it is | Stack |
|---|---|---|
| youtube-trending-aws-pipeline | Serverless data lake that turns raw YouTube trending CSV/JSON into partitioned Parquet analytics tables | S3, Lambda, Glue (PySpark), Athena, QuickSight |
| ml-driftnet | Master's project: fine-tuning GPT-2 Small on ML Q&A data and proving domain adaptation with five metrics | PyTorch, Hugging Face Transformers |
- Email: jayanthmekala05@gmail.com
- LinkedIn: linkedin.com/in/jayanth-mekala-1893b11aa
- Location: Massachusetts, USA (open to relocate)
