msk

Thala is an Intelligent incident management system for automated detection, classification, and resolution tracking. this is an efficient tool that integrates with existing developer ecosystem {Winner : SuperHack 2025} 😉

Publish a real-time financial data feed to a Kafka client using Amazon MSK

This is a collecton of CDK projects to show how to load data from streaming services into Amazon Redshift.

Serverless framework based stream processing using Amazon MSK and Amazon Lambda

Streaming kafka events using Spark in avro format and saving the events in parquet format

Create Kafka topic, stream the data to producer and consume on the console using Amazon MSK

Log data -> Kafka (MSK) - Lambda -> OpenSearch - Anomaly Detection

Reverse engineering of the L&S Emotion Control 2.4 GHz lighting protocol from a KZQ-8YKC-K remote (PIC16F1503 + TI CC2500). Full RF and packet spec recovered by SPI bus sniffing, verified over the air with a HackRF

Real-time streaming pipeline using AWS CDK with Amazon MSK Serverless, Amazon Managed Flink, Amazon Kinesis Data Firehose, Amazon S3, and Amazon SageMaker Feature Store for stock market data processing.

MSK/ASP pipeline with FastAPI, SvelteKit, and Atlas

CDC wiring, CRM API, and Atlas Search index automation

Production-grade real-time streaming platform on AWS MSK + EMR on EKS + EMR Serverless + Kinesis Data Analytics for Apache Flink, with Databricks Streaming comparison track. Multi-sink fan-out (Redis/OpenSearch/ClickHouse/S3 Iceberg), WebSocket push via MSK→Lambda fan-out, 19 Terraform modules.

The Kafka failure modes a quickstart never shows: rebalance redelivery, a poison record blocking a partition, and the offset off-by-one.

Download-and-apply AWS MSK Kafka starter: Terraform + producer → topic → consumer

Event-driven data platform with Kafka (MSK), Lambda, Airflow, Snowflake, and Kubernetes consumers.

Python SRE toolkit for Apache Kafka / MSK: lag monitors, rebalance helpers, topic capacity planning, incident runbooks.

Lightweight readiness monitoring and decision-support system built with Python and CSV workflows.

🌿 Plataforma bioinformática nutricional clínica · 307 hierbas en español · 18 condiciones · análisis genómico · evidencia MSK · informes PDF profesionales · FastAPI + Supabase