Skip to content
View Yashu24-coder's full-sized avatar

Block or report Yashu24-coder

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Yashu24-coder/README.md

Kavali Yashwanth Royal

Data engineer in Bangalore. I build pipelines that land messy data, test it, and refuse to publish a number that fails a check — Python, SQL, PySpark, dbt, Kafka and AWS.

Portfolio: yashu24-coder.github.io

Right now I am working the stack end to end: batch on AWS, streaming with Kafka and Spark, and the dbt transformation layer on top. Four projects, each runnable from a clone, each with the tests and the numbers to back it up.

Pinned work

Project What it demonstrates
aws-retail-data-platform Batch ELT on AWS — S3 medallion layers, Glue PySpark, Athena and Redshift Serverless, 12 data-quality gates, 23 tests, everything in Terraform
streaming-orders-pipeline Kafka to Spark Structured Streaming — 120s watermark, 5-minute tumbling windows, exactly-once sink, dead-letter queue with reason codes
dbt-saas-analytics dbt analytics engineering — 13 models, 27 data tests, incremental MRR fact table, SCD2 snapshot, cohort retention that reconciles with revenue
aws-nyc-taxi-data-engineering NYC TLC lakehouse — S3 bronze/silver/gold, Glue, Athena and Terraform

How to read these

Every repository has a "What this project does not do" section. Start there. It says which parts run in CI and which need Docker or an AWS account, and it says plainly that the data is synthetic or public. I would rather you knew the edges than found them.

Tools

Python SQL PySpark dbt Kafka AWS (S3, Glue, Athena, Redshift) Terraform Docker DuckDB pytest GitHub Actions

Contact

Pinned Loading

  1. aws-retail-data-platform aws-retail-data-platform Public

    Batch ELT platform on AWS: S3 medallion layers, Glue PySpark, Athena and Redshift Serverless, 12 data-quality gates, all in Terraform.

    Python 1

  2. streaming-orders-pipeline streaming-orders-pipeline Public

    Real-time order events: Kafka to Spark Structured Streaming with windowed aggregations, checkpointed exactly-once writes, a dead-letter queue for bad records, and a local runner you can execute wit…

    Python 1

  3. dbt-saas-analytics dbt-saas-analytics Public

    dbt project turning messy SaaS billing exports into MRR, net new MRR, ARR and cohort retention: 13 models, 27 data tests, an incremental fact table and a type-2 snapshot, running on DuckDB with no …

    Python 1