Skip to content
View 2Ju1's full-sized avatar

Block or report 2Ju1

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
2Ju1/README.md

Lee Juwon

I build LLM systems and developer tools with an emphasis on reproducible experiments, measurable performance, and clear engineering trade-offs.

Computer Science & Engineering at Ewha Womans University.

Featured work

Extended verl with phase-aware model residency, CPU AdamW, and bounded asynchronous gradient streaming for memory-efficient full-parameter GRPO.

  • Reduced the Actor-backward peak by 27.9% and end-to-end step time by 12.1% with a 16 MiB streaming pipeline.
  • Enabled Qwen2.5-1.5B training on a GPU with 11.90 GiB usable capacity where all-GPU and CPU-Adam-without-streaming configurations reached OOM.
  • Preserved experiment configurations, raw evidence, failure cases, and known limitations for reproducibility.

Built a reproducible benchmark that separates the effects of context growth, prefix stability, output length, and tool latency on LLM response time.

  • Measured TTFT growth from 0.084 s to 0.458 s as controlled context grew from 90 to 24,717 prompt tokens.
  • Combined client-side latency with vLLM Prometheus metrics to distinguish KV recomputation, cache reuse, prefill, and decode costs.
  • Added a versioned experiment spec, CLI, unit tests, and automated CI checks.

Engineering interests

  • LLM inference and training systems
  • Developer tooling and reproducible evaluation
  • Performance measurement and resource-efficient systems
  • Interfaces that are understandable to both developers and LLMs

Elsewhere

Pinned Loading

  1. agentic-llm-latency-benchmark agentic-llm-latency-benchmark Public

    Reproducible benchmark for agentic context growth, prefix caching, and LLM latency

    Python

  2. verl-phase-aware-offloading verl-phase-aware-offloading Public

    Memory-efficient full-parameter GRPO on a single GPU with phase-aware offloading, CPU AdamW, and async gradient streaming.

    Python