Skip to content
@neuralmagic

Neural Magic

Neural Magic (Acquired by Red Hat) empowers developers to optimize & deploy LLMs at scale. Our model compression & acceleration enable top performance with vLLM

Pinned Loading

  1. deepsparse deepsparse Public archive

    Sparsity-aware deep learning inference runtime for CPUs

    Python 3.2k 192

Repositories

Showing 10 of 118 repositories
  • crucible Public

    Crucible: an agentic workflow engine

    neuralmagic/crucible's past year of commit activity
    Rust 11 Apache-2.0 5 12 6 Updated Nov 6, 2026
  • vllm Public Forked from vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    neuralmagic/vllm's past year of commit activity
    Python 17 Apache-2.0 24,837 0 38 Updated Nov 6, 2026
  • research Public

    Repository to enable research flows

    neuralmagic/research's past year of commit activity
    Python 4 3 0 4 Updated Nov 6, 2026
  • vllm-vcr Public

    vLLM inference simulator and replay machine

    neuralmagic/vllm-vcr's past year of commit activity
    Rust 11 Apache-2.0 2 15 (2 issues need help) 15 Updated Nov 6, 2026
  • model-validation-configs Public
    neuralmagic/model-validation-configs's past year of commit activity
    2 2 1 6 Updated Nov 6, 2026
  • evals-refresh Public Forked from eldarkurtic/evals-refresh
    neuralmagic/evals-refresh's past year of commit activity
    Shell 3 4 0 2 Updated Nov 6, 2026
  • inspect_evals Public Forked from UKGovernmentBEIS/inspect_evals

    Collection of evals for Inspect AI

    neuralmagic/inspect_evals's past year of commit activity
    Python 0 MIT 485 0 1 Updated Nov 6, 2026
  • nm-hard-tools Public

    MCP services for rigorous inference evaluation and benchmarking

    neuralmagic/nm-hard-tools's past year of commit activity
    Python 0 Apache-2.0 0 0 11 Updated Nov 5, 2026
  • Speech Public Forked from NVIDIA-NeMo/Speech

    A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

    neuralmagic/Speech's past year of commit activity
    Python 0 Apache-2.0 3,752 0 0 Updated Nov 5, 2026
  • inspect_k8s_sandbox Public Forked from UKGovernmentBEIS/inspect_k8s_sandbox

    A Kubernetes sandbox environment for use with inspect_ai

    neuralmagic/inspect_k8s_sandbox's past year of commit activity
    Python 0 MIT 41 0 0 Updated Nov 5, 2026
View all repositories