Skip to content
@neuralmagic

Neural Magic

Neural Magic (Acquired by Red Hat) empowers developers to optimize & deploy LLMs at scale. Our model compression & acceleration enable top performance with vLLM

Pinned Loading

  1. deepsparse deepsparse Public archive

    Sparsity-aware deep learning inference runtime for CPUs

    Python 3.2k 192

Repositories

Showing 10 of 111 repositories
  • crucible Public

    Crucible: an autonomous goal-directed research loop engine

    neuralmagic/crucible's past year of commit activity
    Rust 9 Apache-2.0 3 7 10 Updated Oct 2, 2026
  • model-validation-configs Public
    neuralmagic/model-validation-configs's past year of commit activity
    2 2 1 10 Updated Oct 2, 2026
  • vllm Public Forked from vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    neuralmagic/vllm's past year of commit activity
    Python 17 Apache-2.0 23,176 0 38 Updated Oct 1, 2026
  • inspect_k8s_sandbox Public Forked from UKGovernmentBEIS/inspect_k8s_sandbox

    A Kubernetes sandbox environment for use with inspect_ai

    neuralmagic/inspect_k8s_sandbox's past year of commit activity
    Python 0 MIT 35 0 5 Updated Oct 1, 2026
  • llm-manifesto Public

    Declarative Kubernetes renderer for llm-d and vLLM deployments

    neuralmagic/llm-manifesto's past year of commit activity
    Python 2 Apache-2.0 0 0 0 Updated Oct 1, 2026
  • nm-vllm-omni-ent Public Forked from vllm-project/vllm-omni

    A framework for efficient model inference with omni-modality models

    neuralmagic/nm-vllm-omni-ent's past year of commit activity
    Python 3 Apache-2.0 1,874 0 2 Updated Oct 1, 2026
  • rh-custom-models-plugin Public
    neuralmagic/rh-custom-models-plugin's past year of commit activity
    Python 0 Apache-2.0 0 0 0 Updated Oct 1, 2026
  • vllm-vcr Public

    vLLM inference simulator and replay machine

    neuralmagic/vllm-vcr's past year of commit activity
    Rust 7 Apache-2.0 2 15 (2 issues need help) 14 Updated Oct 1, 2026
  • eval-hub-contrib Public Forked from eval-hub/eval-hub-contrib

    Community-contributed evaluation framework adapters for eval-hub

    neuralmagic/eval-hub-contrib's past year of commit activity
    Python 0 Apache-2.0 24 0 1 Updated Sep 30, 2026
  • DeepEP Public Forked from deepseek-ai/DeepEP

    DeepEP: an efficient expert-parallel communication library

    neuralmagic/DeepEP's past year of commit activity
    Cuda 1 MIT 1,469 0 2 Updated Sep 30, 2026
View all repositories

Most used topics

Loading…