PythonHub
Link
click to show
click to show
AirLLM
AirLLM is a Python library for running very large language models on consumer GPUs with limited memory by loading model layers sequentially instead of keeping the entire model in VRAM.
https://github.com/lyogavin/airllm
2 · 99 ·