Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

Runs LLaMA with Extremely HIGH speed

LLM inference in Fortran

The bare metal in my basement

Portable LLM - A rust library for LLM inference

Wrapper for simplified use of Llama2 GGUF quantized models.

Simple large language model playground app

V-lang api wrapper for llm-inference chatllm.cpp

VB.NET api wrapper for llm-inference chatllm.cpp

C# api wrapper for llm-inference chatllm.cpp

Nim api-wrapper for llm-inference chatllm.cpp

Simple bot that transcribes Telegram voice messages. Powered by go-telegram-bot-api & whisper.cpp Go bindings.

rust api wrapper for llm-inference chatllm.cpp

# gemma-2-2b-it.csThis project implements int8 CPU inference in pure C#. It ports a Rust repository using Gemini 2.5 Pro Preview, and you can easily build and run it with the provided batch files. 🐙💻

llama 3.2 1b fp16 cpu inference in one file of pure VB.NET

lua api wrapper for llm-inference chatllm.cpp

kotlin api wrapper for llm-inference chatllm.cpp

gemma-2-2b-it int8 cpu inference in one file of pure C#

D-lang api wrapper for llm-inference chatllm.cpp

🤖 AI Text Completion App built with Streamlit and Llama-3.2-1B. Generate creative text completions with an intuitive web interface. GPU & CPU optimized, easy to deploy, perfect for content creation and AI experimentation.