Fast, lightweight, pure C/C++ HTTP server based on httplib, nlohmann::json and llama.cpp. Set of LLM REST APIs and a web UI to interact with llama.cpp.
Some results have been hidden because they may be inaccessible to you
Show inaccessible resultsSome results have been hidden because they may be inaccessible to you
Show inaccessible results