NInfer

Made by Igor L. / NInfer contributors.

NInfer is a runtime that reads decisions straight from a language model's output probabilities, by Igor L. / NInfer contributors. Benchmarked in several versions; see the scores below.

Licence
Apache-2.0
Pricing
Free (self-hosted)

Independent benchmarks

Links