ollama

Get up and running with large language models locally. (Summary from the program web page.)

The official web page: https://github.com/ollama/ollama.

Note: It is better to use commands from the ollama-models-lcc module, as they better suit to the requirements on jobs submitted to a batch system.

Typical usage:

$ module add ollama
$ ollama --help