How to run Ollama

Discuss Apps
,
1

What app is this about, and its version: Ollama 0.12.2~ynh1
What YunoHost version are you running: 12.1.25
What type of hardware are you using: VPS bought online

Describe your issue

I’ve installed Ollama, but I have no idea how to use it through YunoHost and can’t find any guide/docs anywhere. Anyone able to help and/or sending toward the right direction?

Share relevant logs or error messages

N/A

2

It’s from cli :

  1. Open ollama shell : yunohost app shell ollama
  2. Run ollama commands
  3. You can also use its api locally
3

I imagine you can also use it with Litechat (?) but I didn’t try it…

Provider type: ollama
Base url: http://localhost:11434

4

After starting the shell, I try to run a command, but get bash: ollama: command not found

5

Ah yes, it’s been a while since the last time I used it from cli.
So after entering the ollama shell, cd bin and there you can run ollama commands with ./ollama command. Ex : ./ollama ps. I probably have created an alias for it.
Beware that it requires a huge amount of ram and disk.

I tried it but I couldn’t get it running at all and because of lack of time I didn’t dig further. Thought there is open-webui packaged, but this monster requires 12G on disk just to install and it was decided to remove it from the catalog. It works out of the box with ldap support.

1 Like