LLM: ollama install ubuntu 24.04

From OnnoWiki
Revision as of 12:35, 15 July 2024 by Onnowpurbo (talk | contribs)
Jump to navigation Jump to search

Sumber: https://www.jeremymorgan.com/blog/generative-ai/local-llm-ubuntu/

Install aplikasi pendukung

sudo su
apt install curl net-tools


Download

curl -fsSL https://ollama.com/install.sh | sh

Sebagai user biasa run & download model

ollama serve
ollama run llama3


OPTIONAL: Sebagai super user,

sudo su
sudo snap install --beta open-webui


Contoh

curl http://localhost:11434/api/generate -d '{
  "model" : "llama3",
  "prompt" : "tell me a joke",
  "stream" : false
  }'
  


Referensi