Ubuntu+deepseek+Dify+xinference+RAGFLOW本地部署
1.deepseek本地部署
在Ollama官网下载
需要魔法下载
curl -fsSL https://ollama.com/install.sh | sh在官网找到需要下载的deepseek模型版本
复制命令到终端
ollama run deepseek-r1:7b停止ollama服务
sudo systemctl stop ollama # sudo systemctl stop ollama.service开启ollama服务
sudo systemctl start ollama.service查看ollama服务状态
sudo systemctl status ollama.service使用allama_gui
一个简易界面来使用模型
- 安装:python -m pip install ollama_gui
- 运行:python -m ollama_gui
2.Dify本地部署
安装好docker
git clone https://github.com/langgenius/dify.gitcd dify cd docker cp .env.example .env ######### #在.env文件的最后添加 #启用自定义模型 CUSTOM_MODEL_ENABLED=true #指定Ollama的API地址(根据部署环境调整IP) OLLAMA_API_BASE_URL=host.docker.internal:11434OLLAMA_API_BASE_URL=host.docker.internal:11434 ######## docker compose up -d此处若报错
+] Running 9/9 ✘ sandbox Error Cannot connect to the Docker daemon at unix:///var... 3.8s ✘ api Error Cannot connect to the Docker daemon at unix:///var/run... 3.8s ✘ worker Error Cannot connect to the Docker daemon at unix:///var/... 3.8s ✘ weaviate Error Cannot connect to the Docker daemon at unix:///va... 3.8s ✘ web Error Cannot connect to the Docker daemon at unix:///var/run... 3.8s ✘ db Error Cannot connect to the Docker daemon at unix:///var/run/... 3.8s ✘ ssrf_proxy Error Get "h