AI News HubLIVE
站內改寫3 分鐘閱讀

待翻譯:Unsloth Desktop

AI 服務暫時不可用,以下為來源摘要,待恢復後補全翻譯:For the complete documentation index, see llms.txt. This page is also available as Markdown. Introducing Unsloth Desktop Unsloth Desktop (Beta) is a free, open-source app for running and training AI models on your own l…

來源Hacker News AI作者: sequence7

AI 服務暫時不可用,以下為來源正文,待恢復後補全翻譯。

For the complete documentation index, see llms.txt. This page is also available as Markdown. Introducing Unsloth Desktop Unsloth Desktop (Beta) is a free, open-source app for running and training AI models on your own local hardware. Available for macOS, Windows, and Linux. Unsloth lets you run, train and deploy LLMs, diffusion image/video, MLX, GGUF and audio models. Download Unsloth DesktopFeaturesGitHub Features ✨ Accurate tool calls Get 50% more accurate, self-healing tool calls and sandboxed code execution Diffusion image/video Run and train image/video diffusion models like MiniMax H3 with 2× faster inference. Make your agent local Connect local LLMs to agentic tools like Claude Code and Codex with model swapping Unlimited Web search Get unlimited, private and secure web search and deep research Run the latest models Discover, manage and train the latest Muse Glimmer, MiniMax-H3, Kimi K3, Qwen3.8 models. Deploy anywhere Securely deploy models remotely and access Unsloth anywhere via Cloudflare HTTPS Get started 🦥 Install Unsloth Desktop, download a model, and start chatting in minutes. Download Unsloth Desktop:macOSWindowsLinux and WSL 1 Install Unsloth Desktop Download Unsloth Desktop Install the app for macOS, Windows, or Linux Launch the app 2 Choose a model Open 'Select model' dropdown ontop or 'Model hub' tab, choose a model and a quantization that fits your device, then download it. Once it finishes, start chatting - no setup required. 3 Unsloth is now ready To chat, type a message and press Enter. Connect tools: Claude Code, Codex, web search, MCP and more Train models: Fine-tune text, diffusion, embedding, and more Generate media: Create and train images, video, TTS locally Feature Deep Dive ⭐ See everything Unsloth Desktop has to offer: Image and Video Generation Create images with MiniMax-H3, FLUX, Z-Image and fine-tuned LoRA adapters. Generate video with Wan and LTX models. Transform, inpaint, extend, upscale, reference and edit existing images. Code execution Get up to 50% more accurate tool-calling with self-healing tool calls that detect, repair and retry failures automatically. Execute Bash and Python in a secure sandbox so models can run code, test results and complete real tasks locally. Access model anywhere Serve your local or Colab models over HTTPS through Unsloth's free Cloudflare tunnel. Check a run from your phone, your laptop, or anywhere else you happen to be. Bind the app to your network with -H 0.0.0.0, or open a free Cloudflare tunnel for HTTPS: Use the Latest models You can run and train nearly every model, including upcoming ones. Expect Day Zero support for models like Qwen3.8, Gemma, Meta, NVIDIA, GLM, Gemma models and more. It's all thanks to llama.cpp and Hugging Face and we're also proud to contribute back to the ecosystem. Kimi K3 DeepSeek V4 Qwen3.6 GLM-5.2 Gemma 4 MiniMax M3 DiffusionGemma Deep Research Normal search utilises the web for its answers and happens while the model is still thinking. Deep research plans first, searches for the best sources, then produces a detailed report with all citations. Train Diffusion Models Train LoRA adapters for SDXL, FLUX.2, Qwen-Image and Z-Image on your own images. Caption them in Studio, pick a rank, and hit train. Train with no code Drop in a PDF, CSV or JSON and go. LoRA, full fine-tuning, pretraining. All 2x faster, 70% less VRAM, no accuracy loss. Multi-GPU and latest models work. Text, diffusion, audio and image models are supported! Transcribe/generate audio Generate, fine-tune or transcribe audio with Unsloth completely locally. Text-to-speech, speech-to-text, Whisper, Qwen3-ASR, you name it! Use Cloud Models Run models from OpenAI, Anthropic, Ollama, llama.cpp, vLLM, and more. Use the same Unsloth chat interface for local and cloud models with support for tool-calling, image gen, prompt caching to reduce token usage while preserving provider-native features like OpenAI’s web search and code execution. Connect your Agent Unsloth Start lets you connect Claude Code, Codex and other agents to local models via the unsloth start command. Start Unsloth, load a model, open your project folder, and then run: Codex Hermes Agent OpenClaw Unsloth API OpenCode Frequently asked questions Do you collect my data? No telemetry. Unsloth detects your GPU type and device so the app can know what works. The app can run entirely offline. Can I use models I already downloaded? Yes, they are found automatically. If yours are not you can specify your own custom folders. Why is inference slower sometimes? Web search, code execution and tool-call healing all cost time. Turn them off and speed should match any other llama.cpp app. Still slow? Open a GitHub issue. GPU only? No. Unsloth works on a wide variety of CPU, Mac etc setups. Does it support OpenAI-compatible APIs? Yes. See the API guide. We also support connection to Cloud models or other APIs like Anthropic or OpenAI. What devices does Unsloth support? Unsloth supports all OS including Mac, Windows, Linux and WSL and supports NVIDIA, Intel, AMD and Mac GPUs/CPUs. Older hardware however may not be well supported. A huge thank you to NVIDIA and Hugging Face for being part of our launch. Also thanks to all of our early beta testers for Unsloth Desktop, we truly appreciate your time and feedback. We’d also like to thank llama.cpp, PyTorch, stablediffusion.cpp, and open model labs for providing the infrastructure that made Unsloth Desktop possible. PreviousHomepageNextModels