<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>llmnet.nl – Guide</title><link>https://gids.llmnet.nl/en/</link><description>Latest articles from Guide on llmnet.nl, the knowledge network on AI and LLMs.</description><language>en</language><lastBuildDate>Fri, 13 Nov 2026 18:08:31 +0000</lastBuildDate><atom:link href="https://gids.llmnet.nl/en/feed.xml" rel="self" type="application/rss+xml"/><item><title>Setting up AnythingLLM as a desktop workspace</title><link>https://gids.llmnet.nl/en/anythingllm-opzetten-als-complete-desktop-werkplek</link><guid isPermaLink="true">https://gids.llmnet.nl/en/anythingllm-opzetten-als-complete-desktop-werkplek</guid><pubDate>Sun, 23 Aug 2026 00:00:00 +0000</pubDate><description>Complete guide to AnythingLLM as a desktop workplace. Connect local models, manage vector storage, and search documents 100% privately.</description></item><item><title>Installing Kobold.cpp for local GGUF inference</title><link>https://gids.llmnet.nl/en/kobold-cpp-installeren-voor-lokale-gguf-inferentie</link><guid isPermaLink="true">https://gids.llmnet.nl/en/kobold-cpp-installeren-voor-lokale-gguf-inferentie</guid><pubDate>Sun, 23 Aug 2026 00:00:00 +0000</pubDate><description>A guide to Kobold.cpp: install the standalone GGUF engine, configure GPU offloading and run local language models with context optimization.</description></item><item><title>Power Limits and Fan Curves for GPU Servers</title><link>https://gids.llmnet.nl/en/power-limits-en-fancurves-instellen-voor-gpu-servers</link><guid isPermaLink="true">https://gids.llmnet.nl/en/power-limits-en-fancurves-instellen-voor-gpu-servers</guid><pubDate>Sun, 23 Aug 2026 00:00:00 +0000</pubDate><description>Practical guide to power limits, persistence mode, and fan curves on Linux GPU servers for energy-efficient, quiet, and thermally stable AI inference.</description></item><item><title>Configuring ExLlamaV2 for maximum EXL2 speed</title><link>https://gids.llmnet.nl/en/exllamav2-configureren-voor-maximale-exl2-snelheid</link><guid isPermaLink="true">https://gids.llmnet.nl/en/exllamav2-configureren-voor-maximale-exl2-snelheid</guid><pubDate>Sat, 22 Aug 2026 00:00:00 +0000</pubDate><description>Optimize ExLlamaV2 and EXL2 quantization for maximum token speed on Nvidia GPUs with FlashAttention-2, cache tuning, and speculative sampling.</description></item><item><title>Installing and configuring Jan AI on Windows</title><link>https://gids.llmnet.nl/en/jan-ai-installeren-en-lokaal-configureren-op-windows</link><guid isPermaLink="true">https://gids.llmnet.nl/en/jan-ai-installeren-en-lokaal-configureren-op-windows</guid><pubDate>Sat, 22 Aug 2026 00:00:00 +0000</pubDate><description>Guide to Jan AI on Windows: install the desktop app, configure Vulkan or CUDA GPU offloading, and manage local open-source models.</description></item><item><title>KV cache quantization in llama.cpp and vLLM</title><link>https://gids.llmnet.nl/en/kv-cache-kwantisatie-instellen-in-llama-cpp-en-vllm</link><guid isPermaLink="true">https://gids.llmnet.nl/en/kv-cache-kwantisatie-instellen-in-llama-cpp-en-vllm</guid><pubDate>Sat, 22 Aug 2026 00:00:00 +0000</pubDate><description>Save VRAM and extend your context length by quantizing the KV cache to FP8 or INT4 in llama.cpp and vLLM, with concrete runtime parameters and instructions.</description></item><item><title>Installing Tabby as a local code assistant with Docker</title><link>https://gids.llmnet.nl/en/tabby-als-lokale-code-assistent-installeren-met-docker</link><guid isPermaLink="true">https://gids.llmnet.nl/en/tabby-als-lokale-code-assistent-installeren-met-docker</guid><pubDate>Sat, 22 Aug 2026 00:00:00 +0000</pubDate><description>Learn step by step how to install Tabby as a self-hosted AI code assistant with Docker and GPU support for VS Code and JetBrains.</description></item><item><title>Compiling llama.cpp with CUDA: maximum performance</title><link>https://gids.llmnet.nl/en/llama-cpp-compileren-met-cuda-voor-maximale-prestaties</link><guid isPermaLink="true">https://gids.llmnet.nl/en/llama-cpp-compileren-met-cuda-voor-maximale-prestaties</guid><pubDate>Fri, 21 Aug 2026 00:00:00 +0000</pubDate><description>Learn step by step how to compile llama.cpp with Nvidia CUDA support for maximum token throughput and minimal latency on a Linux system.</description></item><item><title>Building local function calling with Ollama and Python</title><link>https://gids.llmnet.nl/en/lokale-function-calling-bouwen-met-ollama-en-python</link><guid isPermaLink="true">https://gids.llmnet.nl/en/lokale-function-calling-bouwen-met-ollama-en-python</guid><pubDate>Fri, 21 Aug 2026 00:00:00 +0000</pubDate><description>Build reliable local function calling with Ollama and Python. Learn schema validation, Pydantic models, error handling and tool calling pipelines.</description></item><item><title>Automatically anonymizing personal data with AI</title><link>https://gids.llmnet.nl/en/gevoelige-persoonsgegevens-automatisch-anonimiseren-met-ai</link><guid isPermaLink="true">https://gids.llmnet.nl/en/gevoelige-persoonsgegevens-automatisch-anonimiseren-met-ai</guid><pubDate>Thu, 20 Aug 2026 00:00:00 +0000</pubDate><description>Automatically anonymizing and pseudonymizing personal data with local AI, Microsoft Presidio, NER, and LLMs in compliance with the GDPR.</description></item><item><title>Adding local re-ranking to your RAG search pipeline</title><link>https://gids.llmnet.nl/en/lokale-re-ranking-toevoegen-aan-je-rag-zoekpipeline</link><guid isPermaLink="true">https://gids.llmnet.nl/en/lokale-re-ranking-toevoegen-aan-je-rag-zoekpipeline</guid><pubDate>Thu, 20 Aug 2026 00:00:00 +0000</pubDate><description>Improve the precision of your local RAG pipeline with cross-encoders and local re-ranking through FlashRank and ONNX without sending data to the cloud.</description></item><item><title>Running local vision models for image analysis</title><link>https://gids.llmnet.nl/en/lokale-vision-modellen-draaien-voor-beeldanalyse</link><guid isPermaLink="true">https://gids.llmnet.nl/en/lokale-vision-modellen-draaien-voor-beeldanalyse</guid><pubDate>Thu, 20 Aug 2026 00:00:00 +0000</pubDate><description>Complete guide to running vision models locally with Ollama and vLLM for OCR, diagram analysis, and privacy-friendly image processing.</description></item><item><title>Nginx reverse proxy with authentication for your LLM</title><link>https://gids.llmnet.nl/en/nginx-reverse-proxy-met-authenticatie-voor-je-lokale-llm</link><guid isPermaLink="true">https://gids.llmnet.nl/en/nginx-reverse-proxy-met-authenticatie-voor-je-lokale-llm</guid><pubDate>Thu, 20 Aug 2026 00:00:00 +0000</pubDate><description>Secure your local LLM server with Nginx, Bearer API keys, TLS encryption, streaming support, and rate limiting against overload.</description></item><item><title>Configuring speculative decoding for faster LLM tokens</title><link>https://gids.llmnet.nl/en/speculative-decoding-instellen-voor-snellere-llm-tokens</link><guid isPermaLink="true">https://gids.llmnet.nl/en/speculative-decoding-instellen-voor-snellere-llm-tokens</guid><pubDate>Wed, 19 Aug 2026 00:00:00 +0000</pubDate><description>Practical guide to configuring speculative decoding in llama.cpp, vLLM, and Ollama with draft models for maximum token throughput.</description></item><item><title>Installing Text Generation WebUI on Linux</title><link>https://gids.llmnet.nl/en/text-generation-webui-installeren-op-een-linux-server</link><guid isPermaLink="true">https://gids.llmnet.nl/en/text-generation-webui-installeren-op-een-linux-server</guid><pubDate>Wed, 19 Aug 2026 00:00:00 +0000</pubDate><description>Install Text Generation WebUI (oobabooga) on a Linux server. Practical guide covering CUDA, loaders, CLI flags, and network configuration.</description></item><item><title>Combining Two GPUs for Local Language Models</title><link>https://gids.llmnet.nl/en/twee-gpu-s-combineren-voor-grotere-lokale-taalmodellen</link><guid isPermaLink="true">https://gids.llmnet.nl/en/twee-gpu-s-combineren-voor-grotere-lokale-taalmodellen</guid><pubDate>Wed, 19 Aug 2026 00:00:00 +0000</pubDate><description>Practical guide to dual-GPU setups: tensor and pipeline parallelism, PCIe bandwidth, VRAM pooling, and configuration in llama.cpp and vLLM.</description></item><item><title>Local LLMs on Windows/WSL: Installation and Differences</title><link>https://gids.llmnet.nl/en/lokale-llm-s-op-windows-wsl-installatie-en-verschillen</link><guid isPermaLink="true">https://gids.llmnet.nl/en/lokale-llm-s-op-windows-wsl-installatie-en-verschillen</guid><pubDate>Sun, 16 Aug 2026 00:00:00 +0000</pubDate><description>Discover whether local LLMs run better on native Windows or through WSL2. Compare performance, installation steps, and hardware integration.</description></item><item><title>Outsourcing AI tasks smartly through a proxy and routing</title><link>https://gids.llmnet.nl/en/deepseek-harness-kimi-claude-uitbesteding</link><guid isPermaLink="true">https://gids.llmnet.nl/en/deepseek-harness-kimi-claude-uitbesteding</guid><pubDate>Sat, 15 Aug 2026 00:00:00 +0000</pubDate><description>Learn how, as an indie developer, to delegate programming tasks to specialized models via an OpenAI proxy, including logging and per-task cost control.</description></item><item><title>Running RAG locally: from embedding to answer</title><link>https://gids.llmnet.nl/en/lokaal-rag-draaien-van-embedding-tot-antwoord</link><guid isPermaLink="true">https://gids.llmnet.nl/en/lokaal-rag-draaien-van-embedding-tot-antwoord</guid><pubDate>Sat, 15 Aug 2026 00:00:00 +0000</pubDate><description>Build a complete local RAG pipeline without the cloud. From text parsing and embedding models to vector storage, reranking, and contextual synthesis.</description></item><item><title>Local models in Docker: containers without the hassle</title><link>https://gids.llmnet.nl/en/lokale-modellen-in-docker-containers-zonder-gedoe</link><guid isPermaLink="true">https://gids.llmnet.nl/en/lokale-modellen-in-docker-containers-zonder-gedoe</guid><pubDate>Sat, 15 Aug 2026 00:00:00 +0000</pubDate><description>Run local AI models in isolation with Docker and GPU passthrough via the NVIDIA Container Toolkit. A complete guide with compose files and optimizations.</description></item><item><title>Tracking model updates locally: version control for LLMs</title><link>https://gids.llmnet.nl/en/model-updates-lokaal-bijhouden-van-welke-versie-draai-je</link><guid isPermaLink="true">https://gids.llmnet.nl/en/model-updates-lokaal-bijhouden-van-welke-versie-draai-je</guid><pubDate>Sat, 15 Aug 2026 00:00:00 +0000</pubDate><description>Learn how to manage local model versions, GGUF hashes and Ollama tags, prevent update regression and roll back automatically on your own hardware.</description></item><item><title>Quantization in Practice: Compressing Models Yourself</title><link>https://gids.llmnet.nl/en/quantisatie-in-de-praktijk-zelf-een-model-comprimeren</link><guid isPermaLink="true">https://gids.llmnet.nl/en/quantisatie-in-de-praktijk-zelf-een-model-comprimeren</guid><pubDate>Sat, 15 Aug 2026 00:00:00 +0000</pubDate><description>Learn step by step how to convert open-source language models to GGUF and quantize them yourself using llama.cpp for optimal local performance.</description></item><item><title>VRAM calculator: how much memory does a model need?</title><link>https://gids.llmnet.nl/en/vram-rekenhulp-hoeveel-geheugen-heeft-welk-model-nodig</link><guid isPermaLink="true">https://gids.llmnet.nl/en/vram-rekenhulp-hoeveel-geheugen-heeft-welk-model-nodig</guid><pubDate>Sat, 15 Aug 2026 00:00:00 +0000</pubDate><description>Calculate exactly how much VRAM a local LLM requires. Formulas for model parameters, quantization, context length, KV cache, and CUDA overhead.</description></item><item><title>Setting up Continue.dev with local models in VS Code</title><link>https://gids.llmnet.nl/en/lokale-code-assistent-continue-dev</link><guid isPermaLink="true">https://gids.llmnet.nl/en/lokale-code-assistent-continue-dev</guid><pubDate>Sun, 09 Aug 2026 00:00:00 +0000</pubDate><description>Learn how to set up Continue.dev in VS Code with local open-weight language models via Ollama for maximum privacy and free code generation.</description></item><item><title>Choosing an embedding model for Dutch documents</title><link>https://gids.llmnet.nl/en/welk-embeddingmodel-kies-je-voor-nederlandse-documenten</link><guid isPermaLink="true">https://gids.llmnet.nl/en/welk-embeddingmodel-kies-je-voor-nederlandse-documenten</guid><pubDate>Sun, 09 Aug 2026 00:00:00 +0000</pubDate><description>Find out which embedding model performs best for Dutch-language documents in a local RAG setup. With benchmarks, memory requirements, and practical tips.</description></item><item><title>When it does not work: out-of-memory, slow tokens and a GPU that stays out of it</title><link>https://gids.llmnet.nl/en/als-het-niet-werkt-out-of-memory-trage-tokens-en-een-gpu-die-niet-meed</link><guid isPermaLink="true">https://gids.llmnet.nl/en/als-het-niet-werkt-out-of-memory-trage-tokens-en-een-gpu-die-niet-meed</guid><pubDate>Fri, 07 Aug 2026 00:00:00 +0000</pubDate><description>Troubleshooting article for local LLM setups: out-of-memory, slow tokens and a GPU that stays out of it, with a diagnostic step-by-step plan and solutions per platform.</description></item><item><title>Configuring GPU Passthrough in Proxmox for LLMs</title><link>https://gids.llmnet.nl/en/llm-gpu-passthrough-proxmox</link><guid isPermaLink="true">https://gids.llmnet.nl/en/llm-gpu-passthrough-proxmox</guid><pubDate>Fri, 07 Aug 2026 00:00:00 +0000</pubDate><description>Learn how to configure GPU passthrough in Proxmox VE for local LLMs. A complete step-by-step plan for IOMMU, VFIO, and PCIe assignment.</description></item><item><title>Local or via an API? The three-year calculation</title><link>https://gids.llmnet.nl/en/lokaal-of-via-een-api-de-rekensom-over-drie-jaar</link><guid isPermaLink="true">https://gids.llmnet.nl/en/lokaal-of-via-een-api-de-rekensom-over-drie-jaar</guid><pubDate>Fri, 07 Aug 2026 00:00:00 +0000</pubDate><description>Local or via an API? A three-year cost calculation: depreciation, electricity, and management versus price per million tokens. Verified on 2026-08-07.</description></item><item><title>Local LLM&#x27;s op Apple Silicon: unified memory, MLX en Ollama vergeleken</title><link>https://gids.llmnet.nl/en/lokale-llm-s-op-apple-silicon-unified-memory-mlx-en-ollama-vergeleken</link><guid isPermaLink="true">https://gids.llmnet.nl/en/lokale-llm-s-op-apple-silicon-unified-memory-mlx-en-ollama-vergeleken</guid><pubDate>Fri, 07 Aug 2026 00:00:00 +0000</pubDate><description>How unified memory changes the VRAM calculus for local LLMs on Apple Silicon: Ollama, MLX, and LM Studio compared for setup and model selection.</description></item><item><title>Running Dutch and European open models locally</title><link>https://gids.llmnet.nl/en/nederlandse-en-europese-open-modellen-lokaal-draaien</link><guid isPermaLink="true">https://gids.llmnet.nl/en/nederlandse-en-europese-open-modellen-lokaal-draaien</guid><pubDate>Fri, 07 Aug 2026 00:00:00 +0000</pubDate><description>Running Dutch and European open models locally: what exists, how to test whether a model really speaks good Dutch. Checked on 2026-08-07.</description></item><item><title>Enforcing Structured JSON Outputs in Local LLMs</title><link>https://gids.llmnet.nl/en/structured-outputs-lokale-llm</link><guid isPermaLink="true">https://gids.llmnet.nl/en/structured-outputs-lokale-llm</guid><pubDate>Fri, 07 Aug 2026 00:00:00 +0000</pubDate><description>Enforce valid JSON in local LLMs: JSON schemas in Ollama, LM Studio, and vLLM, GBNF grammars in llama.cpp, plus schema design and error handling.</description></item><item><title>Setting context length for local LLMs | Guide llmnet.nl</title><link>https://gids.llmnet.nl/en/context-window-optimaliseren-lokaal</link><guid isPermaLink="true">https://gids.llmnet.nl/en/context-window-optimaliseren-lokaal</guid><pubDate>Thu, 06 Aug 2026 00:00:00 +0000</pubDate><description>Discover how to set context length optimally when running LLMs locally, avoid memory problems, and balance GPU and RAM memory.</description></item><item><title>Deploying LM Studio Headless as a Server | llmnet.nl Guide</title><link>https://gids.llmnet.nl/en/lm-studio-headless-server</link><guid isPermaLink="true">https://gids.llmnet.nl/en/lm-studio-headless-server</guid><pubDate>Thu, 06 Aug 2026 00:00:00 +0000</pubDate><description>Learn how to use LM Studio without a graphical user interface as an OpenAI-compatible API server on macOS and Linux. Complete with background services and…</description></item><item><title>Measuring the energy consumption of your local LLM setup</title><link>https://gids.llmnet.nl/en/lokale-llm-energieverbruik-meten</link><guid isPermaLink="true">https://gids.llmnet.nl/en/lokale-llm-energieverbruik-meten</guid><pubDate>Thu, 06 Aug 2026 00:00:00 +0000</pubDate><description>Learn step by step how to measure the exact energy consumption of your local LLM setup at hardware level, through the CLI and with smart plugs.</description></item><item><title>Local Fine-Tuning with LoRA: Practical Guide | LLMnet</title><link>https://gids.llmnet.nl/en/lokale-llm-fine-tuning-lora</link><guid isPermaLink="true">https://gids.llmnet.nl/en/lokale-llm-fine-tuning-lora</guid><pubDate>Thu, 06 Aug 2026 00:00:00 +0000</pubDate><description>A practical guide to fine-tuning LLMs locally with LoRA. Learn all about data preparation, hyperparameter settings, and evaluating adapters.</description></item><item><title>Local LLM Servers Secure on Your Network | Guide</title><link>https://gids.llmnet.nl/en/lokale-llm-netwerk-beveiliging</link><guid isPermaLink="true">https://gids.llmnet.nl/en/lokale-llm-netwerk-beveiliging</guid><pubDate>Thu, 06 Aug 2026 00:00:00 +0000</pubDate><description>Read how to configure local LLM servers securely within your network. Prevent unauthorized access, connect a reverse proxy, and set up network segmentation.</description></item><item><title>Setting up a local vector database: Qdrant and Chroma</title><link>https://gids.llmnet.nl/en/lokale-vector-database-opzetten</link><guid isPermaLink="true">https://gids.llmnet.nl/en/lokale-vector-database-opzetten</guid><pubDate>Thu, 06 Aug 2026 00:00:00 +0000</pubDate><description>Practical guide to setting up and configuring Chroma and Qdrant locally. Learn about databases versus files, docker setups, and metadata.</description></item><item><title>Configuring vLLM for high throughput on Linux</title><link>https://gids.llmnet.nl/en/vllm-server-configureren</link><guid isPermaLink="true">https://gids.llmnet.nl/en/vllm-server-configureren</guid><pubDate>Thu, 06 Aug 2026 00:00:00 +0000</pubDate><description>Read how to set up vLLM on Linux for optimal throughput with multiple concurrent requests. A guide to memory management, batching and security.</description></item><item><title>Editing an Ollama Modelfile: system prompt and parameters</title><link>https://gids.llmnet.nl/en/ollama-model-file-aanpassen</link><guid isPermaLink="true">https://gids.llmnet.nl/en/ollama-model-file-aanpassen</guid><pubDate>Wed, 05 Aug 2026 00:00:00 +0000</pubDate><description>Learn how to set the system prompt and parameters with an Ollama Modelfile. An extensive guide with examples, parameter explanations and management.</description></item><item><title>Comparing models fairly on your own hardware</title><link>https://gids.llmnet.nl/en/modellen-vergelijken-op-eigen-hardware</link><guid isPermaLink="true">https://gids.llmnet.nl/en/modellen-vergelijken-op-eigen-hardware</guid><pubDate>Mon, 03 Aug 2026 00:00:00 +0000</pubDate><description>A step-by-step plan for testing LLMs objectively on your own hardware: fixing variables, measuring speed and quality, and avoiding faulty comparisons.</description></item></channel></rss>
