{"id":69088,"date":"2025-05-21T07:00:00","date_gmt":"2025-05-21T14:00:00","guid":{"rendered":"https:\/\/dhblog.dream.press\/blog\/?p=69088"},"modified":"2025-05-26T11:28:55","modified_gmt":"2025-05-26T18:28:55","slug":"local-ai-hosting","status":"publish","type":"post","link":"https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/","title":{"rendered":"Everything You Need To Know To Start Hosting Your Own AI Models Locally"},"content":{"rendered":"\n<p>Sending your data off to someone else\u2019s cloud to run an AI model can feel like handing your house keys to a stranger. There&#8217;s always the chance that you&#8217;ll come home to find that they absconded with all your valuables or left a giant mess for you to clean up (at your cost, of course). Or what if they changed the locks and now you can&#8217;t even get back in?!<\/p>\n\n\n\n<p>If you\u2019ve ever wanted more control or peace of mind over your AI, the solution might be right under your nose: hosting AI models locally. Yes, on your own hardware and under <em>your<\/em> own roof (physical or virtual). It\u2019s kind of like deciding to cook your favorite dish at home instead of ordering takeout. You know exactly what goes into it; you fine-tune the recipe, and you can eat anytime you want \u2014 no depending on anyone else to get it right.<\/p>\n\n\n\n<p>In this guide, we\u2019ll break down why local AI hosting could transform the way you work, what hardware and software you need, how to do it step by step, and best practices to keep everything running smoothly. Let\u2019s dive in and give you the power to <a href=\"https:\/\/www.dreamhost.com\/blog\/how-to-use-ai\/\">run AI&nbsp;on your own terms<\/a>.<\/p>\n\n\n\n<h2 id=\"h-what-is-locally-hosted-ai-and-why-you-should-care\" class=\"wp-block-heading\">What Is Locally Hosted AI (and Why You Should Care)<\/h2>\n\n\n\n<p>Locally hosted AI means running machine learning models directly on equipment you own or fully control. You can use a home workstation with a decent GPU, a dedicated server in your office, or even a rented bare-metal machine, if that suits you better.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1600\" height=\"905\" data-src=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/01_locally_hosted_ai_vs_cloud_hosted_ai.webp\" alt=\"Locally hosted ai vs cloud hosted ai\" class=\"wp-image-69103 lazyload\" data-srcset=\"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/01_locally_hosted_ai_vs_cloud_hosted_ai.webp 1600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/01_locally_hosted_ai_vs_cloud_hosted_ai-300x170.webp 300w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/01_locally_hosted_ai_vs_cloud_hosted_ai-1024x579.webp 1024w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/01_locally_hosted_ai_vs_cloud_hosted_ai-768x434.webp 768w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/01_locally_hosted_ai_vs_cloud_hosted_ai-1536x869.webp 1536w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/01_locally_hosted_ai_vs_cloud_hosted_ai-600x339.webp 600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/01_locally_hosted_ai_vs_cloud_hosted_ai-1200x679.webp 1200w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/01_locally_hosted_ai_vs_cloud_hosted_ai-730x413.webp 730w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/01_locally_hosted_ai_vs_cloud_hosted_ai-1460x826.webp 1460w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/01_locally_hosted_ai_vs_cloud_hosted_ai-784x443.webp 784w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/01_locally_hosted_ai_vs_cloud_hosted_ai-1568x887.webp 1568w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/01_locally_hosted_ai_vs_cloud_hosted_ai-877x496.webp 877w\" data-sizes=\"(max-width: 1600px) 100vw, 1600px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 1600px; --smush-placeholder-aspect-ratio: 1600\/905;\" \/><\/figure>\n\n\n\n<p>Why does this matter? A few important reasons\u2026<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Privacy and data control:<\/strong> No shipping sensitive information off to third-party servers. You hold the keys.<\/li>\n\n\n\n<li><strong>Faster response times:<\/strong> Your data never leaves your network, so you skip the round-trip to the cloud.<\/li>\n\n\n\n<li><strong>Customization:<\/strong> Tweak, fine-tune, or even re-architect your models however you see fit.<\/li>\n\n\n\n<li><strong>Reliability: <\/strong><a href=\"https:\/\/help.dreamhost.com\/hc\/en-us\/sections\/360008717711-Site-Downtime\">Avoid downtime<\/a> or usage limits that cloud AI providers impose.<\/li>\n<\/ul>\n\n\n\n<p>Of course, hosting AI yourself means you\u2019ll manage your own infrastructure, updates, and potential fixes. But if you want to make sure your AI is <em>truly<\/em> yours, local hosting is a game-changer.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td>Pros<\/td><td>Cons<\/td><\/tr><tr><td><strong>Security and data privacy: <\/strong>You\u2019re not sending proprietary data to external APIs. For many small businesses dealing with user info or internal analytics, that\u2019s a huge plus for compliance and peace of mind.<br><br><strong>Control and customization:<\/strong> You\u2019re free to choose models, tailor hyperparameters, and experiment with different frameworks. You\u2019re not bound by vendor constraints or forced updates that might break your workflows.<br><br><strong>Performance and speed:<\/strong> For real-time services, like a live chatbot or on-the-fly content generation, local hosting can eliminate latency issues. You can even optimize hardware specifically for your model\u2019s needs.<br><br><strong>Potentially lower long-term costs:<\/strong> If you handle large volumes of AI tasks, cloud fees can add up quickly. Owning the hardware might be cheaper over time, especially for high usage.<\/td><td><strong>Initial hardware costs:<\/strong> Quality GPUs and sufficient RAM can be pricey. For a small business, that could eat up some budget.<br><br><strong>Maintenance overhead:<\/strong> You handle OS updates, framework upgrades, and security patches. Or you hire someone to do it.<br><br><strong>Expertise required:<\/strong> Troubleshooting driver issues, configuring environment variables, and optimizing GPU usage might be tricky if you\u2019re new to AI or systems administration.<br><br><strong>Energy use and cooling:<\/strong> Big models can demand a lot of power. Plan for electricity costs and suitable ventilation if you\u2019re running them around the clock.<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h2 id=\"h2_assessing-hardware-requirements\" class=\"wp-block-heading\">Assessing Hardware Requirements<\/h2>\n\n\n\n<p>Getting your physical setup right is one of the biggest steps toward successful local AI hosting. You don\u2019t want to invest time (and money) into configuring an AI model, only to discover your GPU can\u2019t handle the load or your server overheats.&nbsp;<\/p>\n\n\n\n<p>So, before you dive into the details of installation and model fine-tuning, it\u2019s worth mapping out exactly what sort of hardware you\u2019ll need.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Why Hardware Matters for Local AI<\/h3>\n\n\n\n<p>When you\u2019re hosting AI locally, performance largely boils down to how powerful (and compatible) your hardware is. A robust CPU can manage simpler tasks or smaller machine learning models, but deeper models often need GPU acceleration to handle the intense parallel computations. If your hardware is underpowered, you\u2019ll see slow inference times, choppy performance, or you might fail to load large models altogether.<\/p>\n\n\n\n<p>That doesn\u2019t mean you need a supercomputer. Many modern mid-range GPUs can handle medium-scale AI tasks \u2014 it\u2019s all about matching your model\u2019s demands to your budget and usage patterns.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Key Considerations<\/h3>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"h-1-cpu-vs-gpu\">1. <strong>CPU vs. GPU<\/strong><\/h4>\n\n\n\n<p>Some AI operations (like basic classification or smaller language model queries) can run on a solid CPU alone. However, if you want real-time chat interfaces, text generation, or image synthesis, a GPU is a near-must.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"h-2-memory-ram-and-storage\"><strong>2. Memory (RAM) and Storage<\/strong><\/h4>\n\n\n\n<p>Large language models can easily consume tens of gigabytes. Aim for 16GB or 32GB system RAM for moderate usage. If you plan to load multiple models or train new ones, 64GB+ might be beneficial.<\/p>\n\n\n\n<p>An SSD is also strongly recommended \u2014 loading models from spinning HDDs slow everything down. A 512GB SSD or larger is common, depending on how many model checkpoints you store.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"h-3-server-vs-workstation\"><strong>3. Server vs. Workstation<\/strong><\/h4>\n\n\n\n<p>If you\u2019re just experimenting or only need AI occasionally, a powerful desktop might do the job. Plug in a mid-range GPU and you\u2019re set. For 24\/7 uptime, consider a dedicated server with proper cooling, redundant power supplies, and possibly ECC (error-correcting) RAM for stability.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"h-4-hybrid-cloud-approach\"><strong>4. Hybrid Cloud Approach<\/strong><\/h4>\n\n\n\n<p>Not everyone has the physical space or desire to manage a noisy GPU rig. You can still \u201cgo local\u201d by renting or purchasing a dedicated server from a hosting provider that supports GPU hardware. That way, you get full control over your environment without physically maintaining the box.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td>Consideration<\/td><td>Key Takeaway<\/td><\/tr><tr><td>CPU vs.GPU<\/td><td>CPUs work for light tasks, but GPUs are essential for real-time or heavy AI.<\/td><\/tr><tr><td>Memory and Storage<\/td><td>16\u201332GB RAM is baseline; SSDs are a must for speed and efficiency.<\/td><\/tr><tr><td>Server vs. Workstation<\/td><td>Desktops are fine for light use; servers are better for uptime and reliability.<\/td><\/tr><tr><td>Hybrid Cloud Approach<\/td><td>Rent GPU servers if space, noise, or hardware management is a concern.<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">Pulling It All Together<\/h3>\n\n\n\n<p>Think about how heavily you\u2019ll use AI. If you see your model constantly in action (like a full-time chatbot or daily <a href=\"https:\/\/www.dreamhost.com\/blog\/what-is-dall-e\/\">image generation for marketing<\/a>), invest in a robust GPU and enough RAM to keep everything running smoothly. If your needs are more exploratory or light usage, a mid-tier GPU card in a standard workstation can deliver decent performance without destroying your budget.<\/p>\n\n\n\n<p>Ultimately, hardware shapes your AI experience. It\u2019s easier to plan carefully up front than to juggle endless system upgrades once you realize your model requires more juice. Even if you start small, keep an eye on your next step: if your local user base or model complexity grows, you\u2019ll want headroom to scale.<\/p>\n\n\n\n<div class=\"article-newsletter article-newsletter--gradient\">\n\n\n<h2>Get Content Delivered Straight to Your Inbox<\/h2><p>Subscribe now to receive all the latest updates, delivered directly to your inbox.<\/p><form class=\"nwsl-form\" id=\"newsletter_block_\" novalidate><div class=\"messages\"><\/div><div class=\"form-group\"><label for=\"input_newsletter_block_\"><input type=\"email\"name=\"email\"id=\"input_newsletter_block_\"placeholder=\"Enter your email address\"novalidatedisabled=\"disabled\"\/><\/label><button type=\"submit\"class=\"btn btn--brand\"disabled=\"disabled\"><span>Sign Me Up!<\/span><svg width=\"21\" height=\"14\" viewBox=\"0 0 21 14\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\">\n<path d=\"M13.8523 0.42524L12.9323 1.34521C12.7095 1.56801 12.7132 1.9304 12.9404 2.14865L16.7241 5.7823H0.5625C0.251859 5.7823 0 6.03416 0 6.3448V7.6573C0 7.96794 0.251859 8.2198 0.5625 8.2198H16.7241L12.9405 11.8535C12.7132 12.0717 12.7095 12.4341 12.9323 12.6569L13.8523 13.5769C14.072 13.7965 14.4281 13.7965 14.6478 13.5769L20.8259 7.39879C21.0456 7.17913 21.0456 6.82298 20.8259 6.60327L14.6477 0.42524C14.4281 0.205584 14.0719 0.205584 13.8523 0.42524Z\" fill=\"white\"\/>\n<\/svg>\n<\/button><\/div><\/form><\/div>\n\n\n<h2 id=\"h2_choosing-the-right-model-and-software\" class=\"wp-block-heading\">Choosing the Right Model (and Software)<\/h2>\n\n\n\n<p>Picking an <a href=\"https:\/\/www.dreamhost.com\/blog\/open-source-ai\/\">open-source AI model<\/a> to run locally might feel like staring at a massive menu (like that phonebook they call a menu at Cheesecake Factory). You\u2019ve got endless options, each with its own flavors and best-use scenarios. While variety <em>is<\/em> the spice of life, it can also be overwhelming.&nbsp;<\/p>\n\n\n\n<p>The key is to nail down what exactly <em>you<\/em> <a href=\"https:\/\/www.dreamhost.com\/blog\/ai-content-creation\/\">need from your AI tools<\/a>: text generation, image synthesis, domain-specific predictions, or something else altogether.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1600\" height=\"919\" data-src=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/02_choose_your_ai_model.webp\" alt=\"\" class=\"wp-image-69102 lazyload\" data-srcset=\"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/02_choose_your_ai_model.webp 1600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/02_choose_your_ai_model-300x172.webp 300w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/02_choose_your_ai_model-1024x588.webp 1024w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/02_choose_your_ai_model-768x441.webp 768w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/02_choose_your_ai_model-1536x882.webp 1536w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/02_choose_your_ai_model-600x345.webp 600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/02_choose_your_ai_model-1200x689.webp 1200w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/02_choose_your_ai_model-730x419.webp 730w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/02_choose_your_ai_model-1460x839.webp 1460w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/02_choose_your_ai_model-784x450.webp 784w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/02_choose_your_ai_model-1568x901.webp 1568w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/02_choose_your_ai_model-877x504.webp 877w\" data-sizes=\"(max-width: 1600px) 100vw, 1600px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 1600px; --smush-placeholder-aspect-ratio: 1600\/919;\" \/><\/figure>\n\n\n\n<p>Your use case drastically narrows the search for the right model. For example, if you want to generate marketing copy, you\u2019d <a href=\"https:\/\/www.dreamhost.com\/blog\/guide-to-generative-ai\/\">explore language models<\/a> like LLaMA derivatives. For visual tasks, you\u2019d look at image-based models such as Stable Diffusion or flux.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Popular Open-Source Models<\/h3>\n\n\n\n<p>Depending on your needs, you should check out the following.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">Language Models<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>LLaMA\/ Alpaca \/ Vicuna:<\/strong> All well-known projects for local hosting. They can handle chat-like interactions or text completion. Check how much VRAM they require (some variants need only ~8GB).<\/li>\n\n\n\n<li><strong>GPT-J \/ GPT-NeoX: <\/strong>Good for pure text generation, though they can be more demanding on your hardware.<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\">Image Models<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Stable Diffusion: <\/strong>A go-to for generating art, product images, or concept designs. It\u2019s widely used and has a massive community offering tutorials, add-ons, and creative expansions.<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\">Domain-Specific Models<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Browse Hugging Face for specialized models (e.g., finance, healthcare, legal). You might find a smaller, domain-tuned model that\u2019s easier to run than a general-purpose giant.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Open Source Frameworks<\/h3>\n\n\n\n<p>You\u2019ll need to load and interact with your chosen model using a framework. Two industry standards dominate:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>PyTorch: <\/strong>Renowned for user-friendly debugging and a huge community. Most new open-source models appear in PyTorch first.<\/li>\n\n\n\n<li><strong>TensorFlow: <\/strong>Backed by Google, stable for production environments, though the learning curve can be steeper in some areas.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Where To Find Models<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/huggingface.co\/docs\/hub\/en\/index\"><strong>Hugging Face Hub<\/strong><\/a><strong>: <\/strong>A massive repository of open-source models. Read community reviews, usage notes, and watch for how actively a model is maintained.<\/li>\n\n\n\n<li><strong>GitHub: <\/strong>Many labs or indie devs post custom AI solutions. Just verify the model\u2019s license and confirm it\u2019s stable enough for your use case.<\/li>\n<\/ul>\n\n\n\n<p>Once you pick your model and framework, take a moment to read the official docs or any example scripts. If your model is super fresh (like a newly released LLaMA variant), be prepared for some potential bugs or incomplete instructions.&nbsp;<\/p>\n\n\n\n<p>The more you understand your model\u2019s nuances, the better you\u2019ll be at deploying, optimizing, and maintaining it in a local environment.<\/p>\n\n\n\n<h2 id=\"h2_step-by-step-guide-how-to-run-ai-models-locally\" class=\"wp-block-heading\">Step-by-Step Guide: How To Run AI Models Locally<\/h2>\n\n\n\n<p>Now you\u2019ve chosen suitable hardware and zeroed in on a model or two. Below is a detailed walkthrough that should get you from a blank server (or workstation) to a functioning AI model you can play with.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Step 1: Prepare Your System<\/h3>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Install Python 3.8+<\/strong><\/li>\n<\/ol>\n\n\n\n<p>&nbsp;Virtually all open-source AI runs on Python these days. On Linux, you might do:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo apt update\nsudo apt install python3 python3-venv python3-pip<\/code><\/pre>\n\n\n\n<p>On Windows or macOS, download from <a href=\"http:\/\/python.org\">python.org<\/a> or use a package manager like Homebrew.<\/p>\n\n\n\n<ol start=\"2\" class=\"wp-block-list\">\n<li><strong>GPU drivers and toolkit<\/strong><\/li>\n<\/ol>\n\n\n\n<p>If you have an NVIDIA GPU, install the latest drivers from the official site or your <a href=\"https:\/\/www.dreamhost.com\/blog\/linux-distros\/\">distro<\/a>\u2019s repository. Then add the CUDA toolkit (matching your GPU\u2019s computation capability) if you want GPU-accelerated PyTorch or TensorFlow.<\/p>\n\n\n\n<ol start=\"3\" class=\"wp-block-list\">\n<li><strong>Optional: Docker or Venv<\/strong><\/li>\n<\/ol>\n\n\n\n<p>If you <a href=\"https:\/\/www.dreamhost.com\/blog\/what-is-docker\/\">prefer containerization, set up Docker<\/a> or Docker Compose. If you like environment managers, use Python <a href=\"https:\/\/docs.python.org\/3\/library\/venv.html\">venv<\/a> to isolate your AI dependencies.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Step 2: Set Up a Virtual Environment<\/h3>\n\n\n\n<p>Virtual environments create isolated environments where you can install or remove libraries and change Python version without affecting your system&#8217;s default Python setup.<\/p>\n\n\n\n<p>This saves you headaches down the line when you have multiple projects running on your computer.<\/p>\n\n\n\n<p>Here is how you can create a virtual environment:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>python3 -m venv localAI\nsource localAI\/bin\/activate<\/code><\/pre>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1600\" height=\"703\" data-src=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/03-Configura-un-ambiente-virtual.jpg\" alt=\"\" class=\"wp-image-69113 lazyload\" data-srcset=\"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/03-Configura-un-ambiente-virtual.jpg.webp 1600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/03-Configura-un-ambiente-virtual-300x132.jpg 300w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/03-Configura-un-ambiente-virtual-1024x450.jpg 1024w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/03-Configura-un-ambiente-virtual-768x337.jpg 768w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/03-Configura-un-ambiente-virtual-1536x675.jpg 1536w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/03-Configura-un-ambiente-virtual-600x264.jpg.webp 600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/03-Configura-un-ambiente-virtual-1200x527.jpg.webp 1200w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/03-Configura-un-ambiente-virtual-730x321.jpg.webp 730w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/03-Configura-un-ambiente-virtual-1460x641.jpg.webp 1460w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/03-Configura-un-ambiente-virtual-784x344.jpg.webp 784w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/03-Configura-un-ambiente-virtual-1568x689.jpg.webp 1568w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/03-Configura-un-ambiente-virtual-877x385.jpg.webp 877w\" data-sizes=\"(max-width: 1600px) 100vw, 1600px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 1600px; --smush-placeholder-aspect-ratio: 1600\/703;\" \/><\/figure>\n\n\n\n<p>You&#8217;ll notice the <strong>localAI<\/strong> prefix to your terminal prompt. That means you are inside the virtual environment and any changes that you make here will not affect your system environment.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Step 3: Install Required Libraries<\/h3>\n\n\n\n<p>Depending on the model\u2019s framework, you\u2019ll want:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>PyTorch<\/strong><\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-code\"><code>pip3 install torch torchvision torchaudio<\/code><\/pre>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1600\" height=\"703\" data-src=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/04-Instala-bibliotecas-necesarias.jpg\" alt=\"\" class=\"wp-image-69114 lazyload\" data-srcset=\"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/04-Instala-bibliotecas-necesarias.jpg.webp 1600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/04-Instala-bibliotecas-necesarias-300x132.jpg 300w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/04-Instala-bibliotecas-necesarias-1024x450.jpg 1024w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/04-Instala-bibliotecas-necesarias-768x337.jpg 768w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/04-Instala-bibliotecas-necesarias-1536x675.jpg 1536w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/04-Instala-bibliotecas-necesarias-600x264.jpg.webp 600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/04-Instala-bibliotecas-necesarias-1200x527.jpg.webp 1200w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/04-Instala-bibliotecas-necesarias-730x321.jpg.webp 730w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/04-Instala-bibliotecas-necesarias-1460x641.jpg.webp 1460w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/04-Instala-bibliotecas-necesarias-784x344.jpg.webp 784w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/04-Instala-bibliotecas-necesarias-1568x689.jpg.webp 1568w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/04-Instala-bibliotecas-necesarias-877x385.jpg.webp 877w\" data-sizes=\"(max-width: 1600px) 100vw, 1600px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 1600px; --smush-placeholder-aspect-ratio: 1600\/703;\" \/><\/figure>\n\n\n\n<p>Or if you need GPU acceleration:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>pip3 install torch torchvision torchaudio --extra-index-url https:\/\/download.pytorch.org\/whl\/cu118<\/code><\/pre>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1600\" height=\"703\" data-src=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/05_gpu_acceleration.webp\" alt=\"\" class=\"wp-image-69100 lazyload\" data-srcset=\"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/05_gpu_acceleration.webp 1600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/05_gpu_acceleration-300x132.webp 300w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/05_gpu_acceleration-1024x450.webp 1024w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/05_gpu_acceleration-768x337.webp 768w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/05_gpu_acceleration-1536x675.webp 1536w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/05_gpu_acceleration-600x264.webp 600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/05_gpu_acceleration-1200x527.webp 1200w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/05_gpu_acceleration-730x321.webp 730w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/05_gpu_acceleration-1460x641.webp 1460w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/05_gpu_acceleration-784x344.webp 784w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/05_gpu_acceleration-1568x689.webp 1568w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/05_gpu_acceleration-877x385.webp 877w\" data-sizes=\"(max-width: 1600px) 100vw, 1600px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 1600px; --smush-placeholder-aspect-ratio: 1600\/703;\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>TensorFlow<\/strong><\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-code\"><code>pip3 install tensorflow<\/code><\/pre>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1600\" height=\"703\" data-src=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/06-TensorFlow.jpg\" alt=\"\" class=\"wp-image-69115 lazyload\" data-srcset=\"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/06-TensorFlow.jpg.webp 1600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/06-TensorFlow-300x132.jpg 300w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/06-TensorFlow-1024x450.jpg 1024w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/06-TensorFlow-768x337.jpg 768w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/06-TensorFlow-1536x675.jpg 1536w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/06-TensorFlow-600x264.jpg.webp 600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/06-TensorFlow-1200x527.jpg.webp 1200w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/06-TensorFlow-730x321.jpg.webp 730w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/06-TensorFlow-1460x641.jpg.webp 1460w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/06-TensorFlow-784x344.jpg.webp 784w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/06-TensorFlow-1568x689.jpg.webp 1568w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/smush-webp\/2025\/05\/06-TensorFlow-877x385.jpg.webp 877w\" data-sizes=\"(max-width: 1600px) 100vw, 1600px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 1600px; --smush-placeholder-aspect-ratio: 1600\/703;\" \/><\/figure>\n\n\n\n<p>For GPU usage, make sure you have the right \u201ctensorflow-gpu\u201d or relevant version.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Step 4: Download and Prepare Your Model<\/h3>\n\n\n\n<p>Let\u2019s say you\u2019re using a language model from Hugging Face.<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Clone or download:<\/strong><\/li>\n<\/ol>\n\n\n\n<p>Now you might want to install, git large file systems (LFS) before you proceed since the huggingface repositories will pull in large model files.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo apt install git-lfs\ngit clone https:\/\/huggingface.co\/your-model<\/code><\/pre>\n\n\n\n<p><a href=\"https:\/\/huggingface.co\/TinyLlama\/TinyLlama-1.1B-intermediate-step-1431k-3T\/tree\/main\">TinyLlama repository<\/a> is a small local LLM repository you can clone by running the below command.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>git clone https:\/\/huggingface.co\/Qwen\/Qwen2-0.5B<\/code><\/pre>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" width=\"1024\" height=\"406\" data-src=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/07_download_and_prepare_your_model-1024x406.webp\" alt=\"\" class=\"wp-image-69096 lazyload\" data-srcset=\"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/07_download_and_prepare_your_model-1024x406.webp 1024w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/07_download_and_prepare_your_model-300x119.webp 300w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/07_download_and_prepare_your_model-768x305.webp 768w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/07_download_and_prepare_your_model-1536x610.webp 1536w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/07_download_and_prepare_your_model-600x238.webp 600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/07_download_and_prepare_your_model-1200x476.webp 1200w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/07_download_and_prepare_your_model-730x290.webp 730w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/07_download_and_prepare_your_model-1460x579.webp 1460w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/07_download_and_prepare_your_model-784x311.webp 784w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/07_download_and_prepare_your_model-1568x622.webp 1568w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/07_download_and_prepare_your_model-877x348.webp 877w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/07_download_and_prepare_your_model.webp 1600w\" data-sizes=\"(max-width: 1024px) 100vw, 1024px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 1024px; --smush-placeholder-aspect-ratio: 1024\/406;\" \/><\/figure>\n\n\n\n<ol start=\"2\" class=\"wp-block-list\">\n<li><strong>Folder organization:<\/strong><\/li>\n<\/ol>\n\n\n\n<p>Place model weights in a directory like \u201c~\/models\/&lt;model-name&gt;\u201d Keep them distinct from your environment so you don\u2019t accidentally delete them during environment changes.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Step 5: Load and Verify Your Model<\/h3>\n\n\n\n<p>Here is an example script that you can run directly. Just make sure that you change the <strong>model_path<\/strong> to match the directory of the cloned repository.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>import torch\nfrom transformers import AutoTokenizer, AutoModelForCausalLM\nimport logging\n\n# Suppress warnings\nlogging.getLogger(\"transformers\").setLevel(logging.ERROR)\n\n# Use local model path\nmodel_path = \"\/Users\/dreamhost\/path\/to\/cloned\/directory\"\n\nprint(f\"Loading model from: {model_path}\")\n\n# Load model and tokenizer\ntokenizer = AutoTokenizer.from_pretrained(model_path)\nmodel = AutoModelForCausalLM.from_pretrained(\n&nbsp;&nbsp;&nbsp;&nbsp;model_path,&nbsp;\n&nbsp;&nbsp;&nbsp;&nbsp;torch_dtype=torch.float16,\n&nbsp;&nbsp;&nbsp;&nbsp;device_map=\"auto\"\n)\n\n# Input prompt\nprompt = \"Tell me something interesting about DreamHost:\"\nprint(\"n\" + \"=\"*50)\nprint(\"INPUT:\")\nprint(prompt)\nprint(\"=\"*50)\n\n# Generate response\ninputs = tokenizer(prompt, return_tensors=\"pt\").to(model.device)\noutput_sequences = model.generate(\n&nbsp;&nbsp;&nbsp;&nbsp;**inputs,\n&nbsp;&nbsp;&nbsp;&nbsp;max_new_tokens=100,\n&nbsp;&nbsp;&nbsp;&nbsp;do_sample=True,\n&nbsp;&nbsp;&nbsp;&nbsp;temperature=0.7\n)\n\n# Extract just the generated part, not including input\ninput_length = inputs.input_ids.shape&#91;1]\nresponse = tokenizer.decode(output_sequences&#91;0]&#91;input_length:], skip_special_tokens=True\n\n# Print output\nprint(\"n\" + \"=\"*50)\nprint(\"OUTPUT:\")\nprint(response)\nprint(\"=\"*50)<\/code><\/pre>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1600\" height=\"1001\" data-src=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/08_load_and_verify_your_model.webp\" alt=\"\" class=\"wp-image-69097 lazyload\" data-srcset=\"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/08_load_and_verify_your_model.webp 1600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/08_load_and_verify_your_model-300x188.webp 300w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/08_load_and_verify_your_model-1024x641.webp 1024w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/08_load_and_verify_your_model-768x480.webp 768w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/08_load_and_verify_your_model-1536x961.webp 1536w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/08_load_and_verify_your_model-600x375.webp 600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/08_load_and_verify_your_model-1200x751.webp 1200w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/08_load_and_verify_your_model-730x457.webp 730w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/08_load_and_verify_your_model-1460x913.webp 1460w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/08_load_and_verify_your_model-784x490.webp 784w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/08_load_and_verify_your_model-1568x981.webp 1568w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/08_load_and_verify_your_model-877x549.webp 877w\" data-sizes=\"(max-width: 1600px) 100vw, 1600px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 1600px; --smush-placeholder-aspect-ratio: 1600\/1001;\" \/><\/figure>\n\n\n\n<p>If you see similar output, you are all set to use your local model in your application scripts.<\/p>\n\n\n\n<p>Make sure you:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Check for warnings: <\/strong>If you see warnings about missing keys or mismatches, ensure your model is compatible with the library version.<\/li>\n\n\n\n<li><strong>Test output:<\/strong> If you get a coherent paragraph back, you\u2019re golden!<\/li>\n<\/ol>\n\n\n\n<h3 class=\"wp-block-heading\">Step 6: Tune for Performance<\/h3>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Quantization: <\/strong>Some models support int8 or int4 variants, drastically reducing VRAM needs and inference time.<\/li>\n\n\n\n<li><strong>Precision: <\/strong>Float16 can be significantly faster than float32 on many GPUs. Check your model\u2019s doc to enable half-precision.<\/li>\n\n\n\n<li><strong>Batch size: <\/strong>If you\u2019re running multiple queries, experiment with a small batch size so you don\u2019t overload your memory.<\/li>\n\n\n\n<li><strong>Caching and pipeline: <\/strong>Transformers offer <a href=\"https:\/\/www.dreamhost.com\/blog\/a-comprehensive-guide-to-website-caching\/\">caching<\/a> for repeated tokens; helpful if you run many step-by-step text prompts.<\/li>\n<\/ol>\n\n\n\n<h3 class=\"wp-block-heading\">Step 7: Monitor Resource Usage<\/h3>\n\n\n\n<p>Run \u201cnvidia-smi\u201d or your OS\u2019s performance monitor to see GPU utilization, memory usage, and temperature. If you see your GPU pinned at 100% or VRAM maxed out, consider a smaller model or extra optimization.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1600\" height=\"1039\" data-src=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/09_monitoring_gpu_load_and_heat_.webp\" alt=\"\" class=\"wp-image-69094 lazyload\" data-srcset=\"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/09_monitoring_gpu_load_and_heat_.webp 1600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/09_monitoring_gpu_load_and_heat_-300x195.webp 300w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/09_monitoring_gpu_load_and_heat_-1024x665.webp 1024w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/09_monitoring_gpu_load_and_heat_-768x499.webp 768w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/09_monitoring_gpu_load_and_heat_-1536x997.webp 1536w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/09_monitoring_gpu_load_and_heat_-600x390.webp 600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/09_monitoring_gpu_load_and_heat_-1200x779.webp 1200w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/09_monitoring_gpu_load_and_heat_-730x474.webp 730w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/09_monitoring_gpu_load_and_heat_-1460x948.webp 1460w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/09_monitoring_gpu_load_and_heat_-784x509.webp 784w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/09_monitoring_gpu_load_and_heat_-1568x1018.webp 1568w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/09_monitoring_gpu_load_and_heat_-877x570.webp 877w\" data-sizes=\"(max-width: 1600px) 100vw, 1600px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 1600px; --smush-placeholder-aspect-ratio: 1600\/1039;\" \/><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">Step 8: Scale Up (if Needed)<\/h3>\n\n\n\n<p>If you need to scale up, you can! Check out the following options.<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Upgrade your hardware:<\/strong> Insert a second GPU or move to a more powerful card.<\/li>\n\n\n\n<li><strong>Use multi-GPU clusters: <\/strong>If your business workflow demands it, you can orchestrate multiple GPUs for bigger models or concurrency.<\/li>\n\n\n\n<li><strong>Move to dedicated hosting:<\/strong> If your home\/office environment isn\u2019t cutting it, consider a data center or specialized hosting with guaranteed GPU resources.<\/li>\n<\/ol>\n\n\n\n<p>Running AI locally might feel like a lot of steps, but once you\u2019ve done it once or twice, the process is straightforward. You install dependencies, load a model, and run a quick test to make sure everything is functioning like it should. After that, it\u2019s all about fine-tuning: tweaking your hardware usage, exploring new models, and continually refining your AI\u2019s capabilities to fit your small business or personal project goals.<\/p>\n\n\n\n<h2 id=\"h2_best-practices-from-ai-pros\" class=\"wp-block-heading\">Best Practices from AI Pros<\/h2>\n\n\n\n<p>As you run your own AI models, keep these best practices in mind:<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Ethical and Legal Considerations<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Carefully <a href=\"https:\/\/www.dreamhost.com\/news\/announcements\/what-to-know-about-gdpr-data-security\/\">handle private data in line with regulations<\/a> (GDPR, HIPAA if relevant).<\/li>\n\n\n\n<li>Evaluate your model\u2019s training set or usage patterns to avoid introducing bias or generating problematic content.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Version Control and Documentation<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Maintain code, model weights, and environment configs in Git or a similar system.<\/li>\n\n\n\n<li>Tag or label model versions so you can roll back if the latest build misbehaves.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Model Updates and Fine-Tuning<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Periodically check for improved model releases from the community.<\/li>\n\n\n\n<li>If you have domain-specific data, consider fine-tuning or training further to boost accuracy.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Observe Resource Usage<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>If you see GPU memory frequently maxed, you might need to add more VRAM or reduce the model size.<\/li>\n\n\n\n<li>For CPU-based setups, watch out for thermal throttling.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Security<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>If you expose an API endpoint externally, <a href=\"https:\/\/www.dreamhost.com\/blog\/ultimate-guide-ssl-tls\/\">secure it with SSL<\/a>, authentication tokens, or IP restrictions.<\/li>\n\n\n\n<li>Keep your OS and libraries up to date to patch vulnerabilities.<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1600\" height=\"900\" data-src=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/10_operating_your_own_ai_model_responsibly.webp\" alt=\"\" class=\"wp-image-69095 lazyload\" data-srcset=\"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/10_operating_your_own_ai_model_responsibly.webp 1600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/10_operating_your_own_ai_model_responsibly-300x169.webp 300w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/10_operating_your_own_ai_model_responsibly-1024x576.webp 1024w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/10_operating_your_own_ai_model_responsibly-768x432.webp 768w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/10_operating_your_own_ai_model_responsibly-1536x864.webp 1536w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/10_operating_your_own_ai_model_responsibly-600x338.webp 600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/10_operating_your_own_ai_model_responsibly-1200x675.webp 1200w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/10_operating_your_own_ai_model_responsibly-730x411.webp 730w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/10_operating_your_own_ai_model_responsibly-1460x821.webp 1460w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/10_operating_your_own_ai_model_responsibly-784x441.webp 784w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/10_operating_your_own_ai_model_responsibly-1568x882.webp 1568w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/10_operating_your_own_ai_model_responsibly-877x493.webp 877w\" data-sizes=\"(max-width: 1600px) 100vw, 1600px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 1600px; --smush-placeholder-aspect-ratio: 1600\/900;\" \/><\/figure>\n\n\n\n<h2 id=\"h2_your-ai-toolkit-further-learning-and-resources\" class=\"wp-block-heading\">Your AI Toolkit: Further Learning and Resources<\/h2>\n\n\n\n<p>Learn more about:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.dreamhost.com\/blog\/customer-relationships\/\">Mastering customer relationships with AI<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.dreamhost.com\/blog\/boost-productivity\/\">Boosting productivity with AI<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.dreamhost.com\/blog\/best-wordpress-plugins\/\">100 best WordPress plugins<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.dreamhost.com\/blog\/claude-ai\/\">Getting the most out of Claude AI<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.dreamhost.com\/blog\/how-to-use-midjourney\/\">How to use Midjourney<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.dreamhost.com\/blog\/meeting-summaries-otter-ai\/\">How to use Otter.ai<\/a><\/li>\n<\/ul>\n\n\n\n<p>For library-level frameworks and advanced user-driven code, PyTorch or TensorFlow documentation is your best friend. The <a href=\"https:\/\/huggingface.co\/docs\">Hugging Face documentation<\/a> is also excellent for exploring more model loading tips, pipeline examples, and community-driven improvements.<\/p>\n\n\n\n<h2 id=\"h2_its-time-to-take-your-ai-in-house\" class=\"wp-block-heading\">It\u2019s Time To Take Your AI In-House<\/h2>\n\n\n\n<p>Hosting your own AI models locally can feel intimidating at first, but it\u2019s a move that pays off in spades: tighter control over your data, faster response times, and the freedom to experiment. By choosing a model that fits your hardware, and running through a few Python commands, you\u2019re on your way to an AI solution that\u2019s truly your own.<\/p>\n\n\n\n\n","protected":false},"excerpt":{"rendered":"<p>Sending your data off to someone else\u2019s cloud to run an AI model can feel like handing your house keys to a stranger. There&#8217;s always the chance that you&#8217;ll come home to find that they absconded with all your valuables or left a giant mess for you to clean up (at your cost, of course). [&hellip;]<\/p>\n","protected":false},"author":1006,"featured_media":69092,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_yoast_wpseo_metadesc":"Local AI hosting gives you privacy, speed, and control. Here\u2019s everything you need to start hosting AI models locally, from setup to scaling.","toc_headlines":"[[\"h-what-is-locally-hosted-ai-and-why-you-should-care\",\"What Is Locally Hosted AI (and Why You Should Care)\"],[\"h2_assessing-hardware-requirements\",\"Assessing Hardware Requirements\"],[\"h2_choosing-the-right-model-and-software\",\"Choosing the Right Model (and Software)\"],[\"h2_step-by-step-guide-how-to-run-ai-models-locally\",\"Step-by-Step Guide: How To Run AI Models Locally\"],[\"h2_best-practices-from-ai-pros\",\"Best Practices from AI Pros\"],[\"h2_your-ai-toolkit-further-learning-and-resources\",\"Your AI Toolkit: Further Learning and Resources\"],[\"h2_its-time-to-take-your-ai-in-house\",\"It\u2019s Time To Take Your AI In-House\"]]","hide_toc":false,"footnotes":""},"categories":[14839,804],"tags":[],"class_list":["post-69088","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-web-hosting"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v26.3 (Yoast SEO v27.4) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Local AI Hosting: How To Host Your Own Models - DreamHost<\/title>\n<meta name=\"description\" content=\"Local AI hosting gives you privacy, speed, and control. Here\u2019s everything you need to start hosting AI models locally, from setup to scaling.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Everything You Need to Know About Local AI Hosting\" \/>\n<meta property=\"og:description\" content=\"Learn how to host AI models locally for better privacy, performance, and control. This guide covers setup, scaling, and key benefits of local AI hosting.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/\" \/>\n<meta property=\"og:site_name\" content=\"DreamHost Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/DreamHost\/\" \/>\n<meta property=\"article:published_time\" content=\"2025-05-21T14:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-05-26T18:28:55+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/1220x628_ogimage_everything_you_need_to_know_to_start_hosting_your_own_ai_models_locally.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"Brian Andrus\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:title\" content=\"Everything You Need to Know About Local AI Hosting\" \/>\n<meta name=\"twitter:description\" content=\"Learn how to host AI models locally for better privacy, performance, and control. This guide covers setup, scaling, and key benefits of local AI hosting.\" \/>\n<meta name=\"twitter:creator\" content=\"@dreamhost\" \/>\n<meta name=\"twitter:site\" content=\"@dreamhost\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Brian Andrus\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"14 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Local AI Hosting: How To Host Your Own Models - DreamHost","description":"Local AI hosting gives you privacy, speed, and control. Here\u2019s everything you need to start hosting AI models locally, from setup to scaling.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/","og_locale":"en_US","og_type":"article","og_title":"Everything You Need to Know About Local AI Hosting","og_description":"Learn how to host AI models locally for better privacy, performance, and control. This guide covers setup, scaling, and key benefits of local AI hosting.","og_url":"https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/","og_site_name":"DreamHost Blog","article_publisher":"https:\/\/www.facebook.com\/DreamHost\/","article_published_time":"2025-05-21T14:00:00+00:00","article_modified_time":"2025-05-26T18:28:55+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/1220x628_ogimage_everything_you_need_to_know_to_start_hosting_your_own_ai_models_locally.webp","type":"image\/webp"}],"author":"Brian Andrus","twitter_card":"summary_large_image","twitter_title":"Everything You Need to Know About Local AI Hosting","twitter_description":"Learn how to host AI models locally for better privacy, performance, and control. This guide covers setup, scaling, and key benefits of local AI hosting.","twitter_creator":"@dreamhost","twitter_site":"@dreamhost","twitter_misc":{"Written by":"Brian Andrus","Est. reading time":"14 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/#article","isPartOf":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/"},"author":{"name":"Brian Andrus","@id":"https:\/\/www-dev.dreamhost.com\/blog\/#\/schema\/person\/a3f8817a11ac0b464bfbcb6c505cb82b"},"headline":"Everything You Need To Know To Start Hosting Your Own AI Models Locally","datePublished":"2025-05-21T14:00:00+00:00","dateModified":"2025-05-26T18:28:55+00:00","mainEntityOfPage":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/"},"wordCount":2598,"publisher":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/#organization"},"image":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/#primaryimage"},"thumbnailUrl":"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/1460x1095_blog_hero_everything_you_need_to_know_to_start_hosting_your_own_ai_models_locally.webp","articleSection":["AI","Web Hosting"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/","url":"https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/","name":"Local AI Hosting: How To Host Your Own Models - DreamHost","isPartOf":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/#primaryimage"},"image":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/#primaryimage"},"thumbnailUrl":"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/1460x1095_blog_hero_everything_you_need_to_know_to_start_hosting_your_own_ai_models_locally.webp","datePublished":"2025-05-21T14:00:00+00:00","dateModified":"2025-05-26T18:28:55+00:00","description":"Local AI hosting gives you privacy, speed, and control. Here\u2019s everything you need to start hosting AI models locally, from setup to scaling.","breadcrumb":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/#primaryimage","url":"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/1460x1095_blog_hero_everything_you_need_to_know_to_start_hosting_your_own_ai_models_locally.webp","contentUrl":"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/05\/1460x1095_blog_hero_everything_you_need_to_know_to_start_hosting_your_own_ai_models_locally.webp","width":1460,"height":1095,"caption":"Hosting your own AI models locally hero image"},{"@type":"BreadcrumbList","@id":"https:\/\/www-dev.dreamhost.com\/blog\/local-ai-hosting\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/dhblog.dream.press\/blog\/"},{"@type":"ListItem","position":2,"name":"Everything You Need To Know To Start Hosting Your Own AI Models Locally"}]},{"@type":"WebSite","@id":"https:\/\/www-dev.dreamhost.com\/blog\/#website","url":"https:\/\/www-dev.dreamhost.com\/blog\/","name":"DreamHost Blog","description":"","publisher":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www-dev.dreamhost.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www-dev.dreamhost.com\/blog\/#organization","name":"DreamHost","url":"https:\/\/www-dev.dreamhost.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www-dev.dreamhost.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/dhblog.dream.press\/blog\/wp-content\/uploads\/2019\/01\/dh_logo-blue-2.png","contentUrl":"https:\/\/dhblog.dream.press\/blog\/wp-content\/uploads\/2019\/01\/dh_logo-blue-2.png","width":1200,"height":168,"caption":"DreamHost"},"image":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/DreamHost\/","https:\/\/x.com\/dreamhost","https:\/\/www.instagram.com\/dreamhost\/","https:\/\/www.linkedin.com\/company\/dreamhost\/","https:\/\/www.youtube.com\/user\/dreamhostusa"]},{"@type":"Person","@id":"https:\/\/www-dev.dreamhost.com\/blog\/#\/schema\/person\/a3f8817a11ac0b464bfbcb6c505cb82b","name":"Brian Andrus","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2023\/10\/brian-andrus-150x150.jpg","url":"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2023\/10\/brian-andrus-150x150.jpg","contentUrl":"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2023\/10\/brian-andrus-150x150.jpg","caption":"Brian Andrus"},"description":"Brian is a Cloud Engineer at DreamHost, primarily responsible for cloudy things. In his free time he enjoys navigating fatherhood, cutting firewood, and self-hosting whatever he can.","url":"https:\/\/www-dev.dreamhost.com\/blog\/author\/brianandrus\/"}]}},"lang":"en","translations":{"en":69088,"es":69085,"it":69204,"fr":71337,"nl":71362,"uk":72389,"pt":72407,"pl":72426,"de":72950,"ru":72953},"pll_sync_post":[],"_links":{"self":[{"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/posts\/69088","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/users\/1006"}],"replies":[{"embeddable":true,"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/comments?post=69088"}],"version-history":[{"count":20,"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/posts\/69088\/revisions"}],"predecessor-version":[{"id":69151,"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/posts\/69088\/revisions\/69151"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/media\/69092"}],"wp:attachment":[{"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/media?parent=69088"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/categories?post=69088"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/tags?post=69088"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}