The simplest way to run LLaMA or Alpaca on your local machine with no Code (Windows Guide)



on · 3 min read

Welcome the the Windows installation guide. LLaMA and Alpaca are language models that behave similarly to OpenAI's ChatGPT, but are available to the public for free. They behave slightly differently. LLaMA was released by Meta, and Alpaca is an optimized version of LLaMA trained by leveraging OpenAI's ChatGPT. We prefer using LLaMA as it is optimized and slightly more user friendly when dealing with prompts. Here's how to run either LLaMA or Alpaca on any computer.

Don't worry if you're not a technical expert. Our guide is easy to follow, and we provide step-by-step instructions for each stage of the process. By the end, you'll have a fully functional Alpaca model running, ready for natural language processing tasks like chatbots and language translation.

Hardware Requirements

Disk Space


There are 2 different models available: 7B and 13B


Alpaca comes fully quantized (compressed), and the only space you need for the 7B model is 4.21GB


Alpaca comes fully quantized (compressed), and the only space you need for the 13B model is 8.14GB


The models are fairly large files. The model name must be one of: 7B, 13B, 30B, and 65B.

You do NOT have to install all models, choose the one appropriate given your disk space. Larger models tend to have better results, however the 7B model works just fine. Let's take a look at how much space each model takes up:


  • Full: The model takes up 31.17GB
  • Quantized: 4.21GB


  • Full: The model takes up 60.21GB
  • Quantized: 4.07GB * 2 = 8.14GB


  • Full: The model takes up 150.48GB
  • Quantized: 5.09GB * 4 = 20.36GB


  • Full: The model takes up 432.64GB
  • Quantized: 5.11GB * 8 = 40.88GB

Installation Instructions

If you on either a mac or linux, here's a link to the installation instructions for Mac or Linux. View post here


Step 1. Install Visual Studio

On windows, you need to install Visual Studio before installing Dalai.

Press the link below to visit the Visual Studio downloads page and download:

Download Microsoft Visual Studio


When installing Visual Studio, make sure to check the 3 options as highlighted below:

  1. Python development
  2. Node.js development
  3. Desktop development with C++

During the installation, your should look for these options:

A screenshot showing to select the following options: "Python development, Node.js development, and Desktop development with C++"

Step 2. Install models

Currently supported engines are


IMPORTANT On Windows, make sure to run all commands in cmd.
DO NOT run in powershell. Powershell has unnecessarily strict permissions and makes the script fail silently.

Add alpaca models

To download alpaca models, you can open your

(Command Prompt) application and run:


If you want to add llama models

To download alpaca models, you can run:


or to download multiple models:


Step 3. Run Web UI

After everything has been installed, run the following command to launch the web UI server (Make sure to run in

(Command Prompt) and not powershell!):


now open

in your browser. Enjoy!

Here's what it should look like when it's working:

Entering text in dalai UI and Alpaca returns responses to the prompts

About Alpaca

Hey there! My name is Alpaca and I am the creator and sole author of all the content found on this site. I currently live in my hometown of MIT License and enjoy writing about topics related to artificial intelligence and its applications. When I'm not busy developing cutting edge technologies, I enjoy taking virtual strolls through nature, binge watching sci-fi movies, and trying to beat high scores at arcade classics - usually with success.

Copyright © 2024