Models

LocalChat supports 300+ AI models. You can download multiple models and switch between them based on what you're working on.

Access the model gallery from Settings > Models to browse and download available models.

Model manager

Each model card shows:

  • Name - The model identifier
  • Description - What the model does best
  • Vision badge - Indicates the model can process images
  • Size - Download size (e.g., 0.3 GB, 5.0 GB, 6.2 GB)
  • RAM - Memory required to run the model (e.g., 8 GB, 16 GB)

Downloading models

To download a new model:

  1. Open Settings > Models
  2. Find the model you want
  3. Click Download
  4. Wait for the download to complete

Tip: Start with smaller models if you're not sure which to choose. Gemma 3 at 0.3 GB is a good starting point for simple tasks.

Model recommendations

ModelBest forSizeRAM
Gemma 3Quick, simple tasks0.3 GB8 GB
Qwen2.5 3B InstructEveryday tasks~2 GB8 GB
DeepSeek R1Math and coding5.0 GB16 GB
GLM 4.6V FlashVision and design-to-code6.2 GB16 GB

Vision models

Models with the Vision badge can understand and analyze images. Use these for:

  • Analyzing screenshots and photos
  • Converting designs to code
  • Reading charts and diagrams
  • Extracting text from images

See Image analysis for more details.

Switching models

To switch models during a conversation:

  1. Click the model name at the bottom of the chat input
  2. Select a different model from the dropdown
  3. Continue your conversation

The new model picks up where the previous one left off. Different models may give different responses to the same prompt.

Loading models

Downloaded models show a Load button. Click it to:

  • Make the model active for new conversations
  • Prepare the model in memory for faster responses

Only one model can be loaded at a time. Loading a new model unloads the previous one.

Managing storage

AI models can be large (0.3-8GB each). To manage storage:

Check model sizes

Review the size shown on each model card before downloading. Vision models and advanced reasoning models tend to be larger.

Delete a model

  1. Open Settings > Models
  2. Find the downloaded model
  3. Right-click or look for the delete option
  4. Confirm the deletion

This frees up disk space. You'll need to re-download the model if you want to use it again.