Skip to content
WebLLM

Getting Started for Users

Welcome! WebLLM lets you use AI on websites using your own AI provider - whether that’s a free local model running on your computer, or premium models like Claude or GPT-4 using your own API keys.

Why Use WebLLM?

Section titled “Why Use WebLLM?”

🔒 Privacy First

Section titled “🔒 Privacy First”

Your data stays under your control. Use local models that never send data anywhere, or use your own API keys directly.

💰 Save Money

Section titled “💰 Save Money”

One AI subscription works across all WebLLM-enabled websites. No more paying per app.

⚡ Use Premium Models Everywhere

Section titled “⚡ Use Premium Models Everywhere”

Already paying for Claude Pro or ChatGPT Plus? Use those premium models on any WebLLM-enabled website.

🆓 Or Use Free Local Models

Section titled “🆓 Or Use Free Local Models”

Run AI completely free on your own computer. No subscriptions needed.

Quick Setup (5 Minutes)

Section titled “Quick Setup (5 Minutes)”

Step 1: Install the Extension

Section titled “Step 1: Install the Extension”
  1. Install WebLLM for Chrome (Chrome Web Store link)
  2. Click “Add to Chrome”
  3. Click “Add Extension” when prompted
  4. Pin the extension - Click the puzzle icon in Chrome toolbar, then click the pin next to WebLLM

✅ Extension installed!

Step 2: Choose Your AI Provider

Section titled “Step 2: Choose Your AI Provider”

When you first click the WebLLM icon, you’ll see the setup wizard. You have three options:

Section titled “Option 1: Free Local Model (Recommended for Getting Started)”
  • Best for: Privacy, offline use, no costs
  • Setup time: 5-10 minutes (one-time download)
  • Capabilities: Good for summarization, translation, basic Q&A

Click “Download Local Model” and select Llama 3.2 1B (1.2GB download). This runs entirely on your computer.

Option 2: Use Your Own API Keys

Section titled “Option 2: Use Your Own API Keys”
  • Best for: Premium capabilities, you already have an API key
  • Setup time: 2 minutes
  • Capabilities: State-of-the-art AI (Claude, GPT-4, etc.)

Click “Add API Provider” and choose:

Paste your API key and save.

Option 3: Use Multiple Providers (Advanced)

Section titled “Option 3: Use Multiple Providers (Advanced)”
  • Set up both local and cloud providers
  • WebLLM automatically chooses the best one for each task
  • Local for quick tasks, cloud for complex ones

✅ Provider configured!

Step 3: Try It Out

Section titled “Step 3: Try It Out”

Visit a WebLLM-enabled demo site to test it:

  1. Go to webllm.org/demo
  2. Click “Summarize this article”
  3. WebLLM will ask for permission (first time only)
  4. Click “Allow”
  5. Watch the AI summarize the article!

✅ You’re all set!

What’s Next?

Section titled “What’s Next?”

Now that you’re set up, you can:

Common Questions

Section titled “Common Questions”

How do I know if a website supports WebLLM?

Section titled “How do I know if a website supports WebLLM?”

Look for the “Powered by WebLLM” badge, or the WebLLM icon will light up when you visit a supported site.

Will this slow down my computer?

Section titled “Will this slow down my computer?”

Local models use about as much power as watching a YouTube video. Cloud models don’t use your computer at all - they run on the provider’s servers.

Is my data safe?

Section titled “Is my data safe?”

Yes! With local models, your data never leaves your computer. With cloud providers, your data goes directly from the extension to the provider using your API key - the website never sees it.

Can I use WebLLM without an API key?

Section titled “Can I use WebLLM without an API key?”

Absolutely! Local models are completely free and don’t require any API keys or subscriptions.

How much does it cost?

Section titled “How much does it cost?”
  • WebLLM Extension: Free forever
  • Local models: Free forever
  • Cloud providers: You pay the provider directly (typically $0.01-0.10 per request, depending on model)

Can I switch providers later?

Section titled “Can I switch providers later?”

Yes! You can add, remove, or change providers anytime from the extension settings.

Need Help?

Section titled “Need Help?”

Ready to experience AI on your terms? Install WebLLM and take control of your AI experience!