Using WebLLM-Enabled Websites

Once you have WebLLM installed and configured, you can use AI features on any website that supports WebLLM. This guide shows you how.

Finding WebLLM-Enabled Websites

Look for the Badge

Websites that support WebLLM often display a badge:

“Powered by WebLLM” or “Supports WebLLM”

Check the Extension Icon

The WebLLM icon in your toolbar shows the status:

• 🟢 Colorful icon - Current website supports WebLLM
• ⚪ Gray icon - Current website doesn’t use WebLLM

Browse the Directory

Visit webllm.org/showcase to find websites using WebLLM:

• Documentation sites with AI-powered search
• Content platforms with summarization
• Code editors with AI assistance
• Educational platforms
• And more!

Using AI Features

When a website tries to use AI through WebLLM:

First-Time Permission

1. Permission popup appears asking for access
2. The popup shows:
   • Which website is requesting access
   • What the AI will be used for
   • Which provider will handle the request
3. Choose your response:
   • “Allow Once” - Grant access for this session only
   • “Always Allow” - Remember decision for this website
   • “Deny” - Block this request

Recommendation: Start with “Allow Once” until you trust the website.

Using AI Features

Once you’ve granted permission, the website can use AI features:

Common features you’ll see:

• Summarize buttons - Condense articles or documents
• Translate options - Convert to different languages
• Search powered by AI - Natural language queries
• Chat interfaces - Ask questions about content
• Generate tools - Create text, code, or other content
• Analyze features - Extract insights from data

Just click and use! WebLLM handles everything in the background.

Real-Time Progress

When AI is working, you’ll see progress:

1. Processing indicator on the website
2. Extension icon animates (shows activity)
3. For streaming responses: Text appears word-by-word
4. For batch responses: Full response appears when done

Managing Permissions

Control which websites can use WebLLM.

View All Permissions

1. Open WebLLM extension
2. Click “Permissions” tab
3. See list of all websites with access:
   • Website name and URL
   • When access was granted
   • Last time AI was used
   • Total requests made

Revoke Permission

To remove access for a website:

1. Permissions → Find the website
2. Click “Revoke Access”
3. Confirm

The website will need to ask for permission again next time.

Update Permission

To change permission settings:

1. Permissions → Find the website
2. Click “Edit”
3. Change settings:
   • Allow/deny specific providers
   • Set request limits
   • Enable/disable notifications
4. Click “Save”

Viewing Usage History

Track how websites use WebLLM.

Open History

1. Open WebLLM extension
2. Click “History” tab
3. See all AI requests:
   • Date and time
   • Website that made the request
   • The prompt (what was asked)
   • The response (what AI said)
   • Provider used
   • Estimated cost (for cloud providers)

Filter History

Find specific requests:

By website:

• Filter → Select website
• See only requests from that site

By date:

• Filter → Select date range
• See requests in time period

By provider:

• Filter → Select provider
• See which requests used which AI

Export History

Download your data:

1. History → Click “Export”
2. Choose format:
   • CSV - For spreadsheets
   • JSON - For analysis
   • PDF - For reports
3. Click “Download”

Delete History

Remove old requests:

Delete individual requests:

• History → Click request → “Delete”

Delete by website:

• History → Filter by website → “Delete All”

Delete all history:

• Settings → Privacy → “Clear All History”

Understanding Notifications

WebLLM shows notifications to keep you informed.

Permission Requests

When a website wants to use AI:

• Popup notification - Take action required
• Shows website details and purpose
• Choose to allow or deny

Usage Alerts

When certain events happen:

• Cost alerts - Approaching spending limits
• Error alerts - Something went wrong
• Update alerts - New model or feature available

Configure Notifications

Control what notifications you see:

1. Settings → Notifications
2. Toggle each type:
   • Permission requests - Always on (required)
   • Usage alerts - Recommended on
   • Error notifications - Recommended on
   • Update notifications - Optional
   • Cost warnings - Recommended on
3. Set notification style:
   • Banner - Non-intrusive
   • Modal - Requires action
   • Sound - Audio alert

Privacy While Using Websites

WebLLM protects your privacy even when using AI features.

What Websites Can See

When you use WebLLM on a website:

Websites CAN see:

• ✅ That you have WebLLM installed
• ✅ That you granted/denied permission
• ✅ The response from AI (because they requested it)

Websites CANNOT see:

• ❌ Your API keys
• ❌ Which provider you used
• ❌ Your usage on other websites
• ❌ Your WebLLM settings
• ❌ Your full history

Sensitive Data

When using AI with sensitive information:

Best practices:

1. Use local models for sensitive data
2. Check website privacy policy before sharing data
3. Review prompts before allowing AI access
4. Revoke access after one-time use if needed

Remember: Websites can read AI responses, so don’t use AI features on untrusted sites with sensitive information.

Common Use Cases

Reading Articles

Feature: Summarize button on articles

How to use:

1. Read article you want summarized
2. Click “Summarize with AI” button
3. Grant permission (first time)
4. Get instant summary

Privacy tip: Summaries are generated from public content, typically safe to use with any provider.

Documentation Search

Feature: AI-powered search on docs sites

How to use:

1. Type natural language question: “How do I handle errors?”
2. AI searches and synthesizes answer
3. Get answer with relevant links

Privacy tip: Your search queries are just text, safe for any provider.

Code Assistance

Feature: AI code completion and debugging

How to use:

1. Select code that needs help
2. Click “Ask AI” or similar
3. AI analyzes and suggests fixes

Privacy tip: If code is proprietary, use local models to keep it private.

Content Translation

Feature: Translate pages or selections

How to use:

1. Select text to translate
2. Click “Translate” → Choose language
3. Get instant translation

Privacy tip: Public content is safe. For private messages, use local models.

Writing Assistance

Feature: AI writing suggestions

How to use:

1. Type in text field
2. AI suggests improvements
3. Accept or modify suggestions

Privacy tip: For personal writing, consider local models for complete privacy.

Troubleshooting

Permission request not appearing

Solutions:

• Check if popup was blocked (browser settings)
• Click WebLLM icon manually
• Refresh the webpage
• Check extension is enabled

AI feature not working

Solutions:

• Verify permission granted (Permissions tab)
• Check provider is configured (Providers tab)
• Check internet connection (for cloud providers)
• Check provider status (Settings → Providers)

Responses are slow

Possible causes:

• Cloud provider is slow - Try different provider
• Local model is underpowered - Upgrade model or use cloud
• Large request - Long prompts take longer
• Rate limiting - Provider temporarily throttled

Solutions:

• Switch to faster provider
• Reduce prompt length
• Wait a moment and try again

Wrong language in response

Solutions:

• Check the prompt language
• Specify language in request
• Try different provider (some better at certain languages)

Unexpected cost charges

Check:

• History → Filter by date → See all requests
• Check if website made many requests
• Verify spending limits are set

Prevent:

• Set daily/monthly limits (Providers → Settings)
• Revoke access from high-usage sites
• Use local models when possible

Advanced Features

Custom Provider for Specific Sites

Use different providers for different websites:

1. Permissions → Select website
2. Edit → Provider Settings
3. Choose specific provider for this site
4. Save

Example: Use GPT-4 for coding sites, Claude for writing sites, local for everything else.

Request Limits Per Site

Prevent websites from overusing AI:

1. Permissions → Select website
2. Edit → Set limits:
   • Max requests per hour
   • Max requests per day
   • Max cost per day
3. Save

Automatic Permission Patterns

Set rules for automatic permissions:

1. Settings → Permissions → Auto-Allow Rules
2. Add rule:
   • Domain pattern: *.trusted-site.com
   • Action: Auto-allow
   • Provider: Specific or any
3. Save

Use carefully! Only for fully trusted websites.

Best Practices

✅ Do

• Grant permission thoughtfully - Trust the website first
• Review usage regularly - Check History monthly
• Set spending limits - Protect yourself from surprise costs
• Use local models when possible - Free and private
• Revoke unused permissions - Clean up periodically

❌ Don’t

• Don’t auto-allow everything - Review each request
• Don’t ignore cost alerts - They protect you
• Don’t share sensitive data on untrusted sites - Even with local models
• Don’t forget to revoke access - When you’re done with a site

Getting More Websites to Support WebLLM

Love WebLLM? Help grow the ecosystem!

Request Support

Ask your favorite websites to add WebLLM:

Template message:

Hi! I'd love to see WebLLM support on your site.

WebLLM lets users bring their own AI (local models or
personal API keys) to websites. Benefits:

For users:
- Use AI features with own providers
- Better privacy control
- No extra subscriptions

For your site:
- Zero AI infrastructure costs
- Easy to integrate
- Better privacy for users

Learn more: https://webllm.org

Thanks!

Send to:

• Support email
• Feature request form
• Social media
• Community forum

Share Your Experience

Help others discover WebLLM:

• Tweet about sites using WebLLM
• Write reviews mentioning WebLLM support
• Share in communities and forums

Next Steps

You’re now a WebLLM pro! Here’s what else you can explore:

➡️ Privacy & Data Control - Deep dive into privacy ➡️ Advanced Configuration - Fine-tune your setup ➡️ Developer Guide - Build WebLLM-enabled sites

Need Help?

• FAQ - Common questions
• Troubleshooting - Fix issues
• Community Forum - Get support
• Showcase - Find great WebLLM sites

---

Enjoy using AI on your terms with WebLLM!