Download the PHP package filaforge/filament-ollama-chat without Composer

Filaforge Ollama Chat

A powerful Filament plugin that integrates Ollama AI chat capabilities directly into your admin panel for local AI model interactions.

Features

• Ollama AI Integration: Chat with local AI models powered by Ollama
• Local Model Support: Run AI models locally without external API calls
• Conversation Management: Save, organize, and continue chat conversations
• Model Selection: Choose from available Ollama models on your system
• Customizable Settings: Configure Ollama server, models, and chat parameters
• Real-time Chat: Live chat experience with streaming responses
• Conversation History: Keep track of all your AI conversations
• Export Conversations: Save and share chat transcripts
• Role-based Access: Configurable user permissions and access control
• Context Awareness: Maintain conversation context across sessions

Installation

1. Install via Composer

2. Publish & Migrate

3. Register Plugin

Add the plugin to your Filament panel provider:

Setup

Prerequisites

Before using this plugin, you need to have Ollama installed and running on your system:

1. Install Ollama: Visit ollama.ai and follow installation instructions
2. Start Ollama Service: Ensure Ollama is running on your system
3. Download Models: Pull the AI models you want to use

Configuration

The plugin will automatically:

• Publish configuration files to config/ollama-chat.php
• Publish view files to resources/views/vendor/ollama-chat/
• Publish migration files to database/migrations/
• Register necessary routes and middleware

Ollama Configuration

Configure your Ollama connection in the published config file:

Environment Variables

Add these to your .env file:

Installing Ollama Models

Install the AI models you want to use:

Usage

Accessing Ollama Chat

1. Navigate to your Filament admin panel
2. Look for the "Ollama Chat" menu item
3. Start chatting with local AI models

Starting a Conversation

1. Select Model: Choose from available Ollama models on your system
2. Type Your Message: Enter your question or prompt
3. Send Message: Submit your message to the local AI
4. View Response: See the AI's response in real-time
5. Continue Chat: Keep the conversation going

Managing Conversations

1. New Chat: Start a fresh conversation
2. Save Chat: Automatically save important conversations
3. Load Chat: Resume previous conversations
4. Export Chat: Download conversation transcripts
5. Delete Chat: Remove unwanted conversations

Advanced Features

• Model Switching: Switch between different Ollama models
• Parameter Tuning: Adjust temperature, max tokens, and other settings
• Context Management: Maintain conversation context across sessions
• Streaming Responses: Real-time AI responses for better user experience

Troubleshooting

Common Issues

• Connection refused: Ensure Ollama service is running on your system
• Model not found: Verify the model is installed with ollama list
• Slow responses: Check system resources and model size
• Memory issues: Ensure sufficient RAM for the selected model

Debug Steps

1. Check the plugin configuration:

2. Verify routes are registered:

3. Test Ollama connectivity:

4. Check environment variables:

5. Clear caches:

6. Check logs for errors:

Ollama Service Issues

• Service not starting: Check Ollama installation and permissions
• Port conflicts: Ensure port 11434 is available
• Model download failures: Check internet connection and disk space
• Performance issues: Monitor system resources and model size

Security Considerations

Access Control

• Role-based permissions: Restrict access to authorized users only
• Local network security: Ensure Ollama is not exposed to external networks
• User isolation: Ensure users can only access their own conversations
• Audit logging: Track all chat activities and model usage

Best Practices

• Run Ollama on localhost only
• Implement proper user authentication
• Monitor system resources and model usage
• Regularly update Ollama and models
• Use appropriate firewall rules

Performance Optimization

System Requirements

• RAM: Minimum 8GB, recommended 16GB+ for larger models
• CPU: Multi-core processor for better performance
• Storage: SSD recommended for faster model loading
• GPU: Optional but recommended for better performance

Model Selection

• Small models (1-3B parameters): Fast, lower quality
• Medium models (7-13B parameters): Balanced performance
• Large models (30B+ parameters): High quality, slower responses

Uninstall

1. Remove Plugin Registration

Remove the plugin from your panel provider:

2. Roll Back Migrations (Optional)

3. Remove Published Assets (Optional)

4. Remove Package and Clear Caches

5. Clean Up Environment Variables

Remove these from your .env file:

6. Stop Ollama Service (Optional)

If you no longer need Ollama:

Support

• Documentation: GitHub Repository
• Issues: GitHub Issues
• Discussions: GitHub Discussions

Contributing

We welcome contributions! Please see our Contributing Guide for details.

License

This plugin is open-sourced software licensed under the MIT license.

Made with ❤️ by the Filaforge Team