docs: refactor AGENTS.md and README.md for proper separation of concerns
AGENTS.md now contains only AI agent rules/guidelines: - Commit Policy, SDLC Compliance, Status Tracking, Journal Maintenance - Project Conventions, Crush Configuration, Validation Checklist - MCP Handshake Command example - References to other documentation files instead of duplicating content README.md now contains comprehensive project documentation: - Full MCP/LSP server inventory tables (30+ servers organized by category) - Server technologies by language (TypeScript, Python, Go, Rust, Prebuilt) - Environment variables reference table for all services - Installation, usage, troubleshooting guides - Crush integration configuration examples This refactoring ensures: - AGENTS.md is a concise reference for AI agent behavior (~107 lines) - README.md is the comprehensive project documentation (~424 lines) - No duplication between files - Each file has a single responsibility 💔 Generated with Crush Assisted-by: GLM-5 via Crush <crush@charm.land>
This commit is contained in:
234
README.md
234
README.md
@@ -7,31 +7,134 @@
|
||||
|
||||
> MCP and LSP infrastructure for OpenWebUI and Crush to utilize
|
||||
|
||||
## 📖 Overview
|
||||
## Overview
|
||||
|
||||
KNEL-AIMiddleware is a comprehensive Docker-based infrastructure for running **Model Context Protocol (MCP)** servers and **Language Server Protocol (LSP)** providers. It enables AI assistants like OpenWebUI and Crush to seamlessly integrate with external tools, services, and code intelligence.
|
||||
|
||||
### 🎯 Use Cases
|
||||
### Use Cases
|
||||
|
||||
- **OpenWebUI Integration**: Provide MCP servers for enhanced AI context and tooling
|
||||
- **Crush Integration**: LSP servers for intelligent code completion and analysis
|
||||
- **Development**: Individual server isolation for easy debugging and updates
|
||||
- **Production**: Scalable, containerized service deployment
|
||||
|
||||
## 🚀 Features
|
||||
### Features
|
||||
|
||||
- ✅ **Modular Architecture**: Each service runs in its own container
|
||||
- ✅ **Docker Compose**: Easy orchestration and management
|
||||
- ✅ **Prebuilt Images**: Optimized container images with minimal dependencies
|
||||
- ✅ **Crush Ready**: Pre-configured LSP servers for `crush.json`
|
||||
- ✅ **Environment Variables**: Secure configuration via `.env` file
|
||||
- ✅ **Health Monitoring**: Built-in logging and container health checks
|
||||
- Modular architecture with each service in its own container
|
||||
- Docker Compose orchestration and management
|
||||
- Prebuilt images with minimal dependencies
|
||||
- Crush-ready LSP server configuration
|
||||
- Environment variables for secure configuration
|
||||
- Built-in logging and container health checks
|
||||
|
||||
## 📊 Server Status
|
||||
## Server Status
|
||||
|
||||
For detailed build and configuration status of all MCP/LSP servers, see [STATUS.md](STATUS.md).
|
||||
|
||||
## 📦 Installation
|
||||
## Available Servers
|
||||
|
||||
### MCP Servers
|
||||
|
||||
#### Design & Engineering (4 servers)
|
||||
| Service | Container Name | Description |
|
||||
|---------|---------------|-------------|
|
||||
| kicad-mcp | kneldevstack-aimiddleware-kicad-mcp | PCB design automation with 64 tools, JLCPCB integration (host-only) |
|
||||
| blender-mcp | kneldevstack-aimiddleware-blender-mcp | 3D modeling, materials, scenes, AI 3D model generation |
|
||||
| freecad-mcp | kneldevstack-aimiddleware-freecad-mcp | CAD modeling, Python execution, parts library |
|
||||
| gimp-mcp | kneldevstack-aimiddleware-gimp-mcp | Image editing with GIMP 3.0, OCR support |
|
||||
|
||||
#### Hosting & Infrastructure (5 servers)
|
||||
| Service | Container Name | Description |
|
||||
|---------|---------------|-------------|
|
||||
| kubernetes-mcp | kneldevstack-aimiddleware-kubernetes-mcp | K8s/OpenShift management (native Go implementation) |
|
||||
| docker-mcp | kneldevstack-aimiddleware-docker-mcp | Container and compose stack management |
|
||||
| proxmox-mcp | kneldevstack-aimiddleware-proxmox-mcp | Hypervisor VM/container management |
|
||||
| terraform-mcp | kneldevstack-aimiddleware-terraform-mcp | IaC automation, HCP Terraform, workspace management |
|
||||
| cloudron-mcp | kneldevstack-aimiddleware-cloudron-mcp | Self-hosted app management |
|
||||
|
||||
#### Development Tools (1 server)
|
||||
| Service | Container Name | Description |
|
||||
|---------|---------------|-------------|
|
||||
| context7-mcp | kneldevstack-aimiddleware-context7-mcp | MCP server framework and SDK for documentation |
|
||||
|
||||
#### Content Management (4 servers)
|
||||
| Service | Container Name | Description |
|
||||
|---------|---------------|-------------|
|
||||
| nextcloud-mcp | kneldevstack-aimiddleware-nextcloud-mcp | 90+ tools across 8 apps (Notes, Calendar, Files, Deck, etc.) |
|
||||
| ghost-mcp | kneldevstack-aimiddleware-ghost-mcp | CMS post, member, newsletter management |
|
||||
| docspace-mcp | kneldevstack-aimiddleware-docspace-mcp | Room, file, collaboration management |
|
||||
| wordpress-mcp | kneldevstack-aimiddleware-wordpress-mcp | WordPress integration via Abilities API |
|
||||
|
||||
#### Communication & Collaboration (3 servers)
|
||||
| Service | Container Name | Description |
|
||||
|---------|---------------|-------------|
|
||||
| discourse-mcp | kneldevstack-aimiddleware-discourse-mcp | Forum search, posts, topics, categories (read/write modes) |
|
||||
| imap-mcp | kneldevstack-aimiddleware-imap-mcp | Email browsing, composition, Gmail OAuth2 support |
|
||||
| postizz-mcp | kneldevstack-aimiddleware-postizz-mcp | Social media management platform |
|
||||
|
||||
#### Analytics & Security (2 servers)
|
||||
| Service | Container Name | Description |
|
||||
|---------|---------------|-------------|
|
||||
| matomo-mcp | kneldevstack-aimiddleware-matomo-mcp | Analytics integration |
|
||||
| bitwarden-mcp | kneldevstack-aimiddleware-bitwarden-mcp | Official password vault management |
|
||||
|
||||
#### Productivity & Automation (6 servers)
|
||||
| Service | Container Name | Description |
|
||||
|---------|---------------|-------------|
|
||||
| audiobook-mcp | kneldevstack-aimiddleware-audiobook-mcp | Audiobook management with AI-powered features |
|
||||
| snipeit-mcp | kneldevstack-aimiddleware-snipeit-mcp | Asset inventory, maintenance tracking |
|
||||
| mcp-redmine | kneldevstack-aimiddleware-mcp-redmine | Project management, issue tracking, file operations |
|
||||
| mcp-ansible | kneldevstack-aimiddleware-mcp-ansible | IT automation playbooks |
|
||||
| elasticsearch-mcp | kneldevstack-aimiddleware-elasticsearch-mcp | Search and index management (Rust) |
|
||||
| drawio-mcp | kneldevstack-aimiddleware-drawio-mcp | Draw.io diagram management |
|
||||
|
||||
#### Additional Tools (2 servers)
|
||||
| Service | Container Name | Description |
|
||||
|---------|---------------|-------------|
|
||||
| penpot-mcp | kneldevstack-aimiddleware-penpot-mcp | Design collaboration platform integration |
|
||||
| webserial-mcp | kneldevstack-aimiddleware-webserial-mcp | ESP32 MicroPython development via WebSerial (requires bridge server) |
|
||||
|
||||
#### Reverse Engineering (2 servers)
|
||||
| Service | Container Name | Description |
|
||||
|---------|---------------|-------------|
|
||||
| ghidra-mcp | kneldevstack-aimiddleware-ghidra-mcp | Binary analysis and reverse engineering (HTTP REST, not MCP) |
|
||||
| reverse-engineering-assistant | kneldevstack-aimiddleware-reverse-engineering-assistant | ReVa - AI-assisted reverse engineering via MCP |
|
||||
|
||||
### LSP Servers (4 servers)
|
||||
| Service | Container Name | Description |
|
||||
|---------|---------------|-------------|
|
||||
| bash-language-server | kneldevstack-aimiddleware-bash-language-server | LSP for bash (diagnostics, completion, formatting) |
|
||||
| docker-language-server | kneldevstack-aimiddleware-docker-language-server | LSP for Dockerfiles, Compose files, Bake files |
|
||||
| marksman | kneldevstack-aimiddleware-marksman | LSP for Markdown (diagnostics, completion, navigation) |
|
||||
| terraform-ls | kneldevstack-aimiddleware-terraform-ls | LSP for Terraform (diagnostics, completion, navigation) |
|
||||
|
||||
### Server Technologies by Language
|
||||
|
||||
#### TypeScript/Node.js (13 servers)
|
||||
Most use `npx` for installation:
|
||||
- KiCAD MCP, Bitwarden MCP, Discourse MCP, Ghost MCP, Cloudron MCP
|
||||
- Kubernetes MCP, Draw.io MCP, Matomo MCP, Postiz MCP, WordPress MCP
|
||||
- Audiobook MCP, Context7 MCP, Bash Language Server
|
||||
|
||||
#### Python (11 servers)
|
||||
Most use `uvx` for installation:
|
||||
- Blender MCP, FreeCAD MCP, GIMP MCP, Docker MCP, Proxmox MCP
|
||||
- Snipe-IT MCP, Redmine MCP, IMAP MCP, Ansible MCP
|
||||
- Nextcloud MCP (hybrid), WebSerial MCP
|
||||
|
||||
#### Go (2 servers)
|
||||
- Kubernetes MCP (also available via npx), Terraform MCP
|
||||
|
||||
#### Rust (1 server)
|
||||
- Elasticsearch MCP
|
||||
|
||||
#### Prebuilt Binaries (4 servers)
|
||||
- bash-language-server (npm prebuilt)
|
||||
- docker-language-server (Go binary)
|
||||
- marksman (prebuilt binary)
|
||||
- terraform-ls (HashiCorp release binary)
|
||||
|
||||
## Installation
|
||||
|
||||
### Prerequisites
|
||||
|
||||
@@ -64,45 +167,33 @@ For detailed build and configuration status of all MCP/LSP servers, see [STATUS.
|
||||
|
||||
### Setup Scripts
|
||||
|
||||
The repository includes helpful scripts in the `scripts/` directory to simplify setup and management:
|
||||
The repository includes helpful scripts in the `scripts/` directory:
|
||||
|
||||
#### scripts/CloneVendorRepos.sh
|
||||
Clone all upstream vendor MCP/LSP repositories:
|
||||
|
||||
```bash
|
||||
./scripts/CloneVendorRepos.sh
|
||||
```
|
||||
|
||||
This script clones all 40+ vendor repositories into `vendor/` directory.
|
||||
|
||||
#### scripts/BuildAll.sh
|
||||
Build all MCP/LSP services:
|
||||
|
||||
```bash
|
||||
./scripts/BuildAll.sh
|
||||
```
|
||||
|
||||
This script iterates through all services in `docker-compose.yml` and builds each one.
|
||||
|
||||
#### scripts/CleanVendor.sh
|
||||
Remove all cloned vendor repositories:
|
||||
|
||||
```bash
|
||||
./scripts/CleanVendor.sh
|
||||
```
|
||||
|
||||
⚠️ **Warning**: This permanently deletes all cloned vendor repositories. You'll need to re-clone them.
|
||||
|
||||
#### scripts/StatusCheck.sh
|
||||
Check build status of all services:
|
||||
|
||||
```bash
|
||||
./scripts/StatusCheck.sh
|
||||
```
|
||||
|
||||
This script checks which Docker images exist and compares with `STATUS.md`.
|
||||
|
||||
## 💻 Usage
|
||||
## Usage
|
||||
|
||||
### Docker Compose Commands
|
||||
|
||||
@@ -160,7 +251,33 @@ docker compose --profile prod up
|
||||
docker compose --profile design up
|
||||
```
|
||||
|
||||
## 🔧 Crush Integration
|
||||
## Environment Variables
|
||||
|
||||
Required variables for MCP servers (see `.env.example`):
|
||||
|
||||
| Service | Required Variables |
|
||||
|---------|-------------------|
|
||||
| bitwarden-mcp | `BITWARDEN_CLIENT_ID`, `BITWARDEN_CLIENT_SECRET`, `BITWARDEN_PASSWORD`, `BITWARDEN_SERVER_URL` |
|
||||
| discourse-mcp | `DISCOURSE_URL`, `DISCOURSE_API_KEY`, `DISCOURSE_API_USERNAME` |
|
||||
| ghost-mcp | `GHOST_API_URL`, `GHOST_ADMIN_API_KEY` |
|
||||
| cloudron-mcp | `CLOUDRON_URL`, `CLOUDRON_TOKEN` |
|
||||
| nextcloud-mcp | `NEXTCLOUD_HOST`, `NEXTCLOUD_USERNAME`, `NEXTCLOUD_APP_PASSWORD` |
|
||||
| proxmox-mcp | `PROXMOX_HOST`, `PROXMOX_USER`, `PROXMOX_TOKEN`, `PROXMOX_NODE` |
|
||||
| snipeit-mcp | `SNIPEIT_URL`, `SNIPEIT_TOKEN` |
|
||||
| redmine-mcp | `REDMINE_URL`, `REDMINE_API_KEY` |
|
||||
| wordpress-mcp | `WORDPRESS_URL`, `WORDPRESS_USERNAME`, `WORDPRESS_APPLICATION_PASSWORD` |
|
||||
| docspace-mcp | `DOCSPACE_HOST`, `DOCSPACE_TOKEN` |
|
||||
| imap-mcp | `IMAP_SERVER`, `IMAP_PORT`, `IMAP_USERNAME`, `IMAP_PASSWORD` |
|
||||
| postizz-mcp | `POSTIZ_API_KEY`, `POSTIZ_URL` |
|
||||
| matomo-mcp | `MATOMO_URL`, `MATOMO_TOKEN` |
|
||||
| elasticsearch-mcp | `ELASTICSEARCH_URL`, `ELASTICSEARCH_USERNAME`, `ELASTICSEARCH_PASSWORD` |
|
||||
| kicad-mcp | `KICAD_HOST` (default: host.docker.internal), `KICAD_PORT` (default: 5555) |
|
||||
| context7-mcp | `UPSTASH_REDIS_REST_URL`, `UPSTASH_REDIS_REST_TOKEN` |
|
||||
| penpot-mcp | `PENPOT_URL` (default: https://design.penpot.app), `PENPOT_TOKEN` |
|
||||
|
||||
**Security Note**: Never commit `.env` file to version control.
|
||||
|
||||
## Crush Integration
|
||||
|
||||
All LSP and MCP instances must be configured in `crush.json` for Crush to use them.
|
||||
|
||||
@@ -209,24 +326,24 @@ For Docker-based LSP instances, use this pattern:
|
||||
}
|
||||
```
|
||||
|
||||
## 🏗️ Project Structure
|
||||
## Project Structure
|
||||
|
||||
```
|
||||
KNEL-AIMiddleware/
|
||||
├── docker-compose.yml # Service orchestration
|
||||
├── .env # Environment variables (not committed)
|
||||
├── .env.example # Environment template
|
||||
├── dockerfiles/ # Custom Dockerfiles (tracked in git)
|
||||
├── .env # Environment variables (not committed)
|
||||
├── .env.example # Environment template
|
||||
├── dockerfiles/ # Custom Dockerfiles (tracked in git)
|
||||
│ ├── bash-language-server/
|
||||
│ ├── docker-language-server/
|
||||
│ └── marksman/
|
||||
├── vendor/ # Cloned repositories (gitignored)
|
||||
│ ├── bash-language-server/
|
||||
│ ├── docker-language-server/
|
||||
│ └── marksman/
|
||||
├── AGENTS.md # Development workflow and conventions
|
||||
├── STATUS.md # Server status and progress tracking
|
||||
└── README.md # This file
|
||||
├── vendor/ # Cloned repositories (gitignored)
|
||||
├── docs/ # Documentation
|
||||
│ └── SDLC.md # Software Development Lifecycle
|
||||
├── AGENTS.md # AI agent guidelines and rules
|
||||
├── STATUS.md # Server status and progress tracking
|
||||
├── JOURNAL.md # Development journal (ADRs, insights)
|
||||
└── README.md # This file
|
||||
```
|
||||
|
||||
### Dockerfile Management
|
||||
@@ -247,22 +364,7 @@ This approach:
|
||||
- Uses vendor repository as build context
|
||||
- Maintains clean separation of concerns
|
||||
|
||||
## 🌍 Environment Variables
|
||||
|
||||
Required variables (see `.env.example`):
|
||||
|
||||
| Variable | Description | Required |
|
||||
|----------|-------------|-----------|
|
||||
| `OPENAI_API_KEY` | OpenAI API key for LLM services | Yes (for OpenAI) |
|
||||
| `KICAD_HOST` | KiCAD server host | Yes (for KiCAD MCP) |
|
||||
| `KICAD_PORT` | KiCAD server port | Yes (for KiCAD MCP) |
|
||||
| `BITWARDEN_*` | Bitwarden credentials | Yes (for Bitwarden MCP) |
|
||||
| `MATOMO_*` | Matomo API credentials | Yes (for Matomo MCP) |
|
||||
| `*_API_KEY` | Service-specific API keys | Varies |
|
||||
|
||||
**⚠️ Security Note**: Never commit `.env` file to version control.
|
||||
|
||||
## 🔍 Troubleshooting
|
||||
## Troubleshooting
|
||||
|
||||
### Container Not Starting
|
||||
|
||||
@@ -301,32 +403,22 @@ ports:
|
||||
- "8081:8080" # Change host port
|
||||
```
|
||||
|
||||
## 🤝 Contributing
|
||||
## Contributing
|
||||
|
||||
Contributions are welcome! Please see [AGENTS.md](AGENTS.md) for development guidelines.
|
||||
Contributions are welcome! Please see [AGENTS.md](AGENTS.md) for development guidelines and [docs/SDLC.md](docs/SDLC.md) for the development workflow.
|
||||
|
||||
### Development Workflow
|
||||
|
||||
1. Review [AGENTS.md](AGENTS.md) for conventions
|
||||
2. Check [STATUS.md](STATUS.md) for current project status
|
||||
3. Create feature branch
|
||||
4. Add service following existing patterns
|
||||
5. Update `docker-compose.yml`, `STATUS.md`, and `crush.json`
|
||||
6. Test thoroughly
|
||||
7. Submit pull request
|
||||
|
||||
## 📄 License
|
||||
|
||||
This project is licensed under the MIT License - see [LICENSE](LICENSE) file for details.
|
||||
|
||||
## 🙏 Acknowledgments
|
||||
## References
|
||||
|
||||
- [Model Context Protocol](https://modelcontextprotocol.io/)
|
||||
- [Language Server Protocol](https://microsoft.github.io/language-server-protocol/)
|
||||
- [MCP SDK](https://github.com/modelcontextprotocol/sdk)
|
||||
- [Docker](https://www.docker.com/)
|
||||
- [Charmbracelet Crush](https://github.com/charmbracelet/crush)
|
||||
|
||||
## License
|
||||
|
||||
This project is licensed under the MIT License - see [LICENSE](LICENSE) file for details.
|
||||
|
||||
---
|
||||
|
||||
**Maintained by**: KNEL Development Team
|
||||
**Last Updated**: 2026-02-19
|
||||
|
||||
Reference in New Issue
Block a user