myron 05522edb1d Add llava vision: use Ollama llava:7b for all image analysis, Claude as fallback
- Add _ollama_vision_call() using Ollama /api/generate with images array
- handle_screenshot: try llava first (free, on-LAN), fall back to Claude on error;
  text-only snapshots now use ollama instead of groq
- handle_vision: same llava-first/Claude-fallback pattern; caller can force
  provider='ollama' or 'claude' explicitly; stored provider_used reflects actual
  provider that ran

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01X8tDRrQqgLjqXebMCBNcP3
2026-07-01 04:05:37 -05:00
2026-06-29 20:58:22 -05:00

JARVIS

Iron Man-style AI assistant for home and network management.

Features

  • Home Assistant control (lights, climate, scenes, switches)
  • Proxmox VM management (start/stop/status)
  • 4-tier chat: KB intents > Groq cloud > Ollama local > Claude API
  • Real-time status bar (HA, Proxmox, DigitalOcean)
  • Iron Man HUD at jarvis.orbishosting.com

Stack

  • PHP 8.x / Apache / MySQL on Ubuntu 24.04
  • Ollama VM at 10.48.200.95 (llama3.2:1b)
  • Groq API (llama-3.3-70b / compound-mini with web search)
  • Claude API (Anthropic) final fallback

Setup

cp api/config.example.php api/config.php Fill in all credentials in config.php before running.

Key Files

  • public/index.html Iron Man HUD frontend
  • public/api.php API router
  • api/config.example.php Config template
  • api/endpoints/chat.php 4-tier chat handler
  • api/endpoints/facts_collector.php HA entity sync cron
  • api/lib/kb_engine.php KB intent engine
  • api/lib/db.php PDO database wrapper
S
Description
Mirror of github.com/myronblair/jarvis
Readme 12 MiB
Languages
PHP 49.7%
Python 21.8%
JavaScript 15.6%
CSS 6.4%
Shell 3.1%
Other 3.4%