Skip to content

Latest commit

Β 

History

4 Commits

Folders and files

NameName
Last commit message
Last commit date
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

πŸ—οΈ SITESYNAPSE


⚑ AI PROPERTY INSPECTION COPILOT

Vision-Grounded Measurements β€’ Citation-Backed Compliance β€’ Multi-Agent Escalation


🌍 The Problem

Traditional property and infrastructure inspections often rely on:

❌ Manual observations

❌ Subjective assessments

❌ Missing quantitative measurements

❌ No automated compliance validation

❌ Inconsistent documentation


πŸš€ The Solution

SiteSynapse combines:

🧠 Computer Vision

πŸ“š Retrieval-Augmented Generation (RAG)

βš– Rule-Based Compliance Evaluation

πŸ€– Multi-Agent Orchestration

πŸ“Š LLMOps Evaluation

πŸ‘¨β€βš– Human-in-the-Loop Escalation

to transform raw inspection imagery into:

βœ” Real-world measurements

βœ” Structural defect analysis

βœ” Code-compliance validation

βœ” Citation-grounded decisions

βœ” Audit-ready inspection reports


⚑ CORE CAPABILITIES

πŸ‘ Vision AI

Depth Estimation

Defect Detection

Spatial Measurements

Dimension Extraction

πŸ“š RAG Engine

TF-IDF Retrieval

Keyword Expansion

Code Lookup

Citation Grounding

πŸ€– Agents

VisionAgent

ComplianceAgent

AdjudicatorAgent

ReportAgent

πŸ“Š LLMOps

Run Tracing

Config Registry

Regression Tests

Evaluation Harness


🧠 MULTI-AGENT INSPECTION PIPELINE

╔══════════════════════════════════════════════════════════════════════╗
β•‘                         SITE SYNAPSE                               β•‘
β•‘             AI PROPERTY INSPECTION COPILOT                         β•‘
β•šβ•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•

                     Inspection Image
                             β”‚
                             β–Ό

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚               VisionAgent                β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚ β€’ Defect Detection                       β”‚
β”‚ β€’ Depth Estimation                       β”‚
β”‚ β€’ Real-world Measurements                β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                             β”‚
                             β–Ό

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚             ComplianceAgent              β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚ β€’ Hybrid Retrieval                       β”‚
β”‚ β€’ TF-IDF Search                          β”‚
β”‚ β€’ Keyword Expansion                      β”‚
β”‚ β€’ OSHA / IBC / IRC Lookup                β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                             β”‚
                             β–Ό

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚            RuleBasedJudge                β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚ PASS                                     β”‚
β”‚ FAIL                                     β”‚
β”‚ AMBIGUOUS                                β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                             β”‚
                             β–Ό

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚            AdjudicatorAgent              β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚ Confidence Thresholding                  β”‚
β”‚ Human Escalation Logic                   β”‚
β”‚ Review Notes                             β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                             β”‚
                             β–Ό

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚              ReportAgent                 β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚ Markdown Report Generation               β”‚
β”‚ Compliance Citations                     β”‚
β”‚ Measurement Summary                      β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                             β”‚
                             β–Ό

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                RunLogger                 β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚ JSONL Traces                             β”‚
β”‚ Latency Metrics                          β”‚
β”‚ Escalation Statistics                    β”‚
β”‚ Evaluation Analytics                     β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

πŸ”¬ AI AGENTS

πŸ‘ VisionAgent

Perception layer responsible for extracting quantitative observations.

Features

Depth Estimation:
  Monocular Depth Processing

Defect Detection:
  Crack Detection
  Surface Damage
  Structural Anomalies

Measurements:
  Length Estimation
  Depth Estimation
  Physical Extent Analysis

πŸ“š ComplianceAgent

Retrieves building regulations and safety standards.

Supported Sources

IRC:
  International Residential Code

IBC:
  International Building Code

OSHA:
  OSHA 1926 Safety Standards

Hybrid Retrieval Engine

Retrieval:
  TF-IDF Lexical Search

Expansion:
  Semantic Keyword Expansion

Ranking:
  Top-K Document Selection

Output:
  Citation Grounded Evidence

βš– RuleBasedJudge

Determines compliance verdicts.

PASS:
  Meets Standards

FAIL:
  Violates Standards

AMBIGUOUS:
  Requires Additional Review

πŸ‘¨β€βš– AdjudicatorAgent

Human-in-the-loop escalation framework.

Confidence Score < 0.40:
  Escalate

Borderline Findings:
  Escalate

Conflicting Evidence:
  Escalate

Output:
  Review Notes
  Escalation Summary

πŸ“ ReportAgent

Generates inspection-ready documentation.

Generated Report Includes

Inspection Summary
Defect Findings
Physical Measurements
Compliance Verdicts
Rule Citations
Escalation Notes
Final Recommendation

πŸ“Š LLMOPS OBSERVABILITY

Configuration Registry

v1_mock_baseline:
  Baseline Inspection Logic

v2_stricter_escalation:
  Increased Compliance Sensitivity

Run Tracing

Every inspection produces structured telemetry.

{
  "inspection_id": "run_184",
  "latency_ms": 284,
  "findings": 3,
  "verdict": "FAIL",
  "escalated": true
}

Stored automatically in:

runs.jsonl

πŸ“‚ REPOSITORY STRUCTURE

SiteSynapse/
β”‚
β”œβ”€β”€ agents/
β”‚   β”œβ”€β”€ adjudicator_agent.py
β”‚   β”œβ”€β”€ compliance_agent.py
β”‚   β”œβ”€β”€ orchestrator.py
β”‚   β”œβ”€β”€ report_agent.py
β”‚   β”œβ”€β”€ state.py
β”‚   └── vision_agent.py
β”‚
β”œβ”€β”€ eval/
β”‚   β”œβ”€β”€ eval_harness.py
β”‚   └── golden_set.py
β”‚
β”œβ”€β”€ llmops/
β”‚   β”œβ”€β”€ logger.py
β”‚   └── registry.py
β”‚
β”œβ”€β”€ rag/
β”‚   β”œβ”€β”€ corpus.py
β”‚   └── retriever.py
β”‚
β”œβ”€β”€ vision/
β”‚   β”œβ”€β”€ defect_detector.py
β”‚   β”œβ”€β”€ depth_estimator.py
β”‚   └── measurements.py
β”‚
β”œβ”€β”€ tests/
β”‚   └── test_regression.py
β”‚
β”œβ”€β”€ app.py
β”œβ”€β”€ cli.py
β”œβ”€β”€ generate_sample_images.py
β”œβ”€β”€ requirements.txt
└── README.md

⚑ QUICK START

1️⃣ Clone Repository

git clone https://github.com/yourusername/SiteSynapse.git

cd SiteSynapse

2️⃣ Create Virtual Environment

Windows

python -m venv venv

venv\Scripts\activate

Linux / macOS

python3 -m venv venv

source venv/bin/activate

3️⃣ Install Dependencies

pip install -r requirements.txt

4️⃣ Generate Synthetic Inspection Images

python generate_sample_images.py

5️⃣ Run CLI Inspection

python -m cli sample_images/wall_0.png

6️⃣ Execute Regression Suite

python tests/test_regression.py

7️⃣ Launch Streamlit Dashboard

streamlit run app.py

πŸ“ˆ EVALUATION BENCHMARKS

Metric Target
Retrieval Recall@3 β‰₯ 0.85
Citation Grounding Rate β‰₯ 0.90
Depth Estimator MAE ≀ 1.5m
Escalation Precision β‰₯ 0.80
Report Completeness β‰₯ 95%
Compliance Accuracy β‰₯ 0.88

πŸ§ͺ SAMPLE INSPECTION OUTPUT

Defect:
  Wall Crack

Length:
  2.3 m

Depth:
  0.08 m

Compliance:
  FAIL

Citation:
  OSHA 1926.501

Confidence:
  0.37

Escalated:
  YES

πŸ›  TECHNOLOGY STACK

Core Stack

Language:
  Python 3.10+

Frontend:
  Streamlit
  Custom CSS
  GSAP 3

Machine Learning:
  NumPy
  Scikit-Learn
  Pillow

RAG:
  TF-IDF Retrieval
  Hybrid Search

Testing:
  Pytest
  Evaluation Harness

Observability:
  JSONL Tracing
  Run Logging

πŸ’Ό RESUME HIGHLIGHT

Designed and developed a multi-agent AI property inspection platform integrating computer vision, retrieval-augmented generation, rule-based compliance validation, human-in-the-loop escalation workflows, and LLMOps evaluation pipelines to generate citation-grounded inspection reports with quantitative structural measurements and automated regulatory assessment.


πŸ“š CITATION

@software{sitesynapse2026,
  title={SiteSynapse},
  author={Your Name},
  year={2026},
  description={AI Property Inspection Copilot with Vision-Grounded Measurements, Compliance RAG, Multi-Agent Escalation and LLMOps Evaluation}
}

πŸ“œ LICENSE

MIT License

Copyright (c) 2026

See the LICENSE file for full details.


⚑ INSPECT SMARTER. MEASURE PRECISELY. COMPLY AUTOMATICALLY.

Built with Python β€’ Computer Vision β€’ RAG β€’ Multi-Agent AI β€’ Streamlit

About

AI site & property inspection copilot using vision-grounded measurements, citation-backed RAG compliance checks, and multi-agent escalation.

Topics

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Contributors

Languages