Traditional property and infrastructure inspections often rely on:
β Manual observations
β Subjective assessments
β Missing quantitative measurements
β No automated compliance validation
β Inconsistent documentation
SiteSynapse combines:
π§ Computer Vision
π Retrieval-Augmented Generation (RAG)
β Rule-Based Compliance Evaluation
π€ Multi-Agent Orchestration
π LLMOps Evaluation
π¨ββ Human-in-the-Loop Escalation
to transform raw inspection imagery into:
β Real-world measurements
β Structural defect analysis
β Code-compliance validation
β Citation-grounded decisions
β Audit-ready inspection reports
|
Depth Estimation Defect Detection Spatial Measurements Dimension Extraction |
TF-IDF Retrieval Keyword Expansion Code Lookup Citation Grounding |
VisionAgent ComplianceAgent AdjudicatorAgent ReportAgent |
Run Tracing Config Registry Regression Tests Evaluation Harness |
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β SITE SYNAPSE β
β AI PROPERTY INSPECTION COPILOT β
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Inspection Image
β
βΌ
ββββββββββββββββββββββββββββββββββββββββββββ
β VisionAgent β
ββββββββββββββββββββββββββββββββββββββββββββ€
β β’ Defect Detection β
β β’ Depth Estimation β
β β’ Real-world Measurements β
ββββββββββββββββββββββββββββββββββββββββββββ
β
βΌ
ββββββββββββββββββββββββββββββββββββββββββββ
β ComplianceAgent β
ββββββββββββββββββββββββββββββββββββββββββββ€
β β’ Hybrid Retrieval β
β β’ TF-IDF Search β
β β’ Keyword Expansion β
β β’ OSHA / IBC / IRC Lookup β
ββββββββββββββββββββββββββββββββββββββββββββ
β
βΌ
ββββββββββββββββββββββββββββββββββββββββββββ
β RuleBasedJudge β
ββββββββββββββββββββββββββββββββββββββββββββ€
β PASS β
β FAIL β
β AMBIGUOUS β
ββββββββββββββββββββββββββββββββββββββββββββ
β
βΌ
ββββββββββββββββββββββββββββββββββββββββββββ
β AdjudicatorAgent β
ββββββββββββββββββββββββββββββββββββββββββββ€
β Confidence Thresholding β
β Human Escalation Logic β
β Review Notes β
ββββββββββββββββββββββββββββββββββββββββββββ
β
βΌ
ββββββββββββββββββββββββββββββββββββββββββββ
β ReportAgent β
ββββββββββββββββββββββββββββββββββββββββββββ€
β Markdown Report Generation β
β Compliance Citations β
β Measurement Summary β
ββββββββββββββββββββββββββββββββββββββββββββ
β
βΌ
ββββββββββββββββββββββββββββββββββββββββββββ
β RunLogger β
ββββββββββββββββββββββββββββββββββββββββββββ€
β JSONL Traces β
β Latency Metrics β
β Escalation Statistics β
β Evaluation Analytics β
ββββββββββββββββββββββββββββββββββββββββββββ
Perception layer responsible for extracting quantitative observations.
Depth Estimation:
Monocular Depth Processing
Defect Detection:
Crack Detection
Surface Damage
Structural Anomalies
Measurements:
Length Estimation
Depth Estimation
Physical Extent AnalysisRetrieves building regulations and safety standards.
IRC:
International Residential Code
IBC:
International Building Code
OSHA:
OSHA 1926 Safety StandardsRetrieval:
TF-IDF Lexical Search
Expansion:
Semantic Keyword Expansion
Ranking:
Top-K Document Selection
Output:
Citation Grounded EvidenceDetermines compliance verdicts.
PASS:
Meets Standards
FAIL:
Violates Standards
AMBIGUOUS:
Requires Additional ReviewHuman-in-the-loop escalation framework.
Confidence Score < 0.40:
Escalate
Borderline Findings:
Escalate
Conflicting Evidence:
Escalate
Output:
Review Notes
Escalation SummaryGenerates inspection-ready documentation.
Inspection Summary
Defect Findings
Physical Measurements
Compliance Verdicts
Rule Citations
Escalation Notes
Final Recommendationv1_mock_baseline:
Baseline Inspection Logic
v2_stricter_escalation:
Increased Compliance SensitivityEvery inspection produces structured telemetry.
{
"inspection_id": "run_184",
"latency_ms": 284,
"findings": 3,
"verdict": "FAIL",
"escalated": true
}Stored automatically in:
runs.jsonl
SiteSynapse/
β
βββ agents/
β βββ adjudicator_agent.py
β βββ compliance_agent.py
β βββ orchestrator.py
β βββ report_agent.py
β βββ state.py
β βββ vision_agent.py
β
βββ eval/
β βββ eval_harness.py
β βββ golden_set.py
β
βββ llmops/
β βββ logger.py
β βββ registry.py
β
βββ rag/
β βββ corpus.py
β βββ retriever.py
β
βββ vision/
β βββ defect_detector.py
β βββ depth_estimator.py
β βββ measurements.py
β
βββ tests/
β βββ test_regression.py
β
βββ app.py
βββ cli.py
βββ generate_sample_images.py
βββ requirements.txt
βββ README.md
git clone https://github.com/yourusername/SiteSynapse.git
cd SiteSynapsepython -m venv venv
venv\Scripts\activatepython3 -m venv venv
source venv/bin/activatepip install -r requirements.txtpython generate_sample_images.pypython -m cli sample_images/wall_0.pngpython tests/test_regression.pystreamlit run app.py| Metric | Target |
|---|---|
| Retrieval Recall@3 | β₯ 0.85 |
| Citation Grounding Rate | β₯ 0.90 |
| Depth Estimator MAE | β€ 1.5m |
| Escalation Precision | β₯ 0.80 |
| Report Completeness | β₯ 95% |
| Compliance Accuracy | β₯ 0.88 |
Defect:
Wall Crack
Length:
2.3 m
Depth:
0.08 m
Compliance:
FAIL
Citation:
OSHA 1926.501
Confidence:
0.37
Escalated:
YESLanguage:
Python 3.10+
Frontend:
Streamlit
Custom CSS
GSAP 3
Machine Learning:
NumPy
Scikit-Learn
Pillow
RAG:
TF-IDF Retrieval
Hybrid Search
Testing:
Pytest
Evaluation Harness
Observability:
JSONL Tracing
Run LoggingDesigned and developed a multi-agent AI property inspection platform integrating computer vision, retrieval-augmented generation, rule-based compliance validation, human-in-the-loop escalation workflows, and LLMOps evaluation pipelines to generate citation-grounded inspection reports with quantitative structural measurements and automated regulatory assessment.
@software{sitesynapse2026,
title={SiteSynapse},
author={Your Name},
year={2026},
description={AI Property Inspection Copilot with Vision-Grounded Measurements, Compliance RAG, Multi-Agent Escalation and LLMOps Evaluation}
}MIT License
Copyright (c) 2026
See the LICENSE file for full details.