🏆 Winner of the Snap Inc. API Prize at Hack the North 2025 🏆
SpectraSphere is a hackathon project built at Hack the North 2025. It transforms a handful of photos and a short trip description into a five-panel, themed storyboard. Each story feels like a mini comic flipbook, complete with captions and stylized visuals. You can view and share the generated story as an immersive AR experience.
SpectraSphere also integrates with Snap Spectacles:
- Open your generated story inside the glasses to view your panels in immersive AR.
- The glasses will read the captions aloud so the experience feels narrated.
- Alongside your story, the system generates a 3D interactive object that symbolizes the trip (e.g. a ramen bowl for a food adventure, a torii gate for a Japan trip).
- This object floats in AR, and you can walk around it, tap it, or interact with it as a living memory anchor.
This repo ships a single runnable app for demos: spectacles/.
No separate backend/frontend needed.
git clone https://github.com/your-username/spectrasphere.git
cd spectrasphere/spectacles-
Go to Lenstudio and import this repo
- New Project → Import from GitHub → paste the repo URL
-
Open Lenstudio and Download the Remote Service Gateway Module from Asset Library
- Add the obtained API key to the Remote Service Gateway Component
-
In Story Viewer Object, Under API Endpoint, add:
https://api.jsonbin.io/v3/b/<JSONBIN_ID>/latest?meta=false- Run the App by Clicking on Preview Lenses on Lenstudio.
- Upload 4 photos of your trip.
- Enter a short trip blurb (e.g. “A weekend at Hack the North coding and exploring Waterloo”).
- Our backend (Cohere + Jsonbin) generates a 5-panel story JSON.
- That JSON is hosted at a stable public URL.
- The Spectacles app fetches this JSON and renders it as a flipbook in your chosen theme.
- Open in Snap Spectacles for a narrated AR flipbook + floating 3D memory object.
- Frontend: React + Tailwind (flipbook + themes)
- App Folder:
spectacles/(standalone viewer) - AI Model: Cohere Aya Vision (
c4ai-aya-vision-32b) - Storage: Jsonbin (public JSON endpoint)
- Other Tools: Lucide icons, styled components
- Hardware Integration: Snap Spectacles (AR narration + 3D object generation)
- Comic Book
- Studio Ghibli
- Watercolor Travel Journal
- Cyberpunk Neon