Skip to content
View kapildhinwa2010-dev's full-sized avatar
🏫
School student / research about ai with ai. online till 9 Nov 2026. stay tuned
🏫
School student / research about ai with ai. online till 9 Nov 2026. stay tuned
  • None
  • India
  • 05:56 (UTC -12:00)

Block or report kapildhinwa2010-dev

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

STOP,see Repo list hereπŸ‘‹

scroll down to know about my project

This proflie is a mini research and tools lab for AI resrchers

I'm Kapil Dhinwa, a school student learning AI by building practical projects with AI-assisted development.

I enjoy exploring new ideas in machine learning, language models, memory systems, neuromorphic computing, and wave-based AI. I design the ideas, break down the problems, and use AI as a development partner to help turn them into working projects.


🌍 New Architecture (5)

  • fluid-ARC β€” A numerics-first language model built on sheaf-guided spectral diffusion β€” every math claim machine-checked (21 self-checks, 59 CI tests).
  • DNA_DYNIMO β€” An experimental PyTorch toolkit exploring Fourier-feature neural fields for matrix generation, budget-aware routing, and a compact causal transformer.
  • NEXUS-16 β€” A wave-native, tokenizer-free byte-level semantic encoder crunching text at ~956K tokens/s.
  • Spiking_GNN β€” A bio-inspired 241M-parameter spiking graph neural network that computes with spikes, not dense activations.
  • FREQUENCY_EVER β€” A wave-native blueprint: no floats, no tokenizer, no GEMM β€” computation is wave interference.

πŸ”§ Adaptive Plug-and-Play Layers (2)

  • fluidtech πŸš€ flagship β€” A bounded memory layer for language models with exact recall, bounded KV-cache management, and an optional PyTorch adapter.
  • TMU β€” A GPT-2 plugin layer that carries world time into a frozen base model β€” only the layer trains.

πŸ§ͺ Failed Research Arc: DNA-LLM (Parts 1–3) β€” Post-Mortem

An honest archive of an ambitious attempt to compress full LLM knowledge and behavior into <1–10 MB β€” documenting what worked in narrow tests, where the approach broke, and why I pivoted.

  • DNA-LLM (Part 1 β€” Weight Generation / DNA Nanna): Explored Implicit Neural Representations (randomized Fourier Features + MLP) to map 2D coordinates into ~1B virtual parameters (3.75 GB) from ~257K DNA weights (~1 MB, 3913x ratio). Why it fell short: Generating structured weights from coordinates didn't translate into compressing real pretrained LLM knowledge without quality collapse.
  • DNA-LLM-PART-2 (Part 2 β€” Behavior Extraction / Reverse.Dean): Shifted from static weights to activation-level "Behavior DNA" (8,784 LOC across 21 experiments using runtime SVD bottlenecks, logit lens, concept injection, spiral zoom, and distribution-shift tests). Why it fell short: Activation bottlenecks and concept rescue couldn't generalize reliably to unseen, open-ended prompts.
  • DNA-LLM-PART-3 (Part 3 β€” Knowledge Memory / HELIX): Separated storage from interpretation using SPIRAL content-addressing, wave lattices, Reed-Solomon ECC, and relational rule algebra (2,308 LOC). Result: Achieved 99.9–100% accuracy in 3–13 KB on narrow, rule-dense domains (e.g., structured geography/chemistry relations), but failed the main goal β€” it does not scale to general LLM knowledge, full reasoning behavior, or billions of open-ended facts.

Key Takeaway:

  • Rule-dense, structured domains compress dramatically well, but general natural-language intelligence and reasoning cannot be replaced by compact coordinate/hash/rule memory alone β€” which motivated my shift toward practical plug-and-play memory layers like fluidtech.

And all the toolkit(24 repos) and advance tools(94 repos) made by above mentioned 3 failed projects ...

πŸ§ͺ Toolkit (24 tools!)

Small, honest, CI-verified research tools β€” every repo ships with bounded tests, self-diagnosing CI, CodeQL, and honest limitations sections. Negative results included.

Measurement & trust:

  • WAVE-CLASH β€” Stack many messages into one wave signal and measure the crosstalk when you read them back.
  • NEVER_LIE β€” A digest-guarded exact memory that abstains on corruption instead of answering wrong.
  • MOLECULE-COMPRESS β€” Quality-gated LLM compression experiments; first result: ternary PTQ collapse, measured on Qwen2.5-0.5B.
  • VARIEANCE-LIES β€” Rank sweeps showing how much of "99% variance preserved" is a lie for actual behavior.
  • RULE-FORAGER β€” Mines inverse relations between facts, so derived rules cost zero stored bytes.
  • POWERLAW-PROBE β€” SVD spectra of activations vs weights β€” tells you if a layer is compressible at all.
  • LLM-EQUATION β€” A curve distiller that fits equations with an extrapolation gate β€” and rejects curve-fits that lie.
  • ANT-HILL β€” Builds a 3D "occupancy mold" of how a model physically organizes knowledge, with an HTML viewer.
  • Draft_ponit_harness β€” drift-point: the exact generated token where a compressed model replay first diverges from the original.

Model introspection:

  • TRACE-PATH β€” Finds which block of a model carries a piece of information, with activation patching.
  • BUS-TRACE β€” Shows who writes what into the residual stream, block by block.
  • HEAD-DETECTIVE β€” Classifies what every attention head actually does, straight from its attention patterns.
  • LOGIT-STREAM β€” Gives every answer token a birth certificate: which layer pushed it to the top.
  • STATE-MIRROR β€” Watches where two nearly identical prompts start to differ inside a model.
  • -KNOCKOUT-LAB β€” Removes one block at a time and ranks every component by the damage it prevents.
  • NOISE-STORM β€” Pressure-tests every block with calibrated noise and maps what is fragile.
  • PROBE-STACK β€” Maps where a property lives inside a model, one tiny probe per layer.
  • INNER-VOTE- β€” Checks whether a model agrees with itself: hidden-state consensus across paraphrases.
  • KNOW-VAULT β€” Censuses the storage vault inside a memory layer: how many slots, how many dead.

Weight & representation audits:

  • LAYER-CENSUS- β€” Per-layer atlas of weight matrices: shapes, effective rank, spectrum decay, norm statistics.
  • TWIN-TOWER β€” Detects duplicated and redundant layers with cross-layer similarity clustering.
  • DEAD-CELL β€” Maps internal waste: zero rows and columns in weights, plus neurons that never activate.
  • SKIP-RUN- β€” Measures how much model depth is real by skipping every k-th block and tracking behavior deltas.
  • GEOMETRY-SCAN β€” Per-layer hidden state geometry: intrinsic dimension, anisotropy cone strength, variance spectrum.

✦ These projects are co-built with AI, but the ideas, direction, and system designs are mine. I use AI to help execute, test, and iterate on the concepts I want to explore.

πŸ”¬ Advanced Toolkit (94 specialized tools)

All repositories feature: CI workflows, CodeQL security analysis, comprehensive tests, professional documentation, and bugless Python code.

DNA & Fourier-based Systems:

  • FourierNet β€” Fourier-based weight generation with extreme compression (3913x)
  • DNA-Encoder β€” Encode any model into DNA representation
  • DNA-Pro β€” Production-ready DNA generator with inference mode
  • DNA-Lite β€” Lightweight DNA for small models
  • SparseDNA β€” Sparse matrix generation with DNA
  • QuantDNA β€” Quantized DNA weight generation (1-8 bit)
  • MatrixGen β€” Generate matrices from coordinates
  • WeightForge β€” Forge weights from minimal parameters
  • ParamShrink β€” Parameter shrinking via Fourier features

Compression & Activation Analysis:

Knowledge & Memory Systems:

HELIX Architecture:

Router Systems:

Benchmark Suites:

Serving Systems:

Libraries:

Research Tools:

Testing Frameworks:

Generation Systems:

DNA Architectures:

Additional Tools:


🧠 What I'm learning

  • Python and PyTorch
  • Large language models and memory systems
  • Neural networks and graph learning
  • Neuromorphic and wave-based computing
  • Reproducible open-source experimentation

πŸ“ Current status

  • 🌍 School student
  • πŸ§‘β€πŸŽ“ Learning: AI and machine learning
  • πŸ—οΈ Building: projects that excite me
  • πŸ“± Back online: Holi 2027

πŸ‘₯ Connect and collaborate

I enjoy experimenting with AI architectures and learning in public. If you find an issue or have an idea, feel free to open an issue in the relevant repository.

###🏳 UPCOMING PROJECT AFTER HOLI(22 MARCH 2027)

  1. GEOMETRICAL-NURAL-NETWORK
  2. NON- LINERTY 3.PLUG AND PLAY LAYER
  3. NEW ARCHITECTURES

Learn. Build. Share. Repeat.

Popular repositories Loading

  1. fluidtech fluidtech Public

    A bounded memory layer for language models, with exact recall for retained token IDs. NumPy core; optional PyTorch adapter.

    Python 5

  2. NEXUS-16 NEXUS-16 Public

    Wave-native, tokenizer-free byte-level semantic encoder using frequency representations and Mamba-style sequential processing.

    Python 3

  3. Spiking_GNN Spiking_GNN Public template

    Bio-inspired spiking graph neural network with neuromorphic learning and connectome-inspired modeling.

    Python 3

  4. FREQUENCY_EVER FREQUENCY_EVER Public

    Experimental wave-native AI architecture using tokenizer-free frequency-domain computation and soliton-based signal transfer.

    Python 2

  5. fluid-ARC fluid-ARC Public

    Research/prototype Python package exploring a transformer-attention alternative: cellular-sheaf diffusion with multi-scale spectral filtering and sparse top-k routing, plus a small language-model i…

    Python 2

  6. DNA_DYNIMO DNA_DYNIMO Public

    Research toolkit exploring Fourier-feature neural fields for matrix generation, budget-aware routing, and a compact causal transformer in PyTorch.

    Python 2