Skip to content

Laya-style decision models (DecisionEngine) #604

Description

@leehack

Tracking issue for DecisionEngine: typed, non-autoregressive decisions with Laya-style models (ModernBERT GGUF backbone in llama.cpp + a safetensors decision head), following Laya's system_one and the Jev request/response shape.

Design: doc/decision_engine.md (added in the first PR).

Stack (each merged only after maintainer approval):

  1. Pure-Dart core: question/answer types, json.dumps parity, sequence assembly, decoding, parity fixture from laya 0.3.5.
  2. Native backend, engine hooks, DecisionEngine facade, export, local-only E2E, docs.
  3. example/basic_app decision example.
  4. example/laya_tetris Flutter example (base and Tetris-tuned heads).
  5. Head fine-tuning notebook and dataset tool.
  6. Web: decision module in llama-web-bridge, asset publication, WebGpuLlamaBackend wiring.

Needs maintainer decisions before it happens: hosting the Tetris-tuned head; publishing new bridge assets.

Known limits: no Unicode normalization (the Hugging Face tokenizer applies NFC); one encoder pass per question; no cancellation; only the English checkpoint has parity evidence.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestpriority:P2Planned next: useful unblocked work or validation after P1 items

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions