Skip to content
View HowardLiYH's full-sized avatar
πŸ‘‹
Learning
πŸ‘‹
Learning

Block or report HowardLiYH

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
HowardLiYH/README.md

Hi there, I'm Howard Li πŸ‘‹

One principle, three substrates β€” a tree with three branches: circuitry & weights (GAUSE), market & candlesticks (RISP), memory & documents (NicheMem), rooted in a glowing core: structure, not reward

I am a Master's student at UPenn (Applied Math & Computational Science) and a graduate of Bowdoin College (Math & Economics), originally from Shanghai, China.


πŸ”­ Research Vision: The Post-Scaling Era

"The next gains won't come from bigger monoliths, but from populations of specialists β€” and from deciding who is allowed to keep knowing things when the world moves on."

I operationalize ecological dynamics (competitive exclusion, niche partitioning) to build learner populations that self-organize, retain dormant expertise that reward-chasing systems provably destroy, and stay calibrated to environments that return changed.


πŸ§ͺ Current Research

Emergent specialization and memory in learner populations under non-stationarity

One principle β€” what survives a bounded budget must be decided by structure, not by the reward/usage stream β€” instantiated across three substrates:

  • GAUSE (weight space β€” learner populations) β€” competitive exclusion as a coordination-free assignment mechanism. Central finding: retention of dormant-regime knowledge tracks a single property β€” reward-independence of capacity assignment. Reward-driven allocators (capacity-bounded monoliths, learned MoE routers) are structurally blind to dormant tasks; emergent competition reaches the protective assignment with no gate, no schedule, no diversity objective β€” matching a hand-designed oracle it was never shown.

  • RISP (decision space β€” trading strategy pools) β€” the financial successor: decision-focused (predict-then-optimize) strategy pools. Decomposes market non-stationarity into two independently-owned failure modes β€” between-regime forgetting (fixed by allocation) and within-regime drift (fixed by an episode-invariance objective) β€” with a measured super-additive interaction: neither fix works without the other. Ships its honest audits: a pre-registered real-data gate that returned null (shipped, not buried) and the measured boundary where the mechanism inverts.

  • NicheMem (context space β€” long-horizon agent memory) β€” the same principle transported to agent memory: usage-driven policies (LRU paging, usage-weighted compression, learned utility) erase dormant-family skills as a class β€” what the score measures is irrelevant; that it is a function of the usage stream is decisive. Competitive memory ownership retains dormant runbooks exactly, recovering 97% of a privileged oracle with no labels, quotas, or trained router. Mechanism-level evidence today; the LLM tier is pre-registered (10 predictions, 4 refuted and reported).

⬇️ Next

  • NicheMem's LLM tier β€” the decisive gate experiment its pre-registration commits to: capacity becomes context and memory, dormancy becomes stale expertise. The mechanism is validated; the substrate is the open question.
  • RISP's equities flagship β€” CRSP S&P 500 constituents, 7 crisis episodes, structure gate pre-registered.

Key Results:

  • πŸš€ Efficiency: matches hand-built oracles without being shown them (GAUSE; RISP, p = 0.72; NicheMem, 97%) β€” all on laptop CPUs.
  • 🧠 Emergence: specialization and ownership arise from local competition, never central design.
  • πŸ” Honesty: every project pre-registers its predictions and ships its refutations β€” across the three repos, seven pre-registered predictions were refuted and reported as findings.

Key Notes:

  • ❓ "Where does GAUSE most directly plug in?" A large MoE model whose rarely-triggered experts get overwritten because they emit no routing signal β€” GAUSE predicts the gate forgets them and competition-based ownership retains them.

πŸ“« Connect with Me

Twitter LinkedIn

Pinned Loading

  1. GAUSE GAUSE Public

    A router-free, reward-independent alternative to MoE gating that resists catastrophic forgetting in continual/non-stationary settings.

    Python 1

  2. NicheMem NicheMem Public

    Idle but not forgotten: usage-driven agent memory forgets the dormant skills you'll need next quarter; NicheMem's competitive ownership retains them exactly. Mechanism-level benchmark + verified th…

    TeX 1

  3. RISP RISP Public

    Regime-Invariant Specialist Pools (RISP): reward-independent specialist retention + episode-invariant decision-focused training for non-stationary markets. Theory, 11-arm experiments, three papers …

    TeX 1

  4. Emergent-Applications Emergent-Applications Public

    πŸš€ Revolutionary applications built on emergent specialization research: AutoML orchestration, trading systems, research assistants, and more.

    Python 1

  5. PopAgent PopAgent Public

    PopAgent: Multi-agent LLM trading with adaptive method selection. Agents learn WHICH methods to use via Thompson Sampling and population-based learning.

    Python 3

  6. dydx-trading-bot dydx-trading-bot Public

    An automated trading bot for conducting Pairs Trading on DYDX.

    Python 4