All issues

Search results

[feature]: extended metamorphic eval w/ label-renaming invariance

enhancementNew feature or requestNew feature or request

Status: Open.

#512 In NandhaKishorM/laya;

· Rukafuu opened on Sep 25, 2026

Independent eval: 12,000 US federal IT solicitations, 741 quote-graded rows: laya 0.780 vs Jev 0.919, and a 16-point drop at 150 to 300 tokens with the state uncut

Status: Open.

#450 In NandhaKishorM/laya;

· bhushankinge opened on Sep 24, 2026

[bug]: MCP tools return invalid model name when using 'auto' with Agent

bugSomething isn't workingSomething isn't working

Status: Open.

#444 In NandhaKishorM/laya;

· soumojit-D48 opened on Sep 24, 2026

CUDA default autocast (bf16) is the least precise dtype: up to 0.073 from fp32 and a preset answer flips; fp16 is within 0.019 at the same latency

Status: Open.

#443 In NandhaKishorM/laya;

· bhushankinge opened on Sep 24, 2026

CI: a required check that never runs, cancelled runs on main, and a plan for the rest

Status: Open.

#399 In NandhaKishorM/laya;

· maxfield-allison opened on Sep 24, 2026

A confidence threshold does not transfer across option counts: at 20 options the gate at 0.85 selects below model accuracy

Status: Open.

#394 In NandhaKishorM/laya;

· PerryLink opened on Sep 24, 2026

Docs site: structure and the guides still to write

Status: Open.

#390 In NandhaKishorM/laya;

· maxfield-allison opened on Sep 24, 2026

Router misroutes dict-state input: language_undecided falls through to english arm (0.10-score checkpoint)

Status: Open.

#384 In NandhaKishorM/laya;

· SuperInstance opened on Sep 24, 2026

A forced-choice cancellation question ignores negation: do NOT cancel is answered cancel_account, at 0.9998 on laya-multilingual

Status: Open.

#377 In NandhaKishorM/laya;

· PerryLink opened on Sep 24, 2026

Feature: confidence-based abstention in the core API (and laya-ts)

Status: Open.

#361 In NandhaKishorM/laya;

· aashish254 opened on Sep 24, 2026

Follow-ups to the scoped OOM fallback: fallback observability + scoped autocast drop

Status: Open.

#351 In NandhaKishorM/laya;

· aashish254 opened on Sep 24, 2026

Pin model revisions and verify runtime artifact integrity

Status: Open.

#332 In NandhaKishorM/laya;

· KunjShah95 opened on Sep 24, 2026