Research gap ledger
Each row states what has actually been demonstrated, what remains missing, and the evidence that would move the field. “Partly answered” means one bounded study exists—not that the result transfers to ordinary production.
Realistic chart and dashboard benchmarks show materially stronger generation alongside render, replay, and semantic failures.
A stratified sample of editorial, operational, scientific, and governed work scored through human acceptance.
Measured, boundedTen primary cases yield three controlled partial joins: HAIChart to analyst use, task decomposition to analyst correction, and ChartAttack to reader harm.
One immutable configuration and accepted artifact carried through real delivery, representative use, a later event, and whole cost.
3 controlled partial · 0 accepted-deliverySeveral systems test data binding or calculation in bounded grammars; execution-clean dashboard outputs can still contain semantic defects.
Accuracy against owned measures, ambiguous fields, changing sources, permissions, and unstated local rules.
Measured, boundedMulti-turn research records regressive editing; in one novice study most observed clutter and unusable-chart repairs failed.
Accepted-artifact correction cost, abandonment, reliable stopping, and regression after delivery.
Failure demonstratedA trained 7B critic beats tested general models on one expert-adjudicated quality rubric; chart-specific tools improve numeric QA and grounding. Strong general models lead some newer transfer tests.
End-to-end, equal-budget routing tests over source fidelity, integrity, readability, interaction, mobile states, repair success, and reader outcomes.
Partly answeredImmediate post-removal learning, ordinary 12-month decay, and adjacent performance-versus-learning trials now yield a three-arm protocol with withdrawal, six-week and six-month transfer, and a separate reader stage.
Human approval and a powered run across capability and accessibility profiles. The protocol is not evidence of learning, atrophy, access, reader benefit, or a winning arm.
Designed, not runTen reader cases yield one direct controlled AI-created-chart effect. Lexara adds six developers using a deployed evaluation toolkit for two weeks across 38 experiments, 57 newly authored cases, ten models, and six prompts. Three production cases and the later same-feature InfoViP operational line bring the audit to 15 named cases.
One immutable artifact/build and exact configuration joined to accepted intended-reader delivery, consequential decision or calibrated trust, whole cost, and later post-release same-lineage recheck. Development selection, reported reviewer confidence, and at-scale processing do not fill those states.
15 named · 1 longitudinal evaluation · 1 operational near-miss · 0 full episodesA 2025 PRISMA review reports 127 supplement positions. The complete crosswalk recovers 122 distinct A208 review keys: 114 DOI keys, two confirmed PubMed identifiers, five keys without a publisher identifier, and one key carrying a conflicted PMID. Five exact-looking DOI candidates exist outside the review-controlled frame and remain unadmitted.
Obtain review-author, publisher, extraction, or A208-controlled joins for the five supplement-only rows and keep the unrelated PMID quarantined before auditing lifecycle fields. Preserve source label, authoritative key, external candidate, identifier validation, and admission authority separately. Do not score unscreened rows or report zero of 127.
127 positions · 122 review keys · 5 authority gaps · denominator unknownA bounded title-cue screen over 122 authoritative A208 keys surfaces one explicit GPT course study. Its one-commit supplement pins 1,271 blobs spanning quiz and homework prompts, results, generated code, and grader bundles.
An immutable provider model/configuration, accepted release, intended-audience delivery and outcome, whole cost, later event, and same-lineage recheck. Government, UN, and student audiences named in prompts were not recipients or evaluators. The other 121 title nonmatches are not exclusions.
122 title-triaged · 1 GPT signal · 1 pinned-output bundle · 0 delivery/recheck chainsExact-DOI discovery covers 114 stable keys and 87 available abstracts. AIDSVu is the sole five-category lifecycle signal: ten years of public delivery, 501,527 unique users in 2019, named planning uses, governance, and a later 2026 data release.
An explicit AI role, immutable build, version-bound audience or decision outcome, affected-audience recheck, and whole cost. Keep 86 abstract cue nonmatches unexcluded; 27 DOI rows lack abstracts and eight stable keys lack DOIs.
114 DOI records · 87 abstracts · 1 non-AI afterlife · 0 complete AI lifecyclesAll 27 no-abstract DOI rows have now been investigated. Six have full primary texts, 20 have primary abstract or official content, and one remains content-unassessed. The held cases separate controlled measurement, co-design/demo, production intent, expert redesign, practice context, risk-ranking decision support, and public delivery.
B91 is access-blocked and unassessed after three bounded passes; reopen only on exact new lawful custody. Otherwise pursue the full B92 paper or one same-artifact accepted field release joined to consequential audience outcome and later affected-audience recheck. The 26 substantive GenAI and AI-visualization-role screens remain empty.
27 investigated · 6 full · 20 abstract/official · 1 access-blocked/unassessed · 0 generic B91 targetsEight stable non-DOI keys yield three exact DOI repairs, two publication-year corrections, one rejected foreign PMID, four full texts, two primary abstracts, one issue excerpt, and one gated primary. The EMR cancer diary reports increasing use; an independent review recovers an 11-clinician QUIS median of 4.38.
The gated row remains unassessed. The cancer diary exposes no AI role, immutable accepted build, log denominator, patient or decision outcome, later event, or affected-clinician recheck. Recover B81, B112's full paper, partial B19/B142 text, or one of the 14 content-unassessed DOI rows.
8 keys · 3 DOI repairs · 1 operational comparator · 0 AI lifecyclesNine high-signal rows were investigated; eight now expose a primary abstract or official project record and seven report participants or evaluators. InfoViP is the delivery near-miss: seven FDA safety evaluators supplied requirements, evaluated the prototype, and had suggestions addressed. An official FDA page describes NLP and unsupervised learning and says an enhanced version will be installed in production.
“Will be installed” does not confirm installation, acceptance, routine use, regulatory outcome, later change, or evaluator return. These eight surfaces are not full papers. A subsequent residual pass reduces the content-unassessed DOI remainder from 14 to three. None contains an explicit GenAI cue.
9 investigated · 8 content surfaces · 7 human evaluations · 0 lifecyclesThe final CIOMS report supports an approved AWS/AERS component processing more than 30 million historical plus about 8,000 daily submissions. The now-closed Elsa/API/UI opportunity names Joshua Xu, Leihong Wu, and Oanh Dang as research mentors.
Closure supplies no selection, work, acceptance, or release receipt. A fellow is a nonemployee barred from inherently governmental functions, and neither official actor profiles nor an adjacent AI-QA project names an InfoViP operator, maintainer, QA executor, release approver, authorization authority, completed audit, or Elsa application join.
3 research mentors · 0 operating authorities · opportunity closed · no InfoViP-Elsa join · 15 named · 0 fullAll 14 residual rows were investigated; eleven now have substantive primary content, including one full chapter. It connects three UX experts and 25 problems to a third version. Corridor stakeholders and university network managers add two practice-context near misses.
At that pass B92, B91, and B110 were metadata-only. A later recheck changes B110, without rewriting this historical 14 → 11 + 3 receipt. Treat expert review, stakeholder application, and multi-unit evaluation as literal stages—not deployment.
14 investigated · 11 substantive · 1 full text · 3 unassessed at that passB110 now has an official abstract, a pinned framework, a pinned DiscoverWater application, and a same-named KU interface reachable in August 2026.
At that pass B92 and B91 remained content-unassessed. The live bytes are not bound to a commit, and no receipt shows acceptance, continuous or ordinary use, consequential audience outcome, accessibility acceptance, affected-audience return, whole cost, or an AI visualization role.
3 rechecked · 1 newly substantive · 1 live surface · 2 unassessed at that passThe dated live DiscoverWater page does not match the sole published v1.2 page state; linked v2.0 source is R/Shiny. Eight of twelve dependency basenames occur in pinned application source, two of three sampled assets match canonically, and an official 2018 record adds a limited prototype demonstration.
No manifest binds the live page to an immutable build. Analytics and comment hooks are instrumentation, not use. Acceptance, ordinary use, audience outcome, accessibility acceptance, later affected-audience return, whole cost, and an AI role remain missing.
1 live page · 0 exact builds · 8/12 names · 2/3 canonical samples · 0 audience outcomesB92's exact publisher abstract describes multicriteria hydrogen-pipeline risk evaluation, Monte Carlo simulation, Kendall's tau rank comparison, and graphs for ranking sections. Three bounded B91 passes cover six named lawful surfaces.
B92's absences are abstract-bounded. B91 remains access-blocked and content-unassessed—not negative—while generic search is paused. Reopen only on an exact publisher abstract/body, accepted manuscript, correction, or new lawful deposit; otherwise pursue a lifecycle-bearing target.
1 publisher abstract · 1 access-blocked/unassessed · generic search paused · 0 AI lifecyclesMultilingual chart QA covers ten languages, while a chart-centric judge benchmark spans 25. Both find language-dependent accuracy or bias.
Human-authored local work, cultural chart conventions, code-switching, more low-resource languages, and delivered reader outcomes. Current sets translate English-centric sources.
Partly answeredOne scientific skill family improved quality in all ten paired suite-by-agent comparisons; broader skill benchmarks show conditional gains and regressions.
Independent tests of popular generic, dashboard, accessibility, mobile, and explanatory skills against the current model and normal harness.
Partly answeredTask and environment typologies explain why journalism, BI, exploration, science, operations, and education differ.
Which dimensions actually change the best generator, critic, evidence bundle, or human gate.
OpenBrowser replay and visible interaction evidence improve dashboard evaluation.
Real-user exploration, authenticated apps, permissions, exports, assistive technology, devices, and recovery paths.
Measured, boundedThree provider families expose enablement, data-boundary, and monitoring controls; two provider stories report named-feature organizational use; two studies add adjacent governance practice. Zero of seven held rows clears the complete same-deployment join.
One feature-specific nine-receipt episode joining version, authorization, effective scope, data authority, audit, routine use, incident disposition, independently accepted outcome, and later recheck.
3 controls · 2 use · 2 adjacent · 0 completeTwelve cost fragments are held. One matches a declared partial inference budget. A second exposes retry survival: over 888 tasks, VisCoder2-32B and GPT-4.1 both finish at 732 execution passes after 584 versus 714 revisions. The released debug paths discard comparable resource telemetry, and execution is not human or production acceptance.
Run current-general and specialist routes through all eleven lanes under one frozen cap and acceptance contract. Persist every retry's tokens, compute, latency, charges, evaluator and human work; retain failed outcomes; and report eligible, attempted, candidate, accepted, delivered, and reader-successful ratios separately.
Same endpoint · 584 vs 714 revisions · 0 / 12 accepted-cost comparisonsThree dashboard afterlives, MAIDR's study surface and maintenance, and Graphy's repeated co-design now enter one six-receipt audit with PM4Py-UCM and DV-World. Every receipt appears somewhere; zero of seven cases joins the complete release-validation chain.
One exact lineage joining repeated representative use, immutable tested build, exact exposure model, versioned release, later material event, and representative or actor-separated post-change recheck—then extending into recovery, authority, accessibility, decision, trust, or whole cost.
0 / 7 full release-validation joinsThree dashboard afterlives cross delivery into a later event; two reach accepted repair, corrected delivery, and maintainer recheck. None receives an affected-actor recheck or transfers maintenance authority.
One affected user or separate operator exercises the corrected route, or a named second person exercises release or incident authority. Keep all twelve actor-separated states on one case.
3 afterlives · 2 restorations · 0 independent recovery · 0 authority transferSome studies release code, tasks, or supplements; others retain executors, judges, model versions, or failure traces.
Independent reruns, cross-renderer tests, stable tasks, and calibration against readers or domain experts.
Open