Skip to main content
Search

# Large Language Model

47 related articles

Subscribe to updates
  1. medRxiv

    Clinical research requests skip hand-written SQL: an agentic pipeline matched analyst cohorts across 50 pediatric orthopedic queries

    Natural-language data requests in clinical research used to require staff to translate them into computable rules, pick data sources and write institution-specific queries. A large-language-model multi-agent pipeline decomposes each investigator request into source-specific tasks, generates and executes SQL, then combines structured records with clinical-note adjudication. Of 50 pediatric orthopedic requests, 43 completed manual review, with adjusted median positive predictive value 0.93, sensitivity within the observed union 0.92 and F1 0.90.

  2. arXiv

    Gate-level netlists become readable RTL: RTLREX recovers equivalent designs for all 30 contest benchmarks

    When the original RTL and documentation are gone and only a gate-level netlist or a complete truth table remains, RTLREX has a large language model choose analyses among domain-specific tools, build candidate RTL, and confirm each result with independent equivalence checking. On the 30 benchmarks of ICCAD 2022 CAD Contest Problem A it recovered equivalent high-level RTL for all of them, above WolFEx's 26, and on the 26 recovered by both it cut mean syntax cost by 20.5% relative to WolFEx.

  3. Protocol state machines skip retrieval: State-inferer slices code per transition for an LLM and reaches a strict F-score of 95.2

    State-inferer recovers a protocol implementation's state machine by program slicing: from each state-variable assignment it runs depth-bounded forward and backward searches on the system dependence graph, hands the LLM one compact fragment per transition, then specializes RFC security properties into linear temporal logic formulas over that model and checks them with nuXmv. On seven open-source TLS, IKEv2 and SSH implementations it reaches a macro-average strict transition-level F-score of 95.2 against 78.9 for the strongest baseline, Codex, and uncovers four previously unknown vulnerabilities, all assigned CVE or CNVD identifiers.

  4. Robots stop taking commands literally: MIT's FLEX uses an LLM to turn "don't spill on the laptop" into avoiding every device

    Researchers at MIT and New York University introduce FLEX, a flexible feature-editing pipeline for robot motion planning that lets a robotic arm go beyond the literal wording of a natural-language instruction and infer a higher-level intent the person never stated. Earlier methods added one object to an avoidance list per correction, so the list grew long and went stale as the environment changed. FLEX uses a large language model to generalize across the features already named and a vision system to drop objects no longer present; in three simulated tasks, serving coffee, moving a candle and carrying a bowling ball, the robot followed the literal command and extended avoidance to electronics, flammable objects and fragile items.

  5. arXiv

    LLM interactive narratives get a common yardstick: three experience managers trade off differently on one shared world model, and none wins everywhere

    LLM-driven interactive narrative systems have been hard to compare because each experience manager is tied to its own bespoke scenario. An LLM-based narrative platform turns experience managers into interchangeable modules over a shared symbolic world model of facts, operations and goals, and every applied operation carries explicit preconditions and effects, so any session can be replayed as a common state-transition path. On a Little Red Riding Hood scenario, open generation, Monte Carlo repair and autonomous characters each ran 100 simulated sessions, and no manager led on all four properties: player agency, manager controllability, author intent and robustness.

  6. Patient-safety reasoning without the knowledge graph loses 0.047 F1, while retrieval's gain straddles zero

    Patient-safety reasoning requires linking clinical narratives, medications, laboratory findings and adverse events, and a language model alone can produce plausible but unsupported conclusions. The same MIMIC-III/IV cases ran under four conditions with one LLaMA 2 7B model and one prompt: model only, plus retrieval-augmented generation, plus a patient-safety knowledge graph and ontology, and both. The full framework reached F1 0.89 for concept extraction, 0.046 above baseline; removing the knowledge graph cost the most, with F1 0.047, AUROC 0.084 and AUPRC 0.110, while removing retrieval gave an F1 difference of 0.029 whose interval crossed zero.

  7. Fireworks AI

    Evals stop at failure reports: GEPA writes them into the prompt, lifting Qwen3-32b Text2SQL test accuracy by 10%

    Eval Protocol plugs GEPA prompt optimization into an existing evaluation interface, so the same datasets, metrics and task constraints both measure an agent and automatically rewrite its system prompt. In a Text2SQL case, Qwen3-32b gained 10% test-set accuracy and more than 5% validation-set accuracy without touching model weights, with about 45 minutes of prompt search; the same eval then served as the objective for RFT.

  8. Test cases stop being hand-written one by one: five agents split the work and audit themselves, averaging a 93.4% mutation score across five datasets

    Software test-case design has long depended on manual work, and models that treat generation as one-shot text translation struggle with multi-layered business rules. A pipeline of five roles, parser, triage, architect, writer and auditor, turns test generation into a stateful reasoning process in which the auditor corrects scripts before output. Across five datasets spanning travel, telecom, financial regulation and a government job platform, the pipeline averaged a 93.4% mutation score, 1.4% hallucination and 7.8% redundancy, at an average generation time of 21.2 hours.

  9. Metal printing design stops relying on manual judgment: agents revise the part and the assessment code, cutting a thermal peak by 160 °C

    Design assessment for laser powder bed fusion no longer requires engineers to hand-carry results between preset rules and simulation tools. AgenticDfAM lets language-model agents interpret manufacturing guidance, select tools and propose redesigns, while geometric measurement and numerical comparison stay with executable tools. Across four case studies, three redesign strategies removed all reference violations on an analytical artifact, thermal feedback lowered a bracket's predicted layer-scale peak temperature by 160 °C, and a corrected support-construction procedure was reused in four build orientations.

  10. Meta slimmed its data-pipeline agent router: new column setup fell from days to under an hour

    Meta replaced the orchestration layer of its data-pipeline agents with a thin router that only sequences work and runs reliability checks, leaving domain reasoning to 14 specialized subagents with isolated context. A single agent loaded with all domain knowledge worked in demos but began hallucinating in production, mixing naming conventions and code-generation patterns across subsystems. Configuration prep for a new data column dropped from three to four days by hand, or about a day with the earlier config-driven system, to under an hour, with about two-thirds of changes landing without significant human edits.