TruthfulQA
Canonical31papers using it
2024first seen
817 questions designed to elicit common human misconceptions, measuring whether models answer truthfully rather than imitatively.
Papers using TruthfulQA (31)
- CrossHallu: Do Hallucination Signals Generalize Across Languages and Domains in Large Language Model's Internals?Comprehensive Evaluation of Large Language Model Responses: A Multi-Factor Scoring SystemMechELK: A Mechanistic Interpretability Framework for Eliciting Latent Knowledge in Large Language ModelsSERC: LDPC-Inspired Semantic Error Correction for Retrieval-Augmented GenerationCausalGaze: Unveiling Hallucinations via Counterfactual Graph Intervention in Large Language ModelsDeCoVec: Building Decoding Space based Task Vector for Large Language Models via In-Context LearningMitigating LLM Hallucinations through Domain-Grounded Tiered RetrievalROAST: Rollout-based On-distribution Activation Steering TechniqueDr.LLM: Dynamic Layer Routing in LLMsKatotohananQA: Evaluating Truthfulness of Large Language Models in FilipinoToo Helpful, Too Harmless, Too Honest or Just Right?Hallucination Detection with the Internal Layers of LLMsWe Think, Therefore We Align LLMs to Helpful, Harmless and Honest Before They Go WrongCounterfactual Probing for Hallucination Detection and Mitigation in Large Language ModelsSteering When Necessary: Flexible Steering Large Language Models with BacktrackingGrAInS: Gradient-based Attribution for Inference-Time Steering of LLMs and VLMsMALM: A Multi-Information Adapter for Large Language Models to Mitigate HallucinationTemporal Self-Rewarding Language Models: Decoupling Chosen-Rejected via
Past-FutureTest-Time Scaling in Diffusion LLMs via Hidden Semi-Autoregressive
ExpertsSelective Self-to-Supervised Fine-Tuning for Generalization in Large
Language ModelsSample, Don't Search: Rethinking Test-Time Alignment for Language ModelsSteering When Necessary: Flexible Steering Large Language Models with
BacktrackingWhen Persuasion Overrides Truth in Multi-Agent LLM Debates: Introducing
a Confidence-Weighted Persuasion Override Rate (CW-POR)More is Less: The Pitfalls of Multi-Model Synthetic Preference Data in DPO Safety AlignmentTeuken-7B-Base & Teuken-7B-Instruct: Towards European LLMsBenchmark Inflation: Revealing LLM Performance Gaps Using Retro-HoldoutsSkillAggregation: Reference-free LLM-Dependent AggregationEvaluating Consistencies in LLM responses through a Semantic Clustering
of Question AnsweringSelective Self-Rehearsal: A Fine-Tuning Approach to Improve
Generalization in Large Language ModelsMaintaining Informative Coherence: Migrating Hallucinations in Large
Language Models via Absorbing Markov ChainsMitigating Adversarial Attacks in LLMs through Defensive Suffix
Generation