#llm-safety
-
Hallucination Detection Tools Compared: 11 Options
Eleven hallucination detection tools compared by family, deployment, and grounding requirement: HHEM, Lynx, MiniCheck, RAGAS, Bedrock, TLM, and more.
-
LLM Hallucination Detection Methods Explained: Four Techniques
The four main LLM hallucination detection methods compared: sampling consistency, claim decomposition, internal-state probing, and NLI faithfulness checks.
-
Fine-Tuned Classifiers vs. Moderation APIs: Cost and Tradeoffs
Off-the-shelf moderation APIs are cheap to start and expensive to outgrow. Fine-tuned classifiers are the reverse, and the crossover has a measurable point.
-
Llama Guard vs Llama Guard 2 vs Llama Guard 3: Lineage Clarified
Meta's Llama Guard series gets cited loosely, often with the wrong base model or taxonomy. Here is the verified lineage, version by version, with sources.
-
Perspective API Review: 8 Attributes and Where It Fails
Perspective API scores toxicity, insult, threat and five other attributes for comment moderation, and structurally misses the harms in LLM outputs.
-
Content Moderation for RAG: The Retrieval Layer Is an Attack Path
RAG pipelines have a moderation gap at the retrieval layer that input and output classifiers miss, because injected documents enter the context first.
-
Classifier Ensembles for Production Content Moderation
Single classifiers have characteristic blind spots. Ensembles that mix architectures and training data cut those failures, at a real cost in latency.
-
False Positive Costs in Content Moderation: How to Measure Them
False positives in content moderation drive hidden costs: user abandonment, review queue spend, and appeal load. How to quantify and calibrate them.
-
OpenAI Moderation API Review: What It Catches and Misses
OpenAI Moderation API review: ~20ms latency, free with API credits, image support, and the obfuscation, context, and customization gaps it leaves open.
-
Llama Guard Benchmark Review: Real Performance vs. Vendor Claims
Meta's Llama Guard is the default open-source moderation classifier. Its benchmark numbers look strong; here is what they do and do not actually measure.
-
NeMo Guardrails in Production: What It Does Well; Where It Fails
NVIDIA's NeMo Guardrails offers conversation-flow control that plain classifiers cannot provide. The deployment complexity is real and worth costing out.