BitsExplorer

BitsExplorer finds what people are building with AI, every day. See today's picks →

Preview of Catch the AI Lying: an audited pass/fail harness for one small free model

Catch the AI Lying: an audited pass/fail harness for one small free model

MIS 752 Lab 7, AI Evaluation. A ten-item gold standard of self-contained clinical vignettes, liquid/lfm-2.5-2.6b:free answering all ten through OpenRouter, and three rulers over the same answers: exact match, a lenient contains check, and nvidia/nemotron-3-ultra-550b-a55b:free as an LLM-as-judge…

Description excerpted from the original listing, which is linked below.

Open it Listing Source code

The week in AI-built software

Every Monday: how many projects were built with AI that week, which tools built them, where they came from, and the week's picks.

Read the latest week