A daily AI and EdTech news filter that cuts fifty stories down to five, paired with a golden-set evaluation pipeline to measure whether the scorer still agrees with my own judgment.
Foundations: Memory & KnowledgeUpdated Nov 3, 2026
News is a personalized, curated news service. I started it because I was pissed off that Feedly wouldn’t offer APIs to paying subscribers. Sidenote: there’s a question around what “moats” are post-LLM. Services should offer a headless experience by default.
News fetches roughly fifty daily stories and narrows them to at most five worth reading. The harder part was deciding whether its judgment matched mine. The project pairs the digest with an evaluation loop so a prompt change can be checked against examples I’ve already labeled.
How it works
Three scheduled jobs fetch stories, score them, and assemble a daily digest. They share a database and run in parallel.
The fetcher polls RSS, Hacker News, GitHub Trending, and narrow Google News queries. A hash of each URL prevents the same link being stored twice.
Haiku-level worker evaluates each item against four criteria. The digest takes up to five high-confidence items.
Measuring judgment
I manually label a golden set of stories, replay the scorer against it, and compare the verdicts and reasons. A larger model reviews the reasoning. A regression gate checks proposed changes before they replace the current prompt.