HackerRank open sourced its ATS. My resume scored 90/100. Oh wait 74. No – 88
A developer tested HackerRank's new open-source Applicant Tracking System (ATS) and discovered significant inconsistency in how the LLM-based tool scores the same resume. The analysis highlights that while technical skills are evaluated reliably, subjective categories like project quality vary wildly even at low temperature settings.
Why it matters
This demonstrates the inherent unreliability of using LLMs for automated hiring decisions, raising concerns about fairness and consistency in recruitment technology.
This open-source ATS by HackerRank has been blowing up recently: https://github.com/interviewstreet/hiring-agent
The article is a technical critique based on empirical testing of a software tool without political or ideological framing.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in