How Proxy Variables and Feedback Loops Code Disparate Impact into Automated Hiring
Applicant tracking systems increasingly rely on machine learning to filter resumes, but seemingly neutral data points like commute times or vocabulary can act as proxies for protected characteristics. Once embedded, these proxies create mathematical feedback loops that amplify historical hiring biases across thousands of candidates.
Share this story
In short
- Applicant tracking systems use machine learning to filter resumes based on historical hiring data.
- Algorithms often rely on proxy variables—like zip codes or vocabulary—that correlate with protected characteristics.
- These proxies create feedback loops that mathematically amplify past biases across thousands of applications.
When a human recruiter rejects a candidate because they live 45 minutes away, the liability is isolated to a single desk. When an algorithmic applicant tracking system makes the exact same geographical inference, it applies the rule across 50,000 applications simultaneously, transforming a singular bias into a structural feedback loop with massive Title VII implications.[2][7]
Enterprise software vendors have spent the last decade replacing manual resume screening with machine learning models designed to predict candidate success. These systems ingest historical hiring data, identify the traits of employees who stayed at the company for more than 24 months, and search for those exact patterns in new applicant pools.[5]
The mechanical flaw in this architecture lies in proxy variables. A modern hiring algorithm is explicitly programmed to ignore protected characteristics like race, gender, and age. However, the model is fed thousands of other data points—zip codes, high school graduation years, commute distances, and specific vocabulary choices—that correlate heavily with those protected classes.[1][6]
If a company historically hired male engineers from a specific set of universities, the algorithm learns to favor the extracurricular activities, phrasing, and geographic markers associated with that demographic. The model does not know it is filtering for men; it only knows that candidates who use the word "executed" rather than "collaborated" historically generated a 15% higher retention rate.[1][4]
This dynamic creates what the University of Colorado Law Review identifies as a "double blind" for marginalized applicants. The candidate cannot see the hidden criteria scoring their resume, and the employer cannot see how the algorithm's neutral-seeming efficiency metrics are quietly reconstructing historical exclusion.[3]
Once a proxy variable is established, it triggers a mathematical feedback loop. The algorithm recommends candidates who fit the proxy profile. The human hiring manager, trusting the software, hires from that recommended pool. The new hires succeed, feeding positive reinforcement back into the model's training data and cementing the proxy variable's predictive weight for the next 10,000 applicants.[5][6]
The legal stakes for this technical mechanism are severe. In May 2024, Frontiers in Artificial Intelligence published a comprehensive examination of how algorithmic discrimination intersects with US legal practices, specifically Title VII of the Civil Rights Act of 1964.[2]
Under Title VII, a hiring practice does not need to be intentionally discriminatory to be illegal; it only needs to produce a "disparate impact" on a protected class without a strict business necessity. A 15-mile commute radius filter might seem like a neutral retention strategy, but if it systematically excludes minority neighborhoods, it violates federal law.[2][3]
Computer scientists and legal scholars approach this liability from fundamentally different angles. A 2023 multidisciplinary survey published on arXiv highlighted the tension between technical "fairness" and legal compliance.[1]
Engineers often attempt to solve the problem by optimizing for "demographic parity," tweaking the algorithm until it outputs a candidate pool that matches the baseline population. However, forced parity does not eliminate the underlying proxy variables; it merely masks them, leaving the employer exposed to audits that reveal the model's internal scoring weights.[1][4]
The Brookings Institution warned in 2019 that mitigating bias in algorithmic hiring requires more than just scrubbing obvious identifiers. It requires adversarial testing—deliberately feeding the model resumes from diverse candidates to see which seemingly benign bullet points trigger a rejection.[4]
For job seekers, the presence of proxy variables means that optimizing a resume is no longer just about matching the job description. A six-month employment gap, for instance, is often penalized by algorithms as a risk factor for turnover. Because women are statistically more likely to take a six-month gap for maternity leave, the algorithm's penalty disproportionately lowers their callback rates.[3][6]
Because the cited academic literature and legal reviews rely entirely on quantitative modeling, historical dataset analysis, and statutory interpretation rather than human testimony, the researchers provide mathematical proofs of disparate impact rather than direct interview quotations from affected candidates.[1][2][3]
To break the feedback loop, enterprise employers are increasingly demanding "explainable AI" from their vendors. Instead of a black-box score, the ATS must output the specific variables that drove the recommendation, allowing human HR teams to manually override proxies like zip codes or graduation dates before the rejection is finalized.[5][7]
The Equal Employment Opportunity Commission is currently drafting updated technical guidelines for algorithmic tools, expected to mature in late 2026. Those rules will force enterprise software vendors to mathematically prove their models do not rely on discriminatory proxies before deployment, shifting the burden of proof from the applicant back to the algorithm.[2][7]
Key terms
- Proxy Variable
- A neutral data point (e.g., high school graduation year) that an algorithm uses as a stand-in for a protected characteristic (e.g., age) because the two are statistically correlated.
- Disparate Impact
- A legal doctrine under US employment law where a seemingly neutral policy or algorithm disproportionately harms a protected group, regardless of the employer's intent.
- Feedback Loop
- A self-reinforcing cycle where an algorithm's past hiring recommendations become the training data for its future decisions, compounding historical biases.
- Applicant Tracking System (ATS)
- Enterprise software used by human resources departments to electronically filter, score, and manage resumes submitted by job seekers.
- Demographic Parity
- A technical fairness metric requiring an algorithm to select candidates from different demographic groups at rates proportional to their representation in the applicant pool.
Frequently asked
What is a proxy variable in hiring?
A proxy variable is a seemingly neutral piece of data, like a zip code or commute distance, that strongly correlates with a protected characteristic like race or age. Algorithms use these proxies to make filtering decisions without explicitly knowing the candidate's demographic.
How do feedback loops form in applicant tracking systems?
Feedback loops occur when an algorithm recommends candidates based on historical data, the company hires those candidates, and their subsequent success is fed back into the system. This reinforces the algorithm's preference for the specific proxy variables those candidates shared.
Does algorithmic bias violate federal law?
Yes. Under Title VII of the Civil Rights Act, a hiring practice that disproportionately excludes a protected class without a strict business necessity constitutes illegal disparate impact, even if the discrimination was unintentional.
Can algorithms be programmed to be completely fair?
It is mathematically difficult. Optimizing for one definition of fairness, such as equal callback rates across demographics, often conflicts with other metrics, and forced parity does not remove the underlying proxy variables from the model's logic.
Viewpoints in depth
Algorithmic Auditors
Computer scientists argue that bias can be mitigated through rigorous mathematical testing and explainable AI.
Technical researchers view algorithmic bias as a data problem that can be solved with better engineering. By applying adversarial testing—deliberately probing the model with diverse datasets—auditors can identify which proxy variables are skewing the results. This camp advocates for "explainable AI," where the applicant tracking system is forced to output the specific variables that drove a rejection, allowing human operators to manually adjust the weights and achieve demographic parity before the model is deployed at scale.
Civil Rights Advocates
Legal scholars warn that technical fixes are insufficient without strict regulatory enforcement of Title VII.
For legal experts, the danger of algorithmic hiring is its ability to launder historical discrimination through the objective veneer of mathematics. They argue that optimizing a model for demographic parity does not solve the underlying disparate impact if the algorithm is still secretly penalizing candidates for taking maternity leave or living in minority neighborhoods. This perspective demands that employers bear the legal burden of proving their software's metrics are a strict business necessity, rather than forcing applicants to prove they were discriminated against by a black box.
Enterprise Employers
Corporate HR departments are caught between the need to process thousands of resumes efficiently and the risk of massive legal liability.
Business leaders adopted applicant tracking systems to manage the overwhelming volume of digital applications, relying on vendors' promises of objective, data-driven hiring. Now, these employers face a structural liability gap. They do not own the proprietary algorithms scoring their candidates, but they are fully liable under federal law if those algorithms produce a disparate impact. Consequently, enterprise buyers are increasingly demanding indemnification clauses and transparent audit reports from software vendors before integrating AI into their hiring pipelines.
- Algorithmic Auditors
- Computer scientists and engineers focused on developing mathematical debiasing techniques and explainable AI models to achieve demographic parity.
- Civil Rights Advocates
- Legal scholars and policymakers arguing that algorithms must be strictly regulated under Title VII to prevent structural disparate impact.
- Enterprise Employers
- Business leaders and HR strategists balancing the efficiency gains of automated screening against the legal liability of algorithmic bias.
Perspectives this story doesn't cover
- Job applicants whose resumes are filtered out without feedback or explanation.
Sources
[1]arXivAlgorithmic AuditorsFairness and Bias in Algorithmic Hiring: a Multidisciplinary Survey
Read on arXiv →
[2]Frontiers in Artificial IntelligenceCivil Rights AdvocatesAlgorithmic discrimination: examining its types and regulatory measures with emphasis on US legal practices
Read on Frontiers in Artificial Intelligence →
[3]University of Colorado Law ReviewCivil Rights AdvocatesALGORITHMIC BIAS AND ACCOUNTABILITY: THE DOUBLE B(L)IND FOR MARGINALIZED JOB APPLICANTS
Read on University of Colorado Law Review →
[4]Brookings InstitutionEnterprise EmployersChallenges for mitigating bias in algorithmic hiring
Read on Brookings Institution →
[5]LSE BlogsEnterprise EmployersRecruiting in a digital age: pitfalls and strategies for automated hiring
Read on LSE Blogs →
[6]Montreal AI Ethics InstituteAlgorithmic AuditorsFairness and Bias in Algorithmic Hiring
Read on Montreal AI Ethics Institute →
[7]Factlen Editorial TeamSynthesis by Factlen editorial team
Read on Factlen Editorial Team →
More in Careers & Work
See all →Workplace Tech
The Neurological Tax of the Grid: How Nonverbal Overload Drives Video Conferencing Fatigue
7 sources
Automation Defense
The Non-Routine Cognitive and Manual Task Factors That Shield Jobs From Automation
6 sources
Technology Acceptance
The 72% Prediction: How Perceived Usefulness Outweighs Ease of Use in Determining Technology Adoption
8 sources
Algorithmic Management
The Judgment Gap: How Algorithmic Task Allocation Restructures Middle Management and Worker Autonomy
6 sources
Comments
Every angle. Every day.
Get Careers & Work stories with full source coverage and perspective breakdowns, free every day.




