Skip to main content
ExplainerAlgorithmic HiringMechanism Explainer· 4 min read· in Careers & Work

How Proxy Variables and Feedback Loops Code Disparate Impact into Automated Hiring

Applicant tracking systems increasingly rely on machine learning to filter resumes, but seemingly neutral data points like commute times or vocabulary can act as proxies for protected characteristics. Once embedded, these proxies create mathematical feedback loops that amplify historical hiring biases across thousands of candidates.

By Camille Durand

Algorithmic Auditors 35%Civil Rights Advocates 35%Enterprise Employers 30%
Algorithmic Auditors
Computer scientists and engineers focused on developing mathematical debiasing techniques and explainable AI models to achieve demographic parity.
Civil Rights Advocates
Legal scholars and policymakers arguing that algorithms must be strictly regulated under Title VII to prevent structural disparate impact.
Enterprise Employers
Business leaders and HR strategists balancing the efficiency gains of automated screening against the legal liability of algorithmic bias.

Perspectives this story doesn't cover

  • Job applicants whose resumes are filtered out without feedback or explanation.

Key terms

Proxy Variable
A neutral data point (e.g., high school graduation year) that an algorithm uses as a stand-in for a protected characteristic (e.g., age) because the two are statistically correlated.
Disparate Impact
A legal doctrine under US employment law where a seemingly neutral policy or algorithm disproportionately harms a protected group, regardless of the employer's intent.
Feedback Loop
A self-reinforcing cycle where an algorithm's past hiring recommendations become the training data for its future decisions, compounding historical biases.
Applicant Tracking System (ATS)
Enterprise software used by human resources departments to electronically filter, score, and manage resumes submitted by job seekers.
Demographic Parity
A technical fairness metric requiring an algorithm to select candidates from different demographic groups at rates proportional to their representation in the applicant pool.

Key points

  • Applicant tracking systems use machine learning to filter resumes based on historical hiring data.
  • Algorithms often rely on proxy variables—like zip codes or vocabulary—that correlate with protected characteristics.
  • These proxies create feedback loops that mathematically amplify past biases across thousands of applications.
  • Under Title VII, algorithms that produce a disparate impact can trigger massive legal liability for employers.
  • Technical fixes like forced demographic parity often mask proxy variables rather than eliminating them.
  • Regulators are increasingly demanding that enterprise software vendors prove their models do not rely on discriminatory proxies.

When a human recruiter rejects a candidate because they live 45 minutes away, the liability is isolated to a single desk. When an algorithmic applicant tracking system makes the exact same geographical inference, it applies the rule across 50,000 applications simultaneously, transforming a singular bias into a structural feedback loop with massive Title VII implications.[2][7]

Enterprise software vendors have spent the last decade replacing manual resume screening with machine learning models designed to predict candidate success. These systems ingest historical hiring data, identify the traits of employees who stayed at the company for more than 24 months, and search for those exact patterns in new applicant pools.[5]

The mechanical flaw in this architecture lies in proxy variables. A modern hiring algorithm is explicitly programmed to ignore protected characteristics like race, gender, and age. However, the model is fed thousands of other data points—zip codes, high school graduation years, commute distances, and specific vocabulary choices—that correlate heavily with those protected classes.[1][6]

If a company historically hired male engineers from a specific set of universities, the algorithm learns to favor the extracurricular activities, phrasing, and geographic markers associated with that demographic. The model does not know it is filtering for men; it only knows that candidates who use the word "executed" rather than "collaborated" historically generated a 15% higher retention rate.[1][4]

How seemingly neutral data points create structural feedback loops in automated hiring.

This dynamic creates what the University of Colorado Law Review identifies as a "double blind" for marginalized applicants. The candidate cannot see the hidden criteria scoring their resume, and the employer cannot see how the algorithm's neutral-seeming efficiency metrics are quietly reconstructing historical exclusion.[3]

Once a proxy variable is established, it triggers a mathematical feedback loop. The algorithm recommends candidates who fit the proxy profile. The human hiring manager, trusting the software, hires from that recommended pool. The new hires succeed, feeding positive reinforcement back into the model's training data and cementing the proxy variable's predictive weight for the next 10,000 applicants.[5][6]

The legal stakes for this technical mechanism are severe. In May 2024, Frontiers in Artificial Intelligence published a comprehensive examination of how algorithmic discrimination intersects with US legal practices, specifically Title VII of the Civil Rights Act of 1964.[2]

Under Title VII, a hiring practice does not need to be intentionally discriminatory to be illegal; it only needs to produce a "disparate impact" on a protected class without a strict business necessity. A 15-mile commute radius filter might seem like a neutral retention strategy, but if it systematically excludes minority neighborhoods, it violates federal law.[2][3]

A 15-mile commute radius filter might seem like a neutral retention strategy, but if it systematically excludes minority neighborhoods, it violates federal law.

Computer scientists and legal scholars approach this liability from fundamentally different angles. A 2023 multidisciplinary survey published on arXiv highlighted the tension between technical "fairness" and legal compliance.[1]

The gap between computer science definitions of fairness and US legal standards for disparate impact.

Engineers often attempt to solve the problem by optimizing for "demographic parity," tweaking the algorithm until it outputs a candidate pool that matches the baseline population. However, forced parity does not eliminate the underlying proxy variables; it merely masks them, leaving the employer exposed to audits that reveal the model's internal scoring weights.[1][4]

The Brookings Institution warned in 2019 that mitigating bias in algorithmic hiring requires more than just scrubbing obvious identifiers. It requires adversarial testing—deliberately feeding the model resumes from diverse candidates to see which seemingly benign bullet points trigger a rejection.[4]

For job seekers, the presence of proxy variables means that optimizing a resume is no longer just about matching the job description. A six-month employment gap, for instance, is often penalized by algorithms as a risk factor for turnover. Because women are statistically more likely to take a six-month gap for maternity leave, the algorithm's penalty disproportionately lowers their callback rates.[3][6]

Because the cited academic literature and legal reviews rely entirely on quantitative modeling, historical dataset analysis, and statutory interpretation rather than human testimony, the researchers provide mathematical proofs of disparate impact rather than direct interview quotations from affected candidates.[1][2][3]

Employers face increasing pressure to audit their applicant tracking systems for hidden proxy variables to avoid Title VII liability.

To break the feedback loop, enterprise employers are increasingly demanding "explainable AI" from their vendors. Instead of a black-box score, the ATS must output the specific variables that drove the recommendation, allowing human HR teams to manually override proxies like zip codes or graduation dates before the rejection is finalized.[5][7]

The Equal Employment Opportunity Commission is currently drafting updated technical guidelines for algorithmic tools, expected to mature in late 2026. Those rules will force enterprise software vendors to mathematically prove their models do not rely on discriminatory proxies before deployment, shifting the burden of proof from the applicant back to the algorithm.[2][7]

Frequently asked

What is a proxy variable in hiring?

A proxy variable is a seemingly neutral piece of data, like a zip code or commute distance, that strongly correlates with a protected characteristic like race or age. Algorithms use these proxies to make filtering decisions without explicitly knowing the candidate's demographic.

How do feedback loops form in applicant tracking systems?

Feedback loops occur when an algorithm recommends candidates based on historical data, the company hires those candidates, and their subsequent success is fed back into the system. This reinforces the algorithm's preference for the specific proxy variables those candidates shared.

Does algorithmic bias violate federal law?

Yes. Under Title VII of the Civil Rights Act, a hiring practice that disproportionately excludes a protected class without a strict business necessity constitutes illegal disparate impact, even if the discrimination was unintentional.

Can algorithms be programmed to be completely fair?

It is mathematically difficult. Optimizing for one definition of fairness, such as equal callback rates across demographics, often conflicts with other metrics, and forced parity does not remove the underlying proxy variables from the model's logic.

Sources

Source coverage

7 outlets

3 viewpoints surfaced

Algorithmic Auditors 35%Civil Rights Advocates 35%Enterprise Employers 30%
  1. [1]arXivAlgorithmic Auditors

    Fairness and Bias in Algorithmic Hiring: a Multidisciplinary Survey

    Read on arXiv
  2. [2]Frontiers in Artificial IntelligenceCivil Rights Advocates

    Algorithmic discrimination: examining its types and regulatory measures with emphasis on US legal practices

    Read on Frontiers in Artificial Intelligence
  3. [3]University of Colorado Law ReviewCivil Rights Advocates

    ALGORITHMIC BIAS AND ACCOUNTABILITY: THE DOUBLE B(L)IND FOR MARGINALIZED JOB APPLICANTS

    Read on University of Colorado Law Review
  4. [4]Brookings InstitutionEnterprise Employers

    Challenges for mitigating bias in algorithmic hiring

    Read on Brookings Institution
  5. [5]LSE BlogsEnterprise Employers

    Recruiting in a digital age: pitfalls and strategies for automated hiring

    Read on LSE Blogs
  6. [6]Montreal AI Ethics InstituteAlgorithmic Auditors

    Fairness and Bias in Algorithmic Hiring

    Read on Montreal AI Ethics Institute
  7. [7]Factlen Editorial Team

    Synthesis by Factlen editorial team

    Read on Factlen Editorial Team

Comments

Stay informed

Every angle. Every day.

Get Careers & Work stories with full source coverage and perspective breakdowns delivered to your inbox.