Combating Bias in AI

Agency Partners: General Services Administration, U.S. Census Bureau
University Partners: Probabilistic Computing Project / Massachusetts Institute of Technology (MIT)
Project Status: Ongoing
An isometric 3 by 5 grid is formed by square blocks. 4 blocks in the bottom-right are joined by a line and are in a different color demonstrating a focus, or bias, to the bottom-right of the grid.

A major risk in building data-driven applications, including those that use machine learning methods, is susceptibility to biases in data. Even the best models can fail if the distribution of out-of-sample data differs significantly from the distribution of the data that was used to train or validate the model. Also, machine learning algorithms trained on biased data can sometimes amplify those biases. To address this problem, we are developing a set of scalable software products and companion training material to help those using federal data systematically identify sources of biased training data.

We’re Hiring

Join us in discovering new and exciting ways to make a difference.

Apply Now