“The stakes are high, and clear and they boil down to this: if we live in a world where very important decisions about employment, credit, insurance, and other vital economic factors are made by algorithms and data that are essentially black-boxed — impermeable to inspection either because of trade secrecy, or because of real secrecy, or just because they’re hidden away — that is essentially an open invitation to regulatory arbitrage around nearly all legal values that we hold dear — be they anti-discrimination, be they die process, be they basic fairness.”
Frank Pasquale, author of The Black Box Society: The Secret Algorithms That Control Money and Information