![\"New](\"https:\/\/www.gannett-cdn.com\/presto\/2022\/09\/03\/PNM2\/1931038b-c351-49fa-bdbb-d2acbbc8b9a4-Fioretto_Fernando.jpg?width=660&height=659&fit=crop&format=pjpg&auto=webp\")
<\/figure>\nLAS CRUCES – Ferdinando Fioretto, who received dual doctorates in computer science from New Mexico State University and the University of Udine in Italy, has won multiple awards in the past year for his influential research on privacy and fairness in machine learning algorithms as well as on the integration of operations research with deep learning.<\/p>\n
For his pivotal contributions, Fioretto, an assistant professor of computer science at Syracuse University, has been awarded an Early Career Researcher Award by the Association for Constraint Programming, a Young Investigator Award for Research in Computer Science by the Italian Scientists and Scholars in North America Foundation, a National Science Foundation CAREER Award, and a Google Research Scholar Award.<\/p>\n
In addition to his NSF and Early Career Awards, Fioretto has earned multiple Best Paper Awards, including a Best AI Dissertation Award by the International Conference of the Italian Association for Artificial Intelligence.<\/p>\n\n
\u201cAs we evolve as a society,\u201d Fioretto said, \u201calgorithms are replacing some of the decisions that were made by us humans.\u201d These algorithms are used in various domains of our society, such as federal fund allocation, energy systems, criminal justice, loan approvals, and ranking systems like those used in employment decisions. \u00a0<\/p>\n
Algorithms are fed historical data that they analyze to build mathematical models that can be used on subsequent data to make predictions or \u201cabstractly reason to give us an outcome,\u201d Fioretto explained. In this process, termed \u201cmachine learning,\u201d algorithms frequently introduce or employ existing biases, which in turn seep into the decisions they make. Consequently, these decisions can come with huge societal impacts.<\/p>\n\n
For example, what\u2019s known as the PATTERN algorithm is used to predict whether a prisoner will be likely to reoffend based on data from previous court cases, which were decided by people with their own, even unconscious, biases. Unfortunately, the algorithm learns these biases as it creates a predictive model from the data.<\/p>\n
These biases can arise from latent factors, variables that aren\u2019t directly observed but can be inferred, which are \u201cinterpreted or misinterpreted as relevant,\u201d Fioretto said. These factors can be associated with individuals\u2019 protected attributes, such as race and gender.<\/p>\n\n
In 2006 there was a \u201cbreakthrough,\u201d as Fioretto described it, in the field of theoretical computer science called \u201cdifferential privacy,\u201d which is a mathematical way to ensure that data generated by an algorithm cannot be used to infer any identifiable information about the individuals who are described in the data. Among others, the US Census Bureau is adopting this privacy definition in its 2020 data release.<\/p>\n
\u201cThis technology relies on noise addition to ensure that the algorithm\u2019s outputs remain insensitive to the participation of any individual,\u201d Fioretto explained. However, this noise affects the accuracy of the algorithms\u2019 outputs. \u201cOnce you’re adding noise, you’re altering some properties of the data,\u201d he said. \u201cMy group has found that the mechanisms that are adopted in order to satisfy privacy properties can make errors that are actually disproportionate with respect to some characteristics of the population and exacerbate the existing bias toward minorities\u201d.<\/p>\n
In other words, implementing privacy measures on data used for decision processes can have significant societal and economic repercussions.<\/p>\n
Fioretto\u2019s research looks particularly at how allocation decisions are affected. Title I, the program that funds low-income school districts, uses rule-based algorithms to decide where and how much money is distributed. He explained that depending on the privacy preservation of the data used, school districts might receive substantially less money than what would have been warranted. \u00a0<\/p>\n
Fioretto added that \u201cthe relationship between privacy, accuracy and fairness is complicated.\u201d His research is working towards disentangling this relationship to devise algorithms that can guarantee the privacy of individuals without excessively sacrificing the accuracy of the data and the fairness of the decisions made.<\/p>\n\n
Fioretto not only searches for solutions to the large-scale consequences of machine learning algorithms, but also engages the community around the importance of these issues. He co-organizes the annual AAAI workshop on Privacy Preserving Artificial Intelligence<\/a> and works with policymakers and data users to understand and address these concerns. Fioretto\u2019s research and activism will ultimately bring us closer to more equitable decisions being made for our communities.<\/p>\n This week\u2019s Eye on Research was written by Jessica Brinegar of NMSU Marketing and Communications. She can be reached at jessmaeb@nmsu.edu<\/a>.<\/em><\/p>\n