玩游戏可帮助分析师消除偏见

Game-playing may help intelligence analysts¹ with the serious business of identifying biases³ that can cloud decision-making and problem-solving during life or death situations, according to researchers. Analytic⁴ exercises conducted by researchers at Raytheon that used scenario⁵-based games designed by Col. Jacob Graham, senior research associate in the College of Information Sciences and Technology, Penn State, showed that some of the participants displayed anchoring and confirmation⁶ biases as they tried to determine responsibility and motivations for insurgent⁷ attacks in the scenario. Confirmation bias² is the tendency to accept only information that supports current beliefs and attitudes, while anchoring leads people to overemphasize past judgments⁸ or initial hypotheses in spite of new, contradictory⁹ evidence.

 

"Biases are often difficult to identify, but it's important to recognize bias in decision theory and analysis," said Graham, who worked with Donald Kretz and B. J. Simpson, both cognitive¹⁰ scientists at Raytheon Intelligence and Information Systems. "For decision makers¹¹, biases can make the difference in life and death decisions."

 

The researchers said that the idea to use games as a way to detect confirmation bias was rooted in recent studies that implicated¹² biases in number of national intelligence failures.

 

"There have been a lot of post-9/11 studies that looked at analytic tradecraft and intelligence failures," said Kretz. "What they found was that there are a number of significant obstacles to good and thorough intelligence analysis, but what gets mentioned over and over in these studies is cognitive bias."

 

Graham designed a series of games based on real-life situations that U.S. intelligence analysts faced in Iraq. He used information from a collection of digital documents and reports that he developed to create decision-making games for analysts.

 

"It's fictional¹³, but it's very real," said Graham. "We are very careful not to give up secrets on how the U.S. operates."

 

The researchers, who report their findings at the IEEE Conference on Technologies for Homeland Security, today (Nov. 13), said the games used a chain of messages, intercepted¹⁴ phone calls and intelligence reports that offered insights into the activities of insurgent（叛乱的） groups in a poor area of Baghdad.

 

According to Kretz, three groups of nine participants, all engineers at Raytheon, were placed in the middle of an evolving scenario of a series of insurgent attacks. The subjects, who were college educated but not trained in intelligence analysis, had access evidence following each attack and were asked to assess responsibility and motivation after each attack occurred.

 

The first group analyzed¹⁵ the data by trying to understand the relationships between known and unknown groups of people -- link analysis. Another group pulled information and weighed the importance of the data, called information extraction and weighting. Researchers briefed the final group on how to use competing hypothesis to explain reported insurgent acts. Creating alternative hypothesis is one way to avoid confirmation bias.

 

The team that trained in considering alternative hypotheses significantly outperformed the other teams when identifying the perpetrators and the intended targets, Kretz said.

分享到：