Information Awareness Office
From Wikipedia, the free encyclopedia
The Information Awareness Office (IAO) was established by the Defense Advanced Research Projects Agency (DARPA) in January 2002 to bring together several DARPA projects focused on applying information technology to counter asymmetric threats to national security. The IAO mission was to "imagine, develop, apply, integrate, demonstrate and transition information technologies, components and prototype, closed-loop, information systems that will counter asymmetric threats by achieving total information awareness".
Following public criticism that the development and deployment of these technologies could potentially lead to a mass surveillance system, the IAO was defunded by Congress in 2003, although several of the projects run under IAO have continued under different funding.[1][2]
[edit] History
The IAO was established after Admiral John Poindexter, former United States National Security Advisor to President Ronald Reagan and SAIC executive Brian Hicks approached the US Department of Defense with the idea for an information awareness program after the terrorist attacks of September 11, 2001.[2]
Poindexter and Hicks had previously worked together on intelligence-technology programs for the Defense Advanced Research Projects Agency. DARPA agreed to host the program and appointed Poindexter to run it in 2002
The IAO began funding research and development of the Total Information Awareness (TIA) Program in February 2003 but renamed the program the Terrorism Information Awareness Program in May that year after an adverse media reaction to the program's implications for public surveillance. Although TIA was only one of several IAO projects, many critics and news reports conflated TIA with other related research projects of the IAO, with the result that TIA came in popular usage to stand for an entire subset of IAO programs.
The TIA program itself was the "systems-level" program of the IAO that intended to integrate information technologies into a prototype system to provide tools to better detect, classify, and identify potential foreign terrorists with the goal to increase the probability that authorized agencies of the United States could preempt adverse actions. As a systems-level program of programs, TIA's goal was the creation of a "counterterrorism information architecture" that integrated technologies from other IAO programs (and elsewhere, as appropriate). The TIA program was researching, developing, and integrating technologies to virtually aggregate data, to follow subject-oriented link analysis, to develop descriptive and predictive models through data mining or human hypothesis, and to apply such models to additional datasets to identify terrorists and terrorist groups.
Among the other IAO programs that were intended to provide TIA with component data aggregation and automated analysis technologies were the Genisys, Genisys Privacy Protection, Evidence Extraction and Link Discovery, and Scalable Social Network Analysis programs.
On August 2, 2002, Dr. Poindexter gave a speech at DARPAtech 2002 entitled "Overview of the Information Awareness Office"[3] in which he described the TIA program.
In addition to the program itself, the involvement of Poindexter as director of the IAO also raised concerns among some, since he had been earlier convicted of lying to Congress and altering and destroying documents pertaining to the Iran-Contra Affair, although those convictions were later overturned on the grounds that the testimony used against him was protected.
On January 16, 2003, Senator Russ Feingold introduced legislation to suspend the activity of the IAO and the Total Information Awareness program pending a Congressional review of privacy issues involved.[4] A similar measure introduced by Senator Ron Wyden would have prohibited the IAO from operating within the United States unless specifically authorized to do so by Congress, and would have shut the IAO down entirely 60 days after passage unless either the Pentagon prepared a report to Congress assessing the impact of IAO activities on individual privacy and civil liberties or the President certified the program's research as vital to national security interests. In February 2003, Congress passed legislation suspending activities of the IAO pending a Congressional report of the office's activities (Consolidated Appropriations Resolution, 2003, No.108–7, Division M, §111(b) [signed Feb. 20, 2003]).
In response to this legislation, DARPA provided Congress on May 20, 2003 with a report on its activities.[5] In this report, IAO changed the name of the program to the Terrorism Information Awareness Program and emphasized that the program was not designed to compile dossiers on US citizens, but rather to research and develop the tools that would allow authorized agencies to gather information on terrorist networks. Despite the name change and these assurances, the critics continued to see the system as prone to potential misuse or abuse.
As a result House and Senate negotiators moved to prohibit further funding for the TIA program by adding provisions to the Department of Defense Appropriations Act, 2004[6] (signed into law by President Bush on October 1, 2003). Further, the Joint Explanatory Statement included in the conference committee report specifically directed that the IAO as program manager for TIA be terminated immediately.[7]
[edit] IAO research
IAO research was conducted along five major investigative paths: secure collaboration problem solving; structured discovery; link and group understanding; context aware visualization; and decision making with corporate memory.
Among the IAO projects were:
[edit] Genisys
Genisys aimed at developing technologies which would enable "ultra-large, all-source information repositories".[8]
Vast amounts of information were going to be collected and analyzed, and the available database technology at the time was insufficient for storing and organizing such vast quantities of data. So they developed techniques for virtual data aggregation in order to support effective analysis across heterogeneous databases, as well as unstructured public data sources, such as the World Wide Web. "Effective analysis across heterogenous databases" means the ability to take things from databases which are designed to store different types of data -- such as a a database containing criminal records, a phone call database and a foreign intelligence database. The World Wide Web is considered an "unstructured public data source" because it is publicly accessible and contains many different types of data -- such as blogs, emails, records of visits to web sites, etc -- all of which need to be analyzed and stored efficiently.[8]
Another goal was to develop "a large, distributed system architecture for managing the huge volume of raw data input, analysis results, and feedback, that will result in a simpler, more flexible data store that performs well and allows us to retain important data indefinitely. "[8]
[edit] Evidence Extraction and Link Discovery
Evidence Extraction and Link Discovery (EELD) development of technologies and tools for automated discovery, extraction and linking of sparse evidence contained in large amounts of classified and unclassified data sources (such as phone call records from the NSA call database or bank records).[9]
EELD was designed to design systems with the ability to extract data from multiple sources (e.g., text messages, social networking sites, financial records, and web pages. It was to develop the ability to detect patterns comprising multiple types of links between data items or people communicating (e.g., financial transactions, communications, travel, etc.).[9]
It is designed to link items relating potential "terrorist" groups and scenarios, and to learn patterns of different groups or scenarios to identify new organizations and emerging threats.[9]
[edit] Scalable Social Network Analysis
Scalable Social Network Analysis (SSNA) aimed at developing techniques based on social network analysis for modeling the key characteristics of terrorist groups and discriminating these groups from other types of societal groups.[10]
Jason Ethier, of Northeastern University said the following in his study of SSNA:
The purpose of the SSNA algorithms program is to extend techniques of social network analysis to assist with distinguishing potential terrorist cells from legitimate groups of people ... In order to be successful SSNA will require information on the social interactions of the majority of people around the globe. Since the Defense Department cannot easily distinguish between peaceful citizens and terrorists, it will be necessary for them to gather data on innocent civilians as well as on potential terrorists.
—Jason Ethier[10]
[edit] Human Identification at a Distance (HumanID)
The Human Identification at a Distance (HumanID) project developed automated biometric identification technologies to detect, recognize and identify humans at great distances for "force protection", crime prevention, and "homeland security/defense" purposes.[11]
It's goals included programs to:[11]
- Develop algorithms for locating and acquiring subjects out to 150 meters (500 ft) in range.
- Fuse face and gait recognition into a 24/7 human identification system.
- Develop and demonstrate a human identification system that operates out to 150 meters (500 ft.) using visible imagery.
- Develop a low power millimeter wave radar system for wide field of view detection and narrow field of view gait classification.
- Characterize gait performance from video for human identification at a distance.
- Develop a multi-spectral infrared and visible face recognition system.
[edit] Effective Affordable Reusable Speech-to-text (EARS)
Effective Affordable Reusable Speech-to-text (EARS) to develop automatic speech-to-text transcription technology whose output is substantially richer and much more accurate than previously possible. EARS was to focus on everyday human-to-human speech from broadcasts and telephone conversations in multiple languages. [12] It is expected to increase the speed with which speech can be processed by computers by 100 times or more.[13]
The intent is to create a core enabling technology (technology that is used as a component for future technologies) suitable for a wide range of future surveillance applications.[12]
[edit] Bio-Surveillance
Bio-Surveillance to develop the necessary information technologies and resulting prototype capable of detecting the covert release of a biological pathogen automatically, and significantly earlier than traditional approaches.[14]
[edit] Wargaming the Asymmetric Environment (WAE)
Wargaming the Asymmetric Environment (WAE) focused on developing automated technology capable of identifying predictive indicators of terrorist activity or impending attacks by examining individual and group behavior in broad environmental context and examining the motivation of specific terrorists.[15]
[edit] Futures Markets Applied to Prediction (FutureMAP)
Futures Markets Applied to Prediction (FutureMAP) was intended to harness collective intelligence by researching market-based techniques for avoiding surprise and predicting future events. The intent was to explore the feasibility of market-based trading mechanisms to predict political instability, threats to national security, and other major events in the near future.[16]
[edit] Babylon
Babylon to develop rapid, two-way, natural language speech translation interfaces and platforms for the warfighter for use in field environments for force protection, refugee processing, and medical triage.[17]
[edit] Genoa / Genoa II
Genoa and Genoa II focused on providing advanced decision-support and collaboration tools to rapidly deal with and adjust to dynamic crisis management and allow for inter-agency collaboration in real-time.[18][19] Another function was to be able to intelligently make estimates of possible future scenarios to assist intelligence officials what to do[13], in a manner similar to the DARPA's Deep Green program which is designed to assist Army commanders in making battlefield decisions.
[edit] TIDES
Translingual Information Detection, Extraction and Summarization (TIDES) developing advanced language processing technology to enable English speakers to find and interpret critical information in multiple languages without requiring knowledge of those languages.[20]
Outside groups (such as universities, corporations, etc) were invited to participate in the annual information retrieval, topic detection and tracking, automatic content extraction, and machine translation evaluations run by NIST.[20]
[edit] Communicator
Communicator was to develop "dialogue interaction" technology that enables warfighters to talk with computers, such that information will be accessible on the battlefield or in command centers without ever having to touch a keyboard. The Communicator Platform was to be both wireless and mobile, and to be designed to function in a networked environment.[21]
The dialogue interaction software was to interpret the context of the dialogue in order to improve performance, and to be capable of automatically adapting to new topics (because situations quickly change in war) so conversation is natural and efficient. The Communicator program emphasized task knowledge to compensate for natural language effects and noisy environments. Unlike automated translation of natural language speech, which is much more complex due to an essentially unlimited vocabulary and grammar, the Communicator program is directed task specific issues so that there are constrained vocabularies (the system only needs to be able to understand language related to war). Research was also started to focus on foreign language computer interaction for use in supporting coalition operations.[21]
Live exercises were conducted involving small unit logistics operations involving the United States Marines to test the technology in extreme environments. [21]
[edit] Components of TIA projects that continue to be developed
Despite the withdrawal of funding for the TIA and the closing of the IAO, the core of the project survived.[22] Legislators included a classified annex to the Defense Appropriations Act that preserved funding for TIA's component technologies, if they were transferred to other government agencies. TIA projects continued to be funded under classified annexes to Defense and Intelligence appropriation bills. However, the act also stipulated that the technologies only be used for military or foreign intelligence purposes against foreigners.[23]
TIA's two core projects are now operated by Advanced Research and Development Activity (ARDA) located among the 60-odd buildings of "Crypto City" at NSA headquarters in Fort Meade, MD. ARDA itself has been shifted from the NSA to the Disruptive Technology Office (run by to the Director of National Intelligence). They are funded by National Foreign Intelligence Program for foreign counterterrorism intelligence purposes.
One technology, now codenamed "Baseball" is the Information Awareness Prototype System, the core architecture to integrated all the TIA's information extraction, analysis, and dissemination tools. Work on this project is conducted by SAIC through its Hicks & Associates, consulting arm that is run by former Defense and military officials and which had originally been awarded US$19 million IAO contract to build the prototype system in late 2002.[24]
The other project has been re-designated "TopSail" (formerly Genoa II) and would provide IT tools to help anticipate and preempt terrorist attacks. SAIC has also been contracted to work on Topsail, including a US$3.7 million contract in 2005.
[edit] Media Coverage
The first mention of the IAO in the mainstream media came from New York Times reporter John Markoff on February 13, 2002.[25] Initial reports contained few details about the program. In the following months, as more information emerged about the scope of the TIA project, civil libertarians became concerned over what they saw as the potential for the development of an Orwellian mass surveillance system.
On November 14, 2002 the New York Times published a column by William Safire in which he claimed "[TIA] has been given a $200 million budget to create computer dossiers on 300 million Americans."[26] Safire has been "credited" with triggering the anti-TIA movement.[27]
[edit] Concerns and criticism
Extensive criticism of the IAO has come from across the political spectrum, from neo-luddite anarchists to right-wing constitutionalists.
Critics believe that massive information aggregation and analysis technologies are a grave threat to privacy and civil liberties. Many fear that allowing a government to monitor all communications, and map social networks will give them the ability to target dissenters or political threats. Critics claim that this concern is not unfounded, citing COINTELPRO and other government programs that targeted peaceful political activists in the U.S. Programs such as those the IAO funded would greatly enhance their ability to identify, track, infiltrate, and target such groups. Such a system of surveillance is a necessary component of a strong totalitarian state.
Proponents believe that development of these technologies is inevitable and that designing systems and policies to control their use is a more effective strategy than opposition.
[edit] See also
- Mass surveillance
- ADVISE
- Combat Zones That See, or CTS, a project to link up all security cameras citywide and "track everything that moves".
- ECHELON, NSA worldwide digital interception program
- Carnivore, FBI US digital interception program
- Communications Assistance For Law Enforcement Act
- Intellipedia, a collection of wikis used by the U.S. intelligence community to "connect the dots" between pieces of intelligence
- Multistate Anti-Terrorism Information Exchange
- TALON
- Synthetic Environment for Analysis and Simulations
- Information Processing Technology Office
[edit] References
- ^ "Total/Terrorism Information Awareness (TIA): Is It Truly Dead?" (in English). Electronic Frontier Foundation (official website). 2003. http://w2.eff.org/Privacy/TIA/20031003_comments.php. Retrieved on 2009-03-15.
- ^ a b Harris, Shane (Feb. 23, 2006). "TIA Lives On" (in English). National Journal. http://nationaljournal.com/about/njweekly/stories/2006/0223nj1.htm. Retrieved on 2009-03-16.
- ^ Overview of the Information Awareness Office
- ^ Search Results - THOMAS (Library of Congress)
- ^ http://www.information-retrieval.info/docs/tia-exec-summ_20may2003.pdf
- ^ Department of Defense Appropriations Act, 2004, Pub. L. No. 108–87, § 8131, 117 Stat. 1054, 1102 (2003)
- ^ 149 Cong. Rec. H8755—H8771 (24 September, 2003)
- ^ a b c "Genisys" (in English). Information Awareness Office (official website). http://infowar.net/tia/www.darpa.mil/iao/Genisys.htm. Retrieved on 2009-03-15.
- ^ a b c "Evidence Extraction and Link Discovery" (in English). Information Awareness Office (official website -- mirror). http://infowar.net/tia/www.darpa.mil/iao/EELD.htm. Retrieved on 2009-03-15.
- ^ a b Ethier, Jason. "Current Research in Social Network Theory" (in English). Northeastern University College of Computer and Infomation Science. http://www.ccs.neu.edu/home/perrolle/archive/Ethier-SocialNetworks.html. Retrieved on 2009-03-15.
- ^ a b c "Human Identification at a distance" (in English). Information Awareness Office (official website -- mirror). http://infowar.net/tia/www.darpa.mil/iao/HID.htm. Retrieved on 2009-03-15.
- ^ a b "EARS" (in English). Information Awareness Office (official website -- mirror). http://infowar.net/tia/www.darpa.mil/iao/EARS.htm. Retrieved on 2009-03-15.
- ^ a b Belasco, Amy (January 21, 2003). "EFF: Memorandum Regarding TIA Funding" (in English). Electronic Frontier Foundation. http://w2.eff.org/Privacy/TIA/belasco-memo.php. Retrieved on 2009-03-15.
- ^ BSS
- ^ WAE
- ^ FutureMap
- ^ Babylon
- ^ "Genoa" (in English). Information Awareness Office (official website). http://infowar.net/tia/www.darpa.mil/iao/Genoa.htm. Retrieved on 2009-03-15.
- ^ "Genoa II" (in English). Information Awareness Office (official website). http://infowar.net/tia/www.darpa.mil/iao/GenoaII.htm. Retrieved on 2009-03-15.
- ^ a b "TIDES" (in English). Information Awareness Office (official website -- mirror). http://infowar.net/tia/www.darpa.mil/iao/TIDES.htm. Retrieved on 2009-03-15.
- ^ a b c "Communicator" (in English). Information Awareness Office (official website). http://infowar.net/tia/www.darpa.mil/iao/Communicator.htm. Retrieved on 2009-03-15.
- ^ Wanted: Competent Big Brothers, Newsweek, 8 February 2006, retrieved 27 July 2007
- ^ The Total Information Awareness Project Lives On, Technology Review, 26 April 2006, retrieved 27 July 2007
- ^ TIA Lives On, National Journal, 23 February 2006, retrieved 27 July 2007
- ^ Chief Takes Over at Agency To Thwart Attacks on U.S. - New York Times
- ^ You Are a Suspect
- ^ Big Brother ...
[edit] Further reading
- Copies of the original IAO web pages formerly available at http://www.darpa.mil/iao/ (June 12, 2002–June 3, 2003) can be found at Archive.org, Internet Archive
- John Poindexter, Overview of the Information Awareness Office (Remarks as prepared for delivery by Dr. John Poindexter, Director, Information Awareness Office, at the DARPATech 2002 Conference) (August 2, 2002).
[edit] External links
[edit] Media coverage
- Harris, Shane (February 26, 2006). "TIA Lives On". The National Journal. http://nationaljournal.com/about/njweekly/stories/2006/0223nj1.htm.
- "Pentagon Defends Surveillance Program". The Washington Post. May 20, 2003.
- Webb, Cynthia L. (May 21, 2003). "The Pentagon's PR Play". The Washington Post.
- Bray, Hiawatha (April 4, 2003). "Mining Data to Fight Terror Stirs Privacy Fears". The Boston Globe. pp. C2.
- McCullagh, Declan (January 15, 2003). News.com.com "Pentagon database plan hits snag on Hill". CNET News.com. http://news.com.com/2100-1023-980889.html News.com.com.
- Markoff, John (February 13, 2002). "Chief Takes Over at Agency To Thwart Attacks on U.S.". The New York Times. pp. (first mainstream media mention of IAO). http://select.nytimes.com/gst/abstract.html?res=F20A11F734580C708DDDAB0894DA404482#.
[edit] Academic articles
- K. A. Taipale (2003). "Data Mining and Domestic Security: Connecting the Dots to Make Sense of Data". Columbia Sci. & Tech. Law Review 5 (2): 1–83 (TIA discussed 39–50). http://ssrn.com/abstract=546782.
- Robert Popp and John Poindexter (november/december 2006). "Countering Terrorism through Information and Privacy Protection Technologies" (PDF). IEEE Security & Privacy: 18 –26. http://www.simson.net/clips/academic/2006.data-surveillance.pdf.
[edit] Critical views (established sources)
- "TIA: Total Information Awareness". American Civil Liberties Union. January 16, 2004. http://www.aclu.org/privacy/spying/14956res20040116.html.
- Charles V. Peña (November 22, 2002). "TIA: Information Awareness Office Makes Us a Nation of Suspects". Cato Institute. http://www.cato.org/research/articles/pena-021122.html.
- "Total/Terrorism Information Awareness (TIA): Is It Truly Dead? EFF: It's Too Early to Tell". Electronic Frontier Foundation. http://www.eff.org/Privacy/TIA/20031003_comments.php.
- Epic.org "Total "Terrorism" Information Awareness (TIA): Latest News". Electronic Privacy Information Center. http://www.epic.org/privacy/profiling/tia/ Epic.org.
- SPTimes.com "A Times Editorial: Unfocused data-mining". St. Petersburg Times. January 24, 2003. http://www.sptimes.com/2003/01/24/Opinion/Unfocused_data_mining.shtml SPTimes.com.
[edit] Critical views (less well recognized)
- Russ Kick. "Information Awareness Office Website Deletes Its Logo". The Memory Hole. http://www.thememoryhole.org/policestate/iao-logo.htm.
[edit] Proponent views
- Mac Donald, Heather (January 27, 2003). "Total Misrepresentation". The Weekly Standard. http://www.weeklystandard.com/Content/Public/Articles/000/000/002/137dvufs.asp.
- Levin, Jonathan (February 13, 2003). "Total Preparedness: The case for the Defense Department's Total Information Awareness project". National Review. http://www.nationalreview.com/comment/comment-levin021303.asp.
- Taylor, Jr., Stuart (December 10, 2002). "Big Brother and Another Overblown Privacy Scare". The Atlantic. http://www.theatlantic.com/politics/nj/taylor2002-12-10.htm.
Accord:
- Shane Ham & Robert D. Atkinson (2002). "Using Technology to Detect and Prevent Terrorism" (PDF). Progressive Policy Institute. http://www.ppionline.org/douments/IT_terrorism.pdf.
- "Safegaurding Privacy in the Fight Against Terrorism" (PDF). DOD Technology and Privacy Advisory Committee (TAPAC). March 2004. http://www.cdt.org/security/usapatriot/20040300tapac.pdf.
Also:
- Ignatius, David (August 1, 2003). "Back in the Safe Zone". The Washington Post. pp. A19 (discussing opposition to the IAO FutureMap project). http://www.washingtonpost.com/wp-dyn/articles/A10955-2003Jul31.html.