DARPA Network Challenge: Difference between revisions
Miestersean (talk | contribs) Add extensive new sections and content. |
|||
Line 1: | Line 1: | ||
The 2009 '''DARPA Network Challenge''' was a prize competition for exploring the roles the [[Internet]] and [[social networking]] play in the |
The 2009 '''DARPA Network Challenge''' was a prize competition for exploring the roles the [[Internet]] and [[social networking]] play in the real-time communications, wide-area [[collaboration]]s, and practical actions required to solve broad-scope, time-critical problems. The competition was sponsored by the [[Defense Advanced Research Projects Agency]] (DARPA), a research organization of the [[United States]] [[United States Department of Defense|Department of Defense]]. The challenge was designed to help the military generate ideas for operating under a range of circumstances, such as natural disasters.<ref name="cnnref">{{Cite web|url=http://articles.cnn.com/2009-12-05/tech/darpa.balloon.challenge_1_balloons-darpa-invited?_s=PM:TECH|title=MIT wins $40,000 prize in nationwide balloon-hunt contest|accessdate=2012-02-21|publisher=CNN|year=2009}}</ref> [[United States Congress|Congress]] authorized DARPA to award cash prizes to further DARPA’s mission to sponsor revolutionary, high-payoff research that bridges the gap between fundamental discoveries and their use for national security. |
||
== Specifics of the competition == |
|||
Under the rules of the competition, the $40,000 challenge award would be granted to the first team to submit the locations of 10 moored, 8-foot, red, weather balloons at 10 previously undisclosed fixed locations in the continental United States. The balloons were to be placed in readily accessible locations visible from nearby roads. |
Under the rules of the competition, the $40,000 challenge award would be granted to the first team to submit the locations of 10 moored, 8-foot, red, weather balloons at 10 previously undisclosed fixed locations in the continental United States. The balloons were to be placed in readily accessible locations visible from nearby roads. The balloons were deployed at 10:00 AM Eastern Time on December 5, 2009 and scheduled to be taken down at 5:00 PM. DARPA was prepared to deploy them for a second day and wait for up to a week for a team to find all of the balloons. |
||
The contest was announced only about a month before the start date. This limited the amount of time teams had to prepare. The ability of many to do so showed the effectiveness of mass and social media to quickly distribute information and organize people.<ref name="reflecting">{{cite journal | author=John C. Tang, Manuel Cebrian, Nicklaus A. Giacobe, Hyun-Woo Kim, Taemie Kim, Douglas "Beaker" Wickert| title=Reflecting on the DARPA Red Balloon Challenge| journal=Communications of the ACM | year=2011| volume=54| issue=4| page=78-85| url=http://cacm.acm.org/magazines/2011/4/106587-reflecting-on-the-darpa-red-balloon-challenge/fulltext}}</ref> The time in which information about the challenge spread rapidly was actually more compressed than a month, however: in the week preceding the launch day, the official competition site increased in traffic from an average of 1,000 hits per day to 20,000 hits per day. Similarly, the efforts of many competing teams went viral in the last few days before the start date. <ref name="projectreport">{{Cite web|url=http://www.hsdl.org/?view&did=17522|title=DARPA Network Challenge Project Report|accessdate=2012-03-03|author=Defense Advanced Research Projects Agency}}</ref> |
|||
DARPA selected the date of the competition to commemorate the 40th anniversary of the [[Internet]]. |
DARPA selected the date of the competition to commemorate the 40th anniversary of the [[Internet]]. |
||
==Results== |
|||
⚫ | |||
As mentioned above, DARPA was prepared to deploy the balloons for a second day and accept submissions for up to a week until a team found all 10 balloons. However, the [[Massachusetts Institute of Technology|MIT]] Red Balloon Challenge Team won the competition in under 9 hours.<ref>{{cite web |title=MIT Red Balloon Team Wins DARPA Network Challenge |url=https://networkchallenge.darpa.mil/darpanetworkchallengewinner2009.pdf |publisher=DARPA |accessdate=2009-12-06}}</ref> In second place was a team from the [[GTRI|Georgia Tech Research Institute (GTRI)]], who located nine balloons. Additionally, two teams found eight balloons, five found seven, and the iSchools team (which represented [[Pennsylvania State University]], [[University of Illinois at Urbana-Champaign]], [[University of Pittsburgh]], [[Syracuse University]], and [[University of North Carolina at Chapel Hill]]), whose strategy is described below, finished tenth with six balloons.<ref name="reflecting" /> In table form, the top ten teams were:<ref>{{cite web |title=DARPA Network Challenge Final Standings |url=https://networkchallenge.darpa.mil/FinalStandings.pdf |publisher=DARPA |accessdate=2010-10-07}}</ref> |
|||
⚫ | |||
⚫ | It might play out like this. Alice joins the team, and we give her an invite link like http://balloon.media.mit.edu/alice. Alice then e-mails her link to Bob, who uses it to join the team as well. We make a http://balloon.media.mit.edu/bob link for Bob, who posts it to Facebook. His friend Carol sees it, signs up, then twitters about http://balloon.media.mit.edu/carol. Dave uses Carol's link to join... then spots one of the DARPA balloons! Dave is the first person to report the balloon's location to us, and the MIT Red Balloon Challenge Team is the first to find all 10. Once that happens, we send Dave $2000 for finding the balloon. Carol gets $1000 for inviting Dave, Bob gets $500 for inviting Carol, and Alice gets $250 for inviting Bob. The remaining $250 is donated to charity.}} |
||
⚫ | Prior to the competition numerous people had discussed possible strategies,<ref>{{cite web |author=Adrian Hon |title=How to Win the DARPA Network Challenge | url=http://mssv.net/2009/10/31/how-to-win-the-darpa-network-challenge/ |publisher=Mssv |date=October 31, 2009}}</ref> including [[satellite photography]], [[aerial photography]] and [[crowdsourcing]] to detect balloons, as well as the possibility of [[misinformation]] campaigns to stop other teams from winning. |
||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | * Balloon 3: [[Tonsler Park, Charlottesville|Tonsler Park]], [[Charlottesville, Virginia|Charlottesville]], Virginia <ref>{{cite web |url=http://www.readthehook.com/blog/index.php/2009/12/05/ten-red-balloons-and-ones-in-charlottesville/ |title= Ten red balloons– and one’s in Charlottesville! | publisher=The Hook | date= Saturday December 5, 2009}}</ref> {{coord|38|1|34|N|78|29|28|W |type:event_region:US-VA |name=Tonsler Park}} |
||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | |||
==Top Ten Teams== |
|||
In the final standings <ref>{{cite web |title=DARPA Network Challenge Final Standings |url=https://networkchallenge.darpa.mil/FinalStandings.pdf |publisher=DARPA |accessdate=2010-10-07}}</ref> the top ten teams reported are: |
|||
{| class="wikitable" |
{| class="wikitable" |
||
Line 57: | Line 36: | ||
|} |
|} |
||
== |
==Winning strategy== |
||
The winning MIT team used a technique similar to [[multi-level marketing]] to recruit participants, with the prize money to be distributed up the chain of participants leading to successful balloon spottings, and all prize income remaining after distribution to participants to be given to charity.<ref>{{cite web|url=http://balloon.mit.edu/mit/payoff/|title=How It Works|publisher=MIT Red Balloon Challenge Team}}</ref> The team's strategy for public collaboration in finding the balloons was explained on their website: |
|||
⚫ | |||
⚫ | It might play out like this. Alice joins the team, and we give her an invite link like http://balloon.media.mit.edu/alice. Alice then e-mails her link to Bob, who uses it to join the team as well. We make a http://balloon.media.mit.edu/bob link for Bob, who posts it to Facebook. His friend Carol sees it, signs up, then twitters about http://balloon.media.mit.edu/carol. Dave uses Carol's link to join... then spots one of the DARPA balloons! Dave is the first person to report the balloon's location to us, and the MIT Red Balloon Challenge Team is the first to find all 10. Once that happens, we send Dave $2000 for finding the balloon. Carol gets $1000 for inviting Dave, Bob gets $500 for inviting Carol, and Alice gets $250 for inviting Bob. The remaining $250 is donated to charity.}} |
||
The recursive nature of the reward had two beneficial effects. First, participants had an incentive to involve others, as these new people would not be become competitors for the reward but rather cooperating partners. Second, people not located in the United States were motivated to participate by passing along information even though they had no way of locating a balloon in person. This helped the team garner a large amount (over 5,000) of participants.<ref name="reflecting"/> The team only began with four initial participants.<ref name="projectreport"/> |
|||
To determine whether submissions were legitimate or fake, the team employed at least three strategies.<ref name="reflecting" /> The first strategy was examining whether there were multiple submissions for a location. If this was the case, then the likelihood of a balloon actually being there was thought to be higher. A second strategy was to check whether the IP address of the submitter matched the supposed location of the balloon. A third strategy was to examine photos accompanying the submission. Real photos included a DARPA employee and a DARPA banner, details which were not announced, while faked ones did not. |
|||
==Second-place strategy == |
|||
The second-place GTRI team used a strategy that relied heavily on Internet publicity and social media.<ref name="reflecting" /> They created a Web site three weeks before the launch day and used a variety of media-related efforts, including a [[Facebook]] group, in order to increase the visibility of the team and increase the chance that people who spotted the balloons would report the sighting to them. |
|||
The team promised to donate all winnings to charity to appeal to the altruism of participants. However, due to the lack of structure that created much incentive as MIT's scheme, their network of participants grew to only about 1,400 people. |
|||
With regards to validating submissions, the team assumed that because of the charitable nature of their effort, the number of false submissions would be low. In any case, they primarily relied on personal validation, having phone conversations with submitters. |
|||
⚫ | |||
The tenth-place iSchools team, which represented five universities, tried two distinct approaches.<ref name="reflecting"/> The first was directly recruiting team members to look for the balloons on launch day. These members included students, faculty, and alumni on official mailing lists and social media website groups for organizations on the team (e.g., [[Pennsylvania State University]]). Only a few of these observers actually participated, however, and only one balloon was found using this strategy. |
|||
The second strategy used by the team was using [[open-source intelligence]] methods to do cyberspace searching for results related to the challenge. This was the main source of their success in locating balloons. This strategy, in turn, consisted of two distinct strategies. The first was to use a group of human analysts who would manually search online on a variety of information sources, including [[Twitter]] and the websites of competing teams, compile reported sightings, and then evaluate the validity of sightings based on the reputation of the sources. |
|||
The second strategy relating to cyberspace searching was an automated Web crawler which captured data from Twitter and opposing teams' websites and then analyzed it. This technology worked slowly and would have benefited from a longer contest duration, but the Twitter crawler proved to be especially useful because tweets sometimes contained geographic information. |
|||
To confirm the validity of possible sightings, recruited team members were used when possible. If none were available, new observers were recruited from organizations located near the sighting. The distributed location of the different organizations in the team allowed this to be a feasible strategy. Photographic analysis was also used to confirm or dispute the validity of claims. |
|||
The team also encountered a case of another team accidentally leaking information about a sighting and then trying to cover it up. The iSchools team used a variety of information sources, including social networks, to determine what the real location was. This demonstrated the possibility of using information from a wide variety of public websites to determine the validity of something. |
|||
== Other strategies == |
|||
⚫ | Prior to the competition numerous people had discussed possible strategies,<ref>{{cite web |author=Adrian Hon |title=How to Win the DARPA Network Challenge | url=http://mssv.net/2009/10/31/how-to-win-the-darpa-network-challenge/ |publisher=Mssv |date=October 31, 2009}}</ref> including [[satellite photography]], [[aerial photography]] and [[crowdsourcing]] to detect balloons, as well as the possibility of [[misinformation]] campaigns to stop other teams from winning. |
||
One team leader, Jason Brindel of [[San Rafael, California]], organized a team of around 140 people <ref name="Nationwide balloon-hunt contest">{{cite web|last=Gross|first=Doug|title=Nationwide balloon-hunt contest tests online networking|url=http://articles.cnn.com/2009-12-04/tech/darpa.balloon.challenge_1_social-networking-balloons-hunt?_s=PM:TECH|work=CNN|accessdate=3 March 2012}}</ref> . His plan was to create a web site and Twitter account dedicated to the challenge that would allow his team members to communicate their findings. However, anyone participating in the challenge would be allowed to submit information. The caveat being they needed to provide confirmation details about their submitted information. Brindel planned to scour the Internet for mentions of balloons across news sites, blogs, and social media sites. |
|||
[[George Hotz]], now famous for hacking the [[PlayStation 3]] and being sued by and settling with [[Sony]], only prepared the competition for an hour bore posting a [[Twitter|tweet]] an hour before the start of the competition. Hotz was able to locate 8 balloons successfully. Four were found within his Twitter network of almost 50,000 followers, and four were acquired through trades of balloon sightings with other teams.<ref name="projectreport"/> |
|||
A team calling themselves [[Nerdfighters]] utilized their existing network of followers from the [[Brotherhood 2.0]] [[vlog]] to launch a viral video before the competition. They managed to attract 2,000 active balloon seekers. They also utilized 3,000 Nerdfighters who scanned for Internet traffic related to the competition and specialized in launching a misinformation campaign, hoping to confuse or misdirect other teams. They also created a network of cell phone users to provide direct text message verification of findings.<ref name="projectreport"/> |
|||
A team of [[iPhone]] application developers formed Army of Eyes, based out of [[Austin, TX]]. Their application was developed soon after the original challenge announcement in order to be made available by challenge launch day.<ref name="projectreport"/> |
|||
The {{URL|http://i-neighbors.org/|iNeighbors}} team, made up of members of an existing social media site for neighborhood watch communities, performed no recruitment or trading efforts. Their goal was to test the strength of their existing network with its ability to effectively report on abnormal activity within neighborhoods. They were able to locate five of the ten balloons.<ref name="projectreport"/> |
|||
==Reflections== |
|||
The challenge generated a number of insights. First, it showed how mass and social media can act complementarily. While mass media was useful primarily for spreading general information about the challenge, social media was effective for viral dissemination of information about the challenge to potential team recruits. Second, it showed how social media can be useful as a data mining source. For example, the iSchools team did better than many other teams by simply monitoring public websites. Third, the challenge showed the variety of ways in which social networking can be utilized. The MIT and GTRI teams used it primarily to facilitate fast communication between participants, while the iSchools team used it as a source of information. |
|||
Fourth, the challenge showed the general effectiveness of using [[crowdsourcing]] techniques to solve geographically-distributed, time-sensitive problems. The DARPA program managers were surprised by how quickly the challenge was completed, and the ability of teams to locate and verify sightings was promising. The results have implications for problems such as locating missing children. However, it can be difficult to filter useful data from public sites, and the independent verification of publicly listed information remains a challenge in efficiency and accuracy.<ref name="reflecting"/> |
|||
DARPA noted that though social networks can be used as a powerful source of intelligence, doing so may be politically sensitive due to the privacy concerns involved with data mining users' content. Similarly, the winning MIT team surmised that their recursive approach would only be effective if the effort's goal was seen to be moral and good by participants.<ref name="projectreport"/> |
|||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | * Balloon 3: [[Tonsler Park, Charlottesville|Tonsler Park]], [[Charlottesville, Virginia|Charlottesville]], Virginia <ref>{{cite web |url=http://www.readthehook.com/blog/index.php/2009/12/05/ten-red-balloons-and-ones-in-charlottesville/ |title= Ten red balloons– and one’s in Charlottesville! | publisher=The Hook | date= Saturday December 5, 2009}}</ref> {{coord|38|1|34|N|78|29|28|W |type:event_region:US-VA |name=Tonsler Park}} |
||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | |||
==Related challenges== |
|||
Inspired by the success of the DARPA Network Challenge, DARPA launched the [[DARPA Shredder Challenge 2011|Shredder Challenge]] in 2011. This competition aimed to explore methods to reconstruct documents shredded by a variety of paper shredding techniques. As with the DARPA Network Challenge, some teams used crowdsourcing to solicit human help in reconstructing the documents.<ref>{{cite news | url=http://news.cnet.com/8301-17938_105-57326966-1/crowdsourcing-the-most-challenging-puzzle-ever/ | title=Crowdsourcing the 'most challenging puzzle ever | publisher=[[CNET]] | date=November 17, 2011 | accessdate=2011-12-01}}</ref> The winning team used a combination of computer-vision algorithm to suggest fragment pairings to human assemblers for verification.<ref name = "Wired Dec 2">{{cite web|last=Drummond|first=Katie|date = December 2, 2011|title=Programmers Shred Pentagon’s Paper Puzzle Challenge|url=http://www.wired.com/dangerroom/2011/12/darpa-shredder-challenge-2|publisher=''[[Wired (magazine)|Wired]]''|accessdate=December 5, 2011}}</ref> |
Inspired by the success of the DARPA Network Challenge, DARPA launched the [[DARPA Shredder Challenge 2011|Shredder Challenge]] in 2011. This competition aimed to explore methods to reconstruct documents shredded by a variety of paper shredding techniques. As with the DARPA Network Challenge, some teams used crowdsourcing to solicit human help in reconstructing the documents.<ref>{{cite news | url=http://news.cnet.com/8301-17938_105-57326966-1/crowdsourcing-the-most-challenging-puzzle-ever/ | title=Crowdsourcing the 'most challenging puzzle ever | publisher=[[CNET]] | date=November 17, 2011 | accessdate=2011-12-01}}</ref> The winning team used a combination of computer-vision algorithm to suggest fragment pairings to human assemblers for verification.<ref name = "Wired Dec 2">{{cite web|last=Drummond|first=Katie|date = December 2, 2011|title=Programmers Shred Pentagon’s Paper Puzzle Challenge|url=http://www.wired.com/dangerroom/2011/12/darpa-shredder-challenge-2|publisher=''[[Wired (magazine)|Wired]]''|accessdate=December 5, 2011}}</ref> |
||
Line 71: | Line 114: | ||
*[http://networkchallenge.darpa.mil/Rules.pdf Rules for the 2009 Network Challenge] |
*[http://networkchallenge.darpa.mil/Rules.pdf Rules for the 2009 Network Challenge] |
||
[[Category:Science competitions]] |
[[Category:Science competitions]] |
||
[[Category:Crowdsourcing]] |
[[Category:Crowdsourcing]] |
||
[[Category:Computer science competitions]] |
[[Category:Computer science competitions]] |
Revision as of 17:42, 3 March 2012
The 2009 DARPA Network Challenge was a prize competition for exploring the roles the Internet and social networking play in the real-time communications, wide-area collaborations, and practical actions required to solve broad-scope, time-critical problems. The competition was sponsored by the Defense Advanced Research Projects Agency (DARPA), a research organization of the United States Department of Defense. The challenge was designed to help the military generate ideas for operating under a range of circumstances, such as natural disasters.[1] Congress authorized DARPA to award cash prizes to further DARPA’s mission to sponsor revolutionary, high-payoff research that bridges the gap between fundamental discoveries and their use for national security.
Specifics of the competition
Under the rules of the competition, the $40,000 challenge award would be granted to the first team to submit the locations of 10 moored, 8-foot, red, weather balloons at 10 previously undisclosed fixed locations in the continental United States. The balloons were to be placed in readily accessible locations visible from nearby roads. The balloons were deployed at 10:00 AM Eastern Time on December 5, 2009 and scheduled to be taken down at 5:00 PM. DARPA was prepared to deploy them for a second day and wait for up to a week for a team to find all of the balloons.
The contest was announced only about a month before the start date. This limited the amount of time teams had to prepare. The ability of many to do so showed the effectiveness of mass and social media to quickly distribute information and organize people.[2] The time in which information about the challenge spread rapidly was actually more compressed than a month, however: in the week preceding the launch day, the official competition site increased in traffic from an average of 1,000 hits per day to 20,000 hits per day. Similarly, the efforts of many competing teams went viral in the last few days before the start date. [3]
DARPA selected the date of the competition to commemorate the 40th anniversary of the Internet.
Results
As mentioned above, DARPA was prepared to deploy the balloons for a second day and accept submissions for up to a week until a team found all 10 balloons. However, the MIT Red Balloon Challenge Team won the competition in under 9 hours.[4] In second place was a team from the Georgia Tech Research Institute (GTRI), who located nine balloons. Additionally, two teams found eight balloons, five found seven, and the iSchools team (which represented Pennsylvania State University, University of Illinois at Urbana-Champaign, University of Pittsburgh, Syracuse University, and University of North Carolina at Chapel Hill), whose strategy is described below, finished tenth with six balloons.[2] In table form, the top ten teams were:[5]
Place | Name | Hometown | # Balloons | Date/Time |
---|---|---|---|---|
1 | MIT Red Balloon Challenge Team | Cambridge, MA | 10 | 6:52:41 PM |
2 | GTRI "I Spy a Red Balloon" Team | Atlanta, GA | 9 | 6:59:11 PM |
3 | Christian Rodriguez and Tara Chang (Red Balloon Race) | Cambridge, MA | 8 | 6:52:54 PM |
4 | Dude It's a Balloon | Glen Rock, NJ | 8 | 7:42:41 PM |
5 | Groundspeak Geocachers | Seattle, WA | 7 | 4:02:23 PM |
6 | Army of Eyes ‐ Mutual Mobile, Inc. | Austin, TX | 7 | 4:33:20 PM |
7 | Team DeciNena | Evergreen, CO | 7 | 6:46:37 PM |
8 | Anonymous | Anonymous | 7 | 7:16:51 PM |
9 | Nerdfighters | Missoula, MT | 7 | 8:19:24 PM |
10 | iSchools DARPA Challenge Team | State College, PA | 6 | 6:13:08 PM |
Winning strategy
The winning MIT team used a technique similar to multi-level marketing to recruit participants, with the prize money to be distributed up the chain of participants leading to successful balloon spottings, and all prize income remaining after distribution to participants to be given to charity.[6] The team's strategy for public collaboration in finding the balloons was explained on their website:
We're giving $2000 per balloon to the first person to send us the correct coordinates, but that's not all -- we're also giving $1000 to the person who invited them. Then we're giving $500 whoever invited the inviter, and $250 to whoever invited them, and so on... (see how it works). It might play out like this. Alice joins the team, and we give her an invite link like http://balloon.media.mit.edu/alice. Alice then e-mails her link to Bob, who uses it to join the team as well. We make a http://balloon.media.mit.edu/bob link for Bob, who posts it to Facebook. His friend Carol sees it, signs up, then twitters about http://balloon.media.mit.edu/carol. Dave uses Carol's link to join... then spots one of the DARPA balloons! Dave is the first person to report the balloon's location to us, and the MIT Red Balloon Challenge Team is the first to find all 10. Once that happens, we send Dave $2000 for finding the balloon. Carol gets $1000 for inviting Dave, Bob gets $500 for inviting Carol, and Alice gets $250 for inviting Bob. The remaining $250 is donated to charity.
The recursive nature of the reward had two beneficial effects. First, participants had an incentive to involve others, as these new people would not be become competitors for the reward but rather cooperating partners. Second, people not located in the United States were motivated to participate by passing along information even though they had no way of locating a balloon in person. This helped the team garner a large amount (over 5,000) of participants.[2] The team only began with four initial participants.[3]
To determine whether submissions were legitimate or fake, the team employed at least three strategies.[2] The first strategy was examining whether there were multiple submissions for a location. If this was the case, then the likelihood of a balloon actually being there was thought to be higher. A second strategy was to check whether the IP address of the submitter matched the supposed location of the balloon. A third strategy was to examine photos accompanying the submission. Real photos included a DARPA employee and a DARPA banner, details which were not announced, while faked ones did not.
Second-place strategy
The second-place GTRI team used a strategy that relied heavily on Internet publicity and social media.[2] They created a Web site three weeks before the launch day and used a variety of media-related efforts, including a Facebook group, in order to increase the visibility of the team and increase the chance that people who spotted the balloons would report the sighting to them.
The team promised to donate all winnings to charity to appeal to the altruism of participants. However, due to the lack of structure that created much incentive as MIT's scheme, their network of participants grew to only about 1,400 people.
With regards to validating submissions, the team assumed that because of the charitable nature of their effort, the number of false submissions would be low. In any case, they primarily relied on personal validation, having phone conversations with submitters.
Tenth-place strategy
The tenth-place iSchools team, which represented five universities, tried two distinct approaches.[2] The first was directly recruiting team members to look for the balloons on launch day. These members included students, faculty, and alumni on official mailing lists and social media website groups for organizations on the team (e.g., Pennsylvania State University). Only a few of these observers actually participated, however, and only one balloon was found using this strategy.
The second strategy used by the team was using open-source intelligence methods to do cyberspace searching for results related to the challenge. This was the main source of their success in locating balloons. This strategy, in turn, consisted of two distinct strategies. The first was to use a group of human analysts who would manually search online on a variety of information sources, including Twitter and the websites of competing teams, compile reported sightings, and then evaluate the validity of sightings based on the reputation of the sources.
The second strategy relating to cyberspace searching was an automated Web crawler which captured data from Twitter and opposing teams' websites and then analyzed it. This technology worked slowly and would have benefited from a longer contest duration, but the Twitter crawler proved to be especially useful because tweets sometimes contained geographic information.
To confirm the validity of possible sightings, recruited team members were used when possible. If none were available, new observers were recruited from organizations located near the sighting. The distributed location of the different organizations in the team allowed this to be a feasible strategy. Photographic analysis was also used to confirm or dispute the validity of claims.
The team also encountered a case of another team accidentally leaking information about a sighting and then trying to cover it up. The iSchools team used a variety of information sources, including social networks, to determine what the real location was. This demonstrated the possibility of using information from a wide variety of public websites to determine the validity of something.
Other strategies
Prior to the competition numerous people had discussed possible strategies,[7] including satellite photography, aerial photography and crowdsourcing to detect balloons, as well as the possibility of misinformation campaigns to stop other teams from winning.
One team leader, Jason Brindel of San Rafael, California, organized a team of around 140 people [8] . His plan was to create a web site and Twitter account dedicated to the challenge that would allow his team members to communicate their findings. However, anyone participating in the challenge would be allowed to submit information. The caveat being they needed to provide confirmation details about their submitted information. Brindel planned to scour the Internet for mentions of balloons across news sites, blogs, and social media sites.
George Hotz, now famous for hacking the PlayStation 3 and being sued by and settling with Sony, only prepared the competition for an hour bore posting a tweet an hour before the start of the competition. Hotz was able to locate 8 balloons successfully. Four were found within his Twitter network of almost 50,000 followers, and four were acquired through trades of balloon sightings with other teams.[3]
A team calling themselves Nerdfighters utilized their existing network of followers from the Brotherhood 2.0 vlog to launch a viral video before the competition. They managed to attract 2,000 active balloon seekers. They also utilized 3,000 Nerdfighters who scanned for Internet traffic related to the competition and specialized in launching a misinformation campaign, hoping to confuse or misdirect other teams. They also created a network of cell phone users to provide direct text message verification of findings.[3]
A team of iPhone application developers formed Army of Eyes, based out of Austin, TX. Their application was developed soon after the original challenge announcement in order to be made available by challenge launch day.[3]
The iNeighbors team, made up of members of an existing social media site for neighborhood watch communities, performed no recruitment or trading efforts. Their goal was to test the strength of their existing network with its ability to effectively report on abnormal activity within neighborhoods. They were able to locate five of the ten balloons.[3]
Reflections
The challenge generated a number of insights. First, it showed how mass and social media can act complementarily. While mass media was useful primarily for spreading general information about the challenge, social media was effective for viral dissemination of information about the challenge to potential team recruits. Second, it showed how social media can be useful as a data mining source. For example, the iSchools team did better than many other teams by simply monitoring public websites. Third, the challenge showed the variety of ways in which social networking can be utilized. The MIT and GTRI teams used it primarily to facilitate fast communication between participants, while the iSchools team used it as a source of information.
Fourth, the challenge showed the general effectiveness of using crowdsourcing techniques to solve geographically-distributed, time-sensitive problems. The DARPA program managers were surprised by how quickly the challenge was completed, and the ability of teams to locate and verify sightings was promising. The results have implications for problems such as locating missing children. However, it can be difficult to filter useful data from public sites, and the independent verification of publicly listed information remains a challenge in efficiency and accuracy.[2]
DARPA noted that though social networks can be used as a powerful source of intelligence, doing so may be politically sensitive due to the privacy concerns involved with data mining users' content. Similarly, the winning MIT team surmised that their recursive approach would only be effective if the effort's goal was seen to be moral and good by participants.[3]
Verified balloon locations
The officially verified coordinates of the balloons,[9] listed by their tag numbers, were:
- Balloon 1: Union Square, San Francisco, California 37°47′16″N 122°24′26″W / 37.78778°N 122.40722°W
- Balloon 2: Chaparral Park, Scottsdale, Arizona 33°30′36″N 111°54′29″W / 33.51000°N 111.90806°W
- Balloon 3: Tonsler Park, Charlottesville, Virginia [10] 38°1′34″N 78°29′28″W / 38.02611°N 78.49111°W
- Balloon 4: Chase Palm Park, Santa Barbara, California 34°24′51″N 119°41′5″W / 34.41417°N 119.68472°W
- Balloon 5: Lee Park, Memphis, Tennessee 35°8′17″N 90°3′43″W / 35.13806°N 90.06194°W
- Balloon 6: Collins Avenue, Miami, Florida 25°54′14″N 80°7′31″W / 25.90389°N 80.12528°W
- Balloon 7: Glasgow Park, Christiana, Delaware 39°36′30″N 75°43′51″W / 39.60833°N 75.73083°W
- Balloon 8: Katy Park, Katy, Texas 29°48′56″N 95°48′15″W / 29.81556°N 95.80417°W
- Balloon 9: Waterfront Park, Portland, Oregon 45°30′44″N 122°40′28″W / 45.51222°N 122.67444°W
- Balloon 10: Centennial Park, Atlanta, Georgia 33°45′33″N 84°23′33″W / 33.75917°N 84.39250°W
Related challenges
Inspired by the success of the DARPA Network Challenge, DARPA launched the Shredder Challenge in 2011. This competition aimed to explore methods to reconstruct documents shredded by a variety of paper shredding techniques. As with the DARPA Network Challenge, some teams used crowdsourcing to solicit human help in reconstructing the documents.[11] The winning team used a combination of computer-vision algorithm to suggest fragment pairings to human assemblers for verification.[12]
In January 2012, the University of Pennsylvania School of Medicine launched the MyHeartMap Challenge to map Automatic External Defibrillators (AEDs) in the city of Philladelphia.[13] According to the organizer Dr. Raina Merchant, "DARPA succeeded with locating red balloons. AEDs are a natural extension of a brilliant idea."[14]
References
- ^ "MIT wins $40,000 prize in nationwide balloon-hunt contest". CNN. 2009. Retrieved 2012-02-21.
- ^ a b c d e f g John C. Tang, Manuel Cebrian, Nicklaus A. Giacobe, Hyun-Woo Kim, Taemie Kim, Douglas "Beaker" Wickert (2011). "Reflecting on the DARPA Red Balloon Challenge". Communications of the ACM. 54 (4): 78-85.
{{cite journal}}
: CS1 maint: multiple names: authors list (link) - ^ a b c d e f g Defense Advanced Research Projects Agency. "DARPA Network Challenge Project Report". Retrieved 2012-03-03.
- ^ "MIT Red Balloon Team Wins DARPA Network Challenge" (PDF). DARPA. Retrieved 2009-12-06.
- ^ "DARPA Network Challenge Final Standings" (PDF). DARPA. Retrieved 2010-10-07.
- ^ "How It Works". MIT Red Balloon Challenge Team.
- ^ Adrian Hon (October 31, 2009). "How to Win the DARPA Network Challenge". Mssv.
- ^ Gross, Doug. "Nationwide balloon-hunt contest tests online networking". CNN. Retrieved 3 March 2012.
- ^ "DARPA Network Challenge Balloon Coordinates" (PDF). DARPA. Retrieved 2009-12-13.
- ^ "Ten red balloons– and one's in Charlottesville!". The Hook. Saturday December 5, 2009.
{{cite web}}
: Check date values in:|date=
(help) - ^ "Crowdsourcing the 'most challenging puzzle ever". CNET. November 17, 2011. Retrieved 2011-12-01.
- ^ Drummond, Katie (December 2, 2011). "Programmers Shred Pentagon's Paper Puzzle Challenge". Wired. Retrieved December 5, 2011.
{{cite web}}
: Italic or bold markup not allowed in:|publisher=
(help) - ^ McCullough, Marie (January 31, 2012). "Global contest will lead to help during heart attacks". Philadelphia Enquirer. Retrieved 2012-02-02.
- ^ "MyHeartMap Challenge Media Page". University of Pennsylvania. Retrieved 2012-02-03.