Archive Team

Archive Team logo

Archive Team is a group dedicated to digital preservation and web archiving that was co-founded by Jason Scott in 2009.[1][2]

Its primary focus is the copying and preservation of content housed by at-risk online services. Some of its projects include the partial preservation of GeoCities,[3][4] Yahoo! Video, Google Video, Splinder, Friendster, FortuneCity,[a] TwitPic,[5] SoundCloud,[6] and the "Aaron Swartz Memorial JSTOR Liberator".[7] Archive Team also archives URL shortener services[8] and wikis[9] on a regular basis.

According to Jason Scott, "Archive Team was started out of anger and a feeling of powerlessness, this feeling that we were letting companies decide for us what was going to survive and what was going to die."[10] Scott continues, "it's not our job to figure out what's valuable, to figure out what's meaningful. We work by three virtues: rage, paranoia, and kleptomania."[11]

Warrior/Tracker system

[edit]

Archive Team is composed of a loose community of independent contributors/users.[citation needed] Their archival process makes use of a "Warrior", a virtual machine environment. Individuals use the Warrior in their desktop environments to download content without requiring technical expertise. Tasks are allocated by a centrally-managed Tracker that networks with and allocates items to Warriors. The tracker also monitors user upload activity and displays a leader board.[12]

Projects

[edit]

There are several projects currently running:

  • Imgur: The image host Imgur updated their terms of service on April 19, 2023. This update focused on removing old, unused, and inactive content that is not tied to a user account, along with NSFW content.[13]
  • Blogger: In May 2023, Google announced that inactive accounts would be deleted starting on 2023-12-01 across their platform, including Blogger blogs.[14]
  • Reddit: Banning communities that generate bad PR for Reddit Inc. Restricting access to APIs and data on June 19, 2023.[15]
  • Russian invasion of Ukraine: Archiving various .ua sites in the wake of the Russian government's invasion.[16]
  • Telegram: Archiving public messages in various newsworthy and/or otherwise notable Telegram channels.[17]
  • GitHub: When it was bought by Microsoft in 2018, many archivists and users were worried the site would become more restrictive. This project archives the UI parts of GitHub and the code of each repository.[18]
  • Mediafire: On 2020-12-18, users reported that they began receiving emails from MediaFire how they plan to classify accounts as abandoned if they fail to meet certain criteria, starting in January.[19]
  • Coronavirus Outbreak: Documenting and preserving data, events, and impacts of COVID-19 on society.[20]
  • YouTube: Saving metadata, thumbnails, comments and selected videos. Videos and channels are to be limited to: Channels that may be deleted because company went bankrupt, channel owner died, YouTube banning certain content, and channels related to world events and politics.[21]
  • Wikiteam: Saving wiki xml dumps.[22]
  • Urlteam: Saving URL shorteners.[23]
  • URLs: Archiving URLs from various sources.[24]

As of 18 June 2024, the largest project on ArchiveTeam is Reddit, with over 3 petabytes archived.[25][b]

See also

[edit]

Notes

[edit]
  1. ^ Sources covering Archive Team projects:[26][27][28][29][30][31][32][33]
  2. ^ The tracker uses units with binary prefixes e.g. pebibytes (1024 GB) instead of petabytes (1000 GB)

References

[edit]
  1. ^ Scott, Jason (January 6, 2009). "Team Archive is GO". ASCII by Jason Scott. Archived from the original on 2016-11-02. Retrieved December 30, 2016.
  2. ^ "Revision history of "Main Page"". Archive Team. Archived from the original on 2016-12-31. Retrieved December 30, 2016.
  3. ^ Gilbertson, Scott (2010-11-01). "Geocities Lives On as Massive Torrent Download". Wired. Archived from the original on 2012-04-25.
  4. ^ Modine, Austin (2009-04-28). "Web 0.2 archivists save Geocities from deletion". The Register. Archived from the original on 2012-05-03.
  5. ^ "TwitPic - Archiveteam". Archived from the original on 2014-09-09. Retrieved 2014-09-17.
  6. ^ Deahl, Dani (2017-07-18). "Archive Team promises to back up SoundCloud amid worries of a shutdown". Archived from the original on 2018-10-21. Retrieved 2018-11-28.
  7. ^ Farivar, Cyrus (2013-01-15). "Aaron Swartz Memorial JSTOR Liberator sets public domain academic articles free". Archived from the original on 2018-03-23. Retrieved 2018-11-28.
  8. ^ "url shortening was a fucking awful idea". URLTE.AM. Archived from the original on 2011-06-11.
  9. ^ WikiTeam Archived 2016-02-10 at the Wayback Machine
  10. ^ "Open Source Bridge 2012 Keynote - Jason Scott". YouTube. 28 June 2012. Archived from the original on 2017-09-14. Retrieved 2018-11-28.
  11. ^ "Open Source Bridge 2012 Keynote - Jason Scott". YouTube. 28 June 2012. Archived from the original on 2017-09-14. Retrieved 2018-11-28.
  12. ^ Ogden, Jessica (October 21, 2021). ""Everything on the internet can be saved": Archive Team, Tumblr and the cultural significance of web archiving". Internet Histories. 6 (1–2): 113–132. doi:10.1080/24701475.2021.1985835. hdl:1983/daef55ca-1fb1-4d91-a820-244bf24fe2b7. S2CID 239510759.
  13. ^ "Imgur Terms of Service Update". Imgur Help. Archived from the original on 31 May 2023. Retrieved 9 June 2023.
  14. ^ "Blogger - Archiveteam". wiki.archiveteam.org. Retrieved 2024-01-02.
  15. ^ Slowe, Christopher (2023-04-18). "An Update Regarding Reddit's API". reddit.com. Archived from the original on 2024-06-18. Retrieved 2023-06-09.
  16. ^ ".ua - Archiveteam". wiki.archiveteam.org. Archived from the original on 2023-03-23. Retrieved 2023-06-09.
  17. ^ "Telegram - Archiveteam". wiki.archiveteam.org. Archived from the original on 2023-05-29. Retrieved 2023-06-09.
  18. ^ "GitHub - Archiveteam". wiki.archiveteam.org. Archived from the original on 2023-05-27. Retrieved 2023-06-09.
  19. ^ "MediaFire - Archiveteam". wiki.archiveteam.org. Retrieved 2024-01-02.
  20. ^ "Coronavirus - Archiveteam". wiki.archiveteam.org. Archived from the original on 2023-06-09. Retrieved 2023-06-09.
  21. ^ "YouTube - Archiveteam". wiki.archiveteam.org. Retrieved 2024-01-02.
  22. ^ "WikiTeam - Archiveteam". wiki.archiveteam.org. Retrieved 2024-01-02.
  23. ^ "URLTeam - Archiveteam". wiki.archiveteam.org. Retrieved 2024-01-02.
  24. ^ "URLs - Archiveteam". wiki.archiveteam.org. Retrieved 2024-01-02.
  25. ^ "Reddit tracker Dashboard". tracker.archiveteam.org. Archived from the original on 2023-05-23. Retrieved 2023-06-09.
  26. ^ Sullivan, Mark (2012-04-13). "The 'Archive Team' Rescues User Content From Doomed Sites". PC World. Archived from the original on 2012-04-20.
  27. ^ Schwartz, Matt (January 2012). "Fire in the Library". Technology Review. Archived from the original on 2012-01-24.
  28. ^ Garfield, Bob; Scott, Jason (2012-03-23). "The Archive Team". OnTheMedia. Archived from the original on 2012-04-27. Retrieved 2012-04-19.
  29. ^ Masnick, Mike (2012-04-12). "Historic Archive Of Websites From The January 18th SOPA Blackout". Techdirt. Archived from the original on 2012-04-15.
  30. ^ Scott, Jason (2012-03-06). "Click: The Archive Team - Jason Scott talks about his mission to salvage our digital heritage". BBC. Archived from the original on 2015-04-03.
  31. ^ Morton, Simon; Scott, Jason (2012-03-03). "The Archive Team". RadioNZ. Archived from the original on 2012-04-21.
  32. ^ Misener, Dan (2011-04-29). "Full Interview: Jason Scott on online video and digital heritage". CBC. Archived from the original on 2012-10-26.
  33. ^ Paul-Choudhury, Sumit (May 6, 2011). "Amateur heroes of online heritage". New Scientist. Archived from the original on April 2, 2015. Retrieved March 9, 2015.
[edit]