You can now search every tweet ever!

Image
Press Trust of India Washington
Last Updated : Nov 19 2014 | 12:36 PM IST
Twitter has indexed and made searchable every public tweet made since the microblogging platform's launch in 2006, which amounts to hundreds of billions of messages.
A new, more powerful search function will let users search for specific words used by specific users, hashtags used between a set of given dates and other variables.
The company is making the complete results from its "Tweet Index" available through the "All" tab of search results generated by its Web client and iOS and Android apps, Twitter said in a blog post.
While the micro blogging site already enables discovery of relatively fresh user-generated content via "an inverted index containing about a week's worth of recent tweets," a project has been long in the making to enable efficient searching of the "roughly half a trillion documents" contained on the site.
"Since that first simple tweet over eight years ago, hundreds of billions of tweets have captured everyday human experiences and major historical events," project co-leader Yi Zhuang wrote.
"Our search engine excelled at surfacing breaking news and events in real time, and our search index infrastructure reflected this strong emphasis on recency. But our long-standing goal has been to let people search through every tweet ever published," Zhuang wrote.
The new Tweet Index "serves queries with an average latency of under 100 milliseconds," the company said.
While the real-time index of recent tweets is "fully stored in RAM for low latency and fast updates," the full index uses cheaper storage to keep its maintenance from being "prohibitively expensive."
Twitter's priorities in creating the comprehensive, searchable index of tweets were to make the system modular, scalable as it grows over time, cost-effective, simple and quick for people to use, and developed incrementally, Zhuang said.
*Subscribe to Business Standard digital and get complimentary access to The New York Times

Smart Quarterly

₹900

3 Months

₹300/Month

SAVE 25%

Smart Essential

₹2,700

1 Year

₹225/Month

SAVE 46%
*Complimentary New York Times access for the 2nd year will be given after 12 months

Super Saver

₹3,900

2 Years

₹162/Month

Subscribe

Renews automatically, cancel anytime

Here’s what’s included in our digital subscription plans

Exclusive premium stories online

  • Over 30 premium stories daily, handpicked by our editors

Complimentary Access to The New York Times

  • News, Games, Cooking, Audio, Wirecutter & The Athletic

Business Standard Epaper

  • Digital replica of our daily newspaper — with options to read, save, and share

Curated Newsletters

  • Insights on markets, finance, politics, tech, and more delivered to your inbox

Market Analysis & Investment Insights

  • In-depth market analysis & insights with access to The Smart Investor

Archives

  • Repository of articles and publications dating back to 1997

Ad-free Reading

  • Uninterrupted reading experience with no advertisements

Seamless Access Across All Devices

  • Access Business Standard across devices — mobile, tablet, or PC, via web or app

More From This Section

First Published: Nov 19 2014 | 12:36 PM IST

Next Story