New software turns text into music

Image
Press Trust of India New York
Last Updated : May 12 2014 | 3:26 PM IST
Researchers, including one of Indian-origin, have used a first-of-its-kind software to translate the emotions of the written word into music.
The work could transform the way people interact with literature and spark new ways to visualise information, such as audiovisual e-books that generate music according to the emotions on the page or novel music apps, researchers said.
"Given a novel in an electronically readable form, our system - called TransProse - generates simple piano pieces whose notes are dependent on the emotion words in the text," said Saif Mohammad, a computer scientist at the National Research Council Canada.
Along with Hannah Davis, who created TransProse as her master's thesis at New York University, Mohammad used the software to count the density of words associated with the eight basic emotions: anticipation, anger, joy, fear, disgust, sadness, surprise and trust, 'LiveScience' reported.
"It is the first system that automatically generates musical pieces based on the emotions in the text, and uses a novel mechanism to determine sequences of notes that capture the emotional activity in text," said Mohammad, who holds a bachelor's degree in Electronics Engineering from Vishwakarma Institute of Technology, University of Pune.
The algorithm uses databases to rate words according to their emotional value, thereby analysing sentiment in the text and gauging its "emotional temperature".
The algorithm works by splitting the book into four sections: the beginning, early middle, late middle and ending. Then, it generates an emotion profile for each part - a collection of various statistics about the presence of emotional words in the text, Mohammad said.
The researchers have used TransProse to measure the sentiment changes throughout a book, automatically generating music that reflects specific moods.
So far, the scientists have created musical soundtracks for several famous novels, including "Peter Pan" by JM Barrie, "A Clockwork Orange" by Anthony Burgess and "The Road" by Cormac McCarthy, among others.
*Subscribe to Business Standard digital and get complimentary access to The New York Times

Smart Quarterly

₹900

3 Months

₹300/Month

SAVE 25%

Smart Essential

₹2,700

1 Year

₹225/Month

SAVE 46%
*Complimentary New York Times access for the 2nd year will be given after 12 months

Super Saver

₹3,900

2 Years

₹162/Month

Subscribe

Renews automatically, cancel anytime

Here’s what’s included in our digital subscription plans

Exclusive premium stories online

  • Over 30 premium stories daily, handpicked by our editors

Complimentary Access to The New York Times

  • News, Games, Cooking, Audio, Wirecutter & The Athletic

Business Standard Epaper

  • Digital replica of our daily newspaper — with options to read, save, and share

Curated Newsletters

  • Insights on markets, finance, politics, tech, and more delivered to your inbox

Market Analysis & Investment Insights

  • In-depth market analysis & insights with access to The Smart Investor

Archives

  • Repository of articles and publications dating back to 1997

Ad-free Reading

  • Uninterrupted reading experience with no advertisements

Seamless Access Across All Devices

  • Access Business Standard across devices — mobile, tablet, or PC, via web or app

More From This Section

First Published: May 12 2014 | 3:26 PM IST

Next Story