Word Lens
   HOME

TheInfoList



OR:

Word Lens was an
augmented reality Augmented reality (AR), also known as mixed reality (MR), is a technology that overlays real-time 3D computer graphics, 3D-rendered computer graphics onto a portion of the real world through a display, such as a handheld device or head-mounted ...
translation application from Quest Visual. Word Lens used the built-in cameras on smartphones and similar devices to quickly scan and identify foreign text (such as that found in a sign or a menu), and then translated and displayed the words in another language on the device's display. The words were displayed in the original context on the original background, and the translation was performed in real-time without a connection to the internet. For example, using the viewfinder of a camera to show a shop sign on a smartphone's display would result in a real-time image of the shop sign being displayed, but the words shown on the sign would be the translated words instead of the original foreign words. Until early 2015, the application was available for the
Apple An apple is a round, edible fruit produced by an apple tree (''Malus'' spp.). Fruit trees of the orchard or domestic apple (''Malus domestica''), the most widely grown in the genus, are agriculture, cultivated worldwide. The tree originated ...
's
iPhone The iPhone is a line of smartphones developed and marketed by Apple that run iOS, the company's own mobile operating system. The first-generation iPhone was announced by then–Apple CEO and co-founder Steve Jobs on January 9, 2007, at ...
,
iPod The iPod is a series of portable media players and multi-purpose mobile devices that were designed and marketed by Apple Inc. from 2001 to 2022. The iPod Classic#1st generation, first version was released on November 10, 2001, about mon ...
, and
iPad The iPad is a brand of tablet computers developed and marketed by Apple Inc., Apple that run the company's mobile operating systems iOS and later iPadOS. The IPad (1st generation), first-generation iPad was introduced on January 27, 2010. ...
, as well as for a selection of Android smartphones. The application was free on Apple's
iTunes iTunes is a media player, media library, and mobile device management (MDM) utility developed by Apple. It is used to purchase, play, download and organize digital multimedia on personal computers running the macOS and Windows operating s ...
, but an in-app purchase was necessary to enable translation capabilities. On
Google Play Google Play, also known as the Google Play Store, Play Store, or sometimes the Android Store (and was formerly Android Market), is a digital distribution service operated and developed by Google. It serves as the official app store for certifie ...
, there were both the free demo and the full translation-enabled versions of the application. At
Google Google LLC (, ) is an American multinational corporation and technology company focusing on online advertising, search engine technology, cloud computing, computer software, quantum computing, e-commerce, consumer electronics, and artificial ...
's unveiling of its Glass Development Kit in November 2013, translation capabilities of Word Lens were also demonstrated on
Google Glass Google Glass, or simply Glass, is a discontinued brand of smart glasses developed by Google's X Development (formerly Google X), with a mission of producing a ubiquitous computer. Google Glass displays information to the wearer using a head-u ...
. According to the January 2014 ''
New York Times ''The New York Times'' (''NYT'') is an American daily newspaper based in New York City. ''The New York Times'' covers domestic, national, and international news, and publishes opinion pieces, investigative reports, and reviews. As one of ...
'' article, Word Lens was free for Google Glass.
Google Google LLC (, ) is an American multinational corporation and technology company focusing on online advertising, search engine technology, cloud computing, computer software, quantum computing, e-commerce, consumer electronics, and artificial ...
acquired Quest Visual on May 16, 2014 in order to incorporate Word Lens into its
Google Translate Google Translate is a multilingualism, multilingual neural machine translation, neural machine translation service developed by Google to translation, translate text, documents and websites from one language into another. It offers a web applic ...
service. As a result, all Word Lens language packs were available free of charge until January 2015. The details of the acquisition have not been released. Word Lens feature was incorporated into the
Google Translate Google Translate is a multilingualism, multilingual neural machine translation, neural machine translation service developed by Google to translation, translate text, documents and websites from one language into another. It offers a web applic ...
app and released on January 14, 2015.


Application

Word Lens is an
augmented reality Augmented reality (AR), also known as mixed reality (MR), is a technology that overlays real-time 3D computer graphics, 3D-rendered computer graphics onto a portion of the real world through a display, such as a handheld device or head-mounted ...
application that recognizes printed words using its
optical character recognition Optical character recognition or optical character reader (OCR) is the electronics, electronic or machine, mechanical conversion of images of typed, handwritten or printed text into machine-encoded text, whether from a scanned document, a photo ...
capabilities and instantly translates these words into the desired language. This application does not require connection to the internet. In its default mode, Word Lens performs real-time translation, but can be paused to display a single frame or to look up alternative translations of each specific word in that frame. It is also possible to use the built-in dictionary to manually type in words that need to be translated. ''Word Lens 1.0'' was released on December 16, 2010, and received significant amount of attention soon after, including ''
Wired Wired may refer to: Arts, entertainment, and media Music * ''Wired'' (Jeff Beck album), 1976 * ''Wired'' (Hugh Cornwell album), 1993 * ''Wired'' (Mallory Knox album), 2017 * "Wired", a song by Prism from their album '' Beat Street'' * "Wired ...
'', ''
The Economist ''The Economist'' is a British newspaper published weekly in printed magazine format and daily on Electronic publishing, digital platforms. It publishes stories on topics that include economics, business, geopolitics, technology and culture. M ...
'',
CNN Cable News Network (CNN) is a multinational news organization operating, most notably, a website and a TV channel headquartered in Atlanta. Founded in 1980 by American media proprietor Ted Turner and Reese Schonfeld as a 24-hour cable ne ...
, ''
the New York Times ''The New York Times'' (''NYT'') is an American daily newspaper based in New York City. ''The New York Times'' covers domestic, national, and international news, and publishes opinion pieces, investigative reports, and reviews. As one of ...
'', ''
Forbes ''Forbes'' () is an American business magazine founded by B. C. Forbes in 1917. It has been owned by the Hong Kong–based investment group Integrated Whale Media Investments since 2014. Its chairman and editor-in-chief is Steve Forbes. The co ...
'', ''
the Wall Street Journal ''The Wall Street Journal'' (''WSJ''), also referred to simply as the ''Journal,'' is an American newspaper based in New York City. The newspaper provides extensive coverage of news, especially business and finance. It operates on a subscriptio ...
'',
MIT The Massachusetts Institute of Technology (MIT) is a private research university in Cambridge, Massachusetts, United States. Established in 1861, MIT has played a significant role in the development of many areas of modern technology and sc ...
Technology Review ''MIT Technology Review'' is a bimonthly magazine wholly owned by the Massachusetts Institute of Technology. It was founded in 1899 as ''The Technology Review'', and was re-launched without "''The''" in its name on April 23, 1998, under then pu ...
, and ~2.5 million views on
YouTube YouTube is an American social media and online video sharing platform owned by Google. YouTube was founded on February 14, 2005, by Steve Chen, Chad Hurley, and Jawed Karim who were three former employees of PayPal. Headquartered in ...
in the first 6 days. Since the application held a No. 1 position on the lists of ''Top Free Apps'' and ''Top Grossing Apps'' on
iTunes iTunes is a media player, media library, and mobile device management (MDM) utility developed by Apple. It is used to purchase, play, download and organize digital multimedia on personal computers running the macOS and Windows operating s ...
for the few days following its release, it is currently described as ''Top In App Purchases''. In 2014, Word Lens was featured in the
Apple An apple is a round, edible fruit produced by an apple tree (''Malus'' spp.). Fruit trees of the orchard or domestic apple (''Malus domestica''), the most widely grown in the genus, are agriculture, cultivated worldwide. The tree originated ...
ad for iPhone 5Sbr>''Powerful''
This application is currently available as ''Word Lens 2.2.3''.


Supported devices

Word Lens requires
iPhone The iPhone is a line of smartphones developed and marketed by Apple that run iOS, the company's own mobile operating system. The first-generation iPhone was announced by then–Apple CEO and co-founder Steve Jobs on January 9, 2007, at ...
3GS+,
iPod Touch The iPod Touch (stylized as iPod touch) is a discontinued line of iOS-based mobile devices designed and formerly marketed by Apple Inc. with a touchscreen-controlled user interface. As with other iPod models, the iPod Touch can be used as a po ...
with a video camera,
iPad 2 The iPad 2 is a tablet computer, tablet developed and marketed by Apple Inc. Compared to IPad (1st generation), the first iPad, as the second model in the iPad line, it gained a faster multi-core processor, dual core Apple A5, A5 processor, a ...
+, or any
iPad Mini The iPad Mini (branded and marketed as iPad mini) is a line of small tablet computers developed and marketed by Apple Inc. It is a sub-series of the iPad line of tablets, with screen sizes of 7.9 inches and 8.3 inches. The first-generation ...
. In 2012, Word Lens was released for a selection of Android smartphones. In 2013, Word Lens became available for
Google Glass Google Glass, or simply Glass, is a discontinued brand of smart glasses developed by Google's X Development (formerly Google X), with a mission of producing a ubiquitous computer. Google Glass displays information to the wearer using a head-u ...
, even though Google Glass itself is not yet freely available.


Supported languages

At the release, only English-to-Spanish and Spanish-to-English were supported, but other language dictionaries were planned, with European languages expected first. English-to-French and French-to-English were released on December 14, 2011. In 2012, English-to-Italian and Italian-to-English were added, followed by English-to-German / German-to-English and English-to-Portuguese / Portuguese-to-English in 2013, and English-to-Russian / Russian-to-English in 2014. Since the acquisition by Google in May 2014, all previously released language packs can be downloaded for free. It was also speculated that through incorporation into
Google Translate Google Translate is a multilingualism, multilingual neural machine translation, neural machine translation service developed by Google to translation, translate text, documents and websites from one language into another. It offers a web applic ...
, Word Lens would be extended to "broad language coverage and translation capabilities in the future".


Accuracy

According to its description, Word Lens is best used on clearly printed text and was not designed to translate handwritten or stylized fonts. This application was created to help tourists understand signs and menus, and it is not 100% accurate. The developer Otavio Good commented: "I will be the first to say that it’s not perfect, but perfect was not the goal". However, testers who took the app to other countries said it had been useful. Further, even though the application was not designed to read books, the ''
Wall Street Journal ''The Wall Street Journal'' (''WSJ''), also referred to simply as the ''Journal,'' is an American newspaper based in New York City. The newspaper provides extensive coverage of news, especially business and finance. It operates on a subscriptio ...
'' journalist Ben Rooney managed to understand a page from ''Harry Potter y el Prisionero de Azkaban''.


Developers

Word Lens was developed by Otavio Good, a former video game developer and the founder of Quest Visual, John DeWeese, who previously worked on the
Electronic Arts Electronic Arts Inc. (EA) is an American video game company headquartered in Redwood City, California. Founded in May 1982 by former Apple Inc., Apple employee Trip Hawkins, the company was a pioneer of the early home computer game industry ...
game ''
Spore In biology, a spore is a unit of sexual reproduction, sexual (in fungi) or asexual reproduction that may be adapted for biological dispersal, dispersal and for survival, often for extended periods of time, in unfavourable conditions. Spores fo ...
'', and programmers Maia Good, Bryan Lin and Eric Park. A U.S. patent application on the technology was filed by the company in 2010 (based on a year-earlier provisional patent application), naming Good as inventor, but went abandoned for failure to respond to a Patent Office action. The application was published a
US20110090253


Competition

The
Google Goggles Google Goggles was an image recognition mobile app developed by Google. It was used for searches based on pictures taken by handheld devices. For example, taking a picture of a famous landmark searches for information about it, or taking a pictu ...
application for Android and
iPhone The iPhone is a line of smartphones developed and marketed by Apple that run iOS, the company's own mobile operating system. The first-generation iPhone was announced by then–Apple CEO and co-founder Steve Jobs on January 9, 2007, at ...
has the capability to translate text or identify objects in an image, but it requires users to take a picture with their phones, and an active internet connection. Word Lens does it on the fly, meaning it's interpreting frames in video, almost in real time. A similar app called LookTel, designed to help blind people, scans print on objects such as packages of food and reads them aloud."


Reviews

Articles in the ''
Wall Street Journal ''The Wall Street Journal'' (''WSJ''), also referred to simply as the ''Journal,'' is an American newspaper based in New York City. The newspaper provides extensive coverage of news, especially business and finance. It operates on a subscriptio ...
'' and '' Tom's Guide'' cited Clarke's third law describing Word Lens: "Any sufficiently advanced technology is indistinguishable from magic". ''
The New York Times ''The New York Times'' (''NYT'') is an American daily newspaper based in New York City. ''The New York Times'' covers domestic, national, and international news, and publishes opinion pieces, investigative reports, and reviews. As one of ...
'' journalist
David Pogue David Welch Pogue (born March 9, 1963) is an American technology and science writer and TV presenter, and correspondent for ''CBS News Sunday Morning''. He has hosted 18 ''Nova'' specials on PBS, including '' Nova ScienceNow'', the ''Making Stu ...
included Word Lens in his list of "the best tech ideas of the year" 2010 (10 ideas total). In the ''
Wall Street Journal ''The Wall Street Journal'' (''WSJ''), also referred to simply as the ''Journal,'' is an American newspaper based in New York City. The newspaper provides extensive coverage of news, especially business and finance. It operates on a subscriptio ...
'' article by Ben Rooney, Word Lens received a rating of 4/5 and was described as "a sort of magic". Word Lens was chosen as a finalist for the 2010
Crunchies The Crunchies was an industry award given out from 2007 to 2017 by several technology blogs to the Silicon Valley companies and venture capitalists they cover. The awards have been sponsored and co-hosted by blogs such as GigaOm, TechCrunch, Ven ...
br>Best Technology Achievement award
Ellen of ''
The Ellen DeGeneres Show ''The Ellen DeGeneres Show'' is an American first-run syndicated talk show that was hosted by Ellen DeGeneres. The show ran for nineteen seasons from September 8, 2003, to May 26, 2022, in which it broadcast 3,339 episodes. It was produced by ...
'' demoed Word Lens and referred to it as "amazing" in her segmen
Ellen Found the Best Apps!
Otavio Good won th
2012
Netexplo award in the category ''Innovation & Technology'' presented at the
UNESCO The United Nations Educational, Scientific and Cultural Organization (UNESCO ) is a List of specialized agencies of the United Nations, specialized agency of the United Nations (UN) with the aim of promoting world peace and International secur ...
headquarters for the creation of Word Lens. ''
The New York Times ''The New York Times'' (''NYT'') is an American daily newspaper based in New York City. ''The New York Times'' covers domestic, national, and international news, and publishes opinion pieces, investigative reports, and reviews. As one of ...
'' App Smart columnist Kit Eaton included Word Lens into his list of favorite apps.


History of updates

''Table updated on April 23, 2014 based on refs.''


See also

*
Augmented reality Augmented reality (AR), also known as mixed reality (MR), is a technology that overlays real-time 3D computer graphics, 3D-rendered computer graphics onto a portion of the real world through a display, such as a handheld device or head-mounted ...
*
Optical character recognition Optical character recognition or optical character reader (OCR) is the electronics, electronic or machine, mechanical conversion of images of typed, handwritten or printed text into machine-encoded text, whether from a scanned document, a photo ...
*
Google Translate Google Translate is a multilingualism, multilingual neural machine translation, neural machine translation service developed by Google to translation, translate text, documents and websites from one language into another. It offers a web applic ...


References

{{reflist, 2


External links


Quest Visual homepage

Original video demonstration of Word Lens
* Otavio Goo
explains
Word Lens 1.0 * Otavio Goo
explains
Word Lens 1.0.1 (interview with
Reuters Reuters ( ) is a news agency owned by Thomson Reuters. It employs around 2,500 journalists and 600 photojournalists in about 200 locations worldwide writing in 16 languages. Reuters is one of the largest news agencies in the world. The agency ...
)
Independent demo of Word Lens
*
Apple An apple is a round, edible fruit produced by an apple tree (''Malus'' spp.). Fruit trees of the orchard or domestic apple (''Malus domestica''), the most widely grown in the genus, are agriculture, cultivated worldwide. The tree originated ...
a
''Powerful''
featuring Word Lens for iPhone 5S Discontinued iOS software Photo software Android (operating system) software Translation software Augmented reality applications