How can I make my own version of IBM Watson?

Answer Wiki

• Open Advancement of Question Answering Systems
• SeanTater/uncc2014watsonsim
• brmson/yodaqa
• Open Question Answering Platform
• AKSW/QA
• Aqualog
• SolrSherlock/SolrSherlock

3 Answers

Phillip Rhodes, worked at IBM

Answered Feb 2, 2014

Building a literal duplicate of Watson would be damn tough and cost a lot of money.  But you can do some similar things and get a start a few ways...

For an overview of how to build a "watson-like" you can start here:

https://www.ibm.com/developerwor...

For more on some of the Open Source software you would use to build something like Watson, look into NLP software, semantic knowledgebases, and reasoning software.  Some good starting points include:

http://opennlp.apache.org

http://uima.apache.org

GATE.ac.uk - index.html

Quepy: A Python framework to transform natural language questions to queries.

http://jena.apache.org

Watson also apparently used Prolog heavily, so you might want to look into Prolog resources. I cataloged a few here a  while back:

Prolog? I'm Going To Learn Prolog??

For some interesting research on interacting with natural language queries, see:

http://start.csail.mit.edu

And you might also look at another project that bills itself as "an open source wolfram alpha", here:

SymPy Gamma


Be prepared to invest quite a lot of time and energy.

4.1k Views · 21 Upvotes · View Timeline

Upvote21Downvote

Comments2+

Share

Promoted by VisionMobile

Are you coding for AR/VR?

Take this developer survey and let us know what is your primary coding language.

Start now at s.developereconomics.com

경축! 아무것도 안하여 에스천사게임즈가 새로운 모습으로 재오픈 하였습니다.
어린이용이며, 설치가 필요없는 브라우저 게임입니다.
https://s1004games.com

Gary Miller, Software Developer, Business Intelligence Architect, AI Researcher

Answered Feb 10, 2015

This book contains a lot of the prerquisite knowledge needed to get started.

It covers the front end search portion.

Taming Text: How to Find, Organize, and Manipulate It: Grant S. Ingersoll, Thomas S. Morton, Andrew L. Farris: 9781933988382: Amazon.com: Books

I would follow this up though with resources on interfacing PROLOG with database using a Fuzzy model.

I haven't read this one yet due to its cost but going through the table of contents this one should be high on your list.

Knowledge Management in Fuzzy Databases (Studies in Fuzziness and Soft Computing): Olga Pons, Maria A. Vila: 9783540668367: Amazon.com: Books

You won't be able to get enough performance out of the high end PC to do a large knowledge base.  So you'll  probably want to plan on a high end PC cluster so that you can scale your solution.  Many existing programming languages do not do distributed comping without a lot of complex software infrastructure.  Since NOSQL  already provides you a way of scaling your knowledge out access multiple nodes as documents, I would recommend one of these as a scalable data storage mechanism.

1k Views · View Timeline

UpvoteDownvote

Comment

Share

Jack Park, Startup entrepreneur: knowledge gardens

Updated Feb 11, 2015

I think that's a question which is being answered in a variety of places. Actually, not an open source version of Watson in any literal sense, but there are open source projects, which include:

OAQA which is a student project actually associated with Watson
Watsonsim another student project
YodaQA -- I built and played with this one
AKSW OpenQA
AKSW QA
AquaLog
and my own OpenSherlock (was SolrSherlock).

Most of those are at GitHub or elsewhere on the web. OpenSherlock has not really found its way to GitHub, though early components of it are at GitHub under the old name SolrSherlock. Update: OpenSherlock now has its own repo: OpenSherlock

There are many papers and slides online about those various projects. One slidedeck for SolrSherlock is here
SolrSherlock: Linkfinding among Biomolecules with Literature-based Di…
and at the end of this month, a slidedeck for a conference talk about OpenSherlock will be at my slideshare account (root of the above link).

My experience with YodaQA is interesting: it's UIMA based, uses Solr for indexing Wikipedia, and uses Fuseki for indexing DbPedia and Yago, then answers questions.  It took me a while to bring it up on a Windows platform (used Cygwin for parts of it). In terms of question answering, it, and perhaps most of the open source so-called "cognitive systems" are not particularly accurate. I believe that's simply because a year or so of open source experiments is no match for the zillions of person-years invested by IBM in Watson. That's not to say open source won't rise to the occasion; I believe it will.

I did not mention:
OpenCog
DeepDive

earlier because they are not strictly question-answering platforms; but they each include powerful tools very useful in such a project; DeepDive does have an app written on it that approaches question answering.

1.8k Views · 5 Upvotes · View Timeline

[출처] https://www.quora.com/How-can-I-make-my-own-version-of-IBM-Watson