Watson wannabes: 4 open source projects for machine intelligence
2016.03.19 19:59
Watson wannabes: 4 open source projects for machine intelligence
Over the last year, as part of the new enterprise services that IBM has been pushing om its reinvention, Watson has become less of a "Jeopardy"-winning gimmick and more of a tool. It also remains IBM's proprietary creation.
What are the chances, then, of creating a natural-language machine learning system on the order of Watson, albeit with open source components? To some degree, this has already happened -- in part because Watson itself was built in top of existing open source work, and others have been developing similar systems in parallel to Watson. Here's a look at four such projects.
DARPA DeepDive
The biggest name brand of the bunch, DARPA's DeepDive project isn't meant to emulate Watson's plain-language query system, but rather Watson's ability to improve its decision-making over time with human guidance.
Developed principally by Christopher Re, a professor at the University of Wisconsin, the project is open source (Apache 2.0). According to EE Times, the main goal of DeepDive is to create an automated system for classifying unstructured data -- in one example case, categorizing articles in technical journals. Those planning to make use of DeepDive should be familiar with SQL and Python, but the system is already capable of extracting data from a wide variety of conventional sources, such as Web pages or PDF documents.
Apache UIMA
Unstructured Information Management (UIMA) is a standard for performing analysis on textual content. Watson used an implementation of UIMA, but you don't have to go through Watson to use UIMA. In fact, IBM's UIMA architecture was open-sourced and is being maintained by the Apache Foundation. It features support for multiple programming languages, with updates added periodically (most recently in October 2014).
Apache UIMA as it stands is a long way from being a full machine learning solution; it's only one -- albeit an important -- part of the whole that IBM created. If you don't want to use the bare bones, you can pick up one of its derivative projects, such as YodaQA, which leverages UIMA for its processing and uses Wikipedia as a primary data source.
OpenCog
OpenCog "aims to provide research scientists and software developers with a common platform to build and share artificial intelligence programs." Open-sourced under the GNU Affero license, the project's ambition is to fuel nothing less than what its creators call "generally intelligent" systems, artificial intelligence that has broad, humanlike understandings of the world instead of domain-centered specialties (such as being very good at chess but nothing else).
OpenCog's creators claim their framework is already in use in "natural language applications, both for research and by commercial corporations." That puts it a little further away from pie-in-the-sky AI concepts and closer to the practical Q&A domain inhabited by Watson.
OAQA (Open Advancement of Question Answering Systems)
As the name might imply, OAQA's mission is "open advancement in the engineering of question answering systems -- language software systems that provide direct answers to questions posed in natural language." Sound like one of Watson's aims? Yup, especially since the OAQA was jointly initiated by IBM and Carnegie Mellon University. Like Apache UIMA, OAQA implements the UIMA framework, but don't think of it as a ready-to-use solution; it's a toolkit.
The one major drawback to each project, as you can guess, is that they're not offered in nearly as refined or polished a package as Watson. Whereas Watson is designed to be used immediately in a business context, these are raw toolkits that require heavy lifting.
Plus, Watson's services have already been pre-trained with a curated body of real-world data. With these systems, you'll have to supply the data sources, which may prove to be a far bigger project than the programming itself.
광고 클릭에서 발생하는 수익금은 모두 웹사이트 서버의 유지 및 관리, 그리고 기술 콘텐츠 향상을 위해 쓰여집니다.
