Explicit Semantic Analysis (ESA)

I often receive requests for the implementation of Explicit Semantic Analysis, so I thought to put together a Web page about it :) At the moment, we do not release the actual source code, as we do not have resources to properly maintain it. Most of the algorithms should be covered in our papers. Below I list a few publicly available ESA implementations in the hope they might be useful for you.

By the way, my Wikipedia preprocessing code (WikiPrep) is available here.

Publicly available implementations

References

  1. Evgeniy Gabrilovich and Shaul Markovitch
    "Wikipedia-based Semantic Interpretation for Natural Language Processing."
    Journal of Artificial Intelligence Research, 34:443–498, 2009
    [PDF]

  2. Evgeniy Gabrilovich and Shaul Markovitch
    "Computing Semantic Relatedness using Wikipedia-based Explicit Semantic Analysis"
    Proceedings of The 20th International Joint Conference on Artificial Intelligence (IJCAI), Hyderabad, India, January 2007
    [Abstract / PDF]

  3. Evgeniy Gabrilovich and Shaul Markovitch
    "Overcoming the Brittleness Bottleneck using Wikipedia: Enhancing Text Categorization with Encyclopedic Knowledge"
    Proceedings of The 21st National Conference on Artificial Intelligence (AAAI), pp. 1301-1306, Boston, July 2006
    [Abstract / PDF]

  4. Evgeniy Gabrilovich
    "Feature Generation for Textual Information Retrieval Using World Knowledge"
    PhD Thesis, Technion - Israel Institute of Technology, Haifa, Israel, December 2006
    [Abstract / PDF]


Evgeniy Gabrilovich
gabr@cs.technion.ac.il

Last updated on January 27, 2016