Tools for Corpus Linguistics

A hopefully comprehensive list of currently 280 tools used in corpus compilation and analysis.

This list is kept up to date by its users. Hence, please feel free to contribute by suggesting new tools.

You can also make suggestions, e.g., corrections, regarding individual tools by clicking the symbol. As this is a non-commercial side (side, side) project, checking and incorporating updates usually takes some time.

Suggest a Tool

Top 25 Tags

All Tags
concordancer 47
annotation 43
visualization 29
tagging 20
text analysis 20
pos tagger 18
wordlists 16
statistics 12
compilation 11
keywords 11
collocation 10
qda 10
readability 8
lexis 8
parser 8
tokenizer 8
frequency analysis 7
language learning 6
analysis 6
web-based 6
mixed methods 6
spoken 6
crawler 5
language teaching 5
xml 5

There is also a comprehensive list of all tags in the database.


Tools [tokenizer]

Tool Description Tags Platforms Pricing
jTokenizer Tokenizing natural languagetokenizerFree
Natural Language Toolkit Platform for building Python programs to work with human language datatokenizer, taggerUnix, Mac, Windows (+Python 3.4)Free
SoMaJo A tokenizer and sentence splitter for German and English web and social media texts.tokenizer, sentence boundary detectorLinux, Mac, WindowsFree, Open Source
Tweet NLP Tweet tokenizer, PoS Tagger, hierarchical word clusters, and a dependency parser for tweets, along with annotated corpora and web-based annotation tools. Clusters: http://www.cs.cmu.edu/~ark/TweetNLP/cluster_viewer.html pos tagger, tokenizer, parserFree
TXM XML & TEI compatible text analysis software based on TreeTagger, the CQP search engine and the R statistical environment.text analysis, concordancer, r, statistics, search tool, tokenizer, xmlWindows,Mac,Linux,TomcatFree
Unitok An annotation-aware tokenizer that splits text into line-by-line tokens.tokenizerFree
YACSI Chinese Tokeniser / PoS Tagger A Chinese tokenizer and PoS taggerchinese, tokenizer, pos taggerWindowsFree
Word Frequency Analyser A web-based tool for analyzing word frequencies that also produces frequency charts and word clouds.pos tagger, tokenizer, lemmatizer, frequency analysisWebFree

Last Updated: February 29, 2024.

In case you are interested, the data is also available in JSON format.