Tutorial (Stopwords for nagisa)

How to use stopwords for nagisa

This tutorial provides how to use stopwords for Japanese text in nagisa.

Install python libraries

Before we get started, please run the following command to install the libraries used in this tutorial.

pip install nagisa

Get stopwords

Nagisa provides a built-in Japanese stopwords list. You can use nagisa.stopwords to easily filter out common Japanese stopwords (such as particles and auxiliary verbs) from tokenized results.

python tutorial_stopwords.py

tutorial_stopwords.py

import nagisa

text = "日本語のストップワードを簡単に利用できます。"
tokens = nagisa.tagging(text)
print(tokens.words)
# => ['日本', '語', 'の', 'ストップ', 'ワード', 'を', '簡単', 'に', '利用', 'でき', 'ます', '。']

# Filter out stopwords from the tokenized result
words = [word for word in tokens.words if word not in nagisa.stopwords]
print(words)
# => ['日本', '語', 'ストップ', 'ワード', '簡単', '利用', '。']