際際滷

際際滷Share a Scribd company logo
Introduction to Japanese Morphological Analysis
?
?
?
?
Introduction to Japanese Morphological Analysis
% echo | mecab
, , , ,*,*, , ,
, , ,*,*,*, , ,
, , ,*,*,*, , ,
, ,*,*, , , , ,
EOS
?
?
Introduction to Japanese Morphological Analysis
Introduction to Japanese Morphological Analysis
Input
Dictionary
Input
Dictionary
Input common_pre?x_search( )
Dictionary
Input common_pre?x_search( )
Dictionary
Input common_pre?x_search( )
Dictionary
Input common_pre?x_search( )
Dictionary
Input common_pre?x_search( )
Dictionary
Input common_pre?x_search( )
not matched
Dictionary
Input
?
?
3 1 6,7
25 4
Dictionary
?
?
3 1 6,7
25 4
Dictionary
common_pre?x_search( )
Introduction to Japanese Morphological Analysis
?
?
?
Generating cost (Dictionary)
Connecting cost
21356245
3003 9428
-310
-283
-9617
-386
1285, 1285
1293, 1293 1303, 1303
0
1293, 1293
Generating cost (Dictionary)
Connecting cost
21356245
3003 9428
-310
-283
-9617
-386
1285, 1285
1293, 1293 1303, 1303
0
1293, 1293
7729
2504
% echo | mecab -F "%m,%Hnt%phl,%phr,%pw,%pC,%pcn" -N2
, , , , ,*,*, , ,
1293,1293,3003,-310,2693
, , , ,*,*,*, , ,
1303,1303,9428,-9617,2504
EOS
, , ,*,*,*,*, , ,
1285,1285,6245,-283,5962
, , , , ,*,*, , ,
1293,1293,2135,-368,7729
EOS
○ left context, right context, generating cost,
connecting cost, cumulative cost
?
?
?
?
Introduction to Japanese Morphological Analysis
?
?
?
?

More Related Content

Viewers also liked (20)

PPTX
On Similarities Between Japanese and Other Languages
Graspingfish
?
PPTX
Japanese phonology
Haider Almansury
?
PDF
赫姻看看稼乙温の書朔への豚棋
Naoya Murakami
?
PDF
赫姻看看稼乙温の府初と並箭府初
Naoya Murakami
?
PDF
檎のデ`タ更夛とメモリ砿尖
Takeshi Arabiki
?
PDF
NLPforml5
Hidekazu Oiwa
?
PPTX
ACL 2014 iみ氏
xzhaoxx
?
PDF
CRF を聞った Web 云猟渇竃 for WebDB Forum 2011
Shuyo Nakatani
?
PPTX
Differences between Japanese and English
Cashie Cheer
?
PDF
檎ではじめる意敬庄岳岳艶姻盾裂
Takeshi Arabiki
?
PDF
狼双ラベリングの児粥
Takatomo Isikawa
?
PDF
Prml Reading Group 10 8.3
屎崗 萄梳
?
PDF
Web云猟渇竃 using crf
Shuyo Nakatani
?
PDF
Zipf? (ジップtのひみつ) #DSIRNLP
Shuyo Nakatani
?
PPTX
Language Comparison (Korean, Japanese and English)
MIN KYUNG LEE
?
PPTX
Difference between English and Nihongo
Lyka Cuecaco
?
PPTX
掘馨稼鉛沿iみ氏彿創
Jiro Nishitoba
?
PDF
秘壇徭隼冱囂I尖秘壇
Hiromu Shioya
?
PPTX
EMNLP 2015 yomikai
Yo Ehara
?
PDF
徭隼冱囂I尖のための字亠僥楼秘壇1嫗
Hiroki Mizukami
?
On Similarities Between Japanese and Other Languages
Graspingfish
?
Japanese phonology
Haider Almansury
?
赫姻看看稼乙温の書朔への豚棋
Naoya Murakami
?
赫姻看看稼乙温の府初と並箭府初
Naoya Murakami
?
檎のデ`タ更夛とメモリ砿尖
Takeshi Arabiki
?
NLPforml5
Hidekazu Oiwa
?
ACL 2014 iみ氏
xzhaoxx
?
CRF を聞った Web 云猟渇竃 for WebDB Forum 2011
Shuyo Nakatani
?
Differences between Japanese and English
Cashie Cheer
?
檎ではじめる意敬庄岳岳艶姻盾裂
Takeshi Arabiki
?
狼双ラベリングの児粥
Takatomo Isikawa
?
Prml Reading Group 10 8.3
屎崗 萄梳
?
Web云猟渇竃 using crf
Shuyo Nakatani
?
Zipf? (ジップtのひみつ) #DSIRNLP
Shuyo Nakatani
?
Language Comparison (Korean, Japanese and English)
MIN KYUNG LEE
?
Difference between English and Nihongo
Lyka Cuecaco
?
掘馨稼鉛沿iみ氏彿創
Jiro Nishitoba
?
秘壇徭隼冱囂I尖秘壇
Hiromu Shioya
?
EMNLP 2015 yomikai
Yo Ehara
?
徭隼冱囂I尖のための字亠僥楼秘壇1嫗
Hiroki Mizukami
?

More from Takeshi Arabiki (11)

PDF
蝕kの伉誼
Takeshi Arabiki
?
PDF
HTML5 Canvas で僥ぶアフィンQ
Takeshi Arabiki
?
PDF
Introduction to Favmemo for Immature Engineers
Takeshi Arabiki
?
PDF
檎のスコ`プとフレ`ムと桟廠と
Takeshi Arabiki
?
PDF
檎井赫艶岳看沿岳::晦看稼乙を恬ってみた
Takeshi Arabiki
?
PDF
檎デ`タフレ`ム徭喇徭壓
Takeshi Arabiki
?
PDF
HMM, MEMM, CRF メモ
Takeshi Arabiki
?
PDF
猟忖双カ`ネルによる看なしツイ`ト蛍 ?猟忖双カ`ネル秘T?
Takeshi Arabiki
?
PDF
檎デバッグあれこれ
Takeshi Arabiki
?
PDF
はじめてのまっぷりでゅ?す
Takeshi Arabiki
?
PDF
意敬庄岳岳艶姻のデ`タを檎であれこれ
Takeshi Arabiki
?
蝕kの伉誼
Takeshi Arabiki
?
HTML5 Canvas で僥ぶアフィンQ
Takeshi Arabiki
?
Introduction to Favmemo for Immature Engineers
Takeshi Arabiki
?
檎のスコ`プとフレ`ムと桟廠と
Takeshi Arabiki
?
檎井赫艶岳看沿岳::晦看稼乙を恬ってみた
Takeshi Arabiki
?
檎デ`タフレ`ム徭喇徭壓
Takeshi Arabiki
?
HMM, MEMM, CRF メモ
Takeshi Arabiki
?
猟忖双カ`ネルによる看なしツイ`ト蛍 ?猟忖双カ`ネル秘T?
Takeshi Arabiki
?
檎デバッグあれこれ
Takeshi Arabiki
?
はじめてのまっぷりでゅ?す
Takeshi Arabiki
?
意敬庄岳岳艶姻のデ`タを檎であれこれ
Takeshi Arabiki
?
Ad

Introduction to Japanese Morphological Analysis