分词器
快来分享你的内容吧～
IK分词器安装
<html> <head></head> <body> <div class="content ql-editor"> <h2>安装步骤</h2> <p><span style="font-size: 1.5em; font-family: PingFangSC-Regular;"><br></span></p> <p>gitee地址：https://gitee.com/star8521/elasticsearch-analysis-ik/tree/7.x/</p> <p><br></p> <p>1. 先clone下ik分词器的工程</p> <p><br></p> <p>2. 在本地根据es的版本切换分支，master是8.x，本地是7.16.3版本，所以checkout 7.x分支</p> <p><br></p> <p>3. 然后修改pom.xml文件的es版本，必须和本地保持一致，不然启动报错</p> <p><br></p> <p>4. 然后mvn package，打包后会生成一个zip包（target\releases\elasticsearch-analysis-ik-7.16.3.zip）</p> <p><br></p> <p>5. 复制到本地es的plugins目录下，解压zip包，并且重命名为ik</p> <p><br></p> <p>6. 重启es服务</p> <p><br></p> <p>7. 可以利用kinbana的devtools工具进行测试</p> <p><br></p> <p><br></p> <h2>测试中文分词</h2> <p><br></p> <div class="ql-code-block-container"> <div class="ql-code-block"><br> </div> <div class="ql-code-block"> POST /_analyze </div> <div class="ql-code-block"> <span class="ql-token hljs-punctuation">{</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"analyzer":</span> <span class="ql-token hljs-string">"ik_max_word",</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"text":</span> <span class="ql-token hljs-string">"计算机科学"</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-punctuation">}</span> </div> <div class="ql-code-block"><br> </div> </div> <p><br></p> <div class="ql-code-block-container"> <div class="ql-code-block"><br> </div> <div class="ql-code-block"> <span class="ql-token hljs-punctuation">{</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"tokens"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-punctuation">[</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-punctuation">{</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"token"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-string">"计算机",</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"start_offset"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-number">0,</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"end_offset"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-number">3,</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"type"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-string">"CN_WORD",</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"position"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-number">0</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-punctuation">},</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-punctuation">{</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"token"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-string">"计算",</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"start_offset"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-number">0,</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"end_offset"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-number">2,</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"type"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-string">"CN_WORD",</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"position"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-number">1</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-punctuation">},</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-punctuation">{</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"token"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-string">"算机",</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"start_offset"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-number">1,</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"end_offset"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-number">3,</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"type"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-string">"CN_WORD",</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"position"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-number">2</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-punctuation">},</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-punctuation">{</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"token"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-string">"科学",</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"start_offset"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-number">3,</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"end_offset"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-number">5,</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"type"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-string">"CN_WORD",</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-attr">"position"</span> <span class="ql-token hljs-punctuation">:</span> <span class="ql-token hljs-number">3</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-punctuation">}</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-punctuation">]</span> </div> <div class="ql-code-block"> <span class="ql-token hljs-punctuation">}</span> </div> </div> <p><br></p> <p><br></p> <p><br></p> </div> </body> </html>