Text Processing on 中文AI术语词典https://terms-en.ai-term-hub.com/zh/tags/text-processing/Recent content in Text Processing on 中文AI术语词典Hugozh-cnSat, 18 Jul 2026 11:44:45 +0000序列标注https://terms-en.ai-term-hub.com/zh/terms/sequence_labeling/Sat, 18 Jul 2026 11:33:18 +0000https://terms-en.ai-term-hub.com/zh/terms/sequence_labeling/<h2 id="definition">Definition</h2> <p>序列标注涉及为给定输入序列中的每个标记预测分类标签，例如句子中的单词或字符串中的字符。常见的应用包括词性标注、命名实体识别和句法分块。</p> <h3 id="summary">Summary</h3> <p>一种自然语言处理任务，为输入序列中的每个元素分配一个标签。</p> <h2 id="key-concepts">Key Concepts</h2> <ul> <li>标记分类</li> <li>上下文依赖</li> <li>双向编码</li> <li>条件随机场层</li> </ul> <h2 id="use-cases">Use Cases</h2> <ul> <li>命名实体识别</li> <li>词性标注</li> <li>句法分块</li> </ul> <h2 id="related-terms">Related Terms</h2> <ul> <li><a href="https://terms-en.ai-term-hub.com/en/terms/nlp-%E8%87%AA%E7%84%B6%E8%AF%AD%E8%A8%80%E5%A4%84%E7%90%86/">NLP (自然语言处理)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/transformer/">Transformer</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/bilstm-%E5%8F%8C%E5%90%91%E9%95%BF%E7%9F%AD%E6%9C%9F%E8%AE%B0%E5%BF%86%E7%BD%91%E7%BB%9C/">BiLSTM (双向长短期记忆网络)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/crf-%E6%9D%A1%E4%BB%B6%E9%9A%8F%E6%9C%BA%E5%9C%BA/">CRF (条件随机场)</a></li> </ul>通义千问编辑功能https://terms-en.ai-term-hub.com/zh/terms/qwen_edit/Sat, 18 Jul 2026 11:31:25 +0000https://terms-en.ai-term-hub.com/zh/terms/qwen_edit/<h2 id="definition">Definition</h2> <p>通义千问编辑指的是通义千问系列中针对编辑、润色和重构文本内容的特定功能或模型迭代。这些能力允许用户重写、优化和结构化文本，以提升清晰度和专业性。</p> <h3 id="summary">Summary</h3> <p>通义千问编辑（Qwen Edit）指通义千问生态中专注于文本和内容编辑的能力或模型模块。</p> <h2 id="key-concepts">Key Concepts</h2> <ul> <li>文本编辑</li> <li>内容润色</li> <li>语法纠正</li> <li>风格迁移</li> </ul> <h2 id="use-cases">Use Cases</h2> <ul> <li>学术论文校对</li> <li>营销文案重写</li> <li>会议纪要摘要与整理</li> </ul> <h2 id="related-terms">Related Terms</h2> <ul> <li><a href="https://terms-en.ai-term-hub.com/en/terms/qwen-%E9%80%9A%E4%B9%89%E5%8D%83%E9%97%AE/">Qwen (通义千问)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/text-summarization-%E6%96%87%E6%9C%AC%E6%91%98%E8%A6%81/">Text Summarization (文本摘要)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/nlp-editing-%E8%87%AA%E7%84%B6%E8%AF%AD%E8%A8%80%E5%A4%84%E7%90%86%E7%BC%96%E8%BE%91/">NLP Editing (自然语言处理编辑)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/grammarly-grammarly%E8%AF%AD%E6%B3%95%E6%A3%80%E6%9F%A5%E5%B7%A5%E5%85%B7/">Grammarly (Grammarly语法检查工具)</a></li> </ul>文本改写https://terms-en.ai-term-hub.com/zh/terms/paraphrasing/Sat, 18 Jul 2026 11:29:29 +0000https://terms-en.ai-term-hub.com/zh/terms/paraphrasing/<h2 id="definition">Definition</h2> <p>在自然语言处理中，文本改写涉及为给定的输入文本生成替代表达，同时保留其原始语义含义。这对于减少抄袭、增强数据多样性以及提高内容可读性至关重要，通常依赖于预训练的语言模型来实现高质量的语义等价转换。</p> <h3 id="summary">Summary</h3> <p>自然语言处理任务，旨在用不同的词汇或句式重写文本，同时保持原意不变。</p> <h2 id="key-concepts">Key Concepts</h2> <ul> <li>语义保留</li> <li>文本重写</li> <li>自然语言生成</li> <li>同义性</li> </ul> <h2 id="use-cases">Use Cases</h2> <ul> <li>抄袭检测与规避工具</li> <li>用于训练NLP模型的数据增强</li> <li>提高技术文档的可读性</li> </ul> <h2 id="related-terms">Related Terms</h2> <ul> <li><a href="https://terms-en.ai-term-hub.com/en/terms/%E6%96%87%E6%9C%AC%E6%91%98%E8%A6%81-text-summarization/">文本摘要 (Text Summarization)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/%E6%9C%BA%E5%99%A8%E7%BF%BB%E8%AF%91-machine-translation/">机器翻译 (Machine Translation)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/%E8%87%AA%E7%84%B6%E8%AF%AD%E8%A8%80%E5%A4%84%E7%90%86-nlp/">自然语言处理 (NLP)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/%E5%BA%8F%E5%88%97%E5%88%B0%E5%BA%8F%E5%88%97%E6%A8%A1%E5%9E%8B-sequence-to-sequence-models/">序列到序列模型 (Sequence-to-Sequence Models)</a></li> </ul>智能文字识别https://terms-en.ai-term-hub.com/zh/terms/intelligent_word_recognition/Sat, 18 Jul 2026 11:22:43 +0000https://terms-en.ai-term-hub.com/zh/terms/intelligent_word_recognition/<h2 id="definition">Definition</h2> <p>智能文字识别是指由神经网络驱动的高级光学字符识别（OCR）技术。它超越了简单的模式匹配，通过理解上下文并处理n</p> <h3 id="summary">Summary</h3> <p>利用人工智能算法（特别是深度学习）准确识别和解读来自图像或手写来源的文本。</p> <h2 id="key-concepts">Key Concepts</h2> <ul> <li>光学字符识别</li> <li>深度学习</li> <li>计算机视觉</li> <li>文本提取</li> </ul> <h2 id="use-cases">Use Cases</h2> <ul> <li>历史档案数字化</li> <li>发票自动化处理</li> <li>实时翻译应用</li> </ul> <h2 id="related-terms">Related Terms</h2> <ul> <li><a href="https://terms-en.ai-term-hub.com/en/terms/ocr-%E5%85%89%E5%AD%A6%E5%AD%97%E7%AC%A6%E8%AF%86%E5%88%AB/">OCR (光学字符识别)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/natural-language-processing-%E8%87%AA%E7%84%B6%E8%AF%AD%E8%A8%80%E5%A4%84%E7%90%86/">Natural Language Processing (自然语言处理)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/image-classification-%E5%9B%BE%E5%83%8F%E5%88%86%E7%B1%BB/">Image Classification (图像分类)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/handwriting-recognition-%E6%89%8B%E5%86%99%E8%AF%86%E5%88%AB/">Handwriting Recognition (手写识别)</a></li> </ul>字符计算https://terms-en.ai-term-hub.com/zh/terms/character_computing/Sat, 18 Jul 2026 11:09:54 +0000https://terms-en.ai-term-hub.com/zh/terms/character_computing/<h2 id="definition">Definition</h2> <p>这一概念侧重于文本操作，其中计算的基本单位是单个字符。它通常用于需要细粒度文本分析的任务，例如拼写检查。</p> <h3 id="summary">Summary</h3> <p>字符计算涉及在单个字符层面而非单词或句子层面处理、生成或分析文本。</p> <h2 id="key-concepts">Key Concepts</h2> <ul> <li>分词</li> <li>文本生成</li> <li>细粒度分析</li> <li>子词单元</li> </ul> <h2 id="use-cases">Use Cases</h2> <ul> <li>手写识别（OCR）</li> <li>低资源语言建模</li> <li>密文分析</li> </ul> <h2 id="related-terms">Related Terms</h2> <ul> <li><a href="https://terms-en.ai-term-hub.com/en/terms/token-%E8%AF%8D%E5%85%83/">Token (词元)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/nlp-%E8%87%AA%E7%84%B6%E8%AF%AD%E8%A8%80%E5%A4%84%E7%90%86/">NLP (自然语言处理)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/rnn-%E5%BE%AA%E7%8E%AF%E7%A5%9E%E7%BB%8F%E7%BD%91%E7%BB%9C/">RNN (循环神经网络)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/transformer-%E5%8F%98%E6%8D%A2%E5%99%A8%E6%9E%B6%E6%9E%84/">Transformer (变换器架构)</a></li> </ul>词袋模型https://terms-en.ai-term-hub.com/zh/terms/bag_of_words_model/Sat, 18 Jul 2026 11:08:27 +0000https://terms-en.ai-term-hub.com/zh/terms/bag_of_words_model/<h2 id="definition">Definition</h2> <p>这种自然语言处理技术将文本表示为单词的多重集， disregarding 句法和序列。它根据词频或存在性将文档转换为数值向量。</p> <h3 id="summary">Summary</h3> <p>词袋模型是一种简化的文本表示方法，描述文档中单词的出现情况，忽略语法和词序。</p> <h2 id="key-concepts">Key Concepts</h2> <ul> <li>分词</li> <li>频率统计</li> <li>向量空间</li> <li>特征提取</li> </ul> <h2 id="use-cases">Use Cases</h2> <ul> <li>文本分类</li> <li>垃圾邮件过滤</li> <li>信息检索</li> </ul> <h2 id="code-example">Code Example</h2> <div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-python" data-lang="python"><span style="display:flex;"><span><span style="color:#f92672">from</span> sklearn.feature_extraction.text <span style="color:#f92672">import</span> CountVectorizer </span></span><span style="display:flex;"><span>corpus <span style="color:#f92672">=</span> [<span style="color:#e6db74">&#34;Hello world&#34;</span>, <span style="color:#e6db74">&#34;World hello&#34;</span>] </span></span><span style="display:flex;"><span>vectorizer <span style="color:#f92672">=</span> CountVectorizer() </span></span><span style="display:flex;"><span>X <span style="color:#f92672">=</span> vectorizer<span style="color:#f92672">.</span>fit_transform(corpus) </span></span></code></pre></div><h2 id="related-terms">Related Terms</h2> <ul> <li><a href="https://terms-en.ai-term-hub.com/en/terms/tf-idf-%E8%AF%8D%E9%A2%91-%E9%80%86%E6%96%87%E6%A1%A3%E9%A2%91%E7%8E%87/">TF-IDF (词频-逆文档频率)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/n-grams-n%E5%85%83%E8%AF%AD%E6%B3%95/">N-grams (N元语法)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/word-embeddings-%E8%AF%8D%E5%B5%8C%E5%85%A5/">Word Embeddings (词嵌入)</a></li> </ul>文本摘要https://terms-en.ai-term-hub.com/zh/terms/summarization/Sat, 18 Jul 2026 11:02:04 +0000https://terms-en.ai-term-hub.com/zh/terms/summarization/<h2 id="definition">Definition</h2> <p>文本摘要将大量文本缩减为较短版本，而不丢失核心含义。它可以是抽取式的，即从源文本中选择重要句子；也可以是抽象式的，即生成新的概括性语句。</p> <h3 id="summary">Summary</h3> <p>一项自然语言处理任务，生成较长文本的简洁连贯摘要，同时保留其关键信息。</p> <h2 id="key-concepts">Key Concepts</h2> <ul> <li>抽取式摘要</li> <li>抽象式摘要</li> <li>信息密度</li> <li>连贯性</li> </ul> <h2 id="use-cases">Use Cases</h2> <ul> <li>新闻文章精简</li> <li>会议纪要生成</li> <li>法律文档审查</li> </ul> <h2 id="code-example">Code Example</h2> <div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-python" data-lang="python"><span style="display:flex;"><span><span style="color:#f92672">from</span> transformers <span style="color:#f92672">import</span> pipeline </span></span><span style="display:flex;"><span>summarizer <span style="color:#f92672">=</span> pipeline(<span style="color:#e6db74">&#34;summarization&#34;</span>) </span></span><span style="display:flex;"><span>result <span style="color:#f92672">=</span> summarizer(<span style="color:#e6db74">&#34;AI is transforming industries...&#34;</span>, max_length<span style="color:#f92672">=</span><span style="color:#ae81ff">50</span>, min_length<span style="color:#f92672">=</span><span style="color:#ae81ff">10</span>)[<span style="color:#ae81ff">0</span>][<span style="color:#e6db74">&#39;summary_text&#39;</span>] </span></span></code></pre></div><h2 id="related-terms">Related Terms</h2> <ul> <li><a href="https://terms-en.ai-term-hub.com/en/terms/%E8%87%AA%E7%84%B6%E8%AF%AD%E8%A8%80%E5%A4%84%E7%90%86-nlp/">自然语言处理 (NLP)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/transformer-%E6%A8%A1%E5%9E%8B/">Transformer 模型</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/bert/">BERT</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/t5/">T5</a></li> </ul>命名实体识别https://terms-en.ai-term-hub.com/zh/terms/named_entity_recognition/Sat, 18 Jul 2026 11:01:16 +0000https://terms-en.ai-term-hub.com/zh/terms/named_entity_recognition/<h2 id="definition">Definition</h2> <p>命名实体识别（NER）是信息抽取的一个子任务，用于在文本中定位并将命名实体分类为预定义的类别，如人名、组织机构名、地名、医疗术语等。</p> <h3 id="summary">Summary</h3> <p>一项自然语言处理任务，旨在将关键信息实体识别并分类到预定义的类别中。</p> <h2 id="key-concepts">Key Concepts</h2> <ul> <li>实体类型化</li> <li>词元分类</li> <li>序列标注</li> <li>BiLSTM-CRF 架构</li> </ul> <h2 id="use-cases">Use Cases</h2> <ul> <li>简历解析</li> <li>客户支持意图检测</li> <li>病历分析</li> </ul> <h2 id="related-terms">Related Terms</h2> <ul> <li><a href="https://terms-en.ai-term-hub.com/en/terms/information_extraction-%E4%BF%A1%E6%81%AF%E6%8A%BD%E5%8F%96/">information_extraction (信息抽取)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/part_of_speech_tagging-%E8%AF%8D%E6%80%A7%E6%A0%87%E6%B3%A8/">part_of_speech_tagging (词性标注)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/coreference_resolution-%E6%8C%87%E4%BB%A3%E6%B6%88%E8%A7%A3/">coreference_resolution (指代消解)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/tokenization-%E5%88%86%E8%AF%8D/">tokenization (分词)</a></li> </ul>自然语言处理https://terms-en.ai-term-hub.com/zh/terms/natural_language_processing/Sat, 18 Jul 2026 10:53:26 +0000https://terms-en.ai-term-hub.com/zh/terms/natural_language_processing/<h2 id="definition">Definition</h2> <p>自然语言处理（NLP）是人工智能的一个子领域，它将计算语言学与统计、机器学习和深度学习模型相结合。它使机器能够</p> <h3 id="summary">Summary</h3> <p>人工智能的一个分支，专注于使计算机能够理解、解释和生成人类语言。</p> <h2 id="key-concepts">Key Concepts</h2> <ul> <li>分词</li> <li>情感分析</li> <li>命名实体识别</li> <li>机器翻译</li> </ul> <h2 id="use-cases">Use Cases</h2> <ul> <li>聊天机器人和虚拟助手</li> <li>自动化客户支持</li> <li>语言翻译服务</li> </ul> <h2 id="code-example">Code Example</h2> <div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-python" data-lang="python"><span style="display:flex;"><span><span style="color:#f92672">import</span> spacy </span></span><span style="display:flex;"><span>nlp <span style="color:#f92672">=</span> spacy<span style="color:#f92672">.</span>load(<span style="color:#e6db74">&#39;en_core_web_sm&#39;</span>) </span></span><span style="display:flex;"><span>doc <span style="color:#f92672">=</span> nlp(<span style="color:#e6db74">&#39;Apple is looking at buying U.K. startup for $1 billion&#39;</span>) </span></span><span style="display:flex;"><span><span style="color:#66d9ef">for</span> ent <span style="color:#f92672">in</span> doc<span style="color:#f92672">.</span>ents: </span></span><span style="display:flex;"><span> print(ent<span style="color:#f92672">.</span>text, ent<span style="color:#f92672">.</span>label_) </span></span></code></pre></div><h2 id="related-terms">Related Terms</h2> <ul> <li><a href="https://terms-en.ai-term-hub.com/en/terms/computational_linguistics-%E8%AE%A1%E7%AE%97%E8%AF%AD%E8%A8%80%E5%AD%A6/">computational_linguistics (计算语言学)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/machine_learning-%E6%9C%BA%E5%99%A8%E5%AD%A6%E4%B9%A0/">machine_learning (机器学习)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/deep_learning-%E6%B7%B1%E5%BA%A6%E5%AD%A6%E4%B9%A0/">deep_learning (深度学习)</a></li> <li><a href="https://terms-en.ai-term-hub.com/en/terms/text_mining-%E6%96%87%E6%9C%AC%E6%8C%96%E6%8E%98/">text_mining (文本挖掘)</a></li> </ul>