uTools-Manuals/docs/python/token.html

<div class="body" role="main"><div class="section" id="module-token"><h1><span class="yiyi-st" id="yiyi-10">32.5. <a class="reference internal" href="#module-token" title="token: Constants representing terminal nodes of the parse tree."><code class="xref py py-mod docutils literal"><span class="pre">token</span></code></a>  - 用于Python解析树的常量</span></h1><p><span class="yiyi-st" id="yiyi-11"><strong>源代码：</strong> <a class="reference external" href="https://hg.python.org/cpython/file/3.5/Lib/token.py">Lib / token.py</a></span></p><p><span class="yiyi-st" id="yiyi-12">该模块提供表示解析树（终端令牌）的叶节点的数值的常数。</span><span class="yiyi-st" id="yiyi-13">有关语言语法的上下文中的名称的定义，请参阅Python分发中的文件<code class="file docutils literal"><span class="pre">Grammar/Grammar</span></code>。</span><span class="yiyi-st" id="yiyi-14">名称映射到的特定数值可能在Python版本之间变化。</span></p><p><span class="yiyi-st" id="yiyi-15">该模块还提供从数字代码到名称和一些函数的映射。</span><span class="yiyi-st" id="yiyi-16">这些函数镜像Python C头文件中的定义。</span></p><dl class="data"><dt id="token.tok_name"><span class="yiyi-st" id="yiyi-17"> <code class="descclassname">token.</code><code class="descname">tok_name</code></span></dt><dd><p><span class="yiyi-st" id="yiyi-18">将此模块中定义的常量的数字值映射回名称字符串的字典，从而允许生成更加人性化的解析树表示。</span></p></dd></dl><dl class="function"><dt id="token.ISTERMINAL"><span class="yiyi-st" id="yiyi-19"> <code class="descclassname">token.</code><code class="descname">ISTERMINAL</code><span class="sig-paren">(</span><em>x</em><span class="sig-paren">)</span></span></dt><dd><p><span class="yiyi-st" id="yiyi-20">对终端令牌值返回true。</span></p></dd></dl><dl class="function"><dt id="token.ISNONTERMINAL"><span class="yiyi-st" id="yiyi-21"> <code class="descclassname">token.</code><code class="descname">ISNONTERMINAL</code><span class="sig-paren">(</span><em>x</em><span class="sig-paren">)</span></span></dt><dd><p><span class="yiyi-st" id="yiyi-22">对非终端令牌值返回true。</span></p></dd></dl><dl class="function"><dt id="token.ISEOF"><span class="yiyi-st" id="yiyi-23"> <code class="descclassname">token.</code><code class="descname">ISEOF</code><span class="sig-paren">(</span><em>x</em><span class="sig-paren">)</span></span></dt><dd><p><span class="yiyi-st" id="yiyi-24">如果<em>x</em>是指示输入结束的标记，则返回true。</span></p></dd></dl><p><span class="yiyi-st" id="yiyi-25">令牌常量是：</span></p><dl class="data"><dt id="token.ENDMARKER"><span class="yiyi-st" id="yiyi-26"> <code class="descclassname">token.</code><code class="descname">ENDMARKER</code></span></dt><dt id="token.NAME"><span class="yiyi-st" id="yiyi-27"> <code class="descclassname">token.</code><code class="descname">NAME</code></span></dt><dt id="token.NUMBER"><span class="yiyi-st" id="yiyi-28"> <code class="descclassname">token.</code><code class="descname">NUMBER</code></span></dt><dt id="token.STRING"><span class="yiyi-st" id="yiyi-29"> <code class="descclassname">token.</code><code class="descname">STRING</code></span></dt><dt id="token.NEWLINE"><span class="yiyi-st" id="yiyi-30"> <code class="descclassname">token.</code><code class="descname">NEWLINE</code></span></dt><dt id="token.INDENT"><span class="yiyi-st" id="yiyi-31"> <code class="descclassname">token.</code><code class="descname">INDENT</code></span></dt><dt id="token.DEDENT"><span class="yiyi-st" id="yiyi-32"> <code class="descclassname">token.</code><code class="descname">DEDENT</code></span></dt><dt id="token.LPAR"><span class="yiyi-st" id="yiyi-33"> <code class="descclassname">token.</code><code class="descname">LPAR</code></span></dt><dt id="token.RPAR"><span class="yiyi-st" id="yiyi-34"> <code class="descclassname">token.</code><code class="descname">RPAR</code></span></dt><dt id="token.LSQB"><span class="yiyi-st" id="yiyi-35"> <code class="descclassname">token.</code><code class="descname">LSQB</code></span></dt><dt id="token.RSQB"><span class="yiyi-st" id="yiyi-36"> <code class="descclassname">token.</code><code class="descname">RSQB</code></span></dt><dt id="token.COLON"><span class="yiyi-st" id="yiyi-37"> <code class="descclassname">token.</code><code class="descname">COLON</code></span></dt><dt id="token.COMMA"><span class="yiyi-st" id="yiyi-38"> <code class="descclassname">token.</code><code class="descname">COMMA</code></span></dt><dt id="token.SEMI"><span class="yiyi-st" id="yiyi-39"> <code class="descclassname">token.</code><code class="descname">SEMI</code></span></dt><dt id="token.PLUS"><span class="yiyi-st" id="yiyi-40"> <code class="descclassname">token.</code><code class="descname">PLUS</code></span></dt><dt id="token.MINUS"><span class="yiyi-st" id="yiyi-41"> <code class="descclassname">token.</code><code class="descname">MINUS</code></span></dt><dt id="token.STAR"><span class="yiyi-st" id="yiyi-42"> <code class="descclassname">token.</code><code class="descname">STAR</code></span></dt><dt id="token.SLASH"><span class="yiyi-st" id="yiyi-43"> <code class="descclassname">token.</code><code class="descname">SLASH</code></span></dt><dt id="token.VBAR"><span class="yiyi-st" id="yiyi-44"> <code class="descclassname">token.</code><code class="descname">VBAR</code></span></dt><dt id="token.AMPER"><span class="yiyi-st" id="yiyi-45"> <code class="descclassname">token.</code><code class="descname">AMPER</code></span></dt><dt id="token.LESS"><span class="yiyi-st" id="yiyi-46"> <code class="descclassname">token.</code><code class="descname">LESS</code></span></dt><dt id="token.GREATER"><span class="yiyi-st" id="yiyi-47"> <code class="descclassname">token.</code><code class="descname">GREATER</code></span></dt><dt id="token.EQUAL"><span class="yiyi-st" id="yiyi-48"> <code class="descclassname">token.</code><code class="descname">EQUAL</code></span></dt><dt id="token.DOT"><span class="yiyi-st" id="yiyi-49"> <code class="descclassname">token.</code><code class="descname">DOT</code></span></dt><dt id="token.PERCENT"><span class="yiyi-st" id="yiyi-50"> <code class="descclassname">token.</code><code class="descname">PERCENT</code></span></dt><dt id="token.LBRACE"><span class="yiyi-st" id="yiyi-51"> <code class="descclassname">token.</code><code class="descname">LBRACE</code></span></dt><dt id="token.RBRACE"><span class="yiyi-st" id="yiyi-52"> <code class="descclassname">token.</code><code class="descname">RBRACE</code></span></dt><dt id="token.EQEQUAL"><span class="yiyi-st" id="yiyi-53"> <code class="descclassname">token.</code><code class="descname">EQEQUAL</code></span></dt><dt id="token.NOTEQUAL"><span class="yiyi-st" id="yiyi-54"> <code class="descclassname">token.</code><code class="descname">NOTEQUAL</code></span></dt><dt id="token.LESSEQUAL"><span class="yiyi-st" id="yiyi-55"> <code class="descclassname">token.</code><code class="descname">LESSEQUAL</code></span></dt><dt id="token.GREATEREQUAL"><span class="yiyi-st" id="yiyi-56"> <code class="descclassname">token.</code><code class="descname">GREATEREQUAL</code></span></dt><dt id="token.TILDE"><span class="yiyi-st" id="yiyi-57"> <code class="descclassname">token.</code><code class="descname">TILDE</code></span></dt><dt id="token.CIRCUMFLEX"><span class="yiyi-st" id="yiyi-58"> <code class="descclassname">token.</code><code class="descname">CIRCUMFLEX</code></span></dt><dt id="token.LEFTSHIFT"><span class="yiyi-st" id="yiyi-59"> <code class="descclassname">token.</code><code class="descname">LEFTSHIFT</code></span></dt><dt id="token.RIGHTSHIFT"><span class="yiyi-st" id="yiyi-60"> <code class="descclassname">token.</code><code class="descname">RIGHTSHIFT</code></span></dt><dt id="token.DOUBLESTAR"><span class="yiyi-st" id="yiyi-61"> <code class="descclassname">token.</code><code class="descname">DOUBLESTAR</code></span></dt><dt id="token.PLUSEQUAL"><span class="yiyi-st" id="yiyi-62"> <code class="descclassname">token.</code><code class="descname">PLUSEQUAL</code></span></dt><dt id="token.MINEQUAL"><span class="yiyi-st" id="yiyi-63"> <code class="descclassname">token.</code><code class="descname">MINEQUAL</code></span></dt><dt id="token.STAREQUAL"><span class="yiyi-st" id="yiyi-64"> <code class="descclassname">token.</code><code class="descname">STAREQUAL</code></span></dt><dt id="token.SLASHEQUAL"><span class="yiyi-st" id="yiyi-65"> <code class="descclassname">token.</code><code class="descname">SLASHEQUAL</code></span></dt><dt id="token.PERCENTEQUAL"><span class="yiyi-st" id="yiyi-66"> <code class="descclassname">token.</code><code class="descname">PERCENTEQUAL</code></span></dt><dt id="token.AMPEREQUAL"><span class="yiyi-st" id="yiyi-67"> <code class="descclassname">token.</code><code class="descname">AMPEREQUAL</code></span></dt><dt id="token.VBAREQUAL"><span class="yiyi-st" id="yiyi-68"> <code class="descclassname">token.</code><code class="descname">VBAREQUAL</code></span></dt><dt id="token.CIRCUMFLEXEQUAL"><span class="yiyi-st" id="yiyi-69"> <code class="descclassname">token.</code><code class="descname">CIRCUMFLEXEQUAL</code></span></dt><dt id="token.LEFTSHIFTEQUAL"><span class="yiyi-st" id="yiyi-70"> <code class="descclassname">token.</code><code class="descname">LEFTSHIFTEQUAL</code></span></dt><dt id="token.RIGHTSHIFTEQUAL"><span class="yiyi-st" id="yiyi-71"> <code class="descclassname">token.</code><code class="descname">RIGHTSHIFTEQUAL</code></span></dt><dt id="token.DOUBLESTAREQUAL"><span class="yiyi-st" id="yiyi-72"> <code class="descclassname">token.</code><code class="descname">DOUBLESTAREQUAL</code></span></dt><dt id="token.DOUBLESLASH"><span class="yiyi-st" id="yiyi-73"> <code class="descclassname">token.</code><code class="descname">DOUBLESLASH</code></span></dt><dt id="token.DOUBLESLASHEQUAL"><span class="yiyi-st" id="yiyi-74"> <code class="descclassname">token.</code><code class="descname">DOUBLESLASHEQUAL</code></span></dt><dt id="token.AT"><span class="yiyi-st" id="yiyi-75"> <code class="descclassname">token.</code><code class="descname">AT</code></span></dt><dt id="token.ATEQUAL"><span class="yiyi-st" id="yiyi-76"> <code class="descclassname">token.</code><code class="descname">ATEQUAL</code></span></dt><dt id="token.RARROW"><span class="yiyi-st" id="yiyi-77"> <code class="descclassname">token.</code><code class="descname">RARROW</code></span></dt><dt id="token.ELLIPSIS"><span class="yiyi-st" id="yiyi-78"> <code class="descclassname">token.</code><code class="descname">ELLIPSIS</code></span></dt><dt id="token.OP"><span class="yiyi-st" id="yiyi-79"> <code class="descclassname">token.</code><code class="descname">OP</code></span></dt><dt id="token.AWAIT"><span class="yiyi-st" id="yiyi-80"> <code class="descclassname">token.</code><code class="descname">AWAIT</code></span></dt><dt id="token.ASYNC"><span class="yiyi-st" id="yiyi-81"> <code class="descclassname">token.</code><code class="descname">ASYNC</code></span></dt><dt id="token.ERRORTOKEN"><span class="yiyi-st" id="yiyi-82"> <code class="descclassname">token.</code><code class="descname">ERRORTOKEN</code></span></dt><dt id="token.N_TOKENS"><span class="yiyi-st" id="yiyi-83"> <code class="descclassname">token.</code><code class="descname">N_TOKENS</code></span></dt><dt id="token.NT_OFFSET"><span class="yiyi-st" id="yiyi-84"> <code class="descclassname">token.</code><code class="descname">NT_OFFSET</code></span></dt><dd><div class="versionchanged"><p><span class="yiyi-st" id="yiyi-85"><span class="versionmodified">在3.5版中已更改：</span>添加了<a class="reference internal" href="#token.AWAIT" title="token.AWAIT"><code class="xref py py-data docutils literal"><span class="pre">AWAIT</span></code></a>和<a class="reference internal" href="#token.ASYNC" title="token.ASYNC"><code class="xref py py-data docutils literal"><span class="pre">ASYNC</span></code></a>令牌。</span><span class="yiyi-st" id="yiyi-86">从Python 3.7开始，“async”和“await”将被标记为<a class="reference internal" href="#token.NAME" title="token.NAME"><code class="xref py py-data docutils literal"><span class="pre">NAME</span></code></a>令牌，并且将删除<a class="reference internal" href="#token.AWAIT" title="token.AWAIT"><code class="xref py py-data docutils literal"><span class="pre">AWAIT</span></code></a>和<a class="reference internal" href="#token.ASYNC" title="token.ASYNC"><code class="xref py py-data docutils literal"><span class="pre">ASYNC</span></code></a>。</span></p></div></dd></dl></div></div>