增加tkinter和pyqt5

docs/python/Scrapy.html

@@ -20,11 +20,10 @@
     <h2>创建项目</h2>
     <p>在开始爬取之前，您必须创建一个新的Scrapy项目。
     进入您打算存储代码的目录中，运行下列命令:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span>scrapy startproject tutorial
-    </pre></div>
-    </div>
+    <pre><code class="language-python"><span></span>scrapy startproject tutorial
+    </code></pre>
     <p>该命令将会创建包含下列内容的 <code class="docutils literal"><span class="pre">tutorial</span></code> 目录:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span>tutorial/
+    <pre><code class="language-python"><span></span>tutorial/
         scrapy.cfg
     
         tutorial/
@@ -39,8 +38,7 @@
             spiders/
                 __init__.py
                 ...
-    </pre></div>
-    </div>
+    </code></pre>
     </div>
     <div class="section" id="item">
     <h2>定义Item</h2>
@@ -53,14 +51,13 @@
     <p>首先根据需要从dmoz.org获取到的数据对item进行建模。
     我们需要从dmoz中获取名字，url，以及网站的描述。
     对此，在item中定义相应的字段。编辑 <code class="docutils literal"><span class="pre">tutorial</span></code> 目录中的 <code class="docutils literal"><span class="pre">items.py</span></code> 文件:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span><span class="kn">import</span> <span class="nn">scrapy</span>
+    <pre><code class="language-python"><span></span><span class="kn">import</span> <span class="nn">scrapy</span>
     
     <span class="k">class</span> <span class="nc">DmozItem</span><span class="p">(</span><span class="n">scrapy</span><span class="o">.</span><span class="n">Item</span><span class="p">):</span>
         <span class="n">title</span> <span class="o">=</span> <span class="n">scrapy</span><span class="o">.</span><span class="n">Field</span><span class="p">()</span>
         <span class="n">link</span> <span class="o">=</span> <span class="n">scrapy</span><span class="o">.</span><span class="n">Field</span><span class="p">()</span>
         <span class="n">desc</span> <span class="o">=</span> <span class="n">scrapy</span><span class="o">.</span><span class="n">Field</span><span class="p">()</span>
-    </pre></div>
-    </div>
+    </code></pre>
     <p>一开始这看起来可能有点复杂，但是通过定义item，
     您可以很方便的使用Scrapy的其他方法。而这些方法需要知道您的item的定义。</p>
     </div>
@@ -83,7 +80,7 @@
     该方法负责解析返回的数据(response data)，提取数据(生成item)以及生成需要进一步处理的URL的 <a class="reference internal" href="../topics/request-response.html#scrapy.http.Request" title="scrapy.http.Request"><code class="xref py py-class docutils literal"><span class="pre">Request</span></code></a> 对象。</li>
     </ul>
     <p>以下为我们的第一个Spider代码，保存在 <code class="docutils literal"><span class="pre">tutorial/spiders</span></code> 目录下的 <code class="docutils literal"><span class="pre">dmoz_spider.py</span></code> 文件中:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span><span class="kn">import</span> <span class="nn">scrapy</span>
+    <pre><code class="language-python"><span></span><span class="kn">import</span> <span class="nn">scrapy</span>
     
     <span class="k">class</span> <span class="nc">DmozSpider</span><span class="p">(</span><span class="n">scrapy</span><span class="o">.</span><span class="n">Spider</span><span class="p">):</span>
         <span class="n">name</span> <span class="o">=</span> <span class="s2">"dmoz"</span>
@@ -97,17 +94,15 @@
             <span class="n">filename</span> <span class="o">=</span> <span class="n">response</span><span class="o">.</span><span class="n">url</span><span class="o">.</span><span class="n">split</span><span class="p">(</span><span class="s2">"/"</span><span class="p">)[</span><span class="o">-</span><span class="mi">2</span><span class="p">]</span> <span class="o">+</span> <span class="s1">'.html'</span>
             <span class="k">with</span> <span class="nb">open</span><span class="p">(</span><span class="n">filename</span><span class="p">,</span> <span class="s1">'wb'</span><span class="p">)</span> <span class="k">as</span> <span class="n">f</span><span class="p">:</span>
                 <span class="n">f</span><span class="o">.</span><span class="n">write</span><span class="p">(</span><span class="n">response</span><span class="o">.</span><span class="n">body</span><span class="p">)</span>
-    </pre></div>
-    </div>
+    </code></pre>
     <div class="section" id="id3">
     <h3>爬取</h3>
     <p>进入项目的根目录，执行下列命令启动spider:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span>scrapy crawl dmoz
-    </pre></div>
-    </div>
+    <pre><code class="language-python"><span></span>scrapy crawl dmoz
+    </code></pre>
     <p>该命令启动了我们刚刚添加的 <code class="docutils literal"><span class="pre">dmoz</span></code> spider, 向 <code class="docutils literal"><span class="pre">dmoz.org</span></code> 发送一些请求。
     您将会得到类似的输出:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span>2014-01-23 18:13:07-0400 [scrapy] INFO: Scrapy started (bot: tutorial)
+    <pre><code class="language-python"><span></span>2014-01-23 18:13:07-0400 [scrapy] INFO: Scrapy started (bot: tutorial)
     2014-01-23 18:13:07-0400 [scrapy] INFO: Optional features available: ...
     2014-01-23 18:13:07-0400 [scrapy] INFO: Overridden settings: {}
     2014-01-23 18:13:07-0400 [scrapy] INFO: Enabled extensions: ...
@@ -118,8 +113,7 @@
     2014-01-23 18:13:08-0400 [scrapy] DEBUG: Crawled (200) &lt;GET http://www.dmoz.org/Computers/Programming/Languages/Python/Resources/&gt; (referer: None)
     2014-01-23 18:13:09-0400 [scrapy] DEBUG: Crawled (200) &lt;GET http://www.dmoz.org/Computers/Programming/Languages/Python/Books/&gt; (referer: None)
     2014-01-23 18:13:09-0400 [scrapy] INFO: Closing spider (finished)
-    </pre></div>
-    </div>
+    </code></pre>
     <div class="admonition note">
     <p class="first admonition-title">注解</p>
     <p class="last">最后你可以看到有一行log包含定义在 <code class="docutils literal"><span class="pre">start_urls</span></code> 的初始URL，并且与spider中是一一对应的。在log中可以看到其没有指向其他页面( <code class="docutils literal"><span class="pre">(referer:None)</span></code> )。</p>
@@ -169,15 +163,14 @@
     <h4>在Shell中尝试Selector选择器</h4>
     <p>为了介绍Selector的使用方法，接下来我们将要使用内置的 <a class="reference internal" href="../topics/shell.html#topics-shell"><span>Scrapy shell</span></a> 。Scrapy Shell需要您预装好 <a class="reference external" href="http://ipython.org/">IPython</a> (一个扩展的Python终端)。</p>
     <p>您需要进入项目的根目录，执行下列命令来启动shell:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span>scrapy shell "http://www.dmoz.org/Computers/Programming/Languages/Python/Books/"
-    </pre></div>
-    </div>
+    <pre><code class="language-python"><span></span>scrapy shell "http://www.dmoz.org/Computers/Programming/Languages/Python/Books/"
+    </code></pre>
     <div class="admonition note">
     <p class="first admonition-title">注解</p>
     <p class="last">当您在终端运行Scrapy时，请一定记得给url地址加上引号，否则包含参数的url(例如 <code class="docutils literal"><span class="pre">&amp;</span></code> 字符)会导致Scrapy运行失败。</p>
     </div>
     <p>shell的输出类似:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span>[ ... Scrapy log here ... ]
+    <pre><code class="language-python"><span></span>[ ... Scrapy log here ... ]
     
     2014-01-23 17:11:42-0400 [scrapy] DEBUG: Crawled (200) &lt;GET http://www.dmoz.org/Computers/Programming/Languages/Python/Books/&gt; (referer: None)
     [s] Available Scrapy objects:
@@ -193,8 +186,7 @@
     [s]   view(response)    View response in a browser
     
     In [1]:
-    </pre></div>
-    </div>
+    </code></pre>
     <p>当shell载入后，您将得到一个包含response数据的本地 <code class="docutils literal"><span class="pre">response</span></code> 变量。输入 <code class="docutils literal"><span class="pre">response.body</span></code> 将输出response的包体， 输出 <code class="docutils literal"><span class="pre">response.headers</span></code> 可以看到response的包头。</p>
     <p>#TODO..
     更为重要的是, <code class="docutils literal"><span class="pre">response</span></code> 拥有一个 <code class="docutils literal"><span class="pre">selector</span></code> 属性,
@@ -205,7 +197,7 @@
     <code class="docutils literal"><span class="pre">response.xpath()</span></code> 或 <code class="docutils literal"><span class="pre">response.css()</span></code> ，</p>
     <p>同时，shell根据response提前初始化了变量 <code class="docutils literal"><span class="pre">sel</span></code> 。该selector根据response的类型自动选择最合适的分析规则(XML vs HTML)。</p>
     <p>让我们来试试:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span>In [1]: response.xpath('//title')
+    <pre><code class="language-python"><span></span>In [1]: response.xpath('//title')
     Out[1]: [&lt;Selector xpath='//title' data=u'&lt;title&gt;Open Directory - Computers: Progr'&gt;]
     
     In [2]: response.xpath('//title').extract()
@@ -219,8 +211,7 @@
     
     In [5]: response.xpath('//title/text()').re('(\w+):')
     Out[5]: [u'Computers', u'Programming', u'Languages', u'Python']
-    </pre></div>
-    </div>
+    </code></pre>
     </div>
     <div class="section" id="id7">
     <h4>提取数据</h4>
@@ -228,35 +219,30 @@
     <p>您可以在终端中输入 <code class="docutils literal"><span class="pre">response.body</span></code> 来观察HTML源码并确定合适的XPath表达式。不过，这任务非常无聊且不易。您可以考虑使用Firefox的Firebug扩展来使得工作更为轻松。详情请参考 <a class="reference internal" href="../topics/firebug.html#topics-firebug"><span>使用Firebug进行爬取</span></a> 和 <a class="reference internal" href="../topics/firefox.html#topics-firefox"><span>借助Firefox来爬取</span></a> 。</p>
     <p>在查看了网页的源码后，您会发现网站的信息是被包含在 <em>第二个</em> <code class="docutils literal"><span class="pre">&lt;ul&gt;</span></code> 元素中。</p>
     <p>我们可以通过这段代码选择该页面中网站列表里所有 <code class="docutils literal"><span class="pre">&lt;li&gt;</span></code> 元素:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span><span class="n">response</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'//ul/li'</span><span class="p">)</span>
-    </pre></div>
-    </div>
+    <pre><code class="language-python"><span></span><span class="n">response</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'//ul/li'</span><span class="p">)</span>
+    </code></pre>
     <p>网站的描述:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span><span class="n">response</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'//ul/li/text()'</span><span class="p">)</span><span class="o">.</span><span class="n">extract</span><span class="p">()</span>
-    </pre></div>
-    </div>
+    <pre><code class="language-python"><span></span><span class="n">response</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'//ul/li/text()'</span><span class="p">)</span><span class="o">.</span><span class="n">extract</span><span class="p">()</span>
+    </code></pre>
     <p>网站的标题:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span><span class="n">response</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'//ul/li/a/text()'</span><span class="p">)</span><span class="o">.</span><span class="n">extract</span><span class="p">()</span>
-    </pre></div>
-    </div>
+    <pre><code class="language-python"><span></span><span class="n">response</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'//ul/li/a/text()'</span><span class="p">)</span><span class="o">.</span><span class="n">extract</span><span class="p">()</span>
+    </code></pre>
     <p>以及网站的链接:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span><span class="n">response</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'//ul/li/a/@href'</span><span class="p">)</span><span class="o">.</span><span class="n">extract</span><span class="p">()</span>
-    </pre></div>
-    </div>
+    <pre><code class="language-python"><span></span><span class="n">response</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'//ul/li/a/@href'</span><span class="p">)</span><span class="o">.</span><span class="n">extract</span><span class="p">()</span>
+    </code></pre>
     <p>之前提到过，每个 <code class="docutils literal"><span class="pre">.xpath()</span></code> 调用返回selector组成的list，因此我们可以拼接更多的 <code class="docutils literal"><span class="pre">.xpath()</span></code> 来进一步获取某个节点。我们将在下边使用这样的特性:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span><span class="k">for</span> <span class="n">sel</span> <span class="ow">in</span> <span class="n">response</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'//ul/li'</span><span class="p">):</span>
+    <pre><code class="language-python"><span></span><span class="k">for</span> <span class="n">sel</span> <span class="ow">in</span> <span class="n">response</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'//ul/li'</span><span class="p">):</span>
         <span class="n">title</span> <span class="o">=</span> <span class="n">sel</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'a/text()'</span><span class="p">)</span><span class="o">.</span><span class="n">extract</span><span class="p">()</span>
         <span class="n">link</span> <span class="o">=</span> <span class="n">sel</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'a/@href'</span><span class="p">)</span><span class="o">.</span><span class="n">extract</span><span class="p">()</span>
         <span class="n">desc</span> <span class="o">=</span> <span class="n">sel</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'text()'</span><span class="p">)</span><span class="o">.</span><span class="n">extract</span><span class="p">()</span>
         <span class="k">print</span> <span class="n">title</span><span class="p">,</span> <span class="n">link</span><span class="p">,</span> <span class="n">desc</span>
-    </pre></div>
-    </div>
+    </code></pre>
     <div class="admonition note">
     <p class="first admonition-title">注解</p>
     <p class="last">关于嵌套selctor的更多详细信息，请参考 <a class="reference internal" href="../topics/selectors.html#topics-selectors-nesting-selectors"><span>嵌套选择器(selectors)</span></a> 以及 <a class="reference internal" href="../topics/selectors.html#topics-selectors"><span>选择器(Selectors)</span></a> 文档中的 <a class="reference internal" href="../topics/selectors.html#topics-selectors-relative-xpaths"><span>使用相对XPaths</span></a> 部分。</p>
     </div>
     <p>在我们的spider中加入这段代码:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span><span class="kn">import</span> <span class="nn">scrapy</span>
+    <pre><code class="language-python"><span></span><span class="kn">import</span> <span class="nn">scrapy</span>
     
     <span class="k">class</span> <span class="nc">DmozSpider</span><span class="p">(</span><span class="n">scrapy</span><span class="o">.</span><span class="n">Spider</span><span class="p">):</span>
         <span class="n">name</span> <span class="o">=</span> <span class="s2">"dmoz"</span>
@@ -272,26 +258,23 @@
                 <span class="n">link</span> <span class="o">=</span> <span class="n">sel</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'a/@href'</span><span class="p">)</span><span class="o">.</span><span class="n">extract</span><span class="p">()</span>
                 <span class="n">desc</span> <span class="o">=</span> <span class="n">sel</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'text()'</span><span class="p">)</span><span class="o">.</span><span class="n">extract</span><span class="p">()</span>
                 <span class="k">print</span> <span class="n">title</span><span class="p">,</span> <span class="n">link</span><span class="p">,</span> <span class="n">desc</span>
-    </pre></div>
-    </div>
+    </code></pre>
     <p>现在尝试再次爬取dmoz.org，您将看到爬取到的网站信息被成功输出:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span>scrapy crawl dmoz
-    </pre></div>
-    </div>
+    <pre><code class="language-python"><span></span>scrapy crawl dmoz
+    </code></pre>
     </div>
     </div>
     <div class="section" id="id8">
     <h3>使用item</h3>
     <p><a class="reference internal" href="../topics/items.html#scrapy.item.Item" title="scrapy.item.Item"><code class="xref py py-class docutils literal"><span class="pre">Item</span></code></a> 对象是自定义的python字典。
     您可以使用标准的字典语法来获取到其每个字段的值。(字段即是我们之前用Field赋值的属性):</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span><span class="gp">&gt;&gt;&gt; </span><span class="n">item</span> <span class="o">=</span> <span class="n">DmozItem</span><span class="p">()</span>
+    <pre><code class="language-python"><span></span><span class="gp">&gt;&gt;&gt; </span><span class="n">item</span> <span class="o">=</span> <span class="n">DmozItem</span><span class="p">()</span>
     <span class="gp">&gt;&gt;&gt; </span><span class="n">item</span><span class="p">[</span><span class="s1">'title'</span><span class="p">]</span> <span class="o">=</span> <span class="s1">'Example title'</span>
     <span class="gp">&gt;&gt;&gt; </span><span class="n">item</span><span class="p">[</span><span class="s1">'title'</span><span class="p">]</span>
     <span class="go">'Example title'</span>
-    </pre></div>
-    </div>
+    </code></pre>
     <p>为了将爬取的数据返回，我们最终的代码将是:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span><span class="kn">import</span> <span class="nn">scrapy</span>
+    <pre><code class="language-python"><span></span><span class="kn">import</span> <span class="nn">scrapy</span>
     
     <span class="kn">from</span> <span class="nn">tutorial.items</span> <span class="kn">import</span> <span class="n">DmozItem</span>
     
@@ -310,14 +293,13 @@
                 <span class="n">item</span><span class="p">[</span><span class="s1">'link'</span><span class="p">]</span> <span class="o">=</span> <span class="n">sel</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'a/@href'</span><span class="p">)</span><span class="o">.</span><span class="n">extract</span><span class="p">()</span>
                 <span class="n">item</span><span class="p">[</span><span class="s1">'desc'</span><span class="p">]</span> <span class="o">=</span> <span class="n">sel</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'text()'</span><span class="p">)</span><span class="o">.</span><span class="n">extract</span><span class="p">()</span>
                 <span class="k">yield</span> <span class="n">item</span>
-    </pre></div>
-    </div>
+    </code></pre>
     <div class="admonition note">
     <p class="first admonition-title">注解</p>
     <p class="last">您可以在 <a class="reference external" href="https://github.com/scrapy/dirbot">dirbot</a> 项目中找到一个具有完整功能的spider。该项目可以通过 <a class="reference external" href="https://github.com/scrapy/dirbot">https://github.com/scrapy/dirbot</a> 找到。</p>
     </div>
     <p>现在对dmoz.org进行爬取将会产生 <code class="docutils literal"><span class="pre">DmozItem</span></code> 对象:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span>[scrapy] DEBUG: Scraped from &lt;200 http://www.dmoz.org/Computers/Programming/Languages/Python/Books/&gt;
+    <pre><code class="language-python"><span></span>[scrapy] DEBUG: Scraped from &lt;200 http://www.dmoz.org/Computers/Programming/Languages/Python/Books/&gt;
          {'desc': [u' - By David Mertz; Addison Wesley. Book in progress, full text, ASCII format. Asks for feedback. [author website, Gnosis Software, Inc.\n],
           'link': [u'http://gnosis.cx/TPiP/'],
           'title': [u'Text Processing in Python']}
@@ -325,8 +307,7 @@
          {'desc': [u' - By Sean McGrath; Prentice Hall PTR, 2000, ISBN 0130211192, has CD-ROM. Methods to build XML applications fast, Python tutorial, DOM and SAX, new Pyxie open source XML processing library. [Prentice Hall PTR]\n'],
           'link': [u'http://www.informit.com/store/product.aspx?isbn=0130211192'],
           'title': [u'XML Processing with Python']}
-    </pre></div>
-    </div>
+    </code></pre>
     </div>
     </div>
     <div class="section" id="following-links">
@@ -337,7 +318,7 @@
     <p>既然已经能从页面上爬取数据了,为什么不提取您感兴趣的页面的链接,追踪他们,
     读取这些链接的数据呢?</p>
     <p>下面是实现这个功能的改进版spider:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span><span class="kn">import</span> <span class="nn">scrapy</span>
+    <pre><code class="language-python"><span></span><span class="kn">import</span> <span class="nn">scrapy</span>
     
     <span class="kn">from</span> <span class="nn">tutorial.items</span> <span class="kn">import</span> <span class="n">DmozItem</span>
     
@@ -360,8 +341,7 @@
                 <span class="n">item</span><span class="p">[</span><span class="s1">'link'</span><span class="p">]</span> <span class="o">=</span> <span class="n">sel</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'a/@href'</span><span class="p">)</span><span class="o">.</span><span class="n">extract</span><span class="p">()</span>
                 <span class="n">item</span><span class="p">[</span><span class="s1">'desc'</span><span class="p">]</span> <span class="o">=</span> <span class="n">sel</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s1">'text()'</span><span class="p">)</span><span class="o">.</span><span class="n">extract</span><span class="p">()</span>
                 <span class="k">yield</span> <span class="n">item</span>
-    </pre></div>
-    </div>
+    </code></pre>
     <p>现在， <cite>parse()</cite> 仅仅从页面中提取我们感兴趣的链接，使用
     <cite>response.urljoin</cite> 方法构造一个绝对路径的URL(页面上的链接都是相对路径的)，
     产生(yield)一个请求， 该请求使用 <cite>parse_dir_contents()</cite> 方法作为回调函数,
@@ -372,7 +352,7 @@
     根据所访问的页面,提取不同的数据.</p>
     <p>一种常见的方法是,回调函数负责提取一些item,查找能跟进的页面的链接,
     并且使用相同的回调函数yield一个 <cite>Request</cite>:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span><span class="k">def</span> <span class="nf">parse_articles_follow_next_page</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">response</span><span class="p">):</span>
+    <pre><code class="language-python"><span></span><span class="k">def</span> <span class="nf">parse_articles_follow_next_page</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">response</span><span class="p">):</span>
         <span class="k">for</span> <span class="n">article</span> <span class="ow">in</span> <span class="n">response</span><span class="o">.</span><span class="n">xpath</span><span class="p">(</span><span class="s2">"//article"</span><span class="p">):</span>
             <span class="n">item</span> <span class="o">=</span> <span class="n">ArticleItem</span><span class="p">()</span>
     
@@ -384,8 +364,7 @@
         <span class="k">if</span> <span class="n">next_page</span><span class="p">:</span>
             <span class="n">url</span> <span class="o">=</span> <span class="n">response</span><span class="o">.</span><span class="n">urljoin</span><span class="p">(</span><span class="n">next_page</span><span class="p">[</span><span class="mi">0</span><span class="p">]</span><span class="o">.</span><span class="n">extract</span><span class="p">())</span>
             <span class="k">yield</span> <span class="n">scrapy</span><span class="o">.</span><span class="n">Request</span><span class="p">(</span><span class="n">url</span><span class="p">,</span> <span class="bp">self</span><span class="o">.</span><span class="n">parse_articles_follow_next_page</span><span class="p">)</span>
-    </pre></div>
-    </div>
+    </code></pre>
     <p>上述代码将创建一个循环,跟进所有下一页的链接,直到找不到为止 –
     对于爬取博客、论坛以及其他做了分页的网站十分有效。</p>
     <p>另一种常见的需求是从多个页面构建item的数据, 这可以使用
@@ -401,9 +380,8 @@
     <div class="section" id="id9">
     <h2>保存爬取到的数据</h2>
     <p>最简单存储爬取的数据的方式是使用 <a class="reference internal" href="../topics/feed-exports.html#topics-feed-exports"><span>Feed exports</span></a>:</p>
-    <div class="highlight-python"><div class="highlight"><pre><span></span>scrapy crawl dmoz -o items.json
-    </pre></div>
-    </div>
+    <pre><code class="language-python"><span></span>scrapy crawl dmoz -o items.json
+    </code></pre>
     <p>该命令将采用 <a class="reference external" href="http://en.wikipedia.org/wiki/JSON">JSON</a> 格式对爬取的数据进行序列化，生成 <code class="docutils literal"><span class="pre">items.json</span></code> 文件。</p>
     <p>在类似本篇教程里这样小规模的项目中，这种存储方式已经足够。
     如果需要对爬取到的item做更多更为复杂的操作，您可以编写