python爬虫之BeautifulSoup 使用select方法详解

python爬虫之BeautifulSoup 使用select方法详解,第1张

概述本文介绍了python爬虫之BeautifulSoup使用select方法详解,分享给大家。具体如下:

本文介绍了Python爬虫之BeautifulSoup 使用select方法详解 ,分享给大家。具体如下:

<HTML><head><Title>The Dormouse's story</Title></head><body><p  name="dromouse"><b>The Dormouse's story</b></p><p >Once upon a time there were three little sisters; and their names were<a href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow"  ID="link1"><!-- ElsIE --></a>,<a href="http://example.com/lacIE" rel="external nofollow" rel="external nofollow" rel="external nofollow"  ID="link2">LacIE</a> and<a href="http://example.com/tillIE" rel="external nofollow" rel="external nofollow" rel="external nofollow"  ID="link3">TillIE</a>;and they lived at the bottom of a well.</p><p >...</p>"""

我们在写 CSS 时,标签名不加任何修饰,类名前加点,ID名前加 #,在这里我们也可以利用类似的方法来筛选元素,用到的方法是 soup.select(),返回类型是 List

(1)通过标签名查找

print soup.select('Title') #[<Title>The Dormouse's story</Title>] print soup.select('a')#[<a  href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link1"><!-- ElsIE --></a>,<a  href="http://example.com/lacIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link2">LacIE</a>,<a  href="http://example.com/tillIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link3">TillIE</a>] print soup.select('b')#[<b>The Dormouse's story</b>]

(2)通过类名查找

print soup.select('.sister')#[<a  href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link1"><!-- ElsIE --></a>,<a  href="http://example.com/tillIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link3">TillIE</a>]

(3)通过 ID 名查找

print soup.select('#link1')#[<a  href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link1"><!-- ElsIE --></a>]

(4)组合查找

组合查找即和写 class 文件时,标签名与类名、ID名进行的组合原理是一样的,例如查找 p 标签中,ID 等于 link1的内容,二者需要用空格分开

print soup.select('p #link1')#[<a  href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link1"><!-- ElsIE --></a>]

直接子标签查找

print soup.select("head > Title")#[<Title>The Dormouse's story</Title>]

(5)属性查找

查找时还可以加入属性元素,属性需要用中括号括起来,注意属性和标签属于同一节点,所以中间不能加空格,否则会无法匹配到。

print soup.select("head > Title")#[<Title>The Dormouse's story</Title>] print soup.select('a[href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ]')#[<a  href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link1"><!-- ElsIE --></a>]

同样,属性仍然可以与上述查找方式组合,不在同一节点的空格隔开,同一节点的不加空格

print soup.select('p a[href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ]')#[<a  href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link1"><!-- ElsIE --></a>]

以上就是本文的全部内容,希望对大家的学习有所帮助,也希望大家多多支持编程小技巧。

总结

以上是内存溢出为你收集整理的python爬虫之BeautifulSoup 使用select方法详解全部内容,希望文章能够帮你解决python爬虫之BeautifulSoup 使用select方法详解所遇到的程序开发问题。

如果觉得内存溢出网站内容还不错,欢迎将内存溢出网站推荐给程序员好友。

欢迎分享,转载请注明来源:内存溢出

原文地址:https://54852.com/langs/1201434.html

(0)
打赏 微信扫一扫微信扫一扫 支付宝扫一扫支付宝扫一扫
上一篇 2022-06-04
下一篇2022-06-04

发表评论

登录后才能评论

评论列表(0条)

    保存