
本文介绍了Python爬虫之BeautifulSoup 使用select方法详解 ,分享给大家。具体如下:
<HTML><head><Title>The Dormouse's story</Title></head><body><p name="dromouse"><b>The Dormouse's story</b></p><p >Once upon a time there were three little sisters; and their names were<a href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link1"><!-- ElsIE --></a>,<a href="http://example.com/lacIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link2">LacIE</a> and<a href="http://example.com/tillIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link3">TillIE</a>;and they lived at the bottom of a well.</p><p >...</p>"""
我们在写 CSS 时,标签名不加任何修饰,类名前加点,ID名前加 #,在这里我们也可以利用类似的方法来筛选元素,用到的方法是 soup.select(),返回类型是 List
(1)通过标签名查找
print soup.select('Title') #[<Title>The Dormouse's story</Title>] print soup.select('a')#[<a href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link1"><!-- ElsIE --></a>,<a href="http://example.com/lacIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link2">LacIE</a>,<a href="http://example.com/tillIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link3">TillIE</a>] print soup.select('b')#[<b>The Dormouse's story</b>](2)通过类名查找
print soup.select('.sister')#[<a href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link1"><!-- ElsIE --></a>,<a href="http://example.com/tillIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link3">TillIE</a>](3)通过 ID 名查找
print soup.select('#link1')#[<a href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link1"><!-- ElsIE --></a>](4)组合查找
组合查找即和写 class 文件时,标签名与类名、ID名进行的组合原理是一样的,例如查找 p 标签中,ID 等于 link1的内容,二者需要用空格分开
print soup.select('p #link1')#[<a href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link1"><!-- ElsIE --></a>]直接子标签查找
print soup.select("head > Title")#[<Title>The Dormouse's story</Title>](5)属性查找
查找时还可以加入属性元素,属性需要用中括号括起来,注意属性和标签属于同一节点,所以中间不能加空格,否则会无法匹配到。
print soup.select("head > Title")#[<Title>The Dormouse's story</Title>] print soup.select('a[href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ]')#[<a href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link1"><!-- ElsIE --></a>]同样,属性仍然可以与上述查找方式组合,不在同一节点的空格隔开,同一节点的不加空格
print soup.select('p a[href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ]')#[<a href="http://example.com/elsIE" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" rel="external nofollow" ID="link1"><!-- ElsIE --></a>]以上就是本文的全部内容,希望对大家的学习有所帮助,也希望大家多多支持编程小技巧。
总结以上是内存溢出为你收集整理的python爬虫之BeautifulSoup 使用select方法详解全部内容,希望文章能够帮你解决python爬虫之BeautifulSoup 使用select方法详解所遇到的程序开发问题。
如果觉得内存溢出网站内容还不错,欢迎将内存溢出网站推荐给程序员好友。
欢迎分享,转载请注明来源:内存溢出
微信扫一扫
支付宝扫一扫
评论列表(0条)