Trending on TikTok

Buldak

Sunscreen

Sanrio

English

{{sellerTotalView > 1 ? __("sellers", {number: sellerTotalView}) : __("seller", {number: sellerTotalView}) }}, {{numTotalView > 1 ? __("items", {number: numTotalView}) : __("item", {number: numTotalView}) }}

View Cart & Check Out

Nickname

Let us know how to properly address you.

Update Your Name

xxxxxxx@yamibuy.com

Account Orders Favorites

Points 0

Coupons 0

Gift Card Balance $0.00

Sign Out

Change Your Zip Code

Inventory information and delivery speeds may vary for different locations.

Location History

We will notify you by email when the item back in stock.

Your email: {{remindEmail}}

Cancel

Jingdong book

Python网络数据采集

View Cart & Check Out

{{buttonTypePin == 3 ? __("Scan to view more PinGo") : __("Scan to start")}}

Books Computers & Internet Programming Language and Programming

Jingdong book

Python网络数据采集

Name: Python网络数据采集
Brand: Jingdong book
SKU: 3118203911
Price: 46.77 USD
Availability: OutOfStock

{{__(":people-members", {'people': item.limit_people_count})}} {{ itemCurrency }}{{ item.valid_price }} {{ itemCurrency }}{{ item.invalid_price }} {{ itemDiscount }}

Ends in

{{ itemCurrency }}{{ priceFormat(item.valid_price / item.bundle_specification) }}/{{ item.unit }}

{{ itemCurrency }}{{ item.valid_price }} {{ itemCurrency }}{{ priceFormat(item.valid_price / item.bundle_specification) }}/{{ item.unit }} {{ itemCurrency }}{{ item.invalid_price }} {{itemDiscount}}

Sale ends in

Sale will starts after Sale ends in

{{ __( "Pay with Gift Card to get sale price: :itemCurrency:price", { 'itemCurrency' : itemCurrency, 'price' : (item.giftcard_price ? priceFormat(item.giftcard_price) : '0.00') } ) }} ({{ itemCurrency }}{{ priceFormat(item.giftcard_price / item.bundle_specification) }}/{{ item.unit }}) Details

Best before

Currently unavailable.

We don't know when or if this item will be back in stock.

Unavailable in your area.

Sold Out

Details

Full product details

Editer Recommend

网络上的数据量越来越大，单靠浏览网页获取信息越来越困难，如何有效地提取并利用信息已成为一个巨大的挑战。本书采用简洁强大的Python语言，全面介绍网络数据采集技术，教你从不同形式的网络资源中自由地获取数据。你将学会如何使用Python脚本和网络API一次性采集并处理成千上万个网页上的数据。

本书适合熟悉Python的程序员、安全专业人士、网络管理员阅读。书中不仅介绍了网络数据采集的基本原理，还深入探讨了更高级的主题，比如分析原始数据、用网络爬虫测试网站等。此外，书中还提供了详细的代码示例，以帮助你更好地理解书中的内容。

通过阅读本书，你将能够：

解析复杂的HTML页面

遍历多个网页和网站

了解API的基本概念和工作原理

学习存储数据的方法

下载、读取并抽取网络文档中的数据

使用工具和方法清洗格式异常的数据

读取并处理自然语言

越过表单和登录窗口采集数据

学习采集JavaScript的方法

学习图像处理和文字识别方法

Content Description

本书采用简洁强大的Python语言，介绍了网络数据采集，并为采集新式网络中的各种数据类型提供了全面的指导。第1部分重点介绍网络数据采集的基本原理：如何用Python从网络服务器请求信息，如何对服务器的响应进行基本处理，以及如何以自动化手段与网站进行交互。第二部分介绍如何用网络爬虫测试网站，自动化处理，以及如何通过更多的方式接入网络。

Author Description

Ryan Mitchell，数据科学家、软件工程师，目前在波士顿LinkeDrive公司负责开发公司的API和数据分析工具。此前，曾在Abine公司构建网络爬虫和网络机器人。她经常做网络数据采集项目的咨询工作，主要面向金融和零售业。另著有Instant Web Scraping with Java。

Catalogue

译者序 ix
前言 xi
第一部分创建爬虫
第1章初见网络爬虫 2
1．1网络连接 2
1．2BeautifulSoup简介 4
1．2．1安装BeautifulSoup 5
1．2．2运行BeautifulSoup 7
1．2．3可靠的网络连接 8
第2章复杂HTML解析 11
2．1不是一直都要用锤子 11
2．2再端一碗BeautifulSoup 12
2．2．1BeautifulSoup的find()和findAll() 13
2．2．2其他BeautifulSoup对象 15
2．2．3导航树 16
2．3正则表达式 19
2．4正则表达式和BeautifulSoup 23
2．5获取属性 24
2．6Lambda表达式 24
2．7超越BeautifulSoup 25
第3 章开始采集 26
3．1遍历单个域名 26
3．2采集整个网站 30
3．3通过互联网采集 34
3．4用Scrapy 采集 38
第4 章使用API 42
4．1API 概述 43
4．2API 通用规则 43
4．2．1方法 44
4．2．2验证 44
4．3服务器响应 45
4．4Echo Nest 46
4．5Twitter API 48
4．5．1开始 48
4．5．2几个示例 50
4．6Google API 52
4．6．1开始 52
4．6．2几个示例 53
4．7解析JSON 数据 55
4．8回到主题 56
4．9再说一点API 60
第5 章存储数据 61
5．1媒体文件 61
5．2把数据存储到CSV 64
5．3MySQL 65
5．3．1安装MySQL 66
5．3．2基本命令 68
5．3．3与Python 整合 71
5．3．4数据库技术与最佳实践 74
5．3．5MySQL 里的“六度空间游戏” 75
5．4Email 77
第6 章读取文档 80
6．1文档编码 80
6．2纯文本 81
6．3CSV 85
6．4PDF 87
6．5微软Word 和．docx 88
第二部分高级数据采集
第7 章数据清洗 94
7．1编写代码清洗数据 94
7．2数据存储后再清洗 98
第8 章自然语言处理 103
8．1概括数据 104
8．2马尔可夫模型 106
8．3自然语言工具包 112
8．3．1安装与设置 112
8．3．2用NLTK 做统计分析 113
8．3．3用NLTK 做词性分析 115
8．4其他资源 119
第9 章穿越网页表单与登录窗口进行采集 120
9．1Python Requests 库 120
9．2提交一个基本表单 121
9．3单选按钮、复选框和其他输入 123
9．4提交文件和图像 124
9．5处理登录和cookie 125
9．6其他表单问题 127
第10 章采集JavaScript 128
10．1JavaScript 简介 128
10．2Ajax 和动态HTML 131
10．3处理重定向 137
第11 章图像识别与文字处理 139
11．1OCR 库概述 140
11．1．1Pillow 140
11．1．2Tesseract 140
11．1．3NumPy 141
11．2处理格式规范的文字 142
11．3读取验证码与训练Tesseract 146
11．4获取验证码提交答案 151
第12 章避开采集陷阱 154
12．1道德规范 154
12．2让网络机器人看起来像人类用户 155
12．2．1修改请求头 155
12．2．2处理cookie 157
12．2．3时间就是一切 159
12．3常见表单安全措施 159
12．3．1隐含输入字段值 159
12．3．2避免蜜罐 160
12．4问题检查表 162
第13 章用爬虫测试网站 164
13．1测试简介 164
13．2Python 单元测试 165
13．3Selenium 单元测试 168
13．4Python 单元测试与Selenium 单元测试的选择 172
第14 章远程采集 174
14．1为什么要用远程服务器 174
14．1．1避免IP 地址被封杀 174
14．1．2移植性与扩展性 175
14．2Tor 代理服务器 176
14．3远程主机 177
14．3．1从网站主机运行 178
14．3．2从云主机运行 178
14．4其他资源 179
14．5勇往直前 180
附录APython 简介 181
附录B互联网简介 184
附录C网络数据采集的法律与道德约束 188
作者简介 200
封面介绍 200

Specifications

Brand

Jingdong book

Brand Origin

China

Disclaimer

Product packaging, specifications and price are subject to change without notice. All information about the products on our website is provided for information purposes only. Please always read labels, warnings and directions provided with the product before use.

View Full Terms of Use

Scan to Share

Add to favorites

{{ $isZh ? coupon.coupon_name_sub : coupon.coupon_ename_sub | formatCurrency }}

Clip coupons

Quantity

{{buttonTypePin == 3 ? __("Scan to view more PinGo") : __("Scan to start")}}

Sold by JD@CHINA

Ship to

Free shipping over 69

Genuine guarantee

View details

Region

Added to Cart

Keep Shopping

More to Consider

Coupons

Clip Clipped Over

Expires soon {{ formatTime(coupon.use_end_time) }}

Share this item with friends

Cancel

Yami Gift Card

Get this exclusive deal when paying with gift card

Terms and Conditions

Gift card deals are special offers for selected products;

The gift card deals will automatically be activated if a customer uses gift card balance at check out and the balance is sufficient to pay for the total price of the shopping cart products with gift card deals;

You will not be able to activate the gift card deals if you choose other payment methods besides gift card. The products will be purchased at their normal prices;

If your account balance is not enough to pay for the products with gift card deals, you can choose to reload your gift card balance by clicking on the Reload button at either shopping cart page or check out page;

Products that have gift card deals can be recognized by a special symbol showing 'GC Deal';

For any additional questions or concerns, please contact our customer service;

Yamibuy reserves the right of final interpretation.

Sold by Yami

Service Guarantee

Free Shipping over $49

Easy Returns

Ships from United States

Shipping

United States

Standard Shipping is $5.99 (Excluding Alaska & Hawaii). Free on orders of $49 or more.

Local Express is $5.99 (Available in Parts of CA, NJ, MA & PA). Free on orders of $49 or more.

2-Day Express (Includes Alaska & Hawaii) starts at $19.99.

Return Policy

Yami is committed to provide our customers with a peace of mind when purchasing from us. Most items shipped from Yamibuy.com can be returned within 30 days of receipt of shipment (For Food, Beverages, Snacks, Dry Goods, Health supplements, Fresh Grocery and Perishables Goods, within 7 days of receipt of shipment due to damages or quality issues; To ensure that every customer receives safe and high-quality products, we do not provide refunds or returns for beauty products once they have been opened or used, except in the case of quality issues; Some products may have different policies or requirements associated with them, please see below for products under special categories, or contact Yami Customer Service for further assistance).
Thank you for your understanding and support.

Learn More

Sold by Yami

Terms and Conditions of Yami E-Gift Card

If you choose “Redeem automatically” as your delivery method, your gift card balance will be reload automatically after your order has been processed successfully;

If you choose “Send to Email”as your delivery method, the card number and CVV will be sent to the email address automatically;

Any user can use the card number and CVV to redeem the gift card, please keep your gift card information safely. If you have any trouble receiving email, please contact Yami customer service;

Yami gift card can be used to purchase both Yami owned or Marketplace products;

Yami gift card will never expire;

Yami gift card balance does not have to be used up at once;

Return Policy

Gift card that has already been consumed is non-refundable.

Sold by JD@CHINA

Fulfilled by Yami

Service Guarantee

Free Shipping over $49

Easy Returns

Ships from United States

Shipping

United States

Standard Shipping is $5.99 (Excluding Alaska & Hawaii). Free on orders of $49 or more.

Local Express is $5.99 (Available in Parts of CA, NJ, MA & PA). Free on orders of $49 or more.

2-Day Express (Includes Alaska & Hawaii) starts at $19.99.

Return Policy

You may return product within 30 days upon receiving the product. Items returned must be new in it's original packing, including the original invoice for the purchase. Customer return product at their own expense.

Sold by JD@CHINA

Yami-China FC

Service Guarantee

Cross-store Free Shipping over $69

30-days Return

Yami-China FC

Yami has a consolidation warehouse in China which collects multiple sellers’ packages and combines to one order. Our Yami consolidation warehouse will directly ship the packages to your door. Cross-store free shipping over $69.

Return Policy

You may return products within 30 days upon receiving the products. Sellers take responsibilities for any wrong shipment or missing items. Packing needs to be unopened for any other than quality issues return. We promise to pack carefully, but because goods are taking long journey to destinations, simple damages to packaging may occur. Any damages not causing internal goods quality problems are not allowed to return. If you open the package and any quality problem is found, please contact customer service within three days after receipt of goods.

Shipping Information

Yami Consolidation Service Shipping Fee $9.99(Free shipping over $69)

Sellers in China will ship their orders within 1-2 business days once the order is placed. Packages are sent to our consolidation warehouse in China and combined there. Our Yami consolidation warehouse will directly ship the packages to you via UPS. The average time for UPS to ship from China to the United States is about 10 working days and it can be traced using the tracking number. Due to the pandemic, the delivery time may be delayed by about 5 days. The package needs to be signed by the guest. If the receipt is not signed, the customer shall bear the risk of loss of the package.

Sold by JD@CHINA

Service Guarantee

Free shipping over 69

Genuine guarantee

Shipping

Yami Consolidated Shipping $9.99(Free shipping over $69)

Seller will ship the orders within 1-2 business days. The logistics time limit is expected to be 7-15 working days. In case of customs clearance, the delivery time will be extended by 3-7 days. The final receipt date is subject to the information of the postal company.

Yami Points information

All items are excluding from any promotion or points events on Yamibuy.com

Return Policy

Download the Yami App

Feedback

Back Top

Reviews{{'('+ commentList.posts_count + ')'}}

Have your say. Be the first to help other guests.

Write a review

{{i}} star

{{i}} stars

{{ parseInt(commentRatingList[i]) }}%

{{ showTranslate(comment) }}Show Less

{{ strLimit(comment,800) }}Show more

Show Original

Show All

{{ formatTime(comment.in_dtm) }} VERIFIED PURCHASE {{groupData}}

{{ comment.likes_count }} {{ comment.likes_count }} {{ comment.reply_count }} {{comment.in_user==uid ? __('Delete') : __('Report')}}

{{ showTranslate(comment) }}Show Less

{{ strLimit(comment,800) }}Show more

Show Original

Show All

{{ formatTime(comment.in_dtm) }} VERIFIED PURCHASE {{groupData}}

{{ comment.likes_count }} {{ comment.likes_count }} {{ comment.reply_count }} {{comment.in_user==uid ? __('Delete') : __('Report')}}

No related comment~

Load more reviews

Review

{{ showTranslate(commentDetails) }}Show Less

{{ strLimit(commentDetails,800) }}Show more

Show Original

Show All

{{ formatTime(commentDetails.in_dtm) }} VERIFIED PURCHASE {{groupData}}

Please write at least one word

Comments{{'(' + replyList.length + ')'}}