国产av日韩一区二区三区精品,成人性爱视频在线观看,国产,欧美,日韩,一区,www.成色av久久成人,2222eeee成人天堂

Table of Contents
自己寫的php curl庫(kù)實(shí)現(xiàn)整站克隆功能,phpcurl
Home php教程 php手冊(cè) 自己寫的php curl庫(kù)實(shí)現(xiàn)整站克隆功能,phpcurl

自己寫的php curl庫(kù)實(shí)現(xiàn)整站克隆功能,phpcurl

Jun 13, 2016 am 09:14 AM
curl php

自己寫的php curl庫(kù)實(shí)現(xiàn)整站克隆功能,phpcurl

有時(shí)候經(jīng)常會(huì)用到一些在線手冊(cè),比如國(guó)內(nèi)或國(guó)外的,有些是訪問(wèn)速度慢,有些是作者直接吧網(wǎng)站關(guān)閉了,有些是服務(wù)器總是宕機(jī),所以還是全盤克隆到自己服務(wù)器比較爽。

庫(kù)特點(diǎn):

給定一初始連接,初始鏈接以下的層級(jí)所有文件會(huì)拷貝到本地。
多次克隆可以配置是否覆蓋。
可以配置是否下載圖片。
所有鏈接替換為相對(duì)鏈接,所以可以隨便rewrite。
絕對(duì)不會(huì)出現(xiàn)文件覆蓋等問(wèn)題。
最NB的特點(diǎn)是,沒(méi)有比這更NB的庫(kù)了。

SVN:http://svn.phpdr.net/repos/ares/php/library/trunk/lib/CurlMulti/MyCurl/Clone.php

幫客之家下載:http://xiazai.jb51.net/201502/other/CurlMulti.rar

克隆結(jié)果展示(這個(gè)克隆操作幾秒鐘就完成了):

克隆源網(wǎng)站:http://www.laruence.com/manual/
克隆結(jié)果:http://manual.phpdr.net/yaf/

Demo代碼:

復(fù)制代碼 代碼如下:


class Controller_Spider extends MyYaf_Controller_Base{
?function init(){
??parent::init();
??if(!$this->getRequest()->isCli()){
????? Ares_Http::error403();
??}
??include 'CurlMulti/CurlMulti.php';
??include 'CurlMulti/MyCurl.php';
??include 'phpQuery.php';
?}
}

復(fù)制代碼 代碼如下:


class YafdocController extends Controller_Spider {
?function init() {
??parent::init ();
??include 'CurlMulti/MyCurl/Clone.php';
?}
?function indexAction() {
??$url = 'http://www.laruence.com/manual';
??$dir = Yaf_Application::app ()->getAppDirectory () . '/data/manual';
??$cacheDir = $this->getBaseDir () . '/cache/curl';
??if (! is_dir ( $cacheDir )) {
???mkdir ( $cacheDir );
??}
??$curl = new CurlMulti ();
??$curl->maxThread = 10;
??$curl->cache ['enable'] = true;
??$curl->cache ['enableDownload'] = true;
??$curl->cache ['dir'] = $cacheDir;
??$curl->cache ['compress'] = true;
??$clone = new MyCurl_Clone ( $curl, $url, $dir );
??$clone->overwrite = true;
??$clone->start ();
??return false;
?}
}

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undress AI Tool

Undress AI Tool

Undress images for free

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

Why We Comment: A PHP Guide Why We Comment: A PHP Guide Jul 15, 2025 am 02:48 AM

PHPhasthreecommentstyles://,#forsingle-lineand/.../formulti-line.Usecommentstoexplainwhycodeexists,notwhatitdoes.MarkTODO/FIXMEitemsanddisablecodetemporarilyduringdebugging.Avoidover-commentingsimplelogic.Writeconcise,grammaticallycorrectcommentsandu

How to Install PHP on Windows How to Install PHP on Windows Jul 15, 2025 am 02:46 AM

The key steps to install PHP on Windows include: 1. Download the appropriate PHP version and decompress it. It is recommended to use ThreadSafe version with Apache or NonThreadSafe version with Nginx; 2. Configure the php.ini file and rename php.ini-development or php.ini-production to php.ini; 3. Add the PHP path to the system environment variable Path for command line use; 4. Test whether PHP is installed successfully, execute php-v through the command line and run the built-in server to test the parsing capabilities; 5. If you use Apache, you need to configure P in httpd.conf

PHP Syntax: The Basics PHP Syntax: The Basics Jul 15, 2025 am 02:46 AM

The basic syntax of PHP includes four key points: 1. The PHP tag must be ended, and the use of complete tags is recommended; 2. Echo and print are commonly used for output content, among which echo supports multiple parameters and is more efficient; 3. The annotation methods include //, # and //, to improve code readability; 4. Each statement must end with a semicolon, and spaces and line breaks do not affect execution but affect readability. Mastering these basic rules can help write clear and stable PHP code.

python if else example python if else example Jul 15, 2025 am 02:55 AM

The key to writing Python's ifelse statements is to understand the logical structure and details. 1. The infrastructure is to execute a piece of code if conditions are established, otherwise the else part is executed, else is optional; 2. Multi-condition judgment is implemented with elif, and it is executed sequentially and stopped once it is met; 3. Nested if is used for further subdivision judgment, it is recommended not to exceed two layers; 4. A ternary expression can be used to replace simple ifelse in a simple scenario. Only by paying attention to indentation, conditional order and logical integrity can we write clear and stable judgment codes.

PHP 8 Installation Guide PHP 8 Installation Guide Jul 16, 2025 am 03:41 AM

The steps to install PHP8 on Ubuntu are: 1. Update the software package list; 2. Install PHP8 and basic components; 3. Check the version to confirm that the installation is successful; 4. Install additional modules as needed. Windows users can download and decompress the ZIP package, then modify the configuration file, enable extensions, and add the path to environment variables. macOS users recommend using Homebrew to install, and perform steps such as adding tap, installing PHP8, setting the default version and verifying the version. Although the installation methods are different under different systems, the process is clear, so you can choose the right method according to the purpose.

Your First PHP Script: A Practical Introduction Your First PHP Script: A Practical Introduction Jul 16, 2025 am 03:42 AM

How to start writing your first PHP script? First, set up the local development environment, install XAMPP/MAMP/LAMP, and use a text editor to understand the server's running principle. Secondly, create a file called hello.php, enter the basic code and run the test. Third, learn to use PHP and HTML to achieve dynamic content output. Finally, pay attention to common errors such as missing semicolons, citation issues, and file extension errors, and enable error reports for debugging.

What is PHP and What is it Used For? What is PHP and What is it Used For? Jul 16, 2025 am 03:45 AM

PHPisaserver-sidescriptinglanguageusedforwebdevelopment,especiallyfordynamicwebsitesandCMSplatformslikeWordPress.Itrunsontheserver,processesdata,interactswithdatabases,andsendsHTMLtobrowsers.Commonusesincludeuserauthentication,e-commerceplatforms,for

how to handle undefined index in PHP how to handle undefined index in PHP Jul 15, 2025 am 02:08 AM

The "undefinedindex" error occurs because a key that does not exist in the array is accessed. Solutions include: 1. Use isset() to check whether the key exists, which is suitable for processing user input; 2. Use array_key_exists() to determine whether the key is set, and it can be recognized even if the value is null; 3. Use the empty merge operator?? to set the default value to avoid directly accessing undefined keys; in addition, you need to pay attention to common problems such as the spelling of form field names, the database result is empty, the array unpacking is not verified, the child keys are not checked in foreach, and the session_start() is not called.

See all articles