


How to get the correct number of applicants and viewers when crawling the 58.com work page?
Apr 05, 2025 am 08:39 AM58.com recruitment information crawling: Solve the problem of inconsistent data of applicants and viewers
When crawling the 58.com recruitment page, you often encounter a difficult problem: the number of applicants and the number of viewers displayed by the web page source code does not match the data actually displayed on the page, and the source code is often displayed as 0, while the data updated in real time on the page is consistent with the Elements content in the browser developer tool (F12). This article will explore how to solve this problem and obtain accurate applicants and viewers.
Problem analysis:
In order to prevent data from being maliciously crawled, 58.com adopted the method of dynamically loading data. The number of applicants and viewers on the page is not directly obtained from the HTML source code, but is loaded asynchronously through JavaScript. Therefore, direct parsing HTML source code cannot obtain the correct data.
Solution:
To obtain the correct number of applicants and viewers, you need to find the API interface provided by 58.com. By analyzing network requests, we can find an API interface for obtaining recruitment information statistics, with a URL similar to the following format:
<code>https://statisticszp.58.com/position/totalcount/?infoId=27988...</code>
The infoId
parameter represents the specific position ID and needs to be extracted based on the URL of the target recruitment page.
API returns data example:
The JSON data returned by the API interface contains the information we need:
{ "deliveryCount": 1141, // Number of applicants "commentCount": 0, "infoCount": 4, // Number of viewers "resumeReadPercent": 0, "referUrl": "", "nextUrl": "null" }
The deliveryCount
field indicates the number of applicants, and the infoCount
field indicates the number of viewers.
Implementation steps:
Get Job ID (infoId): Analyze the URL of the target recruitment page and find the parameter value corresponding to the Job ID. This may require the use of regular expressions or other string processing methods.
Construct API request URL: Replace the extracted
infoId
into the API URL template to form a complete API request URL.Send API requests: Use Python's
requests
library or other HTTP clients to send GET requests to the API URL.Analyze JSON data: parse the JSON data returned by the API into a Python dictionary, extract the values ??of
deliveryCount
andinfoCount
, that is, the correct number of applicants and number of viewers.
Through the above steps, you can bypass the dynamic loading mechanism of 58.com's web page and accurately obtain the number of applicants and viewers on the recruitment page. Please note that the address and parameter names of the API interface may change and need to be adjusted according to actual conditions. At the same time, please abide by 58.com's robots.txt rules to avoid excessive pressure on the server.
The above is the detailed content of How to get the correct number of applicants and viewers when crawling the 58.com work page?. For more information, please follow other related articles on the PHP Chinese website!

Hot AI Tools

Undress AI Tool
Undress images for free

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Clothoff.io
AI clothes remover

Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Article

Hot Tools

Notepad++7.3.1
Easy-to-use and free code editor

SublimeText3 Chinese version
Chinese version, very easy to use

Zend Studio 13.0.1
Powerful PHP integrated development environment

Dreamweaver CS6
Visual web development tools

SublimeText3 Mac version
God-level code editing software (SublimeText3)

Hot Topics

In the ever-changing virtual currency market, timely and accurate market data is crucial. The free market website provides investors with a convenient way to understand key information such as price fluctuations, trading volume, and market value changes of various digital assets in real time. These platforms usually aggregate data from multiple exchanges, and users can get a comprehensive market overview without switching between exchanges, which greatly reduces the threshold for ordinary investors to obtain information.

The OEX official website entrance is the primary channel for users to enter the OEX (OEX) platform. The platform is known for its safety, efficiency and convenience, and provides currency trading, contract trading, financial management services, etc. 1. Visit the official website; 2. Click "Register" to fill in your mobile phone number or email address; 3. Set your password and verify; 4. Log in after successful registration. The platform's advantages include high security, simple operation, rich currency, and global service. It also provides beginner's guidance and teaching modules, suitable for all types of investors.

In cryptocurrency trading, stop loss and take profit are the core tools of risk control. 1. Stop loss is used to automatically sell when the price falls to the preset point to prevent the loss from expanding; 2. Take-profit is used to automatically sell when the price rises to the target point and lock in profits; 3. The stop loss can be set using the technical support level method, the fixed percentage method or the volatility reference method; 4. Setting the stop profit can be based on the risk-return ratio method or the key resistance level method; 5. Advanced skills include moving stop loss and batch take-profit to dynamically protect profits and balance risks, thereby achieving long-term and stable trading performance.

This article recommends 6 mainstream Bitcoin price and market viewing tools. 1. Binance provides real-time and accurate data and rich trading functions, suitable for all kinds of users; 2. OKX has a friendly interface and perfect charts, suitable for technical analysis users; 3. Huobi (HTX) data is stable and reliable, and simple and intuitive; 4. Gate.io has rich currency, suitable for users who track a large number of altcoins at the same time; 5. TradingView aggregates multi-exchange data, with powerful chart and technical analysis functions; 6. CoinMarketCap provides overall market performance data, suitable for understanding the macro market of Bitcoin.

The latest rankings of the top ten formal digital currency trading platforms are as follows: 1. Binance ranks first with the first trading volume, rich currency selection and comprehensive ecosystem; 2. OKX follows closely with its powerful trading engine and the Web3 ecosystem integration; 3. Coinbase has become the first choice for European and American users for its high security and compliance; 4. Kraken is favored by institutions for its long history and excellent security; 5. KuCoin is called the "Treasure Hunters Paradise" for launching a large number of potential altcoins; 6. Bybit is known for its derivative trading experience, and has now become a comprehensive exchange; 7. Gate.io has many online currencies and is quickly updated, suitable for veteran players; 8. Huob

Understanding Bitcoin’s real-time price trends is crucial to participating in the cryptocurrency market. This will not only help you make smarter investment decisions, but will also allow you to seize market opportunities in a timely manner and avoid potential risks. By analyzing historical data and current trends, you can have a preliminary judgment on the future price direction. This article will recommend some commonly used market analysis websites for you. We will focus on how to use these websites for market analysis to help you better understand the reasons and trends of Bitcoin price fluctuations.

The real-time price of Dogecoin can be checked through five major platforms. 1. Binance supports trading and trading quota depth; 2. OKX provides Chinese interface and APP for convenient operation; 3. CoinGecko data is fully suitable for beginners; 4. CoinMarketCap aggregates global market conditions and supports price reminders; 5. TradingView is suitable for technical analysts. It is recommended that novices pay attention to the spot market and judge the market situation based on trading volume and in-depth. Advanced users can use professional tools to improve decision-making accuracy.

Google has launched a browser extension called "PasswordCheckup" to help users determine whether their passwords are in a secure state. In the future, this password leakage detection feature will be a default feature of Google Chrome, not just limited to optional extensions. Although the PasswordCheckup extension provided by Google can automatically detect the password security used by users when logging into different websites, interested users can still experience it in advance by downloading the ChromeCanary version. However, it should be noted that this function is turned off by default and users need to turn it on manually. Once the function is enabled, users can know the login they entered when logging in on non-Google sites.
