Large selection of image storage solutions
Jul 06, 2016 pm 01:53 PM
The current architecture of the project is LNMP. The main function is for users to upload large images (5-30M) to the server, and the server will then cut the large image into hundreds of small images. Load the thumbnail after front-end access.
I have no experience in using CDN and OSS. I only know about Qiniu’s image storage, which is used by companies in the same industry. In the past few days, a certain work in the project was forwarded a lot on WeChat and the number of visits was relatively large (10W PV that day) , causing a bottleneck in the server bandwidth, I am temporarily using Alibaba Cloud's CDN to accelerate static images. Since I did not consider using independent storage to process images in the early planning, I now want to separate the images.
There are currently 3 bottlenecks:
1. CPU: When cutting a large picture into small pictures, the CPU usage is very high. If more than 20 users are cutting pictures at the same time, the CPU will basically reach 80%. The CPU is currently 8-core from Alibaba Cloud, and the memory is 16G, which is enough memory. According to our current user base, there will be no more than 20 users cutting pictures online at the same time.
2. Storage: Since users can upload large images without restrictions, it is also a problem to store images on a single machine. Currently, it is a 1T ordinary hard drive
3. Bandwidth: Currently, the fixed bandwidth is 10M, which is enough under normal traffic conditions , if a work is sent to WeChat Moments by a user and a large number of reposts occur, the bandwidth will not be enough under high concurrency conditions.
Solution:
1. Use Qiniu's picture storage. The only troublesome thing about using Qiniu is the synchronization of pictures. Pictures uploaded by users may be modified and deleted, and they need to be synchronized to Qiniu immediately. I don’t know if there will be slow synchronization or other unknown problems.
2. Use Alibaba’s OSS CDN. Since the server is now also an Alibaba product, image synchronization can be done through the intranet, and the speed should be better. However, I saw some information saying that Alibaba’s fees are much more expensive than Qiniu. I haven’t compared them, so I don’t know how big the gap is.
Which of these two options is reasonable? Is there any better option? Thanks!
Reply content:
The current architecture of the project is LNMP. The main function is for users to upload large images (5-30M) to the server, and the server will then cut the large image into hundreds of small images. Load the thumbnail after front-end access.
I have no experience in using CDN and OSS. I only know about Qiniu’s image storage, which is used by companies in the same industry. In the past few days, a certain work in the project was forwarded a lot on WeChat and the number of visits was relatively large (10W PV that day) , causing a bottleneck in the server bandwidth, I am temporarily using Alibaba Cloud's CDN to accelerate static images. Since I did not consider using independent storage to process images in the early planning, I now want to separate the images.
There are currently 3 bottlenecks:
1. CPU: When cutting a large picture into small pictures, the CPU usage is very high. If more than 20 users are cutting pictures at the same time, the CPU will basically reach 80%. The CPU is currently 8-core from Alibaba Cloud, and the memory is 16G, which is enough memory. According to our current user base, there will be no more than 20 users cutting pictures online at the same time.
2. Storage: Since users can upload large images without restrictions, it is also a problem to store images on a single machine. Currently, it is a 1T ordinary hard drive
3. Bandwidth: Currently, the fixed bandwidth is 10M, which is enough under normal traffic conditions , if a work is sent to WeChat Moments by a user and a large number of reposts occur, the bandwidth will not be enough under high concurrency conditions.
Solution:
1. Use Qiniu's picture storage. The only troublesome thing about using Qiniu is the synchronization of pictures. Pictures uploaded by users may be modified and deleted, and they need to be synchronized to Qiniu immediately. I don’t know if there will be slow synchronization or other unknown problems.
2. Use Alibaba’s OSS CDN. Since the server is now also an Alibaba product, image synchronization can be done through the intranet, and the speed should be better. However, I saw some information saying that Alibaba’s fees are much more expensive than Qiniu. I haven’t compared them, so I don’t know how big the gap is.
Which of these two options is reasonable? Is there any better option? Thanks!
In fact, Qiniu will be better. The problems you are worried about can be solved. Many times the problems arise because the designers are taking advantage of them. For example, do you want to modify the picture? Just delete the new ones and create new ones. If the names have changed, they will not be affected by the cache.
As for the problem of cutting pictures you mentioned... why do you need to cut pictures online? Can't you cut it yourself? Do I have to cut the original image? Cutting a 30M original image and cutting a 600K thumbnail definitely occupy different resources. Do you enlarge the 30M original image to 100% for users to cut?
Alibaba’s price should be cheaper than Qiniu’s. Alibaba Baichuan previously had 100GB of free storage space
Users directly transfer to Qiniu. Please refer to the official documentation for details. There is a demo
Hot AI Tools
Undress AI Tool
Undress images for free
Undresser.AI Undress
AI-powered app for creating realistic nude photos
AI Clothes Remover
Online AI tool for removing clothes from photos.
Clothoff.io
AI clothes remover
Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!
Hot Article
Hot Tools
Notepad++7.3.1
Easy-to-use and free code editor
SublimeText3 Chinese version
Chinese version, very easy to use
Zend Studio 13.0.1
Powerful PHP integrated development environment
Dreamweaver CS6
Visual web development tools
SublimeText3 Mac version
God-level code editing software (SublimeText3)
Hot Topics
How to get the current session ID in PHP?
Jul 13, 2025 am 03:02 AM
The method to get the current session ID in PHP is to use the session_id() function, but you must call session_start() to successfully obtain it. 1. Call session_start() to start the session; 2. Use session_id() to read the session ID and output a string similar to abc123def456ghi789; 3. If the return is empty, check whether session_start() is missing, whether the user accesses for the first time, or whether the session is destroyed; 4. The session ID can be used for logging, security verification and cross-request communication, but security needs to be paid attention to. Make sure that the session is correctly enabled and the ID can be obtained successfully.
PHP get substring from a string
Jul 13, 2025 am 02:59 AM
To extract substrings from PHP strings, you can use the substr() function, which is syntax substr(string$string,int$start,?int$length=null), and if the length is not specified, it will be intercepted to the end; when processing multi-byte characters such as Chinese, you should use the mb_substr() function to avoid garbled code; if you need to intercept the string according to a specific separator, you can use exploit() or combine strpos() and substr() to implement it, such as extracting file name extensions or domain names.
How do you perform unit testing for php code?
Jul 13, 2025 am 02:54 AM
UnittestinginPHPinvolvesverifyingindividualcodeunitslikefunctionsormethodstocatchbugsearlyandensurereliablerefactoring.1)SetupPHPUnitviaComposer,createatestdirectory,andconfigureautoloadandphpunit.xml.2)Writetestcasesfollowingthearrange-act-assertpat
How to split a string into an array in PHP
Jul 13, 2025 am 02:59 AM
In PHP, the most common method is to split the string into an array using the exploit() function. This function divides the string into multiple parts through the specified delimiter and returns an array. The syntax is exploit(separator, string, limit), where separator is the separator, string is the original string, and limit is an optional parameter to control the maximum number of segments. For example $str="apple,banana,orange";$arr=explode(",",$str); The result is ["apple","bana
JavaScript Data Types: Primitive vs Reference
Jul 13, 2025 am 02:43 AM
JavaScript data types are divided into primitive types and reference types. Primitive types include string, number, boolean, null, undefined, and symbol. The values are immutable and copies are copied when assigning values, so they do not affect each other; reference types such as objects, arrays and functions store memory addresses, and variables pointing to the same object will affect each other. Typeof and instanceof can be used to determine types, but pay attention to the historical issues of typeofnull. Understanding these two types of differences can help write more stable and reliable code.
Using std::chrono in C
Jul 15, 2025 am 01:30 AM
std::chrono is used in C to process time, including obtaining the current time, measuring execution time, operation time point and duration, and formatting analysis time. 1. Use std::chrono::system_clock::now() to obtain the current time, which can be converted into a readable string, but the system clock may not be monotonous; 2. Use std::chrono::steady_clock to measure the execution time to ensure monotony, and convert it into milliseconds, seconds and other units through duration_cast; 3. Time point (time_point) and duration (duration) can be interoperable, but attention should be paid to unit compatibility and clock epoch (epoch)
How to pass a session variable to another page in PHP?
Jul 13, 2025 am 02:39 AM
In PHP, to pass a session variable to another page, the key is to start the session correctly and use the same $_SESSION key name. 1. Before using session variables for each page, it must be called session_start() and placed in the front of the script; 2. Set session variables such as $_SESSION['username']='JohnDoe' on the first page; 3. After calling session_start() on another page, access the variables through the same key name; 4. Make sure that session_start() is called on each page, avoid outputting content in advance, and check that the session storage path on the server is writable; 5. Use ses
How does PHP handle Environment Variables?
Jul 14, 2025 am 03:01 AM
ToaccessenvironmentvariablesinPHP,usegetenv()orthe$_ENVsuperglobal.1.getenv('VAR_NAME')retrievesaspecificvariable.2.$_ENV['VAR_NAME']accessesvariablesifvariables_orderinphp.iniincludes"E".SetvariablesviaCLIwithVAR=valuephpscript.php,inApach
