Backend Development
Golang
How to optimize the performance of large number of image link replacements using Golang?
How to optimize the performance of large number of image link replacements using Golang?
Apr 02, 2025 pm 12:12 PM
This article discusses how to optimize Golang code and efficiently handle large-scale image link replacement, especially for scenarios where images are uploaded to Alibaba Cloud OSS and replaced the original link. Performance bottlenecks are often frequent network requests and resource creation.
Assume that the initial string contains multiple image links:
<code>content := `<img class="wscnph lazy" src="/static/imghw/default1.png" data-src="https://img.php.cn/upload/article/001/246/273/174278558460021.jpg" alt="How to optimize the performance of large number of image link replacements using Golang?" ><img class="wscnph lazy" src="/static/imghw/default1.png" data-src="https://img.php.cn/upload/article/001/246/273/174278558769141.jpg" alt="How to optimize the performance of large number of image link replacements using Golang?" > `</code>
We need to match the link, upload it to OSS, and replace the original link. The original code has performance problems, which are mainly reflected in the repeated creation of OSS clients and blocking uploads.
For optimization, we will adopt the following strategies:
Singleton OSS client: Use
sync.Onceto ensure thatoss.Newis executed only once, avoiding repeated creation of OSS client instances.Concurrent upload: Use
goroutineto upload images concurrently to OSS to avoid blocking the main thread.Caching mechanism (optional): Introduce caches (such as
sync.Map) to store old and new link mappings of uploaded images to avoid repeated uploads of the same images.
The improved code is as follows:
package main
import (
"bytes"
"fmt"
"regexp"
"strconv"
"strings"
"sync"
"time"
"github.com/aliyun/aliyun-oss-go-sdk/oss"
)
// ... (Aliyun OSS configuration: Endpoint, key, AccessKeySecret, BucketName) ...
var (
ossClient *oss.Client
once sync.Once
imgCache sync.Map // key: old URL, value: new URL
)
func getOSSClient() *oss.Client {
once.Do(func() {
client, err := oss.New(Endpoint, key, AccessKeySecret)
if err != nil {
panic(err) // Handle error appropriately in production
}
ossClient = client
})
return ossClient
}
func Upload(url string) (string, error) {
client := getOSSClient()
bucket, err := client.Bucket(BucketName)
if err != nil {
return "", err
}
t1 := time.Now().Unix()
long := 0 // Simplified counter, consider a more robust solution
obj := fmt.Sprintf("article/%d%d.png", t1, long)
err = bucket.PutObject(obj, bytes.NewReader(ReadImgData(url))) // ReadImgData function assumed to exist
if err != nil {
return "", err
}
return "https://" BucketName "." Endpoint "/" obj, nil
}
func RepImages(htmls string) string {
var imgRE = regexp.MustCompile(`<img alt="How to optimize the performance of large number of image link replacements using Golang?" > ]*src=["']([^"'] )["'][^>]*>`) // Improved regex
imgs := imgRE.FindAllStringSubmatch(htmls, -1)
var wg sync.WaitGroup
resultChan := make(chan string, len(imgs))
for _, img := range imgs {
if len(img) > 1 {
oldURL := img[1]
if newURL, ok := imgCache.Load(oldURL); ok {
resultChan <img class="wscnph lazy" src="/static/imghw/default1.png" data-src="https://img.php.cn/upload/article/001/246/273/174278558769141.jpg" alt="How to optimize the performance of large number of image link replacements using Golang?" > `
fmt.Println(RepImages(content))
}
// Placeholder for the actual image reading function
func ReadImgData(url string) []byte {
// Replace this with your actual image reading logic
// ...
return []byte("image data")
}
Remember to replace Endpoint , key , AccessKeySecret , and BucketName for your Alibaba Cloud OSS configuration. ReadImgData function needs to be implemented according to your actual situation. This improved version utilizes concurrency and caching, significantly improving the efficiency of handling large number of image links. Error handling has also been strengthened to avoid program crashes. The caching mechanism can be further optimized, such as using LRU caching policies to manage memory usage.
The above is the detailed content of How to optimize the performance of large number of image link replacements using Golang?. For more information, please follow other related articles on the PHP Chinese website!
Hot AI Tools
Undress AI Tool
Undress images for free
Undresser.AI Undress
AI-powered app for creating realistic nude photos
AI Clothes Remover
Online AI tool for removing clothes from photos.
Clothoff.io
AI clothes remover
Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!
Hot Article
Hot Tools
Notepad++7.3.1
Easy-to-use and free code editor
SublimeText3 Chinese version
Chinese version, very easy to use
Zend Studio 13.0.1
Powerful PHP integrated development environment
Dreamweaver CS6
Visual web development tools
SublimeText3 Mac version
God-level code editing software (SublimeText3)
Hot Topics
What is Impossible Cloud Network (ICNT)? How? A comprehensive introduction to the ICN project that Binance will launch soon
Jul 07, 2025 pm 07:06 PM
Contents 1. What is ICN? 2. ICNT latest updates 3. Comparison and economic model between ICN and other DePIN projects and economic models 4. Conclusion of the next stage of the DePIN track At the end of May, ICN (ImpossibleCloudNetwork) @ICN_Protocol announced that it had received strategic investment in NGPCapital with a valuation of US$470 million. Many people's first reaction was: "Has Xiaomi invested in Web3?" Although this was not Lei Jun's direct move, the one who had bet on Xiaomi, Helium, and WorkFusion
High return expectations for cryptocurrency tokens in July 2025: hype or reality?
Jul 04, 2025 pm 08:42 PM
As July 2025 approaches, the crypto market is hotly discussing which tokens may bring high returns. Are names like Pi, PEPE and FloppyPepe really worth the risky investment? Potential cryptocurrencies worth paying attention to in July 2025: virtual fire or real gold? As mid-2025, the heat of discussions on high-yield crypto assets continues to heat up. Bitcoin trends and "altcoin season" expectations have attracted investors' attention. Do tokens like PiNetwork, PEPE and FloppyPepe have the potential to bring considerable investment returns? Let's analyze its prospects one by one. Altcoin Market: Can July get what it wants? Against the backdrop of Bitcoin’s expected record of historical highs, the “altcoin season” seems to be brewing. Back
How to avoid risks in the turmoil in the currency circle? The TOP3 stablecoin list is revealed
Jul 08, 2025 pm 07:27 PM
Against the backdrop of violent fluctuations in the cryptocurrency market, investors' demand for asset preservation is becoming increasingly prominent. This article aims to answer how to effectively hedge risks in the turbulent currency circle. It will introduce in detail the concept of stablecoin, a core hedge tool, and provide a list of TOP3 stablecoins by analyzing the current highly recognized options in the market. The article will explain how to select and use these stablecoins according to their own needs, so as to better manage risks in an uncertain market environment.
2025 Stablecoin Investment Tutorial How to Choose a Safe Stablecoin Platform
Jul 07, 2025 pm 09:09 PM
How do novice users choose a safe and reliable stablecoin platform? This article recommends the Top 10 stablecoin platforms in 2025, including Binance, OKX, Bybit, Gate.io, HTX, KuCoin, MEXC, Bitget, CoinEx and ProBit, and compares and analyzes them from dimensions such as security, stablecoin types, liquidity, user experience, fee structure and additional functions. The data comes from CoinGecko, DefiLlama and community evaluation. It is recommended that novices choose platforms that are highly compliant, easy to operate and support Chinese, such as KuCoin and CoinEx, and gradually build confidence through a small number of tests.
Ripple, Bank of America and XRP: A new era of financial innovation?
Jul 04, 2025 pm 08:36 PM
Ripple is redefining the future landscape of the financial industry by applying for a national bank license and promoting XRP’s new role in the crypto economy. Master the latest trends and in-depth observations and seize the trend opportunities. The cryptocurrency ecosystem is in rapid evolution, and Ripple and its digital asset XRP are undoubtedly at the center of the storm. A series of actions carried out in the US banking system are attracting widespread attention. All this development seems to be a real financial drama, gradually beginning! Ripple's banking industry aspirations are roughly the key to Ripple CEO Brad Garlinghouse is no longer content with the boundaries of traditional fintech. As a key step in strategic upgrades, Ripple
Global stablecoin market value PK! Who is the gold substitute in the bear market
Jul 08, 2025 pm 07:24 PM
This article will discuss the world's mainstream stablecoins and analyze which stablecoins have the risk aversion attribute of "gold substitute" in the market downward cycle (bear market). We will explain how to judge and choose a relatively stable value storage tool in a bear market by comparing the market value, endorsement mechanism, transparency, and comprehensively combining common views on the Internet, and explain this analysis process.
The popularity of the currency circle has returned, why do smart people have begun to quietly increase their positions? Look at the trend from the on-chain data and grasp the next round of wealth password!
Jul 09, 2025 pm 08:30 PM
As the market conditions pick up, more and more smart investors have begun to quietly increase their positions in the currency circle. Many people are wondering what makes them take decisively when most people wait and see? This article will analyze current trends through on-chain data to help readers understand the logic of smart funds, so as to better grasp the next round of potential wealth growth opportunities.
Remittix, Monero and Cryptocurrency - The Evolution of Fiatcoin: Why has it caused heated discussion?
Jul 04, 2025 pm 09:33 PM
Explore Remittix (RTX), Monero (XMR) and Crypto-Fiat Trends: How these projects shape the future of cryptocurrencies through practicality and community orientation. Remittix, Monero and Cryptocurrency Evolution: What is the hottest speculation? The crypto market is always in a dynamic change, and new and old projects are competing for investors' attention. Currently, Remittix (RTX), Monero (XMR) and crypto-fiat currency directions are becoming the focus of discussion. Let’s find out what driving forces are behind this wave of popularity? Remittix: The emerging token with emerging potential is gradually gaining market attention, and its development trajectory has been compared to the early stages of Bitcoin and Ethereum by some people. "CryptoR
