Implementing Rate Limiting for API Requests in Gin

Introduction to Rate Limiting

On the journey so far, you've learned how to build a robust backend for a ToDo application using Go and the Gin framework. You've connected this application to a database to enable data persistence and implemented SQL queries using GORM for effective database management. You also dealt with real-time communication using a WebSocket connection. In this final lesson for this course, we will introduce you to the concept of rate limiting — a crucial technique used to control the flow of incoming requests to your API. Implementing rate limiting ensures that your application can handle high volumes of traffic without being overwhelmed, thereby protecting resources and maintaining service reliability. By the end of this lesson, you’ll be able to incorporate rate limiting into your Gin-based ToDo App.

Understanding Rate Limiting

Rate limiting controls the number of requests a client can make to a server within a specified timeframe. One common method is the token bucket algorithm, which allows a set number of requests per period (for example, one request every second), with an extra capacity known as burst capacity . The token bucket algorithm maintains a "bucket" of tokens, replenished at a steady rate. Each request requires a token, and if tokens are available, the request proceeds. The burst capacity defines how many additional tokens can be stored, allowing short bursts of increased request frequency without immediate throttling. Implementing rate limiting helps prevent service disruptions and misuse, ensures fair client usage, and stabilizes server load by managing request flow efficiently, contributing to application reliability and performance.

Middleware in Gin: Revisiting with a Focus on Rate Limiting

In previous lessons, you learned about middleware in the Gin framework and successfully implemented a request logger to capture HTTP requests details. Middleware, as you know, serves as a crucial intermediary to handle requests and responses efficiently, providing functionalities like error handling, validation, and logging. Building on this foundation, we'll now focus on using middleware for rate limiting — essential for managing request flow and ensuring your application remains stable under heavy load. Our RateLimiterMiddleware in our ToDo App will evaluate incoming requests per client IP to ensure they comply with set API rate policies before reaching their respective handlers. This helps conserve resources and ensures fair usage while preventing any single client from overwhelming the service.

Join the 1M+ learners on CodeSignal

Be a part of our community of 1M+ users who develop and demonstrate their skills on CodeSignal

Implementing the RateLimiterMiddleware

Let's look at the implementation of the rate-limiting middleware within our application:

package middleware

import (
    "github.com/gin-gonic/gin"
    "golang.org/x/time/rate"
    "net/http"
)

var limiters = make(map[string]*rate.Limiter)

// RateLimiterMiddleware limits the number of requests allowed per client IP
func RateLimiterMiddleware() gin.HandlerFunc {
    return func(c *gin.Context) {
        ip := c.ClientIP()

        if _, exists := limiters[ip]; !exists {
            limiters[ip] = rate.NewLimiter(1, 5) // 1 request per second with a burst capacity of 5
        }
        limiter := limiters[ip]

        if !limiter.Allow() {
            c.JSON(http.StatusTooManyRequests, gin.H{"error": "Too Many Requests"})
            c.Abort()
            return
        }
        c.Next()
    }
}

package middleware

import (
    "github.com/gin-gonic/gin"
    "golang.org/x/time/rate"
    "net/http"
)

var limiters = make(map[string]*rate.Limiter)

// RateLimiterMiddleware limits the number of requests allowed per client IP
func RateLimiterMiddleware() gin.HandlerFunc {
    return func(c *gin.Context) {
        ip := c.ClientIP()

        if _, exists := limiters[ip]; !exists {
            limiters[ip] = rate.NewLimiter(1, 5) // 1 request per second with a burst capacity of 5
        }
        limiter := limiters[ip]

        if !limiter.Allow() {
            c.JSON(http.StatusTooManyRequests, gin.H{"error": "Too Many Requests"})
            c.Abort()
            return
        }
        c.Next()
    }
}

Let's briefly discuss what we are doing in this code snippet:

We create a map limiters to keep track of rate limiters associated with each client IP. This allows us to manage the request flow for each client individually.
We define RateLimiterMiddleware as a Gin middleware function, which checks the incoming client IP.
If the client IP doesn’t exist in the map, a new rate limiter is created with a preset rate (1 request/second) and burst capacity of 5.
The rate.Limiter from the package golang.org/x/time/rate is used for efficiently implementing the token bucket algorithm, which controls the request flow.
Each request is evaluated by the associated rate limiter; if a request isn’t allowed, a "Too Many Requests" error is returned, and the request is aborted.

To see the rate limiter in action, test it by making multiple requests from the same client IP within a short span of time. A simple way to test it is to run the following cURL command in a new terminal tab:

Shell

curl localhost:3000/api/todos/[1-10]

curl localhost:3000/api/todos/[1-10]

The bracket expression [1-10] in this command is a feature of cURL that allows you to quickly generate multiple requests by specifying a range of numbers to be appended to the URL. Here, the cURL command makes requests to endpoints such as /api/todos/1, /api/todos/2, and so on up to /api/todos/10. Note that the bracket expression is used purely for generating multiple requests rapidly for testing purposes; the bracket part itself doesn't affect the resources being accessed (in this case).

In this lesson, you learned about the importance of rate limiting and how to implement it within the Gin web framework using middleware. Rate limiting helps maintain the performance, security, and reliability of your API by controlling traffic flow and preventing abuse.

You integrated the rate limiting middleware into the ToDo App and tested it to ensure proper functionality. As you move forward, continue experimenting with different rate-limiting configurations and observe their impact on your API.

Congratulations on adding another important feature to your web application! Keep building your skills with the upcoming exercises.

Introduction to Rate Limiting

Understanding Rate Limiting

Middleware in Gin: Revisiting with a Focus on Rate Limiting

Join the 1M+ learners on CodeSignal

Implementing the RateLimiterMiddleware

Testing the Rate Limiter

Summary and Next Steps