This project features two Go microservices, a Producer and a Consumer, that communicate using gRPC. The services manage tasks within a PostgreSQL database and provide endpoints for Prometheus metrics and pprof profiling.

Architecture & Tooling

• Communication: Utilizes gRPC for efficient, typed, and bi-directional communication.
• Database: Employs PostgreSQL with sqlc for type-safe query generation and golang-migrate for schema migrations, embedded via go:embed.
• Monitoring: Integrates Prometheus and Grafana for metrics visualization.
• Profiling: Leverages net/http/pprof for generating flame graphs and performance analysis.
• Standard Library: Uses log/slog for structured logging, flag and os for configuration, and the standard http package for metrics and profiling. golang.org/x/time/rate is used for rate limiting.

GOGC and GOMEMLIMIT

The GOMEMLIMIT is configured in docker-compose.yml to establish a soft memory limit for the Go runtime, aiding in the prevention of OOM errors in containerized environments. While GOGC can be adjusted, GOMEMLIMIT generally offers superior control over memory usage trade-offs by dynamically modifying GC frequency as the limit is approached.

Build Flags & Optimizations

Extensive use of Go compiler and linker flags is made to optimize production binaries. Linker flags like -s (disables symbol table generation) and -w (disables DWARF generation) significantly reduce binary size when used together as -ldflags="-s -w". The flag -X 'main.Version=...' allows for dynamic injection of the version string at build time, accessible via the -version flag. Compiler flags include -pgo=auto for Profile-Guided Optimization, which uses captured CPU profiles to optimize hot functions.

Profiling & Flame Graphs

Profiling endpoints are accessible on ports 6061 (Consumer) and 6062 (Producer). To capture CPU profiles and generate flame graphs, Go must be installed locally. The process involves using curl to capture the profile and then go tool pprof to visualize it, including flame graph views.

Testing

Unit tests can be executed using the command: go test ./... -v -cover.