feat: update Redis connection pool configuration

[gaius-qi]

Description

This pull request introduces updates to Redis configuration defaults and enhancements to Redis connection pool management across the codebase. The changes include adjustments to default Redis connection settings, the addition of new configuration options (PoolSize and PoolTimeout), and updates to relevant test cases and configuration files.

Redis Configuration Updates:

• internal/job/constants.go: Reduced DefaultRedisMaxIdle from 10 to 5 and DefaultRedisMaxActive from 50 to 20 to optimize resource usage.
• manager/config/constants.go: Added defaults for DefaultRedisPoolSize (20) and DefaultRedisPoolTimeout (10 seconds) and reduced DefaultLFUCacheSize from 10,000 to 8,000. [1] [2]

New Redis Connection Pool Options:

• manager/config/config.go: Introduced PoolSize and PoolTimeout fields in the RedisConfig struct to allow configuration of the Redis connection pool. These fields were also initialized with default values in the New() function. [1] [2]
• manager/cache/cache.go: Updated the New function to pass the new PoolSize and PoolTimeout options to the Redis client configuration.

Test and Configuration File Updates:

• manager/config/config_test.go: Updated test cases to include PoolSize (10) and PoolTimeout (1 second) in the Redis configuration.
• manager/config/testdata/manager.yaml: Added poolSize and poolTimeout fields to the Redis configuration in the test YAML file.

Related Issue

Motivation and Context

Screenshots (if appropriate)

Types of changes

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)
• Documentation Update (if none of the other choices apply)

Checklist

• My change requires a change to the documentation.
• I have updated the documentation accordingly.
• I have read the CONTRIBUTING document.
• I have added tests to cover my changes.

[chlins]

lgtm

[Liam-Zhao]

LGTM