[JENKINS-73411] 60 Million ListBucket API call a month by Artifact S3 Manager

[jenkins-infra-bot]

artifact-manager-s3:871.v72f7f642a_245

I recently started using artifact-manager-s3 to save jenkins job artifacts on S3. In the previous month's AWS bill, I saw that more than $200 had been billed for the 'ListBucket' API call. There are more than 60M requests. I found that the call was made to the S3 bucket used to save the jenkins artifacts.

---

Originally reported by anianna, imported from: 60 Million ListBucket API call a month by Artifact S3 Manager

• status: Open
• priority: Major
• component(s): artifact-manager-s3-plugin
• resolution: Unresolved
• votes: 0
• watchers: 2
• imported: 2025-12-02

Raw content of original issue

artifact-manager-s3:871.v72f7f642a_245

I recently started using artifact-manager-s3 to save jenkins job artifacts on S3. In the previous month's AWS bill, I saw that more than $200 had been billed for the 'ListBucket' API call. There are more than 60M requests. I found that the call was made to the S3 bucket used to save the jenkins artifacts.

environment

Jenkins: 2.452.2<br/>
OS: Linux - 5.10.218-208.862.amzn2.aarch64<br/>
Java: 21.0.3 - Azul Systems, Inc. (Zing 64-Bit Tiered VM)<br/>
---<br/>
Parameterized-Remote-Trigger:3.2.0<br/>
ansible:403.v8d0ca_dcb_b_502<br/>
ant:497.v94e7d9fffa_b_9<br/>
antisamy-markup-formatter:162.v0e6ec0fcfcf6<br/>
apache-httpcomponents-client-4-api:4.5.14-208.v438351942757<br/>
artifact-diff-plugin:1.3<br/>
artifact-manager-s3:871.v72f7f642a_245<br/>
asm-api:9.7-33.v4d23ef79fcc8<br/>
authentication-tokens:1.113.v81215a_241826<br/>
authorize-project:1.7.2<br/>
aws-credentials:231.v08a_59f17d742<br/>
aws-global-configuration:130.v35b_7b_96f53c3<br/>
aws-java-sdk:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-api-gateway:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-autoscaling:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-cloudformation:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-cloudfront:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-codebuild:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-codedeploy:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-ec2:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-ecr:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-ecs:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-efs:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-elasticbeanstalk:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-elasticloadbalancingv2:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-iam:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-kinesis:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-lambda:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-logs:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-minimal:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-organizations:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-secretsmanager:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-sns:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-sqs:1.12.730-457.v3403b_37d2170<br/>
aws-java-sdk-ssm:1.12.730-457.v3403b_37d2170<br/>
bootstrap5-api:5.3.3-1<br/>
bouncycastle-api:2.30.1.78.1-233.vfdcdeb_0a_08a_a_<br/>
branch-api:2.1169.va_f810c56e895<br/>
build-timeout:1.33<br/>
build-timestamp:1.0.3<br/>
build-with-parameters:76.v9382db_f78962<br/>
caffeine-api:3.1.8-133.v17b_1ff2e0599<br/>
checks-api:2.2.0<br/>
cloud-stats:336.v788e4055508b_<br/>
cloudbees-folder:6.928.v7c780211d66e<br/>
command-launcher:107.v773860566e2e<br/>
commons-compress-api:1.26.1-2<br/>
commons-lang3-api:3.14.0-76.vda_5591261cfe<br/>
commons-text-api:1.12.0-119.v73ef73f2345d<br/>
conditional-buildstep:1.4.3<br/>
config-file-provider:973.vb_a_80ecb_9a_4d0<br/>
configurationslicing:548.ve92d48e66b_f8<br/>
copyartifact:746.vd2a_674fb_4f6f<br/>
credentials:1337.v60b_d7b_c7b_c9f<br/>
credentials-binding:677.vdc9d38cb_254d<br/>
data-tables-api:2.0.8-1<br/>
display-url-api:2.204.vf6fddd8a_8b_e9<br/>
docker-commons:439.va_3cb_0a_6a_fb_29<br/>
docker-workflow:580.vc0c340686b_54<br/>
durable-task:555.v6802fe0f0b_82<br/>
ec2:1688.v8c07e01d657f<br/>
echarts-api:5.5.0-1<br/>
eddsa-api:0.3.0-4.v84c6f0f4969e<br/>
email-ext:1814.v404722f34263<br/>
extended-read-permission:53.v6499940139e5<br/>
external-monitor-job:215.v2e88e894db_f8<br/>
font-awesome-api:6.5.2-1<br/>
git:5.2.2<br/>
git-client:5.0.0<br/>
git-server:126.v0d945d8d2b_39<br/>
github:1.39.0<br/>
github-api:1.318-461.v7a_c09c9fa_d63<br/>
github-branch-source:1789.v5b_0c0cea_18c3<br/>
gitlab-api:5.3.0-91.v1f9a_fda_d654f<br/>
gitlab-oauth:1.19<br/>
gitlab-plugin:1.8.1<br/>
gradle:2.12<br/>
gson-api:2.11.0-41.v019fcf6125dc<br/>
instance-identity:185.v303dc7c645f9<br/>
ionicons-api:74.v93d5eb_813d5f<br/>
jackson2-api:2.17.0-379.v02de8ec9f64c<br/>
jakarta-activation-api:2.1.3-1<br/>
jakarta-mail-api:2.1.3-1<br/>
javadoc:243.vb_b_503b_b_45537<br/>
javax-activation-api:1.2.0-7<br/>
javax-mail-api:1.6.2-10<br/>
jaxb:2.3.9-1<br/>
jdk-tool:73.vddf737284550<br/>
jersey2-api:2.42-147.va_28a_44603b_d5<br/>
jjwt-api:0.11.5-112.ve82dfb_224b_a_d<br/>
jnr-posix-api:3.1.19-2<br/>
job-dsl:1.87<br/>
joda-time-api:2.12.7-29.v5a_b_e3a_82269a_<br/>
jquery3-api:3.7.1-2<br/>
jsch:0.2.16-86.v42e010d9484b_<br/>
json-api:20240303-41.v94e11e6de726<br/>
json-path-api:2.9.0-58.v62e3e85b_a_655<br/>
junit:1265.v65b_14fa_f12f0<br/>
ldap:725.v3cb_b_711b_1a_ef<br/>
lockable-resources:1255.vf48745da_35d0<br/>
log-parser:2.3.4<br/>
mailer:472.vf7c289a_4b_420<br/>
matrix-auth:3.2.2<br/>
matrix-project:832.va_66e270d2946<br/>
maven-plugin:3.23<br/>
mina-sshd-api-common:2.12.1-113.v4d3ea_5eb_7f72<br/>
mina-sshd-api-core:2.12.1-113.v4d3ea_5eb_7f72<br/>
monitoring:1.99.0<br/>
node-iterator-api:55.v3b_77d4032326<br/>
okhttp-api:4.11.0-172.vda_da_1feeb_c6e<br/>
openstack-cloud:2.65<br/>
pam-auth:1.11<br/>
parameterized-trigger:806.vf6fff3e28c3e<br/>
permissive-script-security:0.7<br/>
pipeline-build-step:540.vb_e8849e1a_b_d8<br/>
pipeline-github-lib:61.v629f2cc41d83<br/>
pipeline-graph-analysis:216.vfd8b_ece330ca_<br/>
pipeline-groovy-lib:727.ve832a_9244dfa_<br/>
pipeline-input-step:495.ve9c153f6067b_<br/>
pipeline-milestone-step:119.vdfdc43fc3b_9a_<br/>
pipeline-model-api:2.2198.v41dd8ef6dd56<br/>
pipeline-model-definition:2.2198.v41dd8ef6dd56<br/>
pipeline-model-extensions:2.2198.v41dd8ef6dd56<br/>
pipeline-rest-api:2.34<br/>
pipeline-stage-step:312.v8cd10304c27a_<br/>
pipeline-stage-tags-metadata:2.2198.v41dd8ef6dd56<br/>
pipeline-stage-view:2.34<br/>
pipeline-utility-steps:2.17.0<br/>
plain-credentials:182.v468b_97b_9dcb_8<br/>
plugin-util-api:4.1.0<br/>
purge-build-queue-plugin:88.v23b_97b_f2c7a_d<br/>
rebuild:332.va_1ee476d8f6d<br/>
resource-disposer:0.23<br/>
run-condition:1.7<br/>
scm-api:690.vfc8b_54395023<br/>
script-security:1341.va_2819b_414686<br/>
secondary-timestamper-plugin:1.1<br/>
slack:722.vd07f1ea_7ff40<br/>
snakeyaml-api:2.2-111.vc6598e30cc65<br/>
ssh-credentials:337.v395d2403ccd4<br/>
ssh-slaves:2.973.v0fa_8c0dea_f9f<br/>
sshd:3.330.vc866a_8389b_58<br/>
structs:337.v1b_04ea_4df7c8<br/>
timestamper:1.27<br/>
token-macro:400.v35420b_922dcb_<br/>
trilead-api:2.147.vb_73cc728a_32e<br/>
variant:60.v7290fc0eb_b_cd<br/>
workflow-aggregator:596.v8c21c963d92d<br/>
workflow-api:1316.v33eb_726c50b_a_<br/>
workflow-basic-steps:1058.vcb_fc1e3a_21a_9<br/>
workflow-cps:3903.v48a_8836749e9<br/>
workflow-durable-task-step:1353.v1891a_b_01da_18<br/>
workflow-job:1400.v7fd111b_ec82f<br/>
workflow-multibranch:783.787.v50539468395f<br/>
workflow-scm-step:427.v4ca_6512e7df1<br/>
workflow-step-api:657.v03b_e8115821b_<br/>
workflow-support:907.v6713a_ed8a_573<br/>
ws-cleanup:0.46<br/>
zentimestamp:4.2<br/>

1 attachment

• getBucketLocation-spam.log

[jenkins-infra-bot]

anianna:

• Original comment link
• Raw content of original comment:

  If it matters:
  
  The bucket was created from the artifact configuration page on Jenkins
  

If it matters:

The bucket was created from the artifact configuration page on Jenkins

[jenkins-infra-bot]

kendall_level:

• Original comment link
• Raw content of original comment:

  We are also seeing this with Artifact Manager 894.v29efa_d1a_6383 - page loads are very slow and when we root-caused, we found that every page load is stalling behind 70 calls to 'getBucketLocation'. Attached request logs showing spam created when opening a job's /artifact page.
  

We are also seeing this with Artifact Manager 894.v29efa_d1a_6383 - page loads are very slow and when we root-caused, we found that every page load is stalling behind 70 calls to 'getBucketLocation'. Attached request logs showing spam created when opening a job's /artifact page.