Skip to content

AWS Multi corrections #292

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
babenek merged 5 commits into from
Dec 15, 2025
Merged

AWS Multi corrections #292

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
385de2e
awsm
babenek Dec 14, 2025
aebfd50
fix unpaired
babenek Dec 14, 2025
71ee820
corrections
babenek Dec 15, 2025
595175f
missed category fix
babenek Dec 15, 2025
d33e028
markup
babenek Dec 15, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
44 changes: 22 additions & 22 deletions .ci/benchmark.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
META MD5 52ca58b257084ebd44d6e812e0552686
DATA MD5 9890b532c1403b6546dde09bf66f7a41
DATA: 16995334 interested lines. MARKUP: 63710 items
META MD5 b86be0057a47695cb0050d0e187e9fc3
DATA MD5 b77c97976d58351be1aa7899c7301b66
DATA: 16995334 interested lines. MARKUP: 63736 items
FileType FileNumber ValidLines Positives Negatives
--------------- ------------ ------------ ----------- -----------
684 567150 136 695
Expand All @@ -14,7 +14,7 @@ FileType FileNumber ValidLines Positives Negatives
.backup 1 62 2
.bash 2 2158 5
.bat 5 248 2 16
.bats 15 2804 14 62
.bats 15 2804 14 64
.bazel 3 424 14
.build 2 40 1 2
.bundle 4 1512 471
Expand Down Expand Up @@ -84,11 +84,11 @@ FileType FileNumber ValidLines Positives Negatives
.ipynb 6 4804 10 10
.j 1 241 4
.j2 32 6043 7 209
.java 650 141112 478 1457
.java 650 141112 478 1455
.jenkinsfile 1 58 2 6
.jinja2 1 64 2
.js 640 530803 859 3134
.json 884 13053260 1843 10338
.json 884 13053260 1814 10391
.jsp 13 3202 1 47
.jsx 7 857 15
.jwt 1 1 2
Expand All @@ -113,13 +113,13 @@ FileType FileNumber ValidLines Positives Negatives
.lua 10 1924 3 39
.m 16 13358 22 195
.manifest 3 102 9 6
.markdown 38 5862 69 41
.markdown 38 5862 69 42
.markerb 3 12 3
.marko 1 21 2
.md 768 181113 1040 2462
.mdx 3 549 8
.mjml 1 18 1
.mjs 19 4119 91 113
.mjs 19 4119 91 116
.mk 1 5878 15
.ml 1 1856 16
.mlir 2 1596 19
Expand All @@ -139,7 +139,7 @@ FileType FileNumber ValidLines Positives Negatives
.patch 3 109384 4 25
.pbxproj 1 941 1
.pem 65 1467 64 3
.php 394 81495 167 1484
.php 394 81495 167 1487
.pl 16 14727 7 37
.pm 10 5224 1 30
.po 3 2994 11
Expand All @@ -157,14 +157,14 @@ FileType FileNumber ValidLines Positives Negatives
.pug 2 193 2
.purs 1 69 4
.pxd 1 150 2 4
.py 876 292413 748 3879
.py 876 292413 756 3880
.pyi 4 1361 10
.pyp 1 167 1
.python 1 213
.pyx 2 1094 24
.r 4 62 5 2
.rake 2 51 4
.rb 834 127133 384 3070
.rb 834 127133 383 3070
.re 1 31 1
.red 1 159 1
.release 1 13 4
Expand All @@ -179,7 +179,7 @@ FileType FileNumber ValidLines Positives Negatives
.rsa 3 3 3
.rsc 1 691 1
.rsp 18 7739 24 37
.rst 91 34736 88 345
.rst 91 34736 88 346
.rules 1 6 3
.sample 2 25 3 8
.sbt 3 570 7
Expand Down Expand Up @@ -213,7 +213,7 @@ FileType FileNumber ValidLines Positives Negatives
.travis 1 34 2 4
.ts 607 107776 266 1990
.tsx 54 7914 1 125
.txt 322 89402 5258 5785
.txt 322 89402 5258 5784
.utf8 1 77 1
.vsmdi 1 6 2 2
.vue 50 8736 1 165
Expand All @@ -225,13 +225,13 @@ FileType FileNumber ValidLines Positives Negatives
.yml 560 56585 1897 1386
.zsh 6 872 11
.zsh-theme 1 97 1
TOTAL: 11361 16995334 17154 53615
TOTAL: 11361 16995334 17132 53676
credsweeper result_cnt : 0, lost_cnt : 0, true_cnt : 0, false_cnt : 0
Rules Positives Negatives Reported TP FP TN FN FPR FNR ACC PRC RCL F1
------------------------------ ----------- ----------- ---------- ---- ---- ----- ----- -------- -------- -------- ----- -------- ----
API 242 4002 0 0 4002 242 0.000000 1.000000 0.942978 0.000000
AWS Client ID 205 20 0 0 20 205 0.000000 1.000000 0.088889 0.000000
AWS Multi 83 11 0 0 11 83 0.000000 1.000000 0.117021 0.000000
AWS Client ID 213 33 0 0 33 213 0.000000 1.000000 0.134146 0.000000
AWS Multi 34 66 0 0 66 34 0.000000 1.000000 0.660000 0.000000
AWS S3 Bucket 92 0 0 0 0 92 1.000000 0.000000 0.000000
Akamai Credentials 6 2 0 0 2 6 0.000000 1.000000 0.250000 0.000000
Anthropic API Key 1 0 0 0 0 1 1.000000 0.000000 0.000000
Expand All @@ -246,7 +246,7 @@ CMD Password 33 137 0 0
CMD Secret 1 18 0 0 18 1 0.000000 1.000000 0.947368 0.000000
CMD Token 6 2 0 0 2 6 0.000000 1.000000 0.250000 0.000000
CURL User Password 7 2 0 0 2 7 0.000000 1.000000 0.222222 0.000000
Credential 96 597 0 0 597 96 0.000000 1.000000 0.861472 0.000000
Credential 96 598 0 0 598 96 0.000000 1.000000 0.861671 0.000000
Docker Swarm Token 2 0 0 0 0 2 1.000000 0.000000 0.000000
Dropbox App secret 74 145 0 0 145 74 0.000000 1.000000 0.662100 0.000000
Facebook Access Token 0 1 0 0 1 0 0.000000 1.000000
Expand All @@ -259,28 +259,28 @@ Grafana Access Policy Token 0 2 0 0
Grafana Provisioned API Key 7 16 0 0 16 7 0.000000 1.000000 0.695652 0.000000
Grafana Service Account Token 3 0 0 0 0 3 1.000000 0.000000 0.000000
JSON Web Token 174 61 0 0 61 174 0.000000 1.000000 0.259574 0.000000
JWK 80 0 0 0 0 80 1.000000 0.000000 0.000000
JWK 80 3 0 0 3 80 0.000000 1.000000 0.036145 0.000000
Jira / Confluence PAT token 0 4 0 0 4 0 0.000000 1.000000
Key 4213 20802 0 0 20802 4213 0.000000 1.000000 0.831581 0.000000
Key 4225 20798 0 0 20798 4225 0.000000 1.000000 0.831155 0.000000
MailGun API Key 8 0 0 0 0 8 1.000000 0.000000 0.000000
NKEY Seed 60 0 0 0 0 60 1.000000 0.000000 0.000000
NTLM Token 4 0 0 0 0 4 1.000000 0.000000 0.000000
Nonce 131 109 0 0 109 131 0.000000 1.000000 0.454167 0.000000
OTP / 2FA Secret 64 3 0 0 3 64 0.000000 1.000000 0.044776 0.000000
Other 0 20 0 0 20 0 0.000000 1.000000
PEM Private Key 1154 72 0 0 72 1154 0.000000 1.000000 0.058728 0.000000
Password 2595 11364 0 0 11364 2595 0.000000 1.000000 0.814098 0.000000
Password 2597 11362 0 0 11362 2597 0.000000 1.000000 0.813955 0.000000
Perplexity API Key 2 0 0 0 0 2 1.000000 0.000000 0.000000
Postman Credentials 2 0 0 0 0 2 1.000000 0.000000 0.000000
SQL Password 44 14 0 0 14 44 0.000000 1.000000 0.241379 0.000000
Salesforce Credentials 6 0 0 0 0 6 1.000000 0.000000 0.000000
Salt 90 130 0 0 130 90 0.000000 1.000000 0.590909 0.000000
Secret 1520 2481 0 0 2481 1520 0.000000 1.000000 0.620095 0.000000
Secret 1525 2476 0 0 2476 1525 0.000000 1.000000 0.618845 0.000000
Slack Token 15 1 0 0 1 15 0.000000 1.000000 0.062500 0.000000
Stripe Credentials 2 0 0 0 0 2 1.000000 0.000000 0.000000
Tencent WeChat API App ID 47 0 0 0 0 47 1.000000 0.000000 0.000000
Token 1140 5268 0 0 5268 1140 0.000000 1.000000 0.822097 0.000000
Twilio Credentials 30 39 0 0 39 30 0.000000 1.000000 0.565217 0.000000
URL Credentials 225 401 0 0 401 225 0.000000 1.000000 0.640575 0.000000
UUID 2517 3716 0 0 3716 2517 0.000000 1.000000 0.596182 0.000000
17154 53615 0 0 0 53615 17154 0.000000 1.000000 0.757606 0.000000
17132 53676 0 0 0 53676 17132 0.000000 1.000000 0.758050 0.000000
3 changes: 1 addition & 2 deletions meta/0f133e09.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -191,7 +191,7 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,ValueStart,Valu
20171,d27bec8f,GitHub,0f133e09,data/0f133e09/test/d27bec8f.py,54,54,F,,,,,Auth
20172,03cdc0c5,GitHub,0f133e09,data/0f133e09/test/03cdc0c5.py,95,95,T,123,143,,aws-id,AWS Client ID
1020172,03cdc0c5,GitHub,0f133e09,data/0f133e09/test/03cdc0c5.py,95,95,T,123,186,,aws-id,Credential
136761,03cdc0c5,GitHub,0f133e09,data/0f133e09/test/03cdc0c5.py,95,95,T,123,313,,,AWS Multi
136761,03cdc0c5,GitHub,0f133e09,data/0f133e09/test/03cdc0c5.py,95,95,F,123,313,,short-therm-signature,AWS Multi
136760,03cdc0c5,GitHub,0f133e09,data/0f133e09/test/03cdc0c5.py,95,95,T,21,50,,info,AWS S3 Bucket
20680,0ccc1045,GitHub,0f133e09,data/0f133e09/_/0ccc1045.py,1236,1236,F,,,,,Key
23378,03c77d4f,GitHub,0f133e09,data/0f133e09/_/03c77d4f.py,241,241,F,,,,,Key
Expand Down Expand Up @@ -369,7 +369,6 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,ValueStart,Valu
131073,77000b93,GitHub,0f133e09,data/0f133e09/test/77000b93.txt,76,76,F,,,,,Password
135029,cd558fc3,GitHub,0f133e09,data/0f133e09/_/cd558fc3.py,819,819,F,,,,,Key
135030,5e62348b,GitHub,0f133e09,data/0f133e09/test/app/5e62348b.py,65,65,F,,,,,Token
135779,c65fed08,GitHub,0f133e09,data/0f133e09/test/c65fed08.txt,9,10,F,,,,,AWS Multi
1359693,03cdc0c5,GitHub,0f133e09,data/0f133e09/test/03cdc0c5.py,64,64,T,47,83,,,UUID
1359698,3c2e2b70,GitHub,0f133e09,data/0f133e09/test/3c2e2b70.txt,9,9,T,326,362,,,UUID
1359699,3e082ff8,GitHub,0f133e09,data/0f133e09/test/3e082ff8.txt,9,9,T,326,362,,,UUID
Expand Down
3 changes: 3 additions & 0 deletions meta/23689bd1.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -321,3 +321,6 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,ValueStart,Valu
11532918,b5304871,GitHub,23689bd1,data/23689bd1/test/b5304871.mjs,314,314,T,273,309,,,UUID
11532919,b5304871,GitHub,23689bd1,data/23689bd1/test/b5304871.mjs,568,568,T,18,54,,,UUID
11532920,b5304871,GitHub,23689bd1,data/23689bd1/test/b5304871.mjs,587,587,T,18,54,,,UUID
11536667,5caed4e2,GitHub,23689bd1,data/23689bd1/test/5caed4e2.mjs,86,92,F,8,55,,unpair,JWK
11536668,a57bbb8c,GitHub,23689bd1,data/23689bd1/test/a57bbb8c.mjs,90,96,F,8,55,,unpair,JWK
11536669,b2db93fc,GitHub,23689bd1,data/23689bd1/test/b2db93fc.mjs,65,71,F,10,356,,unpair,JWK
3 changes: 1 addition & 2 deletions meta/39def7b4.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -128,8 +128,7 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,ValueStart,Valu
10958,b5ca0850,GitHub,39def7b4,data/39def7b4/spec/b5ca0850.rb,89,89,F,,,,,Credential
17247,d97e408a,GitHub,39def7b4,data/39def7b4/spec/d97e408a.rb,91,91,T,51,112,,,Credential:AWS Multi
1338229,d97e408a,GitHub,39def7b4,data/39def7b4/spec/d97e408a.rb,91,91,T,51,71,,,AWS Client ID
1238230,d97e408a,GitHub,39def7b4,data/39def7b4/spec/d97e408a.rb,91,94,T,51,93,,,AWS Multi
1338230,d97e408a,GitHub,39def7b4,data/39def7b4/spec/d97e408a.rb,91,94,F,72,52,,unpair,AWS Multi
1238230,d97e408a,GitHub,39def7b4,data/39def7b4/spec/d97e408a.rb,91,94,F,,,,unpair,AWS Multi
11037,d97e408a,GitHub,39def7b4,data/39def7b4/spec/d97e408a.rb,94,94,T,32,93,,,Credential:AWS Multi
1238231,d97e408a,GitHub,39def7b4,data/39def7b4/spec/d97e408a.rb,94,94,T,32,52,,,AWS Client ID
12188,e84ecee2,GitHub,39def7b4,data/39def7b4/lib/e84ecee2.rb,45,45,F,,,,,Key
Expand Down
3 changes: 3 additions & 0 deletions meta/653a7746.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,3 +19,6 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,ValueStart,Valu
1520905,d79cda41,GitHub,653a7746,data/653a7746/secret/d79cda41.1,682,682,F,,,,,CMD Secret
11527783,7b3ed02b,GitHub,653a7746,data/653a7746/_/7b3ed02b.rst,165,165,F,47,51,,,Secret:Key
11527784,d79cda41,GitHub,653a7746,data/653a7746/secret/d79cda41.1,289,289,F,41,45,,,Secret:Key
11536637,7b3ed02b,GitHub,653a7746,data/653a7746/_/7b3ed02b.rst,168,169,F,47,48,,example-key,AWS Multi
11536638,814ea24d,GitHub,653a7746,data/653a7746/test/secret/814ea24d.bats,282,283,F,25,65,,example,AWS Multi
11536670,814ea24d,GitHub,653a7746,data/653a7746/test/secret/814ea24d.bats,282,282,F,25,45,,,AWS Client ID
Loading
Loading