Skip to content

markup for keyword patterns #197

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
babenek merged 1 commit into from
Mar 24, 2025
Merged

markup for keyword patterns #197

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
26 changes: 13 additions & 13 deletions .ci/benchmark.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
META MD5 ae6812718aa42625968a68ecefc95370
DATA MD5 c24134143fc8d0061a06c02bd6a9ec5a
DATA: 16352935 interested lines. MARKUP: 59619 items
META MD5 6f1e4554eebf7ff6ea54c339b5a6bac5
DATA MD5 249cef59dfe797b20b91ab1040e548fc
DATA: 16352935 interested lines. MARKUP: 59624 items
FileType FileNumber ValidLines Positives Negatives Templates
--------------- ------------ ------------ ----------- ----------- -----------
446 47536 89 415 72
Expand Down Expand Up @@ -85,7 +85,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.java 613 133184 351 1324 169
.jenkinsfile 1 58 2 6
.jinja2 1 64 2
.js 652 532634 546 2470 284
.js 652 532634 558 2470 284
.json 843 13045846 1087 10010 132
.jsp 13 3202 1 37
.jsx 7 857 19
Expand Down Expand Up @@ -114,7 +114,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.markdown 3 139 3 1
.markerb 3 12 3
.marko 1 21 2
.md 700 149680 770 2334 584
.md 700 149680 771 2334 584
.mdx 3 549 7
.mjml 1 18 1
.mjs 22 4424 71 341
Expand Down Expand Up @@ -154,14 +154,14 @@ FileType FileNumber ValidLines Positives Negatives Templat
.pug 2 193 2
.purs 1 69 4
.pxd 1 150 4 2
.py 886 290215 687 3229 712
.py 886 290215 688 3230 712
.pyi 4 1361 9
.pyp 1 167 1
.python 1 213
.pyx 2 1094 23
.r 4 62 5 2
.rake 2 51 2
.rb 834 128817 304 2444 594
.rb 834 128817 307 2444 594
.re 1 31 1
.red 1 159 1
.release 1 13 4
Expand Down Expand Up @@ -224,7 +224,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.yml 420 36296 561 906 364
.zsh 6 872 12
.zsh-theme 1 97 1
TOTAL: 10343 16352935 12112 46625 4907
TOTAL: 10343 16352935 12129 46626 4907
credsweeper result_cnt : 0, lost_cnt : 0, true_cnt : 0, false_cnt : 0
Rules Positives Negatives Templates Reported TP FP TN FN FPR FNR ACC PRC RCL F1
------------------------------ ----------- ----------- ----------- ---------- ---- ---- ----- ----- -------- -------- -------- ----- -------- ----
Expand All @@ -233,7 +233,7 @@ AWS Client ID 170 19 0
AWS Multi 82 10 0 0 0 10 82 0.000000 1.000000 0.108696 0.000000
AWS S3 Bucket 67 23 0 0 0 23 67 0.000000 1.000000 0.255556 0.000000
Atlassian Old PAT token 3 7 0 0 0 7 3 0.000000 1.000000 0.700000 0.000000
Auth 417 2744 81 0 0 2825 417 0.000000 1.000000 0.871376 0.000000
Auth 429 2744 81 0 0 2825 429 0.000000 1.000000 0.868162 0.000000
Azure Access Token 19 0 0 0 0 0 19 1.000000 0.000000 0.000000
BASE64 Private Key 12 4 0 0 0 4 12 0.000000 1.000000 0.250000 0.000000
BASE64 encoded PEM Private Key 7 0 0 0 0 0 7 1.000000 0.000000 0.000000
Expand All @@ -259,21 +259,21 @@ Grafana Provisioned API Key 22 1 0
JSON Web Token 170 61 0 0 0 61 170 0.000000 1.000000 0.264069 0.000000
Jira / Confluence PAT token 0 4 0 0 0 4 0 0.000000 1.000000
Jira 2FA 21 0 1 0 0 1 21 0.000000 1.000000 0.045455 0.000000
Key 3916 15714 482 0 0 16196 3916 0.000000 1.000000 0.805290 0.000000
Key 3917 15715 482 0 0 16197 3917 0.000000 1.000000 0.805260 0.000000
Nonce 93 49 0 0 0 49 93 0.000000 1.000000 0.345070 0.000000
Other 9 7450 5 0 0 7455 9 0.000000 1.000000 0.998794 0.000000
PEM Private Key 1019 1483 0 0 0 1483 1019 0.000000 1.000000 0.592726 0.000000
Password 2032 7527 2539 0 0 10066 2032 0.000000 1.000000 0.832038 0.000000
SQL Password 44 13 0 0 0 13 44 0.000000 1.000000 0.228070 0.000000
Salesforce Credentials 2 0 0 0 0 0 2 1.000000 0.000000 0.000000
Salt 49 74 1 0 0 75 49 0.000000 1.000000 0.604839 0.000000
Secret 1310 1567 799 0 0 2366 1310 0.000000 1.000000 0.643634 0.000000
Secret 1311 1567 799 0 0 2366 1311 0.000000 1.000000 0.643459 0.000000
Seed 1 6 0 0 0 6 1 0.000000 1.000000 0.857143 0.000000
Slack Token 4 1 0 0 0 1 4 0.000000 1.000000 0.200000 0.000000
Stripe Credentials 2 0 0 0 0 0 2 1.000000 0.000000 0.000000
Tencent WeChat API App ID 6 0 0 0 0 0 6 1.000000 0.000000 0.000000
Token 647 4169 453 0 0 4622 647 0.000000 1.000000 0.877206 0.000000
Token 650 4169 453 0 0 4622 650 0.000000 1.000000 0.876707 0.000000
Twilio Credentials 30 39 0 0 0 39 30 0.000000 1.000000 0.565217 0.000000
URL Credentials 224 168 197 0 0 365 224 0.000000 1.000000 0.619694 0.000000
UUID 1075 265 0 0 0 265 1075 0.000000 1.000000 0.197761 0.000000
12112 46625 4907 0 0 0 46625 12112 0.000000 1.000000 0.793793 0.000000
12129 46626 4907 0 0 0 46626 12129 0.000000 1.000000 0.793567 0.000000
2 changes: 1 addition & 1 deletion meta/83a072aa.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
24957,bb2a4b5f,GitHub,83a072aa,data/83a072aa/src/bb2a4b5f.rb,1,1,T,F,65,123,F,F,,,,,0,0,F,F,F,Key
27883,3fd2c995,GitHub,83a072aa,data/83a072aa/src/3fd2c995.rb,8,8,Template,T,46,66,F,F,CharsOnly,,,Secret,3.52,20,F,F,F,Gitlab Feed Token:Key:Secret
29326,924ed9ac,GitHub,83a072aa,data/83a072aa/test/924ed9ac.yml,21,21,T,T,14,26,F,F,CharsOnly,,,Secret,3.42,12,F,F,F,Password
30039,bf6ef743,GitHub,83a072aa,data/83a072aa/src/bf6ef743.rb,42,42,T,T,74,84,F,F,Any,,,Token,2.96,11,F,F,F,Password
30039,bf6ef743,GitHub,83a072aa,data/83a072aa/src/bf6ef743.rb,42,42,T,T,74,84,F,F,Any,,,Token,2.96,11,F,F,F,Password:Token
135439,bf6ef743,GitHub,83a072aa,data/83a072aa/src/bf6ef743.rb,42,42,T,T,111,121,F,F,Any,,,Token,2.96,11,F,F,F,Password
31180,ff10c105,GitHub,83a072aa,data/83a072aa/src/ff10c105.yml,7,7,Template,T,16,35,F,F,CharsOnly,,,Unknown,3.83,19,F,F,F,Key
31373,924ed9ac,GitHub,83a072aa,data/83a072aa/test/924ed9ac.yml,36,36,T,T,15,71,F,F,Any,,,Secret,3.83,56,F,F,F,Secret
Expand Down
2 changes: 1 addition & 1 deletion meta/a09d9e50.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -139,7 +139,7 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
30622,27c04b11,GitHub,a09d9e50,data/a09d9e50/src/27c04b11.asciidoc,90,90,Template,F,16,19,F,F,CharsOnly,,,Key,1.58,3,F,F,F,API:Key
30896,edf46b1f,GitHub,a09d9e50,data/a09d9e50/src/edf46b1f.sh,29,29,T,T,25,33,F,F,CharsOnly,,,Secret,2.75,8,F,F,F,Password
31508,8d682a30,GitHub,a09d9e50,data/a09d9e50/src/8d682a30.sh,27,27,T,T,26,34,F,F,CharsOnly,,,Secret,2.75,8,F,F,F,Password
32626,c419ffed,GitHub,a09d9e50,data/a09d9e50/test/c419ffed.js,806,806,T,F,23,35,F,F,Any,,,Key,3.25,12,F,F,F,API:Key
32626,c419ffed,GitHub,a09d9e50,data/a09d9e50/test/c419ffed.js,806,806,T,F,23,35,F,F,Any,,,Key,3.25,12,F,F,F,API:Key:Auth
32627,d94baedb,GitHub,a09d9e50,data/a09d9e50/test/d94baedb.ts,35,35,Template,T,45,53,F,F,CharsOnly,,,Secret,2.75,8,F,F,F,Password
32719,2ffd440d,GitHub,a09d9e50,data/a09d9e50/test/2ffd440d.js,380,380,T,F,21,33,F,F,Any,,,Key,3.25,12,F,F,F,API:Key
34251,27c04b11,GitHub,a09d9e50,data/a09d9e50/src/27c04b11.asciidoc,403,403,F,F,36,40,F,F,NumbersOnly,,,Secret,1.0,4,F,F,F,Password
Expand Down
2 changes: 2 additions & 0 deletions meta/c8acf322.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -403,3 +403,5 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
134572,ef428ae1,GitHub,c8acf322,data/c8acf322/src/ef428ae1.rb,38,38,F,F,,,F,F,,,,,0,0,F,F,F,Auth
134573,f1fc8c09,GitHub,c8acf322,data/c8acf322/src/f1fc8c09.rb,37,37,F,F,,,F,F,,,,,0,0,F,F,F,Auth
1238206,bc7a053b,GitHub,c8acf322,data/c8acf322/src/bc7a053b.rb,93,93,F,F,,,F,F,,,,,0.0,0,F,F,F,Auth
1480781,f0cb8289,GitHub,c8acf322,data/c8acf322/src/f0cb8289.rb,40,40,T,F,54,72,F,F,,,,,0.0,0,F,F,F,Token
1480782,f0cb8289,GitHub,c8acf322,data/c8acf322/src/f0cb8289.rb,47,47,T,F,54,72,F,F,,,,,0.0,0,F,F,F,Token
1 change: 1 addition & 0 deletions meta/c8c48c5e.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -139,3 +139,4 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
130017,9fc19616,GitHub,c8c48c5e,data/c8c48c5e/other/9fc19616.md,81,81,F,F,,,F,F,,,,,0.00,,F,F,F,Password
134574,1057dd5b,GitHub,c8c48c5e,data/c8c48c5e/test/1057dd5b.md,6,6,F,F,,,F,F,,,,,0,0,F,F,F,Auth
1238205,669b8a5c,GitHub,c8c48c5e,data/c8c48c5e/test/669b8a5c.example,31,31,F,F,42,91,F,F,,,,,0.0,0,F,F,F,Auth
1480783,95e2596f,GitHub,c8c48c5e,data/c8c48c5e/other/95e2596f.md,130,130,T,F,18,188,F,F,,,,,0.0,0,F,F,F,Key
22 changes: 11 additions & 11 deletions meta/f295f04f.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
17096,b3356305,GitHub,f295f04f,data/f295f04f/other/b3356305.md,1129,1129,F,F,-1,-1,F,F,,,,,0.0,0,F,F,F,Key
18764,b3356305,GitHub,f295f04f,data/f295f04f/other/b3356305.md,396,396,F,F,-1,-1,F,F,,,,,0.0,0,F,F,F,Key
27198,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,350,350,Template,T,23,35,F,F,Any,,,Token,2.72,12,F,F,F,Secret:Token
29337,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,211,211,T,T,30,50,F,F,Any,,,Auth,4.12,20,F,F,F,Gitlab Feed Token:Key
29337,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,211,211,T,T,30,50,F,F,Any,,,Auth,4.12,20,F,F,F,Gitlab Feed Token:Key:Auth
29338,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,349,349,Template,T,33,48,F,F,Any,,,Secret,2.93,15,F,F,F,Secret
29341,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,127,127,T,F,20,61,F,F,Any,,,SeedSalt,4.74,41,F,F,F,Auth:Nonce
29377,1266b54d,GitHub,f295f04f,data/f295f04f/test/1266b54d.js,148,148,Template,T,13,20,F,F,CharsOnly,,,Unknown,2.52,7,F,F,F,Password
Expand All @@ -53,7 +53,7 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
35524,8a9ab6e4,GitHub,f295f04f,data/f295f04f/test/8a9ab6e4.key,1,15,T,T,,,F,F,Any,Private,,Unknown,2.53,31,F,F,F,PEM Private Key
36032,b3356305,GitHub,f295f04f,data/f295f04f/other/b3356305.md,326,326,Template,T,16,24,F,F,CharsOnly,,,Secret,2.75,8,F,F,F,Password
36124,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,86,86,T,F,23,66,F,F,Any,,,Auth,4.8,43,F,F,F,Auth
36133,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,297,297,T,F,30,46,F,F,Any,,,Auth,2.83,16,F,F,F,Key
36133,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,297,297,T,F,30,46,F,F,Any,,,Auth,2.83,16,F,F,F,Key:Auth
36137,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,463,463,T,F,29,45,F,F,Any,,,Auth,2.83,16,F,F,F,Auth:Key
36138,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,82,82,T,F,20,61,F,F,Any,,,SeedSalt,5.0,41,F,F,F,Auth:Nonce
36139,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,41,41,T,F,20,63,F,F,Any,,,SeedSalt,4.88,43,F,F,F,Auth:Nonce
Expand Down Expand Up @@ -91,10 +91,10 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
37583,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,116,116,T,F,23,66,F,F,Any,,,Auth,4.8,43,F,F,F,Auth
37584,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,426,426,T,F,25,68,F,F,Any,,,Auth,4.8,43,F,F,F,Auth
37585,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,545,545,T,F,25,68,F,F,Any,,,Auth,4.8,43,F,F,F,Auth
37599,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,323,323,T,F,30,46,F,F,Any,,,Auth,2.83,16,F,F,F,Key
37600,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,437,437,T,F,30,46,F,F,Any,,,Auth,2.83,16,F,F,F,Key
37601,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,478,478,T,F,30,46,F,F,Any,,,Auth,2.83,16,F,F,F,Key
37602,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,556,556,T,F,30,46,F,F,Any,,,Auth,2.83,16,F,F,F,Key
37599,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,323,323,T,F,30,46,F,F,Any,,,Auth,2.83,16,F,F,F,Key:Auth
37600,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,437,437,T,F,30,46,F,F,Any,,,Auth,2.83,16,F,F,F,Key:Auth
37601,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,478,478,T,F,30,46,F,F,Any,,,Auth,2.83,16,F,F,F,Key:Auth
37602,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,556,556,T,F,30,46,F,F,Any,,,Auth,2.83,16,F,F,F,Key:Auth
37603,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,508,508,T,F,29,45,F,F,Any,,,Auth,2.83,16,F,F,F,Auth:Key
37604,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,578,578,T,F,29,45,F,F,Any,,,Auth,2.83,16,F,F,F,Auth:Key
37605,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,97,97,T,F,20,61,F,F,Any,,,SeedSalt,5.0,41,F,F,F,Auth:Nonce
Expand Down Expand Up @@ -133,11 +133,11 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
74085,b4951d4e,GitHub,f295f04f,data/f295f04f/test/b4951d4e.js,85,85,F,F,-1,-1,F,F,,,,,0.0,0,F,F,F,Key
74086,b4951d4e,GitHub,f295f04f,data/f295f04f/test/b4951d4e.js,106,106,F,F,-1,-1,F,F,,,,,0.0,0,F,F,F,Key
74173,47746fff,GitHub,f295f04f,data/f295f04f/test/47746fff.js,439,439,F,F,-1,-1,F,F,,,,,0.0,0,F,F,F,Key
74607,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,233,233,T,T,30,50,F,F,Any,,,Auth,4.12,20,F,F,F,Gitlab Feed Token:Key
74608,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,255,255,T,T,30,50,F,F,Any,,,Auth,4.12,20,F,F,F,Gitlab Feed Token:Key
74609,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,276,276,T,T,30,50,F,F,Any,,,Auth,4.12,20,F,F,F,Gitlab Feed Token:Key
74610,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,403,403,T,T,30,50,F,F,Any,,,Auth,4.12,20,F,F,F,Gitlab Feed Token:Key
74611,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,524,524,T,T,30,50,F,F,Any,,,Auth,4.12,20,F,F,F,Gitlab Feed Token:Key
74607,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,233,233,T,T,30,50,F,F,Any,,,Auth,4.12,20,F,F,F,Gitlab Feed Token:Key:Auth
74608,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,255,255,T,T,30,50,F,F,Any,,,Auth,4.12,20,F,F,F,Gitlab Feed Token:Key:Auth
74609,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,276,276,T,T,30,50,F,F,Any,,,Auth,4.12,20,F,F,F,Gitlab Feed Token:Key:Auth
74610,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,403,403,T,T,30,50,F,F,Any,,,Auth,4.12,20,F,F,F,Gitlab Feed Token:Key:Auth
74611,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,524,524,T,T,30,50,F,F,Any,,,Auth,4.12,20,F,F,F,Gitlab Feed Token:Key:Auth
74612,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,705,705,Template,T,19,31,F,F,Any,,,Auth,3.12,12,F,F,F,Auth
74613,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,54,54,T,T,27,47,F,F,Any,,,Auth,4.12,20,F,F,F,Auth:Gitlab Feed Token:Key
74614,456f5110,GitHub,f295f04f,data/f295f04f/test/456f5110.js,68,68,T,T,27,47,F,F,Any,,,Auth,4.12,20,F,F,F,Auth:Gitlab Feed Token:Key
Expand Down
2 changes: 2 additions & 0 deletions meta/f623c7b3.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -122,3 +122,5 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
130111,730d0dba,GitHub,f623c7b3,data/f623c7b3/src/730d0dba.py,301,301,F,F,,,F,F,,,,,0.00,,F,F,F,Password
130112,e6a0fcf8,GitHub,f623c7b3,data/f623c7b3/src/e6a0fcf8.py,391,391,F,F,,,F,F,,,,,0.00,,F,F,F,Password
133013,e6a0fcf8,GitHub,f623c7b3,data/f623c7b3/src/e6a0fcf8.py,302,302,F,F,,,F,F,,,,,0,0,F,F,F,Password
1480784,eeb6b41f,GitHub,f623c7b3,data/f623c7b3/test/eeb6b41f.py,175,175,F,F,24,40,F,F,,,,,0.0,0,F,F,F,Key
1480785,eeb6b41f,GitHub,f623c7b3,data/f623c7b3/test/eeb6b41f.py,2553,2553,T,F,23,32,F,F,,,,,0.0,0,F,F,F,Secret
Loading