cisco-ehsan commited on
Commit
1d32c2c
·
verified ·
1 Parent(s): 496e992

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -153,6 +153,9 @@ Top-n accuracy on masked token prediction.
153
  | 5 | 82.72 % | 74.12 % | 55.41 % |
154
  | 10 | 88.80 % | 81.64 % | 60.03 % |
155
 
 
 
 
156
  #### Summary
157
 
158
  SecureBERT 2.0 outperforms both the original SecureBERT and ModernBERT on cybersecurity-specific and code-related tasks.
 
153
  | 5 | 82.72 % | 74.12 % | 55.41 % |
154
  | 10 | 88.80 % | 81.64 % | 60.03 % |
155
 
156
+ This figure presents a comparative study of SecureBERT 2.0, SecureBERT, and ModernBERT on the masked language modeling (MLM) task. This shows SecureBERT 2.0 outperforms both the original SecureBERT and generic ModernBERT, particularly in code understanding and domain-specific terms.
157
+ ![image](https://cdn-uploads.huggingface.co/production/uploads/661030b81d2d202e24567c37/o0hxtirn-LV_omHsnBXhd.png)
158
+
159
  #### Summary
160
 
161
  SecureBERT 2.0 outperforms both the original SecureBERT and ModernBERT on cybersecurity-specific and code-related tasks.