Update README.md
Browse files
README.md
CHANGED
|
@@ -153,6 +153,9 @@ Top-n accuracy on masked token prediction.
|
|
| 153 |
| 5 | 82.72 % | 74.12 % | 55.41 % |
|
| 154 |
| 10 | 88.80 % | 81.64 % | 60.03 % |
|
| 155 |
|
|
|
|
|
|
|
|
|
|
| 156 |
#### Summary
|
| 157 |
|
| 158 |
SecureBERT 2.0 outperforms both the original SecureBERT and ModernBERT on cybersecurity-specific and code-related tasks.
|
|
|
|
| 153 |
| 5 | 82.72 % | 74.12 % | 55.41 % |
|
| 154 |
| 10 | 88.80 % | 81.64 % | 60.03 % |
|
| 155 |
|
| 156 |
+
This figure presents a comparative study of SecureBERT 2.0, SecureBERT, and ModernBERT on the masked language modeling (MLM) task. This shows SecureBERT 2.0 outperforms both the original SecureBERT and generic ModernBERT, particularly in code understanding and domain-specific terms.
|
| 157 |
+

|
| 158 |
+
|
| 159 |
#### Summary
|
| 160 |
|
| 161 |
SecureBERT 2.0 outperforms both the original SecureBERT and ModernBERT on cybersecurity-specific and code-related tasks.
|