File size: 2,383 Bytes
bfb75cf | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 | ---
license: apache-2.0
base_model: roberta-base
tags:
- text-classification
- question-answering
- roberta
- pytorch
- transformers
language:
- en
pipeline_tag: text-classification
---
# Cyber_Bot
This is a fine-tuned RoBERTa model for question-answering classification tasks.
## Model Details
- **Base Model**: roberta-base
- **Model Type**: Sequence Classification
- **Language**: English
- **License**: Apache 2.0
## Model Information
- **Number of Classes**: 5
- **Classification Type**: grouped_classification
- **Class Names**: Empty, Word, Short, Medium, Long
## Usage
```python
from transformers import AutoTokenizer, AutoModelForSequenceClassification
import torch
# Load model and tokenizer
tokenizer = AutoTokenizer.from_pretrained('whitedevil0089devil/Cyber_Bot')
model = AutoModelForSequenceClassification.from_pretrained('whitedevil0089devil/Cyber_Bot')
# Example usage
question = "Your question here"
inputs = tokenizer(question, return_tensors="pt", truncation=True, padding=True, max_length=384)
with torch.no_grad():
outputs = model(**inputs)
predictions = torch.nn.functional.softmax(outputs.logits, dim=-1)
predicted_class = torch.argmax(outputs.logits, dim=-1).item()
confidence = predictions[0][predicted_class].item()
print(f"Predicted class: {predicted_class}")
print(f"Confidence: {confidence:.4f}")
```
## Training Details
This model was fine-tuned using:
- **Framework**: PyTorch + Transformers
- **Optimization**: AdamW with learning rate scheduling
- **Training Strategy**: Early stopping with validation monitoring
- **Hardware**: Trained on Google Colab (T4 GPU)
## Intended Use
This model is designed for question-answering classification tasks. It can be used to:
- Classify questions into predefined categories
- Provide automated responses based on question classification
- Support Q&A systems and chatbots
## Limitations
- Model performance depends on the similarity between training data and inference data
- May not generalize well to domains significantly different from training data
- Classification accuracy may vary based on question complexity and length
## Citation
If you use this model, please cite:
```
@misc{roberta-qa-model,
title={Fine-tuned RoBERTa for Question-Answer Classification},
author={Your Name},
year={2024},
url={https://huggingface.co/whitedevil0089devil/Cyber_Bot}
}
```
|