Text Classification
PEFT
PyTorch
Safetensors
English
regression
story-point-estimation
software-engineering
Eval Results (legacy)
Instructions to use DEVCamiloSepulveda/0-LLAMA3SP-talenddataquality with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use DEVCamiloSepulveda/0-LLAMA3SP-talenddataquality with PEFT:
from peft import PeftModel from transformers import AutoModelForSequenceClassification base_model = AutoModelForSequenceClassification.from_pretrained("meta-llama/Llama-3.2-1B") model = PeftModel.from_pretrained(base_model, "DEVCamiloSepulveda/0-LLAMA3SP-talenddataquality") - Notebooks
- Google Colab
- Kaggle
| license: llama3.2 | |
| language: | |
| - en | |
| base_model: meta-llama/Llama-3.2-1B | |
| pipeline_tag: text-classification | |
| library_name: peft | |
| tags: | |
| - regression | |
| - story-point-estimation | |
| - software-engineering | |
| datasets: | |
| - talenddataquality | |
| metrics: | |
| - mae | |
| - mdae | |
| model-index: | |
| - name: llama-3.2-1b-story-point-estimation | |
| results: | |
| - task: | |
| type: regression | |
| name: Story Point Estimation | |
| dataset: | |
| name: talenddataquality Dataset | |
| type: talenddataquality | |
| split: test | |
| metrics: | |
| - type: mae | |
| value: 5.165 | |
| name: Mean Absolute Error (MAE) | |
| - type: mdae | |
| value: 5.644 | |
| name: Median Absolute Error (MdAE) | |
| # LLAMA 3 Story Point Estimator - talenddataquality | |
| This model is fine-tuned on issue descriptions from talenddataquality and tested on talenddataquality for story point estimation. | |
| ## Model Details | |
| - Base Model: LLAMA 3.2 1B | |
| - Training Project: talenddataquality | |
| - Test Project: talenddataquality | |
| - Task: Story Point Estimation (Regression) | |
| - Architecture: PEFT (LoRA) | |
| - Input: Issue titles | |
| - Output: Story point estimation (continuous value) | |
| ## Usage | |
| ```python | |
| from transformers import AutoModelForSequenceClassification, AutoTokenizer | |
| from peft import PeftConfig, PeftModel | |
| # Load peft config model | |
| config = PeftConfig.from_pretrained("DEVCamiloSepulveda/0-LLAMA3SP-talenddataquality") | |
| # Load tokenizer and model | |
| tokenizer = AutoTokenizer.from_pretrained("DEVCamiloSepulveda/0-LLAMA3SP-talenddataquality") | |
| base_model = AutoModelForSequenceClassification.from_pretrained( | |
| config.base_model_name_or_path, | |
| num_labels=1, | |
| torch_dtype=torch.float16, | |
| device_map='auto' | |
| ) | |
| model = PeftModel.from_pretrained(base_model, "DEVCamiloSepulveda/0-LLAMA3SP-talenddataquality") | |
| # Prepare input text | |
| text = "Your issue description here" | |
| inputs = tokenizer(text, return_tensors="pt", truncation=True, max_length=20, padding="max_length") | |
| # Get prediction | |
| outputs = model(**inputs) | |
| story_points = outputs.logits.item() | |
| ``` | |
| ## Training Details | |
| - Fine-tuning method: LoRA (Low-Rank Adaptation) | |
| - Sequence length: 20 tokens | |
| - Best training epoch: 6 / 20 epochs | |
| - Batch size: 32 | |
| - Training time: 269.348 seconds | |
| - Mean Absolute Error (MAE): 5.165 | |
| - Median Absolute Error (MdAE): 5.644 | |
| ### Framework versions | |
| - PEFT 0.14.0 |