SeqXGPT: Sentence-Level AI-Generated Text Detection
Paper
•
2310.08903
•
Published
•
2
A trained SeqXGPT model for detecting AI-generated text at the sentence level.
This model implements the SeqXGPT architecture from the paper "SeqXGPT: Sentence-Level AI-Generated Text Detection".
| Metric | Score |
|---|---|
| Sentence Accuracy | 95.6% |
| Macro F1 Score | 95.6% |
| Word Accuracy | 95.5% |
gpt2: GPT-2 generatedgptneo: GPT-Neo generatedgptj: GPT-J generatedllama: LLaMA generatedgpt3re: GPT-3 rewrittenhuman: Human writtenimport torch
from model import ModelWiseTransformerClassifier
# Load model
model = torch.load("seqxgpt_transformer.pt")
model.eval()
# Inference requires feature extraction from 4 LLMs (GPT-2, GPT-Neo, GPT-J, LLaMA)
# See the original SeqXGPT repo for full pipeline
@misc{wang2023seqxgpt,
title={SeqXGPT: Sentence-Level AI-Generated Text Detection},
author={Pengyu Wang and Linyang Li and Ke Ren and Botian Jiang and Dong Zhang and Xipeng Qiu},
year={2023},
eprint={2310.08903},
archivePrefix={arXiv},
primaryClass={cs.CL}
}