Added crossplag results

Signed-off-by: Jacob Torrey <jacob@thinkst.com>
pull/6/head
Jacob Torrey 2023-06-20 21:08:11 -06:00
rodzic 7459d8aa48
commit 28de021d03
5 zmienionych plików z 4709 dodań i 4068 usunięć

Wyświetl plik

@ -1,3 +1,4 @@
<<<<<<< HEAD
# ZipPy: Fast method to classify text as AI or human-generated
This is a research repo for fast AI detection using compression.
@ -24,3 +25,7 @@ The leading LLM detection tools are [OpenAI's model detector (v2)](https://opena
![ROC curve of detection tools](https://github.com/thinkst/zippy/blob/main/ai_detect_roc.png?raw=true)
=======
# ai-detect
Research repo for fast AI detection methods
>>>>>>> 3c715ce (Initial commit)

Plik binarny nie jest wyświetlany.

Przed

Szerokość:  |  Wysokość:  |  Rozmiar: 66 KiB

Po

Szerokość:  |  Wysokość:  |  Rozmiar: 78 KiB

File diff suppressed because one or more lines are too long

Wyświetl plik

@ -6,7 +6,7 @@ from sklearn.metrics import roc_curve, auc
import re
from junitparser import JUnitXml
MODELS = ['zippy', 'roberta', 'gptzero', 'openai']
MODELS = ['zippy', 'roberta', 'gptzero', 'openai', 'crossplag']
SKIPCASES = ['gpt2', 'gpt3']
MAX_PER_CASE = 500

Wyświetl plik

@ -8,7 +8,7 @@ AI_SAMPLE_DIR = 'samples/llm-generated/'
HUMAN_SAMPLE_DIR = 'samples/human-generated/'
MIN_LEN = 150
NUM_JSONL_SAMPLES = 150
NUM_JSONL_SAMPLES = 500
ai_files = os.listdir(AI_SAMPLE_DIR)
human_files = os.listdir(HUMAN_SAMPLE_DIR)