The Genesis of GPT Check

As AI-powered language generation tools like ChatGPT gain popularity, the potential for unethical use by students and others has become a concern. In response, I created GPT Check, an AI plagiarism detector that focuses on identifying instances of copied main ideas from AI-generated content.

What Makes GPT Check Unique

Unlike other plagiarism detectors, GPT Check uses an innovative approach by generating multiple AI-generated responses and comparing them to the answer to detect plagiarism. By focusing on identifying the main idea rather than just relying on perplexity scores, GPT Check can accurately detect plagiarism, even if the text has been paraphrased or rephrased.

How GPT Check Works

Using the OpenAI API and the GPT-3 language model, GPT Check generates multiple AI-generated answers to a given prompt and compares them to the student's response. It leverages machine learning techniques, including the Hugging Face Transformers library, NLTK for text tokenization, and SentenceTransformer for text embedding, and uses a combination of Jaccard similarity and cosine similarity metrics to compare the generated text and the student's response.

The Technologies and Libraries I Used

The GPT Check project was built using Python and several powerful libraries, including Hugging Face Transformers, NLTK for text tokenization, and SentenceTransformer for text embedding. A combination of Jaccard similarity and cosine similarity metrics was used to ensure accurate plagiarism detection.

Challenges and Lessons Learned

Working with GPT-3 was one of the most significant challenges I faced, as it required significant computational resources to use effectively. However, through experimentation with different similarity metrics and threshold values, I gained a deeper understanding of plagiarism detection and how to leverage machine-learning techniques to detect instances of plagiarism accurately.

Future Plans for GPT Check

In the future, I plan to continue refining GPT Check by exploring different machine-learning algorithms and incorporating other language models and text datasets to improve its accuracy and effectiveness. With its unique approach to plagiarism detection, GPT Check has the potential to be a valuable tool for educators and others concerned with the ethical use of AI-generated content.

Built With

• bert
• nltk
• openai
• python
• streamlit
• transformers