Added command-line parser/runner and samples to test with

Signed-off-by: Jacob Torrey <jacob@thinkst.com>

ai-generated.txt

@@ -8,6 +8,20 @@ When it comes to relationships, I'm single at the moment but hoping to find some
 
 Overall, I'm a pretty laid-back guy who enjoys the simple things in life - good food, good friends, and good experiences. I'm always up for trying something new and I'm excited to see where life takes me next.
 
+"Deceptive Shadows" is a thrilling white-collar crime movie that delves into the world of high-stakes finance, greed, and deception. Set in the backdrop of a prestigious investment firm, the film follows the gripping story of Ethan Reynolds, a brilliant but morally ambiguous investment banker, and Rachel Morgan, a determined and resourceful FBI agent.
+
+Ethan Reynolds, a charismatic and ambitious Wall Street player, has built a reputation as a financial genius within the firm. Beneath his polished exterior, however, lies a dark secret—he has been orchestrating a complex Ponzi scheme to siphon off millions of dollars from unsuspecting clients. With his charm and quick thinking, Ethan manages to stay one step ahead of suspicion while living a life of luxury.
+
+Enter Rachel Morgan, a seasoned FBI agent with a sharp intuition for white-collar crime. Assigned to investigate the mysterious financial irregularities surrounding Ethan's firm, Rachel becomes determined to expose the truth and bring the mastermind down. As she delves deeper into the case, she uncovers a web of deceit, forged documents, and falsified transactions that link directly to Ethan.
+
+Caught in a dangerous cat-and-mouse game, Ethan realizes that Rachel is closing in on his trail. He uses all his wit, charm, and insider knowledge to manipulate the situation, throwing Rachel off balance and leading her astray. The lines between right and wrong blur as Ethan's motives are revealed—he had initially embarked on the fraudulent scheme to save his family from financial ruin, but greed eventually took over.
+
+As the tension escalates, Rachel and Ethan engage in a battle of wits, each determined to outsmart the other. Their encounters become increasingly intense, as Rachel's determination to bring Ethan to justice clashes with the doubts that start to creep into her mind. Meanwhile, Ethan's facade begins to crack, revealing glimpses of vulnerability and remorse.
+
+In a gripping climax, the truth behind Ethan's crimes is unveiled, leaving both Rachel and Ethan facing their own moral dilemmas. As the consequences of their choices loom, they must confront the cost of their actions and decide where their loyalties truly lie.
+
+"Deceptive Shadows" is a captivating white-collar crime movie that explores the depths of human ambition, the allure of power, and the consequences of deception. It keeps audiences on the edge of their seats, questioning the fine line between right and wrong in a world driven by greed and ambition.
+
 As an AI language model, I don't have a physical body or personal life experiences, but I can tell you about my capabilities and functions. I was created by OpenAI and based on the GPT-3.5 architecture, which makes me one of the largest and most advanced language models available.
 
 My main purpose is to assist users in generating human-like text, answering questions, and providing information on a wide range of topics. I've been trained on a massive dataset of texts from the internet, books, and other sources, which enables me to understand and generate text in a variety of styles and formats.

lzma_detect.py

@@ -4,9 +4,10 @@
 # (C) 2023 Thinkst Applied Research, PTY
 # Author: Jacob Torrey <jacob@thinkst.com>
 
-import lzma
+import lzma, argparse
 from typing import List, Optional, Tuple
 
+# The prelude file is a text file containing only AI-generated text, it is used to 'seed' the LZMA dictionary
 PRELUDE_FILE : str = 'ai-generated.txt'
 
 class LzmaLlmDetector:
@@ -64,10 +65,17 @@ class LzmaLlmDetector:
         if self.prelude_ratio == 0.0:
             return None
         (prelude_score, sample_score) = self.get_compression_ratio(sample)
-        print(str((prelude_score, sample_score)))
+        #print(str((prelude_score, sample_score)))
         delta = prelude_score - sample_score
         determination = 'AI'
         if delta < 0 or round(delta, self.FUZZINESS_THRESHOLD) == 0:
             determination = 'Human'
         return (determination, abs(delta * 100))
         
+if __name__ == '__main__':
+    parser = argparse.ArgumentParser()
+    parser.add_argument("sample_file", help='Text file containing the sample to classify')
+    args = parser.parse_args()
+    with open(args.sample_file, 'r') as fp:
+        l = LzmaLlmDetector(PRELUDE_FILE)
+        print(str(l.score_text(fp.read())))

samples/human-generated/about_me.txt

@@ -0,0 +1,3 @@
+I am a person who lives in rural CO, I like living in rural areas, probably because when I was little I grew up in rural VT. 
+I am 33 years old, I have a dog namd Dusty who I walk multiple times each day. Today I ran to the fire station to do the pack test then ran home. 
+It started snowing today so I started a fire in the wood stove which is heating the house nicely as it is supposed to get quite cold this evening.

samples/human-generated/cnn_santos.txt

@@ -0,0 +1,7 @@
+The White House declined to weigh in on the unsealing of a 13-count indictment that alleges Republican Rep. George Santos made false statements on multiple financial disclosure declarations.
+
+“It’s a case that we’re not going to speak to — the Justice Department is independent, and we respect that,” White House press secretary Karine Jean-Pierre told reporters traveling with the President to Westchester County in New York on Wednesday.
+
+In addition to charges he lied in financial disclosures, Santos was also accused of fraudulently applying for Covid-19 relief funds and committing wire fraud.
+
+Jean-Pierre deferred to the House Republican conference when pressed about the possibility of the GOP representative getting expelled from Congress.

samples/human-generated/reuters_santos.txt

@@ -0,0 +1,15 @@
+NEW YORK, May 10 (Reuters) - U.S. Representative George Santos was arrested on Wednesday on federal charges of fraud, money laundering and theft of public funds in the latest hit to the newly elected Republican, who has resisted calls to resign for lying about his resume.
+
+The 13-count indictment, unsealed on Wednesday, charges Santos, 34, with defrauding prospective political supporters by laundering funds to pay for his personal expenses and illegally receiving unemployment benefits while he was employed.
+
+He is also accused of making false statements to the House of Representatives about his assets, income and liabilities.
+
+Top House Republicans, who control the chamber by a narrow 222-213 margin, said they would wait for the legal process to play out before taking further action on Santos, who is due to appear later Wednesday at the federal courthouse in Central Islip, New York.
+
+"Taken together, the allegations in the indictment charge Santos with relying on repeated dishonesty and deception to ascend to the halls of Congress and enrich himself," Breon Peace, the U.S. Attorney for the Eastern District of New York, said in a statement.
+
+Santos's congressional office referred requests for comment to his counsel. An attorney for Santos did not immediately respond to requests for comment about the indictment.
+
+Nine House Republicans have so far called on Santos to resign, including six from his home state of New York. But No. 2 House Republican Steve Scalise said the caucus would withhold judgment on Santos.
+
+"The charges just came out," Scalise said at a press conference. "In America, there's a presumption of innocence, but they're serious charges. He's going to have to go through the legal process."

samples/llm-generated/about_me.txt

@@ -0,0 +1,13 @@
+Hey there, my name is Alex and I'm a 27-year-old guy living in a cozy little town. I was born and raised in a close-knit community, where everyone knows each other and it feels like one big family.
+
+I've always had a passion for technology, and it led me to pursue a career in software development. I currently work as a software engineer at a reputable tech company. It's a job that keeps me on my toes, constantly learning and problem-solving, which I find incredibly fulfilling.
+
+When I'm not immersed in coding, I love spending time outdoors. Hiking in the mountains, taking long walks on the beach, or even just enjoying a peaceful picnic in the park – nature is my sanctuary. I believe in the importance of staying active and connected to the world around us.
+
+One of my greatest joys in life is music. I've been playing the guitar since I was a teenager and even formed a band with a few close friends. We enjoy jamming together and occasionally perform at local venues. Music has this magical ability to bring people together and express emotions in ways that words alone cannot.
+
+I'm an avid traveler as well, always seeking new adventures and cultural experiences. Exploring different countries, immersing myself in diverse traditions, and connecting with people from all walks of life – it's truly eye-opening and humbling. My travel memories are some of my most cherished.
+
+In terms of relationships, I'm currently in a loving partnership with an amazing person who shares my passion for life. We support and inspire each other to grow and chase our dreams. Building a deep connection and creating a meaningful life together is something I value deeply.
+
+That's a little glimpse into who I am as a person. Life is a journey, and I'm excited to see what the future holds, embracing new experiences, and continuing to evolve as an individual.

samples/llm-generated/about_me_short.txt

@@ -0,0 +1,5 @@
+Hey there, my name is Alex and I'm a 27-year-old guy living in a cozy little town. I was born and raised in a close-knit community, where everyone knows each other and it feels like one big family.
+
+I've always had a passion for technology, and it led me to pursue a career in software development. I currently work as a software engineer at a reputable tech company. It's a job that keeps me on my toes, constantly learning and problem-solving, which I find incredibly fulfilling.
+
+When I'm not immersed in coding, I love spending time outdoors. Hiking in the mountains, taking long walks on the beach, or even just enjoying a peaceful picnic in the park – nature is my sanctuary. I believe in the importance of staying active and connected to the world around us.

samples/llm-generated/gpt_santos_long.txt

@@ -0,0 +1,13 @@
+New York City, May 10, 2023 – In a significant development today, George Santos, a prominent business figure, has been charged with multiple federal financial crimes. The charges were filed by the United States Department of Justice following an extensive investigation into Santos' financial activities.
+
+According to the indictment, Santos faces allegations of money laundering, wire fraud, and securities fraud. The charges stem from his alleged involvement in a complex scheme that defrauded investors and manipulated financial markets for personal gain. Federal authorities have been closely examining Santos' financial transactions and activities over an extended period.
+
+The indictment suggests that Santos utilized deceptive practices and manipulated financial records to mislead investors and obscure illicit gains. The alleged scheme involved various intricate mechanisms designed to artificially inflate asset values and misrepresent financial performance.
+
+Law enforcement agencies and federal prosecutors have worked diligently to build a strong case against Santos, collecting evidence and cooperating with financial regulatory bodies. If convicted, Santos could face substantial fines and a lengthy prison sentence, given the severity of the charges and the potential financial impact on affected individuals and institutions.
+
+The legal proceedings are expected to unfold in the coming months as the case moves through the federal court system. The trial will likely attract considerable attention from both legal observers and the business community, given Santos' prominence and the alleged nature of the crimes.
+
+The Department of Justice has expressed its commitment to pursuing justice and ensuring that individuals who engage in fraudulent financial activities are held accountable. The charges against Santos are part of ongoing efforts to safeguard the integrity of the financial system and protect investors from fraudulent practices.
+
+As the legal process progresses, further updates will be provided. The case serves as a reminder of the importance of transparency and ethical conduct in financial dealings, and it underscores the vigilance of regulatory authorities in preserving the integrity of the financial markets.

samples/llm-generated/gpt_santos_short.txt

@@ -0,0 +1,3 @@
+George Santos Charged with Federal Financial Crimes
+
+New York City, May 10, 2023 – In a significant development today, George Santos, a prominent business figure, has been charged with multiple federal financial crimes. The charges were filed by the United States Department of Justice following an extensive investigation into Santos' financial activities.