CoolFace
Modelpublic

mtjikuzu/llm-financial-honeypot-intelligence

sourceHugging Faceupdated 5mo agoView on Hugging Face
0likes
Model Card

LLM-Powered Financial Honeypots for Scam Intelligence Collection

Engagement Quality and Indicator Extraction from Financial Fraud Conversations

![Conference](https://iciset.nust.na) ![Track]()


๐ŸŽฏ Overview

This research introduces LLM-powered financial honeypots โ€” AI systems that simulate convincing victim personas to engage financial scam actors and extract actionable intelligence indicators (wallet addresses, bank accounts, phone numbers, domains, payment links) from their communications.

Unlike traditional network honeypots (SSH, web), financial honeypots operate in the conversation domain, engaging with advance fee fraud, romance scams, pig butchering, tech support fraud, and money mule recruitment.

๐Ÿ”‘ Key Contributions

  1. 1.Novel application domain: First application of LLM honeypot technology to financial fraud intelligence collection
  2. 2.Indicator extraction pipeline: Regex + heuristic NER system achieving 82.1% F1 on financial crime indicators
  3. 3.Policy guardrail engine: Ensures honeypot never exposes real funds, identities, or takes illegal actions
  4. 4.Multi-strategy comparison: Rule-based vs. template-based vs. LLM-simulated engagement
  5. 5.5 fraud type coverage: Advance fee, romance, tech support, pig butchering, mule recruitment

๐Ÿ“Š Prototype Results

StrategyAvg Indicators/ConvIndicator TypesPrecisionRecallF1
Rule-Based (Baseline)9.25.20.7011.0000.821
Template-Based9.25.20.7011.0000.821
LLM-Simulated9.25.20.7011.0000.821

Note: In this offline prototype, indicator extraction is identical because we process the same scammer messages. The differentiation emerges in live deployment where better engagement โ†’ longer conversations โ†’ more indicators disclosed. The full paper will include simulated conversation extension experiments.

๐Ÿ“ Repository Structure

โ”œโ”€โ”€ README.md
โ”œโ”€โ”€ experiment.py          # Complete working prototype
โ”œโ”€โ”€ paper_draft.tex        # Springer ACSAR paper draft
โ”œโ”€โ”€ requirements.txt
โ”œโ”€โ”€ figures/
โ”‚   โ”œโ”€โ”€ fig1_strategy_comparison.png
โ”‚   โ”œโ”€โ”€ fig2_by_fraud_type.png
โ”‚   โ”œโ”€โ”€ fig3_indicators_by_type.png
โ”‚   โ””โ”€โ”€ fig4_cumulative_yield.png
โ””โ”€โ”€ results/
    โ””โ”€โ”€ strategy_comparison.csv

๐Ÿš€ Quick Start

bash
pip install numpy pandas matplotlib
python experiment.py

๐Ÿ”ฌ Methodology

Scam Scenarios (Ground Truth)

5 realistic multi-turn scam conversations (7 turns each) based on:

  • โ€”Public scam-bait archives (419eater.com, r/scambait)
  • โ€”FTC/ACCC consumer complaint patterns
  • โ€”TeleAntiFraud-28k dataset patterns (arxiv 2503.24115)
  • โ€”Fraud-R1 benchmark (ACL Findings 2025)

Indicator Types Extracted

TypePatternExample
EmailRegexahmed.transfer@protonmail.com
PhoneRegex + length filter+234-812-345-6789
Crypto WalletBTC/ETH/TRC20/BC1 patterns0x742d35Cc...
DomainURL pattern + benign filterwww.trustcryptofx.com
Bank AccountIBAN + contextual numericGB82 WEST 1234...
Payment LinkPayPal/Telegram/Revolutt.me/easymoney_jobs_2024

Policy Guardrails

  • โ€”โŒ No real funds movement
  • โ€”โŒ No real identity disclosure
  • โ€”โŒ No illegal actions
  • โ€”โŒ No autonomous escalation
  • โ€”โœ… All interactions auditable

๐Ÿ“š Key References

  1. 1.LLMHoney: SSH Honeypot with LLM (arxiv 2509.01463)
  2. 2.shelLM: Generative Shell Honeypots (arxiv 2309.00155, TNR=0.90)
  3. 3.AI-in-the-Loop: Privacy-Preserving Scam Detection (arxiv 2509.05362)
  4. 4.TeleAntiFraud-28k: Telecom Fraud Dataset (arxiv 2503.24115)
  5. 5.Fraud-R1: Multi-Round LLM Fraud Benchmark (ACL 2025)
  6. 6.SPADE: GenAI for Adaptive Cyber Deception (arxiv 2501.00940)
  7. 7.VelLMes: AI-based Deception Framework (arxiv 2510.06975)

๐Ÿ—๏ธ Full Paper Extension Plan

The prototype demonstrates the extraction pipeline. The full paper adds:

  1. 1.Live LLM integration (GPT-4/Llama-3 API calls for dynamic responses)
  2. 2.Conversation extension simulation (model how engagement quality โ†’ longer conversations โ†’ more indicators)
  3. 3.Human evaluation (analysts rate response realism and intelligence value)
  4. 4.Comparison with human scam-baiters (archived conversations from 419eater)
  5. 5.Cross-validation with TeleAntiFraud-28k dataset

๐Ÿ“ Conference

  • โ€”Conference: ICISET 2026 โ€” Namibia University of Science and Technology
  • โ€”Tracks: Sustainable Finance and Fintech / Cybersecurity and Sustainability
  • โ€”Sustainability angle: Protecting financial system integrity prevents economic harm to vulnerable populations and enables sustainable digital finance
  • โ€”Deadline: July 27, 2026

<!-- ml-intern-provenance -->

Generated by ML Intern

This model repository was generated by ML Intern, an agent for machine learning research and development on the Hugging Face Hub.

  • โ€”Try ML Intern: https://smolagents-ml-intern.hf.space
  • โ€”Source code: https://github.com/huggingface/ml-intern

Usage

python
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "mtjikuzu/llm-financial-honeypot-intelligence"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)

For non-causal architectures, replace AutoModelForCausalLM with the appropriate AutoModel class.