Apppublic

Eva1307/legal-review-env

sourceHugging Faceupdated 6mo agoView on Hugging Face

0likes

App README

Legal Review Environment

An OpenEnv RL environment where an LLM agent reviews legal contract clauses clause-by-clause, identifies risks, and suggests edits. Models real work done by legal reviewers at startups and enterprises.

Motivation

Contract review is a high-stakes, time-consuming task. This environment trains and evaluates agents on realistic legal documents with deterministic graders — filling a genuine gap in the OpenEnv ecosystem.

Observation Space

Field	Type	Description
task_id	string	Which task is active
contract_text	string	Current clause title + text
clause_index	int	Which clause (0-indexed)
total_clauses	int	Total clauses in contract
reviewedsofar	list	History of previous actions + scores
step_number	int	Current step
context	string	Task instructions

Action Space

Field	Type	Values
action_type	string	flag, approve, request_edit
risk_level	string	high, medium, low, none
risk_category	string	indemnity, ip, termination, liability, none
suggested_edit	string	Required if actiontype=requestedit
reasoning	string	One sentence explanation

Tasks

Task ID	Name	Difficulty	Description
task_easy	Clause Classification	Easy	Flag or approve clauses, identify risk level
task_medium	Multi-factor Risk Assessment	Medium	Assess risk level, category, and action across a data processing agreement
task_hard	Redline and Edit	Hard	Propose specific redlined edits for all risky clauses in an enterprise license

Reward Function

—Partial rewards at every step (not sparse)
—Bonuses for catching high-risk clauses with correct reasoning
—Penalties for approving dangerous clauses (indemnity, unlimited liability)
—Edit quality scored via keyword matching for task_hard

Baseline Scores (Qwen/Qwen2.5-72B-Instruct)

Task	Avg Reward	Success
task_easy	0.77	true
task_medium	0.84	true
task_hard	0.60	true

Setup

bash

git clone https://huggingface.co/spaces/Eva1307/legal-review-env
cd legal-review-env
pip install -r requirements.txt
python app.py

Docker

bash

docker build -t legal-review-env .
docker run -p 7860:7860 legal-review-env

API Endpoints

—POST /reset?task_id=task_easy — start new episode
—POST /step?task_id=task_easy — submit action
—GET /state?task_id=task_easy — current state
—GET /tasks — list all tasks
—GET /health — health check

Inference

bash

export HF_TOKEN=your_token
export API_BASE_URL=https://router.huggingface.co/v1
export MODEL_NAME=Qwen/Qwen2.5-72B-Instruct
python inference.py