CoolFace
Modelpublic

QuantBridge/distilbert-energy-intelligence-multitask-v2

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face
0likes6downloads
Model Card

DistilBERT Energy Intelligence Multitask NER — v2

Model ID: Quantbridge/distilbert-energy-intelligence-multitask-v2

A domain-specific fine-tuned DistilBERT model for Named Entity Recognition across energy markets, financial instruments, geopolitics, corporate events, and technology. This is a broad-coverage multitask NER model designed for intelligence extraction from financial news and market commentary.

The model recognises 59 entity types (119 BIO labels including B-/I- prefixes) spanning multiple intelligence domains.


Entity Taxonomy

Financial Instruments & Markets

LabelDescription
EQUITYStocks and equity instruments
DERIVATIVEFutures, options, swaps
CURRENCYFX pairs and currencies
FIXED_INCOMEBonds, treasuries, notes
ASSET_CLASSBroad asset class references
INDEXMarket indices (S&P 500, FTSE, etc.)
COMMODITYPhysical commodities (oil, gas, metals)
TRADING_HUBPrice benchmarks and trading hubs

Financial Institutions

LabelDescription
FINANCIAL_INSTITUTIONBanks, brokerages, investment firms
CENTRAL_BANKCentral banks (Fed, ECB, BoE)
HEDGE_FUNDHedge funds and asset managers
RATING_AGENCYCredit rating agencies
EXCHANGEStock and commodity exchanges

Macro & Policy

LabelDescription
MACRO_INDICATORGDP, inflation, unemployment figures
MONETARY_POLICYInterest rate decisions, QE programmes
FISCAL_POLICYGovernment spending, tax policy
TRADE_POLICYTariffs, trade agreements, WTO actions
ECONOMIC_BLOCG7, G20, EU, ASEAN, etc.

Energy Domain

LabelDescription
ENERGY_COMPANYOil majors, utilities, renewable firms
ENERGY_SOURCEOil, gas, coal, solar, nuclear, etc.
PIPELINEEnergy pipelines and transmission lines
REFINERYOil refineries and processing plants
ENERGY_POLICYOPEC decisions, energy legislation
ENERGY_TRANSITIONDecarbonisation, net-zero, EV, hydrogen
GRIDPower grids and electricity networks

Geopolitical

LabelDescription
GEOPOLITICAL_EVENTSummits, elections, geopolitical shifts
SANCTIONEconomic sanctions and embargoes
TREATYInternational agreements and accords
CONFLICT_ZONEActive or historic conflict regions
DIPLOMATIC_ACTIONDiplomatic moves, expulsions, negotiations
COUNTRYNation states
REGIONGeographic regions (Middle East, EU, etc.)
CITYCities and urban locations

Corporate Events

LabelDescription
COMPANYGeneral companies
M_AND_AMergers and acquisitions
IPOInitial public offerings
EARNINGS_EVENTQuarterly earnings, revenue reports
EXECUTIVENamed C-suite executives
CORPORATE_ACTIONDividends, buybacks, restructuring

Infrastructure & Supply Chain

LabelDescription
INFRAPhysical infrastructure (general)
SUPPLY_CHAINSupply chain disruptions and logistics
SHIPPING_VESSELNamed ships and tankers
PORTPorts and maritime hubs

Risk & Events

LabelDescription
EVENTGeneral newsworthy events
RISK_FACTORRisk factors and vulnerabilities
NATURAL_DISASTERHurricanes, earthquakes, floods
CYBER_EVENTCyber attacks and digital incidents
DISRUPTIONSupply or market disruptions

Technology

LabelDescription
TECH_COMPANYTechnology companies
AI_MODELAI systems and models
SEMICONDUCTORChips and semiconductor companies
TECH_REGULATIONTechnology regulation and policy

People & Organizations

LabelDescription
PERSONNamed individuals
THINK_TANKPolicy research organizations
NEWS_SOURCEMedia and news outlets
REGULATORY_BODYGovernment regulators (SEC, FCA, etc.)
ORGGeneral organizations

Usage

python
from transformers import pipeline

ner = pipeline(
    "token-classification",
    model="Quantbridge/distilbert-energy-intelligence-multitask-v2",
    aggregation_strategy="simple",
)

text = (
    "The Federal Reserve held interest rates steady as Brent crude fell below $75 "
    "following OPEC+ production cuts and renewed sanctions on Russian energy exports."
)

results = ner(text)
for entity in results:
    print(f"{entity['word']:<35} {entity['entity_group']:<25} {entity['score']:.3f}")

Example output:

Federal Reserve                     CENTRAL_BANK              0.961
Brent                               TRADING_HUB               0.954
OPEC+                               REGULATORY_BODY           0.947
Russian energy exports              SANCTION                  0.932

Load model directly

python
from transformers import AutoTokenizer, AutoModelForTokenClassification
import torch

model_name = "Quantbridge/distilbert-energy-intelligence-multitask-v2"

tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForTokenClassification.from_pretrained(model_name)
model.eval()

text = "Goldman Sachs cut its oil price forecast after OPEC+ agreed to extend output cuts."
inputs = tokenizer(text, return_tensors="pt")

with torch.no_grad():
    outputs = model(**inputs)

predicted_ids = outputs.logits.argmax(dim=-1)[0]
tokens = tokenizer.convert_ids_to_tokens(inputs["input_ids"][0])

for token, label_id in zip(tokens, predicted_ids):
    label = model.config.id2label[label_id.item()]
    if label != "O" and not token.startswith("["):
        print(f"{token.lstrip('##'):<25} {label}")

Model Details

PropertyValue
Base architecturedistilbert-base-uncased
Architecture typeDistilBertForTokenClassification
Entity types59 types (119 BIO labels)
Hidden dimension768
Attention heads12
Layers6
Vocabulary size30,522
Max sequence length512 tokens

Intended Use

This model is designed for financial and energy intelligence extraction — automated NER over news feeds, earnings transcripts, regulatory filings, and geopolitical reports. It is a base model suitable for:

  • —Structured data extraction from unstructured financial news
  • —Entity linking and knowledge graph population
  • —Signal detection for trading and risk systems
  • —Geopolitical risk monitoring

Out-of-scope use

  • —General-purpose NER on non-financial text
  • —Languages other than English
  • —Documents with heavy technical jargon outside the financial/energy domain

Limitations

  • —English-only
  • —Optimised for news-style formal writing; may underperform on social media or informal text
  • —59-label taxonomy may produce overlapping predictions for ambiguous entities (e.g. a company that is also an energy company)
  • —BIO scheme does not support nested entities

License

Apache 2.0 — see LICENSE.