datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Coptic-websites-scrappingwebsite_metadata_c4The dataset is in the form of a json lines file with 1,20,000 examples, where an example consists of text (extracted from C4 English dataset) and metadata fields (website description extracted from Wikipedia).
Example:
{
"text": "US10289222B2 - Handling of touch events in a browser environment - Google Patents\nHandling of touch events in a browser environment Download PDF\nUS10289222B2\nUS10289222B2 US13/857,848 US201313857848A US10289222B2 US 10289222 B2 US10289222 B2 US 10289222B2 US… See the full description on the dataset page: https://huggingface.co/datasets/bs-modeling-metadata/website_metadata_c4.expel-website
Expel.com Website Pages
code-website-setwebsite-technology-evidence-dataset
Website Technology Evidence Dataset
A balanced synthetic dataset for classifying observable website fingerprint evidence into a likely web technology.
Provenance
All records are synthetically generated from documented, recognizable public fingerprints. No claim is made that these records were collected from real websites.
Dataset
38 technologies
6,840 examples
180 examples per technology
train: 5,472
validation: 684
test: 684
balanced classes… See the full description on the dataset page: https://huggingface.co/datasets/newazhala/website-technology-evidence-dataset.website_metadata_c4_toyA smaller version (100 samples) of https://huggingface.co/datasets/bs-modeling-metadata/website_metadata_c4
crawl-malaysian-websitejina-website-100-64-16-BAAI_bge-small-en-v1.5-1000_9062874564
jina-website-100-64-16-BAAI_bge-small-en-v1.5-1000_9062874564 Dataset
Dataset Description
jina-website-100-64-16-BAAI_bge-small-en-v1.5-1000_9062874564 is a generated dataset designed to support the development of domain specific embedding models for retrieval tasks.
Associated Model
This dataset was used to train the jina-website-100-64-16-BAAI_bge-small-en-v1.5-1000_9062874564 model.
How to Use
To use this dataset for model training or evaluation… See the full description on the dataset page: https://huggingface.co/datasets/florianhoenicke/jina-website-100-64-16-BAAI_bge-small-en-v1.5-1000_9062874564.1000s-websites
Thousands of Websites Dataset
A fine-tuning dataset for training language models to generate website designs based on design specifications and requirements.
Overview
This dataset contains training examples for fine-tuning code generation models (specifically DeepSeek Coder 6.7B) to create brand-specific website designs. Each example includes design specifications (industry, tone, layout, etc.) paired with corresponding HTML/CSS/JavaScript implementations.… See the full description on the dataset page: https://huggingface.co/datasets/CodeByBB/1000s-websites.IRCAM-Website-Datajina-website-1-0-16-BAAI_bge-small-en-v1.5-50_9062874564
jina-website-1-0-16-BAAI_bge-small-en-v1.5-50_9062874564 Dataset
Dataset Description
jina-website-1-0-16-BAAI_bge-small-en-v1.5-50_9062874564 is a generated dataset designed to support the development of domain specific embedding models for retrieval tasks.
Associated Model
This dataset was used to train the jina-website-1-0-16-BAAI_bge-small-en-v1.5-50_9062874564 model.
How to Use
To use this dataset for model training or evaluation, you can load it… See the full description on the dataset page: https://huggingface.co/datasets/florianhoenicke/jina-website-1-0-16-BAAI_bge-small-en-v1.5-50_9062874564.website_generation_promptuyghur_website_crawel
Uyghur News Dataset
维吾尔语新闻数据集
数据集描述
本数据集包含从维吾尔语新闻网站爬取的文章，适用于维吾尔语自然语言处理任务。
数据规模
总文章数: 28,140 篇
数据格式: JSONL (每行一个JSON对象)
文件大小: ~174 MB
数据来源
来源
数量
域名
努尔网
27,748 篇
nur.cn
天山网维语版
392 篇
uy.ts.cn
字段说明
{
"title": "文章标题 (维吾尔语)",
"content": "文章内容 (维吾尔语)",
"link": "原文链接 URL"
}
使用示例
import json
with open('complete_uyghur_dataset.jsonl', 'r', encoding='utf-8') as f:
for line in f:
data =… See the full description on the dataset page: https://huggingface.co/datasets/anke01/uyghur_website_crawel.jina-website-100-64-16-BAAI_bge-small-en-v1.5-50_9062874564
jina-website-100-64-16-BAAI_bge-small-en-v1.5-50_9062874564 Dataset
Dataset Description
jina-website-100-64-16-BAAI_bge-small-en-v1.5-50_9062874564 is a generated dataset designed to support the development of domain specific embedding models for retrieval tasks.
Associated Model
This dataset was used to train the jina-website-100-64-16-BAAI_bge-small-en-v1.5-50_9062874564 model.
How to Use
To use this dataset for model training or evaluation, you… See the full description on the dataset page: https://huggingface.co/datasets/florianhoenicke/jina-website-100-64-16-BAAI_bge-small-en-v1.5-50_9062874564.jina-website-1-64-16-BAAI_bge-small-en-v1.5-50_9062874564
jina-website-1-64-16-BAAI_bge-small-en-v1.5-50_9062874564 Dataset
Dataset Description
jina-website-1-64-16-BAAI_bge-small-en-v1.5-50_9062874564 is a generated dataset designed to support the development of domain specific embedding models for retrieval tasks.
Associated Model
This dataset was used to train the jina-website-1-64-16-BAAI_bge-small-en-v1.5-50_9062874564 model.
How to Use
To use this dataset for model training or evaluation, you can load… See the full description on the dataset page: https://huggingface.co/datasets/florianhoenicke/jina-website-1-64-16-BAAI_bge-small-en-v1.5-50_9062874564.website-builder-ai-agent
Website Builder Agent Meta and Traffic Dataset in AI Agent Marketplace | AI Agent Directory | AI Agent Index from DeepNLP
This dataset is collected from AI Agent Marketplace Index and Directory at http://www.deepnlp.org, which contains AI Agents's meta information such as agent's name, website, description, as well as the monthly updated Web performance metrics, including Google,Bing average search ranking positions, Github Stars, Arxiv References, etc.
The dataset is helpful for AI… See the full description on the dataset page: https://huggingface.co/datasets/DeepNLP/website-builder-ai-agent.jina-website-1-0-1-BAAI_bge-small-en-v1.5-50_9062874564
jina-website-1-0-1-BAAI_bge-small-en-v1.5-50_9062874564 Dataset
Dataset Description
jina-website-1-0-1-BAAI_bge-small-en-v1.5-50_9062874564 is a generated dataset designed to support the development of domain specific embedding models for retrieval tasks.
Associated Model
This dataset was used to train the jina-website-1-0-1-BAAI_bge-small-en-v1.5-50_9062874564 model.
How to Use
To use this dataset for model training or evaluation, you can load it… See the full description on the dataset page: https://huggingface.co/datasets/florianhoenicke/jina-website-1-0-1-BAAI_bge-small-en-v1.5-50_9062874564.website_datawebsite-hero-designwebsitesSOIT_Websitewebsite_prompt_llamawebsite-datasetWebsiteFingerprintingWebsite_generation_prompt_datasetwebsite-categorization-datasetWebsiteDatatrain_model_tool_pos_websitewebsite_datasetwebsite_dataset_02