Datasetpublic

Felladrin/pretrain-mental-health-counseling-conversations

Conversion of Amod/mental_health_counseling_conversations dataset to be used in pretraining. Python code used for conversion: from datasets import load_dataset import pandas import re dataset = load_dataset("Amod/mental_health_counseling_conversations", split="train") def format(columns): return re.sub(r'\s+', ' ', columns["Response"]).strip() text = [format(columns) for columns in dataset] pandas.DataFrame({"text": list(filter(None, text))}).to_csv("train.csv", index=False)

sourceHugging Faceopenrailupdated 3y agoView on Hugging Face

2likes50downloads

Dataset Card

Conversion of Amod/mental_health_counseling_conversations dataset to be used in pretraining.

Python code used for conversion:

python

from datasets import load_dataset
import pandas
import re

dataset = load_dataset("Amod/mental_health_counseling_conversations", split="train")

def format(columns):
    return re.sub(r'\s+', ' ', columns["Response"]).strip()

text = [format(columns) for columns in dataset]

pandas.DataFrame({"text": list(filter(None, text))}).to_csv("train.csv", index=False)