louisbrulenaudet/mergekit-configs

Dataset Description

• —Repository: https://huggingface.co/datasets/louisbrulenaudet/mergekit-configs
• —Leaderboard: N/A
• —Point of Contact: Louis Brulé Naudet

<img src="assets/thumbnail.webp">

MergeKit-configs: access all Hub architectures and automate your model merging process

This dataset facilitates the search for compatible architectures for model merging with MergeKit, streamlining the automation of high-performance merge searches. It provides a snapshot of the Hub’s configuration state, eliminating the need to manually open configuration files.

import polars as pl

# Login using e.g. `huggingface-cli login` to access this dataset
df = pl.read_parquet('hf://datasets/louisbrulenaudet/mergekit-configs/data/raw-00000-of-00001.parquet')

result = (
  df.groupby(
    [
      "architectures",
      "hidden_size",
      "model_type",
      "intermediate_size"
    ]
  ).agg(
    pl.struct([pl.col("id")]).alias("models")
  )
)

Citing & Authors

If you use this dataset in your research, please use the following BibTeX entry.

@misc{HFforLegal2024,
  author =       {Louis Brulé Naudet},
  title =        {MergeKit-configs: access all Hub architectures and automate your model merging process},
  year =         {2024}
  howpublished = {\url{https://huggingface.co/datasets/louisbrulenaudet/mergekit-configs}},
}

Feedback

If you have any feedback, please reach out at louisbrulenaudet@icloud.com.