CoolFace
Modelpublic

Logics-MLLM/Logics-PPT-Qwen3.6-35B-A3B-SFT

sourceHugging Faceapache-2.0updated 7d agoView on Hugging Face
1likes193downloads
Model Card

Logics-PPT-Qwen3.6-35B-A3B-SFT

Model card for Logics-PPT-Qwen3.6-35B-A3B-SFT. The technical report is under review and a public link will be added when available.

Note: This model was previously named Logics-PPT-Qwen-3.6-35B-A3B-SFT and has been renamed to Logics-PPT-Qwen3.6-35B-A3B-SFT on 2026-09-20 for naming consistency.

๐Ÿ“ฐ News

  • โ€”[2026.09.20] Released Logics-PPT-Qwen3.6-35B-A3B-SFT under the Apache-2.0 license.
  • โ€”This model is the supervised fine-tuning (SFT) checkpoint for the MoE presentation-generation backbone in our presentation-intelligence pipeline.
  • โ€”The technical report is currently under review. A citation link will be added after public release.

๐Ÿ”Ž Overview

Logics-PPT-Qwen3.6-35B-A3B-SFT is a presentation-generation model built on top of Qwen3.6-35B-A3B, an MoE backbone, for single-page HTML slide generation.

The model is trained for end-to-end presentation generation through a slide-wise HTML generation paradigm within the OpenClaw framework. In our study, Single-HTML is adopted as the final generation setting because it offers stronger robustness and optimization efficiency than multi-page HTML and Python-based generation.

This release corresponds to the SFT stage of our unified training pipeline for presentation intelligence:

  1. 1.Cross-validated data synthesis
  2. 2.Guided supervised fine-tuning
  3. 3.Reinforcement learning with verifiable rewards

This checkpoint is the final pre-RL SFT model for the 35B-A3B MoE backbone.

Why this model?

PPT generation is a long-horizon task that jointly requires:

  • โ€”document understanding,
  • โ€”information acquisition,
  • โ€”content organization,
  • โ€”layout planning,
  • โ€”and visually coherent slide construction.

This model is designed to improve presentation generation beyond a generic base model through:

  • โ€”cross-validated synthetic task and rubric construction
  • โ€”teacher-enhanced trajectory distillation
  • โ€”mixed-teacher supervision
  • โ€”lightweight filtering of low-quality trajectories

The goal of this SFT stage is to substantially improve both:

  • โ€”benchmark-level presentation quality, and
  • โ€”basic slide aesthetics before RL refinement.

๐Ÿง  Training Recipe

Stage 1: Cross-validated data synthesis

The paper constructs a synthetic PPT-generation training corpus through a five-stage pipeline:

  • โ€”source profiling
  • โ€”task construction
  • โ€”rubric generation
  • โ€”principle audit
  • โ€”rubric tightening

Stage 2: Guided SFT with mixed teachers

The model is trained from Qwen3.6-35B-A3B using supervised fine-tuning on distilled presentation-generation trajectories.

Teacher models:

  • โ€”Qwen-3.8-Max: strong general coding and agentic reasoning
  • โ€”GLM-5.2: presentation-specialized teacher

Teacher guidance is strengthened through progressively richer prompts:

  • โ€”Base
  • โ€”Pro
  • โ€”Max

Training corpora are combined under:

  • โ€”Single
  • โ€”Mixed
  • โ€”Mixed+Filter

The released model corresponds to the selected mixed+filter checkpoint used as the RL initialization for the MoE backbone.

Selected setting for this release:

  • โ€”Target backbone: Qwen-3.6-35B-A3B
  • โ€”Training regime: mixed + filter
  • โ€”Selected teacher composition: qwen + glm_pro (filter)

๐Ÿ“Š Experimental Results

Main SFT results

Reported overall benchmark scores from the paper:

ModelPresentBenchGDPVal (PPT subset)
Qwen3.6-35B-A3B (base / no train)64.9374.01
Logics-PPT-Qwen3.6-35B-A3B-SFT74.2878.17

Compared with the base model, this SFT checkpoint improves:

  • โ€”PresentBench: 64.93 โ†’ 74.28 (+9.35)
  • โ€”GDPVal (PPT subset): 74.01 โ†’ 78.17 (+4.16)

These results show that the SFT pipeline produces substantial gains on both the in-domain benchmark and the external PPT evaluation subset.

Aesthetic metric snapshot

The paper also reports rule-based aesthetic scores for the selected SFT checkpoint:

Metric groupPresentBenchGDPVal (PPT subset)
Aspect ratio0.990.88
Whitespace0.890.73
Element collision avoidance0.740.49
Visual balance0.580.54
Font readability0.950.80
Total4.163.44

๐ŸŽฏ Intended Use

This model is intended for research use in:

  • โ€”automatic presentation generation
  • โ€”HTML-based slide generation
  • โ€”multimodal layout generation
  • โ€”long-horizon agentic generation
  • โ€”supervised post-training for deck synthesis
  • โ€”MoE backbones for structured generation

It is especially suitable for research on systems that:

  • โ€”read source materials,
  • โ€”plan a multi-slide presentation,
  • โ€”generate one HTML file per slide,
  • โ€”and render outputs for downstream evaluation or refinement.

โš ๏ธ Limitations

  • โ€”This is an SFT checkpoint, not the final RL-refined model.
  • โ€”Although it significantly improves overall presentation quality, post-render visual issues may still remain, including:
  • โ€”excessive whitespace,
  • โ€”imperfect balance,
  • โ€”element overlap,
  • โ€”and other fine-grained layout defects.
  • โ€”The model is optimized for single-slide HTML generation rather than native .pptx output.
  • โ€”Real deployment still requires the broader agent and rendering stack used in the paper.
  • โ€”Performance depends on task prompting, reference-material access, and rendering setup.

๐Ÿš€ Quickstart

Transformers: text-generation smoke test

python
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "Logics-MLLM/Logics-PPT-Qwen3.6-35B-A3B-SFT"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    dtype=torch.bfloat16,
    device_map="auto",
)
model.eval()

messages = [{
    "role": "user",
    "content": (
        "Create an 8-slide presentation as separate HTML slides for a technical topic. "
        "Use a consistent design system, clear hierarchy, and readable visual layout."
    ),
}]

inputs = tokenizer.apply_chat_template(
    messages,
    tokenize=True,
    add_generation_prompt=True,
    return_dict=True,
    return_tensors="pt",
).to(model.device)

with torch.inference_mode():
    output = model.generate(
        **inputs,
        max_new_tokens=2048,
        do_sample=True,
        temperature=1.0,
        top_p=0.95,
        top_k=20,
    )

completion = output[0, inputs["input_ids"].shape[-1]:]
print(tokenizer.decode(completion, skip_special_tokens=True))

This is only a minimal text-generation smoke test. Actual presentation generation in our setup additionally uses:

  • โ€”the OpenClaw-style agent framework,
  • โ€”task instruction files and reference materials,
  • โ€”browser rendering

๐Ÿ“š Citation

The technical report is currently under review. Citation information will be added after public release.

๐Ÿ™ Acknowledgements

We thank the Qwen, GLM, OpenClaw, PresentBench, and GDPVal teams and the broader research communities working on agentic generation, presentation intelligence, and reinforcement learning for LLMs.

License

The model weights are released under the Apache License 2.0.