You can probably find some long-form tuned models on HF. I've had decent results... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Gracana on April 20, 2025 \| parent \| context \| favorite \| on: Gemma 3 QAT Models: Bringing AI to Consumer GPUs You can probably find some long-form tuned models on HF. I've had decent results with QwQ-32B (which I can run on my desktop) and Mistral Large (which I have to run on my server). Generating and refining an outline before writing the whole piece can help, and you can also split the piece up into multiple outputs (working a paragraph or two at a time, for instance). So far I've found it to be a tough process, with mixed results.

nico on April 20, 2025 [–]

Thank you, will try out your suggestions

Have you used something like a director model to supervise the output? If so, could you comment on the effectiveness of it and potentially any tips?

Gracana on April 21, 2025 | [–]

Nope, sounds neat though. There's so much to keep up with in this space.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact