Recommended models

Three tiers based on your available RAM and quality needs.

Tips for text summarization

1 For very long documents, use a chunked summarization approach: summarize sections, then summarize the summaries

2 Specify the desired output format in your prompt: bullet points, paragraph, key takeaways, etc.

3 A 8B model with a focused prompt often matches a 32B model's summary quality for straightforward content

4 Use lower temperature (0.1–0.3) for factual summarization to reduce hallucination risk

Related Pages

Find the right model for your Mac

DevPulse monitors your actual RAM usage and tells you exactly which models will run alongside your dev tools.

Download for macOS

macOS 14+ · Apple Silicon & Intel · Free during launch