Skip to content

Conversation

smola
Copy link
Contributor

@smola smola commented Jul 9, 2025

Perplexity setup example. See their docs. Tested with the sonar model.

Summarization of chats does not seem to work, output is always <think>. But otherwise, works fine.

@frankroeder
Copy link
Owner

Hi @smola, thank you for your PR. Yes, using r1-1776 as a topic model is not optimal because of those <think> blocks. It would be better to use a non-reasoning model for that.

@frankroeder frankroeder merged commit b219863 into frankroeder:main Jul 9, 2025
2 checks passed
@smola smola deleted the smola/perplexity branch July 11, 2025 14:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants