Dapr Conversation API - DeepSeek with Ollama?

[thangchung]

Describe the feature

Currently, I am experimenting with Conversation API - deepseek. It works fine with the deepseek API key. But it could not work with the Ollama - deepseek model. I read through the code at https://github.com/dapr/components-contrib/blob/v1.15.0-rc.3/conversation/deepseek/deepseek.go, and found out that this component uses https://github.com/cohesion-org/deepseek-go, and it can only work with deepseek API (cloud platform).

Is there any way to run it with Ollama - Deepseek deepseek-r1:1.5b?

/cc @yaron2

My environment:

• Windows 11
• Dapr

[berndverst]

We can only rely on SDKs written in Go without C extensions.

I did a quick search for Go libraries related to Ollama but could not find any that do not use CGO.

Unfortunately, CGO based SDKs cannot be accepted for Dapr components. Dapr needs to be able to be compiled as a platform agnostic distribution.

If you find a Go SDK that does not use CGO that does what you want we will accept contributions with such a SDK.

[yaron2]

We can only rely on SDKs written in Go without C extensions.

I did a quick search for Go libraries related to Ollama but could not find any that do not use CGO.

Unfortunately, CGO based SDKs cannot be accepted for Dapr components. Dapr needs to be able to be compiled as a platform agnostic distribution.

If you find a Go SDK that does not use CGO that does what you want we will accept contributions with such a SDK.

I'm fairly certain the SDK we're using for Langchain supports Ollama without cgo: https://github.com/tmc/langchaingo

[github-actions]

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

[thangchung]

thanks @yaron2 @berndverst. I will have a look at it 👍

[github-actions]

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

[github-actions]

This issue has been automatically closed because it has not had activity in the last 37 days. If this issue is still valid, please ping a maintainer and ask them to label it as pinned, good first issue, help wanted or triaged/resolved. Thank you for your contributions.

[github-actions]

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.