Add local model support

[mschuwalow]

Right now it's not possible to use golem-llm without an api key / with a local model. We should add support for ollama or one of the alternatives to address that usecase.

EDIT 1:
For testing, we should have ollama run in a docker image and run both durable and portable (optional) wasm against it. We can use some very small model that runs fine on cpu for this.

The tests should be written by writing a special testing component that will be composed with the respective golem-llm wasms using wac. The examples component should be used as the starting point and it's test cases should be included.
As the llms are non-deterministic by nature, just asserting the test functions pass and produce non-empty outputs is probably enough.

---

This composed component should then be executed using golem as the runtime.
This can be done by using the golem-test-framework. It is also used as part of the main repo and a lot of example tests using it can be found there.

---

If there are issues with using the golem-test-framework (there is very little documentation for it currently), an alternative is to start golem using one of two ways as part of the ci:

• using the golem server run command of the cli
• using the docker images published as part of the main repo. There are docker-compose files in the repo showcasing various setups

The component can then be uploaded to golem and invoked using the cli.

[jdegoes]

/bounty $750

[algora-pbc]

💎 $500 bounty • Ambati Sahithi

💎 $750 bounty • Golem Cloud

Steps to solve:

1. Start working: Comment /attempt #6 with your implementation plan
2. Submit work: Create a pull request including /claim #6 in the PR body to claim the bounty
3. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

❗ Important guidelines:

• To claim a bounty, you need to provide a short demo video of your changes in your pull request
• If anything is unclear, ask for clarification before starting as this will help avoid potential rework
• Low quality AI PRs will not receive review and will be closed
• Do not ask to be assigned unless you've contributed before

Thank you for contributing to golemcloud/golem-llm!

Attempt	Started (UTC)	Solution	Actions
🟢 @neo773	May 07, 2025, 01:29:14 PM	WIP
🟢 @Sanket6652	May 07, 2025, 03:56:38 PM	WIP
🟢 @varshith257	May 07, 2025, 07:14:24 PM	#7	Reward
🟢 @Rutik7066	May 08, 2025, 11:03:58 AM	#8	Reward
🟢 @luffy-orf	May 09, 2025, 04:32:21 PM	WIP
🟢 @Nanashi-lab	May 12, 2025, 09:40:35 AM	#12	Reward

[neo773]

/attempt #6

[Rutik7066]

/attempt #6

[luffy-orf]

/attempt #6

[Nanashi-lab]

/attempt #6