v0.1.0-alpha

[ividal]

What's Changed

Roadmap features

[FEATURE] User can install Lumigator in their k8s cluster
[FEATURE] User can select multiple models to compare on the same dataset
[FEATURE] User can launch an experiment for summarization with a dataset that did not have ground-truth
[FEATURE] Evaluate experiment results
[FEATURE] User can launch an experiment for summarization that already has ground-truth
[FEATURE] Save inference output as a dataset which can be downloaded

Summary

New UI:

• Added detailed display for datasets and experiments.
• Enabled dataset download and results viewing.
• Improved job status updates and error handling.
• Added support for multiple models in experiments.
• Enabled ground truth generation (annotations) and improved dataset validation.

New SDK:

• Added support for experiments, datasets and launching annotation jobs.
• Introduced health endpoints and transparent error handling.
• Vendor caching adjustments.
• Packaged SDK plus integration tests.

API changes:

• Refactored jobs endpoints (/health, /jobs, /experiments).
• Exposed available models via endpoint (/models).
• Added support for CORS API requests and job status refreshes.
• Introduced alembic for database migrations and improved error handling.
• Added support for inference with seq2seq models (via Transformers) and opinionated annotations for summarization with BART-large-cnn.

Infrastructure:

• Migrated from Pants to UV for building and testing.
• Added Docker support for local development and deployment.
• Introduced Helm charts for backend and frontend services.
• Improved CI/CD pipelines for building and publishing Docker images and PyPI packages.
• Added support for Nvidia GPUs and debugging tools like Debugpy.

Documentation:

• User documentation and guides: https://mozilla-ai.github.io/lumigator/
• Improved documentation for dataset upload and model data.
• Added troubleshooting sections.
• Updated contributing guidelines and issue templates.

PRs

• Changing to DockerHub by @macaab26 in Changing to DockerHub #188
• Remove local test-dev-setup and clarify pants installation instructions by @veekaybee in Remove local test-dev-setup and clarify pants installation instructions #187
• Added all fixes in PR185 plus init script for localstack by @aittalam in Added all fixes in PR185 plus init script for localstack #186
• Added optional support for localstack persistence by @aittalam in Added optional support for localstack persistence #191
• Delete old local docker infra by @veekaybee in Delete old local docker infra #193
• Local documentation cleanup by @veekaybee in Local documentation cleanup  #192
• Few fixes on README by @aittalam in Few fixes on README #194
• doc: devcontainer restructure, links to main readme, minor typos by @ividal in doc: devcontainer restructure, links to main readme, minor typos #195
• Updated lumigator/README.md by @aittalam in Updated lumigator/README.md #197
• Updated notebooks README by @aittalam in Updated notebooks README #196
• Fixes notebook URL from relative path to static site to render correctly in GH by @veekaybee in Fixes notebook URL from relative path to static site to render correctly in GH #198
• [LUMI-28] Add minimal info on env vars by @javiermtorres in [LUMI-28] Add minimal info on env vars #200
• [LUMI-50] Set Docker Repository by @chainlink in [LUMI-50] Set Docker Repository #204
• chore: introduce issue templates by @ividal in chore: introduce issue templates #199
• Added updated notebook and deps by @aittalam in Added updated notebook and deps #211
• [LUMI-19] Coreweave s3 support by @agpituk in [LUMI-19] Coreweave s3 support #208
• [LUMI-21] Make required fields as required in chart by @javiermtorres in [LUMI-21] Make required fields as required in chart #201
• [LUMI-16] Allow a secret for the Mistral API to be auto-generated if needed by @javiermtorres in [LUMI-16] Allow a secret for the Mistral API to be auto-generated if needed #202
• Added first version of the new endpoint tutorial by @aittalam in Added first version of the new endpoint tutorial #212
• chore: ray image for local container depends on OS by @ividal in chore: ray image for local container depends on OS #210
• Direct port of lm-buddy to Lumigator by @veekaybee in Direct port of lm-buddy to Lumigator #209
• Resolving pathing and build dependencies between lm-buddy and Lumigator by @veekaybee in Resolving pathing and build dependencies between lm-buddy and Lumigator #220
• Change link for metrics by @veekaybee in Change link for metrics #222
• [LUMI-33] Move env vars to settings by @javiermtorres in [LUMI-33] Move env vars to settings #205
• Added extra hosts to match localhost from lumigator to local laptop by @agpituk in Added extra hosts to match localhost from lumigator to local laptop #218
• Removing jobrunner by @aittalam in Removing jobrunner #217
• Add documentation for environment variables in README and docker compose by @javiermtorres in Add documentation for environment variables in README and docker compose #221
• Davide/datasets fix by @aittalam in Davide/datasets fix #214
• README related tweak (PANTS_GUIDE.md) by @peteski22 in README related tweak (PANTS_GUIDE.md) #234
• Change lm-buddy to evaluator and remove finetuning module by @veekaybee in Change lm-buddy to evaluator and remove finetuning module #226
• CLI :Remove Ragas and Prometheus from CLI by @peteski22 in CLI :Remove Ragas and Prometheus from CLI #238
• Lumi 69 fix by @aittalam in Lumi 69 fix #242
• Remove extra file by @chainlink in Remove extra file #244
• [LUMI-133] Create Backend Package and drop mzai top level package by @chainlink in [LUMI-133] Create Backend Package and drop mzai top level package  #243
• Fix up Env Vars for AWS Creds by @chainlink in Fix up Env Vars for AWS Creds #247
• Parametrized job submission by @aittalam in Parametrized job submission #248
• [LUMI-107] Add UV to backend by @chainlink in [LUMI-107] Add UV to backend #249
• Initial work on 'base' SDK and health endpoints. by @peteski22 in Initial work on 'base' SDK and health endpoints. #250
• make the client 'private' by @peteski22 in make the client 'private' #253
• Adding OpenAI key to Helm Chart by @macaab26 in Adding OpenAI key to Helm Chart #246
• SDK: Add 'Completions' by @peteski22 in SDK: Add 'Completions' #252
• [LUMI-108] Add docker backend by @chainlink in [LUMI-108] Add docker backend #251
• Removing cli module to move cli components closer to entrypoint by @veekaybee in Removing cli module to move cli components closer to entrypoint  #256
• Use custom sql init (sqlite) by @javiermtorres in Use custom sql init (sqlite) #236
• Deploy locally on Linux without root access by @dpoulopoulos in Deploy locally on Linux without root access #261
• [LUMI-106] Make evaluator work dir configurable for different environments by @chainlink in [LUMI-106] Make evaluator work dir configurable for different environments #260
• Davide/lumi 100 fix ld preload by @aittalam in Davide/lumi 100 fix ld preload #254
• [LUMI-53] [Security] Remove secrets from RAY_WORKER_ENV_VARS by @chainlink in [LUMI-53] [Security] Remove secrets from RAY_WORKER_ENV_VARS #267
• [LUMI-110] Move evaluator into it's own folder for module resolution by @chainlink in [LUMI-110] Move evaluator into it's own folder for module resolution #263
• SDK: Add 'experiments' by @peteski22 in SDK: Add 'experiments' #259
• Check test race conditions by @javiermtorres in Check test race conditions #237
• [LUMI-131] Working local docker compose without pants deps by @chainlink in [LUMI-131] Working local docker compose without pants deps #270
• Adding CONTRIBUTING by @veekaybee in Adding CONTRIBUTING #271
• SDK: add datasets by @javiermtorres in SDK: add datasets #255
• [LUMI-150] Run backend tests via uv by @chainlink in [LUMI-150] Run backend tests via uv #278
• [LUMI-151] Run backend tests in Github via UV by @chainlink in [LUMI-151] Run backend tests in Github via UV #276
• Added GT field recording whether a dataset contains GT by @aittalam in Added GT field recording whether a dataset contains GT #274
• [LUMI-149] Move schemas to top level by @chainlink in [LUMI-149] Move schemas to top level #281
• [LUMI-148] Move SDK to subfolder for packaging by @chainlink in [LUMI-148] Move SDK to subfolder for packaging #283
• [LUMI-154] Add uv to SDK project by @chainlink in [LUMI-154] Add uv to SDK project #286
• [LUMI-155] Add Github action for SDK tests by @chainlink in [LUMI-155] Add Github action for SDK tests #287
• [LUMI-157] Update readme with uv by @chainlink in [LUMI-157] Update readme with uv #288
• [LUMI-101]Adding build & push new action for uv by @macaab26 in [LUMI-101]Adding build & push new action for uv #279
• Remove summarizer, ground truth deployment, and Ray serve by @veekaybee in Remove summarizer, ground truth deployment, and Ray serve #280
• [LUMI-156] Drop pants by @chainlink in [LUMI-156] Drop pants #282
• [LUMI-157] Update backend tests docs to remove pants and change to uv by @chainlink in [LUMI-157] Update backend tests docs to remove pants and change to uv #289
• Removal of heading that was not required in PR template. by @peteski22 in Removal of heading that was not required in PR template. #284
• Ruff fixes by @macaab26 in Ruff fixes #293
• Added support for Local environment for non contributors by @agpituk in Added support for Local environment for non contributors #291
• Add option to build to main docker-compose file and add make target by @chainlink in Add option to build to main docker-compose file and add make target #295
• Add integration tests by @javiermtorres in Add integration tests #273
• Adding / fixing fmt and lint by @macaab26 in Adding / fixing fmt and lint #294
• test: Initial backend integration tests involving experiments by @ividal in Initial backend integration tests involving experiments  #290
• [LUMI-181] Drop remaining pants BUILD files by @chainlink in [LUMI-181] Drop remaining pants BUILD files #301
• [LUMI-182] Don't launch postgres in test suite (not used anymore) by @chainlink in [LUMI-182] Don't launch postgres in test suite (not used anymore) #300
• [ LUMI-184] Build lumigator before tests by @chainlink in [ LUMI-184] Build lumigator before tests #298
• [LUMI-183] Make test by @chainlink in [LUMI-183] Make test #299
• [LUMI-37] Refactor experiments service into jobs and create inference and evaluation jobs by @veekaybee in [LUMI-37] Refactor experiments service into jobs and create inference and evaluation jobs #285
• Adding ternary operator to tag latest only in main by @macaab26 in Adding ternary operator to tag latest only in main #305
• Linting: uvx ruff check --fix --config ruff.toml by @peteski22 in Linting: uvx ruff check --fix --config ruff.toml #308
• test: avoid bad not found messages by @ividal in test: avoid bad not found messages #314
• only override values required locally by @chainlink in only override values required locally #311
• Change dataset input fields to required only by @veekaybee in Change dataset input fields to required only  #306
• Add docker compose external file with overrides for using external deps by @chainlink in Add docker compose external file with overrides for using external deps #312
• Batch inference round 1/n by @aittalam in Batch inference round 1/n #309
• Backend: Introduce alembic to assist with database migrations by @peteski22 in Backend: Introduce alembic to assist with database migrations #307
• Separate dev dependencies and add pre-commit support by @macaab26 in Separate dev dependencies and add pre-commit support #304
• Comment fix by @macaab26 in Comment fix #319
• Provide jobs endpoint to SDK by @javiermtorres in Provide jobs endpoint to SDK  #302
• Backend: Tests use Alembic by @peteski22 in Backend: Tests use Alembic #320
• chore: tear down containers launched after make test by @ividal in chore: tear down containers launched after make test #327
• Remove docker-compose volume mount to avoid .venv conflicts by @agpituk in Remove docker-compose volume mount to avoid .venv conflicts #323
• Update README.md by @njbrake in Update README.md #334
• Git Ignore: Ignore temporary journal logs for SQLite by @peteski22 in Git Ignore: Ignore temporary journal logs for SQLite #338
• Removed duplicated line from deps.py by @aittalam in Removed duplicated line from deps.py #342
• Datasets: deleting a dataset with a DB entry but no S3 file should be handled correctly by @peteski22 in Datasets: deleting a dataset with a DB entry but no S3 file should be handled correctly #332
• Lumigator Docs by @dpoulopoulos in Lumigator Docs #341
• API: health/jobs related endpoints - correctly handle 404s etc by @peteski22 in API: health/jobs related endpoints - correctly handle 404s etc #318
• Linting/tooling clean up by @peteski22 in Linting/tooling clean up #344
• Trigger push to dockerhub only when merging PRs by @agpituk in Trigger push to dockerhub only when merging PRs #346
• 201 Create - adds Location by @peteski22 in 201 Create - adds Location #347
• Added support for llamafile model names by @kernel-loophole in Added support for llamafile model names #321
• Update Notebooks to reflect current API use by @dpoulopoulos in Update Notebooks to reflect current API use #345
• workflows: Amend Notebook integration test by @dpoulopoulos in workflows: Amend Notebook integration test #350
• [LUMI-224] Delete old dockerfiles by @chainlink in [LUMI-224] Delete old dockerfiles #353
• Package SDK by @javiermtorres in Package SDK #313
• Centralized environment variables and removed external docker-compose by @agpituk in Centralized environment variables and removed external docker-compose #352
• Changed ordering of commands in make local-up by @aittalam in Changed ordering of commands in make local-up #354
• Project directory structure by @george-mzai in Project directory structure #336
• Amend the repository's README files by @dpoulopoulos in Amend the repository's README files #357
• Docs: typo fix, and some styling/layout/links by @peteski22 in Docs: typo fix, and some styling/layout/links #358
• Linting: uvx ruff check --fix (again) by @peteski22 in Linting: uvx ruff check --fix (again) #360
• GHA: Update names of workflow jobs by @peteski22 in GHA: Update names of workflow jobs #361
• run tests (SDK/Backend) on PR changes and when PRs merge to main by @peteski22 in run tests (SDK/Backend) on PR changes and when PRs merge to main #370
• Build and Publish docs only if there are no broken links by @dpoulopoulos in Build and Publish docs only if there are no broken links #369
• Fix badge links and names by @dpoulopoulos in Fix badge links and names #371
• Docs: Frontend README separation to /docs by @peteski22 in Docs: Frontend README separation to /docs #367
• LUMI-127 adding inference API by @aittalam in LUMI-127 adding inference API #328
• Dataset detailed display by @george-mzai in Dataset detailed display #372
• Set max samples to unlimited by default with option to override API request cycle by @veekaybee in Set max samples to unlimited by default with option to override API request cycle #374
• Add test instructions by @javiermtorres in Add test instructions #365
• Adding job logs support to health endpoint [LUMI-211] by @aittalam in Adding job logs support to health endpoint [LUMI-211] #324
• GitHub actions: allow docker image build to be a required check by @peteski22 in GitHub actions: allow docker image build to be a required check #378
• Exit link checker and docs workflow early if no changes to /docs by @peteski22 in Exit link checker and docs workflow early if no changes to /docs #394
• GitHub actions: update link checker and docs build workflows by @peteski22 in GitHub actions: update link checker and docs build workflows #398
• GHA: docs - merge link checking and build/publish by @peteski22 in GHA: docs - merge link checking and build/publish #397
• Add Pull Request Labeler by @daavoo in Add Pull Request Labeler #366
• Docs typo: missing 'L' by @peteski22 in Docs typo: missing 'L' #383
• Fix/docs/conceptual guides/lumigator endpoints by @GuilhermeRava in Fix/docs/conceptual guides/lumigator endpoints #390
• GHA: add additional labels for PR labeler by @peteski22 in GHA: add additional labels for PR labeler #401
• Copy updates to Datasets page by @hasangzl in Copy updates to Datasets page #392
• Separating out setting model type into a separate method in the job service by @veekaybee in Separating out setting model type into a separate method in the job service #385
• GHA: SDK - run unit tests only when there are changes to SDK by @peteski22 in GHA: SDK - run unit tests only when there are changes to SDK #402
• Frontend Dockerfile by @macaab26 in Frontend Dockerfile #376
• Re-enable experiment endpoint by @javiermtorres in Re-enable experiment endpoint #377
• Added label + title suggestion in issue template for bugs by @aittalam in Added label + title suggestion in issue template for bugs #412
• doc: notebook and documentation instructions to install schemas and sdk assume pypi by @ividal in 410 notebook and documentation instructions to install schemas and sdk assume pypi #416
• Frontend: support single page apps (SPA) when served with nginx by @peteski22 in Frontend: support single page apps (SPA) when served with nginx #420
• UI: Trigger experiment 🧪 💥 by @george-mzai in UI: Trigger experiment 🧪 💥 #409
• fix: install schemas explicitly by @ividal in fix: install schemas explicitly #430
• [backend] Expose suggested models by @dpoulopoulos in [backend] Expose suggested models #419
• Frontend: ensure .env file is available to container during build by @peteski22 in Frontend: ensure .env file is available to container during build #431
• Check that extra params in job creation are forbidden by @javiermtorres in Check that extra params in job creation are forbidden #396
• Test rearrangement by @javiermtorres in Test rearrangement #429
• GHA: Prevent merging a PR to main when 'do-not-merge' label is present by @peteski22 in GHA: Prevent merging a PR to main when 'do-not-merge' label is present #443
• makefile: Run tests without altering state by @dpoulopoulos in makefile: Run tests without altering state #442
• Deployment: Add frontend profile to start-lumigator by @peteski22 in Deployment: Add frontend profile to start-lumigator #452
• New action to build the FE by @macaab26 in New action to build the FE #418
• github: Amend GitHub issue and PR templates by @dpoulopoulos in github: Amend GitHub issue and PR templates #455
• Frontend: GHA tweak to add checkout action before checking for path changes by @peteski22 in Frontend: GHA tweak to add checkout action before checking for path changes #457
• API: Allow CORS API requests no matter what FQDN the UI is hosted on by @peteski22 in API: Allow CORS API requests no matter what FQDN the UI is hosted on #441
• backend: Refresh job status by @dpoulopoulos in backend: Refresh job status #451
• [BUG] Limit auto-reload to relevant directories by @dpoulopoulos in [BUG] Limit auto-reload to relevant directories #446
• Linting: uvx ruff check by @peteski22 in Linting: uvx ruff check #459
• chore: Fix typo in PR teplate by @dpoulopoulos in chore: Fix typo in PR teplate #465
• evaluator: Upgrade the openai client by @dpoulopoulos in evaluator: Upgrade the openai client #467
• doc: Update contributing.md (pre-MVP phase) by @ividal in Update contributing.md (pre-MVP phase) #444
• Check tag consistency as a requirement to publishing by @javiermtorres in Check tag consistency as a requirement to publishing #425
• chore: Fix bullet list in CONTRIBUTING.md by @dpoulopoulos in chore: Fix bullet list in CONTRIBUTING.md #476
• feature(API): support seq2seq models by @dpoulopoulos in 339 support seq2seq models #477
• Refactor model_path to model_uri by @dpoulopoulos in Refactor model_path to model_uri #464
• Display Experiment results by @george-mzai in Display Experiment results #440
• Ensure Frontend service starts with Make by @agpituk in Ensure Frontend service starts with Make #498
• Retrofit requests-mock in SDK by @javiermtorres in Retrofit requests-mock in SDK #502
• Disable results btn on failed experiments by @george-mzai in Disable results btn on failed experiments #496
• Download Results by @george-mzai in Download Results #497
• Publish to PyPI and to DockerHub with semver by @macaab26 in Publish to PyPI and to DockerHub with semver #506
• Fix job's results file name by @dpoulopoulos in Fix job's results file name #504
• Change inference job's results file name by @dpoulopoulos in Change inference job's results file name #517
• Changing to PyPI by @macaab26 in Changing to PyPI #520
• Publish PyPI packages and images with tags by @macaab26 in Publish PyPI packages and images with tags #528
• Store the dataset generated by an inference job by @dpoulopoulos in Store the dataset generated by an inference job #522
• Fix SDK tests by @javiermtorres in Fix SDK tests #536
• Changing versions by @macaab26 in Changing versions #529
• Fixing errors in SDK pipeline by @macaab26 in Fixing errors in SDK pipeline #538
• SDK transparent error handling by @javiermtorres in SDK transparent error handling #537
• API: Refactor jobs endpoints from health/ to jobs/ by @peteski22 in API: Refactor jobs endpoints from health/ to jobs/ #514
• Resolves issue 507 - UI fixes by @george-mzai in Resolves issue 507 - UI fixes #530
• Fix FE build and push by @macaab26 in Fix FE build and push #545
• Adding .env for frontend by @macaab26 in Adding .env for frontend #547
• UI: Ensure (all) experiments which can have their status updated, get their status updated. by @peteski22 in UI: Ensure (all) experiments which can have their status updated, get their status updated. #542
• Fix frontend build by @agpituk in Fix frontend build #548
• Fix error in path by @macaab26 in Fix error in path #564
• Backend: Replacing evaluation module that currently does eval+inference with just evaluation (Issue 435) by @veekaybee in Backend: Replacing evaluation module that currently does eval+inference with just evaluation (Issue 435) #523
• Workflow using independent inference and evaluation, without annotation service #485 Build workflow calling inference + evaluation jobs sequentially by @aittalam in #485 Build workflow calling inference + evaluation jobs sequentially #540
• feature(API): annotation/ground truth generation uses new inference job by @ividal in 337 annotation/ground truth generation uses new inference job #519
• Add fakes for the S3 service and use the standalone localstack by @javiermtorres in Add fakes for the S3 service and use the standalone localstack #453
• SDK: Adjust behaviour for vendor caching by @peteski22 in SDK: Adjust behaviour for vendor caching #578
• Hotfix for container stop in tests by @javiermtorres in Hotfix for container stop in tests #591
• Docker: Clean up docker compose by @peteski22 in Docker: Clean up docker compose #594
• Remove global include from Makefile by @agpituk in Remove global include from Makefile #595
• Issue 556 retrieve models by @george-mzai in Issue 556 retrieve models #596
• API:include URL to website for models by @peteski22 in API:include URL to website for models #603
• Add postgres helm chart as dependency by @chainlink in Add postgres helm chart as dependency #203
• Move backend to subchart by @chainlink in Move backend to subchart #575
• Restoring models' website urls by @george-mzai in Restoring models' website urls #606
• Fix: API website URL for model update by @peteski22 in Fix: API website URL for model update #607
• SDK healthcheck retry configuration by @javiermtorres in SDK healthcheck retry configuration #587
• API: Documentation improvement for dataset upload by @peteski22 in API: Documentation improvement for dataset upload #598
• Connect multiple jobs under one experiment by @dpoulopoulos in Connect multiple jobs under one experiment #592
• Push frontend to dockerhub in more cases by @chainlink in Push frontend to dockerhub in more cases #615
• Update typos in API docs by @peteski22 in Update typos in API docs #617
• docs: Clarify suggested models scope and usage by @dpoulopoulos in docs: Clarify suggested models scope and usage #561
• Harden OpenAI and Mistral env var injection by @veekaybee in Harden OpenAI and Mistral env var injection #599
• [FEATURE] Support for Debugpy by @njbrake in [FEATURE] Support for Debugpy #612
• 568 wire eval lite by @aittalam in 568 wire eval lite #616
• Fix runner FE builds by @macaab26 in Fix runner FE builds #623
• Pipeline refactor by @macaab26 in Pipeline refactor #608
• Changing README badges by @macaab26 in Changing README badges #631
• UI: Fix missing model.path and max_samples parsed from job entrypoint config by @peteski22 in UI: Fix missing model.path and max_samples parsed from job entrypoint config #625
• Replace localstack with minio by @javiermtorres in Replace localstack with minio #491
• Use nginx to send Lumigator requests from the FE to any backend deployment by @agpituk in Use nginx to send Lumigator requests from the FE to any backend deployment #610
• Check Minio health more often by @njbrake in Check Minio health more often #638
• Frontend: Change to relative backend by @chainlink in Frontend: Change to relative backend #627
• UI: Fix - Change the way we decide if a property is present from entrypoint config by @peteski22 in UI: Fix - Change the way we decide if a property is present from entrypoint config #640
• Bug fix: Assigned correct template to gpt-4o, removed gpt-3.5 by @aittalam in Bug fix: Assigned correct template to gpt-4o, removed gpt-3.5 #641
• 559 add inference job tests to makefile by @aittalam in 559 add inference job tests to makefile #633
• Use output-field field in inference requests by @javiermtorres in Use output-field field in inference requests  #630
• Fix architecture bug by @macaab26 in Fix architecture bug #637
• Docs: Update alembic guide to include uv by @peteski22 in Docs: Update alembic guide to include uv #649
• Build always BE by @chainlink in Build always BE #652
• Change from EXPERIMENT to JOB to match schema by @chainlink in Change from EXPERIMENT to JOB to match schema #650
• Docs: Update docs to include instructions to stop Lumigator by @HareeshBahuleyan in Docs: Update docs to include instructions to stop Lumigator #654
• Add frontend chart by @chainlink in Add frontend chart #582
• fix: crash if requested output field for inference doesn't exist in dataset by @ividal in fix: crash if requested output field for inference doesn't exist in dataset #624
• Fix docker clean by @aittalam in Fix docker clean #656
• Docs: Mention Lumigator UI usage in README + minor improvements by @HareeshBahuleyan in Docs: Mention Lumigator UI usage in README + minor improvements  #647
• [NFC] Remove unused Ray environment variables by @njbrake in [NFC] Remove unused Ray environment variables #639
• Multiple models experiment - Issue#554 by @george-mzai in Multiple models experiment - Issue#554  #642
• clear selected job upon dismissing details by @george-mzai in clear selected job upon dismissing details #671
• remove models that don't support generic summaries. by @njbrake in remove models that don't support generic summaries. #673
• Removed references to minio, added frontend container by @aittalam in Removed references to minio, added frontend container #669
• Minor consolidation of Environment Variables by @njbrake in Minor consolidation of Environment Variables #614
• Fix bad links in readme by @njbrake in Fix bad links in readme #679
• Add experiment record handling to experiment service by @javiermtorres in Add experiment record handling to experiment service #604
• API/Storage: Recreate a CSV from the uploaded dataset (CSV) and allow filtering for downloads by @peteski22 in API/Storage: Recreate a CSV from the uploaded dataset (CSV) and allow filtering for downloads #657
• Use Job name instead of a reference to the address in memory. by @njbrake in Use Job name instead of a reference to the address in memory. #677
• Issue 480 experiment results by @george-mzai in Issue 480 experiment results #681
• UI: Enable dataset download icon and download CSV by default by @peteski22 in UI: Enable dataset download icon and download CSV by default #685
• 658 GPU support + related env vars on Linux + getting started instructions on Readme by @ividal in 658 GPU support + related env vars on Linux + getting started instructions on Readme #659
• API: Models - add flag to indicate if a model requires an API key by @peteski22 in API: Models - add flag to indicate if a model requires an API key #689
• UI/models/separate api hf by @peteski22 in UI/models/separate api hf #691
• add pending to jobs by @chainlink in add pending to jobs #695
• Add pip reqs to backend by @chainlink in Add pip reqs to backend #696
• API/UI: Make model data more flexible for future use by @peteski22 in API/UI: Make model data more flexible for future use #700
• doc: missing nvidia-container-toolkit instructions by @ividal in doc: missing nvidia-container-toolkit instructions #707
• fix: empty ground-truth column should mean no ground-truth by @ividal in fix: empty ground-truth column should mean no ground-truth #676
• Issue 509 dataset validation by @george-mzai in Issue 509 dataset validation #708
• Docs: Add a page in docs with step-by-step instructions on how to use Lumigator UI by @HareeshBahuleyan in Docs: Add a page in docs with step-by-step instructions on how to use Lumigator UI #684
• Use Job Schemas to validate input and output of jobs (inference & eval_lite) by @njbrake in Use Job Schemas to validate input and output of jobs (inference & eval_lite) #692
• Remove nonworking models, add documentation by @javiermtorres in Remove nonworking models, add documentation #711
• Add annotations to the SDK by @javiermtorres in Add annotations to the SDK #682
• Factor out job and experiment status check loops by @javiermtorres in Factor out job and experiment status check loops #699
• Remove view option by @george-mzai in Remove view option #697
• Created troubleshooting section, added disk space error by @aittalam in Created troubleshooting section, added disk space error #713
• Added API keys / tokens troubleshooting section + fixes by @aittalam in Added API keys / tokens troubleshooting section + fixes #720
• Ray env var empty string fix by @veekaybee in Ray env var empty string fix #721
• [NFC] Remove unused package-lock files by @njbrake in [NFC] Remove unused package-lock files #636
• HotReload for Jobs in Dev Mode by @njbrake in HotReload for Jobs in Dev Mode #725
• Backend: Decouple datasets service from HTTP presentation layer by @peteski22 in Backend: Decouple datasets service from HTTP presentation layer #719
• Debugpy comes to Unit Tests! by @njbrake in Debugpy comes to Unit Tests! #715
• 724 update backend documentation by @aittalam in 724 update backend documentation #727
• Add warning about local-template env mismatch to Makefile by @veekaybee in Add warning about local-template env mismatch to Makefile #726
• UI - Generate ground truth by @george-mzai in UI - Generate ground truth #722
• Remove unneeded config options from the front end chart by @chainlink in Remove unneeded config options from the front end chart #732
• Simplify supported configuration options for backend chart by @chainlink in Simplify supported configuration options for backend chart #731
• Add ray dependency to helm chart by @macaab26 in Add ray dependency to helm chart #672
• Updating the CONTRIBUTING file by @davidmanzanoai in Updating the CONTRIBUTING file #680
• Backend: Decouple completions service from HTTP presentation layer by @peteski22 in Backend: Decouple completions service from HTTP presentation layer #739
• Comment out default resource requests for Ray by @chainlink in Comment out default resource requests for Ray #747
• fix(doc): RAY_WORKER_GPU* by @ividal in fix(doc): RAY_WORKER_GPU* #743
• Updating documentation by @macaab26 in Updating documentation #745
• Changing tag regexp by @macaab26 in Changing tag regexp #749
• Changing version for the release by @macaab26 in Changing version for the release #751
• Changing version by @macaab26 in Changing version #753

New Contributors

• @ividal made their first contribution in doc: devcontainer restructure, links to main readme, minor typos #195
• @javiermtorres made their first contribution in [LUMI-28] Add minimal info on env vars #200
• @agpituk made their first contribution in [LUMI-19] Coreweave s3 support #208
• @peteski22 made their first contribution in README related tweak (PANTS_GUIDE.md) #234
• @dpoulopoulos made their first contribution in Deploy locally on Linux without root access #261
• @kernel-loophole made their first contribution in Added support for llamafile model names #321
• @george-mzai made their first contribution in Project directory structure #336
• @daavoo made their first contribution in Add Pull Request Labeler #366
• @GuilhermeRava made their first contribution in Fix/docs/conceptual guides/lumigator endpoints #390
• @hasangzl made their first contribution in Copy updates to Datasets page #392
• @HareeshBahuleyan made their first contribution in Docs: Mention Lumigator UI usage in README + minor improvements  #647
• @davidmanzanoai made their first contribution in Updating the CONTRIBUTING file #680

Full Changelog: dublin...v0.1.0-alpha

---

This discussion was created from the release v0.1.0-alpha.