Skip to content

feat: integrate opik with ragbits audit #352

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
kdziedzic68 opened this issue Feb 11, 2025 · 0 comments
Open

feat: integrate opik with ragbits audit #352

kdziedzic68 opened this issue Feb 11, 2025 · 0 comments
Labels
feature New feature or request

Comments

@kdziedzic68
Copy link
Contributor

Feature description

Implemenation of OpikTraceHandler inheriting from ragbits.core.audit.base.TraceHandler is needed.

  1. Opik metric parameters should be set up within constructor
  2. Opik requires its own wrappers to compute the metrics - potentially some generic wrapper to our stack should be implemented within ragbits.core

Motivation

Users want to track model quality performance on production

Additional context

No response
@kdziedzic68 kdziedzic68 added the feature New feature or request label Feb 11, 2025
@kdziedzic68 kdziedzic68 moved this to Backlog in ragbits Feb 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature New feature or request
Projects
ragbits
Status: Backlog
Milestone
No milestone
Development

No branches or pull requests
1 participant
@kdziedzic68