improved
Datasets v2
10 days ago by Cormick Marskamp
We've made a significant update to how datasets work in Orq.ai with the release of Datasets v2. This update merges variable collections into datasets, streamlining the structure and eliminating confusion between the two concepts.
What’s Changed?
Previously, variable collections only contained input variables, while Datasets v1 stored message arrays and optional references. With Datasets v2, we now combine everything into a single entity. This provides a single source of truth, making it clearer what constitutes a dataset and simplifying how datasets are used.
Why This Change?
- Eliminates confusion between datasets and variable collections.
- Creates a unified structure for better dataset management.
- Ensures consistency for experiments and historical logging.
Why use Datasets v2?
- Upload a dataset to evaluate your use case in an Experiment
- Save human-curated logs into curated datasets, which you can use to fine-tune your model.
- Save bad-rated logs, crucial for prompt engineers looking to refine prompts and improve output quality.
See an example of how to create a dataset below:
