Skip to content
SupportLogin
Combine

Combine

Combine multiple Datasets into a single new merged Dataset
datasets.combine.create(CombineCreateParams**kwargs) -> CombineCreateResponse
POST/api/v1/datasets/combine
Validate that a set of Datasets can be combined
datasets.combine.validate(CombineValidateParams**kwargs) -> CombineValidateResponse
POST/api/v1/datasets/combine/validate
ModelsExpand Collapse
class CombineCreateResponse: …
dataset_id: str

The newly created merged Dataset’s ID. Returns existing ID on idempotent replay.

class CombineValidateResponse: …
compatible: bool

Whether the proposed merge can proceed.

training_type: Optional[Literal["instruction_dataset", "preference_pairs"]]

Resolved training type for a compatible merge. Homogeneous source sets inherit their shared type; mixed instruction + preference sets resolve to instruction_dataset.

One of the following:
"instruction_dataset"
"preference_pairs"
total_estimated_rows: Optional[float]

Sum of processed_rows across all sources for a compatible merge.

issues: List[Issue]

Validation diagnostics. Errors block the merge; warnings describe reconciliation the merge performs automatically.

code: Literal["too_few_sources", "too_many_sources", "duplicate_source_ids", 9 more]

Stable machine-readable validation issue code.

One of the following:
"too_few_sources"
"too_many_sources"
"duplicate_source_ids"
"dataset_not_found"
"wrong_organization"
"dataset_not_ready"
"missing_run_id"
"mixed_multimodal_sources"
"all_preference_sources_missing_dpo_columns"
"incompatible_column_types"
"preference_source_missing_ranked_generations"
"mixed_training_types_resolved_to_sft"
level: Literal["error", "warning"]

error blocks the merge; warning describes automatic reconciliation.

One of the following:
"error"
"warning"
message: str

Preformed user-facing message.

count: Optional[float]
limit: Optional[float]
dataset_id: Optional[str]
status: Optional[str]
dataset_ids: Optional[List[str]]
multimodal_dataset_ids: Optional[List[str]]
text_dataset_ids: Optional[List[str]]
columns: Optional[List[IssueColumn]]
column: str

Column whose source types do not agree.

types: List[IssueColumnType]
dataset_id: str

Source Dataset ID.

type: str

DuckDB type observed for this Dataset.

cast_to: str

Common DuckDB type used by the merge.

types: Optional[List[IssueType]]
dataset_id: str

Source Dataset ID.

training_type: Literal["instruction_dataset", "preference_pairs"]

Training type resolved for this source Dataset.

One of the following:
"instruction_dataset"
"preference_pairs"