Combine

Combine multiple Datasets into a single new merged Dataset

POST/api/v1/datasets/combine

Validate that a set of Datasets can be combined

POST/api/v1/datasets/combine/validate

ModelsExpand Collapse

CombineCreateResponse object { dataset_id }

dataset_id: string

The newly created merged Dataset’s ID. Returns existing ID on idempotent replay.

CombineValidateResponse object { compatible, training_type, total_estimated_rows, issues }

compatible: boolean

Whether the proposed merge can proceed.

training_type: optional "instruction_dataset" or "preference_pairs"

Resolved training type for a compatible merge. Homogeneous source sets inherit their shared type; mixed instruction + preference sets resolve to instruction_dataset.

One of the following:

"instruction_dataset"

"preference_pairs"

total_estimated_rows: optional number

Sum of processed_rows across all sources for a compatible merge.

issues: array of object { code, level, message, 9 more }

Validation diagnostics. Errors block the merge; warnings describe reconciliation the merge performs automatically.

code: "too_few_sources" or "too_many_sources" or "duplicate_source_ids" or 9 more

Stable machine-readable validation issue code.

One of the following:

"too_few_sources"

"too_many_sources"

"duplicate_source_ids"

"dataset_not_found"

"wrong_organization"

"dataset_not_ready"

"missing_run_id"

"mixed_multimodal_sources"

"all_preference_sources_missing_dpo_columns"

"incompatible_column_types"

"preference_source_missing_ranked_generations"

"mixed_training_types_resolved_to_sft"

level: "error" or "warning"

error blocks the merge; warning describes automatic reconciliation.

One of the following:

"error"

"warning"

message: string

Preformed user-facing message.

count: optional number

limit: optional number

dataset_id: optional string

status: optional string

dataset_ids: optional array of string

multimodal_dataset_ids: optional array of string

text_dataset_ids: optional array of string

columns: optional array of object { column, types, cast_to }

column: string

Column whose source types do not agree.

types: array of object { dataset_id, type }

dataset_id: string

Source Dataset ID.

type: string

DuckDB type observed for this Dataset.

cast_to: string

Common DuckDB type used by the merge.

types: optional array of object { dataset_id, training_type }

dataset_id: string

Source Dataset ID.

training_type: "instruction_dataset" or "preference_pairs"

Training type resolved for this source Dataset.

One of the following:

"instruction_dataset"

"preference_pairs"