Pipeline Components

A pipeline contains a Target Schema and is associated with a Mapper. The target schema is provided when initially creating the pipeline or after editing and deploying target schema changes. While, the mapper is created after you run a job in the pipeline.

Pipelines are used to map incoming data automatically. For a given pipeline, you can create jobs. Create a job with new source data, and the pipeline will use its mapper to map it to the pipeline’s target schema. If a mapper does not exist for a pipeline when the job is ran, it will use AI to generate the mapper.

See Get Pipeline to learn more about the pipeline specification.