Create and modify pipelines

To create a pipeline using the Telemetry Pipeline web interface:

1. Sign in to Telemetry Pipeline (opens in a new tab).
2. Open the project where you want to deploy a new pipeline.
3. Go to Core Instances, and then click the name of the Core Instance running in the environment where you want to deploy a new pipeline.
4. In the Data Pipelines section, click Create Data Pipeline.
5. In the dialog that appears, configure the following options:
   • Name: The name to give your pipeline.
   • Service type: The Service type to use for your pipeline.
   • Workload type: The Workload type to use for your pipeline.
   • Storage class: (StatefulSet pipelines only) The StorageClass (opens in a new tab) to use for each Pod’s PersistentVolume (opens in a new tab). After you set this value for a StatefulSet pipeline, you can’t modify it.
   • Retention policy when scaled: (StatefulSet pipelines only) Specifies whether Kubernetes should retain or delete the PersistentVolumeClaim (opens in a new tab) (PVC) associated with each affected Pod if the StatefulSet pipeline is scaled down.
   • Retention policy when deleted: (StatefulSet pipelines only) Specifies whether Kubernetes should retain or delete each Pod’s PVC if the StatefulSet pipeline is deleted.
6. Click Save and continue.
7. Add and configure your source plugins and destination plugins.
8. Add processing rules to transform the telemetry data as it passes through your pipeline.
9. Click Save and Deploy to finish creating your pipeline.

To modify a pipeline in the Telemetry Pipeline web interface:

1. Sign in to Telemetry Pipeline (opens in a new tab).
2. Open the project that contains the pipeline that you want to modify.
3. Go to Core Instances, then click the name of the Core Instance associated with the pipeline you want to modify.
4. Under Data Pipelines, click the name of the pipeline that you want to modify.
5. Click Edit.
6. Configure the source, destination, and processing rules for your pipeline.
7. Click Save and Deploy to save your changes.
8. To manage advanced pipeline settings, go to the  Advanced Settings page. The settings on this page include:
   • Replicas
   • Deployment strategy
   • Version and agent image type
   • Files
   • Secrets

To delete a pipeline in the Telemetry Pipeline web interface:

1. Sign in to Telemetry Pipeline (opens in a new tab).
2. Open the project that contains the pipeline that you want to delete.
3. Go to Core Instances, then click the name of the Core Instance associated with the pipeline you want to delete.
4. Under Data Pipelines, find the pipeline that you want to delete, and then click Settings > Delete.
5. In the confirmation dialog that appears, click Delete to permanently delete your pipeline.