Plainsight
HomeOn-Demand LoginSupportRequest a Demo
Search
⌃K
Links

Output Data to Google Pub/Sub

A streaming pipeline can write pipeline output to a Google Pub/Sub topic. Users can configure a Pub/Sub connection which the pipeline will use as an output destination. For information on setting up Pub/Sub topics and to view the message format for publishing messages, see our Pub/Sub guide:
Add output destinations under the Outputs tab.
To configure a Google Pub/Sub connection as an output destination:
  1. 1.
    Navigate to the "Outputs" tab of your streaming pipeline.
  2. 2.
    Click the "Add Output" button on the far right. If you do not see this option, ensure you are in "Edit" mode.
  3. 3.
    Select the "Google Cloud Pub/Sub Connection" option.
Fill in the fields with the Pub/Sub connection information:
  1. 1.
    Enter a name for your output destination in the Output Name field. This is how it will display in your list of input sources. Example, Pipeline Output
  2. 2.
    Enter the Google Project ID for this Pub/Sub topic.
  3. 3.
    Enter the "Pub/Sub Topic" relative name. Only the relative name is needed, not the full name. For example, if the full topic name is projects/myproject/topics/mytopic then only mytopic should be entered.
  4. 4.
    Click "Choose File" and select the Service Account JSON file. The service account must have Pub/Sub publisher permissions for this topic.
  5. 5.
    When finished, click "Save Output" to add this output destination to your pipeline.
Configure a Google Pub/Sub topic to publish output data for your pipeline.
Once the complete pipeline is configured and published, your pipeline's output data will be published to the selected topic in our Pub/Sub Output Format.

Removing an Output Destination

Removing an output destination will stop pipeline output from being written to that location.
Removing an output destination cannot be undone.
To remove an output destination:
  1. 1.
    Navigate to the "Outputs" tab.
  2. 2.
    Under the Connected Outputs table, find the output you want to remove and click "Remove" under the Actions column. If you do not see this option, ensure you are in "Edit" mode.
  3. 3.
    You will be prompted to confirm the deletion. Click "Remove Output" to permanently remove the output destination from your pipeline.
Click to remove this output destination.
Previous
Output Data to Amazon S3
Next
Pipeline Blocks
Last modified 9mo ago