View and Sample Pipeline Data

You can view the data streaming between the nodes of your deployed Pipeline by using a Pipeline Tap. A Pipeline Tap also enables you sample data from your deployed pipeline to use to Simulate and Test Pipeline Data Streams.

View Pipeline Data

You can only open Pipeline Tap or sample Pipeline data on deployed Pipelines.
  1. Log in to the Mezmo Web App.
  2. Click Pipelines.
  3. Select the Pipeline where you want to examine the data stream.
  4. In that Pipeline, click on the Source or Processor node where you want to examine the egress data.
  5. Click Tap.

You will see the data flowing from that Source or Processor begin to stream in the Pipeline Tap window based on the number of Log Events you set.

If you make a change to a Processor's configuration and want to view the effect with a Tap, make sure to Clear any previous Taps. Otherwise, the new Tap output will be added to the bottom of the previous output.

Sample Pipeline Data

You can sample data from the Pipeline Tap to use in testing your Processors while you are developing your Pipeline.

  1. Open a Pipeline Tap for the Source that you want to sample data from, and use the filters to select specific events that you want to sample.
  2. Click Save as sample.
  3. Enter a name for the sample, then click Save sample. The sample will be added to the Sample Management inventory for the Pipeline.

Simulate and Test Pipeline Data Streams provides more information on how to use samples for testing Pipelines in development, along with an overview video.

Create Samples in a Pipeline

If you have a file or raw data you want to use in simulating a Pipeline, you can easily add that data to the sample sets with the Create option.

  1. On any Pipeline Source, click the Simulate .

  2. Click Create New Sample.

  3. Either paste your data into the sample window, or upload a formatted file. You can paste or upload these types of files

    1. Paste JSON objects or arrays with all of your events
    2. Paste NDJSON with all of your events
    3. Paste Text with each line as a separate event
    4. Upload a file with the events separated by line

  4. Click Add sample data if you pasted the input.

  5. Verify the resulting sample set in the preview.

  6. Name the sample , or leave the default naming.

Example Sample Sets

You can copy paste these examples for simulating and testing Pipelines.

JSON with an Array

JSON
Copy

NDJSON

JSON
Copy
Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard
  Last updated on Apr 25, 2024
Next to read:
Simulate and Test Pipeline Data Streams
On This Page
View and Sample Pipeline DataView Pipeline DataSample Pipeline DataCreate Samples in a PipelineExample Sample SetsJSON with an ArrayNDJSON