Set Up Your Organization
Onboarding starts with your organization, which you set up when you create your Free Trial account. An organization lets you add members and share reusable pipeline components like Shared Sources and Processor Groups with other members. Onboarding walks you through creating your organization and getting telemetry flowing. See Build Your First Pipeline below for the step-by-step flow.Check out an Example Pipeline
For an example of specialized Pipeline for data optimization, check out the topic Pipeline Example: Kubernetes Telemetry Data OptimizationBuild Your First Pipeline
You don’t have to build a pipeline by hand to get started. Every new organization is auto-provisioned with a first pipeline that wires an OpenTelemetry (OTel) Source to a Mezmo Log Analysis destination. This pipeline, named OTel Ingest, gives your telemetry somewhere to land as soon as you finish onboarding. Onboarding is a short, guided flow:- Name your organization and select Create Organization. Mezmo provisions the organization and the OTel Ingest pipeline.
- Connect your telemetry by choosing Use OpenTelemetry (recommended) or Use another Pipeline source. The auto-provisioned pipeline sends your data to Mezmo Log Analysis, which requires OpenTelemetry data. If you choose another source instead, Mezmo opens the pipeline editor with an empty draft pipeline for you to build. Add the components you need, including a destination, to finish it (see Set Up Pipeline Destinations).
- Choose one of four setup paths for your OpenTelemetry data: a new collector on a host or VM, a new collector installed via Helm chart on Kubernetes, an existing collector with the Mezmo exporter added, or the OpenTelemetry Demo.
otelcol-contrib), Helm chart, and existing-collector setups. You can reach the in-app OpenTelemetry setup instructions anytime from the setup icon in the app header, and those instructions cover all four paths including the OpenTelemetry Demo, so you can still get them if you skipped onboarding.
Pipeline Basics
If you’d rather build a pipeline yourself, or want to understand what the automatic setup created, it helps to know the component model. A Telemetry Pipeline is built from three components:- Sources
- Destinations
- Processors
- Set Up Pipeline Sources and Supported Telemetry Pipeline Sources
- Set Up Pipeline Processors and Supported Processors
- Set Up Pipeline Destinations and Supported Telemetry Data Destinations
With Mezmo Flow
With Mezmo Flow guiding the way, you can set up your first log volume reduction pipeline in minutes! Set up your data source, then let Mezmo Flow profile your data and make recommendations for processors to reduce your log volume by as much as 50%.Add a Data Source
The first step is to set up the Source of your telemetry data. Your options include using the Mezmo Agent, an OpenTelemetry Collector, or Demo Logs You can find a complete list of Supported Telemetry Pipeline Sources in our product documentation.Create a Profile
A Data Profile provides you with an in-depth analysis of the most common types, volume, and sources of your incoming telemetry data. When you set up a Source with Mezmo Flow, you will generate a data profile for that source. When the data profiler completes its analysis, you’ll see charts that provide you with information about the composition of the source logs, the most common message patterns, and a breakdown of log metrics by app, host, level, and log type.Add a Data Destination
All telemetry pipelines terminate in a Destination like an observability tool or a storage location. When you set up a Pipeline using Mezmo Flow, Mezmo Log Analysis is automatically added as a Destination. You can find a complete list of supported Destinations in our product documentation.Add Processors
Once Mezmo Flow has analyzed your data and presented you with a data profile, you have the ability to apply Processors to specific message patterns to reduce the volume of log data you’re sending to your destination.- Select the Processor you want to apply to the log data from the Process Logs menu.
- As you select a Processor, you will see the effect it has on your overall log volume.
- When you’re satisfied with the results, click Apply Processors to Pipeline.
- Mezmo Flow will generate a visualization of your Pipeline, with your selected processors grouped into a Processor Group.
- You can now edit your Pipeline, add or edit the configuration of the components, or set up additional functionality like In-Stream Alerts. Just click Edit Pipeline to get started.
- When you’re finished working on your Pipeline, don’t forget to click Deploy to make the changes active!
Learn with a Tutorial
These tutorials, which include interactive demos, will show you how to build a mini-pipeline, also known as a Pipette, for specific processing functionality. Along the way you’ll learn about best practices like using the Blackhole destination for testing, using Pipeline Tap to view the changes in data as it passes along the Processor chain, and using Simulationn Mode to test the end-to-end processing of your data.View and Analyze Telemetry Data
Once you’ve set up your telemetry data pipeline with a Mezmo Log Analysis Destination, you can use the log viewing and search functionality to take a deep dive into your optimized data.Create Alerts
One of the most important features of a telemetry data platform is its ability to notify you of critical system conditions in a timely way. With most observability tools, alerts are sent only after the data has been indexed and analyzed, which can have a significant negative impact on your ability to respond. With the Mezmo Platform, you can set alerts not only for the volume of data being indexed, as well as specific views, you can also set alert conditions for any data stream in your telemetry pipeline, which will alert you within milliseconds of the event occurring, rather than after it has been indexed.- Create Index Rate Alerts
- Add Alerts to Views
- Create Usage Alerts
- Set Threshold Alerts for Pipeline Data Volume
- Set In-Stream Alerts for Pipeline Nodes

