Ingestion

The Ingestion app allows you to explicitly review and manage data point ingestion into Obcerv.

As of Obcerv 2.0.0, all data points require a configuration defining the order of their dimensions. Dimensions are the ordered names and values within a data point that uniquely identify the data point’s entity.

Obcerv ships with known dimensions already configured (see Resolved data points) – all Geneos and internal data (Kubernetes) are configured out-of-the-box.

Dropped data points Copied

Note

Only users with admin privileges can configure dimensions.

Any unknown dimension is listed in the Dropped tab. These data points are not processed by Obcerv. If you wish to see this data, you must configure the order of dimensions.

To configure the order of unknown dimension keys, click the Order icon in the right-most column. This opens the Order dimension keys dialog, where you can drag the keys into the desired order.

Note

To see a full JSON example of the data point, click Sample.

The dimensions are ordered by hierarchy groups so that you can configure these at the same time. For example, if the following dimensions are listed:

[a][b]
[a][b][c]
[a][b][c][d]

Then configuring the order of [a][b] will also allow you to configure the other dimensions with common keys. It is important that hierarchies are configured following a consistent key order.

Once you have configured one or more dimension keys, the checkbox for the item will be selected in the list. To save the changes, click Configure.

After saving your changes, the configured dimensions are moved from the Dropped tab to the Resolved tab.

Resolved data points Copied

There are two sections for resolved dimensions: Configured and Read only.

Configured Copied

These are the dimensions that previously appeared in the Dropped tab. If the items have pending status, it means that they have been configured but no new data has arrived matching these dimensions. Non-pending items are fully configured and working as expected.

You can modify the order of dimensions on the list (see Dropped data points).

To remove configured dimensions, select the checkbox for the dimension keys, and then click the Remove button.

Note

Removing dimensions from the data points does not automatically populate them in the Dropped tab. They will only appear if new data is published that uses those exact dimensions, which may be unlikely to happen.

Read only Copied

The Read only tab shows the preconfigured dimensions for known dimension keys. This information is provided for reference only.

Filters Copied

Note

The Filters option is currently in beta.

Filters allow you to exclude certain data points based on some matching rules.

1. From the Filters tab, click the Add button to create a new filter.
2. Choose between Expression or Dimension filter to build your filter.
3. Once the value is set, select one or more options in the Datapoint drop-down list to apply the filter to.
4. Click Save.

To modify or delete a filter, select the checkbox for the filter, and then click Edit or Remove.