Asset Details

A data catalog is an inventory of data assets in an organization. To view the details of any data asset, navigate to the Discover page. Search for the asset with the help of the search bar and filter options, and click the asset in the asset panel. The Asset Details page is displayed.

Types of Assets

Based on the type of asset selected, the details of the asset provided varies.

asset_types

Below is a description of the details provided for the following asset types: Database and Table. Similarly, based on the type of asset selected, different tabs with relevant data are displayed.

Database

The following tabs in the Asset Details page of a database are manifested:

  1. Related Assets: The Related Assets tab displays a flow chart with all the tables belonging to the database. You can click on the table name to view its details.

    Asset details

  2. Schema Changes: The Schema Changes tab displays a panel with all the snapshots that are taken every time a crawler runs. Select exactly two snapshots for comparison. schema changes

    To show only the differences between the two executions, click the Show Only Differences toggle icon. schema change differences

  3. Overview: The Overview tab provides you with the description, metadata, and label info for the selected database. Database Overview tab

  • You can edit the description by clicking the edit icon.
  • To add labels, click the plus icon and enter the required values.edit labels

Table

The following tabs in the Asset Details page of a table are manifested:

Profile

Asset profiling helps to identify data quality issues in data sources. The profiling tab displays the below information about the assets profiled within the selected table.

  • Current Profile: Displays the following information about the profiled table for a selected date and time.

    Property NameDefinitionExample
    Current Rows ProfiledNumber of rows profiled.1001
    Total Rows ProfiledTotal number of rows profiled1500
    Profiling TypeFull or Sample type of asset profiling?Full or Sample
    StatusDefines whether the asset was successfully, or unsuccessfully profiled.Successful, or Failed
    Start TimeDefines the date and time at which the profiling of the asset started.2020-06-11 14:15:00
    End TimeDefines the date and time at which the profiling had ended.2020-06-11 14:15:17
  • Click the Profiled At button and select a date and time to view that day's profile information for the selected table.

  • Compare Profiles: This tab allows you to compare the current profiled data of an asset with previously profiled data.

Profile Now

Click Profile Now and select Sample Profile or Full Profile from the drop-down list to profile the asset accordingly.

Schedule Profile

  1. Click Schedule Profile from the drop-down list to schedule the profiling of an asset. The Profile Schedular wizard is displayed.

  2. Select one of the following profiling types from the Profiling Type drop-down list.

    Profiling TypeDescription
    SampleProfiles the first 100 columns in the table.
    FullProfiles all the columns in the table.
    IncrementalIncremental profile uses a monotonically increasing date column to determine the bounds for selecting data from the data source
  3. Based on the profiling type selected, specify values for the required properties. For Sample and Full profile select a schedule. For Incremental type, do the following:

    • Select one of the following incremental strategies and specify required values accordingly.
      • Auto Increment Id based
        The incremental profile uses a monotonically increasing value of a column to determine the bounds for selecting data from the data source.
      • Partition based
        The incremental profile uses a date-based partition column to determine the bounds for selecting data from the data source. Only useful if the data source supports partition.
      • Incremental Strategy
        The incremental profile uses a monotonically increasing date column to determine the bounds for selecting data from the data source.
    • Select a column name from the Date Column list.
    • Specify a date format.
    • Click Advanced to use the following advanced fields: Time Zone and Minute Offset.
    • Click the Round End Date checkbox and select a frequency.
    • Select a time tag to incrementally run the profile schedule for the asset.
    • Click the toggle button to enable the configuration.
    • Click Save Schedule.

Quality

The Quality tab provides you with information on the quality of your data.

Execution DetailsDescription
StartExecution start time
EndExecution end time
ConfiguredNumber of evaluations configured
PassedNumber of evaluations passed
ScannedNumber of evaluations scanned
FailedNumber of evaluations failed
StatusStatus of execution i.e whether it failed or passed
Quality ScorePercentage value of the data quality

execution details


Execution Summary: The Execution Summary panel provides you with an overall summary of the execution status.

execution summary


Data Violations: The Data Violations panel displays a sample of the data attributed to the failure of the policy.

Sample Data

Click the Sample Data tab to view how the asset (table) would typically look like. You can filter the data according to the Column Data Type and Column Names. Click to minimize the filter panel.

sample data

Failed Policies

To view the details of a failed policy, click the Failed tab and click the policy name from the Policies panel. The following details are displayed in the Quality tab window:

Property NameDescription
NameName of the failed policy
DescriptionDescription that was provided while creating the policy.
Start TimePolicy execution start time
End TimePolicy execution end time
StatusExecution status whether failed or success
Failure ReasonDescription for why the policy failed

failed policy details


Click View Past Executions to view executions that have been executed in the past. The Data Quality/Executions page is displayed.

Successful Policies

To view the details of a successful policy, click the Success tab and policy name from the Policies panel. The following details are displayed in the Quality tab window:

PropertiesDescription
NameName of the policy. Click to go to the policy definition.
StatusShows if the policy has succeeded or failed
Quality ScoreShows the data quality score of the underlying asset.
DescriptionDescription about the policy
Total rows scannedSum of rows scanned during execution
Total rows failedSum of rows that did not scan during execution
Rule passed/ Total rulesNumber of rules passed by the total number of rules
Start TimeDate and time at which the execution of the policy began
End TimeDate and time at which the execution of the policy ended

You can also view the following details of the rules defined while creating the policy:

Property NameDescription
Column NameName of the column that was selected while applying the rule definition
ExpressionExpression value
StatusSuccess or failed
Success PercentageSuccess percentage value
DescriptionDescribes the total success percentage along with the expected threshold percentage if execution failed.

successful policy details

Related Assets

All the columns that exist in the table are displayed in the Related Assets tab. Click the column name to further view the details of the selected column. Use the plus, minus, and reset button to zoom in and zoom out from the flow chart.

child assets

Schema Changes

Schema Changes: The Schema Changes tab displays a panel with all the snapshots that are taken every time a crawler runs. Select exactly two snapshots for comparison.

schema changes

To show only the differences between the two executions, click the Show Only Differences toggle icon.

schema change differences

Overview

The Overview tab provides you with the following information about the table:

  1. Descriptions: This is the description that was provided by you while creating the asset. If a description doesn't exist for the asset, click the Add button to add one.
  2. Metadata: Displays the metadata of the asset.
  3. Labels: Displays a table with the existing labels. You can edit the labels by clicking the edit icon. If there are no existing labels, you can add a label by clicking the plus icon.