Tables from a data source can be scheduled for profiling by configuring the data source.
Profiling large assets or data sets instantaneously could be time-consuming. Auto profiling is important because it saves you a lot of time. Once a data source is configured for auto profiling, you will always be able to view the most recently updated data on the asset details page.
To configure a cron based profiling job for a data source, follow the given procedure.
Navigate to the Settings tab from the left navigation menu bar. The Settings page is displayed.
Click Auto Profile from the left menu bar. The Data Source Auto Profiling page is displayed. ![auto profile](/assets/auto profile.png)
Click Add Configuration. The Create Auto Profile Config wizard is displayed.
Fill in the following properties
Field Name Description Select Data Source From the drop-down list, select a data source to configure and start auto profiling. Execution Schedule Select one of the following time tags: Minute, Hour, Day, Week, Month, and Year. Include Tables Write a comma-separated regex query to include the tables that need to be auto profiled. Exclude Tables Write a comma-separated regex query to exclude the tables from being auto profiled. Show Assets On including or excluding tables, click show assets to view the assets that belong to the tables. Parallelization Count Parallelization count allows you to select a number of tables that can be auto profiled simultaneously.
Click the toggle button to enable or disable the configuration.
Once a data source is configured, it is displayed in a table along with the below properties:
|Data Source||Name of the data source that was configured.|
|Scheduled||Time that was scheduled for the cron job.|
|Parallelization Count||Number of tables selected for parallelization.|
|Enabled||for disabled and for enabled.|
|Created At||Date and time at which the configuration happened.|
|Updated At||Date and time at which the configuration was last updated.|
To delete a configuration, follow the given procedure:
- Click the three vertical ellipsis icon .
- Click Delete. A confirmation dialog box is displayed.
- Click Ok.
To edit a configuration, follow the given procedure:
- Click the name of a data source from the data source auto profile configuration page or click the three vertical ellipsis icon and click Edit .
- The Edit Auto Profile Configuration wizard is displayed.
- Make your changes to the configuration.
- Click Save.