The RDB via Snapshot Connector can be configured using the Aspire Admin UI. It requires the following entities to be created:
Bellow are the examples of how to create the Credential, Connection and the Seed. For the Connector please check this page.
Easy Heading Free | ||||
---|---|---|---|---|
|
Note: we are not going to use this credential, we will use SA instead, creating this because credential is required in connection config)
Image Added
Image Removed
An RDBMS "URL" is needed to tell the connector application what database to crawl. The exact form of this URL is dictated by the JDBC driver and therefore the database vendor, but will be of the form
jdbc:<vendor>://<server>:<port>/{DATABASE}
For example: jdbc:mysql://192.168.40.27/{DATABASE} - the marker {DATABASE} will be replaced with the value of Database name field (see Create Seed section on this page)
See your database vendor's documentation for more information on JDBC URLs.
Note - {DATABASE} value will be read from seed "Database name" field.
JDBC Driver Jar /home/dliu/projects/dmp/baseline/assets/aspire-distribution-archetype-5.0.4-distribution/drivers/GoogleBigQueryJDBC42.jar
Specify Classpath /home/dliu/projects/dmp/bigquery-lib
The description of all "connection" fields can be found here.
Note: The JDBC driver class can be found in attachments - bigquery-lib.zip
Image Added
Image Removed
Full SQL: SELECT object_type, object_name, parent_object_name, access_id, access_type, access_role, status, environment, processed_time, expiration_dttm FROM `prd-65343-datalake-bd-88394358`.dp_resources_datamng_65343_in.dp_data_products_access WHERE processed_date='2022-12-16' and access_type='security_group' and status='enabled' and environment = 'PRD' and object_type = 'power_bi'
The description of all "seed" fields can be found here.
Image Removed
Image Added