Connectors
Last updated
Was this helpful?
Last updated
Was this helpful?
A Connector enables to interface with various external storage systems. They provide standardized access to files and tables while managing authentication, monitoring, and data access functionality.
A Connector must fulfill these requirements:
Provide an HTML user interface for configuring external connections
Store encrypted credentials for external systems (e.g., service accounts or dedicated user accounts)
Generate an audit trail for configuration changes
Respond to requests about attached data by:
Listing files with current metadata (size, checksums, create/update dates)
Generating time-limited signed URLs for file retrieval
Listing tables with current metadata (column names & types, row count)
Dumping table data with optional column and row subsetting
Generating an audit trail for data access
Monitor external systems for data changes
Notify Publisher of changes
Log all external system access, including purpose and success/fail status