Connectors

A Connector provides Publisher with a uniform interface to files and/or tables that are held in some external storage system.

In particular, a Connector must:

  • Provide an HTML user interface for configuring the external connection

    • Store encrypted credentials to the external system (eg. a service account or dedicated user account)

    • Generate an audit trail for configuration changes

  • Respond to requests about the attached data:

    • List files (with current file metadata such as size, checksums, create/update dates, etc.)

    • Generate time-limited signed URLs for retrieving files

    • List tables (with current metadata such as column names & types, row count, etc.)

    • Dump table data, optionally subsetting columns and rows

    • Generate an audit trail for data access

  • Monitor the external system for changes to the attached data

    • Notify Publisher of changes

  • Log each access to the external system with a purpose and a success/fail flag

Connector Types

Publisher comes with a number of Connectors developed by DNAstack. It is possible for third-party developers to create Connectors to additional Data Sources. To learn how to develop a new Connector, follow Data Source Connector Developer Guide.

Last updated

© DNAstack. All rights reserved.