Connecting Data Sources
This section shows you how to connect your own data sources. If you plan on using the provided sample data, you can just skip this part and jump to the next section where you will learn how to create a data model.
Creating the Connection
To connect your own data sources, press the “Add data source” button () in the main toolbar. Select your corresponding data source type and provide the required connection details. After completing the wizard, the connection to the data source will be established by the Data Virtuality Server. The configuration will persistently be stored in the Data Virtuality Server and the data from the data sources will be available to all users according to their permissions.
Explanation of the wizard fields:
- Alias: This will be the name of the data source to be used in the Data Virtuality Server. You can freely choose it. Please note that only underscores are allowed as separators. Spaces and dashes aren’t accepted.
- Host: The IP address or hostname of the data source. Please ensure that it can be reached from the server’s network as all requests to this data source will originate from the Data Virtuality Server.
- Port: The corresponding port of the data source system.
- Database: The name of the database in the data source system.
- Username / Password: Credentials to connect to the data source system.
- Data Source Parameters: Additional connection parameters related to metadata. These parameters can be used to modify the representation of the data source, for example, to filter certain schemas, show schema names, or import only tables. For further information, please refer to our Documentation, section Data Source Properties – shared by all JDBC Connectors / Data Source Properties specific for DBMS.
importer.schemaPatternis by default set to the database default schema., If you would like to see a schema that is different from the standard, please change this parameter. If you would also like to write to this data source, please add the
- Translator Parameters: Advanced parameters for the data source related to query behavior. This should not be changed in most cases. See section Translator Properties shared by all JDBC Connectors / Translator Properties specific for DBMS.
- JDBC Parameters: Parameters to pass to the underlying driver (here the PostgreSQL JDBC driver), for example
Click “Test Connection” to verify that the connection can be established (optional).
Click “Next” to advance in the wizard and then on “Finish” to let the DV Server create the connection to the data source system.
Adding a data source will populate metadata depending on the data source type which can be divided into two types:
- Automatically read metadata from relational and NoSQL data sources.
- Predefined metadata that comes with the connector, usually for web service data sources.
Note that metadata is being cached internally and it is possible to refresh this cache, either automatically on a schedule or manually in the Data Virtuality Studio. Actual rows from data sources are not being persisted at this point.
Working with the connection
After the connection is created, the data source will be shown in the Data explorer of the Data Virtuality Studio:
You can double click on the connection to see the tables or expand the data source tree to see the tables and procedures of the data source.
In order to generate a query to a certain table, simply double click on it. You can also use the context menu (right-click) on a specific table and query 500 rows or count the number of rows in this table.
In case the metadata changes on the data source system side, you can right-click on the data source in DV Studio and click “Refresh Metadata”.
This section lists common issues you might encounter when connecting your data source(s).
|I get an error message that mentions a timeout.||This is usually a network problem. Please make sure the data source system accepts incoming connections from the DV Server. Consult your network administrator if you are not sure about this.|
|I don’t see any tables or I don’t see the tables I am looking for.||Check the schema settings in the “Data Source Parameters” of the connection wizard. You might have connected to a different schema than the one containing your tables.|
|Connecting the data source takes unexpectedly long.||This might happen when too much metadata must be loaded. You might want to try to reduce the number of tables to load by using a schema filter or table name filter under “Data Source Parameters” of the connection wizard.|