File Data Sources

From DMXDeepInsight
Jump to: navigation, search

You can connect to almost any file saved on your computer, anywhere on the web, Google Drive, Dropbox, and Amazon S3. File datasets can be created in two simple steps.

  1. Create connection – This is where you specify connection details.
  2. Configure and save connection – This is where you map datatypes and save dataset.

We support these file formats:

  • Delimited text files (comma (,) separated, tab separated, a semi-colon (;) separated, space separated, pipe (|) separated)
  • Excel Files (.xls and .xlsx)
  • Web Files

FlatFile1.png

Before You Begin

  • Ensure that any file you import conforms to the Data Source Limits.
  • If you are connecting to a file, connection information is not stored in DeepInsight.
  • If you are connecting to Google Drive or Dropbox, connection information is not stored in DeepInsight.
  • If you are connecting to a database, connection information is stored in DeepInsight, so you can create multiple data sets without having to re-configure this data source.
  • If you are connecting using a web data connector, connection information is not stored in DeepInsight.
  • If you are integrating with third-party software, connecting information is not stored in DeepInsight.
  • If the excel file you are importing has multiple sheets, then you are prompted to choose a sheet to import. You cannot select multiple sheets, but you can consolidate data from all sheets and create a single data source. Want to know How? See, Union.
  • DeepInsight imports the file data into a data grid where it automatically identifies the format for the imported data and categorizes it into different datatypes. You can select a different datatype for each column and can also set a different date format.
  • If the user-selected datatype does not conform with DeepInsight datatypes norm, then a null value is inserted in place of the user-defined datatype.
  • If the data import is successful, the dataset color changes to green and you are prompted to create another dataset or create or open a workbook. To perform these actions, you can either click the drop-down arrow next to each column name or open the Map Datatypes dialog.
  • Once the data is imported, you can perform these actions:
    • Data Masking
    • Setting New Data Type
    • Dropping Columns
    • Renaming Columns
    • Adding Header Row

Import Files from My Computer

On the Configure page, Flat File is the default tab. If you are not in this tab, then first click this tab and then follow the instructions below to upload a file.

Step 1: Create Connection

  1. Click Add datasource.png.
  2. Dataset Name. The dataset name cannot have special characters, cases or numbers.
  3. Dataset description is optional.
  4. Character Encoding Type is optional.
  5. Number Format Locale is optional.
  6. Browse and upload the file.
  7. (Applicable only to Excel Files). Select a sheet to import
  8. Add to DeepInsight.

Step 2: Configure & Save

When you import data into DeepInsight, the data imported into a grid. You have two ways of verifying datatype for the imported data.

  • Do you see a drop-down arrow next to each column name? Click it > make your changes > click anywhere on the page to close the drop-down and then save your changes.

-OR-

  1. Click Map Datatypes.
  2. Verify and make corrections to the string attributes > apply changes > save.

Import Files from Google Drive

Step 1: Create Connection

  1. Click Add datasource.png.
  2. Dataset Name. The dataset name cannot have special characters, cases or numbers.
  3. Dataset description is optional.
  4. Character Encoding Type is optional.
  5. Number Format Locale is optional.
  6. Click Google Drive tab and then click Connect.
  7. Choose your account and permit DeepInsight to access your drive.
  8. Select a file > select a sheet > add to DeepInsight.

Step 2: Configure & Save

When you import data into DeepInsight, the data imported into a grid. You have two ways of verifying datatype for the imported data.

  • Do you see a drop-down arrow next to each column name? Click it > make your changes > click anywhere on the page to close the drop-down and then save your changes.

-OR-

  1. Click Map Datatypes.
  2. Verify and make corrections to the string attributes > apply changes > save.

Import Files from Dropbox

Step 1: Create Connection

  1. Click Add datasource.png.
  2. Dataset Name. The dataset name cannot have special characters, cases or numbers.
  3. Dataset description is optional.
  4. Character Encoding Type is optional.
  5. Number Format Locale is optional.
  6. Click Dropbox tab and then click Connect.
  7. Sign in with your Google account or provide your Dropbox login credentials.
  8. Permit DMXDeepInsight to access files and folders uploaded to your Dropbox account.
  9. The next time you import files from Dropbox, you’ll not be prompted to give DeepInsight permission to access Dropbox.
  10. Select a sheet > add to DeepInsight.

Step 2: Configure & Save

When you import data into DeepInsight, the data imported into a grid. You have two ways of verifying datatype for the imported data.

  • Do you see a drop-down arrow next to each column name? Click it > make your changes > click anywhere on the page to close the drop-down and then save your changes.

-OR-

  1. Click Map Datatypes.
  2. Verify and make corrections to the string attributes > apply changes > save.

Import Files from the Web

Step 1: Create Connection

  1. Click Add datasource.png.
  2. Dataset Name. The dataset name cannot have special characters, cases or numbers.
  3. Dataset description is optional.
  4. Character Encoding Type is optional.
  5. Number Format Locale is optional.
  6. Click The Web tab > give the file location on the web > add to DeepInsight.
  7. Select a sheet > add to DeepInsight.

Step 2: Configure & Save

When you import data into DeepInsight, the data imported into a grid. You have two ways of verifying datatype for the imported data.

  • Do you see a drop-down arrow next to each column name? Click it > make your changes > click anywhere on the page to close the drop-down and then save your changes.

-OR-

  1. Click Map Datatypes.
  2. Verify and make corrections to the string attributes > apply changes > save.

Import Files from Amazon S3

Step 1: Create Connection

  1. Click Add datasource.png.
  2. Dataset Name. The dataset name cannot have special characters, cases or numbers.
  3. Dataset description is optional.
  4. Character Encoding Type is optional.
  5. Number Format Locale is optional.
  6. Click Amazon S3 tab > give access key and secret key > connect.
  7. Expand Amazon Data Source > choose your file > add to DeepInsight.
  8. Select a sheet to import > add to DeepInsight.

Step 2: Configure & Save

When you import data into DeepInsight, the data imported into a grid. You have two ways of verifying datatype for the imported data.

  • Do you see a drop-down arrow next to each column name? Click it > make your changes > click anywhere on the page to close the drop-down and then save your changes.

-OR-

  1. Click Map Datatypes.
  2. Verify and make corrections to the string attributes > apply changes > save.