SQL to Lineage Flow

Learn how to import your assets and set up your project in Datascale. Follow these simple steps to get started.

Create a new space & project

Spaces help you organize projects by team, department, or any logical separation that makes sense for your organization.

1. Click on the “New Space” in the top navigation

2. Create a new project within this space to start tracking your data assets

Create a new import

Once your project is set up, navigate to your newly created project and click on the “New Import” button. This will open the import wizard to guide you through the process

Set up source

We support various import types including databases in DDL, schema in YML, and documentations in Markdown.

Import assets

Paste the scripts you want to track and analyze.

Processing

Datascale will now analyze your source to build the dependency graph and embedding vector for search. This automated process includes:

1. Metadata extraction from your source

2. SQL query parsing (for database import type) to identify relationships between data assets

3. Dependency mapping to create a comprehensive lineage graph

4. Computing embedding vector for search

Explore your lineage

After processing completes, you can explore the relationships between your data assets in an interactive lineage graph. 🎉 This visualization helps you understand:

• How data flows through your organization

• Where critical dependencies exist

• Potential impact areas when making changes

• Root causes of data quality issues

Navigate the graph by clicking on nodes to explore upstream and downstream connections, and search for specific assets.

Next steps

Now that you’ve set up your project and imported your first assets, here are some ways to get more value from Datascale: