Conversing with Data: Transforming Text into SQL Queries and Visual Curves

Description

Conversational Data Retrieval and Visualization Workflow

This workflow enables users to interact with a PostgreSQL database using natural language. It translates text inputs into SQL queries, retrieves the corresponding data, and generates visualizations using QuickChart, facilitating seamless data analysis without manual query writing.

Table of Contents

Pre-conditions and Requirements
Database Schema Setup
Step-by-Step Workflow Explanation
Customization Guide

Pre-conditions and Requirements

1. API Keys and Services Required

To operate this workflow, access to the following services is necessary:

DeepSeek API**: For converting natural language into SQL queries.
API Key: Obtain from your DeepSeek account.
QuickChart**: For generating data visualizations.
Service URL: https://quickchart.io/chart

2. n8n Instance Setup

n8n Installation**: Install and run n8n using the Official Guide.
Credential Configuration**:
DeepSeek API: Set up DeepSeek credentials in n8n by adding your API key.
PostgreSQL Database:
Local Database Access: If your PostgreSQL database is hosted locally and needs to be accessed over the internet (e.g., by n8n running on a different machine or in the cloud), you can expose it using ngrok:
Install ngrok: Download and install ngrok from ngrok.com.
Start ngrok Tunnel: Run the command ngrok tcp 5432 to expose your local PostgreSQL server.
This will provide a forwarding address like tcp://0.tcp.ngrok.io:12345 that can be used to connect to your local database remotely.
Update n8n Credentials: In n8n, configure the PostgreSQL node to use the ngrok forwarding address, ensuring remote access to your local database.

Database Schema Setup

Before initiating the workflow, ensure that the database schema is extracted and saved:

Extract Schema: Retrieve the database schema, including table names and column details.
Save Schema: Store the extracted schema in a JSON file for reference during query generation.

Step-by-Step Workflow Explanation

User Input Handling
The workflow begins by receiving a natural language query from the user.

Schema Retrieval
Loads the previously saved database schema from the JSON file.

AI-Based SQL Generation
Combines the user's query with the database schema.
Utilizes the DeepSeek API to translate the natural language query into a SQL statement.

SQL Query Execution
Executes the generated SQL query against the PostgreSQL database.
Retrieves the data corresponding to the query.

Data Visualization
Formats the retrieved data into a structure compatible with QuickChart.
Sends the data to QuickChart to generate a visual representation.
Example: To create a bar chart, construct a URL with the chart configuration:
https://quickchart.io/chart?c={type:'bar',data:{labels:['Label1','Label2'],datasets:[{label:'Dataset1',data:[10,20]}]}}
This URL returns an image of the chart.

Response Delivery
Presents the generated visualizations and data insights to the user.

Customization Guide

Modifying the AI Model

Alternative AI Services**: Replace DeepSeek with other AI models by adjusting the API call configurations in the workflow.

Changing Visualization Services

Visualization Tools**: Swap QuickChart with other visualization services by modifying the data processing and visualization steps.

Expanding Database Support

Additional Databases**: Adapt the workflow to support other databases (e.g., MySQL, MongoDB) by configuring the respective database credentials and query execution nodes.

This workflow streamlines the process of data retrieval and visualization, allowing users to interact with their database using natural language, thereby enhancing accessibility and efficiency in data analysis.