Delivery & Formats

​

Delivery Methods

​

Cloud Storage

• Amazon S3: Direct delivery to your S3 bucket
• Google Cloud Storage: Delivery to your Google Cloud Storage bucket
• Azure Blob Storage: Delivery to your Azure Blob Storage container

​

Secure File Transfer (SFTP)

• Secure, encrypted transfer
• Automated delivery scheduling
• Compatible with all standard SFTP clients

​

File Formats

​

CSV

• Easy to import into spreadsheets and databases
• Flat structure (nested data flattened)
• Compatible with Excel, Google Sheets, and all major databases

​

JSON

• Preserves nested object structure
• Arrays maintained as arrays
• Human-readable format

​

Parquet

• Optimized for analytics and data warehouses
• Efficient compression
• Schema embedded in file

​

Delta

• Schema enforcement
• Built on Parquet
• Native support in Databricks, Spark, and other lakehouse platforms

​

Update Frequency

​

Monthly Refreshes

​

Data Organization

​

Versioning

• build_version field in each record (schema version)

​

Integration Examples

​

Loading into Database

COPY data_legion FROM '/path/to/data.csv' WITH (FORMAT csv, HEADER true);

LOAD DATA INTO `project.dataset.data_legion`
FROM FILES (format='PARQUET', uris=['gs://bucket/data-legion-*.parquet']);

​

Processing with Python

import pandas as pd
df = pd.read_csv('data-legion.csv')

import json
with open('data-legion.jsonl') as f:
    for line in f:
        record = json.loads(line)

import pandas as pd
df = pd.read_parquet('data-legion.parquet')

from deltalake import DeltaTable
dt = DeltaTable('data-legion-delta/')
df = dt.to_pandas()

​

Related Documentation

• Quickstart - Get started guide
• Person Schema - Person data structure
• Company Schema - Company data structure
• Get Sample Data - Get a sample dataset