# LakeXpress Documentation > An efficient database-to-Parquet export tool with multi-cloud object storage support. Export from PostgreSQL, SQL Server, MySQL, Oracle to S3, Azure, GCS, OneLake, Snowflake, Databricks, and more. ## 0.3 Fast database-to-Parquet export tool with multi-cloud object storage support. - [LakeXpress](/0.3.md): Fast database-to-Parquet export tool with multi-cloud object storage support. ### advanced - [Export Performance](/0.3/advanced/export-performance.md): Configure export methods and parallel processing for high-performance data export. - [Incremental Sync](/0.3/advanced/incremental-sync.md): Sync only changed data using watermark-based incremental exports. - [Examples](/0.3/advanced/incremental/examples.md): Complete step-by-step examples and real-world scenarios for incremental sync. - [Loading Strategies](/0.3/advanced/incremental/loading-strategies.md): Choose between append and upsert strategies for incremental data loading. - [Troubleshooting](/0.3/advanced/incremental/troubleshooting.md): Troubleshoot common incremental sync issues and optimize performance. - [Watermarks](/0.3/advanced/incremental/watermarks.md): Understand watermark tracking, safety lag, querying, and resetting watermarks. ### compatibility Supported databases, storage backends, and publishing targets for LakeXpress. - [Compatibility](/0.3/compatibility.md): Supported databases, storage backends, and publishing targets for LakeXpress. ### configuration - [Database Connections](/0.3/configuration/database-configuration.md): Configure database connections for LakeXpress source databases and the LakeXpress DB. - [DuckDB (LakeXpress DB Only)](/0.3/configuration/databases/duckdb.md): Configure DuckDB as a LakeXpress DB. - [MariaDB](/0.3/configuration/databases/mariadb.md): Configure MariaDB connections for LakeXpress source databases. - [MySQL](/0.3/configuration/databases/mysql.md): Configure MySQL connections for LakeXpress source databases and the LakeXpress DB. - [Oracle](/0.3/configuration/databases/oracle.md): Configure Oracle connections for LakeXpress source databases. - [PostgreSQL](/0.3/configuration/databases/postgresql.md): Configure PostgreSQL connections for LakeXpress source databases and the LakeXpress DB. - [SAP HANA](/0.3/configuration/databases/sap-hana.md): Configure SAP HANA connections for LakeXpress source databases. - [SQL Server](/0.3/configuration/databases/sql-server.md): Configure SQL Server connections for LakeXpress source databases and the LakeXpress DB. - [SQLite (LakeXpress DB Only)](/0.3/configuration/databases/sqlite.md): Configure SQLite as a LakeXpress DB. - [Teradata](/0.3/configuration/databases/teradata.md): Configure Teradata connections for LakeXpress source databases. - [Azure Storage](/0.3/configuration/storage/azure.md): Configure Azure Data Lake Storage Gen2 and Blob Storage for LakeXpress exports. - [Google Cloud Storage (GCS)](/0.3/configuration/storage/gcs.md): Configure Google Cloud Storage for LakeXpress Parquet file exports. - [Local Filesystem](/0.3/configuration/storage/local-filesystem.md): Export Parquet files to local directories with LakeXpress. - [Microsoft Fabric OneLake](/0.3/configuration/storage/onelake.md): Configure Microsoft Fabric OneLake storage for LakeXpress Parquet file exports. - [S3-Compatible Storage](/0.3/configuration/storage/s3.md): Configure AWS S3 and S3-compatible storage (MinIO, OVH, etc.) for LakeXpress exports. - [Intermediate Storage](/0.3/configuration/storage/storage-overview.md): Configure local and cloud storage backends for LakeXpress Parquet file exports. ### guides - [Examples & Recipes](/0.3/guides/command-cookbook.md): Tested commands and real-world examples for common LakeXpress scenarios covering exports, publishing, and incremental sync. - [Quick start guide](/0.3/guides/quickstart.md): Get started with LakeXpress in two steps -- create a config and run a sync. ### installation Install LakeXpress on Windows, Linux, or macOS. Download, configure, and start building database-to-lakehouse pipelines quickly. - [Installation](/0.3/installation.md): Install LakeXpress on Windows, Linux, or macOS. Download, configure, and start building database-to-lakehouse pipelines quickly. ### integrations - [BigQuery Publishing](/0.3/integrations/bigquery-publishing.md): Create BigQuery external and native tables from Parquet files stored in Google Cloud Storage. - [BigQuery Reference](/0.3/integrations/bigquery-reference.md): Data type mappings, CLI arguments, querying, and troubleshooting for BigQuery publishing. - [Databricks Publishing](/0.3/integrations/databricks-publishing.md): Create Databricks Unity Catalog external and managed Delta tables from exported Parquet files. - [Databricks Reference](/0.3/integrations/databricks-reference.md): Data type mappings, CLI arguments, querying tables, and Delta features for Databricks publishing. - [ducklake-publishing](/0.3/integrations/ducklake-publishing.md): Publish database exports as DuckLake tables with LakeXpress. Register Parquet files in a DuckLake catalog for SQL queries. - [Microsoft Fabric Publishing](/0.3/integrations/fabric-publishing.md): Create Microsoft Fabric Lakehouse Delta tables and SQL analytics views from exported Parquet files. - [Microsoft Fabric Reference](/0.3/integrations/fabric-reference.md): Data type mappings, querying tables, troubleshooting, and CLI arguments for Fabric publishing. - [AWS Glue Publishing](/0.3/integrations/glue-publishing.md): Create AWS Glue Data Catalog tables from exported Parquet files for use with Athena, Redshift Spectrum, and EMR. - [AWS Glue Reference](/0.3/integrations/glue-reference.md): Data type mappings, CLI arguments, and querying for AWS Glue publishing. - [MotherDuck Publishing](/0.3/integrations/motherduck-publishing.md): Create MotherDuck tables and views from exported Parquet files in S3, GCS, or Azure storage. - [MotherDuck Reference](/0.3/integrations/motherduck-reference.md): Data type mappings, CLI arguments, querying, and troubleshooting for MotherDuck publishing. - [Amazon Redshift Publishing](/0.3/integrations/redshift-publishing.md): Create Amazon Redshift internal and external tables from exported Parquet files using LakeXpress. - [Snowflake Publishing](/0.3/integrations/snowflake-publishing.md): Create Snowflake external and internal tables from exported Parquet files using LakeXpress. - [Snowflake Reference](/0.3/integrations/snowflake-reference.md): Data type mappings, CLI arguments, and deprecated options for Snowflake publishing. ### reference - [CLI Reference](/0.3/reference/cli-reference.md): Complete reference for all LakeXpress commands, options, and configuration parameters. - [Logging and Monitoring](/0.3/reference/logging.md): Database and file-based logging systems for tracking LakeXpress export activity. ### sitemap Complete overview of all LakeXpress documentation pages. - [Sitemap](/0.3/sitemap.md): Complete overview of all LakeXpress documentation pages. ### wizard Build your LakeXpress command interactively. - [Command Wizard](/0.3/wizard.md): Build your LakeXpress command interactively. ## latest Fast database-to-Parquet export tool with multi-cloud object storage support. - [LakeXpress](/latest.md): Fast database-to-Parquet export tool with multi-cloud object storage support. ### advanced - [Export Performance](/latest/advanced/export-performance.md): Configure export methods and parallel processing for high-performance data export. - [Incremental Sync](/latest/advanced/incremental-sync.md): Sync only changed data using watermark-based incremental exports. - [Loading Strategies](/latest/advanced/incremental/loading-strategies.md): Choose between the append, upsert and delete_insert strategies for incremental data loading. - [Troubleshooting](/latest/advanced/incremental/troubleshooting.md): Troubleshoot common incremental sync issues and optimize performance. - [Watermarks](/latest/advanced/incremental/watermarks.md): Understand watermark tracking, late-arriving data, safety lag, querying, and resetting watermarks. ### ai - [LakeXpress Agent Skill](/latest/ai/agent-skills.md): Install the official arpe.io agent skill that teaches Claude Code, Codex, Cursor, Copilot and other AI agents to build correct LakeXpress command lines - [LakeXpress MCP Server](/latest/ai/mcp-server.md): Connect Claude, ChatGPT, Cursor, VS Code and other AI assistants to the arpe.io MCP server to build, check and run LakeXpress commands ### cli LakeXpress commands, the options they share, and license resolution. - [CLI Reference](/latest/cli.md): LakeXpress commands, the options they share, and license resolution. - [cleanup](/latest/cli/cleanup.md): Remove stale or failed runs of a LakeXpress sync configuration. - [config](/latest/cli/config.md): Create, list and delete LakeXpress sync configurations. - [lxdb](/latest/cli/lxdb.md): Initialize, empty, drop and unlock the LakeXpress DB. - [run](/latest/cli/run.md): Run a LakeXpress export from a legacy YAML configuration file. - [status](/latest/cli/status.md): Show the runs of a LakeXpress sync configuration and their status. - [sync](/latest/cli/sync.md): Run a LakeXpress sync configuration, or only its export or publish step. ### configuration - [Database Connections](/latest/configuration/database-configuration.md): Configure database connections for LakeXpress source databases and the LakeXpress DB. - [MariaDB](/latest/configuration/databases/mariadb.md): Configure MariaDB connections for LakeXpress source databases. - [MySQL](/latest/configuration/databases/mysql.md): Configure a MySQL source database for LakeXpress. - [Oracle](/latest/configuration/databases/oracle.md): Configure Oracle connections for LakeXpress source databases. - [PostgreSQL](/latest/configuration/databases/postgresql.md): Configure a PostgreSQL source database for LakeXpress. - [SAP HANA](/latest/configuration/databases/sap-hana.md): Configure SAP HANA connections for LakeXpress source databases. - [SQL Server](/latest/configuration/databases/sql-server.md): Configure a SQL Server source database for LakeXpress. - [Teradata](/latest/configuration/databases/teradata.md): Configure Teradata connections for LakeXpress source databases. - [Azure Storage](/latest/configuration/storage/azure.md): Configure Azure Data Lake Storage Gen2 and Blob Storage for LakeXpress exports. - [Google Cloud Storage (GCS)](/latest/configuration/storage/gcs.md): Configure Google Cloud Storage for LakeXpress Parquet file exports. - [Local Filesystem](/latest/configuration/storage/local-filesystem.md): Export Parquet files to local directories with LakeXpress. - [Microsoft Fabric OneLake](/latest/configuration/storage/onelake.md): Configure Microsoft Fabric OneLake storage for LakeXpress Parquet file exports. - [S3-Compatible Storage](/latest/configuration/storage/s3.md): Configure AWS S3 and S3-compatible storage (MinIO, OVH, etc.) for LakeXpress exports. - [Intermediate Storage](/latest/configuration/storage/storage-overview.md): Configure local and cloud storage backends for LakeXpress Parquet file exports. ### guides - [Examples & Recipes](/latest/guides/command-cookbook.md): Tested commands and real-world examples for common LakeXpress scenarios covering exports, publishing, and incremental sync. - [Quick start guide](/latest/guides/quickstart.md): Your first LakeXpress export -- from a PostgreSQL database to Parquet files on local disk. - [Azure Storage Exports](/latest/guides/recipes/azure.md): Export tables to Parquet files on Azure Blob Storage and ADLS Gen2. - [BigQuery Publishing](/latest/guides/recipes/bigquery.md): Export to cloud storage and publish the tables to BigQuery. - [Configuration Management](/latest/guides/recipes/configuration-management.md): Create, list and delete sync configurations, check their status, and run legacy YAML files. - [Databricks Publishing](/latest/guides/recipes/databricks.md): Export to cloud storage and publish the tables to Databricks Unity Catalog. - [DuckLake Publishing](/latest/guides/recipes/ducklake.md): Export to cloud storage and publish the tables to DuckLake. - [Microsoft Fabric Publishing](/latest/guides/recipes/fabric.md): Export to OneLake and publish the tables to Microsoft Fabric. - [Google Cloud Storage Exports](/latest/guides/recipes/gcs.md): Export tables to Parquet files on Google Cloud Storage. - [AWS Glue Publishing](/latest/guides/recipes/glue.md): Export to S3 and register the tables in the AWS Glue Data Catalog. - [Incremental Sync](/latest/guides/recipes/incremental-sync.md): Export only new or changed rows on each sync, with watermark columns. - [LakeXpress DB Commands](/latest/guides/recipes/lakexpress-db.md): Initialize, empty, drop and unlock the LakeXpress DB, for each supported backend. - [Local Exports](/latest/guides/recipes/local-exports.md): Export PostgreSQL, SQL Server, MySQL, MariaDB and Teradata tables to Parquet files on local disk. - [MotherDuck Publishing](/latest/guides/recipes/motherduck.md): Export to cloud storage and publish the tables to MotherDuck. - [OneLake Exports](/latest/guides/recipes/onelake.md): Export tables to Parquet files on Microsoft OneLake. - [Amazon Redshift Publishing](/latest/guides/recipes/redshift.md): Export to cloud storage and publish the tables to Amazon Redshift. - [Resume Failed Exports](/latest/guides/recipes/resume-failed-exports.md): Retry only the tables that failed in a previous run. - [AWS S3 Exports](/latest/guides/recipes/s3.md): Export tables to Parquet files on AWS S3 and S3-compatible storage. - [Snowflake Publishing](/latest/guides/recipes/snowflake.md): Export to cloud storage and publish the tables to Snowflake, as external or internal tables. - [Table Filtering](/latest/guides/recipes/table-filtering.md): Select which tables to export with include and exclude patterns. ### installation Install LakeXpress on Windows or Linux. Download, configure, and start building database-to-lakehouse pipelines quickly. - [Installation](/latest/installation.md): Install LakeXpress on Windows or Linux. Download, configure, and start building database-to-lakehouse pipelines quickly. ### integrations - [BigQuery Publishing](/latest/integrations/bigquery-publishing.md): Create BigQuery external and native tables from Parquet files stored in Google Cloud Storage. - [BigQuery Reference](/latest/integrations/bigquery-reference.md): Data type mappings, CLI arguments, querying, and troubleshooting for BigQuery publishing. - [Databricks Publishing](/latest/integrations/databricks-publishing.md): Create Databricks Unity Catalog external and managed Delta tables from exported Parquet files. - [Databricks Reference](/latest/integrations/databricks-reference.md): Data type mappings, CLI arguments, querying tables, and Delta features for Databricks publishing. - [DuckLake Publishing](/latest/integrations/ducklake-publishing.md): Publish database exports as DuckLake tables with LakeXpress. Register Parquet files in a DuckLake catalog for SQL queries. - [Microsoft Fabric Publishing](/latest/integrations/fabric-publishing.md): Create Microsoft Fabric Lakehouse Delta tables and SQL analytics views from exported Parquet files. - [Microsoft Fabric Reference](/latest/integrations/fabric-reference.md): Data type mappings, querying tables, troubleshooting, and CLI arguments for Fabric publishing. - [AWS Glue Publishing](/latest/integrations/glue-publishing.md): Create AWS Glue Data Catalog tables from exported Parquet files for use with Athena, Redshift Spectrum, and EMR. - [AWS Glue Reference](/latest/integrations/glue-reference.md): Data type mappings, CLI arguments, and querying for AWS Glue publishing. - [MotherDuck Publishing](/latest/integrations/motherduck-publishing.md): Create MotherDuck tables and views from exported Parquet files in S3, GCS, or Azure storage. - [MotherDuck Reference](/latest/integrations/motherduck-reference.md): Data type mappings, CLI arguments, querying, and troubleshooting for MotherDuck publishing. - [Amazon Redshift Publishing](/latest/integrations/redshift-publishing.md): Create Amazon Redshift internal and external tables from exported Parquet files using LakeXpress. - [Amazon Redshift Reference](/latest/integrations/redshift-reference.md): Data type mappings, CLI arguments, and querying for Amazon Redshift publishing. - [Snowflake Publishing](/latest/integrations/snowflake-publishing.md): Create Snowflake external and internal tables from exported Parquet files using LakeXpress. - [Snowflake Reference](/latest/integrations/snowflake-reference.md): Data type mappings, CLI arguments, and deprecated options for Snowflake publishing. ### lakexpress-db Create the LakeXpress DB, the database where LakeXpress stores its sync configurations and run history. - [Set up the LakeXpress DB](/latest/lakexpress-db.md): Create the LakeXpress DB, the database where LakeXpress stores its sync configurations and run history. - [DuckDB as LakeXpress DB](/latest/lakexpress-db/duckdb.md): Use a DuckDB file as the LakeXpress DB. - [MySQL as LakeXpress DB](/latest/lakexpress-db/mysql.md): Create a MySQL database to use as the LakeXpress DB. - [PostgreSQL as LakeXpress DB](/latest/lakexpress-db/postgresql.md): Create a PostgreSQL database to use as the LakeXpress DB. - [SQL Server as LakeXpress DB](/latest/lakexpress-db/sql-server.md): Create a SQL Server database to use as the LakeXpress DB. - [SQLite as LakeXpress DB](/latest/lakexpress-db/sqlite.md): Use a SQLite file as the LakeXpress DB. ### reference - [CLI Commands](/latest/reference/cli-commands.md): Every LakeXpress command on one page, with a link to its reference. - [Compatibility](/latest/reference/compatibility.md): Supported databases, storage backends, and publishing targets for LakeXpress. - [Exit Codes](/latest/reference/exit-codes.md): Process exit codes returned by LakeXpress, for schedulers and scripts. - [Logging and Monitoring](/latest/reference/logging.md): Database and file-based logging systems for tracking LakeXpress export activity. ### sitemap Complete overview of all LakeXpress documentation pages. - [Sitemap](/latest/sitemap.md): Complete overview of all LakeXpress documentation pages. ### wizard Build your LakeXpress command interactively. - [Command Wizard](/latest/wizard.md): Build your LakeXpress command interactively.