For AI agents: the complete documentation index is available at https://docs.dataplatform.ovh.net/llms.txt, the full documentation bundle is available at https://docs.dataplatform.ovh.net/llms-full.txt, and this page is available as Markdown at https://docs.dataplatform.ovh.net/dpe-actions-postgresql-to-parquet.md.
  • 🇬🇧 English

    • PostgreSQL to Parquet Action

    You can choose the file format. To create a new action, navigate to the Action tab of the Data Processing Engine (DPE)

    Objective

    The PostgreSQL to Parquet action extracts data from a PostgreSQL database and puts it into a Parquet file in your Project bucket. You can choose the file format.

    Info

    Note: This action supports the functionality to have customised date in the folder name. You can find the tutorial here.

    Configure a PostgreSQL to Parquet action

    To create a new action, navigate to the Action tab of the Data Processing Engine (DPE), click on New Action and select the PostgreSQL to Parquet action.

    Choose a source and a destination

    To set-up the action, start by selecting a source from the list that you have already set-up in the Sources tab of the Lakehouse Manager.

    Choose a source and a destination — Select source

    Then, choose the destination bucket from the list of Project buckets.

    Choose a source and a destination — List buckets

    Destination file

    You will then be prompted to choose the destination folder. If you leave the folder name empty, it will automatically be named as the source name.

    Destination file — Select destination

    Your data will be put into the destination folder in a file named part-1. If your file is too big, it will be split into multiple files named part-1, part-2, part-3 and so on.

    The order of your rows will be preserved in this process. Hence, the first rows will be in the part-1 file and the following rows will be in the part-2 file.

    Info

    Note that this action has its transfer speed optimised for the PostgreSQL source.

    Go further

    If you need training or technical assistance to implement our solutions, contact your sales representative or click on this link to get a quote and ask our Professional Services experts for a custom analysis of your project.

    Ask questions, give your feedback and interact directly with the team building the Data Platform on the dedicated Discord channel.

    If you need support with your OVHcloud services, create a request in our Help Centre.

    Join our community of users.